AR Sculpture
How did I make my first 3D sculpture for AR?
using neural networks
3d скульптура космонавт
In August 2022, I was lucky enough to join the art lab and become an alpha tester for the Phygital Plus app.
This is an online service that allows you to work with neural networks without knowing the code and any technical nuances. Very convenient, intuitive and there is no intimidating Google Collab interface.
As part of the laboratory, we were preparing a project for ARTLIFE FEST 2022. Each participant got a random picture, for which they had to create a 3D sculpture.
I got a painting by Nastya Miro "Houston, we have problems."
We didn't have to literally translate the artist's intent into 3D. The task was to convey the feeling, mood, my associations from the picture.
So I created my first 3D sculpture.
Below I will share the algorithm of all actions.
This is an online service that allows you to work with neural networks without knowing the code and any technical nuances. Very convenient, intuitive and there is no intimidating Google Collab interface.
As part of the laboratory, we were preparing a project for ARTLIFE FEST 2022. Each participant got a random picture, for which they had to create a 3D sculpture.
I got a painting by Nastya Miro "Houston, we have problems."
We didn't have to literally translate the artist's intent into 3D. The task was to convey the feeling, mood, my associations from the picture.
So I created my first 3D sculpture.
Below I will share the algorithm of all actions.
My pipeline.
What was done?
What was done?
1) Neural networks allow you to quickly find interesting references.
I created them with Midjourney and Stable Diffusion.
I created them with Midjourney and Stable Diffusion.
2) Then I took out my Oculus Quest 2 VR helmet and there I tried to create 3D flowers and plants based on the generated references.
For sculpting flowers, I chose the SculptrVR application. I had no experience in creating 3d before, I chose the most intuitive application.
3) I downloaded the 3D sculpture of an astronaut from the site https://sketchfab.com/
and colored it in Procreate.
4) Then I imported both files into Blender.
For sculpting flowers, I chose the SculptrVR application. I had no experience in creating 3d before, I chose the most intuitive application.
3) I downloaded the 3D sculpture of an astronaut from the site https://sketchfab.com/
and colored it in Procreate.
4) Then I imported both files into Blender.
5) with the help of stable diffusion, the texture of the planet was generated
6) animation of the astronaut in Mixamo. This site is my discovery!
With a mouse click, you can put your character in any position or animate it (bone animation)
6) animation of the astronaut in Mixamo. This site is my discovery!
With a mouse click, you can put your character in any position or animate it (bone animation)
7) As a result, everything was collected and brought to the ideal in Blender. To demonstrate in AR, I used the ARHead service.
By clicking on this link from your phone, you can look at my sculpture in augmented reality - https://app.arhead.io/V3_BVYkr
By clicking on this link from your phone, you can look at my sculpture in augmented reality - https://app.arhead.io/V3_BVYkr
Видео пайплайн
Видео процесс создания 3д скульптуры для дополненной реальности
It was my first 3d experience and I'm very proud that my work was presented at the Art Life Fest exhibition.
I am grateful to the Phygital Plus team that they not only provided us with access to their cool service, but also supported us and taught us how to work with neural networks and 3D.
I was so inspired by this story that I continued to experiment with neural networks and 3D.
Follow me on social networks (links below)
I am grateful to the Phygital Plus team that they not only provided us with access to their cool service, but also supported us and taught us how to work with neural networks and 3D.
I was so inspired by this story that I continued to experiment with neural networks and 3D.
Follow me on social networks (links below)
You might be interested in these articles: