In the past year I have explored various platforms and identified skillsets necessary for an artist/creator working with the metaverse. Have conducted experiments to evaluate various platforms and begun learning platforms that are going to be central to this ever evolving landscape.
This includes: Mainstream game engines – Unreal and Unity Upcoming platforms such as – Spaces.io and many more.
Progress so far: Have successfully adapted a 3d scene to work across 3platforms – Unity, Unreal and Spatial
The original scene was born from this sketch.
It was refined and eventually finished piece of 2d concept art.
This was later translated to 3d in Blender using a stylized hand painted texture workflow.
Zoophony VR was art project I worked on for a few months at The Indian Sonic Research Organisation. The final vr experienced was launched on 19th Dec at Max Mueller Bhavan. Check out the VR experience online at https://zoophony.theisro.org/
This is what it looks like..
An early experiment used the sound files to generate fcurve data that would deform the mesh. This is what that looked like
However this did not translate to VR and had to be abandoned due to technical limitations, of the webxr and oculus quest platforms, where we wanted to publish Zoophony.
This was part of Soundchains, which is a virtual sound exchange program between Indian and German artists. The first edition of Soundchains features my collaboration with Berlin-based composer, Sergey Khismatov. We focused on spatial audio and virtual reality. I used one of Sergey's compositions to explore surround sound and virtual reality, and experiment with new compositional and story telling narratives. To see more of Sergey's work visit https://www.khismatov.com/
An art project I've been working on for the last few months at The Indian Sonic Research Organisation, comes to an conclusion, with its public launch tomorrow 19th Dec.
Check it out online at https://zoophony.theisro.org/ The vr experience will go live online then and will be available on pc, mobile and most vr headsets (PC vr and portable).
Soundchains is a virtual sound exchange program between Indian and German artists. The first edition of Soundchains features my collaboration with Berlin-based composer, Sergey Khismatov. We will focus on spatial audio and virtual reality. I will be using one of Sergey's compositions to explore surround sound and virtual reality, and experiment with new compositional and story telling narratives.
To see how I created some of the artwork see my previous post. To see more of my work visit chaitanyak.com
To see more of Sergey's work visit khismatov.com SOUNDCHAINS IS SUPPORTED BY
While working on a project I had been using Blender's "bake to fcurve" option to make my models deform in reaction to a sound file. However I reached a massive roadblock when the fcurve data would not transfer to Unity 3d (from where the project had to be deployed).
The answer was in the alembic format. it bakes fcurve data (including noise modifiers etc ) and can be imported to unity.
Step 1
Export your file as an alembic file from Blender. Use the default settings for now.. if you select the "apply subdivisions" option you will wind up with a massive file.
Step 2
In unity go to the package manager(via asset store) and search for "Alembic" and install the package.
Step 3
Import your alembic file the way you would any fbx. add an animation controller and it works!
