Creative Mammals asked me to help put together a crazy video starring rap artist Latto for an introduction into a live presentation for the Atlanta Hawks.
Latto's performance was captured as a 3D performance and provided to me as an animated alembic file. The UV map provided was a frame variable UV that only provided a diffuse channel. I pulled separate channels from the provided file to generate custom roughness maps to give a little more detail to the orginal .abc file. The result allowed us to put Latto in various 3D environments with very few restrictions with what we could do with the camera in space. I animated the environment, cameras, and lighting to add to the performance as a whole.
There are some currently obvious limitations to the technology, but the possibilities are extremely exciting!