Realistic Animation from an Avatar with Stable Diffusion
This tutorial will guide you through the process of creating an avatar with ReadyPlayerMe, animating it in Mixamo, building a 3d scene around it in Blender and feeding this scene into StableDiffusion Automatic1111 to create a video animation, using an uber-realistic custom model with the Deforum and ControlNet extensions.
2023-03-22 19:00:00 - Render Realm
00:00 | Intro
00:20 | Creating an avatar with ReadyPlayerMe
01:45 | Preparing the avatar for uploading it to Mixamo
03:00 | Animating the avatar in Mixamo and importing it into Blender
05:41 | Importing a 3d background scene from Sketchfab into blender and render the scene
10:19 | Preparing Automatic1111 for a hyper-realistic render
12:13 | Using the Deforum and ControlNet extension for rendering the animation
14:47 | Creating the final video