render-realm 1 year ago
Render Realm #Dee Dee Design

Realistic Animation from an Avatar with Stable Diffusion

This tutorial will guide you through the process of creating an avatar with ReadyPlayerMe, animating it in Mixamo, building a 3d scene around it in Blender and feeding this scene into StableDiffusion Automatic1111 to create a video animation, using an uber-realistic custom model with the Deforum and ControlNet extensions.

00:00 | Intro

00:20 | Creating an avatar with ReadyPlayerMe

01:45 | Preparing the avatar for uploading it to Mixamo

03:00 | Animating the avatar in Mixamo and importing it into Blender

05:41 | Importing a 3d background scene from Sketchfab into blender and render the scene

10:19 | Preparing Automatic1111 for a hyper-realistic render

12:13 | Using the Deforum and ControlNet extension for rendering the animation

14:47 | Creating the final video