Today we'll be using AI tools to create virtual environments for your film projects! We cover the entire workflow, from generating the 3D environment, to filming in a low-budget virtual production environment, to compositing your shot with some AI tips and tricks, like re-lighting your shot based on the environment you've created! Chapters: 00:00 Intro 00:34 What is Virtual Production? 01:42 Generating a 360° image 03:17 Preparing the 3D Model [Depth Maps] 06:22 Filming the scene 08:05 Key out the actors 09:10 Generate Normal Maps 11:15 Putting it all together 14:11 Final Shots Tools used in this video: - Skybox Labs by Blockade Labs: - NVIDIA Canvas: - ControlNet for Stable Diffusion: - midjourney: - High Resolution Depth Maps for Stable Diffusion WebUI: - Blender: - CamTrackAR: - Reality OBJ to USDZ Converter: - After Effects: - : - High Reslution Normal Maps for Stable Diffusion: - DaVinciResolve: - Reference to image plane: Videos Links: - Avatar Featurette: Performance Capture: - Avatar & Avatar 2 Behind the scenes - How James Cameron Evolved Motion Capture in the Avatar Films: - The Virtual Production of The Mandalorian Season Two: - Blender Motion Tracking - Room Transformation! by Ian Hubert: - Grae n YouTube Channel: @UC_EkMqKOm7Ej_g03Ryv0UZw - Inpainting in Augmented Reality: - How to Make a Blur Node in Blender!: ❤️ Buy me a coffee: Follow me on Twitter:
Hide player controls
Hide resume playing