XaiJu
Mickmumpitz
Mickmumpitz

patreon


[NEW VIDEO & FREE WORKFLOWS] Generate ENTIRE AI WORLDS for your MOVIES

This is the future of VFX!

You can now create entire animated AI worlds for your short films with this free AI filmmaking workflow! In this video, we’ll show you how to replace your video’s background using just a prompt or reference image—while keeping your original camera movement perfectly intact. Unlike static AI backgrounds, this workflow generates animated environments that interact with your footage, adding realistic shadows, ripples, splashing water, and more.

To put it to the test, we created a full short film about a man who changes size based on his confidence, and almost every single shot uses this AI video workflow. We’re using Vace, built on the Wan2.1 open-source video model (the same tool we used in our last video for generating consistent and controllable AI characters). It lets you film like a traditional movie (lighting, blocking, performance) but transform your footage afterward with dynamic AI worlds, without the need for a green screen or complex compositing workflows in Nuke or After Effects.

If you’re a filmmaker, VFX artist, or AI creator looking to push storytelling to the next level, this AI short film workflow might change the way you make movies.

🔗 DOWNLOAD THE FREE WORKFLOWS BELOW!

🔗 ADVANCED WORKFLOW & GUIDE: https://www.patreon.com/posts/advanced-entire-137635237

👉 INSTALLATION GUIDE: https://mickmumpitz.ai/guides/actor-compositor

👉 COMFYUI INSTALLATION GUIDE: https://mickmumpitz.ai/guides/installing-comfyui

[NEW VIDEO & FREE WORKFLOWS] Generate ENTIRE AI WORLDS for your MOVIES

Comments

hi guys, where is the workflow.json used in the video? I cant find it!! please help or share here! th a lot!

Kablo Skater Rail

I have a question, If I need to create an image with an specific angle and I put an empty box like a room in blender set camera position. Can I use that in ComfyUI for BG images? I dont need a video, but I tried but nothing works Thanks

Felipe Gonzalez

Hi this workflow has a really powerful element to it that is almost overlooked, the camera tracking part, i was wondering if you have any updates to this workflow maybe focusing on the camera tracker and environments at all with Wan 2.2 now out? or any pointers on how to adapt the workflow for the 2.2 update... really awesome stuff.

Jayson King


More Creators