(Just a quick note, the frame rate for this original video is much smoother, when converting to a gif, I had to drop the fps)
The last week or so, I've been setting up a workflow for creating AI animations with Wan 2.1.
I've managed to set up a fairly decent Image2Video workflow that doesn't kill my GPU
You might be thinking, That's neat… But what use cases does it have?
Well, I'm thinking the same thing here!
I'm pretty unsure how I'll be using this, as even though Wan 2.1 does work on pretty "low end" hardware, it's still a kick on my 12GB, I'm limited to small outputs of 512x512, and I rely on post-processing upscale and frame interpolation.
Even though it's just about running on my poor GPU, I'm very, very happy that I'm generating these with my own system and not relying on cloud services.
The biggest reason for not wanting to do cloud services like Midjourney or Runway is their limits on NSFW. With this being open source and generating on my own hardware, NSFW is surely doable.
I'm still currently working on trying to get the Start & End frames working on my system; this requires a lot more VRAM, so it needs a little more tweaking to get working.
(The Start & End Frames is where the AI will animate between two images, creating a smooth transition.)
Potential use cases
The Start & End frames to me, seem like they have the most use, as I could animate sequences generated with my sequence model, creating a very nice-looking TF animation.
(I'm working pretty hard to get this workflow running on my GPU)
For I2V
Potentially using it to add a little bit of motion in some of my TF images; nothing crazy, but another fun way to view a picture.
Adding motion panels within sequences, this could add some layer of "depth", I guess, to the overall sequence comic.
Some uses I found to be pretty neat
Making small little breast expansion videos. With the right prompting, from my tests, they actually came out quite great!
Editing existing transformations from media (mainly TV & Films)
I created some more NSFW themed versions of some classic TG clips from some films & movies, ones that have been shared around on youtube for many years now.
For those who have the ability to run Wan 2.1, once my workflows are completed, and I'm pretty happy with them, I will be fully releasing them for anyone to use!
With full guides for setting up ComfyUI & Manager with a virtual env & all dependencies. These will be free for anyone, possibly released either here as a public post or on CivitAI.
I'll speak more about this once I get the Start & End frames working haha
I'll be sharing more of these animations once I get them upscaled!
I'd also like to quickly mention about the sequences, I haven't forgotten, it was just bad timing with everything that has gone on. I still got a few fun idea's I'd like to make, and I'll be sharing these as soon as they are made.
TLDR:
I've been working on AI animations and trying to get a workflow for animating between images to possibly create smooth TF animations.
Once I'm happy with workflows, they will be free for people to use.
Haven't forgotten about sequences; they are still in the works.