TG/RC Lip Sync Test (NSFW Version)
Added 2024-09-10 03:22:40 +0000 UTCSo after 18 hours or so, I finally managed to get this to look decent! The main reason it took so long was failing with the ComfyUI version of Live Portrait. For anyone interested in trying this themselves, this gradio interface is much better: https://huggingface.co/cleardusk/LivePortrait-Windows
I think the main issue with this test is that the realistic facial movement makes everything else look very stiff and wooden. At least, I think that's the issue. So this will be a challenge to solve with AnimateDiff going forward. I'll post an update on the next project shortly. Thanks for your support as always!
Edit 9/10/24: Wasn't particularly happy with this and tried a slightly different workflow - Live Portrait for the eyes and facial expression into Runway for lip sync. Let me know if you like it better or worse. https://drive.google.com/file/d/1WVER_FrNg-MeghConzJu6VIrhGBipX2S/view?usp=sharing
Comments
Thanks! I had a lot of fun with that :)
Blankage
2024-09-11 02:05:51 +0000 UTCnobody has commented on it but good job on the accent changes. It was done well and I hope to see more like it
Shadowassaian12
2024-09-11 01:37:15 +0000 UTCThanks so much for the comment! I really appreciate the feedback. There is room for improvement, but it's great to know I'm on the right track!
Blankage
2024-09-10 14:15:42 +0000 UTCVery cool test, and it definitely looks like you're making progress. I see what you mean about the body being stiffer than the (very animated) face, but only after you pointed it out and I was looking for it. Even then it wasn't too glaring and all-in-all I think this is looking great!
Istmael
2024-09-10 10:37:32 +0000 UTC
