LivePortrait - Image, Video & Webcam
Added 2024-07-27 17:20:00 +0000 UTC
Now you can ditch InsightFace and go fully open source with LivePortrait in ComfyUI! We've got a few model options available for the face cropper to provide image animation, video-to-video animation, and even live via your webcam :)
When recording your driving videos, try not to move around too much. Movement in the z-direction seems worst, but essentially try to keep as still as possible.
Still not the most amazing quality ever. You can see the crop lines and the faces are fairly low-resolution, but hey!
Information Links:
https://github.com/KwaiVGI/LivePortrait
https://liveportrait.github.io/
https://github.com/kijai/ComfyUI-LivePortraitKJ
https://ai.google.dev/edge/mediapipe/solutions/vision/face_detector
https://github.com/yoyo-nb/Thin-Plate-Spline-Motion-Model
https://www.pexels.com/video/woman-wearing-red-dress-7626887/
Workflows used in the video are attached below:
Comments
The new version of Wav2Lip incorporates both Facefusion and the driving video of LivePortait. It's super error prone on Windows, but you can really get to a different level with Live Portrait if you smooth it out and lower the sensitivity (wink wink, grabs razor) ... jk sorry. But it's dope. Not free but I'm a sucker for 1-man teams. Or wait umm.. I guess raising the sensitivity would be... :
NetDude
2024-09-08 00:30:08 +0000 UTCWhen I've got mine set to 24 fps and 0 frame load cap, it will do the entire 7s input video.
Nerdy Rodent
2024-08-02 13:12:42 +0000 UTCIt's set to 0 in frame_load_cap node. If I edit the FPS node I can get more seconds, but it stops at max 60.
Diego Cataldi
2024-08-02 12:24:53 +0000 UTCDo you have the number of frames to generate limited or set to 0?
Nerdy Rodent
2024-08-02 11:39:48 +0000 UTCQuick question, when I use vidtovid it animates only the first 24 frames, or the first second. Even if I change the FPS value the max frames that it can animate are 60fps and I can't animate a video longer than 3 seconds. Why is that?
Diego Cataldi
2024-08-02 08:47:18 +0000 UTCLive cam support is game changer. I’ll check if it works with a Comfy streaming node. Saw your workflows. Nice indeed
Lord Banzai
2024-07-28 03:59:10 +0000 UTCOh very nice.
Clayfacer
2024-07-27 20:13:35 +0000 UTC
