Stable WarpFusion v0.35 - ipadapter weight types, sdxl xinsir controlnets

Changelog

• add ipadapter weight types from https://github.com/cubiq/ComfyUI_IPAdapter_plus

• add SDXL Controlnets from https://huggingface.co/xinsir:

  • tile

  • scribble

  • scribble anime

  • depth

  • openpose

  • canny

• started adding cosxl, it's running, but only producing noise for now :(

• add prompted blip version

• fix sdxl reconstructed noise mode not working

IPAdapter weight types

You can now use IPAdapter weight types. They are adjustable in GUI -> controlnets tab for active ipadapters.

weight_type
combine_embeds
embeds scaling

This means ipadapter can now be used as the content reference (with style transfer weight_types), and work like tile or ip2p controlnets.
The default values mimic the previous version's behavior.

SDXL Controlnets

The pack of SDXL Controlnets by Xinsir seems to work better than the older ones. It also adds tile controlnet, which can help with temporal consistency.

Other

Added prompted (question answering) mode for BLIP captioner. It's not very smart compared to modern VLLMs, but still can help with basic scene analysis. To activate it just enter blip_question text in Extra features -> Frame Captioning

Local install guides:
Windows: https://github.com/Sxela/WarpFusion#local-installation-guide-for-windows-venv
Linux: https://github.com/Sxela/WarpFusion/blob/main/README.md#local-installation-guide-for-linux-ubuntu-2204-venv

If something's not working, make a new env and grab a fresh install.bat from that repo first, ask questions later :D

Local install guide:
https://github.com/Sxela/WarpFusion/blob/main/README.md

Guides made by users:

• 05.05.2023, v0.10 Video to AI Animation Tutorial For Beginners: Stable WarpFusion + Controlnet | MDMZ

• 11.05.2023, v0.11 How to use Stable Warp Fusion

• 13.05.2023, v0.8 Warp Fusion Local Install Guide (v0.8.6) with Diffusion Demonstration

• 14.05.2023, v0.12 Warp Fusion Alpha Masking Tutorial | Covers Both Auto-Masking and Custom Masking

• 23.05.2023, v0.12 STABLE WARPFUSION TUTORIAL - Colab Pro & Local Install

• 15.06.2023, v0.13 AI Animation out of Your Video: Stable Warpfusion Guide (Google Colab & Local Intallation)

• 17.06.2023, v0.14 Stable Warpfusion Tutorial: Turn Your Video to an AI Animation

• 21.06.2023, v0.14 Avoiding Common Problems with Stable Warpfusion

• 21.06.2023, v0.15 Warp Fusion: Step by Step Tutorial

• 04.07.2023, v0.15 Intense AI Video Maker (Stable WarpFusion Tutorial)

• 15.08.2023, v0.17 BEST Laptop for AI ( SDXL & Stable Warpfusion ) ft. RTX 4090 - Make AI Art FREE and FAST!

• 25.08.2023, ComfyWarp v0.1 WarpFusion: Warp and Consistency explanation in ComfyUI

• 2.09.2023, ComfyWarp v0.2 WarpFusion: ComfyWarp iteration 2.

• 3.09.2023, v0.16+ WarpFusion - Multiple Masked Prompts Guide

• 10.10.2023, ComfyWarp v0.4 WarpFusion: ComfyWarp v0.4.2 (schedulers, flow_blend)

• 4.11.2023, ComfyWarp v0.5 WarpFusion: ComfyWarp v0.5 - FixedQueue

• 13.11.2023, v0.27 Stable WarpFusion v0.27 - Changelog

• 2.03.2024 v0.16 Create a INSANE Video Using AI Animation | Stable Warpfusion (youtube.com)

YouTube playlist with settings:
https://www.youtube.com/watch?v=wvvcWm4Snmc&list=PL2cEnissQhlCUgjnGrdvYMwUaDkGemLGq

Setting on GitHub: 
WarpFusion/examples at main · Sxela/WarpFusion (github.com)

For tech support and other questions please join our discord server:
https://discord.gg/58Rd73uAe7

Discord is the preferred method because it is nearly impossible to provide any decent help or tech support via Patreon due to its limited text formatting and inability to add screenshots or videos to comments or DMs.
Due to the recent Patreon comments update it's impossible to reply to comments from notifications anymore, so if your comment hasn't been replied to for a while, DM me.