Advanced Setups 25 - Controlling Stable Diffusion With Houdini Pt. 3: ControlNet
Added 2023-03-16 10:00:02 +0000 UTCEDIT: Added updated scene file for new controlnet extension API calls
In part three of our small series on stable diffusion in Houdini, Mo uses Automatic1111’s API together with its controlnet extension to build a “render engine” based on AI.
Comments
Hello, please can you help me how to use Flux model in Mlops? Is that possible?
Tomas Krejzek
2024-11-06 21:16:34 +0000 UTCHi Mo, it seems like this img2img only works with 1x1 aspect ratios. What would need to be changed for it to work on 512x768?
Will H
2023-05-16 19:38:08 +0000 UTCI resorted to downgrading to Stable Diffusion d006108d75d74b3237ccbb60a9373bf28c2b85d7 to make this work.
Patrick Cabral
2023-03-20 08:57:34 +0000 UTCYes. I have those. Also when I am using this work-around, it does load the controlnet model although it's throwing error on the image . https://github.com/Mikubill/sd-webui-controlnet/issues/567 I am using Stable Diffusion a9fed7c364061ae6efb37f797b6b522cb3cf7aa2 I read somewhere that the current version broke the API. Maybe give me your current Stable Diffusion version so I can roll back to that version. Or you can update to the latest stable diffusion so you can reproduce the bug.
Patrick Cabral
2023-03-19 15:06:31 +0000 UTCHi Patrick, yes. That file works for me. Did you make sure you have the proper settings enabled in the controlnet extension's settings page in webUI? (Max number of models, max cache number, allow control via Script etc.)
Entagma
2023-03-19 09:12:21 +0000 UTCHello Mo, Thanks for the updating the file. Were you able to make it work on your end? The updated file still doesn't load the models for some reason.
Patrick Cabral
2023-03-19 07:39:01 +0000 UTCThanks for giving me the heads up - I just added an updated scene file with the new proposed workflow. Cheers, Mo
Entagma
2023-03-18 22:02:28 +0000 UTCthanks a lot. Unfortunately not working for me - not sure if Entagma has an update but will keep looking
Juan Sloane
2023-03-18 16:39:11 +0000 UTCThey were using this workaround at https://github.com/Mikubill/sd-webui-controlnet/issues/571 I manage to load the controlnet that way, but for some reason it's throwing errors .
Patrick Cabral
2023-03-18 14:35:52 +0000 UTCI was getting weird results, nothing to do with the tutorial. Will look into your post. thanks!
Juan Sloane
2023-03-18 14:27:02 +0000 UTCHello, New member here. I think this doesn't work with the latest Stable Diffusion Controlnet update from a couple of days ago. Here's I think is the new API https://github.com/Mikubill/sd-webui-controlnet/wiki/API#migrating-from-controlnet2img-to-sdapiv12img
Patrick Cabral
2023-03-18 13:08:43 +0000 UTC
