Audio Reactive Animtions with Stable Diffusion and TouchDesigner
Added 2023-02-01 05:39:24 +0000 UTCHey! In this tutorial, we'll go over how to use Stable Diffusion with a custom component to generate audio-reactive animations in TouchDesigner.
Project File attached
Link to The first Tutorial: https://www.youtube.com/watch?v=mRXTR...
Link to the API: https://computerender.com/
Prompt Engineering with Lexica: https://lexica.art/
Opt out of Ai Training: https://haveibeentrained.com/
Huge thank you to Peter Whidden for his support on this and his work on Computerender which makes this project possible!!
Comments
Hi! This looks so great! Just a question: I saw in your youtube video a short explanation on how to set up that cross (around 1:30) To crossfade between the new images generated. I have checked the project files but I can't find it anywhere! Do you have the project from the video? I would love to see it to learn how to setup a Chopexec to do that! Thanks! :)
Altnt
2024-05-21 07:58:46 +0000 UTC@Jana I've just started looking into that as well- I know Auto1111 can expose a local API, I just need to figure out how that API call differs from the Computerender setup
David Fong
2023-02-14 15:30:24 +0000 UTCHey! Thanks sooo much for bringing me back to touchdesigner! am experimenting with Auto1111 deforum, and now I'm looking for a way to use it in TD. basically your workflow except the API. Thought I could combine yours and that one - or the next version with imgtoimg, but I'm stuck here :) https://www.youtube.com/c/VJSCHOOL?app=desktop Can you lead me in any direction?
Jana Spacelight
2023-02-11 14:11:42 +0000 UTC
