StreamDiffusionTD 0.1.7 🖼️🚀 [ Changelog ]
Added 2024-04-11 22:18:59 +0000 UTCImproved Model Support !
SDXL-Turbo supported !! ( but no TensorRT yet ... working on that )
stabilityai/sdxl-turbo in Main SD Model ID/Path... see more
SDXS, a recently released 2.1 based model is now supported. faster than sd-turbo, but not good for img2img. very smooth for text2image interpolation though. SDXS + TensorRT beats sd-turbo in speed but looses quality.
IDKiro/sdxs-512-0.9 in Main SD Model ID/Path... see more
LoRA Loader loads with every model type now. but it may cause shape error if the LoRA type doesn't match the Main SD Model type.
Caution: For tensorRT, using the wrong LoRA type will cause errors after building the model. sd-turbo and sdxs are 2.1 based and will not work with 1.5 or sdxl based LoRA.
Added LoRA folder to search for subfolders. if folder contains pytorch_lora_weights.safetensors or .bin , it can be loaded. specifically for jiaxiangc/res-adapter (https://huggingface.co/jiaxiangc/res-adapter) - which seems to possibly increase quality with SD 1.5
Added check for git lfs (large file storage) and provides option to install if not installed
Added Pulse to open model folders.
Added dropdown option that doesn't change LoRA or Main Model when changing Basefolder
Relabelled Modelid to 'Main SD Model ID / Path'
Streamactive check is now based on FPS. so slow fps shouldn't result in stop / start of Streamactive toggle
Installation Check fixes for main repo. allows to continue anyway and provides details during installation.
Current things being worked on: improved prompt blending, sdxl tensorrt, non local inference, per frame metadata for timing + custom data, using shared memory or cuda block instead of ndi/spout. Also special shout out to @meng on the server for helping test and get sdxl working.
As always, your feedback is appreciated and very helpful ! and thanks so much for the support !
Find the operator here !!
Comments
Hi, i have been trying everything, and have setup a vpn but it doesn't seem to work, and i am fairly new with the hugging face website. what are the steps i have to take to get a model locally? ps: i have updated to tox 0.1.9
Michael Claessens
2024-04-23 07:29:58 +0000 UTCThank you so much for the update!!! I tried loading a custom SDXL model in the tox - apologies if you've covered this somewhere, but are there different settings that are needed for running SDXL models? Right now all my images are turning out hazy
Jacky Lu
2024-04-20 23:20:16 +0000 UTCWhen I load the tox. all the parameter tabs are empty except extension, common and custom
Torben Zs
2024-04-20 19:31:49 +0000 UTCCould likely be that it is not accessible in your region or firewal or vpn might be cutting off the connection. also changing location via vpn could help.
dotsimulate
2024-04-19 21:48:56 +0000 UTChi i first of all, very nice work! i wanted to try it out but i also get an error where the model isn't loading, and i restarted and now i cant seem to get a CMD window popping up. is it possible that the hugging API is down? During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\Users\mc\Desktop\SDtouchdesigner\StreamDiffusion\streamdiffusionTD\..\utils\wrapper.py", line 417, in _load_model pipe: StableDiffusionPipeline = StableDiffusionPipeline.from_pretrained( File "C:\Users\mc\Desktop\SDtouchdesigner\StreamDiffusion\venv\lib\site-packages\diffusers\pipelines\pipeline_utils.py", line 1090, in from_pretrained cached_folder = cls.download( File "C:\Users\mc\Desktop\SDtouchdesigner\StreamDiffusion\venv\lib\site-packages\diffusers\pipelines\pipeline_utils.py", line 1649, in download info = model_info( File "C:\Users\mc\Desktop\SDtouchdesigner\StreamDiffusion\venv\lib\site-packages\huggingface_hub\utils\_validators.py", line 119, in _inner_fn return fn(*args, **kwargs) File "C:\Users\mc\Desktop\SDtouchdesigner\StreamDiffusion\venv\lib\site-packages\huggingface_hub\hf_api.py", line 2227, in model_info r = get_session().get(path, headers=headers, timeout=timeout, params=params) File "C:\Users\mc\Desktop\SDtouchdesigner\StreamDiffusion\venv\lib\site-packages\requests\sessions.py", line 600, in get return self.request("GET", url, **kwargs) File "C:\Users\mc\Desktop\SDtouchdesigner\StreamDiffusion\venv\lib\site-packages\requests\sessions.py", line 587, in request resp = self.send(prep, **send_kwargs) File "C:\Users\mc\Desktop\SDtouchdesigner\StreamDiffusion\venv\lib\site-packages\requests\sessions.py", line 701, in send r = adapter.send(request, **kwargs) File "C:\Users\mc\Desktop\SDtouchdesigner\StreamDiffusion\venv\lib\site-packages\huggingface_hub\utils\_http.py", line 68, in send return super().send(request, *args, **kwargs) File "C:\Users\mc\Desktop\SDtouchdesigner\StreamDiffusion\venv\lib\site-packages\requests\adapters.py", line 547, in send raise ConnectionError(err, request=request) requests.exceptions.ConnectionError: (ProtocolError('Connection aborted.', ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None)), '(Request ID: 83d6f800-b779-4497-8eb9-f5809bda6156)') Model load has failed. Doesn't exist.
Michael Claessens
2024-04-19 13:40:20 +0000 UTCit may be due to something with connection to model or getting stuff in the loading process. I had this happen to me once when huggingface api was down for the day.
dotsimulate
2024-04-18 18:38:35 +0000 UTCPerhaps something is disconnected with ndi . if you can send a screenshot, I am happy to look
dotsimulate
2024-04-18 18:37:17 +0000 UTCeverything is done but can't show the result, how can i fix it?
Rajendra Raga
2024-04-17 16:26:30 +0000 UTCHi Dotsimulate! I’m facing an issue where the command window gets stuck at the “preparing stream….” Line. This is after all the set up has been done. Im using the “stabilityai/ sd-turbo” as my SD model. Please let me know if there is a solution?
_ Wykes
2024-04-17 08:52:18 +0000 UTCI recently started subscribing to you. Thanks for useful tox! I'd like to ask you about stream diffusion tox. It seems that we can set some step parameters. I'm not sure what multiple settings are associated with, could you please explain?
mu_shr
2024-04-16 08:54:02 +0000 UTCcant wait for the non local inference update!
Ahmad Haqqi
2024-04-16 07:55:03 +0000 UTCI just can't get past this error, had it trying to get 1.0 and 1.5 working too. Leading to the cmd window just popping up and disappearing when I start the stream. I can't find how to remedy this error either way, so I'm at a loss. From what I gather, the venv is short of json, re, shutil, traceback and glob. error: subprocess-exited-with-error × Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> [4 lines of output] Traceback (most recent call last): File "E:\StreamDiffusion-for-windows\venv\lib\site-packages\pip\_vendor\pyproject_hooks\_in_process\_in_process.py", line 15, in import json ModuleNotFoundError: No module named 'json' [end of output] note: This error originates from a subprocess, and is likely not a problem with pip. error: subprocess-exited-with-error × Getting requirements to build wheel did not run successfully. │ exit code: 1 ╰─> See above for output. note: This error originates from a subprocess, and is likely not a problem with pip.
Jimi Vex
2024-04-13 14:16:34 +0000 UTCLikely should be able to help but might be a bit more info. Can you dm the full log or send message on discord with screenshots. Is likely an easy fix.
dotsimulate
2024-04-12 20:40:43 +0000 UTCIt should list it in the cmd window. But also if launching from TouchDesigner should be launching with a cmd that sets the sender name based on the Streaminname parameter in StreamSettings2 page. Maybe make sure that that is set to a unique name and you don't have other projects / versions of StreamDiffusionTD open.
dotsimulate
2024-04-12 20:40:02 +0000 UTCHow do you find the number for the corresponding ndi output
tmoney
2024-04-12 18:52:45 +0000 UTCyou may have a console message asking you to input the number of the ndi sender you d like to use as written at the end of your error message (""Enter the number of the NDI source you want to use: ")) - 1 ValueError: invalid literal for int() with base 10: ** "). I had this too , you just have to type the number coresponding to your chosen ndi output and hit enter to continue
virusvjvisuals
2024-04-12 15:27:49 +0000 UTCAlessia Zucca
2024-04-12 09:30:39 +0000 UTCI've been trying to get this working with TD 2023.11600 and .11340 to no avail. Whenever I try to start the stream the cmd prompt asks for an NDI source number to use but immediately crashes no matter the response. Traceback (most recent call last): File "D:\StableDiffusion\StreamDiffusion\streamdiffusionTD\main_ndi.py", line 648, in fire.Fire(main) File "D:\StableDiffusion\StreamDiffusion\venv\lib\site-packages\fire\core.py", line 143, in Fire component_trace = _Fire (component, args, parsed_flag_args, context, name) File "D:\StableDiffusion\StreamDiffusion\venv\lib\site-packages\fire\core.py", line 477, in _Fire component, remaining_args = _CallAndUpdateTrace( File "D:\StableDiffusion\StreamDiffusion\venv\lib\site-packages\fire\core.py", line 693, in _CallAndUpdateTrace component = fn(*varargs, **kwargs) File "D:\StableDiffusion\StreamDiffusion\streamdiffusionTD\main_ndi.py", line 578, in main ndi_sender_name = select_ndi_source(args.sender) # Pass args.sender to the function line 207, in select_ndi_source File "D:\StableDiffusion\StreamDiffusion\streamdiffusionTD\ndi_spout_utils.py", selected_index = int(input("Enter the number of the NDI source you want to use: ")) - 1 ValueError: invalid literal for int() with base 10: **
tmoney
2024-04-12 06:46:54 +0000 UTCI gotta crack this baby open soon!
Dr. Mindset
2024-04-11 23:59:18 +0000 UTCYes!!! The update I have been waiting for!! Thank you so much 👏👏
Malich Coory
2024-04-11 22:55:57 +0000 UTC