Custom ChatGPT-4-Turbo and Whisper(speech to text) Plugins for TouchDesigner
Added 2023-03-12 19:11:25 +0000 UTCHey! In this tutorial, we'll go over 2 new components I developed to run OpenAI's Whisper (speech-to-text) and ChatGPT within TouchDesigner. No need to install any dependencies.
Link to Open AI: https://platform.openai.com/signup
Update:
Note the component now works with the new GPT4 & GPT-4-Turbo Model as well.
Comments
Check out my eleven labs speech to text video. I setup a network that auto turns on and off whisper when someone talks
Torin Blankensmith
2025-03-13 14:01:16 +0000 UTCIt’s using OpenAI’s servers to process, so it’s optimized already. No custom install needed
Torin Blankensmith
2025-03-13 13:59:38 +0000 UTCHi Torin! thank you for the plug-in! Are there any technical specifications for GPUs to use this plug-in in Windows?
Fabrizio
2025-03-13 11:13:52 +0000 UTCHey Torin, thank you for the tutorial. I'm currently trying to implement a live speech to text project with Whisper Ki. Is it possible to run the whole thing without the record on/off button? So that there is input all the time and is analyzed in the meantime, even if this is probably a bit delayed? If so, do you have any tips for me on how I can implement this in td?
Sina Catharina Oberwinster
2024-04-29 13:00:45 +0000 UTCI'm using a Mac, there is an error: "No such file or directory". Do you know how to solve it or show us clearly how to connect Arduino with Chat GPT APIs?
Bo
2024-01-24 15:03:44 +0000 UTCThis is such amazing work - the possibilities are staggering as you play with it. I am having the same issue as Daniel and Issac where the "record audio" causes the application to crash but the prerecorded audio works just fine. I am on Windows with the latest Stable build.
Eugene Pitts
2023-12-16 21:54:30 +0000 UTCMe too touch designer crashes every time I hit record would really appreciate a solution
Isaac Hooper
2023-12-12 03:19:04 +0000 UTCJust an update, with specified file path to a pre-recorded audio, the transcription works perfectly, the fatal error only happens when I hit record audio. Thank you.
Daniel
2023-12-07 16:21:26 +0000 UTCHello Torin! Thank you for the plugin! I have an issue that when I hit the record voice input button on the whisper node, touch designer just returned a fatal error warning and says the application must closed. (I'm using Mac)
Daniel
2023-12-07 15:59:05 +0000 UTCJust include the asyncIO tox anywhere in your TD project
Torin Blankensmith
2023-11-28 15:36:27 +0000 UTCHow do I use the async .tox file in order to make the gpt tox working ?
FRANCOIS DEJARDIN - Polykrom
2023-11-24 14:11:18 +0000 UTCReally cool man, learning a bunch. Is there a way we could trigger an event based on the response ? As in, if we ask it to press 2 seperate buttons, for example for yes / no questions
Djoeneuh
2023-11-13 02:14:32 +0000 UTCAnd the script that can take the actual script and separate it from the text, it should be the same yeah?
Alon Hammer
2023-11-07 20:42:17 +0000 UTCHey! That's strange. I specifically set this up so you don't need to install any libraries. Seems like an SSL issue with TD. What version of TD are you using?
Torin Blankensmith
2023-11-07 20:41:33 +0000 UTCHey I just updated this to work with the new GPT-4-Turbo model as well. Yeah, I just gave it a couple of examples of what glsl code in TouchDesigner looks like. If you want to have it work with python in TD just give it examples of using python in TD
Torin Blankensmith
2023-11-07 20:39:57 +0000 UTCThis is awesome!! I use chatgpt a lot to help with python scripts. Do you have any recommendations or direction for streamlineing that approach. I saw in the video you had a script that took the response and generated a glsl script. Is that easy to change for python?
Alon Hammer
2023-11-07 20:15:55 +0000 UTCHello Torin! Thank you for the plugin! I have an issue that it keeps returning a mistake whenever I try to integrate it into my project (I'm using Mac): HTTPSConnectionPool(host='api.openai.com', port=443): Max retries exceeded with url: /v1/audio/transcriptions (Caused by SSLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1129)'))) I've already installed new Python, openai libraries, ssl for python, updated my TD version but it keeps returning a mistake. Do you have any idea what could be the issue?
Yulia Babanova
2023-05-16 17:53:01 +0000 UTC
