XaiJu
tblankensmith
tblankensmith

patreon


Easily Train Pose, Image, & Audio Detection AI in TouchDesigner (No Code): Teachable Machine Plugin

In this tutorial, you'll learn how to use the Teachable Machine plugin for TouchDesigner. It lets you quickly train lightweight Pose Detection, Image Recognition, and Audio Classification models and embed them into TouchDesigner to run offline without an internet connection.

Link to Teachable Machine: https://teachablemachine.withgoogle.com/

Easily Train Pose, Image, & Audio Detection AI in TouchDesigner (No Code):  Teachable Machine Plugin

Comments

Hello, can I use an image or a 3D model in stead of my webcam? I want to detect the classifications on an image or a 3D scanned model for example. So I want to create a parameter for image input or 3D model input. I am a beginner btw, thanks for your help.

akcaysegul

Hey Man , is it possible to run multiple Instances in one TD Project?

Jones Corzlus

Hey Torin, Wonderful Tutorial! has helped me so much! I was wondering while triggering visuals based on single object detection, is there a possibility for the camera/touchdesigner to detect multiple objects and then trigger visuals bleeding into each other? I am trying out this architectural project and wanna see if its even possible. Thanks much!

Trishla Yadav

Hey I need to roll out a fix for that. For now, go inside the component, locate the webrender TOP, there's a parameter called Cache. I'd you click the + button select a folder path. Make sure you're online and try downloading your model again. This should allow it to work offline

Torin Blankensmith

Hello , if I try to run the project offline, I get an error saying 'Error loading modelTypeError: Cannot read properties of undefined (reading 'load')'. Can you help me out with this?

Edward

Hello Torin Thanks for this wonderful share, opens a lot of doors. It seems like the Webcam and Microphone dropdowns list your devices, and not mine... would you have a quick workaround? Would you please post a fix? Thank you in advance

Jonathan Masterson

Hi Torin, I'm a big fan of your work! When I open a project with a .tox with locally downloaded model as you instructed in the tutorial I get this message: "Error loading modelTypeError: Cannot read properties of undefined (reading 'load')". When I connect to internet everything works fine but it is important to me that the project works without an internet connection. Any ideas how to fix it or the internet connection is a must? I have win 11 and latest touchdesigner version with noncommercial license.

Karol Kłaput

Hey torin, im trying to use the model but i get this message : teachable machine error loading modeltyperror: failed to excute 'getusermedia on mediadevices: at least one of audio and video must be request. it that or it loading for a lot of time and not loaded. thank for help

Lior Baum

hmm strange. I'll look into the multiple-camera issue

Torin Blankensmith

I tried the method from Dom by sending multiple OBS virtual cameras to TD and tested it with MediaPipe, and it works! However, when I tried it with the Teachable Machine plugin in TD couldn't read from the OBS virtual camera at all.

Kiki

Hi Torin, thank you for the tutorial. I'm using Windows, and I tried to add a video device in from TOP, however, it seems to cause an error due to having two camera inputs at the same time (one is from Teachable_Machine_0.2.tox). Do you know how this can be fixed? Thank you!

Kiki

I would like to run multiple teachable machines at the same time. Is it possible? How should I sent image data to the differet machines?

Phil Jungschlaeger

I tried to drag and drop the switch to place a reference from the null just like you did in the YouTube video but I get a red X with an error reading; argument must be a string or a real number, not 'td.switchTop'

Keli'i Centurion

are you on a windows computer?

Torin Blankensmith

Hey, thanks for the reply. tried pretty much everything - OBS to SpoutCam etc. Also went into the code but could not find an answer. only my laptop cam works, no NDI, OBS cam, spout cam and even tried Manycam. Any other solution suggestions? Much love

Bojan Ma

This project has pre-defined models, but you can bring in external python libraries into TD. It does take some setup though

Torin Blankensmith

Hey you can connect a TOP to the Spout Syphon Out top. On mac if you run OBS there's an option to bring in a Syphon feed and start a virtual webcam which then gets picked up in the plugin. On PC you can use Spout Cam to accomplish the same thing

Torin Blankensmith

Can we also applying a trained model to touchdesigner? for example, Chord Recognition from tensorflow. https://github.com/topics/chord-recognition

Samson Wong

Hey! First of all thanks for this amazing integration! I´m exploring it´s capabilities to categorize art genres for a uni project. Is it possible to have a Top Input as a image reference instead of the webcam? Best

Bojan Ma

Windows 11! Yes, it works with the built-in webcam but my webcam is unfortunately broken. Switching to a different device doesn't work, even with changing only the first device shows :) I used it on Mac with an external camera and it worked great.

Soyun Park

this works on mac and pc

Torin Blankensmith

Hello, Does this plugin work on mac only?

omar karout

What OS, and TD version are you both on? Also have you tested using your computer's built in webcam?

Torin Blankensmith

I have the same issue! :')

Soyun Park

Hi, I'm trying to connect a Nexico webcamera to Teachable Machine, but it's not showing up. Only the default laptop webcam is turning on. What needs to be adjusted to make it work? I have windows 10

Алексей Топалов


More Creators