XaiJu
tblankensmith

tblankensmith

patreon


tblankensmith posts

Depth Anything TouchDesigner Tutorial

In this tutorial, we'll dive into Torin's new DepthAnything plugin for TouchDesigner—a drop-in .tox that turns any webcam or TOP into a real-time depth map (no extra installs or special hardware) for Mac + PC. We’ll explore instanced visuals with trails, experiment with occlusion, and set up high-quality depth exports. We'll also show how to integrate the plugin with Josef Pelz’s PCR point-cloud renderer tool, and Prismatic's screen-space depth rendering tool for rim lights and material...

View Post

DepthAnything TouchDesigner Plugin: Huge Update! v03

You can find the updated component on the original Patreon post here

DepthAnything turns any webcam feed and now any TOP into a live depth map, showing how far away things are in the scene, similar to the kind of depth data you'd get from a Kinect or Orbbec camera. No install needed, just drag the .tox into...

View Post

Yolo TouchDesigner Plugin: Multi-Pose, Object, VisDrone, & Face Tracking + More

This plugin brings Ultralytics YOLO into TouchDesigner with no install required. Just drag and drop the yolo.tox into your project.

Features

  • Object Tracking – unique IDs that persist across frames

  • Multi-Person Pose Tracking – body keypoints, joints, & persistent IDs across frames

  • View Post

ChatGPT-5 TouchDesigner Plugin

Hey! I'm excited to launch an update to the ChatGPT-5 Plugin for TouchDesigner!
If you want to combine it with other AI models like text-to-speech, speech-to-text, or animate a 3D character with the responses, check out this Patreon project as well.

How to get started:
1) Drag and drop the ChatGPT5.tox plugin into your TD project
2) Make sure you have credit on your 2025-08-13 18:31:24 +0000 UTC View Post

Flux Krea Plugin: AI Image Generation in TouchDesigner

Hey Everyone! I'm excited to launch a new Flux Krea Dev integration with TouchDesigner. It lets you easily generate photo realistic imagery

Hey Everyone!

I'm excited to launch a new Flux Krea Dev integration with TouchDesigner. It lets you easily generate photo realistic imagery that doesn't have the over saturated 'ai' style aesthetic. Totally subjective, of course... but I'm excited to see what you create using it!

The plugin runs on any OS with no installation and has a...

View Post

Project File: Object Tracking in TouchDesigner with MediaPipe

In this beginner-friendly tutorial, we dive into object tracking with the MediaPipe plugin for TouchDesigner—no paid license required! You’ll learn how to connect a webcam or custom video input using NDI, visualize tracked objects with custom lines and bloom effects, and generate sound both through real-time audio buffers and MIDI note output to Ableton.

📌 Resources & Links

🔗 MediaPipe Plugin for TouchDesigner – 2025-06-26 23:36:54 +0000 UTC View Post

DATFEST NYC TouchDesigner Festival

Hey All!

I'm co-hosting a NYC new media arts festival called DATFEST with Lyell Hintz (@dotsimulate), happening April 18 at Chemistry Creative in East Williamsburg! The festival centers around TouchDesigner, with hands-on workshops, talks, interactive installations, and live AV performances across two immersive venues.

We’re especially excited to have Greg and Isabelle from the Derivative (TouchDes...

View Post

Watercolor Hand Tracking Brush in TouchDesigner Tutorial

In this beginner tutorial, we'll dive into hand tracking with MediaPipe and building an interactive watercolor effect in TouchDesigner! You'll learn how to create a custom hand-tracked brush to paint dynamically on screen, with brush size control, gesture-based clearing, and even video textures as brushes.

📌 Resources & Links:

- Clamp Math Component (Free Download) – [https://www.pa...

View Post

Clamp Math TouchDesigner TOX: Smooth and Reliable Value Mapping

This simple Clamp_Math.tox component in TouchDesigner makes it easy to adjust and smooth out values from hand tracking, sensors, or other inputs. It keeps numbers within a set range, ensuring smooth and reliable interactions. You can customize the input and output ranges, limit extreme values, and add optional smoothing for more natural motion. Great for making interactive controls feel more responsive and consistent.

View Post

Generative Architecture and Hand Tracking in TouchDesigner with MediaPipe

In this tutorial, we'll create a Brutalist-inspired Generative Architecture piece using TouchDesigner. We’ll explore instancing, physically based rendering (PBR), hand tracking with MediaPipe for interaction.
Let me know in the comments if you have any questions.

📌 Resources & Links:

- Hand Tracking Masterclass (3-Part Series) – [https://www...

View Post

Hand Tracking Master Class in TouchDesigner with MediaPipe

I'm so excited to launch this three-part Master Class on Hand Tracking in TouchDesigner with MediaPipe 🎉. I’ve taken insights from my Genuary artworks (a 30-day generative art challenge in January) and distilled them into a series of tutorials. This course will help you create your own interactive artworks and even extend hand tracking to build custom interfaces.

📌 Resources & Links:
- View Post

ChatGPT Plugin for TouchDesigner Now Supports o1-Preview, o1-Mini, GPT-4o, & GPT-4o-mini with Vision / Image Upload

I'm very excited to launch this new plugin that supports OpenAI's new models which you can read more about here.

Here's a link to my previous tutorial that shows how to get an API key and set up your project

Here's anoth...

View Post

Eleven Labs Speech-to-Text: Audio Quality Upgrade

The new TouchDesigner plugin features dramatically improved voice quality with a new Audio Format dropdown.

Options include PCM 16000, 22050, 24000, and 44100. The default is now 24000, reducing audio artifacts—previously set to 16000. The highest quality, 44100, is available with a Pro Eleven Labs subscription.

Thanks to Matthew Reisinger for highlighting this and supporting the project, making the upgrade available to all!

You can find the download for the component o...

View Post

New Shader Park Plugin for TouchDesigner + T3D Support

I'm excited to launch the new Shader Park plugin for TouchDesigner! It allows you to easily take your raymarched shaders that run in the browser and bring them natively into TouchDesigner to introduce things like audio reactivity, hook them up to sensors, or render out high quality video. This can also be a nice way to create a shader that runs natively and bring it to the browser.

The new plugin has support for Josef Pelz's T3D operators! It now has no installation process, just drag a...

View Post

Easily Train Pose, Image, & Audio Detection AI in TouchDesigner (No Code): Teachable Machine Plugin

In this tutorial, you'll learn how to use the Teachable Machine plugin for TouchDesigner. It lets you quickly train lightweight Pose Detection, Image Recognition, and Audio Classification models and embed them into TouchDesigner to run offline without an internet connection.

Link to Teachable Machine: https://teachablemachine.withgoogle.com/

View Post

ChatGPT Plugin for TouchDesigner supports GPT-4o + Vision

I'm very excited to launch this new plugin that supports OpenAI's latest GPT-4o model which you can read more about here.

This new plugin update also includes the ability to have GPT process images, which you can easily turn on and off with each new message via the 'Upload Image With Message' toggle. You can attach any TOP to the component and the second you press 'Generate Response' it will snag the curren...

View Post

Text-to-Speech ElevenLabs Plugin for TouchDesigner with Whisper, ChatGPT, and MediaPipe Integration

In this tutorial, you'll learn how to use the new ElevenLabs text-to-speech plugin for TouchDesigner. We'll also walk through a project creating a voice-activated 3D talking character by integrating Whisper for speech-to-text, ChatGPT for generating dialogue, ElevenLabs for text-to-speech, and MediaPipe for motion tracking to create an interactive experience.

Previous Tutorial on ChatGPT and Whisper: https:...

View Post

Picture in Picture Hand Tracking Effect - TouchDesigner Tutorial

Happy New Year! Got some exciting things in the works for the new year that I'm looking forward to sharing with you all soon.

I'm doing Genuary this month, a challenge to create a piece of generative art every day in January. The prompt for day 3 is to create something in the style of a Droste effect / a Picture in a Picture and thought it'd be fun to turn it into a quick little tutorial. Hope you enjoy!

Link to Genuary: ht...

View Post

ChatGPT TouchDesigner Plugin Supports GPT4-Turbo + JSON Mode!

I'm very excited to announce the ChatGPT Plugin for TouchDesigner now supports OpenAI's new GPT-4-Turbo beat which includes a 128K context window and JSON mode, and improved accuracy on returning the right function parameters. You can learn more about the new features features OpenAI launched today on their blog.

2023-11-06 23:19:37 +0000 UTC View Post

New TouchDesigner MediaPipe Plugin 0.3.1 Release 🎉


Link to the original video tutorial walking through the component

New features

  • Smooth Pose Tracking with MediaPipe update to 0.10.7. no more jittery poses
  • Camera flip toggle on MediaPipe component flips the camera + output
  • Face mesh example using the source video as texture
  • Easily track pinch gestures with the new hand_tracking pinch midpoint,...

    View Post

Face, Hand, Pose Tracking & More with MediaPipe GPU Plugin for TouchDesigner

Hey! In this tutorial, we'll go over the new free open-sourced MediaPipe plugin for TouchDesigner that's GPU accelerated and works on Mac and PC with no instillation. The plugin supports face, hand, pose and object tracking with multi-person face detection, object detection, and image segmentation / background removal.


Link to the GitHub to download the Plugin: https://github.com/torinmb/me...

View Post

Audio Reactive & Motion Controlled Visuals in TouchDesigner - Tutorial 2/3

Hey! In this tutorial, we'll go over how to create audio reactive visuals that are also motion controlled using a custom Body Tracking plugin that I developed for TouchDesigner.

Link to the project file for the visuals is attached below. You can drag and drop the audio_reactive_visuals.tox into the Body Tracking Component Project file which you can download here View Post

New Body Tracking Plugin for TouchDesigner - No Kinect Needed | Tutorial 1/3

Hey! In this tutorial, we'll go over my new body-tracking plugin for TouchDesigner. It runs off the webcam and works on both Mac and PC. The components work without any setup, or installation needed. I also go over how to start using it in your TouchDesigner Projects.

The Project has been tested on the latest TouchDesigner 2022.33910. Please make sure to use the latest version.

Link to OBS

2023-07-26 02:17:09 +0000 UTC View Post

TouchDesigner Berlin Event Update + New Component Sneak Peak

Hey Everyone! Thank you so much for your support. I know it's been a long time since I've posted. I was traveling to the Open Source Arts Developer conference in Denver Colorado with Peter and I'm currently in Berlin for the TouchDesigner Event. It's been amazing to meet some really incredible people in the media arts and creative technology field and I'm feeling very inspired. I'll be back in New York soon. I'm very excited to get back to making some tutorials!

In the meantime here's ...

View Post

TouchDesigner Plugin now supports GPT-4!🎉

The component from this tutorial now works with the new GPT-4 model. You need to get on OpenAI's waitlist to get access: https://openai.com/waitlist/gpt-4-api

The component defaults to GPT-3.5-turbo, so it works out of the box. If you get off the waitlist you can change the model from the component parameters.
View Post

Custom ChatGPT-4-Turbo and Whisper(speech to text) Plugins for TouchDesigner

Hey! In this tutorial, we'll go over 2 new components I developed to run OpenAI's Whisper (speech-to-text) and ChatGPT within TouchDesigner. No need to install any dependencies.

Link to Open AI: https://platform.openai.com/signup

Update:
Note the component now works with the new GPT4 & GPT-4-Turbo Model as well. 

View Post

Video to Video AI Style Transfer with Stable Diffusion and Keyframing in TouchDesigner - Tutorial

Hey! In this tutorial, we'll go over how how to do video to video style transfer with Stable Diffusion using a custom component in TouchDesigner. We'll cover how to keyframe in animations so you can drive your AI style generation with audio reactivity and swap out your model parameters at exact times in your video.  

Link to early SD Tutorials: https://www.youtube.com/watch?v=mRXTR9vcHAs
Link to ...

View Post

Create Audio Reactive Shaders With Three.js and Shader Park

Hey! In this tutorial will cover how to create an audio reactive shader using Three.js and Shader Park.


Starter template: https://glitch.com/~starter-template-audio-reactive-shader-three-js-shader-park

Completed project: https://glitch.com/~audio-reactive-shader-three-js-shader-park


Getting started with Shader Park: 2023-02-07 19:00:50 +0000 UTC View Post

Audio Reactive Animtions with Stable Diffusion and TouchDesigner

Hey! In this tutorial, we'll go over how to use Stable Diffusion with a custom component to generate audio-reactive animations in TouchDesigner.

Project File attached

Link to The first Tutorial: https://www.youtube.com/watch?v=mRXTR...

Link to the API: https://computerender.com/

Prompt Engineering with Lexica: View Post

Web GUI for TouchDesigner Component

Hey! In this tutorial, we'll go over how to use a new custom component that allows you to instantly create a web GUI for any TouchDesigner container and control TD in real time over the web. The website will also live-update when changes in TD are made. 

We'll also dive into behind the scenes how we're able to programmatically get and set the state of TouchDesigner containers using Python.

Links:

2023-01-16 02:59:41 +0000 UTC View Post