RabidCrab

Speech To Speech!?

Yes! BUT YOU NEED AN ELEVENLABS SUBSCRIPTION WHICH IS AN ADDITIONAL $20, AND IT'S A BIT SLOW RIGHT NOW!

I'm working on a way to bundle ElevenLabs costs into the program, but holy cow is it expensive, and with the addition of Speech To Speech it's even more expensive! But don't worry, I'm working on a way to get this integrated at something at least a bit cheaper than $35 a month for my program + ElevenLabs.

Along with this update comes a fix for all of the connection issues associ...

Windows Media Support

This is another update meant for the chatbox display. This adds the ability for the program to display the current audio/video you're playing on your browser, and a few other apps too!

Make sure to read the warning before enabling this option, otherwise you might get yourself into an embarrassing situation!

ChatGPT?!?

Yes! ChatGPT!

Maybe your friends want to tell you that 1 million bananas will fit in the Grand Canyon, but you're not so sure about that. You used to have to open your virtual window, open your browser, and search for it.

But, no more! Just ask ChatGPT by saying "Hey Chat, can 1 million bananas fit in the Grand Canyon?" and the answer will show up on your custom messagebox, or chatbox!

Oh yeah, it's for every tier patron too!

Voice Commands

You can now make just about any voice command, including sending OSC commands to VRChat! The program also comes setup with a bunch of commands to control Spotify, and the program itself.

For Spotify there's: Play, Pause, Volume 0-100, Skip, Replay, Find (Song + Artist), Favorite, and Previous.

For the program there's: Status on/off, Voice 1-4, Chatbox on/off, Messagebox On/Off, and Emotes On/Off.

And of course you can customize all of the commands yourself. Don't like one? J...

Spotify And System Resource Integration

Much more to come soon!

Until then, enjoy having a super easy to setup status bar above your head that can track your computer's RAM, CPU, GPU, and VRAM resources. And of course Spotify integration allows everyone to see what you're listening to, or if you have it paused or muted.

It all works together with Speech To Text and won't interfere with your chat messages at all!

Google And IBM Voices

How about 400 more voices to choose from?

After hammering out a bunch of the translation issues, and smashing all other known bugs, it's time for new features!

Stay tuned this month, you're going to be seeing a lot of updates!

2.0! Wew!

We’re back with version 2.0! After a break, both to polish VRCSTT as much as possible and taking some much needed holiday, we’re presenting our largest update yet. Relocating across country is always stressful, so I/we are glad to be able to fully focus on updates again. We’ll be covering in this post all the new features of our program and the new Unity shader that has been simplified for our speech bubble. We’ll also be placing at the very end a lot of issues that were addressed and...

1.9 is out, with a lot of improvements!

1.9 is all about polishing the program to make it more reliable and performant, as well as preparing for new features coming in the next update. The UI update is a much needed change that will give me more room to add more features, and the settings saving across versions is there to make your lives easier when updating.

User Interface

There has been ...

1.8 - Poiyomi Integration And Avatar Dynamics

The speech to text bubble is now officially a Poiyomi 3rd party mod!

A lot of the Poiyomi features are now much easier to add to the messagebox, as well as a huge performance improvement! The messagebox has gone from nearly 800 polys to under 400, and from 4 materials to 1! You will also notice a difference in box sizes when uploading the new Speech Bubble on your avatar.

2023-02-03 07:00:43 +0000 UTC View Post

1.7!

This release isn't too exciting, but it was a necessary series of bug fixes and optimizations that spans multiple updates.

Bugs were becoming a big problem. Everything from the voice recorder to the AI voice playback had some sort of major bug in it that needed to be squashed. And squashed they were! Here's a (not comprehensive) list of all the bug fixes that were all crushed in 1.7:

- Added FonixTalk, also knows as the Moonbase Alpha voice.... Aeiou

- Added some ...

1.6 Is Out!

1.6 is a huge improvement on how my program manages audio.

The entire audio system has been revamped to include a noise suppressor (thank you RNNoise https://jmvalin.ca/demo/rnnoise/) that reduces audio bleed from your speakers to your microphone and increases accuracy by cleaning up the background noise present in all microphones.

All of the known messagebox bugs have been fixed with the exception of a bug w...

Monthly Subscription Unlocked!

Patreon finally gave us the option to charge monthly on the day you sign up and not the 1st of the month! YES! 

If you sign up in the middle of the month, it will now charge you next month on the same day like it should have at the beginning.

All existing Patreons will get charged on the 1st of this month, but don't worry, you will always get AT LEAST 30 days of access per charge. You don't lose any days because you signed up after the 1st!

1.5.3 is out! Continuous speech unlocked!

Always-On (continuous) speech recognition is now available for the Premium Tier patrons!

Continuous speech recognition is just a fancy way of saying you no longer need to press the record button every time you want to talk. Instead, all you need to do is press it once and it'll stay on!

Continuous speech has support for all of the fancy features of the program, including logging messages,...

1.3.3 Is Out!

New features and fixes:

- 63 Emotes!

- OBS and Streamlabs support!

- The sizing issue with some avatars is finally fixed!

This update was an absolute nightmare to program out. Handling multi-line emotes was a much more difficult process than I imagined, and even now there's still some rare cases where emotes won't properly line up, but it works in 99.5% of cases. You have to try and break it in order to get it to break now.

Next on the list is support for more th...

Updated Installation Tutorial

This new installation tutorial covers everything you need to get started with STT (and STTS coming soon)!

This video also includes explanations and solutions for common issues you may come across during installation, although hopefully you don't come across any!

33 text languages, 57 speech languages, and 114 voices!

English, 日本語 (ひらがな), français, Español, Deutsch, svenska, Suomalainen, Nederlands, and many others! With live translation between the languages!

New Patreon Options

I created 2 new options to choose from! If you choose the cheaper option, you'll still get all the features of the higher priced tier, just at a slower rate. I figured this would be a good option for those who are tight on money and want to use it. As the number of patrons increase, I may be able to lower the prices more, but don't hold me to it, it all depends on a future I can't predict.

Version 1.1.2 was also released. Between 1.1.2 and 1.0.7 I've been fixing a number of bugs that ha...

1.0.7 Released!

Today I spent some time communicating with the VRChat team in order to determine fps drops associated with animator controllers. After their generous help, we were able to halve the fps cost of the messagebox! There's still some more optimization that needs to be done, but until then I'll be working on other parts of the mod.

Along with new optimizations came a number of major bugs that I managed to squash. There's still some more to go, but right now I feel pretty good about the curren...

1.0.6 Released!

1.0.6 isn't a flashy update, but it is a very important one!

Global VR Controller support is a tricky issue to tackle. The APIs that expose VR functions to programmers are very optimized, which also means they're difficult to use and very cryptic at times.

It took me nearly 3 days of digging through documentation to figure out how to bind directly to SteamVR, but I finally did it! 1.0.6 is the first implementation of global controller bindings!

2022-02-21 13:07:52 +0000 UTC View Post

VRChat Open Beta STTS

I'm excited to announce this no longer requires a client mod with VRChat Open Beta!

When Open Beta is released, you will be able to use this with 100% approval from VRChat!

1.0.1 Released!

1.0.1 comes with a huge number of quality of life improvements to the mod!

The installer script now has multiple options to choose from, including the ability to control the character bandwidth. This means you can choose to use as many as 127 parameter bytes for the mod, or as few as 43! It's still recommended to use at least 72 bytes for the mod, but the choice is yours now!

Along with t...

1.0.0 Has been released! We're out of beta!

This release is a pretty huge milestone for the project since it was first created in March of last year. Hundreds of hours of work has gone into this project, and I plan on spending hundreds more hours making this product worth using.

This release doesn't have a lot of new features, but it does mark a huge change in the code base. I refactored the avatar script, mod, and program to prepare for feature additions like custom emotes and custom shader additions.

Update to 0.9.8

Another update to the mod as a whole! This one squashes a lot of bugs I've made when dealing with the write defaults issue. I've also added a couple of quality of life features so it's not just a general bug fix update.

Custom keyboard bindings are now supported (just ignore the weird names, I have to manually add like 200 user friendly names of the keys and it's really time consuming, but they work either way)!

Along with custom keybindings, I also added a button hold duration so...

Demo

While I'm still working on a presentation video, here's a clip of the mod in use.

Despite having used it for 6 months now, I don't have any actual video of me using it. Whoops.