Retargeting Mocap (and lil' dude)

im confused about the work flow between different types of rigs. how does the rokoko rig differ to other rigs such as rigs from make human or mixamo. does the re-targeting feature of the rokoko add on simply allow you to translate animation data between them all? what if the rigs are different? thank you!

Excellent work... and singing.

Doug Brown

This is amazing. To hopefully save somebody else some time: this is Windows only for the moment. It installs on the Mac but then doesn't work and I ended up filing a ticket with the amazing Rokoko people. They told me that they have yet to add Mac OS support, and don't currently have an ETA for that. [Update just saw that someone commented on this being Windows already before]

German Bauer

I found this video while i was in the middle of trying to retarget some borked mixamo data and the addon really helped. Actually it didnt help at all, it gave me exactly the same issue, but it tried, and that made me feel much better and less annoyed, which really helped (the w quaternion rotation on the shoulders gets +90 degrees for no reason?? but if i retarget the same animation from mixamo downloaded with the skin its fine?) anyway awesome video, really relevant and helpful to me rn, and youre a good singer

Nate

That's soo cool, thanks ! Yeah I guess right now at least all the mac / linux users won't be able to install this addon, as it's Windows only. I actually pushed an issue on their github for this and I got feedbacks from rokoko devs, the good news is that it's completely the plan for them to support those OS'es as well for the final version, it's just that they first released the beta version on one OS only to get feedbacks first. At least I saw they pushed for now a fix to warn people that it won't work when you are not on Windows, should clear up some misunderstanding up front ;)

Hey Ian, excellent video! I'm not quite sure but did you end up showing us the process of rigging the figures? Was it manual or automatic?

Allan

AH! That's awesome to hear! I hope it works! Apparently a few folks have had trouble installing the addon.

Ian Hubert

great- thank you!!

Hey Mark! So- suit wise, I THINK the cheapest practical option is what I've currently got, a Rokoko suit. I absolutely love it- it's all accelerometer based, so you don't need external sensors or anything, just some wifi and the suit. Around 2,500 or so? That said, can you get cheaper?? I think so... I've seen some really cool demos of AI based skeleton extrapolation from video (the Kinect was doing stuff like that 10 years ago), and I suspect the technology is going to be to some level of production-ready fairly soon here. I haven't actually seen it used in anything yet, though, that I recall.

Ian Hubert

How do I super like this, had a client that needed simple mixamo animations retargeted to a rig with a tight turnaround and I thought I was going crazy, every single solution was so backwards and so time consuming. THANK YOU SO MUCH, this is literally going to change my life.

Daniel

Oh it doesn't? Dang, I didn't know that. Maybe I should have held off on talking about it, I was just really excited to finally have something that fixed so many issues I'd been having.

Ian Hubert

Apparently OSX isn't supported yet, but they're working on it. Heh

Okay, thanks - I found out that the addon doesn't support mac osx yet. Hopefully, an update will come soon

Yes I am on a MacBook Pro

Tyler Babb

I am using the newest version. 8.3.

Tyler Babb

I had problems installing it too, I got several messages, I do not remember if the one you are telling me also came out the solutions going to the directory where the message marked me and check if there was something that was not correct, I discovered the rest of an addon that I had installed and uninstalled days before and that left traces, I deleted it and then the installation worked

fab4_Blender

I'm having troubles installing, whenever I try to tick the box to enable the addon valueerror: _type_ 'v' not supported Was this similar to your issue? If so what was the solution?

I have the same issue; valueerror: _type_ 'v' not supported - are you on a MacBook, Tyler Babb?

Holy crap the transition from pure chaos to an actual bop at 6:26

Darren Penuliar

I already made it work. There was only some remnant of another old uninstalled addon that had left garbage, now if it works

fab4_Blender

I have blender version 2.83 installed

fab4_Blender

It is a very interesting addon !! thanks. I'm also having problems installing the addon I have blender version 2.83 installed

fab4_Blender

hey ian, thanks so much! On the topic of mocap... do you have any recommendations for people who'd want to get mocap gear (suits, equipment, etc) for filmmakers on a budget? (I always imagine you have to spend quite alot to get anything relatively decent). Again- thanks for being so charitable with your stuff!

This looks so exciting, gotta give it a try! By the way, I recently discovered your music is SO GOOD!. I can't stop watching "Everybody loves pasta" over and over.

Mornarion

Wow, this looks amazingly quick! As far as Photogrammetry is concerned for people, is this May 7th tutorial still your preferred workflow for the scan? https://www.patreon.com/posts/turning-people-36836508

Jeroen Van Harten

Ahaa! I thought I had searched through them all - must have glazed over that first one. From the first couple minutes, it looks like it's exactly what I was looking for! Cheers man. Also, isn't it like 4am in WA state? Quite the night owl.

Oooo- that probably WOULD be useful. Just a bit of smoothing to get rid of any jitter (or stylistically, for controlling quasi-animated characters, maybe)

Ian Hubert

AH! Yeah! I have two that I think are about exactly that. Maybe you've already seen them? I still want to get more in depth at some point. https://www.patreon.com/posts/re-animating-in-36909454 https://www.patreon.com/posts/making-shot-in-37501621 Here's another where I talk about the same sort of thing but from more of an after-effects perspective (at least in terms of tracking): https://www.patreon.com/posts/ae-to-blender-3d-34871595 It sounds like you've already dug through a lot of the tutorials, so maybe you've already seen these, but hopefully they help??

Ian Hubert

Oh interesting!!! So- I could have sworn in my experiments it turned out that if you hit "Alt+S" it always defaulted to the same size, and the FBX import scale was just a transform- but there's a 99% chance I was in a State of Ultimate Chaos, haha, yeah man- FBX scaling was the hardest part of this whole thing, for me! Thanks for the heads up on that; I suspect we'll all have to battle FBX scaling at some point in the future. And yeah! Pretty delighted they went the free route, actually! With any luck it's going to save a lot of headaches.

Ian Hubert

Super cool tut, Ian. Unrelated - but could you lay down some info on combining camera tracked shots with manually animated camera movement - like the shot in your drips/steam tutorial? That'd be killer.

That's a life-changing add-on, can't believe it's free. If I can give a Mixamo tip (I'm sure you know, but for other people): in the import screen where you check "auto orient bones" and stuff for the Mixamo animations, you also have to enter a different scale (don't leave it at 1), I don't remember the correct scale off the top of my head but I think it was like 0.1 or 0.05 or something...? But anyway this add-on solves a lot of problems!!! I thought it was part of buying the suit, which would have been fair enough. But free!! Whoa

Jan van den Hemel

Huh- interesting. I had a bit of trouble originally, but did a complete uninstall/reinstall and it's worked for me since. Which version of blender are you using?

Ian Hubert

I'm having trouble installing the add on.. Blender is not letting me check the box to enable it. Any help?

Tyler Babb

Fascinating as this was, the highlight for me was the impromptu performance at the end. :) Maybe keyframe decimation would be handy on that mocap data...

Pete Burges

Ah yeah!!! I poked around with that like literally 12 years ago or something, but that would be great to look into! Especially if it lets you "fade" between actions- that could be really cool. Thanks for the tip!!

Ian Hubert

Thank god it's there!

Particularly the guitar

Kai Christensen

Very cool. You're adding so much production value to so many of the community's renders by doing all this!

Kai Christensen

album when?

Chunky

I'm not sure if you have tried the NLA editor yet, but it might be helpful for you if you've got a large amount of characters. It's basically a more robust method of when you duplicated the conversing animation and offsetted it. It allows you to save animations as "actions" then you are able to loop them, stack them (ex. add an idle animation + a smoking animation, so your character can chat and smoke), or transition them.

Alex Doyi

Just what I needed, thanks Ian!

James Morr

hey!! So, I covered a lot of it in this video here: https://www.patreon.com/posts/turning-people-36836508 But I learned a bit since then, so I'll definitely try to create an updated version at some point soon, here!

Ian Hubert

T his is amazing! Photoscan tutorials pls!

Came for the tutorial, stayed for the guitar solo

Yes! Cont wait to see the nextDynamo.

dizamn

masterxeon1001