Ended up stumbling into something very similar to Nicolas Daniel's animations (https://twitter.com/nicolasdnl/status/1344713981718650880) with some of the effects I was developing, just added a few tweaks and voila ;)
I really like the way the lighting and shading turned out here too!