Since the last post and comments on the video format I started looking for examples of whether it was possible to blend the two.
I did discover liru and it seems like an interesting mix that works like a progressive movie control (albeit size being huge, but i think that can be acceptable if it's instead not online but downloadble only, perhaphs the online can be a trailer instead).
Is something like liru a better way of control the action vs a straight up mp4?