After burning a full week of vacation on this, I got a first working prototype of the benchmark tool. The idea is to measure VaM performance in a scene that is identical for everyone with as little random factors as possible. VaM's settings should be enforced to be the same for everyone to make the results actually comparable. That will allow us to gather solid performance data for VaM and system info on different peoples machines, instead of comparing apples with oranges because the other person had setting X enabled or was 1m further from the character.
Note that there is no video editing here, all camera cuts and fade to black are made entirely in VaM. I think that particular plugin, in combination with LogicBricks StateMachine obviously, could be useful for story scenes? The jitter obviously comes from not capturing the video with VSync enabled, as you hopefully learned to do in my tutorial. But a benchmark with VSync enabled is not useful :D
So far nobody responded to my call for a commission, so the scene itself is just a placeholder with mocap by ReignMocap. Although I might as well use it, but I would need a second scene with two characters. Possibly I might use one of the sub-scenes in Acid's Intimate scene. As said, I just burned some 40+ hours during vacation, just getting the coding somewhere around 60% done. There is still plenty of stuff to do, I don't have the capacity at the moment to build a major quality scene. So we will see where this goes.