Video-to-Video in Runway is mind-blowing.
I tried giving it a challenge and it’s incredible it was able to track all the balls so well. This was on the first try.
I uploaded the source video then used just a simple prompt. A man is juggling fireballs in a dimly lit room. And that’s it!
Also, it works super fast, this came back in just a minute or two. I have endless ideas for experimentation I’ll be testing out.
Futurepedia