Blog: Runway Ml

3 models and 3 concepts that interest me:

U-GAT-IT uses unsupervised image-to-image translation to stylize images and video to look like anime illustrations. I want to use this model to create an anime short! The idea is to take existing video, run it through the model then re-dub it to create a new storyline.
The First Order Motion Model allows you to generate a video sequence from a still source image by animating it to match the motion of the driving video. My grandmother, who was essentially my second parent, passed away when I was in middle school. I often wonder what conversations with her would be like if she was alive now that I'm an adult. It would be interesting to use the First Order Motion model to animate a portrait of her saying some stuff to me.
Liquid Warping: Liquid Warping is a model that allows you to imitate human motion and appearance by inputting a video you would like to imitate and then a target you’d like to change. I want to use the motion imitation feature to recreate an animated short released by Disney. The short is called Us Again and the two characters seriously look like my partner and I. We had joked about recreating the video. We haven’t gotten to it yet, but this would be a fun edit in the meantime.

Collage