0

Make-A-Video

 1 year ago
source link: https://makeavideo.studio/
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.
neoserver,ios ssh client

Make-A-Video

Make-A-Video research builds on the recent progress made in text-to-image generation technology built to enable text-to-video generation. The system uses images with descriptions to learn what the world looks like and how it is often described. It also uses unlabeled videos to learn how the world moves. With this data, Make-A-Video lets you bring your imagination to life by generating whimsical, one-of-a-kind videos with just a few words or lines of text.
overview.webp

A dog wearing a Superhero outfit with red cape flying through the sky

Make-A-Video with text

Bring your imagination to life and create one-of-a-kind videos

Surreal
Realistic
Stylized
A teddy bear painting a portrait
Robot dancing in times square
Cat watching TV with a remote in hand
A fluffy baby sloth with an orange knitted hat trying to figure out a laptop close up highly detailed studio lighting screen reflecting in its eye
A_teddy_bear_painting_a_portrait.webp

From static to magic

Add motion to a single image or fill-in the in-between motion to two images.

Single image
Pair of images
Input image
i2vsingle1input.webp
i2vsingle1input.webp
i2vsingle2input.jpg
i2vsingle3input.jpg
arrow-right-pano.png
Make-A-Video output
i2vsingle1.webp

Adding extra creativity to your video

Create variations of your video based on the original.

Input video
similarvid2input.webp
similarvid2input.webp
similarvid1input.webp
similarvid3input.webp
arrow-right-pano.png
Make-A-Video output
similarvid2a.webp
similarvid2b.webp
similarvid2c.webp
similarvid2d.webp

The New State of the Art in Video Generation

Meta_Icon_image-portability_outline.png
Better representation of text input*
Meta_Icon_highly-rated-content_outline.png
Higher quality*
*when compared to the previous state of the art via user studies.

Interested in trying Make-A-Video?

Let us know if you’re interested in gaining access to any future releases of our Make-A-Video research

Advancing AI responsibly

Meta AI is committed to developing responsible AI and ensuring the safe use of this state-of-the-art video technology. Our research takes the following steps to reduce the creation of harmful, biased, or misleading content.

Source Data

This technology analyzes millions of pieces of data to learn about the world. As a way to reduce the risk of harmful content being generated, we examine, applied, and iterated on filters to reduce the potential for harmful content to surface in videos.

Identifying as AI-generated content

Since Make-A-Video can create content that looks realistic, we add a watermark to all videos we generate. This will help ensure viewers know the video was generated with AI and is not a captured video.

A Work-in-Progress

Our goal is to eventually make this technology available to the public, but for now we will continue to analyze, test, and trial Make-A-Video to ensure that each step of release is safe and intentional.

Acknowledgement

Research Authors

Uriel Singer*, Adam Polyak*, Thomas Hayes*, Xi Yin*, Jie An, Songyang Zhang, Qiyuan (Isabelle) Hu, Harry Yang, Oron Ashual, Oran Gafni, Devi Parikh*, Sonal Gupta*, Yaniv Taigman*

*Core Contributors

Project Contributors

Mustafa Said Mehmetoglu, Jacob Xu, Katayoun Zand, Jia-Bin Huang, Jiebo Luo, Shelly Sheynin, Nadav Benedek, Shoshana Swell, Chantal Mora, Ana Paula Kirschner Mofarrej, Raghu Nayani, Eric Kaplan, Aiman Farooq, Alyssa Newcomb, Anne Davidson, Tamara Piksa, Michelle Restrepo, Natalie Hereth, Mallika Malhotra, Harrison Rudolph, Michael Friedrichs, Aran Mun, Angela Fan, Kelly Freed

Gallery

A_small_domesticated_carnivorous_mammal_with_soft_fur,_a_short_snout,_and_retractable_claws_second_upsample.webp

A small domesticated carnivorous mammal with soft fur, a short snout, and retractable claws

a_golden_retriever_eating_ice_cream_on_a_beautiful_tropical_beach_at_sunset,_high_resolution__22.webp

A golden retriever eating ice cream on a beautiful tropical beach at sunset, high resolution

A_musk_ox_grazing_on_beautiful_wildflowers._second_upsample.webp

A musk ox grazing on beautiful wildflowers

A_blue_unicorn_flying_over_a_mystical_land_second_upsample__16.webp

A blue unicorn flying over a mystical land

Humans_building_a_highway_on_mars,_highly_detailed._second_upsample.webp

Humans building a highway on mars, highly detailed

Sailboat_sailing_on_a_sunny_day_in_a_mountain_lake,_highly_detailed._second_upsample.webp

Sailboat sailing on a sunny day in a mountain lake, highly detailed

A_confused_grizzly_bear_in_calculus_class.__21.webp

A confused grizzly bear in calculus class

A_ballerina_performs_a_beautiful_and_difficult_dance_on_the_roof_of_a_very_tall_skyscraper;_the_city_is_lit_up_and_glowing_behind_her._second_upsample__44.webp

A ballerina performs a beautiful and difficult dance on the roof of a very tall skyscraper; the city is lit up and glowing behind her

A_knight_riding_on_a_horse_through_the_countryside_second_upsample__12.webp

A knight riding on a horse through the countryside

A_panda_playing_on_a_swing_set_second_upsample__1.webp

A panda playing on a swing set


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK