A new artificial intelligence video generator from Meta can produce high-definition footage with sound, the company announced today. A few months ago, competitor OpenAI launched the text-to-video model Sora, but Movie Gen has not yet been publicly launched.
Movie Gen uses text input to automatically generate new videos, as well as edit existing footage or stills. new york times The audio added to the film was also reportedly generated by artificial intelligence, matching the images with ambient noise, sound effects and background music. Videos can be produced in different aspect ratios.
Meta says that in addition to generating new clips, Movie Gen can create custom videos from images, or take an existing movie and change different elements of it. One example shared by the company shows a static avatar of a woman; the added video shows her sitting in a pumpkin patch, sipping a drink.
Movie Gen can also be used to edit existing footage and change styles and transitions or add content that didn’t exist before. In one example shared by Meta, a relatively innocuous video of what appeared to be an illustration of a runner was edited in a different way by AI: In one frame, he was holding a pom-pom. In another photo, the background was edited to depict the desert. In the third scene, the runner wears a dinosaur costume. Changes can be made using text prompts.
Nearly two years after powerful AI image and video generators became mainstream, AI companies are pushing the technology even further: In the past six months alone, large tech companies like Google and OpenAI, as well as smaller startups, have Similar tools are being developed. OpenAI’s Sora was first announced in February but has yet to be released publicly; this week, one of the video generator’s co-leads left the company for Google.
Chris Cox, Meta’s chief product officer, wrote on Threads that the company “[isn’t] Prepare to release it as a product soon,” as it’s still expensive and takes too long to build.
Creatives such as filmmakers, photographers, artists, writers and actors are also worried about how AI generators will affect their livelihoods, and AI has been a central part of multiple strikes, including the Screen Actors Guild-American Television Federation History A joint Hollywood strike last year also included SAG-AFTRA and the Writers Guild of America (WGA).