MagicTime tagged posts

Text-to-video AI blossoms with new metamorphic video capabilities

GIF of two vases filled with dandelions blossoming to illustrate text-to-video artificial intelligence advances.
MIGHTY MORPHING: “MagicTime is a step toward AI that can better simulate the physical, chemical, biological, or social properties of the world around us,” says computer science PhD student Jinfa Huang. (University of Rochester GIF created using MagicTime)

Using time-lapse videos as training data, computer scientists have developed video generators that simulate the physical world more accurately. While text-to-video artificial intelligence models like OpenAI’s Sora are rapidly metamorphosing in front of our eyes, they have struggled to produce metamorphic videos. Simulating a tree sprouting or a flower blooming is harder for AI systems than generating other types of videos because it requires the knowledge of the physical world and can vary widely.

But now, these models have ta...

Read More