Luma AI’s Ray3 Modify brings actors and AI into perfect sync

MUMBAI: What if AI stopped guessing how humans move, feel and perform, and instead took its cues directly from them? Luma AI believes it has found the answer with Ray3 Modify, its latest video model now live on the Dream Machine platform.

Ray3 Modify is designed to make AI video feel less like a magic trick and more like a reliable creative partner. Rather than generating scenes from scratch, the model builds on real actor performances, preserving their timing, expressions and emotional intent while letting creators reshape the world around them.

For years, AI video has dazzled but frustrated. Performances could drift, emotions could flatten and continuity often slipped through the cracks. Ray3 Modify tackles this head on by anchoring every scene to human-led footage. The camera, the actor and the original performance become the director, with AI following their lead.

The result is a hybrid workflow that feels closer to a film set than a prompt box. Brands can shoot with actors and then place them in multiple environments without reshoots. Filmmakers can capture a performance once and reimagine it across worlds, styles and moods. Editors can revisit scenes long after the cameras have stopped rolling.

At the heart of Ray3 Modify are four standout upgrades. New start and end keyframes allow creators to control how scenes begin and conclude, keeping motion and framing consistent even in complex shots. Character Reference locks in a character’s identity, costume and likeness across an entire scene, a crucial step for actor-led projects. Performance Preservation ensures that eye lines, gestures and emotional beats remain intact. And an enhanced Modify Video pipeline improves how faithfully AI follows real-world movement and composition.

Luma AI CEO and co-founder Amit Jain, says the goal is creative control without creative compromise. Teams can shoot first and imagine later, changing locations, looks or even reworking scenes with AI, all without rebuilding the physical production.

Available now on Dream Machine, Ray3 Modify is aimed squarely at real production workflows across film, advertising and post-production. It signals a shift in AI video from spectacle to craft, where human performance sets the rhythm and AI fills in the rest.

In short, Ray3 Modify makes AI video less about replacing actors and more about amplifying them. And that might just be the performance upgrade creatives have been waiting for.