Luma Launches New AI Model for Video Generation from Start and End Frames

Luma, an AI-powered video and 3D modeling startup backed by a16z, has unveiled a new model called Ray3 Modify that enables users to alter existing videos using character reference images while preserving the original performance. The tool also allows creators to define start and end frames to guide the generation of seamless transition sequences.

The company announced on Thursday that the Ray3 Modify model addresses a key challenge in AI-driven content creation—maintaining human expressiveness when editing or generating visuals for creative studios. According to Luma, this new model more accurately follows input footage, empowering production teams to integrate real actors into branded or imaginative video projects. The startup emphasized that Ray3 Modify excels at retaining the actor's original movements, timing, gaze direction, and emotional expression during scene transitions.

With Ray3 Modify, users can transform a source video by providing a character reference image, effectively converting a live-action performer’s appearance into a designated digital character. This reference helps preserve critical details such as costume design, facial likeness, and identity throughout the production process.

In addition, creators can supply both starting and ending frame references to generate interpolated video segments using the Ray3 Modify model. This feature is particularly valuable for maintaining continuity between scenes, offering precise control over character motion and behavioral nuances during transitions.

"Generative video models are highly expressive but often difficult to control. Today, we're excited to introduce Ray3 Modify—a breakthrough that bridges real-world performances with AI-driven creativity while giving full control back to creators. Creative teams can now capture performances on camera and instantly reimagine them in any virtual environment, change outfits, or even reshoot entire scenes with AI—without returning to physical sets," said Amit Jain, co-founder and CEO of Luma AI, in a statement.

Luma stated that the new model is now accessible through its Dream Machine platform. The release positions the company in direct competition with players like Runway and Kling, following the launch of its video modification capabilities in June 2025.