All stories

Luma adds text-prompt video editing to Dream Machine

Luma has rolled out Modify with Instructions to all Dream Machine subscribers, letting users edit existing video clips with plain-language prompts for object removal, swaps, virtual sets and restyling.

Luma announced Modify with Instructions, a feature in its Dream Machine platform that lets users describe changes to existing footage in natural language instead of masking or regenerating clips by hand.

To use it, a user picks a single frame where the target element is clearly visible and types a prompt such as "change the red dress to a blue suit" or "replace the coffee cup with a wine glass." The system interprets the instruction from that frame, then applies the edit across the full clip.

Luma frames the tool around four groups of work: VFX (object removal, set extension, virtual weather and seasons), advertising (virtual product placement, ingredient swaps, virtual makeup), film and storytelling (virtual environments, set redesign, wardrobe and fashion changes) and design (restyling, retexturing, material and color swaps).

The company lists several limitations. A strength slider runs across three settings (Adhere, Flex and Reimagine), which trade preserving detail against larger changes. The object being modified should appear in the first frame. Videos that don't match Dream Machine's preset aspect ratios (9:16, 3:4, 1:1, 4:3, 16:9 and 21:9) are cropped and reformatted, and Luma warns that edit quality may degrade as a result.

The feature is available now to all Dream Machine subscribers. Luma called it "still early" and said it plans to expand its frame-level video editing capabilities in the coming weeks. The announcement does not give pricing changes, limits on clip length or resolution, or details of the underlying model.

Sources