Blog · Agents
Prompt box or timeline?
· Updated · 5 min read
Short answer
Use a prompt box when the picture doesn't exist yet, and a timeline when it does and the note is about timing. A generator makes new pixels; a timeline moves frames you already have. Most real jobs use both: generate the shot you never got, then cut it. A prompt can drive either one, so ask what the prompt is driving.
On this page
What does a two-frame fix cost?
On a timeline, a few keypresses. In a prompt box it has no cheap form at all. Take an 8-second shot at 24 fps, cut two frames too long. Here’s that note on each route, at Runway’s API rates as of November 2026. App plans price differently.
| Route | What happens | Cost | What you lose |
|---|---|---|---|
| Trim on a timeline | Two frames stop playing | No generation | Nothing. The frames are still in the source |
| Agent on a timeline | It sends the same trim | One agent turn | Nothing, but it’s slower than the keys |
| Gen-4.5, generate again | A new 8-second take | 96 credits, $0.96 | The take |
| Aleph 2.0, edit your clip | A new video made from yours | 224 credits, $2.24 | Every pixel goes through the model |
The money is small. The real cost is the last column. You liked that take, and a new one has a different gesture, light and framing, and it may no longer match the shots either side of it. The same seed on an identical request gives only “similar” results.
The unit doesn’t fit either. Gen-4.5’s shortest video is 2 seconds, so the smallest thing you can buy is 48 frames, and you wanted to change 2.
Nobody sensible regenerates for two frames, and that’s the point. The note needs a timeline, so a generated film ends up on one anyway.
What can a prompt box do that a timeline can’t?
Make the shot you never got. No amount of trimming gives you a harbor at dawn if nobody was at the harbor. That’s a real strength, and it changes what a small project can attempt:
- Missing shots and pickups. Adobe now pitches it this way: Premiere’s tool lets editors “generate video to fill gaps in their timeline”, with Firefly and partner models.
- Previz and pitches, where a rough picture of an idea beats a storyboard.
- Going past your handles. Omni Flash can generate a 3 to 10 second continuation of a clip. A timeline can only hold on the last frame.
- Changing what’s in the frame. Aleph 2.0 edits a clip of 2 to 30 seconds from a prompt and up to 5 keyframe images. It can deliver ProRes and expand to a new aspect ratio. Input tops out at 1080p and 30 fps.
The limits come with the method. Google’s docs say “Each turn in the conversation produces a new video”, uploads for editing must be 10 seconds or less, and its prompt guide suggests adding “Keep everything else the same”. That’s a request, not a guarantee.
Which tool fits which note?
Sort a round of notes this way before you open anything. The third column is a separate question, because an agent on a timeline takes a prompt and edits what’s already there.
| The note | Prompt box | Timeline by hand | Agent on a timeline |
|---|---|---|---|
| “Two frames earlier” | No cheap form | Best: a few keys | Works, but slower |
| “Use take 3 here” | Can’t reach it | Good if you know where it is | Good: finds it by the words said |
| “8 seconds out of the second half” | Makes a new video | Good, and slow | Best first pass, then you adjust |
| “Find every flash frame” | No | Slow, by eye | Best: one pass, with timecodes |
| “Same cut in 9:16” | Expands the frame, changing pixels | Good, one clip at a time | Best first pass |
| “A harbor at dawn” | Best | No | Only with a generator connected |
| “Hold 2 seconds longer”, no handles | Best | Freeze frame | Only with a generator connected |
| “Make it dusk” | Strong, whole frame | A grade gets part of the way | The same grade, by words |
The bold cells are our judgment, not a benchmark, and so is this: most notes in a round of an edit sit in the top half. Two of them have their own guides: the 9:16 version and dusk from day.
How to test any tool on your footage
Run this in any editor with a Difference blend mode. It takes five minutes.
- Ask the tool for a change to one thing in a clip: a sign, or a coat color.
- Put the result on the track above the original, lined up to the frame.
- Set the top clip’s blend to Difference. Black means unchanged. Faint noise is usually just compression.
- Look for structure outside what you asked for: edges, faces, text. That’s pixels the model changed.
- Run the same request a second time and compare the two results.
A masked change on a timeline should stay near black outside the mask, because nothing else was redrawn. A generator usually won’t, and for a previz or an effects element that may not matter. For a shot a client signed off on, you want to know before you deliver.
Most jobs use both, so plan for the hand-off
The order that works is to generate first and lock the cut later. Three habits make it cheaper:
- Generate handles. For a 6-second hold, ask for 8. At Gen-4.5’s rate those two seconds cost $0.24 and give you about a second each side to trim into.
- Keep every take you like as a file. Assume you can’t summon it again.
- Do color and timing last, on the timeline, so a regenerated shot doesn’t undo them.
Some products hold both in one place. Cardboard generates video and keeps each shot as its own clip on a timeline, which suits someone building a video from nothing.
nolanlabs, which we make, is the other half only: an agent on a timeline, Nolan Edit or your own, sending the same edits as the buttons, so the two-frame fix stays in your hands and you never wait for a turn. Today it doesn’t generate footage, so a shot you never got has to come from elsewhere and arrive as a clip. What the agent does shows as a proposal you can undo in one step. The two-frame fix by hand costs nothing; Nolan Edit’s turns are counted in credits, 100 a month without a plan.