nolanlabs

Blog · The cut

How to cut video to music

· 6 min read

A line of red posts goes away over a flat plain at dusk, unevenly spaced in a clear rhythm.

Short answer

Frames per beat is fps × 60 ÷ BPM, so 120 BPM is 12 frames at 24 fps and 11.988 at 23.976. Work out where beats land from the start of the track rather than adding a fixed count, then check by ear. Cut mostly on downbeats and phrases. Save cuts on every beat for short stretches, or for picture made to the music.

On this page
  1. How do you turn BPM into frames?
  2. Why can’t you just cut every N frames?
  3. Why is cutting on every beat usually wrong?
  4. What should you cut on instead?
  5. Should the cut land on the beat or just before it?
  6. How does this work with an agent?

That sum tells you where the beats are, not where to cut. Cutting on every beat is usually wrong, because it’s too fast to read and gives every beat the same weight.

How do you turn BPM into frames?

Multiply the frame rate by 60, then divide by the BPM. A bar of 4/4 is four times that, and a four-bar phrase is sixteen times.

BPM 23.976 fps 24 fps 25 fps 30 fps Beat in seconds
60 23.976 24.000 25.000 30.000 1.000
70 20.551 20.571 21.429 25.714 0.857
90 15.984 16.000 16.667 20.000 0.667
100 14.386 14.400 15.000 18.000 0.600
120 11.988 12.000 12.500 15.000 0.500
128 11.239 11.250 11.719 14.063 0.469
140 10.275 10.286 10.714 12.857 0.429
174 8.268 8.276 8.621 10.345 0.345

The 23.976 column uses the exact rate, 24000/1001. Before you trust any row, confirm the BPM. A study of tempo estimation by Henkel and colleagues calls picking the wrong octave, half or double the tempo, a common problem, and says it’s often ambiguous even to human listeners.

Why can’t you just cut every N frames?

Because frames are whole and beats aren’t, so a fixed count drifts. At 128 BPM and 23.976 fps, a beat is 11.239 frames. Measured from the start of the track, the beats land on frames 0, 11, 22, 34, 45, 56, 67, 79, 90. The gaps run 11, 11, 12, 11, 11, 11, 12, 11. Cut every 11 frames and you’re a full frame early after about four beats, which is under two seconds.

The trap is worse when the number looks clean. At 120 BPM and 23.976 fps, a 12-frame grid seems exact, but the beat is 11.988. You’re a frame late after about 83 beats, or 42 seconds. By three minutes, you’ve cut 4,320 frames, which run 180.18 seconds, and you’re 4.3 frames behind the music.

So work out each position from the start: frame = round(beat number × frames per beat).

Even that only holds for music played to a click. When the mockups on La La Land were replaced by a 95-piece orchestra, Tom Cross told Steve Hullfish the live performance was elastic and fell differently against the cuts, and “we often had to roll picture cuts 1 or 2 frames.” Use the numbers for a first pass, then mark what you can see in the waveform and hear in the track.

Why is cutting on every beat usually wrong?

It’s too fast, and it’s flat. At 120 BPM, every beat means a 0.5-second shot and 360 cuts in three minutes. James Cutting gives an average shot length of 3.57 seconds for Revenge of the Sith and 1.71 seconds for Quantum of Solace, leaving out its opening credits. A cut on every beat at 120 BPM runs more than three times faster than that second figure. Twelve frames is enough to register a shape, but rarely enough to read what a shot is about.

Hullfish makes the length point too: sub-one-second edits can hold a 30-second promo but not an hour-long documentary. He adds that dancers don’t move on every beat, and that some beats go by with no motion at all.

The flatness matters more. Music already ranks its beats, and a cut on all of them erases the ranking. It also makes the next cut predictable. The drum scenes in Whiplash get called cutting to the beat, but Rob Hardy wrote at No Film School that Tom Cross’s work there is nothing like adding a cut for every quarter note.

The exception is real, and it has a condition. On Baby Driver, Paul Machliss said every line or beat of a song was a shot, because the scenes were planned around the songs and even small actions on set were counted in. The picture was shot for those cuts. Yours probably wasn’t.

What should you cut on instead?

Downbeats and phrases, mostly. The downbeat is the first beat of the bar. In a simple 4/4 backbeat, the accent falls on 2 and 4, so a cut there sits against the pulse. A phrase is often four bars in common-practice music, but count yours, because plenty of music doesn’t hold to that. On La La Land, Cross says Damien Chazelle planned particular moments to hit particular downbeats. That’s the idea: choose which ones matter.

Here’s a 30-second piece at 128 BPM in 4/4, on a 23.976 timeline. It’s exactly 64 beats, or 719.28 frames.

Cut on every Beats Frames each Shots in 30 s Shot length
Beat 1 11.239 64 0.47 s
Bar 4 44.955 16 1.88 s
Two bars 8 89.910 8 3.75 s
Four-bar phrase 16 179.820 4 7.50 s

Downbeats land on frames 0, 45, 90, 135, 180, 225, 270, 315 and 360. Phrases start at 0, 180, 360 and 539.

One plan, as an example rather than a recipe: two shots in the first phrase, four in the second, one held through the third, then three bars and four single beats in the fourth. That’s 14 shots against 64, an average just over two seconds, and the only beat-by-beat cutting is the last bar, where it reads as a push into whatever comes next.

Not everything has to be a cut. A shot’s own action can hit the beat, a hand coming down or a door closing, so slip the shot until it lands and let the cut sit elsewhere.

Should the cut land on the beat or just before it?

Try both. Rounding to the nearest frame never puts you more than about 21 ms off at 24 fps, and a whole frame is 41.7 ms at 24, 40 at 25, and 33.3 at 30.

One borrowed yardstick: thresholds reported in TV Technology put detection of sound-and-picture offset at about 45 ms with sound early and 125 ms with sound late. That’s lip-sync work, not research on music cuts, so read it as a hint. By that measure, a picture cut one frame late sits near the edge, while one or two frames early falls on the forgiving side. In our judgment, that’s a good reason to audition a cut a frame or two ahead of a hard beat, then keep whichever feels right on a full-speed play.

If you’ve shortened the picture since you cut it, recheck everything downstream. Tightening moves cuts off beats, and so does a split edit that puts the picture cut somewhere new.

How does this work with an agent?

In nolanlabs, our editor, the agent’s look tool shows a source’s sound as a picture, with the beats and the cuts over it. The reading behind it gives tempo, beats nudged to their attacks, hits, quiet stretches, and bars taken from the beat that lands hardest. So you can ask for cuts on the downbeats through the verse and a hold across the third phrase, and it can see where they fall. Bars come from the beat that lands hardest, so check the first one by ear on a track that accents elsewhere. And a cut that’s two frames off doesn’t need another turn: you drag it. More in Sound.

Blog

Keep reading.

Every piece

Written by the people who make nolanlabs, a video editor that edits with you.

Download for Mac Download for Windows Download

Free to start, on Mac and Windows.