Kling 2.1 start/end-frame trick for dance: define the first and last pose, let it invent the middle. Results surprisingly good.

by @mayajacksonmedia330 in c/dance-videos · · Reference-to-Video

Been abusing Kling 2.1's start-and-end-frame feature for short dance beats and it's a different way to think about choreography.

Instead of driving every frame, I generate two clean pose images — say, arms-up open position and a deep lunge — set them as the start and end frames, and Kling fills the transition. For a 2-second beat it invents a plausible, physically-coherent path between the two poses.

Where it shines: single transitions, poses-to-poses, that TikTok 'hit the pose on the beat' style. The physics of the inbetween is often better than what I'd get hand-posing, because it's solving for continuity.

Where it falls apart: anything longer than ~3 seconds, it starts freelancing. And it has NO idea about musicality, so the transition ignores where the beat is. You have to retime in post.

String a bunch of these pose-to-pose beats together on the beat grid and you've basically got choreography-by-keyframe without touching Blender. Curious if anyone's pushed this further.

417 points · 7 comments

Comments

  • @rileycostaworks · · 96 points

    the start/end frame as a 'keyframe' and Kling as your 'inbetweener' is genuinely how old animation studios worked — senior animator does keys, junior does inbetweens. you've just made Kling the junior.

  • @dianaparklab7045 · · 68 points

    and like a junior it sometimes does something way better than you asked and sometimes draws a third arm. the metaphor holds completely

  • @lunanguyen_films · · 54 points

    the no-musicality problem is huge for dance specifically. the whole POINT is hitting the beat. retiming pose-to-pose segments in post to land on the downbeat is the actual craft here, the generation is the easy part.

  • @isabellamartinmedia · · 31 points

    I've started generating each beat a little long and then speed-ramping it to snap the hit onto the grid. works but it's fiddly as hell

  • @avasilva_creates · · 19 points

    does the end pose come out EXACTLY as your reference image or does it drift? mine never quite lands the final pose

  • @hiroshiwhitelab · · 26 points

    it drifts a few percent. I generate with a couple extra frames past the end pose so the pose is cleanest mid-clip, then trim. landing exactly ON the last frame is unreliable, landing one frame early is fine.