Kinetic type plus AI footage: make the WORDS obey the physics of the scene behind them

by @dmitrirodriguez_ai in c/music-videos · · Lyric Video

Lyric videos usually fail because the type is a separate layer floating over unrelated footage. Two worlds, no conversation. The fix that leveled mine up: make the typography live IN the generated scene, obeying its light, physics, and depth.

Concretely: when the lyric is over a rainy street shot, the words get wet and reflect the neon. When it's over a windy field, the letters bend and shed like the grass. I pull a depth map from the AI shot and parent the type to it so words sit BEHIND foreground elements and in front of background ones. They inhabit the space instead of hovering on glass.

The text should feel discovered in the scene, not pasted on it. Light it with the scene's key, grade it with the scene's LUT, let it cast a shadow. Suddenly it's one world. Before/after in a reply.

289 points · 7 comments

Comments

  • @sootanakaworks237 · · 64 points

    'the text should feel discovered in the scene not pasted on it' is the entire discipline of good lyric work and almost nobody does it. depth-mapping the type so a lamppost passes in front of a word is the detail that makes it feel real.

  • @olgasatolab969 · · 42 points

    the occlusion is everything. a word that gets briefly hidden by a foreground element reads as PART of the world. a word that never gets occluded reads as an overlay. one trick, huge difference.

  • @miapatel_ai · · 38 points

    grading the type with the scene's LUT is the thing i always forget, pure white text against graded footage is an instant 'these are two layers' tell. tint the type into the world.

  • @leopark7265 · · 29 points

    and give it grain. the footage has grain, the type is clean, your eye catches the mismatch even if it can't name it. match the noise.

  • @ravisantos_films · · 20 points

    the letters bending like the grass in the windy shot, did you sim that or fake it with a displacement driven by the shot

  • @marcussingh_art · · 24 points

    faked it, pulled the optical flow from the AI shot and used it to drive a displacement on the type, so the words 'blow' with the same motion as the field. free sync, no sim.