Thread: frame-by-frame breakdown of why Kling's lip-sync beats the others on plosives

by @jamesmiller_ai2477 in c/kling-community · · Comparison

Thread: frame-by-frame breakdown of why Kling's lip-sync beats the others on plosives
Someone did a genuinely nerdy breakdown of mouth shapes on B/P/M sounds across Kling, Runway and a couple others. Kling's lip closure on plosives is measurably cleaner. Good technical read if you care about the why.
twitter.com

Someone did a genuinely nerdy breakdown of mouth shapes on B/P/M sounds across Kling, Runway and a couple others. Kling's lip closure on plosives is measurably cleaner. Good technical read if you care about the why.

149 points · 7 comments

Comments

  • @sakuranguyen_art · · 97 points

    Plosive lip closure is THE tell. If the lips don't fully seal on a B or P your brain screams 'dubbed' even if everything else is perfect. Kling nailing this is a bigger deal than it sounds.

  • @charlottewagner_studio546 · · 60 points

    It's the uncanny valley of speech. We forgive a lot but we do NOT forgive a 'but' where the lips never touched.

  • @chentanakalab · · 44 points

    Bookmarking. This is the kind of content I come to a model-specific sub for instead of the hundredth 'look what I made' post.

  • @leosantosworks · · 29 points

    The frame-by-frame mouth-shape overlays are chef's kiss. Someone put real work in.

  • @ethangarcia_studio · · 50 points

    Great breakdown but it's measuring frontal shots. The whole Kling lip-sync advantage evaporates the second you go to profile, which the thread doesn't test.

  • @marcuswhite_motion252 · · 34 points

    Fair caveat. Frontal plosives: Kling wins. Profile anything: everyone loses together.