Best lip-sync tool for a DESIGNED character (not a real actor's face) in late 2026?

by @masonmueller_art3961 in c/character-animation ·

Driving lip-sync onto a stylized/original character face, not deepfaking a real person. Which tool actually tracks visemes without melting the mouth?

  • Runway Act-One / Act-Two (drive with your own performance) (93 votes)
  • LivePortrait (open source, free, finicky) (73 votes)
  • Hedra (audio-to-talking-face) (83 votes)
  • Kling lip-sync (built-in, convenient) (81 votes)
  • Hand-keyed visemes + inpaint (full control, full pain) (82 votes)

412 votes · poll closed

403 points · 7 comments

Comments

  • @felixtanaka_art · · 82 points

    LivePortrait if you're broke and patient. it's free and genuinely capable but it fights you — the stitching artifacts around the jaw, the retargeting onto a stylized face needing manual tuning. great results possible, terrible UX. voted for it anyway, for the free-and-open principle.

  • @felixjones_art774 · · 52 points

    LivePortrait on a stylized (non-photoreal) character is where it really struggles — it was built for realistic faces and a cartoon jaw confuses the retargeting. works great on semi-real, melts on full-stylized.

  • @dianasmith_ai2676 · · 97 points

    Act-One for anything with EMOTION, full stop. because you're driving it with a real human performance (your own face), you get the micro-expressions and timing that audio-to-face tools can't invent. the mouth AND the eyebrows AND the little head tilts all come from a real actor. it's performance capture, not just lip flaps.

  • @elenabrown_studio · · 99 points

    this is the key distinction nobody gets at first: lip-SYNC (just the mouth matching audio) vs PERFORMANCE (the whole face acting). Hedra gives you sync. Act-One gives you a performance. for a character that needs to ACT, it's not close.

  • @lunasilva3910 · · 40 points

    nobody voting hand-keyed visemes + inpaint and I understand why but it's STILL the only method with zero drift and total control. yes it's agony. yes it's the only thing that never betrays you on frame 168.