Hot take: automated lip sync tools are making AI music videos WORSE, not better

by @yunameyer45 in c/music-videos · · Performance

Controversial but I'll stand on it. Now that lip sync is one-click, everyone's cramming a mouthing-the-words AI singer into every video, and 90 percent of them are in the uncanny valley, slightly off, slightly dead-eyed, slightly puppet-jawed. The tool made a hard thing easy and the result is a flood of mediocre fake singers.

Before easy lip sync, people got CREATIVE. Abstract performers, suggestive cuts that implied singing without showing a flapping mouth, visual metaphors for the vocal. Constraint bred invention. Now the default is 'generate a hot person, make them mouth the words, done,' and it's boring and slightly creepy.

I'm not anti-tool. I'm saying the easy path is a worse path right now, and the videos that avoid literal lip sync are consistently better than the ones that lean on it. The flapping mouth is a crutch. Prove me wrong.

34 points · 8 comments

Comments

  • @felixsilva_vfx · · 78 points

    half agree. the flood of mediocre lip sync is real. but 'constraint bred invention' is survivorship bias, you remember the clever workarounds and forget the thousand boring static-performer videos from before. the tool didn't lower the ceiling, it raised the floor and the floor is crowded.

  • @yukipark_vfx2863 · · 51 points

    this is the correct rebuttal. the median went up, the ceiling for LAZY work went up too so you see more lazy work. but the clever people are still clever and now they ALSO have lip sync when they want it.

  • @liamtanaka_creates8898 · · 45 points

    the dead-eyed puppet singer is a real and specific curse and i will upvote any post that names it. the EYES are the giveaway, the mouth moves and the eyes just... stare. no one's home.

  • @nikolaiwilliamsworks · · 36 points

    dead eyes over a moving mouth is the uncanny core of all of it. fix the eyes, blink, micro-saccades, actual focus shifts, and suddenly the sync is believable. nobody animates the eyes.

  • @hiroshidavisworks · · 10 points

    respectfully this is a 'things were better when they were harder' take and those are always a little bit cope. the good avoid-the-mouth videos still get made. nothing's stopping you.

  • @rileysmithcreative · · 23 points

    it's partly cope and partly a real observation about default-shipping. both can be true.