Act-Two tip dump: how to stop your driven performance from looking like a puppet
Act-Two (drive a character with video of you acting) is incredible but easy to make creepy. What I've learned after a lot of uncanny attempts:
Match the energy of your performance to the character's face. If you over-act, a subtle AI face can't keep up and you get rubber-mask territory. Dial your performance DOWN.
Good even lighting on your driving video. Act-Two reads your facial landmarks; harsh shadows on your real face confuse the transfer.
Keep your head movement modest. Big fast head turns break the mapping. Think 'subtle actor,' not 'enthusiastic YouTuber.'
Done right it's the best lip-sync + performance tool out there because a HUMAN is doing the acting. You're not prompting emotion, you're performing it.