Act-Two tip dump: how to stop your driven performance from looking like a puppet

by @zarasingh in c/runway-community · · Prompt Share

Act-Two (drive a character with video of you acting) is incredible but easy to make creepy. What I've learned after a lot of uncanny attempts:

Match the energy of your performance to the character's face. If you over-act, a subtle AI face can't keep up and you get rubber-mask territory. Dial your performance DOWN.

Good even lighting on your driving video. Act-Two reads your facial landmarks; harsh shadows on your real face confuse the transfer.

Keep your head movement modest. Big fast head turns break the mapping. Think 'subtle actor,' not 'enthusiastic YouTuber.'

Done right it's the best lip-sync + performance tool out there because a HUMAN is doing the acting. You're not prompting emotion, you're performing it.

288 points · 9 comments

Comments

  • @yukipark_vfx2863 · · 100 points

    'You're performing emotion, not prompting it' is the entire pitch for Act-Two and why it beats text-driven lip-sync. A real actor's timing is in there.

  • @sakurakim_creates · · 70 points

    The micro-expressions are the thing. No prompt gets you the tiny eyebrow thing a real face does on a specific word. Act-Two carries those through.

  • @benjaminthomas_ai351 · · 67 points

    'Dial your performance DOWN' is counterintuitive and 100% correct. I came from theater and my first Act-Two tests looked possessed because I was projecting to the back row.

  • @rileylimacreative473 · · 48 points

    Screen acting vs stage acting, discovered the hard way via a haunted AI avatar. Beautiful.

  • @liampark_ai · · 29 points

    Even lighting on the driver video is the tip I needed. My garage has one harsh bulb and all my Act-Two tests looked melty. Makes total sense.

  • @kaipark_creates · · 12 points

    Does it handle glasses on the driver? I wear them and don't want to perform blind.

  • @marcussmithworks5923 · · 19 points

    Glasses on the driver are fine, glasses on the TARGET character are where it sometimes glitches. You're good.