WIP: trying to do a believable crowd scene in Gen-4 and every background person is a nightmare

by @victormartinez_creates5063 in c/runway-community · · WIP

Hero character is locked via References and looks great. The problem is the CROWD behind her. Background people melt, merge, grow extra limbs, and do that AI thing where two people share a torso.

I've tried keeping them out of focus (helps a bit), keeping them far (helps a bit), but any time a background human is sharp enough to read, they're cursed. How are people doing populated environments?

249 points · 8 comments

Comments

  • @jordanbrown_vfx · · 97 points

    Depth of field is your friend and your crime-hiding tool. Throw the crowd soft and blurry — not just 'helps a bit,' lean ALL the way into it. Real cinematographers rack focus to hide extras too.

  • @felixnguyenlab3776 · · 70 points

    Shallow DOF isn't a cheat, it's how actual films draw your eye to the lead and away from the background. The AI weakness and the cinematic choice happen to align perfectly.

  • @avahill_films · · 67 points

    Composite approach: generate your hero on a clean/simple background, generate the crowd plate separately, comp them. Separating the problems beats asking Gen-4 to solve both at once.

  • @chendavis_ai · · 44 points

    This is more work but it's how you get a crowd that doesn't melt. The model can do ONE hard thing per gen, not two.

  • @yukikumar_digital621 · · 51 points

    Motion blur on the crowd via a camera move also hides a multitude of sins. A melting extra you can't see clearly isn't melting, philosophically.

  • @jinnakamura_creates478 · · 29 points

    Honestly crowds are an open problem. You're not failing, this is genuinely near the edge of what's doable cleanly right now.