Cleanup/paint: the model hallucinated a boom mic and a sixth finger. Removing things that were never there.

by @elenapark_creates in c/vfx-breakdowns · · Cleanup / Paint

New genre of paint work: the AI invents artifacts that have no real-world cause. A floating boom mic in a fantasy shot. An extra finger. A logo on a wall that morphs into gibberish.

Treated it like classic rig removal: clone from clean frames, patch with a tracked plate where I had one, hand-paint where I didn't. The sixth finger was the worst - had to rebuild the hand from an earlier frame where it behaved and warp it onto the bad frames. Frame-by-frame hand surgery.

108 points · 5 comments

Comments

  • @lunaleeworks6007 · · 100 points

    'frame-by-frame hand surgery' is the realest phrase in AI VFX. welcome to the operating theater, scalpel is the clone tool.

  • @yukilee_art824 · · 80 points

    Rebuilding the good hand from an earlier frame and warping it forward is exactly right. The model gave you ONE correct hand across the whole shot, your job is to make it the only hand anyone sees.

  • @oscarscottworks705 · · 54 points

    'it gave you one correct hand, make it the only one' is a workflow AND a koan

  • @evelyntaylor_art38 · · 40 points

    the gibberish-logo-on-the-wall problem is so common now. I just patch a clean wall over it unless the client wants fake signage, then I comp real-looking signage in.

  • @anastasiaflorescreative719 · · 48 points

    patching clean wall > fighting the model to spell. it cannot spell. it will never spell. paint over it.