Workflow Share: my full character-consistency pipeline from design to finished shot, start to end

by @felixsingh_vfx8295 in c/character-animation · · Workflow Share

Enough people asked that I'm writing the whole thing out. This is how I take a character from a sketch to a shot that holds. It's a lot of steps because consistency is a lot of steps.

Lock the design. I generate ~20 candidate character sheets, pick ONE, and treat it as canon. No more design changes after this or everything downstream drifts.

Build the turnaround. Front, 3/4, profile, back. I use the chosen face as InstantID reference to generate the angles, then hand-fix until all four are unmistakably the same person. This is the dataset seed.

Train the LoRA on the turnaround + ~25 generated-and-cleaned variations (expressions, lighting). Diverse dataset, face constant.

Per shot: LoRA for the character + InstantID face-lock from the canon front view + pose/composition control (ControlNet or a reference). The LoRA does the body/outfit, InstantID enforces the face.

Motion: animate the still with image-to-video (Kling/Hailuo for body), then drive the face separately with Act-One for dialogue shots.

Face-lock cleanup pass: even with all this, 1 in 4 shots drifts a little. I fix the worst frames with a targeted face inpaint using the canon reference.

It's not push-button. Consistency is a PIPELINE, not a setting. Full node graph + the character bible in comments.

1,188 points · 7 comments

Comments

  • @avalee_studio · · 97 points

    the '1 in 4 shots still drifts even with all this, so budget a cleanup pass' honesty is what i needed to hear. I kept thinking I was doing it wrong because I STILL got drift. turns out even the full pipeline isn't perfect and a manual face-fix pass is just part of the job. that reframes everything.

  • @yukisantos_studio · · 61 points

    yep. nobody's at zero drift. the pros just have a fast cleanup pass and accept it as a line item, not a failure. consistency is asymptotic — you get to 'good enough that the audience doesn't notice', never to literal perfect.

  • @hanaschulz_ai · · 68 points

    this is genuinely more useful than any paid course on this. thank you for writing out all six steps including the unglamorous cleanup. saving and sending to everyone who asks me 'how do you keep her consistent'.

  • @irisrodriguesworks · · 98 points

    'consistency is a PIPELINE, not a setting' is the thesis statement for this entire sub. newcomers want the one magic checkbox and there isn't one. it's six disciplined steps and a cleanup pass. the people shipping consistent characters are all doing roughly THIS, with variations.

  • @sashayamamotoworks154 · · 99 points

    step 1 'lock the design and NEVER change it' is the one people skip and then wonder why nothing holds. if you're still tweaking the character's jacket in shot 30, you've been training on a moving target the whole time. canon means CANON.