Why do the arms always detach from the torso during fast spins? Viggle, Wan, doesn't matter, it happens on everything

by @liamnguyen9962 in c/dance-videos · · Need Help

Trying to do a turning routine — nothing crazy, basic chainé turns. Every model I've tried pops the arms off the shoulders for 2-3 frames at the fastest point of rotation and then snaps them back. Looks like a horror movie.

Stuff I've tried:
Lower CFG / motion strength — helps a little, kills the energy
Reference clip at higher fps — no change
Masking the torso — now the torso is static and the arms float, worse

Is this just a limitation of how these models handle self-occlusion when a limb crosses the body fast? Or am I missing a setting? Any help appreciated, this is the last bug before I can post my actual routine.

49 points · 8 comments

Comments

  • @dianaleecreative · · 72 points

    It's self-occlusion plus motion blur confusing the model about which arm is which. The classic fix is to shoot your reference at a HIGHER shutter (less blur per frame) so each frame has a crisp arm the pose estimator can lock onto. Counterintuitive but the blur is the enemy here, not the speed.

  • @victorpark_art1614 · · 18 points

    wait, less blur in the REFERENCE? not the output? let me try that tonight

  • @hiroshisinghworks · · 24 points

    also try a controlnet openpose pass on the turns specifically and composite it over the Viggle base. belt and suspenders but the shoulders stay planted.

  • @sakurakimworks · · 23 points

    skill issue (affectionate). the detaching arm is a rite of passage, welcome

  • @marcussmithlab218 · · 41 points

    every single one of us has shipped a video with one frame of flying arm and prayed no one scrubbed through it