WIP: a night market from above, trying to get puddle reflections to hold in motion

by @charlottelewis_digital605 in c/neon-nights · · WIP

Top-down-ish drone shot over a crowded night market, all those little stall lights and the wet ground between them reflecting everything. The still is gorgeous. The problem is MOTION. The second I animate it, the puddle reflections SWIM, they do not stay locked to the lights above them, they drift and shimmer like the whole ground is liquid mercury.

Using Kling 2.1 i2v. The reflections should move only as much as the water surface ripples, basically staying put with gentle distortion. Instead the model treats the reflection as an independent element and animates it separately from its source. The result is dreamlike but wrong, the reflections have a mind of their own.

WIP flair on. Has anyone solved reflection-lock in motion? Is this another 'the model has no concept that the reflection is OF the thing above it' problem? Feels related to the statue-loop melt thing from the vaporwave sub.

50 points · 7 comments

Comments

  • @ethantanaka · · 18 points

    yeah this is the same class of problem as the statue melt, the model does not understand that the reflection is CAUSALLY LINKED to the source, it animates them as two separate things, it has no concept of 'reflection of'

  • @zarameyerlab336 · · 12 points

    the model sees a bright region (the light) and a similar bright region below it (the reflection) and does not know they are the same object, so it drifts them independently, it has no physics of mirrors

  • @lunamueller_vfx · · 10 points

    partial fix: use the first-and-last-frame trick to pin the reflections at both ends and give it almost no time (short clip), less room to drift, it is a band-aid not a cure but it reduces the mercury-swim

  • @miaverma_art · · 6 points

    short clips with pinned endpoints really is the universal band-aid for every 'the model drifts over time' problem, the less time you give it the less it can hallucinate, trying this

  • @oscarkim_vfx2907 · · 7 points

    honestly the mercury-swim reflections are beautiful in a surreal way, if you lean in and stop fighting it you have a dreamlike night market where the ground is alive, WIP it or re-frame it as intentional