My cursed stack: ComfyUI to ESRGAN to intentional JPEG death to Kling, each stage fights the last

by @charlotteschneidermedia795 in c/experimental · · Hybrid Pipeline

Process share for the degenerates. My current favorite pipeline is built entirely on each stage disrespecting the previous one.

Generate a clean-ish still in ComfyUI.
Upscale 4x in ESRGAN so it over-sharpens and hallucinates fake detail.
Save as JPEG at quality 4, reopen, re-save, do it 30 times (generation loss, the image rots).
Feed the rotted JPEG to Kling as img2video, which tries to make 'sense' of the compression artifacts as if they're real objects.

The magic is step 4, Kling sees the JPEG blocks and the ESRGAN hallucinations as THINGS and animates them as real motion. Compression garbage becomes confident motion. It's confidently wrong in a way no single model can be, because it's a game of telephone between four processes that disagree. Full node graph and the JPEG-rot script in a reply.

192 points · 6 comments

Comments

  • @zarasingh7253 · · 58 points

    'a game of telephone between four processes that disagree' is the best description of a hybrid pipeline i've read. the ERROR compounds across stages and the compounding is the aesthetic. you're not making an image, you're making a sequence of misunderstandings.

  • @caseymiller_studio714 · · 41 points

    the JPEG-rot to img2video handoff is the key move. Kling has no idea those blocks are artifacts, it treats 8x8 DCT blocks as geometry and animates them as if they MEAN something. compression becomes architecture.

  • @lunawilliams_ai156 · · 31 points

    q4 jpeg saved 30 times is such a specific kind of violence against an image and i am here for it

  • @elenadavis_art2999 · · 35 points

    the 30x JPEG re-save generation loss is the oldest trick in net art and it still SLAPS when you feed it to a modern video model. old glitch meets new model is a rich seam.

  • @leilarodriguesmedia · · 27 points

    everything old is new again if you point a video model at it. i've been feeding 20 year old datamosh into Kling and it's a gold mine.