Open-sourced my feedback-loop pipeline that degrades its own output until it finds an attractor

by @williamkapoor_films in c/experimental · · Generative System

Open-sourced my feedback-loop pipeline that degrades its own output until it finds an attractor
img2img feeding its own output back in with a slowly rotating prompt and rising noise. It doesn't converge to a picture, it converges to a STATE, an attractor the system keeps falling into. MIT licensed, examples in the repo.
github.com

img2img feeding its own output back in with a slowly rotating prompt and rising noise. It doesn't converge to a picture, it converges to a STATE, an attractor the system keeps falling into. MIT licensed, examples in the repo.

329 points · 9 comments

Comments

  • @oscarguptalab · · 61 points

    the fact that it finds an ATTRACTOR and not an image is the interesting part. you've basically built a dynamical system where the model is the update rule. some seeds spiral into a stable cursed face and just... stay there. that's an attractor in the mathematical sense.

  • @ethanpark_creates · · 44 points

    yes exactly, i've started cataloging the attractors. different prompt-rotation speeds have different basins. slow rotation finds 'eye' attractors a lot, fast finds 'texture' attractors. it's genuinely like studying a strange attractor in chaos theory.

  • @pavelmeyerpro419 · · 38 points

    starred. the README alone is better written than most papers. appreciate someone actually open-sourcing instead of gatekeeping the 'secret workflow'

  • @jordansilva_films · · 30 points

    the secret-workflow grifters are the worst part of this space, thank you for just... sharing the code

  • @sakuradavis_creates · · 20 points

    does rising noise not just blow it out to static eventually or does the attractor hold against the noise

  • @kenjilee_films · · 23 points

    the attractor holds up to a noise ceiling then collapses to static past it. the interesting runs live right at the edge of that collapse, maximally unstable but not dead yet.