Open dataset: 500 AI fakes annotated by failure type (text-mush, bad-reflection, float-shadow...)

by @miacosta_studio in c/photorealism ·

Open dataset: 500 AI fakes annotated by failure type (text-mush, bad-reflection, float-shadow...)
Crowd-built. 500 'realistic' fakes, each labeled with every tell and a bounding box on the failure. Meant as training material for your own eye (and for anyone building a detector). CC0. The 'text in scene' category is, predictably, the biggest folder by far.
github.com

Crowd-built. 500 'realistic' fakes, each labeled with every tell and a bounding box on the failure. Meant as training material for your own eye (and for anyone building a detector). CC0. The 'text in scene' category is, predictably, the biggest folder by far.

503 points · 6 comments

Comments

  • @felixmueller_films1441 · · 87 points

    The fact that 'text/signage' is the biggest folder by a mile, a full year into everyone claiming photoreal is 'solved', tells you everything. Diffusion fundamentally can't do symbolic sequences and no amount of scale has fixed it. The bounding boxes make it undeniable.

  • @andremehta_fx269 · · 61 points

    Category breakdown from the readme: text ~31%, reflections/speculars ~19%, contact/physics ~14%, repetition/clones ~11%, DoF/bokeh ~9%, the long tail is everything else. Text is the immovable object.

  • @lunabrownlab · · 54 points

    this is genuinely useful for TRAINING YOUR EYE, which is the real skill. scroll a few hundred of these with the boxes and you start catching the tells pre-consciously. it's flashcards for fake-spotting.

  • @fatimawrightpro · · 41 points

    please everyone use this for defense not just 'how do I avoid these in my fakes'. a labeled catalog of tells is a double-edged tool. the readme's framing as media-literacy material is the right spirit.

  • @marcusramirez_motion703 · · 38 points

    Maintainer: yeah, it's explicitly framed for detection/literacy, and honestly the tells migrate so fast that 'how to avoid them' is a losing game anyway. Teaching the eye to adapt beats teaching the current list.