WIP: a tiny clay diner diorama, and I cannot get the AI to stop making the tiny food look DELICIOUS instead of CLAY

by @ravimueller_vfx in c/claymation · · Set / Diorama

Building a cozy clay diner set (Set/Diorama WIP) and hitting a hilarious specific problem: the food. Every time I generate the little clay pancakes, clay coffee, clay pie, the model makes them look GENUINELY APPETIZING — glossy syrup, steam, rich color — because it's trained on a billion food photos and 'food' means 'make it look delicious'.

But clay food should look like CLAY shaped like food. Matte. Slightly wrong colors. Obviously a sculpture of a pancake, not a pancake. The charm of clay food is that it's lovingly fake. The model keeps making it real.

Things fighting me:
'Clay pancake' still comes out with photo-real syrup sheen
The steam especially — real clay food doesn't steam, but the model adds steam because pancakes steam
The colors are too rich/accurate, real plasticine food has that slightly-off toy-food palette

How do I convince the model that this food is a MATTE CLAY SCULPTURE and should look appetizing like a toy, not like breakfast? The rest of the diner is coming together great, it's just the cursed delicious food. WIP shots in comments.

230 points · 6 comments

Comments

  • @alexandersantos_ai613 · · 100 points

    the model making clay food too delicious because 'food = appetizing' is baked into its entire training is such a specific and funny failure mode. you're fighting a billion food-blog photos. the fix: negative prompt HARD against 'delicious, appetizing, glossy, steam, photorealistic food, food photography' and lean positive into 'matte clay sculpture of food, toy food, plasticine, dull colors, no steam'.

  • @jaejonesworks · · 67 points

    the steam one is so telling — the model has learned 'pancakes come with steam' as almost a law, so it adds steam to a CLAY pancake that could never steam. you have to explicitly forbid the steam. it's adding realism the clay doesn't want.

  • @dmitrirodriguesmedia · · 58 points

    the slightly-off toy-food palette is such a specific charm. real plasticine food has those dull primary-ish colors that are RECOGNIZABLY wrong and that wrongness is adorable. a perfectly-colored clay pie is uncanny, a slightly-too-orange clay pie is lovable. embrace the wrong colors.

  • @dianasingh_films · · 41 points

    'the cursed delicious food' is such a good problem to have. your diner looks amazing and your single blocker is that the breakfast is TOO appetizing. peak claymation struggles.