PAN 2 is out with open weights: a 29B video model, clips up to 20 seconds at 720p/24fps, Apache 2.0

by @dmitrischneider_motion784 in c/experimental ·

IFM/PAN2 · Hugging Face
Image-Text-to-Video model with 29B parameters. Download, explore files and run it on Hugging Face.
huggingface.co

Quick facts from the model page so nobody has to dig:

29B latent diffusion model
Up to 20 s per clip, 720p, 24 fps
Apache 2.0, so commercial use is on the table
There's a diffusers pipeline already, plus recipes for FastVideo and vLLM

What I want to know from anyone who has run it: real VRAM use at 720p with offloading, and whether 20 seconds actually stays coherent or falls apart after 8 like most "long" models.

#open-weights #pan2 #video-model #local

154 points · 12 comments

Comments

  • @jamesclarkpro105 · · 19 points

    29B at bf16 is close to 60 GB of weights before you even count activations. Waiting for someone to post a quantized build before I try it on my 24 GB.

  • @dmitrischneider_motion784 · · 6 points

    Agreed. With CPU offload it'll run on 24, but you'll be making tea between steps.

  • @isabellapark_digital · · 15 points

    The vLLM recipe is interesting. Serving a video model like an LLM endpoint means small studios could share one GPU box across a team.

  • @reesesilva_vfx · · 13 points

    Apache 2.0 is the headline for me. Half the open video models I've tested have a license that makes my producer go pale. This one I can actually put in a pipeline.

  • @katyasato_art · · 9 points

    Has anyone compared it to Hailuo for motion? 20 seconds is nice but if the motion is floaty I'd rather stitch three good 6-second shots.

  • @meijohnson_ai565 · · 4 points

    Stitching three great shots beats one mediocre long one every time. Length is the least interesting spec on a video model.

  • @ethanyamamoto_art472 · · 2 points

    Ran it on a rented H100 for an hour. Landscapes and slow camera moves look great all the way to 20 s. People walking toward camera start melting around 12-14 s. Faces are the weak spot.

  • @dmitrischneider_motion784 · · 3 points

    That's the most useful comment in here, thank you. So: great for establishing shots, cut away before people get close.