FLUX.2 [klein] 9B on 20 GB of VRAM
Yes. Q8_0 fits on 20 GB with 7.7 GB to spare. A distilled 9B FLUX.2 for fast generation and editing in a few steps. Much lighter than FLUX.2 dev.
Runs well
Yes, with room to spare.
Q8_0 (10.0 GB) needs about 12.3 GB in use, so 7.7 GB of the 20 GB stays free: room for a larger image, a LoRA or a ControlNet.
Best fileQ8_0
File size10.0 GB
VRAM needed~12.3 GB
System RAM32 GB+
Memory map · 20 GB GPU12.3 GB / 20 GB
010 GB20 GB
Weights Q8_0 · 10.0 GBWorking memory · 1.5 GBReserve · 0.8 GBFree · 7.7 GB
calculated How this is counted.
Got an RTX 40 or 50? Swap Q8_0 for FP8 (9.4 GB): same quality class, computed natively there.
01What to download
| Part | File | Folder | Size | |
|---|---|---|---|---|
| Model | flux-2-klein-9b-Q8_0.gguf Q8_0 · unsloth/FLUX.2-klein-9B-GGUF | models/unet | 10.0 GB | Download → |
| Text encoder | qwen_3_8b_fp8mixed.safetensors Qwen3 8B FP8 · Comfy-Org/flux2-klein-9B | models/text_encoders | 8.7 GB | Download → |
| VAE | flux2-vae.safetensors FLUX.2 VAE · Comfy-Org/flux2-dev | models/vae | 0.3 GB | Download → |
| Total download · keep about the same free on disk | 19.0 GB | |||
Alternatives: Qwen3 8B BF16 (16.4 GB). Sizes from Hugging Face, 2026-10-01.
Free ComfyUI workflow, tested on my RTX 5060 Ti: GGUF Q8_0 workflow (.json). Drag the file into ComfyUI. All workflows →
02Every file, on 20 GB
| File | Size | Needed | On this card | Quality | Download |
|---|---|---|---|---|---|
| 16-bit SAFETENSORS · black-forest-labs | 18.2 GB | 20.5 GB | spills 0.5 GB | the original weights | Hugging Face → |
| Q8_0 ← GGUF · unsloth | 10.0 GB | 12.3 GB | fits · 7.7 GB spare | practically identical to the original | Hugging Face → |
| FP8 SAFETENSORS · black-forest-labs | 9.4 GB | 11.7 GB | fits · 8.3 GB spare | practically identical to the original | Hugging Face → |
| Q6_K GGUF · unsloth | 7.9 GB | 10.2 GB | fits · 9.8 GB spare | very close to the original | Hugging Face → |
| Q5_K_M GGUF · unsloth | 7.0 GB | 9.3 GB | fits · 10.7 GB spare | close; small differences in fine detail | Hugging Face → |
| Q4_K_M GGUF · unsloth | 5.9 GB | 8.2 GB | fits · 11.8 GB spare | good; some loss in fine detail and text | Hugging Face → |
| Q3_K_M GGUF · unsloth | 4.8 GB | 7.1 GB | fits · 12.9 GB spare | noticeable loss of detail | Hugging Face → |
| Q2_K GGUF · unsloth | 4.0 GB | 6.3 GB | fits · 13.7 GB spare | heavy loss; a last resort | Hugging Face → |
“Needed” adds 1.5 GB of working memory for FLUX.2 klein 9B and a 0.8 GB reserve. Sizes 2026-10-01.