FLUX.2 [klein] 4B on 8 GB of VRAM
Yes, but only just: Q8_0 leaves 1.9 GB free on 8 GB. The smallest FLUX.2: 4B parameters, Apache-2.0 licence, a few steps per image. Fits almost any modern card.
Runs well
Yes, just.
Q8_0 (4.3 GB) fits with only 1.9 GB to spare (about 6.1 GB of 8 GB).
Best fileQ8_0
File size4.3 GB
VRAM needed~6.1 GB
System RAM32 GB+
Memory map · 8 GB GPU6.1 GB / 8 GB
04 GB8 GB
Weights Q8_0 · 4.3 GBWorking memory · 1.0 GBReserve · 0.8 GBFree · 1.9 GB
calculated How this is counted.
Got an RTX 40 or 50? Swap Q8_0 for FP8 (4.1 GB): same quality class, computed natively there.
01What to download
| Part | File | Folder | Size | |
|---|---|---|---|---|
| Model | flux-2-klein-4b-Q8_0.gguf Q8_0 · unsloth/FLUX.2-klein-4B-GGUF | models/unet | 4.3 GB | Download → |
| Text encoder | qwen_3_4b_fp8_mixed.safetensors Qwen3 4B FP8 · Comfy-Org/z_image_turbo | models/text_encoders | 5.6 GB | Download → |
| VAE | flux2-vae.safetensors FLUX.2 VAE · Comfy-Org/flux2-dev | models/vae | 0.3 GB | Download → |
| Total download · keep about the same free on disk | 10.3 GB | |||
Alternatives: Qwen3 4B BF16 (8.0 GB). Sizes from Hugging Face, 2026-10-01.
Free ComfyUI workflow, tested on my RTX 5060 Ti: FP8 workflow (.json). Drag the file into ComfyUI. All workflows →
02Every file, on 8 GB
| File | Size | Needed | On this card | Quality | Download |
|---|---|---|---|---|---|
| 16-bit SAFETENSORS · black-forest-labs | 7.8 GB | 9.6 GB | spills 1.6 GB | the original weights | Hugging Face → |
| Q8_0 ← GGUF · unsloth | 4.3 GB | 6.1 GB | fits · 1.9 GB spare | practically identical to the original | Hugging Face → |
| FP8 SAFETENSORS · black-forest-labs | 4.1 GB | 5.9 GB | fits · 2.1 GB spare | practically identical to the original | Hugging Face → |
| Q6_K GGUF · unsloth | 3.4 GB | 5.2 GB | fits · 2.8 GB spare | very close to the original | Hugging Face → |
| Q5_K_M GGUF · unsloth | 3.1 GB | 4.9 GB | fits · 3.1 GB spare | close; small differences in fine detail | Hugging Face → |
| Q4_K_M GGUF · unsloth | 2.6 GB | 4.4 GB | fits · 3.6 GB spare | good; some loss in fine detail and text | Hugging Face → |
| Q3_K_M GGUF · unsloth | 2.1 GB | 3.9 GB | fits · 4.1 GB spare | noticeable loss of detail | Hugging Face → |
| Q2_K GGUF · unsloth | 1.8 GB | 3.6 GB | fits · 4.4 GB spare | heavy loss; a last resort | Hugging Face → |
“Needed” adds 1 GB of working memory for FLUX.2 klein 4B and a 0.8 GB reserve. Sizes 2026-10-01.