FLUX.2 [klein] 4B on 6 GB of VRAM
Download FP8 (4.1 GB). With the model's working memory it needs about 5.9 GB, leaving 0.1 GB spare on 6 GB. Quality: practically identical to the original.
On RTX 40 and RTX 50 GPUs take the FP8 file instead of Q8_0: same class, faster there. On older NVIDIA, AMD and Intel GPUs Q8_0 is the better 8-bit file.
01What to download
| Part | File | Folder | Size | |
|---|---|---|---|---|
| Model | flux-2-klein-4b-fp8.safetensors FP8 · black-forest-labs/FLUX.2-klein-4b-fp8 | models/diffusion_models | 4.1 GB | Download → |
| Text encoder | qwen_3_4b_fp8_mixed.safetensors Qwen3 4B FP8 · Comfy-Org/z_image_turbo | models/text_encoders | 5.6 GB | Download → |
| VAE | flux2-vae.safetensors FLUX.2 VAE · Comfy-Org/flux2-dev | models/vae | 0.3 GB | Download → |
| Total download · keep about the same free on disk | 10.0 GB | |||
Alternatives: Qwen3 4B BF16 (8.0 GB). The 16-bit text encoder is a little more faithful; the smaller one is chosen here because it loads faster and needs less RAM. Sizes read from Hugging Face (2026-09-25). “Download” links start the file directly; the file name links are the same files the official ComfyUI workflows use.
System RAM: 32 GB or more. ComfyUI keeps the model file, the text encoder and the VAE in system RAM and moves them to the GPU as needed. With this set of files that is about 10.0 GB, plus roughly 6 GB for Windows, ComfyUI and a browser: 16.0 GB in total. With less RAM it still runs, but Windows starts swapping to disk and loading gets very slow. calculated
02Every file, on 6 GB
| File | Size | Needed | On this card | Quality | Download |
|---|---|---|---|---|---|
| 16-bit SAFETENSORS · black-forest-labs | 7.8 GB | 9.6 GB | 3.6 GB too big | the original weights | Hugging Face → |
| Q8_0 GGUF · unsloth | 4.3 GB | 6.1 GB | spills 0.1 GB | practically identical to the original | Hugging Face → |
| FP8 ← SAFETENSORS · black-forest-labs | 4.1 GB | 5.9 GB | fits · 0.1 GB spare | practically identical to the original | Hugging Face → |
| Q6_K GGUF · unsloth | 3.4 GB | 5.2 GB | fits · 0.8 GB spare | very close to the original | Hugging Face → |
| Q5_K_M GGUF · unsloth | 3.1 GB | 4.9 GB | fits · 1.1 GB spare | close; small differences in fine detail | Hugging Face → |
| Q4_K_M GGUF · unsloth | 2.6 GB | 4.4 GB | fits · 1.6 GB spare | good; some loss in fine detail and text | Hugging Face → |
| Q3_K_M GGUF · unsloth | 2.1 GB | 3.9 GB | fits · 2.1 GB spare | noticeable loss of detail | Hugging Face → |
| Q2_K GGUF · unsloth | 1.8 GB | 3.6 GB | fits · 2.4 GB spare | heavy loss; a last resort | Hugging Face → |
Sizes from the Hugging Face file listing, read 2026-09-25. “Needed” = file + 1 GB working memory for this model + 0.8 GB kept free for the system.
03The text encoder
Qwen3 4B: 8.0 GB as 16-bit, 5.6 GB as FP8. ComfyUI encodes the prompt first and can push the encoder out of VRAM before sampling, so it does not have to fit together with the model. On 6 GB the encoder itself is too big for VRAM, so let it run from system RAM: slower prompt encoding, same images.