Can the RTX 4060 Laptop 8 GB run FLUX.2 [klein] 9B?
Not at full quality. The 16-bit and 8-bit files are too big for the RTX 4060 Laptop 8 GB; the largest that fits is Q3_K_M (4.8 GB).
Q3_K_M (4.8 GB) fits with only 0.9 GB to spare (about 7.1 GB of 8 GB). Quality: noticeable loss of detail. For better quality, Q4_K_M (5.9 GB) also runs, with about 0.2 GB spilling into system RAM - a little slower, still practical.
Also try the FP8 file (9.4 GB) on this GPU. It does not fit entirely, but a current ComfyUI streams the overflow from RAM and native 8-bit files often beat a small GGUF that does fit. Dynamic VRAM →
01What to download
| Part | File | Folder | Size | |
|---|---|---|---|---|
| Model | flux-2-klein-9b-Q3_K_M.gguf Q3_K_M · unsloth/FLUX.2-klein-9B-GGUF | models/unet | 4.8 GB | Download → |
| Text encoder | qwen_3_8b_fp8mixed.safetensors Qwen3 8B FP8 · Comfy-Org/flux2-klein-9B | models/text_encoders | 8.7 GB | Download → |
| VAE | flux2-vae.safetensors FLUX.2 VAE · Comfy-Org/flux2-dev | models/vae | 0.3 GB | Download → |
| Total download · keep about the same free on disk | 13.8 GB | |||
Alternatives: Qwen3 8B BF16 (16.4 GB). Sizes from Hugging Face, 2026-10-01.
Free ComfyUI workflow, tested on my RTX 5060 Ti: GGUF Q8_0 workflow (.json). Drag the file into ComfyUI. All workflows →
02Every FLUX.2 klein 9B file on 8 GB
| File | Size | Needed | On this card | Quality | Download |
|---|---|---|---|---|---|
| 16-bit SAFETENSORS · black-forest-labs | 18.2 GB | 20.5 GB | 12.5 GB too big | the original weights | Hugging Face → |
| FP8 SAFETENSORS · black-forest-labs | 9.4 GB | 11.7 GB | 3.7 GB too big | practically identical to the original | Hugging Face → |
| Q8_0 GGUF · unsloth | 10.0 GB | 12.3 GB | 4.3 GB too big | practically identical to the original | Hugging Face → |
| Q6_K GGUF · unsloth | 7.9 GB | 10.2 GB | 2.2 GB too big | very close to the original | Hugging Face → |
| Q5_K_M GGUF · unsloth | 7.0 GB | 9.3 GB | spills 1.3 GB | close; small differences in fine detail | Hugging Face → |
| Q4_K_M GGUF · unsloth | 5.9 GB | 8.2 GB | spills 0.2 GB | good; some loss in fine detail and text | Hugging Face → |
| Q3_K_M ← GGUF · unsloth | 4.8 GB | 7.1 GB | fits · 0.9 GB spare | noticeable loss of detail | Hugging Face → |
| Q2_K GGUF · unsloth | 4.0 GB | 6.3 GB | fits · 1.7 GB spare | heavy loss; a last resort | Hugging Face → |
“Needed” adds 1.5 GB of working memory for FLUX.2 klein 9B and a 0.8 GB reserve. Sizes 2026-10-01.
03The text encoder
At 8.7 GB even the smallest Qwen3 8B file is too big for 8 GB, so it runs from system RAM. That slows down reading the prompt, not the picture. Sizes: 16-bit 16.4 GB, FP8 8.7 GB. Why the encoder does not count against VRAM →
04Measured and reported results
Nobody has sent measured numbers for this pair yet. If you run FLUX.2 klein 9B on a RTX 4060 Laptop 8 GB, send your time per image and peak VRAM and it will appear here, credited.
05With more VRAM
With 12 GB you could run FLUX.2 klein 9B at 8-bit or better (FP8, 9.4 GB) with no offloading: for example on the RTX 5070 12 GB, RTX 4070 Super 12 GB, RTX 4070 12 GB.
What changes from the RTX 4060 Laptop 8 GB to the RTX 5060 Ti 16 GB →
06About the RTX 4060 Laptop 8 GB
The RTX 4060 Laptop 8 GB is an Ada Lovelace GPU with hardware FP8, so ComfyUI can compute Comfy-Org's FP8 files natively: small and fast. (Plain FP8 files use FP8 maths with the --fast fp8_matrix_mult option.) As a laptop GPU it runs at a lower power limit than desktop cards (35–115 W depending on the laptop). The memory verdicts are the same; speed depends heavily on how much power the laptop maker allows.
8 GB GDDR6 · 128-bit · Ada Lovelace · 35–115 W. Everything that runs on it →
07Questions
How much VRAM does FLUX.2 klein 9B need?
Around 6.3 GB with the smallest file (Q2_K) and 11.7 GB with an 8-bit file (FP8). The full 16-bit file needs about 20.5 GB.
Which FLUX.2 klein 9B file should I download for the RTX 4060 Laptop 8 GB?
Q3_K_M (4.8 GB) from unsloth/FLUX.2-klein-9B-GGUF. Load it with Unet Loader (GGUF) from the ComfyUI-GGUF node pack.
FP8 or Q8_0 for FLUX.2 klein 9B on the RTX 4060 Laptop 8 GB?
FP8 (9.4 GB): the RTX 4060 Laptop 8 GB computes it natively, while Q8_0 (10.0 GB) is unpacked on the fly.
How much do I need to download for FLUX.2 klein 9B on the RTX 4060 Laptop 8 GB?
13.8 GB: flux-2-klein-9b-Q3_K_M.gguf, qwen_3_8b_fp8mixed.safetensors, flux2-vae.safetensors.