Check my GPU →

flux-2-klein-4b-Q8_0.gguf

The Q8_0 file of FLUX.2 [klein] 4B. 4.3 GB on disk, about 6.1 GB of VRAM to run without offloading. In ComfyUI it goes in models/unet.

4.3 GBmodels/unetFLUX.2 klein 4B
Fileflux-2-klein-4b-Q8_0.gguf
ModelFLUX.2 [klein] 4B (image model, 4B)
PrecisionQ8_0
Size4.3 GB
VRAM to fitabout 6.1 GB
FolderComfyUI/models/unet/
Loader nodeUnet Loader (GGUF) from the ComfyUI-GGUF custom nodes
Sourceunsloth/FLUX.2-klein-4B-GGUF on Hugging Face

Download flux-2-klein-4b-Q8_0.gguf (4.3 GB)

Where to put it

Put the file in ComfyUI/models/unet/ (portable version: ComfyUI_windows_portable/ComfyUI/models/unet/). Press R in ComfyUI or restart it, then pick the file in Unet Loader (GGUF) from the ComfyUI-GGUF custom nodes.

If a workflow says “Value not in list” for that node, the workflow expects a file with another name. Click the node and choose this one.

Which graphics cards it fits

VRAMThis fileBest file for that card (RTX 40/50)
6 GBOffload onlyShort by 0.1 GB: runs with part of it in system RAM, slowerflux-2-klein-4b-fp8.safetensors (4.1 GB)
8 GBRuns wellFits in VRAM, 1.9 GB to spareflux-2-klein-4b-fp8.safetensors (4.1 GB)
10 GBRuns wellFits in VRAM, 3.9 GB to spareflux-2-klein-4b.safetensors (7.8 GB)
12 GBRuns wellFits in VRAM, 5.9 GB to spareflux-2-klein-4b.safetensors (7.8 GB)
16 GBRuns wellFits in VRAM, 9.9 GB to spareflux-2-klein-4b.safetensors (7.8 GB)
20 GBRuns wellFits in VRAM, 13.9 GB to spareflux-2-klein-4b.safetensors (7.8 GB)
24 GBRuns wellFits in VRAM, 17.9 GB to spareflux-2-klein-4b.safetensors (7.8 GB)
32 GBRuns wellFits in VRAM, 25.9 GB to spareflux-2-klein-4b.safetensors (7.8 GB)
48 GBRuns wellFits in VRAM, 41.9 GB to spareflux-2-klein-4b.safetensors (7.8 GB)

Need = file × 1 + 1 GB for the picture and 0.8 GB for Windows and the browser — the same rule as the rest of the site.

Measured with this exact file

GPUTimeSizeStepsPeak VRAMSource
RTX 5060 Ti 16 GB4.3 s per image1024x1024412.4 GBmeasured by me, 2026-10-01

Time = sampling + VAE decode, after a warm-up run. Peak VRAM = memory in use on the whole card. How I measure.

What else you need

This file alone does not make a picture. With it you load:

RoleFileSizeFolder
Modelflux-2-klein-4b-Q8_0.gguf4.3 GBmodels/unet
Text encoderqwen_3_4b_fp8_mixed.safetensors5.6 GBmodels/text_encoders
VAEflux2-vae.safetensors0.3 GBmodels/vae

10.3 GB in total. Smaller text-encoder versions and other options are on the FLUX.2 klein 4B page.

Other files of FLUX.2 klein 4B

FilePrecisionSizeVRAM to fit
flux-2-klein-4b.safetensors16-bit7.8 GB9.6 GB
flux-2-klein-4b-Q8_0.ggufQ8_04.3 GB6.1 GB
flux-2-klein-4b-fp8.safetensorsFP84.1 GB5.9 GB
flux-2-klein-4b-Q6_K.ggufQ6_K3.4 GB5.2 GB
flux-2-klein-4b-Q5_K_M.ggufQ5_K_M3.1 GB4.9 GB
flux-2-klein-4b-Q4_K_M.ggufQ4_K_M2.6 GB4.4 GB
flux-2-klein-4b-Q3_K_M.ggufQ3_K_M2.1 GB3.9 GB
flux-2-klein-4b-Q2_K.ggufQ2_K1.8 GB3.6 GB

Same model, different compression. 8-bit files (FP8, INT8, Q8_0) look almost the same as 16-bit; below Q5 the loss starts to show.

Want the answer for your exact card? Check your GPU. Every file of every model: ComfyUI model files.

Size and source read from Hugging Face (2026-10-01).