Check my GPU →

flux-2-klein-9b-Q8_0.gguf

The Q8_0 file of FLUX.2 [klein] 9B. 10.0 GB on disk, about 12.3 GB of VRAM to run without offloading. In ComfyUI it goes in models/unet.

10.0 GBmodels/unetFLUX.2 klein 9B
Fileflux-2-klein-9b-Q8_0.gguf
ModelFLUX.2 [klein] 9B (image model, 9B)
PrecisionQ8_0
Size10.0 GB
VRAM to fitabout 12.3 GB
FolderComfyUI/models/unet/
Loader nodeUnet Loader (GGUF) from the ComfyUI-GGUF custom nodes
Sourceunsloth/FLUX.2-klein-9B-GGUF on Hugging Face

Download flux-2-klein-9b-Q8_0.gguf (10.0 GB)

Where to put it

Put the file in ComfyUI/models/unet/ (portable version: ComfyUI_windows_portable/ComfyUI/models/unet/). Press R in ComfyUI or restart it, then pick the file in Unet Loader (GGUF) from the ComfyUI-GGUF custom nodes.

If a workflow says “Value not in list” for that node, the workflow expects a file with another name. Click the node and choose this one.

Which graphics cards it fits

VRAMThis fileBest file for that card (RTX 40/50)
6 GBOffload onlyShort by 6.3 GB: runs with part of it in system RAM, slowerflux-2-klein-9b-Q3_K_M.gguf (4.8 GB)
8 GBOffload onlyShort by 4.3 GB: runs with part of it in system RAM, slowerflux-2-klein-9b-Q3_K_M.gguf (4.8 GB)
10 GBOffload onlyShort by 2.3 GB: runs with part of it in system RAM, slowerflux-2-klein-9b-Q5_K_M.gguf (7.0 GB)
12 GBOffload onlyShort by 0.3 GB: runs with part of it in system RAM, slowerflux-2-klein-9b-fp8.safetensors (9.4 GB)
16 GBRuns wellFits in VRAM, 3.7 GB to spareflux-2-klein-9b-fp8.safetensors (9.4 GB)
20 GBRuns wellFits in VRAM, 7.7 GB to spareflux-2-klein-9b-fp8.safetensors (9.4 GB)
24 GBRuns wellFits in VRAM, 11.7 GB to spareflux-2-klein-9b.safetensors (18.2 GB)
32 GBRuns wellFits in VRAM, 19.7 GB to spareflux-2-klein-9b.safetensors (18.2 GB)
48 GBRuns wellFits in VRAM, 35.7 GB to spareflux-2-klein-9b.safetensors (18.2 GB)

Need = file × 1 + 1.5 GB for the picture and 0.8 GB for Windows and the browser — the same rule as the rest of the site.

Measured with this exact file

GPUTimeSizeStepsPeak VRAMSource
RTX 5060 Ti 16 GB8.5 s per image1024x1024413.5 GBmeasured by me, 2026-10-01

Time = sampling + VAE decode, after a warm-up run. Peak VRAM = memory in use on the whole card. How I measure.

What else you need

This file alone does not make a picture. With it you load:

RoleFileSizeFolder
Modelflux-2-klein-9b-Q8_0.gguf10.0 GBmodels/unet
Text encoderqwen_3_8b_fp8mixed.safetensors8.7 GBmodels/text_encoders
VAEflux2-vae.safetensors0.3 GBmodels/vae

19.0 GB in total. Smaller text-encoder versions and other options are on the FLUX.2 klein 9B page.

Other files of FLUX.2 klein 9B

FilePrecisionSizeVRAM to fit
flux-2-klein-9b.safetensors16-bit18.2 GB20.5 GB
flux-2-klein-9b-Q8_0.ggufQ8_010.0 GB12.3 GB
flux-2-klein-9b-fp8.safetensorsFP89.4 GB11.7 GB
flux-2-klein-9b-Q6_K.ggufQ6_K7.9 GB10.2 GB
flux-2-klein-9b-Q5_K_M.ggufQ5_K_M7.0 GB9.3 GB
flux-2-klein-9b-Q4_K_M.ggufQ4_K_M5.9 GB8.2 GB
flux-2-klein-9b-Q3_K_M.ggufQ3_K_M4.8 GB7.1 GB
flux-2-klein-9b-Q2_K.ggufQ2_K4.0 GB6.3 GB

Same model, different compression. 8-bit files (FP8, INT8, Q8_0) look almost the same as 16-bit; below Q5 the loss starts to show.

Free workflow with this file

Drag the .json into ComfyUI. All free workflows →

Want the answer for your exact card? Check your GPU. Every file of every model: ComfyUI model files.

Size and source read from Hugging Face (2026-10-01).