Check my GPU →

flux1-dev-Q4_K_S.gguf

The Q4_K_S file of FLUX.1 [dev]. 6.8 GB on disk, about 9.1 GB of VRAM to run without offloading. In ComfyUI it goes in models/unet.

6.8 GBmodels/unetFLUX.1 dev
Fileflux1-dev-Q4_K_S.gguf
ModelFLUX.1 [dev] (image model, 12B)
PrecisionQ4_K_S
Size6.8 GB
VRAM to fitabout 9.1 GB
FolderComfyUI/models/unet/
Loader nodeUnet Loader (GGUF) from the ComfyUI-GGUF custom nodes
Sourcecity96/FLUX.1-dev-gguf on Hugging Face

Download flux1-dev-Q4_K_S.gguf (6.8 GB)

Where to put it

Put the file in ComfyUI/models/unet/ (portable version: ComfyUI_windows_portable/ComfyUI/models/unet/). Press R in ComfyUI or restart it, then pick the file in Unet Loader (GGUF) from the ComfyUI-GGUF custom nodes.

If a workflow says “Value not in list” for that node, the workflow expects a file with another name. Click the node and choose this one.

Which graphics cards it fits

VRAMThis fileBest file for that card (RTX 40/50)
6 GBOffload onlyShort by 3.1 GB: runs with part of it in system RAM, slowerflux1-dev-Q3_K_S.gguf (5.2 GB)
8 GBOffload onlyShort by 1.1 GB: runs with part of it in system RAM, slowerflux1-dev-Q3_K_S.gguf (5.2 GB)
10 GBRunsFits in VRAM, 0.9 GB to sparethis file
12 GBRunsFits in VRAM, 2.9 GB to spareflux1-dev-Q5_K_S.gguf (8.3 GB)
16 GBRunsFits in VRAM, 6.9 GB to spareflux1-dev-fp8-e4m3fn.safetensors (11.9 GB)
20 GBRunsFits in VRAM, 10.9 GB to spareflux1-dev-fp8-e4m3fn.safetensors (11.9 GB)
24 GBRunsFits in VRAM, 14.9 GB to spareflux1-dev-fp8-e4m3fn.safetensors (11.9 GB)
32 GBRunsFits in VRAM, 22.9 GB to spareflux1-dev.safetensors (23.8 GB)
48 GBRunsFits in VRAM, 38.9 GB to spareflux1-dev.safetensors (23.8 GB)

Need = file × 1 + 1.5 GB for the picture and 0.8 GB for Windows and the browser — the same rule as the rest of the site.

Measured with this exact file

GPUTimeSizeStepsPeak VRAMSource
RTX 5060 Ti 16 GB47.3 s per image1024x1024208.8 GBmeasured by me, 2026-09-27

Time = sampling + VAE decode, after a warm-up run. Peak VRAM = memory in use on the whole card. How I measure.

What else you need

This file alone does not make a picture. With it you load:

RoleFileSizeFolder
Modelflux1-dev-Q4_K_S.gguf6.8 GBmodels/unet
Text encodert5xxl_fp8_e4m3fn.safetensors4.9 GBmodels/text_encoders
Text encoderclip_l.safetensors0.2 GBmodels/text_encoders
VAEae.safetensors0.3 GBmodels/vae

12.3 GB in total. Smaller text-encoder versions and other options are on the FLUX.1 dev page.

Other files of FLUX.1 dev

FilePrecisionSizeVRAM to fit
flux1-dev.safetensors16-bit23.8 GB26.1 GB
flux1-dev-Q8_0.ggufQ8_012.7 GB15.0 GB
flux1-dev-fp8-e4m3fn.safetensorsFP811.9 GB14.2 GB
flux1-dev-Q6_K.ggufQ6_K9.9 GB12.2 GB
flux1-dev-Q5_K_S.ggufQ5_K_S8.3 GB10.6 GB
flux1-dev-Q4_K_S.ggufQ4_K_S6.8 GB9.1 GB
flux1-dev-Q3_K_S.ggufQ3_K_S5.2 GB7.5 GB
flux1-dev-Q2_K.ggufQ2_K4.0 GB6.3 GB

Same model, different compression. 8-bit files (FP8, INT8, Q8_0) look almost the same as 16-bit; below Q5 the loss starts to show.

Want the answer for your exact card? Check your GPU. Every file of every model: ComfyUI model files.

Size and source read from Hugging Face (2026-10-01).