FLUX.1 [dev] on 12 GB of VRAM
Download Q5_K_S (8.3 GB). With the model's working memory it needs about 10.6 GB, leaving 1.4 GB spare on 12 GB. Quality: close; small differences in fine detail. For better quality, Q6_K (9.9 GB) also runs, with about 0.2 GB spilling into system RAM — a little slower, still practical.
Worth trying on NVIDIA GPUs: with an up-to-date ComfyUI, Dynamic VRAM (on by default for NVIDIA since March 2026) streams whatever does not fit from system RAM, and ComfyUI's own start-up message recommends native FP8/INT8 files over GGUF, saying they “will be faster even if they are larger than your memory”. So before settling for a heavily compressed GGUF, try the native FP8 file (11.9 GB). The file recommended above is the best one that fits entirely — the safe choice on older ComfyUI versions, AMD and Intel. Comfy blog: Dynamic VRAM →
01What to download
| Part | File | Folder | Size | |
|---|---|---|---|---|
| Model | flux1-dev-Q5_K_S.gguf Q5_K_S · city96/FLUX.1-dev-gguf | models/unet | 8.3 GB | Download → |
| Text encoder | t5xxl_fp8_e4m3fn.safetensors T5-XXL FP8 · comfyanonymous/flux_text_encoders | models/text_encoders | 4.9 GB | Download → |
| Text encoder | clip_l.safetensors CLIP-L · comfyanonymous/flux_text_encoders | models/text_encoders | 0.2 GB | Download → |
| VAE | ae.safetensors FLUX.1 VAE (ae) · Comfy-Org/Lumina_Image_2.0_Repackaged | models/vae | 0.3 GB | Download → |
| Total download · keep about the same free on disk | 13.8 GB | |||
Alternatives: T5-XXL FP16 (9.8 GB). The 16-bit text encoder is a little more faithful; the smaller one is chosen here because it loads faster and needs less RAM. Sizes read from Hugging Face (2026-09-25). “Download” links start the file directly; the file name links are the same files the official ComfyUI workflows use.
System RAM: 32 GB or more. ComfyUI keeps the model file, the text encoder and the VAE in system RAM and moves them to the GPU as needed. With this set of files that is about 13.8 GB, plus roughly 6 GB for Windows, ComfyUI and a browser: 19.8 GB in total. With less RAM it still runs, but Windows starts swapping to disk and loading gets very slow. calculated
02Every file, on 12 GB
| File | Size | Needed | On this card | Quality | Download |
|---|---|---|---|---|---|
| 16-bit SAFETENSORS · black-forest-labs | 23.8 GB | 26.1 GB | 14.1 GB too big | the original weights | Hugging Face → |
| Q8_0 GGUF · city96 | 12.7 GB | 15.0 GB | 3.0 GB too big | practically identical to the original | Hugging Face → |
| FP8 SAFETENSORS · Kijai | 11.9 GB | 14.2 GB | 2.2 GB too big | practically identical to the original | Hugging Face → |
| Q6_K GGUF · city96 | 9.9 GB | 12.2 GB | spills 0.2 GB | very close to the original | Hugging Face → |
| Q5_K_S ← GGUF · city96 | 8.3 GB | 10.6 GB | fits · 1.4 GB spare | close; small differences in fine detail | Hugging Face → |
| Q4_K_S GGUF · city96 | 6.8 GB | 9.1 GB | fits · 2.9 GB spare | good; some loss in fine detail and text | Hugging Face → |
| Q3_K_S GGUF · city96 | 5.2 GB | 7.5 GB | fits · 4.5 GB spare | noticeable loss of detail | Hugging Face → |
| Q2_K GGUF · city96 | 4.0 GB | 6.3 GB | fits · 5.7 GB spare | heavy loss; a last resort | Hugging Face → |
Sizes from the Hugging Face file listing, read 2026-09-25. “Needed” = file + 1.5 GB working memory for this model + 0.8 GB kept free for the system.
03The text encoder
T5-XXL: 9.8 GB as 16-bit, 4.9 GB as FP8, 2.9 GB as GGUF Q4_K_M (plus CLIP-L (0.25 GB)). ComfyUI encodes the prompt first and can push the encoder out of VRAM before sampling, so it does not have to fit together with the model. On 12 GB the FP8 encoder fits on its own, so prompt encoding stays fast.