FLUX.1 Fill [dev] on 24 GB of VRAM
Yes. Q8_0 fits on 24 GB with 8.7 GB to spare. The inpainting and outpainting model from the FLUX.1 Tools release. Same 12B size class as FLUX.1 dev.
Runs well
Yes, with room to spare.
Q8_0 (12.7 GB) needs about 15.3 GB in use, so 8.7 GB of the 24 GB stays free: room for a larger image, a LoRA or a ControlNet.
Best fileQ8_0
File size12.7 GB
VRAM needed~15.3 GB
System RAM32 GB+
Memory map · 24 GB GPU15.3 GB / 24 GB
012 GB24 GB
Weights Q8_0 · 12.7 GBWorking memory · 1.8 GBReserve · 0.8 GBFree · 8.7 GB
calculated How this is counted.
01What to download
| Part | File | Folder | Size | |
|---|---|---|---|---|
| Model | flux1-fill-dev-Q8_0.gguf Q8_0 · YarvixPA/FLUX.1-Fill-dev-GGUF | models/unet | 12.7 GB | Download → |
| Text encoder | t5xxl_fp8_e4m3fn.safetensors T5-XXL FP8 · comfyanonymous/flux_text_encoders | models/text_encoders | 4.9 GB | Download → |
| Text encoder | clip_l.safetensors CLIP-L · comfyanonymous/flux_text_encoders | models/text_encoders | 0.2 GB | Download → |
| VAE | ae.safetensors FLUX.1 VAE (ae) · Comfy-Org/Lumina_Image_2.0_Repackaged | models/vae | 0.3 GB | Download → |
| Total download · keep about the same free on disk | 18.2 GB | |||
Alternatives: T5-XXL FP16 (9.8 GB). Sizes from Hugging Face, 2026-10-01.
02Every file, on 24 GB
| File | Size | Needed | On this card | Quality | Download |
|---|---|---|---|---|---|
| 16-bit SAFETENSORS · black-forest-labs | 23.8 GB | 26.4 GB | 2.4 GB too big | the original weights | Hugging Face → |
| Q8_0 ← GGUF · YarvixPA | 12.7 GB | 15.3 GB | fits · 8.7 GB spare | practically identical to the original | Hugging Face → |
| Q6_K GGUF · YarvixPA | 9.9 GB | 12.5 GB | fits · 11.5 GB spare | very close to the original | Hugging Face → |
| Q5_K_S GGUF · YarvixPA | 8.3 GB | 10.9 GB | fits · 13.1 GB spare | close; small differences in fine detail | Hugging Face → |
| Q4_K_S GGUF · YarvixPA | 6.8 GB | 9.4 GB | fits · 14.6 GB spare | good; some loss in fine detail and text | Hugging Face → |
| Q3_K_S GGUF · YarvixPA | 5.2 GB | 7.8 GB | fits · 16.2 GB spare | noticeable loss of detail | Hugging Face → |
“Needed” adds 1.8 GB of working memory for FLUX.1 Fill and a 0.8 GB reserve. Sizes 2026-10-01.