FLUX.1 Fill [dev] on 16 GB of VRAM
Yes, but only just: Q8_0 leaves 0.7 GB free on 16 GB. The inpainting and outpainting model from the FLUX.1 Tools release. Same 12B size class as FLUX.1 dev.
Runs well
Yes, just.
Q8_0 (12.7 GB) fits with only 0.7 GB to spare (about 15.3 GB of 16 GB).
Best fileQ8_0
File size12.7 GB
VRAM needed~15.3 GB
System RAM32 GB+
Memory map · 16 GB GPU15.3 GB / 16 GB
08 GB16 GB
Weights Q8_0 · 12.7 GBWorking memory · 1.8 GBReserve · 0.8 GBFree · 0.7 GB
calculated How this is counted.
01What to download
| Part | File | Folder | Size | |
|---|---|---|---|---|
| Model | flux1-fill-dev-Q8_0.gguf Q8_0 · YarvixPA/FLUX.1-Fill-dev-GGUF | models/unet | 12.7 GB | Download → |
| Text encoder | t5xxl_fp8_e4m3fn.safetensors T5-XXL FP8 · comfyanonymous/flux_text_encoders | models/text_encoders | 4.9 GB | Download → |
| Text encoder | clip_l.safetensors CLIP-L · comfyanonymous/flux_text_encoders | models/text_encoders | 0.2 GB | Download → |
| VAE | ae.safetensors FLUX.1 VAE (ae) · Comfy-Org/Lumina_Image_2.0_Repackaged | models/vae | 0.3 GB | Download → |
| Total download · keep about the same free on disk | 18.2 GB | |||
Alternatives: T5-XXL FP16 (9.8 GB). Sizes from Hugging Face, 2026-10-01.
02Every file, on 16 GB
| File | Size | Needed | On this card | Quality | Download |
|---|---|---|---|---|---|
| 16-bit SAFETENSORS · black-forest-labs | 23.8 GB | 26.4 GB | 10.4 GB too big | the original weights | Hugging Face → |
| Q8_0 ← GGUF · YarvixPA | 12.7 GB | 15.3 GB | fits · 0.7 GB spare | practically identical to the original | Hugging Face → |
| Q6_K GGUF · YarvixPA | 9.9 GB | 12.5 GB | fits · 3.5 GB spare | very close to the original | Hugging Face → |
| Q5_K_S GGUF · YarvixPA | 8.3 GB | 10.9 GB | fits · 5.1 GB spare | close; small differences in fine detail | Hugging Face → |
| Q4_K_S GGUF · YarvixPA | 6.8 GB | 9.4 GB | fits · 6.6 GB spare | good; some loss in fine detail and text | Hugging Face → |
| Q3_K_S GGUF · YarvixPA | 5.2 GB | 7.8 GB | fits · 8.2 GB spare | noticeable loss of detail | Hugging Face → |
“Needed” adds 1.8 GB of working memory for FLUX.1 Fill and a 0.8 GB reserve. Sizes 2026-10-01.