FLUX.1 Kontext [dev] on 8 GB of VRAM
Not at full quality. The 16-bit and 8-bit files are too big for 8 GB; the largest that fits is Q3_K_M (5.4 GB). The image-editing member of the FLUX.1 family: give it a picture and an instruction, it changes only what you asked for.
Q3_K_M (5.4 GB) fits with only 0.0 GB to spare (about 8.0 GB of 8 GB). Quality: noticeable loss of detail. For better quality, Q4_K_M (6.9 GB) also runs, with about 1.5 GB spilling into system RAM - a little slower, still practical.
Also try the FP8 file (11.9 GB) on NVIDIA GPUs. It does not fit entirely, but a current ComfyUI streams the overflow from RAM and native 8-bit files often beat a small GGUF that does fit. Dynamic VRAM →
01Other amounts of VRAM
02Every file, on 8 GB
| File | Size | Needed | On this card | Quality | Download |
|---|---|---|---|---|---|
| 16-bit SAFETENSORS · black-forest-labs | 23.8 GB | 26.4 GB | 18.4 GB too big | the original weights | Hugging Face → |
| Q8_0 GGUF · QuantStack | 12.7 GB | 15.3 GB | 7.3 GB too big | practically identical to the original | Hugging Face → |
| FP8 SAFETENSORS · Comfy-Org | 11.9 GB | 14.5 GB | 6.5 GB too big | practically identical to the original | Hugging Face → |
| Q6_K GGUF · QuantStack | 9.8 GB | 12.4 GB | 4.4 GB too big | very close to the original | Hugging Face → |
| Q5_K_M GGUF · QuantStack | 8.4 GB | 11.0 GB | 3.0 GB too big | close; small differences in fine detail | Hugging Face → |
| Q4_K_M GGUF · QuantStack | 6.9 GB | 9.5 GB | spills 1.5 GB | good; some loss in fine detail and text | Hugging Face → |
| Q3_K_M ← GGUF · QuantStack | 5.4 GB | 8.0 GB | fits · 0.0 GB spare | noticeable loss of detail | Hugging Face → |
| Q2_K GGUF · QuantStack | 4.0 GB | 6.6 GB | fits · 1.4 GB spare | heavy loss; a last resort | Hugging Face → |
“Needed” adds 1.8 GB of working memory for FLUX.1 Kontext and a 0.8 GB reserve. Sizes 2026-10-01.
03What to download
| Part | File | Folder | Size | |
|---|---|---|---|---|
| Model | flux1-kontext-dev-Q3_K_M.gguf Q3_K_M · QuantStack/FLUX.1-Kontext-dev-GGUF | models/unet | 5.4 GB | Download → |
| Text encoder | t5xxl_fp8_e4m3fn.safetensors T5-XXL FP8 · comfyanonymous/flux_text_encoders | models/text_encoders | 4.9 GB | Download → |
| Text encoder | clip_l.safetensors CLIP-L · comfyanonymous/flux_text_encoders | models/text_encoders | 0.2 GB | Download → |
| VAE | ae.safetensors FLUX.1 VAE (ae) · Comfy-Org/Lumina_Image_2.0_Repackaged | models/vae | 0.3 GB | Download → |
| Total download · keep about the same free on disk | 10.8 GB | |||
Alternatives: T5-XXL FP16 (9.8 GB). Sizes from Hugging Face, 2026-10-01.
Free ComfyUI workflow, tested on my RTX 5060 Ti: FP8 workflow (.json) · GGUF Q8_0 workflow (.json). Drag the file into ComfyUI. All workflows →