Can the RTX 4090 24 GB run FLUX.1 [dev]?
Download FP8 (11.9 GB). With the model's working memory it needs about 14.2 GB, leaving 9.8 GB spare on 24 GB. Quality: practically identical to the original.
01What to download
| Part | File | Folder | Size | |
|---|---|---|---|---|
| Model | flux1-dev-fp8-e4m3fn.safetensors FP8 · Kijai/flux-fp8 | models/diffusion_models | 11.9 GB | Download → |
| Text encoder | t5xxl_fp8_e4m3fn.safetensors T5-XXL FP8 · comfyanonymous/flux_text_encoders | models/text_encoders | 4.9 GB | Download → |
| Text encoder | clip_l.safetensors CLIP-L · comfyanonymous/flux_text_encoders | models/text_encoders | 0.2 GB | Download → |
| VAE | ae.safetensors FLUX.1 VAE (ae) · Comfy-Org/Lumina_Image_2.0_Repackaged | models/vae | 0.3 GB | Download → |
| Total download · keep about the same free on disk | 17.4 GB | |||
Alternatives: T5-XXL FP16 (9.8 GB). The 16-bit text encoder is a little more faithful; the smaller one is chosen here because it loads faster and needs less RAM. Sizes read from Hugging Face (2026-09-25). “Download” links start the file directly; the file name links are the same files the official ComfyUI workflows use.
System RAM: 32 GB or more. ComfyUI keeps the model file, the text encoder and the VAE in system RAM and moves them to the GPU as needed. With this set of files that is about 17.4 GB, plus roughly 6 GB for Windows, ComfyUI and a browser: 23.4 GB in total. With less RAM it still runs, but Windows starts swapping to disk and loading gets very slow. calculated
02Every FLUX.1 dev file on 24 GB
| File | Size | Needed | On this card | Quality | Download |
|---|---|---|---|---|---|
| 16-bit SAFETENSORS · black-forest-labs | 23.8 GB | 26.1 GB | 2.1 GB too big | the original weights | Hugging Face → |
| FP8 ← SAFETENSORS · Kijai | 11.9 GB | 14.2 GB | fits · 9.8 GB spare | practically identical to the original | Hugging Face → |
| Q8_0 GGUF · city96 | 12.7 GB | 15.0 GB | fits · 9.0 GB spare | practically identical to the original | Hugging Face → |
| Q6_K GGUF · city96 | 9.9 GB | 12.2 GB | fits · 11.8 GB spare | very close to the original | Hugging Face → |
| Q5_K_S GGUF · city96 | 8.3 GB | 10.6 GB | fits · 13.4 GB spare | close; small differences in fine detail | Hugging Face → |
| Q4_K_S GGUF · city96 | 6.8 GB | 9.1 GB | fits · 14.9 GB spare | good; some loss in fine detail and text | Hugging Face → |
| Q3_K_S GGUF · city96 | 5.2 GB | 7.5 GB | fits · 16.5 GB spare | noticeable loss of detail | Hugging Face → |
| Q2_K GGUF · city96 | 4.0 GB | 6.3 GB | fits · 17.7 GB spare | heavy loss; a last resort | Hugging Face → |
Sizes from the Hugging Face file listing, read 2026-09-25. “Needed” = file + 1.5 GB working memory for this model + 0.8 GB kept free for the system.
03The text encoder
T5-XXL: 9.8 GB as 16-bit, 4.9 GB as FP8, 2.9 GB as GGUF Q4_K_M (plus CLIP-L (0.25 GB)). ComfyUI encodes the prompt first and can push the encoder out of VRAM before sampling, so it does not have to fit together with the model. On 24 GB the FP8 encoder fits on its own, so prompt encoding stays fast.
04About this GPU
The RTX 4090 24 GB is an Ada Lovelace GPU with hardware FP8, so ComfyUI can compute Comfy-Org's FP8 files natively: small and fast. (Plain FP8 files use FP8 maths with the --fast fp8_matrix_mult option.)
RTX 4090 24 GB: 24 GB GDDR6X · 384-bit · 1008 GB/s · Ada Lovelace. Everything that runs on the RTX 4090 24 GB →
05What more VRAM would change
Nothing to gain for this model: the RTX 4090 24 GB already runs a top-quality file entirely in VRAM. More memory would only help with bigger images, longer clips or several models at once.
What changes from the RTX 4090 24 GB to the RTX 5090 32 GB →
06Measured and reported results
| Label | Setup | Result | Peak VRAM | Date | Source |
|---|---|---|---|---|---|
| reported | fp8 (ComfyUI template) “Prompt executed in 11.28 seconds” ComfyUI 'GPU Benchmark Flux DEV fp8' thread: stock Flux dev fp8 workflow template, time of 2nd/3rd run (no loading); resolution/steps not stated in thread | 11.28 s / image | — | 2025-12-28 | github.com → |
| reported | Q8_0 GGUF · 1024x1024 · 20 steps “15 seconds at the fastest to 17 seconds at the slowest on my RTX 4090 with Euler 20 Steps for 1024x1024 images” stated range 15-17 s; city96 ComfyUI-GGUF Q8 | 15 s / image | — | 2024-08-25 | github.com → |
| reported | fp8 (--fast) · 1024x1024 · 20 steps “Prompt executed in 10.01 seconds” ComfyUI 'RTX 4090 benchmarks - FLUX model' thread; OP settings 1024x1024, 20 steps; Aug 2024 ComfyUI/PyTorch 2.5 dev; FP8 with --fast, GPU at 2.52 GHz/875mV undervolt (9.07 s at 2. | 10.01 s / image | — | 2024-08-26 | github.com → |
Reported results are other people's numbers, copied as published, with a link. Settings, drivers and ComfyUI versions differ, so compare them with care. Send yours.
07Questions
How much VRAM does FLUX.1 dev need?
Around 6.3 GB with the smallest file (Q2_K) and 14.2 GB with an 8-bit file (FP8), counting working memory and a small system reserve. The full 16-bit file needs about 26.1 GB.
Which FLUX.1 dev file should I download for the RTX 4090 24 GB?
FP8 (11.9 GB) from Kijai/flux-fp8.
Is FP8 faster than GGUF on the RTX 4090 24 GB?
It can be. This GPU has FP8 hardware, and ComfyUI computes FP8 natively for files made for it (Comfy-Org's fp8_scaled files), or for any FP8 file with the --fast fp8_matrix_mult option. GGUF files are unpacked on the fly, which costs some speed.
How much do I need to download for FLUX.1 dev on the RTX 4090 24 GB?
About 17.4 GB for the model file, text encoder and VAE listed on this page, and the same again free on disk. With a 24 GB card, 32 GB of system RAM or more is recommended.