Datasheet for local AI49 models98 GPUsData read 2026-09-25
No adsNo tracking
Check my GPU →

FLUX.2 [dev] VRAM requirements

The 32B second-generation FLUX. Very capable and very heavy: even 4-bit files are around 20 GB, and the text encoder is a 24B language model.

Released 2025-11Licence: FLUX [dev] Non-Commercial LicenseSteps: 28–50Text encoder: Mistral Small 3 (24B) (18.0 GB as FP8)
TypeImage
Parameters32B
Fits entirely from17 GB
8-bit or better from39 GB

01The files, and how much VRAM each needs

FileSizeNeededMin. VRAMQualitySource
16-bit64.4 GB67.7 GB68 GBthe original weightsblack-forest-labs/FLUX.2-dev →
Q8_035.0 GB38.3 GB39 GBpractically identical to the originalcity96/FLUX.2-dev-gguf →
FP835.5 GB38.8 GB39 GBpractically identical to the originalComfy-Org/flux2-dev →
Q6_K27.4 GB30.7 GB31 GBvery close to the originalcity96/FLUX.2-dev-gguf →
Q5_K_M24.1 GB27.4 GB28 GBclose; small differences in fine detailcity96/FLUX.2-dev-gguf →
Q4_K_M20.1 GB23.4 GB24 GBgood; some loss in fine detail and textcity96/FLUX.2-dev-gguf →
Q3_K_M16.0 GB19.3 GB20 GBnoticeable loss of detailcity96/FLUX.2-dev-gguf →
Q2_K12.9 GB16.2 GB17 GBheavy loss; a last resortcity96/FLUX.2-dev-gguf →

“Needed” = file + 2.5 GB working memory + 0.8 GB system reserve.

03Best GPU for FLUX.2 dev

The cheapest cards (by launch price) that run it well, and every card sorted by memory: best GPU for FLUX.2 dev → Planning bigger images or longer clips? Open the calculator →

04By graphics card

GPUVRAMVerdictBest fileNeeded
Desktop graphics cards
RTX 2060 6 GB6 GBNot practicalQ2_K16.2 GB
RTX 3050 6 GB6 GBNot practicalQ2_K16.2 GB
RTX 2070 Super 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 2080 Super 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 3050 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 3060 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 3060 Ti 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 3070 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 3070 Ti 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 4060 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 4060 Ti 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 5050 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 5060 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 5060 Ti 8 GB8 GBNot practicalQ2_K16.2 GB
RX 7600 8 GB8 GBNot practicalQ2_K16.2 GB
RX 9050 8 GB8 GBNot practicalQ2_K16.2 GB
RX 9060 XT 8 GB8 GBNot practicalQ2_K16.2 GB
Arc B570 10 GB10 GBNot practicalQ2_K16.2 GB
RTX 3080 10 GB10 GBNot practicalQ2_K16.2 GB
RTX 2080 Ti 11 GB11 GBOffload onlyQ4_K_M23.4 GB
Arc B580 12 GB12 GBOffload onlyQ4_K_M23.4 GB
RTX 2060 12 GB12 GBOffload onlyQ4_K_M23.4 GB
RTX 3060 12 GB12 GBOffload onlyQ4_K_M23.4 GB
RTX 3080 12 GB12 GBOffload onlyQ4_K_M23.4 GB
RTX 3080 Ti 12 GB12 GBOffload onlyQ4_K_M23.4 GB
RTX 4070 12 GB12 GBOffload onlyQ4_K_M23.4 GB
RTX 4070 Super 12 GB12 GBOffload onlyQ4_K_M23.4 GB
RTX 4070 Ti 12 GB12 GBOffload onlyQ4_K_M23.4 GB
RTX 5070 12 GB12 GBOffload onlyQ4_K_M23.4 GB
RX 7700 XT 12 GB12 GBOffload onlyQ4_K_M23.4 GB
RX 9070 GRE 12 GB12 GBOffload onlyQ4_K_M23.4 GB
Arc A770 16 GB16 GBOffload onlyQ2_K16.2 GB
RTX 4060 Ti 16 GB16 GBOffload onlyQ2_K16.2 GB
RTX 4070 Ti Super 16 GB16 GBOffload onlyQ2_K16.2 GB
RTX 4080 16 GB16 GBOffload onlyQ2_K16.2 GB
RTX 4080 Super 16 GB16 GBOffload onlyQ2_K16.2 GB
RTX 5060 Ti 16 GB16 GBOffload onlyQ2_K16.2 GB
RTX 5070 Ti 16 GB16 GBOffload onlyQ2_K16.2 GB
RTX 5080 16 GB16 GBOffload onlyQ2_K16.2 GB
RX 7600 XT 16 GB16 GBOffload onlyQ2_K16.2 GB
RX 7800 XT 16 GB16 GBOffload onlyQ2_K16.2 GB
RX 7900 GRE 16 GB16 GBOffload onlyQ2_K16.2 GB
RX 9060 XT 16 GB16 GBOffload onlyQ2_K16.2 GB
RX 9070 16 GB16 GBOffload onlyQ2_K16.2 GB
RX 9070 XT 16 GB16 GBOffload onlyQ2_K16.2 GB
RX 7900 XT 20 GB20 GBTightQ3_K_M19.3 GB
Arc Pro B60 24 GB24 GBRunsQ4_K_M23.4 GB
RTX 3090 24 GB24 GBRunsQ4_K_M23.4 GB
RTX 3090 Ti 24 GB24 GBRunsQ4_K_M23.4 GB
RTX 4090 24 GB24 GBRunsQ4_K_M23.4 GB
RX 7900 XTX 24 GB24 GBRunsQ4_K_M23.4 GB
Arc Pro B70 32 GB32 GBRunsQ6_K30.7 GB
RTX 5090 32 GB32 GBRunsQ6_K30.7 GB
Laptop GPUs
RTX 3050 Laptop 4 GB4 GBNot practicalQ2_K16.2 GB
RTX 3050 Ti Laptop 4 GB4 GBNot practicalQ2_K16.2 GB
RTX 2060 Laptop 6 GB6 GBNot practicalQ2_K16.2 GB
RTX 3050 Laptop 6 GB6 GBNot practicalQ2_K16.2 GB
RTX 3060 Laptop 6 GB6 GBNot practicalQ2_K16.2 GB
RTX 4050 Laptop 6 GB6 GBNot practicalQ2_K16.2 GB
RTX 2070 Laptop 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 2070 Super Laptop 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 2080 Laptop 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 2080 Super Laptop 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 3070 Laptop 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 3070 Ti Laptop 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 3080 Laptop 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 4060 Laptop 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 4070 Laptop 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 5050 Laptop 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 5060 Laptop 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 5070 Laptop 8 GB8 GBNot practicalQ2_K16.2 GB
RX 7600M 8 GB8 GBNot practicalQ2_K16.2 GB
RX 7600M XT 8 GB8 GBNot practicalQ2_K16.2 GB
RX 7600S 8 GB8 GBNot practicalQ2_K16.2 GB
RX 7700S 8 GB8 GBNot practicalQ2_K16.2 GB
RTX 4080 Laptop 12 GB12 GBOffload onlyQ4_K_M23.4 GB
RTX 5070 Laptop 12 GB12 GBOffload onlyQ4_K_M23.4 GB
RTX 5070 Ti Laptop 12 GB12 GBOffload onlyQ4_K_M23.4 GB
RX 7800M 12 GB12 GBOffload onlyQ4_K_M23.4 GB
RTX 3080 Laptop 16 GB16 GBOffload onlyQ2_K16.2 GB
RTX 3080 Ti Laptop 16 GB16 GBOffload onlyQ2_K16.2 GB
RTX 4090 Laptop 16 GB16 GBOffload onlyQ2_K16.2 GB
RTX 5080 Laptop 16 GB16 GBOffload onlyQ2_K16.2 GB
RX 7900M 16 GB16 GBOffload onlyQ2_K16.2 GB
RTX 5090 Laptop 24 GB24 GBRunsQ4_K_M23.4 GB
Unified memory
Radeon 8060S (Strix Halo) 96 GB96 GBRuns well16-bit67.7 GB
Apple Silicon Macs (by memory)
Mac 16 GB12.7 GBOffload onlyQ4_K_M23.4 GB
Mac 18 GB14.4 GBOffload onlyQ2_K16.2 GB
Mac 24 GB19.6 GBTightQ3_K_M19.3 GB
Mac 32 GB26.8 GBRunsQ4_K_M23.4 GB
Mac 36 GB30.2 GBRunsQ5_K_M27.4 GB
Mac 48 GB40.2 GBRuns wellQ8_038.3 GB
Mac 64 GB55.7 GBRuns wellQ8_038.3 GB
Mac 96 GB85 GBRuns well16-bit67.7 GB
Mac 128 GB115.4 GBRuns well16-bit67.7 GB
Mac 192 GB175.4 GBRuns well16-bit67.7 GB
Mac 256 GB236.9 GBRuns well16-bit67.7 GB
Mac 512 GB498.1 GBRuns well16-bit67.7 GB

On RTX 40/50 GPUs the FP8 file is preferred over Q8_0 when both fit (hardware FP8). All verdicts are calculated; see how the numbers work.

05Text encoder, VAE and other files

FileFolderSizeWhen
Mistral 3 Small FP8
mistral_3_small_flux2_fp8.safetensors
models/text_encoders18.0 GBtext encoder · smaller, recommendedDownload →
Mistral 3 Small BF16
mistral_3_small_flux2_bf16.safetensors
models/text_encoders35.6 GBtext encoder · alternativeDownload →
FLUX.2 VAE
flux2-vae.safetensors
models/vae0.3 GBrequiredDownload →

The files the official ComfyUI workflows load next to the model. Sizes read from Hugging Face (2026-09-25). Every GPU page for this model lists the exact set to download for that card, with the total.

Mistral Small 3 (24B): 35.6 GB as 16-bit, 18.0 GB as FP8. ComfyUI encodes the prompt first and can push the encoder out of VRAM before sampling, so it does not have to fit together with the model. On 16 GB the encoder itself is too big for VRAM, so let it run from system RAM: slower prompt encoding, same images.

06Where the files go in ComfyUI

FileFolderLoader node
Diffusion model (.safetensors: 16-bit, FP8, INT8)ComfyUI/models/diffusion_modelsLoad Diffusion Model
GGUF file (.gguf)ComfyUI/models/unetUnet Loader (GGUF) — from the ComfyUI-GGUF node pack
Text encoderComfyUI/models/text_encodersLoad CLIP / DualCLIPLoader (or the GGUF versions)
VAEComfyUI/models/vaeLoad VAE

Standard ComfyUI folders. After copying files, press R in ComfyUI (or restart it) to refresh the lists. Some uploads need their uploader's own loader node — see the notes above.

07AMD, Intel and NVIDIA: which file types are fast

File typeRTX 50RTX 40RTX 30 / 20RX 9000RX 7000/6000 · Strix HaloIntel Arc
16-bitRunsRunsRunsRunsRunsRuns
FP8Native FP8Native FP8No FP8 speed-upNative FP8No FP8 speed-upNo FP8 speed-up
GGUFRuns (GGUF node)Runs (GGUF node)Runs (GGUF node)Runs (GGUF node)Runs (GGUF node)Runs (GGUF node)

Every file type loads on every listed GPU, so the memory verdicts apply to all of them. What differs is speed: FP8 maths needs RTX 40/50 or RX 9000 (with ROCm 6.4+ and PyTorch 2.7+); ComfyUI's INT8 maths runs on NVIDIA and AMD, not on Intel; GGUF is unpacked on the fly on any GPU, which costs some speed. NVFP4 files are fast only on RTX 50. AMD runs ComfyUI on Windows through ROCm, Intel through PyTorch XPU; some custom nodes are NVIDIA-only. Source: ComfyUI model_management.py. AMD and Intel guide →

08Measured and reported results

LabelGPUSetupResultPeak VRAMDateSource
reportedRTX 5060 Ti 16 GBflux2_dev_fp8mixed + mistral_3_small_flux2_fp8 · 1024x1024 · 20 steps
“FP8 t2i 142秒程度(20Steps)”
ComfyUI t2i at 1MP; approximate (程度)
142 s / image—2025-11-28note.com →
reportedRTX 5060 Ti 16 GBGGUF Q4_0 (flux2-dev-q4_0.gguf) · 1024x1024 · 20 steps
“GGUF Q4_0 t2i 180秒程度(20Steps)”
ComfyUI t2i at 1MP; approximate (程度); author notes GGUF slower than fp8 when spilling VRAM
180 s / image—2025-11-28note.com →

Reported results are other people's numbers, copied as published, with a link. Settings, drivers and ComfyUI versions differ, so compare them with care. Send yours.

09Training a LoRA for FLUX.2 dev

No trainer documentation with a VRAM figure for this model was found yet. What the trainers say for other models →

10Every file tracked for FLUX.2 dev

FileTypeSizeRepo
flux2_dev_fp8mixed.safetensorsFP835.46 GBComfy-Org/flux2-dev →
flux2-dev.safetensorsBF1664.45 GBblack-forest-labs/FLUX.2-dev →
flux2-dev-BF16.ggufBF1664.45 GBcity96/FLUX.2-dev-gguf →
flux2-dev-Q8_0.ggufQ8_035.00 GBcity96/FLUX.2-dev-gguf →
flux2-dev-Q6_K.ggufQ6_K27.40 GBcity96/FLUX.2-dev-gguf →
flux2-dev-Q5_1.ggufQ5_125.19 GBcity96/FLUX.2-dev-gguf →
flux2-dev-Q5_K_M.ggufQ5_K_M24.06 GBcity96/FLUX.2-dev-gguf →
flux2-dev-Q5_0.ggufQ5_023.22 GBcity96/FLUX.2-dev-gguf →
flux2-dev-Q5_K_S.ggufQ5_K_S23.22 GBcity96/FLUX.2-dev-gguf →
flux2-dev-Q4_1.ggufQ4_121.26 GBcity96/FLUX.2-dev-gguf →
flux2-dev-Q4_K_M.ggufQ4_K_M20.08 GBcity96/FLUX.2-dev-gguf →
flux2-dev-Q4_0.ggufQ4_019.30 GBcity96/FLUX.2-dev-gguf →
flux2-dev-Q4_K_S.ggufQ4_K_S19.30 GBcity96/FLUX.2-dev-gguf →
flux2-dev-Q3_K_M.ggufQ3_K_M15.96 GBcity96/FLUX.2-dev-gguf →
flux2-dev-Q3_K_S.ggufQ3_K_S15.78 GBcity96/FLUX.2-dev-gguf →
flux2-dev-Q2_K.ggufQ2_K12.86 GBcity96/FLUX.2-dev-gguf →

Text encoder is Mistral Small 3 (24B) - see mistral-3-small-flux2 entry; very heavy. VAE ae.safetensors 336211292 bytes (BFL repo).