Can the Mac 16 GB run FLUX.2 [klein] 9B?
Download Q8_0 (10.0 GB). With the model's working memory it needs about 12.3 GB, leaving 0.4 GB spare on 12.7 GB. Quality: practically identical to the original.
01What to download
| Part | File | Folder | Size | |
|---|---|---|---|---|
| Model | flux-2-klein-9b-Q8_0.gguf Q8_0 · unsloth/FLUX.2-klein-9B-GGUF | models/unet | 10.0 GB | Download → |
| Text encoder | qwen_3_8b.safetensors Qwen3 8B BF16 · Comfy-Org/flux2-klein-9B | models/text_encoders | 16.4 GB | Download → |
| VAE | flux2-vae.safetensors FLUX.2 VAE · Comfy-Org/flux2-dev | models/vae | 0.3 GB | Download → |
| Total download · keep about the same free on disk | 26.7 GB | |||
On a Mac, FP8 text encoders do not load, so a 16-bit one is listed. Sizes read from Hugging Face (2026-09-25). “Download” links start the file directly; the file name links are the same files the official ComfyUI workflows use.
Shared memory: about 32.7 GB of your 16 GB. On this machine the model, the text encoder, the VAE and the operating system all use the same memory. That is about 16.7 GB more than there is. It still runs: while the model works, the system compresses or swaps the idle text encoder, so loading and changing the prompt get slower. A smaller file or text encoder avoids that. calculated
02Every FLUX.2 klein 9B file on 12.7 GB
| File | Size | Needed | On this card | Quality | Download |
|---|---|---|---|---|---|
| 16-bit SAFETENSORS · black-forest-labs | 18.2 GB | 20.5 GB | 7.8 GB too big | the original weights | Hugging Face → |
| Q8_0 ← GGUF · unsloth | 10.0 GB | 12.3 GB | fits · 0.4 GB spare | practically identical to the original | Hugging Face → |
| Q6_K GGUF · unsloth | 7.9 GB | 10.2 GB | fits · 2.5 GB spare | very close to the original | Hugging Face → |
| Q5_K_M GGUF · unsloth | 7.0 GB | 9.3 GB | fits · 3.4 GB spare | close; small differences in fine detail | Hugging Face → |
| Q4_K_M GGUF · unsloth | 5.9 GB | 8.2 GB | fits · 4.5 GB spare | good; some loss in fine detail and text | Hugging Face → |
| Q3_K_M GGUF · unsloth | 4.8 GB | 7.1 GB | fits · 5.6 GB spare | noticeable loss of detail | Hugging Face → |
| Q2_K GGUF · unsloth | 4.0 GB | 6.3 GB | fits · 6.4 GB spare | heavy loss; a last resort | Hugging Face → |
Sizes from the Hugging Face file listing, read 2026-09-25. “Needed” = file + 1.5 GB working memory for this model + 0.8 GB kept free for the system. FP8 and INT8 files are left out on a Mac: Apple GPUs cannot compute FP8, so ComfyUI either fails to load them or converts them back to 16-bit, which saves no memory. Use a 16-bit or GGUF file.
03The text encoder
Qwen3 8B: 16.4 GB as 16-bit, 8.7 GB as FP8. ComfyUI encodes the prompt first and can push the encoder out of VRAM before sampling, so it does not have to fit together with the model. On 12.7 GB the FP8 encoder fits on its own, so prompt encoding stays fast.
04About this GPU
A Mac with 16 GB shares that memory between the CPU and the GPU. On current macOS the GPU may use about 12.7 GB of it by default (older macOS versions: about 11.5 GB); that is the figure used here. ComfyUI can go past it, but macOS then starts compressing and swapping memory and everything slows down. ComfyUI runs on Apple GPUs through PyTorch's MPS backend. 16-bit and GGUF files work; FP8 and INT8 files do not save memory on a Mac, so they are skipped. Speed is the catch: even the fastest Macs are several times slower per image than a desktop RTX card. Chips sold with 16 GB: M1, M1 Pro, M2, M2 Pro, M3, M4, M5, M6 (memory bandwidth 68.25–200 GB/s — the higher, the faster). Everything about Macs and local AI →
Mac 16 GB: 16 GB unified · ~12.7 GB for the GPU · 68.25–200 GB/s · Apple Silicon. Everything that runs on the Mac 16 GB →
05What more VRAM would change
Nothing to gain for this model: the Mac 16 GB already runs a top-quality file entirely in VRAM. More memory would only help with bigger images, longer clips or several models at once.
06Measured and reported results
Nobody has sent measured numbers for this pair yet. If you run FLUX.2 klein 9B on a Mac 16 GB, send your time per image and peak VRAM and it will appear here, credited.
07Questions
How much VRAM does FLUX.2 klein 9B need?
Around 6.3 GB with the smallest file (Q2_K) and 11.7 GB with an 8-bit file (FP8), counting working memory and a small system reserve. The full 16-bit file needs about 20.5 GB.
Which FLUX.2 klein 9B file should I download for the Mac 16 GB?
Q8_0 (10.0 GB) from unsloth/FLUX.2-klein-9B-GGUF. Load it with Unet Loader (GGUF) from the ComfyUI-GGUF node pack.
Is FP8 faster than GGUF on the Mac 16 GB?
No. This GPU has no FP8 compute, so ComfyUI converts FP8 weights back before the maths. FP8 only saves memory here; Q8_0 GGUF is the closer-to-original 8-bit pick.
How much do I need to download for FLUX.2 klein 9B on the Mac 16 GB?
About 26.7 GB for the model file, text encoder and VAE listed on this page, and the same again free on disk. With a 12.7 GB card, 48 GB of system RAM or more is recommended.