Datasheet for local AI49 models98 GPUsData read 2026-09-25
No adsNo tracking
Check my GPU →

Can the RTX 5060 8 GB run Qwen-Image 2.1?

Image model · 7.1B8 GB GDDR7 · 128-bit · 448 GB/s · BlackwellData 2026-09-25
Runs
Yes, with a compressed file.

Download Q5_K_M (5.0 GB). With the model's working memory it needs about 7.3 GB, leaving 0.7 GB spare on 8 GB. Quality: close; small differences in fine detail. For better quality, Q6_K (5.9 GB) also runs, with about 0.2 GB spilling into system RAM — a little slower, still practical.

Best fileQ5_K_M
File size5.0 GB
VRAM needed~7.3 GB
System RAM32 GB+
Memory map · RTX 5060 8 GB7.3 GB / 8 GB
04 GB8 GB
Weights Q5_K_M · 5.0 GBWorking memory · 1.5 GBReserve · 0.8 GBFree · 0.7 GB
calculated from real file sizes plus working memory. Not yet measured on this setup. How this works.

Worth trying on this GPU: with an up-to-date ComfyUI, Dynamic VRAM (on by default for NVIDIA since March 2026) streams whatever does not fit from system RAM, and ComfyUI's own start-up message recommends native FP8/INT8 files over GGUF, saying they “will be faster even if they are larger than your memory”. So before settling for a heavily compressed GGUF, try the native INT8 file (7.3 GB). The file recommended above is the best one that fits entirely — the safe choice on older ComfyUI versions, AMD and Intel. Comfy blog: Dynamic VRAM →

01What to download

PartFileFolderSize
Modelqwen_image_2.1_Q5_K_M.gguf
Q5_K_M · Abiray/Qwen-Image-2.1-GGUF
models/unet5.0 GBDownload →
Text encoderqwen3vl_8b_int8_convrot.safetensors
Qwen3-VL 8B INT8 · Comfy-Org/Qwen-Image-2.1
models/text_encoders9.4 GBDownload →
VAEqwen_image_2.1_vae_bf16.safetensors
Qwen-Image 2.1 VAE · Comfy-Org/Qwen-Image-2.1
models/vae0.7 GBDownload →
Total download · keep about the same free on disk15.0 GB

Alternatives: Qwen3-VL 8B BF16 (17.5 GB). The 16-bit text encoder is a little more faithful; the smaller one is chosen here because it loads faster and needs less RAM. Sizes read from Hugging Face (2026-09-25). “Download” links start the file directly; the file name links are the same files the official ComfyUI workflows use.

System RAM: 32 GB or more. ComfyUI keeps the model file, the text encoder and the VAE in system RAM and moves them to the GPU as needed. With this set of files that is about 15.0 GB, plus roughly 6 GB for Windows, ComfyUI and a browser: 21.0 GB in total. With less RAM it still runs, but Windows starts swapping to disk and loading gets very slow. calculated

02Every Qwen-Image 2.1 file on 8 GB

FileSizeNeededOn this cardQualityDownload
16-bit
SAFETENSORS · Comfy-Org
14.2 GB16.5 GB8.5 GB too bigthe original weightsHugging Face →
Q8_0
GGUF · Abiray
7.6 GB9.9 GBspills 1.9 GBpractically identical to the originalHugging Face →
INT8
SAFETENSORS · Comfy-Org
7.3 GB9.6 GBspills 1.6 GBpractically identical to the originalHugging Face →
Q6_K
GGUF · Abiray
5.9 GB8.2 GBspills 0.2 GBvery close to the originalHugging Face →
Q5_K_M ←
GGUF · Abiray
5.0 GB7.3 GBfits · 0.7 GB spareclose; small differences in fine detailHugging Face →
Q4_K_M
GGUF · Abiray
4.2 GB6.5 GBfits · 1.5 GB sparegood; some loss in fine detail and textHugging Face →
Q3_K_M
GGUF · Abiray
3.2 GB5.5 GBfits · 2.5 GB sparenoticeable loss of detailHugging Face →

Sizes from the Hugging Face file listing, read 2026-09-25. “Needed” = file + 1.5 GB working memory for this model + 0.8 GB kept free for the system.

03The text encoder

Qwen3-VL 8B: 17.5 GB as 16-bit, 9.4 GB as INT8. ComfyUI encodes the prompt first and can push the encoder out of VRAM before sampling, so it does not have to fit together with the model. On 8 GB the encoder itself is too big for VRAM, so let it run from system RAM: slower prompt encoding, same images.

04About this GPU

The RTX 5060 8 GB is a Blackwell GPU with FP8 and FP4 hardware: ComfyUI computes Comfy-Org's FP8 files natively here, and NVFP4 files (where a model offers them) are faster still.

RTX 5060 8 GB: 8 GB GDDR7 · 128-bit · 448 GB/s · Blackwell. Everything that runs on the RTX 5060 8 GB →

05What more VRAM would change

With 10 GB you could run Qwen-Image 2.1 at 8-bit or better (Q8_0, 7.6 GB) with no offloading: for example on the RTX 3080 10 GB.

What changes from the RTX 5060 8 GB to the RTX 5060 Ti 16 GB →

06Measured and reported results

Nobody has sent measured numbers for this pair yet. If you run Qwen-Image 2.1 on a RTX 5060 8 GB, send your time per image and peak VRAM and it will appear here, credited.

07Questions

How much VRAM does Qwen-Image 2.1 need?

Around 5.5 GB with the smallest file (Q3_K_M) and 9.6 GB with an 8-bit file (INT8), counting working memory and a small system reserve. The full 16-bit file needs about 16.5 GB.

Which Qwen-Image 2.1 file should I download for the RTX 5060 8 GB?

Q5_K_M (5.0 GB) from Abiray/Qwen-Image-2.1-GGUF. Load it with Unet Loader (GGUF) from the ComfyUI-GGUF node pack.

Is FP8 faster than GGUF on the RTX 5060 8 GB?

It can be. This GPU has FP8 hardware, and ComfyUI computes FP8 natively for files made for it (Comfy-Org's fp8_scaled files), or for any FP8 file with the --fast fp8_matrix_mult option. GGUF files are unpacked on the fly, which costs some speed.

How much do I need to download for Qwen-Image 2.1 on the RTX 5060 8 GB?

About 15.0 GB for the model file, text encoder and VAE listed on this page, and the same again free on disk. With a 8 GB card, 32 GB of system RAM or more is recommended.