Datasheet for local AI49 models98 GPUsData read 2026-09-25
No adsNo tracking
Check my GPU →

HunyuanImage 2.1 on 8 GB of VRAM

Image model · 17BAny 8 GB GPUData 2026-09-25
Offload
Not entirely in VRAM, but it can still run.

The smallest sensible file, Q4_K_M (11.3 GB), needs about 14.6 GB — 6.6 GB more than 8 GB GPU has. ComfyUI can still run it by streaming part of the model from system RAM. How much slower that is depends on your ComfyUI version, the file format and the PCIe link — see the note below.

Best fileQ4_K_M
File size11.3 GB
VRAM needed~14.6 GB
System RAM32 GB+
Memory map · 8 GB GPU14.6 GB needed · 6.6 GB over 8 GB
07 GB15 GB
Weights Q4_K_M · 11.3 GBWorking memory · 2.5 GBReserve · 0.8 GBSpills to system RAM · 6.6 GB
calculated from real file sizes plus working memory. Not yet measured on this setup. How this works.

Worth trying on NVIDIA GPUs: with an up-to-date ComfyUI, Dynamic VRAM (on by default for NVIDIA since March 2026) streams whatever does not fit from system RAM, and ComfyUI's own start-up message recommends native FP8/INT8 files over GGUF, saying they “will be faster even if they are larger than your memory”. So before settling for a heavily compressed GGUF, try the native FP8 file (17.4 GB). The file recommended above is the best one that fits entirely — the safe choice on older ComfyUI versions, AMD and Intel. Comfy blog: Dynamic VRAM →

01What to download

PartFileFolderSize
Modelhunyuanimage2.1-q4_k_m.gguf
Q4_K_M · calcuis/hunyuanimage-gguf
models/unet11.3 GBDownload →
Text encoderqwen_2.5_vl_7b_fp8_scaled.safetensors
Qwen2.5-VL 7B FP8 · Comfy-Org/HunyuanImage_2.1_ComfyUI
models/text_encoders9.4 GBDownload →
Text encoderbyt5_small_glyphxl_fp16.safetensors
ByT5 small Glyph-XL · Comfy-Org/HunyuanImage_2.1_ComfyUI
models/text_encoders0.4 GBDownload →
VAEhunyuan_image_2.1_vae_fp16.safetensors
HunyuanImage 2.1 VAE · Comfy-Org/HunyuanImage_2.1_ComfyUI
models/vae0.8 GBDownload →
Total download · keep about the same free on disk21.9 GB

Alternatives: Qwen2.5-VL 7B BF16 (16.6 GB). The 16-bit text encoder is a little more faithful; the smaller one is chosen here because it loads faster and needs less RAM. Sizes read from Hugging Face (2026-09-25). “Download” links start the file directly; the file name links are the same files the official ComfyUI workflows use.

System RAM: 32 GB or more. ComfyUI keeps the model file, the text encoder and the VAE in system RAM and moves them to the GPU as needed. With this set of files that is about 21.9 GB, plus roughly 6 GB for Windows, ComfyUI and a browser: 27.9 GB in total. With less RAM it still runs, but Windows starts swapping to disk and loading gets very slow. calculated

02Every file, on 8 GB

FileSizeNeededOn this cardQualityDownload
16-bit
SAFETENSORS · Comfy-Org
34.9 GB38.2 GB30.2 GB too bigthe original weightsHugging Face →
Q8_0
GGUF · calcuis
19.8 GB23.1 GB15.1 GB too bigpractically identical to the originalHugging Face →
FP8
SAFETENSORS · Comfy-Org
17.4 GB20.7 GB12.7 GB too bigpractically identical to the originalHugging Face →
Q6_K
GGUF · calcuis
15.7 GB19.0 GB11.0 GB too bigvery close to the originalHugging Face →
Q5_K_M
GGUF · calcuis
13.4 GB16.7 GB8.7 GB too bigclose; small differences in fine detailHugging Face →
Q4_K_M ←
GGUF · calcuis
11.3 GB14.6 GB6.6 GB too biggood; some loss in fine detail and textHugging Face →
Q3_K_M
GGUF · calcuis
9.8 GB13.1 GB5.1 GB too bignoticeable loss of detailHugging Face →
Q2_K
GGUF · calcuis
7.3 GB10.6 GB2.6 GB too bigheavy loss; a last resortHugging Face →

Sizes from the Hugging Face file listing, read 2026-09-25. “Needed” = file + 2.5 GB working memory for this model + 0.8 GB kept free for the system.

03The text encoder

Qwen2.5-VL 7B: 16.6 GB as 16-bit, 9.4 GB as FP8. ComfyUI encodes the prompt first and can push the encoder out of VRAM before sampling, so it does not have to fit together with the model. On 8 GB the encoder itself is too big for VRAM, so let it run from system RAM: slower prompt encoding, same images.