Datasheet for local AI49 models98 GPUsData read 2026-09-25
No adsNo tracking
Check my GPU →

What AI models run on 6 GB of VRAM?

7 of 49 image and video models run at 8-bit quality or better on 6 GB. Here is every one, with the file to download.

01Every model on 6 GB

ModelVerdictBest fileSizeNeeded
image models
FLUX.1 [dev]Offload onlyQ3_K_S5.2 GB7.5 GB
FLUX.1 [schnell]Offload onlyQ3_K_S5.2 GB7.5 GB
FLUX.1 Kontext [dev]Offload onlyQ3_K_M5.4 GB8.0 GB
FLUX.1 Krea [dev]Offload onlyQ3_K_M5.4 GB7.7 GB
FLUX.1 Fill [dev]Offload onlyQ3_K_S5.2 GB7.8 GB
FLUX.2 [dev]Not practicalQ2_K12.9 GB16.2 GB
FLUX.2 [klein] 9BOffload onlyQ3_K_M4.8 GB7.1 GB
FLUX.2 [klein] 4BRuns wellFP84.1 GB5.9 GB
Krea 2 (Turbo)Offload onlyQ2_K4.9 GB7.5 GB
Qwen-ImageNot practicalQ2_K7.1 GB9.9 GB
Qwen-Image-Edit (2511)Not practicalQ2_K7.5 GB10.5 GB
Qwen-Image 2.1TightQ3_K_M3.2 GB5.5 GB
Z-Image TurboTightQ2_K3.6 GB5.6 GB
Z-Image (base)Offload onlyQ5_K_M5.6 GB7.6 GB
Ideogram 4Not practicalQ4_16.2 GB14.7 GB
Boogu-Image (Turbo)Offload onlyQ4_17.4 GB10.0 GB
ERNIE-Image (Turbo)TightQ2_K3.2 GB5.5 GB
HiDream-O1-ImageOffload onlyFP88.1 GB10.9 GB
Mage-Flow (Microsoft)Runs wellINT84.2 GB6.0 GB
Lumina Image 2.0Runs wellQ8_02.8 GB4.6 GB
HiDream-I1 (Full)Offload onlyQ4_K_M11.5 GB14.3 GB
HiDream-I1 (Dev)Offload onlyQ4_K_M11.5 GB14.3 GB
Stable Diffusion 3.5 LargeOffload onlyQ4_15.3 GB7.6 GB
Stable Diffusion 3.5 MediumRuns wellQ8_02.9 GB4.7 GB
Chroma1-HDTightQ2_K3.4 GB5.7 GB
SDXL 1.0Offload only16-bit6.9 GB7.1 GB
Illustrious XL / Pony (SDXL anime)Runs wellQ8_02.7 GB4.7 GB
Stable Diffusion 1.5Runs well16-bit2.1 GB3.3 GB
HunyuanImage 2.1Offload onlyQ4_K_M11.3 GB14.6 GB
video models
Wan 2.1 T2V 14BOffload onlyQ4_K_M10.1 GB14.4 GB
Wan 2.1 T2V 1.3BRuns well16-bit2.8 GB5.6 GB
Wan 2.1 I2V 14B 480POffload onlyQ4_K_M11.3 GB15.6 GB
Wan 2.1 I2V 14B 720POffload onlyQ4_K_M11.3 GB18.1 GB
Wan 2.1 VACE 14BOffload onlyQ4_K_M11.6 GB16.4 GB
Wan 2.2 T2V A14BOffload onlyQ4_K_M9.7 GB14.0 GB
Wan 2.2 I2V A14BOffload onlyQ4_K_M9.7 GB14.0 GB
Wan 2.2 TI2V 5BTightQ2_K1.9 GB5.7 GB
Wan 2.2 Animate 14BOffload onlyQ4_K_M11.5 GB16.8 GB
Wan Animate 2 (14B)Offload onlyQ4_K_M11.3 GB16.6 GB
Wan 2.2 S2V 14BNot practicalQ2_K9.5 GB14.3 GB
SCAIL-2 (character animation)Offload onlyQ4_K_M11.5 GB16.8 GB
HunyuanVideo (13B, original)Offload onlyQ4_K_M7.9 GB12.2 GB
LTX-Video 13B (0.9.8)Offload onlyQ4_K_M8.8 GB13.1 GB
HunyuanVideo 1.5Offload onlyQ4_K_M5.1 GB9.4 GB
LTX-2 (19B)Not practicalQ2_K8.1 GB12.9 GB
LTX-2.3 (22B)Not practicalQ2_K8.3 GB13.1 GB
LTX-2.5 (22B)Not practicalQ2_K8.8 GB13.6 GB
MiniMax H3 (33B)Not practicalQ3_K_M15.6 GB21.4 GB
MiniMax H3 PrunedOffload onlyQ4_K_M11.6 GB17.4 GB

Assumes a GPU without FP8 compute (Q8_0 preferred for 8-bit). On RTX 40/50, FP8 files are used where available. How the numbers work.