From the RTX 2060 6 GB to the RTX 3060 12 GB: what changes for local AI
+6 GB of VRAM (6 → 12 GB). Of 49 models, 10 newly run well, 35 get a better file or stop offloading, and 4 stay the same.
10newly run well
35better file
4no change
+6GB more VRAM
01Newly runs well
| Model | On the RTX 2060 6 GB | On the RTX 3060 12 GB | Needed |
|---|---|---|---|
| FLUX.2 [klein] 9B | Offload only Q3_K_M | Runs well FP8 | 11.7 GB |
| Qwen-Image 2.1 | Tight Q3_K_M | Runs well Q8_0 | 9.9 GB |
| Z-Image Turbo | Tight Q2_K | Runs well Q8_0 | 9.2 GB |
| Z-Image (base) | Offload only Q5_K_M | Runs well Q8_0 | 9.2 GB |
| ERNIE-Image (Turbo) | Tight Q2_K | Runs well Q8_0 | 11.0 GB |
| HiDream-O1-Image | Offload only FP8 | Runs well FP8 | 10.9 GB |
| Stable Diffusion 3.5 Large | Offload only Q4_1 | Runs well Q8_0 | 11.1 GB |
| Chroma1-HD | Tight Q2_K | Runs well FP8 | 11.5 GB |
| SDXL 1.0 | Offload only 16-bit | Runs well 16-bit | 7.1 GB |
| Wan 2.2 TI2V 5B | Tight Q2_K | Runs well Q8_0 | 9.2 GB |
“Runs well” means a 16-bit or 8-bit file fits entirely in VRAM.
02A better file, or less offloading
| Model | On the RTX 2060 6 GB | On the RTX 3060 12 GB | Needed |
|---|---|---|---|
| FLUX.1 [dev] | Offload only Q3_K_S | Runs Q5_K_S | 10.6 GB |
| FLUX.1 [schnell] | Offload only Q3_K_S | Runs Q5_K_S | 10.6 GB |
| FLUX.1 Kontext [dev] | Offload only Q3_K_M | Runs Q5_K_M | 11.0 GB |
| FLUX.1 Krea [dev] | Offload only Q3_K_M | Runs Q5_K_M | 10.7 GB |
| FLUX.1 Fill [dev] | Offload only Q3_K_S | Runs Q5_K_S | 10.9 GB |
| Krea 2 (Turbo) | Offload only Q2_K | Runs Q5_K_M | 11.5 GB |
| Qwen-Image | Not practical Q2_K | Tight Q2_K | 9.9 GB |
| Qwen-Image-Edit (2511) | Not practical Q2_K | Tight Q2_K | 10.5 GB |
| Boogu-Image (Turbo) | Offload only Q4_1 | Runs Q5_1 | 11.2 GB |
| HiDream-I1 (Full) | Offload only Q4_K_M | Tight Q3_K_M | 11.6 GB |
| HiDream-I1 (Dev) | Offload only Q4_K_M | Tight Q3_K_M | 11.6 GB |
| HunyuanImage 2.1 | Offload only Q4_K_M | Tight Q2_K | 10.6 GB |
| Wan 2.1 T2V 14B | Offload only Q4_K_M | Tight Q3_K_M | 11.9 GB |
| Wan 2.2 T2V A14B | Offload only Q4_K_M | Tight Q3_K_M | 11.5 GB |
| Wan 2.2 I2V A14B | Offload only Q4_K_M | Tight Q3_K_M | 11.5 GB |
| Wan 2.2 Animate 14B | Offload only Q4_K_M | Tight Q2_K | 11.8 GB |
| Wan Animate 2 (14B) | Offload only Q4_K_M | Tight Q2_K | 11.8 GB |
| HunyuanVideo (13B, original) | Offload only Q4_K_M | Tight Q3_K_M | 10.5 GB |
| LTX-Video 13B (0.9.8) | Offload only Q4_K_M | Tight Q3_K_M | 10.8 GB |
| HunyuanVideo 1.5 | Offload only Q4_K_M | Runs Q6_K | 11.3 GB |
| FLUX.2 [dev] | Not practical Q2_K | Offload only Q4_K_M | 23.4 GB |
| FLUX.2 [klein] 4B | Runs well FP8 | Runs well 16-bit | 9.6 GB |
| Ideogram 4 | Not practical Q4_1 | Offload only Q4_1 | 14.7 GB |
| Mage-Flow (Microsoft) | Runs well INT8 | Runs well 16-bit | 10.0 GB |
| Lumina Image 2.0 | Runs well Q8_0 | Runs well 16-bit | 7.0 GB |
| Stable Diffusion 3.5 Medium | Runs well Q8_0 | Runs well 16-bit | 6.9 GB |
| Illustrious XL / Pony (SDXL anime) | Runs well Q8_0 | Runs well 16-bit | 7.1 GB |
| Wan 2.1 I2V 14B 480P | Offload only Q4_K_M | Offload only Q3_K_M | 12.9 GB |
| Wan 2.1 VACE 14B | Offload only Q4_K_M | Offload only Q3_K_S | 12.6 GB |
| Wan 2.2 S2V 14B | Not practical Q2_K | Offload only Q4_K_M | 18.7 GB |
| SCAIL-2 (character animation) | Offload only Q4_K_M | Offload only Q2_K | 12.6 GB |
| LTX-2 (19B) | Not practical Q2_K | Offload only Q2_K | 12.9 GB |
| LTX-2.3 (22B) | Not practical Q2_K | Offload only Q2_K | 13.1 GB |
| LTX-2.5 (22B) | Not practical Q2_K | Offload only Q2_K | 13.6 GB |
| MiniMax H3 (33B) | Not practical Q3_K_M | Offload only Q4_K_M | 25.7 GB |
03No change in what fits
Same verdict and same file on both cards. Speed can still differ.
04Speed and features
Memory bandwidth goes from 336 to 360 GB/s (×1.07). For models that fit on both cards, bandwidth and compute decide the speed; this ratio is a rough first guide, not a benchmark.