Laptop GPUs for local AI
Laptop GPUs share names with desktop cards but often have less memory — an RTX 4090 Laptop has 16 GB, not 24. Here is what each one really runs.
NVIDIA RTX 50 Laptop
24 GBRTX 5090 Laptop 24 GBRuns 43 of 49 models well16 GBRTX 5080 Laptop 16 GBRuns 25 of 49 models well12 GBRTX 5070 Ti Laptop 12 GBRuns 17 of 49 models well8 GBRTX 5070 Laptop 8 GBRuns 8 of 49 models well12 GBRTX 5070 Laptop 12 GBRuns 17 of 49 models well8 GBRTX 5060 Laptop 8 GBRuns 8 of 49 models well8 GBRTX 5050 Laptop 8 GBRuns 8 of 49 models well
NVIDIA RTX 40 Laptop
NVIDIA RTX 30 Laptop
16 GBRTX 3080 Ti Laptop 16 GBRuns 25 of 49 models well16 GBRTX 3080 Laptop 16 GBRuns 25 of 49 models well8 GBRTX 3080 Laptop 8 GBRuns 8 of 49 models well8 GBRTX 3070 Ti Laptop 8 GBRuns 8 of 49 models well8 GBRTX 3070 Laptop 8 GBRuns 8 of 49 models well6 GBRTX 3060 Laptop 6 GBRuns 7 of 49 models well4 GBRTX 3050 Ti Laptop 4 GBRuns 1 of 49 models well4 GBRTX 3050 Laptop 4 GBRuns 1 of 49 models well6 GBRTX 3050 Laptop 6 GBRuns 7 of 49 models well
NVIDIA RTX 20 Laptop
AMD Radeon laptop
Apple Silicon Macs
MacBooks and Mac minis share their memory with the GPU. What runs on a Mac with 16 to 512 GB →
Unified memory
AMD Ryzen AI Max+ 395 ("Strix Halo") can dedicate up to 96 GB of a 128 GB system to graphics on Windows, per AMD. Everything fits; generation is much slower than on a big desktop card.
Laptop vs desktop: what to know
- Same name, less VRAM and power: NVIDIA lists the GeForce RTX 4090 Laptop GPU at 16 GB GDDR6, 256-bit, 80–150 W. The desktop GeForce RTX 4090 is 24 GB GDDR6X, 384-bit, 450 W Total Graphics Power (https://www.nvidia.com/en-us/geforce/graphics-cards/40-series/rtx… source →
- The pattern continues with Blackwell. NVIDIA lists the RTX 5090 Laptop GPU at 24 GB GDDR7, 256-bit, 95–150 W. The desktop RTX 5090 is 32 GB GDDR7, 512-bit, 575 W Total Graphics Power (https://www.nvidia.com/en-us/geforce/graphics-cards/50-series/rtx-5090/). source →
- Notebookcheck on Ampere: compared with the desktop RTX 3080, the RTX 3080 Laptop drops from 8,704 to 6,144 shaders and from a 320-bit to a 256-bit memory interface, with power cut from 320 W to 80–150+ W. Mobile RTX 3080s performed '(much) worse than their des… source →
- Notebookcheck found that a 140 W RTX 3070 Laptop (Schenker XMG Neo 17) outperformed its RTX 3080 laptops in synthetic benchmarks: 'ostensibly slower GPUs can turn out to be faster than their more expensive and thus allegedly faster siblings'. A higher TGP can … source →
- Notebookcheck: 'OEMs are also free to configure Ampere Laptop GPUs across a range of total graphics power (TGP) values', these details 'are not necessarily made explicit in the official spec sheets', and 'it is currently not possible for customers to estimate … source →
- NVIDIA still publishes wide power ranges for current laptop GPUs, e.g. RTX 5090 Laptop 95–150 W, RTX 5070 Laptop 50–100 W, RTX 5050 Laptop 35–100 W. The same GPU name can run at very different power levels, and so different speeds, depending on the laptop. VRA… source →