Discrete GPUs

GPUs for local inference

GPU memory, bandwidth, backend support and source-linked specifications. Manufacturer list is the published launch MSRP, not a current selling price. First-party measurements are shown only where a recorded test exists.

Catalogue review recorded · individual claims have separate datesStructured datasetSourceMethodology

Photos show board-partner cards or manufacturer-edition boards and link to the manufacturer product page. Manufacturer list is the published launch MSRP, not a current street price. VRAM capacity and bandwidth describe different constraints; neither alone predicts model throughput. TDP is a thermal-design specification, not measured wall power. First-party tok/s appear only after a receipt on that card — currently 0 GPU measurements.

ASUS Dual board GeForce RTX 4060
GeForce RTX 4060
8 GB · 272 GB/s · $299 launch MSRP
CUDA · 115 W TDP · source review 2026-09-04
Manufacturer specifications
ASUS Dual board (8 GB model shown) GeForce RTX 4060 Ti 16GB
GeForce RTX 4060 Ti 16GB
16 GB · 288 GB/s · $499 launch MSRP
CUDA · 165 W TDP · source review 2026-09-04
Manufacturer specifications
ASUS Dual board GeForce RTX 4070 SUPER
GeForce RTX 4070 SUPER
12 GB · 504 GB/s · $599 launch MSRP
CUDA · 220 W TDP · source review 2026-09-04
Manufacturer specifications
PNY XLR8 board GeForce RTX 4070 Ti SUPER
GeForce RTX 4070 Ti SUPER
16 GB · 672 GB/s · $799 launch MSRP
CUDA · 285 W TDP · source review 2026-09-04
Manufacturer specifications
Gigabyte Gaming OC board GeForce RTX 4080 SUPER
GeForce RTX 4080 SUPER
16 GB · 736 GB/s · $999 launch MSRP
CUDA · 320 W TDP · source review 2026-09-04
Manufacturer specifications
PNY XLR8 board GeForce RTX 4090
GeForce RTX 4090
24 GB · 1008 GB/s · $1,599 launch MSRP
CUDA · 450 W TDP · source review 2026-09-04
Manufacturer specifications
MSI Ventus 3X board GeForce RTX 3090
GeForce RTX 3090
24 GB · 936 GB/s · $1,499 launch MSRP
CUDA · 350 W TDP · source review 2026-09-04
Manufacturer specifications
ASUS Prime board GeForce RTX 5070
GeForce RTX 5070
12 GB · 672 GB/s · $549 launch MSRP
CUDA · 250 W TDP · source review 2026-09-04
Manufacturer specifications
PNY XLR8 board GeForce RTX 5070 Ti
GeForce RTX 5070 Ti
16 GB · 896 GB/s · $749 launch MSRP
CUDA · 300 W TDP · source review 2026-09-04
Manufacturer specifications
ASUS Prime board GeForce RTX 5080
GeForce RTX 5080
16 GB · 960 GB/s · $999 launch MSRP
CUDA · 360 W TDP · source review 2026-09-04
Manufacturer specifications
MSI Ventus 3X board GeForce RTX 5090
GeForce RTX 5090
32 GB · 1792 GB/s · $1,999 launch MSRP
CUDA · 575 W TDP · source review 2026-09-04
Manufacturer specifications
PNY RTX 6000 Ada workstation board RTX 6000 Ada Generation
RTX 6000 Ada Generation
48 GB · 960 GB/s · $6,800 launch MSRP
CUDA · 300 W TDP · source review 2026-09-04
Manufacturer specifications
ASUS TUF Gaming board Radeon RX 9070 XT
Radeon RX 9070 XT
16 GB · 640 GB/s · $599 launch MSRP
ROCM · 304 W TDP · source review 2026-09-07
Manufacturer specifications
Intel Limited Edition board Intel Arc B580
Intel Arc B580
12 GB · 456 GB/s · $249 launch MSRP
XPU · 190 W TDP · source review 2026-09-04
Manufacturer specifications