RTX 4090 (card only)
High-end local inference. AgentRig Score: 59
- Chip
- RTX 4090
- GPU
- RTX 4090
- VRAM (GB)
- 24
- OS
- Linux/Windows
- Price
- $3,016
- Price config
- RTX 4090 24GB card only, used sold median
- Price status
- verified
- Price note
- gpusold.com 2026-10-20
- Llama 3.1 8B Q4 tok/s
- 127.7
- Good for
- High-end local inference
Spec source: https://www.nvidia.com/en-us/geforce/graphics-cards/40-series/rtx-4090/
Price source: https://gpusold.com/
Benchmark source: https://github.com/XiongjieDai/GPU-Benchmarks-on-LLM-Inference