NVIDIA

RTX 5080

Rent in the cloud

Where to buyLDLC Materiel.net TopAchat Cybertek Grosbill Rue du Commerce Amazon

16 Go

VRAM

—

Best generation

—

Efficiency (ref.)

—

Elec. cost / M tokens (ref.) · 0,25 €/kWh

What this card can run

Llama 3.2 3B Instruct Q4_K_M

2.02 Go

Not measured

Smooth ≥ 60 tok/s (faster than you read) · Comfortable 30-60 · Slow < 30 · "Doesn't fit" = model size + 2 GB headroom > VRAM (CPU offloading is excluded from the protocol: the numbers would be meaningless).

Measurements by model

No runs for this card yet. Your move: run the bench.

VRAM used = peak system GPU memory during the run (includes the OS, roughly 0.5–1 GB more than the model alone).