Leaderboard RTX 5050 Qwen2.5 7B Card × model estimate
Qwen2.5 7B on RTX 5050 Q4_K_M should fit On an RTX 5050 (8 GB), Qwen2.5 7B in Q4_K_M needs about 5,9 Go of video memory: it should fit.
Not measured yet: the figures below are estimates, computed from the models already measured on this card. Measure my card
≥ 5,9 Go
Recommended VRAM (8 GB avail.)
—
Electricity / M tokens · 0,25 €/kWh
No model has been measured on the RTX 5050 yet: no speed estimate possible.
What about a longer context? Context KV cache Estimated VRAM Fits in 8 GB? Estimated speed 4 096 0,2 Go 5,1 Go yes — 8 192 0,4 Go 5,3 Go yes — 16 384 0,9 Go 5,7 Go yes — 32 768 1,8 Go 6,6 Go yes —
Estimated VRAM = file + KV cache (full-attention layers, f16) + ~0,5 Go of buffers, excluding memory used by the system — hence the slightly higher “recommended VRAM”, which keeps that margin. Speed ≈ estimated speed × weights read ÷ (weights read + added KV cache).
Qwen2.5 7B on other cards Vendor NVIDIA Chip Pick a chip… RTX 3050 · 8 Go · should fit RTX 3050 Laptop GPU · 4 Go · too tight RTX 3050 Ti Laptop GPU · 4 Go · too tight RTX 3060 · 12 Go · should fit RTX 3060 Laptop GPU · 6 Go · should fit RTX 3060 Ti · 8 Go · should fit RTX 3070 · 8 Go · should fit RTX 3070 Laptop GPU · 8 Go · should fit RTX 3070 Ti · 8 Go · should fit RTX 3070 Ti Laptop GPU · 8 Go · should fit RTX 3080 · 10 Go · should fit RTX 3080 Laptop GPU · 8 Go · should fit RTX 3080 Ti · 12 Go · should fit RTX 3080 Ti Laptop GPU · 16 Go · should fit RTX 3090 · 24 Go · should fit RTX 3090 Ti · 24 Go · should fit RTX 4050 Laptop GPU · 6 Go · should fit RTX 4060 · 8 Go · should fit RTX 4060 Laptop GPU · 8 Go · should fit RTX 4060 Ti · 8 Go · should fit RTX 4070 · 12 Go · should fit RTX 4070 Laptop GPU · 8 Go · should fit RTX 4070 SUPER · 12 Go · should fit RTX 4070 Ti · 12 Go · should fit RTX 4070 Ti SUPER · 16 Go · should fit RTX 4080 · 16 Go · should fit RTX 4080 Laptop GPU · 12 Go · should fit RTX 4080 SUPER · 16 Go · should fit RTX 4090 · 24 Go · should fit RTX 4090 Laptop GPU · 16 Go · should fit RTX 5050 · 8 Go · should fit RTX 5050 Laptop GPU · 8 Go · should fit RTX 5060 · 8 Go · should fit RTX 5060 Laptop GPU · 8 Go · should fit RTX 5060 Ti · 16 Go · should fit RTX 5070 · 12 Go · should fit RTX 5070 Laptop GPU · 8 Go · should fit RTX 5070 Ti · 16 Go · should fit RTX 5070 Ti Laptop GPU · 12 Go · should fit RTX 5080 · 16 Go · should fit RTX 5080 Laptop GPU · 16 Go · should fit RTX 5090 · 32 Go · should fit RTX 5090 Laptop GPU · 24 Go · should fit
should fit Estimates based on real measurements of other models on this card and on the model's public data (Qwen). As soon as a measurement exists, this page shows the real figures.
TokenBench · V1.0 · Measurements powered by llama.cpp
Privacy & cookies