Card × model benchmark

Qwen2.5 Coder 14B on RTX 5070 Ti Q4_K_M

Smooth

On an RTX 5070 Ti (16 GB), Qwen2.5 Coder 14B in Q4_K_M generates 81,9 tokens/s and reads the prompt at 3 725 tokens/s, using 9,4 Go of video memory.

Median of 1 run · latest on 25/09/26

81,9 tok/s

Generation

3 725 tok/s

Prompt processing

9,4 Go

VRAM used (peak)

166 W

Average power

0,49 tok/s/W

Efficiency

0,14 €/M tok

Electricity / M tokens · 0,25 €/kWh

Estimate your monthly cost from your electricity price and usage: sign in

RTX 5070 Ti pageAll cards on Qwen2.5 Coder 14BFeel the speed Rent in the cloud
Where to buyLDLC Materiel.net TopAchat Cybertek Grosbill Rue du Commerce Amazon

What about a longer context?

An estimate, not a measurement: the KV cache grows with context, takes VRAM and slows generation down.

ContextKV cacheEstimated VRAMFits in 16 GB?Estimated speed
4 0960,8 Go10,0 Goyes≈ 76,5 tok/s
8 1921,5 Go10,8 Goyes≈ 71,0 tok/s
16 3843,0 Go12,3 Goyes≈ 62,0 tok/s
32 7686,0 Go15,3 Goyes≈ 49,5 tok/s

KV cache per token = 2 × 48 layers × 8 KV heads × 128 × 2 bytes (f16). Estimated VRAM = measured VRAM + added KV cache. Speed ≈ measured speed × weights ÷ (weights + added KV cache) — attention compute is not modelled, the real drop is slightly larger. Fine-tune it in the “Configurator”

Qwen2.5 Coder 14B on other cards

CardVRAMGenerationDifferencePrice
RTX 5070 Ti16 Go81,9 tok/sthis card—
RTX 4070 Ti12 Go50,3 tok/s−38,6 %—

Other models measured on the RTX 5070 Ti

Qwen2.5 Coder 0.5B Q4_K_M 805 tok/sQwen2.5 0.5B Q4_K_M 803 tok/sQwen3 0.6B Q4_K_M 728 tok/sQwen3.5 0.8B Q4_K_M 514 tok/sQwen2.5 1.5B Q4_K_M 481 tok/sQwen2.5 Coder 1.5B Q4_K_M 481 tok/sQwen3 1.7B Q4_K_M 456 tok/sQwen3.5 2B Q4_K_M 394 tok/sQwen2.5 Coder 3B Q4_K_M 305 tok/sQwen2.5 3B Q4_K_M 305 tok/sLlama 3.2 3B Instruct Q4_K_M 283 tok/sQwen3 4B Q4_K_M 225 tok/sQwen3 2507 4B Q4_K_M 224 tok/sQwen3.5 4B Q4_K_M 196 tok/sQwen2.5 7B Instruct Q4_K_M 162 tok/sQwen2.5 Coder 7B Q4_K_M 162 tok/sMeta Llama 3.1 8B Instruct Q4_K_M 151 tok/sQwen3 8B Q4_K_M 146 tok/sQwen3.5 9B Q4_K_M 125 tok/sDeepSeek R1 Distill Qwen 14B Q4_K_M 81,5 tok/sQwen2.5 14B Instruct Q4_K_M 82,4 tok/sQwen3 14B Q4_K_M 84,8 tok/sPhi-4 Q4_K_M 84,9 tok/s

All measurements

DateSourceTypeGenerationPromptVRAMMax temp.Powerllama.cpp
25/09/26French_Girl_13context 32 768MSI Gaming X Trio50,21 26615,5 Go70 °C225 Wllama.cpp 96278e39f
25/09/26French_Girl_13context 16 384MSI Gaming X Trio62,92 01912,7 Go70 °C206 Wllama.cpp 96278e39f
25/09/26French_Girl_13context 8 192MSI Gaming X Trio71,62 67011,2 Go67 °C197 Wllama.cpp 96278e39f
25/09/26French_Girl_13standardMSI Gaming X Trio81,93 7259,4 Go61 °C166 Wllama.cpp 96278e39f

Protocol: llama-bench (llama.cpp), prompt 512 + generation 128 tokens, model fully loaded in VRAM. VRAM used = system peak (includes the OS, ~0.5 to 1 GB more than the model alone). Measure my card