Configurator

Build your setup, without overflowing

Pick your card, the memory to leave to the system, the model and the context size: we check that everything fits in video memory and estimate the speed.

Speeds at context 0 are measured. Anything depending on context or concurrency is an estimate: every formula is shown, nothing is written to the database.

Graphics card

24 models measuredReserved for the OS

display, browser, system

Model82,4 tok/s · 10,0 Go measured · 2 runsContext window

tok

max 32 768

KV cache

Video memory of the RTX 5070 Ti

10,6 Go used of 15,0 Go usable (16 GB)

4,4 Go left to add a model or grow a context.

▮ model (measured)▨ KV cache□ Reserved for the OS

Qwen2.5 14B InstructQ4_K_M · 4 096 tok

VRAM: 10,6 Go; 10,0 Go + 0,6 Go KV
Alone: 77,0 tok/s; Estimated
Concurrent: —; add a 2nd model