Configurator

Build your setup, without overflowing

Pick your card, the memory to leave to the system, the model and the context size: we check that everything fits in video memory and estimate the speed.

Speeds at context 0 are measured. Anything depending on context or concurrency is an estimate: every formula is shown, nothing is written to the database.

Graphics card

24 models measuredReserved for the OS

display, browser, system

Model162 tok/s · 5,9 Go measured · 1 runContext window

tok

max 32 768

KV cache

Video memory of the RTX 5070 Ti

6,1 Go used of 15,0 Go usable (16 GB)

8,9 Go left to add a model or grow a context.

▮ model (measured)▨ KV cache□ Reserved for the OS

Qwen2.5 Coder 7BQ4_K_M · 4 096 tok

VRAM: 6,1 Go; 5,9 Go + 0,2 Go KV
Alone: 156 tok/s; Estimated
Concurrent: —; add a 2nd model