DeepSeek

R1 0528 (Qwen3) 8B

reasoning

8,2B

Parameters

4,7 Go

Q4_K_M file

≥ 6,2 Go

Recommended VRAM

131 072

Max context

Standard llama-bench run (prompt 512 / generation 128 tokens), model fully in VRAM. Click a card for details. Electricity cost at the default price (0,25 €/kWh).

Card · Q4_K_MVRAMGenerationPromptVRAM usedPower€ elec. / M tokPrice
RTX 4070 Ti12 Go90,1 tok/s5 9945,2 Go154 W0,12 €/M tok—

Not measured on these cards yet — click for an estimate:

Technical sheet

Published
2025-05-29
Architecture
36 layers · 8 KV heads · dimension 128
Attention
Standard: every layer keeps the whole context in memory.
Context cache (f16)
≈ 141 MB per 1,000 tokens · 4,5 Go for 32,768 tokens
GGUF file
bartowski/deepseek-ai_DeepSeek-R1-0528-Qwen3-8B-GGUF · deepseek-ai_DeepSeek-R1-0528-Qwen3-8B-Q4_K_M.gguf Download (4,7 Go)

Public Hugging Face data (official config.json, GGUF repo). The context cache only counts full-attention layers.