NVIDIA

Nemotron 3.5 Lightning

MoE

Pick a size: the video memory shown is the Q4_K_M file (the protocol's quantisation) plus about 1.5 GB for a 4,000-token context.

30B-A3B

32 GB card

Parameters: 31,6B · 3B active
Q4_K_M file: 23,7 Go
Recommended VRAM: ≥ 25,2 Go
Max context: 262 144

Not measured yet

MoE (“30B-A3B”): all the memory of a 30B, but the speed of a model with 3B active parameters. “> 32 GB”: several cards, or part of the model in system memory (much slower).