QDNAAdvisory and architecture for LLM inference and training platforms, on-premises or hybrid

DeepSeek V4

DeepSeek

DeepSeek V4

DeepSeek V4 delivers frontier-level performance at reduced cost. The Pro version totals 1.6 trillion parameters (49 billion active), the Flash version 284 billion (13 billion active), both under the MIT licence. The Pro version handles reasoning, while the Flash version serves everyday tasks with speed and fits on a single-node machine. This model forms the foundation of dwarfstar.

Key points: Price-to-performance ratio · Mixture of experts · Pro 1.6T, 49B active · Flash 284B, 13B active · Foundation of dwarfstar.

Architecture

DeepSeek V4 is a family of two mixture-of-experts models, both with a native context of 1,048,576 tokens and an MIT licence. DeepSeek V4 Pro totals 1,600 billion parameters of which 49 billion are active per token (384 experts, 6 active), for 865 GB of weights published in FP4 and FP8. DeepSeek V4 Flash totals 284 billion parameters of which 13 billion are active (256 experts, 6 active), for 167 GB of weights published in the 0731 revision. Both figures come from the official model card on Hugging Face, re-read on 2 September 2026.

Strengths

It delivers frontier-level performance at reduced cost, making it a benchmark for price-to-performance among open-weight models.

Use cases

The Pro version handles demanding reasoning tasks, while the Flash version serves everyday work with speed. DeepSeek V4 forms the foundation of the dwarfstar stack.

Deployment

Served by vLLM or llama.cpp depending on quantisation. It runs locally on an RTX PRO 6000 server within dwarfstar.

All models on the platform are interchangeable through a single gateway: switching models is a matter of changing one configuration line, with no code rewrite. Local execution remains the priority.

Official sources

Deploy this model on your premises

On your own hardware, with your data staying in-house.

Book a call

Which machine can run DeepSeek V4?

DeepSeek V4 Pro totals 1600 billion parameters, about 920 GB in NVFP4 (calculated as 1,600 billion × 0.5 byte plus a 15% execution margin). 4 platforms in the catalogue have enough memory for the Pro version. Active parameters govern speed, not footprint: every expert stays resident. DeepSeek V4 Flash, 284 billion parameters, weighs about 163 GB by the same calculation (167 GB of weights published in FP4 + FP8) and also fits on a DGX Station GB300 and on a cluster of two DGX Spark, see the DeepSeek V4 Flash on DGX guide.

PlatformMemoryMost precise format that fitsSizing page
H200 SXM server1,128 GBNVFP4DeepSeek V4 on H200 SXM server
B200 SXM1,440 GBNVFP4DeepSeek V4 on B200 SXM
B300 SXM2,304 GBFP8DeepSeek V4 on B300 SXM
GB300 NVL7220,700 GBFP16DeepSeek V4 on GB300 NVL72

See also DeepSeek V4 in NVFP4 and the full sizing matrix.