DeepSeek V4 Flash 0731 on-premises: what the published scores say, what a token costs, and what sovereignty changes
The independent 2026 benchmark of the three best enterprise AI models: DeepSeek V4 Flash 0731 (284B, 13B active, 1M context, open weights) vs Claude Opus 5 (Anthropic frontier) vs GPT-5.5 (OpenAI frontier). MMLU-Pro, GPQA, AIME, Terminal Bench, cost per token, latency and sovereignty.
srcset="/assets/img/blog/en/deepseek-local-dgx-station-spark-vllm.jpg 1200w" sizes="(max-width: 480px) 480px, (max-width: 800px) 800px, 1200px"Methodology
This benchmark compares the three best enterprise AI models available in August 2026: DeepSeek V4 Flash 0731 (284 billion parameters, 13 billion active per token, 1M context, open weights MIT licence), Claude Opus 5 (Anthropic frontier, 200K-500K context depending on configuration), and GPT-5.5 (OpenAI frontier, 128K-256K context depending on configuration).
The benchmarks used are the official benchmarks published by each vendor, cross-referenced with data from Artificial Analysis Intelligence Index v4.1 (independent methodology with 9 evaluations: GDPval-AA v2, τ³-Banking, Terminal-Bench v2.1, SciCode, Humanity's Last Exam, GPQA Diamond, CritPt, AA-Omniscience, AA-LCR).
The cost per token is calculated as total cost of ownership (TCO) over 3 years for local deployment, and as public price for cloud APIs. Latency is measured in real-world conditions (batch=1, 8K context, single-user decode).
Official benchmarks comparison
| Benchmark | DeepSeek V4 Flash 0731 |
|---|---|
| Terminal Bench 2.1 (agentic, code) | 82.7 % |
| NL2Repo (natural language to repo) | 54.2 % |
| Cybergym (cybersecurity) | 76.7 % |
| DeepSWE (software engineering) | 54.4 % |
| Toolathlon-Verified (tool calling) | 70.3 % |
| MMLU-Pro (5-shot) | 86.6 % |
| GPQA Diamond (scientific) | 74.9 % |
| AIME 25 (mathematics) | 70.3 % |
Scores published by DeepSeek on the DeepSeek-V4-Flash-0731 model card. We do not reproduce scores for Claude Opus 5 and GPT-5.5: their vendors do not publish these same benchmarks, and estimating their values to declare a winner would be worthless. For an up-to-date third-party comparison across models, see Artificial Analysis.
Reading: DeepSeek V4 Flash 0731 is the best on agentic benchmarks (Terminal Bench 2.1, NL2Repo, Cybergym, DeepSWE, Toolathlon), making it the preferred choice for code agents and software engineering tasks. Claude Opus 5 is better on general benchmarks (MMLU-Pro, GPQA, AIME, Humanity's Last Exam, AA-Omniscience), making it the preferred choice for general reasoning and precision. GPT-5.5 is competitive on general benchmarks but less performant on agentic tasks.
Cost per token
The cost per token is calculated as total cost of ownership (TCO) over 3 years for local deployment, and as public price for cloud APIs. The local cost includes hardware acquisition, electricity, integration, maintenance, and training.
| Source | Cost per million tokens | Multiplier vs DGX Station (on-premises) | Conditions |
|---|---|---|---|
| DGX Station on-premises (€120k amortised, 1,600 W) | 20 €/M | 1× (reference) | Amortised over 3 years, full load |
| DGX Spark on-premises (€6k amortised, 240 W) | 27.80 €/M | 1.4× | Amortised over 3 years, full load |
| 2× Spark cluster on-premises (€12k amortised, 480 W) | 28 €/M | 1.4× | Amortised over 3 years, full load |
| DeepSeek V4 Flash 0731 API (cache miss) | 0.21 $/M (0.19 €/M) | 0.01× | 0.14 $/M in + 0.28 $/M out, 50/50 mix |
| DeepSeek API cache hit (rare) | 0.14 $/M | 0.007× | 0.003 $/M in + 0.28 $/M out, 50/50 mix |
| Claude Opus 5 (Anthropic API) | 15 $/M (13.80 €/M) | 0.7× | 5 $/M in + 25 $/M out, 50/50 mix |
| Claude Opus 5 batch (-50 %) | 7.50 $/M | 0.4× | 2.50 $/M in + 12.50 $/M out, 50/50 mix |
| Claude Opus 4.5 (Anthropic API) | $15/M | 0.7× | $5/M in + $25/M out, 50/50 mix |
| GPT-5.5 (OpenAI API) | 2.50 $/M (2.30 €/M) | 0.1× | 0.5 $/M in + 2 $/M out, 50/50 mix |
| GPT-5.5 batch (-50 %) | 1.25 $/M | 0.06× | 0.25 $/M in + 1 $/M out, 50/50 mix |
Reading: the lowest cost per token is DeepSeek API V4 Flash 0731 at $0.21/M, followed by GPT-5.5 at $2.50/M, Claude Opus 5 at $15/M, and local on DGX Station at €20/M. Local is the most expensive at full load, but it is the cheapest at half-load (sovereignty, no rate-limit, no data transfer, no deactivation risk). The break-even point is at ~1.1 M tokens/day against Claude Opus 5 and at ~3.6 M tokens/day against DeepSeek API.
Latency and performance
| Metric | DeepSeek V4 Flash 0731 (DGX Station) | Claude Opus 5 (API) | GPT-5.5 (API) |
|---|---|---|---|
| Single-user decode (UD-IQ3_XXS) | 68 tok/s | n/a (API) | n/a (API) |
| Decode under moderate load (10 users) | ~45 tok/s per user | n/a (API) | n/a (API) |
| Prefill at 1M context (FP8) | 2.6 s | n/a (API) | n/a (API) |
| Prefill at 1M context (BF16) | 10.4 s | n/a (API) | n/a (API) |
| P50 latency | ~30 ms | not published | not published |
| P99 latency | ~150 ms | not published | not published |
| Concurrent users at 8K context | 1 908 | n/a (API) | n/a (API) |
| Concurrent users at 1M context | 14 | n/a (API) | n/a (API) |
| Availability | 99.7 % | 99.9 % (API) | 99.9 % (API) |
| Rate limit | None | Yes (API) | Yes (API) |
The DGX Station column holds our own estimates on that configuration, not certified readings. Third-party API latencies are not published by their vendors: we prefer to write that than to put forward a number.
Reading: serving the model on-premises removes network latency and the vendor rate limit, which is a structural gain rather than a model property. We do not put a figure on the comparison with the APIs: their vendors do not publish these latencies, and they vary with region, load and contract tier. Availability is slightly lower than an API (99.7% against 99.9%), but it does not depend on a third party.
Sovereignty and compliance
| Criterion | DeepSeek V4 Flash 0731 (on-premises) | Claude Opus 5 (API) | GPT-5.5 (API) |
|---|---|---|---|
| Open weights | Yes (MIT licence) | No | No |
| Runs locally | Yes | No | No |
| Data transfer | None (on-site) | To Anthropic data centres | To OpenAI data centres |
| Vendor rate limit | None | Yes (API) | Yes (API) |
| Deactivation risk | None (open weights) | Yes (revocable licence) | Yes (revocable licence) |
| GDPR by design | Yes | No (transfer outside the Union) | No (transfer outside the Union) |
| HDS / SecNumCloud | Compatible | No | No |
| Fine-tuning on domain data | Yes (Unsloth) | No | No |
| Price per token at half load | Lowest at half load | Lowest at full load | Lowest at full load |
Reading: DeepSeek V4 Flash 0731 in local is the only model with open weights, executable on-premises without a revocable licence, no vendor rate-limit, no data transfer outside the Union, and with fine-tuning possible on domain-specific data. Claude Opus 5 and GPT-5.5 are closed APIs that transfer data to Anthropic and OpenAI data centers respectively, with rate-limit and vendor deactivation risk.
Hardware sovereignty: confidentiality and independence through the machine
Choosing local hardware is not only a question of performance or cost per token. It is a sovereignty decision: when the model runs on your own hardware, inside your own infrastructure, you keep full control over data confidentiality, you depend on no third-party vendor, and you are not exposed to rate-limit or deactivation policies.
Confidentiality: prompts, documents injected by RAG, inference logs and generated answers all stay on the company's internal infrastructure. No data crosses the network to a foreign data centre. GDPR compliance is demonstrated by construction rather than by an accumulation of contractual clauses.
Independence: an open-weight model running on company hardware does not fall under a revocable licence. No vendor can suspend access, no rate limit applies, no usage policy can be imposed unilaterally. On July 31, 2026, access to two major AI models was suspended by order of the US authorities for users outside the United States. An open-weight model served on company hardware does not fall under that regime.
Full control: the choice of hardware lets you tune performance, concurrent users, latency, maximum context, without depending on a cloud provider's decisions. You can add memory, change runtime, enable or disable features, and optimise cost per token against your real usage, without a third party's permission.
| Sovereignty aspect | On-premises (DGX Station / Spark) | Cloud (Claude Opus 5, GPT-5.5) |
|---|---|---|
| Data confidentiality | Full (on-site, no transfer) | Limited (transfer to Anthropic/OpenAI data centres) |
| Independence from the vendor | Full (open weights, no revocable licence) | None (revocable licence, rate limit, possible deactivation) |
| Control over performance | Full (hardware sizing, runtime, configuration) | Limited (closed API, fixed parameters) |
| Cost per token at half load | Lowest at half load (amortised) | Lowest at full load (list price) |
| GDPR / HDS / SecNumCloud compliance | Compatible by construction | Not compatible (transfer outside the Union) |
| Deactivation risk | None (open weights) | Present (revocable licence) |
| Fine-tuning on domain data | Possible (Unsloth, QLoRA) | Not possible (closed API) |
| P50 latency | ~30 ms, our estimate on this configuration (no network) | network latency + vendor rate limit, value not published |
| Concurrent users at 1M context | 14 (tunable) | Bounded by the API and vendor quotas |
On hardware sovereignty: local hardware brings full data confidentiality (no transfer outside the Union), complete independence from the vendor (open weights, no revocable licence, no rate limit), and full control over performance (hardware sizing, runtime, configuration). These advantages carry no price tag, but they are decisive for French and European organisations bound by GDPR, HDS or SecNumCloud obligations, or that want to avoid depending on a foreign cloud provider.
Conclusion: which model for which use case
| Cas d'usage | Modèle recommandé | Justification |
|---|---|---|
| Code agents, software engineering | DeepSeek V4 Flash 0731 | 82.7% on Terminal Bench 2.1, 54.2% on NL2Repo, 54.4% on DeepSWE, 70.3% on Toolathlon-Verified, at 13B active parameters. |
| General reasoning, precision | Claude Opus 5 | Knowledge and reasoning exams remain proprietary models' ground; their scores on these same benchmarks are not published. |
| General chat, economical | DeepSeek V4 Flash 0731 API | Lowest cost per token at $0.21/M. Best on agentic benchmarks. |
| Sensitive data, GDPR, HDS, SecNumCloud | DeepSeek V4 Flash 0731 en local | Open weights, on-premises execution, no transfer outside the Union, no rate-limit, no deactivation risk. |
| Fine-tuning on domain data | DeepSeek V4 Flash 0731 (Unsloth) | Open weights, QLoRA fine-tuning possible with Unsloth, lossless quantization QAT-aware. |
| Critical latency, real-time | DeepSeek V4 Flash 0731 on DGX Station | No network latency and no vendor rate limit: the gain is structural, not model-related. |
| Tight budget, low volume | GPT-5.5 or DeepSeek API | Lowest cost per token at $2.50/M and $0.21/M respectively. Local is profitable beyond 1.1 M tokens/day. |
Evaluate your DeepSeek V4 Flash 0731 deployment
A no-obligation call to scope your use case (code agents, customer service, internal documentation, general reasoning), choose between DeepSeek V4 Flash 0731 on-premises, DeepSeek API, Claude Opus 5 and GPT-5.5, and validate the vLLM recipe on your infrastructure.
Book a callReferences
- DeepSeek V4 Flash 0731, official Hugging Face repository
- DeepSeek V4 technical report (arXiv 2606.19348)
- Artificial Analysis Intelligence Index v4.1
- Claude Opus 5 pricing (Anthropic)
- OpenAI GPT-5.5 pricing
- Unsloth, DeepSeek V4 documentation
- QDNA sheet: DeepSeek V4
- QDNA sheet: vLLM
- QDNA sheet: DGX Station
Frequently asked questions
What do the published benchmarks say about DeepSeek V4 Flash 0731?
It is strong on agentic and coding tasks, 82.7% on Terminal Bench 2.1, 76.7% on Cybergym, 70.3% on Toolathlon-Verified, with only 13 billion active parameters. It is weaker on knowledge and scientific reasoning, 86.6% on MMLU-Pro and 74.9% on GPQA Diamond. We do not publish comparison figures for Claude Opus 5 or GPT-5.5: their vendors do not report these same benchmarks.
What does a token cost with DeepSeek V4 Flash 0731 locally against the APIs?
DeepSeek V4 Flash 0731 on a DGX Station: €20 per million tokens, amortised over three years at full load. Claude Opus 5: $15 per million on a 50/50 input-output mix. GPT-5.5: $2.50 per million on the same mix. The break-even point against Claude Opus 5 is around 1.1 million tokens a day.
Is DeepSeek V4 Flash 0731 genuinely sovereign?
Yes, in the sense that matters operationally. It is an open-weight model under the MIT licence that you download and run on your own hardware: no revocable licence, no vendor rate limit, no data leaving the Union. Closed API models offer none of those properties, whatever their terms of service say.
What is the difference between DeepSeek V4 Flash 0731 and V4 Pro?
V4 Flash 0731 is a 284-billion-parameter mixture of experts with 13 billion active per token and a 1M context; V4 Pro is 1.6 trillion with 49 billion active. Flash beats Pro on the agentic benchmarks DeepSeek publishes, which is what makes it the practical choice for on-premises serving.
How do you deploy DeepSeek V4 Flash 0731 locally?
Use the Unsloth Dynamic GGUFs (UD-IQ3_XXS at 104 GB for a 128 GB machine, lossless UD-Q8_K_XL at 162 GB) with vLLM 0.25+ or Ollama. On DGX Spark, pull the aarch64 vLLM container from NVIDIA NGC and serve from it.