QDNA Send a message

Local LLM and compliance in healthcare

Healthcare falls under the HDS and GDPR framework. Serving a model on the organisation's premises moves the question of data transfer.

By QDNA · Published on · Updated on

Short answer. A model served on the organisation's premises processes data in place. No data leaves the information system, which answers the HDS and GDPR framework without depending on a transfer to a third party.

Which framework applies?

The sector falls under HDS and GDPR. The sensitive point is certified health data hosting. Processing carried out on site removes the transfer of data to a provider, and with it the question of hosting location and of the sub-processor.

Which platforms qualify?

Indicative prices, not contractual, excluding integration; “on quotation” when no vendor publishes a price. Sources are at the end of the page. Sizing depends on the model chosen. See the sizing pages for the footprint of each model on each platform.

What this page does not say

This page describes an architecture. It is not legal advice. Compliance is assessed on the actual processing, with the organisation’s data protection officer and, where applicable, its supervisory authority.

Official sources

Does a local LLM answer HDS and GDPR?

A model served on the organisation's premises processes data in place. No data leaves the information system, which answers the HDS and GDPR framework without depending on a transfer to a third party.

Which platform should I start with?

The choice depends on the target model and the number of users. The sizing pages give the memory footprint of each model on each platform.

Method and sources

Memory footprints are calculated, not measured: a reading on real hardware may differ depending on the engine and the exact weight format. Every figure below carries its source and the date of its last check.

  • DGX Spark, 128 GB (128 GB LPDDR5X, 273 GB/s, 240 W power supply, 140 W GB10 TDP), manufacturer sheet checked on 26 September 2026. Price: €7,000 excl. VAT, indicative and not contractual. Price used by QDNA from October 2026 to follow the observed hardware price increase; previous reading: PNY DGX Spark at €6,099.95 incl. VAT, €5,083.29 excl. VAT, at LDLC.pro and €5,290 excl. VAT at Nelpx on 26 September 2026.
  • Mac Studio Ultra, 512 GB (M5 Ultra, up to 512 GB unified memory, 1.2 TB/s, 480 W continuous; the 512 GB variant is announced for late October 2026), manufacturer sheet checked on 26 September 2026. Price: €6,599 to €12,429 incl. VAT, indicative and not contractual. Apple Store France read on 8 October 2026: €6,599 for the M5 Ultra with 96 GB and 1 TB, €12,429 with 256 GB and 1 TB (36-core CPU and 80-core GPU chip required), €20,679 with 16 TB; the 512 GB option, announced for late October, is not priced yet.
  • DGX Station, 748 GB (252 GB HBM3e (7.1 TB/s) and 496 GB LPDDR5X (396 GB/s), 1,600 W, 20 PFLOPS FP4 with sparsity (15 dense)), manufacturer sheet checked on 26 September 2026. Price: €150,000 excl. VAT, indicative and not contractual. Price used by QDNA from October 2026 to follow the observed hardware price increase; previous reading at the reseller pi3g on 14 September 2026: €88,000 to €110,500 excl. VAT depending on the OEM (Supermicro, MSI, Exxact, Gigabyte, HP and ASUS), €173,000 excl. VAT for Dell.
  • RTX PRO 6000 server, 768 GB (96 GB GDDR7 and 1,597 GB/s per card, 600 W, hence 768 GB for 8 cards), manufacturer sheet checked on 26 September 2026. Price: on quotation. No manufacturer publishes a price for an 8-card server; the card alone is listed at $16,000 on the NVIDIA marketplace (as reported by thundercompute.com, 1 September 2026) and at €17,709.95 incl. VAT, €14,758 excl. VAT, in its Max-Q edition at LDLC on 26 September 2026.
  • H200 SXM server, 1,128 GB (141 GB HBM3e and 4.8 TB/s per GPU, 900 GB/s NVLink, 700 W, hence 1,128 GB for 8 GPUs), manufacturer sheet checked on 26 September 2026. Price: about €451k excl. VAT, indicative and not contractual. 8-GPU H200 141 GB server with two Xeon Gold 6538Y+ listed at £387,785 by CTO Servers on 2 September 2026, converted at the ECB rate of £0.860 per €1 on 25 September 2026.
  • B200 SXM, 1,440 GB (HGX B200, 8 Blackwell GPUs, 1.4 TB total memory, 144 PFLOPS FP4 with sparsity (72 dense), 1.8 TB/s NVLink per GPU), manufacturer sheet checked on 26 September 2026. Price: on quotation. NVIDIA publishes no price; Aivres quoted about $340,000 excl. VAT for an HGX B200 server (Arc Compute, updated 30 July 2026, flagged as outdated by the author).
  • B300 SXM, 2,304 GB (HGX B300, 8 Blackwell Ultra GPUs at 288 GB, hence 2,304 GB (the HGX sheet rounds to 2.1 TB), 144 PFLOPS FP4 with sparsity (108 dense), 1.8 TB/s NVLink per GPU), manufacturer sheet checked on 26 September 2026. Price: about €436k to €697k excl. VAT, indicative and not contractual. BIZON X9000 G5 at $496,728 (November 2026 delivery) and Supermicro AS-8126GS-NB3RT at $795,000 from Vipera, both listed on 2 September 2026, converted at the ECB rate of $1.1403 per €1 on 25 September 2026.
  • GB300 NVL72, 20,700 GB (72 Blackwell Ultra GPUs and 36 Grace CPUs, 20 TB of GPU memory per NVIDIA (72 × 288 GB = 20,736 GB), 37 TB fast memory, 130 TB/s NVLink, 1,440 PFLOPS FP4 with sparsity (1,080 dense); power draw not published), manufacturer sheet checked on 26 September 2026. Price: on quotation. NVIDIA publishes no price; analyst estimates range from $3.7M to $6.5M per rack (Loop Capital, Tom’s Hardware, as reported by Spheron on 16 August 2026).