Local LLM and compliance in healthcare

Healthcare falls under the HDS and GDPR framework. Serving a model on the client premises moves the question of data transfer.

Short answer. A model served on the client premises processes data in place. No data leaves the information system, which answers the HDS and GDPR framework without depending on a transfer to a third party.

Which framework applies?

The sector falls under HDS and GDPR. The sensitive point is certified health data hosting. Processing carried out on site removes the transfer of data to a provider, and with it the question of hosting location and of the sub-processor.

Which platforms qualify?

Sizing depends on the model chosen. See the sizing pages for the footprint of each model on each platform.

What this page does not say

This page describes an architecture. It is not legal advice. Compliance is assessed on the actual processing, with the organisation’s data protection officer and, where applicable, its supervisory authority.

Official sources

Does a local LLM answer HDS and GDPR?

A model served on the client premises processes data in place. No data leaves the information system, which answers the HDS and GDPR framework without depending on a transfer to a third party.

Which platform should I start with?

The choice depends on the target model and the number of users. The sizing pages give the memory footprint of each model on each platform.

Method

Parameter counts and memory figures come from the site fact sheets. Memory footprints are calculated, not measured: a reading on real hardware may differ depending on the engine and the exact weight format. Prices are indicative and not contractual.