QDNASales and integration of LLM inference and training platforms, on-premises or hybrid

How much memory does Qwen 3.6 27B need in Q4?

Qwen 3.6 27B has 27 billion parameters. The Q4 format decides how much memory is needed to load them.

Short answer. In Q4, the weights of Qwen 3.6 27B take about 15.5 GB including the runtime margin. 8 of the 8 platforms in the catalogue have enough memory.

How is this footprint calculated?

Qwen 3.6 27B totals 27 billion parameters. The Q4 format takes 0.5 byte per parameter. The product gives the weights, to which a 15% runtime margin is added for activations and buffers. The attention cache is not included: it grows with context and concurrency.

What does the format change?

Q4 brings block quantisation, broadly supported.

FormatWeights in memory Compatible platforms
FP1662.1 GB8
FP831.0 GB8
NVFP415.5 GB8
Q415.5 GB8

Which platforms qualify?

See the Qwen 3.6 27B fact sheet.

How much memory for Qwen 3.6 27B in Q4?

About 15.5 GB for the weights, excluding the attention cache.

Which format should I choose for Qwen 3.6 27B?

Q4 brings block quantisation, broadly supported. The most precise format that fits the target machine remains the best choice.

Method

Parameter counts and memory figures come from the site fact sheets. Memory footprints are calculated, not measured: a reading on real hardware may differ depending on the engine and the exact weight format. Prices are indicative and not contractual.