QDNAAdvisory and architecture for LLM inference and training platforms, on-premises or hybrid

How much memory does Kimi K2.7 Code need in NVFP4?

Kimi K2.7 Code has 1000 billion parameters. The NVFP4 format decides how much memory is needed to load them.

Short answer. In NVFP4, the weights of Kimi K2.7 Code take about 575 GB including the runtime margin. 6 of the 8 platforms in the catalogue have enough memory.

How is this footprint calculated?

Kimi K2.7 Code totals 1000 billion parameters. The NVFP4 format takes 0.5 byte per parameter (4 bits per parameter, hence 0.5 byte; 4-bit published weights weigh 0.54 to 0.56 byte per parameter with their scales (DeepSeek V4 Pro 865 GB for 1,599 billion, Kimi K3 1,561 GB for 2,780 billion)). The product gives the weights, to which a 15% runtime margin is added for activations and buffers: 1,000 billion parameters × 0.5 byte (NVFP4) = 500.0 GB of weights; × 1.15 runtime margin = 575.0 GB. The attention cache is not calculated on this page. These models’ architectures (compressed latent, linear or sparse attention, Mamba layers) share no per-token formula; it is measured on the machine, with the target context and concurrency [TO BE MEASURED].

What does the format change?

NVFP4 brings Blackwell format, native FP4 compute.

FormatWeights in memory Compatible platforms
FP162,300 GB2
FP81,150 GB3
NVFP4575 GB6
Q4690 GB6

Which platforms qualify?

See the Kimi K2.7 Code fact sheet.

How much memory for Kimi K2.7 Code in NVFP4?

About 575 GB for the weights, excluding the attention cache.

Which format should I choose for Kimi K2.7 Code?

NVFP4 brings Blackwell format, native FP4 compute. The most precise format that fits the target machine remains the best choice.

Method and sources

Memory footprints are calculated, not measured: a reading on real hardware may differ depending on the engine and the exact weight format. Every figure below carries its source and the date of its last check.