QDNAAdvisory and architecture for LLM inference and training platforms, on-premises or hybrid

How much memory does MiniMax M3 need in FP8?

MiniMax M3 has 428 billion parameters. The FP8 format decides how much memory is needed to load them.

Short answer. In FP8, the weights of MiniMax M3 take about 492 GB including the runtime margin. 7 of the 8 platforms in the catalogue have enough memory.

How is this footprint calculated?

MiniMax M3 totals 428 billion parameters. The FP8 format takes 1 byte per parameter (8 bits per parameter (E4M3), hence 1 byte, block scales not counted). The product gives the weights, to which a 15% runtime margin is added for activations and buffers: 428 billion parameters × 1 byte (FP8) = 428.0 GB of weights; × 1.15 runtime margin = 492.2 GB. The attention cache is not calculated on this page. These models’ architectures (compressed latent, linear or sparse attention, Mamba layers) share no per-token formula; it is measured on the machine, with the target context and concurrency [TO BE MEASURED].

What does the format change?

FP8 brings negligible loss on most tasks.

FormatWeights in memory Compatible platforms
FP16984 GB4
FP8492 GB7
NVFP4246 GB7
Q4295 GB7

Which platforms qualify?

See the MiniMax M3 fact sheet.

How much memory for MiniMax M3 in FP8?

About 492 GB for the weights, excluding the attention cache.

Which format should I choose for MiniMax M3?

FP8 brings negligible loss on most tasks. The most precise format that fits the target machine remains the best choice.

Method and sources

Memory footprints are calculated, not measured: a reading on real hardware may differ depending on the engine and the exact weight format. Every figure below carries its source and the date of its last check.