AMD unveiled the AI accelerator Instinct MI350P: 144 GB of HBM3E, a PCIe 5.0 × 16 interface, and 600 W power consumption

AMD unveiled a new graphics accelerator Instinct MI350P

The company AMD released a PCI‑e expansion card called Instinct MI350P, aimed at air‑cooled servers and designed for machine learning workloads where a full OAM platform is not required.

Technical specifications
Parameter Value
Chip 128 execution blocks, 8192 streaming processors, 512 matrix cores
Maximum frequency 2.2 GHz
Memory 144 GB HBM3E, 4096‑bit bus
Memory bandwidth up to 4 TB/s (peak)
Cache L3 128 MB ECC support for memory error correction

Instinct MI350P is a “semi‑trimmed” version of the MI350X but with the same set of compute blocks.

Performance
Matrix format Peak performance
MXFP4 / MXFP64 6.0 PFLOPS
MXFP8 / OCP‑FP82 3.2 PFLOPS
FP16 / BF161 5.15 PFLOPS
FP6436 TFLOPS

Structured sparsity allows doubling the figures when working with 8‑ and 16‑bit numbers.

Physical dimensions
* Thickness – two expansion slots
* Card length – 267 mm
* Interface – PCIe 5.0 x16
* Power connector – 12 V (2×6)
* Power consumption – standard 600 W, can be reduced to 450 W

Conclusion
Instinct MI350P combines high computational power and energy efficiency, making it attractive for AI server solutions without the need for a full OAM platform.