AMD Launches MI350P, Its First PCIe “Instinct” In Four Years – Packs CDNA 4 GPU With 4.6 PFLOPs AI Compute, 144 GB HBM3E at 600W

AMD has announced its brand new Instinct MI350P PCIe GPU accelerator, which is the first PCIe design in years and is aimed at AI workloads.

The Instinct MI350P PCIe GPU Takes The MI350X Chips, Cuts It Into Half For 128 CUs, 144 GB HBM3E & 600W Power

With the Instinct MI350P PCIe GPU, AMD gives enterprise users an option to expand their AI computing capabilities without having to invest in expensive infrastructure. The PCIe design of the MI350P makes it an easy-to-use and drop-in solution that brings lots of performance in a standard dual-slot and server-focused design.

Designed to help you prepare for the agentic AI era, AMD Instinct MI350P PCIe cards are dual-slot drop-in cards for standard air-cooled servers. They are built to deploy inference on premises within your current data center’s power, cooling, and rack infrastructure. AMD Instinct GPUs in cost-effective PCIe cards round out the AMD AI compute portfolio, providing a range of options for your enterprise as it navigates its unique AI adoption curve.

2 of 9

The following are some of the highlights of the Instinct MI350P PCIe GPU:

• Native support for lower-precision MXFP6 and MXFP4, which deliver high throughput.
• Acceleration through sparsity support for most mainstream 8- and 16-bit precisions.
• An estimated 2,299 teraflops (TFLOPS) and up to 4,600 peak TFLOPS at MXFP4, the highest performance currently available in an enterprise PCIe card.
• An estimated 144GB of high bandwidth memory 3e (HBM3E) running at up to 4TB/s.
• An open ecosystem with low- and no-cost development stack options simplifies deployment and helps lower operating expenses.

Looking at the specifications, the AMD Instinct MI350P features the CDNA 4 architecture, and is based on the same TSMC 3nm process technology in a 4 XCD configuration, half the amount of the MI350X. It also features a single IO die, which is based on TSMC's 6nm FinFET process. There are 128 compute units on the chip, which equal 8,192 Stream processors, and 512 Matrix cores. The cores are clocked at 2200 MHz at peak. The entire chip features 73 billion transistors.

For memory, the Instinct MI350P packs 128 MB of LLC in the form of Infinity Cache within the GPU, and 144 GB of fast HBM3E memory that operates across a 4096-bit wide bus, delivering 4 TB/s of memory. In comparison, the MI350X packs 288 GB of HBM3E memory across a 8192-bit bus interface. The PCIe card measures 10.5" (267mm) in length and features a passive-cooled design, which is ideal for servers. AMD also uses a 16-Pin connector to meet the 600W TBP of the card. It can also be configured down to 450W.

In terms of performance, the AMD Instinct MI350P offers:

• 4.6 PFLOPs MXFP4
• 4.6 PFLOPs MXFP6
• 2.3 PFLOPs MXFP8
• 2.3 PFLOPs FP16 (Sparsity)
• 1.15 PFLOPs FP16
• 72 TFLOPs FP16
• 72 TFLOPs FP32
• 36 TFLOPs FP64
• 2.3 POPs INT8
• 4.6 POPs INT8 (Sparsity)
• 1.15 PFLOPs BFloat16
• 2.30 PFLOPs BFloat16 (Sparsity)

As you can see, the AMD Instinct MI350 series, including the MI350P, offers native acceleration across various Enterprise AI precision formats such as MXFP6 and MXFP4.

The MI350P will be competing against the H200 NVL, which is NVIDIA's last PCIe-based GPU accelerator with 141 GB of HBM3E memory and running the Hopper H200 GPU. NVIDIA has released the RTX PRO 6000 Blackwell server edition, but that's based on the standard GB202 chip instead of the GB200, which is the true server option. The RTX PRO 6000 Blackwell packs 96 GB of GDDR7 memory. The H200 NVL GPUs cost anywhere around $30-$40K US.

The AMD Instinct MI350P PCIe GPUs are now available across various partners and offer a fully open ecosystem and Enterprise Ready AI software stack with ROCm support.

Follow Wccftech on Google to get more of our news coverage in your feeds.