Intel has unveiled the latest performance and internal projections of its upcoming 5th Gen Emerald Rapids & next-gen Granite Rapids Xeon CPUs.
Intel 5th Gen Emerald Rapids Xeon 64-Core CPU Offers Up To 40% Better Performance Than 56-Core Sapphire Rapids
Talking about its Xeon CPUs during SC23, Intel unveiled new performance metrics which include actual results for its upcoming 5th Gen Emerald Rapids and projections for its next-gen Granite Rapids Xeon CPUs. The chipmaker compared the results against its own Sapphire Rapids 4th Gen chips while also showcasing HPC metrics for the Xeon Max CPUs against AMD's EPYC Genoa 96-core chips.
Starting with the details, the Intel 5th Gen Emerald Rapids CPUs will be pin-compatible with the Sapphire Rapids CPUs on the Eagle Stream platform. They utilize the same LGA-4677 socket and offer mainly an optimized design with few additional cores/threads, larger pools of cache, & focus on higher performance per watt.
The company highlights that Emerald Rapids Xeon CPUs will offer workload-optimized performance and energy-efficient compute. At the same time, the addition of faster DDR5-5600 memory should result in higher bandwidth and transfer speedups. The 5th Gen Xeons will also offer CXL 1.0 and 2.0 support along with up to 80 PCIe Gen 5.0 lanes. Intel touts a 40% speedup in performance. Details are mentioned below:
Intel Emerald Rapids (Xeon 8592+ 64-Core) vs Sapphire Rapids (Xeon 8480+ 56 Cores):
- AI Speech Recognition: 1.4x Boost
- HPC LAMMPS (Copper): 1.4x Boost
- Media Transcode (FFMPEG): 1.2x Boost
Some of the features to expect within the 5th Gen Xeon "Emerald Rapids" CPUs include:
- Up To 3x larger LLC cache
- Increased Memory Speed
- Higher CPU Core Count (Up To 64 Cores)
- CXL Type 3 high bandwidth interface
- Workload optimizations (Intel AE)
- Optimized Power Mode
- Up To 17% General Purpose Perf/Wat Increase
- Offload CPU cores with Intel Accelerator Engines for Power Efficiency
- Huge performance boost across inference and training
- Intel AMX for built-in AI Acceleration
- Out-of-box deployed with Optimized SW stacks
Intel 5th Gen Emerald Rapids Xeon CPU Specs "Official":
| CPU Name | Cores / Threads | Cache | Base / Boost (Max) | DDR5 Support | TDP | Price (RCP) |
|---|---|---|---|---|---|---|
| Xeon Platinum 8593Q | 64/128 | 320 MB | 2.2 / 3.9 GHz | DDR5-5600 | 385W | $12400 |
| Xeon Platinum 8592+ | 64/128 | 320 MB | 1.9 / 3.9 GHz | DDR5-5600 | 350W | $11600 |
| Xeon Platinum 8592V | 64/128 | 320 MB | 2.0 / 3.9 GHz | DDR5-4800 | 330W | $10995 |
| Xeon Platinum 8580Q | 60/120 | 300 MB | 2.1 / 4.0 GHz | DDR5-5600 | 350W | TBD |
| Xeon Platinum 8580 | 60/120 | 300 MB | 2.0 / 4.0 GHz | DDR5-5600 | 350W | $10710 |
| Xeon Platinum 8581V | 60/120 | 300 MB | 2.0 / 3.9 GHz | DDR5-4800 | 270W | $7568 |
| Xeon Platinum 8570 | 56/112 | 300 MB | 2.1 / 4.0 GHz | DDR5-5600 | 350W | $9595 |
| Xeon Platinum 8571N | 52/104 | 300 MB | 2.4 / 4.0 GHz | DDR5-4800 | 300W | $6839 |
| Xeon Platinum 8558P | 48/96 | 260 MB | 2.7 / 4.0 GHz | DDR5-5600 | 350W | $6795 |
| Xeon Platinum 8568Y+ | 48/96 | 300 MB | 2.3 / 4.0 GHz | DDR5-5600 | 350W | $6497 |
| Xeon Platinum 8562Y+ | 32/64 | 300 MB | 2.8 / 4.1 GHz | DDR5-5600 | 300W | $5945 |
| Xeon Platinum 8558 | 48/96 | 260 MB | 2.1 / 4.0 GHz | DDR5-5600 | 330W | $4650 |
| Xeon Platinum 8558U | 48/96 | 260 MB | 2.0 / 4.0 GHz | DDR5-5600 | 300W | $3720 |
| Xeon Gold 6558Q | 32/64 | 60.0 MB | 3.2 / 4.1 GHz | DDR5-5200 | 350W | $6416 |
| Xeon Gold 6554S | 36/72 | 180 MB | 2.2 / 4.0 GHz | DDR5-5200 | 270W | $3157 |
| Xeon Gold 6548Y+ | 32/64 | 60.0 MB | 2.5 / 4.1 GHz | DDR5-5200 | 250W | $3726 |
| Xeon Gold 6548N | 32/64 | 60.0 MB | 2.8 / 4.1 GHz | DDR5-5200 | 250W | $3875 |
| Xeon Gold 6544Y | 16/32 | 45.0 MB | 3.6 / 4.1 GHz | DDR5-5200 | 270W | $3622 |
| Xeon Gold 6542Y | 24/48 | 60.0 MB | 2.9 / 4.1 GHz | DDR5-5200 | 250W | $2878 |
| Xeon Gold 6538Y+ | 32/64 | 60.0 MB | 2.2 / 4.0 GHz | DDR5-5200 | 225W | $3141 |
| Xeon Gold 6538N | 32/64 | 60.0 MB | 2.1 / 4.1 GHz | DDR5-5200 | 205W | $3351 |
| Xeon Gold 6534 | 8/16 | 22.5 MB | 3.9 / 4.2 GHz | DDR5-4800 | 195W | $2816 |
| Xeon Gold 6530 | 32/64 | 160 MB | 2.1 / 4.0 GHz | DDR5-4800 | 270W | $2128 |
| Xeon Gold 6526Y | 16/32 | 37.5 MB | 2.8 / 3.9 GHz | DDR5-4800 | 195W | $1517 |
| Xeon Gold 5520+ | 28/56 | 52.5 MB | 2.2 / 4.0 GHz | DDR5-4800 | 205W | $1640 |
| Xeon Gold 5515+ | 8/16 | 22.5 MB | 3.2 / 4.1 GHz | DDR5-4800 | 165W | $1099 |
| Xeon Gold 5512U | 28/56 | 52.5 MB | 2.1 / 3.7 GHz | DDR5-4800 | 185W | $1230 |
| Xeon Silver 4516Y+ | 24/48 | 45.0 MB | 2.2 / 3.7 GHz | DDR5-4400 | 185W | $1295 |
| Xeon Silver 4514Y | 16/32 | 30.0 MB | 2.0 / 3.4 GHz | DDR5-4400 | 150W | $780 |
| Xeon Silver 4510T | 12/24 | 30.0 MB | 2.0 / 3.7 GHz | DDR5-4400 | 115W | $624 |
| Xeon Silver 4510 | 12/24 | 30.0 MB | 2.4 / 3.3 GHz | DDR5-4400 | 150W | $563 |
| Xeon Silver 4509Y | 8/16 | 22.5 MB | 2.6 / 4.1 GHz | DDR5-4400 | 125W | $563 |
Intel Next-Gen Granite Rapids P-Core Xeon CPU Performance Projections
Intel is also stating the internal performance projections of its upcoming Granite Rapids Xeon CPUs which will come in P-Core-only flavors while Sierra Forest will adopt the E-Core architecture & offer up to 288 cores. These chips will offer compatibility with the next-gen Birch Stream platform which comes in two distinct sockets, LGA 4710 and LGA 7529. The company is confirming that the Granite Rapids Xeon CPUs will offer increased core counts, frequencies, and the latest Intel AMX (Advanced Matrix Extensions). Granite Rapids will also add FP16 to broaden the precision support for AI-based developers. The platform will offer 12-channel MCRDIMM support to tackle larger LLM models that are memory-bound.
In terms of performance, the internal estimates against existing 4th Gen Sapphire Rapids CPUs show that Granite Rapids Xeon chips will offer a 2.9x boost in AI Inferencing (DeepMD+LAAMPS), 2.8x boost in memory bandwidth and up to 3x better performance in AI workloads. These are just rough estimates and final performance may differ.
56-Core Xeon Max CPUs Competitive Against 96-Core AMD's EPYC Genoa
Lastly, Intel also showcases some HPC performance benchmarks of its Xeon Max 9480 CPU which packs 56 cores and 64 GB HBM memory against the AMD EPYC 9654 with 96 cores. The Xeon Max CPU is shown to offer up to 30% better performance. The EPYC 9645 retails for $11,805 while the Xeon Max 9480 costs $12,980 US.
Both CPUs are rated at 360/350W but the Sapphire Rapids CPUs do consume higher wattage so that might lead to lower TCO than the AMD solution. Furthermore, AMD also offers its 3D V-Cache boosted offerings in Genoa-X flavors which can offer competitive performance in these bandwidth-bound workload scenarios.
With that said, Intel will be launching its 5th Gen Xeon Emerald Rapids CPU family on the 14th of December while the Granite Rapids CPUs will debut soon after Sierra Forest by 2nd half of 2024.
Intel Xeon CPU Families (Preliminary):
| Family Branding | Diamond Rapids | Clearwater Forest | Granite Rapids | Sierra Forest | Emerald Rapids | Sapphire Rapids | Ice Lake-SP | Cooper Lake-SP | Cascade Lake-SP/AP | Skylake-SP |
|---|---|---|---|---|---|---|---|---|---|---|
| Process Node | TBD | Intel 18A | Intel 3 | Intel 3 | Intel 7 | Intel 7 | 10nm+ | 14nm++ | 14nm++ | 14nm+ |
| Platform Name | Intel Oak Stream | Intel Birch Stream | Intel Birch Stream | Intel Mountain Stream Intel Birch Stream | Intel Eagle Stream | Intel Eagle Stream | Intel Whitley | Intel Cedar Island | Intel Purley | Intel Purley |
| Core Architecture | Panther Cove-X | Darkmont | Redwood Cove | Sierra Glen | Raptor Cove | Golden Cove | Sunny Cove | Cascade Lake | Cascade Lake | Skylake |
| MCP (Multi-Chip Package) SKUs | Yes | Yes | Yes | Yes | Yes | Yes | No | No | Yes | No |
| Socket | LGA XXXX / 9324 | LGA 4710 / 7529 | LGA 4710 / 7529 | LGA 4710 / 7529 | LGA 4677 | LGA 4677 | LGA 4189 | LGA 4189 | LGA 3647 | LGA 3647 |
| Max Core Count | TBD | Up To 288 | Up To 128 | Up To 288 | Up To 64? | Up To 56 | Up To 40 | Up To 28 | Up To 28 | Up To 28 |
| Max Thread Count | TBD | Up To 288 | Up To 256 | Up To 288 | Up To 128 | Up To 112 | Up To 80 | Up To 56 | Up To 56 | Up To 56 |
| Max L3 Cache | TBD | TBD | 480 MB L3 | 108 MB L3 | 320 MB L3 | 105 MB L3 | 60 MB L3 | 38.5 MB L3 | 38.5 MB L3 | 38.5 MB L3 |
| Memory Support | Up To 16-Channel DDR5? | Up To 12-Channel DDR5-8000 | Up To 12-Channel DDR5-6400 MCR-8800 | Up To 12-Channel DDR5-6400 | Up To 8-Channel DDR5-5600 | Up To 8-Channel DDR5-4800 | Up To 8-Channel DDR4-3200 | Up To 6-Channel DDR4-3200 | DDR4-2933 6-Channel | DDR4-2666 6-Channel |
| PCIe Gen Support | PCIe 6.0? | PCIe 5.0 (96 Lanes) | PCIe 5.0 (136 Lanes) | PCIe 5.0 (88Lanes) | PCIe 5.0 (80 Lanes) | PCIe 5.0 (80 lanes) | PCIe 4.0 (64 Lanes) | PCIe 3.0 (48 Lanes) | PCIe 3.0 (48 Lanes) | PCIe 3.0 (48 Lanes) |
| TDP Range (PL1) | TBD | Up To 500W | Up To 500W | Up To 350W | Up To 350W | Up To 350W | 105-270W | 150W-250W | 165W-205W | 140W-205W |
| 3D Xpoint Optane DIMM | TBD | N/A | Donahue Pass | N/A | Crow Pass | Crow Pass | Barlow Pass | Barlow Pass | Apache Pass | N/A |
| Competition | AMD EPYC Venice | AMD EPYC Turin | AMD EPYC Turin | AMD EPYC Bergamo | AMD EPYC Genoa ~5nm | AMD EPYC Genoa ~5nm | AMD EPYC Milan 7nm+ | AMD EPYC Rome 7nm | AMD EPYC Rome 7nm | AMD EPYC Naples 14nm |
| Launch | 2025-2026 | 2026 | 2024 | 2024 | 2023 | 2022 | 2021 | 2020 | 2018 | 2017 |
Xeon CPU Performance Footnotes:
Follow Wccftech on Google to get more of our news coverage in your feeds.
