AMD EPYC 9654 “Genoa” 96 Core CPU Benchmarked In Cache & Memory Benchmark – Over 2x Inter-Cache Bandwidth Versus Milan-X & Up To 30 TB/s L1 Transfer Rates

AMD EPYC 9654 "Genoa" CPU With 96 Cores Tears Apart The Milan-X CPU In Cache & Latency Performance Benchmark 2

AMD's EPYC Genoa CPUs are going to offer some insane performance increase for the x86 server segment as we witnessed in the leaked benchmarks a few days ago and now, we get to see an even better performance teaser in the form of the cache and latency benchmarks for the top EPYC 9654 CPU which rocks up to 96 cores and completely shatters the AMD Milan-X CPUs with its huge inter-cache bandwidth figures.

AMD EPYC 9654 "Genoa" CPU With 96 Cores Tears Apart The Milan-X CPU In Cache & Latency Performance Benchmark

The latest performance benchmarks are once again leaked by Yuuki_AnS who has shared the cache and latency figures for both, the AMD EPYC 9654 'Genoa' and Intel Xeon Platinum 8480+ 'Sapphire Rapids-SP' chip. You might remember that the same leaker also posted the cache & latency figures for the AMD EPYC Milan-X and a very early Sapphire Rapids-SP CPU earlier this year. Since then, the red team has Milan-X shipping to its customers and is getting ready to launch Genoa CPUs but Intel has yet to launch its Sapphire Rapids-SP chips which are facing delay after delay.

Related StoryJason R. Wilson
AMD RDNA 3 “Navi 3x” GPU Renders Show What The Radeon RX 7000 Powerhouses Could Look Like

The AMD EPYC Milan-X introduced a huge Last-Level-Cache on top of the Zen 3 core package or CCD. Featuring up to 64 MB of L3 cache per CCD, this boosted the Milan-X CPU's cache by 512 MB for a total of 768 MB when combined with the 32 MB of cache available per CCD. Not only is there more cache on Milan-X to play with compared to the standard Milan chips but it also runs really fast. We have seen some inter-CPU cache figures by Chips and Cheese who have done a fantastic job in deep-diving the V-Cache architecture for Milan-X CPUs here.

With that said, the CPU in question today is the AMD EPYC 9654 which is a Genoa SKU with 96 cores and 192 threads. This chip was tested in a dual-socket configuration, featuring a base clock of 2GHz and a boost clock that fluctuates between 2.15 to 3.7 GHz at a maximum TDP of 360W. This is just an engineering sample so bear in mind that the final performance could improve vastly. This chip isn't the flagship either as the leaker states that the EPYC 9664 exists too. We know that Genoa is going to max out at 96 cores in a total of 12 CCDs (each with 8 cores) so that could be a high-clock optimized chip with a higher TDP.

Compared to Milan-X, the Genoa EPYC 9654 CPU from AMD carries 384 MB of L3 cache and 96 MB of L2 cache (1 MB per core). So that's a total of 480 MB of cache but Genoa will also be receiving a 3D V-Cache variation next year known as Genoa-X which will feature up to 1248 MB of total cache (384 MB L3 + 96 MB L2 + 768 MB V-Cache).

AMD EPYC 9654 "Genoa" CPU Cache & Bandwidth Figures (Image Credits: Yuuki_AnS):

Related StoryHassan Mujtaba
AMD Ryzen 7 7700X 8 Core Zen 4 Desktop CPU Smiles For The Camera

AMD EPYC Genoa Delivers Up To 30 TB/s of Inter-Cache Bandwidth & Over 2x Increase Versus EPYC 7773X

Benchmarks? Ah yes, the benchmarks, we are finally there. Don't get too shocked to see the results because the figures presented here and just monstrous for the AMD EPYC part. We also put in the old and new benchmarks that Yuuki_AnS shared a while back and well the results are as follows:

AMD EPYC 9654 "Genoa" Zen 4 CPU Latency Benchmarks
Memory Latency
L1 Latency
L2 Latency
L3 Latency
0
40
80
120
160
200
240
0
40
80
120
160
200
240
EPYC 9654 Genoa (2 x 96 Core)
Sapphire Rapids-SP Xeon QS (2 x 56 Core)
Sapphire Rapids-SP Xeon ES (2 x 48 Core)
EPYC 7773X Milan-X (2 x 64 Core)
Ice Lake-SP Xeon (2 x 40 Core)

The AMD EPYC Genoa and Intel Sapphire Rapids-SP platforms are both tested with DDR5-4800 system memory. The EPYC 9654 Genoa CPU delivers the lowest latencies amongst all modern server chips only slightly losing out to its Milan-X brother but the margin is so close that it will definitely end up faster with the final retail release. The CPU just eats the Sapphire Rapids-SP processor away in latency figures.

AMD EPYC 9654 "Genoa" CPU Latency Chart (Image Credits: Yuuki_AnS):

AMD EPYC 9654 "Genoa" CPU With 96 Cores Tears Apart The Milan-X CPU In Cache & Latency Performance Benchmark 3

AMD EPYC 7773X "Milan-X" CPU Latency Chart (Image Credits: Yuuki_AnS):

AMD EPYC 9654 "Genoa" CPU With 96 Cores Tears Apart The Milan-X CPU In Cache & Latency Performance Benchmark 4

You can also see how the latency has improved dramatically for the Zen 4 server powerhouse versus its Milan-X predecessor in the comparative charts above. You can zoom in the picture by clicking it and remember that the lower the latency, the better!

AMD EPYC 9654 "Genoa" Zen 4 CPU Bandwidth (Read) Benchmarks
Memory Bandwidth
L1 Bandwidth
L2 Bandwidth
L3 Bandwidth
0
5000
10000
15000
20000
25000
30000
0
5000
10000
15000
20000
25000
30000
EPYC 9654 Genoa (2 x 96 Core)
Sapphire Rapids-SP Xeon QS (2 x 56 Core)
Sapphire Rapids-SP Xeon ES (2 x 48 Core)
EPYC 7773X Milan-X (2 x 64 Core)
Ice Lake-SP Xeon (2 x 40 Core)

In bandwidth, as I said above, the AMD EPYC 9654 Genoa CPU is an entirely different beast. You can see the memory bandwidth being the highest amongst all three modern processors and the inter-cache figures are insanity (I've lost count of how many times I've used this word but that is simply what Genoa is).

In L1 cache tests, the Genoa CPU delivers a 2.2x increase over Milan-X and a 17% jump over Sapphire Rapids-SP Xeon. In L2 cache tests, the CPU delivers an 89% increase over Milan-X and a 2.44x increase over its Xeon counterpart. Finally, in L3 bandwidth, the Genoa CPU delivers an earth-shattering 3.27 increase in performance over the Milan-X CPU and an 8.8x jump over the Xeon part. That's up to 30 TB/s on inter-CPU cache bandwidth which is bonkers.

AMD's EPYC Genoa CPUs will feature 128 PCIe Gen 5.0 lanes, 160 for a 2P (dual-socket) configuration. The SP5 platform will also feature DDR5-5200 memory support which is some insane improvement over the existing DDR4-3200 MHz DIMMs. But that's not all, it will also support up to 12 DDR5 memory channels and 2 DIMMs per channel which will allow up to 3 TB of system memory using 128 GB modules. The AMD EPYC 9000 Genoa CPU lineup is expected to launch in the second half of this year. For the complete SKU details, you should check out our detailed post here.

AMD EPYC Milan Zen 3 vs EPYC Genoa Zen 4 Size Comparisons:

CPU NameAMD EPYC MilanAMD EPYC Genoa
Process NodeTSMC 7nmTSMC 5nm
Core ArchitectureZen 3Zen 4
Zen CCD Die Size80mm272mm2
Zen IOD Die Size416mm2397mm2
Substrate (Package) AreaTBD5428mm2
Socket Area4410mm26080mm2
Socket NameLGA 4094LGA 6096
Max Socket TDP450W700W
WccfTech Tv
Subscribe
Filter videos by
Order