Amazon has ramped up the ASIC race by showcasing Trainium3 server configurations and next-gen Trainium4 ASICs, bringing massive performance and efficiency gains.
Amazon's Trainium3 UltraServers & Next-Gen Trainium4 Chips Feature Massive Performance & Efficiency Gains
The race of custom silicon from Big Tech is indeed reaching newer levels, as we are seeing massive advancements from firms like Google, Meta, and now Amazon. At the AWS re: Invent 2025, Amazon has given an insight into what customers should expect from the firm in the realm of ASICs, and one of the bigger developments from the company is the introduction of Trainium3 UltraServers, which basically an AI system scaling up into 144 chips in a single cluster, which has brought in "up to 4.4x more compute performance, 4x greater energy efficiency, and almost 4x more memory bandwidth" compared to the previous generation.
Trn3 UltraServers pack up to 144 Trainium3 chips into a single integrated system, delivering up to 4.4x more compute performance than Trainium2 UltraServers. This allows you to tackle AI projects that were previously impractical or too expensive by training models faster, cutting time from months to weeks, serving more inference requests from users simultaneously, and reducing both time-to-market and operational costs.
The Trainium3 UltraServers server features the newer NeuronSwitch-v1 technology, which debuts with upgraded bandwidth and fabric networking. It's an alternative to NVIDIA's NVLink solution, offered by Amazon. Instead, here, the idea is to interconnect Trainium ASICs into a massive 1 million-chip cluster, which is claimed to bring the ability to train "trillion-token datasets" for inferencing capabilities. The UltraServers are an indicator that ASIC manufacturers are aggressively expanding their compute portfolio, given the compute constraints companies are facing.
Amazon has also given us a look into next-gen Trainium4 ASICs, which are said to feature 6x higher FP4 performance and a massive increase in memory specifications. More importantly, Trainium4 will now support NVIDIA's NVLink technology as well, which means that customers looking to scale up their existing infrastructure by adding the Trainium stack, combined with Team Green's compute portfolio, can do so easily. Amazon has reported massive 'external interest' around its custom AI chips, with companies like Anthropic reporting reduced training costs.
It appears that Amazon is 'all in' when it comes to the race for ASICs, and following Google's recent TPU announcements, it seems the retail giant is not holding back when it comes to advancing its compute portfolio.
Follow Wccftech on Google to get more of our news coverage in your feeds.
