OpenAI has reportedly built its first in-house custom AI chip in collaboration with Broadcom and TSMC, as the AI giant is looking to upscale its inferencing capabilities.
OpenAI's First AI Chip Will Reportedly Target Inferencing Workloads, Expected To Debut With Cutting-Edge Performance
OpenAI is probably one of the only firms in the industry that has presented massive ambitions when scaling AI compute power, whether through a network of "fabrication facilities" or even through developing in-house solutions that are more effective than existing counterparts. Sam Altman is known to experiment with the "AI hype," and now, according to a new report by Reuters, OpenAI has developed its first AI chip, collaborating with the chip designer Broadcom and none other than TSMC, the semiconductor giant.
The report states that the firm's newest chip is targeted towards inferencing workloads, and while the industry is currently focused on model training and enhancements, the future definitely lies in bringing inference capabilities in the LLM models out there. Interestingly, it is revealed that OpenAI has dropped the idea of building a "network" of foundries and shifted the focus towards in-house chip design since the latter requires less financial resources and execution time.
OpenAI is said to be building a hybrid model of "AI compute acquisition," which means that the firm is planning to expand its AI capabilities through the integration of existing architectures, such as those from NVIDIA and AMD, along with developing in-house solutions, to ensure diversity in workloads and reduce dependency on its partners. Since it has key relations with NVIDIA, OpenAI would certainly not offer its in-house chips in markets, although this isn't certain for now, and it depends on how successful OpenAI's first chip endeavor turns out.
In terms of the actual details of the AI chip, the report doesn't mention specifics apart from the fact that OpenAI has managed to bring in TSMC onboard to cater to semiconductor needs, and the chip could debut in the industry by 2026, depending upon how OpenAI decides to proceed with it. It was reported previously that the OpenAI's chip might be based on TSMC's A16 Angstrom process, hence revealing that the ambition would target the higher-end market segment.
OpenAI has reportedly secured a chip team of about 20 people, including individuals who have worked on Google's TPUs (Tensor Processing Units), so OpenAI's AI chip ambition is undoubtedly backed by the right people on the team.
Given that we are in an era where every major tech giant is in pursuit of developing their well-equipped AI computing portfolio, it is certainly imminent that companies push towards developing in-house solutions to ease off the pressure on the AI supply chain, along with bringing in customization in existing workloads.
About the author: Muhammad Zuhair is a hardware and technology reporter for Wccftech, specializing in the semiconductor industry and the complex interplay between technology, manufacturing, and geopolitics. His coverage focuses on the corporate strategies and technological roadmaps of industry giants like TSMC, NVIDIA, Samsung, and Intel. Zuhair's expertise lies in deconstructing complex topics such as fabrication nodes (e.g., 2nm process), the economic impact of policies like the CHIPS Act, and the strategic development of AI infrastructure from NVIDIA, AMD and Intel.
Follow Wccftech on Google to get more of our news coverage in your feeds.
