When bringing forward new AI models and upgrading them, tech companies are not relenting any time soon and keep working to evolve their technologies. It has not been long since OpenAI announced its plans to bring an advanced version of GPT-4 known as the Orion model. The expectations have been set by the company for it to be yet another groundbreaking leap in language model development. However, new reports are surfacing claiming otherwise in terms of performance barely outdoing its predecessor, raising the question whether the AI field, in fact, is hitting the ceiling.
A new report claims OpenAI's Orion model might not be as groundbreaking as anticipated and delivers marginal gains over GPT-4
There is no denying OpenAI revolutionized AI and the endless possibilities for technology. Ever since its inception, the company has been growing massively and bringing more cutting-edge advancements. It now seems to be slowly transitioning into more commercial focused products and services. The company is aggressively pushing toward bringing AGI to the world, along with that, it has been working on bringing updates for its existing models and even working on new models.
The upcoming model by OpenAI, codenamed 'Orion,' is claimed to offer a major leap in capabilities over the GPT-4, and users are eagerly looking forward to a more efficient and ethically aligned model. However, according to The Information's new report, OpenAI's new language model might only offer incremental improvement over its predecessor, contrary to expectations.
Orion has been portrayed as the upgraded AI model that outpaces GPT-4 in multiple domains, including programming tasks, but that does not stand to be true as the model seems to only offer improvements in language capabilities. Orion also poses some challenges on the operational front as it is expected to require more resources than previous models to be run in the data centers and also for maintenance.
The report further cites that OpenAI presents the reason for relatively slower-paced improvements in the AI models as the insufficient availability of high-quality training data. Since most of the publicly available data has already been utilized, the company has now formed a "Foundations Team" headed by Nick Ryder to find new information sources for training the language models that are unique and attempt to overcome the current limitations in AI advancements.
The snail-paced progress in LLM models is not limited to OpenAI and seems to extend across the industry, raising the question of whether the models are reaching stagnation. Perhaps AGI would pave the way for a fresh way to use existing models and bring noteworthy upgrades to them.
Follow Wccftech on Google to get more of our news coverage in your feeds.
