Concept Shows How Apple Should Use AI To Grow Siri In A Way That Can Read And Interact With What Is On The Screen

Jun 8, 2024 at 05:47pm EDT
Concept for AI powered Siri capabilities

Apple is heavily focused on finally bringing its version of the AI at the WWDC 2024 event on Monday. While other companies seem to be fully engulfed in the AI frenzy, the Cupertino giant took its time to be prepared by taking a holistic approach to using the technology to make users' lives easier. The focus is not only on bringing new functionalities and capabilities but also on using the existing features in the most optimal way. Siri is getting revamped to enhance user experience using generative AI, among other initiatives, and we are hooked on the endless possibilities the voice assistant's advanced functionality might hold.

The concept shows Apple Intelligence tied to a ChatGPT-like screen viewing feature for iPhone, giving Siri the power to do more than just read

Apple is focusing even on tiny details when it comes to its current initiatives, and the recent branding of Artificial intelligence as 'Apple Intelligence' is a prime example of how the company does not leave any side uncovered.

Related Story Apple CEO Admits the Firm Has “Rarely Been First” with Newer Technologies, Reassures Employees an ‘AI Breakthrough’ Is Coming Soon in an Hour-Long Pep Talk

Siri will be in the limelight of the event with new features and a complete makeover with the help of AI. The new version would assist in summarizing meetings, articles, or even notifications you missed out on. It is also said to have a natural voice, be smart in responding to different situations and varied emotions, and be equipped to handle multiple commands.

Brotolotti has presented a concept for AI-infused Siri, suggesting how its capabilities could be maximized to move into new, unexplored domains. The designer presented how, with the help of Shortcuts and the LLM model, Apple could provide live automation and present responses in a simplified way. He went on to give an example of Siri being used to add up prices when browsing a website, and it can even be utilized to summarize a document you are viewing.

OpenAI is bringing forth a similar feature for ChatGPT: the ability to see everything going on the phone's screen. Considering this, the idea presented does not sound far-fetched and can be something the company considers in the future.

Apple even published a paper earlier in the year that presented Reference Resolution As Language Modeling (ReALM) as a new model that could be used for reading and interpreting screens in real time. So, the possibility of this concept coming to fruition is there, especially with how aggressively the company is giving Siri a huge upgrade.

We expect these features to be announced at the developers conference, but the AI-powered Siri might be coming next year with a subsequent iOS update. Apple Intelligence will use a hybrid approach for processing AI with on-device capabilities coming to higher-end and more powerful models and cloud-based options for older and newer models. The decision for either approach will be based on the complexity of the given task.

Google recently introduced its side of the AI upgrades for Android 15, and in comparison to Apple, the search giant has spent a lot of time on research and development. With iOS 18's announcement planned for Monday, we will surely know how far Apple is behind Google and OpenAI in terms of AI development and how iOS 18 can be considered the biggest update the device has seen in a decade.

Follow Wccftech on Google to get more of our news coverage in your feeds.