Google is hosting its I/O event, with AI as the center of attention. The company has delved completely into bringing AI to the masses with its latest upgrades, and it has a lot to show in this regard. Since AI rests at the heart of Android, the entire operations will be bolstered by the company's Gemini. The Gemini app is gradually improving in understanding context and deeper integrations with apps and what is on the screen.
Google's Gemini and on-device Gemini Nano will be deeply integrated with Android
Google has made a drastic change to how we use Gemini with an overlay panel, which can be accessed anywhere on the operating system. You will be able to make searches powered by AI, and any results that you get can be dragged and dropped into the primary app, such as Notes or Messages. The company also showcased a demo of how Gemini works inside the YouTube app. Users will get an "Ask this video" button that will allow them to inquire about different portions of the video while understanding the context of the question.
Users with Gemini Advanced can use the same kind of "Ask this PDF" button to search for and inquire about documents. These additions will be released to users worldwide in the next few months. Users will get Dynamic Suggestions after activating Gemini to understand what is on their Android screen. Android will use the company's Gemini Nano technology to make searches and generate text or visual content based on your commands.
While Gemini Nano has existed since last year, the company is building up on its support for multimodality. It will take into account "sights, sounds, and spoken language" and will launch on the Pixel-branded devices later this year. Users will also be able to use TalkBack to generate rich descriptions for unlabeled images and the entire process will be happening on-device.
This update will help fill in missing information — whether it’s more details about what’s in a photo that family or friends sent or the style and cut of clothes when shopping online.
Google also demonstrated another feature of Gemini Nano that observes your call in real-time and identifies if it is a scam. It gives you the option to hang up immediately or keep on listening. The company has also announced a handful of additional tools that embed AI in the core of Android. We will be getting Android 15 later this year, potentially alongside the new Pixel 9 series launch. Google will be announcing additional details related to Android 15 today, and we will be covering them extensively.
Follow Wccftech on Google to get more of our news coverage in your feeds.
