The much-awaited Google I/O keynote just happened, and as expected, AI and technological advancements remain the star of the show. The event detailed the latest updates on Project Astra, Project Starline, and Project Mariner. Project Astra has us intrigued by the major leap it offers, especially as an AI assistant. The company just unveiled more agent capabilities, and what this cutting-edge technology will bring about.
Google just showcased how Project Astra can interact and control your Android phone in real-time autonomously
Project Astra is basically the technology that is behind Gemini Live's camera and screen-sharing capabilities. However, during Google's I/O conference today, the tech giant shared about the next big step it is taking to make the AI assistant even more efficient. The company showcased its capabilities in a live demo using the Pixel 9 Pro, where a user was seen using the tool while fixing a bicycle and asking it to find a relevant manual.
Astra was able to locate the manual promptly and help highlight the relevant parts by interacting with the screen autonomously. This showed that Astra could understand context seamlessly, and even when it came to controlling the device, it did so impressively. It can even go one step further by making phone calls and even carrying out conversations on your behalf.
Project Astra goes beyond screen control and performing tasks on your behalf. It even helps those with visual impairments by providing real-time spatial awareness that can help identify obstacles, detect objects in a room, and literally read the room for you.
Google referred to these AI advancements as Action Intelligence, as the tool actively performs tasks on your behalf, including controlling apps, engaging in conversations, helping you shop, and carrying out more natural conversations. Google, with a standalone Astra app, would be able to test these features to finally extend to Gemini Live and be more widely available as an ultimate universal AI assistant.
Follow Wccftech on Google to get more of our news coverage in your feeds.
