Microsoft Responds To Google’s Search App For Windows By Introducing New Copilot And Agentic Experiences

In the ongoing one-upmanship between Microsoft and Google, the former is now choosing to respond to latter's dedicated search app for Windows by launching sweeping Copilot and agentic experiences, aiming to turn "every Windows 11 PC into an AI PC."

Hey, Copilot!

Microsoft believes voice commands are the most convenient way to interact with Copilot, Windows' bespoke AI-powered assistant. Therefore, the company is now bringing new wake and goodbye words for Copilot to Windows 11 PCs:

1. The opt-in feature provides a new way to start a conversation with Copilot Voice.
2. Simply enable "Hey, Copilot" within the settings of the Copilot app.
3. Then, just ask a question starting with "Hey, Copilot…"
4. The command will force a microphone icon to appear on the screen along with a chime to indicate that Copilot is listening.
5. To end a conversation, simply say "Goodbye" or tap "X."
6. Alternatively, Copilot will automatically end a conversation if no further interaction occurs for a preset number of seconds.

Copilot Vision

Microsoft is now rolling out Copilot Vision in all markets where Copilot is available.

1. Copilot Vision enables users to share their desktop or a particular app with Copilot, allowing the AI-powered assistant to provide real-time insights and answers to queries by analyzing the underlying content.
2. Highlights allow Copilot to visually show a user how to perform a particular task within a supported app, for instance, where to click.
3. When you share Word, Excel, or PowerPoint files with Copilot Vision, it will analyze the entire file and not just what appears on the screen at the time.
4. Windows Insiders will soon be able to converse with Copilot Vision using text, with Copilot responding in text within the same chat window. This supplements the audio-based inputs and outputs that were the main medium of interaction with Copilot Vision previously.

Copilot Actions And Connectors For Local Files

1. After enabling Copilot Actions on the web back in May, which allowed the assistant to take actions such as booking a table at your favorite restaurant, Microsoft is now bringing Copilot Actions for local files to Windows Insiders in Copilot Labs.
   • The feature will allow Copilot to take direct actions on local files, including sorting vacation photos to extracting the requisite information from a PDF file.
2. Moreover, Copilot Connectors allows users to link their preferred services - such as OneDrive, Google Drive, Gmail, Google Calendar, etc. - with the Copilot on the Windows app. 
   • The feature will allow Copilot to remember personal details across platforms. For instance, if you ask for your dentist appointments, the Copilot will instantly surface your calendar entries.
   • You can also now ask Copilot to export a given text to Word, Excel, or PowerPoint files, making it easier to jump right into projects. 

AI Agents

Manus AI Agent

Introducing Manus, a general AI agent that can perform various tasks on your Windows 11 PC. The agent can perform complex tasks in mere minutes, such as creating a website using the documents in your local folder with just one click.

1. Manus is also available as a native app on Windows. 
2. Manus leverages Model Context Protocol to fetch the right documents and build a website for you in minutes without the need to manually upload photos or other documents.

AI Actions In File Explorer

1. Right-click on files and select 'AI Actions' to do quick tasks, such as editing images or summarizing documents.
2. Image Actions for .jpg, .jpeg, and .png files.
   • Use Bing Visual Search to find similar products or images.
   • Instantly blur or remove backgrounds and erase objects with the help of the Photos App.

Gaming

Gaming Copilot

Microsoft is now introducing a personal gaming sidekick, which seamlessly integrates into the Game Bar on Windows 11 PCs.

1. You can ask your Gaming Copilot for help on a particular game that you are playing with the help of the voice mode.
2. You can also ask for recommendations, or about your achievements and play history. 

Xbox PC App

You can now seamlessly access your gaming library, apps, and play history in one place with Xbox on Windows PCs and supported handheld devices.

1. When you install a game from a supported PC storefront, it automatically appears in “My Library” within the Xbox PC app.
2. Your cloud-playable games and gameplay history will now follow you across all your devices.

Follow Wccftech on Google to get more of our news coverage in your feeds.