Microsoft is rolling out a major update to Copilot Vision for Windows Insiders that significantly boosts what the AI tool can do. With this latest upgrade, Microsoft Copilot Vision can now view and analyze your entire desktop not just a pair of apps. This makes it a much more powerful and versatile AI assistant.
Previously, Copilot Vision could only interpret the content from two apps simultaneously. But with this expanded capability, the tool now works across “any specific browser or app window,” or even the entire desktop, according to Microsoft. This brings it closer to how screen sharing works during a video call except in this case, your AI assistant is the one watching.
To activate the feature, users simply click the glasses icon in the Copilot app and choose the screen or window they want to share with the AI. Once enabled, Copilot Vision can analyze the visual content, provide suggestions, and even answer your questions in real time.
Microsoft says the upgraded tool can assist with a wide variety of tasks, including:
- Offering creative tips for design projects
- Giving resume improvement suggestions
- Helping users navigate through games
- Summarizing or clarifying on-screen text and layouts
Unlike Microsoft’s Recall feature which automatically takes snapshots of your screen—Copilot Vision is more interactive and user-initiated. You decide when the AI sees your screen and what it interacts with.
The company first began testing Copilot Vision last year, focusing on web browsing in Microsoft Edge. But with this new rollout, it becomes an even more integral productivity tool across the Windows ecosystem. Interestingly, Copilot Vision also works with your phone’s camera, allowing it to answer questions about physical objects or surroundings captured in real time.
This update signals Microsoft’s continued push to integrate AI seamlessly into the everyday workflow making Microsoft Copilot Vision not just smarter, but also more accessible and useful.
Source: Microsoft Copilot Vision Update Lets AI See Your Entire Screen for Smarter Assistance
