×
Microsoft Copilot Vision now scans entire computer screens
Written by
Published on
Join our daily newsletter for breaking news, product launches and deals, research breakdowns, and other industry-leading AI coverage
Join Now

Microsoft is expanding Copilot Vision’s capabilities to scan entire computer screens, not just individual apps. The AI tool can now analyze everything on a user’s desktop or any specific browser or app window, representing a significant upgrade from its previous limitation of viewing only two apps simultaneously.

What you should know: Copilot Vision now provides comprehensive desktop analysis through an opt-in screen sharing approach.

  • Users can activate the feature by clicking the glasses icon in the Copilot app and selecting which desktop they want the AI to analyze.
  • The tool can “help analyze content, provide insights, and answer your questions, coaching you through it aloud,” according to Microsoft.
  • Unlike Recall, which automatically captures regular screen snapshots, Copilot Vision requires manual activation similar to screen sharing during video calls.

How it works: The expanded functionality transforms Copilot Vision from a limited dual-app viewer into a comprehensive desktop assistant.

  • Microsoft suggests use cases include “tips on making improvements to your creative project, help with improving your resume, or guidance while navigating a new game.”
  • The feature builds on Microsoft’s initial testing that began last year, when Copilot Vision could only see web content in Edge browsers.
  • The tool also maintains its ability to answer questions about what it sees through mobile phone cameras.

The big picture: This update positions Copilot Vision as a more versatile AI assistant that can provide contextual help across entire workflows rather than isolated applications.

  • The expansion reflects Microsoft’s broader strategy of integrating AI assistance throughout the Windows experience.
  • By requiring user activation rather than automatic monitoring, Microsoft appears to be addressing privacy concerns that have surrounded similar screen-scanning technologies.
  • The rollout to Windows Insiders suggests Microsoft is taking a cautious approach to testing before wider deployment.
Now Microsoft’s Copilot Vision AI can scan everything on your screen

Recent News

Arc browser maker launches $20/month AI subscription tier

Free users keep core features but face limits on heavy chat usage.

OpenAI releases first open-source models with Phi-like synthetic training

Safety concerns trump performance when anyone can remove your model's guardrails.