Microsoft’s new Copilot Vision one-ups ChatGPT with web browsing assistance

Microsoft’s Copilot Vision introduces a new dimension to AI-assisted web browsing by enabling real-time visual understanding and interaction capabilities within the Microsoft Edge browser.

Latest development: Microsoft has launched Copilot Vision in preview, offering Pro subscribers an AI assistant that can view and understand users’ online activities in real-time through Copilot Labs.

• The feature enables Copilot to read along with users, discuss browsing issues, and provide contextual insights based on visual information
• Users can interact with Copilot Vision through natural verbal communication, making it more accessible and user-friendly
• Initial rollout is limited to select websites and Pro subscribers in the United States
• Access Copilot Vision here

Key features and applications: Copilot Vision functions as an intelligent browsing companion that can assist with various online activities.

• The AI can help users with fashion choices by analyzing Pinterest boards and providing personalized outfit suggestions
• Holiday shopping assistance includes identifying relevant products that match user preferences
• Travel planning support involves highlighting crucial information for activities like museum visits

Technical implementation: The integration of Copilot Vision has been carefully designed with user experience and privacy in mind.

• The feature is accessible through Microsoft Edge’s browser interface, positioned at the bottom for easy access
• Privacy controls are opt-in only, giving users full control over their browsing activity sharing
• All session data, including conversations and contextual information, is deleted after use

Subscription details: Access to Copilot Vision comes as part of the broader Copilot Pro subscription package.

• The service costs $20 per month
• Subscribers receive priority access to latest AI models
• Additional benefits include enhanced Copilot Voice access and integration with Microsoft 365 applications

Market implications: Microsoft’s introduction of Copilot Vision represents a strategic move in the ongoing AI assistant competition.

• This feature differentiates Copilot from ChatGPT by offering real-time visual understanding capabilities
• The controlled rollout suggests a careful approach to gathering user feedback and refining the technology before wider deployment
• Integration with Microsoft’s broader ecosystem could provide advantages in the increasingly competitive AI assistant market