Microsoft’s Copilot Labs will let you test unreleased AI features — here’s how it works

Microsoft’s Copilot Labs: A new platform for experimental AI features: Microsoft has unveiled Copilot Labs, a space for users to access and test unreleased AI features, similar to Google Labs but with a subscription-based model.

Key features and functionality: Copilot Labs launches with two experimental features that expand Copilot’s capabilities, offering users new levels of AI assistance.

• Copilot Vision combines voice assistance with real-time screen analysis in Microsoft Edge, taking both text and visual elements into account.
• The Think Deeper feature allows Copilot to spend more time processing complex questions, delivering step-by-step answers to difficult queries.

User experience and applications: Copilot Vision demonstrates practical applications in everyday scenarios, enhancing user interaction with online content.

• During a demo, Copilot Vision assisted a user in selecting outfit inspiration from Pinterest, offering suggestions and encouragement based on the visual content.
• The feature aims to provide context-aware assistance by interpreting both textual and visual information on the user’s screen.

Privacy and security considerations: Microsoft has implemented measures to address potential privacy concerns associated with AI screen analysis.

• Copilot Vision sessions are opt-in and not stored for training purposes.
• The feature does not work on all websites or paywalled content and does not process site content directly.

Accessibility and cost: Copilot Labs is exclusively available to Copilot Pro subscribers, setting it apart from Google’s free Labs platform.

• Access to Copilot Labs requires a Copilot Pro subscription, priced at $20 per month.
• The subscription also includes other benefits such as priority access to the latest AI models and integration with Microsoft Office applications.

Comparison to alternatives: While Copilot Labs offers unique features, similar capabilities can be found in other platforms, albeit with different pricing models.

• Google Labs provides free access to experimental AI features, making it a potential alternative for users unwilling to commit to a subscription.
• OpenAI’s ChatGPT Plus subscription ($20 per month) offers access to advanced models with capabilities similar to Think Deeper.

Implications for AI development: Copilot Labs represents a strategic move by Microsoft to accelerate AI innovation through user feedback and testing.

• By allowing users to interact with experimental features, Microsoft can gather valuable insights to refine and improve its AI offerings.
• This approach may lead to faster development and deployment of AI technologies that better meet user needs and expectations.

Looking ahead: The future of AI assistants: Copilot Labs signals a trend towards more sophisticated and context-aware AI assistants in everyday computing.

• As features like Copilot Vision and Think Deeper evolve, users may expect increasingly seamless integration of AI assistance across various applications and scenarios.
• The subscription model for accessing cutting-edge AI features could become more prevalent, potentially raising questions about equitable access to advanced technologies.