Microsoft revamps Copilot with memory, actions, and visual AI features

Microsoft’s wide-ranging update to Copilot represents a significant push to create a more personalized, capable AI assistant that can compete directly with leading alternatives like ChatGPT and Claude. The comprehensive enhancement package, announced during Microsoft’s 50th anniversary, demonstrates the company’s commitment to AI technology and its determination to maximize its investment in OpenAI by integrating multiple cutting-edge capabilities simultaneously.

The big picture: Microsoft is upgrading Copilot with a suite of features that transform it from a basic AI assistant into a personalized digital companion with advanced capabilities for understanding context, performing tasks, and creating content.

Key features: Memory functionality allows Copilot to remember user preferences, interests, and personal details to provide tailored responses and suggestions.

• Users maintain control over what information Copilot stores and can opt out entirely from the memory features.
• Microsoft plans to soon introduce options for personalizing Copilot’s appearance, furthering the goal of creating uniquely customized AI experiences.

Expanding capabilities: Copilot’s new Actions feature enables it to perform web-based tasks similar to OpenAI’s Operator agent and Amazon’s Nova Act model.

• The AI can now book tickets, make restaurant reservations, assist with purchases, and even research products while looking for discounts.
• Deep Research functionality allows Copilot to analyze large document collections and online sources for complex projects.

Visual intelligence: Copilot Vision is expanding from web tools to Windows and mobile applications, significantly broadening the AI’s ability to interpret visual information.

• On Windows, Copilot can now analyze screen content across other applications to answer questions or interact with files.
• Mobile users on iOS and Android can use Copilot to interpret real-time camera feeds or analyze photos from their camera roll.

Content creation tools: Microsoft is enhancing Copilot’s ability to organize and present information in multiple formats.

• A new podcast-style audio generation feature explains topics using AI-generated speech.
• The Pages feature organizes notes and research across documents into a consolidated canvas.

What they’re saying: “Copilot is more than an AI, it’s yours,” says Microsoft AI CEO Mustafa Suleyman, emphasizing the personalized nature of the updated assistant.

Rollout details: Many of these new features are beginning to roll out today as “initial versions,” with improvements expected in the coming weeks and months.

• Availability will vary by feature, platform, and market.
• While none of these features are industry firsts, their simultaneous release signals Microsoft’s determination to remain competitive in the AI assistant space.