Microsoft enhances Windows search with AI for Copilot Plus PCs

Microsoft has finally rolled out its Recall feature to all Copilot Plus PCs after a 10-month delay focused on addressing security concerns. The controversial feature, which captures screenshots of user activity to create a searchable visual history, arrives alongside AI-powered Windows search improvements and a new Click to Do feature similar to Google’s Circle to Search. These developments mark a significant advancement in how users interact with Windows systems but continue to navigate the balance between innovative functionality and privacy considerations.

The big picture: Microsoft’s Recall officially launches today as an opt-in feature after multiple delays and substantial security overhauls since its initial announcement.

• Originally slated to debut with Copilot Plus PCs in June 2023, the feature faced pushback from security researchers concerned about its privacy implications.
• The feature works by taking regular screenshots of user activity, categorizing them to create a more natural and image-aware search experience on Windows devices.

Key improvements: Microsoft has addressed security vulnerabilities while expanding Windows’ AI capabilities with natural language search and screen-based contextual actions.

• The Recall database is now encrypted, filters sensitive data by default, and requires users to explicitly opt in rather than being automatically enabled.
• Windows search now supports natural language queries across File Explorer, the search box, and settings, allowing users to describe images or documents instead of remembering exact file names.

New functionality: The Click to Do feature provides contextual AI actions similar to Google’s Circle to Search interface.

• Users activate it with Windows key + left mouse click to get AI-powered suggestions for text or images on screen.
• Capabilities include summarizing text and removing objects from images, though text actions are currently limited to Qualcomm-powered devices.

Availability details: The features are rolling out with some regional and hardware limitations.

• All Copilot Plus PCs will receive Recall, improved Windows search, and Click to Do starting today.
• AMD and Intel-powered Copilot Plus PCs will get Click to Do’s text actions “in the next few months,” while the feature is temporarily unavailable in EU countries, Iceland, Liechtenstein, and Norway.

Expert assessment: Security researcher Kevin Beaumont, who initially raised concerns about Recall, acknowledged Microsoft’s efforts to secure the feature.

• After testing the final version, Beaumont noted that “Microsoft has made serious efforts to try to secure Recall,” validating the company’s responsive approach to security feedback.