Microsoft Expands Copilot Vision to Windows and Mobile for Real-world AI Assistance

Microsoft has recently revealed plans to integrate Copilot Vision into the Windows operating system and mobile device platforms, significantly expanding its scope of application. Previously, as a key component of Microsoft's redesigned Copilot strategy, Copilot Vision was primarily limited to Edge browser webpages, where it helped users interpret online content.

With this latest update, Copilot Vision can now analyze live video streams captured by mobile device cameras in real-time. This advancement enables the tool to provide practical solutions such as plant care advice or home decor recommendations. The feature is already available on iOS and Android through the Copilot app, with similar functionality for Windows systems expected to roll out soon.

The Windows version of the Copilot app will fully support Copilot Vision, empowering the AI assistant to guide users through using software like Adobe Photoshop or analyzing photos and webpages they are currently viewing.

It’s important to note that Copilot Vision differs fundamentally from the Recall feature available on Microsoft’s Copilot Plus PCs. While Recall requires user activation before capturing screenshots automatically, Copilot Vision operates more like sharing apps or an entire desktop during a Microsoft Teams call.

The Windows version of Copilot Vision will be available for testing by Windows Insider users starting next week. After completing the testing phase, it will gradually roll out to a broader audience. Additionally, Microsoft has introduced several upgrades to Copilot, including enhanced memory capabilities, personalized settings, web operation support, podcast creation tools, and advanced research features.