Microsoft has rolled out Copilot Vision in Edge browser for free, allowing users to interact with on-screen content using voice-based AI. Announced by Mustafa Suleyman, CEO of Microsoft AI, on Bluesky, the feature was previously limited to Copilot Pro subscribers but now offers basic functionality to all Edge users.
Described as a “talk-based experience,” Copilot Vision listens to your voice commands and then helps you navigate or understand what’s visible on your screen. For example, you can ask it to walk you through a recipe, decode a job description, or even brainstorm a cover letter based on what you’re looking at.
Suleyman noted, “Copilot Vision can literally see what you see on screen.” While the tool can highlight portions of your browser to help you find information, it does not interact directly with elements on the page, such as clicking links or executing commands.
To enable Copilot Vision, users must visit Microsoft’s website through the Edge browser. After opting in, they can activate the feature by opening the Copilot sidebar and clicking the microphone icon. A chime and a slight hue shift in the browser indicate that the Vision session has started.
System-Wide Features Reserved for Copilot Pro
While the free version is limited to use within Edge, Copilot Pro subscribers gain access to system-wide Vision capabilities. These include advanced support for apps like Photoshop, video editing software, and even in-game assistance for titles like Minecraft. Earlier this month, The Verge’s Tom Warren showcased how Copilot helped guide gameplay in real time.
Microsoft clarifies that while it logs Copilot’s responses, it does not collect your voice inputs, screenshots, or website data during Vision sessions. Users can end the session at any time by clicking “stop sharing” or simply closing the browser window.
Early Access May Vary
Initial access to the feature might not be seamless. In one user’s experience, opting in took several attempts, and the interface didn’t fully load. Performance may vary based on hardware, with newer devices likely providing smoother functionality.
Despite the occasional hiccups, Copilot Vision in Edge browser represents a significant step forward in accessible AI-powered assistance. Microsoft continues to push the boundaries of user interaction through natural language, voice recognition, and contextual awareness.
