Microsoft today launches Copilot Vision for Windows, the extension of his AI assistant, which allows you to share a screen or applications so that Copilot can do things like training using Adobe Photoshop or analyze photos and websites.
“When you decide to turn on, Copilot Vision can see what you see and talk about it in real time” says the Copilot team. “It works as a second set of eyes, able to analyze content, help after loss, you provide insight and answer your questions while driving.”
Microsoft started testing Copilot Vision for the first time in Windows at the beginning of this year, and now it is launched free of charge in the US for both Windows 10 and Windows 11 users. You will no longer need a Copilot Pro subscription, but this is still the experimental part of Microsoft Copilot laboratories AI initiatives.
Copilot Vision on Windows works in the Copilot application and can be activated using the glasses icon, which allows you to choose a browser window or the application you want to share with AI – just like sharing a screen or application at a meeting of Microsoft bands. It is an OPT-IN experience in which you will have to specifically share your applications so that Copilot Vision operates; This is not like a reminder where the screen snapshots still make when you turn on.
I was not able to fully test Copilot’s vision in Windows, because Microsoft limits the impressions to the USA, but in April I got a miniature practice at the 50th anniversary of Microsoft. After sharing the application, Copilot is able to distinguish parts of the screen to guide you and assist you answer questions. You can also exploit Copilot Vision on iOS and Android.
Update, June 12: An article has been updated to reflect that Copilot Vision does not require Copilot Pro.