Microsoft has started testing a new update For the Copilot application in Windows, which will allow you to provide you with a screen or application with AI assistant. Copilot Vision was originally circumscribed to the Microsoft Edge browser, but now it extends to any application on the computer.
Copilot Vision will be able to do things like training using Adobe Photoshop or analyze photos and websites. Last week I could see the early version of Copilot Vision in Windows on the 50th anniversary of Microsoft, where the AI assistant led me through the game Minecraft And he helped optimize the settings in the Microsoft Clipchamp video editor.
I was not able to fully test Copilot’s vision in Windows via the beta version, because Microsoft limits experience only for American testers. Copilot will be able to distinguish parts of the screen to guide you through applications, although this initial beta version will not yet be enabled. Copilot Vision may sound similar to the Microsoft withdrawal function, which automatically performs the shutter, if you allow it, but in fact it is more like sharing an application or the entire computer in the Microsoft Teams connection.
Microsoft also started testing file search in Copilot in Windows, which allows you to ask AI assistant about the file content on the computer. File search supports .docx, .xlsx, .PPTX, .txt, .pdf, .json files, and you can operate Copilot to easily find documents you have recently worked on.
Both of these Copilot functions simply require the Copilot application in Windows, not the full Copilot Plus computer. You can also operate Copilot Vision on iOS and Android. Microsoft began testing these recent Copilot functions with Windows informants, before wider implementation for all Windows 11 users in the coming weeks or months.