Skip to main content

Microsoft announces major AI upgrade for Windows with smarter Copilot feature

The Copilot key shown on a white keyboard.
Microsoft

Microsoft announced improvements to Copilot in a blog post today, including a new Vision feature that allows the AI assistant to view and interact with users’ Windows screens in real time.

As part of Microsoft’s 50th anniversary, it announced a huge improvement to Copilot, making it more personalized and guiding users through tasks at every step. Microsoft introduced Vision in Copilot for the web last year, but the announcement is now for Windows and mobile. You can use the native Windows app to use Copilot when working across various apps, files, and browser tabs. Vision in Copilot will read your screen and interact with it.

Recommended Videos

You can use Copilot to search, organize files, change settings, and work together on projects without constantly switching apps or files. You can access the Copilot app by pressing Alt + Space or by pressing Alt + Space for two seconds for voice commands. Microsoft says the native Copilot app is available today, but the Vision feature will reach the Windows Insider program first next week for future testing. The software giant didn’t mention a specific general release date, so we can only wait.

During a demo, Microsoft showed how Copilot added a second cursor to guide users by highlighting the buttons they needed to click. For example, in Photoshop, Copilot Vision pointed out specific tools and the steps the user needed to follow next. The Vision feature used voice instructions and visual cues to provide a more interactive experience, which is a giant leap forward.

While Vision could make interacting with your Windows computer easier, giving an AI assistant access to everything on your screen could raise privacy concerns. But Microsoft did say that the sessions are entirely opt-in and ephemeral. Microsoft claims Copilot Vision does not save or use anything it interacts with. Microsoft also says that Copilot Vision can answer questions about what’s on your screen and provides an example by saying, “Imagine you’re trying to furnish a new apartment, Copilot Vision can help you search for furniture, find the right color palette, think through your options on everything from rugs to throws and even suggest ways of arranging what you’re looking at.”

Judy Sanhz
Judy Sanhz is a Digital Trends computing writer covering all computing news. Loves all operating systems and devices.
I hope Microsoft adds these 6 things to the next major Windows Update
Windows 11 logo on a laptop.

Windows 11 updates have a bit of a reputation, from slowing Intel's newest desktop processors to breaking games. Despite the occasional hiccup, we still look forward with cautious optimism.

Despite the occasional rough patch, Microsoft continues to evolve the OS, and each update feels like a chance for a new beginning. While Microsoft hasn't confirmed anything yet, the rumor mill is buzzing with what comes next, and I'm starting to feel excited. The talk of new features suggests fixes for long-standing annoyances, productivity boosts, and quality-of-life improvements worth waiting for.
What's coming to Windows in 2025?

Read more
Microsoft could make account-free Windows 11 installs a thing of the past
Windows 11 logo on a laptop.

The offline Windows 11 install looks like it could officially be a thing of the past. 

Microsoft is officially shutting the door on local accounts during Windows 11 setup, confirming that all new installations, Home and Pro alike, will now require a Microsoft account. 

Read more
Microsoft 365 Copilot gets an AI Researcher that everyone will love
Researcher agent in action inside Microsoft 365 Copilot app.

Microsoft is late to the party, but it is finally bringing a deep research tool of its own to the Microsoft 365 Copilot platform across the web, mobile, and desktop. Unlike competitors such as Google Gemini, Perplexity, or OpenAI’s ChatGPT, all of which use the Deep Research name, Microsoft is going with the Researcher agent branding.
The overarching idea, however, isn’t too different. You tell the Copilot AI to come up with thoroughly researched material on a certain topic or create an action plan, and it will oblige by producing a detailed document that would otherwise take hours of human research and compilation. It’s all about performing complex, multi-step research on your behalf as an autonomous AI agent.
Just to avoid any confusion early on, Microsoft 365 Copilot is essentially the rebranded version of the erstwhile Microsoft 365 (Office) app. It is different from the standalone Copilot app, which is more like a general purpose AI chatbot application.
Researcher: A reasoning agent in Microsoft 365 Copilot
How Researcher agent works?
Underneath the Researcher agent, however, is OpenAI’s Deep Research model. But this is not a simple rip-off. Instead, the feature’s implementation in Microsoft 365 Copilot runs far deeper than the competition. That’s primarily because it can look at your own material, or a business’ internal data, as well.
Instead of pulling information solely from the internet, the Researcher agent can also take a look at internal documents such as emails, chats, internal meeting logs, calendars, transcripts, and shared documents. It can also reference data from external sources such as Salesforce, as well as other custom agents that are in use at a company.
“Researcher’s intelligence to reason and connect the dots leads to magical moments,” claims Microsoft. Researcher agent can be configured by users to reference data from the web, local files, meeting recordings, emails, chats, and sales agent, on an individual basis — all of them, or just a select few.

Why it stands out?

Read more