The new Windows Copilot on Windows 11 is essentially Bing.com/chat integrated into a Microsoft Edge-powered panel. If you have tried the first preview of Windows Copilot, you probably know that it is disappointing, but this could change soon thanks to deeper integration with Windows 11.
Microsoft has been working on Windows Copilot inbox plugins using Microsoft Edge APIs. These plugins could allow the web-based Windows Copilot to control OS-level features such as changing settings, opening apps, turning on or off dark mode, changing brightness level, and reading content from another app.
Microsoft plans to avoid bloating Copilot and is testing several plugins to enhance the experience on Windows 11. Several new .json files have been spotted in Windows 11 preview builds, including “TaskManagerService-ai-plugin.json.” This suggests that Windows Copilot may also gain access to the Task Manager.
For example, you will soon be able to ask Copilot to manage a process using Task Manager, such as ending or learning more about a process.
Windows Copilot is designed to be as modular as possible. Most of its features are handled using inbox plugins and third-party plugins. These inbox plugins allow you to launch or close apps, set alarms, search for files, and more.
Microsoft is leveraging a new set of JSON files representing different plugins for Windows Copilot. One notable plugin is the AccessibilityTools-ai-plugin.json, which could potentially allow Copilot to control accessibility features, making it easier for those with disabilities to navigate through the system.
Other plugins include ai-plugin-WindowsSettings.json, which controls different settings on Windows 11, and ClockService-ai-plugin.json, which manages time and alarm settings.
Additionally, there is testing being done on a plugin for Task Manager integration, where users could monitor or close running apps using the AI within Copilot. This adds a new dimension to the user experience, turning Windows Copilot into a power-user hub.
The LaunchApplication-ai-plugin.json and SmartFileActions-ai-plugin.json plugins provide an interactive way to open apps through simple AI-driven commands.
Microsoft is also testing several other plugins, including the Open Feedback Hub Plugin, Set Windows Theme Plugin, Fix Slow PC Plugin, Close App Plugin, Screen Snipping Plugin, Set Timer Plugin, Set Alarm Plugin, and Suggest Media Plugin.
Copilot’s plugin architecture includes openapi.yml files for each JSON plugin. These YAML files likely define the API endpoints for the plugins, facilitating communication between the AI and the operating system.
While no references to third-party plugins have been spotted yet, Microsoft is expected to offer third-party plugins in the near future. The infrastructure is being ramped up before pushing plugins to everyone, and the third-party plugins will be enabled in the coming weeks.