The company announced yesterday that it has begun testing several new features that will soon appear in Copilot, sharing a brief preview.

Among the new and improved features, Microsoft included the new DALL-E 3 model, which allows users to create higher quality images.

Another upcoming feature in Microsoft Edge is the ability to select text on a web page and rewrite it. According to Microsoft, this feature will be available very soon.

Bing is set to introduce a Deep Search feature powered by GPT-4, aiming to refine search outcomes. This functionality involves extending initial search queries into detailed descriptions, enabling the AI to furnish more pertinent results. Additionally, Bing will incorporate upgraded image search capabilities, leveraging GPT-4’s advanced vision functionalities.

“This year will be remembered as the moment that we, as individuals, began to harness the power of AI in our daily lives. The last 10 months reflect years of AI research, close partnerships, and breakthrough innovations coming together. This culmination is now unifying our product vision to empower every person and every organization on the planet to achieve more,” Yusuf Medhi, executive vice president at Microsoft, wrote in a blog post.

The company is actively developing a code interpreter feature that empowers users to delegate
intricate tasks such as calculations, coding, data analysis, visualization, and mathematical operations. Presently, the company is in the process of collecting feedback as it prepares to launch this feature, indicating its imminent availability in the near future.

“Once open, the Windows Copilot side bar stays consistent across your apps, programs, and windows, always available to act as your personal assistant. It makes every user a power user, helping you take action, customize your settings, and seamlessly connect across your favorite apps.”

explains Panos Panay, Microsoft’s head of Windows and devices.

Windows Copilot can summarize the content you’re viewing in apps, rewrite it, or even explain it. Its purpose overlaps with that of the dialog box found in Bing Chat, so you can ask it common questions and things that are commonly asked of the search engine.

Copilot will not directly replace the search bar in the Windows 11 taskbar. It will be a separate Copilot button. According to Microsoft, Windows Copilot is a “personal assistant,” which sounds very similar to the way Microsoft described Cortana as a “personal productivity assistant.”

Microsoft will allow developers to extend plugins written for OpenAI’s Bing or ChatGPT to this AI-powered assistant. Windows Copilot will offer many new features that developers create for ChatGPT and Bing, and for future enhancements that are automatically ported to Windows Copilot.

Testing of Windows Copilot will begin publicly in June before the company rolls it out more broadly to existing Windows 11 users.