Microsoft announced AI Copilot: for Windows 11, Store, Terminal, Plugin Support, and More for apps and services.
These enhancements will improve the functionality and capabilities of AI apps and services by incorporating plug-ins created by external developers. It will be easier for users to find and use AI-powered apps and services they want. These co-pilot assistants will help users with tasks like writing emails and generating images. Microsoft has made a multi-million dollar investment in OpenAI and committed to using the same open plug-in standard as OpenAI, enabling interoperability between Bing Chat, Microsoft’s CoPilot platform, and ChatGPT.
These announcements were made at Microsoft’s annual Build conference, which largely focused on AI-related announcements. The company has seen an increase in daily downloads and has crossed the threshold of 100 million daily active users for Bing. The company has rapidly deployed AI systems and their impact on various aspects of society is being noticed.
Bing/ChatGPT in Windows 11 – Windows’s Copilot
After integrating AI into various apps and services, it is now coming to Windows 11 as Windows Copilot. It will be available in the Windows 11 taskbar and will allow users to change their Windows settings and perform other tasks. Copilot will have access to existing Bing/ChatGPT and will allow you to ask questions about anything, from simple to complex. It will summarize content from the clipboard and compose text. Copilot will be available on the desktop and is built on top of Bing Chat as it supports Bing and ChatGPT plugin.
Users can ask Windows Copilot for specific adjustments for specific purposes, and it is expected that users will upgrade to Windows 11 from Windows 10. Microsoft claims that 20% of users have already made the switch. Windows Copilot will be available in June and will put Bing front and center for Windows 11 users. The company has included features to expand Bing Chat’s functionality and reach across the Microsoft platform.
Windows 11— AndroidGreek (@AndroidGreek) May 23, 2023
– Windows Copilot- Centralized AI assistance
– Bing Chat and third-party plugins for Windows- Allow developers to integrate apps within Windows Copilot
-Hybrid AI loop supports AI development across the platform and across Azure to clients with new silicon support https://t.co/uEjlEOadPD pic.twitter.com/erUgeQal4M
To enhance productivity, you can access Windows Copilot by simply tapping on the bottom of your taskbar. Once activated, the Copilot sidebar remains open across all apps, programs, and windows, serving as a personal assistant to provide helpful information and support. It will open in a separate window that opens up along the right side of your screen. This is one of the ways to provide centralized AI assistance. It seems like Microsoft is replacing Cortana as the primary assistant for Windows. Copilot can be used to rewrite, summarize, or explain and even to check the local time of family members living in another location, find flights, hotels, and more.
It can run commands, customize settings, and perform tasks in Windows apps. Both Bing and ChatGPT utilize advanced AI technologies, with Bing powered by GPT-4 and ChatGPT using GPT-4 for its chat experience. This strengthens Microsoft’s search engine offerings, especially since Samsung has chosen to stick with Google instead of switching to Bing.
Customize RGB lighting through Setting Menu
Windows 11 is getting a new feature called Dynamic Lighting. It lets you adjust the lighting of your accessories and components all in one place, even if they’re from different brands. This means you won’t have to use multiple programs to control RGB lighting anymore. Dynamic Lighting will be available to Windows Insiders this month, but it’s not clear when everyone else will get it.
With Dynamic Lighting, you’ll be able to control the RGB lighting of your device and components from a single hub in the Settings menu. This will make it easier to adjust the lighting for all your accessories and components, no matter what brand they are. However, the company hasn’t shared exactly how it will work.
Windows Copilot is now available on Microsoft Store with a new AI makeover, including an AI hub that showcases the best AI experiences available on the store. It also features AI-generated review summaries to help find apps that focus on productivity, such as resume building, trip planning, and creating presentations.
New AI features on Microsoft Store- AI Hub, AI-Generated keywords, AI-Generated review summary, Microsoft Store Ads, and Backup, Restore Apps, certification tests for Win32 app , and any developer with an Amazon Appstore Developer account can now submit their apps.#MSBuild pic.twitter.com/dD8XDJ7VLt— AndroidGreek (@AndroidGreek) May 23, 2023
New apps will now appear in the Spotlight section and Bing search results, and Windows 11 will restore pinned apps in the same location when switching to a new PC. Microsoft Store’s progressive web apps (PWAs) can use Windows widgets and the edge sidebar for a new experience, and a digital goods API is available for PWAs to accept in-app purchases, simplifying the checkout process.
Developers can use AI-generated keyword suggestions to improve their app descriptions for better search engine optimization (SEO). The AI hub is divided into subsections focused on different categories such as photography and word processing, and it aims to educate customers on how AI can enhance productivity, help with tasks, and discover new content.
Microsoft is gathering feedback from the developer community on the review summary feature during its preview, and developers can still browse individual app reviews and ratings. They are committed to offering a safe and inclusive environment for its customers and developers. A new developer tool in the Microsoft Partner Center allows developers to let AI suggest search tags for their apps, and Microsoft Store ads will start appearing in Bing search results and expand to 150 regions outside the US.
Overall, these features are coming soon, and Microsoft has updated its backup and restore system to retain Microsoft Store apps in the original position on the taskbar and start menu when users upgrade Windows or switch computers.
Get More android app
Microsoft has now opened the Amazon App Store to all Android developers for Windows 11. Previously, it was limited to certain Android apps. This provides access to a subset of mobile apps that have been adapted for desktop environments, and most of the Android apps tested on the Amazon App Store for Windows 11 run smoothly and offer a great user experience.
The company has made material available for developers to help them make their apps compatible with the Windows Subsystem for Android (WSA). Developers need to submit their apps for testing to distribute them on Windows 11 devices. This means Microsoft emphasizes proper Windows resizing and native mapping to ensure Android apps integrate well with the Windows 11 interface. Developers with Amazon AppStore accounts can submit their apps for Windows 11.
Windows 11 supports Android 13, and with the potential for apps in the Amazon App Store to incorporate the latest features, opening the Amazon App Store to all Android developers is expected to bring more apps to the marketplace and increase available options for Windows 11 users.
Windows Terminal get Generative-AI
Windows Terminal, a developer tool, now has an AI-powered chatbot through GitHub Copilot integration. With this tool, developers can receive code recommendations, get explanations for errors, and take actions through the terminal. Microsoft is also considering bringing GitHub Copilot to other developer tools.
— AndroidGreek (@AndroidGreek) May 23, 2023
This means that developers can use natural language queries to engage with the chatbot and receive recommendations for commands, explanations for errors, and suggested actions with the terminal. Microsoft is also testing GitHub Copilot in other development tools such as WinDBG.
GitHub CoPilot will soon come to other developer tools, including WinDBG, and will allow developers to chat with AI. Additionally, a command line palette will make it easier to find actions, and you can customize Windows Terminal with profile icons and various color options.
GitHub Copilot will be able to take advantage of natural language AI both inline and in an experimental chat experience to recommend commands, explain errors, and take actions with the terminal application. You can also add your name to the GitHub Copilot Chat waitlist and try out new features as they become available.
Windows Terminal was first introduced at Build 2019 and has become popular on Windows 10. It offers multiple tab support, colorful themes, customization options, GPU-based text rendering, and emoji support. It is also experimenting with GitHub Copilot AI in other developer tools, like WinDBG. WinDBG is used by developers to debug applications, device drivers, and Windows itself, and it can analyze memory dumps for troubleshooting.
Bing GPT-4 Chatbot – No Waitlist
The waitlist for the new Bing Chatbot powered by GPT-4 has been removed. Anyone can now sign up and start using the Chatbot immediately. Initially, there was a limit of 15 questions per session and a maximum of 150 per day.
Ungrouping Taskbar with Labels
Please keep in mind that this is a highly experimental project and even though it's been daily driven as part of testing, I cannot guarantee a perfect user experience. It's my first time making something that attempts to fix broken bits of the OS/shell early on. It's been a ride.— Albacore (@thebookisclosed) May 8, 2023
Microsoft is bringing back the ability to ungroup taskbar items on Windows 11. Users will be able to click on apps running multiple instances, and the taskbar will automatically ungroup them with labels. This feature will be useful for users who want to have apps ungrouped when interacting with the taskbar. It’s not fully clear if users will be able to disable app groups and enable app labels permanently. This feature is expected to rollout in preview within the coming weeks.
Support for Win32 apps, and WIndows 365 Boot to WIndows 11
The updates include better security with Win32 apps in isolation mode, and a feature called Windows 365 Boot that lets PCs boot directly into Windows 365 for shared hardware environments. Win32 developers can now use new certification tests to make submitting apps smoother.
Dev Home – Helps developers become more productive.— AndroidGreek (@AndroidGreek) May 23, 2023
– Reliable dev machine setup, Dev Drive, and efficient tracking of your workflows.
– Native support for additional archives including tar, 7-zip, rar, gz, and many others using the libarchive open-source project.#MSBuild pic.twitter.com/RhdBu329Vy
Microsoft is expanding beyond the standard Zip format by adding Native Windows Support for more archive formats including tar, 7-zip, rar, gz, and others. This means users no longer need to install third-party apps like WinRar to access files in these formats. This is made possible through the libarchive open-source project, which is expected to improve compression performance for archive files on Windows.
These updates are currently in development and will be available for Windows later this week. The native Zip Support in previous versions of Windows has been criticized, and the new archive format in Windows 11 is expected to provide a better user experience.
A low-energy audio feature was created through a partnership between Samsung and Intel to connect wireless devices with less battery usage. Bluetooth LE uses the LC3 audio code for multi-streaming and improves energy efficiency for hearing aids. Windows 11 update will add support for 10 additional languages to live caption which transcribes audio in real-time.
The support includes Chinese, Danish, French, German, Italian, Japanese, Korean, Portuguese, Spanish, and additional English dialects.
Bing as ChatGPT Default Search Engine
Microsoft’s Chatbot will support ChatGPT as its default experience, and after this update, ChatGPT can access the web for real-time information about current events through Bing Search Engine. However, it will cite its sources, allowing users to check more about the information. It is currently available to ChatGPT plus subscribers, and we can expect it to become accessible to everyone through Bing Plugin.
- ChatGPT integration
- Windows Integration
Microsoft is adopting the same Open Plugin standard as OpenAI, allowing for interoperability across ChatGPT and Microsoft Copilot. This integration allows ChatGPT to access the web to provide up-to-date information from Bing’s Search Engine rather than being limited to pre-2021 information. The company will actively upgrade Bing Chat in recent weeks and over 70 plugins for ChatGPT plus subscribers, enabling the Chatbot to use third-party tools and access the internet.
Build Plugin, and Run on Azure AI:
– https://t.co/n2ksU5EaEM using GitHub Codespace, and deploy on Azure Container.
Azure Open AI: GPT-4, DALL·E 2, ChatGPT, GPT 3.5#Microsoft #OpenAI #MSBuild pic.twitter.com/oUb5WSRnJI— AndroidGreek (@AndroidGreek) May 23, 2023
Until a plugin is available for everyone, free ChatGPT users will soon be able to install an official plugin to access Bing Search. Bing now supports plugins from various services like Expedia, Instacart, TripAdvisor, Redfin, and Zillow. Microsoft has seen significant growth in the use of Bing Chat since its initial unveiling.
Plug-ins for AI apps
Microsoft has a lot of apps and services powered by AI. Copilots and other companies want to make the ecosystem bigger by letting third-party developers create plug-ins using OpenAI with the AI-powered chatbot called ChatGPT. Developers can use DEs like Visual Studio, Codespace, and Visual Studio Code to build their plug-ins. There are three types of plug-ins: ChatGPT, Microsoft Team message extension, and Power Platform connectors.
MS Dev Box: https://t.co/hyTpBQfdYH— AndroidGreek (@AndroidGreek) May 23, 2023
– Azure Deployment Environment: https://t.co/vIQM83brfV
– GitHub advance Security for Dev Ops: https://t.co/885Kujg1L5
– Azure Load Test: https://t.co/rUm2tYYMEV
– ChatGPT Plugin (Web API), Sample (https://t.co/21lIDqGivS) https://t.co/uq3bt9fym9 pic.twitter.com/ZdkVBiSjqF
There will be three types of CoPilot plug-ins: ChatGPT, Team Message extensions, and Power Platform connectors. Plugins let developers integrate third-party apps with the Windows AI chatbot and AI technology. Plug-ins act as a connection between Copilot and the digital world. Azure OpenAI service-based applications also support the plug-in standard. Plug-ins provide more capabilities by letting users access real-time information, integrated data, and perform calculations.
Microsoft also provides various tools like Azure AI apps, Azure OpenAI Service, and Team Toolkit for Visual Studio to help developers debug and test plug-ins. They are also looking to make money from plug-ins, although the pricing details are not yet clear. Competitors are expected to develop their own plug-in framework in response.
Recently, OpenAI ChatGPT announced the plugin support and with the plug-in standard, developers can create plug-ins that will work across Microsoft platforms, including ChatGPT, Bing Chat, Dynamic 365 Copilot, Microsoft 365 Copilot, and even with Windows Co-Pilot. Bing Chat already received new plugins from Instacart, Kayak, Klarna, Redfin, and Zillow, and these plug-ins will also be available in Windows CoPilot.
Plug-ins allow users to interact with different software and services, and they are just web-based APIs. They can retrieve real-time information, incorporate company data, and perform actions on behalf of users. Some companies like Atlassian, Adobe, ServiceNow, Thomson Reuters, Moveworks, and Mural have partnered with Microsoft to offer new plug-ins for the Microsoft 365 CoPilot Early-access program.
Microsoft also released a new framework for plug-ins that serves as a bridge between an AI system like ChatGPT and private or proprietary data. It exists due to concerns about privacy and potential leakage of sensitive information by generative AI models. Companies like Apple and Samsung have already banned the use of AI tools like ChatGPT to mitigate the risk of mishandling and leaking confidential data.
Other Upcoming WIndows 11 Feature
- Applications running on Win32 in isolation
- Windows 365 Boot
- New privacy capabilities
- Glanceable VPN on the taskbar
- Live Caption now available in 10 additional languages
- Account Bading available in Start menu
- Support for Bluetooth Low Energy (LE) Audio
Other features are also coming with the future update including the ability to enable and disable presence-sensing feature, a Shield icon to recognize VPN connection, Live Caption in 10 different languages, and a tweaked design for Widgets. These features were in beta testing and are expected to come with the future update of Windows, which could be the Windows 11 23H2 update and may be shifted away from yearly version changes. Bluetooth Low Energy (LE) audio support is coming in partnership with Samsung and Intel to enhance audio experience.
- India’s framework to tackle deepfakes before they disrupt democracyby Mehak
- Stop Buying an Avita Laptop: Bad Customer Support, Stuck on Boot, and Windows Update Restartby Love Adhikari
- Google Chrome adds a boarding pass detector to Androidby Mehak
- Xbox App Compact Mode for Windows Portal Devicesby Love Adhikari
- Find your Spotify Wrapped 2023by Mehak