Windows introduces “Describe Image”: AI-powered image descriptions arrive natively in Windows Copilot+

Microsoft brings on-device AI vision to Windows with a new feature for Copilot+ PCs.

“Describe Image” lets users generate instant, private descriptions of any picture or graphic, right from the desktop.

Microsoft is rolling out a great feature called “Describe Image”, now available to Windows Insider users on Copilot+ PCs. This innovation enables users to right-click on any image—be it a photo, screenshot, chart, or graphic—and receive a detailed description generated by artificial intelligence. Unlike previous integrations that relied on cloud services, this tool processes images directly on the device, ensuring privacy and reducing latency.

The feature is part of the broader “Click to Do” actions menu, embedded throughout the Windows interface. For now, it’s available to testers with Snapdragon-based Copilot+ machines, with support for Intel and AMD hardware on the way. Microsoft’s aim is to enhance accessibility for users with visual impairments and to provide a productivity boost for anyone needing to quickly understand or summarize visual content.

Describe Image operates entirely offline, focusing on privacy and speed.

AI vision in Windows runs locally, with no images or data sent to the cloud.

A key selling point for “Describe Image” is its privacy-first design. The image never leaves the user’s device: the description is generated using AI models running locally, with no need for an internet connection. This not only speeds up response time but also aligns with growing user concerns about data privacy and security.

Microsoft leverages the AI accelerators built into the latest Copilot+ hardware, ensuring that even complex images or charts can be described almost instantly. Early tests show that the feature works across Photos, File Explorer, web browsers, and even screenshots, making it a versatile tool for a wide range of scenarios—from drafting documents to making web content more accessible.

______

Native AI vision marks a new era for accessibility and productivity on Windows.

Microsoft sets the stage for broader AI-powered features integrated directly into the OS.

The introduction of “Describe Image” is seen by analysts as a significant move toward truly native AI functionality within the Windows operating system. Beyond its impact for users with disabilities, the feature simplifies daily workflows for professionals, educators, and students who regularly deal with visual materials.

By pioneering offline, hardware-accelerated AI vision at the system level, Microsoft is not only responding to competitive pressure but also reshaping expectations around privacy, accessibility, and the user experience in mainstream computing. With broader rollout planned for all Copilot+ PCs and other Windows devices, “Describe Image” is poised to become a standard productivity and accessibility tool for millions of users.

______

The "Describe Image" function in Windows is also designed to help people who have little or no vision. If a visually impaired user clicks on an image or icon, the computer writes a description in words of what can be seen (for example: "This is the Downloads folder" or "This is a photo of a dog running").

This description can be read aloud by the computer through screen reader programs, so the person knows what's in the images without needing to see well.It doesn't require internet and the data remains secure on the computer. The function helps to use all of Windows better, even for working or studying more independently.

______

FOLLOW US FOR MORE.

DATA STUDIOS

datastudios.org