After months of teasers, previews, and select rollouts, Microsoft’s Copilot Vision is now available to try for all Edge users in the U.S. The flashy new AI tool is designed to watch your screen as you browse so you can ask it various questions about what you’re doing and get useful context-appropriate responses.
The feature works for “most” sites, according to Microsoft but it gives you a list of recommendations to start with. We have Amazon, which makes sense, but also Geoguessr? I’m pretty sure the point of that site is to try and guess where you are on the map without any help. Anyway, the full list of starter sites is as follows:
CEO of Microsoft AI Mustafa Suleyman announced the release on Bluesky yesterday and shared a few of his favorite use cases.
Usually, when you want to ask Copilot a question, you have to write out the paragraphs of context yourself, and aside from being slow and annoying, this can also be pretty difficult if you’re trying to ask about something you don’t know much about.
With Copilot Vision, instead of trying to describe what you’re looking at or what you’re talking about, the AI model can see it right on your screen.
So, according to Suleyman’s examples, you can search for “breathable sheets” on Amazon and ask Copilot if any of the results are made from appropriate fabrics. Copilot can point the right ones out to you or give you examples of breathable fabric to search for.
On the Food & Wine recipe website, Copilot can help you go hands-free while you cook by answering your questions and reading out parts of the recipe to you. This works because the whole experience is designed to work through voice — you speak directly to the AI and the AI speaks back.
According to one of the videos on the Copilot Vision page, however, it looks like you can type out questions too and receive written responses.
Microsoft is taking things very slowly and carefully with this feature, almost certainly because it wants to avoid triggering another backlash like it did with Recall. The company makes sure to stress that the feature is “opt-in,” doesn’t record your screen, is only on when you turn it on, and deletes the data as soon as you end a session.
If you’re interested in testing it out, you can set things up and see a little tutorial through the Microsoft website.
“If you’re not paying for the product, you are the product.” Bogdan Onikiienko, an engineer at MacPaw, dropped that hard-hitting quote on me after usi
It was somewhat unexpected, but amid all the hype around agents and assistants, AI also changed the browser wars forever. And once again, Apple finds
When you think of AI, names like Google, Microsoft, and OpenAI pop up in your mind. Netflix, the world’s biggest streaming platform, doesn’t quite sou
If you have a regular subscription, you’re likely well-versed in the dance of paying for something and wondering if it’s worth the value. For many peo
Kagi’s “Assistant” feature, previously only available to Ultimate subscribers, is now rolling out to all tiers — including the free trial tier. The fe
OpenAI seems to be announcing new AI models by the week to improve its ChatGPT chatbot for the betterment of its 400 million users. However, the ease
MidjourneyWhen it comes to AI image generators, you’ve got your choice from dozens these days. Two standouts from that pack (which includes Dall-E, Fi
SOPA Images / Getty ImagesMeta announced on Tuesday that it is launching a new developers conference in April, dubbed “Llamacon,” that will focus on “
We are a comprehensive and trusted information platform dedicated to delivering high-quality content across a wide range of topics, including society, technology, business, health, culture, and entertainment.
From breaking news to in-depth reports, we adhere to the principles of accuracy and diverse perspectives, helping readers find clarity and reliability in today’s fast-paced information landscape.
Our goal is to be a dependable source of knowledge for every reader—making information not only accessible but truly trustworthy. Looking ahead, we will continue to enhance our content and services, connecting the world and delivering value.
