Screenshots
The tool captures an image of a window, a region or the whole display and sends it to a vision model, which reads it the way you would. It works on anything you can see, including images, charts and apps that expose no text.
Plenty of Mac apps can now look at your screen and answer questions about it. They differ less in what they can do than in how they look: one capture when you ask, or everything in the background, kept. This guide compares 11 of them on that, and on four other questions that matter more than any feature list.
Disclosure
We make Crodo, which is one of the 11. Every tool here, Crodo included, answers the same five questions from its own documentation, and every entry lists where it falls short. No tool paid to be included. Where something else is the better choice, we say so.
Yes. ChatGPT, Claude, Gemini, Raycast and Apple's own Siri AI capture a single window or screenshot only when you ask. A few, like Screenpipe and Highlight, watch in the background and keep a searchable record. That difference matters more than any feature.
At a glance
How each one sees your screen, whether it runs in the background, and what happens to what it captures.
| Tool | How it sees your screen | Runs in background? | What happens to the capture | Voice | Price |
|---|---|---|---|---|---|
| ChatGPT | Frontmost window plus its text, on both Command keys | No; opt-in history on Pro, Business and Enterprise | Kept locally in the chat session file | Plus and up | Free plan; Plus $20/mo |
| Claude | A window or region you pick | No | Attached to the chat | Dictation | Free; Pro $20/mo |
| Gemini | Visible part of the frontmost window | No | Saved to Gemini Activity if it is on | Yes | Free |
| Siri AI | A window or region you select | No | Not stored, per Apple | Yes | Free, macOS 27 |
| Raycast | Window text plus a screenshot | No | Not stored | Dictation | Pro from $10/mo |
| VoiceOS | The area you point at | No | Not retained after processing | Yes | From $11.99/mo |
| Crodo | Display under your cursor, on keypress | No | Not stored | Yes | Free |
| Jarvis | A screenshot when summoned | No | Not stored by Jarvis | Yes | Free 40/wk; Pro $16/mo |
| Screenpipe | Event-triggered screenshots plus text | Yes, always | Stored locally, 14 days by default | Dictation only | Free on 1 device; from $25/mo |
| Highlight | Permitted app windows | Yes, by design | Uploaded, then deleted | Yes | From $35/mo |
| Shadow | The meeting window, when it changes | During meetings | Stored locally | Plus | Free; Plus $8/mo |
Checked 17 October 2026from each vendor's own documentation. Plans change often; confirm on the vendor's site before you pay.
How it works
“Seeing your screen” covers four quite different things. Most tools use one or two of them.
The tool captures an image of a window, a region or the whole display and sends it to a vision model, which reads it the way you would. It works on anything you can see, including images, charts and apps that expose no text.
The tool asks macOS for the actual text inside an app, through the same Accessibility system screen readers use. It is more accurate than reading pixels for long pages and code, and can include text scrolled out of view, but it only works as well as each app exposes its text.
The tool keeps taking captures in the background and indexes them, so you can search or ask about the past. It is the only approach that answers “what was I looking at on Tuesday”, and the only one that builds up a record of everything.
A few tools go further: they look at the screen, then click, type and navigate in apps you approve. Seeing the screen is how they find their way around.
The decision
One capture per question, and nothing in between. Nothing accumulates, so the only exposure is whatever is on screen at the moment you ask. Right for help with what is in front of you: an error, a page, a message, a chart.
A searchable archive of everything that crosses your screen, including passwords that flash past, private messages and client data. That archive is both the value and the risk. Right when you genuinely need to recall what you saw, and best kept on your own Mac.
Do you want help with this screen, or memory of past screens? For help, pick an on-demand tool. For memory, pick an always-on recorder and check where it stores the record.
The list
Not ranked one to eleven: the right tool depends on whether you want help, memory or meetings. Within each group, the tools most people already have come first.
These take one capture at the moment you trigger them and nothing in between. Nothing builds up over time. What differs is how much they see, whether you can talk to them, and where the capture goes.
The biggest name, and the most ways to look
Best for
A deliberate “look at this window” gesture, and an agent that can actually operate Mac apps.
Where it falls short
One window at a time, never the whole display. Live screen sharing during a voice call exists only in the iPhone and Android apps, not on Mac. Two desktop apps, ChatGPT and ChatGPT Classic, currently coexist with different features.
Show it a region or a window, on any plan
Best for
Choosing exactly what to show, down to a dragged region, without paying.
Where it falls short
No continuous awareness: every capture is one you take. Computer use is in beta on Pro and Max only, and Anthropic warns it may struggle with complex multi-step work.
Free, native, and also on both Command keys
Best for
Fast, free questions about the window in front of you, especially if you already live in Google Workspace.
Where it falls short
Only the visible part of one window. Every Speak to Window use captures the active window, even when you only meant to dictate. Speak to Window is English-only.
Built in, nothing to install, still in beta
Best for
Anyone on macOS 27 who wants screen help with no extra app and no Screen Recording permission to grant.
Where it falls short
In beta, behind a waitlist, and English-only at launch. Onscreen awareness was announced in 2024 and only shipped with macOS 27 in September 2026.
Real text, not just a screenshot
Best for
Raycast users who want one hotkey that hands the AI the actual text of what they are reading.
Where it falls short
Pro-only and metered in AI credits. During a chat, the model can take a capture on its own unless you switch that off in settings.
Point at it while you talk
Best for
Pointing at one specific thing on a busy screen without having to explain where it is.
Where it falls short
No free plan. Captures are still images taken when you ask, with no history to look back on. Fully cloud-based, with no on-device option.
Spoken question and screen on one key, free
Best for
Asking about anything on screen by voice, for free, in the same app you use for dictation, meeting notes and your inbox.
Where it falls short
English only. Cloud processing, with no offline mode. It answers but cannot click or type for you, and there is no way to point at one part of the screen the way VoiceOS allows.
A summon-only bar with connectors
Best for
Trying a summon-only screen assistant with connectors at no cost.
Where it falls short
In beta according to its own terms, built by a single founder, with no security certifications yet. Refunds are generally not given.
These are designed to capture continuously, so they can answer questions about things you saw hours or days ago. That memory is the point, and it is also the risk: everything that crosses your screen ends up in the record.
A searchable local record of everything you saw
Best for
Asking “what was I working on” days later, with the record kept on your own Mac.
Where it falls short
No longer open source: its core moved to a source-available licence in June 2026. Always-on capture records everything on screen, including other people’s messages and meeting audio.
Watches in the background to draft your follow-ups
Best for
People with back-to-back meetings who want follow-ups drafted from what they actually worked on.
Where it falls short
Now a meetings and follow-up product; the original Highlight app is retired on 15 November 2026. Its own documents disagree about how continuous its capture is, and it does not say how often screenshots are taken.
Screen capture tied to a specific trigger: a call. Useful when what matters is what was shown in a meeting, not what is on your screen right now.
Captures what was shown in your meetings
Best for
Bot-free meeting notes that include what was on screen, with everything kept as local files.
Where it falls short
Screen shortcuts are unavailable while a meeting is being recorded, and meeting screenshots stop if the meeting window is hidden. All AI features run in the cloud.
Before you grant anything
Every screen tool asks for some of these in System Settings > Privacy & Security. Here is what each one actually lets an app do, and you can revoke any of them there at any time.
| Permission | What it lets an app do | Who asks for it |
|---|---|---|
| Screen & System Audio Recording | Lets an app capture images of your windows or your whole display. | ChatGPT, Claude, VoiceOS, Jarvis, Crodo, Screenpipe, Highlight and Shadow. Optional in Raycast, which can send text only. |
| Accessibility | Lets an app read the text inside other apps, and click or type in them. Raycast notes it is renamed Device Control and Data Access on macOS 27. | ChatGPT, Claude, Raycast, VoiceOS, Jarvis, Crodo (for its hotkeys and pasting), Screenpipe, Highlight and Shadow. Optional in Gemini. |
| Input Monitoring | Lets an app see what you type across all apps. | Screenpipe, optionally. |
| Microphone | Lets an app hear spoken questions and dictation. | Any tool you talk to. |
The exception is Apple's own Siri AI: it is built into macOS 27, and Apple documents no Screen Recording or Accessibility grant for it at all.
How to choose
Start from what you are trying to do. One requirement usually settles it.
Explain an error, a setting or a chart
Any on-demand tool works. Free options: Gemini, Claude and Crodo.
Hand over the actual text of a long page or code
Raycast or ChatGPT appshots, which read the app’s text through Accessibility. ChatGPT includes text scrolled out of view.
Point at one thing on a crowded screen
VoiceOS, or drag a region in Claude.
Ask out loud instead of typing
Crodo, VoiceOS, Gemini’s Speak to Window, or ChatGPT voice on Plus.
Have it actually do the task
ChatGPT Computer Use, or Claude computer use on Pro and Max.
Find something you saw days ago
Screenpipe, which keeps the record on your Mac, or Highlight.
Keep what was shown in a meeting
Shadow, free.
Install nothing at all
Siri AI on macOS 27, in beta.
Worth knowing
The gaps nobody puts on a pricing page, and the ones most likely to give you a wrong answer.
ChatGPT, Gemini and Raycast default to the frontmost window. Claude and Siri AI let you pick a window or a region. Crodo captures the whole display your cursor is on. VoiceOS can span up to three monitors in one question.
Screenshot-only tools read the image. Raycast and ChatGPT appshots also read the app’s text through Accessibility, which is more accurate, but apps that expose little text give them only a screenshot. OpenAI notes that for Google Docs, Gmail, Sheets and Slides, ChatGPT may receive only the visible screenshot.
Screenpipe captures on events, with idle snapshots 30 seconds apart on power and up to 120 seconds apart on battery, so a screen that changes quietly can go uncaptured.
At work
Method
Every claim comes from the vendor’s own documentation, pricing pages, help centres and release notes, checked on 17 October 2026.
A second pass then tried to disprove each claim against those same primary sources, and corrected it wherever it succeeded.
Every tool answers the same five questions: how it sees the screen, whether it runs in the background, what it keeps, where captures go, and what it costs.
Prices are US list prices. Local prices vary, and these plans change often, so confirm on each vendor’s site before you pay.
This is a documentation-based comparison, not a timed hands-on test.
We make Crodo. It answers the same five questions as everything else, with its limitations listed. No tool paid to be included.
Questions
Yes. ChatGPT, Claude, Google Gemini, Raycast, VoiceOS, Jarvis and Crodo can all look at your screen when you ask, and Apple’s Siri AI does it natively on macOS 27. Screenpipe and Highlight go further and capture your screen in the background. The biggest difference between them is not features but whether they look only when you ask or watch all the time.
Most do not. ChatGPT, Claude, Gemini, Siri AI, Raycast, VoiceOS, Jarvis and Crodo take a single capture when you trigger them and nothing in between. Screenpipe and Highlight are designed to capture continuously in the background, and Shadow captures automatically during meetings. ChatGPT also offers an opt-in Computer History feature on paid plans, which records accessibility events rather than screenshots.
They can see anything visible in what they capture. On-demand tools only see a password if it is on screen at the moment you ask, so close sensitive windows first. Always-on recorders can capture whatever passes across the screen, which is why Screenpipe and Highlight offer per-app exclusions and pause controls, and why Screenpipe’s own documentation warns that redaction can miss things.
In the new ChatGPT desktop app, open the window you want help with and press both Command keys together; ChatGPT attaches a screenshot of that window plus its text. In voice mode, turn on Screen context in settings and say “take a look at this”. In ChatGPT Classic, use the + button and choose Take Screenshot. Live screen sharing during a voice call is only available in the iPhone and Android apps.
Google Gemini’s Mac app, Claude’s quick entry and Crodo are all free and can see your screen when you ask. Apple’s Siri AI is free with macOS 27 but is in beta behind a waitlist. Jarvis gives 40 free requests a week. Raycast’s screen feature needs a paid Pro plan, and VoiceOS and Highlight have no free plan.
Not the on-demand assistants: ChatGPT, Claude, Gemini, Raycast, VoiceOS, Jarvis and Crodo all send captures to cloud models. Apple handles some requests on device and sends larger ones to its Private Cloud Compute. Screenpipe stores its record on your Mac, though some of its network features are on by default, and Shadow keeps meeting captures as local files.
Yes, in two cases here. ChatGPT’s Computer Use and Claude’s computer use (in beta, on Pro and Max) can see the screen and click and type in apps you approve, asking permission app by app. The rest, including Crodo, answer questions about what they see but do not operate your apps.
For most third-party tools, yes: it is what lets an app capture images of your windows. Raycast can work with Accessibility alone, sending text without a screenshot. Apple’s Siri AI is built into macOS and needs no Screen Recording grant at all. You can revoke any app’s access in System Settings > Privacy & Security.
On-demand tools only do work when you trigger them. Always-on recorders run constantly: Screenpipe lists 600 MB to 4 GB of memory depending on settings, and around 30 GB of storage a month.
Meta acquired Limitless, the company formerly called Rewind, on 5 December 2025, and Rewind’s screen and audio capture was switched off on 19 December 2025. Screenpipe and Highlight are the closest background-capture alternatives on Mac.
Go deeper