Skip to main content

Ask while showing your screen

Use this when you ask an agent or chat something like "what is this error" while pointing at your screen. Sogon never reads the captured image as text; it pastes the image as is, so nothing is sent to the cloud. Only the words you speak go through the LLM for correction.

Setup​

Turn on Capture a screen region and talk about it (⌃⇧S) in Settings → General → External Tools. It's off by default, and while it's off ⌃⇧S does nothing.

Try it​

  1. Click the app where the question should go (an agent input, a chat box) to place the cursor.
  2. Press ⌃⇧S. A crosshair like ⌘⇧4 appears.
  3. Drag to select the region to show. A window showing the image opens and recording starts right away.
  4. Say your question. You can also type in the window's field.
  5. Press ⌃⇧S again or ⌘Return.
  6. The image is pasted into the original app first, then the corrected text.

Press esc while selecting to cancel quietly. A tight region works best.

Good to know​

  • There are two pastes: a single ⌘V gives the receiving app only the image or only the text.
  • If there's nowhere to paste, both stay on the clipboard and the Voice Bar says so.
  • Click the image in the window to see it larger. The larger window has Copy and Save.
  • Sogon keeps the capture with the dictation history. Expand the item in Settings → History → Dictation and use View screen or Copy screen.
  • Change the shortcut in Settings → General → Recording → Screen Region Shortcut.