Skip to main content

Connect an LLM

With an LLM connected, Sogon fixes misrecognitions and spacing in your dictation, and ⌘C twice translation plus the correct, structure, and translate actions in the ⌃⇧C grid start working. Without one, Sogon inserts the transcription as is.

Choosing a provider​

Pick one in Settings → LLM → Correction Provider → Provider.

ProviderAuthenticationWhere to get itGood when
Amazon BedrockBedrock API key and regionBedrock API keys in the AWS consoleYour company only allows Bedrock. One key covers Nova and Claude.
Anthropic ClaudeA key starting with sk-ant-Anthropic ConsoleYou want the fastest Claude
Google GeminiGemini API keyGoogle AI StudioYou want to start on the free tier
OpenAI (GPT)Codex CLI sign-inRun codex login in a terminalYou already use the Codex CLI
Groq CloudGroq API keyGroq ConsoleYou need fast responses
Local MLXNoneThe model is downloaded to your MacYou do not want text to leave your Mac

The default is None (use raw transcript).

Connecting​

  1. Open Settings → LLM.
  2. Choose the service in Provider.
  3. Enter the key in the authentication section that appears. For Bedrock, also enter the Region (for example us-east-1).
  4. Choose a model in the model section. The default is fine to start.
  5. Check that the correction provider's Status turns ready.

Keys are stored in this Mac's Keychain.

Settings → LLM with Amazon Bedrock selected

Correction modes​

Choose how Sogon polishes text in the Correction Mode section of the same tab.

ModeWhat it does
Standard (STT Correction)Fixes misrecognitions, spacing, and English term spelling. Keeps your tone.
Filler RemovalRemoves fillers such as "um" and "uh".
StructuredOrganizes what you said into lists and paragraphs.
CustomUses a prompt template you choose.

If a correction changes more than half of the original, Sogon discards it and inserts the original (Standard and Filler Removal modes). For text longer than 1,500 characters, Sogon inserts it without correction.

Checking that it works​

  1. Do your first dictation again.
  2. Expand the new item in Settings → History → Dictation.
  3. If Compare appears, correction was applied. You can switch between the corrected text and the original.

If the correction changed nothing, Compare does not appear. That's not a failure.

If it does not work​

SymptomWhat to check
Status shows an errorPaste the key again. For Bedrock, check that the model is available in that region.
The translation window says No LLM provider is set upThe provider is None. Connect one with the steps above.
You chose OpenAI and see Signed outRun codex login in a terminal and reopen Sogon.
Correction never happensIn the quick controls, check that Enable correction is on in the engine section. With it off, the raw text is inserted even when a provider is chosen.

Models and speed comparisons per provider are in LLM providers.