SK-404

Doc no. SK-404DatasheetRev 2026.11Sheet 2.22 of 4

U10

Study Copilot

macOS menu-bar study helper: select a screen region or clipboard text and get a step-by-step explanation from a hosted model with your own API key, or an offline mock.

Active

01

Block diagram

Menu barapp.py · rumps Captureregion · clipboard Explainerexplainer_engine Explanationview latest Sandbox quiz127.0.0.1:8001 Mock · Claude · Gemini
Fig. 1: Menu bar to explanation
02

Characteristics

UI shellNative macOS menu-bar app built with rumps and PyObjC (app.py), keeping inference on background worker threads
InputsCaptures interactive screen regions (screencapture -i), full screen, or current macOS clipboard text
Vision backendsSupports offline mock mode (no network/API key), Gemini (GEMINI_API_KEY) and Claude (ANTHROPIC_API_KEY)
Practice sandboxIncludes an isolated local test quiz server (http://127.0.0.1:8001) for verifying capture and explanation flows safely
RequiresmacOS with uv (automatically provisions .venv) and Screen Recording permission for capture
  • macOS
  • rumps
  • PyObjC
03

Overview & build notes

Sits quietly in the macOS menu bar so you can drag a selection box around a dense derivation or copy a paragraph to the clipboard and inspect a structured explanation without switching browser tabs.

explainer_engine.py decouples image/text prompting behind swappable backends — defaulting to Gemini vision when GEMINI_API_KEY is exported, falling back to Anthropic Claude or running completely offline via a deterministic mock backend.

A self-contained local quiz page (mock_practice_server.py on :8001) makes it easy to test OCR/vision capture end to end offline.

04

Files & artifacts

KindFileDetailsSize
Sourceapp.pymacOS menu-bar lifecycle, hotkeys and background worker loop on GitHubGitHub
Sourceexplainer_engine.pyPrompt wrapper across offline mock, Gemini and Claude vision APIs on GitHubGitHub
Sourcemock_practice_server.pyLocal 127.0.0.1:8001 practice sandbox server on GitHubGitHub
Setuprun.shAuto-provisions .venv with uv and launches the menu bar appGitHub