Skip to content
Get packs

Peekaboo macOS UI Automation

Lets the agent see, click, type and manage macOS apps, windows and menus via the Peekaboo CLI.

Source Download skill
Repository
spinabot/brigade
Stars
11,367
Licence
MIT
Files
1 file

What it does

This skill teaches the agent to control a Mac the way a person would: it can take screenshots, read the on-screen layout of apps and windows, then click buttons, type text, press keys, scroll, drag, open or quit apps, and use menus and the Dock. It relies on a separate command-line tool called Peekaboo, which must be installed on the Mac first. Once installed, the agent can chain these actions to complete multi-step tasks on the desktop.

Great for

  • Developers who want an agent to automate repetitive clicking or form-filling in native macOS apps
  • Testers exploring how a Mac app's interface behaves without writing custom scripts
  • Users who want an agent to take and analyse screenshots of specific windows

Skip it if

  • Windows or Linux machines, since the skill only runs on macOS (darwin); the skill cannot work elsewhere
  • Sensitive tasks such as entering passwords or banking details, because the skill's own example types a password and the agent acts on the live screen with your permissions (risk of mistakes or exposure)
  • Unattended runs without supervision, since mis-targeted clicks or keystrokes can change or delete data in whatever app is in focus

Try asking

  • “Open Safari, go to the login page, and fill in the email field”
  • “Take a screenshot of my main display and summarise the dashboard shown”
  • “Click File > Export in TextEdit and save the document as PDF”
  • “List the open windows in VS Code and move the frontmost one to a new size”
Step-by-step guide: how to use Peekaboo macOS UI AutomationInstall, first run, examples, tips and FAQs

Install in 3 steps

  1. 1

    Download the skill

    The ZIP contains the 1 original files, the MIT licence and an attribution note.

    peekaboo.zip
  2. 2

    Add it to your agent

    Claude Code (all projects)

    mkdir -p ~/.claude/skills && unzip peekaboo.zip -d ~/.claude/skills/

    Claude Code / Agent SDK (this project only)

    mkdir -p .claude/skills && unzip peekaboo.zip -d .claude/skills/

    Claude apps (web/desktop): Settings → Capabilities → Skills → Upload skill, and choose the ZIP.

  3. 3

    Ask for the task

    No special command needed — the agent reads the skill's description and loads it when your request matches. Try one of the prompts above.

Get better results

  • Run peekaboo permissions first and grant Screen Recording and Accessibility access in System Settings before asking for automation
  • Use peekaboo see --annotate to inspect element IDs before clicking, and prefer targeting a specific --app or --window-title to avoid acting on the wrong window
  • Keep sensitive inputs manual and review the agent's planned commands before letting it type into live apps

What's inside

  • SKILL.md

Redistributed unmodified from spinabot/brigade under the MIT licence. The assessment was drafted with AI from the skill's files on 2026-10-29. Skills can instruct your agent to run code — read SKILL.md and any scripts before installing.