Skip to content
Get packs

Caveman LLM Gateway Setup

Route an app's LLM calls through the Caveman gateway to measure spend without changing behavior

Source Download skill
Repository
JuliusBrussee/caveman
Stars
116,835
Licence
Apache-2.0
Files
1 file

What it does

When installed, this skill tells an AI coding agent how to wire an existing app so every call it makes to an AI model (OpenAI, Anthropic, Gemini and similar) passes through the Caveman gateway, a proxy that records usage and cost. The agent is instructed to find the LLM calls in the code, change only the base URL and add an authentication header, store the gateway key in an environment variable, and then send one small test request to confirm it works. The skill says it only measures and does not optimize or alter requests.

Great for

  • Developers who run an app calling OpenAI, Anthropic or other LLM APIs and want per-app spend visibility
  • Teams that already use the Caveman Cloud gateway and need a quick, consistent integration
  • Engineers who want a minimal change to existing LLM client code rather than a refactor

Skip it if

  • Apps with no LLM calls: the skill is designed to stop and report nothing to wire, so it adds no value there
  • Projects where sending prompts and responses through a third-party proxy is not allowed, since requests are routed via the gateway
  • Users without a Caveman gateway URL and key: the skill stops and asks for them, so it cannot be used standalone

Try asking

  • “set up caveman for this repository”
  • “Wire our support-bot app through the Caveman gateway so we can see LLM spend”
  • “Add LLM spend observability to this Python service using our Caveman key”
Step-by-step guide: how to use Caveman LLM Gateway SetupInstall, first run, examples, tips and FAQs

Install in 3 steps

  1. 1

    Download the skill

    The ZIP contains the 1 original files, the Apache-2.0 licence and an attribution note.

    caveman-setup.zip
  2. 2

    Add it to your agent

    Claude Code (all projects)

    mkdir -p ~/.claude/skills && unzip caveman-setup.zip -d ~/.claude/skills/

    Claude Code / Agent SDK (this project only)

    mkdir -p .claude/skills && unzip caveman-setup.zip -d .claude/skills/

    Claude apps (web/desktop): Settings → Capabilities → Skills → Upload skill, and choose the ZIP.

  3. 3

    Ask for the task

    No special command needed — the agent reads the skill's description and loads it when your request matches. Try one of the prompts above.

Get better results

  • Use a gateway key created for this app only and keep it in a gitignored env file, as the skill instructs; review the diff before committing
  • Choose stored versus byok deliberately: stored keeps provider keys in Caveman Cloud, byok means the app sends its own provider key with each request through the gateway
  • Check the verification output yourself, since the skill reports the real HTTP status and usage numbers and claims no savings

What's inside

  • SKILL.md

Redistributed unmodified from JuliusBrussee/caveman under the Apache-2.0 licence. The assessment was drafted with AI from the skill's files on 2026-10-29. Skills can instruct your agent to run code — read SKILL.md and any scripts before installing.