Skip to content

Audit a pytest suite

Measure whether your pytest tests catch bugs, and find flaky, slow or bloated ones, report-only.

Stars
49,023
Licence
MIT
Files
1 file

What it does

When installed, the agent can run a pinned measurement tool against a Python project's pytest suite. It checks whether the tests would notice deliberately broken code (mutants), which tests are slow, flaky or order-dependent, and whether any tests look removable. It then writes a report and explains the findings, but it does not edit or delete tests itself.

Great for

  • Python developers who want to know whether their test suite really catches bugs
  • Teams trying to speed up slow CI test runs without losing detection
  • Maintainers investigating intermittent or order-dependent test failures

Skip it if

  • Non-Python projects, since it targets pytest specifically
  • People wanting the agent to automatically rewrite or delete tests; the skill is report-only by design
  • Very large repositories, where a deep audit may exceed the default 30-minute budget

Try asking

  • “Audit my pytest suite and tell me which tests are flaky or slow”
  • “Run a quick audit of this project and show me surviving mutants”
  • “Check whether any of my tests are redundant using a deep audit”
  • “Find order-dependent tests in my pytest suite”
Step-by-step guide: how to use Audit a pytest suiteInstall, first run, examples, tips and FAQs

Install in 3 steps

  1. 1

    Download the skill

    The ZIP contains the 1 original files, the MIT licence and an attribution note.

    agentic-test-audit.zip
  2. 2

    Add it to your agent

    Claude Code (all projects)

    mkdir -p ~/.claude/skills && unzip agentic-test-audit.zip -d ~/.claude/skills/

    Claude Code / Agent SDK (this project only)

    mkdir -p .claude/skills && unzip agentic-test-audit.zip -d .claude/skills/

    Claude apps (web/desktop): Settings → Capabilities → Skills → Upload skill, and choose the ZIP.

  3. 3

    Ask for the task

    No special command needed — the agent reads the skill's description and loads it when your request matches. Try one of the prompts above.

Get better results

  • Add .test-suite-audit/ to .gitignore before running, since the runner writes its output there
  • Treat surviving mutants and removal candidates as leads to verify, not proven bugs or safe deletions
  • Ask for a prune-check on any removal set before acting on it

What's inside

  • SKILL.md

Redistributed unmodified from sickn33/agentic-awesome-skills under the MIT licence. The assessment was drafted with AI from the skill's files on 2026-10-29. Skills can instruct your agent to run code — read SKILL.md and any scripts before installing.