Metadata-Version: 2.4
Name: culprit
Version: 0.4.1
Summary: Root-cause analysis for a PR or branch: classify feature vs bugfix, find the introducing commit (suspect set) or the blast radius.
Author: Noordeen
License-Expression: MIT
Project-URL: Homepage, https://github.com/noordeen123/culprit
Project-URL: Repository, https://github.com/noordeen123/culprit
Project-URL: Issues, https://github.com/noordeen123/culprit/issues
Keywords: git,rca,root-cause,pull-request,regression,blame
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Topic :: Software Development :: Version Control :: Git
Classifier: Topic :: Software Development :: Quality Assurance
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Operating System :: OS Independent
Classifier: Environment :: Console
Requires-Python: >=3.9
Description-Content-Type: text/markdown
License-File: LICENSE
Provides-Extra: api
Requires-Dist: anthropic>=0.40; extra == "api"
Provides-Extra: mcp
Requires-Dist: mcp<2,>=1.0; python_version >= "3.10" and extra == "mcp"
Provides-Extra: dev
Requires-Dist: pytest>=7; extra == "dev"
Requires-Dist: ruff>=0.4; extra == "dev"
Requires-Dist: yamllint>=1.35; extra == "dev"
Dynamic: license-file

# culprit

<!-- mcp-name: io.github.noordeen123/culprit -->

<p align="center">
  <a href="https://github.com/noordeen123/culprit/actions/workflows/ci.yml"><img src="https://github.com/noordeen123/culprit/actions/workflows/ci.yml/badge.svg" alt="CI"></a>
  <a href="https://pypi.org/project/culprit/"><img src="https://img.shields.io/pypi/v/culprit.svg" alt="PyPI"></a>
  <a href="https://pypi.org/project/culprit/"><img src="https://img.shields.io/pypi/pyversions/culprit.svg" alt="Python versions"></a>
  <a href="LICENSE"><img src="https://img.shields.io/badge/License-MIT-blue.svg" alt="License: MIT"></a>
</p>

<p align="center">
  <b>Root-cause analysis for agent-driven development.</b><br>
  Your coding agent finds what introduced a bug, and verifies its own fix is complete before it commits.
</p>

<p align="center">
  <a href="#quick-start">Quick start</a> ·
  <a href="#the-tools">Tools</a> ·
  <a href="#does-it-actually-work">Accuracy</a> ·
  <a href="docs/ARCHITECTURE.md">Architecture</a> ·
  <a href="https://registry.modelcontextprotocol.io/v0.1/servers?search=io.github.noordeen123/culprit">MCP registry</a>
</p>

<p align="center">
  <img src="docs/demo.gif" width="900" alt="An agent's fix scores partial with two missed call sites, then complete after patching them">
  <br>
  <em>A real run. The fix patched one caller of <code>parse_config</code> and missed two, so it scores <code>partial</code>.</em>
</p>

## Why an agent needs this

An agent can dig through git history to find what broke, and it is good at it. What it
will not reliably do is spend a dozen tool calls on that every time, or stop and check
whether the helper it just changed has three other callers before it commits. culprit
turns both into one deterministic call that returns structured JSON it can act on:

| The agent asks | culprit answers |
|---|---|
| "What introduced this bug?" | Ranked suspect commits, the author's intent, the releases it shipped in |
| "Is my fix complete?" | `verify_fix`: missed call sites, whether a test shipped, a risk level |
| "What could this change break?" | Reverse-import dependents, covering tests, high-risk shared modules |

- ⚡️ **Instant.** No test runs, no bisect. Benchmarked at 41% fewer agent tool calls.
- 🔒 **Read-only and offline.** Never writes to your repo or PR. No API key, no network.
- 🔌 **MCP-native.** 11 tools over stdio, on the official MCP registry, plus a one-command plugin.
- 🗣️ **Language-agnostic.** Suspects work anywhere git does. Blast radius reads 12 language families.

## Does it actually work?

Benchmarked against 50 real regressions, 25 from [git](https://github.com/git/git) and 25 from
[systemd](https://github.com/systemd/systemd), where the introducing commit is known from each
fix's `Fixes:` trailer (author-verified ground truth). Given only the fix commit, culprit blames
the removed lines to rank the commits that introduced the bug.

| Metric | Result |
|---|---|
| Introducing commit ranked #1 | **50%** (25/50) |
| Introducing commit in the top-5 suspect set | **66%** (33/50) |

Deterministic and offline, on large C codebases the engine has never seen. Reproduce with
`python benchmarks/run.py`, which clones the repos and scores every case.

### But an agent can run `git blame` itself

It can, and it is good at it. So the honest question is not whether culprit is accurate,
but whether it beats or helps an agent that has git and no culprit. Same 10 regressions,
three arms, isolated so no arm can read the answer from the fix commit:

| | culprit alone | agent alone | agent + culprit |
|---|---|---|---|
| Introducing commit ranked #1 | 80% | **90%** | **90%** |
| Introducing commit in top 5 | 90% | **100%** | **100%** |
| Mean tool calls to get there | 1 | 14.9 | **8.8** (-41%) |
| Mean tokens to get there | ~0 | 55,534 | **47,616** (-14%) |

**The agent wins on accuracy, and culprit does not make it more accurate. What culprit
does is get it there in roughly half the steps for about 8,000 fewer tokens per
investigation.** Tool calls dropped in 10 of 10 cases, tokens in 7 of 10. On the hardest
case the agent needed 42 tool calls and 124k tokens alone, against 16 calls and 84k with
culprit.

Those savings are already net of reading culprit's output, which is counted in the third
column. culprit's own run is one deterministic call, no model, under a second.

So culprit is an accelerator for an agent, not a replacement for one, and not a smarter
blamer than one. Method, caveats (n=10, and this slice is easier than the full 50), and
reproduction: [`benchmarks/agent/`](benchmarks/agent/).

## Quick start

**Claude Code plugin** (installs the MCP server plus a skill that tells the agent when to use it):

```bash
/plugin marketplace add noordeen123/culprit
/plugin install culprit@culprit
```

**Any MCP client** (Cursor, Windsurf, VS Code, Codex CLI, Zed, Continue, Cline, Amazon Q, Goose):

```json
{
  "mcpServers": {
    "culprit": {
      "command": "uvx",
      "args": ["--from", "culprit[mcp]", "culprit-mcp"]
    }
  }
}
```

**CLI**, no agent required:

```bash
uvx culprit                     # run from PyPI on demand
rca --verify-fix patch.diff     # exit 0 if complete, 1 otherwise
```

Needs Python 3.10+ and [uv](https://docs.astral.sh/uv/) for the MCP server. The CLI runs on 3.9+.

## The tools

| Tool | What it answers |
|---|---|
| `analyze` | Full RCA in one call: classify, suspects or blast radius, risk, test impact |
| `verify_fix` | Is this diff safe to commit? `complete` / `partial` / `risky`, plus the missed call sites |
| `find_suspects` | Rank the commits that introduced the bug |
| `check_completeness` | Call sites of the changed symbol the fix did not touch |
| `get_intent` | The introducing commit's message, linked PR, referenced issues |
| `get_evolution` | Per-commit history of the buggy lines via `git log -L` |
| `get_risk_score` | QA gate score (0 to 100, low/medium/high) with contributing factors |
| `get_blast_radius` | Feature impact: dependents, covering tests, high-risk files |
| `get_test_impact` | Minimal test set to run for this change |
| `classify_change` | Bugfix vs feature, with evidence |
| `from_trace` | RCA straight from a stack trace, no diff or PR needed |

## verify_fix, the pre-commit gate

The agent runs this on its own diff before committing:

- **`verdict`**: `complete` when no untouched call site is left behind, `partial` when one was
  missed, `risky` when risk is high. The verdict is the completeness axis; test coverage is
  the separate confidence axis on `risk_level`.
- **`untouched_references`**: the exact files that still use the changed symbol. This is the
  list the agent goes and patches.
- **`skipped_symbols`**, **`adds_test`**, **`notes`**: what was too widely used to check, whether
  a test shipped, and what to do next.

Loop until `complete`, then commit. That is the whole idea.

## CLI and CI

```bash
rca                            # current branch vs the configured base
rca --last                     # the latest commit only
rca --pr 16786                 # a specific PR (uses the PR's own base)
rca --trace crash.txt          # RCA from a stack trace, no fix or PR needed
rca --verify-fix patch.diff    # check a diff before committing
rca --select-tests             # print the tests to run for this change
rca --html report.html --open  # a single self-contained HTML report
rca --pr 16889 --fail-on high  # exit non-zero when QA risk is high
rca serve --repo /path         # local web UI with a base picker
```

**CI gate**: risk via exit code only, no PR comments, no writes. Copy
[`examples/github-actions/culprit-pr.yml`](examples/github-actions/culprit-pr.yml) into
`.github/workflows/`:

```yaml
- run: pip install "culprit>=0.3.0"
- env: { GH_TOKEN: "${{ github.token }}" }
  run: rca --pr ${{ github.event.pull_request.number }} --fail-on high
```

## HTML report

`--html` writes one self-contained file. No CDN, opens offline, attaches to CI. It opens with the
verdict: a scored QA risk with the factors behind it, and the prime suspect with how long the bug
lived.

<p align="center">
  <img src="docs/report-verdict.png" width="820" alt="QA risk scored medium 48 out of 100 with contributing factors, and the prime suspect commit with the releases it shipped in">
</p>

Then it reconstructs how the bug got there. Every commit that touched the buggy line, from
creation through the commit that broke it (red, with the exact diff) to the fix (green):

<p align="center">
  <img src="docs/report-timeline.png" width="820" alt="Line evolution timeline: origin, three modifications, the breaking commit changing w times h to w plus h, then the fix restoring it">
</p>

<p align="center"><em>Every node expands to its diff. <a href="docs/report.png">See the full report</a>.</em></p>

## vs `git bisect`

| | `git bisect` | culprit |
|---|---|---|
| Input | A reliable failing test | The fix diff (or a stack trace) |
| Method | Checks out commits and runs the test | Blames the fix's lines plus `git log -L` |
| Speed | Minutes (about log2(N) test runs) | Instant |
| Output | First bad commit | Suspect set, intent, lifecycle, completeness, risk |
| Confidence | Proof | Strong heuristic |

`--bisect "<cmd>"` runs a real bisect as an optional confirmation layer, in a throwaway
`git worktree` so your checkout is never touched. When the first failing commit matches the
blamed suspect, the report stamps it **confirmed by git bisect**.

## Architecture

One normalized context in, one structured JSON result out. The only non-deterministic step
is the optional LLM narrative, isolated behind an adapter so the engine runs with no API key.

<p align="center">
  <picture>
    <source media="(prefers-color-scheme: dark)" srcset="docs/workflow-dark.svg">
    <img src="docs/workflow-light.svg" width="980" alt="Two pipelines. Root cause: input, pr_context, classify, suspect, risk score, output. Verify: proposed diff, verify_fix, verdict.">
  </picture>
</p>

Two lanes, one engine. Every module writes one slice of the result, so nothing cares whether
the target came from `gh`, the REST API, local git, or a pasted stack trace. Full module map:
[`docs/ARCHITECTURE.md`](docs/ARCHITECTURE.md).

## Configuration

The base branch resolves in order: the `--base` flag, then `CULPRIT_BASE`, then `.culprit.toml`
(`base = "origin/main"`), then `HEAD~1`. `--last` forces the latest-commit view.

PR titles and labels use the GitHub CLI when present, or the unauthenticated REST API for public
repos (set `GITHUB_TOKEN` or `GITLAB_TOKEN` to raise limits). Deep links cover GitHub, GitLab,
Bitbucket, and Gitea. Blast radius reads imports across JS/TS, Python, Go, Java/Kotlin, Ruby,
C/C++, C#, PHP, Rust, Scala, and Swift.

## Contributing

```bash
pip install -e ".[dev]" && pytest
```

Module map and data shapes: [`docs/ARCHITECTURE.md`](docs/ARCHITECTURE.md). Publishing the MCP
server to the registries: [`docs/PUBLISHING.md`](docs/PUBLISHING.md). MIT licensed.

<p align="center">
  <a href="https://glama.ai/mcp/servers/noordeen123/culprit">
    <img src="https://glama.ai/mcp/servers/noordeen123/culprit/badges/card.svg" alt="culprit MCP server">
  </a>
</p>
