Metadata-Version: 2.4
Name: prompt-rubric-drift
Version: 0.1.7
Summary: Detect deterministic prompt and rubric drift and produce pull request review reports.
Author-email: AuraOne <opensource@auraone.ai>
License-Expression: MIT
Project-URL: Homepage, https://github.com/auraoneai/prompt-rubric-drift
Project-URL: Documentation, https://github.com/auraoneai/prompt-rubric-drift#readme
Project-URL: Repository, https://github.com/auraoneai/prompt-rubric-drift.git
Project-URL: Issues, https://github.com/auraoneai/prompt-rubric-drift/issues
Project-URL: Changelog, https://github.com/auraoneai/prompt-rubric-drift/blob/main/CHANGELOG.md
Keywords: prompt-engineering,rubric,drift-detection,llm-evaluation,evals,github-action
Classifier: Development Status :: 3 - Alpha
Classifier: Environment :: Console
Classifier: Intended Audience :: Developers
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Software Development :: Quality Assurance
Classifier: Topic :: Software Development :: Version Control
Requires-Python: >=3.10
Description-Content-Type: text/markdown
License-File: LICENSE
Dynamic: license-file

# prompt-rubric-drift

Compare prompt and rubric directories and produce deterministic pull request review notes.

`prompt-rubric-drift` is for prompt owners, evaluation engineers, and reviewers who need a repeatable first pass over scoring-contract changes. Its differentiator is an offline, deterministic review of both prompt and rubric files, using local text, JSON, and regex heuristics to flag stricter or looser wording, prompt-injection exposure, missing examples, judge-contract terms, weight changes, and added or removed criteria without calling a model.

## Inspectable Output

- Markdown: finding count, severity/category/path rows, and suggested review questions.
- JSON: `ok`, `finding_count`, and the complete structured finding list.
- GitHub Action: the Markdown report file, job summary content, and an optional marker-matched pull request comment.

## Runtime Boundary

The Python CLI reads only the two local directories and makes no network requests or model calls. The composite GitHub Action installs the package from the checked-out action path, writes to `GITHUB_STEP_SUMMARY`, and uses `actions/github-script` to list, create, or update pull request comments when `comment: "true"`.

Prompt scanning covers `.txt`, `.md`, and `.prompt`; rubric scanning covers `.json`, `.yaml`, `.yml`, and `.md`. The comparison walks the `after` tree, so a file deleted entirely from `after` is not reported as a file deletion.

## Install

Python package:

```bash
python -m pip install prompt-rubric-drift==0.1.7
```

GitHub Action:

```yaml
permissions:
  contents: read
  pull-requests: write

steps:
  - uses: actions/checkout@v4
  - uses: auraoneai/prompt-rubric-drift@v0.1.7
    with:
      before: prompts/base
      after: prompts/head
      output: prompt-rubric-drift.md
      comment: "true"
```

Both directories must already exist in the checked-out workspace.

## Quickstart

```bash
prompt-rubric-drift compare examples/before examples/after --out drift-report.md
prompt-rubric-drift compare examples/before examples/after --format json --out drift-report.json
```

## Release Status

Registry status verified July 13, 2026:

- Python package `0.1.7` is published on PyPI.
- The installed CLI supports both Markdown and JSON output.
- The latest public GitHub Action tag is `v0.1.7`.
- No moving `v1` tag or npm package is claimed.

The project is alpha software. No safety, compliance, or adoption claim is made.

## Limits

Findings are deterministic heuristics, not semantic proof. The tool does not approve prompt changes, detect all file deletions, run an LLM judge, or guarantee that a prompt or rubric is safe.

## Next Action

Use the installed CLI or `v0.1.7` Action, then review high-severity findings with the rubric owner before gating pull requests.
