Metadata-Version: 2.5
Name: eio-agents
Version: 0.6.0rc1
Summary: Reference library for the Evaluation Intelligence Ontology (EIO) and PER 2.0 evaluation records for AI agents: convert, validate, verify, explain.
Project-URL: Homepage, https://www.proofagent.ai/eio-agents/schema/
Project-URL: Repository, https://github.com/ProofAgent-ai/eio-agents
Project-URL: Documentation, https://github.com/ProofAgent-ai/eio-agents/tree/main/docs
Project-URL: Issues, https://github.com/ProofAgent-ai/eio-agents/issues
Project-URL: Changelog, https://github.com/ProofAgent-ai/eio-agents/blob/main/CHANGELOG.md
Project-URL: Security, https://github.com/ProofAgent-ai/eio-agents/security/policy
Author-email: ProofAI LLC <support@proofagent.ai>
Maintainer-email: ProofAgent <support@proofagent.ai>
License-Expression: Apache-2.0
License-File: LICENSE
License-File: NOTICE
Keywords: agent-evaluation,ai-agents,evaluation-record,evidence,json-ld,json-schema,ontology,reproducibility,rfc8785,verification
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3 :: Only
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Programming Language :: Python :: 3.14
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Software Development :: Quality Assurance
Classifier: Topic :: Software Development :: Testing
Classifier: Typing :: Typed
Requires-Python: >=3.10
Requires-Dist: jsonschema<5,>=4.20
Requires-Dist: pyyaml<7,>=6.0
Provides-Extra: build
Requires-Dist: build>=1.2; extra == 'build'
Requires-Dist: twine>=6.1; extra == 'build'
Provides-Extra: dev
Requires-Dist: build>=1.2; extra == 'dev'
Requires-Dist: pre-commit>=4; extra == 'dev'
Requires-Dist: pytest>=7; extra == 'dev'
Requires-Dist: ruff==0.16.9; extra == 'dev'
Requires-Dist: twine>=6.1; extra == 'dev'
Provides-Extra: lint
Requires-Dist: ruff==0.16.9; extra == 'lint'
Provides-Extra: test
Requires-Dist: pytest>=7; extra == 'test'
Description-Content-Type: text/markdown

# EIO-Agents

[![Evaluation stack: agent infrastructure, evaluation framework, EIO-Agents semantic layer, and Portable Evaluation Record](docs/eio-agents-stack.svg)](https://www.proofagent.ai/eio-agents/schema/)

**The framework-agnostic semantic layer for AI-agent evaluation.** EIO-Agents uses the Evaluation Intelligence Ontology (EIO) to turn an evaluator's observations into evidence-linked claims and a versioned Portable Evaluation Record (PER). It also validates, verifies, and explains that record.

[Explore EIO and its schemas](https://www.proofagent.ai/eio-agents/schema/) · [See a PER example](https://www.proofagent.ai/eio-agents/per) · [Read the quick start](docs/quickstart.md)

## From evaluation to evidence

| You provide | EIO-Agents produces | You can check |
|---|---|---|
| A native evaluation bundle with observed turns, sources, and decisions | A PER with cited claims, findings, measured or withheld scores, provenance, and a content digest | Schema and semantic validity, source consistency, and a human-readable explanation |

ProofAgent Harness is one possible evaluation producer; EIO-Agents does not require it. The raw bundle remains local. Review a PER before sharing it, because permitted redacted excerpts and metadata can still be sensitive.

## Try the synthetic example

From this repository root, with Python 3.10 or newer:

```bash
python3 -m venv .venv
.venv/bin/pip install -e .
.venv/bin/eio-agents project tests/data/native/v0_6/source-complete.bundle.json \
  -o native.per.json --jcs native.per.jcs
.venv/bin/eio-agents validate native.per.json
.venv/bin/eio-agents verify native.per.json \
  --bundle tests/data/native/v0_6/source-complete.bundle.json
.venv/bin/eio-agents explain native.per.json --list
.venv/bin/eio-agents explain native.per.json readiness
```

The last command prints this explanation from the included **synthetic** bundle:

```text
Readiness: 42.0448/100 (recorded). Raw weighted score: 42.0448/100.
```

Use a target from `explain --list` to inspect one finding or score, then `eio-agents evidence native.per.json <finding-id>` to locate its cited evidence. `verify --bundle` re-derives the PER and checks its digest against the local source; it does **not** prove the original evaluation or an agent is safe. The sample's score is not a production sign-off.

## Versions and limits

- **Package:** `0.6.0rc1` · **ontology:** EIO `0.6.0` · **source-complete record:** PER `2.0.0`. The reference scoring profile is `0.3.1-draft.1`; missing inputs leave affected values **WITHHELD**, never guessed. Older partial records retain their own historical versions.
- **Open format:** PER 2.0.0 uses [JSON Schema Draft 2020-12](https://www.proofagent.ai/eio-agents/schema/per/2.0.0/per.schema.json) and EIO publishes a JSON-LD context. It is a versioned ProofAgent specification, **not** a W3C- or ISO-ratified standard or a compliance certification.
- **Framework mappings:** provisional evidence-relevance links, not legal or regulatory compliance determinations. Historical ProofAgent report conversion requires the matching adapter and pinned EIO release.

For local-text privacy boundaries, CLI targets, and your own bundle, see [the quick start](docs/quickstart.md). For the complete record structure and dashboard-style example, see [the PER guide](https://www.proofagent.ai/eio-agents/per).

## Develop and contribute

```bash
.venv/bin/pip install -e '.[test]'
.venv/bin/python -m pytest -q tests
.venv/bin/python tools/eio_gates.py
```

Maintained by **ProofAI LLC** under the ProofAgent brand. Code, ontology data, and schemas are [Apache-2.0 licensed](LICENSE); see [NOTICE](NOTICE), [contribution guidelines](CONTRIBUTING.md), and [security policy](SECURITY.md). Support and private security reports: [support@proofagent.ai](mailto:support@proofagent.ai).
