Metadata-Version: 2.4
Name: agentope
Version: 0.3.1
Summary: Evaluate changes to LLM agent decisions offline, from the traces you already keep. No logprobs.
Keywords: llm,agents,evaluation,off-policy evaluation,counterfactual,opentelemetry
Author: Liminal Planes
Author-email: Liminal Planes <contact@liminalplanes.com>
License-Expression: Apache-2.0
License-File: LICENSE
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3 :: Only
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Programming Language :: Python :: 3.14
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Software Development :: Quality Assurance
Classifier: Typing :: Typed
Requires-Dist: numpy>=2.5.5
Requires-Dist: scipy>=1.18.1
Requires-Dist: httpx>=0.28.1 ; extra == 'llm'
Requires-Dist: pyyaml>=6.0.3 ; extra == 'llm'
Requires-Python: >=3.12
Project-URL: Homepage, https://www.agentope.dev
Project-URL: Documentation, https://www.agentope.dev/docs
Project-URL: Repository, https://github.com/liminalplanes/agentope
Project-URL: Issues, https://github.com/liminalplanes/agentope/issues
Project-URL: Changelog, https://github.com/liminalplanes/agentope/releases
Provides-Extra: llm
Description-Content-Type: text/markdown

# agentope

Offline evaluation of LLM agent decisions, without logprobs.

> Would this agent decision have gone better under a different policy?

agentope estimates how a different policy would have done at one decision point (which tool to call, which model to route to, which prompt variant to use) from logs you already have. Every number comes with its evidence level, diagnostics, a verdict (`ok` / `weak` / `unreliable`) and the assumptions it rests on.

**Documentation:** [www.agentope.dev](https://www.agentope.dev)
