Metadata-Version: 2.4
Name: verifiers
Version: 0.1.15.dev439
Summary: Verifiers: Environments for LLM Reinforcement Learning
Project-URL: Homepage, https://github.com/primeintellect-ai/verifiers
Project-URL: Documentation, https://github.com/primeintellect-ai/verifiers
Project-URL: Repository, https://github.com/primeintellect-ai/verifiers.git
Project-URL: Issues, https://github.com/primeintellect-ai/verifiers/issues
Author-email: William Brown <williambrown97@gmail.com>
License-Expression: MIT
License-File: LICENSE
Keywords: agentic-rl,agents,environments,eval,grpo,harness,llm,multi-turn,reinforcement-learning,rl,rlvr,tool-use,train,verifiers
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Software Development :: Libraries :: Python Modules
Requires-Python: <3.14,>=3.11
Requires-Dist: aiohttp>=3.9.0
Requires-Dist: aiolimiter>=1.2.1
Requires-Dist: anthropic>=0.78.0
Requires-Dist: datasets<4.7.0,>=3.0.0
Requires-Dist: gepa
Requires-Dist: httpx>=0.27.0
Requires-Dist: loguru>=0.7.0
Requires-Dist: math-verify>=0.8.0
Requires-Dist: mcp>=1.14.1
Requires-Dist: msgpack>=1.1.2
Requires-Dist: numpy
Requires-Dist: openai-agents>=0.0.7
Requires-Dist: openai>=1.108.1
Requires-Dist: prime-pydantic-config[toml]>=0.3.0.dev86
Requires-Dist: prime-sandboxes>=0.2.27
Requires-Dist: prime-tunnel>=0.1.8
Requires-Dist: pydantic>=2.11.9
Requires-Dist: pyzmq>=27.1.0
Requires-Dist: renderers>=0.1.8.dev40
Requires-Dist: requests
Requires-Dist: rich
Requires-Dist: setproctitle>=1.3.0
Requires-Dist: tenacity>=8.5.0
Requires-Dist: tomli-w>=1.0.0
Requires-Dist: typing-extensions; python_version < '3.12'
Requires-Dist: uvloop>=0.21.0; sys_platform != 'win32' and sys_platform != 'cygwin' and platform_python_implementation != 'PyPy'
Provides-Extra: browser
Requires-Dist: aiohttp>=3.9.0; extra == 'browser'
Requires-Dist: python-dotenv>=1.0.0; extra == 'browser'
Requires-Dist: stagehand>=3.0.0; extra == 'browser'
Provides-Extra: harbor
Requires-Dist: harbor==0.14.0; (python_version >= '3.12') and extra == 'harbor'
Provides-Extra: modal
Requires-Dist: modal>=1.4.0; extra == 'modal'
Provides-Extra: notebook
Requires-Dist: nest-asyncio>=1.6.0; extra == 'notebook'
Provides-Extra: quest
Requires-Dist: certifi; extra == 'quest'
Requires-Dist: pillow; extra == 'quest'
Requires-Dist: pymupdf; extra == 'quest'
Provides-Extra: rg
Requires-Dist: reasoning-gym; extra == 'rg'
Provides-Extra: rl
Requires-Dist: accelerate>=1.4.0; extra == 'rl'
Requires-Dist: deepspeed>=0.17.6; extra == 'rl'
Requires-Dist: flash-attn>=2.8.3; extra == 'rl'
Requires-Dist: liger-kernel>=0.5.10; extra == 'rl'
Requires-Dist: peft; extra == 'rl'
Requires-Dist: requests; extra == 'rl'
Requires-Dist: torch<2.9.0,>=2.8.0; extra == 'rl'
Requires-Dist: transformers>=4.56.2; extra == 'rl'
Requires-Dist: vllm<0.11.0,>=0.10.0; extra == 'rl'
Requires-Dist: wandb; extra == 'rl'
Provides-Extra: ta
Requires-Dist: nltk>=3.9.2; extra == 'ta'
Requires-Dist: textarena==0.7.4; extra == 'ta'
Description-Content-Type: text/markdown

<p align="center">
  <picture>
    <source media="(prefers-color-scheme: light)" srcset="https://github.com/user-attachments/assets/40c36e38-c5bd-4c5a-9cb3-f7b902cd155d">
    <source media="(prefers-color-scheme: dark)" srcset="https://github.com/user-attachments/assets/6414bc9b-126b-41ca-9307-9e982430cde8">
    <img alt="Prime Intellect" src="https://github.com/user-attachments/assets/6414bc9b-126b-41ca-9307-9e982430cde8" width="312" style="max-width: 100%;">
  </picture>
</p>

---

# Overview

verifiers is our library for creating environments to train and evaluate LLMs.

verifiers is tightly integrated with the [Environments Hub](https://app.primeintellect.ai/dashboard/environments?ex_sort=most_stars), as well as our training framework [prime-rl](https://github.com/PrimeIntellect-ai/prime-rl) and our [Hosted Training](https://app.primeintellect.ai/dashboard/training) platform.

## Installation

We recommend installing the [Prime CLI](https://github.com/PrimeIntellect-ai/prime) to interact with the environments.

```bash
# install uv
curl -LsSf https://astral.sh/uv/install.sh | sh
# install the prime CLI
uv tool install prime
```

## Further reading

- The [docs](docs/) contain short, human-written guides and overviews about the architecture.
- The [AGENTS.md](AGENTS.md) and [skills](skills/) are for coding agents and go into more details.


## Citation

Originally created by Will Brown ([@willccbb](https://github.com/willccbb)).

```bibtex
@misc{brown_verifiers_2025,
  author       = {William Brown},
  title        = {{Verifiers}: Environments for LLM Reinforcement Learning},
  howpublished = {\url{https://github.com/PrimeIntellect-ai/verifiers}},
  year         = {2025}
}
```
