Metadata-Version: 2.4
Name: inspect_harbor
Version: 0.5.1
Summary: Inspect AI interface to Harbor tasks
Project-URL: Source Code, https://github.com/meridianlabs-ai/inspect_harbor
Project-URL: Issue Tracker, https://github.com/meridianlabs-ai/inspect_harbor/issues
Project-URL: Documentation, https://meridianlabs-ai.github.io/inspect_harbor/
Author: Meridian Labs
License: MIT License
License-File: LICENSE
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Requires-Python: >=3.12
Requires-Dist: harbor>=0.6.5
Requires-Dist: inspect-ai>=0.3.201
Requires-Dist: pyyaml
Description-Content-Type: text/markdown

# Inspect Harbor

[Harbor](https://harborframework.com/) is a framework for building, evaluating, and optimizing AI agents in containerized environments. Inspect Harbor provides an interface to run Harbor tasks using [Inspect AI](https://inspect.aisi.org.uk/).

```bash
pip install inspect-harbor
```

Then in Python:

```python
from inspect_ai import eval
from inspect_harbor import aider_polyglot

eval(aider_polyglot(), model="openai/gpt-5-mini")
```

Or load any dataset directly via the generic `harbor()` interface:

```python
from inspect_ai import eval
from inspect_harbor import harbor

eval(
    harbor(package_name="aider/aider-polyglot", package_ref="latest"),
    model="openai/gpt-5-mini",
)
```

For full documentation, see <https://meridianlabs-ai.github.io/inspect_harbor>. The docs site covers installation, the Harbor task model, the default agent scaffold, task parameters, the generic `harbor()` interface (`org/name` and `name@version` datasets, plus local/git tasks), and a complete catalog of available datasets.

See [CHANGELOG.md](CHANGELOG.md) for release notes.

## Development

Clone the repository and install development dependencies:

```bash
git clone https://github.com/meridianlabs-ai/inspect_harbor.git
cd inspect_harbor
make install  # Installs dependencies and sets up pre-commit hooks
```

Run tests and checks:

```bash
make check    # Run linting (ruff check + format) and type checking (pyright)
make test     # Run tests
make cov      # Run tests with coverage report
```

Clean up build artifacts:

```bash
make clean    # Remove cache and build artifacts
```

## Credits

This work is based on contributions by [@iphan](https://github.com/iphan) and [@anthonyduong9](https://github.com/anthonyduong9) from the `inspect_evals` repository:

- [@iphan](https://github.com/iphan)'s [Terminal Bench implementation](https://github.com/UKGovernmentBEIS/inspect_evals/pull/791)
- [@anthonyduong9](https://github.com/anthonyduong9)'s [Harbor task implementation](https://github.com/UKGovernmentBEIS/inspect_evals/pull/945)
