Metadata-Version: 2.5
Name: seamark
Version: 0.1.0
Summary: The Seamark CLI: run Harbor evals in the Seamark cloud and follow them from the terminal.
Project-URL: Homepage, https://seamark.cloud
License: Proprietary
Keywords: agents,benchmarks,cli,evals,harbor
Classifier: Environment :: Console
Classifier: Intended Audience :: Developers
Classifier: License :: Other/Proprietary License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.13
Requires-Python: >=3.13
Requires-Dist: httpx>=0.28
Requires-Dist: pydantic-settings>=2.10
Requires-Dist: rich>=14
Requires-Dist: typer>=0.21
Provides-Extra: harbor
Requires-Dist: harbor>=0.23; extra == 'harbor'
Description-Content-Type: text/markdown

# seamark

The command line for [Seamark](https://seamark.cloud): run
[Harbor](https://github.com/harbor-framework/harbor) evaluation tasks in the
cloud and follow them from a terminal or a coding agent. `seamark run`
replaces `harbor run`: tasks are uploaded once, trials are queued and run in
Seamark's cloud, and logs, trajectories, results, QA verdicts and costs come
back through `seamark status`, `logs`, `pull`, `summary` and `qa`.

## Install

```bash
uv tool install seamark      # or: pipx install seamark
```

Datasets from the Harbor registry (`seamark run -d NAME@VERSION`,
`seamark ls datasets`) need Harbor's registry client:

```bash
uv tool install 'seamark[harbor]'
```

Python 3.13 or newer; `uv tool install` fetches it when needed.

## Sign in

Create an API key at https://seamark.cloud/settings/keys, then:

```bash
seamark login        # paste the key; it is checked and saved (readable only by you)
seamark whoami       # the organization, scope and server the key acts on
```

`SEAMARK_API_KEY` and `SEAMARK_API_URL` in the environment win over the
saved key and the default server. In scripts, pipe the key in
(`printf %s "$KEY" | seamark login`) or set `SEAMARK_API_KEY`.

## Use

```bash
seamark checks ./my-task                           # the upload checks, run locally
seamark run ./my-task -a codex -m openai/gpt-6-sol # upload and queue a trial
seamark status                                     # progress of your experiments
seamark logs TRIAL_ID                              # a trial's logs
seamark qa TRIAL_ID                                # did the agent earn its reward?
seamark pull TRIAL_ID                              # its artifacts
seamark skill install                              # teach a coding agent to drive seamark
```

Every command takes `--help`, and `--json` for scripts.
