Metadata-Version: 2.4
Name: vlabs-sdk
Version: 0.0.2
Summary: SDK contracts and clean promotion-gate CLI for Verifiable Labs: run modes, model-provider interface, typed schemas, and a property-tested formal-spec mirror.
Project-URL: Homepage, https://verifiable-labs.com
Project-URL: Repository, https://github.com/verifiablelabs/vlabs-sdk
Project-URL: Issues, https://github.com/verifiablelabs/vlabs-sdk/issues
Author-email: Stelios Zacharioudakis <sdi2200243@di.uoa.gr>
License-Expression: Apache-2.0
License-File: LICENSE
Keywords: ai-agents,contamination-resistant,evaluation,formal-specification,generalization,promotion-gate,verifiable-labs
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Software Development :: Quality Assurance
Classifier: Typing :: Typed
Requires-Python: >=3.11
Requires-Dist: typer>=0.12
Provides-Extra: dev
Requires-Dist: build>=1.2; extra == 'dev'
Requires-Dist: hypothesis>=6.100; extra == 'dev'
Requires-Dist: pytest>=8; extra == 'dev'
Requires-Dist: ruff>=0.6; extra == 'dev'
Description-Content-Type: text/markdown

# vlabs-sdk

> Verifiable Labs builds clean feedback and promotion gates for increasingly general AI agents.

SDK contracts for the Verifiable Labs platform: run configuration, the
model-provider interface, and the typed schemas that evaluation contracts,
score sets, gate outcomes, and assurance cards are built from.

- **pip package:** `vlabs-sdk`
- **import package:** `vlabs_sdk`
- **CLI:** `vlabs` (clean promotion gate)

## Install

```bash
pip install vlabs-sdk        # once published; until then:
pip install "vlabs-sdk @ git+https://github.com/verifiablelabs/vlabs-sdk@main"
```

```python
from vlabs_sdk.providers.dummy_provider import DummyProvider
from vlabs_sdk.providers.base import ModelRequest
from vlabs_sdk.schemas import AssuranceCardV2, ScoreSet, TransferMetrics
from vlabs_sdk.run_config import default_config
from vlabs_sdk.formal_spec.clean_promotion_gate import accept_clean_update
```

Migrating from the legacy `verifiable-labs-envs` package? See
[MIGRATION.md](MIGRATION.md).

## clean-gate CLI

The `vlabs` CLI ships **with** the `vlabs-sdk` distribution — no extra
install:

```bash
pip install vlabs-sdk
vlabs --help
vlabs clean-gate --old baseline.json --new candidate.json
# exit 0 = ACCEPT, exit 1 = REJECT (reasons printed)
```

The CLI is implemented in the bundled `vlabs_prm_eval` package (depends
only on `vlabs_sdk` + `typer`); both import packages are included in the
wheel.

## What ships here

| Surface | Path |
|---|---|
| Run config — modes `evaluate_only` / `gate_only` / `improve_and_gate` / `substrate`, privacy-preserving defaults | `src/vlabs_sdk/run_config.py` |
| Provider interface + dummy provider (`validate_config` / `estimate_cost` / `run` / `dry_run`) | `src/vlabs_sdk/providers/` |
| Schemas — EvaluationContract, ScoreSet, TransferMetrics, GateOutcome, AssuranceCard v2, split policy | `src/vlabs_sdk/schemas/` |
| Formal-spec math mirror (clean score, CleanVGS, generalization gap, 8-condition promotion gate) | `src/vlabs_sdk/formal_spec/` |
| `vlabs clean-gate` CLI (ACCEPT exit 0 / REJECT exit 1) | `tools/vlabs-prm-eval/` |

This repository is a mirror of the canonical monorepo with the import
namespace remapped (see [PROVENANCE.md](PROVENANCE.md)); it becomes
canonical at split-flip time.

## Formal scope

Selected mathematical properties behind the contamination-resistant
promotion gate are machine-verified in Lean 4. The implementation is
property-tested against the formal specification.

## License

Apache-2.0.
