Metadata-Version: 2.4
Name: tagnos
Version: 0.1.0a3
Summary: AI-native, multi-judge evaluation and annotation. Your experts, amplified.
Project-URL: Homepage, https://tagnos.app
Project-URL: Documentation, https://tagnos.app/docs
Project-URL: Repository, https://github.com/tagnos/tagnos
Project-URL: Issues, https://github.com/tagnos/tagnos/issues
Author: Tagnos contributors
License: Apache-2.0
License-File: LICENSE
Keywords: ai,ai-native,annotation,copilotkit,eval,evaluation,litellm,llm,multi-judge,rlhf
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Information Technology
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Software Development :: Libraries
Requires-Python: >=3.12
Requires-Dist: aiosqlite>=0.20
Requires-Dist: alembic>=1.13
Requires-Dist: asyncpg>=0.30
Requires-Dist: cryptography>=43
Requires-Dist: fastapi>=0.115
Requires-Dist: httpx>=0.27
Requires-Dist: litellm[proxy]>=1.55
Requires-Dist: pydantic-settings>=2.5
Requires-Dist: pydantic>=2.9
Requires-Dist: python-multipart>=0.0.9
Requires-Dist: pyyaml>=6
Requires-Dist: rich>=13
Requires-Dist: sqlalchemy[asyncio]>=2.0.36
Requires-Dist: structlog>=24
Requires-Dist: typer>=0.13
Requires-Dist: uvicorn[standard]>=0.32
Provides-Extra: dev
Requires-Dist: build>=1; extra == 'dev'
Requires-Dist: httpx>=0.27; extra == 'dev'
Requires-Dist: mypy>=1.13; extra == 'dev'
Requires-Dist: pip-licenses>=5; extra == 'dev'
Requires-Dist: pytest-asyncio>=0.24; extra == 'dev'
Requires-Dist: pytest-cov>=5; extra == 'dev'
Requires-Dist: pytest>=8; extra == 'dev'
Requires-Dist: ruff>=0.8; extra == 'dev'
Requires-Dist: twine>=5; extra == 'dev'
Requires-Dist: types-pyyaml; extra == 'dev'
Description-Content-Type: text/markdown

# Tagnos

> **AI-native annotation and evaluation where your expertise scales.**

Structure your AI evaluation. Capture your experts' judgment. Bring your own LLMs.

Tagnos is the first **AI-native** annotation and evaluation platform — every action is triggerable by chat, every screen has a context-aware Copilot, and your experts' corrections compound into an AI that speaks with their voice. Built for teams who need traceable, structured AI quality — from solo founders to regulated enterprises.

**Powered by [CopilotKit](https://copilotkit.ai)** · **LLM-agnostic via [LiteLLM](https://litellm.ai)** · **Apache 2.0**

---

## Why Tagnos is different

| | Feature | What it means |
|---|---|---|
| 🤖 | **AI-Native from day 1** | Every screen ships with a context-aware Copilot (powered by CopilotKit). Every action is triggerable by natural language. No menu hunting. |
| 🧑‍⚖️ | **Multi-judge consensus** | 3 LLMs evaluate each item. When they agree, auto-accept. When they disagree, a human arbitrates. No more single-judge blind spots. |
| 🧠 | **Expert-Amplifier** | Every expert correction is captured into a Knowledge Base that becomes an AI assistant. Junior teammates consult your senior's judgment — even when the senior is offline. |
| 📄🤖 | **Document + Trace paradigm** | Evaluate legal contracts, medical cases, or AI agent traces in the same tool, with the same collaborative workflow. |
| 🔌 | **Bring Your Own LLMs** | Built-in LiteLLM proxy. Configure OpenAI, Anthropic, Gemini, Mistral, or your own Ollama/vLLM — in the UI, no code. |
| 🇪🇺 | **EU-native, self-host-ready** | GDPR by design. Fully air-gapped deployment supported. |

---

## Quick start

```bash
pip install tagnos
tagnos serve
```

Opens `http://localhost:8080` with demo data. Configure your LLM providers in **Settings → LLM Providers** and start annotating.

Prefer Docker?

```bash
docker run -p 8080:8080 tagnos/tagnos
```

---

## Who uses Tagnos

- **Legal teams** review contracts with AI-assisted clause detection and risk scoring
- **Healthcare clinics** annotate cases for medical AI training, preserving doctor judgment
- **AI product teams** evaluate agent traces, catch hallucinations missed by single-judge eval
- **Solo AI builders** get structured eval without hiring a data science team

---

## Comparison

| Feature | Tagnos | LangSmith | Phoenix | Label Studio |
|---|---|---|---|---|
| AI-Native (chat-triggerable actions) | ✅ CopilotKit | ❌ | ❌ | ❌ |
| Multi-judge eval (3 LLMs) | ✅ | ❌ | ❌ | ❌ |
| Expert-Amplifier (AI trained on corrections) | ✅ | ❌ | ❌ | ❌ |
| Document + Trace in one tool | ✅ | Traces only | Traces only | Docs only |
| Bring Your Own LLMs | ✅ | ❌ cloud only | ✅ | ❌ |
| Self-host free | ✅ | ❌ | ✅ | ✅ |
| EU-native option | ✅ | ❌ | ⚠ | ✅ |

---

## The 5 things Tagnos stands for

1. Your AI learns at the speed of your judgment — not your dev backlog.
2. Your knowledge shouldn't disappear into a spreadsheet.
3. Three LLMs give a second opinion — even when you're alone.
4. The next teammate inherits your reasoning, not a CSV.
5. Every decision today works for tomorrow — without effort.

---

## Documentation

- [Quickstart](./docs/quickstart.md)
- [LLM Providers (BYO-LLM setup)](./docs/litellm-config.md)
- [Multi-judge explained](./docs/multi-judge.md)
- [Architecture](./ARCHITECTURE.md)
- [Roadmap](./PLAN.md)

## Community

- [GitHub Discussions](https://github.com/tagnos/tagnos/discussions)
- [Discord](https://discord.gg/tagnos) *(coming soon)*

## License

[Apache 2.0](./LICENSE). Commercial use, modification, and distribution permitted.

## Contributing

See [CONTRIBUTING.md](./CONTRIBUTING.md). PRs welcome, especially integrations and plugin examples.
