Metadata-Version: 2.4
Name: nti-benchmark
Version: 0.1.1
Summary: Verifiable security benchmark for AI agent frameworks
Author-email: Abisheak P <abisheakp197@gmail.com>
License: Apache-2.0
Project-URL: Homepage, https://github.com/abisheakp197/nti-benchmark
Project-URL: Repository, https://github.com/abisheakp197/nti-benchmark
Project-URL: Issues, https://github.com/abisheakp197/nti-benchmark/issues
Keywords: ai,security,benchmark,post-quantum,nti,agents
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Developers
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Topic :: Security
Requires-Python: >=3.11
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: nti-attack-library>=0.1.0
Requires-Dist: ube-foundation>=0.1.0
Requires-Dist: click>=8.1.0
Requires-Dist: rich>=13.0.0
Requires-Dist: httpx>=0.27.0
Provides-Extra: dev
Requires-Dist: pytest>=8.0.0; extra == "dev"
Requires-Dist: pytest-xdist>=3.5.0; extra == "dev"
Requires-Dist: pytest-random-order>=1.1.0; extra == "dev"
Requires-Dist: build>=1.0.0; extra == "dev"
Requires-Dist: twine>=5.0.0; extra == "dev"
Dynamic: license-file

# NTI Benchmark


**Verifiable security benchmark for AI agent frameworks.**


[![License: Apache 2.0](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)


## What It Does


Runs the full NTI Attack Library against four leading AI agent frameworks — LangChain, CrewAI, AutoGen, and Microsoft Agent Framework — with and without NTI protection. Produces a signed, offline-verifiable report.


## Results Shape


    NTI Benchmark Results
    ┌─────────────────────────────┬───────────┬───────────┬───────┐
    │ Framework                   │ Bare      │ With NTI  │ Delta │
    ├─────────────────────────────┼───────────┼───────────┼───────┤
    │ LangChain                   │ 32/100    │ 98/100    │ +66   │
    │ CrewAI                      │ 28/100    │ 97/100    │ +69   │
    │ AutoGen                     │ 30/100    │ 98/100    │ +68   │
    │ Microsoft Agent Framework   │ 31/100    │ 98/100    │ +67   │
    └─────────────────────────────┴───────────┴───────────┴───────┘


## Why It Matters


Every framework claims to be secure. This benchmark proves or disproves it. Every result is signed and verifiable offline by anyone.


## Install


    pip install nti-benchmark


## Run


    nti-benchmark run


Output written to results/ with a Dilithium5 signature.


## Verify Any Report Offline


    nti-benchmark verify ./results/benchmark-2026-01-15T10-00-00.json


No network. No servers. Just math.


## Submit a Framework


See docs/SUBMITTING.md.


## License


Apache License 2.0. See LICENSE.


## Links


- NTI-1 Spec: https://abisheakp197.github.io/nti-spec/
- nti-attack: https://pypi.org/project/nti-attack/
- nti-scanner: https://pypi.org/project/nti-scanner/
- nti-badge: https://nti-badge-svs1.vercel.app
