Metadata-Version: 2.4
Name: datanyx
Version: 0.2.0
Summary: Turn sensitive data into a value-free schema that AI agents can work from.
License-Expression: MIT
Project-URL: Homepage, https://github.com/lud3nb3rg/DataNyx
Project-URL: Documentation, https://lud3nb3rg.github.io/DataNyx/
Project-URL: Source, https://github.com/lud3nb3rg/DataNyx
Project-URL: Changelog, https://github.com/lud3nb3rg/DataNyx/blob/main/CHANGELOG.md
Project-URL: Issues, https://github.com/lud3nb3rg/DataNyx/issues
Keywords: ai-agents,privacy,schema,anonymization,data
Classifier: Development Status :: 3 - Alpha
Classifier: Environment :: Console
Classifier: Intended Audience :: Developers
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Topic :: Security
Classifier: Topic :: Software Development :: Libraries
Requires-Python: >=3.10
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: sqlalchemy>=2
Requires-Dist: tomli>=2; python_version < "3.11"
Provides-Extra: postgres
Requires-Dist: psycopg[binary]>=3.1; extra == "postgres"
Provides-Extra: mysql
Requires-Dist: pymysql>=1.1; extra == "mysql"
Requires-Dist: cryptography; extra == "mysql"
Provides-Extra: mssql
Requires-Dist: pymssql>=2.3; extra == "mssql"
Provides-Extra: oracle
Requires-Dist: oracledb>=2; extra == "oracle"
Provides-Extra: parquet
Requires-Dist: pyarrow>=14; extra == "parquet"
Provides-Extra: excel
Requires-Dist: openpyxl>=3.1; extra == "excel"
Provides-Extra: yaml
Requires-Dist: pyyaml>=6; extra == "yaml"
Provides-Extra: streaming
Requires-Dist: ijson>=3.2; extra == "streaming"
Provides-Extra: mcp
Requires-Dist: mcp>=1.2; extra == "mcp"
Provides-Extra: avro
Requires-Dist: fastavro>=1.9; extra == "avro"
Provides-Extra: orc
Requires-Dist: pyarrow>=14; extra == "orc"
Provides-Extra: duckdb
Requires-Dist: duckdb>=1.0; extra == "duckdb"
Provides-Extra: stats
Requires-Dist: pyreadstat>=1.2; (sys_platform != "win32" or python_version >= "3.11") and extra == "stats"
Provides-Extra: mongodb
Requires-Dist: pymongo>=4.6; extra == "mongodb"
Provides-Extra: ddl
Requires-Dist: sqlglot>=25; extra == "ddl"
Provides-Extra: bigquery
Requires-Dist: sqlalchemy-bigquery>=1.9; extra == "bigquery"
Provides-Extra: snowflake
Requires-Dist: snowflake-sqlalchemy>=1.5; extra == "snowflake"
Provides-Extra: zstd
Requires-Dist: zstandard>=0.22; extra == "zstd"
Provides-Extra: remote
Requires-Dist: fsspec>=2024.2; extra == "remote"
Requires-Dist: aiohttp>=3.9; extra == "remote"
Provides-Extra: s3
Requires-Dist: fsspec>=2024.2; extra == "s3"
Requires-Dist: s3fs>=2024.2; extra == "s3"
Provides-Extra: gcs
Requires-Dist: fsspec>=2024.2; extra == "gcs"
Requires-Dist: gcsfs>=2024.2; extra == "gcs"
Provides-Extra: azure
Requires-Dist: fsspec>=2024.2; extra == "azure"
Requires-Dist: adlfs>=2024.2; extra == "azure"
Provides-Extra: all
Requires-Dist: datanyx[avro,azure,bigquery,check,ddl,duckdb,excel,gcs,mcp,mongodb,mssql,mysql,oracle,orc,parquet,pdf,postgres,presidio,remote,s3,snowflake,stats,streaming,yaml,zstd]; extra == "all"
Provides-Extra: text
Requires-Dist: spacy>=3.7; extra == "text"
Provides-Extra: check
Requires-Dist: sqlglot>=25; extra == "check"
Provides-Extra: pdf
Requires-Dist: pypdf>=4; extra == "pdf"
Provides-Extra: presidio
Requires-Dist: presidio-analyzer>=2.2; extra == "presidio"
Dynamic: license-file

<div align="center">

# DataNyx

**Let an AI agent work with your data without ever seeing it.**

DataNyx turns files and databases into value-free schemas an agent can write code against,
and replaces names and identifiers in free text with placeholders.

[![License: MIT](https://img.shields.io/badge/license-MIT-blue.svg)](LICENSE)
[![Python 3.10+](https://img.shields.io/badge/python-3.10%2B-3776ab.svg)](pyproject.toml)
[![Code style: ruff](https://img.shields.io/badge/lint-ruff-261230.svg)](https://docs.astral.sh/ruff/)
[![Types: mypy](https://img.shields.io/badge/types-mypy-2a6db2.svg)](https://mypy-lang.org/)

[Getting started](docs/getting-started.md) ·
[Documentation](docs/index.md) ·
[Command reference](docs/cli-reference.md) ·
[Privacy model](docs/privacy-model.md) ·
[Website](https://lud3nb3rg.github.io/DataNyx/) ·
[Changelog](CHANGELOG.md)

</div>

---

You want an agent to write a report, a query or a data-cleaning script, but the data is customers,
patients or payroll. Pasting rows into a chat is a leak, and describing the columns by hand is
tedious. DataNyx sits in between:

|  | What the agent gets | What it never gets |
|---|---|---|
| **Structured data**<br>`datanyx schema` | Field names, types, formats, nesting, primary and foreign keys | Values, examples, enum labels, counts or statistics |
| **Free text**<br>`datanyx anonymize` | The text with `<PERSON_1>`, `<EMAIL_1>` and friends in place of identifiers | The identifiers themselves (best effort: [review the result](docs/anonymization.md#how-reliable-text-anonymization-is)) |

## A first look

```console
$ datanyx schema customers.csv --format text
root: array<{
  id: integer
  email: string<email>
  signed_up: string<date>
  plan: string
  lifetime_value: number
  notes: string | null
}>

$ datanyx anonymize call-notes.txt
<PERSON_1> (<EMAIL_1>) called on <DATE_1> about invoice
<ID_1>. Ms. <PERSON_1> lives in <LOCATION_1>. Her manager <PERSON_2> agreed.
```

The agent sees the shape of the table and the story in the text, and none of the values. It can also
try its code on [fake rows](docs/synthetic-data.md) generated from the schema.

## Install

```sh
git clone <this repository> datanyx && cd datanyx
uv sync --all-extras                 # or: pip install -e ".[all]"
datanyx doctor                       # shows which optional packages and models are installed
```

Python 3.10 or newer. [Supported sources](docs/sources.md) lists the extra for each format.

## What's in the documentation

| | |
|---|---|
| [Getting started](docs/getting-started.md) | Install, a first schema, a first anonymized text |
| [Schemas](docs/schemas.md), [synthetic data](docs/synthetic-data.md) | The core: what the agent sees instead of the data |
| [Debugging](docs/debugging.md), [checking code](docs/checking-code.md) | Fixing code without seeing the data |
| [Scanning](docs/scanning.md), [anonymization](docs/anonymization.md), [pseudonymization](docs/pseudonymization.md), [detection quality](docs/detection.md) | Finding and hiding personal data |
| [Using it with an agent](docs/agents.md) | `datanyx protect`, the guard hook and the MCP server |
| [Installing and deploying](docs/deployment.md) | PyPI, Docker, a pre-commit hook, a GitHub Action, a shared MCP server |
| [Team settings](docs/settings.md), [schema diff](docs/schema-diff.md) | Shared policy, and change detection for CI |
| [Privacy model](docs/privacy-model.md) | What is guaranteed, what isn't, and the known limits |
| [Command reference](docs/cli-reference.md), [Python API](docs/python-api.md) | Every option, and use from code |
| [Contributing](docs/contributing.md) | Architecture, adding a source, tests |

To read it as a site: `uv sync --group docs` then `uv run mkdocs serve`.

## License

[MIT](LICENSE) © 2026 ludenberg
