Metadata-Version: 2.4
Name: metaxy
Version: 0.0.1.dev2
Summary: Add your description here
Author-email: Daniel Gafni <danielgafni16@gmail.com>
License-File: LICENSE
Requires-Python: >=3.10
Requires-Dist: cyclopts
Requires-Dist: narwhals>=2.9.0
Requires-Dist: platformdirs>=4.5.0
Requires-Dist: polars-hash>=0.5.1
Requires-Dist: polars>=1.33.1
Requires-Dist: pydantic-settings>=2.11.0
Requires-Dist: pydantic>=2.11.9
Requires-Dist: pyyaml>=6.0.0
Requires-Dist: rich>=13.0.0
Requires-Dist: sqlglot>=27.29.0
Requires-Dist: tomli>=2.3.0
Provides-Extra: bigquery
Requires-Dist: ibis-framework[bigquery]>=11.0.0; extra == 'bigquery'
Provides-Extra: clickhouse
Requires-Dist: ibis-framework[clickhouse]>=11.0.0; extra == 'clickhouse'
Provides-Extra: dagster
Requires-Dist: dagster>=1.12.3; extra == 'dagster'
Provides-Extra: delta
Requires-Dist: deltalake>=1.2.1; extra == 'delta'
Provides-Extra: duckdb
Requires-Dist: duckdb>=1.4.1; extra == 'duckdb'
Requires-Dist: ibis-framework[duckdb]>=11.0.0; extra == 'duckdb'
Provides-Extra: graphviz
Requires-Dist: pygraphviz>=1.14; extra == 'graphviz'
Provides-Extra: ibis
Requires-Dist: ibis-framework>=11.0.0; extra == 'ibis'
Requires-Dist: pyarrow>=18.0.0; extra == 'ibis'
Provides-Extra: lancedb
Requires-Dist: lancedb>=0.15.0; extra == 'lancedb'
Provides-Extra: mermaid
Requires-Dist: mermaid-py>=0.8.0; extra == 'mermaid'
Provides-Extra: sqlmodel
Requires-Dist: sqlmodel>=0.0.27; extra == 'sqlmodel'
Description-Content-Type: text/markdown

<p align="center">
  <img src="https://raw.githubusercontent.com/anam-org/metaxy/main/docs/assets/metaxy.svg" alt="Metaxy Logo" width="100"/>
</p>

<h1 align="center">Metaxy</h1>

<p align="center">
  <a href="https://pypi.org/project/metaxy/"><img src="https://img.shields.io/pypi/v/metaxy.svg?color=4644ad" alt="PyPI version"></a>
  <a href="https://pypi.org/project/metaxy/"><img src="https://img.shields.io/pypi/pyversions/metaxy.svg?color=4644ad" alt="Python versions"></a>
  <a href="https://pypi.org/project/metaxy/"><img src="https://img.shields.io/pypi/dm/metaxy.svg?color=4644ad" alt="PyPI downloads"></a>
  <a href="https://github.com/anam-org/metaxy/actions/workflows/QA.yml"><img src="https://github.com/anam-org/metaxy/actions/workflows/QA.yml/badge.svg" alt="CI"></a>
  <a href="https://docs.astral.sh/ruff/"><img src="https://img.shields.io/badge/linting-ruff-4644ad" alt="Ruff"></a>
  <a href="https://docs.basedpyright.com"><img src="https://img.shields.io/badge/basedpyright-checked-4644ad" alt="basedpyright - checked"></a>
  <a href="https://prek.j178.dev"><img src="https://img.shields.io/endpoint?url=https://raw.githubusercontent.com/j178/prek/master/assets/badge/v0.json" alt="prek"></a>
</p>

Metaxy is a metadata layer for **multi-modal Data and ML pipelines**. Metaxy tracks feature versions, (partial) data dependencies, and lineage across complex computation graphs.

Metaxy's goal is to provide a standard instrument for any kind of multi-modal (or just tabular) **incremental** pipelines, standardizing dependency specification, versioning, partial data dependencies, manipulations over metadata, migrations, and more.

Read the [docs](https://anam-org.github.io/metaxy) to learn more.

## Installation

**Warning**: Metaxy hasn't been publicly released yet, but you can try the latest dev release:

```shell
pip install --pre metaxy
```

## Integrating Metaxy in your project

Metaxy is highly pluggable and generally can be used with any kind of incremental pipelines, storage, metadata stores, and dataframe libraries.

Metaxy provides integrations with popular tools such as [Dagster](https://anam-org.github.io/metaxy/main/integrations/orchestration/dagster), [ClickHouse](https://anam-org.github.io/metaxy/main/integrations/metadata-stores/databases/clickhouse), [DeltaLake](https://anam-org.github.io/metaxy/main/integrations/metadata-stores/storage/delta/), [SQLModel](https://anam-org.github.io/metaxy/main/integrations/plugins/sqlmodel/).

The full list can be found [here](https://anam-org.github.io/metaxy/main/integrations).

## Contributing

See [CONTRIBUTING.md](CONTRIBUTING.md).

## Examples

See [examples](https://github.com/anam-org/metaxy/tree/main/examples).

<img referrerpolicy="no-referrer" src="https://static.scarf.sh/a.png?x-pxid=22cb75dc-201e-4a72-9fb2-c3a53ce9207e&page=README.md" />
