Metadata-Version: 2.3
Name: architxt
Version: 0.1.0
Summary: ArchiTXT is a tool for structuring textual data into a valid database model. It is guided by a meta-grammar and uses an iterative process of tree rewriting.
Author: Nicolas Hiot
Author-email: nicolas.hiot@univ-orleans.fr
Requires-Python: >=3.10,<3.13
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Provides-Extra: all
Provides-Extra: ui
Requires-Dist: aiostream (>=0.6.4,<0.7.0)
Requires-Dist: antlr4-python3-runtime (>=4.13,<5)
Requires-Dist: apted (>=1.0.3,<2.0.0)
Requires-Dist: cachetools (>=5.5.0,<6.0.0)
Requires-Dist: googletrans (>=4.0.2,<5.0.0)
Requires-Dist: levenshtein
Requires-Dist: mlflow (>=2.6.0,<3.0.0)
Requires-Dist: more-itertools
Requires-Dist: nltk (>=3.9,<4.0)
Requires-Dist: numpy (>=1.16,<2.0)
Requires-Dist: psutil (>=7.0.0,<8.0.0)
Requires-Dist: pybrat (>=0.1.7,<0.2.0)
Requires-Dist: rich (>=13.9.4,<14.0.0)
Requires-Dist: scispacy (>=0.5.5,<0.6.0)
Requires-Dist: spacy-alignments (>=0.9.1,<0.10.0)
Requires-Dist: streamlit (>=1.39.0) ; extra == "ui" or extra == "all"
Requires-Dist: streamlit-agraph ; extra == "ui" or extra == "all"
Requires-Dist: streamlit-tags ; extra == "ui" or extra == "all"
Requires-Dist: tqdm (>=4.60)
Requires-Dist: typer (>=0.15.1,<0.16.0)
Requires-Dist: unidecode
Description-Content-Type: text/markdown

# ArchiTXT: Text-to-Database Structuring Tool

![PyPI - Python Version](https://img.shields.io/pypi/pyversions/architxt)
![GitHub Actions Workflow Status](https://img.shields.io/github/actions/workflow/status/neplex/architxt/python-build.yml)

**ArchiTXT** is a robust tool designed to convert unstructured textual data into structured formats that are ready for
database storage. It automates the generation of database schemas and creates corresponding data instances, simplifying
the integration of text-based information into database systems.

Working with unstructured text can be challenging when you need to store and query it in a structured database.
**ArchiTXT** bridges this gap by transforming raw text into organized, query-friendly structures. By automating both
schema generation and data instance creation, it streamlines the entire process of managing textual information in
databases.

## Installation

To install **ArchiTXT**, make sure you have Python 3.10+ and pip installed. Then, run:

```sh
pip install architxt
```

For the development version, you can install it directly through GIT using

```sh
pip install git+https://github.com/Neplex/ArchiTXT.git
```

## Usage

**ArchiTXT** is built to work seamlessly with BRAT-annotated corpora that includes pre-labeled named entities.
It also requires access to a CoreNLP server, which you can set up using the Docker configuration available in
the source repository.

```sh
$ architxt --help

 Usage: architxt [OPTIONS] COMMAND [ARGS]...

 ArchiTXT is a tool for structuring textual data into a valid database model.
 It is guided by a meta-grammar and uses an iterative process of tree rewriting.

╭─ Options ──────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ --install-completion          Install completion for the current shell.                                        │
│ --show-completion             Show completion for the current shell, to copy it or customize the installation. │
│ --help                        Show this message and exit.                                                      │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─ Commands ─────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ run   Extract a database schema form a corpus.                                                                 │
│ ui    Launch the web-based UI.                                                                                 │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
```

```sh
$ architxt run --help

 Usage: architxt run [OPTIONS] CORPUS_PATH

 Extract a database schema form a corpus.

╭─ Arguments ────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ *    corpus_path      PATH  Path to the input corpus. [default: None] [required]                               │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
╭─ Options ──────────────────────────────────────────────────────────────────────────────────────────────────────╮
│ --tau                            FLOAT    The similarity threshold. [default: 0.7]                             │
│ --epoch                          INTEGER  Number of iteration for tree rewriting. [default: 100]               │
│ --min-support                    INTEGER  Minimum support for tree patterns. [default: 20]                     │
│ --corenlp-url                    TEXT     URL of the CoreNLP server. [default: http://localhost:9000]          │
│ --gen-instances                  INTEGER  Number of synthetic instances to generate. [default: 0]              │
│ --language                       TEXT     Language of the input corpus. [default: French]                      │
│ --debug            --no-debug             Enable debug mode for more verbose output. [default: no-debug]       │
│ --help                                    Show this message and exit.                                          │
╰────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
```

To deploy the CoreNLP server using the source repository, you can use Docker Compose with the following command:

```sh
docker compose up -d
```

## Development

### Setting Up the Development Environment with Poetry

To set up the development environment using Poetry, ensure that you have Poetry installed.
You can install it by following the [official installation instructions](https://python-poetry.org/docs/#installation).
Once installed, you can set up the development environment by running the following command:

```sh
poetry install
```

### Enabling Pre-Commit Hook

This project uses `pre-commit` for managing Git hooks.
It should already be installed by poetry as a dev dependency.
To enable the pre-commit hooks locally, run the following command:

```sh
poetry run pre-commit install
```

Once set up, the pre-commit hooks will automatically run every time you make a commit, ensuring code standards are
followed.

### Meta-Grammar

In **ArchiTXT**, ANTLR (Another Tool for Language Recognition) is used to generate a parser/lexer
for the meta-grammar that verify the database schema's validity.
It ensures that the database schema conforms to the expected structure and semantics.

You can view the meta-grammar definition in the [`metagrammar.g4`](metagrammar.g4) file.

To regenerate the parser/lexer for the meta-grammar, run the following command:

```sh
$ poetry run antlr4 -Dlanguage=Python3 metagrammar.g4 -o architxt/grammar
```

