Metadata-Version: 2.1
Name: langeval-cli
Version: 0.1.2
Summary: Evaluation for AI apps and agent.
Project-URL: Documentation, https://github.com/ninehills/langeval#readme
Project-URL: Issues, https://github.com/ninehills/langeval/issues
Project-URL: Source, https://github.com/ninehills/langeval
Author-email: Tao Yang <swulling@gmail.com>
License-Expression: MIT
License-File: LICENSE
Classifier: Development Status :: 4 - Beta
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: Implementation :: CPython
Classifier: Programming Language :: Python :: Implementation :: PyPy
Requires-Python: >=3.7
Requires-Dist: click~=8.0
Requires-Dist: jinja2
Requires-Dist: numpy~=1.26
Requires-Dist: pandas
Requires-Dist: pydantic<2
Requires-Dist: pyyaml
Requires-Dist: rich~=13.6
Description-Content-Type: text/markdown

# LangEval

Evaluation for AI apps and agent

[![PyPI - Version](https://img.shields.io/pypi/v/langeval-cli.svg)](https://pypi.org/project/langeval-cli)
[![PyPI - Python Version](https://img.shields.io/pypi/pyversions/langeval-cli.svg)](https://pypi.org/project/langeval-cli)

```txt
▄▄▌   ▄▄▄·  ▐ ▄  ▄▄ • ▄▄▄ . ▌ ▐· ▄▄▄· ▄▄▌
██•  ▐█ ▀█ •█▌▐█▐█ ▀ ▪▀▄.▀·▪█·█▌▐█ ▀█ ██•
██▪  ▄█▀▀█ ▐█▐▐▌▄█ ▀█▄▐▀▀▪▄▐█▐█•▄█▀▀█ ██▪
▐█▌▐▌▐█ ▪▐▌██▐█▌▐█▄▪▐█▐█▄▄▌ ███ ▐█ ▪▐▌▐█▌▐▌
.▀▀▀  ▀  ▀ ▀▀ █▪·▀▀▀▀  ▀▀▀ . ▀   ▀  ▀ .▀▀▀
```

-----

## Table of Contents

- [Installation](#installation)
- [Documents](#documents)
- [How to use](#how-to-use)
- [Development](#development)
- [License](#license)

## Installation

```console
pip install langeval-cli
```

## Documents

TODO

## How to use

see `./examples` for more details.

## Development

```bash
# Create virtual environment
hatch env create
# Activate virtual environment
hatch shell
# Run test
hatch run test
# Run lint
hatch run lint:style

# Version dump
hatch version patch/minor/major
# Build
hatch build
# Upload to pypi
hatch publish
```

## License

`LangEval` is distributed under the terms of the [MIT](https://spdx.org/licenses/MIT.html) license.

## TODO

- more eval metrics
- support openai function
- docs
- test
- multi-eval
- run retry
- rerun failed task
- refactor task run for lib call