Metadata-Version: 2.1
Name: langeval-cli
Version: 0.3.5
Summary: Evaluation for AI apps and agent.
Project-URL: Documentation, https://github.com/ninehills/langeval#readme
Project-URL: Issues, https://github.com/ninehills/langeval/issues
Project-URL: Source, https://github.com/ninehills/langeval
Author-email: Tao Yang <swulling@gmail.com>
License-Expression: MIT
License-File: LICENSE
Classifier: Development Status :: 4 - Beta
Classifier: Programming Language :: Python
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: Implementation :: CPython
Classifier: Programming Language :: Python :: Implementation :: PyPy
Requires-Python: >=3.7
Requires-Dist: click~=8.0
Requires-Dist: func-timeout
Requires-Dist: jieba
Requires-Dist: jinja2
Requires-Dist: nltk
Requires-Dist: numpy~=1.0
Requires-Dist: openai>1.0
Requires-Dist: pandas
Requires-Dist: pydantic
Requires-Dist: pyyaml
Requires-Dist: rich~=13.0
Requires-Dist: rouge-chinese
Requires-Dist: scikit-learn
Requires-Dist: sqlalchemy
Description-Content-Type: text/markdown

# LangEval

Evaluation for AI apps and agent

[![PyPI - Version](https://img.shields.io/pypi/v/langeval-cli.svg)](https://pypi.org/project/langeval-cli)
[![PyPI - Python Version](https://img.shields.io/pypi/pyversions/langeval-cli.svg)](https://pypi.org/project/langeval-cli)

```txt
▄▄▌   ▄▄▄·  ▐ ▄  ▄▄ • ▄▄▄ . ▌ ▐· ▄▄▄· ▄▄▌
██•  ▐█ ▀█ •█▌▐█▐█ ▀ ▪▀▄.▀·▪█·█▌▐█ ▀█ ██•
██▪  ▄█▀▀█ ▐█▐▐▌▄█ ▀█▄▐▀▀▪▄▐█▐█•▄█▀▀█ ██▪
▐█▌▐▌▐█ ▪▐▌██▐█▌▐█▄▪▐█▐█▄▄▌ ███ ▐█ ▪▐▌▐█▌▐▌
.▀▀▀  ▀  ▀ ▀▀ █▪·▀▀▀▀  ▀▀▀ . ▀   ▀  ▀ .▀▀▀
```

-----

## Table of Contents

- [Installation](#installation)
- [Documents](#documents)
- [How to use](#how-to-use)
- [Development](#development)
- [License](#license)

## Installation

```console
pip install langeval-cli
```

## Documents

TODOs:

- Refactor RAG Eval
FileNotFoundError: [Errno 2] No such file or directory:
'output/ac17315_sqlcoder7b2_V4-fix/eval/eval_100_fix.jsonl'

Progress: run=Progress(total=100, finished=100, failed=0) evals={'sqleval': Progress(total=100, finished=85, failed=0)}
[2023-12-13T03:52:04.850620][task-2312131151-8f4e][runner._run] task eval sqleval progress {progress.evals[evaluator.name]}, result: {result}

## How to use

see `./examples` for more details.

## Development

```bash
# Create virtual environment
hatch env create
# Activate virtual environment
hatch shell
# Run test
hatch run test
# Run lint
hatch run lint:style

# Version dump
hatch version patch/minor/major
# Build
hatch build
# Upload to pypi
hatch publish
```

## License

`LangEval` is distributed under the terms of the [MIT](https://spdx.org/licenses/MIT.html) license.
