Metadata-Version: 2.4
Name: mistralrs
Version: 0.8.16
Classifier: Programming Language :: Rust
Classifier: Programming Language :: Python :: Implementation :: CPython
Classifier: Programming Language :: Python :: Implementation :: PyPy
Classifier: License :: OSI Approved :: MIT License
Classifier: Programming Language :: Python :: 3.10
Summary: Fast, flexible LLM inference.
Keywords: llm,inference,machine-learning,ai,transformers
Home-Page: https://github.com/EricLBuehler/mistral.rs
Author: Eric Buehler
License: MIT
Requires-Python: >=3.10
Description-Content-Type: text/markdown; charset=UTF-8; variant=GFM
Project-URL: Source Code, https://github.com/EricLBuehler/mistral.rs

# mistralrs Python SDK

`mistralrs` is the Python SDK for [mistral.rs](https://github.com/EricLBuehler/mistral.rs), a blazing-fast LLM inference engine.

## Documentation

For full documentation, see:
- [Python SDK Documentation](https://ericlbuehler.github.io/mistral.rs/tutorials/03-python-sdk/)
- [Installation Guide](https://ericlbuehler.github.io/mistral.rs/guides/install/)

## Quick Install

```bash
pip install mistralrs        # CPU, or Metal on Apple Silicon
```

NVIDIA CUDA wheels ship as GitHub release assets because they vary by CUDA toolkit level
(`cuda128`, `cuda129`, `cuda131`) and GPU compute capability. See the Python SDK
installation guide for the `--find-links` command.

