Metadata-Version: 2.4
Name: warpllm
Version: 0.1.3
Classifier: Programming Language :: Rust
Classifier: Programming Language :: Python :: Implementation :: CPython
Summary: A warp-speed, robust AI gateway
License-Expression: Apache-2.0
Requires-Python: >=3.10
Description-Content-Type: text/markdown; charset=UTF-8; variant=GFM

# warpllm

A warp-speed, robust AI gateway written for rust, node, and python applications - built for planet scale by the community.

[![Join Discord](https://img.shields.io/badge/Discord-Join%20the%20warpllm%20community-5865F2?style=for-the-badge&logo=discord&logoColor=white)](https://discord.gg/tSSQTxFnsC)
[![Reddit](https://img.shields.io/badge/Reddit-r%2Fwarpllm-FF4500?style=for-the-badge&logo=reddit&logoColor=white)](https://www.reddit.com/r/warpllm/)

## Community

> [!IMPORTANT]
> **warpllm is community-led.**
>
> The roadmap, examples, integrations, and rough edges should be shaped in the open by the people building with it. Bring ideas, questions, provider requests, bug reports, benchmarks, and experiments.

## Features

1.  **Provider-agnostic API** - switch between different providers and models without having to learn a new integration.
1.  [Coming Soon] **Failover** - define multiple models to handle outages / errors
1.  [Coming Soon] **Load Balancing** - define a % of requests to be handled per model
1.  [Coming Soon] **You decide** - post in discord or reddit! Drive the future of warpllm.

## Key focus points

1.  **Native SDK support** - Written once in rust, compiled for maximum performance, available for rust/typescript/python.
1.  **Self hostable** - Avoid vendor lock-in (e.g. from the cloud provider), or data leaving your infra.
1.  **Warp-speed execution** - What we named ourselves after. Machine level code, faster than a typescript or python native library.
1.  **Compact file size** - Pre-compiled into binary format, not verbose text files.

## Roadmap

Next up: streaming, more providers and endpoints, and pip/npm packages — then failover, load balancing, caching, and metrics. See the full [ROADMAP.md](https://github.com/warpllm/warpllm/blob/main/ROADMAP.md).

## Quickstart

In progress.

## License

The warpllm core is open source under the [Apache License 2.0](https://github.com/warpllm/warpllm/blob/main/LICENSE).

