Metadata-Version: 2.4
Name: haaztest-kitten-inference
Version: 0.2.0
Summary: Kitten TTS inference engines: TTS 0.8 on the CPU, TTS 2 on NVIDIA and AMD GPUs
Project-URL: Homepage, https://github.com/KittenML/kitten-inference
Project-URL: Source, https://github.com/KittenML/kitten-inference
Project-URL: Issues, https://github.com/KittenML/kitten-inference/issues
Author: KittenML
License-Expression: Apache-2.0
License-File: LICENSE
Keywords: kitten-tts,speech,text-to-speech,tts
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3
Classifier: Topic :: Multimedia :: Sound/Audio :: Speech
Requires-Python: >=3.8
Provides-Extra: tts-0-8
Requires-Dist: haaztest-kitten-inference-tts08<0.3,>=0.2.0; extra == 'tts-0-8'
Provides-Extra: tts-2
Requires-Dist: haaztest-kitten-inference-tts2-cu12<0.3,>=0.2.0; extra == 'tts-2'
Requires-Dist: haaztest-kitten-inference-tts2<0.3,>=0.2.0; extra == 'tts-2'
Provides-Extra: tts-2-rocm
Requires-Dist: haaztest-kitten-inference-tts2-rocm<0.3,>=0.2.0; extra == 'tts-2-rocm'
Requires-Dist: haaztest-kitten-inference-tts2<0.3,>=0.2.0; extra == 'tts-2-rocm'
Description-Content-Type: text/markdown

# kitten-inference

Fast inference engines for the Kitten TTS text-to-speech models:

- **Kitten TTS 2 on an NVIDIA GPU:** first streamed audio after about **11 ms**, and complete files **5 to 7 times
  faster** than Kitten TTS 2 on vLLM or llama.cpp (RTX PRO 6000, one request at a time; 2.4 times or more on a 12 GB
  RTX 3060). AMD Radeon RX 7000 and RX 9000 are supported too.
- **Kitten TTS 0.8 on the CPU:** the nano model runs **1.1 to 2.3 times faster** than kittenml 0.9.6 (ONNX Runtime) on
  every machine we tested, and about **60 times faster than real time** on a 12-core desktop CPU.

```sh
python3 -m venv .venv && . .venv/bin/activate   # Windows, in a Command Prompt: py -m venv .venv, then .venv\Scripts\activate.bat
python -m pip install -U pip                    # pip older than 23.3 skips "[tts-0.8]" with only a warning
pip install "kitten-inference[tts-0.8]"         # Kitten TTS 0.8 on the CPU (kitten-inference-tts08)
```

On Ubuntu and Debian, `python3 -m venv` needs `sudo apt-get install -y python3-venv` first.

For Kitten TTS 2, install `"kitten-inference[tts-2]"` instead (NVIDIA, driver R570 or newer: kitten-inference-tts2 +
kitten-inference-tts2-cu12) or `"kitten-inference[tts-2-rocm]"` (AMD Radeon with ROCm 7: kitten-inference-tts2 +
kitten-inference-tts2-rocm; [setup](https://github.com/KittenML/kitten-inference/blob/main/tts-2/docs/amd-radeon.md)). Kitten TTS 2 needs Python 3.9 or newer on Linux x86-64 or Windows x64
(AMD: Linux x86-64, tested inside WSL2).
Other systems have no Kitten TTS 2 engine: pip then stops with "No matching distribution", or installs the old version
0.1.1 of this package instead (`pip show kitten-inference` says which). Extras combine on Linux x86-64 and Windows x64
with Python 3.9 or newer: `"kitten-inference[tts-0.8,tts-2]"`.

- With a pip you cannot upgrade, write the extra as `"kitten-inference[tts-0-8]"`: supported, not optimal, because pip
  22.0.2 to 23.2.1 install no engine for `[tts-0.8]` and still report success.
- Python: `from kitten_inference.tts08 import KittenTTS`, `from kitten_inference.tts2 import KittenTTS2`.
- Version 0.1.x of this package was the TTS 0.8 engine itself (`import model_inference`); code that uses it pins
  `kitten-inference==0.1.1`.

Docs, speed tables and examples: https://github.com/KittenML/kitten-inference

Licenses: this package's code is Apache-2.0. The engine packages that the extras install also contain third-party code
under other licenses, listed in their NOTICE files. The models each engine downloads keep their own licenses. The Kitten TTS 2
model is under the [Stellon Labs Community License](https://huggingface.co/KittenML/kitten-tts-2/blob/main/LICENSE.md),
not Apache or MIT: commercial use needs registration, the license ends once your revenue or funding passes US$1M,
training on or distilling from the outputs is not allowed, and redistribution must include the agreement, a notice
file and "Powered by KittenML". Read it before you build on Kitten TTS 2. The Kitten TTS 0.8 model licenses are in
the [tts-0.8 README](https://github.com/KittenML/kitten-inference/tree/main/tts-0.8#license).
