Metadata-Version: 2.4
Name: llamator
Version: 3.5.0
Summary: Framework for testing vulnerabilities of GenAI systems.
Home-page: https://github.com/LLAMATOR-Core/llamator
Author: Roman Neronov, Timur Nizamov, Nikita Ivanov
License: Attribution 4.0 International
Project-URL: Documentation, https://llamator-core.github.io/llamator
Classifier: Development Status :: 5 - Production/Stable
Classifier: Environment :: Console
Classifier: Intended Audience :: Science/Research
Classifier: License :: Other/Proprietary License
Classifier: Natural Language :: English
Classifier: Operating System :: OS Independent
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Classifier: Topic :: Scientific/Engineering :: Information Analysis
Classifier: Topic :: Security
Classifier: Topic :: Software Development :: Testing
Requires-Python: >=3.9
Description-Content-Type: text/markdown
License-File: LICENSE.md
Requires-Dist: python-dotenv>=0.5.1
Requires-Dist: httpx==0.27.2
Requires-Dist: openai==1.68.2
Requires-Dist: langchain==0.3.21
Requires-Dist: langchain-community==0.3.20
Requires-Dist: langchain-core==0.3.49
Requires-Dist: tqdm==4.66.3
Requires-Dist: colorama==0.4.6
Requires-Dist: prettytable==3.10.0
Requires-Dist: pandas==2.2.2
Requires-Dist: inquirer==3.2.4
Requires-Dist: prompt-toolkit==3.0.43
Requires-Dist: openpyxl==3.1.5
Requires-Dist: python-docx==1.1.2
Requires-Dist: datetime==5.5
Requires-Dist: pyarrow==19.0.1
Requires-Dist: pymupdf==1.25.5
Requires-Dist: pillow==11.1.0
Requires-Dist: huggingface_hub==0.30.1
Requires-Dist: datasets==3.5.0
Requires-Dist: GitPython==3.1.44
Dynamic: license-file

# ![LLAMATOR](assets/LLAMATOR.svg)

Red Teaming python-framework for testing chatbots and GenAI systems

[![License: CC BY-NC-SA 4.0](https://img.shields.io/badge/License-CC_BY--NC--SA_4.0-lightgrey.svg)](https://creativecommons.org/licenses/by-nc-sa/4.0/)
[![PyPI - Python Version](https://img.shields.io/pypi/pyversions/llamator)](https://pypi.org/project/llamator)
[![PyPI](https://badge.fury.io/py/llamator.svg)](https://badge.fury.io/py/llamator)
[![Docker](https://img.shields.io/badge/dockerfile-gray.svg?logo=docker)](https://github.com/LLAMATOR-Core/llamator/blob/release/docker)
[![Downloads](https://pepy.tech/badge/llamator)](https://pepy.tech/project/llamator)
[![Downloads](https://pepy.tech/badge/llamator/month)](https://pepy.tech/project/llamator)
[![GitHub Repo stars](https://img.shields.io/github/stars/LLAMATOR-Core/llamator)](https://github.com/LLAMATOR-Core/llamator/stargazers)
[![Chat](https://img.shields.io/badge/chat-gray.svg?logo=telegram)](https://t.me/llamator)

## Install 🚀

```bash
pip install llamator==3.5.0
```

## Documentation 📚

Documentation Link: [https://LLAMATOR-Core.github.io/llamator](https://LLAMATOR-Core.github.io/llamator/)

## Guides ▶️

* [LLM Red Teaming with LLAMATOR](https://www.youtube.com/watch?v=JGTZMJsgZJU)
* [LLAMATOR: Quick Start Guide](https://www.youtube.com/watch?v=MMez57DsO1k)

## Examples 💡

* 📄 [RAG bot testing via REST API](https://github.com/LLAMATOR-Core/llamator/blob/release/examples/llamator-api.ipynb)
* 🧙‍♂️ [Gandalf web bot testing via Selenium](https://github.com/LLAMATOR-Core/llamator/blob/release/examples/llamator-selenium.ipynb)
* 💬 [Telegram bot testing via Telethon](https://github.com/LLAMATOR-Core/llamator/blob/release/examples/llamator-telegram.ipynb)
* 📱 [WhatsApp bot testing via Selenium](https://github.com/LLAMATOR-Core/llamator/blob/release/examples/llamator-whatsapp.ipynb)
* 🔗 [LangChain client testing with custom attack](https://github.com/LLAMATOR-Core/llamator/blob/release/examples/llamator-langchain-custom-attack.ipynb)
* 📷 [Vision Model testing via LangChain](https://github.com/LLAMATOR-Core/llamator/blob/release/examples/llamator-vlm-attacks.ipynb)
* 🐋 [Running LLAMATOR in Docker](https://github.com/LLAMATOR-Core/llamator/blob/release/docker)


## Supported Clients 🛠️

* 🌐 All LangChain clients
* 🧠 OpenAI-like API
* ⚙️ Custom Class (Telegram, WhatsApp, Selenium, etc.)

## Unique Features 🌟

* ️🗡 Support for custom attacks and datasets from the user
* 👜 Large selection of attacks on LLMs, RAGs, Agents, VLMs in English and Russian
* 🛡 Custom configuration of chat clients
* 📊 History of attack requests and responses in Excel and CSV format
* 📄 Test report document in DOCX format

## OWASP Classification 🔒

* 💉 [LLM01: Prompt Injection and Jailbreaks](https://genai.owasp.org/llmrisk/llm01-prompt-injection/)
* 🕵️‍♀️ [LLM07: System Prompt Leakage](https://genai.owasp.org/llmrisk/llm072025-system-prompt-leakage/)
* 🤥 [LLM09: Misinformation](https://genai.owasp.org/llmrisk/llm092025-misinformation/)
* 💸 [LLM10: Unbounded Consumption](https://genai.owasp.org/llmrisk/llm102025-unbounded-consumption/)

## Community 🌍

* 💬 Telegram Chat — [LLAMATOR | AI Red Team Community](https://t.me/llamator)
* 🖤 Supported by [AI Talent Hub and ITMO University](https://ai.itmo.ru)

## Contacts 📬

✉️ **Email**: [team@llamator.org](mailto:team@llamator.org)

## Enterprise Version 🏢

⚡️<span style="color:#FFC107;"><em>Coming Soon</em></span>⚡️

## License 📜

© Roman Neronov, Timur Nizamov, Nikita Ivanov

This project is licensed under the terms of the **Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International** license. See the [LICENSE](LICENSE) file for details.

[![Creative Commons License](https://i.creativecommons.org/l/by-nc-sa/4.0/88x31.png)](https://creativecommons.org/licenses/by-nc-sa/4.0/)
