Metadata-Version: 2.4
Name: arctic_platform
Version: 0.1.1.dev0
Summary: Snowflake LLM training library w/ RL
Project-URL: Homepage, https://github.com/Snowflake-AI-Research/Arctic-Platform
Project-URL: Issues, https://github.com/Snowflake-AI-Research/Arctic-Platform/issues
Author-email: tunji.ruwase@snowflake.com, stas.bekman@snowflake.com, michael.wyatt@snowflake.com, jeff.rasley@snowflake.com, samyam.rajbhandari@snowflake.com
License-Expression: Apache-2.0
License-File: LICENSE
Keywords: llm,rl,training
Classifier: Development Status :: 4 - Beta
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.10
Requires-Dist: datasets
Requires-Dist: deepspeed>=0.18.2
Requires-Dist: devtools
Requires-Dist: jsonlines
Requires-Dist: loguru
Requires-Dist: nvidia-ml-py
Requires-Dist: openai>=1.48.0
Requires-Dist: peft
Requires-Dist: psutil
Requires-Dist: pydantic>=2.10
Requires-Dist: tabulate
Requires-Dist: torch
Requires-Dist: tqdm
Requires-Dist: transformers<5.0.0,>=4.56
Requires-Dist: wandb
Requires-Dist: yq
Provides-Extra: all
Requires-Dist: autoflake; extra == 'all'
Requires-Dist: parameterized; extra == 'all'
Requires-Dist: pre-commit; extra == 'all'
Requires-Dist: pytest; extra == 'all'
Requires-Dist: pytest-instafail; extra == 'all'
Requires-Dist: pytest-xdist; extra == 'all'
Requires-Dist: vllm==0.18.0; extra == 'all'
Provides-Extra: dev
Requires-Dist: autoflake; extra == 'dev'
Requires-Dist: parameterized; extra == 'dev'
Requires-Dist: pre-commit; extra == 'dev'
Requires-Dist: pytest; extra == 'dev'
Requires-Dist: pytest-instafail; extra == 'dev'
Requires-Dist: pytest-xdist; extra == 'dev'
Provides-Extra: docs
Provides-Extra: formatting
Requires-Dist: autoflake; extra == 'formatting'
Requires-Dist: pre-commit; extra == 'formatting'
Provides-Extra: snowflake
Provides-Extra: testing
Requires-Dist: parameterized; extra == 'testing'
Requires-Dist: pytest; extra == 'testing'
Requires-Dist: pytest-instafail; extra == 'testing'
Requires-Dist: pytest-xdist; extra == 'testing'
Provides-Extra: vllm
Requires-Dist: vllm==0.18.0; extra == 'vllm'
Description-Content-Type: text/markdown

[![License Apache 2.0](https://badgen.net/badge/license/apache2.0/blue)](https://github.com/Snowflake-AI-Research/Arctic-Platform/blob/main/LICENSE)
[![PyPI version](https://badge.fury.io/py/arctic-platform.svg)](https://pypi.org/project/arctic-platform/)

<h3 align="center">
  <img src="docs/images/arctic_platform_logo.svg" width=500px><br>
</h3>

# ArcticPlatform: Simplifying and Accelerating Post-Training for LLMs 

ArcticPlatform is a framework designed to simplify and accelerate the post-training process for large language models (LLMs). It addresses challenges in current frameworks, such as limited support for rapid prototyping and the lack of native data generation tools, by offering modular trainer designs, simplified code structures, and integrated pipelines for creating and cleaning synthetic data. These features enable users to enhance LLM capabilities, like code generation and complex reasoning, with greater efficiency and flexibility. Read more about ArcticPlatform [in our blog](https://www.snowflake.com/en/engineering-blog/arcticplatform-llm-post-training-framework/).

This is a work in progress, starting with the RL components, later integrating more training and inference components.

# Quickstart

To get started training a model with ArcticPlatform, follow the steps below:

1. Install the ArcticPlatform package and its dependencies:

```bash
pip install arctic-platform
```

