Metadata-Version: 2.4
Name: erictransformer
Version: 0.0.4
Summary: Local fine-tuning, pre-training and inference for LLMs
License: Apache 2.0
Project-URL: Repository, https://github.com/EricFillion/erictransformer
Keywords: transformer,fine-tuning,pretraining,training,AI,LLM,deep-learning,generative-ai
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Description-Content-Type: text/markdown
License-File: LICENSE
Requires-Dist: torch<=2.9.1,>=2.2
Requires-Dist: tqdm>=4.66.3
Requires-Dist: transformers<5.0.0,>=4.57.3
Requires-Dist: huggingface-hub<1.0,>=0.34.0
Requires-Dist: datasets<5.0.0,>=4.0.0
Requires-Dist: sentencepiece
Requires-Dist: protobuf
Requires-Dist: tokenizers<0.23.0,>=0.22.0
Requires-Dist: matplotlib<4.0.0,>=3.9.0
Requires-Dist: numpy<3.0.0,>=2.0.0
Requires-Dist: sentence-transformers<6.0.0,>=5.0.0
Requires-Dist: mlx-lm==0.29.1; platform_system == "Darwin" and platform_machine == "arm64"
Requires-Dist: ericsearch<1.0.0
Dynamic: license-file

<h1 align="center">
  Eric Transformer
</h1>

<p align="center">
  <img src="https://raw.githubusercontent.com/EricFillion/erictransformer/main/logo.png" alt="Eric Search logo" width="200">
</p>

<p align="center">
  <a href="https://opensource.org/licenses/Apache-2.0">
    <img src="https://img.shields.io/badge/License-Apache%202.0-blue.svg" alt="License: Apache-2.0" height="20">
  </a>

</p>

<p align="center">
  <strong><a href="https://ericfillion.github.io/erictransformer/">https://ericfillion.github.io/erictransformer/</a></strong>
</p>


Local pre-training, fine-tuning and inference for LLMs. 

- Format your text data in JSONL and then use a few lines of code to train models. 
- Full-parameter training of GPT-OSS-20b on a single H200.
- Use Apple's new MLX-LM framework for fast inference. Run GPT-OSS-120b locally. 
- Enable RAG powered by [Eric Search](https://github.com/EricFillion/ericsearch).
- Local experiment tracking that displays charts and metrics. 


## Install
```sh
pip install erictransformer
```

[Documentation](https://ericfillion.github.io/erictransformer)

## Maintainers
- [Eric Fillion](https://github.com/ericfillion) Lead Maintainer
- [Ted Brownlow](https://github.com/ted537) Maintainer 


## Contributing 
We are currently not accepting contributions. 
