Metadata-Version: 2.1
Name: modifier
Version: 0.0.2
Summary: CAMEL: Context-Aware Modifier for Efficient Language model
Home-page: https://github.com/CSWellesSun/CAMEL
License: Apache-2.0
Author: Welles Sun
Author-email: welles.sun@zju.edu.cn
Requires-Python: >=3.9,<4.0
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Dist: accelerate (>=0.30.1,<0.31.0)
Requires-Dist: datasets (>=2.19.1,<3.0.0)
Requires-Dist: fastchat (>=0.1.0,<0.2.0)
Requires-Dist: pytest (>=8.2.0,<9.0.0)
Requires-Dist: ray (>=2.23.0,<3.0.0)
Requires-Dist: sentencepiece (>=0.2.0,<0.3.0)
Requires-Dist: shortuuid (>=1.0.13,<2.0.0)
Requires-Dist: torch (>=2.3.0,<3.0.0)
Requires-Dist: transformers (>=4.41.0,<5.0.0)
Requires-Dist: wandb (>=0.17.0,<0.18.0)
Project-URL: Repository, https://github.com/CSWellesSun/CAMEL
Description-Content-Type: text/markdown

# CAMEL

## Introduction

CAMEL(Context-Aware Modifier for Efficient Language model) is a speculative decoding method inspired by [EAGLE](https://github.com/SafeAILab/EAGLE). It compresses former input hidden states of window size.

![architecture](docs/arch.png) 

## Usage



## Reference

- [Medusa](https://github.com/FasterDecoding/Medusa)

- [EAGLE](https://github.com/SafeAILab/EAGLE)
