Metadata-Version: 2.4
Name: flash-pop
Version: 0.2.0
Summary: A hardware-aware efficient implementation of RetNet and POP.
Author-email: Lior Cohen <liorcohen5@campus.technion.ac.il>
License: GPL-3.0-or-later
License-File: LICENSE
Requires-Python: >=3.10
Requires-Dist: einops
Requires-Dist: loguru
Requires-Dist: tilelang>=0.1.3
Requires-Dist: torch>=2.1.0
Description-Content-Type: text/markdown


# Flash POP
A hardware-aware efficient implementation of [Retention](https://arxiv.org/abs/2307.08621) and [POP](https://arxiv.org/abs/2402.05643) Retention - Retention augmented with a Parallel Observation Pediction (POP) mechanism.



## 🌟 Credits
- https://github.com/sustcsonglin/fla-tilelang
- https://github.com/tile-ai/tilelang
- https://github.com/leor-c/M3
- https://github.com/leor-c/REM
- https://github.com/fkodom/yet-another-retnet


