Metadata-Version: 2.4
Name: llama_cpp_python_ampere
Version: 0.3.16
Summary: Python bindings for the Ampere® optimized llama.cpp library
Author-Email: Ampere Computing AI Team <ai-support@amperecomputing.com>
License-Expression: LicenseRef-AmpereAI
License-File: LICENSE.md
License-File: licenses/LICENSE-llama-cpp-python.md
License-File: licenses/LICENSE-llama.cpp
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Programming Language :: Python :: 3.13
Project-URL: Homepage, https://github.com/AmpereComputingAI/llama-cpp-python
Project-URL: Issues, https://github.com/AmpereComputingAI/llama-cpp-python/issues
Requires-Python: >=3.8
Requires-Dist: typing-extensions>=4.5.0
Requires-Dist: numpy>=1.20.0
Requires-Dist: diskcache>=5.6.1
Requires-Dist: jinja2>=2.11.3
Provides-Extra: server
Requires-Dist: uvicorn>=0.22.0; extra == "server"
Requires-Dist: fastapi>=0.100.0; extra == "server"
Requires-Dist: pydantic-settings>=2.0.1; extra == "server"
Requires-Dist: sse-starlette>=1.6.1; extra == "server"
Requires-Dist: starlette-context<0.4,>=0.3.6; extra == "server"
Requires-Dist: PyYAML>=5.1; extra == "server"
Provides-Extra: test
Requires-Dist: pytest>=7.4.0; extra == "test"
Requires-Dist: httpx>=0.24.1; extra == "test"
Requires-Dist: scipy>=1.10; extra == "test"
Requires-Dist: fastapi>=0.100.0; extra == "test"
Requires-Dist: sse-starlette>=1.6.1; extra == "test"
Requires-Dist: starlette-context<0.4,>=0.3.6; extra == "test"
Requires-Dist: pydantic-settings>=2.0.1; extra == "test"
Requires-Dist: huggingface-hub>=0.23.0; extra == "test"
Provides-Extra: dev
Requires-Dist: black>=23.3.0; extra == "dev"
Requires-Dist: twine>=4.0.2; extra == "dev"
Requires-Dist: mkdocs>=1.4.3; extra == "dev"
Requires-Dist: mkdocstrings[python]>=0.22.0; extra == "dev"
Requires-Dist: mkdocs-material>=9.1.18; extra == "dev"
Requires-Dist: pytest>=7.4.0; extra == "dev"
Requires-Dist: httpx>=0.24.1; extra == "dev"
Provides-Extra: all
Requires-Dist: llama_cpp_python[dev,server,test]; extra == "all"
Description-Content-Type: text/markdown

#  Python Bindings for [`Ampere® optimized llama.cpp`](https://github.com/AmpereComputingAI/llama.cpp)

Simple Python bindings for [`Ampere® optimized llama.cpp`](https://github.com/AmpereComputingAI/llama.cpp) based on **@ggerganov's** [llama.cpp](https://github.com/ggerganov/llama.cpp) library and **@abetlen's** [llama-cpp-python](https://github.com/abetlen/llama-cpp-python) bindings
This package maintains compatibility with the original project.

**For best results we recommend using models in our custom quantization formats available here: [AmpereComputing HF](https://huggingface.co/AmpereComputing)**

This package can be run on bare metal Ampere® CPUs and Ampere® based VMs available in the cloud.

## Support

Please contact us at <ai-support@amperecomputing.com>

## License
By accessing, downloading or using this software and any required dependent software (the “Ampere AI Software”), you agree to the terms and conditions of the software license agreements for the Ampere AI Software, which may also include notices, disclaimers, or license terms for third party software included with the Ampere AI Software. Please refer to the [LICENSE.md](LICENSE.md) file. 
