Metadata-Version: 2.1
Name: tensorrt_llm
Version: 0.18.0.dev2025022500
Summary: TensorRT-LLM: A TensorRT Toolbox for Large Language Models
Home-page: https://github.com/NVIDIA/TensorRT-LLM
Download-URL: https://github.com/NVIDIA/TensorRT-LLM/tags
Author: NVIDIA Corporation
License: Apache License 2.0
Keywords: nvidia tensorrt deeplearning inference
Classifier: Development Status :: 4 - Beta
Classifier: Intended Audience :: Developers
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.12
Requires-Python: >=3.7, <4
License-File: LICENSE
Requires-Dist: accelerate >=0.25.0
Requires-Dist: build
Requires-Dist: colored
Requires-Dist: cuda-python
Requires-Dist: diffusers >=0.27.0
Requires-Dist: lark
Requires-Dist: mpi4py
Requires-Dist: numpy <2
Requires-Dist: onnx >=1.12.0
Requires-Dist: onnx-graphsurgeon >=0.5.2
Requires-Dist: openai
Requires-Dist: polygraphy
Requires-Dist: psutil
Requires-Dist: pynvml >=11.5.0
Requires-Dist: pulp
Requires-Dist: pandas
Requires-Dist: h5py ==3.12.1
Requires-Dist: StrEnum
Requires-Dist: sentencepiece >=0.1.99
Requires-Dist: tensorrt ~=10.8.0
Requires-Dist: torch <=2.6.0,>=2.6.0a0
Requires-Dist: torchvision
Requires-Dist: nvidia-modelopt[torch] ~=0.23.0
Requires-Dist: nvidia-nccl-cu12
Requires-Dist: nvidia-cuda-nvrtc-cu12
Requires-Dist: transformers <4.48.0,>=4.47.0
Requires-Dist: pydantic >=2.9.1
Requires-Dist: pillow ==10.3.0
Requires-Dist: wheel
Requires-Dist: optimum
Requires-Dist: evaluate
Requires-Dist: mpmath >=1.3.0
Requires-Dist: click
Requires-Dist: click-option-group
Requires-Dist: aenum
Requires-Dist: pyzmq
Requires-Dist: fastapi ==0.115.4
Requires-Dist: uvicorn
Requires-Dist: httpx
Requires-Dist: setuptools
Requires-Dist: ordered-set
Requires-Dist: peft
Requires-Dist: einops
Requires-Dist: flashinfer-python ~=0.2.0
Requires-Dist: ffmpeg
Requires-Dist: opencv-python-headless
Provides-Extra: benchmarking
Requires-Dist: click ; extra == 'benchmarking'
Requires-Dist: pydantic ; extra == 'benchmarking'
Provides-Extra: devel
Requires-Dist: datasets ==2.19.2 ; extra == 'devel'
Requires-Dist: einops ; extra == 'devel'
Requires-Dist: graphviz ; extra == 'devel'
Requires-Dist: mypy ; extra == 'devel'
Requires-Dist: mako ; extra == 'devel'
Requires-Dist: parameterized ; extra == 'devel'
Requires-Dist: pre-commit ; extra == 'devel'
Requires-Dist: pybind11 ; extra == 'devel'
Requires-Dist: pybind11-stubgen ; extra == 'devel'
Requires-Dist: pytest ; extra == 'devel'
Requires-Dist: pytest-asyncio ; extra == 'devel'
Requires-Dist: pytest-cov ; extra == 'devel'
Requires-Dist: pytest-csv ; extra == 'devel'
Requires-Dist: pytest-env ; extra == 'devel'
Requires-Dist: pytest-forked ; extra == 'devel'
Requires-Dist: pytest-xdist ; extra == 'devel'
Requires-Dist: pytest-timeout ; extra == 'devel'
Requires-Dist: pytest-split ; extra == 'devel'
Requires-Dist: pytest-mock ; extra == 'devel'
Requires-Dist: rouge-score ; extra == 'devel'
Requires-Dist: cloudpickle ; extra == 'devel'
Requires-Dist: typing-extensions ==4.12.2 ; extra == 'devel'
Requires-Dist: bandit ==1.7.7 ; extra == 'devel'
Requires-Dist: jsonlines ==4.0.0 ; extra == 'devel'
Requires-Dist: jieba ==0.42.1 ; extra == 'devel'
Requires-Dist: rouge ==1.0.1 ; extra == 'devel'
Requires-Dist: pytest-rerunfailures ; extra == 'devel'
Requires-Dist: ruff ==0.9.4 ; extra == 'devel'
Requires-Dist: lm-eval[api] ==0.4.5 ; extra == 'devel'
Requires-Dist: docstring-parser ; extra == 'devel'

TensorRT-LLM: A TensorRT Toolbox for Large Language Models
