Metadata-Version: 2.4
Name: checkmaite
Version: 0.4.0
Summary: CheckMAITE - an implementation of T&E tools using maite
Author: OpenTeams
License: Apache-2.0
License-File: LICENSE.md
Keywords: artificial intelligence,jatic,testing and evaluation
Classifier: Development Status :: 1 - Planning
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Requires-Python: <3.13,>=3.10
Requires-Dist: dataeval-plots==0.0.6
Requires-Dist: dataeval==1.0.6
Requires-Dist: datamaite==0.5.0
Requires-Dist: fsspec>=2023.1.0
Requires-Dist: httpx>=0.28.1
Requires-Dist: ipython>=8.13
Requires-Dist: maite<0.10,>=0.9.4
Requires-Dist: matplotlib<3.10.8,>=3.7.1
Requires-Dist: modelmaite==0.1.0
Requires-Dist: nrtk[pybsm]==1.0.4
Requires-Dist: numba>=0.60.0
Requires-Dist: opencv-python-headless>=4.9.0.80
Requires-Dist: pandas>=2
Requires-Dist: pillow>=11.0.0
Requires-Dist: polars>=1.37.0
Requires-Dist: pydantic>=2.12.0
Requires-Dist: ray[serve]>=2.9.0
Requires-Dist: scikit-learn>=1.5.2
Requires-Dist: setuptools<82.0.0,>=78.1.1
Requires-Dist: smqtk-core>=0.21.0
Requires-Dist: smqtk-detection>=0.22.0
Requires-Dist: torch>=2.2.0
Requires-Dist: torchmetrics>=1.0.0
Requires-Dist: torchvision>=0.17.0
Requires-Dist: transformers[timm]!=4.51.0,>=4.48.0
Requires-Dist: typing-extensions>=4.14.1
Requires-Dist: universal-pathlib>=0.3.8
Requires-Dist: xaitk-jatic==0.8.1
Provides-Extra: aws
Requires-Dist: s3fs>=2023.1.0; extra == 'aws'
Provides-Extra: azure
Requires-Dist: adlfs>=2023.1.0; extra == 'azure'
Provides-Extra: cloud
Requires-Dist: adlfs>=2023.1.0; extra == 'cloud'
Requires-Dist: gcsfs>=2023.1.0; extra == 'cloud'
Requires-Dist: s3fs>=2023.1.0; extra == 'cloud'
Provides-Extra: gcs
Requires-Dist: gcsfs>=2023.1.0; extra == 'gcs'
Provides-Extra: onnx
Requires-Dist: onnx>=1.14.0; extra == 'onnx'
Requires-Dist: onnxruntime<1.24.0,>=1.14.0; extra == 'onnx'
Provides-Extra: onnx-cuda
Requires-Dist: onnx>=1.14.0; extra == 'onnx-cuda'
Requires-Dist: onnxruntime-gpu<1.24.0,>=1.14.0; extra == 'onnx-cuda'
Provides-Extra: reporting
Requires-Dist: markdown>=3.5; extra == 'reporting'
Requires-Dist: xhtml2pdf>=0.2.16; extra == 'reporting'
Description-Content-Type: text/markdown

# CheckMAITE

`CheckMAITE` is an integration point for AI T&E tooling for computer vision that is based on the `maite` protocols (see [maite documentation](https://mit-ll-ai-technology.github.io/maite/)).

## Description

**What is CheckMAITE?**
CheckMAITE is a Python API which makes testing and evaluation of models and datasets straightforward and reproducible. It can be used to run a wide variety of **Model Evaluation** and **Dataset Analysis** investigations for both **Object Detection** and **Image Classification** computer vision problems.

It was built as an integration point for all [CDAO JATIC](https://cdao.pages.jatic.net/public/) tools and has since expanded focus. Our goal is to make T&E easier for analysts!

To learn more please visit our [published documentation](https://openteams-ai.github.io/checkmaite/).

## Supported environment

- **OS:** Linux x86_64 (CI-tested). macOS x86_64 and arm64 are supported but not CI-tested.
- **Python:** 3.10, 3.11, and 3.12 with `uv` or pip. conda supports 3.10 and 3.11 only. `checkmaite-plugins` is `<3.12` on both paths.
- **GPU:** CPU is the supported baseline. CUDA is optional for PyTorch.
- **Hardware:** any machine that can install those Python versions.

## Installation

For detailed installation instructions please refer to [Setup Guide](https://openteams-ai.github.io/checkmaite/get-started/install_setup.html)

On macOS, `brew install libomp` is required (`dataeval` loads LightGBM, which needs `libomp.dylib`).

## Usage

To learn how to get started using `CheckMAITE`, please visit our [quick start guide](https://openteams-ai.github.io/checkmaite/get-started/index.html).

There are also [How-to Guides](https://openteams-ai.github.io/checkmaite/development/index.html) & [Tutorials](https://openteams-ai.github.io/checkmaite/tool-usage/index.html) that will help get new users up to speed on the available functionality.

## Contributing

The `CheckMAITE` team welcomes contributions of all forms - questions, documentation, and code contributions. Please visit our [contribution guide](https://openteams-ai.github.io/checkmaite/development/contributing.html).

## Authors and acknowledgment

This project was created for [CDAO JATIC](https://cdao.pages.jatic.net/public/) and is maintained by OpenTeams with collaborative community support. 
