Metadata-Version: 2.4
Name: HAPI_SDK
Version: 0.1.10
Summary: A plug-and-play SDK for de-hallucinating outputs from LLMs
Home-page: https://github.com/cyprienn967/HAPI_SDK
Author: True
Author-email: cyprienseydoux@gmail.com
Classifier: Programming Language :: Python :: 3
Classifier: License :: OSI Approved :: MIT License
Classifier: Operating System :: OS Independent
Requires-Python: >=3.7
Description-Content-Type: text/markdown
Requires-Dist: torch
Requires-Dist: transformers
Requires-Dist: accelerate
Requires-Dist: pyarrow>=14.0.0
Requires-Dist: flask
Requires-Dist: numpy
Requires-Dist: evaluate
Requires-Dist: datasets
Requires-Dist: pandas
Requires-Dist: tqdm
Requires-Dist: tokenizers
Requires-Dist: openai
Requires-Dist: tiktoken
Requires-Dist: nltk
Requires-Dist: tenacity
Requires-Dist: safetensors
Requires-Dist: azure-identity
Requires-Dist: azure-keyvault-secrets
Requires-Dist: azure-ai-textanalytics
Requires-Dist: requests
Requires-Dist: werkzeug
Requires-Dist: aws-wsgi
Dynamic: author
Dynamic: author-email
Dynamic: classifier
Dynamic: description
Dynamic: description-content-type
Dynamic: home-page
Dynamic: requires-dist
Dynamic: requires-python
Dynamic: summary

## Overview

HAPI is a plug-and-play SDK to dehallucinate your LLM generation in real time

- Hallucination Detection: Identifies and flags AI-generated misinformation.
- Confidence Filtering: Evaluates reliability of generated content.
- Easy Integration: Will support any open-source model soon

## Supported models - more coming soon!

- Llama-2-7b-chat (meta-llama/Llama-2-7b-chat)
- Falcon40b (tiiuae/falcon-40b)
- Llama-2-7b (meta-llama/Llama-2-7b-hf)
- MPT7B (mosaicml/mpt-7b)

## Installation

pip install HAPI_SDK

## Quick Start

from hapi_sdk import DeHallucinationClient

client = DeHallucinationClient(model_id="meta-llama/Llama-2-7b-chat-hf", license_key="your-license-key")

prompt = "Explain quantum entanglement in simple terms."

output, flagged_sentences = client.dehallucinate1(prompt)

print("Filtered Output:", output)

print("Flagged Sentences:", flagged_sentences)

## Contact with any suggestions!


