Metadata-Version: 2.4
Name: rag-scorecard
Version: 1.0.0
Summary: A lightweight, resilient, and production-ready evaluation engine to audit Retrieval-Augmented Generation (RAG) pipelines.
Author: Kenobi
Classifier: Programming Language :: Python :: 3
Classifier: Programming Language :: Python :: 3.8
Classifier: Programming Language :: Python :: 3.9
Classifier: Programming Language :: Python :: 3.10
Classifier: Programming Language :: Python :: 3.11
Classifier: Programming Language :: Python :: 3.12
Classifier: Operating System :: OS Independent
Classifier: Development Status :: 5 - Production/Stable
Classifier: Intended Audience :: Developers
Classifier: Intended Audience :: Science/Research
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.8
Description-Content-Type: text/markdown
Requires-Dist: pydantic>=2.0.0
Requires-Dist: openai
Requires-Dist: google-genai
Dynamic: requires-python

# rag-scorecard

A lightweight, resilient, and production-ready evaluation engine to audit Retrieval-Augmented Generation (RAG) pipelines.

rag-scorecard balances ultra-fast, zero-cost deterministic token-overlap heuristics with deep semantic LLM-as-a-judge capabilities. The framework is architected to handle structural discrepancies, missing parameters, and sudden API rate limit or availability anomalies gracefully.

---

## Core Features

* **Smart Heuristics:** Token-overlap matching logic that filters out common stop words and handles punctuation variations dynamically without relying on external model endpoints.
* **Production-Grounded Math:** Strict mathematical alignment ensuring that failed or empty ground-truth parameters are fully captured as valid zero-score bounds rather than artificially shrinking the total evaluation denominator pool.
* **Multi-Provider Semantic Judges:** Native support for structured output evaluation utilizing both OpenAI and Gemini platforms.
* **Cascading Error Tolerant Architecture:** An embedded resilience layer prevents external network communication failures or 503/429 spikes from interrupting automated verification pipelines.

---

## Quick Start

### Installation
```bash
pip install rag-scorecard
