Metadata-Version: 2.4
Name: jfinqa-helm
Version: 0.1.0
Summary: HELM plugin for JFinQA: Japanese Financial Numerical Reasoning QA Benchmark
Project-URL: Homepage, https://github.com/ajtgjmdjp/jfinqa
Project-URL: Dataset, https://huggingface.co/datasets/ajtgjmdjp/jfinqa
Author: ajtgjmdjp
License: Apache-2.0
Keywords: benchmark,finance,helm,japanese,nlp
Classifier: Development Status :: 3 - Alpha
Classifier: Intended Audience :: Science/Research
Classifier: License :: OSI Approved :: Apache Software License
Classifier: Programming Language :: Python :: 3
Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
Requires-Python: >=3.9
Requires-Dist: crfm-helm>=0.5.0
Requires-Dist: datasets>=2.0
Description-Content-Type: text/markdown

# jfinqa-helm

HELM plugin for [JFinQA](https://github.com/ajtgjmdjp/jfinqa): Japanese Financial Numerical Reasoning QA Benchmark.

## Installation

```bash
pip install crfm-helm jfinqa-helm
```

## Usage

```bash
helm-run --run-entries jfinqa:model=openai/gpt-4o
```

## About JFinQA

JFinQA contains 1,000 questions across three subtasks:

- **numerical_reasoning** (550 questions): Calculate financial ratios, growth rates, etc.
- **consistency_checking** (200 questions): Verify whether a statement is consistent with financial data
- **temporal_reasoning** (250 questions): Reason about changes over multiple fiscal years

Questions are drawn from 68 companies' EDINET filings covering J-GAAP, IFRS, and US-GAAP.

**Dataset**: [ajtgjmdjp/jfinqa](https://huggingface.co/datasets/ajtgjmdjp/jfinqa)

## License

Apache-2.0
