A worked GraphRAG benchmark dataset: a content-addressed corpus, its chunking, embeddings, vector index, retrieval events, and model-extracted entity/relationship descriptions — every artifact attributed and confidence-weighted, published as a research object.
Published: 2026-06-12T00:00:00+00:00
| @id | @type | name |
|---|---|---|
| ro-crate-metadata.json | CreativeWork | |
| ./ | Dataset | Lillith GraphRAG benchmark |
| https://spdx.org/licenses/CC-BY-4.0 | CreativeWork | CC-BY-4.0 |
| https://blackcatinformatics.ca/gmeow/ro-crate/publisher | Organization | Blackcat Informatics Inc. |
| corpus.ttl | File | corpus.ttl |
| grounded-claim.ttl | File | grounded-claim.ttl |
| lillith-dataset.ttl | File | lillith-dataset.ttl |
| lillith-pipeline.ttl | File | lillith-pipeline.ttl |
| lillith.croissant.jsonld | File | lillith.croissant.jsonld |
| rubric.ttl | File | rubric.ttl |
| scores.ttl | File | scores.ttl |
| https://blackcatinformatics.ca/gmeow/evals/corpus/constitution | File | CONSTITUTION.md |
| https://blackcatinformatics.ca/gmeow/evals/corpus/readme | File | README.md |
| https://blackcatinformatics.ca/gmeow/examples/ai/handbook | File | facilities handbook, 2026 edition |
| https://blackcatinformatics.ca/gmeow/examples/graphrag/mail-archive | File | list archive, 2025 |
| https://blackcatinformatics.ca/gmeow/evals/harness | SoftwareApplication | the gmeow-evals harness |
| https://blackcatinformatics.ca/gmeow/evals/model-reference-baseline | SoftwareApplication | https://blackcatinformatics.ca/gmeow/evals/model-reference-baseline |
| https://blackcatinformatics.ca/gmeow/examples/ai/assistant | SoftwareApplication | facilities assistant model |
| https://blackcatinformatics.ca/gmeow/examples/ai/auditor | SoftwareApplication | grounding auditor |
| https://blackcatinformatics.ca/gmeow/examples/graphrag/embedder | SoftwareApplication | embedder-v3 |
| https://blackcatinformatics.ca/gmeow/examples/graphrag/extractor | SoftwareApplication | extraction model |
| https://blackcatinformatics.ca/gmeow/examples/graphrag/pipeline-runner | SoftwareApplication | lillith pipeline runner |
| https://github.com/blackcat-informatics/lillith-pipeline/blob/main/.github/workflows/benchmark.yml | ['File', 'SoftwareSourceCode', 'ComputationalWorkflow'] | benchmark.yml |
| https://blackcatinformatics.ca/gmeow/examples/ai/invocation-19 | CreateAction | https://blackcatinformatics.ca/gmeow/examples/ai/invocation-19 |
| https://blackcatinformatics.ca/gmeow/examples/graphrag/invocation-44 | CreateAction | https://blackcatinformatics.ca/gmeow/examples/graphrag/invocation-44 |
| https://blackcatinformatics.ca/gmeow/examples/graphrag/lillith-ingest | CreateAction | lillith corpus ingest |
| https://blackcatinformatics.ca/gmeow/examples/graphrag/pipeline-run | CreateAction | lillith benchmark pipeline run 2026-06-02 |
| https://blackcatinformatics.ca/gmeow/examples/ai/claim-close-2200 | Thing | https://blackcatinformatics.ca/gmeow/examples/ai/claim-close-2200 |
| https://blackcatinformatics.ca/gmeow/examples/ai/claim-close-2300 | Thing | https://blackcatinformatics.ca/gmeow/examples/ai/claim-close-2300 |
| https://blackcatinformatics.ca/gmeow/examples/graphrag/chunk-7 | Thing | https://blackcatinformatics.ca/gmeow/examples/graphrag/chunk-7 |
| https://blackcatinformatics.ca/gmeow/examples/graphrag/desc-buildsys | Thing | extracted: 'the build system' |
| https://blackcatinformatics.ca/gmeow/examples/graphrag/desc-mara | Thing | extracted: 'Mara' (maintainer?) |
| https://blackcatinformatics.ca/gmeow/examples/graphrag/lillith-crate | Thing | lillith.crate.zip |
| https://blackcatinformatics.ca/gmeow/examples/graphrag/pipeline-repo | Thing | lillith-pipeline repository |
| https://blackcatinformatics.ca/gmeow/examples/graphrag/rel-maintains | Thing | extracted: Mara maintains the build system |
| https://blackcatinformatics.ca/gmeow/examples/graphrag/summary-infra | Thing | summary: the infrastructure crew |