Evaluation report

Evaluation report — rag

Customer

biblioteca

Suite

rag

This run

staging — 2026-09-23T16:35:21.553349+00:00

Reference

staging — 2026-09-22T12:52:51.200872+00:00

Code version

d5587e119f99866cfa3c8b56c12d894c49a31bb4

Reference approved

2026-09-22T12:52:56.953883+00:00

Did it get worse? No

Nothing got worse compared with the reference. Every case could be judged. No case is suspended. The suite is unchanged from the reference.

regressed 0
errored 0
new 0
missing 0
improved 0
unchanged 18

What got worse (0)

Nothing in this section.

What could not be judged (0)

Nothing in this section.

What is set aside (0)

Nothing in this section.

What was added or removed (0)

Nothing in this section.

What got better (0)

Nothing in this section.

What stayed the same (18)

Case	Check	What happened	Why
`borrowing`	`pii_absent`	Score unchanged at 1.000000.	no identifier found (checked: codice_fiscale, email, iban, partita_iva, phone_it)
`borrowing`	`faithfulness`	Score unchanged at 0.500000.	1 of 2 claims appear in the passages
`borrowing`	`cost_budget`	Score unchanged at 0.754148.	0.000652 USD against a 0.002000 cap (within budget)
`joining`	`pii_absent`	Score unchanged at 1.000000.	no identifier found (checked: codice_fiscale, email, iban, partita_iva, phone_it)
`joining`	`faithfulness`	Score unchanged at 0.500000.	1 of 2 claims appear in the passages
`joining`	`cost_budget`	Score unchanged at 0.755287.	0.000648 USD against a 0.002000 cap (within budget)
`late-return`	`pii_absent`	Score unchanged at 1.000000.	no identifier found (checked: codice_fiscale, email, iban, partita_iva, phone_it)
`late-return`	`faithfulness`	Score unchanged at 0.500000.	1 of 2 claims appear in the passages
`late-return`	`cost_budget`	Score unchanged at 0.757863.	0.000639 USD against a 0.002000 cap (within budget)
`opening-hours`	`pii_absent`	Score unchanged at 1.000000.	no identifier found (checked: codice_fiscale, email, iban, partita_iva, phone_it)
`opening-hours`	`faithfulness`	Score unchanged at 0.500000.	1 of 2 claims appear in the passages
`opening-hours`	`cost_budget`	Score unchanged at 0.754717.	0.000650 USD against a 0.002000 cap (within budget)
`study-room`	`pii_absent`	Score unchanged at 1.000000.	no identifier found (checked: codice_fiscale, email, iban, partita_iva, phone_it)
`study-room`	`faithfulness`	Score unchanged at 0.500000.	1 of 2 claims appear in the passages
`study-room`	`cost_budget`	Score unchanged at 0.757002.	0.000642 USD against a 0.002000 cap (within budget)
`wifi`	`pii_absent`	Score unchanged at 1.000000.	no identifier found (checked: codice_fiscale, email, iban, partita_iva, phone_it)
`wifi`	`faithfulness`	Score unchanged at 0.500000.	1 of 2 claims appear in the passages
`wifi`	`cost_budget`	Score unchanged at 0.757576.	0.000640 USD against a 0.002000 cap (within budget)