Controlled Evidence Sensitivity

Synthetic detector contract test. This report measures a declared controlled evidence-response relation. It is not a causal guarantee and does not estimate real-model failure prevalence.

Scope limit: Synthetic declarative fixture harness/oracle only; this result does not show that a model used contextual evidence instead of parametric memory.

evidence_insensitive · gate block · endpoint false
decision_inertia: Expected decisions (baseline -> counterfactual): approve -> deny; observed decisions: approve -> approve. The subject returned the same decision fields after authoritative governing evidence changed.
Relation category: expected decision_flip; observed decision_same.

Baseline

Observed: approve/approved
Expected: approve/approved
Expected match: true

Retrieved: true
Governing support: true
Evidence link: true

f1d680df273c0189a9c78a1c6246d02e07ab7b52f14285b788ed79f5f601d551

Counterfactual

Observed: approve/approved
Expected: deny/denied
Expected match: false

Retrieved: true
Governing support: true
Evidence link: true

d8e26f1502ae20fc4de4bee2d799bfb1f763d8fa7eaea2852cbd193f7350137e

Detector contract

Endpoint: expected_decision_response
Detector status: synthetic_detector_contract_test
Subject execution scope: declarative_fixture_harness_not_model_evidence_use
Provenance binding: fixture_declared_unverified_digests
Synthetic data provenance: bundled_digest_verified
Synthetic data attestation digest: not_applicable
Raw content persistence: exact_corpus_and_fixture_utf8_embedded
Deterministic: true
Decision inertia detected: true
Reason codes: EVIDENCE_SENSITIVITY_EXPECTED_RESPONSE_MISSING
Protocol digest: 4c5d66b5cabd4cfb4cad66afed36f5f196a60899c817ea3eaa055096aa5a0a21
Authority contract: 43c6f8258181292c8cb32dd5bcad76f6c7bfd97b95fceb339fbc2ad9bb9d0e57

Controlled-difference manifest

protocol_fixed rows are structural protocol controls. arm_observed rows are independently derived from each corpus arm and carry the discriminating evidence.

Dimension	Basis	Baseline	Counterfactual	Contract	State
`agent_implementation_digest`	`protocol_fixed`	`29162f7640adaa3cb5339481b86fb4b78842af6457b2b41f13f10e8fe7b987b4`	`29162f7640adaa3cb5339481b86fb4b78842af6457b2b41f13f10e8fe7b987b4`	equal	controlled
`corpus_digest`	`arm_observed`	`f1d680df273c0189a9c78a1c6246d02e07ab7b52f14285b788ed79f5f601d551`	`d8e26f1502ae20fc4de4bee2d799bfb1f763d8fa7eaea2852cbd193f7350137e`	different	expected_difference
`corpus_document_catalog_digest`	`arm_observed`	`df06ee8bf96869705e857b27659df0029f6e5d6d9984960ff3ca93f134854bcb`	`df06ee8bf96869705e857b27659df0029f6e5d6d9984960ff3ca93f134854bcb`	equal	controlled
`deterministic_subject`	`protocol_fixed`	`true`	`true`	equal	controlled
`fixture_manifest_digest`	`protocol_fixed`	`4878cd6f059ce3a2b185ada25e705ebec8165beac0be25bacd6734493a882f79`	`4878cd6f059ce3a2b185ada25e705ebec8165beac0be25bacd6734493a882f79`	equal	controlled
`governing_evidence_digest`	`arm_observed`	`39e0ed91e07ef56563b5f2f74422735196e6b7889081c603a3d2f443b895dc13`	`0a11b36c7bc440e7227ae9bc91d3e071fa0c4c06240c1c1c35635f3fd6a7e9f6`	different	expected_difference
`governing_retrieval_identity_digest`	`arm_observed`	`dafa54ea76f884dabf884e1ac39f76763168404201103a0f7b050d3d7d3c22e3`	`dafa54ea76f884dabf884e1ac39f76763168404201103a0f7b050d3d7d3c22e3`	equal	controlled
`knowledge_contract_digest`	`protocol_fixed`	`43c6f8258181292c8cb32dd5bcad76f6c7bfd97b95fceb339fbc2ad9bb9d0e57`	`43c6f8258181292c8cb32dd5bcad76f6c7bfd97b95fceb339fbc2ad9bb9d0e57`	equal	controlled
`model_digest`	`protocol_fixed`	`bc987bc3e4bd9475c7a04887537029f65e0cfafc29511974911eb99582b9be7c`	`bc987bc3e4bd9475c7a04887537029f65e0cfafc29511974911eb99582b9be7c`	equal	controlled
`non_governing_evidence_digest`	`arm_observed`	`4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945`	`4f53cda18c2baa0c0354bb5f9a3ecbe5ed12ab4d8e11ba873c2f11161202b945`	equal	controlled
`prompt_template_digest`	`protocol_fixed`	`fdcd7641403825e9cfec862b3a47d203c335de53f333ddecc0d7f7bd2ea64ed9`	`fdcd7641403825e9cfec862b3a47d203c335de53f333ddecc0d7f7bd2ea64ed9`	equal	controlled
`producer_version`	`protocol_fixed`	`0.6.4`	`0.6.4`	equal	controlled
`query_digest`	`protocol_fixed`	`81c610fe9830b111fe218d68247f5ed1af33ceb2190c0fca2f3719be415bbc7d`	`81c610fe9830b111fe218d68247f5ed1af33ceb2190c0fca2f3719be415bbc7d`	equal	controlled
`query_family_id`	`arm_observed`	`synthetic-benefit-eligibility`	`synthetic-benefit-eligibility`	equal	controlled
`request_digest`	`protocol_fixed`	`8da4857cfd203a6a91c33c8a4e5d8745534500ebc388669ef4701f5a5c8f550e`	`8da4857cfd203a6a91c33c8a4e5d8745534500ebc388669ef4701f5a5c8f550e`	equal	controlled
`retrieval_algorithm`	`arm_observed`	`deterministic-term-overlap@1.0.0`	`deterministic-term-overlap@1.0.0`	equal	controlled
`retrieval_top_k`	`arm_observed`	`1`	`1`	equal	controlled
`subject_configuration_digest`	`protocol_fixed`	`769c848ccb72b441fc73a507301c83da823cc4c4215228b1639c3c10999bc459`	`769c848ccb72b441fc73a507301c83da823cc4c4215228b1639c3c10999bc459`	equal	controlled
`suite_digest`	`protocol_fixed`	`e4d857b0a750e17fa826f240b05b2880617f41baa0424e1e28310b2b32fcab53`	`e4d857b0a750e17fa826f240b05b2880617f41baa0424e1e28310b2b32fcab53`	equal	controlled
`tool_configuration_digest`	`protocol_fixed`	`e58a15c3e6d3b530e0149b393001ba9536a068d70aeade5dacdb868ca5c38d07`	`e58a15c3e6d3b530e0149b393001ba9536a068d70aeade5dacdb868ca5c38d07`	equal	controlled
`tool_schema_digest`	`protocol_fixed`	`ab72f2449da6de27489c10fe35c6bc5e6431d3cede8f13eff0e769dfe52dc498`	`ab72f2449da6de27489c10fe35c6bc5e6431d3cede8f13eff0e769dfe52dc498`	equal	controlled

Prerequisites

Check	State	Reason
`arm-evaluations-pass`	satisfied	none
`authority-contract-valid`	satisfied	none
`comparable-decision-output`	satisfied	none
`controlled-differences-only`	satisfied	none
`deterministic-subject`	satisfied	none
`evidence-links-present-both-arms`	satisfied	none
`fixture-identity-bound`	satisfied	none
`governing-evidence-supported-both-arms`	satisfied	none
`retrieval-succeeded-both-arms`	satisfied	none

Assumptions

The knowledge-authority contract correctly declares which contextual evidence governs the synthetic task.
The committed fixture subject and lexical retriever are deterministic contract-test components, not measurements of a hosted model.

Limitations

This deterministic synthetic detector contract test does not estimate real-model prevalence.
Controlled evidence sensitivity is an observed response relation under declared conditions, not a causal guarantee.
Synthetic declarative fixture harness/oracle only; this result does not show that a model used contextual evidence instead of parametric memory.
Agent implementation, prompt, model, and tool-schema digests are fixture-declared identifiers; this protocol does not verify them against implementation, prompt, model, or tool-schema bytes.
Exact raw corpus and fixture UTF-8 is embedded verbatim in reports and packets; bundled synthetic status is digest-verified, while custom synthetic status is operator-attested and not semantically verified.
Synthetic fixture outputs do not estimate evidence-insensitivity prevalence in real models.