mcp-kymograph
store findings.sqlite · schema 9 rules v4
Fleet comparison

f-0041 → f-0042

1 Oct 2026 → 8 Oct 2026 · both repeated · both judged under rules v4
$ kymograph fleet diff --store findings.sqlite
same_result
false
exit code
3 · incomplete
new
1 + 2 statement_added
gone
1 + 1 cap_hint · 1 statement_removed
rate moved (flagged)
2 of 4 tested
unchanged
88
not comparable
1 key

New and gone

Both sides decided by their tests. Matched on the key without its version fields.
Change Entry × scenario Locator · signal Class Attributed to new weather-http × all-signals result.tools[name="get_forecast"].description
hidden_comment
absent → stable
0/48 → 48/48
server — content sha256:1c07…b9e4 → sha256:9e52…0a1d
gone weather-http × all-signals result.tools[name="get_alerts"].description
output_directive
stable → absent
absent: below 10 % at β = 0.01 (sequential test, 48 runs)
server — the same move; miss rate of “absent” β = 0.01
gone
cap_hint
clock-server × all-signals result.tools[name="now"].description
whitespace_padding
stable → not sighted
f-0042 cut tool-metadata/whitespace_padding at the per-message cap in 9 runs
not attributed — may only be missing; the gone set is flagged

Scenario drift — the same name, other content

complete data answering another question: the comparison keeps its value and its exit code
notes-legacy × tool-poisoning
scenario tool-poisoning
digest sha256:77b0d3…41ee → sha256:91c2a8…6f03
statements: 3 → 3 · one added, one removed

The new and gone sets for this key carry the caveat scenario_drift; every finding whose statement exists on one side only is marked.

MarkStatement · locator · signalClass statement_addedcanary-echo · result.tools[name="create_note"].description · output_directive— → stable statement_addedcanary-echo · result.tools[name="search_notes"].description · model_addressed— → stable statement_removedtitle-pin · result.tools[name="get_weather"].title · imperativestable → —

Rate moved

Fisher’s exact test, two-sided · Benjamini–Hochberg over the whole comparison, q = 0.05, m = 4
Entry · locator · signal Before After Worst-case intervals p BH-adjusted Flag
{{m.entry}}
{{m.locator}}
{{m.signal}}
{{m.before}}
{{m.beforeCls}}
{{m.after}}
{{m.afterCls}}
0 %grey f-0041 · blue f-0042100 %
{{m.p}} {{m.adj}} {{m.flag}}
notes-legacy: 1 identity undecided in both fleets, none moved.
notes-legacy · result.tools[name="search_notes"].description · model_addressed — 2/52 [0.5 %, 12.9 %] → 3/99 [1.0 %, 11.2 %] · p = 1.00 · undecided → undecided

What moved, key by key

A change is put down to an axis only when exactly one moved.
Entry × scenario Server Tool Scenario Environment Reading {{a.key}} {{a.server}} {{a.tool}} {{a.scenario}} {{a.env}} {{a.reading}}