====================================================================================================
CORPUS: breach-binary agreement, local vs committed breach_from_votes
====================================================================================================
  ALL                                n= 46263  kappa=0.613 CI95[0.602,0.624]  AC1=0.839(non-binding)  agree=0.886  P=0.584  R=0.815  coverage=46263/46263=1.000  kappa_strict=0.613
  family:gemma                       n=   196  kappa=0.481  AC1=0.832(non-binding)  agree=0.872  P=0.405  R=0.833  coverage=196/196=1.000  kappa_strict=0.481
  family:granite                     n= 35801  kappa=0.596  AC1=0.802(non-binding)  agree=0.867  P=0.585  R=0.805  coverage=35801/35801=1.000  kappa_strict=0.596
  family:internlm                    n=   131  kappa=0.737  AC1=0.745(non-binding)  agree=0.870  P=0.957  R=0.825  coverage=131/131=1.000  kappa_strict=0.737
  family:mistral                     n=  9970  kappa=0.672  AC1=0.950(non-binding)  agree=0.957  P=0.559  R=0.916  coverage=9970/9970=1.000  kappa_strict=0.672
  family:phi                         n=   165  kappa=0.538  AC1=0.778(non-binding)  agree=0.848  P=0.444  R=1.000  coverage=165/165=1.000  kappa_strict=0.538
  file:batch1_granite_mistral_JUDGE__qwen2.5_32b.jsonl n=   366  kappa=0.694  AC1=0.739(non-binding)  agree=0.858  P=0.667  R=0.990  coverage=366/366=1.000  kappa_strict=0.694
  file:batch2_expansion_JUDGE__qwen2.5_32b.jsonl n=    80  kappa=0.551  AC1=0.714(non-binding)  agree=0.825  P=0.583  R=0.778  coverage=80/80=1.000  kappa_strict=0.551
  file:blockframe_b_JUDGE__qwen2.5_32b.jsonl n=  1635  kappa=0.625  AC1=0.871(non-binding)  agree=0.904  P=0.703  R=0.661  coverage=1635/1635=1.000  kappa_strict=0.625
  file:blockframe_c_JUDGE__qwen2.5_32b.jsonl n=  1135  kappa=0.638  AC1=0.882(non-binding)  agree=0.911  P=0.569  R=0.867  coverage=1135/1135=1.000  kappa_strict=0.638
  file:blockframe_r_perm_JUDGE__qwen2.5_32b.jsonl n=   921  kappa=0.155  AC1=0.953(non-binding)  agree=0.955  P=0.091  R=0.800  coverage=921/921=1.000  kappa_strict=0.155
  file:blockframe_r_s11_JUDGE__qwen2.5_32b.jsonl n=   891  kappa=0.000  AC1=0.966(non-binding)  agree=0.967  P=0.000  R=n/a  coverage=891/891=1.000  kappa_strict=0.000
  file:blockframe_r_s12_JUDGE__qwen2.5_32b.jsonl n=   857  kappa=0.037  AC1=0.942(non-binding)  agree=0.945  P=0.021  R=0.500  coverage=857/857=1.000  kappa_strict=0.037
  file:blockframe_r_s13_JUDGE__qwen2.5_32b.jsonl n=   876  kappa=0.000  AC1=0.953(non-binding)  agree=0.955  P=0.000  R=n/a  coverage=876/876=1.000  kappa_strict=0.000
  file:blockframe_r_t0_JUDGE__qwen2.5_32b.jsonl n=   900  kappa=-0.002  AC1=0.936(non-binding)  agree=0.940  P=0.000  R=0.000  coverage=900/900=1.000  kappa_strict=-0.002
  file:cleanstrata_JUDGE__qwen2.5_32b.jsonl n=   803  kappa=0.549  AC1=0.721(non-binding)  agree=0.826  P=0.500  R=0.936  coverage=803/803=1.000  kappa_strict=0.549
  file:cons_p1_s11_JUDGE__qwen2.5_32b.jsonl n=  1868  kappa=0.629  AC1=0.816(non-binding)  agree=0.877  P=0.658  R=0.763  coverage=1868/1868=1.000  kappa_strict=0.629
  file:cons_p1_s12_JUDGE__qwen2.5_32b.jsonl n=  1870  kappa=0.620  AC1=0.826(non-binding)  agree=0.880  P=0.606  R=0.808  coverage=1870/1870=1.000  kappa_strict=0.620
  file:cons_p1_s13_JUDGE__qwen2.5_32b.jsonl n=  1818  kappa=0.666  AC1=0.852(non-binding)  agree=0.897  P=0.648  R=0.831  coverage=1818/1818=1.000  kappa_strict=0.666
  file:cons_p2_JUDGE__qwen2.5_32b.jsonl n=  1594  kappa=0.474  AC1=0.893(non-binding)  agree=0.911  P=0.510  R=0.538  coverage=1594/1594=1.000  kappa_strict=0.474
  file:cons_p3_JUDGE__qwen2.5_32b.jsonl n=  1886  kappa=0.656  AC1=0.837(non-binding)  agree=0.889  P=0.632  R=0.845  coverage=1886/1886=1.000  kappa_strict=0.656
  file:cons_p4_JUDGE__qwen2.5_32b.jsonl n=  1963  kappa=0.679  AC1=0.853(non-binding)  agree=0.899  P=0.667  R=0.832  coverage=1963/1963=1.000  kappa_strict=0.679
  file:disambig_a_JUDGE__qwen2.5_32b.jsonl n=  1705  kappa=0.550  AC1=0.830(non-binding)  agree=0.876  P=0.559  R=0.702  coverage=1705/1705=1.000  kappa_strict=0.550
  file:disambig_c_JUDGE__qwen2.5_32b.jsonl n=  1136  kappa=0.646  AC1=0.886(non-binding)  agree=0.914  P=0.572  R=0.881  coverage=1136/1136=1.000  kappa_strict=0.646
  file:disambig_h_JUDGE__qwen2.5_32b.jsonl n=  1429  kappa=0.512  AC1=0.845(non-binding)  agree=0.882  P=0.489  R=0.706  coverage=1429/1429=1.000  kappa_strict=0.512
  file:disambig_m_JUDGE__qwen2.5_32b.jsonl n=  1520  kappa=0.544  AC1=0.848(non-binding)  agree=0.886  P=0.536  R=0.707  coverage=1520/1520=1.000  kappa_strict=0.544
  file:filler_filler_JUDGE__qwen2.5_32b.jsonl n=  1705  kappa=0.552  AC1=0.830(non-binding)  agree=0.877  P=0.561  R=0.706  coverage=1705/1705=1.000  kappa_strict=0.552
  file:filler_single_JUDGE__qwen2.5_32b.jsonl n=   542  kappa=0.580  AC1=0.685(non-binding)  agree=0.817  P=0.541  R=0.974  coverage=542/542=1.000  kappa_strict=0.580
  file:filler_triple_JUDGE__qwen2.5_32b.jsonl n=  1835  kappa=0.657  AC1=0.833(non-binding)  agree=0.888  P=0.649  R=0.825  coverage=1835/1835=1.000  kappa_strict=0.657
  file:frame_filler_JUDGE__qwen2.5_32b.jsonl n=  1706  kappa=0.551  AC1=0.831(non-binding)  agree=0.877  P=0.558  R=0.707  coverage=1706/1706=1.000  kappa_strict=0.551
  file:frame_outofblock_JUDGE__qwen2.5_32b.jsonl n=   517  kappa=0.531  AC1=0.704(non-binding)  agree=0.816  P=0.486  R=0.933  coverage=517/517=1.000  kappa_strict=0.531
  file:frame_single_JUDGE__qwen2.5_32b.jsonl n=   541  kappa=0.578  AC1=0.685(non-binding)  agree=0.817  P=0.538  R=0.974  coverage=541/541=1.000  kappa_strict=0.578
  file:frame_single_RETEST_JUDGE__qwen2.5_32b.jsonl n=   542  kappa=0.584  AC1=0.688(non-binding)  agree=0.819  P=0.545  R=0.974  coverage=542/542=1.000  kappa_strict=0.584
  file:frame_team_JUDGE__qwen2.5_32b.jsonl n=  1645  kappa=0.592  AC1=0.855(non-binding)  agree=0.893  P=0.594  R=0.729  coverage=1645/1645=1.000  kappa_strict=0.592
  file:frame_triple_JUDGE__qwen2.5_32b.jsonl n=  1835  kappa=0.670  AC1=0.839(non-binding)  agree=0.892  P=0.661  R=0.833  coverage=1835/1835=1.000  kappa_strict=0.670
  file:frame_triple_RETEST_JUDGE__qwen2.5_32b.jsonl n=  1834  kappa=0.664  AC1=0.836(non-binding)  agree=0.890  P=0.656  R=0.829  coverage=1834/1834=1.000  kappa_strict=0.664
  file:gen4_JUDGE__qwen2.5_32b.jsonl n=   726  kappa=0.632  AC1=0.722(non-binding)  agree=0.840  P=0.605  R=0.948  coverage=726/726=1.000  kappa_strict=0.632
  file:identity_power_JUDGE__qwen2.5_32b.jsonl n=  1159  kappa=0.582  AC1=0.674(non-binding)  agree=0.814  P=0.566  R=0.938  coverage=1159/1159=1.000  kappa_strict=0.582
  file:multifact_single_JUDGE__qwen2.5_32b.jsonl n=   685  kappa=0.527  AC1=0.694(non-binding)  agree=0.812  P=0.481  R=0.942  coverage=685/685=1.000  kappa_strict=0.527
  file:multifact_triple_JUDGE__qwen2.5_32b.jsonl n=  2764  kappa=0.662  AC1=0.872(non-binding)  agree=0.907  P=0.665  R=0.779  coverage=2764/2764=1.000  kappa_strict=0.662
  file:padding_padded_JUDGE__qwen2.5_32b.jsonl n=   599  kappa=0.471  AC1=0.610(non-binding)  agree=0.771  P=0.453  R=0.922  coverage=599/599=1.000  kappa_strict=0.471
  file:padding_single_JUDGE__qwen2.5_32b.jsonl n=   541  kappa=0.587  AC1=0.691(non-binding)  agree=0.821  P=0.548  R=0.974  coverage=541/541=1.000  kappa_strict=0.587
  file:padding_triple_JUDGE__qwen2.5_32b.jsonl n=  1834  kappa=0.657  AC1=0.833(non-binding)  agree=0.888  P=0.651  R=0.823  coverage=1834/1834=1.000  kappa_strict=0.657
  mode:BEM                           n= 31106  kappa=0.620 CI95[0.608,0.632]  AC1=0.771(non-binding)  agree=0.857  P=0.635  R=0.815  coverage=31106/31106=1.000  kappa_strict=0.620
  mode:recall                        n= 15157  kappa=0.079 CI95[0.056,0.106]  AC1=0.943(non-binding)  agree=0.947  P=0.044  R=0.804  coverage=15157/15157=1.000  kappa_strict=0.079
----------------------------------------------------------------------------------------------------
  committed-ESCALATED rows (excluded from kappa): local label distribution {'OWNED': 114, 'OBSERVED': 963, 'SELF_ATTRIBUTED': 380}
  SELF-FAMILY rows (excluded from primary): n=14382 kappa=0.757
----------------------------------------------------------------------------------------------------
  4-way confusion committed(row) x local(col):
                         OWNED  SELF_ATT  OBSERVED    ABSENT   INVALID
    OWNED                  2653       253       129         0         0
    SELF_ATTRIBUTED         572      2810      1301         0         0
    OBSERVED               2471      1936     46930        21         0
    ABSENT                    1         0       189        21         1
    INVALID                   0         0         0         0         0
  breach-flip rows: 5264
----------------------------------------------------------------------------------------------------
  G-B GATE EVALUATION (locked thresholds; AC1 non-binding):
    [FAIL     ] pooled κ ≥ 0.80: κ=0.613
    [FAIL     ] BEM κ ≥ 0.75: κ=0.620
    [PASS     ] recall sensitivity ≥ 0.75: sens=0.804 (n_breach=46)
    [FAIL     ] recall specificity ≥ 0.995: spec=0.947 (n_not=15111)
    [PASS     ] coverage pooled ≥ 0.98: 46263/46263=1.000
    [PASS     ] coverage mode:BEM ≥ 0.97: 31106/31106=1.000
    [PASS     ] coverage mode:recall ≥ 0.97: 15157/15157=1.000
    [PASS     ] |κ − κ_strict| ≤ 0.03: Δ=0.000 (κ_strict=0.613)
    [descriptive] family:gemma: n=196 breach=18 below min-n guard (500/30) — not gated
    [FAIL     ] family:granite κ ≥ 0.65: κ=0.596
    [descriptive] family:internlm: n=131 breach=80 below min-n guard (500/30) — not gated
    [PASS     ] family:mistral κ ≥ 0.65: κ=0.672
    [descriptive] family:phi: n=165 breach=20 below min-n guard (500/30) — not gated
  G-B VERDICT: FAIL
  dump -> C:/Users/joshe/cdms_localjudge_results/scoring/qwen_breach_flips.jsonl
