control (replay vs published): {'A': {'wrong': 33, 'n': 400, 'published': [33, 400]}, 'D_decl': {'wrong': 21, 'n': 398, 'published': [21, 398]}}
gate reads 400 · halts 0 · analysis n 398 · excluded {'NCR': 2}
  raw: {'item': 'ANS:en:usage:6:1', 'family': 'ANS', 'choice': 'sufficient', 'shares': {'sufficient': 0.999518762080691, 'insufficient': 0.0004812379193089395}, 'mass': 0.9999055307792787}
  raw: {'item': 'NCR:pt:security:5:0', 'family': 'NCR', 'choice': 'insufficient', 'shares': {'sufficient': 0.001897247658916726, 'insufficient': 0.9981027523410833}, 'mass': 0.9998630502174416}
  raw: {'item': 'NCR:pt:mcp:3:0', 'family': 'NCR', 'choice': 'sufficient', 'shares': {'sufficient': 0.8514349771799148, 'insufficient': 0.1485650228200852}, 'mass': 0.9985876159176204}

=== rule argmax  (PRIMARY) ===
  arm             n wrong  ANS ans.  abst   gen local      US$  wrong by family
  A             398    32  144/144      0   398     0   0.0634  {'ANS': 0, 'NCP': 2, 'NCR': 30}
  A2            398    33  144/144      0   398     0   0.0637  {'ANS': 0, 'NCP': 4, 'NCR': 29}
  D             398    21  144/144    225   414   414   0.1184  {'ANS': 0, 'NCP': 1, 'NCR': 20}
  ALL-DECLINE   398     0    0/144    398     0     0   0.0000  {'ANS': 0, 'NCP': 0, 'NCR': 0}
  C             398    15  135/144    214   184   398   0.0297  {'ANS': 0, 'NCP': 0, 'NCR': 15}
  C2            398    16  135/144    214   184   398   0.0298  {'ANS': 0, 'NCP': 1, 'NCR': 15}
  C+D           398    14  135/144    242   187   585   0.0440  {'ANS': 0, 'NCP': 0, 'NCR': 14}
  false abstention 9/144 (Wilson [0.03322664827171945, 0.11450903457779044]) · harmless 188 · wrong prevented 17 · D answers lost 9
  pass by family {'ANS': '135/144', 'NCP': '14/112', 'NCR': '35/142'} · by lang {'en': '80/193', 'pt': '104/205'}
  paired C_vs_D    wrong 15 vs 21 · fixed 7 broke 1 · p 0.0703 · diff -0.0151 [-0.033, +0.001]
  paired C_vs_A    wrong 15 vs 32 · fixed 17 broke 0 · p 0.0000 · diff -0.0427 [-0.067, -0.023]
  paired C+D_vs_D  wrong 14 vs 21 · fixed 7 broke 0 · p 0.0156 · diff -0.0176 [-0.035, -0.003]
  paired C2_vs_A2  wrong 16 vs 33 · fixed 17 broke 0 · p 0.0000 · diff -0.0427 [-0.067, -0.023]
  verdict C   {'wrong_le_D': True, 'coverage_ge_D': False, 'fewer_paid_calls': True, 'wins': False}
  verdict C+D {'wrong_le_D': True, 'coverage_ge_D': False, 'fewer_paid_calls': True, 'wins': False}
  random gate {'k': 214, 'wrong_median': 15.0, 'wrong_range': [6, 26], 'coverage_median': 66.0, 'coverage_range': [49, 85], 'share_draws_wrong_le_C': 0.613, 'share_draws_coverage_ge_C': 0.0}

=== rule p>=0.2  (diagnostic) ===
  arm             n wrong  ANS ans.  abst   gen local      US$  wrong by family
  A             398    32  144/144      0   398     0   0.0634  {'ANS': 0, 'NCP': 2, 'NCR': 30}
  A2            398    33  144/144      0   398     0   0.0637  {'ANS': 0, 'NCP': 4, 'NCR': 29}
  D             398    21  144/144    225   414   414   0.1184  {'ANS': 0, 'NCP': 1, 'NCR': 20}
  ALL-DECLINE   398     0    0/144    398     0     0   0.0000  {'ANS': 0, 'NCP': 0, 'NCR': 0}
  C             398    19  141/144    169   229   398   0.0369  {'ANS': 0, 'NCP': 0, 'NCR': 19}
  C2            398    20  141/144    169   229   398   0.0372  {'ANS': 0, 'NCP': 1, 'NCR': 19}
  C+D           398    16  141/144    234   234   632   0.0568  {'ANS': 0, 'NCP': 0, 'NCR': 16}
  false abstention 3/144 (Wilson [0.007110119337292331, 0.05945753330740895]) · harmless 153 · wrong prevented 13 · D answers lost 3
  pass by family {'ANS': '141/144', 'NCP': '27/112', 'NCR': '61/142'} · by lang {'en': '100/193', 'pt': '129/205'}
  paired C_vs_D    wrong 19 vs 21 · fixed 5 broke 3 · p 0.7266 · diff -0.0050 [-0.022, +0.012]
  paired C_vs_A    wrong 19 vs 32 · fixed 13 broke 0 · p 0.0002 · diff -0.0327 [-0.054, -0.015]
  paired C+D_vs_D  wrong 16 vs 21 · fixed 5 broke 0 · p 0.0625 · diff -0.0126 [-0.029, +0.001]
  paired C2_vs_A2  wrong 20 vs 33 · fixed 13 broke 0 · p 0.0002 · diff -0.0327 [-0.054, -0.015]
  verdict C   {'wrong_le_D': True, 'coverage_ge_D': False, 'fewer_paid_calls': True, 'wins': False}
  verdict C+D {'wrong_le_D': True, 'coverage_ge_D': False, 'fewer_paid_calls': True, 'wins': False}

=== rule p>=0.8  (diagnostic) ===
  arm             n wrong  ANS ans.  abst   gen local      US$  wrong by family
  A             398    32  144/144      0   398     0   0.0634  {'ANS': 0, 'NCP': 2, 'NCR': 30}
  A2            398    33  144/144      0   398     0   0.0637  {'ANS': 0, 'NCP': 4, 'NCR': 29}
  D             398    21  144/144    225   414   414   0.1184  {'ANS': 0, 'NCP': 1, 'NCR': 20}
  ALL-DECLINE   398     0    0/144    398     0     0   0.0000  {'ANS': 0, 'NCP': 0, 'NCR': 0}
  C             398     9  126/144    248   150   398   0.0234  {'ANS': 0, 'NCP': 0, 'NCR': 9}
  C2            398     8  126/144    248   150   398   0.0234  {'ANS': 0, 'NCP': 1, 'NCR': 7}
  C+D           398     9  126/144    258   152   550   0.0326  {'ANS': 0, 'NCP': 0, 'NCR': 9}
  false abstention 18/144 (Wilson [0.08055066115247486, 0.18893706700424792]) · harmless 207 · wrong prevented 23 · D answers lost 18
  pass by family {'ANS': '126/144', 'NCP': '4/112', 'NCR': '20/142'} · by lang {'en': '70/193', 'pt': '80/205'}
  paired C_vs_D    wrong 9 vs 21 · fixed 12 broke 0 · p 0.0005 · diff -0.0302 [-0.052, -0.013]
  paired C_vs_A    wrong 9 vs 32 · fixed 23 broke 0 · p 0.0000 · diff -0.0578 [-0.085, -0.036]
  paired C+D_vs_D  wrong 9 vs 21 · fixed 12 broke 0 · p 0.0005 · diff -0.0302 [-0.052, -0.013]
  paired C2_vs_A2  wrong 8 vs 33 · fixed 25 broke 0 · p 0.0000 · diff -0.0628 [-0.091, -0.040]
  verdict C   {'wrong_le_D': True, 'coverage_ge_D': False, 'fewer_paid_calls': True, 'wins': False}
  verdict C+D {'wrong_le_D': True, 'coverage_ge_D': False, 'fewer_paid_calls': True, 'wins': False}

AUROC {'ANS_vs_NC': {'auroc': 0.958005249343832, 'ci95': [0.9383475503062118, 0.9750109361329834], 'n_pos': 144, 'n_neg': 254}, 'ANS_vs_NCR': {'auroc': 0.9438575899843505, 'ci95': [0.9184761345852895, 0.9661091549295775], 'n_pos': 144, 'n_neg': 142}, 'ANS_vs_NCP': {'auroc': 0.9759424603174603, 'ci95': [0.9597594246031746, 0.9885292658730159], 'n_pos': 144, 'n_neg': 112}}
mass {'median': 0.9995938898276786, 'below_0.5': 0} · floor {'n': 100, 'flips': 0, 'max_abs_dp': 0.03402199742138767} · mechanism active True · verdict withheld False
sweep (diagnostic): 0.00:32w/144a/398g 0.05:25w/143a/273g 0.10:23w/143a/250g 0.15:21w/141a/240g 0.20:19w/141a/229g 0.25:17w/139a/218g 0.30:17w/137a/210g 0.35:17w/137a/204g 0.40:16w/136a/195g 0.45:15w/135a/188g 0.50:15w/135a/184g 0.55:14w/134a/180g 0.60:13w/133a/176g 0.65:12w/131a/167g 0.70:11w/129a/160g 0.75:10w/129a/157g 0.80:9w/126a/150g 0.85:8w/124a/144g 0.90:6w/120a/135g 0.95:4w/112a/122g 1.00:0w/0a/0g
