poisson-prove · condition  task_id checkout · tool_fail_rate 0.3                                              prove-runs
────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
  lower  violated fell from 0.260 to 0.010 (-0.250) (the paired test (McNemar), q 1.8e-07)                              
  before  0.260 [0.184, 0.354], 26 of 100 episodes                                                                      
  after   0.010 [0.002, 0.054], 1 of 100 episodes                                                                       
          95% Wilson interval on each run's share, per condition, not adjusted                                          
  change  -0.250 [-0.360, -0.165], 97.778% interval (Tango)                                                             
  test    the paired test (McNemar): 0 pairs had violated only after, 25 only before; p 6.0e-08, q 1.8e-07, Holm's p    
          7.7e-07, statistic 25                                                                                         
  rise    0.274: the smallest rise one condition alone would be flagged for, power 0.800, from the observed baseline    
          (McNemar, level 0.003 over 18 tests)                                                                          
  fall    0.201, the same way                                                                                           
  event   violated, its kind not declared; the smallest possible p is 1.6e-30, so a flag can be raised                  
                                                                                                                        
  unchanged  timeout fell from 0.010 to 0.000 (-0.010) (the paired test (McNemar), q 1.000)                             
  before  0.010 [0.002, 0.054], 1 of 100 episodes                                                                       
  after   0.000 [0.000, 0.037], 0 of 100 episodes                                                                       
          95% Wilson interval on each run's share, per condition, not adjusted                                          
  change  -0.010 [-0.067, +0.040], 97.778% interval (Tango)                                                             
  test    the paired test (McNemar): 0 pairs had timeout only after, 1 only before; p 1.000, q 1.000, Holm's p 1.000,   
          statistic 1                                                                                                   
  rise    0.146: the smallest rise one condition alone would be flagged for, power 0.800, from the observed baseline    
          (McNemar, level 0.003 over 18 tests)                                                                          
  fall    none detectable, the same way                                                                                 
  event   timeout, its kind not declared; the smallest possible p is 1.6e-30, so a flag can be raised                   
                                                                                                                        
  compared  mock-agent@v0 2026-10-14 a → b (<comparison-id>)                                                               
  rule      the verdict counts changes at the family-wise level (Holm, q 0.05 over 18 tests); a condition's flag is     
            Benjamini-Hochberg's, at the false discovery rate q 0.05 over 18 tests                                      
  8 more lines above the table: m shows them                                                                            
› episodes  before  26 ended in violated  mock-agent@v0 2026-10-14 a (20261014T035339Z-1add)                            
  episodes  after   1 ended in violated  mock-agent@v0 2026-10-14 b (20261014T035345Z-8381)                             
  episodes  before  1 ended in timeout  mock-agent@v0 2026-10-14 a (20261014T035339Z-1add)                              
  episodes  after   0 ended in timeout  mock-agent@v0 2026-10-14 b (20261014T035345Z-8381)                              
                                                                                                                        
  chart  comparisons/<comparison-id>/1ad7c42d72bbb09d/incidence-violated.html                                          
  chart  comparisons/<comparison-id>/1ad7c42d72bbb09d/incidence-timeout.html                                           
                                                                                                                        
────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────
  ↑↓ move   enter open   esc back   e other event   tab links   y copy   m more   ? help   q quit                       

BBBBBBBBBBBBBDDD         DDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDD                                              DDDDDDDDDD
DDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDD
  BBBBB                                                                                                                 
  DDDDDD                                                                                                                
  DDDDD                                                                                                                 
                                                                                                                        
  DDDDDD                                                                                                                
  DDDD                                                                                                                  
                                                                                                                        
  DDDD                                                                                                                  
                                                                                                                        
  DDDD                                                                                                                  
  DDDDD                                                                                                                 
                                                                                                                        
  BBBBBBBBB                                                                                                             
  DDDDDD                                                                                                                
  DDDDD                                                                                                                 
                                                                                                                        
  DDDDDD                                                                                                                
  DDDD                                                                                                                  
                                                                                                                        
  DDDD                                                                                                                  
                                                                                                                        
  DDDD                                                                                                                  
  DDDDD                                                                                                                 
                                                                                                                        
  DDDDDDDD                                                                                                              
  DDDD                                                                                                                  
                                                                                                                        
  DDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDD                                                                            
VVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVVV
                                                                                                                        
                                                                                                                        
                                                                                                                        
                                                                                                                        
  DDDDD                                                                                                                 
  DDDDD                                                                                                                 
                                                                                                                        
DDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDDD
  BB DDDD   BBBBB DDDD   BBB DDDD   B DDDDDDDDDDD   BBB DDDDD   B DDDD   B DDDD   B DDDD   B DDDD                       
