N=64 noise=0.5 seed=0: 0.3.1 1.913x@2.1 | 0.3.2 race 1.290x@3.4 (4 rates, constant) | Optuna@3 14.405 @7 14.405 @30 1.000
N=64 noise=0.5 seed=1: 0.3.1 2.014x@2.1 | 0.3.2 race 1.686x@3.4 (4 rates, decay) | Optuna@3 11.031 @7 11.031 @30 1.006
N=64 noise=0.5 seed=2: 0.3.1 1.664x@2.1 | 0.3.2 race 1.112x@3.4 (4 rates, constant) | Optuna@3 80.179 @7 80.179 @30 0.978
N=64 noise=0.5 seed=3: 0.3.1 1.629x@2.1 | 0.3.2 race 1.010x@3.4 (4 rates, constant) | Optuna@3 8.988 @7 3.571 @30 0.991
N=64 noise=0.5 seed=4: 0.3.1 2.268x@2.2 | 0.3.2 race 1.531x@3.5 (4 rates, decay) | Optuna@3 26.138 @7 12.477 @30 0.986
N=64 noise=2.0 seed=0: 0.3.1 1.076x@2.1 | 0.3.2 race 1.036x@3.4 (4 rates, constant) | Optuna@3 2.427 @7 2.427 @30 1.001
N=64 noise=2.0 seed=1: 0.3.1 1.311x@2.1 | 0.3.2 race 1.157x@3.4 (4 rates, decay) | Optuna@3 2.134 @7 2.134 @30 1.003
N=64 noise=2.0 seed=2: 0.3.1 1.512x@2.2 | 0.3.2 race 1.200x@3.5 (4 rates, decay) | Optuna@3 10.629 @7 10.629 @30 1.015
N=64 noise=2.0 seed=3: 0.3.1 1.237x@2.1 | 0.3.2 race 1.005x@3.4 (4 rates, decay) | Optuna@3 2.030 @7 1.666 @30 0.983
N=64 noise=2.0 seed=4: 0.3.1 1.389x@2.1 | 0.3.2 race 1.057x@3.4 (4 rates, decay) | Optuna@3 4.802 @7 2.283 @30 0.998
N=256 noise=0.5 seed=0: 0.3.1 0.989x@2.2 | 0.3.2 race 0.967x@3.4 (4 rates, decay) | Optuna@3 0.993 @7 0.993 @30 0.986
N=256 noise=0.5 seed=1: 0.3.1 1.121x@2.1 | 0.3.2 race 0.993x@3.3 (4 rates, decay) | Optuna@3 1.014 @7 1.014 @30 0.999
N=256 noise=0.5 seed=2: 0.3.1 1.207x@2.2 | 0.3.2 race 1.022x@3.4 (4 rates, decay) | Optuna@3 60.932 @7 60.932 @30 1.002
N=256 noise=0.5 seed=3: 0.3.1 1.204x@2.2 | 0.3.2 race 0.989x@3.4 (4 rates, decay) | Optuna@3 1.023 @7 1.023 @30 0.997
N=256 noise=0.5 seed=4: 0.3.1 1.204x@2.2 | 0.3.2 race 1.007x@3.4 (4 rates, decay) | Optuna@3 80.008 @7 1.001 @30 1.001
N=256 noise=2.0 seed=0: 0.3.1 1.008x@2.2 | 0.3.2 race 1.000x@3.4 (4 rates, decay) | Optuna@3 1.017 @7 1.017 @30 0.999
N=256 noise=2.0 seed=1: 0.3.1 1.030x@2.1 | 0.3.2 race 1.016x@3.3 (4 rates, decay) | Optuna@3 1.022 @7 1.022 @30 0.999
N=256 noise=2.0 seed=2: 0.3.1 1.125x@2.1 | 0.3.2 race 1.007x@3.3 (4 rates, decay) | Optuna@3 4.807 @7 4.807 @30 1.001
N=256 noise=2.0 seed=3: 0.3.1 1.061x@2.2 | 0.3.2 race 0.991x@3.4 (4 rates, decay) | Optuna@3 1.017 @7 1.017 @30 0.996
N=256 noise=2.0 seed=4: 0.3.1 1.047x@2.1 | 0.3.2 race 1.000x@3.3 (4 rates, decay) | Optuna@3 6.212 @7 1.013 @30 1.013
N=1024 noise=0.5 seed=0: 0.3.1 1.025x@2.2 | 0.3.2 race 1.009x@3.4 (4 rates, decay) | Optuna@3 1.003 @7 1.003 @30 1.000
N=1024 noise=0.5 seed=1: 0.3.1 1.016x@2.1 | 0.3.2 race 0.992x@3.4 (4 rates, decay) | Optuna@3 1.343 @7 1.343 @30 1.003
N=1024 noise=0.5 seed=2: 0.3.1 0.999x@2.1 | 0.3.2 race 1.000x@3.4 (4 rates, decay) | Optuna@3 1.099 @7 1.099 @30 1.001
N=1024 noise=0.5 seed=3: 0.3.1 1.032x@2.2 | 0.3.2 race 1.022x@3.4 (4 rates, decay) | Optuna@3 1.092 @7 1.092 @30 1.002
N=1024 noise=0.5 seed=4: 0.3.1 1.031x@2.2 | 0.3.2 race 1.016x@3.4 (4 rates, decay) | Optuna@3 1.346 @7 1.346 @30 1.001
N=1024 noise=2.0 seed=0: 0.3.1 1.019x@2.2 | 0.3.2 race 1.000x@3.4 (4 rates, decay) | Optuna@3 1.009 @7 1.009 @30 1.000
N=1024 noise=2.0 seed=1: 0.3.1 0.997x@2.1 | 0.3.2 race 0.995x@3.4 (4 rates, decay) | Optuna@3 1.109 @7 1.109 @30 1.004
N=1024 noise=2.0 seed=2: 0.3.1 1.011x@2.1 | 0.3.2 race 1.004x@3.4 (4 rates, decay) | Optuna@3 1.004 @7 1.004 @30 1.001
N=1024 noise=2.0 seed=3: 0.3.1 1.001x@2.2 | 0.3.2 race 1.003x@4.0 (8 rates, decay) | Optuna@3 1.006 @7 1.006 @30 1.000
N=1024 noise=2.0 seed=4: 0.3.1 1.034x@2.1 | 0.3.2 race 1.004x@3.3 (4 rates, decay) | Optuna@3 1.015 @7 1.015 @30 1.015

median test loss / the 60-rate sweep's best (cost in runs):
  N=64 noise=0.5: 0.3.1 1.913@2.1 | 0.3.2 race 1.290@3.4 | Optuna@3 14.405 @7 12.477 @30 0.991
  N=64 noise=2.0: 0.3.1 1.311@2.1 | 0.3.2 race 1.057@3.4 | Optuna@3 2.427 @7 2.283 @30 1.001
  N=256 noise=0.5: 0.3.1 1.204@2.2 | 0.3.2 race 0.993@3.4 | Optuna@3 1.023 @7 1.014 @30 0.999
  N=256 noise=2.0: 0.3.1 1.047@2.1 | 0.3.2 race 1.000@3.3 | Optuna@3 1.022 @7 1.017 @30 0.999
  N=1024 noise=0.5: 0.3.1 1.025@2.2 | 0.3.2 race 1.009@3.4 | Optuna@3 1.099 @7 1.099 @30 1.001
  N=1024 noise=2.0: 0.3.1 1.011@2.1 | 0.3.2 race 1.003@3.4 | Optuna@3 1.009 @7 1.009 @30 1.001
