19  HPT PyTorch: Regression

In this tutorial, we will show how spotPython can be integrated into the PyTorch training workflow for regreession tasks.

This document refers to the following software versions:

pip list | grep  "spot[RiverPython]"
spotPython                 0.2.34
spotRiver                  0.0.93
Note: you may need to restart the kernel to use updated packages.

spotPython can be installed via pip. Alternatively, the source code can be downloaded from gitHub: https://github.com/sequential-parameter-optimization/spotPython.

!pip install spotPython
# import sys
# !{sys.executable} -m pip install --upgrade build
# !{sys.executable} -m pip install --upgrade --force-reinstall spotPython

19.1 Setup

Before we consider the detailed experimental setup, we select the parameters that affect run time, initial design size and the device that is used.

MAX_TIME = 1
INIT_SIZE = 5
DEVICE = "cpu" # "cuda:0"
from spotPython.utils.device import getDevice
DEVICE = getDevice(DEVICE)
print(DEVICE)
cpu
import os
import copy
import socket
from datetime import datetime
from dateutil.tz import tzlocal
start_time = datetime.now(tzlocal())
HOSTNAME = socket.gethostname().split(".")[0]
experiment_name = '24-torch' + "_" + HOSTNAME + "_" + str(MAX_TIME) + "min_" + str(INIT_SIZE) + "init_" + str(start_time).split(".", 1)[0].replace(' ', '_')
experiment_name = experiment_name.replace(':', '-')
print(experiment_name)
if not os.path.exists('./figures'):
    os.makedirs('./figures')
24-torch_p040025_1min_5init_2023-06-17_17-12-14

19.2 Initialization of the fun_control Dictionary

spotPython uses a Python dictionary for storing the information required for the hyperparameter tuning process, which was described in Section 14.2.

from spotPython.utils.init import fun_control_init
fun_control = fun_control_init(task="regression",
 tensorboard_path="runs/24_spot_torch_regression",
 device=DEVICE)

19.3 PyTorch Data Loading

# Create dataset
import pandas as pd
import numpy as np
from sklearn import datasets as sklearn_datasets
from sklearn.preprocessing import MinMaxScaler
from sklearn.model_selection import train_test_split
X, y = sklearn_datasets.make_regression(
    n_samples=1000, n_features=10, noise=1, random_state=123)
y = y.reshape(-1, 1)

# Normalize the data
X_scaler = MinMaxScaler()
X_scaled = X_scaler.fit_transform(X)
y_scaler = MinMaxScaler()
y_scaled = y_scaler.fit_transform(y)

# combine the features and target into a single dataframe named train_df
train_df = pd.DataFrame(np.hstack((X_scaled, y_scaled)))

target_column = "y"
n_samples = train_df.shape[0]
n_features = train_df.shape[1] - 1
train_df.columns = [f"x{i}" for i in range(1, n_features+1)] + [target_column]
X_train, X_test, y_train, y_test = train_test_split(train_df.drop(target_column,
    axis=1), 
    train_df[target_column],
    random_state=42,
    test_size=0.25)
trainset = pd.DataFrame(np.hstack((X_train, np.array(y_train).reshape(-1, 1))))
testset = pd.DataFrame(np.hstack((X_test, np.array(y_test).reshape(-1, 1))))
trainset.columns = [f"x{i}" for i in range(1, n_features+1)] + [target_column]
testset.columns = [f"x{i}" for i in range(1, n_features+1)] + [target_column]
print(train_df.shape)
print(trainset.shape)
print(testset.shape)
(1000, 11)
(750, 11)
(250, 11)
import torch
from spotPython.torch.dataframedataset import DataFrameDataset
dtype_x = torch.float32
dtype_y = torch.float32
train_df = DataFrameDataset(train_df, target_column=target_column,
    dtype_x=dtype_x, dtype_y=dtype_y)
train = DataFrameDataset(trainset, target_column=target_column,
    dtype_x=dtype_x, dtype_y=dtype_y)
test = DataFrameDataset(testset, target_column=target_column,
    dtype_x=dtype_x, dtype_y=dtype_y)
n_samples = len(train)
  • Now we can test the data loading:
from spotPython.torch.traintest import create_train_val_data_loaders
trainloader, testloader = create_train_val_data_loaders(train, 2, True, 0)
for i, data in enumerate(trainloader, 0):
    inputs, labels = data
    print(inputs.shape)
    print(labels.shape)
    print(inputs)
    print(labels)
    break
torch.Size([2, 10])
torch.Size([2])
tensor([[0.4824, 0.6253, 0.6091, 0.3038, 0.4388, 0.4672, 0.5827, 0.4695, 0.5167,
         0.5232],
        [0.5597, 0.4178, 0.6872, 0.4921, 0.5263, 0.5966, 0.5321, 0.4294, 0.7451,
         0.5688]])
tensor([0.5030, 0.6076])
  • Since this works fine, we can add the data loading to the fun_control dictionary:
# add the dataset to the fun_control
fun_control.update({"data": train_df, # full dataset,
               "train": train,
               "test": test,
               "n_samples": n_samples,
               "target_column": target_column,})

19.4 The Model (Algorithm) to be Tuned

19.5 Specification of the Preprocessing Model

After the training and test data are specified and added to the fun_control dictionary, spotPython allows the specification of a data preprocessing pipeline, e.g., for the scaling of the data or for the one-hot encoding of categorical variables, see Section 14.4.1. This feature is not used here, so we do not change the default value (which is None).

19.6 Select algorithm and core_model_hyper_dict

19.6.1 Implementing a Configurable Neural Network With spotPython

spotPython includes the Net_lin_reg class which is implemented in the file netregression.py.

This class inherits from the class Net_Core which is implemented in the file netcore.py, see Section 14.4.3.

from torch import nn
import spotPython.torch.netcore as netcore


class Net_lin_reg(netcore.Net_Core):
    def __init__(
        self, _L_in, _L_out, l1, dropout_prob, lr_mult,
        batch_size, epochs, k_folds, patience, optimizer,
        sgd_momentum
    ):
        super(Net_lin_reg, self).__init__(
            lr_mult=lr_mult,
            batch_size=batch_size,
            epochs=epochs,
            k_folds=k_folds,
            patience=patience,
            optimizer=optimizer,
            sgd_momentum=sgd_momentum,
        )
        l2 = max(l1 // 2, 4)
        self.fc1 = nn.Linear(_L_in, l1)
        self.fc2 = nn.Linear(l1, l2)
        self.fc3 = nn.Linear(l2, _L_out)
        self.relu = nn.ReLU()
        self.softmax = nn.Softmax(dim=1)
        self.dropout1 = nn.Dropout(p=dropout_prob)
        self.dropout2 = nn.Dropout(p=dropout_prob / 2)

    def forward(self, x):
        x = self.fc1(x)
        x = self.relu(x)
        x = self.dropout1(x)
        x = self.fc2(x)
        x = self.relu(x)
        x = self.dropout2(x)
        x = self.fc3(x)
        return x

19.6.1.1 The Net_Core class

Net_lin_reg inherits from the class Net_Core which is implemented in the file netcore.py. This class was described in Section 14.4.3.

from spotPython.torch.netregression import Net_lin_reg
from spotPython.data.torch_hyper_dict import TorchHyperDict
from spotPython.hyperparameters.values import add_core_model_to_fun_control
fun_control = add_core_model_to_fun_control(core_model=Net_lin_reg,
                              fun_control=fun_control,
                              hyper_dict=TorchHyperDict,
                              filename=None)

19.7 The Search Space

19.7.1 Configuring the Search Space With spotPython

19.7.1.1 The hyper_dict Hyperparameters for the Selected Algorithm

spotPython uses JSON files for the specification of the hyperparameters, which were described in Section 14.5.2.

The corresponding entries for the Net_lin_reg class are shown below.

    "Net_lin_reg":
    {
        "_L_in": {
            "type": "int",
            "default": 10,
            "transform": "None",
            "lower": 10,
            "upper": 10},
        "_L_out": {
            "type": "int",
            "default": 1,
            "transform": "None",
            "lower": 1,
            "upper": 1},
        "l1": {
            "type": "int",
            "default": 3,
            "transform": "transform_power_2_int",
            "lower": 3,
            "upper": 8},
        "dropout_prob": {
            "type": "float",
            "default": 0.01,
            "transform": "None",
            "lower": 0.0,
            "upper": 0.9},
        "lr_mult": {
            "type": "float",
            "default": 1.0,
            "transform": "None",
            "lower": 0.1,
            "upper": 10.0},
        "batch_size": {
            "type": "int",
            "default": 4,
            "transform": "transform_power_2_int",
            "lower": 1,
            "upper": 4},
        "epochs": {
            "type": "int",
            "default": 4,
            "transform": "transform_power_2_int",
            "lower": 4,
            "upper": 9},
        "k_folds": {
            "type": "int",
            "default": 1,
            "transform": "None",
            "lower": 1,
            "upper": 1},
        "patience": {
            "type": "int",
            "default": 2,
            "transform": "transform_power_2_int",
            "lower": 1,
            "upper": 5
        },
        "optimizer": {
            "levels": ["Adadelta",
                       "Adagrad",
                       "Adam",
                       "AdamW",
                       "SparseAdam",
                       "Adamax",
                       "ASGD",
                       "NAdam",
                       "RAdam",
                       "RMSprop",
                       "Rprop",
                       "SGD"],
            "type": "factor",
            "default": "SGD",
            "transform": "None",
            "class_name": "torch.optim",
            "core_model_parameter_type": "str",
            "lower": 0,
            "upper": 12},
        "sgd_momentum": {
            "type": "float",
            "default": 0.0,
            "transform": "None",
            "lower": 0.0,
            "upper": 1.0}
    },

19.8 Modifying the Hyperparameters

spotPython provides functions for modifying the hyperparameters, their bounds and factors as well as for activating and de-activating hyperparameters without re-compilation of the Python source code. These functions were described in Section 14.5.3.

19.8.1 Modify hyper_dict Hyperparameters for the Selected Algorithm aka core_model

19.8.1.1 Modify Hyperparameters of Type numeric and integer (boolean)

from spotPython.hyperparameters.values import modify_hyper_parameter_bounds

fun_control = modify_hyper_parameter_bounds(fun_control, "epochs", bounds=[2, 16])
fun_control = modify_hyper_parameter_bounds(fun_control, "patience", bounds=[3, 7])

19.8.1.2 Modify Hyperparameter of Type factor

from spotPython.hyperparameters.values import modify_hyper_parameter_levels
fun_control = modify_hyper_parameter_levels(fun_control, "optimizer",
    ["Adadelta", "Adagrad", "Adam", "AdamW", "Adamax", "ASGD", "NAdam"])


fun_control.update({
               "_L_in": n_features,
               "_L_out": 1,})

19.8.2 Optimizers

Optimizers are described in Section 14.6.

19.9 Evaluation

The evaluation procedure requires the specification of two elements:

  1. the way how the data is split into a train and a test set (see Section 14.7)
  2. the loss function (and a metric).

19.9.1 Loss Functions and Metrics

The key "loss_function" specifies the loss function which is used during the optimization, see Section 14.8.

We will use MSE loss for the regression task.

from torch.nn import MSELoss
loss_torch = MSELoss()
fun_control.update({"loss_function": loss_torch})

19.9.2 Metric

from torchmetrics import MeanAbsoluteError
metric_torch = MeanAbsoluteError().to(fun_control["device"])
fun_control.update({"metric_torch": metric_torch})

19.10 Preparing the SPOT Call

The following code passes the information about the parameter ranges and bounds to spot.

# extract the variable types, names, and bounds
from spotPython.hyperparameters.values import (get_bound_values,
    get_var_name,
    get_var_type,)
var_type = get_var_type(fun_control)
var_name = get_var_name(fun_control)
fun_control.update({"var_type": var_type,
                    "var_name": var_name})
lower = get_bound_values(fun_control, "lower")
upper = get_bound_values(fun_control, "upper")
from spotPython.utils.eda import gen_design_table
print(gen_design_table(fun_control))
| name         | type   | default   |   lower |   upper | transform             |
|--------------|--------|-----------|---------|---------|-----------------------|
| _L_in        | int    | 10        |    10   |    10   | None                  |
| _L_out       | int    | 1         |     1   |     1   | None                  |
| l1           | int    | 3         |     3   |     8   | transform_power_2_int |
| dropout_prob | float  | 0.01      |     0   |     0.9 | None                  |
| lr_mult      | float  | 1.0       |     0.1 |    10   | None                  |
| batch_size   | int    | 4         |     1   |     4   | transform_power_2_int |
| epochs       | int    | 4         |     2   |    16   | transform_power_2_int |
| k_folds      | int    | 1         |     1   |     1   | None                  |
| patience     | int    | 2         |     3   |     7   | transform_power_2_int |
| optimizer    | factor | SGD       |     0   |     6   | None                  |
| sgd_momentum | float  | 0.0       |     0   |     1   | None                  |

19.11 The Objective Function fun_torch

The objective function fun_torch is selected next. It implements an interface from PyTorch’s training, validation, and testing methods to spotPython.

from spotPython.fun.hypertorch import HyperTorch
fun = HyperTorch().fun_torch
from spotPython.hyperparameters.values import get_default_hyperparameters_as_array
hyper_dict=TorchHyperDict().load()
X_start = get_default_hyperparameters_as_array(fun_control, hyper_dict)

19.12 Starting the Hyperparameter Tuning

The spotPython hyperparameter tuning is started by calling the Spot function as described in Section 14.12.

from spotPython.spot import spot
from math import inf
spot_tuner = spot.Spot(fun=fun,
                   lower = lower,
                   upper = upper,
                   fun_evals = inf,
                   fun_repeats = 1,
                   max_time = MAX_TIME,
                   noise = False,
                   tolerance_x = np.sqrt(np.spacing(1)),
                   var_type = var_type,
                   var_name = var_name,
                   infill_criterion = "y",
                   n_points = 1,
                   seed=123,
                   log_level = 50,
                   show_models= False,
                   show_progress= True,
                   fun_control = fun_control,
                   design_control={"init_size": INIT_SIZE,
                                   "repeats": 1},
                   surrogate_control={"noise": True,
                                      "cod_type": "norm",
                                      "min_theta": -4,
                                      "max_theta": 3,
                                      "n_theta": len(var_name),
                                      "model_fun_evals": 10_000,
                                      "log_level": 50
                                      })
spot_tuner.run(X_start=X_start)

config: {'_L_in': 10, '_L_out': 1, 'l1': 64, 'dropout_prob': 0.7103122166156, 'lr_mult': 3.62368745191023, 'batch_size': 8, 'epochs': 128, 'k_folds': 1, 'patience': 16, 'optimizer': 'Adam', 'sgd_momentum': 0.5446851204405787}
Epoch: 1
Loss on hold-out set: 0.04756716045698053
MeanAbsoluteError value on hold-out data: 0.1730315387248993
Epoch: 2
Loss on hold-out set: 0.03550707387100709
MeanAbsoluteError value on hold-out data: 0.1474880427122116
Epoch: 3
Loss on hold-out set: 0.033306048852146455
MeanAbsoluteError value on hold-out data: 0.14351294934749603
Epoch: 4
Loss on hold-out set: 0.02441786004132346
MeanAbsoluteError value on hold-out data: 0.12299526482820511
Epoch: 5
Loss on hold-out set: 0.027666998806556587
MeanAbsoluteError value on hold-out data: 0.13295623660087585
Epoch: 6
Loss on hold-out set: 0.02629421609698942
MeanAbsoluteError value on hold-out data: 0.12938851118087769
Epoch: 7
Loss on hold-out set: 0.02436501162714864
MeanAbsoluteError value on hold-out data: 0.12449371069669724
Epoch: 8
Loss on hold-out set: 0.02325265571524046
MeanAbsoluteError value on hold-out data: 0.11915665864944458
Epoch: 9
Loss on hold-out set: 0.022695431216178757
MeanAbsoluteError value on hold-out data: 0.12231993675231934
Epoch: 10
Loss on hold-out set: 0.02190949944289107
MeanAbsoluteError value on hold-out data: 0.1169370636343956
Epoch: 11
Loss on hold-out set: 0.022504474477548348
MeanAbsoluteError value on hold-out data: 0.11758717894554138
Epoch: 12
Loss on hold-out set: 0.019249390504371963
MeanAbsoluteError value on hold-out data: 0.10710649937391281
Epoch: 13
Loss on hold-out set: 0.019493088493809888
MeanAbsoluteError value on hold-out data: 0.10847558081150055
Epoch: 14
Loss on hold-out set: 0.018019062062529356
MeanAbsoluteError value on hold-out data: 0.10812432318925858
Epoch: 15
Loss on hold-out set: 0.018879466886190993
MeanAbsoluteError value on hold-out data: 0.10460875928401947
Epoch: 16
Loss on hold-out set: 0.019348414161389594
MeanAbsoluteError value on hold-out data: 0.10767313838005066
Epoch: 17
Loss on hold-out set: 0.015377521833502933
MeanAbsoluteError value on hold-out data: 0.09604329615831375
Epoch: 18
Loss on hold-out set: 0.016069787683112447
MeanAbsoluteError value on hold-out data: 0.09724874794483185
Epoch: 19
Loss on hold-out set: 0.016465385426080933
MeanAbsoluteError value on hold-out data: 0.09914035350084305
Epoch: 20
Loss on hold-out set: 0.014547210640126937
MeanAbsoluteError value on hold-out data: 0.09723448753356934
Epoch: 21
Loss on hold-out set: 0.01349735837184677
MeanAbsoluteError value on hold-out data: 0.09136247634887695
Epoch: 22
Loss on hold-out set: 0.01517634605376148
MeanAbsoluteError value on hold-out data: 0.09611362963914871
Epoch: 23
Loss on hold-out set: 0.01343248393018975
MeanAbsoluteError value on hold-out data: 0.08998894691467285
Epoch: 24
Loss on hold-out set: 0.011019492184890336
MeanAbsoluteError value on hold-out data: 0.08171439170837402
Epoch: 25
Loss on hold-out set: 0.018049278909242468
MeanAbsoluteError value on hold-out data: 0.10895397514104843
Epoch: 26
Loss on hold-out set: 0.011646268717748555
MeanAbsoluteError value on hold-out data: 0.08307880908250809
Epoch: 27
Loss on hold-out set: 0.013046959219010253
MeanAbsoluteError value on hold-out data: 0.09000228345394135
Epoch: 28
Loss on hold-out set: 0.01313130076557986
MeanAbsoluteError value on hold-out data: 0.0888473317027092
Epoch: 29
Loss on hold-out set: 0.011688519207956759
MeanAbsoluteError value on hold-out data: 0.08549283444881439
Epoch: 30
Loss on hold-out set: 0.011451597500126809
MeanAbsoluteError value on hold-out data: 0.08077684044837952
Epoch: 31
Loss on hold-out set: 0.012749804183840752
MeanAbsoluteError value on hold-out data: 0.08812115341424942
Epoch: 32
Loss on hold-out set: 0.012837009951717368
MeanAbsoluteError value on hold-out data: 0.08824317902326584
Epoch: 33
Loss on hold-out set: 0.014677469937228843
MeanAbsoluteError value on hold-out data: 0.09312234073877335
Epoch: 34
Loss on hold-out set: 0.01034737060973911
MeanAbsoluteError value on hold-out data: 0.0783887580037117
Epoch: 35
Loss on hold-out set: 0.01293464506804747
MeanAbsoluteError value on hold-out data: 0.08673838526010513
Epoch: 36
Loss on hold-out set: 0.011428184960478623
MeanAbsoluteError value on hold-out data: 0.08396846801042557
Epoch: 37
Loss on hold-out set: 0.008989775908718767
MeanAbsoluteError value on hold-out data: 0.0768265649676323
Epoch: 38
Loss on hold-out set: 0.010812989331928915
MeanAbsoluteError value on hold-out data: 0.08218038827180862
Epoch: 39
Loss on hold-out set: 0.00972755231487099
MeanAbsoluteError value on hold-out data: 0.07499739527702332
Epoch: 40
Loss on hold-out set: 0.011888355574276494
MeanAbsoluteError value on hold-out data: 0.07958000153303146
Epoch: 41
Loss on hold-out set: 0.010220366309543974
MeanAbsoluteError value on hold-out data: 0.07763081789016724
Epoch: 42
Loss on hold-out set: 0.010597230327364645
MeanAbsoluteError value on hold-out data: 0.08024778962135315
Epoch: 43
Loss on hold-out set: 0.014588615336259337
MeanAbsoluteError value on hold-out data: 0.0977574959397316
Epoch: 44
Loss on hold-out set: 0.010591009931981955
MeanAbsoluteError value on hold-out data: 0.08018942922353745
Epoch: 45
Loss on hold-out set: 0.011320223272042839
MeanAbsoluteError value on hold-out data: 0.07990773022174835
Epoch: 46
Loss on hold-out set: 0.014232796846619366
MeanAbsoluteError value on hold-out data: 0.09149748831987381
Epoch: 47
Loss on hold-out set: 0.012102904754053605
MeanAbsoluteError value on hold-out data: 0.08800232410430908
Epoch: 48
Loss on hold-out set: 0.010057776878391834
MeanAbsoluteError value on hold-out data: 0.0772717297077179
Epoch: 49
Loss on hold-out set: 0.010509379771783164
MeanAbsoluteError value on hold-out data: 0.07864141464233398
Epoch: 50
Loss on hold-out set: 0.008743960747348243
MeanAbsoluteError value on hold-out data: 0.0709068775177002
Epoch: 51
Loss on hold-out set: 0.010159296423999445
MeanAbsoluteError value on hold-out data: 0.07974462956190109
Epoch: 52
Loss on hold-out set: 0.01051356372619538
MeanAbsoluteError value on hold-out data: 0.07753109186887741
Epoch: 53
Loss on hold-out set: 0.008823567088448295
MeanAbsoluteError value on hold-out data: 0.07444192469120026
Epoch: 54
Loss on hold-out set: 0.008176452976553455
MeanAbsoluteError value on hold-out data: 0.07074644416570663
Epoch: 55
Loss on hold-out set: 0.00902248455799724
MeanAbsoluteError value on hold-out data: 0.07078810036182404
Epoch: 56
Loss on hold-out set: 0.009952596410202156
MeanAbsoluteError value on hold-out data: 0.07707291096448898
Epoch: 57
Loss on hold-out set: 0.010939083674824551
MeanAbsoluteError value on hold-out data: 0.0808844119310379
Epoch: 58
Loss on hold-out set: 0.009328995760848844
MeanAbsoluteError value on hold-out data: 0.07061175256967545
Epoch: 59
Loss on hold-out set: 0.010471669889643397
MeanAbsoluteError value on hold-out data: 0.07877392321825027
Epoch: 60
Loss on hold-out set: 0.010303781349457017
MeanAbsoluteError value on hold-out data: 0.07665939629077911
Epoch: 61
Loss on hold-out set: 0.009374280104805765
MeanAbsoluteError value on hold-out data: 0.07055961340665817
Epoch: 62
Loss on hold-out set: 0.008949762749436655
MeanAbsoluteError value on hold-out data: 0.07141201943159103
Epoch: 63
Loss on hold-out set: 0.010521291516182063
MeanAbsoluteError value on hold-out data: 0.07681593298912048
Epoch: 64
Loss on hold-out set: 0.00819973530566418
MeanAbsoluteError value on hold-out data: 0.0712318941950798
Epoch: 65
Loss on hold-out set: 0.009715349220450184
MeanAbsoluteError value on hold-out data: 0.07507050037384033
Epoch: 66
Loss on hold-out set: 0.010654130806582734
MeanAbsoluteError value on hold-out data: 0.07595879584550858
Epoch: 67
Loss on hold-out set: 0.007426840718835592
MeanAbsoluteError value on hold-out data: 0.0658499076962471
Epoch: 68
Loss on hold-out set: 0.008413475852361635
MeanAbsoluteError value on hold-out data: 0.07091933488845825
Epoch: 69
Loss on hold-out set: 0.008897620737307557
MeanAbsoluteError value on hold-out data: 0.07083619385957718
Epoch: 70
Loss on hold-out set: 0.009507225538407894
MeanAbsoluteError value on hold-out data: 0.0715097188949585
Epoch: 71
Loss on hold-out set: 0.010388879993881443
MeanAbsoluteError value on hold-out data: 0.0775178074836731
Epoch: 72
Loss on hold-out set: 0.011419915453236746
MeanAbsoluteError value on hold-out data: 0.0800580307841301
Epoch: 73
Loss on hold-out set: 0.011305031538205711
MeanAbsoluteError value on hold-out data: 0.0800563171505928
Epoch: 74
Loss on hold-out set: 0.00911649912105579
MeanAbsoluteError value on hold-out data: 0.07303250581026077
Epoch: 75
Loss on hold-out set: 0.011775356895094248
MeanAbsoluteError value on hold-out data: 0.0863780602812767
Epoch: 76
Loss on hold-out set: 0.009036743054534063
MeanAbsoluteError value on hold-out data: 0.0709129348397255
Epoch: 77
Loss on hold-out set: 0.009523978193388566
MeanAbsoluteError value on hold-out data: 0.074127696454525
Epoch: 78
Loss on hold-out set: 0.009821503754018954
MeanAbsoluteError value on hold-out data: 0.0711762011051178
Epoch: 79
Loss on hold-out set: 0.009870674090435435
MeanAbsoluteError value on hold-out data: 0.07378025352954865
Epoch: 80
Loss on hold-out set: 0.008592999316629414
MeanAbsoluteError value on hold-out data: 0.07083147019147873
Epoch: 81
Loss on hold-out set: 0.008828655746152722
MeanAbsoluteError value on hold-out data: 0.07077425718307495
Epoch: 82
Loss on hold-out set: 0.01035147954060353
MeanAbsoluteError value on hold-out data: 0.07359737902879715
Epoch: 83
Loss on hold-out set: 0.008900591944295325
MeanAbsoluteError value on hold-out data: 0.06947099417448044
Early stopping at epoch 82
Returned to Spot: Validation loss: 0.008900591944295325
----------------------------------------------

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.19981931523998656, 'lr_mult': 7.004318498645526, 'batch_size': 16, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.07401195908206384}
Epoch: 1
Loss on hold-out set: 0.05714042788665546
MeanAbsoluteError value on hold-out data: 0.196258082985878
Epoch: 2
Loss on hold-out set: 0.06819403622495501
MeanAbsoluteError value on hold-out data: 0.21952258050441742
Epoch: 3
Loss on hold-out set: 0.11124056107119511
MeanAbsoluteError value on hold-out data: 0.29239678382873535
Epoch: 4
Loss on hold-out set: 0.09533474947276868
MeanAbsoluteError value on hold-out data: 0.26955556869506836
Epoch: 5
Loss on hold-out set: 0.051914874170171585
MeanAbsoluteError value on hold-out data: 0.19391055405139923
Epoch: 6
Loss on hold-out set: 0.08955072082187
MeanAbsoluteError value on hold-out data: 0.2676328718662262
Epoch: 7
Loss on hold-out set: 0.08046182362656844
MeanAbsoluteError value on hold-out data: 0.2542583644390106
Epoch: 8
Loss on hold-out set: 0.07941330577197828
MeanAbsoluteError value on hold-out data: 0.25117573142051697
Epoch: 9
Loss on hold-out set: 0.08681665302107208
MeanAbsoluteError value on hold-out data: 0.2707924246788025
Epoch: 10
Loss on hold-out set: 0.09158471501187275
MeanAbsoluteError value on hold-out data: 0.2789772152900696
Epoch: 11
Loss on hold-out set: 0.09421000747304213
MeanAbsoluteError value on hold-out data: 0.2872239649295807
Epoch: 12
Loss on hold-out set: 0.08551583988101859
MeanAbsoluteError value on hold-out data: 0.2716744542121887
Epoch: 13
Loss on hold-out set: 0.09950531391721022
MeanAbsoluteError value on hold-out data: 0.29529333114624023
Epoch: 14
Loss on hold-out set: 0.06816948283659785
MeanAbsoluteError value on hold-out data: 0.24041996896266937
Epoch: 15
Loss on hold-out set: 0.046500539407134056
MeanAbsoluteError value on hold-out data: 0.19376447796821594
Epoch: 16
Loss on hold-out set: 0.06770044231885358
MeanAbsoluteError value on hold-out data: 0.24178873002529144
Epoch: 17
Loss on hold-out set: 0.05287767221268855
MeanAbsoluteError value on hold-out data: 0.21015307307243347
Epoch: 18
Loss on hold-out set: 0.03491756437640441
MeanAbsoluteError value on hold-out data: 0.1671946942806244
Epoch: 19
Loss on hold-out set: 0.07375836313555115
MeanAbsoluteError value on hold-out data: 0.25360575318336487
Epoch: 20
Loss on hold-out set: 0.044861012089409326
MeanAbsoluteError value on hold-out data: 0.193233922123909
Epoch: 21
Loss on hold-out set: 0.051107067418725866
MeanAbsoluteError value on hold-out data: 0.21098536252975464
Epoch: 22
Loss on hold-out set: 0.037569730297515265
MeanAbsoluteError value on hold-out data: 0.1786845475435257
Epoch: 23
Loss on hold-out set: 0.05190536634702431
MeanAbsoluteError value on hold-out data: 0.21270520985126495
Epoch: 24
Loss on hold-out set: 0.02419125847518444
MeanAbsoluteError value on hold-out data: 0.1403767466545105
Epoch: 25
Loss on hold-out set: 0.05571037981855242
MeanAbsoluteError value on hold-out data: 0.21762436628341675
Epoch: 26
Loss on hold-out set: 0.04617020419161571
MeanAbsoluteError value on hold-out data: 0.19541685283184052
Epoch: 27
Loss on hold-out set: 0.0409369527509338
MeanAbsoluteError value on hold-out data: 0.18819409608840942
Epoch: 28
Loss on hold-out set: 0.04514525811138906
MeanAbsoluteError value on hold-out data: 0.19731983542442322
Epoch: 29
Loss on hold-out set: 0.04158846337936426
MeanAbsoluteError value on hold-out data: 0.18263199925422668
Epoch: 30
Loss on hold-out set: 0.05241221522814349
MeanAbsoluteError value on hold-out data: 0.213044211268425
Epoch: 31
Loss on hold-out set: 0.017384580973731845
MeanAbsoluteError value on hold-out data: 0.11611254513263702
Epoch: 32
Loss on hold-out set: 0.028565358370542526
MeanAbsoluteError value on hold-out data: 0.15350380539894104
Epoch: 33
Loss on hold-out set: 0.030573668252480656
MeanAbsoluteError value on hold-out data: 0.16008450090885162
Epoch: 34
Loss on hold-out set: 0.011893070646022496
MeanAbsoluteError value on hold-out data: 0.09382077306509018
Epoch: 35
Loss on hold-out set: 0.05378605248896699
MeanAbsoluteError value on hold-out data: 0.21681149303913116
Epoch: 36
Loss on hold-out set: 0.02759445311599656
MeanAbsoluteError value on hold-out data: 0.15210497379302979
Epoch: 37
Loss on hold-out set: 0.019025430328359728
MeanAbsoluteError value on hold-out data: 0.12371476739645004
Epoch: 38
Loss on hold-out set: 0.05935452309878249
MeanAbsoluteError value on hold-out data: 0.2294108271598816
Epoch: 39
Loss on hold-out set: 0.024063628657083763
MeanAbsoluteError value on hold-out data: 0.14118655025959015
Epoch: 40
Loss on hold-out set: 0.004688028650554388
MeanAbsoluteError value on hold-out data: 0.05071413516998291
Epoch: 41
Loss on hold-out set: 0.062288941717461535
MeanAbsoluteError value on hold-out data: 0.236481174826622
Epoch: 42
Loss on hold-out set: 0.04533956003816504
MeanAbsoluteError value on hold-out data: 0.20052437484264374
Epoch: 43
Loss on hold-out set: 0.048549281727326546
MeanAbsoluteError value on hold-out data: 0.2041630744934082
Epoch: 44
Loss on hold-out set: 0.019743321365431735
MeanAbsoluteError value on hold-out data: 0.12575621902942657
Epoch: 45
Loss on hold-out set: 0.00658693941506116
MeanAbsoluteError value on hold-out data: 0.06837402284145355
Epoch: 46
Loss on hold-out set: 0.043119025269621296
MeanAbsoluteError value on hold-out data: 0.1901431828737259
Epoch: 47
Loss on hold-out set: 0.00811050295535671
MeanAbsoluteError value on hold-out data: 0.0748080164194107
Epoch: 48
Loss on hold-out set: 0.01333735912646118
MeanAbsoluteError value on hold-out data: 0.10199254006147385
Epoch: 49
Loss on hold-out set: 0.05291542175569033
MeanAbsoluteError value on hold-out data: 0.21004906296730042
Epoch: 50
Loss on hold-out set: 0.04660783168908797
MeanAbsoluteError value on hold-out data: 0.20027871429920197
Epoch: 51
Loss on hold-out set: 0.006240577093864742
MeanAbsoluteError value on hold-out data: 0.06082041934132576
Epoch: 52
Loss on hold-out set: 0.10719573242883933
MeanAbsoluteError value on hold-out data: 0.30557289719581604
Epoch: 53
Loss on hold-out set: 0.016106773609001385
MeanAbsoluteError value on hold-out data: 0.1056932732462883
Epoch: 54
Loss on hold-out set: 0.022911386613390948
MeanAbsoluteError value on hold-out data: 0.13509733974933624
Epoch: 55
Loss on hold-out set: 0.024206481187751417
MeanAbsoluteError value on hold-out data: 0.14191319048404694
Epoch: 56
Loss on hold-out set: 0.00929312518258628
MeanAbsoluteError value on hold-out data: 0.08333174884319305
Epoch: 57
Loss on hold-out set: 0.062119108673773314
MeanAbsoluteError value on hold-out data: 0.23861932754516602
Epoch: 58
Loss on hold-out set: 0.030742264989959567
MeanAbsoluteError value on hold-out data: 0.16244368255138397
Epoch: 59
Loss on hold-out set: 0.005619497675644724
MeanAbsoluteError value on hold-out data: 0.06117623671889305
Epoch: 60
Loss on hold-out set: 0.03016309087213717
MeanAbsoluteError value on hold-out data: 0.154178649187088
Epoch: 61
Loss on hold-out set: 0.025128500585101153
MeanAbsoluteError value on hold-out data: 0.1398855447769165
Epoch: 62
Loss on hold-out set: 0.029869132430145617
MeanAbsoluteError value on hold-out data: 0.15519779920578003
Epoch: 63
Loss on hold-out set: 0.0347008072820149
MeanAbsoluteError value on hold-out data: 0.16772989928722382
Epoch: 64
Loss on hold-out set: 0.015288371053573332
MeanAbsoluteError value on hold-out data: 0.10923511534929276
Epoch: 65
Loss on hold-out set: 0.022003992852803907
MeanAbsoluteError value on hold-out data: 0.13253699243068695
Epoch: 66
Loss on hold-out set: 0.003994771022055494
MeanAbsoluteError value on hold-out data: 0.04994754120707512
Epoch: 67
Loss on hold-out set: 0.003103599411827561
MeanAbsoluteError value on hold-out data: 0.04429452121257782
Epoch: 68
Loss on hold-out set: 0.03607370175029102
MeanAbsoluteError value on hold-out data: 0.17718757688999176
Epoch: 69
Loss on hold-out set: 0.012994317043768732
MeanAbsoluteError value on hold-out data: 0.10107450187206268
Epoch: 70
Loss on hold-out set: 0.011148878667307528
MeanAbsoluteError value on hold-out data: 0.09090117365121841
Epoch: 71
Loss on hold-out set: 0.03571437083576855
MeanAbsoluteError value on hold-out data: 0.1796012669801712
Epoch: 72
Loss on hold-out set: 0.021570782030099316
MeanAbsoluteError value on hold-out data: 0.1305653303861618
Epoch: 73
Loss on hold-out set: 0.020120607590989062
MeanAbsoluteError value on hold-out data: 0.1268938183784485
Epoch: 74
Loss on hold-out set: 0.005572846674017216
MeanAbsoluteError value on hold-out data: 0.05410320311784744
Epoch: 75
Loss on hold-out set: 0.023998974087206942
MeanAbsoluteError value on hold-out data: 0.14570081233978271
Epoch: 76
Loss on hold-out set: 0.04124456389169944
MeanAbsoluteError value on hold-out data: 0.1907782107591629
Epoch: 77
Loss on hold-out set: 0.026055371976996724
MeanAbsoluteError value on hold-out data: 0.1496647447347641
Epoch: 78
Loss on hold-out set: 0.01441080088874227
MeanAbsoluteError value on hold-out data: 0.1080111414194107
Epoch: 79
Loss on hold-out set: 0.009577524627705938
MeanAbsoluteError value on hold-out data: 0.08552009612321854
Epoch: 80
Loss on hold-out set: 0.024750234167042532
MeanAbsoluteError value on hold-out data: 0.14082790911197662
Epoch: 81
Loss on hold-out set: 0.030638584965153745
MeanAbsoluteError value on hold-out data: 0.15944190323352814
Epoch: 82
Loss on hold-out set: 0.014047615303608933
MeanAbsoluteError value on hold-out data: 0.10248132050037384
Epoch: 83
Loss on hold-out set: 0.023445379037998225
MeanAbsoluteError value on hold-out data: 0.1379530280828476
Epoch: 84
Loss on hold-out set: 0.006603464569994493
MeanAbsoluteError value on hold-out data: 0.06658899039030075
Epoch: 85
Loss on hold-out set: 0.04938908431090807
MeanAbsoluteError value on hold-out data: 0.20437441766262054
Epoch: 86
Loss on hold-out set: 0.006673424553714301
MeanAbsoluteError value on hold-out data: 0.0658579096198082
Epoch: 87
Loss on hold-out set: 0.06335006477801423
MeanAbsoluteError value on hold-out data: 0.2407539337873459
Epoch: 88
Loss on hold-out set: 0.024692821463471966
MeanAbsoluteError value on hold-out data: 0.14575694501399994
Epoch: 89
Loss on hold-out set: 0.013244972711330965
MeanAbsoluteError value on hold-out data: 0.09836065024137497
Epoch: 90
Loss on hold-out set: 0.008575650495722106
MeanAbsoluteError value on hold-out data: 0.0704338476061821
Epoch: 91
Loss on hold-out set: 0.0026318405227931706
MeanAbsoluteError value on hold-out data: 0.0422031544148922
Epoch: 92
Loss on hold-out set: 0.029692338975636584
MeanAbsoluteError value on hold-out data: 0.16196885704994202
Epoch: 93
Loss on hold-out set: 0.04618232540394131
MeanAbsoluteError value on hold-out data: 0.19176389276981354
Epoch: 94
Loss on hold-out set: 0.0086801564075837
MeanAbsoluteError value on hold-out data: 0.0789569690823555
Epoch: 95
Loss on hold-out set: 0.026352358736882086
MeanAbsoluteError value on hold-out data: 0.1460484117269516
Epoch: 96
Loss on hold-out set: 0.013220021550200488
MeanAbsoluteError value on hold-out data: 0.10111162066459656
Epoch: 97
Loss on hold-out set: 0.002594337360565796
MeanAbsoluteError value on hold-out data: 0.035473451018333435
Epoch: 98
Loss on hold-out set: 0.03109046140391576
MeanAbsoluteError value on hold-out data: 0.15835995972156525
Epoch: 99
Loss on hold-out set: 0.007262847141215676
MeanAbsoluteError value on hold-out data: 0.06860802322626114
Epoch: 100
Loss on hold-out set: 0.05890462351472754
MeanAbsoluteError value on hold-out data: 0.23258662223815918
Epoch: 101
Loss on hold-out set: 0.011675510383946331
MeanAbsoluteError value on hold-out data: 0.09568705409765244
Epoch: 102
Loss on hold-out set: 0.01672241184860468
MeanAbsoluteError value on hold-out data: 0.11220179498195648
Epoch: 103
Loss on hold-out set: 0.036484258837605775
MeanAbsoluteError value on hold-out data: 0.17204108834266663
Epoch: 104
Loss on hold-out set: 0.00438867073113981
MeanAbsoluteError value on hold-out data: 0.051188573241233826
Epoch: 105
Loss on hold-out set: 0.05691108480095863
MeanAbsoluteError value on hold-out data: 0.22322684526443481
Epoch: 106
Loss on hold-out set: 0.0017708888749199871
MeanAbsoluteError value on hold-out data: 0.030722754076123238
Epoch: 107
Loss on hold-out set: 0.0263456583611275
MeanAbsoluteError value on hold-out data: 0.1421354115009308
Epoch: 108
Loss on hold-out set: 0.002244264723757576
MeanAbsoluteError value on hold-out data: 0.03397223353385925
Epoch: 109
Loss on hold-out set: 0.0074816683527866475
MeanAbsoluteError value on hold-out data: 0.07442715018987656
Epoch: 110
Loss on hold-out set: 0.008900052083558157
MeanAbsoluteError value on hold-out data: 0.07960707694292068
Epoch: 111
Loss on hold-out set: 0.011713584002695586
MeanAbsoluteError value on hold-out data: 0.0855242982506752
Epoch: 112
Loss on hold-out set: 0.005263768896264465
MeanAbsoluteError value on hold-out data: 0.05509323626756668
Epoch: 113
Loss on hold-out set: 0.009779219295045263
MeanAbsoluteError value on hold-out data: 0.08587221801280975
Epoch: 114
Loss on hold-out set: 0.052581044208062325
MeanAbsoluteError value on hold-out data: 0.21108335256576538
Epoch: 115
Loss on hold-out set: 0.008360459714343673
MeanAbsoluteError value on hold-out data: 0.07871450483798981
Epoch: 116
Loss on hold-out set: 0.014317905432299563
MeanAbsoluteError value on hold-out data: 0.09627550095319748
Epoch: 117
Loss on hold-out set: 0.008996453283256605
MeanAbsoluteError value on hold-out data: 0.08210601657629013
Epoch: 118
Loss on hold-out set: 0.00422298166239144
MeanAbsoluteError value on hold-out data: 0.05084279552102089
Epoch: 119
Loss on hold-out set: 0.0123847175977732
MeanAbsoluteError value on hold-out data: 0.09481793642044067
Epoch: 120
Loss on hold-out set: 0.008709991203719064
MeanAbsoluteError value on hold-out data: 0.0845244899392128
Epoch: 121
Loss on hold-out set: 0.030261078751400897
MeanAbsoluteError value on hold-out data: 0.14951571822166443
Epoch: 122
Loss on hold-out set: 0.030731553996079845
MeanAbsoluteError value on hold-out data: 0.16167302429676056
Epoch: 123
Loss on hold-out set: 0.014676805389554877
MeanAbsoluteError value on hold-out data: 0.11337821930646896
Epoch: 124
Loss on hold-out set: 0.00243557629016179
MeanAbsoluteError value on hold-out data: 0.03789716958999634
Epoch: 125
Loss on hold-out set: 0.05119089958699126
MeanAbsoluteError value on hold-out data: 0.21606005728244781
Epoch: 126
Loss on hold-out set: 0.002094444831048972
MeanAbsoluteError value on hold-out data: 0.034043170511722565
Epoch: 127
Loss on hold-out set: 0.008678018311528783
MeanAbsoluteError value on hold-out data: 0.07120886445045471
Epoch: 128
Loss on hold-out set: 0.003917701977403148
MeanAbsoluteError value on hold-out data: 0.04486728459596634
Epoch: 129
Loss on hold-out set: 0.03401440597678486
MeanAbsoluteError value on hold-out data: 0.1743471920490265
Epoch: 130
Loss on hold-out set: 0.05980591358322846
MeanAbsoluteError value on hold-out data: 0.23280833661556244
Epoch: 131
Loss on hold-out set: 0.003264618535084944
MeanAbsoluteError value on hold-out data: 0.042245760560035706
Epoch: 132
Loss on hold-out set: 0.004316177311059283
MeanAbsoluteError value on hold-out data: 0.04987620934844017
Epoch: 133
Loss on hold-out set: 0.013219041137122795
MeanAbsoluteError value on hold-out data: 0.10264966636896133
Epoch: 134
Loss on hold-out set: 0.018959957861194487
MeanAbsoluteError value on hold-out data: 0.12290067225694656
Epoch: 135
Loss on hold-out set: 0.025712997848658187
MeanAbsoluteError value on hold-out data: 0.140586718916893
Epoch: 136
Loss on hold-out set: 0.007409775923741491
MeanAbsoluteError value on hold-out data: 0.06862685829401016
Epoch: 137
Loss on hold-out set: 0.008890333830526
MeanAbsoluteError value on hold-out data: 0.06967093050479889
Epoch: 138
Loss on hold-out set: 0.016953227208241037
MeanAbsoluteError value on hold-out data: 0.11249618232250214
Early stopping at epoch 137
Returned to Spot: Validation loss: 0.016953227208241037
----------------------------------------------

config: {'_L_in': 10, '_L_out': 1, 'l1': 128, 'dropout_prob': 0.8582565260508446, 'lr_mult': 0.4977322453322358, 'batch_size': 2, 'epochs': 32768, 'k_folds': 1, 'patience': 128, 'optimizer': 'ASGD', 'sgd_momentum': 0.6834550718769361}
Epoch: 1
Loss on hold-out set: 0.0627363656189118
MeanAbsoluteError value on hold-out data: 0.1979895532131195
Epoch: 2
Loss on hold-out set: 0.04737248030374758
MeanAbsoluteError value on hold-out data: 0.17366760969161987
Epoch: 3
Loss on hold-out set: 0.04137929056155069
MeanAbsoluteError value on hold-out data: 0.1592455506324768
Epoch: 4
Loss on hold-out set: 0.039781247589805085
MeanAbsoluteError value on hold-out data: 0.15983828902244568
Epoch: 5
Loss on hold-out set: 0.03672845433310916
MeanAbsoluteError value on hold-out data: 0.15287697315216064
Epoch: 6
Loss on hold-out set: 0.03322069910645951
MeanAbsoluteError value on hold-out data: 0.13984718918800354
Epoch: 7
Loss on hold-out set: 0.03389249281773421
MeanAbsoluteError value on hold-out data: 0.14277678728103638
Epoch: 8
Loss on hold-out set: 0.029338094465686783
MeanAbsoluteError value on hold-out data: 0.13640561699867249
Epoch: 9
Loss on hold-out set: 0.031851367676087344
MeanAbsoluteError value on hold-out data: 0.14009074866771698
Epoch: 10
Loss on hold-out set: 0.03271510177835201
MeanAbsoluteError value on hold-out data: 0.14312472939491272
Epoch: 11
Loss on hold-out set: 0.029373868104254748
MeanAbsoluteError value on hold-out data: 0.13428717851638794
Epoch: 12
Loss on hold-out set: 0.031324641468333234
MeanAbsoluteError value on hold-out data: 0.13902594149112701
Epoch: 13
Loss on hold-out set: 0.030776613584942727
MeanAbsoluteError value on hold-out data: 0.14018432796001434
Epoch: 14
Loss on hold-out set: 0.030630669334010843
MeanAbsoluteError value on hold-out data: 0.13692258298397064
Epoch: 15
Loss on hold-out set: 0.029418110254385586
MeanAbsoluteError value on hold-out data: 0.13550731539726257
Epoch: 16
Loss on hold-out set: 0.03161165142018035
MeanAbsoluteError value on hold-out data: 0.14092694222927094
Epoch: 17
Loss on hold-out set: 0.029480002596101257
MeanAbsoluteError value on hold-out data: 0.13834312558174133
Epoch: 18
Loss on hold-out set: 0.03098457495701344
MeanAbsoluteError value on hold-out data: 0.13786865770816803
Epoch: 19
Loss on hold-out set: 0.029597533336830868
MeanAbsoluteError value on hold-out data: 0.13630743324756622
Epoch: 20
Loss on hold-out set: 0.0284817149847125
MeanAbsoluteError value on hold-out data: 0.1357511579990387
Epoch: 21
Loss on hold-out set: 0.030449675613975463
MeanAbsoluteError value on hold-out data: 0.1366056501865387
Epoch: 22
Loss on hold-out set: 0.02974787499969049
MeanAbsoluteError value on hold-out data: 0.13951949775218964
Epoch: 23
Loss on hold-out set: 0.02896040116815129
MeanAbsoluteError value on hold-out data: 0.1343095898628235
Epoch: 24
Loss on hold-out set: 0.028038529412660863
MeanAbsoluteError value on hold-out data: 0.13398513197898865
Epoch: 25
Loss on hold-out set: 0.030371056944907954
MeanAbsoluteError value on hold-out data: 0.13830630481243134
Epoch: 26
Loss on hold-out set: 0.030201565406120304
MeanAbsoluteError value on hold-out data: 0.13818831741809845
Epoch: 27
Loss on hold-out set: 0.027702731225678387
MeanAbsoluteError value on hold-out data: 0.13200949132442474
Epoch: 28
Loss on hold-out set: 0.02833219684000748
MeanAbsoluteError value on hold-out data: 0.13532014191150665
Epoch: 29
Loss on hold-out set: 0.028320820440009508
MeanAbsoluteError value on hold-out data: 0.13157136738300323
Epoch: 30
Loss on hold-out set: 0.028519308414640062
MeanAbsoluteError value on hold-out data: 0.13392291963100433
Epoch: 31
Loss on hold-out set: 0.030494494858624724
MeanAbsoluteError value on hold-out data: 0.13711509108543396
Epoch: 32
Loss on hold-out set: 0.02875328583914476
MeanAbsoluteError value on hold-out data: 0.13394393026828766
Epoch: 33
Loss on hold-out set: 0.02878581775240794
MeanAbsoluteError value on hold-out data: 0.13579334318637848
Epoch: 34
Loss on hold-out set: 0.028650887749196653
MeanAbsoluteError value on hold-out data: 0.1354931741952896
Epoch: 35
Loss on hold-out set: 0.02927474992291536
MeanAbsoluteError value on hold-out data: 0.13557706773281097
Epoch: 36
Loss on hold-out set: 0.028845543267483058
MeanAbsoluteError value on hold-out data: 0.13435406982898712
Epoch: 37
Loss on hold-out set: 0.027855557050400725
MeanAbsoluteError value on hold-out data: 0.13316498696804047
Epoch: 38
Loss on hold-out set: 0.02987927594241531
MeanAbsoluteError value on hold-out data: 0.13848355412483215
Epoch: 39
Loss on hold-out set: 0.02979711269465042
MeanAbsoluteError value on hold-out data: 0.13690555095672607
Epoch: 40
Loss on hold-out set: 0.0279158693208592
MeanAbsoluteError value on hold-out data: 0.13300587236881256
Epoch: 41
Loss on hold-out set: 0.02886793928822347
MeanAbsoluteError value on hold-out data: 0.133453831076622
Epoch: 42
Loss on hold-out set: 0.028009962836513295
MeanAbsoluteError value on hold-out data: 0.13275517523288727
Epoch: 43
Loss on hold-out set: 0.02811712634943736
MeanAbsoluteError value on hold-out data: 0.13313783705234528
Epoch: 44
Loss on hold-out set: 0.02929465073122022
MeanAbsoluteError value on hold-out data: 0.13727602362632751
Epoch: 45
Loss on hold-out set: 0.028897887462711273
MeanAbsoluteError value on hold-out data: 0.1352195292711258
Epoch: 46
Loss on hold-out set: 0.02806833324158409
MeanAbsoluteError value on hold-out data: 0.13403871655464172
Epoch: 47
Loss on hold-out set: 0.029565077143585465
MeanAbsoluteError value on hold-out data: 0.13719318807125092
Epoch: 48
Loss on hold-out set: 0.02974519005770465
MeanAbsoluteError value on hold-out data: 0.1365189552307129
Epoch: 49
Loss on hold-out set: 0.02890354243456386
MeanAbsoluteError value on hold-out data: 0.13510020077228546
Epoch: 50
Loss on hold-out set: 0.0286509017564822
MeanAbsoluteError value on hold-out data: 0.13342460989952087
Epoch: 51
Loss on hold-out set: 0.028378947526131622
MeanAbsoluteError value on hold-out data: 0.13393960893154144
Epoch: 52
Loss on hold-out set: 0.028862050497555174
MeanAbsoluteError value on hold-out data: 0.13542117178440094
Epoch: 53
Loss on hold-out set: 0.029104472709374628
MeanAbsoluteError value on hold-out data: 0.13667449355125427
Epoch: 54
Loss on hold-out set: 0.027995321813505142
MeanAbsoluteError value on hold-out data: 0.13203193247318268
Epoch: 55
Loss on hold-out set: 0.027611466320304315
MeanAbsoluteError value on hold-out data: 0.1310359388589859
Epoch: 56
Loss on hold-out set: 0.02777649071921284
MeanAbsoluteError value on hold-out data: 0.13352049887180328
Epoch: 57
Loss on hold-out set: 0.0277478971388094
MeanAbsoluteError value on hold-out data: 0.1329440027475357
Epoch: 58
Loss on hold-out set: 0.028948265942550885
MeanAbsoluteError value on hold-out data: 0.13673385977745056
Epoch: 59
Loss on hold-out set: 0.028236228245392948
MeanAbsoluteError value on hold-out data: 0.13253255188465118
Epoch: 60
Loss on hold-out set: 0.028475487710287174
MeanAbsoluteError value on hold-out data: 0.13403184711933136
Epoch: 61
Loss on hold-out set: 0.027614162804481264
MeanAbsoluteError value on hold-out data: 0.13178753852844238
Epoch: 62
Loss on hold-out set: 0.02635726187521262
MeanAbsoluteError value on hold-out data: 0.1277054399251938
Epoch: 63
Loss on hold-out set: 0.029057357415828544
MeanAbsoluteError value on hold-out data: 0.1379663497209549
Epoch: 64
Loss on hold-out set: 0.02743353600652578
MeanAbsoluteError value on hold-out data: 0.13307519257068634
Epoch: 65
Loss on hold-out set: 0.02841990917790099
MeanAbsoluteError value on hold-out data: 0.13260135054588318
Epoch: 66
Loss on hold-out set: 0.02865375533947372
MeanAbsoluteError value on hold-out data: 0.13406062126159668
Epoch: 67
Loss on hold-out set: 0.02819440630497411
MeanAbsoluteError value on hold-out data: 0.1325525939464569
Epoch: 68
Loss on hold-out set: 0.028831634072897336
MeanAbsoluteError value on hold-out data: 0.1348252147436142
Epoch: 69
Loss on hold-out set: 0.02890387632631852
MeanAbsoluteError value on hold-out data: 0.13579827547073364
Epoch: 70
Loss on hold-out set: 0.02879478446993744
MeanAbsoluteError value on hold-out data: 0.1340966373682022
Epoch: 71
Loss on hold-out set: 0.02699753917402025
MeanAbsoluteError value on hold-out data: 0.12864533066749573
Epoch: 72
Loss on hold-out set: 0.028024618162429155
MeanAbsoluteError value on hold-out data: 0.13139596581459045
Epoch: 73
Loss on hold-out set: 0.02697035462857457
MeanAbsoluteError value on hold-out data: 0.13045170903205872
Epoch: 74
Loss on hold-out set: 0.027775679092143644
MeanAbsoluteError value on hold-out data: 0.13200123608112335
Epoch: 75
Loss on hold-out set: 0.027719686704779936
MeanAbsoluteError value on hold-out data: 0.1324518918991089
Epoch: 76
Loss on hold-out set: 0.02777051592956923
MeanAbsoluteError value on hold-out data: 0.1321130245923996
Epoch: 77
Loss on hold-out set: 0.029234787662207964
MeanAbsoluteError value on hold-out data: 0.13687285780906677
Epoch: 78
Loss on hold-out set: 0.026969334151557025
MeanAbsoluteError value on hold-out data: 0.1290588229894638
Epoch: 79
Loss on hold-out set: 0.02727326051215641
MeanAbsoluteError value on hold-out data: 0.13119223713874817
Epoch: 80
Loss on hold-out set: 0.027869499708952694
MeanAbsoluteError value on hold-out data: 0.13228273391723633
Epoch: 81
Loss on hold-out set: 0.027088261089811567
MeanAbsoluteError value on hold-out data: 0.12906670570373535
Epoch: 82
Loss on hold-out set: 0.026591390637962224
MeanAbsoluteError value on hold-out data: 0.1283389925956726
Epoch: 83
Loss on hold-out set: 0.0273800980310322
MeanAbsoluteError value on hold-out data: 0.13261725008487701
Epoch: 84
Loss on hold-out set: 0.027132428092882035
MeanAbsoluteError value on hold-out data: 0.13080303370952606
Epoch: 85
Loss on hold-out set: 0.02751953606978835
MeanAbsoluteError value on hold-out data: 0.13335266709327698
Epoch: 86
Loss on hold-out set: 0.027437405324308203
MeanAbsoluteError value on hold-out data: 0.12995412945747375
Epoch: 87
Loss on hold-out set: 0.0275255295188011
MeanAbsoluteError value on hold-out data: 0.13209769129753113
Epoch: 88
Loss on hold-out set: 0.02706641058078579
MeanAbsoluteError value on hold-out data: 0.13005848228931427
Epoch: 89
Loss on hold-out set: 0.028751954562127747
MeanAbsoluteError value on hold-out data: 0.13454657793045044
Epoch: 90
Loss on hold-out set: 0.02699841837619412
MeanAbsoluteError value on hold-out data: 0.13032716512680054
Epoch: 91
Loss on hold-out set: 0.028363810378553657
MeanAbsoluteError value on hold-out data: 0.13493768870830536
Epoch: 92
Loss on hold-out set: 0.02654938415509908
MeanAbsoluteError value on hold-out data: 0.12848928570747375
Epoch: 93
Loss on hold-out set: 0.027642433919148366
MeanAbsoluteError value on hold-out data: 0.1316445767879486
Epoch: 94
Loss on hold-out set: 0.026955600478492367
MeanAbsoluteError value on hold-out data: 0.129975363612175
Epoch: 95
Loss on hold-out set: 0.02739864796504359
MeanAbsoluteError value on hold-out data: 0.13171707093715668
Epoch: 96
Loss on hold-out set: 0.02586730217721197
MeanAbsoluteError value on hold-out data: 0.1268623173236847
Epoch: 97
Loss on hold-out set: 0.027926377208690005
MeanAbsoluteError value on hold-out data: 0.1306861937046051
Epoch: 98
Loss on hold-out set: 0.02737451756145068
MeanAbsoluteError value on hold-out data: 0.1304798573255539
Epoch: 99
Loss on hold-out set: 0.027038409941402886
MeanAbsoluteError value on hold-out data: 0.13066989183425903
Epoch: 100
Loss on hold-out set: 0.027118707629172907
MeanAbsoluteError value on hold-out data: 0.1302095353603363
Epoch: 101
Loss on hold-out set: 0.02809304703187081
MeanAbsoluteError value on hold-out data: 0.13483589887619019
Epoch: 102
Loss on hold-out set: 0.028764562489232048
MeanAbsoluteError value on hold-out data: 0.13477547466754913
Epoch: 103
Loss on hold-out set: 0.02756846674271704
MeanAbsoluteError value on hold-out data: 0.12990881502628326
Epoch: 104
Loss on hold-out set: 0.02706038983630909
MeanAbsoluteError value on hold-out data: 0.12523417174816132
Epoch: 105
Loss on hold-out set: 0.026198529082369835
MeanAbsoluteError value on hold-out data: 0.1314202845096588
Epoch: 106
Loss on hold-out set: 0.027221340301136175
MeanAbsoluteError value on hold-out data: 0.13245023787021637
Epoch: 107
Loss on hold-out set: 0.026836192948394455
MeanAbsoluteError value on hold-out data: 0.12907496094703674
Epoch: 108
Loss on hold-out set: 0.026806952535019565
MeanAbsoluteError value on hold-out data: 0.13054917752742767
Epoch: 109
Loss on hold-out set: 0.02524974891450256
MeanAbsoluteError value on hold-out data: 0.12720240652561188
Epoch: 110
Loss on hold-out set: 0.027193567963452854
MeanAbsoluteError value on hold-out data: 0.1324550211429596
Epoch: 111
Loss on hold-out set: 0.02636495349172037
MeanAbsoluteError value on hold-out data: 0.13150963187217712
Epoch: 112
Loss on hold-out set: 0.027444147572775062
MeanAbsoluteError value on hold-out data: 0.13146555423736572
Epoch: 113
Loss on hold-out set: 0.026907032371139696
MeanAbsoluteError value on hold-out data: 0.13066470623016357
Epoch: 114
Loss on hold-out set: 0.027631523248728626
MeanAbsoluteError value on hold-out data: 0.1307561695575714
Epoch: 115
Loss on hold-out set: 0.02901218795997617
MeanAbsoluteError value on hold-out data: 0.13357466459274292
Epoch: 116
Loss on hold-out set: 0.026032598062665783
MeanAbsoluteError value on hold-out data: 0.12772102653980255
Epoch: 117
Loss on hold-out set: 0.026474202050206563
MeanAbsoluteError value on hold-out data: 0.12887021899223328
Epoch: 118
Loss on hold-out set: 0.02683639073181742
MeanAbsoluteError value on hold-out data: 0.12715889513492584
Epoch: 119
Loss on hold-out set: 0.0277396337427975
MeanAbsoluteError value on hold-out data: 0.13241584599018097
Epoch: 120
Loss on hold-out set: 0.027871971409767868
MeanAbsoluteError value on hold-out data: 0.13439971208572388
Epoch: 121
Loss on hold-out set: 0.02643005520182972
MeanAbsoluteError value on hold-out data: 0.1278477907180786
Epoch: 122
Loss on hold-out set: 0.024760906983477375
MeanAbsoluteError value on hold-out data: 0.12319278717041016
Epoch: 123
Loss on hold-out set: 0.02598829566607795
MeanAbsoluteError value on hold-out data: 0.1290157437324524
Epoch: 124
Loss on hold-out set: 0.02622172895233234
MeanAbsoluteError value on hold-out data: 0.12777122855186462
Epoch: 125
Loss on hold-out set: 0.02647816583410531
MeanAbsoluteError value on hold-out data: 0.1279030591249466
Epoch: 126
Loss on hold-out set: 0.026597953212816113
MeanAbsoluteError value on hold-out data: 0.13234475255012512
Epoch: 127
Loss on hold-out set: 0.028058108296390855
MeanAbsoluteError value on hold-out data: 0.13218741118907928
Epoch: 128
Loss on hold-out set: 0.027684563567163423
MeanAbsoluteError value on hold-out data: 0.1320987492799759
Epoch: 129
Loss on hold-out set: 0.026595974487136118
MeanAbsoluteError value on hold-out data: 0.1286838948726654
Epoch: 130
Loss on hold-out set: 0.027063922544184608
MeanAbsoluteError value on hold-out data: 0.1306331306695938
Epoch: 131
Loss on hold-out set: 0.02728924945627417
MeanAbsoluteError value on hold-out data: 0.13100630044937134
Epoch: 132
Loss on hold-out set: 0.027034108255368967
MeanAbsoluteError value on hold-out data: 0.1306549608707428
Epoch: 133
Loss on hold-out set: 0.02495610472789849
MeanAbsoluteError value on hold-out data: 0.12515397369861603
Epoch: 134
Loss on hold-out set: 0.027897849807535142
MeanAbsoluteError value on hold-out data: 0.13363386690616608
Epoch: 135
Loss on hold-out set: 0.02599743153298429
MeanAbsoluteError value on hold-out data: 0.13003382086753845
Epoch: 136
Loss on hold-out set: 0.02454607269052455
MeanAbsoluteError value on hold-out data: 0.12377485632896423
Epoch: 137
Loss on hold-out set: 0.026515968056434455
MeanAbsoluteError value on hold-out data: 0.12814274430274963
Epoch: 138
Loss on hold-out set: 0.027543700067908503
MeanAbsoluteError value on hold-out data: 0.13049232959747314
Epoch: 139
Loss on hold-out set: 0.025071186190762092
MeanAbsoluteError value on hold-out data: 0.12501446902751923
Epoch: 140
Loss on hold-out set: 0.028710802696199002
MeanAbsoluteError value on hold-out data: 0.13533520698547363
Epoch: 141
Loss on hold-out set: 0.028205333240233207
MeanAbsoluteError value on hold-out data: 0.12926939129829407
Epoch: 142
Loss on hold-out set: 0.02575468121925951
MeanAbsoluteError value on hold-out data: 0.12851469218730927
Epoch: 143
Loss on hold-out set: 0.026849108347566167
MeanAbsoluteError value on hold-out data: 0.13019044697284698
Epoch: 144
Loss on hold-out set: 0.027564378679217044
MeanAbsoluteError value on hold-out data: 0.13312862813472748
Epoch: 145
Loss on hold-out set: 0.027848675624190945
MeanAbsoluteError value on hold-out data: 0.1313738375902176
Epoch: 146
Loss on hold-out set: 0.026698896151113635
MeanAbsoluteError value on hold-out data: 0.13109822571277618
Epoch: 147
Loss on hold-out set: 0.025003565162927163
MeanAbsoluteError value on hold-out data: 0.12534448504447937
Epoch: 148
Loss on hold-out set: 0.027038442753158354
MeanAbsoluteError value on hold-out data: 0.1297362595796585
Epoch: 149
Loss on hold-out set: 0.026455838206456975
MeanAbsoluteError value on hold-out data: 0.12908245623111725
Epoch: 150
Loss on hold-out set: 0.02685798465963065
MeanAbsoluteError value on hold-out data: 0.12984022498130798
Epoch: 151
Loss on hold-out set: 0.02735979498247616
MeanAbsoluteError value on hold-out data: 0.13282017409801483
Epoch: 152
Loss on hold-out set: 0.025208503587637095
MeanAbsoluteError value on hold-out data: 0.12668998539447784
Epoch: 153
Loss on hold-out set: 0.027793289568083614
MeanAbsoluteError value on hold-out data: 0.13046494126319885
Epoch: 154
Loss on hold-out set: 0.028269766463781706
MeanAbsoluteError value on hold-out data: 0.13358595967292786
Epoch: 155
Loss on hold-out set: 0.025561354335659415
MeanAbsoluteError value on hold-out data: 0.1290331482887268
Epoch: 156
Loss on hold-out set: 0.026722833411962105
MeanAbsoluteError value on hold-out data: 0.12827372550964355
Epoch: 157
Loss on hold-out set: 0.02780144404396803
MeanAbsoluteError value on hold-out data: 0.13120900094509125
Epoch: 158
Loss on hold-out set: 0.026711996397740828
MeanAbsoluteError value on hold-out data: 0.1296720951795578
Epoch: 159
Loss on hold-out set: 0.02727462076501979
MeanAbsoluteError value on hold-out data: 0.13328804075717926
Epoch: 160
Loss on hold-out set: 0.026778764753447225
MeanAbsoluteError value on hold-out data: 0.1313880980014801
Epoch: 161
Loss on hold-out set: 0.027137759633527214
MeanAbsoluteError value on hold-out data: 0.13140816986560822
Epoch: 162
Loss on hold-out set: 0.02651200305508913
MeanAbsoluteError value on hold-out data: 0.13083574175834656
Epoch: 163
Loss on hold-out set: 0.026935843532458724
MeanAbsoluteError value on hold-out data: 0.1313992440700531
Epoch: 164
Loss on hold-out set: 0.026452278755532462
MeanAbsoluteError value on hold-out data: 0.12846975028514862
Epoch: 165
Loss on hold-out set: 0.02607178757248524
MeanAbsoluteError value on hold-out data: 0.12736769020557404
Epoch: 166
Loss on hold-out set: 0.025321295276808087
MeanAbsoluteError value on hold-out data: 0.12531515955924988
Epoch: 167
Loss on hold-out set: 0.02423002737564578
MeanAbsoluteError value on hold-out data: 0.12276105582714081
Epoch: 168
Loss on hold-out set: 0.02751225454621211
MeanAbsoluteError value on hold-out data: 0.1318725347518921
Epoch: 169
Loss on hold-out set: 0.026341132170152073
MeanAbsoluteError value on hold-out data: 0.12693116068840027
Epoch: 170
Loss on hold-out set: 0.026116666733820845
MeanAbsoluteError value on hold-out data: 0.12633821368217468
Epoch: 171
Loss on hold-out set: 0.024741468111266537
MeanAbsoluteError value on hold-out data: 0.12331338226795197
Epoch: 172
Loss on hold-out set: 0.023749631206446794
MeanAbsoluteError value on hold-out data: 0.12082576751708984
Epoch: 173
Loss on hold-out set: 0.026359065651146617
MeanAbsoluteError value on hold-out data: 0.1295080929994583
Epoch: 174
Loss on hold-out set: 0.025825775254925246
MeanAbsoluteError value on hold-out data: 0.12895938754081726
Epoch: 175
Loss on hold-out set: 0.02611851203359644
MeanAbsoluteError value on hold-out data: 0.13064926862716675
Epoch: 176
Loss on hold-out set: 0.027099355964261728
MeanAbsoluteError value on hold-out data: 0.1295553594827652
Epoch: 177
Loss on hold-out set: 0.024631557617200695
MeanAbsoluteError value on hold-out data: 0.12478180229663849
Epoch: 178
Loss on hold-out set: 0.02653847880855513
MeanAbsoluteError value on hold-out data: 0.12804660201072693
Epoch: 179
Loss on hold-out set: 0.02671378879934006
MeanAbsoluteError value on hold-out data: 0.1299767941236496
Epoch: 180
Loss on hold-out set: 0.024507727040230142
MeanAbsoluteError value on hold-out data: 0.12292832881212234
Epoch: 181
Loss on hold-out set: 0.026697371849174183
MeanAbsoluteError value on hold-out data: 0.12828513979911804
Epoch: 182
Loss on hold-out set: 0.025261787430305657
MeanAbsoluteError value on hold-out data: 0.12520526349544525
Epoch: 183
Loss on hold-out set: 0.02644187912386163
MeanAbsoluteError value on hold-out data: 0.128544881939888
Epoch: 184
Loss on hold-out set: 0.02575473148812307
MeanAbsoluteError value on hold-out data: 0.1264997124671936
Epoch: 185
Loss on hold-out set: 0.024706628903368257
MeanAbsoluteError value on hold-out data: 0.12621305882930756
Epoch: 186
Loss on hold-out set: 0.02422731112218268
MeanAbsoluteError value on hold-out data: 0.12254288047552109
Epoch: 187
Loss on hold-out set: 0.025704228934919228
MeanAbsoluteError value on hold-out data: 0.12849916517734528
Epoch: 188
Loss on hold-out set: 0.026042959142359906
MeanAbsoluteError value on hold-out data: 0.1281791627407074
Epoch: 189
Loss on hold-out set: 0.024247439724664824
MeanAbsoluteError value on hold-out data: 0.1243339255452156
Epoch: 190
Loss on hold-out set: 0.0263562437928825
MeanAbsoluteError value on hold-out data: 0.13033998012542725
Epoch: 191
Loss on hold-out set: 0.025125517176493303
MeanAbsoluteError value on hold-out data: 0.12706629931926727
Epoch: 192
Loss on hold-out set: 0.027627490368128445
MeanAbsoluteError value on hold-out data: 0.1326565146446228
Epoch: 193
Loss on hold-out set: 0.026590768501143128
MeanAbsoluteError value on hold-out data: 0.12729717791080475
Epoch: 194
Loss on hold-out set: 0.02621106459366274
MeanAbsoluteError value on hold-out data: 0.126920685172081
Epoch: 195
Loss on hold-out set: 0.0288025383988861
MeanAbsoluteError value on hold-out data: 0.13584905862808228
Epoch: 196
Loss on hold-out set: 0.02542145775150857
MeanAbsoluteError value on hold-out data: 0.12716707587242126
Epoch: 197
Loss on hold-out set: 0.02614638604800954
MeanAbsoluteError value on hold-out data: 0.12752531468868256
Epoch: 198
Loss on hold-out set: 0.026141022106360955
MeanAbsoluteError value on hold-out data: 0.1290191113948822
Epoch: 199
Loss on hold-out set: 0.02575326415710151
MeanAbsoluteError value on hold-out data: 0.1284116506576538
Epoch: 200
Loss on hold-out set: 0.025428991733667014
MeanAbsoluteError value on hold-out data: 0.12690739333629608
Epoch: 201
Loss on hold-out set: 0.02594689829624258
MeanAbsoluteError value on hold-out data: 0.1297047734260559
Epoch: 202
Loss on hold-out set: 0.02586330722241352
MeanAbsoluteError value on hold-out data: 0.12687110900878906
Epoch: 203
Loss on hold-out set: 0.02629073912452441
MeanAbsoluteError value on hold-out data: 0.129322350025177
Epoch: 204
Loss on hold-out set: 0.026937483941437676
MeanAbsoluteError value on hold-out data: 0.13054977357387543
Epoch: 205
Loss on hold-out set: 0.024399184147284057
MeanAbsoluteError value on hold-out data: 0.1239369809627533
Epoch: 206
Loss on hold-out set: 0.02491433411235145
MeanAbsoluteError value on hold-out data: 0.1228470504283905
Epoch: 207
Loss on hold-out set: 0.02537891222070357
MeanAbsoluteError value on hold-out data: 0.12571370601654053
Epoch: 208
Loss on hold-out set: 0.02665238700079499
MeanAbsoluteError value on hold-out data: 0.13058432936668396
Epoch: 209
Loss on hold-out set: 0.025266655160618635
MeanAbsoluteError value on hold-out data: 0.12509259581565857
Epoch: 210
Loss on hold-out set: 0.026189287210678838
MeanAbsoluteError value on hold-out data: 0.12653057277202606
Epoch: 211
Loss on hold-out set: 0.02795329602076284
MeanAbsoluteError value on hold-out data: 0.13054217398166656
Epoch: 212
Loss on hold-out set: 0.023923977557387843
MeanAbsoluteError value on hold-out data: 0.12221761047840118
Epoch: 213
Loss on hold-out set: 0.026370607013971797
MeanAbsoluteError value on hold-out data: 0.12997731566429138
Epoch: 214
Loss on hold-out set: 0.025865778244527366
MeanAbsoluteError value on hold-out data: 0.12886543571949005
Epoch: 215
Loss on hold-out set: 0.026068468408775514
MeanAbsoluteError value on hold-out data: 0.1287800818681717
Epoch: 216
Loss on hold-out set: 0.025897390615621893
MeanAbsoluteError value on hold-out data: 0.12460552155971527
Epoch: 217
Loss on hold-out set: 0.02543634350450399
MeanAbsoluteError value on hold-out data: 0.12755915522575378
Epoch: 218
Loss on hold-out set: 0.024513623113549935
MeanAbsoluteError value on hold-out data: 0.12117817997932434
Epoch: 219
Loss on hold-out set: 0.0242409840945038
MeanAbsoluteError value on hold-out data: 0.12464911490678787
Epoch: 220
Loss on hold-out set: 0.024816162161684283
MeanAbsoluteError value on hold-out data: 0.12492147833108902
Epoch: 221
Loss on hold-out set: 0.02601984983193688
MeanAbsoluteError value on hold-out data: 0.12994632124900818
Epoch: 222
Loss on hold-out set: 0.026320055830292403
MeanAbsoluteError value on hold-out data: 0.13115257024765015
Epoch: 223
Loss on hold-out set: 0.027070996646070853
MeanAbsoluteError value on hold-out data: 0.13121189177036285
Epoch: 224
Loss on hold-out set: 0.028228018804705546
MeanAbsoluteError value on hold-out data: 0.12933821976184845
Epoch: 225
Loss on hold-out set: 0.025599790387495887
MeanAbsoluteError value on hold-out data: 0.1249241754412651
Epoch: 226
Loss on hold-out set: 0.024328518022278634
MeanAbsoluteError value on hold-out data: 0.12246542423963547
Epoch: 227
Loss on hold-out set: 0.02307236924612274
MeanAbsoluteError value on hold-out data: 0.11982233822345734
Epoch: 228
Loss on hold-out set: 0.024715535906871082
MeanAbsoluteError value on hold-out data: 0.12519867718219757
Epoch: 229
Loss on hold-out set: 0.02686693476396613
MeanAbsoluteError value on hold-out data: 0.13206660747528076
Epoch: 230
Loss on hold-out set: 0.026223544621219237
MeanAbsoluteError value on hold-out data: 0.1268349140882492
Epoch: 231
Loss on hold-out set: 0.02300458084397481
MeanAbsoluteError value on hold-out data: 0.11901410669088364
Epoch: 232
Loss on hold-out set: 0.02629109275721324
MeanAbsoluteError value on hold-out data: 0.12971919775009155
Epoch: 233
Loss on hold-out set: 0.024046501953174204
MeanAbsoluteError value on hold-out data: 0.12266231328248978
Epoch: 234
Loss on hold-out set: 0.026049132773963115
MeanAbsoluteError value on hold-out data: 0.1269674450159073
Epoch: 235
Loss on hold-out set: 0.02490300806054923
MeanAbsoluteError value on hold-out data: 0.12436279654502869
Epoch: 236
Loss on hold-out set: 0.024684672720128826
MeanAbsoluteError value on hold-out data: 0.12426428496837616
Epoch: 237
Loss on hold-out set: 0.023768333008580764
MeanAbsoluteError value on hold-out data: 0.1224224716424942
Epoch: 238
Loss on hold-out set: 0.025920199496904387
MeanAbsoluteError value on hold-out data: 0.12995436787605286
Epoch: 239
Loss on hold-out set: 0.02550450013251975
MeanAbsoluteError value on hold-out data: 0.1252797394990921
Epoch: 240
Loss on hold-out set: 0.024724784121566094
MeanAbsoluteError value on hold-out data: 0.1247449517250061
Epoch: 241
Loss on hold-out set: 0.023724670715552443
MeanAbsoluteError value on hold-out data: 0.1209975928068161
Epoch: 242
Loss on hold-out set: 0.02473006474620585
MeanAbsoluteError value on hold-out data: 0.1237725093960762
Epoch: 243
Loss on hold-out set: 0.02248408281466444
MeanAbsoluteError value on hold-out data: 0.12033984810113907
Epoch: 244
Loss on hold-out set: 0.024625454155611806
MeanAbsoluteError value on hold-out data: 0.12398058921098709
Epoch: 245
Loss on hold-out set: 0.02336194573241907
MeanAbsoluteError value on hold-out data: 0.12074614316225052
Epoch: 246
Loss on hold-out set: 0.02486849725034214
MeanAbsoluteError value on hold-out data: 0.1255793571472168
Epoch: 247
Loss on hold-out set: 0.026085958753634866
MeanAbsoluteError value on hold-out data: 0.1271529495716095
Epoch: 248
Loss on hold-out set: 0.025779618735202046
MeanAbsoluteError value on hold-out data: 0.12859869003295898
Epoch: 249
Loss on hold-out set: 0.024641032176829565
MeanAbsoluteError value on hold-out data: 0.12275566160678864
Epoch: 250
Loss on hold-out set: 0.024696909485355717
MeanAbsoluteError value on hold-out data: 0.12414821982383728
Epoch: 251
Loss on hold-out set: 0.024295955212243522
MeanAbsoluteError value on hold-out data: 0.12326393276453018
Epoch: 252
Loss on hold-out set: 0.024812301908799177
MeanAbsoluteError value on hold-out data: 0.12406845390796661
Epoch: 253
Loss on hold-out set: 0.025424796830823954
MeanAbsoluteError value on hold-out data: 0.12870192527770996
Epoch: 254
Loss on hold-out set: 0.024718252329621465
MeanAbsoluteError value on hold-out data: 0.12188321352005005
Epoch: 255
Loss on hold-out set: 0.02453888626206511
MeanAbsoluteError value on hold-out data: 0.12286242097616196
Epoch: 256
Loss on hold-out set: 0.02473612451714871
MeanAbsoluteError value on hold-out data: 0.1238579973578453
Epoch: 257
Loss on hold-out set: 0.024924442953973388
MeanAbsoluteError value on hold-out data: 0.12685562670230865
Epoch: 258
Loss on hold-out set: 0.02399667945166584
MeanAbsoluteError value on hold-out data: 0.12262078374624252
Epoch: 259
Loss on hold-out set: 0.023002983462890068
MeanAbsoluteError value on hold-out data: 0.12012533843517303
Epoch: 260
Loss on hold-out set: 0.025029484875752437
MeanAbsoluteError value on hold-out data: 0.12583519518375397
Epoch: 261
Loss on hold-out set: 0.0223748070296521
MeanAbsoluteError value on hold-out data: 0.11891818791627884
Epoch: 262
Loss on hold-out set: 0.023905238735460445
MeanAbsoluteError value on hold-out data: 0.1245960220694542
Epoch: 263
Loss on hold-out set: 0.023439062862938346
MeanAbsoluteError value on hold-out data: 0.12235839664936066
Epoch: 264
Loss on hold-out set: 0.024906928010556537
MeanAbsoluteError value on hold-out data: 0.12475068122148514
Epoch: 265
Loss on hold-out set: 0.025582494616295057
MeanAbsoluteError value on hold-out data: 0.12390130013227463
Epoch: 266
Loss on hold-out set: 0.024398568384543372
MeanAbsoluteError value on hold-out data: 0.12526650726795197
Epoch: 267
Loss on hold-out set: 0.02576114767716111
MeanAbsoluteError value on hold-out data: 0.12742167711257935
Epoch: 268
Loss on hold-out set: 0.023824123292609634
MeanAbsoluteError value on hold-out data: 0.12282391637563705
Epoch: 269
Loss on hold-out set: 0.026468743404790683
MeanAbsoluteError value on hold-out data: 0.13013094663619995
Epoch: 270
Loss on hold-out set: 0.025212653927495315
MeanAbsoluteError value on hold-out data: 0.12161057442426682
Epoch: 271
Loss on hold-out set: 0.024408928725109337
MeanAbsoluteError value on hold-out data: 0.12481003999710083
Epoch: 272
Loss on hold-out set: 0.022764707847867004
MeanAbsoluteError value on hold-out data: 0.121512271463871
Epoch: 273
Loss on hold-out set: 0.023778108187640708
MeanAbsoluteError value on hold-out data: 0.12309601902961731
Epoch: 274
Loss on hold-out set: 0.023591601670314048
MeanAbsoluteError value on hold-out data: 0.11971723288297653
Epoch: 275
Loss on hold-out set: 0.02361478134718103
MeanAbsoluteError value on hold-out data: 0.12174592167139053
Epoch: 276
Loss on hold-out set: 0.024397041810831677
MeanAbsoluteError value on hold-out data: 0.1256386786699295
Epoch: 277
Loss on hold-out set: 0.024279772398003843
MeanAbsoluteError value on hold-out data: 0.12344585359096527
Epoch: 278
Loss on hold-out set: 0.023254017295257653
MeanAbsoluteError value on hold-out data: 0.11969319730997086
Epoch: 279
Loss on hold-out set: 0.023779389503361018
MeanAbsoluteError value on hold-out data: 0.1219843402504921
Epoch: 280
Loss on hold-out set: 0.02540700195240788
MeanAbsoluteError value on hold-out data: 0.12828145921230316
Epoch: 281
Loss on hold-out set: 0.024927196686233704
MeanAbsoluteError value on hold-out data: 0.12410106509923935
Epoch: 282
Loss on hold-out set: 0.02085574534057135
MeanAbsoluteError value on hold-out data: 0.1136074811220169
Epoch: 283
Loss on hold-out set: 0.02394624390610261
MeanAbsoluteError value on hold-out data: 0.12057951837778091
Epoch: 284
Loss on hold-out set: 0.022914073143231992
MeanAbsoluteError value on hold-out data: 0.12303503602743149
Epoch: 285
Loss on hold-out set: 0.02369371689700832
MeanAbsoluteError value on hold-out data: 0.12080550193786621
Epoch: 286
Loss on hold-out set: 0.022566994947119383
MeanAbsoluteError value on hold-out data: 0.11771950125694275
Epoch: 287
Loss on hold-out set: 0.02259969133262833
MeanAbsoluteError value on hold-out data: 0.11667267978191376
Epoch: 288
Loss on hold-out set: 0.024495937429843857
MeanAbsoluteError value on hold-out data: 0.12326152622699738
Epoch: 289
Loss on hold-out set: 0.02363144654921295
MeanAbsoluteError value on hold-out data: 0.12285568565130234
Epoch: 290
Loss on hold-out set: 0.02313736692420207
MeanAbsoluteError value on hold-out data: 0.11965490877628326
Epoch: 291
Loss on hold-out set: 0.02408823874332787
MeanAbsoluteError value on hold-out data: 0.1239018663764
Epoch: 292
Loss on hold-out set: 0.023292636614884638
MeanAbsoluteError value on hold-out data: 0.12116318941116333
Epoch: 293
Loss on hold-out set: 0.023024376207419362
MeanAbsoluteError value on hold-out data: 0.11814678460359573
Epoch: 294
Loss on hold-out set: 0.02390584628232015
MeanAbsoluteError value on hold-out data: 0.12480538338422775
Epoch: 295
Loss on hold-out set: 0.02434748106325666
MeanAbsoluteError value on hold-out data: 0.1263754665851593
Epoch: 296
Loss on hold-out set: 0.02427171522285789
MeanAbsoluteError value on hold-out data: 0.12210594117641449
Epoch: 297
Loss on hold-out set: 0.022546080630272625
MeanAbsoluteError value on hold-out data: 0.11936260014772415
Epoch: 298
Loss on hold-out set: 0.024392514023403842
MeanAbsoluteError value on hold-out data: 0.12240888178348541
Epoch: 299
Loss on hold-out set: 0.02394848794870389
MeanAbsoluteError value on hold-out data: 0.1224081963300705
Epoch: 300
Loss on hold-out set: 0.02427683749422916
MeanAbsoluteError value on hold-out data: 0.12409168481826782
Epoch: 301
Loss on hold-out set: 0.0234366940408169
MeanAbsoluteError value on hold-out data: 0.12207351624965668
Epoch: 302
Loss on hold-out set: 0.024494159562261
MeanAbsoluteError value on hold-out data: 0.12252791225910187
Epoch: 303
Loss on hold-out set: 0.02344733773129216
MeanAbsoluteError value on hold-out data: 0.12159857153892517
Epoch: 304
Loss on hold-out set: 0.02317072875710437
MeanAbsoluteError value on hold-out data: 0.1161886602640152
Epoch: 305
Loss on hold-out set: 0.024067959123931358
MeanAbsoluteError value on hold-out data: 0.12069497257471085
Epoch: 306
Loss on hold-out set: 0.023334654581073363
MeanAbsoluteError value on hold-out data: 0.12158739566802979
Epoch: 307
Loss on hold-out set: 0.024122506700229376
MeanAbsoluteError value on hold-out data: 0.12179021537303925
Epoch: 308
Loss on hold-out set: 0.02394571380117365
MeanAbsoluteError value on hold-out data: 0.12195611000061035
Epoch: 309
Loss on hold-out set: 0.02649228638658921
MeanAbsoluteError value on hold-out data: 0.12597167491912842
Epoch: 310
Loss on hold-out set: 0.02655894060909001
MeanAbsoluteError value on hold-out data: 0.12988612055778503
Epoch: 311
Loss on hold-out set: 0.02277460219222121
MeanAbsoluteError value on hold-out data: 0.11949535459280014
Epoch: 312
Loss on hold-out set: 0.023055971204691255
MeanAbsoluteError value on hold-out data: 0.12045996636152267
Epoch: 313
Loss on hold-out set: 0.022680874215099418
MeanAbsoluteError value on hold-out data: 0.1184215396642685
Epoch: 314
Loss on hold-out set: 0.023860680128176076
MeanAbsoluteError value on hold-out data: 0.12032589316368103
Epoch: 315
Loss on hold-out set: 0.022729427467662995
MeanAbsoluteError value on hold-out data: 0.11912428587675095
Epoch: 316
Loss on hold-out set: 0.020768513960453372
MeanAbsoluteError value on hold-out data: 0.11392534524202347
Epoch: 317
Loss on hold-out set: 0.022661287601586082
MeanAbsoluteError value on hold-out data: 0.11838123202323914
Epoch: 318
Loss on hold-out set: 0.02440161991583106
MeanAbsoluteError value on hold-out data: 0.1264677494764328
Epoch: 319
Loss on hold-out set: 0.023737627045581272
MeanAbsoluteError value on hold-out data: 0.12050598114728928
Epoch: 320
Loss on hold-out set: 0.021805088390343976
MeanAbsoluteError value on hold-out data: 0.11774121969938278
Epoch: 321
Loss on hold-out set: 0.02338048013887601
MeanAbsoluteError value on hold-out data: 0.12299597263336182
Epoch: 322
Loss on hold-out set: 0.023958535429507415
MeanAbsoluteError value on hold-out data: 0.12357480078935623
Epoch: 323
Loss on hold-out set: 0.024062747734609122
MeanAbsoluteError value on hold-out data: 0.12144184112548828
Epoch: 324
Loss on hold-out set: 0.022032196304256405
MeanAbsoluteError value on hold-out data: 0.1180565357208252
Epoch: 325
Loss on hold-out set: 0.02286489275623656
MeanAbsoluteError value on hold-out data: 0.11600285768508911
Epoch: 326
Loss on hold-out set: 0.022186077072207506
MeanAbsoluteError value on hold-out data: 0.11741752922534943
Epoch: 327
Loss on hold-out set: 0.02466904787889992
MeanAbsoluteError value on hold-out data: 0.12533831596374512
Epoch: 328
Loss on hold-out set: 0.02096625846636016
MeanAbsoluteError value on hold-out data: 0.11479752510786057
Epoch: 329
Loss on hold-out set: 0.025640024392147704
MeanAbsoluteError value on hold-out data: 0.12542550265789032
Epoch: 330
Loss on hold-out set: 0.02277960296223682
MeanAbsoluteError value on hold-out data: 0.11866328120231628
Epoch: 331
Loss on hold-out set: 0.023849122611815498
MeanAbsoluteError value on hold-out data: 0.12476177513599396
Epoch: 332
Loss on hold-out set: 0.022879613926634193
MeanAbsoluteError value on hold-out data: 0.1221310943365097
Epoch: 333
Loss on hold-out set: 0.024221114595008354
MeanAbsoluteError value on hold-out data: 0.12191087007522583
Epoch: 334
Loss on hold-out set: 0.02197488569484752
MeanAbsoluteError value on hold-out data: 0.1167309433221817
Epoch: 335
Loss on hold-out set: 0.023780320030055008
MeanAbsoluteError value on hold-out data: 0.12280984222888947
Epoch: 336
Loss on hold-out set: 0.023168918326167236
MeanAbsoluteError value on hold-out data: 0.12043548375368118
Epoch: 337
Loss on hold-out set: 0.022370162363804413
MeanAbsoluteError value on hold-out data: 0.11723962426185608
Epoch: 338
Loss on hold-out set: 0.024174746308126487
MeanAbsoluteError value on hold-out data: 0.12360360473394394
Epoch: 339
Loss on hold-out set: 0.022969535056229992
MeanAbsoluteError value on hold-out data: 0.1168724074959755
Epoch: 340
Loss on hold-out set: 0.023178989633427894
MeanAbsoluteError value on hold-out data: 0.11974240839481354
Epoch: 341
Loss on hold-out set: 0.021421286544646135
MeanAbsoluteError value on hold-out data: 0.11768358945846558
Epoch: 342
Loss on hold-out set: 0.020484683012861448
MeanAbsoluteError value on hold-out data: 0.11360418796539307
Epoch: 343
Loss on hold-out set: 0.022212091854113776
MeanAbsoluteError value on hold-out data: 0.11980172246694565
Epoch: 344
Loss on hold-out set: 0.0232325086348222
MeanAbsoluteError value on hold-out data: 0.12070008367300034
Epoch: 345
Loss on hold-out set: 0.024074097364306605
MeanAbsoluteError value on hold-out data: 0.11872594058513641
Epoch: 346
Loss on hold-out set: 0.02161121848631107
MeanAbsoluteError value on hold-out data: 0.11485081911087036
Epoch: 347
Loss on hold-out set: 0.021691437935029777
MeanAbsoluteError value on hold-out data: 0.11754847317934036
Epoch: 348
Loss on hold-out set: 0.02192791945155477
MeanAbsoluteError value on hold-out data: 0.11727705597877502
Epoch: 349
Loss on hold-out set: 0.022828202436018425
MeanAbsoluteError value on hold-out data: 0.11973400413990021
Epoch: 350
Loss on hold-out set: 0.021470825944901056
MeanAbsoluteError value on hold-out data: 0.11811328679323196
Epoch: 351
Loss on hold-out set: 0.023399467311246553
MeanAbsoluteError value on hold-out data: 0.12015660852193832
Epoch: 352
Loss on hold-out set: 0.023745442727425445
MeanAbsoluteError value on hold-out data: 0.12346746772527695
Epoch: 353
Loss on hold-out set: 0.022206633026289637
MeanAbsoluteError value on hold-out data: 0.11835622042417526
Epoch: 354
Loss on hold-out set: 0.022076392150059593
MeanAbsoluteError value on hold-out data: 0.11488797515630722
Epoch: 355
Loss on hold-out set: 0.02323332326700135
MeanAbsoluteError value on hold-out data: 0.120676189661026
Epoch: 356
Loss on hold-out set: 0.02270940661789306
MeanAbsoluteError value on hold-out data: 0.11915867775678635
Epoch: 357
Loss on hold-out set: 0.021424215792673448
MeanAbsoluteError value on hold-out data: 0.11468464136123657
Epoch: 358
Loss on hold-out set: 0.023058000259685893
MeanAbsoluteError value on hold-out data: 0.12101148068904877
Epoch: 359
Loss on hold-out set: 0.023614272138850843
MeanAbsoluteError value on hold-out data: 0.1188330426812172
Epoch: 360
Loss on hold-out set: 0.021964474783562764
MeanAbsoluteError value on hold-out data: 0.11646556854248047
Epoch: 361
Loss on hold-out set: 0.022765747711722118
MeanAbsoluteError value on hold-out data: 0.11847490817308426
Epoch: 362
Loss on hold-out set: 0.022522878216623212
MeanAbsoluteError value on hold-out data: 0.11294984072446823
Epoch: 363
Loss on hold-out set: 0.02400038231838456
MeanAbsoluteError value on hold-out data: 0.12071070075035095
Epoch: 364
Loss on hold-out set: 0.02342674529509774
MeanAbsoluteError value on hold-out data: 0.12045735865831375
Epoch: 365
Loss on hold-out set: 0.02215389242793511
MeanAbsoluteError value on hold-out data: 0.11803635954856873
Epoch: 366
Loss on hold-out set: 0.021840713710480485
MeanAbsoluteError value on hold-out data: 0.11465366184711456
Epoch: 367
Loss on hold-out set: 0.02266016207926441
MeanAbsoluteError value on hold-out data: 0.11983277648687363
Epoch: 368
Loss on hold-out set: 0.023747057300024608
MeanAbsoluteError value on hold-out data: 0.121561698615551
Epoch: 369
Loss on hold-out set: 0.024224666055524723
MeanAbsoluteError value on hold-out data: 0.1265554577112198
Epoch: 370
Loss on hold-out set: 0.02313592129891428
MeanAbsoluteError value on hold-out data: 0.11903318762779236
Epoch: 371
Loss on hold-out set: 0.02153677086981285
MeanAbsoluteError value on hold-out data: 0.11547103524208069
Epoch: 372
Loss on hold-out set: 0.023351890129658083
MeanAbsoluteError value on hold-out data: 0.11829952150583267
Epoch: 373
Loss on hold-out set: 0.020467697050674662
MeanAbsoluteError value on hold-out data: 0.11185140162706375
Epoch: 374
Loss on hold-out set: 0.022666679053218106
MeanAbsoluteError value on hold-out data: 0.1209087148308754
Epoch: 375
Loss on hold-out set: 0.021943264703343932
MeanAbsoluteError value on hold-out data: 0.11893148720264435
Epoch: 376
Loss on hold-out set: 0.021968503911048175
MeanAbsoluteError value on hold-out data: 0.11998794227838516
Epoch: 377
Loss on hold-out set: 0.023383110247086735
MeanAbsoluteError value on hold-out data: 0.11973103880882263
Epoch: 378
Loss on hold-out set: 0.019670968976958345
MeanAbsoluteError value on hold-out data: 0.11067815124988556
Epoch: 379
Loss on hold-out set: 0.02229004497504017
MeanAbsoluteError value on hold-out data: 0.11744754761457443
Epoch: 380
Loss on hold-out set: 0.022365949023078428
MeanAbsoluteError value on hold-out data: 0.11980395019054413
Epoch: 381
Loss on hold-out set: 0.02188297460392884
MeanAbsoluteError value on hold-out data: 0.11809419095516205
Epoch: 382
Loss on hold-out set: 0.022842662009522126
MeanAbsoluteError value on hold-out data: 0.11951816827058792
Epoch: 383
Loss on hold-out set: 0.02315768545260653
MeanAbsoluteError value on hold-out data: 0.12207510322332382
Epoch: 384
Loss on hold-out set: 0.019961689507824
MeanAbsoluteError value on hold-out data: 0.11093264073133469
Epoch: 385
Loss on hold-out set: 0.019647994738528116
MeanAbsoluteError value on hold-out data: 0.11029227077960968
Epoch: 386
Loss on hold-out set: 0.021880251353043906
MeanAbsoluteError value on hold-out data: 0.11507228761911392
Epoch: 387
Loss on hold-out set: 0.02283516015120161
MeanAbsoluteError value on hold-out data: 0.12141263484954834
Epoch: 388
Loss on hold-out set: 0.02251236275061577
MeanAbsoluteError value on hold-out data: 0.11707498878240585
Epoch: 389
Loss on hold-out set: 0.02422393160930369
MeanAbsoluteError value on hold-out data: 0.12255384027957916
Epoch: 390
Loss on hold-out set: 0.02124150393685947
MeanAbsoluteError value on hold-out data: 0.11653085052967072
Epoch: 391
Loss on hold-out set: 0.021034879060534875
MeanAbsoluteError value on hold-out data: 0.11181765049695969
Epoch: 392
Loss on hold-out set: 0.020842952451785093
MeanAbsoluteError value on hold-out data: 0.11509931087493896
Epoch: 393
Loss on hold-out set: 0.022050479282139955
MeanAbsoluteError value on hold-out data: 0.11635109037160873
Epoch: 394
Loss on hold-out set: 0.02055636941358292
MeanAbsoluteError value on hold-out data: 0.11366050690412521
Epoch: 395
Loss on hold-out set: 0.020803136973214956
MeanAbsoluteError value on hold-out data: 0.1121700182557106
Epoch: 396
Loss on hold-out set: 0.022580155366643644
MeanAbsoluteError value on hold-out data: 0.11874538660049438
Epoch: 397
Loss on hold-out set: 0.022230481719210122
MeanAbsoluteError value on hold-out data: 0.12040402740240097
Epoch: 398
Loss on hold-out set: 0.01971437223574564
MeanAbsoluteError value on hold-out data: 0.10989473015069962
Epoch: 399
Loss on hold-out set: 0.01954823029654411
MeanAbsoluteError value on hold-out data: 0.10901451110839844
Epoch: 400
Loss on hold-out set: 0.02175175452854698
MeanAbsoluteError value on hold-out data: 0.11596996337175369
Epoch: 401
Loss on hold-out set: 0.022763980723684654
MeanAbsoluteError value on hold-out data: 0.11898118257522583
Epoch: 402
Loss on hold-out set: 0.022627536899599364
MeanAbsoluteError value on hold-out data: 0.1205178052186966
Epoch: 403
Loss on hold-out set: 0.019508344895051172
MeanAbsoluteError value on hold-out data: 0.11069400608539581
Epoch: 404
Loss on hold-out set: 0.020107761847320944
MeanAbsoluteError value on hold-out data: 0.1120314672589302
Epoch: 405
Loss on hold-out set: 0.02145375120138245
MeanAbsoluteError value on hold-out data: 0.11665696650743484
Epoch: 406
Loss on hold-out set: 0.02035201273683924
MeanAbsoluteError value on hold-out data: 0.11080107092857361
Epoch: 407
Loss on hold-out set: 0.021311906942728456
MeanAbsoluteError value on hold-out data: 0.11645804345607758
Epoch: 408
Loss on hold-out set: 0.021228256631560118
MeanAbsoluteError value on hold-out data: 0.11667586117982864
Epoch: 409
Loss on hold-out set: 0.021098446388847756
MeanAbsoluteError value on hold-out data: 0.11440559476613998
Epoch: 410
Loss on hold-out set: 0.02307727828583059
MeanAbsoluteError value on hold-out data: 0.1194840595126152
Epoch: 411
Loss on hold-out set: 0.021567724249537908
MeanAbsoluteError value on hold-out data: 0.1149352416396141
Epoch: 412
Loss on hold-out set: 0.022551094390219076
MeanAbsoluteError value on hold-out data: 0.1173621267080307
Epoch: 413
Loss on hold-out set: 0.023099554310805008
MeanAbsoluteError value on hold-out data: 0.1222381740808487
Epoch: 414
Loss on hold-out set: 0.022441145202954735
MeanAbsoluteError value on hold-out data: 0.12057356536388397
Epoch: 415
Loss on hold-out set: 0.021867631870360733
MeanAbsoluteError value on hold-out data: 0.11403413116931915
Epoch: 416
Loss on hold-out set: 0.021246422334831247
MeanAbsoluteError value on hold-out data: 0.11414853483438492
Epoch: 417
Loss on hold-out set: 0.022333134684061708
MeanAbsoluteError value on hold-out data: 0.11661579459905624
Epoch: 418
Loss on hold-out set: 0.023087515897932464
MeanAbsoluteError value on hold-out data: 0.11897202581167221
Epoch: 419
Loss on hold-out set: 0.021341724541853183
MeanAbsoluteError value on hold-out data: 0.11664732545614243
Epoch: 420
Loss on hold-out set: 0.021004333461702725
MeanAbsoluteError value on hold-out data: 0.1133473813533783
Epoch: 421
Loss on hold-out set: 0.019867023161787074
MeanAbsoluteError value on hold-out data: 0.1117936447262764
Epoch: 422
Loss on hold-out set: 0.021931999329147706
MeanAbsoluteError value on hold-out data: 0.11452856659889221
Epoch: 423
Loss on hold-out set: 0.021385684851557018
MeanAbsoluteError value on hold-out data: 0.11516034603118896
Epoch: 424
Loss on hold-out set: 0.01899312984974434
MeanAbsoluteError value on hold-out data: 0.11020234227180481
Epoch: 425
Loss on hold-out set: 0.020933714424196902
MeanAbsoluteError value on hold-out data: 0.11486918479204178
Epoch: 426
Loss on hold-out set: 0.02084498700091596
MeanAbsoluteError value on hold-out data: 0.11229844391345978
Epoch: 427
Loss on hold-out set: 0.020831503713949737
MeanAbsoluteError value on hold-out data: 0.11507077515125275
Epoch: 428
Loss on hold-out set: 0.019764060028052578
MeanAbsoluteError value on hold-out data: 0.11177486181259155
Epoch: 429
Loss on hold-out set: 0.021685432123971015
MeanAbsoluteError value on hold-out data: 0.11792240291833878
Epoch: 430
Loss on hold-out set: 0.020704656096252924
MeanAbsoluteError value on hold-out data: 0.11407122015953064
Epoch: 431
Loss on hold-out set: 0.02102146444483272
MeanAbsoluteError value on hold-out data: 0.11512972414493561
Epoch: 432
Loss on hold-out set: 0.02002350132621359
MeanAbsoluteError value on hold-out data: 0.11115288734436035
Epoch: 433
Loss on hold-out set: 0.02126933268356273
MeanAbsoluteError value on hold-out data: 0.10986475646495819
Epoch: 434
Loss on hold-out set: 0.020972297757107298
MeanAbsoluteError value on hold-out data: 0.11283109337091446
Epoch: 435
Loss on hold-out set: 0.02144318236373086
MeanAbsoluteError value on hold-out data: 0.11307622492313385
Epoch: 436
Loss on hold-out set: 0.019751412168261595
MeanAbsoluteError value on hold-out data: 0.10893647372722626
Epoch: 437
Loss on hold-out set: 0.019382065426713477
MeanAbsoluteError value on hold-out data: 0.10839489102363586
Epoch: 438
Loss on hold-out set: 0.02197033773040554
MeanAbsoluteError value on hold-out data: 0.11306318640708923
Epoch: 439
Loss on hold-out set: 0.02120175481987341
MeanAbsoluteError value on hold-out data: 0.1137898787856102
Epoch: 440
Loss on hold-out set: 0.020511549363242617
MeanAbsoluteError value on hold-out data: 0.11309308558702469
Epoch: 441
Loss on hold-out set: 0.020201635592699555
MeanAbsoluteError value on hold-out data: 0.110955148935318
Epoch: 442
Loss on hold-out set: 0.018364675614284353
MeanAbsoluteError value on hold-out data: 0.10907774418592453
Epoch: 443
Loss on hold-out set: 0.02137568584701512
MeanAbsoluteError value on hold-out data: 0.11507178097963333
Epoch: 444
Loss on hold-out set: 0.021270730741574272
MeanAbsoluteError value on hold-out data: 0.11407758295536041
Epoch: 445
Loss on hold-out set: 0.019858712529821788
MeanAbsoluteError value on hold-out data: 0.11177901178598404
Epoch: 446
Loss on hold-out set: 0.02126796918300291
MeanAbsoluteError value on hold-out data: 0.11557762324810028
Epoch: 447
Loss on hold-out set: 0.021178374269492983
MeanAbsoluteError value on hold-out data: 0.11405417323112488
Epoch: 448
Loss on hold-out set: 0.020501147733496813
MeanAbsoluteError value on hold-out data: 0.11353433132171631
Epoch: 449
Loss on hold-out set: 0.021204893360457694
MeanAbsoluteError value on hold-out data: 0.11540701240301132
Epoch: 450
Loss on hold-out set: 0.0202559526792417
MeanAbsoluteError value on hold-out data: 0.10992314666509628
Epoch: 451
Loss on hold-out set: 0.020395079612596116
MeanAbsoluteError value on hold-out data: 0.11425865441560745
Epoch: 452
Loss on hold-out set: 0.02001095834558631
MeanAbsoluteError value on hold-out data: 0.10892607271671295
Epoch: 453
Loss on hold-out set: 0.022424267915775998
MeanAbsoluteError value on hold-out data: 0.11899291723966599
Epoch: 454
Loss on hold-out set: 0.020820962391953798
MeanAbsoluteError value on hold-out data: 0.11509659141302109
Epoch: 455
Loss on hold-out set: 0.020260313718002482
MeanAbsoluteError value on hold-out data: 0.11269659548997879
Epoch: 456
Loss on hold-out set: 0.019855215695667235
MeanAbsoluteError value on hold-out data: 0.11395535618066788
Epoch: 457
Loss on hold-out set: 0.02045181795908623
MeanAbsoluteError value on hold-out data: 0.11324990540742874
Epoch: 458
Loss on hold-out set: 0.020569892367348075
MeanAbsoluteError value on hold-out data: 0.1103745624423027
Epoch: 459
Loss on hold-out set: 0.01848141510648323
MeanAbsoluteError value on hold-out data: 0.10723298043012619
Epoch: 460
Loss on hold-out set: 0.02299214477704178
MeanAbsoluteError value on hold-out data: 0.12029988318681717
Epoch: 461
Loss on hold-out set: 0.018441153553915988
MeanAbsoluteError value on hold-out data: 0.10516586154699326
Epoch: 462
Loss on hold-out set: 0.021054146201446806
MeanAbsoluteError value on hold-out data: 0.11605004966259003
Epoch: 463
Loss on hold-out set: 0.02131437637784984
MeanAbsoluteError value on hold-out data: 0.11417395621538162
Epoch: 464
Loss on hold-out set: 0.020946415463586162
MeanAbsoluteError value on hold-out data: 0.11380963772535324
Epoch: 465
Loss on hold-out set: 0.019688533868951103
MeanAbsoluteError value on hold-out data: 0.11054139584302902
Epoch: 466
Loss on hold-out set: 0.019901008431916126
MeanAbsoluteError value on hold-out data: 0.11354275792837143
Epoch: 467
Loss on hold-out set: 0.019954076192419356
MeanAbsoluteError value on hold-out data: 0.11098586767911911
Epoch: 468
Loss on hold-out set: 0.021591341642294235
MeanAbsoluteError value on hold-out data: 0.11517342925071716
Epoch: 469
Loss on hold-out set: 0.02101422269275645
MeanAbsoluteError value on hold-out data: 0.11422157287597656
Epoch: 470
Loss on hold-out set: 0.018996566489950056
MeanAbsoluteError value on hold-out data: 0.10721056908369064
Epoch: 471
Loss on hold-out set: 0.019636177524856368
MeanAbsoluteError value on hold-out data: 0.11016030609607697
Epoch: 472
Loss on hold-out set: 0.019710230007694916
MeanAbsoluteError value on hold-out data: 0.10972419381141663
Epoch: 473
Loss on hold-out set: 0.019786729236714866
MeanAbsoluteError value on hold-out data: 0.10929636657238007
Epoch: 474
Loss on hold-out set: 0.02078199500615786
MeanAbsoluteError value on hold-out data: 0.11514175683259964
Epoch: 475
Loss on hold-out set: 0.021161249229917304
MeanAbsoluteError value on hold-out data: 0.1150173470377922
Epoch: 476
Loss on hold-out set: 0.02075538135492631
MeanAbsoluteError value on hold-out data: 0.11305328458547592
Epoch: 477
Loss on hold-out set: 0.020084796162554996
MeanAbsoluteError value on hold-out data: 0.11130674928426743
Epoch: 478
Loss on hold-out set: 0.020088918610611774
MeanAbsoluteError value on hold-out data: 0.1100226491689682
Epoch: 479
Loss on hold-out set: 0.021994158954269854
MeanAbsoluteError value on hold-out data: 0.1135614886879921
Epoch: 480
Loss on hold-out set: 0.01997733440774027
MeanAbsoluteError value on hold-out data: 0.11213138699531555
Epoch: 481
Loss on hold-out set: 0.01907661885226844
MeanAbsoluteError value on hold-out data: 0.10868673771619797
Epoch: 482
Loss on hold-out set: 0.01980982678612539
MeanAbsoluteError value on hold-out data: 0.1114146038889885
Epoch: 483
Loss on hold-out set: 0.02262186019618336
MeanAbsoluteError value on hold-out data: 0.11747271567583084
Epoch: 484
Loss on hold-out set: 0.01996333846541044
MeanAbsoluteError value on hold-out data: 0.11046600341796875
Epoch: 485
Loss on hold-out set: 0.01978198069530966
MeanAbsoluteError value on hold-out data: 0.11195585876703262
Epoch: 486
Loss on hold-out set: 0.018260979371892364
MeanAbsoluteError value on hold-out data: 0.1070537194609642
Epoch: 487
Loss on hold-out set: 0.020372305977837943
MeanAbsoluteError value on hold-out data: 0.11105978488922119
Epoch: 488
Loss on hold-out set: 0.02099204063299112
MeanAbsoluteError value on hold-out data: 0.11156647652387619
Epoch: 489
Loss on hold-out set: 0.020609053665733276
MeanAbsoluteError value on hold-out data: 0.1136358380317688
Epoch: 490
Loss on hold-out set: 0.01975886538188206
MeanAbsoluteError value on hold-out data: 0.11086249351501465
Epoch: 491
Loss on hold-out set: 0.01800315712345764
MeanAbsoluteError value on hold-out data: 0.1085311621427536
Epoch: 492
Loss on hold-out set: 0.021358625535309934
MeanAbsoluteError value on hold-out data: 0.11415429413318634
Epoch: 493
Loss on hold-out set: 0.02023705727677831
MeanAbsoluteError value on hold-out data: 0.11321429908275604
Epoch: 494
Loss on hold-out set: 0.020276838999173683
MeanAbsoluteError value on hold-out data: 0.11060445010662079
Epoch: 495
Loss on hold-out set: 0.0189591365837623
MeanAbsoluteError value on hold-out data: 0.11102844029664993
Epoch: 496
Loss on hold-out set: 0.018768380005300667
MeanAbsoluteError value on hold-out data: 0.10797137022018433
Epoch: 497
Loss on hold-out set: 0.02021053767724273
MeanAbsoluteError value on hold-out data: 0.10959085822105408
Epoch: 498
Loss on hold-out set: 0.01892752232138567
MeanAbsoluteError value on hold-out data: 0.10586093366146088
Epoch: 499
Loss on hold-out set: 0.021315123539340373
MeanAbsoluteError value on hold-out data: 0.11298558861017227
Epoch: 500
Loss on hold-out set: 0.02030367800606958
MeanAbsoluteError value on hold-out data: 0.11295736581087112
Epoch: 501
Loss on hold-out set: 0.018780696462102543
MeanAbsoluteError value on hold-out data: 0.10747990757226944
Epoch: 502
Loss on hold-out set: 0.0190315472977818
MeanAbsoluteError value on hold-out data: 0.1078186184167862
Epoch: 503
Loss on hold-out set: 0.018984504571693227
MeanAbsoluteError value on hold-out data: 0.11022800207138062
Epoch: 504
Loss on hold-out set: 0.01787619090153991
MeanAbsoluteError value on hold-out data: 0.10770110040903091
Epoch: 505
Loss on hold-out set: 0.019799520252757552
MeanAbsoluteError value on hold-out data: 0.10990698635578156
Epoch: 506
Loss on hold-out set: 0.01859451985200091
MeanAbsoluteError value on hold-out data: 0.10442978888750076
Epoch: 507
Loss on hold-out set: 0.018900202923832696
MeanAbsoluteError value on hold-out data: 0.10999231785535812
Epoch: 508
Loss on hold-out set: 0.019404211416792046
MeanAbsoluteError value on hold-out data: 0.10857181251049042
Epoch: 509
Loss on hold-out set: 0.01957356173460236
MeanAbsoluteError value on hold-out data: 0.10729798674583435
Epoch: 510
Loss on hold-out set: 0.022303599142081413
MeanAbsoluteError value on hold-out data: 0.1153060793876648
Epoch: 511
Loss on hold-out set: 0.019849460794030164
MeanAbsoluteError value on hold-out data: 0.11106744408607483
Epoch: 512
Loss on hold-out set: 0.019042562850324126
MeanAbsoluteError value on hold-out data: 0.107321597635746
Epoch: 513
Loss on hold-out set: 0.020028855538306137
MeanAbsoluteError value on hold-out data: 0.11051012575626373
Epoch: 514
Loss on hold-out set: 0.020558225307322573
MeanAbsoluteError value on hold-out data: 0.11141415685415268
Epoch: 515
Loss on hold-out set: 0.01928999695897801
MeanAbsoluteError value on hold-out data: 0.10915149748325348
Epoch: 516
Loss on hold-out set: 0.020636258051502713
MeanAbsoluteError value on hold-out data: 0.11023638397455215
Epoch: 517
Loss on hold-out set: 0.020205922616272194
MeanAbsoluteError value on hold-out data: 0.10909661650657654
Epoch: 518
Loss on hold-out set: 0.020066163050360047
MeanAbsoluteError value on hold-out data: 0.1119055524468422
Epoch: 519
Loss on hold-out set: 0.01934577103849733
MeanAbsoluteError value on hold-out data: 0.10994254052639008
Epoch: 520
Loss on hold-out set: 0.019158009261882398
MeanAbsoluteError value on hold-out data: 0.10992364585399628
Epoch: 521
Loss on hold-out set: 0.020124604186664025
MeanAbsoluteError value on hold-out data: 0.11250393092632294
Epoch: 522
Loss on hold-out set: 0.01828252618414505
MeanAbsoluteError value on hold-out data: 0.10611128807067871
Epoch: 523
Loss on hold-out set: 0.020420804834381367
MeanAbsoluteError value on hold-out data: 0.1111908107995987
Epoch: 524
Loss on hold-out set: 0.019417606889607364
MeanAbsoluteError value on hold-out data: 0.10860945284366608
Epoch: 525
Loss on hold-out set: 0.01842124861220024
MeanAbsoluteError value on hold-out data: 0.10754678398370743
Epoch: 526
Loss on hold-out set: 0.0188661554363595
MeanAbsoluteError value on hold-out data: 0.10751084983348846
Epoch: 527
Loss on hold-out set: 0.018565169095721406
MeanAbsoluteError value on hold-out data: 0.10852856934070587
Epoch: 528
Loss on hold-out set: 0.018070776187378214
MeanAbsoluteError value on hold-out data: 0.10515403747558594
Epoch: 529
Loss on hold-out set: 0.01909312981607703
MeanAbsoluteError value on hold-out data: 0.10899509489536285
Epoch: 530
Loss on hold-out set: 0.018699680372762182
MeanAbsoluteError value on hold-out data: 0.109880231320858
Epoch: 531
Loss on hold-out set: 0.01921180036753261
MeanAbsoluteError value on hold-out data: 0.10808829963207245
Epoch: 532
Loss on hold-out set: 0.01827375964067566
MeanAbsoluteError value on hold-out data: 0.10937163233757019
Epoch: 533
Loss on hold-out set: 0.018693143243629796
MeanAbsoluteError value on hold-out data: 0.10916467010974884
Epoch: 534
Loss on hold-out set: 0.018424778320234814
MeanAbsoluteError value on hold-out data: 0.10665513575077057
Epoch: 535
Loss on hold-out set: 0.01764225776422902
MeanAbsoluteError value on hold-out data: 0.10346296429634094
Epoch: 536
Loss on hold-out set: 0.0187419572766521
MeanAbsoluteError value on hold-out data: 0.10650165379047394
Epoch: 537
Loss on hold-out set: 0.019834112213672293
MeanAbsoluteError value on hold-out data: 0.11203843355178833
Epoch: 538
Loss on hold-out set: 0.01792409649429222
MeanAbsoluteError value on hold-out data: 0.105784110724926
Epoch: 539
Loss on hold-out set: 0.0195663014020829
MeanAbsoluteError value on hold-out data: 0.10989225655794144
Epoch: 540
Loss on hold-out set: 0.01875745302682238
MeanAbsoluteError value on hold-out data: 0.10367187857627869
Epoch: 541
Loss on hold-out set: 0.01993930512292233
MeanAbsoluteError value on hold-out data: 0.1097218319773674
Epoch: 542
Loss on hold-out set: 0.01850410113571949
MeanAbsoluteError value on hold-out data: 0.10635329782962799
Epoch: 543
Loss on hold-out set: 0.01680070580244016
MeanAbsoluteError value on hold-out data: 0.10147284716367722
Epoch: 544
Loss on hold-out set: 0.01743443859570107
MeanAbsoluteError value on hold-out data: 0.10482229292392731
Epoch: 545
Loss on hold-out set: 0.018458862579160875
MeanAbsoluteError value on hold-out data: 0.10557042807340622
Epoch: 546
Loss on hold-out set: 0.018974136565617906
MeanAbsoluteError value on hold-out data: 0.1073351800441742
Epoch: 547
Loss on hold-out set: 0.01928049138824766
MeanAbsoluteError value on hold-out data: 0.11035294830799103
Epoch: 548
Loss on hold-out set: 0.018031690045609138
MeanAbsoluteError value on hold-out data: 0.1031453013420105
Epoch: 549
Loss on hold-out set: 0.017353596679998494
MeanAbsoluteError value on hold-out data: 0.10004318505525589
Epoch: 550
Loss on hold-out set: 0.016814619228971425
MeanAbsoluteError value on hold-out data: 0.10142872482538223
Epoch: 551
Loss on hold-out set: 0.01823202486244554
MeanAbsoluteError value on hold-out data: 0.10635076463222504
Epoch: 552
Loss on hold-out set: 0.018324877131017273
MeanAbsoluteError value on hold-out data: 0.10653888434171677
Epoch: 553
Loss on hold-out set: 0.01929087211251802
MeanAbsoluteError value on hold-out data: 0.10975035279989243
Epoch: 554
Loss on hold-out set: 0.01830240217304284
MeanAbsoluteError value on hold-out data: 0.10601293295621872
Epoch: 555
Loss on hold-out set: 0.016817359871250423
MeanAbsoluteError value on hold-out data: 0.10035280138254166
Epoch: 556
Loss on hold-out set: 0.016868349314463557
MeanAbsoluteError value on hold-out data: 0.10197031497955322
Epoch: 557
Loss on hold-out set: 0.017871533265012354
MeanAbsoluteError value on hold-out data: 0.10467325896024704
Epoch: 558
Loss on hold-out set: 0.01848935501941014
MeanAbsoluteError value on hold-out data: 0.10851597785949707
Epoch: 559
Loss on hold-out set: 0.020532517657460024
MeanAbsoluteError value on hold-out data: 0.11231670528650284
Epoch: 560
Loss on hold-out set: 0.017839131786592285
MeanAbsoluteError value on hold-out data: 0.10293290764093399
Epoch: 561
Loss on hold-out set: 0.016918282172991895
MeanAbsoluteError value on hold-out data: 0.10278820246458054
Epoch: 562
Loss on hold-out set: 0.018053439239884027
MeanAbsoluteError value on hold-out data: 0.1048567146062851
Epoch: 563
Loss on hold-out set: 0.017255253497278317
MeanAbsoluteError value on hold-out data: 0.10411572456359863
Epoch: 564
Loss on hold-out set: 0.019148081138846463
MeanAbsoluteError value on hold-out data: 0.10789930075407028
Epoch: 565
Loss on hold-out set: 0.018426872910616416
MeanAbsoluteError value on hold-out data: 0.10701829195022583
Epoch: 566
Loss on hold-out set: 0.01793016258054801
MeanAbsoluteError value on hold-out data: 0.10635080188512802
Epoch: 567
Loss on hold-out set: 0.017570184813521336
MeanAbsoluteError value on hold-out data: 0.10065891593694687
Epoch: 568
Loss on hold-out set: 0.018777417015307947
MeanAbsoluteError value on hold-out data: 0.10693173855543137
Epoch: 569
Loss on hold-out set: 0.020027656784222927
MeanAbsoluteError value on hold-out data: 0.10910703986883163
Epoch: 570
Loss on hold-out set: 0.018670616964809598
MeanAbsoluteError value on hold-out data: 0.10807741433382034
Epoch: 571
Loss on hold-out set: 0.016486172091584497
MeanAbsoluteError value on hold-out data: 0.10315852612257004
Epoch: 572
Loss on hold-out set: 0.017623136838043743
MeanAbsoluteError value on hold-out data: 0.1033482551574707
Epoch: 573
Loss on hold-out set: 0.016634244058902067
MeanAbsoluteError value on hold-out data: 0.09853929281234741
Epoch: 574
Loss on hold-out set: 0.020175395273060226
MeanAbsoluteError value on hold-out data: 0.11410848051309586
Epoch: 575
Loss on hold-out set: 0.01644576013975893
MeanAbsoluteError value on hold-out data: 0.10174485296010971
Epoch: 576
Loss on hold-out set: 0.019963092119821037
MeanAbsoluteError value on hold-out data: 0.10534659773111343
Epoch: 577
Loss on hold-out set: 0.019521941631731654
MeanAbsoluteError value on hold-out data: 0.10939886420965195
Epoch: 578
Loss on hold-out set: 0.018482529717342308
MeanAbsoluteError value on hold-out data: 0.10886183381080627
Epoch: 579
Loss on hold-out set: 0.017324873275356367
MeanAbsoluteError value on hold-out data: 0.10348455607891083
Epoch: 580
Loss on hold-out set: 0.01723464967382218
MeanAbsoluteError value on hold-out data: 0.1045544221997261
Epoch: 581
Loss on hold-out set: 0.017578015871592165
MeanAbsoluteError value on hold-out data: 0.10450991243124008
Epoch: 582
Loss on hold-out set: 0.017870173536163443
MeanAbsoluteError value on hold-out data: 0.10493124276399612
Epoch: 583
Loss on hold-out set: 0.01857024294709845
MeanAbsoluteError value on hold-out data: 0.10485313832759857
Epoch: 584
Loss on hold-out set: 0.019464265163793848
MeanAbsoluteError value on hold-out data: 0.10866386443376541
Epoch: 585
Loss on hold-out set: 0.017181296513687508
MeanAbsoluteError value on hold-out data: 0.1032620444893837
Epoch: 586
Loss on hold-out set: 0.018364248415940285
MeanAbsoluteError value on hold-out data: 0.10480669140815735
Epoch: 587
Loss on hold-out set: 0.018638544428055563
MeanAbsoluteError value on hold-out data: 0.10534331947565079
Epoch: 588
Loss on hold-out set: 0.01765890834957342
MeanAbsoluteError value on hold-out data: 0.10363471508026123
Epoch: 589
Loss on hold-out set: 0.018790488517176223
MeanAbsoluteError value on hold-out data: 0.10745969414710999
Epoch: 590
Loss on hold-out set: 0.017710127233537303
MeanAbsoluteError value on hold-out data: 0.10440104454755783
Epoch: 591
Loss on hold-out set: 0.01782403301273007
MeanAbsoluteError value on hold-out data: 0.10223998129367828
Epoch: 592
Loss on hold-out set: 0.015965731970209163
MeanAbsoluteError value on hold-out data: 0.09755147248506546
Epoch: 593
Loss on hold-out set: 0.018348079642552573
MeanAbsoluteError value on hold-out data: 0.10248523205518723
Epoch: 594
Loss on hold-out set: 0.018883553800890997
MeanAbsoluteError value on hold-out data: 0.1039091944694519
Epoch: 595
Loss on hold-out set: 0.01734096679118617
MeanAbsoluteError value on hold-out data: 0.1027679443359375
Epoch: 596
Loss on hold-out set: 0.017913278867423894
MeanAbsoluteError value on hold-out data: 0.1047079861164093
Epoch: 597
Loss on hold-out set: 0.016821238389675273
MeanAbsoluteError value on hold-out data: 0.10386691242456436
Epoch: 598
Loss on hold-out set: 0.01906579177491949
MeanAbsoluteError value on hold-out data: 0.11050499975681305
Epoch: 599
Loss on hold-out set: 0.016580166036353605
MeanAbsoluteError value on hold-out data: 0.10126671940088272
Epoch: 600
Loss on hold-out set: 0.019866066151431976
MeanAbsoluteError value on hold-out data: 0.1096663549542427
Epoch: 601
Loss on hold-out set: 0.017929457952801993
MeanAbsoluteError value on hold-out data: 0.10566391050815582
Epoch: 602
Loss on hold-out set: 0.018041367225475065
MeanAbsoluteError value on hold-out data: 0.10454201698303223
Epoch: 603
Loss on hold-out set: 0.017509684305793295
MeanAbsoluteError value on hold-out data: 0.10216747969388962
Epoch: 604
Loss on hold-out set: 0.01735041593298471
MeanAbsoluteError value on hold-out data: 0.10232298821210861
Epoch: 605
Loss on hold-out set: 0.018658539228393542
MeanAbsoluteError value on hold-out data: 0.10600672662258148
Epoch: 606
Loss on hold-out set: 0.018679196920905573
MeanAbsoluteError value on hold-out data: 0.10926570743322372
Epoch: 607
Loss on hold-out set: 0.018981261086737505
MeanAbsoluteError value on hold-out data: 0.10724225640296936
Epoch: 608
Loss on hold-out set: 0.017316057725887124
MeanAbsoluteError value on hold-out data: 0.10348092019557953
Epoch: 609
Loss on hold-out set: 0.018182405426426462
MeanAbsoluteError value on hold-out data: 0.10429573804140091
Epoch: 610
Loss on hold-out set: 0.01615119077381678
MeanAbsoluteError value on hold-out data: 0.10049189627170563
Epoch: 611
Loss on hold-out set: 0.015949980703298935
MeanAbsoluteError value on hold-out data: 0.09735921025276184
Epoch: 612
Loss on hold-out set: 0.01842195243089615
MeanAbsoluteError value on hold-out data: 0.10510611534118652
Epoch: 613
Loss on hold-out set: 0.01686162465028853
MeanAbsoluteError value on hold-out data: 0.10036077350378036
Epoch: 614
Loss on hold-out set: 0.017522872965297816
MeanAbsoluteError value on hold-out data: 0.10203390568494797
Epoch: 615
Loss on hold-out set: 0.015801732024992816
MeanAbsoluteError value on hold-out data: 0.09802687913179398
Epoch: 616
Loss on hold-out set: 0.0168879490258405
MeanAbsoluteError value on hold-out data: 0.10305663198232651
Epoch: 617
Loss on hold-out set: 0.016343006016298508
MeanAbsoluteError value on hold-out data: 0.09730079025030136
Epoch: 618
Loss on hold-out set: 0.020238527718077725
MeanAbsoluteError value on hold-out data: 0.11007961630821228
Epoch: 619
Loss on hold-out set: 0.017514642019377788
MeanAbsoluteError value on hold-out data: 0.10458364337682724
Epoch: 620
Loss on hold-out set: 0.017635129589143615
MeanAbsoluteError value on hold-out data: 0.10068614780902863
Epoch: 621
Loss on hold-out set: 0.01860573782372133
MeanAbsoluteError value on hold-out data: 0.10655771195888519
Epoch: 622
Loss on hold-out set: 0.017642200920333077
MeanAbsoluteError value on hold-out data: 0.10317474603652954
Epoch: 623
Loss on hold-out set: 0.01768827882304322
MeanAbsoluteError value on hold-out data: 0.10309094190597534
Epoch: 624
Loss on hold-out set: 0.016644200994633138
MeanAbsoluteError value on hold-out data: 0.09978540986776352
Epoch: 625
Loss on hold-out set: 0.017020023356502254
MeanAbsoluteError value on hold-out data: 0.10209523886442184
Epoch: 626
Loss on hold-out set: 0.01756917510817099
MeanAbsoluteError value on hold-out data: 0.10317963361740112
Epoch: 627
Loss on hold-out set: 0.015506881610684408
MeanAbsoluteError value on hold-out data: 0.09633231908082962
Epoch: 628
Loss on hold-out set: 0.016413349021653024
MeanAbsoluteError value on hold-out data: 0.10198835283517838
Epoch: 629
Loss on hold-out set: 0.01824823516770266
MeanAbsoluteError value on hold-out data: 0.10549373924732208
Epoch: 630
Loss on hold-out set: 0.018902023031453913
MeanAbsoluteError value on hold-out data: 0.10421313345432281
Epoch: 631
Loss on hold-out set: 0.015626733911582657
MeanAbsoluteError value on hold-out data: 0.09998714178800583
Epoch: 632
Loss on hold-out set: 0.01662848651064754
MeanAbsoluteError value on hold-out data: 0.1005074754357338
Epoch: 633
Loss on hold-out set: 0.017907323368999643
MeanAbsoluteError value on hold-out data: 0.1067410558462143
Epoch: 634
Loss on hold-out set: 0.0170460361452812
MeanAbsoluteError value on hold-out data: 0.10443176329135895
Epoch: 635
Loss on hold-out set: 0.01640663208575764
MeanAbsoluteError value on hold-out data: 0.10003924369812012
Epoch: 636
Loss on hold-out set: 0.017915699042302245
MeanAbsoluteError value on hold-out data: 0.10691516846418381
Epoch: 637
Loss on hold-out set: 0.015968547382878267
MeanAbsoluteError value on hold-out data: 0.09662564843893051
Epoch: 638
Loss on hold-out set: 0.016459449216296586
MeanAbsoluteError value on hold-out data: 0.10016974061727524
Epoch: 639
Loss on hold-out set: 0.018406790120934602
MeanAbsoluteError value on hold-out data: 0.1071222573518753
Epoch: 640
Loss on hold-out set: 0.01729987398313824
MeanAbsoluteError value on hold-out data: 0.1041436493396759
Epoch: 641
Loss on hold-out set: 0.015081075912554904
MeanAbsoluteError value on hold-out data: 0.09658883512020111
Epoch: 642
Loss on hold-out set: 0.015137673211950945
MeanAbsoluteError value on hold-out data: 0.09504565596580505
Epoch: 643
Loss on hold-out set: 0.016493399126411533
MeanAbsoluteError value on hold-out data: 0.09949466586112976
Epoch: 644
Loss on hold-out set: 0.016738319444896965
MeanAbsoluteError value on hold-out data: 0.10271362215280533
Epoch: 645
Loss on hold-out set: 0.01588580931944307
MeanAbsoluteError value on hold-out data: 0.09957388043403625
Epoch: 646
Loss on hold-out set: 0.015965759939548053
MeanAbsoluteError value on hold-out data: 0.0955745279788971
Epoch: 647
Loss on hold-out set: 0.01706989003306565
MeanAbsoluteError value on hold-out data: 0.1040133535861969
Epoch: 648
Loss on hold-out set: 0.01626090382458642
MeanAbsoluteError value on hold-out data: 0.10112939029932022
Epoch: 649
Loss on hold-out set: 0.01565112287198038
MeanAbsoluteError value on hold-out data: 0.09762197732925415
Epoch: 650
Loss on hold-out set: 0.016917698573530895
MeanAbsoluteError value on hold-out data: 0.09943915903568268
Epoch: 651
Loss on hold-out set: 0.016069594586345676
MeanAbsoluteError value on hold-out data: 0.09990177303552628
Epoch: 652
Loss on hold-out set: 0.015884773450670762
MeanAbsoluteError value on hold-out data: 0.09909024834632874
Epoch: 653
Loss on hold-out set: 0.015963050755429625
MeanAbsoluteError value on hold-out data: 0.0986873209476471
Epoch: 654
Loss on hold-out set: 0.017527076209780716
MeanAbsoluteError value on hold-out data: 0.10435168445110321
Epoch: 655
Loss on hold-out set: 0.01751922851445367
MeanAbsoluteError value on hold-out data: 0.10382947325706482
Epoch: 656
Loss on hold-out set: 0.017785323522790955
MeanAbsoluteError value on hold-out data: 0.10255855321884155
Epoch: 657
Loss on hold-out set: 0.015571214719432949
MeanAbsoluteError value on hold-out data: 0.09560803323984146
Epoch: 658
Loss on hold-out set: 0.016043056024233615
MeanAbsoluteError value on hold-out data: 0.09736937284469604
Epoch: 659
Loss on hold-out set: 0.01693045300693484
MeanAbsoluteError value on hold-out data: 0.10081886500120163
Epoch: 660
Loss on hold-out set: 0.01630362905464911
MeanAbsoluteError value on hold-out data: 0.10237444192171097
Epoch: 661
Loss on hold-out set: 0.016668751275137766
MeanAbsoluteError value on hold-out data: 0.09968840330839157
Epoch: 662
Loss on hold-out set: 0.017535324301861693
MeanAbsoluteError value on hold-out data: 0.10267435759305954
Epoch: 663
Loss on hold-out set: 0.01715426427894272
MeanAbsoluteError value on hold-out data: 0.09993233531713486
Epoch: 664
Loss on hold-out set: 0.015400039419570627
MeanAbsoluteError value on hold-out data: 0.09726548194885254
Epoch: 665
Loss on hold-out set: 0.018446201251569316
MeanAbsoluteError value on hold-out data: 0.10671498626470566
Epoch: 666
Loss on hold-out set: 0.016969855587230995
MeanAbsoluteError value on hold-out data: 0.10150500386953354
Epoch: 667
Loss on hold-out set: 0.01728946973384154
MeanAbsoluteError value on hold-out data: 0.10326902568340302
Epoch: 668
Loss on hold-out set: 0.016093225956222645
MeanAbsoluteError value on hold-out data: 0.09708940982818604
Epoch: 669
Loss on hold-out set: 0.01700662577568437
MeanAbsoluteError value on hold-out data: 0.10329293459653854
Epoch: 670
Loss on hold-out set: 0.016232700312199692
MeanAbsoluteError value on hold-out data: 0.09891071915626526
Epoch: 671
Loss on hold-out set: 0.016382287562494942
MeanAbsoluteError value on hold-out data: 0.0987488254904747
Epoch: 672
Loss on hold-out set: 0.017364742494731522
MeanAbsoluteError value on hold-out data: 0.10257645696401596
Epoch: 673
Loss on hold-out set: 0.01662480154860532
MeanAbsoluteError value on hold-out data: 0.09952640533447266
Epoch: 674
Loss on hold-out set: 0.016720656718389362
MeanAbsoluteError value on hold-out data: 0.10236503928899765
Epoch: 675
Loss on hold-out set: 0.01733164112471665
MeanAbsoluteError value on hold-out data: 0.10326553136110306
Epoch: 676
Loss on hold-out set: 0.018784760173681813
MeanAbsoluteError value on hold-out data: 0.1067107766866684
Epoch: 677
Loss on hold-out set: 0.014760884100348145
MeanAbsoluteError value on hold-out data: 0.09439777582883835
Epoch: 678
Loss on hold-out set: 0.01503923633834347
MeanAbsoluteError value on hold-out data: 0.09651869535446167
Epoch: 679
Loss on hold-out set: 0.018221429025870747
MeanAbsoluteError value on hold-out data: 0.1052158996462822
Epoch: 680
Loss on hold-out set: 0.016571675351297017
MeanAbsoluteError value on hold-out data: 0.09962265938520432
Epoch: 681
Loss on hold-out set: 0.017114411048120625
MeanAbsoluteError value on hold-out data: 0.10311286896467209
Epoch: 682
Loss on hold-out set: 0.014464321882411847
MeanAbsoluteError value on hold-out data: 0.09503494203090668
Epoch: 683
Loss on hold-out set: 0.01639086593214112
MeanAbsoluteError value on hold-out data: 0.09964287281036377
Epoch: 684
Loss on hold-out set: 0.014097504149540328
MeanAbsoluteError value on hold-out data: 0.09379059821367264
Epoch: 685
Loss on hold-out set: 0.017206537594805317
MeanAbsoluteError value on hold-out data: 0.10595995932817459
Epoch: 686
Loss on hold-out set: 0.01703602604509797
MeanAbsoluteError value on hold-out data: 0.1009056568145752
Epoch: 687
Loss on hold-out set: 0.015717863588191296
MeanAbsoluteError value on hold-out data: 0.09526371210813522
Epoch: 688
Loss on hold-out set: 0.015663065822057735
MeanAbsoluteError value on hold-out data: 0.09848276525735855
Epoch: 689
Loss on hold-out set: 0.016377567252105412
MeanAbsoluteError value on hold-out data: 0.09885045886039734
Epoch: 690
Loss on hold-out set: 0.016546487315014624
MeanAbsoluteError value on hold-out data: 0.10240158438682556
Epoch: 691
Loss on hold-out set: 0.01632447953770073
MeanAbsoluteError value on hold-out data: 0.09692990779876709
Epoch: 692
Loss on hold-out set: 0.016114494334694123
MeanAbsoluteError value on hold-out data: 0.09766481816768646
Epoch: 693
Loss on hold-out set: 0.018029288645193445
MeanAbsoluteError value on hold-out data: 0.10728393495082855
Epoch: 694
Loss on hold-out set: 0.017927403849025723
MeanAbsoluteError value on hold-out data: 0.10393128544092178
Epoch: 695
Loss on hold-out set: 0.015401486737625116
MeanAbsoluteError value on hold-out data: 0.09817850589752197
Epoch: 696
Loss on hold-out set: 0.01723084194343149
MeanAbsoluteError value on hold-out data: 0.1020481288433075
Epoch: 697
Loss on hold-out set: 0.016189304817319984
MeanAbsoluteError value on hold-out data: 0.09932135045528412
Epoch: 698
Loss on hold-out set: 0.016289107106179774
MeanAbsoluteError value on hold-out data: 0.10091916471719742
Epoch: 699
Loss on hold-out set: 0.015832898107595004
MeanAbsoluteError value on hold-out data: 0.09896451979875565
Epoch: 700
Loss on hold-out set: 0.01554116261290801
MeanAbsoluteError value on hold-out data: 0.09611236304044724
Epoch: 701
Loss on hold-out set: 0.015618270779377781
MeanAbsoluteError value on hold-out data: 0.09919142723083496
Epoch: 702
Loss on hold-out set: 0.016827168710393987
MeanAbsoluteError value on hold-out data: 0.0990784615278244
Epoch: 703
Loss on hold-out set: 0.01592696641710063
MeanAbsoluteError value on hold-out data: 0.09641215950250626
Epoch: 704
Loss on hold-out set: 0.01735313367281075
MeanAbsoluteError value on hold-out data: 0.10311415046453476
Epoch: 705
Loss on hold-out set: 0.015714254725802068
MeanAbsoluteError value on hold-out data: 0.09472442418336868
Epoch: 706
Loss on hold-out set: 0.014985095099570269
MeanAbsoluteError value on hold-out data: 0.096425861120224
Epoch: 707
Loss on hold-out set: 0.015136551266380896
MeanAbsoluteError value on hold-out data: 0.09677008539438248
Epoch: 708
Loss on hold-out set: 0.015558350090747505
MeanAbsoluteError value on hold-out data: 0.09699946641921997
Epoch: 709
Loss on hold-out set: 0.015670175110086955
MeanAbsoluteError value on hold-out data: 0.09563177078962326
Epoch: 710
Loss on hold-out set: 0.017739576158346607
MeanAbsoluteError value on hold-out data: 0.10408572852611542
Epoch: 711
Loss on hold-out set: 0.014684017746039899
MeanAbsoluteError value on hold-out data: 0.09469497948884964
Epoch: 712
Loss on hold-out set: 0.015876592832573807
MeanAbsoluteError value on hold-out data: 0.09690582752227783
Epoch: 713
Loss on hold-out set: 0.017155377392846276
MeanAbsoluteError value on hold-out data: 0.10346033424139023
Epoch: 714
Loss on hold-out set: 0.013977735182052128
MeanAbsoluteError value on hold-out data: 0.09348923712968826
Epoch: 715
Loss on hold-out set: 0.01598781299641511
MeanAbsoluteError value on hold-out data: 0.09976905584335327
Epoch: 716
Loss on hold-out set: 0.016376307404619487
MeanAbsoluteError value on hold-out data: 0.10192809998989105
Epoch: 717
Loss on hold-out set: 0.015359079913372018
MeanAbsoluteError value on hold-out data: 0.09410597383975983
Epoch: 718
Loss on hold-out set: 0.01621423731635635
MeanAbsoluteError value on hold-out data: 0.10014477372169495
Epoch: 719
Loss on hold-out set: 0.015811512760216525
MeanAbsoluteError value on hold-out data: 0.0990700051188469
Epoch: 720
Loss on hold-out set: 0.016326651299217097
MeanAbsoluteError value on hold-out data: 0.09944479912519455
Epoch: 721
Loss on hold-out set: 0.016181085370117216
MeanAbsoluteError value on hold-out data: 0.09753566980361938
Epoch: 722
Loss on hold-out set: 0.015810667154049347
MeanAbsoluteError value on hold-out data: 0.09909619390964508
Epoch: 723
Loss on hold-out set: 0.0166935425948274
MeanAbsoluteError value on hold-out data: 0.09963280707597733
Epoch: 724
Loss on hold-out set: 0.015388092847306325
MeanAbsoluteError value on hold-out data: 0.09634996205568314
Epoch: 725
Loss on hold-out set: 0.014354580759099917
MeanAbsoluteError value on hold-out data: 0.09190139919519424
Epoch: 726
Loss on hold-out set: 0.0166465729629878
MeanAbsoluteError value on hold-out data: 0.09869280457496643
Epoch: 727
Loss on hold-out set: 0.015831475346931256
MeanAbsoluteError value on hold-out data: 0.09783978015184402
Epoch: 728
Loss on hold-out set: 0.01556299083221044
MeanAbsoluteError value on hold-out data: 0.09618670493364334
Epoch: 729
Loss on hold-out set: 0.013965027074251945
MeanAbsoluteError value on hold-out data: 0.09361375868320465
Epoch: 730
Loss on hold-out set: 0.015463434519133443
MeanAbsoluteError value on hold-out data: 0.09736931324005127
Epoch: 731
Loss on hold-out set: 0.014861093227761255
MeanAbsoluteError value on hold-out data: 0.09813712537288666
Epoch: 732
Loss on hold-out set: 0.015464305413576464
MeanAbsoluteError value on hold-out data: 0.09853106737136841
Epoch: 733
Loss on hold-out set: 0.015456032168828338
MeanAbsoluteError value on hold-out data: 0.09461469203233719
Epoch: 734
Loss on hold-out set: 0.01617824279014409
MeanAbsoluteError value on hold-out data: 0.09935851395130157
Epoch: 735
Loss on hold-out set: 0.014761063833575463
MeanAbsoluteError value on hold-out data: 0.09676702320575714
Epoch: 736
Loss on hold-out set: 0.015448386578257972
MeanAbsoluteError value on hold-out data: 0.09534621238708496
Epoch: 737
Loss on hold-out set: 0.014634459951266762
MeanAbsoluteError value on hold-out data: 0.09210169315338135
Epoch: 738
Loss on hold-out set: 0.014716752482927404
MeanAbsoluteError value on hold-out data: 0.09544230252504349
Epoch: 739
Loss on hold-out set: 0.015412725097266957
MeanAbsoluteError value on hold-out data: 0.09501354396343231
Epoch: 740
Loss on hold-out set: 0.016149882382014768
MeanAbsoluteError value on hold-out data: 0.09666222333908081
Epoch: 741
Loss on hold-out set: 0.01775537264807402
MeanAbsoluteError value on hold-out data: 0.10346345603466034
Epoch: 742
Loss on hold-out set: 0.01542219238683174
MeanAbsoluteError value on hold-out data: 0.09622672945261002
Epoch: 743
Loss on hold-out set: 0.016156343222925595
MeanAbsoluteError value on hold-out data: 0.09797349572181702
Epoch: 744
Loss on hold-out set: 0.016106794996958343
MeanAbsoluteError value on hold-out data: 0.0988340675830841
Epoch: 745
Loss on hold-out set: 0.016013103759493486
MeanAbsoluteError value on hold-out data: 0.09874331206083298
Epoch: 746
Loss on hold-out set: 0.014706010781543833
MeanAbsoluteError value on hold-out data: 0.09284994006156921
Epoch: 747
Loss on hold-out set: 0.017067880816175603
MeanAbsoluteError value on hold-out data: 0.10132547467947006
Epoch: 748
Loss on hold-out set: 0.015607997224336334
MeanAbsoluteError value on hold-out data: 0.0984627828001976
Epoch: 749
Loss on hold-out set: 0.014726149284397251
MeanAbsoluteError value on hold-out data: 0.09512253850698471
Epoch: 750
Loss on hold-out set: 0.0158435064383472
MeanAbsoluteError value on hold-out data: 0.0968671664595604
Epoch: 751
Loss on hold-out set: 0.015410885891178623
MeanAbsoluteError value on hold-out data: 0.09676636010408401
Epoch: 752
Loss on hold-out set: 0.015981924139729622
MeanAbsoluteError value on hold-out data: 0.09730013459920883
Epoch: 753
Loss on hold-out set: 0.015394724681585406
MeanAbsoluteError value on hold-out data: 0.09544174373149872
Epoch: 754
Loss on hold-out set: 0.015111433343251216
MeanAbsoluteError value on hold-out data: 0.0929160863161087
Epoch: 755
Loss on hold-out set: 0.014325358692682736
MeanAbsoluteError value on hold-out data: 0.09170106798410416
Epoch: 756
Loss on hold-out set: 0.015964099536358845
MeanAbsoluteError value on hold-out data: 0.09903701394796371
Epoch: 757
Loss on hold-out set: 0.01699558595685327
MeanAbsoluteError value on hold-out data: 0.1012343242764473
Epoch: 758
Loss on hold-out set: 0.017743121145698145
MeanAbsoluteError value on hold-out data: 0.10365631431341171
Epoch: 759
Loss on hold-out set: 0.013740836678771302
MeanAbsoluteError value on hold-out data: 0.09064017236232758
Epoch: 760
Loss on hold-out set: 0.01462400351568552
MeanAbsoluteError value on hold-out data: 0.09350497275590897
Epoch: 761
Loss on hold-out set: 0.0143261853044775
MeanAbsoluteError value on hold-out data: 0.09547846019268036
Epoch: 762
Loss on hold-out set: 0.014779664762463653
MeanAbsoluteError value on hold-out data: 0.09424593299627304
Epoch: 763
Loss on hold-out set: 0.01389580865648592
MeanAbsoluteError value on hold-out data: 0.09092319011688232
Epoch: 764
Loss on hold-out set: 0.015050391455976447
MeanAbsoluteError value on hold-out data: 0.09554700553417206
Epoch: 765
Loss on hold-out set: 0.014397227679680024
MeanAbsoluteError value on hold-out data: 0.09381948411464691
Epoch: 766
Loss on hold-out set: 0.01306821484938458
MeanAbsoluteError value on hold-out data: 0.0896538570523262
Epoch: 767
Loss on hold-out set: 0.014229176303221418
MeanAbsoluteError value on hold-out data: 0.09137880057096481
Epoch: 768
Loss on hold-out set: 0.013121134625204528
MeanAbsoluteError value on hold-out data: 0.09098941832780838
Epoch: 769
Loss on hold-out set: 0.013943973435510392
MeanAbsoluteError value on hold-out data: 0.0945793092250824
Epoch: 770
Loss on hold-out set: 0.016022245462615197
MeanAbsoluteError value on hold-out data: 0.09784778207540512
Epoch: 771
Loss on hold-out set: 0.01439549473412626
MeanAbsoluteError value on hold-out data: 0.08988290280103683
Epoch: 772
Loss on hold-out set: 0.015049293290940114
MeanAbsoluteError value on hold-out data: 0.09768327325582504
Epoch: 773
Loss on hold-out set: 0.015067253254953054
MeanAbsoluteError value on hold-out data: 0.09125668555498123
Epoch: 774
Loss on hold-out set: 0.01572325869385774
MeanAbsoluteError value on hold-out data: 0.09566300362348557
Epoch: 775
Loss on hold-out set: 0.014694952520755275
MeanAbsoluteError value on hold-out data: 0.09488808363676071
Epoch: 776
Loss on hold-out set: 0.013595245461807888
MeanAbsoluteError value on hold-out data: 0.09087282419204712
Epoch: 777
Loss on hold-out set: 0.015883198935092272
MeanAbsoluteError value on hold-out data: 0.09451837837696075
Epoch: 778
Loss on hold-out set: 0.014774698863863402
MeanAbsoluteError value on hold-out data: 0.09525643289089203
Epoch: 779
Loss on hold-out set: 0.014679344832353915
MeanAbsoluteError value on hold-out data: 0.09510098397731781
Epoch: 780
Loss on hold-out set: 0.015109249335606971
MeanAbsoluteError value on hold-out data: 0.09509942680597305
Epoch: 781
Loss on hold-out set: 0.015829635252533385
MeanAbsoluteError value on hold-out data: 0.09449939429759979
Epoch: 782
Loss on hold-out set: 0.014674943289428484
MeanAbsoluteError value on hold-out data: 0.09257808327674866
Epoch: 783
Loss on hold-out set: 0.015047785961214685
MeanAbsoluteError value on hold-out data: 0.09444655478000641
Epoch: 784
Loss on hold-out set: 0.016388972419614827
MeanAbsoluteError value on hold-out data: 0.09732528030872345
Epoch: 785
Loss on hold-out set: 0.01470156232383412
MeanAbsoluteError value on hold-out data: 0.09260354936122894
Epoch: 786
Loss on hold-out set: 0.016034300122895122
MeanAbsoluteError value on hold-out data: 0.0961613729596138
Epoch: 787
Loss on hold-out set: 0.014060342495601313
MeanAbsoluteError value on hold-out data: 0.09195954352617264
Epoch: 788
Loss on hold-out set: 0.014614901559210315
MeanAbsoluteError value on hold-out data: 0.09560246020555496
Epoch: 789
Loss on hold-out set: 0.014152293296174321
MeanAbsoluteError value on hold-out data: 0.09273464232683182
Epoch: 790
Loss on hold-out set: 0.01380137887874298
MeanAbsoluteError value on hold-out data: 0.09151924401521683
Epoch: 791
Loss on hold-out set: 0.015109320106178832
MeanAbsoluteError value on hold-out data: 0.09706009179353714
Epoch: 792
Loss on hold-out set: 0.014789463390867846
MeanAbsoluteError value on hold-out data: 0.09200959652662277
Epoch: 793
Loss on hold-out set: 0.013928193185614267
MeanAbsoluteError value on hold-out data: 0.0915532186627388
Epoch: 794
Loss on hold-out set: 0.016241325003544867
MeanAbsoluteError value on hold-out data: 0.09831223636865616
Epoch: 795
Loss on hold-out set: 0.016665622936561705
MeanAbsoluteError value on hold-out data: 0.09791721403598785
Epoch: 796
Loss on hold-out set: 0.013032531679588526
MeanAbsoluteError value on hold-out data: 0.08792100846767426
Epoch: 797
Loss on hold-out set: 0.016545942187367473
MeanAbsoluteError value on hold-out data: 0.0991085022687912
Epoch: 798
Loss on hold-out set: 0.013518403748832194
MeanAbsoluteError value on hold-out data: 0.09024036675691605
Epoch: 799
Loss on hold-out set: 0.016723450411712595
MeanAbsoluteError value on hold-out data: 0.10067889094352722
Epoch: 800
Loss on hold-out set: 0.014928690598462708
MeanAbsoluteError value on hold-out data: 0.09653234481811523
Epoch: 801
Loss on hold-out set: 0.014711382051173132
MeanAbsoluteError value on hold-out data: 0.09093284606933594
Epoch: 802
Loss on hold-out set: 0.012960450640512135
MeanAbsoluteError value on hold-out data: 0.08699740469455719
Epoch: 803
Loss on hold-out set: 0.013489504448395261
MeanAbsoluteError value on hold-out data: 0.08945003896951675
Epoch: 804
Loss on hold-out set: 0.0158687233843375
MeanAbsoluteError value on hold-out data: 0.09582795202732086
Epoch: 805
Loss on hold-out set: 0.013586551842163317
MeanAbsoluteError value on hold-out data: 0.09161761403083801
Epoch: 806
Loss on hold-out set: 0.015144584595388248
MeanAbsoluteError value on hold-out data: 0.09407167136669159
Epoch: 807
Loss on hold-out set: 0.013273325120600627
MeanAbsoluteError value on hold-out data: 0.08859201520681381
Epoch: 808
Loss on hold-out set: 0.01390678915491056
MeanAbsoluteError value on hold-out data: 0.09210921078920364
Epoch: 809
Loss on hold-out set: 0.013699912116935593
MeanAbsoluteError value on hold-out data: 0.09069391340017319
Epoch: 810
Loss on hold-out set: 0.016130061939438747
MeanAbsoluteError value on hold-out data: 0.0972708985209465
Epoch: 811
Loss on hold-out set: 0.013467321177765067
MeanAbsoluteError value on hold-out data: 0.09122227132320404
Epoch: 812
Loss on hold-out set: 0.01511457098046473
MeanAbsoluteError value on hold-out data: 0.09639507532119751
Epoch: 813
Loss on hold-out set: 0.01346178979074466
MeanAbsoluteError value on hold-out data: 0.09231875091791153
Epoch: 814
Loss on hold-out set: 0.012432732820792202
MeanAbsoluteError value on hold-out data: 0.08705297857522964
Epoch: 815
Loss on hold-out set: 0.01531656978566815
MeanAbsoluteError value on hold-out data: 0.0918196588754654
Epoch: 816
Loss on hold-out set: 0.014299484630779867
MeanAbsoluteError value on hold-out data: 0.09416519850492477
Epoch: 817
Loss on hold-out set: 0.014307642002483287
MeanAbsoluteError value on hold-out data: 0.09206739813089371
Epoch: 818
Loss on hold-out set: 0.014281188009869463
MeanAbsoluteError value on hold-out data: 0.09281283617019653
Epoch: 819
Loss on hold-out set: 0.015119961117840527
MeanAbsoluteError value on hold-out data: 0.09667932987213135
Epoch: 820
Loss on hold-out set: 0.013660214606206865
MeanAbsoluteError value on hold-out data: 0.09097762405872345
Epoch: 821
Loss on hold-out set: 0.01502853526500985
MeanAbsoluteError value on hold-out data: 0.0901375561952591
Epoch: 822
Loss on hold-out set: 0.014746537246343602
MeanAbsoluteError value on hold-out data: 0.09310860931873322
Epoch: 823
Loss on hold-out set: 0.01236707932179949
MeanAbsoluteError value on hold-out data: 0.08716238290071487
Epoch: 824
Loss on hold-out set: 0.012744501517154276
MeanAbsoluteError value on hold-out data: 0.08983679115772247
Epoch: 825
Loss on hold-out set: 0.015378207985583382
MeanAbsoluteError value on hold-out data: 0.09713026136159897
Epoch: 826
Loss on hold-out set: 0.014321284473723305
MeanAbsoluteError value on hold-out data: 0.09312793612480164
Epoch: 827
Loss on hold-out set: 0.013711575706399042
MeanAbsoluteError value on hold-out data: 0.09031718969345093
Epoch: 828
Loss on hold-out set: 0.013777390165911734
MeanAbsoluteError value on hold-out data: 0.0906769409775734
Epoch: 829
Loss on hold-out set: 0.014297008442711862
MeanAbsoluteError value on hold-out data: 0.09331678599119186
Epoch: 830
Loss on hold-out set: 0.014293919848423684
MeanAbsoluteError value on hold-out data: 0.090777687728405
Epoch: 831
Loss on hold-out set: 0.012918068776489235
MeanAbsoluteError value on hold-out data: 0.08718926459550858
Epoch: 832
Loss on hold-out set: 0.014772396404853984
MeanAbsoluteError value on hold-out data: 0.09174101799726486
Epoch: 833
Loss on hold-out set: 0.013325818767758998
MeanAbsoluteError value on hold-out data: 0.08506134152412415
Epoch: 834
Loss on hold-out set: 0.01379219883371358
MeanAbsoluteError value on hold-out data: 0.09313932061195374
Epoch: 835
Loss on hold-out set: 0.013107414483771814
MeanAbsoluteError value on hold-out data: 0.08773693442344666
Epoch: 836
Loss on hold-out set: 0.012599176035837444
MeanAbsoluteError value on hold-out data: 0.08884453028440475
Epoch: 837
Loss on hold-out set: 0.011780921306775174
MeanAbsoluteError value on hold-out data: 0.08165815472602844
Epoch: 838
Loss on hold-out set: 0.014336231850805537
MeanAbsoluteError value on hold-out data: 0.09387310594320297
Epoch: 839
Loss on hold-out set: 0.013478868751202147
MeanAbsoluteError value on hold-out data: 0.09145642817020416
Epoch: 840
Loss on hold-out set: 0.013421513961038727
MeanAbsoluteError value on hold-out data: 0.0890832170844078
Epoch: 841
Loss on hold-out set: 0.015149888307205402
MeanAbsoluteError value on hold-out data: 0.09043266624212265
Epoch: 842
Loss on hold-out set: 0.013806431856185858
MeanAbsoluteError value on hold-out data: 0.09011902660131454
Epoch: 843
Loss on hold-out set: 0.014173295812015567
MeanAbsoluteError value on hold-out data: 0.09131743013858795
Epoch: 844
Loss on hold-out set: 0.015254719463603881
MeanAbsoluteError value on hold-out data: 0.09639858454465866
Epoch: 845
Loss on hold-out set: 0.014784935196439619
MeanAbsoluteError value on hold-out data: 0.09075630456209183
Epoch: 846
Loss on hold-out set: 0.014671610406706653
MeanAbsoluteError value on hold-out data: 0.09400767832994461
Epoch: 847
Loss on hold-out set: 0.012538146353193346
MeanAbsoluteError value on hold-out data: 0.0866994708776474
Epoch: 848
Loss on hold-out set: 0.0137287919766095
MeanAbsoluteError value on hold-out data: 0.09285231679677963
Epoch: 849
Loss on hold-out set: 0.013736963089516697
MeanAbsoluteError value on hold-out data: 0.09096042066812515
Epoch: 850
Loss on hold-out set: 0.013327430811186787
MeanAbsoluteError value on hold-out data: 0.09156733006238937
Epoch: 851
Loss on hold-out set: 0.014269664438519005
MeanAbsoluteError value on hold-out data: 0.0910545289516449
Epoch: 852
Loss on hold-out set: 0.01421950169118645
MeanAbsoluteError value on hold-out data: 0.09306163340806961
Epoch: 853
Loss on hold-out set: 0.015269068749553298
MeanAbsoluteError value on hold-out data: 0.09386202692985535
Epoch: 854
Loss on hold-out set: 0.012782299077128604
MeanAbsoluteError value on hold-out data: 0.08542186766862869
Epoch: 855
Loss on hold-out set: 0.014036857344423576
MeanAbsoluteError value on hold-out data: 0.09416131675243378
Epoch: 856
Loss on hold-out set: 0.014692066168014814
MeanAbsoluteError value on hold-out data: 0.09210678189992905
Epoch: 857
Loss on hold-out set: 0.01293559739899744
MeanAbsoluteError value on hold-out data: 0.08840597420930862
Epoch: 858
Loss on hold-out set: 0.014285280979153565
MeanAbsoluteError value on hold-out data: 0.09209945052862167
Epoch: 859
Loss on hold-out set: 0.011501555230400603
MeanAbsoluteError value on hold-out data: 0.08253362774848938
Epoch: 860
Loss on hold-out set: 0.014813214838213754
MeanAbsoluteError value on hold-out data: 0.09522529691457748
Epoch: 861
Loss on hold-out set: 0.013310678197182521
MeanAbsoluteError value on hold-out data: 0.08932850509881973
Epoch: 862
Loss on hold-out set: 0.013992085059774884
MeanAbsoluteError value on hold-out data: 0.09407209604978561
Epoch: 863
Loss on hold-out set: 0.013275856787173931
MeanAbsoluteError value on hold-out data: 0.09053726494312286
Epoch: 864
Loss on hold-out set: 0.014436444260034022
MeanAbsoluteError value on hold-out data: 0.09307929873466492
Epoch: 865
Loss on hold-out set: 0.013152071965353875
MeanAbsoluteError value on hold-out data: 0.08910375833511353
Epoch: 866
Loss on hold-out set: 0.012850007451294611
MeanAbsoluteError value on hold-out data: 0.08894102275371552
Epoch: 867
Loss on hold-out set: 0.01444899046041731
MeanAbsoluteError value on hold-out data: 0.09179641306400299
Epoch: 868
Loss on hold-out set: 0.013559259842489457
MeanAbsoluteError value on hold-out data: 0.09166666865348816
Epoch: 869
Loss on hold-out set: 0.013684128606303905
MeanAbsoluteError value on hold-out data: 0.0897354707121849
Epoch: 870
Loss on hold-out set: 0.013696083778777393
MeanAbsoluteError value on hold-out data: 0.09185910224914551
Epoch: 871
Loss on hold-out set: 0.015111330803168434
MeanAbsoluteError value on hold-out data: 0.093879833817482
Epoch: 872
Loss on hold-out set: 0.012816284695024176
MeanAbsoluteError value on hold-out data: 0.08655447512865067
Epoch: 873
Loss on hold-out set: 0.012677147404230406
MeanAbsoluteError value on hold-out data: 0.08713791519403458
Epoch: 874
Loss on hold-out set: 0.012770630993230347
MeanAbsoluteError value on hold-out data: 0.08626267313957214
Epoch: 875
Loss on hold-out set: 0.01372008048829836
MeanAbsoluteError value on hold-out data: 0.08946963399648666
Epoch: 876
Loss on hold-out set: 0.013506402174804559
MeanAbsoluteError value on hold-out data: 0.08954312652349472
Epoch: 877
Loss on hold-out set: 0.013412432108816574
MeanAbsoluteError value on hold-out data: 0.08668295294046402
Epoch: 878
Loss on hold-out set: 0.014417579979732788
MeanAbsoluteError value on hold-out data: 0.093096524477005
Epoch: 879
Loss on hold-out set: 0.014912518470810028
MeanAbsoluteError value on hold-out data: 0.09506092220544815
Epoch: 880
Loss on hold-out set: 0.014344319722925623
MeanAbsoluteError value on hold-out data: 0.09417473524808884
Epoch: 881
Loss on hold-out set: 0.01391551845612412
MeanAbsoluteError value on hold-out data: 0.08996926993131638
Epoch: 882
Loss on hold-out set: 0.012724271155748283
MeanAbsoluteError value on hold-out data: 0.08438511937856674
Epoch: 883
Loss on hold-out set: 0.01389636686333688
MeanAbsoluteError value on hold-out data: 0.09257492423057556
Epoch: 884
Loss on hold-out set: 0.012219082077742012
MeanAbsoluteError value on hold-out data: 0.08681438118219376
Epoch: 885
Loss on hold-out set: 0.014084854312532116
MeanAbsoluteError value on hold-out data: 0.0938771516084671
Epoch: 886
Loss on hold-out set: 0.01245146324704668
MeanAbsoluteError value on hold-out data: 0.08711754530668259
Epoch: 887
Loss on hold-out set: 0.012810162826111386
MeanAbsoluteError value on hold-out data: 0.08951451629400253
Epoch: 888
Loss on hold-out set: 0.011961171170987654
MeanAbsoluteError value on hold-out data: 0.0845518484711647
Epoch: 889
Loss on hold-out set: 0.013023559809662402
MeanAbsoluteError value on hold-out data: 0.08569023758172989
Epoch: 890
Loss on hold-out set: 0.013722755666676675
MeanAbsoluteError value on hold-out data: 0.08826683461666107
Epoch: 891
Loss on hold-out set: 0.01359645484109933
MeanAbsoluteError value on hold-out data: 0.08834260702133179
Epoch: 892
Loss on hold-out set: 0.01416933746740445
MeanAbsoluteError value on hold-out data: 0.09022218734025955
Epoch: 893
Loss on hold-out set: 0.012287694498809287
MeanAbsoluteError value on hold-out data: 0.08442262560129166
Epoch: 894
Loss on hold-out set: 0.013354957412714915
MeanAbsoluteError value on hold-out data: 0.08816448599100113
Epoch: 895
Loss on hold-out set: 0.012252581345480091
MeanAbsoluteError value on hold-out data: 0.08380437642335892
Epoch: 896
Loss on hold-out set: 0.01354096163639042
MeanAbsoluteError value on hold-out data: 0.08798395097255707
Epoch: 897
Loss on hold-out set: 0.011712401442055124
MeanAbsoluteError value on hold-out data: 0.08550455421209335
Epoch: 898
Loss on hold-out set: 0.011659983006393305
MeanAbsoluteError value on hold-out data: 0.08007799088954926
Epoch: 899
Loss on hold-out set: 0.012956510447975234
MeanAbsoluteError value on hold-out data: 0.08661789447069168
Epoch: 900
Loss on hold-out set: 0.012699409332174885
MeanAbsoluteError value on hold-out data: 0.08543895930051804
Epoch: 901
Loss on hold-out set: 0.01347440895837887
MeanAbsoluteError value on hold-out data: 0.08780964463949203
Epoch: 902
Loss on hold-out set: 0.012062322488830735
MeanAbsoluteError value on hold-out data: 0.08502582460641861
Epoch: 903
Loss on hold-out set: 0.0125646733212731
MeanAbsoluteError value on hold-out data: 0.08520003408193588
Epoch: 904
Loss on hold-out set: 0.011487039153726073
MeanAbsoluteError value on hold-out data: 0.08197511732578278
Epoch: 905
Loss on hold-out set: 0.012388274509454884
MeanAbsoluteError value on hold-out data: 0.08602264523506165
Epoch: 906
Loss on hold-out set: 0.013756699705360613
MeanAbsoluteError value on hold-out data: 0.09058251976966858
Epoch: 907
Loss on hold-out set: 0.012121322727083073
MeanAbsoluteError value on hold-out data: 0.08626579493284225
Epoch: 908
Loss on hold-out set: 0.013126969552298154
MeanAbsoluteError value on hold-out data: 0.08811887353658676
Epoch: 909
Loss on hold-out set: 0.012486929187289206
MeanAbsoluteError value on hold-out data: 0.08539774268865585
Epoch: 910
Loss on hold-out set: 0.012418103681023543
MeanAbsoluteError value on hold-out data: 0.0867692157626152
Epoch: 911
Loss on hold-out set: 0.012156244497521887
MeanAbsoluteError value on hold-out data: 0.08305768668651581
Epoch: 912
Loss on hold-out set: 0.012703179630431502
MeanAbsoluteError value on hold-out data: 0.08557119965553284
Epoch: 913
Loss on hold-out set: 0.010760046217325604
MeanAbsoluteError value on hold-out data: 0.08198575675487518
Epoch: 914
Loss on hold-out set: 0.014742615387658588
MeanAbsoluteError value on hold-out data: 0.09309742599725723
Epoch: 915
Loss on hold-out set: 0.013078017387136546
MeanAbsoluteError value on hold-out data: 0.09001882374286652
Epoch: 916
Loss on hold-out set: 0.013788767945273624
MeanAbsoluteError value on hold-out data: 0.09113806486129761
Epoch: 917
Loss on hold-out set: 0.013423349981409653
MeanAbsoluteError value on hold-out data: 0.08885090798139572
Epoch: 918
Loss on hold-out set: 0.013419296679833981
MeanAbsoluteError value on hold-out data: 0.08926590532064438
Epoch: 919
Loss on hold-out set: 0.014190979123377474
MeanAbsoluteError value on hold-out data: 0.0914575532078743
Epoch: 920
Loss on hold-out set: 0.012152060370814677
MeanAbsoluteError value on hold-out data: 0.08557552099227905
Epoch: 921
Loss on hold-out set: 0.012730487225295899
MeanAbsoluteError value on hold-out data: 0.08702215552330017
Epoch: 922
Loss on hold-out set: 0.013274309685317955
MeanAbsoluteError value on hold-out data: 0.08677337318658829
Epoch: 923
Loss on hold-out set: 0.013685733023303328
MeanAbsoluteError value on hold-out data: 0.08868397027254105
Epoch: 924
Loss on hold-out set: 0.01386322680191976
MeanAbsoluteError value on hold-out data: 0.09354057908058167
Epoch: 925
Loss on hold-out set: 0.012239064387589073
MeanAbsoluteError value on hold-out data: 0.08598855882883072
Epoch: 926
Loss on hold-out set: 0.013424440976353556
MeanAbsoluteError value on hold-out data: 0.0896887555718422
Epoch: 927
Loss on hold-out set: 0.010820798096416789
MeanAbsoluteError value on hold-out data: 0.08151251822710037
Epoch: 928
Loss on hold-out set: 0.012151084399532313
MeanAbsoluteError value on hold-out data: 0.08545488864183426
Epoch: 929
Loss on hold-out set: 0.01278983426988513
MeanAbsoluteError value on hold-out data: 0.08543957024812698
Epoch: 930
Loss on hold-out set: 0.012311756232181021
MeanAbsoluteError value on hold-out data: 0.08709142357110977
Epoch: 931
Loss on hold-out set: 0.01237298404660881
MeanAbsoluteError value on hold-out data: 0.08656416833400726
Epoch: 932
Loss on hold-out set: 0.013037424924526324
MeanAbsoluteError value on hold-out data: 0.088212750852108
Epoch: 933
Loss on hold-out set: 0.01129732211799516
MeanAbsoluteError value on hold-out data: 0.08397737890481949
Epoch: 934
Loss on hold-out set: 0.012794031682715286
MeanAbsoluteError value on hold-out data: 0.08883575350046158
Epoch: 935
Loss on hold-out set: 0.012230864737357478
MeanAbsoluteError value on hold-out data: 0.08738267421722412
Epoch: 936
Loss on hold-out set: 0.012568440040825711
MeanAbsoluteError value on hold-out data: 0.08541558682918549
Epoch: 937
Loss on hold-out set: 0.012745866456146662
MeanAbsoluteError value on hold-out data: 0.08859128504991531
Epoch: 938
Loss on hold-out set: 0.013358476343079625
MeanAbsoluteError value on hold-out data: 0.08721115440130234
Epoch: 939
Loss on hold-out set: 0.013910859338284353
MeanAbsoluteError value on hold-out data: 0.09095103293657303
Epoch: 940
Loss on hold-out set: 0.013263240623588596
MeanAbsoluteError value on hold-out data: 0.08734908699989319
Epoch: 941
Loss on hold-out set: 0.012063078386233125
MeanAbsoluteError value on hold-out data: 0.08444218337535858
Epoch: 942
Loss on hold-out set: 0.014232875614761725
MeanAbsoluteError value on hold-out data: 0.09065848588943481
Epoch: 943
Loss on hold-out set: 0.01235992856779679
MeanAbsoluteError value on hold-out data: 0.08666851371526718
Epoch: 944
Loss on hold-out set: 0.012438899026553069
MeanAbsoluteError value on hold-out data: 0.08656451851129532
Epoch: 945
Loss on hold-out set: 0.010537285318908593
MeanAbsoluteError value on hold-out data: 0.08128148317337036
Epoch: 946
Loss on hold-out set: 0.013374518294246324
MeanAbsoluteError value on hold-out data: 0.08779887855052948
Epoch: 947
Loss on hold-out set: 0.01377926056717115
MeanAbsoluteError value on hold-out data: 0.08997327089309692
Epoch: 948
Loss on hold-out set: 0.01105106325960757
MeanAbsoluteError value on hold-out data: 0.08053159713745117
Epoch: 949
Loss on hold-out set: 0.01463495117003428
MeanAbsoluteError value on hold-out data: 0.09090772271156311
Epoch: 950
Loss on hold-out set: 0.011526155514147832
MeanAbsoluteError value on hold-out data: 0.08224936574697495
Epoch: 951
Loss on hold-out set: 0.011980885340053647
MeanAbsoluteError value on hold-out data: 0.0851246565580368
Epoch: 952
Loss on hold-out set: 0.012485976001243557
MeanAbsoluteError value on hold-out data: 0.08576388657093048
Epoch: 953
Loss on hold-out set: 0.012029190691076413
MeanAbsoluteError value on hold-out data: 0.08383549004793167
Epoch: 954
Loss on hold-out set: 0.012563925284387854
MeanAbsoluteError value on hold-out data: 0.08490633964538574
Epoch: 955
Loss on hold-out set: 0.011367015418897305
MeanAbsoluteError value on hold-out data: 0.0825759619474411
Epoch: 956
Loss on hold-out set: 0.012673540340911131
MeanAbsoluteError value on hold-out data: 0.0869046226143837
Epoch: 957
Loss on hold-out set: 0.011638519025291316
MeanAbsoluteError value on hold-out data: 0.08409284055233002
Epoch: 958
Loss on hold-out set: 0.01329099753027549
MeanAbsoluteError value on hold-out data: 0.0862637609243393
Epoch: 959
Loss on hold-out set: 0.011993132967860826
MeanAbsoluteError value on hold-out data: 0.08292357623577118
Epoch: 960
Loss on hold-out set: 0.012432106827400275
MeanAbsoluteError value on hold-out data: 0.08436718583106995
Epoch: 961
Loss on hold-out set: 0.01426819636777509
MeanAbsoluteError value on hold-out data: 0.09092526882886887
Epoch: 962
Loss on hold-out set: 0.01135685931332167
MeanAbsoluteError value on hold-out data: 0.08223272114992142
Epoch: 963
Loss on hold-out set: 0.01255356213330136
MeanAbsoluteError value on hold-out data: 0.0873047336935997
Epoch: 964
Loss on hold-out set: 0.012711978888692101
MeanAbsoluteError value on hold-out data: 0.08838074654340744
Epoch: 965
Loss on hold-out set: 0.011287045440452252
MeanAbsoluteError value on hold-out data: 0.07960829883813858
Epoch: 966
Loss on hold-out set: 0.010417541695278486
MeanAbsoluteError value on hold-out data: 0.07762384414672852
Epoch: 967
Loss on hold-out set: 0.01363566926595619
MeanAbsoluteError value on hold-out data: 0.08713307231664658
Epoch: 968
Loss on hold-out set: 0.01195495598813674
MeanAbsoluteError value on hold-out data: 0.08406613767147064
Epoch: 969
Loss on hold-out set: 0.013521209100532967
MeanAbsoluteError value on hold-out data: 0.08880829811096191
Epoch: 970
Loss on hold-out set: 0.011613521676384455
MeanAbsoluteError value on hold-out data: 0.08098530769348145
Epoch: 971
Loss on hold-out set: 0.012727366058279586
MeanAbsoluteError value on hold-out data: 0.08623181283473969
Epoch: 972
Loss on hold-out set: 0.011031646913543226
MeanAbsoluteError value on hold-out data: 0.08236534893512726
Epoch: 973
Loss on hold-out set: 0.011020331684752213
MeanAbsoluteError value on hold-out data: 0.08168649673461914
Epoch: 974
Loss on hold-out set: 0.011903865636656215
MeanAbsoluteError value on hold-out data: 0.08244858682155609
Epoch: 975
Loss on hold-out set: 0.009586528508953052
MeanAbsoluteError value on hold-out data: 0.07749377191066742
Epoch: 976
Loss on hold-out set: 0.013409235787306292
MeanAbsoluteError value on hold-out data: 0.08897949010133743
Epoch: 977
Loss on hold-out set: 0.013084092175098098
MeanAbsoluteError value on hold-out data: 0.08544802665710449
Epoch: 978
Loss on hold-out set: 0.01010726172006495
MeanAbsoluteError value on hold-out data: 0.07913002371788025
Epoch: 979
Loss on hold-out set: 0.011725159073297011
MeanAbsoluteError value on hold-out data: 0.08488105982542038
Epoch: 980
Loss on hold-out set: 0.01116789140481463
MeanAbsoluteError value on hold-out data: 0.08023400604724884
Epoch: 981
Loss on hold-out set: 0.01262067057294189
MeanAbsoluteError value on hold-out data: 0.08750743418931961
Epoch: 982
Loss on hold-out set: 0.012382122721401174
MeanAbsoluteError value on hold-out data: 0.08387441188097
Epoch: 983
Loss on hold-out set: 0.01215441478455735
MeanAbsoluteError value on hold-out data: 0.0828717052936554
Epoch: 984
Loss on hold-out set: 0.011883496809750795
MeanAbsoluteError value on hold-out data: 0.0836234986782074
Epoch: 985
Loss on hold-out set: 0.013374665140727302
MeanAbsoluteError value on hold-out data: 0.09011814743280411
Epoch: 986
Loss on hold-out set: 0.011368301703090158
MeanAbsoluteError value on hold-out data: 0.08363550156354904
Epoch: 987
Loss on hold-out set: 0.014327979592647656
MeanAbsoluteError value on hold-out data: 0.08815563470125198
Epoch: 988
Loss on hold-out set: 0.011397412589628857
MeanAbsoluteError value on hold-out data: 0.08076877892017365
Epoch: 989
Loss on hold-out set: 0.011726234183831064
MeanAbsoluteError value on hold-out data: 0.08319567143917084
Epoch: 990
Loss on hold-out set: 0.010481347257955348
MeanAbsoluteError value on hold-out data: 0.07916177064180374
Epoch: 991
Loss on hold-out set: 0.012827152363727995
MeanAbsoluteError value on hold-out data: 0.08690160512924194
Epoch: 992
Loss on hold-out set: 0.011567487690675383
MeanAbsoluteError value on hold-out data: 0.08114299923181534
Epoch: 993
Loss on hold-out set: 0.011254045535291274
MeanAbsoluteError value on hold-out data: 0.07919789105653763
Epoch: 994
Loss on hold-out set: 0.010478017618843295
MeanAbsoluteError value on hold-out data: 0.07815229147672653
Epoch: 995
Loss on hold-out set: 0.012630065706835012
MeanAbsoluteError value on hold-out data: 0.0862812027335167
Epoch: 996
Loss on hold-out set: 0.008843650416905196
MeanAbsoluteError value on hold-out data: 0.0725579485297203
Epoch: 997
Loss on hold-out set: 0.011291064277271895
MeanAbsoluteError value on hold-out data: 0.08262214064598083
Epoch: 998
Loss on hold-out set: 0.009971504470158835
MeanAbsoluteError value on hold-out data: 0.07664857059717178
Epoch: 999
Loss on hold-out set: 0.011888324985241828
MeanAbsoluteError value on hold-out data: 0.08302677422761917
Epoch: 1000
Loss on hold-out set: 0.012875903777700539
MeanAbsoluteError value on hold-out data: 0.08637964725494385
Epoch: 1001
Loss on hold-out set: 0.010365895436637705
MeanAbsoluteError value on hold-out data: 0.0765041634440422
Epoch: 1002
Loss on hold-out set: 0.011982689152382306
MeanAbsoluteError value on hold-out data: 0.08226150274276733
Epoch: 1003
Loss on hold-out set: 0.01173156248260663
MeanAbsoluteError value on hold-out data: 0.08110496401786804
Epoch: 1004
Loss on hold-out set: 0.012521626205101105
MeanAbsoluteError value on hold-out data: 0.08824409544467926
Epoch: 1005
Loss on hold-out set: 0.009614319313453355
MeanAbsoluteError value on hold-out data: 0.07594391703605652
Epoch: 1006
Loss on hold-out set: 0.011966481308045332
MeanAbsoluteError value on hold-out data: 0.08374980837106705
Epoch: 1007
Loss on hold-out set: 0.010690064290247391
MeanAbsoluteError value on hold-out data: 0.08009430021047592
Epoch: 1008
Loss on hold-out set: 0.011428218785731588
MeanAbsoluteError value on hold-out data: 0.08158953487873077
Epoch: 1009
Loss on hold-out set: 0.009912183827861252
MeanAbsoluteError value on hold-out data: 0.07539750635623932
Epoch: 1010
Loss on hold-out set: 0.010733269701783002
MeanAbsoluteError value on hold-out data: 0.07746266573667526
Epoch: 1011
Loss on hold-out set: 0.011356967506823518
MeanAbsoluteError value on hold-out data: 0.08049686998128891
Epoch: 1012
Loss on hold-out set: 0.011302395659328491
MeanAbsoluteError value on hold-out data: 0.08048480749130249
Epoch: 1013
Loss on hold-out set: 0.010679950046558891
MeanAbsoluteError value on hold-out data: 0.07760733366012573
Epoch: 1014
Loss on hold-out set: 0.012641827895810517
MeanAbsoluteError value on hold-out data: 0.08373141288757324
Epoch: 1015
Loss on hold-out set: 0.01095849256181585
MeanAbsoluteError value on hold-out data: 0.08116095513105392
Epoch: 1016
Loss on hold-out set: 0.011386148876990774
MeanAbsoluteError value on hold-out data: 0.08380722254514694
Epoch: 1017
Loss on hold-out set: 0.01154227714160091
MeanAbsoluteError value on hold-out data: 0.08110819011926651
Epoch: 1018
Loss on hold-out set: 0.009516047135402914
MeanAbsoluteError value on hold-out data: 0.07645652443170547
Epoch: 1019
Loss on hold-out set: 0.011654523262727708
MeanAbsoluteError value on hold-out data: 0.07973668724298477
Epoch: 1020
Loss on hold-out set: 0.01057223005850877
MeanAbsoluteError value on hold-out data: 0.0785168930888176
Epoch: 1021
Loss on hold-out set: 0.011928501366176836
MeanAbsoluteError value on hold-out data: 0.08373048901557922
Epoch: 1022
Loss on hold-out set: 0.009873472507424595
MeanAbsoluteError value on hold-out data: 0.07654726505279541
Epoch: 1023
Loss on hold-out set: 0.010868225383431612
MeanAbsoluteError value on hold-out data: 0.0794977992773056
Epoch: 1024
Loss on hold-out set: 0.011797427274357232
MeanAbsoluteError value on hold-out data: 0.08157169818878174
Epoch: 1025
Loss on hold-out set: 0.010043965239698688
MeanAbsoluteError value on hold-out data: 0.07904564589262009
Epoch: 1026
Loss on hold-out set: 0.011882125546544558
MeanAbsoluteError value on hold-out data: 0.08308103680610657
Epoch: 1027
Loss on hold-out set: 0.010998400820147556
MeanAbsoluteError value on hold-out data: 0.08000762015581131
Epoch: 1028
Loss on hold-out set: 0.010344252841653846
MeanAbsoluteError value on hold-out data: 0.0776648223400116
Epoch: 1029
Loss on hold-out set: 0.011862145843915642
MeanAbsoluteError value on hold-out data: 0.085160031914711
Epoch: 1030
Loss on hold-out set: 0.012636470929234443
MeanAbsoluteError value on hold-out data: 0.08663192391395569
Epoch: 1031
Loss on hold-out set: 0.011125314286449186
MeanAbsoluteError value on hold-out data: 0.08183354139328003
Epoch: 1032
Loss on hold-out set: 0.011181745969103455
MeanAbsoluteError value on hold-out data: 0.079971544444561
Epoch: 1033
Loss on hold-out set: 0.012277920728374738
MeanAbsoluteError value on hold-out data: 0.08465900272130966
Epoch: 1034
Loss on hold-out set: 0.010614788963951773
MeanAbsoluteError value on hold-out data: 0.0788840800523758
Epoch: 1035
Loss on hold-out set: 0.011784835778574537
MeanAbsoluteError value on hold-out data: 0.08309363573789597
Epoch: 1036
Loss on hold-out set: 0.01087730146740796
MeanAbsoluteError value on hold-out data: 0.0800665020942688
Epoch: 1037
Loss on hold-out set: 0.011388256335812912
MeanAbsoluteError value on hold-out data: 0.08082480728626251
Epoch: 1038
Loss on hold-out set: 0.011366286591995352
MeanAbsoluteError value on hold-out data: 0.0808706134557724
Epoch: 1039
Loss on hold-out set: 0.010796735221662553
MeanAbsoluteError value on hold-out data: 0.07791291922330856
Epoch: 1040
Loss on hold-out set: 0.011102126767436857
MeanAbsoluteError value on hold-out data: 0.07909753918647766
Epoch: 1041
Loss on hold-out set: 0.010599690711921236
MeanAbsoluteError value on hold-out data: 0.0766838863492012
Epoch: 1042
Loss on hold-out set: 0.010548622982460074
MeanAbsoluteError value on hold-out data: 0.07985451817512512
Epoch: 1043
Loss on hold-out set: 0.011273256912112022
MeanAbsoluteError value on hold-out data: 0.0812205970287323
Epoch: 1044
Loss on hold-out set: 0.010622615672843191
MeanAbsoluteError value on hold-out data: 0.07887143641710281
Epoch: 1045
Loss on hold-out set: 0.010892643124486009
MeanAbsoluteError value on hold-out data: 0.07956566661596298
Epoch: 1046
Loss on hold-out set: 0.011989120397071626
MeanAbsoluteError value on hold-out data: 0.08270996063947678
Epoch: 1047
Loss on hold-out set: 0.013214508618208736
MeanAbsoluteError value on hold-out data: 0.08671504259109497
Epoch: 1048
Loss on hold-out set: 0.011184440878520642
MeanAbsoluteError value on hold-out data: 0.07901544868946075
Epoch: 1049
Loss on hold-out set: 0.011294382419691829
MeanAbsoluteError value on hold-out data: 0.0822777971625328
Epoch: 1050
Loss on hold-out set: 0.011745204907056177
MeanAbsoluteError value on hold-out data: 0.08357858657836914
Epoch: 1051
Loss on hold-out set: 0.010187669305038677
MeanAbsoluteError value on hold-out data: 0.07770856469869614
Epoch: 1052
Loss on hold-out set: 0.010796880781466218
MeanAbsoluteError value on hold-out data: 0.07900968194007874
Epoch: 1053
Loss on hold-out set: 0.010371283883820677
MeanAbsoluteError value on hold-out data: 0.07820475101470947
Epoch: 1054
Loss on hold-out set: 0.013826526593960201
MeanAbsoluteError value on hold-out data: 0.08823282271623611
Epoch: 1055
Loss on hold-out set: 0.011604753570669951
MeanAbsoluteError value on hold-out data: 0.08350546658039093
Epoch: 1056
Loss on hold-out set: 0.01149337330109726
MeanAbsoluteError value on hold-out data: 0.08123457431793213
Epoch: 1057
Loss on hold-out set: 0.010580073476940016
MeanAbsoluteError value on hold-out data: 0.07826511561870575
Epoch: 1058
Loss on hold-out set: 0.01122779815102452
MeanAbsoluteError value on hold-out data: 0.08247750252485275
Epoch: 1059
Loss on hold-out set: 0.01068352089394466
MeanAbsoluteError value on hold-out data: 0.07843056321144104
Epoch: 1060
Loss on hold-out set: 0.012270261884890108
MeanAbsoluteError value on hold-out data: 0.08181322365999222
Epoch: 1061
Loss on hold-out set: 0.010912557443225524
MeanAbsoluteError value on hold-out data: 0.07779532670974731
Epoch: 1062
Loss on hold-out set: 0.01016565670579439
MeanAbsoluteError value on hold-out data: 0.07629743218421936
Epoch: 1063
Loss on hold-out set: 0.00972489661906972
MeanAbsoluteError value on hold-out data: 0.07560122013092041
Epoch: 1064
Loss on hold-out set: 0.010586634172941558
MeanAbsoluteError value on hold-out data: 0.07925236225128174
Epoch: 1065
Loss on hold-out set: 0.011110865902495182
MeanAbsoluteError value on hold-out data: 0.07832329720258713
Epoch: 1066
Loss on hold-out set: 0.01081258029445356
MeanAbsoluteError value on hold-out data: 0.07895831763744354
Epoch: 1067
Loss on hold-out set: 0.009584613825845736
MeanAbsoluteError value on hold-out data: 0.07495171576738358
Epoch: 1068
Loss on hold-out set: 0.009551605819627487
MeanAbsoluteError value on hold-out data: 0.07332585752010345
Epoch: 1069
Loss on hold-out set: 0.011324181564850733
MeanAbsoluteError value on hold-out data: 0.0810571014881134
Epoch: 1070
Loss on hold-out set: 0.011436080088096788
MeanAbsoluteError value on hold-out data: 0.07852671295404434
Epoch: 1071
Loss on hold-out set: 0.011017367200329318
MeanAbsoluteError value on hold-out data: 0.07917678356170654
Epoch: 1072
Loss on hold-out set: 0.010871915873528148
MeanAbsoluteError value on hold-out data: 0.07800702750682831
Epoch: 1073
Loss on hold-out set: 0.010998502369960382
MeanAbsoluteError value on hold-out data: 0.07721097767353058
Epoch: 1074
Loss on hold-out set: 0.012517749753915269
MeanAbsoluteError value on hold-out data: 0.0831843689084053
Epoch: 1075
Loss on hold-out set: 0.010146301971156693
MeanAbsoluteError value on hold-out data: 0.07791890949010849
Epoch: 1076
Loss on hold-out set: 0.010155393081028403
MeanAbsoluteError value on hold-out data: 0.07393450289964676
Epoch: 1077
Loss on hold-out set: 0.011647931899060495
MeanAbsoluteError value on hold-out data: 0.08328304439783096
Epoch: 1078
Loss on hold-out set: 0.009577701082154515
MeanAbsoluteError value on hold-out data: 0.07404865324497223
Epoch: 1079
Loss on hold-out set: 0.01059883209602655
MeanAbsoluteError value on hold-out data: 0.07534079253673553
Epoch: 1080
Loss on hold-out set: 0.011717019538894723
MeanAbsoluteError value on hold-out data: 0.08111023902893066
Epoch: 1081
Loss on hold-out set: 0.010033742766924357
MeanAbsoluteError value on hold-out data: 0.07608054578304291
Epoch: 1082
Loss on hold-out set: 0.009172421495447149
MeanAbsoluteError value on hold-out data: 0.07550060003995895
Epoch: 1083
Loss on hold-out set: 0.01009185444379303
MeanAbsoluteError value on hold-out data: 0.07752638310194016
Epoch: 1084
Loss on hold-out set: 0.010553254316619132
MeanAbsoluteError value on hold-out data: 0.0767262727022171
Epoch: 1085
Loss on hold-out set: 0.01143794949142072
MeanAbsoluteError value on hold-out data: 0.08104894310235977
Epoch: 1086
Loss on hold-out set: 0.011325729397746424
MeanAbsoluteError value on hold-out data: 0.07986637949943542
Epoch: 1087
Loss on hold-out set: 0.01256212100389045
MeanAbsoluteError value on hold-out data: 0.0845801830291748
Epoch: 1088
Loss on hold-out set: 0.0106230449838525
MeanAbsoluteError value on hold-out data: 0.08104776591062546
Epoch: 1089
Loss on hold-out set: 0.009996311937187178
MeanAbsoluteError value on hold-out data: 0.07582814246416092
Epoch: 1090
Loss on hold-out set: 0.009974092952082477
MeanAbsoluteError value on hold-out data: 0.07583585381507874
Epoch: 1091
Loss on hold-out set: 0.011028729123887995
MeanAbsoluteError value on hold-out data: 0.07899322360754013
Epoch: 1092
Loss on hold-out set: 0.012060734159410155
MeanAbsoluteError value on hold-out data: 0.08205616474151611
Epoch: 1093
Loss on hold-out set: 0.010325803911546244
MeanAbsoluteError value on hold-out data: 0.07697279006242752
Epoch: 1094
Loss on hold-out set: 0.010858287210721755
MeanAbsoluteError value on hold-out data: 0.08117183297872543
Epoch: 1095
Loss on hold-out set: 0.00945043177162006
MeanAbsoluteError value on hold-out data: 0.07580047845840454
Epoch: 1096
Loss on hold-out set: 0.0092075860709762
MeanAbsoluteError value on hold-out data: 0.07365872710943222
Epoch: 1097
Loss on hold-out set: 0.010322275206563062
MeanAbsoluteError value on hold-out data: 0.07658993452787399
Epoch: 1098
Loss on hold-out set: 0.01106426224901952
MeanAbsoluteError value on hold-out data: 0.07558135688304901
Epoch: 1099
Loss on hold-out set: 0.010295729056864123
MeanAbsoluteError value on hold-out data: 0.07773536443710327
Epoch: 1100
Loss on hold-out set: 0.011247418246542414
MeanAbsoluteError value on hold-out data: 0.07862092554569244
Epoch: 1101
Loss on hold-out set: 0.010851114023777579
MeanAbsoluteError value on hold-out data: 0.08159010857343674
Epoch: 1102
Loss on hold-out set: 0.010179387307192277
MeanAbsoluteError value on hold-out data: 0.07798542827367783
Epoch: 1103
Loss on hold-out set: 0.012008898176827643
MeanAbsoluteError value on hold-out data: 0.0815420150756836
Epoch: 1104
Loss on hold-out set: 0.00946384031616617
MeanAbsoluteError value on hold-out data: 0.07556978613138199
Epoch: 1105
Loss on hold-out set: 0.01028911307220066
MeanAbsoluteError value on hold-out data: 0.0742238238453865
Epoch: 1106
Loss on hold-out set: 0.010627222104909986
MeanAbsoluteError value on hold-out data: 0.08017504215240479
Epoch: 1107
Loss on hold-out set: 0.010768239337242752
MeanAbsoluteError value on hold-out data: 0.07978500425815582
Epoch: 1108
Loss on hold-out set: 0.01167603149471688
MeanAbsoluteError value on hold-out data: 0.08346602320671082
Epoch: 1109
Loss on hold-out set: 0.01156909433949598
MeanAbsoluteError value on hold-out data: 0.07755319029092789
Epoch: 1110
Loss on hold-out set: 0.009834075596421219
MeanAbsoluteError value on hold-out data: 0.0750022903084755
Epoch: 1111
Loss on hold-out set: 0.010885899606898116
MeanAbsoluteError value on hold-out data: 0.0795014351606369
Epoch: 1112
Loss on hold-out set: 0.01071891247366087
MeanAbsoluteError value on hold-out data: 0.07588104903697968
Epoch: 1113
Loss on hold-out set: 0.008950475187144397
MeanAbsoluteError value on hold-out data: 0.06999867409467697
Epoch: 1114
Loss on hold-out set: 0.010745609888602606
MeanAbsoluteError value on hold-out data: 0.08018994331359863
Epoch: 1115
Loss on hold-out set: 0.011653422314169196
MeanAbsoluteError value on hold-out data: 0.08504735678434372
Epoch: 1116
Loss on hold-out set: 0.010255594564902519
MeanAbsoluteError value on hold-out data: 0.0775161013007164
Epoch: 1117
Loss on hold-out set: 0.013194961291737854
MeanAbsoluteError value on hold-out data: 0.08923175185918808
Epoch: 1118
Loss on hold-out set: 0.011656033527494098
MeanAbsoluteError value on hold-out data: 0.08069266378879547
Epoch: 1119
Loss on hold-out set: 0.007719891232851902
MeanAbsoluteError value on hold-out data: 0.06984210759401321
Epoch: 1120
Loss on hold-out set: 0.010235417703734128
MeanAbsoluteError value on hold-out data: 0.07886522263288498
Epoch: 1121
Loss on hold-out set: 0.01040428339712283
MeanAbsoluteError value on hold-out data: 0.07686296105384827
Epoch: 1122
Loss on hold-out set: 0.010167623999572205
MeanAbsoluteError value on hold-out data: 0.07422826439142227
Epoch: 1123
Loss on hold-out set: 0.00858198181745441
MeanAbsoluteError value on hold-out data: 0.07077968865633011
Epoch: 1124
Loss on hold-out set: 0.01040132021191918
MeanAbsoluteError value on hold-out data: 0.07792466878890991
Epoch: 1125
Loss on hold-out set: 0.010042466515127064
MeanAbsoluteError value on hold-out data: 0.07763601094484329
Epoch: 1126
Loss on hold-out set: 0.011593219857798735
MeanAbsoluteError value on hold-out data: 0.08219302445650101
Epoch: 1127
Loss on hold-out set: 0.0113277904672456
MeanAbsoluteError value on hold-out data: 0.08177977800369263
Epoch: 1128
Loss on hold-out set: 0.009446865795131695
MeanAbsoluteError value on hold-out data: 0.07486579567193985
Epoch: 1129
Loss on hold-out set: 0.009707760762006122
MeanAbsoluteError value on hold-out data: 0.07596983760595322
Epoch: 1130
Loss on hold-out set: 0.009941873976010053
MeanAbsoluteError value on hold-out data: 0.07444003969430923
Epoch: 1131
Loss on hold-out set: 0.011040947003445278
MeanAbsoluteError value on hold-out data: 0.07705940306186676
Epoch: 1132
Loss on hold-out set: 0.009697978816354104
MeanAbsoluteError value on hold-out data: 0.07626297324895859
Epoch: 1133
Loss on hold-out set: 0.013840312908675212
MeanAbsoluteError value on hold-out data: 0.08879583328962326
Epoch: 1134
Loss on hold-out set: 0.00964647189481184
MeanAbsoluteError value on hold-out data: 0.0708564966917038
Epoch: 1135
Loss on hold-out set: 0.009846821152605116
MeanAbsoluteError value on hold-out data: 0.07585752010345459
Epoch: 1136
Loss on hold-out set: 0.009068036595993666
MeanAbsoluteError value on hold-out data: 0.07304773479700089
Epoch: 1137
Loss on hold-out set: 0.010845183327728592
MeanAbsoluteError value on hold-out data: 0.08154459297657013
Epoch: 1138
Loss on hold-out set: 0.010672230424497685
MeanAbsoluteError value on hold-out data: 0.08024439215660095
Epoch: 1139
Loss on hold-out set: 0.009906484218857562
MeanAbsoluteError value on hold-out data: 0.07582869380712509
Epoch: 1140
Loss on hold-out set: 0.0108565807463674
MeanAbsoluteError value on hold-out data: 0.07836318761110306
Epoch: 1141
Loss on hold-out set: 0.010001932521602915
MeanAbsoluteError value on hold-out data: 0.07459291815757751
Epoch: 1142
Loss on hold-out set: 0.009517551009582044
MeanAbsoluteError value on hold-out data: 0.07459530979394913
Epoch: 1143
Loss on hold-out set: 0.010011037042640964
MeanAbsoluteError value on hold-out data: 0.07816445827484131
Epoch: 1144
Loss on hold-out set: 0.01243941217311658
MeanAbsoluteError value on hold-out data: 0.08129476010799408
Epoch: 1145
Loss on hold-out set: 0.010066564755591874
MeanAbsoluteError value on hold-out data: 0.07497663795948029
Epoch: 1146
Loss on hold-out set: 0.010627788481457779
MeanAbsoluteError value on hold-out data: 0.07943899184465408
Epoch: 1147
Loss on hold-out set: 0.009815902790869586
MeanAbsoluteError value on hold-out data: 0.07644426077604294
Epoch: 1148
Loss on hold-out set: 0.011008094822609565
MeanAbsoluteError value on hold-out data: 0.07900101691484451
Epoch: 1149
Loss on hold-out set: 0.009141621411569455
MeanAbsoluteError value on hold-out data: 0.0719374567270279
Epoch: 1150
Loss on hold-out set: 0.010685470722249495
MeanAbsoluteError value on hold-out data: 0.07845080643892288
Epoch: 1151
Loss on hold-out set: 0.010239882624106637
MeanAbsoluteError value on hold-out data: 0.07528442144393921
Epoch: 1152
Loss on hold-out set: 0.009607133076448615
MeanAbsoluteError value on hold-out data: 0.07475128769874573
Epoch: 1153
Loss on hold-out set: 0.011189523736441819
MeanAbsoluteError value on hold-out data: 0.07778310775756836
Epoch: 1154
Loss on hold-out set: 0.010634288034731678
MeanAbsoluteError value on hold-out data: 0.0772995799779892
Epoch: 1155
Loss on hold-out set: 0.009297243257315131
MeanAbsoluteError value on hold-out data: 0.07668069750070572
Epoch: 1156
Loss on hold-out set: 0.0096445917280289
MeanAbsoluteError value on hold-out data: 0.07393070310354233
Epoch: 1157
Loss on hold-out set: 0.011463478669532682
MeanAbsoluteError value on hold-out data: 0.0821145623922348
Epoch: 1158
Loss on hold-out set: 0.009547517756630744
MeanAbsoluteError value on hold-out data: 0.07302863150835037
Epoch: 1159
Loss on hold-out set: 0.010069164760692122
MeanAbsoluteError value on hold-out data: 0.07768897712230682
Epoch: 1160
Loss on hold-out set: 0.010540035372287093
MeanAbsoluteError value on hold-out data: 0.07620395720005035
Epoch: 1161
Loss on hold-out set: 0.009308296660395475
MeanAbsoluteError value on hold-out data: 0.07238492369651794
Epoch: 1162
Loss on hold-out set: 0.009829127792654617
MeanAbsoluteError value on hold-out data: 0.07520761340856552
Epoch: 1163
Loss on hold-out set: 0.01119348744105082
MeanAbsoluteError value on hold-out data: 0.08148014545440674
Epoch: 1164
Loss on hold-out set: 0.010332232805594685
MeanAbsoluteError value on hold-out data: 0.07725068926811218
Epoch: 1165
Loss on hold-out set: 0.009254198656902494
MeanAbsoluteError value on hold-out data: 0.07321751862764359
Epoch: 1166
Loss on hold-out set: 0.00937430547225328
MeanAbsoluteError value on hold-out data: 0.07287628948688507
Epoch: 1167
Loss on hold-out set: 0.011255987148918697
MeanAbsoluteError value on hold-out data: 0.07766179740428925
Epoch: 1168
Loss on hold-out set: 0.010178860113155679
MeanAbsoluteError value on hold-out data: 0.0789569690823555
Epoch: 1169
Loss on hold-out set: 0.009716550889582625
MeanAbsoluteError value on hold-out data: 0.0743381530046463
Epoch: 1170
Loss on hold-out set: 0.010306356822281183
MeanAbsoluteError value on hold-out data: 0.07693162560462952
Epoch: 1171
Loss on hold-out set: 0.009444102267589188
MeanAbsoluteError value on hold-out data: 0.07293622195720673
Epoch: 1172
Loss on hold-out set: 0.008900358267401315
MeanAbsoluteError value on hold-out data: 0.07237017899751663
Epoch: 1173
Loss on hold-out set: 0.010577158275070057
MeanAbsoluteError value on hold-out data: 0.07774744182825089
Epoch: 1174
Loss on hold-out set: 0.009916744485429566
MeanAbsoluteError value on hold-out data: 0.07340314239263535
Epoch: 1175
Loss on hold-out set: 0.009841591522999807
MeanAbsoluteError value on hold-out data: 0.07401861995458603
Epoch: 1176
Loss on hold-out set: 0.010656914777876713
MeanAbsoluteError value on hold-out data: 0.07626963406801224
Epoch: 1177
Loss on hold-out set: 0.009415393633644272
MeanAbsoluteError value on hold-out data: 0.07295504957437515
Epoch: 1178
Loss on hold-out set: 0.01082432455191641
MeanAbsoluteError value on hold-out data: 0.07640108466148376
Epoch: 1179
Loss on hold-out set: 0.009022292265990472
MeanAbsoluteError value on hold-out data: 0.07020310312509537
Epoch: 1180
Loss on hold-out set: 0.009846860033188326
MeanAbsoluteError value on hold-out data: 0.07238741219043732
Epoch: 1181
Loss on hold-out set: 0.010176746438179786
MeanAbsoluteError value on hold-out data: 0.07516361027956009
Epoch: 1182
Loss on hold-out set: 0.010762336769281925
MeanAbsoluteError value on hold-out data: 0.07747180014848709
Epoch: 1183
Loss on hold-out set: 0.01083380190463989
MeanAbsoluteError value on hold-out data: 0.07375109195709229
Epoch: 1184
Loss on hold-out set: 0.010478887374641394
MeanAbsoluteError value on hold-out data: 0.07946207374334335
Epoch: 1185
Loss on hold-out set: 0.009053969468435147
MeanAbsoluteError value on hold-out data: 0.07189838588237762
Epoch: 1186
Loss on hold-out set: 0.009910455293284031
MeanAbsoluteError value on hold-out data: 0.07205488532781601
Epoch: 1187
Loss on hold-out set: 0.010761460459665008
MeanAbsoluteError value on hold-out data: 0.07571960240602493
Epoch: 1188
Loss on hold-out set: 0.009457954476068457
MeanAbsoluteError value on hold-out data: 0.07565835863351822
Epoch: 1189
Loss on hold-out set: 0.011780088075077704
MeanAbsoluteError value on hold-out data: 0.08031079918146133
Epoch: 1190
Loss on hold-out set: 0.010400311481013584
MeanAbsoluteError value on hold-out data: 0.07894163578748703
Epoch: 1191
Loss on hold-out set: 0.011439615144772687
MeanAbsoluteError value on hold-out data: 0.08186908066272736
Epoch: 1192
Loss on hold-out set: 0.010460080052992756
MeanAbsoluteError value on hold-out data: 0.07878659665584564
Epoch: 1193
Loss on hold-out set: 0.009070311074344015
MeanAbsoluteError value on hold-out data: 0.0718805268406868
Epoch: 1194
Loss on hold-out set: 0.010241723361759795
MeanAbsoluteError value on hold-out data: 0.07560012489557266
Epoch: 1195
Loss on hold-out set: 0.01011414893240726
MeanAbsoluteError value on hold-out data: 0.07512010633945465
Epoch: 1196
Loss on hold-out set: 0.009460838764546982
MeanAbsoluteError value on hold-out data: 0.07313651591539383
Epoch: 1197
Loss on hold-out set: 0.009031779529395862
MeanAbsoluteError value on hold-out data: 0.07337120920419693
Epoch: 1198
Loss on hold-out set: 0.008785587098865713
MeanAbsoluteError value on hold-out data: 0.07229243218898773
Epoch: 1199
Loss on hold-out set: 0.010026961972204542
MeanAbsoluteError value on hold-out data: 0.07556162029504776
Epoch: 1200
Loss on hold-out set: 0.009768730646319454
MeanAbsoluteError value on hold-out data: 0.07644645124673843
Epoch: 1201
Loss on hold-out set: 0.010004678175925315
MeanAbsoluteError value on hold-out data: 0.07413491606712341
Epoch: 1202
Loss on hold-out set: 0.009952736186921054
MeanAbsoluteError value on hold-out data: 0.07471282035112381
Epoch: 1203
Loss on hold-out set: 0.009523128456045622
MeanAbsoluteError value on hold-out data: 0.07361201196908951
Epoch: 1204
Loss on hold-out set: 0.008369161186371155
MeanAbsoluteError value on hold-out data: 0.0678621158003807
Epoch: 1205
Loss on hold-out set: 0.01035392093129
MeanAbsoluteError value on hold-out data: 0.07599113136529922
Epoch: 1206
Loss on hold-out set: 0.011108209978532008
MeanAbsoluteError value on hold-out data: 0.07601737976074219
Epoch: 1207
Loss on hold-out set: 0.010924489148358892
MeanAbsoluteError value on hold-out data: 0.07625765353441238
Epoch: 1208
Loss on hold-out set: 0.010551578759526213
MeanAbsoluteError value on hold-out data: 0.07721655815839767
Epoch: 1209
Loss on hold-out set: 0.009645004743056233
MeanAbsoluteError value on hold-out data: 0.07445914298295975
Epoch: 1210
Loss on hold-out set: 0.008735271416489922
MeanAbsoluteError value on hold-out data: 0.07168370485305786
Epoch: 1211
Loss on hold-out set: 0.008662105574318653
MeanAbsoluteError value on hold-out data: 0.07064099609851837
Epoch: 1212
Loss on hold-out set: 0.009472357902013754
MeanAbsoluteError value on hold-out data: 0.07223079353570938
Epoch: 1213
Loss on hold-out set: 0.011355183743738355
MeanAbsoluteError value on hold-out data: 0.0805855393409729
Epoch: 1214
Loss on hold-out set: 0.01080065731657669
MeanAbsoluteError value on hold-out data: 0.07813742011785507
Epoch: 1215
Loss on hold-out set: 0.009808278130643278
MeanAbsoluteError value on hold-out data: 0.07539229840040207
Epoch: 1216
Loss on hold-out set: 0.008829640673963392
MeanAbsoluteError value on hold-out data: 0.07131664454936981
Epoch: 1217
Loss on hold-out set: 0.008686813601525501
MeanAbsoluteError value on hold-out data: 0.07254533469676971
Epoch: 1218
Loss on hold-out set: 0.009849479782230143
MeanAbsoluteError value on hold-out data: 0.0758594423532486
Epoch: 1219
Loss on hold-out set: 0.008797515414717055
MeanAbsoluteError value on hold-out data: 0.06961968541145325
Epoch: 1220
Loss on hold-out set: 0.009217373933085278
MeanAbsoluteError value on hold-out data: 0.07226726412773132
Epoch: 1221
Loss on hold-out set: 0.0103280751327596
MeanAbsoluteError value on hold-out data: 0.07454915344715118
Epoch: 1222
Loss on hold-out set: 0.009198455853450771
MeanAbsoluteError value on hold-out data: 0.07313591241836548
Epoch: 1223
Loss on hold-out set: 0.00947032890864648
MeanAbsoluteError value on hold-out data: 0.07269974797964096
Epoch: 1224
Loss on hold-out set: 0.009810947860854262
MeanAbsoluteError value on hold-out data: 0.07587902992963791
Epoch: 1225
Loss on hold-out set: 0.010517989401414525
MeanAbsoluteError value on hold-out data: 0.07716719061136246
Epoch: 1226
Loss on hold-out set: 0.008896632518280967
MeanAbsoluteError value on hold-out data: 0.0707244798541069
Epoch: 1227
Loss on hold-out set: 0.010213987417034028
MeanAbsoluteError value on hold-out data: 0.07650429010391235
Epoch: 1228
Loss on hold-out set: 0.009622370352617508
MeanAbsoluteError value on hold-out data: 0.07323591411113739
Epoch: 1229
Loss on hold-out set: 0.009224292545556333
MeanAbsoluteError value on hold-out data: 0.07208087295293808
Epoch: 1230
Loss on hold-out set: 0.007999543903473143
MeanAbsoluteError value on hold-out data: 0.06697782874107361
Epoch: 1231
Loss on hold-out set: 0.011030586200722609
MeanAbsoluteError value on hold-out data: 0.07781306654214859
Epoch: 1232
Loss on hold-out set: 0.009425924134726907
MeanAbsoluteError value on hold-out data: 0.07222005724906921
Epoch: 1233
Loss on hold-out set: 0.009683043968422378
MeanAbsoluteError value on hold-out data: 0.07622956484556198
Epoch: 1234
Loss on hold-out set: 0.008147244014435274
MeanAbsoluteError value on hold-out data: 0.06917029619216919
Epoch: 1235
Loss on hold-out set: 0.010080681582900677
MeanAbsoluteError value on hold-out data: 0.07542052865028381
Epoch: 1236
Loss on hold-out set: 0.008857737388321614
MeanAbsoluteError value on hold-out data: 0.07106903940439224
Epoch: 1237
Loss on hold-out set: 0.010441729493019617
MeanAbsoluteError value on hold-out data: 0.07467829436063766
Epoch: 1238
Loss on hold-out set: 0.009292293061662349
MeanAbsoluteError value on hold-out data: 0.07240438461303711
Epoch: 1239
Loss on hold-out set: 0.008785874241875718
MeanAbsoluteError value on hold-out data: 0.070970319211483
Epoch: 1240
Loss on hold-out set: 0.009696479142852089
MeanAbsoluteError value on hold-out data: 0.07074137777090073
Epoch: 1241
Loss on hold-out set: 0.009027174220827874
MeanAbsoluteError value on hold-out data: 0.07144028693437576
Epoch: 1242
Loss on hold-out set: 0.008960784275501888
MeanAbsoluteError value on hold-out data: 0.06947457045316696
Epoch: 1243
Loss on hold-out set: 0.010949381872017815
MeanAbsoluteError value on hold-out data: 0.0781770572066307
Epoch: 1244
Loss on hold-out set: 0.009723316568464119
MeanAbsoluteError value on hold-out data: 0.07283157855272293
Epoch: 1245
Loss on hold-out set: 0.008799611638241913
MeanAbsoluteError value on hold-out data: 0.0725567638874054
Epoch: 1246
Loss on hold-out set: 0.009520853683873913
MeanAbsoluteError value on hold-out data: 0.07376009970903397
Epoch: 1247
Loss on hold-out set: 0.009721368144382722
MeanAbsoluteError value on hold-out data: 0.07440920919179916
Early stopping at epoch 1246
Returned to Spot: Validation loss: 0.009721368144382722
----------------------------------------------

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.1773189149831582, 'lr_mult': 9.06715620679689, 'batch_size': 4, 'epochs': 4, 'k_folds': 1, 'patience': 8, 'optimizer': 'Adamax', 'sgd_momentum': 0.22706194978124503}
Epoch: 1
Loss on hold-out set: 0.03353968291853865
MeanAbsoluteError value on hold-out data: 0.14854852855205536
Epoch: 2
Loss on hold-out set: 0.03143548950863381
MeanAbsoluteError value on hold-out data: 0.14047487080097198
Epoch: 3
Loss on hold-out set: 0.026773299442914626
MeanAbsoluteError value on hold-out data: 0.128300279378891
Epoch: 4
Loss on hold-out set: 0.020451584920519964
MeanAbsoluteError value on hold-out data: 0.1118927150964737
Returned to Spot: Validation loss: 0.020451584920519964
----------------------------------------------

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.3840970624671163, 'lr_mult': 4.593111165984917, 'batch_size': 8, 'epochs': 256, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.8945915831939406}
Epoch: 1
Loss on hold-out set: 0.044173768378402055
MeanAbsoluteError value on hold-out data: 0.1685652732849121
Epoch: 2
Loss on hold-out set: 0.03130715119799501
MeanAbsoluteError value on hold-out data: 0.13991211354732513
Epoch: 3
Loss on hold-out set: 0.02515393616876712
MeanAbsoluteError value on hold-out data: 0.1251569390296936
Epoch: 4
Loss on hold-out set: 0.025658857028343175
MeanAbsoluteError value on hold-out data: 0.12384185940027237
Epoch: 5
Loss on hold-out set: 0.025167155006018124
MeanAbsoluteError value on hold-out data: 0.1239810585975647
Epoch: 6
Loss on hold-out set: 0.018040087123058345
MeanAbsoluteError value on hold-out data: 0.10203435271978378
Epoch: 7
Loss on hold-out set: 0.01820586880325879
MeanAbsoluteError value on hold-out data: 0.10664362460374832
Epoch: 8
Loss on hold-out set: 0.018571511725895107
MeanAbsoluteError value on hold-out data: 0.10493003576993942
Epoch: 9
Loss on hold-out set: 0.01920939954978071
MeanAbsoluteError value on hold-out data: 0.10832036286592484
Epoch: 10
Loss on hold-out set: 0.01865579428053216
MeanAbsoluteError value on hold-out data: 0.10315104573965073
Epoch: 11
Loss on hold-out set: 0.01401579946794204
MeanAbsoluteError value on hold-out data: 0.0901179239153862
Epoch: 12
Loss on hold-out set: 0.012327216133646863
MeanAbsoluteError value on hold-out data: 0.08568612486124039
Epoch: 13
Loss on hold-out set: 0.012179553318817756
MeanAbsoluteError value on hold-out data: 0.08845322579145432
Epoch: 14
Loss on hold-out set: 0.011831798964474154
MeanAbsoluteError value on hold-out data: 0.08390428125858307
Epoch: 15
Loss on hold-out set: 0.01055576115552532
MeanAbsoluteError value on hold-out data: 0.07949520647525787
Epoch: 16
Loss on hold-out set: 0.009269700581698041
MeanAbsoluteError value on hold-out data: 0.0744297057390213
Epoch: 17
Loss on hold-out set: 0.009840337240970448
MeanAbsoluteError value on hold-out data: 0.07731245458126068
Epoch: 18
Loss on hold-out set: 0.007915474358014762
MeanAbsoluteError value on hold-out data: 0.06772644817829132
Epoch: 19
Loss on hold-out set: 0.007850840482493177
MeanAbsoluteError value on hold-out data: 0.06399928033351898
Epoch: 20
Loss on hold-out set: 0.0072376647761924874
MeanAbsoluteError value on hold-out data: 0.06373077630996704
Epoch: 21
Loss on hold-out set: 0.008845426736546582
MeanAbsoluteError value on hold-out data: 0.07176856696605682
Epoch: 22
Loss on hold-out set: 0.006720411490134306
MeanAbsoluteError value on hold-out data: 0.06155279651284218
Epoch: 23
Loss on hold-out set: 0.007743212345399354
MeanAbsoluteError value on hold-out data: 0.06730350106954575
Epoch: 24
Loss on hold-out set: 0.007311985650295882
MeanAbsoluteError value on hold-out data: 0.06670529395341873
Epoch: 25
Loss on hold-out set: 0.006089904501813611
MeanAbsoluteError value on hold-out data: 0.0609063021838665
Epoch: 26
Loss on hold-out set: 0.00697043772149635
MeanAbsoluteError value on hold-out data: 0.06378254294395447
Epoch: 27
Loss on hold-out set: 0.0063509610359017785
MeanAbsoluteError value on hold-out data: 0.06304600089788437
Epoch: 28
Loss on hold-out set: 0.006003552517780152
MeanAbsoluteError value on hold-out data: 0.05950586497783661
Epoch: 29
Loss on hold-out set: 0.005639595791427909
MeanAbsoluteError value on hold-out data: 0.0566311851143837
Epoch: 30
Loss on hold-out set: 0.005428603770652492
MeanAbsoluteError value on hold-out data: 0.053419578820466995
Epoch: 31
Loss on hold-out set: 0.0055784776570937155
MeanAbsoluteError value on hold-out data: 0.056201547384262085
Epoch: 32
Loss on hold-out set: 0.0055535603590358635
MeanAbsoluteError value on hold-out data: 0.053880833089351654
Epoch: 33
Loss on hold-out set: 0.005391660936813997
MeanAbsoluteError value on hold-out data: 0.05629119277000427
Epoch: 34
Loss on hold-out set: 0.005832112319216034
MeanAbsoluteError value on hold-out data: 0.05830826982855797
Epoch: 35
Loss on hold-out set: 0.004702240853619419
MeanAbsoluteError value on hold-out data: 0.05168189853429794
Epoch: 36
Loss on hold-out set: 0.00558203907597712
MeanAbsoluteError value on hold-out data: 0.054067060351371765
Epoch: 37
Loss on hold-out set: 0.004441102723113114
MeanAbsoluteError value on hold-out data: 0.05155332759022713
Epoch: 38
Loss on hold-out set: 0.005109498932908632
MeanAbsoluteError value on hold-out data: 0.05344477295875549
Epoch: 39
Loss on hold-out set: 0.004935030610986838
MeanAbsoluteError value on hold-out data: 0.051950618624687195
Epoch: 40
Loss on hold-out set: 0.004821713012030446
MeanAbsoluteError value on hold-out data: 0.05214648321270943
Epoch: 41
Loss on hold-out set: 0.004075978651311935
MeanAbsoluteError value on hold-out data: 0.04898151382803917
Epoch: 42
Loss on hold-out set: 0.004945997430599834
MeanAbsoluteError value on hold-out data: 0.04880833253264427
Epoch: 43
Loss on hold-out set: 0.004502209430364401
MeanAbsoluteError value on hold-out data: 0.04648277536034584
Epoch: 44
Loss on hold-out set: 0.00666147172083392
MeanAbsoluteError value on hold-out data: 0.06864742934703827
Epoch: 45
Loss on hold-out set: 0.005910040905674626
MeanAbsoluteError value on hold-out data: 0.053658582270145416
Epoch: 46
Loss on hold-out set: 0.0045950034791052245
MeanAbsoluteError value on hold-out data: 0.04844743758440018
Epoch: 47
Loss on hold-out set: 0.0036175305691645726
MeanAbsoluteError value on hold-out data: 0.04808271676301956
Epoch: 48
Loss on hold-out set: 0.003488890058897117
MeanAbsoluteError value on hold-out data: 0.045896921306848526
Epoch: 49
Loss on hold-out set: 0.00578400200710779
MeanAbsoluteError value on hold-out data: 0.06044918671250343
Epoch: 50
Loss on hold-out set: 0.005164328052686821
MeanAbsoluteError value on hold-out data: 0.0536431185901165
Epoch: 51
Loss on hold-out set: 0.004700012891063173
MeanAbsoluteError value on hold-out data: 0.052218612283468246
Epoch: 52
Loss on hold-out set: 0.0037807847432926984
MeanAbsoluteError value on hold-out data: 0.04559548571705818
Epoch: 53
Loss on hold-out set: 0.0040071268541444285
MeanAbsoluteError value on hold-out data: 0.04561883583664894
Epoch: 54
Loss on hold-out set: 0.004556503119314776
MeanAbsoluteError value on hold-out data: 0.051424939185380936
Epoch: 55
Loss on hold-out set: 0.004416221138518794
MeanAbsoluteError value on hold-out data: 0.048841238021850586
Epoch: 56
Loss on hold-out set: 0.005007048537280704
MeanAbsoluteError value on hold-out data: 0.048889338970184326
Epoch: 57
Loss on hold-out set: 0.004050494539306352
MeanAbsoluteError value on hold-out data: 0.04655618220567703
Epoch: 58
Loss on hold-out set: 0.0038132807040758628
MeanAbsoluteError value on hold-out data: 0.04570389166474342
Epoch: 59
Loss on hold-out set: 0.005505600270177973
MeanAbsoluteError value on hold-out data: 0.05313969403505325
Epoch: 60
Loss on hold-out set: 0.004928976029316944
MeanAbsoluteError value on hold-out data: 0.05307455360889435
Epoch: 61
Loss on hold-out set: 0.0038849406517233306
MeanAbsoluteError value on hold-out data: 0.044709350913763046
Epoch: 62
Loss on hold-out set: 0.006665090007070256
MeanAbsoluteError value on hold-out data: 0.06759677827358246
Epoch: 63
Loss on hold-out set: 0.004679489298723638
MeanAbsoluteError value on hold-out data: 0.05234057828783989
Epoch: 64
Loss on hold-out set: 0.004710679978751087
MeanAbsoluteError value on hold-out data: 0.04578879848122597
Epoch: 65
Loss on hold-out set: 0.004465252327990081
MeanAbsoluteError value on hold-out data: 0.049183189868927
Epoch: 66
Loss on hold-out set: 0.003563081291136577
MeanAbsoluteError value on hold-out data: 0.042522087693214417
Epoch: 67
Loss on hold-out set: 0.004021810180060321
MeanAbsoluteError value on hold-out data: 0.04197634011507034
Epoch: 68
Loss on hold-out set: 0.0034908840622703886
MeanAbsoluteError value on hold-out data: 0.04147985950112343
Epoch: 69
Loss on hold-out set: 0.0038022855358002218
MeanAbsoluteError value on hold-out data: 0.047942109405994415
Epoch: 70
Loss on hold-out set: 0.005005419692392216
MeanAbsoluteError value on hold-out data: 0.05023789778351784
Epoch: 71
Loss on hold-out set: 0.004145873379648516
MeanAbsoluteError value on hold-out data: 0.04187287017703056
Epoch: 72
Loss on hold-out set: 0.003889073810760716
MeanAbsoluteError value on hold-out data: 0.04542264714837074
Epoch: 73
Loss on hold-out set: 0.004010846891967384
MeanAbsoluteError value on hold-out data: 0.04383073374629021
Epoch: 74
Loss on hold-out set: 0.004047588711776035
MeanAbsoluteError value on hold-out data: 0.046773649752140045
Epoch: 75
Loss on hold-out set: 0.005714025330043545
MeanAbsoluteError value on hold-out data: 0.05484703555703163
Epoch: 76
Loss on hold-out set: 0.005552604322713849
MeanAbsoluteError value on hold-out data: 0.056404564529657364
Epoch: 77
Loss on hold-out set: 0.003921034387435372
MeanAbsoluteError value on hold-out data: 0.04641023650765419
Epoch: 78
Loss on hold-out set: 0.0034569919899743247
MeanAbsoluteError value on hold-out data: 0.044918209314346313
Epoch: 79
Loss on hold-out set: 0.003975120945956166
MeanAbsoluteError value on hold-out data: 0.04907490313053131
Epoch: 80
Loss on hold-out set: 0.003509639675030485
MeanAbsoluteError value on hold-out data: 0.04442589357495308
Epoch: 81
Loss on hold-out set: 0.00480550341614473
MeanAbsoluteError value on hold-out data: 0.0505160316824913
Epoch: 82
Loss on hold-out set: 0.005009809639121063
MeanAbsoluteError value on hold-out data: 0.05083334445953369
Epoch: 83
Loss on hold-out set: 0.0038993297831008307
MeanAbsoluteError value on hold-out data: 0.04738546535372734
Epoch: 84
Loss on hold-out set: 0.003993078991219303
MeanAbsoluteError value on hold-out data: 0.048434216529130936
Epoch: 85
Loss on hold-out set: 0.004129463642847871
MeanAbsoluteError value on hold-out data: 0.04387468472123146
Epoch: 86
Loss on hold-out set: 0.0032385135778703875
MeanAbsoluteError value on hold-out data: 0.04031972214579582
Epoch: 87
Loss on hold-out set: 0.004974426648052605
MeanAbsoluteError value on hold-out data: 0.05121195316314697
Epoch: 88
Loss on hold-out set: 0.004399876176122282
MeanAbsoluteError value on hold-out data: 0.0457126758992672
Epoch: 89
Loss on hold-out set: 0.0045834535772691625
MeanAbsoluteError value on hold-out data: 0.04920034483075142
Epoch: 90
Loss on hold-out set: 0.0035512696731051334
MeanAbsoluteError value on hold-out data: 0.042832840234041214
Epoch: 91
Loss on hold-out set: 0.004086847631505837
MeanAbsoluteError value on hold-out data: 0.04762283340096474
Epoch: 92
Loss on hold-out set: 0.005393905329248427
MeanAbsoluteError value on hold-out data: 0.05806425213813782
Epoch: 93
Loss on hold-out set: 0.0042780161357337705
MeanAbsoluteError value on hold-out data: 0.047377899289131165
Epoch: 94
Loss on hold-out set: 0.003301859459545659
MeanAbsoluteError value on hold-out data: 0.0412914864718914
Epoch: 95
Loss on hold-out set: 0.004197108422981967
MeanAbsoluteError value on hold-out data: 0.046781107783317566
Epoch: 96
Loss on hold-out set: 0.004982493546681087
MeanAbsoluteError value on hold-out data: 0.05352970212697983
Epoch: 97
Loss on hold-out set: 0.0049124017371612256
MeanAbsoluteError value on hold-out data: 0.04787831008434296
Epoch: 98
Loss on hold-out set: 0.004250070167472586
MeanAbsoluteError value on hold-out data: 0.047887008637189865
Epoch: 99
Loss on hold-out set: 0.00398673002889968
MeanAbsoluteError value on hold-out data: 0.04572070762515068
Epoch: 100
Loss on hold-out set: 0.0043334061384054
MeanAbsoluteError value on hold-out data: 0.0487741082906723
Epoch: 101
Loss on hold-out set: 0.0041120851130567885
MeanAbsoluteError value on hold-out data: 0.044268399477005005
Epoch: 102
Loss on hold-out set: 0.00568409289208878
MeanAbsoluteError value on hold-out data: 0.056522294878959656
Epoch: 103
Loss on hold-out set: 0.0037007570254469387
MeanAbsoluteError value on hold-out data: 0.04256485775113106
Epoch: 104
Loss on hold-out set: 0.00350202958246595
MeanAbsoluteError value on hold-out data: 0.04087650403380394
Epoch: 105
Loss on hold-out set: 0.005402020946157312
MeanAbsoluteError value on hold-out data: 0.059748657047748566
Epoch: 106
Loss on hold-out set: 0.0048203228323377275
MeanAbsoluteError value on hold-out data: 0.04890109971165657
Epoch: 107
Loss on hold-out set: 0.0056788901289875965
MeanAbsoluteError value on hold-out data: 0.05382976680994034
Epoch: 108
Loss on hold-out set: 0.0044914416150851665
MeanAbsoluteError value on hold-out data: 0.04503156617283821
Epoch: 109
Loss on hold-out set: 0.004309649934600058
MeanAbsoluteError value on hold-out data: 0.04810993745923042
Epoch: 110
Loss on hold-out set: 0.0043630018205332915
MeanAbsoluteError value on hold-out data: 0.0465083122253418
Epoch: 111
Loss on hold-out set: 0.005574094572741734
MeanAbsoluteError value on hold-out data: 0.059127986431121826
Epoch: 112
Loss on hold-out set: 0.0035227312511874756
MeanAbsoluteError value on hold-out data: 0.041556216776371
Epoch: 113
Loss on hold-out set: 0.0032937108817828915
MeanAbsoluteError value on hold-out data: 0.04366935044527054
Epoch: 114
Loss on hold-out set: 0.0036641272262817152
MeanAbsoluteError value on hold-out data: 0.04277869686484337
Epoch: 115
Loss on hold-out set: 0.004256316423906307
MeanAbsoluteError value on hold-out data: 0.05133159086108208
Epoch: 116
Loss on hold-out set: 0.004090895514788204
MeanAbsoluteError value on hold-out data: 0.04576700180768967
Epoch: 117
Loss on hold-out set: 0.0037620310766597917
MeanAbsoluteError value on hold-out data: 0.04185907542705536
Epoch: 118
Loss on hold-out set: 0.0038154670726630443
MeanAbsoluteError value on hold-out data: 0.04438988119363785
Epoch: 119
Loss on hold-out set: 0.004178221757205105
MeanAbsoluteError value on hold-out data: 0.04385075345635414
Epoch: 120
Loss on hold-out set: 0.0051138611681955425
MeanAbsoluteError value on hold-out data: 0.056652165949344635
Epoch: 121
Loss on hold-out set: 0.004733090134227257
MeanAbsoluteError value on hold-out data: 0.04831332340836525
Epoch: 122
Loss on hold-out set: 0.003115529430368425
MeanAbsoluteError value on hold-out data: 0.03951925411820412
Epoch: 123
Loss on hold-out set: 0.0035562562675056
MeanAbsoluteError value on hold-out data: 0.0468166284263134
Epoch: 124
Loss on hold-out set: 0.0031515880921353144
MeanAbsoluteError value on hold-out data: 0.04282280057668686
Epoch: 125
Loss on hold-out set: 0.0035220277005512464
MeanAbsoluteError value on hold-out data: 0.04379811882972717
Epoch: 126
Loss on hold-out set: 0.0030562228302618392
MeanAbsoluteError value on hold-out data: 0.042972464114427567
Epoch: 127
Loss on hold-out set: 0.002837238438108838
MeanAbsoluteError value on hold-out data: 0.039429496973752975
Epoch: 128
Loss on hold-out set: 0.005205200139531179
MeanAbsoluteError value on hold-out data: 0.05041923001408577
Epoch: 129
Loss on hold-out set: 0.003928554578267626
MeanAbsoluteError value on hold-out data: 0.044258322566747665
Epoch: 130
Loss on hold-out set: 0.0036149268087587857
MeanAbsoluteError value on hold-out data: 0.042565759271383286
Epoch: 131
Loss on hold-out set: 0.003918500770324547
MeanAbsoluteError value on hold-out data: 0.043459706008434296
Epoch: 132
Loss on hold-out set: 0.003733196543946274
MeanAbsoluteError value on hold-out data: 0.04404522478580475
Epoch: 133
Loss on hold-out set: 0.005469380635890718
MeanAbsoluteError value on hold-out data: 0.043138287961483
Epoch: 134
Loss on hold-out set: 0.0045289429790021755
MeanAbsoluteError value on hold-out data: 0.04440968111157417
Epoch: 135
Loss on hold-out set: 0.003798672678960046
MeanAbsoluteError value on hold-out data: 0.041905324906110764
Epoch: 136
Loss on hold-out set: 0.0059566996795566455
MeanAbsoluteError value on hold-out data: 0.06092849001288414
Epoch: 137
Loss on hold-out set: 0.003536955868567977
MeanAbsoluteError value on hold-out data: 0.04204383119940758
Epoch: 138
Loss on hold-out set: 0.003229896449116304
MeanAbsoluteError value on hold-out data: 0.042585816234350204
Epoch: 139
Loss on hold-out set: 0.0029980924101485136
MeanAbsoluteError value on hold-out data: 0.04050847515463829
Epoch: 140
Loss on hold-out set: 0.004364361977710168
MeanAbsoluteError value on hold-out data: 0.04605453461408615
Epoch: 141
Loss on hold-out set: 0.003450020790057208
MeanAbsoluteError value on hold-out data: 0.0433124303817749
Epoch: 142
Loss on hold-out set: 0.003689752361663666
MeanAbsoluteError value on hold-out data: 0.045169636607170105
Epoch: 143
Loss on hold-out set: 0.003730577174696679
MeanAbsoluteError value on hold-out data: 0.04275091737508774
Epoch: 144
Loss on hold-out set: 0.003521692491822729
MeanAbsoluteError value on hold-out data: 0.0440048910677433
Epoch: 145
Loss on hold-out set: 0.0034155188458450873
MeanAbsoluteError value on hold-out data: 0.04139591380953789
Epoch: 146
Loss on hold-out set: 0.004560022339175798
MeanAbsoluteError value on hold-out data: 0.044974278658628464
Epoch: 147
Loss on hold-out set: 0.004347219675669055
MeanAbsoluteError value on hold-out data: 0.04378635808825493
Epoch: 148
Loss on hold-out set: 0.0048536273672269955
MeanAbsoluteError value on hold-out data: 0.05082546919584274
Epoch: 149
Loss on hold-out set: 0.004587892191729655
MeanAbsoluteError value on hold-out data: 0.050624120980501175
Epoch: 150
Loss on hold-out set: 0.003798043151618913
MeanAbsoluteError value on hold-out data: 0.04561089724302292
Epoch: 151
Loss on hold-out set: 0.004410142003938458
MeanAbsoluteError value on hold-out data: 0.04775158315896988
Epoch: 152
Loss on hold-out set: 0.003563954595991067
MeanAbsoluteError value on hold-out data: 0.044528234750032425
Epoch: 153
Loss on hold-out set: 0.003929359061753769
MeanAbsoluteError value on hold-out data: 0.044635239988565445
Epoch: 154
Loss on hold-out set: 0.006201850424986333
MeanAbsoluteError value on hold-out data: 0.06219970062375069
Epoch: 155
Loss on hold-out set: 0.00447273902184526
MeanAbsoluteError value on hold-out data: 0.04450053721666336
Epoch: 156
Loss on hold-out set: 0.0038621543575764485
MeanAbsoluteError value on hold-out data: 0.046533167362213135
Epoch: 157
Loss on hold-out set: 0.005596092941950222
MeanAbsoluteError value on hold-out data: 0.053259752690792084
Epoch: 158
Loss on hold-out set: 0.00425827896565591
MeanAbsoluteError value on hold-out data: 0.04493100568652153
Epoch: 159
Loss on hold-out set: 0.006510177222815783
MeanAbsoluteError value on hold-out data: 0.05800818279385567
Epoch: 160
Loss on hold-out set: 0.002867206909669269
MeanAbsoluteError value on hold-out data: 0.038868218660354614
Epoch: 161
Loss on hold-out set: 0.004586633860047809
MeanAbsoluteError value on hold-out data: 0.04772476479411125
Epoch: 162
Loss on hold-out set: 0.0036293702586063822
MeanAbsoluteError value on hold-out data: 0.042743001133203506
Epoch: 163
Loss on hold-out set: 0.0035717550092254228
MeanAbsoluteError value on hold-out data: 0.04342453554272652
Epoch: 164
Loss on hold-out set: 0.004034509367652629
MeanAbsoluteError value on hold-out data: 0.04248920455574989
Epoch: 165
Loss on hold-out set: 0.00440359508195941
MeanAbsoluteError value on hold-out data: 0.04551500454545021
Epoch: 166
Loss on hold-out set: 0.004826814192040872
MeanAbsoluteError value on hold-out data: 0.0433378703892231
Epoch: 167
Loss on hold-out set: 0.0041132403987974514
MeanAbsoluteError value on hold-out data: 0.04741557314991951
Epoch: 168
Loss on hold-out set: 0.0040133169202722216
MeanAbsoluteError value on hold-out data: 0.04835224896669388
Epoch: 169
Loss on hold-out set: 0.004197761666115471
MeanAbsoluteError value on hold-out data: 0.04840848222374916
Epoch: 170
Loss on hold-out set: 0.0031965472796735795
MeanAbsoluteError value on hold-out data: 0.04245190694928169
Epoch: 171
Loss on hold-out set: 0.004375114896040606
MeanAbsoluteError value on hold-out data: 0.05020812526345253
Epoch: 172
Loss on hold-out set: 0.004118864821257854
MeanAbsoluteError value on hold-out data: 0.04402399808168411
Epoch: 173
Loss on hold-out set: 0.004594586051289777
MeanAbsoluteError value on hold-out data: 0.05160602554678917
Epoch: 174
Loss on hold-out set: 0.004337858727299853
MeanAbsoluteError value on hold-out data: 0.04507173225283623
Epoch: 175
Loss on hold-out set: 0.004411948890743875
MeanAbsoluteError value on hold-out data: 0.052760060876607895
Epoch: 176
Loss on hold-out set: 0.0036314946368005813
MeanAbsoluteError value on hold-out data: 0.04304400831460953
Epoch: 177
Loss on hold-out set: 0.004147277118662666
MeanAbsoluteError value on hold-out data: 0.04359602555632591
Epoch: 178
Loss on hold-out set: 0.0045528434535586524
MeanAbsoluteError value on hold-out data: 0.04785643145442009
Epoch: 179
Loss on hold-out set: 0.004651665851461554
MeanAbsoluteError value on hold-out data: 0.050683509558439255
Epoch: 180
Loss on hold-out set: 0.004003500613371695
MeanAbsoluteError value on hold-out data: 0.04227450489997864
Epoch: 181
Loss on hold-out set: 0.0032937354929009942
MeanAbsoluteError value on hold-out data: 0.04192142188549042
Epoch: 182
Loss on hold-out set: 0.0037011452644181097
MeanAbsoluteError value on hold-out data: 0.04098087176680565
Epoch: 183
Loss on hold-out set: 0.00414932836429216
MeanAbsoluteError value on hold-out data: 0.04596453532576561
Epoch: 184
Loss on hold-out set: 0.003595417271993172
MeanAbsoluteError value on hold-out data: 0.04005352780222893
Epoch: 185
Loss on hold-out set: 0.003344224984941416
MeanAbsoluteError value on hold-out data: 0.03935883939266205
Epoch: 186
Loss on hold-out set: 0.002739270471226375
MeanAbsoluteError value on hold-out data: 0.03996627777814865
Epoch: 187
Loss on hold-out set: 0.0035647543952922875
MeanAbsoluteError value on hold-out data: 0.043978527188301086
Epoch: 188
Loss on hold-out set: 0.0032233052494886672
MeanAbsoluteError value on hold-out data: 0.04113643243908882
Epoch: 189
Loss on hold-out set: 0.0032768491716859372
MeanAbsoluteError value on hold-out data: 0.04263096675276756
Epoch: 190
Loss on hold-out set: 0.0028258877144636293
MeanAbsoluteError value on hold-out data: 0.039614081382751465
Epoch: 191
Loss on hold-out set: 0.003111237497681654
MeanAbsoluteError value on hold-out data: 0.03800592198967934
Epoch: 192
Loss on hold-out set: 0.003505218662260296
MeanAbsoluteError value on hold-out data: 0.04048600047826767
Epoch: 193
Loss on hold-out set: 0.0034561500023731866
MeanAbsoluteError value on hold-out data: 0.04260244965553284
Epoch: 194
Loss on hold-out set: 0.003391573419273635
MeanAbsoluteError value on hold-out data: 0.039125435054302216
Epoch: 195
Loss on hold-out set: 0.0033161441908879695
MeanAbsoluteError value on hold-out data: 0.04527715593576431
Epoch: 196
Loss on hold-out set: 0.003967731362392537
MeanAbsoluteError value on hold-out data: 0.04096756502985954
Epoch: 197
Loss on hold-out set: 0.003232965558326166
MeanAbsoluteError value on hold-out data: 0.042373161762952805
Epoch: 198
Loss on hold-out set: 0.003785450416647731
MeanAbsoluteError value on hold-out data: 0.041814837604761124
Epoch: 199
Loss on hold-out set: 0.010068454733731127
MeanAbsoluteError value on hold-out data: 0.07955754548311234
Epoch: 200
Loss on hold-out set: 0.003391806481216152
MeanAbsoluteError value on hold-out data: 0.03780559077858925
Epoch: 201
Loss on hold-out set: 0.0031432131532040473
MeanAbsoluteError value on hold-out data: 0.042208462953567505
Epoch: 202
Loss on hold-out set: 0.005191731107372202
MeanAbsoluteError value on hold-out data: 0.05549266189336777
Epoch: 203
Loss on hold-out set: 0.004155735780889364
MeanAbsoluteError value on hold-out data: 0.045664168894290924
Epoch: 204
Loss on hold-out set: 0.004721938157576676
MeanAbsoluteError value on hold-out data: 0.04957960918545723
Epoch: 205
Loss on hold-out set: 0.003942595857599946
MeanAbsoluteError value on hold-out data: 0.04651564359664917
Epoch: 206
Loss on hold-out set: 0.003931369056533042
MeanAbsoluteError value on hold-out data: 0.03794628009200096
Epoch: 207
Loss on hold-out set: 0.0051649569343824525
MeanAbsoluteError value on hold-out data: 0.050679340958595276
Epoch: 208
Loss on hold-out set: 0.004399391444933012
MeanAbsoluteError value on hold-out data: 0.04580559581518173
Epoch: 209
Loss on hold-out set: 0.004221336595181033
MeanAbsoluteError value on hold-out data: 0.04173903167247772
Epoch: 210
Loss on hold-out set: 0.006699731236470765
MeanAbsoluteError value on hold-out data: 0.06602492928504944
Epoch: 211
Loss on hold-out set: 0.007516465652243872
MeanAbsoluteError value on hold-out data: 0.06219218671321869
Epoch: 212
Loss on hold-out set: 0.003921068373050443
MeanAbsoluteError value on hold-out data: 0.04361790791153908
Epoch: 213
Loss on hold-out set: 0.004453822260410034
MeanAbsoluteError value on hold-out data: 0.0438697449862957
Epoch: 214
Loss on hold-out set: 0.004577674907570901
MeanAbsoluteError value on hold-out data: 0.045717716217041016
Epoch: 215
Loss on hold-out set: 0.004811617973150294
MeanAbsoluteError value on hold-out data: 0.05082300677895546
Epoch: 216
Loss on hold-out set: 0.005262121697581422
MeanAbsoluteError value on hold-out data: 0.05604198947548866
Epoch: 217
Loss on hold-out set: 0.0040530535770813
MeanAbsoluteError value on hold-out data: 0.04658399149775505
Epoch: 218
Loss on hold-out set: 0.003596635085398846
MeanAbsoluteError value on hold-out data: 0.04231327772140503
Epoch: 219
Loss on hold-out set: 0.003544626736057628
MeanAbsoluteError value on hold-out data: 0.04259940981864929
Epoch: 220
Loss on hold-out set: 0.004390890207631807
MeanAbsoluteError value on hold-out data: 0.04705815389752388
Epoch: 221
Loss on hold-out set: 0.003756765571827265
MeanAbsoluteError value on hold-out data: 0.04439461603760719
Epoch: 222
Loss on hold-out set: 0.004119404069282801
MeanAbsoluteError value on hold-out data: 0.0452483668923378
Epoch: 223
Loss on hold-out set: 0.003297482161111762
MeanAbsoluteError value on hold-out data: 0.04079422727227211
Epoch: 224
Loss on hold-out set: 0.004029194938515215
MeanAbsoluteError value on hold-out data: 0.04277057573199272
Epoch: 225
Loss on hold-out set: 0.00447925349918047
MeanAbsoluteError value on hold-out data: 0.04982396960258484
Epoch: 226
Loss on hold-out set: 0.003553466061834785
MeanAbsoluteError value on hold-out data: 0.043282151222229004
Epoch: 227
Loss on hold-out set: 0.0033752006068090467
MeanAbsoluteError value on hold-out data: 0.04082063212990761
Epoch: 228
Loss on hold-out set: 0.003997848606607141
MeanAbsoluteError value on hold-out data: 0.04126778244972229
Epoch: 229
Loss on hold-out set: 0.003099867696475581
MeanAbsoluteError value on hold-out data: 0.03947778791189194
Epoch: 230
Loss on hold-out set: 0.0026481614438939446
MeanAbsoluteError value on hold-out data: 0.03484028950333595
Epoch: 231
Loss on hold-out set: 0.0033359686816478835
MeanAbsoluteError value on hold-out data: 0.03791774809360504
Epoch: 232
Loss on hold-out set: 0.004183287199243511
MeanAbsoluteError value on hold-out data: 0.047323256731033325
Epoch: 233
Loss on hold-out set: 0.0034019847363723735
MeanAbsoluteError value on hold-out data: 0.03982974588871002
Epoch: 234
Loss on hold-out set: 0.002957069310420928
MeanAbsoluteError value on hold-out data: 0.03862212970852852
Epoch: 235
Loss on hold-out set: 0.0029763849528726973
MeanAbsoluteError value on hold-out data: 0.04081949219107628
Epoch: 236
Loss on hold-out set: 0.004490011126587265
MeanAbsoluteError value on hold-out data: 0.04681028053164482
Epoch: 237
Loss on hold-out set: 0.004147781727002247
MeanAbsoluteError value on hold-out data: 0.04542946815490723
Epoch: 238
Loss on hold-out set: 0.003915663117751185
MeanAbsoluteError value on hold-out data: 0.044220220297575
Epoch: 239
Loss on hold-out set: 0.005006545272312667
MeanAbsoluteError value on hold-out data: 0.053447138518095016
Epoch: 240
Loss on hold-out set: 0.004791985909258456
MeanAbsoluteError value on hold-out data: 0.04975471645593643
Epoch: 241
Loss on hold-out set: 0.0031758699501791086
MeanAbsoluteError value on hold-out data: 0.04137720167636871
Epoch: 242
Loss on hold-out set: 0.0029729216812962762
MeanAbsoluteError value on hold-out data: 0.04100397601723671
Epoch: 243
Loss on hold-out set: 0.0038469376832884
MeanAbsoluteError value on hold-out data: 0.049388375133275986
Epoch: 244
Loss on hold-out set: 0.004782866853546645
MeanAbsoluteError value on hold-out data: 0.045099299401044846
Epoch: 245
Loss on hold-out set: 0.004148468073445225
MeanAbsoluteError value on hold-out data: 0.04802989214658737
Epoch: 246
Loss on hold-out set: 0.004309220660759725
MeanAbsoluteError value on hold-out data: 0.045375749468803406
Epoch: 247
Loss on hold-out set: 0.00345651180893918
MeanAbsoluteError value on hold-out data: 0.04353006184101105
Epoch: 248
Loss on hold-out set: 0.0031472229211909793
MeanAbsoluteError value on hold-out data: 0.04022664204239845
Epoch: 249
Loss on hold-out set: 0.003636686737943245
MeanAbsoluteError value on hold-out data: 0.04286642745137215
Epoch: 250
Loss on hold-out set: 0.0035389723726486984
MeanAbsoluteError value on hold-out data: 0.04211997240781784
Epoch: 251
Loss on hold-out set: 0.0032160138714396836
MeanAbsoluteError value on hold-out data: 0.04135121777653694
Epoch: 252
Loss on hold-out set: 0.004604727295564341
MeanAbsoluteError value on hold-out data: 0.04091024398803711
Epoch: 253
Loss on hold-out set: 0.003840363762145372
MeanAbsoluteError value on hold-out data: 0.0449271984398365
Epoch: 254
Loss on hold-out set: 0.004347529292939917
MeanAbsoluteError value on hold-out data: 0.04892715811729431
Epoch: 255
Loss on hold-out set: 0.0032716908823012523
MeanAbsoluteError value on hold-out data: 0.0412171296775341
Epoch: 256
Loss on hold-out set: 0.003368251623071142
MeanAbsoluteError value on hold-out data: 0.04478522390127182
Returned to Spot: Validation loss: 0.003368251623071142
----------------------------------------------

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.3929388094520331, 'lr_mult': 5.272804901139736, 'batch_size': 8, 'epochs': 4096, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adam', 'sgd_momentum': 0.937542407984169}
Epoch: 1
Loss on hold-out set: 0.034040828456023804
MeanAbsoluteError value on hold-out data: 0.14757423102855682
Epoch: 2
Loss on hold-out set: 0.02532620718212504
MeanAbsoluteError value on hold-out data: 0.12719190120697021
Epoch: 3
Loss on hold-out set: 0.027672918733993645
MeanAbsoluteError value on hold-out data: 0.1340545415878296
Epoch: 4
Loss on hold-out set: 0.02172755506379824
MeanAbsoluteError value on hold-out data: 0.1183537021279335
Epoch: 5
Loss on hold-out set: 0.02154406737291107
MeanAbsoluteError value on hold-out data: 0.11715680360794067
Epoch: 6
Loss on hold-out set: 0.0202783671158709
MeanAbsoluteError value on hold-out data: 0.1130610778927803
Epoch: 7
Loss on hold-out set: 0.017484381390539438
MeanAbsoluteError value on hold-out data: 0.10341900587081909
Epoch: 8
Loss on hold-out set: 0.013483097164058372
MeanAbsoluteError value on hold-out data: 0.09209871292114258
Epoch: 9
Loss on hold-out set: 0.012328391527070812
MeanAbsoluteError value on hold-out data: 0.08753245323896408
Epoch: 10
Loss on hold-out set: 0.012023998020020755
MeanAbsoluteError value on hold-out data: 0.08679451048374176
Epoch: 11
Loss on hold-out set: 0.010926957095139906
MeanAbsoluteError value on hold-out data: 0.08500358462333679
Epoch: 12
Loss on hold-out set: 0.010323749073952632
MeanAbsoluteError value on hold-out data: 0.07940492779016495
Epoch: 13
Loss on hold-out set: 0.009692958948251448
MeanAbsoluteError value on hold-out data: 0.07663903385400772
Epoch: 14
Loss on hold-out set: 0.009499186263909857
MeanAbsoluteError value on hold-out data: 0.07399671524763107
Epoch: 15
Loss on hold-out set: 0.009570186976098308
MeanAbsoluteError value on hold-out data: 0.07600976526737213
Epoch: 16
Loss on hold-out set: 0.010086916877250923
MeanAbsoluteError value on hold-out data: 0.08000947535037994
Epoch: 17
Loss on hold-out set: 0.009137391544706924
MeanAbsoluteError value on hold-out data: 0.07390737533569336
Epoch: 18
Loss on hold-out set: 0.006899723476779304
MeanAbsoluteError value on hold-out data: 0.06340989470481873
Epoch: 19
Loss on hold-out set: 0.00670411324704458
MeanAbsoluteError value on hold-out data: 0.06276065856218338
Epoch: 20
Loss on hold-out set: 0.005859773808256968
MeanAbsoluteError value on hold-out data: 0.056738171726465225
Epoch: 21
Loss on hold-out set: 0.006255618658063835
MeanAbsoluteError value on hold-out data: 0.060399651527404785
Epoch: 22
Loss on hold-out set: 0.006997985146498601
MeanAbsoluteError value on hold-out data: 0.06588435173034668
Epoch: 23
Loss on hold-out set: 0.006521220469087558
MeanAbsoluteError value on hold-out data: 0.06558956205844879
Epoch: 24
Loss on hold-out set: 0.005995919419403531
MeanAbsoluteError value on hold-out data: 0.06077616289258003
Epoch: 25
Loss on hold-out set: 0.007556874733908396
MeanAbsoluteError value on hold-out data: 0.06909697502851486
Epoch: 26
Loss on hold-out set: 0.003906792388175075
MeanAbsoluteError value on hold-out data: 0.04779723286628723
Epoch: 27
Loss on hold-out set: 0.005729370961872567
MeanAbsoluteError value on hold-out data: 0.05952829495072365
Epoch: 28
Loss on hold-out set: 0.005758428917033598
MeanAbsoluteError value on hold-out data: 0.05173487961292267
Epoch: 29
Loss on hold-out set: 0.005116583123852156
MeanAbsoluteError value on hold-out data: 0.057106420397758484
Epoch: 30
Loss on hold-out set: 0.005816484495115124
MeanAbsoluteError value on hold-out data: 0.05960739776492119
Epoch: 31
Loss on hold-out set: 0.005469855353064639
MeanAbsoluteError value on hold-out data: 0.058521199971437454
Epoch: 32
Loss on hold-out set: 0.004661849364454515
MeanAbsoluteError value on hold-out data: 0.049253616482019424
Epoch: 33
Loss on hold-out set: 0.006113673492922987
MeanAbsoluteError value on hold-out data: 0.06261926889419556
Epoch: 34
Loss on hold-out set: 0.00545161168587296
MeanAbsoluteError value on hold-out data: 0.055061567574739456
Epoch: 35
Loss on hold-out set: 0.004509061430948542
MeanAbsoluteError value on hold-out data: 0.0501042865216732
Epoch: 36
Loss on hold-out set: 0.00535155238130277
MeanAbsoluteError value on hold-out data: 0.058076389133930206
Epoch: 37
Loss on hold-out set: 0.005486363339801564
MeanAbsoluteError value on hold-out data: 0.055893104523420334
Epoch: 38
Loss on hold-out set: 0.005807119507440611
MeanAbsoluteError value on hold-out data: 0.05990086868405342
Epoch: 39
Loss on hold-out set: 0.005397161292708724
MeanAbsoluteError value on hold-out data: 0.05626071244478226
Epoch: 40
Loss on hold-out set: 0.004859287507746271
MeanAbsoluteError value on hold-out data: 0.051196884363889694
Epoch: 41
Loss on hold-out set: 0.003966693303051503
MeanAbsoluteError value on hold-out data: 0.04902725666761398
Epoch: 42
Loss on hold-out set: 0.0055874398048648515
MeanAbsoluteError value on hold-out data: 0.054675955325365067
Epoch: 43
Loss on hold-out set: 0.004917406477034092
MeanAbsoluteError value on hold-out data: 0.05102860927581787
Epoch: 44
Loss on hold-out set: 0.004635998296036728
MeanAbsoluteError value on hold-out data: 0.051162492483854294
Epoch: 45
Loss on hold-out set: 0.005305553418829253
MeanAbsoluteError value on hold-out data: 0.055891893804073334
Epoch: 46
Loss on hold-out set: 0.007105556142050773
MeanAbsoluteError value on hold-out data: 0.06619520485401154
Epoch: 47
Loss on hold-out set: 0.004327295233164669
MeanAbsoluteError value on hold-out data: 0.04997670650482178
Epoch: 48
Loss on hold-out set: 0.00536412176198179
MeanAbsoluteError value on hold-out data: 0.05545830354094505
Epoch: 49
Loss on hold-out set: 0.0048666277679761775
MeanAbsoluteError value on hold-out data: 0.0525333434343338
Epoch: 50
Loss on hold-out set: 0.007220182993669847
MeanAbsoluteError value on hold-out data: 0.06468455493450165
Epoch: 51
Loss on hold-out set: 0.006707694082778241
MeanAbsoluteError value on hold-out data: 0.06456253677606583
Epoch: 52
Loss on hold-out set: 0.007492066440662663
MeanAbsoluteError value on hold-out data: 0.070310078561306
Epoch: 53
Loss on hold-out set: 0.004734556382142105
MeanAbsoluteError value on hold-out data: 0.050361067056655884
Epoch: 54
Loss on hold-out set: 0.006967990282359288
MeanAbsoluteError value on hold-out data: 0.061582062393426895
Epoch: 55
Loss on hold-out set: 0.005839689696011574
MeanAbsoluteError value on hold-out data: 0.05717284977436066
Epoch: 56
Loss on hold-out set: 0.016742544175174675
MeanAbsoluteError value on hold-out data: 0.11352837830781937
Epoch: 57
Loss on hold-out set: 0.004405960432976778
MeanAbsoluteError value on hold-out data: 0.048925165086984634
Epoch: 58
Loss on hold-out set: 0.005203933124185393
MeanAbsoluteError value on hold-out data: 0.05645926296710968
Epoch: 59
Loss on hold-out set: 0.0052071717218495905
MeanAbsoluteError value on hold-out data: 0.05674636363983154
Epoch: 60
Loss on hold-out set: 0.008031855367957369
MeanAbsoluteError value on hold-out data: 0.07612665742635727
Epoch: 61
Loss on hold-out set: 0.004604093745767482
MeanAbsoluteError value on hold-out data: 0.04878578707575798
Epoch: 62
Loss on hold-out set: 0.00585869535509693
MeanAbsoluteError value on hold-out data: 0.05462613329291344
Epoch: 63
Loss on hold-out set: 0.006445140724903659
MeanAbsoluteError value on hold-out data: 0.06414636969566345
Epoch: 64
Loss on hold-out set: 0.00516439044823576
MeanAbsoluteError value on hold-out data: 0.05709226429462433
Epoch: 65
Loss on hold-out set: 0.004039166149021567
MeanAbsoluteError value on hold-out data: 0.050543952733278275
Epoch: 66
Loss on hold-out set: 0.004837716269417126
MeanAbsoluteError value on hold-out data: 0.04994127154350281
Epoch: 67
Loss on hold-out set: 0.004731200273932987
MeanAbsoluteError value on hold-out data: 0.052744872868061066
Epoch: 68
Loss on hold-out set: 0.004760532005763564
MeanAbsoluteError value on hold-out data: 0.05270211026072502
Epoch: 69
Loss on hold-out set: 0.005985971325763354
MeanAbsoluteError value on hold-out data: 0.05810408294200897
Epoch: 70
Loss on hold-out set: 0.0052810573680816516
MeanAbsoluteError value on hold-out data: 0.059474602341651917
Epoch: 71
Loss on hold-out set: 0.005102431514962136
MeanAbsoluteError value on hold-out data: 0.05436895415186882
Epoch: 72
Loss on hold-out set: 0.005386454834431214
MeanAbsoluteError value on hold-out data: 0.051827870309352875
Epoch: 73
Loss on hold-out set: 0.005937059982036436
MeanAbsoluteError value on hold-out data: 0.05593584105372429
Epoch: 74
Loss on hold-out set: 0.005916340684052557
MeanAbsoluteError value on hold-out data: 0.058831870555877686
Epoch: 75
Loss on hold-out set: 0.003886549133121183
MeanAbsoluteError value on hold-out data: 0.04698649048805237
Epoch: 76
Loss on hold-out set: 0.0054802584039096375
MeanAbsoluteError value on hold-out data: 0.059539273381233215
Epoch: 77
Loss on hold-out set: 0.0054120838084552245
MeanAbsoluteError value on hold-out data: 0.05460778623819351
Epoch: 78
Loss on hold-out set: 0.003614176806877367
MeanAbsoluteError value on hold-out data: 0.04489920660853386
Epoch: 79
Loss on hold-out set: 0.0041181262702019395
MeanAbsoluteError value on hold-out data: 0.046127524226903915
Epoch: 80
Loss on hold-out set: 0.0041824948673724735
MeanAbsoluteError value on hold-out data: 0.045728422701358795
Epoch: 81
Loss on hold-out set: 0.0050068135606125
MeanAbsoluteError value on hold-out data: 0.052011217921972275
Epoch: 82
Loss on hold-out set: 0.005575318097774135
MeanAbsoluteError value on hold-out data: 0.0556652694940567
Epoch: 83
Loss on hold-out set: 0.0038617893465255435
MeanAbsoluteError value on hold-out data: 0.04625510051846504
Epoch: 84
Loss on hold-out set: 0.004439953912208837
MeanAbsoluteError value on hold-out data: 0.05002656951546669
Epoch: 85
Loss on hold-out set: 0.004013183171321687
MeanAbsoluteError value on hold-out data: 0.049381621181964874
Epoch: 86
Loss on hold-out set: 0.004019556931636639
MeanAbsoluteError value on hold-out data: 0.0476054847240448
Epoch: 87
Loss on hold-out set: 0.0036824648100024972
MeanAbsoluteError value on hold-out data: 0.045606814324855804
Epoch: 88
Loss on hold-out set: 0.004866409461675702
MeanAbsoluteError value on hold-out data: 0.059195518493652344
Epoch: 89
Loss on hold-out set: 0.004291043197123432
MeanAbsoluteError value on hold-out data: 0.04795457050204277
Epoch: 90
Loss on hold-out set: 0.008173513483550204
MeanAbsoluteError value on hold-out data: 0.07144368439912796
Epoch: 91
Loss on hold-out set: 0.005196747327174403
MeanAbsoluteError value on hold-out data: 0.05270043760538101
Epoch: 92
Loss on hold-out set: 0.005383602322054733
MeanAbsoluteError value on hold-out data: 0.056904908269643784
Epoch: 93
Loss on hold-out set: 0.006149276567157358
MeanAbsoluteError value on hold-out data: 0.06094682216644287
Epoch: 94
Loss on hold-out set: 0.0066072749690838945
MeanAbsoluteError value on hold-out data: 0.05895014479756355
Epoch: 95
Loss on hold-out set: 0.005291859505967678
MeanAbsoluteError value on hold-out data: 0.05440962314605713
Epoch: 96
Loss on hold-out set: 0.004557349539888827
MeanAbsoluteError value on hold-out data: 0.05159949138760567
Epoch: 97
Loss on hold-out set: 0.006259349370865445
MeanAbsoluteError value on hold-out data: 0.05689157545566559
Epoch: 98
Loss on hold-out set: 0.003834137761977648
MeanAbsoluteError value on hold-out data: 0.048342131078243256
Epoch: 99
Loss on hold-out set: 0.00492641756059847
MeanAbsoluteError value on hold-out data: 0.05329395830631256
Epoch: 100
Loss on hold-out set: 0.005641095003260202
MeanAbsoluteError value on hold-out data: 0.05916950851678848
Epoch: 101
Loss on hold-out set: 0.004713376720533951
MeanAbsoluteError value on hold-out data: 0.050139255821704865
Epoch: 102
Loss on hold-out set: 0.00390917131076812
MeanAbsoluteError value on hold-out data: 0.04843597859144211
Epoch: 103
Loss on hold-out set: 0.00523912601975577
MeanAbsoluteError value on hold-out data: 0.0544474720954895
Epoch: 104
Loss on hold-out set: 0.004624792129585617
MeanAbsoluteError value on hold-out data: 0.05178721249103546
Epoch: 105
Loss on hold-out set: 0.0036604072926198377
MeanAbsoluteError value on hold-out data: 0.042486127465963364
Epoch: 106
Loss on hold-out set: 0.00483518289892297
MeanAbsoluteError value on hold-out data: 0.05201509967446327
Epoch: 107
Loss on hold-out set: 0.003451144250759267
MeanAbsoluteError value on hold-out data: 0.0448656864464283
Epoch: 108
Loss on hold-out set: 0.0033919549620661294
MeanAbsoluteError value on hold-out data: 0.04272283613681793
Epoch: 109
Loss on hold-out set: 0.005134900855697005
MeanAbsoluteError value on hold-out data: 0.053732629865407944
Epoch: 110
Loss on hold-out set: 0.005803705168593871
MeanAbsoluteError value on hold-out data: 0.061037641018629074
Epoch: 111
Loss on hold-out set: 0.006128034002980904
MeanAbsoluteError value on hold-out data: 0.05876115709543228
Epoch: 112
Loss on hold-out set: 0.00519334252519337
MeanAbsoluteError value on hold-out data: 0.058168988674879074
Epoch: 113
Loss on hold-out set: 0.0035718701746143204
MeanAbsoluteError value on hold-out data: 0.04514152929186821
Epoch: 114
Loss on hold-out set: 0.004277151065731519
MeanAbsoluteError value on hold-out data: 0.04978640750050545
Epoch: 115
Loss on hold-out set: 0.004871823665636934
MeanAbsoluteError value on hold-out data: 0.05244949460029602
Epoch: 116
Loss on hold-out set: 0.004673454015956898
MeanAbsoluteError value on hold-out data: 0.05246228352189064
Epoch: 117
Loss on hold-out set: 0.004276809276473757
MeanAbsoluteError value on hold-out data: 0.04688465595245361
Epoch: 118
Loss on hold-out set: 0.004846517713495383
MeanAbsoluteError value on hold-out data: 0.05046073719859123
Epoch: 119
Loss on hold-out set: 0.004597692928080888
MeanAbsoluteError value on hold-out data: 0.05168386921286583
Epoch: 120
Loss on hold-out set: 0.004188081156156075
MeanAbsoluteError value on hold-out data: 0.04858671501278877
Epoch: 121
Loss on hold-out set: 0.003318344970466569
MeanAbsoluteError value on hold-out data: 0.04048299044370651
Epoch: 122
Loss on hold-out set: 0.005396820813123333
MeanAbsoluteError value on hold-out data: 0.0584186315536499
Epoch: 123
Loss on hold-out set: 0.003972229551628085
MeanAbsoluteError value on hold-out data: 0.044889554381370544
Epoch: 124
Loss on hold-out set: 0.004590969649143517
MeanAbsoluteError value on hold-out data: 0.050042685121297836
Epoch: 125
Loss on hold-out set: 0.004539417867291425
MeanAbsoluteError value on hold-out data: 0.05047927796840668
Epoch: 126
Loss on hold-out set: 0.005848683225370846
MeanAbsoluteError value on hold-out data: 0.05613407865166664
Epoch: 127
Loss on hold-out set: 0.004091743169211489
MeanAbsoluteError value on hold-out data: 0.048207901418209076
Epoch: 128
Loss on hold-out set: 0.0044140841981923015
MeanAbsoluteError value on hold-out data: 0.04564080759882927
Epoch: 129
Loss on hold-out set: 0.006427089328338441
MeanAbsoluteError value on hold-out data: 0.06441438943147659
Epoch: 130
Loss on hold-out set: 0.00698187503669607
MeanAbsoluteError value on hold-out data: 0.06471940875053406
Epoch: 131
Loss on hold-out set: 0.005492301020575197
MeanAbsoluteError value on hold-out data: 0.05510794371366501
Epoch: 132
Loss on hold-out set: 0.0038746638058096564
MeanAbsoluteError value on hold-out data: 0.04429999738931656
Epoch: 133
Loss on hold-out set: 0.004131640019630523
MeanAbsoluteError value on hold-out data: 0.04512907192111015
Epoch: 134
Loss on hold-out set: 0.0041412388565827555
MeanAbsoluteError value on hold-out data: 0.048965126276016235
Epoch: 135
Loss on hold-out set: 0.004622619445925872
MeanAbsoluteError value on hold-out data: 0.05162231624126434
Epoch: 136
Loss on hold-out set: 0.004560669810560189
MeanAbsoluteError value on hold-out data: 0.05391830950975418
Epoch: 137
Loss on hold-out set: 0.004352466154255365
MeanAbsoluteError value on hold-out data: 0.04820531979203224
Epoch: 138
Loss on hold-out set: 0.005006931803348523
MeanAbsoluteError value on hold-out data: 0.052344195544719696
Epoch: 139
Loss on hold-out set: 0.003934434815738841
MeanAbsoluteError value on hold-out data: 0.048122480511665344
Epoch: 140
Loss on hold-out set: 0.004346775453182329
MeanAbsoluteError value on hold-out data: 0.048927634954452515
Epoch: 141
Loss on hold-out set: 0.004336686306296063
MeanAbsoluteError value on hold-out data: 0.046496614813804626
Epoch: 142
Loss on hold-out set: 0.005520285813346211
MeanAbsoluteError value on hold-out data: 0.05667605251073837
Epoch: 143
Loss on hold-out set: 0.0034324318939501323
MeanAbsoluteError value on hold-out data: 0.04302431643009186
Epoch: 144
Loss on hold-out set: 0.003594133718012783
MeanAbsoluteError value on hold-out data: 0.041878990828990936
Epoch: 145
Loss on hold-out set: 0.0037503555833705163
MeanAbsoluteError value on hold-out data: 0.04121771454811096
Epoch: 146
Loss on hold-out set: 0.004654881192101656
MeanAbsoluteError value on hold-out data: 0.04923189803957939
Epoch: 147
Loss on hold-out set: 0.0027064172502018905
MeanAbsoluteError value on hold-out data: 0.037961091846227646
Epoch: 148
Loss on hold-out set: 0.00644219745759313
MeanAbsoluteError value on hold-out data: 0.05994949862360954
Epoch: 149
Loss on hold-out set: 0.003606069327552656
MeanAbsoluteError value on hold-out data: 0.045673076063394547
Epoch: 150
Loss on hold-out set: 0.0031164754289324933
MeanAbsoluteError value on hold-out data: 0.04157225787639618
Epoch: 151
Loss on hold-out set: 0.0036884219520480223
MeanAbsoluteError value on hold-out data: 0.04682060703635216
Epoch: 152
Loss on hold-out set: 0.0038959504270582998
MeanAbsoluteError value on hold-out data: 0.04956987872719765
Epoch: 153
Loss on hold-out set: 0.0037871081501515092
MeanAbsoluteError value on hold-out data: 0.047977857291698456
Epoch: 154
Loss on hold-out set: 0.0037408119165583662
MeanAbsoluteError value on hold-out data: 0.039958011358976364
Epoch: 155
Loss on hold-out set: 0.0038677287995692736
MeanAbsoluteError value on hold-out data: 0.04843544214963913
Epoch: 156
Loss on hold-out set: 0.005713569881137167
MeanAbsoluteError value on hold-out data: 0.053588442504405975
Epoch: 157
Loss on hold-out set: 0.004957786355302424
MeanAbsoluteError value on hold-out data: 0.04752321541309357
Epoch: 158
Loss on hold-out set: 0.004262916108066412
MeanAbsoluteError value on hold-out data: 0.04940159618854523
Epoch: 159
Loss on hold-out set: 0.0035296700662001967
MeanAbsoluteError value on hold-out data: 0.04322722181677818
Epoch: 160
Loss on hold-out set: 0.0032213861536308144
MeanAbsoluteError value on hold-out data: 0.04215766116976738
Epoch: 161
Loss on hold-out set: 0.004402206274742065
MeanAbsoluteError value on hold-out data: 0.048176735639572144
Epoch: 162
Loss on hold-out set: 0.003927237165809952
MeanAbsoluteError value on hold-out data: 0.0441562719643116
Epoch: 163
Loss on hold-out set: 0.004303609272220025
MeanAbsoluteError value on hold-out data: 0.04567158967256546
Epoch: 164
Loss on hold-out set: 0.007082929056578953
MeanAbsoluteError value on hold-out data: 0.06866125017404556
Epoch: 165
Loss on hold-out set: 0.0041053261145287635
MeanAbsoluteError value on hold-out data: 0.04697166755795479
Epoch: 166
Loss on hold-out set: 0.003783865960461921
MeanAbsoluteError value on hold-out data: 0.04822353646159172
Epoch: 167
Loss on hold-out set: 0.004241686161166351
MeanAbsoluteError value on hold-out data: 0.039535705000162125
Epoch: 168
Loss on hold-out set: 0.002897604008658642
MeanAbsoluteError value on hold-out data: 0.039190541952848434
Epoch: 169
Loss on hold-out set: 0.0032128290254867784
MeanAbsoluteError value on hold-out data: 0.039615534245967865
Epoch: 170
Loss on hold-out set: 0.0035579235148983763
MeanAbsoluteError value on hold-out data: 0.044138118624687195
Epoch: 171
Loss on hold-out set: 0.004412466139336557
MeanAbsoluteError value on hold-out data: 0.04446965083479881
Epoch: 172
Loss on hold-out set: 0.004751260010954483
MeanAbsoluteError value on hold-out data: 0.05063823238015175
Epoch: 173
Loss on hold-out set: 0.0039521709764621365
MeanAbsoluteError value on hold-out data: 0.04536944255232811
Epoch: 174
Loss on hold-out set: 0.0039284936057428195
MeanAbsoluteError value on hold-out data: 0.047884609550237656
Epoch: 175
Loss on hold-out set: 0.0029815303913844553
MeanAbsoluteError value on hold-out data: 0.039284370839595795
Epoch: 176
Loss on hold-out set: 0.003997374269314797
MeanAbsoluteError value on hold-out data: 0.044770248234272
Epoch: 177
Loss on hold-out set: 0.0028286313846413243
MeanAbsoluteError value on hold-out data: 0.0388730987906456
Epoch: 178
Loss on hold-out set: 0.004700290884724573
MeanAbsoluteError value on hold-out data: 0.048045285046100616
Epoch: 179
Loss on hold-out set: 0.0047020615663649025
MeanAbsoluteError value on hold-out data: 0.04931434616446495
Epoch: 180
Loss on hold-out set: 0.005353756478718041
MeanAbsoluteError value on hold-out data: 0.05510467663407326
Epoch: 181
Loss on hold-out set: 0.00418386483368905
MeanAbsoluteError value on hold-out data: 0.04447966068983078
Epoch: 182
Loss on hold-out set: 0.004972278587765207
MeanAbsoluteError value on hold-out data: 0.054018594324588776
Epoch: 183
Loss on hold-out set: 0.0043145970236142415
MeanAbsoluteError value on hold-out data: 0.04940815269947052
Epoch: 184
Loss on hold-out set: 0.0031553891067711733
MeanAbsoluteError value on hold-out data: 0.04441312700510025
Epoch: 185
Loss on hold-out set: 0.003339664089971369
MeanAbsoluteError value on hold-out data: 0.04074613004922867
Epoch: 186
Loss on hold-out set: 0.004679809336697585
MeanAbsoluteError value on hold-out data: 0.04941457509994507
Epoch: 187
Loss on hold-out set: 0.004732472555540306
MeanAbsoluteError value on hold-out data: 0.05255848541855812
Epoch: 188
Loss on hold-out set: 0.0048604851533462735
MeanAbsoluteError value on hold-out data: 0.05063742771744728
Epoch: 189
Loss on hold-out set: 0.003343317026615535
MeanAbsoluteError value on hold-out data: 0.04374553635716438
Epoch: 190
Loss on hold-out set: 0.00345837125113528
MeanAbsoluteError value on hold-out data: 0.04345529526472092
Epoch: 191
Loss on hold-out set: 0.0066736646633791296
MeanAbsoluteError value on hold-out data: 0.06671621650457382
Epoch: 192
Loss on hold-out set: 0.003875662857593086
MeanAbsoluteError value on hold-out data: 0.04490458965301514
Epoch: 193
Loss on hold-out set: 0.004074728913684866
MeanAbsoluteError value on hold-out data: 0.045200150460004807
Epoch: 194
Loss on hold-out set: 0.002891789944107203
MeanAbsoluteError value on hold-out data: 0.04177257418632507
Epoch: 195
Loss on hold-out set: 0.003249969967567411
MeanAbsoluteError value on hold-out data: 0.04067190736532211
Epoch: 196
Loss on hold-out set: 0.004661553897772376
MeanAbsoluteError value on hold-out data: 0.04929041117429733
Epoch: 197
Loss on hold-out set: 0.0036229895455395116
MeanAbsoluteError value on hold-out data: 0.04569051414728165
Epoch: 198
Loss on hold-out set: 0.00439676242393417
MeanAbsoluteError value on hold-out data: 0.045126497745513916
Epoch: 199
Loss on hold-out set: 0.0033434469767503047
MeanAbsoluteError value on hold-out data: 0.042230986058712006
Epoch: 200
Loss on hold-out set: 0.003906614686313428
MeanAbsoluteError value on hold-out data: 0.04591729864478111
Epoch: 201
Loss on hold-out set: 0.0044463396204120825
MeanAbsoluteError value on hold-out data: 0.050672151148319244
Epoch: 202
Loss on hold-out set: 0.003728281250100975
MeanAbsoluteError value on hold-out data: 0.04652899131178856
Epoch: 203
Loss on hold-out set: 0.004614346714285938
MeanAbsoluteError value on hold-out data: 0.049620356410741806
Epoch: 204
Loss on hold-out set: 0.0034541198799974823
MeanAbsoluteError value on hold-out data: 0.04467877373099327
Epoch: 205
Loss on hold-out set: 0.006209311577932615
MeanAbsoluteError value on hold-out data: 0.059300415217876434
Epoch: 206
Loss on hold-out set: 0.0038122607189794316
MeanAbsoluteError value on hold-out data: 0.04067821428179741
Epoch: 207
Loss on hold-out set: 0.006171284261845837
MeanAbsoluteError value on hold-out data: 0.05618562176823616
Epoch: 208
Loss on hold-out set: 0.003561963146478918
MeanAbsoluteError value on hold-out data: 0.042276497930288315
Epoch: 209
Loss on hold-out set: 0.0038399688583970267
MeanAbsoluteError value on hold-out data: 0.045934177935123444
Epoch: 210
Loss on hold-out set: 0.005346070898476204
MeanAbsoluteError value on hold-out data: 0.05655762925744057
Epoch: 211
Loss on hold-out set: 0.004679903093921511
MeanAbsoluteError value on hold-out data: 0.050636082887649536
Epoch: 212
Loss on hold-out set: 0.0044671253723974685
MeanAbsoluteError value on hold-out data: 0.04928886890411377
Epoch: 213
Loss on hold-out set: 0.006268284792129539
MeanAbsoluteError value on hold-out data: 0.06274095922708511
Epoch: 214
Loss on hold-out set: 0.003017566080272541
MeanAbsoluteError value on hold-out data: 0.03823705017566681
Epoch: 215
Loss on hold-out set: 0.004023374451973818
MeanAbsoluteError value on hold-out data: 0.04935360327363014
Epoch: 216
Loss on hold-out set: 0.0035301531530230455
MeanAbsoluteError value on hold-out data: 0.045044053345918655
Epoch: 217
Loss on hold-out set: 0.00462559443947516
MeanAbsoluteError value on hold-out data: 0.04971111938357353
Epoch: 218
Loss on hold-out set: 0.0032264196381315982
MeanAbsoluteError value on hold-out data: 0.039921753108501434
Epoch: 219
Loss on hold-out set: 0.004129542415428564
MeanAbsoluteError value on hold-out data: 0.04280273616313934
Epoch: 220
Loss on hold-out set: 0.004032681536811747
MeanAbsoluteError value on hold-out data: 0.0472063310444355
Epoch: 221
Loss on hold-out set: 0.005380049805113997
MeanAbsoluteError value on hold-out data: 0.05164261534810066
Epoch: 222
Loss on hold-out set: 0.004246145241746777
MeanAbsoluteError value on hold-out data: 0.046155139803886414
Epoch: 223
Loss on hold-out set: 0.004207805445491287
MeanAbsoluteError value on hold-out data: 0.045897796750068665
Epoch: 224
Loss on hold-out set: 0.005206289644487889
MeanAbsoluteError value on hold-out data: 0.04892636463046074
Epoch: 225
Loss on hold-out set: 0.003563295094002234
MeanAbsoluteError value on hold-out data: 0.04190407320857048
Epoch: 226
Loss on hold-out set: 0.005052575460132702
MeanAbsoluteError value on hold-out data: 0.05302921310067177
Epoch: 227
Loss on hold-out set: 0.003704819486684803
MeanAbsoluteError value on hold-out data: 0.041772231459617615
Epoch: 228
Loss on hold-out set: 0.003587962168048283
MeanAbsoluteError value on hold-out data: 0.04278090223670006
Epoch: 229
Loss on hold-out set: 0.0047716555050819325
MeanAbsoluteError value on hold-out data: 0.048386476933956146
Epoch: 230
Loss on hold-out set: 0.004384199384826627
MeanAbsoluteError value on hold-out data: 0.044435590505599976
Epoch: 231
Loss on hold-out set: 0.004677662299639594
MeanAbsoluteError value on hold-out data: 0.05108426883816719
Epoch: 232
Loss on hold-out set: 0.0036431939990602827
MeanAbsoluteError value on hold-out data: 0.04093069210648537
Epoch: 233
Loss on hold-out set: 0.003437203690593474
MeanAbsoluteError value on hold-out data: 0.04335152357816696
Epoch: 234
Loss on hold-out set: 0.0036630460051942223
MeanAbsoluteError value on hold-out data: 0.04344123974442482
Epoch: 235
Loss on hold-out set: 0.003708180174917767
MeanAbsoluteError value on hold-out data: 0.04435721039772034
Epoch: 236
Loss on hold-out set: 0.003868858270978212
MeanAbsoluteError value on hold-out data: 0.044246695935726166
Epoch: 237
Loss on hold-out set: 0.0036437900209995476
MeanAbsoluteError value on hold-out data: 0.041987884789705276
Epoch: 238
Loss on hold-out set: 0.00588216039805526
MeanAbsoluteError value on hold-out data: 0.058823999017477036
Epoch: 239
Loss on hold-out set: 0.00487047747102272
MeanAbsoluteError value on hold-out data: 0.047933828085660934
Epoch: 240
Loss on hold-out set: 0.003897588995689722
MeanAbsoluteError value on hold-out data: 0.0473642498254776
Epoch: 241
Loss on hold-out set: 0.004698812967705491
MeanAbsoluteError value on hold-out data: 0.052283503115177155
Epoch: 242
Loss on hold-out set: 0.005973014079867617
MeanAbsoluteError value on hold-out data: 0.055347368121147156
Epoch: 243
Loss on hold-out set: 0.004486029888013084
MeanAbsoluteError value on hold-out data: 0.05171390622854233
Epoch: 244
Loss on hold-out set: 0.0041421560147826214
MeanAbsoluteError value on hold-out data: 0.04564947634935379
Epoch: 245
Loss on hold-out set: 0.006578552818514015
MeanAbsoluteError value on hold-out data: 0.06658533215522766
Epoch: 246
Loss on hold-out set: 0.003976547180699478
MeanAbsoluteError value on hold-out data: 0.04443370923399925
Epoch: 247
Loss on hold-out set: 0.003386004232053988
MeanAbsoluteError value on hold-out data: 0.041615087538957596
Epoch: 248
Loss on hold-out set: 0.003432725373912897
MeanAbsoluteError value on hold-out data: 0.040015678852796555
Epoch: 249
Loss on hold-out set: 0.0034690658557290015
MeanAbsoluteError value on hold-out data: 0.04036368429660797
Epoch: 250
Loss on hold-out set: 0.003980538455499827
MeanAbsoluteError value on hold-out data: 0.04640873894095421
Epoch: 251
Loss on hold-out set: 0.0042960991390588645
MeanAbsoluteError value on hold-out data: 0.04795510321855545
Epoch: 252
Loss on hold-out set: 0.0035465643212726143
MeanAbsoluteError value on hold-out data: 0.042643751949071884
Epoch: 253
Loss on hold-out set: 0.003841089740346529
MeanAbsoluteError value on hold-out data: 0.047048795968294144
Epoch: 254
Loss on hold-out set: 0.0026811910011977154
MeanAbsoluteError value on hold-out data: 0.03718085587024689
Epoch: 255
Loss on hold-out set: 0.003593377048290629
MeanAbsoluteError value on hold-out data: 0.042193640023469925
Epoch: 256
Loss on hold-out set: 0.0058650822856610545
MeanAbsoluteError value on hold-out data: 0.05935606732964516
Epoch: 257
Loss on hold-out set: 0.0034147067241352296
MeanAbsoluteError value on hold-out data: 0.04032771661877632
Epoch: 258
Loss on hold-out set: 0.0034700777185590645
MeanAbsoluteError value on hold-out data: 0.043793365359306335
Epoch: 259
Loss on hold-out set: 0.003998893699118574
MeanAbsoluteError value on hold-out data: 0.04831216111779213
Epoch: 260
Loss on hold-out set: 0.006515991129593826
MeanAbsoluteError value on hold-out data: 0.06462495028972626
Epoch: 261
Loss on hold-out set: 0.005695944232253456
MeanAbsoluteError value on hold-out data: 0.057035673409700394
Epoch: 262
Loss on hold-out set: 0.0047412586940673036
MeanAbsoluteError value on hold-out data: 0.04873933643102646
Epoch: 263
Loss on hold-out set: 0.0037849684993393326
MeanAbsoluteError value on hold-out data: 0.04443878307938576
Epoch: 264
Loss on hold-out set: 0.0034894749543654094
MeanAbsoluteError value on hold-out data: 0.040950387716293335
Epoch: 265
Loss on hold-out set: 0.0037367491658139777
MeanAbsoluteError value on hold-out data: 0.04335464537143707
Epoch: 266
Loss on hold-out set: 0.004734525705173023
MeanAbsoluteError value on hold-out data: 0.052549783140420914
Epoch: 267
Loss on hold-out set: 0.004221182658128734
MeanAbsoluteError value on hold-out data: 0.04559531435370445
Epoch: 268
Loss on hold-out set: 0.002755478147025171
MeanAbsoluteError value on hold-out data: 0.03826390579342842
Epoch: 269
Loss on hold-out set: 0.0030512308976061546
MeanAbsoluteError value on hold-out data: 0.03899573162198067
Epoch: 270
Loss on hold-out set: 0.00472910846522274
MeanAbsoluteError value on hold-out data: 0.05221331864595413
Epoch: 271
Loss on hold-out set: 0.003738492860544571
MeanAbsoluteError value on hold-out data: 0.04522217810153961
Epoch: 272
Loss on hold-out set: 0.003861755572296189
MeanAbsoluteError value on hold-out data: 0.04362402483820915
Epoch: 273
Loss on hold-out set: 0.004301321087711442
MeanAbsoluteError value on hold-out data: 0.04402918368577957
Epoch: 274
Loss on hold-out set: 0.0051474131208746445
MeanAbsoluteError value on hold-out data: 0.05480555072426796
Epoch: 275
Loss on hold-out set: 0.003356208347739946
MeanAbsoluteError value on hold-out data: 0.04255089536309242
Epoch: 276
Loss on hold-out set: 0.0033318063444886846
MeanAbsoluteError value on hold-out data: 0.04241281747817993
Epoch: 277
Loss on hold-out set: 0.003844761547761185
MeanAbsoluteError value on hold-out data: 0.04201759397983551
Epoch: 278
Loss on hold-out set: 0.005405100018067874
MeanAbsoluteError value on hold-out data: 0.05130346491932869
Epoch: 279
Loss on hold-out set: 0.004881631412947746
MeanAbsoluteError value on hold-out data: 0.05259595811367035
Epoch: 280
Loss on hold-out set: 0.005124181530462872
MeanAbsoluteError value on hold-out data: 0.05761220306158066
Epoch: 281
Loss on hold-out set: 0.004206173671072496
MeanAbsoluteError value on hold-out data: 0.046876661479473114
Epoch: 282
Loss on hold-out set: 0.003300902773748691
MeanAbsoluteError value on hold-out data: 0.03922385722398758
Epoch: 283
Loss on hold-out set: 0.003718932937389534
MeanAbsoluteError value on hold-out data: 0.04172944277524948
Epoch: 284
Loss on hold-out set: 0.005613663500346439
MeanAbsoluteError value on hold-out data: 0.05715513974428177
Epoch: 285
Loss on hold-out set: 0.006950135290696237
MeanAbsoluteError value on hold-out data: 0.061615943908691406
Epoch: 286
Loss on hold-out set: 0.0033961673945764473
MeanAbsoluteError value on hold-out data: 0.04342106357216835
Epoch: 287
Loss on hold-out set: 0.004011343420164562
MeanAbsoluteError value on hold-out data: 0.045315902680158615
Epoch: 288
Loss on hold-out set: 0.0038749624532341074
MeanAbsoluteError value on hold-out data: 0.04253797233104706
Epoch: 289
Loss on hold-out set: 0.003430735159015871
MeanAbsoluteError value on hold-out data: 0.04546288028359413
Epoch: 290
Loss on hold-out set: 0.005187150758789166
MeanAbsoluteError value on hold-out data: 0.05065486207604408
Epoch: 291
Loss on hold-out set: 0.006639391860900153
MeanAbsoluteError value on hold-out data: 0.061462365090847015
Epoch: 292
Loss on hold-out set: 0.004113495696066438
MeanAbsoluteError value on hold-out data: 0.045296695083379745
Epoch: 293
Loss on hold-out set: 0.0036481620030061
MeanAbsoluteError value on hold-out data: 0.04405445232987404
Epoch: 294
Loss on hold-out set: 0.0036178394971341874
MeanAbsoluteError value on hold-out data: 0.0445004478096962
Epoch: 295
Loss on hold-out set: 0.0033592415795857576
MeanAbsoluteError value on hold-out data: 0.04010755196213722
Epoch: 296
Loss on hold-out set: 0.005327103517055021
MeanAbsoluteError value on hold-out data: 0.05033450946211815
Epoch: 297
Loss on hold-out set: 0.003895681541364052
MeanAbsoluteError value on hold-out data: 0.04611100256443024
Epoch: 298
Loss on hold-out set: 0.00526467232817882
MeanAbsoluteError value on hold-out data: 0.056213200092315674
Epoch: 299
Loss on hold-out set: 0.003888036213251517
MeanAbsoluteError value on hold-out data: 0.04334500804543495
Epoch: 300
Loss on hold-out set: 0.004081874071791964
MeanAbsoluteError value on hold-out data: 0.04437809810042381
Epoch: 301
Loss on hold-out set: 0.005214062513244387
MeanAbsoluteError value on hold-out data: 0.04857412353157997
Epoch: 302
Loss on hold-out set: 0.003732083179975713
MeanAbsoluteError value on hold-out data: 0.04646596685051918
Epoch: 303
Loss on hold-out set: 0.0026217802737128772
MeanAbsoluteError value on hold-out data: 0.036823783069849014
Epoch: 304
Loss on hold-out set: 0.004051333141672474
MeanAbsoluteError value on hold-out data: 0.049128901213407516
Epoch: 305
Loss on hold-out set: 0.0040169375654506055
MeanAbsoluteError value on hold-out data: 0.04866471141576767
Epoch: 306
Loss on hold-out set: 0.003440630267600921
MeanAbsoluteError value on hold-out data: 0.04035314545035362
Epoch: 307
Loss on hold-out set: 0.004122288654080445
MeanAbsoluteError value on hold-out data: 0.0467648059129715
Epoch: 308
Loss on hold-out set: 0.0030991866116987935
MeanAbsoluteError value on hold-out data: 0.03762365132570267
Epoch: 309
Loss on hold-out set: 0.003950188386768691
MeanAbsoluteError value on hold-out data: 0.04950582981109619
Epoch: 310
Loss on hold-out set: 0.0034814475086597284
MeanAbsoluteError value on hold-out data: 0.04213317483663559
Epoch: 311
Loss on hold-out set: 0.003917240764406559
MeanAbsoluteError value on hold-out data: 0.04675609618425369
Epoch: 312
Loss on hold-out set: 0.0034493713786727504
MeanAbsoluteError value on hold-out data: 0.03900933265686035
Epoch: 313
Loss on hold-out set: 0.003132644443356089
MeanAbsoluteError value on hold-out data: 0.04067017138004303
Epoch: 314
Loss on hold-out set: 0.003105347320486448
MeanAbsoluteError value on hold-out data: 0.038105204701423645
Epoch: 315
Loss on hold-out set: 0.0038910095601367126
MeanAbsoluteError value on hold-out data: 0.04526979476213455
Epoch: 316
Loss on hold-out set: 0.003411123285523469
MeanAbsoluteError value on hold-out data: 0.04427024722099304
Epoch: 317
Loss on hold-out set: 0.0033061798316530735
MeanAbsoluteError value on hold-out data: 0.041605811566114426
Epoch: 318
Loss on hold-out set: 0.0028085498465531458
MeanAbsoluteError value on hold-out data: 0.03941306099295616
Epoch: 319
Loss on hold-out set: 0.00471792448354934
MeanAbsoluteError value on hold-out data: 0.04766708239912987
Epoch: 320
Loss on hold-out set: 0.0032651170438743734
MeanAbsoluteError value on hold-out data: 0.04244236275553703
Epoch: 321
Loss on hold-out set: 0.006229980750695655
MeanAbsoluteError value on hold-out data: 0.06649015098810196
Epoch: 322
Loss on hold-out set: 0.0033117379199737976
MeanAbsoluteError value on hold-out data: 0.04167573153972626
Epoch: 323
Loss on hold-out set: 0.0032702038986730927
MeanAbsoluteError value on hold-out data: 0.04085982218384743
Epoch: 324
Loss on hold-out set: 0.00601998628362229
MeanAbsoluteError value on hold-out data: 0.059578798711299896
Epoch: 325
Loss on hold-out set: 0.004846972300009311
MeanAbsoluteError value on hold-out data: 0.05224664509296417
Epoch: 326
Loss on hold-out set: 0.0037880160678852057
MeanAbsoluteError value on hold-out data: 0.047848280519247055
Epoch: 327
Loss on hold-out set: 0.004253286883651622
MeanAbsoluteError value on hold-out data: 0.046441417187452316
Epoch: 328
Loss on hold-out set: 0.00410367315481907
MeanAbsoluteError value on hold-out data: 0.045898471027612686
Epoch: 329
Loss on hold-out set: 0.0029329368461683196
MeanAbsoluteError value on hold-out data: 0.04101893678307533
Epoch: 330
Loss on hold-out set: 0.0030834414731208725
MeanAbsoluteError value on hold-out data: 0.039227746427059174
Epoch: 331
Loss on hold-out set: 0.003646944629604389
MeanAbsoluteError value on hold-out data: 0.04370025545358658
Epoch: 332
Loss on hold-out set: 0.004417627048065984
MeanAbsoluteError value on hold-out data: 0.05170157551765442
Epoch: 333
Loss on hold-out set: 0.003911616876537569
MeanAbsoluteError value on hold-out data: 0.050784043967723846
Epoch: 334
Loss on hold-out set: 0.004206687908950507
MeanAbsoluteError value on hold-out data: 0.047452498227357864
Epoch: 335
Loss on hold-out set: 0.0032365315618287575
MeanAbsoluteError value on hold-out data: 0.04264941066503525
Epoch: 336
Loss on hold-out set: 0.0037229803136525383
MeanAbsoluteError value on hold-out data: 0.043100662529468536
Epoch: 337
Loss on hold-out set: 0.0036128703252057007
MeanAbsoluteError value on hold-out data: 0.04015674442052841
Epoch: 338
Loss on hold-out set: 0.004382348357466981
MeanAbsoluteError value on hold-out data: 0.04348261281847954
Epoch: 339
Loss on hold-out set: 0.0036987209245317467
MeanAbsoluteError value on hold-out data: 0.04302207753062248
Epoch: 340
Loss on hold-out set: 0.004147065858552723
MeanAbsoluteError value on hold-out data: 0.050789084285497665
Epoch: 341
Loss on hold-out set: 0.004256010256205245
MeanAbsoluteError value on hold-out data: 0.04750993475317955
Epoch: 342
Loss on hold-out set: 0.004298255530700676
MeanAbsoluteError value on hold-out data: 0.0455324724316597
Epoch: 343
Loss on hold-out set: 0.0029084448079198695
MeanAbsoluteError value on hold-out data: 0.038512591272592545
Epoch: 344
Loss on hold-out set: 0.004024069201381951
MeanAbsoluteError value on hold-out data: 0.04395009204745293
Epoch: 345
Loss on hold-out set: 0.0032611971278368544
MeanAbsoluteError value on hold-out data: 0.041420917958021164
Epoch: 346
Loss on hold-out set: 0.005135368168243747
MeanAbsoluteError value on hold-out data: 0.05346045643091202
Epoch: 347
Loss on hold-out set: 0.0034756725539122463
MeanAbsoluteError value on hold-out data: 0.043180644512176514
Epoch: 348
Loss on hold-out set: 0.0034661958580775383
MeanAbsoluteError value on hold-out data: 0.04034878686070442
Epoch: 349
Loss on hold-out set: 0.0031959376394393316
MeanAbsoluteError value on hold-out data: 0.04109293222427368
Epoch: 350
Loss on hold-out set: 0.004376737670482774
MeanAbsoluteError value on hold-out data: 0.0489698089659214
Epoch: 351
Loss on hold-out set: 0.004808007770119921
MeanAbsoluteError value on hold-out data: 0.04849804937839508
Epoch: 352
Loss on hold-out set: 0.00376612781148747
MeanAbsoluteError value on hold-out data: 0.04474994167685509
Epoch: 353
Loss on hold-out set: 0.004643984125179581
MeanAbsoluteError value on hold-out data: 0.04503946378827095
Epoch: 354
Loss on hold-out set: 0.00399793660893154
MeanAbsoluteError value on hold-out data: 0.04418390989303589
Epoch: 355
Loss on hold-out set: 0.00348878200594826
MeanAbsoluteError value on hold-out data: 0.04162236675620079
Epoch: 356
Loss on hold-out set: 0.003984429459945348
MeanAbsoluteError value on hold-out data: 0.044402364641427994
Epoch: 357
Loss on hold-out set: 0.004372601542854682
MeanAbsoluteError value on hold-out data: 0.049395397305488586
Epoch: 358
Loss on hold-out set: 0.007089567248170313
MeanAbsoluteError value on hold-out data: 0.06212395429611206
Epoch: 359
Loss on hold-out set: 0.004745852873096929
MeanAbsoluteError value on hold-out data: 0.053900159895420074
Epoch: 360
Loss on hold-out set: 0.006870247723111932
MeanAbsoluteError value on hold-out data: 0.061107393354177475
Epoch: 361
Loss on hold-out set: 0.004027127193311523
MeanAbsoluteError value on hold-out data: 0.043461695313453674
Epoch: 362
Loss on hold-out set: 0.003754093308663486
MeanAbsoluteError value on hold-out data: 0.04701240360736847
Epoch: 363
Loss on hold-out set: 0.0035773991594875328
MeanAbsoluteError value on hold-out data: 0.041148021817207336
Epoch: 364
Loss on hold-out set: 0.00394020874763986
MeanAbsoluteError value on hold-out data: 0.04572713375091553
Epoch: 365
Loss on hold-out set: 0.003489406496029053
MeanAbsoluteError value on hold-out data: 0.042910411953926086
Epoch: 366
Loss on hold-out set: 0.004277928557712585
MeanAbsoluteError value on hold-out data: 0.046781912446022034
Epoch: 367
Loss on hold-out set: 0.003551891021504018
MeanAbsoluteError value on hold-out data: 0.04247917979955673
Epoch: 368
Loss on hold-out set: 0.003607397987874911
MeanAbsoluteError value on hold-out data: 0.03952007368206978
Epoch: 369
Loss on hold-out set: 0.003760523710776684
MeanAbsoluteError value on hold-out data: 0.04396238178014755
Epoch: 370
Loss on hold-out set: 0.004511388364909707
MeanAbsoluteError value on hold-out data: 0.049161870032548904
Epoch: 371
Loss on hold-out set: 0.004721494258295647
MeanAbsoluteError value on hold-out data: 0.04609275981783867
Epoch: 372
Loss on hold-out set: 0.005489838729293919
MeanAbsoluteError value on hold-out data: 0.057918693870306015
Epoch: 373
Loss on hold-out set: 0.003747305881820227
MeanAbsoluteError value on hold-out data: 0.04788323864340782
Epoch: 374
Loss on hold-out set: 0.003333100387336392
MeanAbsoluteError value on hold-out data: 0.04079749807715416
Epoch: 375
Loss on hold-out set: 0.003992434241808951
MeanAbsoluteError value on hold-out data: 0.04869787395000458
Epoch: 376
Loss on hold-out set: 0.003239238377366411
MeanAbsoluteError value on hold-out data: 0.040742404758930206
Epoch: 377
Loss on hold-out set: 0.003660452947339141
MeanAbsoluteError value on hold-out data: 0.045963406562805176
Epoch: 378
Loss on hold-out set: 0.00280681889240728
MeanAbsoluteError value on hold-out data: 0.03952661156654358
Epoch: 379
Loss on hold-out set: 0.005010654990512289
MeanAbsoluteError value on hold-out data: 0.052138086408376694
Epoch: 380
Loss on hold-out set: 0.003210095265929244
MeanAbsoluteError value on hold-out data: 0.04239089414477348
Epoch: 381
Loss on hold-out set: 0.005598555245485745
MeanAbsoluteError value on hold-out data: 0.055774420499801636
Epoch: 382
Loss on hold-out set: 0.004464833047486057
MeanAbsoluteError value on hold-out data: 0.045830242335796356
Epoch: 383
Loss on hold-out set: 0.003988542578697793
MeanAbsoluteError value on hold-out data: 0.04416167363524437
Epoch: 384
Loss on hold-out set: 0.002881923542238502
MeanAbsoluteError value on hold-out data: 0.03760777786374092
Epoch: 385
Loss on hold-out set: 0.0042318650858329705
MeanAbsoluteError value on hold-out data: 0.050696633756160736
Epoch: 386
Loss on hold-out set: 0.0038177063910744004
MeanAbsoluteError value on hold-out data: 0.04226723685860634
Epoch: 387
Loss on hold-out set: 0.0032333649310442667
MeanAbsoluteError value on hold-out data: 0.0426122285425663
Epoch: 388
Loss on hold-out set: 0.006023278752476663
MeanAbsoluteError value on hold-out data: 0.05129348114132881
Epoch: 389
Loss on hold-out set: 0.0046529725965994756
MeanAbsoluteError value on hold-out data: 0.04697858914732933
Epoch: 390
Loss on hold-out set: 0.00460825858662199
MeanAbsoluteError value on hold-out data: 0.055609263479709625
Epoch: 391
Loss on hold-out set: 0.003514452871106761
MeanAbsoluteError value on hold-out data: 0.041903793811798096
Epoch: 392
Loss on hold-out set: 0.004668387026820136
MeanAbsoluteError value on hold-out data: 0.04887250065803528
Epoch: 393
Loss on hold-out set: 0.002926087640317794
MeanAbsoluteError value on hold-out data: 0.039156969636678696
Epoch: 394
Loss on hold-out set: 0.005035150598575312
MeanAbsoluteError value on hold-out data: 0.053417351096868515
Epoch: 395
Loss on hold-out set: 0.0035433865268714726
MeanAbsoluteError value on hold-out data: 0.04327113553881645
Epoch: 396
Loss on hold-out set: 0.0038526415408245826
MeanAbsoluteError value on hold-out data: 0.04544553905725479
Epoch: 397
Loss on hold-out set: 0.003321644931642559
MeanAbsoluteError value on hold-out data: 0.0404517687857151
Epoch: 398
Loss on hold-out set: 0.003102972077230286
MeanAbsoluteError value on hold-out data: 0.040747225284576416
Epoch: 399
Loss on hold-out set: 0.0034914331152226382
MeanAbsoluteError value on hold-out data: 0.04230830445885658
Epoch: 400
Loss on hold-out set: 0.004403775027879563
MeanAbsoluteError value on hold-out data: 0.04837372899055481
Epoch: 401
Loss on hold-out set: 0.004511287132596695
MeanAbsoluteError value on hold-out data: 0.04878121614456177
Epoch: 402
Loss on hold-out set: 0.005198746211949344
MeanAbsoluteError value on hold-out data: 0.05131230503320694
Epoch: 403
Loss on hold-out set: 0.004434504671831076
MeanAbsoluteError value on hold-out data: 0.05021558329463005
Epoch: 404
Loss on hold-out set: 0.0030124978381392887
MeanAbsoluteError value on hold-out data: 0.04212661460042
Epoch: 405
Loss on hold-out set: 0.003674986851891797
MeanAbsoluteError value on hold-out data: 0.04322468489408493
Epoch: 406
Loss on hold-out set: 0.004536159246191873
MeanAbsoluteError value on hold-out data: 0.04750412702560425
Epoch: 407
Loss on hold-out set: 0.003834223193974283
MeanAbsoluteError value on hold-out data: 0.0469743050634861
Epoch: 408
Loss on hold-out set: 0.0030864370423124023
MeanAbsoluteError value on hold-out data: 0.040635522454977036
Epoch: 409
Loss on hold-out set: 0.004777974011008873
MeanAbsoluteError value on hold-out data: 0.0492190346121788
Epoch: 410
Loss on hold-out set: 0.003552055084391644
MeanAbsoluteError value on hold-out data: 0.04136216640472412
Epoch: 411
Loss on hold-out set: 0.005208865672006811
MeanAbsoluteError value on hold-out data: 0.05323856323957443
Epoch: 412
Loss on hold-out set: 0.0035002678548488276
MeanAbsoluteError value on hold-out data: 0.039528075605630875
Epoch: 413
Loss on hold-out set: 0.0035945970015937314
MeanAbsoluteError value on hold-out data: 0.0404568612575531
Epoch: 414
Loss on hold-out set: 0.004477621907809455
MeanAbsoluteError value on hold-out data: 0.04626547545194626
Epoch: 415
Loss on hold-out set: 0.003941708077419255
MeanAbsoluteError value on hold-out data: 0.043205562978982925
Epoch: 416
Loss on hold-out set: 0.003753963511706771
MeanAbsoluteError value on hold-out data: 0.045417968183755875
Epoch: 417
Loss on hold-out set: 0.003920420331843688
MeanAbsoluteError value on hold-out data: 0.0462590791285038
Epoch: 418
Loss on hold-out set: 0.0030796109165653193
MeanAbsoluteError value on hold-out data: 0.040011052042245865
Epoch: 419
Loss on hold-out set: 0.003010245674982128
MeanAbsoluteError value on hold-out data: 0.03985120356082916
Epoch: 420
Loss on hold-out set: 0.0028056264334162207
MeanAbsoluteError value on hold-out data: 0.03744121268391609
Epoch: 421
Loss on hold-out set: 0.0036271110385362256
MeanAbsoluteError value on hold-out data: 0.043546225875616074
Epoch: 422
Loss on hold-out set: 0.0031321605002679128
MeanAbsoluteError value on hold-out data: 0.037449631839990616
Epoch: 423
Loss on hold-out set: 0.004529013614764584
MeanAbsoluteError value on hold-out data: 0.047864895313978195
Epoch: 424
Loss on hold-out set: 0.004076658899736542
MeanAbsoluteError value on hold-out data: 0.04255806654691696
Epoch: 425
Loss on hold-out set: 0.0030642416455329544
MeanAbsoluteError value on hold-out data: 0.041767023503780365
Epoch: 426
Loss on hold-out set: 0.003974916291649845
MeanAbsoluteError value on hold-out data: 0.04414362832903862
Epoch: 427
Loss on hold-out set: 0.003742940192368176
MeanAbsoluteError value on hold-out data: 0.04110456630587578
Epoch: 428
Loss on hold-out set: 0.003917250590778789
MeanAbsoluteError value on hold-out data: 0.04116922616958618
Epoch: 429
Loss on hold-out set: 0.003919255049703152
MeanAbsoluteError value on hold-out data: 0.04934512451291084
Epoch: 430
Loss on hold-out set: 0.003131396127987261
MeanAbsoluteError value on hold-out data: 0.03734467923641205
Epoch: 431
Loss on hold-out set: 0.006085113518087095
MeanAbsoluteError value on hold-out data: 0.06109454482793808
Early stopping at epoch 430
Returned to Spot: Validation loss: 0.006085113518087095
----------------------------------------------
spotPython tuning: 0.003368251623071142 [#---------] 14.33% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.6037059450531679, 'lr_mult': 3.534270177215719, 'batch_size': 4, 'epochs': 64, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.872198276538988}
Epoch: 1
Loss on hold-out set: 0.060183103516077
MeanAbsoluteError value on hold-out data: 0.1945483535528183
Epoch: 2
Loss on hold-out set: 0.04426952414214611
MeanAbsoluteError value on hold-out data: 0.17150014638900757
Epoch: 3
Loss on hold-out set: 0.037235531800736986
MeanAbsoluteError value on hold-out data: 0.1540357768535614
Epoch: 4
Loss on hold-out set: 0.031840805625543
MeanAbsoluteError value on hold-out data: 0.14142632484436035
Epoch: 5
Loss on hold-out set: 0.03202378446236253
MeanAbsoluteError value on hold-out data: 0.14387166500091553
Epoch: 6
Loss on hold-out set: 0.029643759957204262
MeanAbsoluteError value on hold-out data: 0.13657322525978088
Epoch: 7
Loss on hold-out set: 0.030575875503321488
MeanAbsoluteError value on hold-out data: 0.14131250977516174
Epoch: 8
Loss on hold-out set: 0.028823264718521386
MeanAbsoluteError value on hold-out data: 0.13344886898994446
Epoch: 9
Loss on hold-out set: 0.027080569208289187
MeanAbsoluteError value on hold-out data: 0.1323689967393875
Epoch: 10
Loss on hold-out set: 0.02624972353223711
MeanAbsoluteError value on hold-out data: 0.12626540660858154
Epoch: 11
Loss on hold-out set: 0.03002172081110378
MeanAbsoluteError value on hold-out data: 0.134773850440979
Epoch: 12
Loss on hold-out set: 0.023451347852436206
MeanAbsoluteError value on hold-out data: 0.12335725128650665
Epoch: 13
Loss on hold-out set: 0.027658470952883363
MeanAbsoluteError value on hold-out data: 0.13427282869815826
Epoch: 14
Loss on hold-out set: 0.02172953947757681
MeanAbsoluteError value on hold-out data: 0.11679435521364212
Epoch: 15
Loss on hold-out set: 0.0240267291587467
MeanAbsoluteError value on hold-out data: 0.12300509214401245
Epoch: 16
Loss on hold-out set: 0.021316817988020677
MeanAbsoluteError value on hold-out data: 0.1117480993270874
Epoch: 17
Loss on hold-out set: 0.025286002239833277
MeanAbsoluteError value on hold-out data: 0.12392155826091766
Epoch: 18
Loss on hold-out set: 0.02083708666167998
MeanAbsoluteError value on hold-out data: 0.11034166812896729
Epoch: 19
Loss on hold-out set: 0.018376308757190905
MeanAbsoluteError value on hold-out data: 0.10513129830360413
Epoch: 20
Loss on hold-out set: 0.018340587556983035
MeanAbsoluteError value on hold-out data: 0.10554394125938416
Epoch: 21
Loss on hold-out set: 0.01627868533755342
MeanAbsoluteError value on hold-out data: 0.09902384132146835
Epoch: 22
Loss on hold-out set: 0.017357494314977278
MeanAbsoluteError value on hold-out data: 0.10184945911169052
Epoch: 23
Loss on hold-out set: 0.0218721097195521
MeanAbsoluteError value on hold-out data: 0.1148502454161644
Epoch: 24
Loss on hold-out set: 0.0169288948783651
MeanAbsoluteError value on hold-out data: 0.09996955841779709
Epoch: 25
Loss on hold-out set: 0.016034380139317364
MeanAbsoluteError value on hold-out data: 0.09808966517448425
Epoch: 26
Loss on hold-out set: 0.01649063985950003
MeanAbsoluteError value on hold-out data: 0.1001017764210701
Epoch: 27
Loss on hold-out set: 0.014900275726492206
MeanAbsoluteError value on hold-out data: 0.09134208410978317
Epoch: 28
Loss on hold-out set: 0.015123956115373099
MeanAbsoluteError value on hold-out data: 0.09061740338802338
Epoch: 29
Loss on hold-out set: 0.018508248802584906
MeanAbsoluteError value on hold-out data: 0.10260578244924545
Epoch: 30
Loss on hold-out set: 0.017104635078770417
MeanAbsoluteError value on hold-out data: 0.10141056776046753
Epoch: 31
Loss on hold-out set: 0.012581344805075787
MeanAbsoluteError value on hold-out data: 0.08213776350021362
Epoch: 32
Loss on hold-out set: 0.012183487069948266
MeanAbsoluteError value on hold-out data: 0.08216845244169235
Epoch: 33
Loss on hold-out set: 0.013629667582766463
MeanAbsoluteError value on hold-out data: 0.08737441152334213
Epoch: 34
Loss on hold-out set: 0.018335746065325415
MeanAbsoluteError value on hold-out data: 0.09569090604782104
Epoch: 35
Loss on hold-out set: 0.015395645221384863
MeanAbsoluteError value on hold-out data: 0.09457874298095703
Epoch: 36
Loss on hold-out set: 0.019819303539892037
MeanAbsoluteError value on hold-out data: 0.10865622013807297
Epoch: 37
Loss on hold-out set: 0.013593299714072297
MeanAbsoluteError value on hold-out data: 0.08736670017242432
Epoch: 38
Loss on hold-out set: 0.012483900982964162
MeanAbsoluteError value on hold-out data: 0.08342680335044861
Epoch: 39
Loss on hold-out set: 0.015323790656014656
MeanAbsoluteError value on hold-out data: 0.09591653198003769
Epoch: 40
Loss on hold-out set: 0.01142269566655159
MeanAbsoluteError value on hold-out data: 0.08025210350751877
Epoch: 41
Loss on hold-out set: 0.010684631511879464
MeanAbsoluteError value on hold-out data: 0.07774414867162704
Epoch: 42
Loss on hold-out set: 0.017582155326381327
MeanAbsoluteError value on hold-out data: 0.10049601644277573
Epoch: 43
Loss on hold-out set: 0.01331357784414043
MeanAbsoluteError value on hold-out data: 0.08983790129423141
Epoch: 44
Loss on hold-out set: 0.013220135394173363
MeanAbsoluteError value on hold-out data: 0.08922933042049408
Epoch: 45
Loss on hold-out set: 0.011164949612769608
MeanAbsoluteError value on hold-out data: 0.07625257223844528
Epoch: 46
Loss on hold-out set: 0.01360235951996098
MeanAbsoluteError value on hold-out data: 0.08333536982536316
Epoch: 47
Loss on hold-out set: 0.011306052335615581
MeanAbsoluteError value on hold-out data: 0.0776590034365654
Epoch: 48
Loss on hold-out set: 0.011522944720151524
MeanAbsoluteError value on hold-out data: 0.07371238619089127
Epoch: 49
Loss on hold-out set: 0.014047805916246337
MeanAbsoluteError value on hold-out data: 0.08702096343040466
Epoch: 50
Loss on hold-out set: 0.010764926947498072
MeanAbsoluteError value on hold-out data: 0.07617778331041336
Epoch: 51
Loss on hold-out set: 0.011728149554692209
MeanAbsoluteError value on hold-out data: 0.08426273614168167
Epoch: 52
Loss on hold-out set: 0.013725520593191808
MeanAbsoluteError value on hold-out data: 0.0884368047118187
Epoch: 53
Loss on hold-out set: 0.013068656162746871
MeanAbsoluteError value on hold-out data: 0.08766157180070877
Epoch: 54
Loss on hold-out set: 0.013495154879055917
MeanAbsoluteError value on hold-out data: 0.08423954993486404
Epoch: 55
Loss on hold-out set: 0.017884490300590795
MeanAbsoluteError value on hold-out data: 0.10212431848049164
Epoch: 56
Loss on hold-out set: 0.013982195660161475
MeanAbsoluteError value on hold-out data: 0.08443963527679443
Epoch: 57
Loss on hold-out set: 0.013471058775515606
MeanAbsoluteError value on hold-out data: 0.08501160889863968
Epoch: 58
Loss on hold-out set: 0.013205067800978819
MeanAbsoluteError value on hold-out data: 0.08486121892929077
Epoch: 59
Loss on hold-out set: 0.011262780770193785
MeanAbsoluteError value on hold-out data: 0.0737399160861969
Epoch: 60
Loss on hold-out set: 0.012946294473173718
MeanAbsoluteError value on hold-out data: 0.08448398113250732
Epoch: 61
Loss on hold-out set: 0.012894252996581297
MeanAbsoluteError value on hold-out data: 0.08258745074272156
Epoch: 62
Loss on hold-out set: 0.012155535706939797
MeanAbsoluteError value on hold-out data: 0.08503129333257675
Epoch: 63
Loss on hold-out set: 0.01430442395930489
MeanAbsoluteError value on hold-out data: 0.09370823204517365
Epoch: 64
Loss on hold-out set: 0.013268292057327926
MeanAbsoluteError value on hold-out data: 0.07863341271877289
Returned to Spot: Validation loss: 0.013268292057327926
----------------------------------------------
spotPython tuning: 0.003368251623071142 [##--------] 18.67% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.3761981315164932, 'lr_mult': 6.316289979440022, 'batch_size': 8, 'epochs': 64, 'k_folds': 1, 'patience': 16, 'optimizer': 'Adam', 'sgd_momentum': 0.769791716102128}
Epoch: 1
Loss on hold-out set: 0.027210937163449432
MeanAbsoluteError value on hold-out data: 0.12963202595710754
Epoch: 2
Loss on hold-out set: 0.025580379143847448
MeanAbsoluteError value on hold-out data: 0.12670503556728363
Epoch: 3
Loss on hold-out set: 0.025575944921001792
MeanAbsoluteError value on hold-out data: 0.12855283915996552
Epoch: 4
Loss on hold-out set: 0.023942057919492454
MeanAbsoluteError value on hold-out data: 0.12115996330976486
Epoch: 5
Loss on hold-out set: 0.02382633482155047
MeanAbsoluteError value on hold-out data: 0.1238267794251442
Epoch: 6
Loss on hold-out set: 0.023795034074665683
MeanAbsoluteError value on hold-out data: 0.12284334748983383
Epoch: 7
Loss on hold-out set: 0.022444022764255733
MeanAbsoluteError value on hold-out data: 0.1210886761546135
Epoch: 8
Loss on hold-out set: 0.016196508168880092
MeanAbsoluteError value on hold-out data: 0.09896834939718246
Epoch: 9
Loss on hold-out set: 0.0140458186169302
MeanAbsoluteError value on hold-out data: 0.09091097861528397
Epoch: 10
Loss on hold-out set: 0.014320183226740673
MeanAbsoluteError value on hold-out data: 0.09358970075845718
Epoch: 11
Loss on hold-out set: 0.012230754456188726
MeanAbsoluteError value on hold-out data: 0.08591143786907196
Epoch: 12
Loss on hold-out set: 0.014420633513701
MeanAbsoluteError value on hold-out data: 0.09308068454265594
Epoch: 13
Loss on hold-out set: 0.011032108143952331
MeanAbsoluteError value on hold-out data: 0.08303385227918625
Epoch: 14
Loss on hold-out set: 0.011734410728278914
MeanAbsoluteError value on hold-out data: 0.08592815697193146
Epoch: 15
Loss on hold-out set: 0.01175486572135828
MeanAbsoluteError value on hold-out data: 0.08289200812578201
Epoch: 16
Loss on hold-out set: 0.01241233938765761
MeanAbsoluteError value on hold-out data: 0.08341027051210403
Epoch: 17
Loss on hold-out set: 0.010504440876263144
MeanAbsoluteError value on hold-out data: 0.08020859211683273
Epoch: 18
Loss on hold-out set: 0.011971536215002599
MeanAbsoluteError value on hold-out data: 0.08428508043289185
Epoch: 19
Loss on hold-out set: 0.01013185555654529
MeanAbsoluteError value on hold-out data: 0.07559321075677872
Epoch: 20
Loss on hold-out set: 0.008311164617464928
MeanAbsoluteError value on hold-out data: 0.06799963861703873
Epoch: 21
Loss on hold-out set: 0.008600415131934968
MeanAbsoluteError value on hold-out data: 0.06609950959682465
Epoch: 22
Loss on hold-out set: 0.00748416683697877
MeanAbsoluteError value on hold-out data: 0.06212526187300682
Epoch: 23
Loss on hold-out set: 0.009369414753133529
MeanAbsoluteError value on hold-out data: 0.07475677132606506
Epoch: 24
Loss on hold-out set: 0.009149775154104358
MeanAbsoluteError value on hold-out data: 0.07342710345983505
Epoch: 25
Loss on hold-out set: 0.007688819951573877
MeanAbsoluteError value on hold-out data: 0.0649414211511612
Epoch: 26
Loss on hold-out set: 0.010247040123335625
MeanAbsoluteError value on hold-out data: 0.0792955681681633
Epoch: 27
Loss on hold-out set: 0.0072550563410531095
MeanAbsoluteError value on hold-out data: 0.0636986717581749
Epoch: 28
Loss on hold-out set: 0.011106135599364183
MeanAbsoluteError value on hold-out data: 0.08097918331623077
Epoch: 29
Loss on hold-out set: 0.009147175097543942
MeanAbsoluteError value on hold-out data: 0.06980173289775848
Epoch: 30
Loss on hold-out set: 0.01005938584230056
MeanAbsoluteError value on hold-out data: 0.07901819795370102
Epoch: 31
Loss on hold-out set: 0.00888601409295868
MeanAbsoluteError value on hold-out data: 0.07148203253746033
Epoch: 32
Loss on hold-out set: 0.008464677044876703
MeanAbsoluteError value on hold-out data: 0.0703500360250473
Epoch: 33
Loss on hold-out set: 0.007691402833810763
MeanAbsoluteError value on hold-out data: 0.06474746763706207
Epoch: 34
Loss on hold-out set: 0.007452669167449992
MeanAbsoluteError value on hold-out data: 0.06142296642065048
Epoch: 35
Loss on hold-out set: 0.007719537785497347
MeanAbsoluteError value on hold-out data: 0.06398045271635056
Epoch: 36
Loss on hold-out set: 0.009593305527232587
MeanAbsoluteError value on hold-out data: 0.07402747124433517
Epoch: 37
Loss on hold-out set: 0.00845887410258384
MeanAbsoluteError value on hold-out data: 0.07119139283895493
Epoch: 38
Loss on hold-out set: 0.006589513158695282
MeanAbsoluteError value on hold-out data: 0.05964001268148422
Epoch: 39
Loss on hold-out set: 0.006656890065642074
MeanAbsoluteError value on hold-out data: 0.058564987033605576
Epoch: 40
Loss on hold-out set: 0.007715205324960775
MeanAbsoluteError value on hold-out data: 0.06473639607429504
Epoch: 41
Loss on hold-out set: 0.00739089240577366
MeanAbsoluteError value on hold-out data: 0.06447663903236389
Epoch: 42
Loss on hold-out set: 0.007729204426715641
MeanAbsoluteError value on hold-out data: 0.06651869416236877
Epoch: 43
Loss on hold-out set: 0.007306096196101096
MeanAbsoluteError value on hold-out data: 0.06266162544488907
Epoch: 44
Loss on hold-out set: 0.009639284248757912
MeanAbsoluteError value on hold-out data: 0.07357724756002426
Epoch: 45
Loss on hold-out set: 0.008533647081716672
MeanAbsoluteError value on hold-out data: 0.06702924519777298
Epoch: 46
Loss on hold-out set: 0.007940250010793343
MeanAbsoluteError value on hold-out data: 0.06394878029823303
Epoch: 47
Loss on hold-out set: 0.007051081010630648
MeanAbsoluteError value on hold-out data: 0.06000024825334549
Epoch: 48
Loss on hold-out set: 0.008212490233984826
MeanAbsoluteError value on hold-out data: 0.06401991844177246
Epoch: 49
Loss on hold-out set: 0.007754719831466086
MeanAbsoluteError value on hold-out data: 0.06534267216920853
Epoch: 50
Loss on hold-out set: 0.01000092662625799
MeanAbsoluteError value on hold-out data: 0.07327666878700256
Epoch: 51
Loss on hold-out set: 0.007849051948333477
MeanAbsoluteError value on hold-out data: 0.06283649802207947
Epoch: 52
Loss on hold-out set: 0.006062831018904322
MeanAbsoluteError value on hold-out data: 0.05587777495384216
Epoch: 53
Loss on hold-out set: 0.008268944091947847
MeanAbsoluteError value on hold-out data: 0.06907951831817627
Epoch: 54
Loss on hold-out set: 0.00837195352161009
MeanAbsoluteError value on hold-out data: 0.06882993876934052
Epoch: 55
Loss on hold-out set: 0.008385075786224517
MeanAbsoluteError value on hold-out data: 0.06701111048460007
Epoch: 56
Loss on hold-out set: 0.007059471528536003
MeanAbsoluteError value on hold-out data: 0.061903879046440125
Epoch: 57
Loss on hold-out set: 0.007530316630819519
MeanAbsoluteError value on hold-out data: 0.062273383140563965
Epoch: 58
Loss on hold-out set: 0.005730778723342442
MeanAbsoluteError value on hold-out data: 0.05311964824795723
Epoch: 59
Loss on hold-out set: 0.00641245162114501
MeanAbsoluteError value on hold-out data: 0.05851878598332405
Epoch: 60
Loss on hold-out set: 0.00868583598639816
MeanAbsoluteError value on hold-out data: 0.07305504381656647
Epoch: 61
Loss on hold-out set: 0.008311354170712692
MeanAbsoluteError value on hold-out data: 0.06804612278938293
Epoch: 62
Loss on hold-out set: 0.009911464196384737
MeanAbsoluteError value on hold-out data: 0.08106707781553268
Epoch: 63
Loss on hold-out set: 0.007812923013453224
MeanAbsoluteError value on hold-out data: 0.0656294971704483
Epoch: 64
Loss on hold-out set: 0.00816879303219091
MeanAbsoluteError value on hold-out data: 0.0662476047873497
Returned to Spot: Validation loss: 0.00816879303219091
----------------------------------------------
spotPython tuning: 0.003368251623071142 [##--------] 21.56% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 8, 'dropout_prob': 0.11008482274785547, 'lr_mult': 7.5593617116043745, 'batch_size': 8, 'epochs': 8, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 1.0}

Epoch: 1
Loss on hold-out set: 0.031167935751574605
MeanAbsoluteError value on hold-out data: 0.1389435976743698
Epoch: 2
Loss on hold-out set: 0.028352285490224238
MeanAbsoluteError value on hold-out data: 0.13003723323345184
Epoch: 3
Loss on hold-out set: 0.026416741875245384
MeanAbsoluteError value on hold-out data: 0.12774239480495453
Epoch: 4
Loss on hold-out set: 0.02488664135729012
MeanAbsoluteError value on hold-out data: 0.12519538402557373
Epoch: 5
Loss on hold-out set: 0.021885372557383227
MeanAbsoluteError value on hold-out data: 0.11694615334272385
Epoch: 6
Loss on hold-out set: 0.01924227945212471
MeanAbsoluteError value on hold-out data: 0.10807961970567703
Epoch: 7
Loss on hold-out set: 0.014303581415381478
MeanAbsoluteError value on hold-out data: 0.08510799705982208
Epoch: 8
Loss on hold-out set: 0.009347625297347182
MeanAbsoluteError value on hold-out data: 0.06922153383493423
Returned to Spot: Validation loss: 0.009347625297347182
----------------------------------------------
spotPython tuning: 0.003368251623071142 [##--------] 22.92% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.4004404230081878, 'lr_mult': 3.6237991669677174, 'batch_size': 8, 'epochs': 32, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.9714699756362758}
Epoch: 1
Loss on hold-out set: 0.03519071065085499
MeanAbsoluteError value on hold-out data: 0.14482280611991882
Epoch: 2
Loss on hold-out set: 0.02701873893506433
MeanAbsoluteError value on hold-out data: 0.13047431409358978
Epoch: 3
Loss on hold-out set: 0.026425202475174478
MeanAbsoluteError value on hold-out data: 0.12834711372852325
Epoch: 4
Loss on hold-out set: 0.025105541038915123
MeanAbsoluteError value on hold-out data: 0.12530823051929474
Epoch: 5
Loss on hold-out set: 0.023656813599365323
MeanAbsoluteError value on hold-out data: 0.12024547904729843
Epoch: 6
Loss on hold-out set: 0.020588616816032874
MeanAbsoluteError value on hold-out data: 0.11326059699058533
Epoch: 7
Loss on hold-out set: 0.02008111512067875
MeanAbsoluteError value on hold-out data: 0.11025741696357727
Epoch: 8
Loss on hold-out set: 0.018177087161395895
MeanAbsoluteError value on hold-out data: 0.1025613322854042
Epoch: 9
Loss on hold-out set: 0.020106520846878227
MeanAbsoluteError value on hold-out data: 0.1110265851020813
Epoch: 10
Loss on hold-out set: 0.018712808365786548
MeanAbsoluteError value on hold-out data: 0.11026214808225632
Epoch: 11
Loss on hold-out set: 0.017324995702916856
MeanAbsoluteError value on hold-out data: 0.1029956266283989
Epoch: 12
Loss on hold-out set: 0.014384190251707639
MeanAbsoluteError value on hold-out data: 0.09433331340551376
Epoch: 13
Loss on hold-out set: 0.01356640637325319
MeanAbsoluteError value on hold-out data: 0.09254033863544464
Epoch: 14
Loss on hold-out set: 0.012132826108044307
MeanAbsoluteError value on hold-out data: 0.08568648993968964
Epoch: 15
Loss on hold-out set: 0.010504629432321772
MeanAbsoluteError value on hold-out data: 0.07662791013717651
Epoch: 16
Loss on hold-out set: 0.012114764252481492
MeanAbsoluteError value on hold-out data: 0.08679305762052536
Epoch: 17
Loss on hold-out set: 0.011368975257746092
MeanAbsoluteError value on hold-out data: 0.08285421878099442
Epoch: 18
Loss on hold-out set: 0.010411389916522526
MeanAbsoluteError value on hold-out data: 0.07702107727527618
Epoch: 19
Loss on hold-out set: 0.009214509064086565
MeanAbsoluteError value on hold-out data: 0.07631659507751465
Epoch: 20
Loss on hold-out set: 0.010442939476649227
MeanAbsoluteError value on hold-out data: 0.07555711269378662
Epoch: 21
Loss on hold-out set: 0.009214771623527141
MeanAbsoluteError value on hold-out data: 0.07608091086149216
Epoch: 22
Loss on hold-out set: 0.008587063596534886
MeanAbsoluteError value on hold-out data: 0.07098817825317383
Epoch: 23
Loss on hold-out set: 0.01000178189592828
MeanAbsoluteError value on hold-out data: 0.07819800078868866
Epoch: 24
Loss on hold-out set: 0.006741508547412722
MeanAbsoluteError value on hold-out data: 0.06063386797904968
Epoch: 25
Loss on hold-out set: 0.00856202187653827
MeanAbsoluteError value on hold-out data: 0.07290737330913544
Epoch: 26
Loss on hold-out set: 0.007817582784857797
MeanAbsoluteError value on hold-out data: 0.0675615668296814
Epoch: 27
Loss on hold-out set: 0.008262146328649434
MeanAbsoluteError value on hold-out data: 0.06900817900896072
Epoch: 28
Loss on hold-out set: 0.0069193496142121915
MeanAbsoluteError value on hold-out data: 0.061182670295238495
Epoch: 29
Loss on hold-out set: 0.007612518543426536
MeanAbsoluteError value on hold-out data: 0.06472010910511017
Epoch: 30
Loss on hold-out set: 0.0060410620062612
MeanAbsoluteError value on hold-out data: 0.057983677834272385
Epoch: 31
Loss on hold-out set: 0.006546675540065687
MeanAbsoluteError value on hold-out data: 0.05921010300517082
Epoch: 32
Loss on hold-out set: 0.0068342524341699715
MeanAbsoluteError value on hold-out data: 0.06123081222176552
Returned to Spot: Validation loss: 0.0068342524341699715
----------------------------------------------
spotPython tuning: 0.003368251623071142 [##--------] 24.76% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 8, 'dropout_prob': 0.1315992831357545, 'lr_mult': 8.305107568239311, 'batch_size': 8, 'epochs': 512, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.9334847012968254}
Epoch: 1
Loss on hold-out set: 0.02564089038825937
MeanAbsoluteError value on hold-out data: 0.12916234135627747
Epoch: 2
Loss on hold-out set: 0.027081175756297614
MeanAbsoluteError value on hold-out data: 0.13117912411689758
Epoch: 3
Loss on hold-out set: 0.023648247539408897
MeanAbsoluteError value on hold-out data: 0.12356310337781906
Epoch: 4
Loss on hold-out set: 0.0192690875264816
MeanAbsoluteError value on hold-out data: 0.11088230460882187
Epoch: 5
Loss on hold-out set: 0.02034655147183098
MeanAbsoluteError value on hold-out data: 0.11464822292327881
Epoch: 6
Loss on hold-out set: 0.014453059160395673
MeanAbsoluteError value on hold-out data: 0.09651318937540054
Epoch: 7
Loss on hold-out set: 0.011594758609518115
MeanAbsoluteError value on hold-out data: 0.08259683847427368
Epoch: 8
Loss on hold-out set: 0.010966210135895955
MeanAbsoluteError value on hold-out data: 0.0795753002166748
Epoch: 9
Loss on hold-out set: 0.0075558110670260106
MeanAbsoluteError value on hold-out data: 0.06120362505316734
Epoch: 10
Loss on hold-out set: 0.008035381205110369
MeanAbsoluteError value on hold-out data: 0.055537935346364975
Epoch: 11
Loss on hold-out set: 0.00640973332184857
MeanAbsoluteError value on hold-out data: 0.052930090576410294
Epoch: 12
Loss on hold-out set: 0.005915495166846085
MeanAbsoluteError value on hold-out data: 0.04522381350398064
Epoch: 13
Loss on hold-out set: 0.00877591640758175
MeanAbsoluteError value on hold-out data: 0.049556344747543335
Epoch: 14
Loss on hold-out set: 0.006246588820144289
MeanAbsoluteError value on hold-out data: 0.04853764921426773
Epoch: 15
Loss on hold-out set: 0.0064042068996442185
MeanAbsoluteError value on hold-out data: 0.04829801991581917
Epoch: 16
Loss on hold-out set: 0.009258432609624978
MeanAbsoluteError value on hold-out data: 0.056830838322639465
Epoch: 17
Loss on hold-out set: 0.006764664860001128
MeanAbsoluteError value on hold-out data: 0.06352127343416214
Epoch: 18
Loss on hold-out set: 0.006728608490543832
MeanAbsoluteError value on hold-out data: 0.0547250434756279
Epoch: 19
Loss on hold-out set: 0.0059059250048257555
MeanAbsoluteError value on hold-out data: 0.04462656006217003
Epoch: 20
Loss on hold-out set: 0.00755604605594846
MeanAbsoluteError value on hold-out data: 0.061879537999629974
Epoch: 21
Loss on hold-out set: 0.006234187409159188
MeanAbsoluteError value on hold-out data: 0.0487164743244648
Epoch: 22
Loss on hold-out set: 0.006333439142556591
MeanAbsoluteError value on hold-out data: 0.04472547024488449
Epoch: 23
Loss on hold-out set: 0.005264009212719668
MeanAbsoluteError value on hold-out data: 0.04007662832736969
Epoch: 24
Loss on hold-out set: 0.00835583169674991
MeanAbsoluteError value on hold-out data: 0.04902168735861778
Epoch: 25
Loss on hold-out set: 0.005170132060333057
MeanAbsoluteError value on hold-out data: 0.041370294988155365
Epoch: 26
Loss on hold-out set: 0.00811089353259089
MeanAbsoluteError value on hold-out data: 0.05157049745321274
Epoch: 27
Loss on hold-out set: 0.007060251882649027
MeanAbsoluteError value on hold-out data: 0.052311692386865616
Epoch: 28
Loss on hold-out set: 0.00714235397601059
MeanAbsoluteError value on hold-out data: 0.05006533861160278
Epoch: 29
Loss on hold-out set: 0.005521938683063797
MeanAbsoluteError value on hold-out data: 0.04288139566779137
Epoch: 30
Loss on hold-out set: 0.00515199644570729
MeanAbsoluteError value on hold-out data: 0.049841199070215225
Epoch: 31
Loss on hold-out set: 0.011609552035990515
MeanAbsoluteError value on hold-out data: 0.07955258339643478
Epoch: 32
Loss on hold-out set: 0.006076499993612647
MeanAbsoluteError value on hold-out data: 0.048023857176303864
Epoch: 33
Loss on hold-out set: 0.008012877843851273
MeanAbsoluteError value on hold-out data: 0.051542337983846664
Epoch: 34
Loss on hold-out set: 0.005365722677149614
MeanAbsoluteError value on hold-out data: 0.0417039655148983
Epoch: 35
Loss on hold-out set: 0.006181872667328112
MeanAbsoluteError value on hold-out data: 0.0418727733194828
Epoch: 36
Loss on hold-out set: 0.011025046488564266
MeanAbsoluteError value on hold-out data: 0.08240727335214615
Epoch: 37
Loss on hold-out set: 0.00586116149267917
MeanAbsoluteError value on hold-out data: 0.045823562890291214
Epoch: 38
Loss on hold-out set: 0.007854221289131888
MeanAbsoluteError value on hold-out data: 0.050141431391239166
Epoch: 39
Loss on hold-out set: 0.007128042884256789
MeanAbsoluteError value on hold-out data: 0.052994996309280396
Epoch: 40
Loss on hold-out set: 0.006209758338579712
MeanAbsoluteError value on hold-out data: 0.05455075576901436
Epoch: 41
Loss on hold-out set: 0.006436633167475903
MeanAbsoluteError value on hold-out data: 0.04465862736105919
Epoch: 42
Loss on hold-out set: 0.0057944295909500825
MeanAbsoluteError value on hold-out data: 0.05279511958360672
Epoch: 43
Loss on hold-out set: 0.007137070857233515
MeanAbsoluteError value on hold-out data: 0.05405142530798912
Epoch: 44
Loss on hold-out set: 0.007899129525819597
MeanAbsoluteError value on hold-out data: 0.053903039544820786
Epoch: 45
Loss on hold-out set: 0.007387098712282942
MeanAbsoluteError value on hold-out data: 0.056726474314928055
Epoch: 46
Loss on hold-out set: 0.007961333259070096
MeanAbsoluteError value on hold-out data: 0.05602148547768593
Epoch: 47
Loss on hold-out set: 0.006925872157520835
MeanAbsoluteError value on hold-out data: 0.04695718735456467
Epoch: 48
Loss on hold-out set: 0.0067807737581652445
MeanAbsoluteError value on hold-out data: 0.05714862048625946
Epoch: 49
Loss on hold-out set: 0.007705649171456523
MeanAbsoluteError value on hold-out data: 0.050464387983083725
Epoch: 50
Loss on hold-out set: 0.007258836645250037
MeanAbsoluteError value on hold-out data: 0.04411129653453827
Epoch: 51
Loss on hold-out set: 0.004982982390701133
MeanAbsoluteError value on hold-out data: 0.044491808861494064
Epoch: 52
Loss on hold-out set: 0.008081050577426427
MeanAbsoluteError value on hold-out data: 0.04619774967432022
Epoch: 53
Loss on hold-out set: 0.0050322098671274846
MeanAbsoluteError value on hold-out data: 0.04296865314245224
Epoch: 54
Loss on hold-out set: 0.007077905095157851
MeanAbsoluteError value on hold-out data: 0.05812880024313927
Epoch: 55
Loss on hold-out set: 0.00585791133696483
MeanAbsoluteError value on hold-out data: 0.044101081788539886
Epoch: 56
Loss on hold-out set: 0.005943979400112049
MeanAbsoluteError value on hold-out data: 0.05310409143567085
Epoch: 57
Loss on hold-out set: 0.008452645668416824
MeanAbsoluteError value on hold-out data: 0.07045605033636093
Epoch: 58
Loss on hold-out set: 0.006413202324581921
MeanAbsoluteError value on hold-out data: 0.049696844071149826
Epoch: 59
Loss on hold-out set: 0.0050093392040396695
MeanAbsoluteError value on hold-out data: 0.04030537232756615
Epoch: 60
Loss on hold-out set: 0.008029380982502755
MeanAbsoluteError value on hold-out data: 0.05650551989674568
Epoch: 61
Loss on hold-out set: 0.005934807741524358
MeanAbsoluteError value on hold-out data: 0.0453670360147953
Epoch: 62
Loss on hold-out set: 0.007187964809035245
MeanAbsoluteError value on hold-out data: 0.04420188441872597
Epoch: 63
Loss on hold-out set: 0.0074811101642951955
MeanAbsoluteError value on hold-out data: 0.057481881231069565
Epoch: 64
Loss on hold-out set: 0.005700742275190638
MeanAbsoluteError value on hold-out data: 0.04329363629221916
Epoch: 65
Loss on hold-out set: 0.006049566637222214
MeanAbsoluteError value on hold-out data: 0.04866845905780792
Epoch: 66
Loss on hold-out set: 0.005904419195997578
MeanAbsoluteError value on hold-out data: 0.04839106649160385
Epoch: 67
Loss on hold-out set: 0.004673702171299067
MeanAbsoluteError value on hold-out data: 0.04010108485817909
Epoch: 68
Loss on hold-out set: 0.007753249607431874
MeanAbsoluteError value on hold-out data: 0.049227695912122726
Epoch: 69
Loss on hold-out set: 0.00567001971649006
MeanAbsoluteError value on hold-out data: 0.04842741787433624
Epoch: 70
Loss on hold-out set: 0.006126732834673021
MeanAbsoluteError value on hold-out data: 0.04160434007644653
Epoch: 71
Loss on hold-out set: 0.0052726569782335945
MeanAbsoluteError value on hold-out data: 0.041839130222797394
Epoch: 72
Loss on hold-out set: 0.0062655570187703956
MeanAbsoluteError value on hold-out data: 0.05744418501853943
Epoch: 73
Loss on hold-out set: 0.0076872695966525685
MeanAbsoluteError value on hold-out data: 0.05600045621395111
Epoch: 74
Loss on hold-out set: 0.007937508774614943
MeanAbsoluteError value on hold-out data: 0.05056946724653244
Epoch: 75
Loss on hold-out set: 0.00552106359330202
MeanAbsoluteError value on hold-out data: 0.04701343923807144
Epoch: 76
Loss on hold-out set: 0.00609765386424873
MeanAbsoluteError value on hold-out data: 0.04224172607064247
Epoch: 77
Loss on hold-out set: 0.008139191657966493
MeanAbsoluteError value on hold-out data: 0.05895627290010452
Epoch: 78
Loss on hold-out set: 0.006619508572743814
MeanAbsoluteError value on hold-out data: 0.0487801767885685
Epoch: 79
Loss on hold-out set: 0.005037055663323324
MeanAbsoluteError value on hold-out data: 0.03863781318068504
Epoch: 80
Loss on hold-out set: 0.00610789593721213
MeanAbsoluteError value on hold-out data: 0.040914248675107956
Epoch: 81
Loss on hold-out set: 0.005451553643644347
MeanAbsoluteError value on hold-out data: 0.04235884174704552
Epoch: 82
Loss on hold-out set: 0.006258054616122727
MeanAbsoluteError value on hold-out data: 0.05160534381866455
Epoch: 83
Loss on hold-out set: 0.007284481602255255
MeanAbsoluteError value on hold-out data: 0.053831297904253006
Epoch: 84
Loss on hold-out set: 0.007054373116835977
MeanAbsoluteError value on hold-out data: 0.04707925021648407
Epoch: 85
Loss on hold-out set: 0.00791024928950815
MeanAbsoluteError value on hold-out data: 0.05161724612116814
Epoch: 86
Loss on hold-out set: 0.00649672523324721
MeanAbsoluteError value on hold-out data: 0.051445864140987396
Epoch: 87
Loss on hold-out set: 0.006368436795271823
MeanAbsoluteError value on hold-out data: 0.04452668875455856
Epoch: 88
Loss on hold-out set: 0.007806728355047342
MeanAbsoluteError value on hold-out data: 0.06865032762289047
Epoch: 89
Loss on hold-out set: 0.005983108623982652
MeanAbsoluteError value on hold-out data: 0.05195354297757149
Epoch: 90
Loss on hold-out set: 0.007398210513393248
MeanAbsoluteError value on hold-out data: 0.05697209760546684
Epoch: 91
Loss on hold-out set: 0.01060471372176452
MeanAbsoluteError value on hold-out data: 0.06379664689302444
Epoch: 92
Loss on hold-out set: 0.00935529345664882
MeanAbsoluteError value on hold-out data: 0.062141913920640945
Epoch: 93
Loss on hold-out set: 0.006879166934308351
MeanAbsoluteError value on hold-out data: 0.055977415293455124
Epoch: 94
Loss on hold-out set: 0.0062155803653264514
MeanAbsoluteError value on hold-out data: 0.04470796138048172
Epoch: 95
Loss on hold-out set: 0.005037711562564303
MeanAbsoluteError value on hold-out data: 0.04139912873506546
Epoch: 96
Loss on hold-out set: 0.005982446273647886
MeanAbsoluteError value on hold-out data: 0.04313800483942032
Epoch: 97
Loss on hold-out set: 0.007368620601482689
MeanAbsoluteError value on hold-out data: 0.06447068601846695
Epoch: 98
Loss on hold-out set: 0.005144171819043358
MeanAbsoluteError value on hold-out data: 0.03936010226607323
Epoch: 99
Loss on hold-out set: 0.006770126625748449
MeanAbsoluteError value on hold-out data: 0.05534083768725395
Epoch: 100
Loss on hold-out set: 0.005169059300035434
MeanAbsoluteError value on hold-out data: 0.04407542571425438
Epoch: 101
Loss on hold-out set: 0.005404143606459624
MeanAbsoluteError value on hold-out data: 0.04325093328952789
Epoch: 102
Loss on hold-out set: 0.00538033217583832
MeanAbsoluteError value on hold-out data: 0.052949532866477966
Epoch: 103
Loss on hold-out set: 0.007452252997226376
MeanAbsoluteError value on hold-out data: 0.04432794079184532
Epoch: 104
Loss on hold-out set: 0.0076378644849970255
MeanAbsoluteError value on hold-out data: 0.04866047948598862
Epoch: 105
Loss on hold-out set: 0.012036860068818848
MeanAbsoluteError value on hold-out data: 0.07584524154663086
Epoch: 106
Loss on hold-out set: 0.006841230135346689
MeanAbsoluteError value on hold-out data: 0.047600843012332916
Epoch: 107
Loss on hold-out set: 0.005709596211090684
MeanAbsoluteError value on hold-out data: 0.04687318950891495
Epoch: 108
Loss on hold-out set: 0.007122647444990243
MeanAbsoluteError value on hold-out data: 0.04391850158572197
Epoch: 109
Loss on hold-out set: 0.005983866125653118
MeanAbsoluteError value on hold-out data: 0.04173583164811134
Epoch: 110
Loss on hold-out set: 0.005983258095894646
MeanAbsoluteError value on hold-out data: 0.040722716599702835
Epoch: 111
Loss on hold-out set: 0.008856720017272317
MeanAbsoluteError value on hold-out data: 0.050259437412023544
Epoch: 112
Loss on hold-out set: 0.007796620410150162
MeanAbsoluteError value on hold-out data: 0.05009892210364342
Epoch: 113
Loss on hold-out set: 0.008376008469464355
MeanAbsoluteError value on hold-out data: 0.07380224764347076
Epoch: 114
Loss on hold-out set: 0.010674723045667633
MeanAbsoluteError value on hold-out data: 0.057504914700984955
Epoch: 115
Loss on hold-out set: 0.005302609418561731
MeanAbsoluteError value on hold-out data: 0.04068050533533096
Epoch: 116
Loss on hold-out set: 0.006240619886452087
MeanAbsoluteError value on hold-out data: 0.045201219618320465
Epoch: 117
Loss on hold-out set: 0.0069990354577863685
MeanAbsoluteError value on hold-out data: 0.05376856401562691
Epoch: 118
Loss on hold-out set: 0.005350317230055991
MeanAbsoluteError value on hold-out data: 0.0441882498562336
Epoch: 119
Loss on hold-out set: 0.005058740439524531
MeanAbsoluteError value on hold-out data: 0.04219115525484085
Epoch: 120
Loss on hold-out set: 0.007329756335055113
MeanAbsoluteError value on hold-out data: 0.04936619848012924
Epoch: 121
Loss on hold-out set: 0.006952753031663106
MeanAbsoluteError value on hold-out data: 0.048088982701301575
Epoch: 122
Loss on hold-out set: 0.006782930837959468
MeanAbsoluteError value on hold-out data: 0.04394419491291046
Epoch: 123
Loss on hold-out set: 0.006512936625911511
MeanAbsoluteError value on hold-out data: 0.05088438093662262
Epoch: 124
Loss on hold-out set: 0.00860863864976349
MeanAbsoluteError value on hold-out data: 0.057826925069093704
Epoch: 125
Loss on hold-out set: 0.0061122417606192785
MeanAbsoluteError value on hold-out data: 0.05203314870595932
Epoch: 126
Loss on hold-out set: 0.0053947931454259605
MeanAbsoluteError value on hold-out data: 0.04319000244140625
Epoch: 127
Loss on hold-out set: 0.007755664367179729
MeanAbsoluteError value on hold-out data: 0.05965414643287659
Epoch: 128
Loss on hold-out set: 0.006672867429427386
MeanAbsoluteError value on hold-out data: 0.04497869685292244
Epoch: 129
Loss on hold-out set: 0.009943524239995321
MeanAbsoluteError value on hold-out data: 0.05729256197810173
Epoch: 130
Loss on hold-out set: 0.005910022107663711
MeanAbsoluteError value on hold-out data: 0.04600305110216141
Epoch: 131
Loss on hold-out set: 0.007636207590908988
MeanAbsoluteError value on hold-out data: 0.0718793123960495
Early stopping at epoch 130
Returned to Spot: Validation loss: 0.007636207590908988
----------------------------------------------
spotPython tuning: 0.003368251623071142 [###-------] 29.65% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.3596224424565029, 'lr_mult': 3.539679634962758, 'batch_size': 8, 'epochs': 65536, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adam', 'sgd_momentum': 0.8862290499912392}
Epoch: 1
Loss on hold-out set: 0.04517169365365254
MeanAbsoluteError value on hold-out data: 0.17187267541885376
Epoch: 2
Loss on hold-out set: 0.033574931666647136
MeanAbsoluteError value on hold-out data: 0.14708836376667023
Epoch: 3
Loss on hold-out set: 0.031927102858102636
MeanAbsoluteError value on hold-out data: 0.14016494154930115
Epoch: 4
Loss on hold-out set: 0.026370667791190117
MeanAbsoluteError value on hold-out data: 0.1314295381307602
Epoch: 5
Loss on hold-out set: 0.024857587830506657
MeanAbsoluteError value on hold-out data: 0.12588050961494446
Epoch: 6
Loss on hold-out set: 0.02458532193773671
MeanAbsoluteError value on hold-out data: 0.12630130350589752
Epoch: 7
Loss on hold-out set: 0.021856597220329076
MeanAbsoluteError value on hold-out data: 0.11757166683673859
Epoch: 8
Loss on hold-out set: 0.020113832697174268
MeanAbsoluteError value on hold-out data: 0.1129705011844635
Epoch: 9
Loss on hold-out set: 0.023072404603130724
MeanAbsoluteError value on hold-out data: 0.120087169110775
Epoch: 10
Loss on hold-out set: 0.017436312438037834
MeanAbsoluteError value on hold-out data: 0.10725101828575134
Epoch: 11
Loss on hold-out set: 0.017249868717044592
MeanAbsoluteError value on hold-out data: 0.10553568601608276
Epoch: 12
Loss on hold-out set: 0.015822105422174854
MeanAbsoluteError value on hold-out data: 0.09524490684270859
Epoch: 13
Loss on hold-out set: 0.013874318971494702
MeanAbsoluteError value on hold-out data: 0.0936526283621788
Epoch: 14
Loss on hold-out set: 0.016219762043635313
MeanAbsoluteError value on hold-out data: 0.09902223199605942
Epoch: 15
Loss on hold-out set: 0.013081359787304936
MeanAbsoluteError value on hold-out data: 0.0905822217464447
Epoch: 16
Loss on hold-out set: 0.011757974788595579
MeanAbsoluteError value on hold-out data: 0.08359221369028091
Epoch: 17
Loss on hold-out set: 0.009143556691828723
MeanAbsoluteError value on hold-out data: 0.07486879080533981
Epoch: 18
Loss on hold-out set: 0.010338937312266544
MeanAbsoluteError value on hold-out data: 0.07941649109125137
Epoch: 19
Loss on hold-out set: 0.009372967791645542
MeanAbsoluteError value on hold-out data: 0.07592059671878815
Epoch: 20
Loss on hold-out set: 0.010562440748081395
MeanAbsoluteError value on hold-out data: 0.0819612666964531
Epoch: 21
Loss on hold-out set: 0.009646473648516755
MeanAbsoluteError value on hold-out data: 0.07789568603038788
Epoch: 22
Loss on hold-out set: 0.009317919599676603
MeanAbsoluteError value on hold-out data: 0.07692451775074005
Epoch: 23
Loss on hold-out set: 0.007581532819466175
MeanAbsoluteError value on hold-out data: 0.06719309836626053
Epoch: 24
Loss on hold-out set: 0.007435524198961885
MeanAbsoluteError value on hold-out data: 0.06575502455234528
Epoch: 25
Loss on hold-out set: 0.00706329750277004
MeanAbsoluteError value on hold-out data: 0.06482714414596558
Epoch: 26
Loss on hold-out set: 0.006419801922196424
MeanAbsoluteError value on hold-out data: 0.061259735375642776
Epoch: 27
Loss on hold-out set: 0.00801278988977796
MeanAbsoluteError value on hold-out data: 0.0723102018237114
Epoch: 28
Loss on hold-out set: 0.006608706512978594
MeanAbsoluteError value on hold-out data: 0.06200139969587326
Epoch: 29
Loss on hold-out set: 0.005638075840818745
MeanAbsoluteError value on hold-out data: 0.05744992569088936
Epoch: 30
Loss on hold-out set: 0.006663960628334041
MeanAbsoluteError value on hold-out data: 0.05884530395269394
Epoch: 31
Loss on hold-out set: 0.005815962706324889
MeanAbsoluteError value on hold-out data: 0.05973099544644356
Epoch: 32
Loss on hold-out set: 0.00697156853397916
MeanAbsoluteError value on hold-out data: 0.06470704078674316
Epoch: 33
Loss on hold-out set: 0.0052746676649947305
MeanAbsoluteError value on hold-out data: 0.05777130648493767
Epoch: 34
Loss on hold-out set: 0.005087609672428746
MeanAbsoluteError value on hold-out data: 0.05353882536292076
Epoch: 35
Loss on hold-out set: 0.006375262104771345
MeanAbsoluteError value on hold-out data: 0.059495195746421814
Epoch: 36
Loss on hold-out set: 0.007405698470967381
MeanAbsoluteError value on hold-out data: 0.06382052600383759
Epoch: 37
Loss on hold-out set: 0.005124340544601804
MeanAbsoluteError value on hold-out data: 0.05205458775162697
Epoch: 38
Loss on hold-out set: 0.003995795087815311
MeanAbsoluteError value on hold-out data: 0.04898841306567192
Epoch: 39
Loss on hold-out set: 0.00528998403828346
MeanAbsoluteError value on hold-out data: 0.05496520176529884
Epoch: 40
Loss on hold-out set: 0.0053386859653983265
MeanAbsoluteError value on hold-out data: 0.05163860321044922
Epoch: 41
Loss on hold-out set: 0.0053529787079529155
MeanAbsoluteError value on hold-out data: 0.05664648860692978
Epoch: 42
Loss on hold-out set: 0.0053644987607472825
MeanAbsoluteError value on hold-out data: 0.05644674971699715
Epoch: 43
Loss on hold-out set: 0.004812189920094649
MeanAbsoluteError value on hold-out data: 0.04900270327925682
Epoch: 44
Loss on hold-out set: 0.004831234676346771
MeanAbsoluteError value on hold-out data: 0.050461605191230774
Epoch: 45
Loss on hold-out set: 0.004314585452543963
MeanAbsoluteError value on hold-out data: 0.05130474269390106
Epoch: 46
Loss on hold-out set: 0.005469501844153886
MeanAbsoluteError value on hold-out data: 0.053899090737104416
Epoch: 47
Loss on hold-out set: 0.004870418339698135
MeanAbsoluteError value on hold-out data: 0.05399174988269806
Epoch: 48
Loss on hold-out set: 0.004588909090288277
MeanAbsoluteError value on hold-out data: 0.05093832314014435
Epoch: 49
Loss on hold-out set: 0.005109988689103997
MeanAbsoluteError value on hold-out data: 0.05263238772749901
Epoch: 50
Loss on hold-out set: 0.004593804735984457
MeanAbsoluteError value on hold-out data: 0.04736630618572235
Epoch: 51
Loss on hold-out set: 0.004752851373172905
MeanAbsoluteError value on hold-out data: 0.04842371121048927
Epoch: 52
Loss on hold-out set: 0.004926708759739995
MeanAbsoluteError value on hold-out data: 0.053868427872657776
Epoch: 53
Loss on hold-out set: 0.004039866518915484
MeanAbsoluteError value on hold-out data: 0.04633256047964096
Epoch: 54
Loss on hold-out set: 0.004189202179029388
MeanAbsoluteError value on hold-out data: 0.04606610909104347
Epoch: 55
Loss on hold-out set: 0.0033730791397637836
MeanAbsoluteError value on hold-out data: 0.04470545053482056
Epoch: 56
Loss on hold-out set: 0.004361390508404982
MeanAbsoluteError value on hold-out data: 0.044892217963933945
Epoch: 57
Loss on hold-out set: 0.005689913759277643
MeanAbsoluteError value on hold-out data: 0.058556243777275085
Epoch: 58
Loss on hold-out set: 0.004246262107412086
MeanAbsoluteError value on hold-out data: 0.048911526799201965
Epoch: 59
Loss on hold-out set: 0.005093036637653744
MeanAbsoluteError value on hold-out data: 0.05318644270300865
Epoch: 60
Loss on hold-out set: 0.0036519616168286455
MeanAbsoluteError value on hold-out data: 0.047186970710754395
Epoch: 61
Loss on hold-out set: 0.004227558720709854
MeanAbsoluteError value on hold-out data: 0.0474846176803112
Epoch: 62
Loss on hold-out set: 0.004108974422132106
MeanAbsoluteError value on hold-out data: 0.04744518920779228
Epoch: 63
Loss on hold-out set: 0.005444718736199368
MeanAbsoluteError value on hold-out data: 0.05280626565217972
Epoch: 64
Loss on hold-out set: 0.004702466259722745
MeanAbsoluteError value on hold-out data: 0.05185684934258461
Epoch: 65
Loss on hold-out set: 0.004349835443702575
MeanAbsoluteError value on hold-out data: 0.048153750598430634
Epoch: 66
Loss on hold-out set: 0.003012275322505861
MeanAbsoluteError value on hold-out data: 0.04121706262230873
Epoch: 67
Loss on hold-out set: 0.004486289635104568
MeanAbsoluteError value on hold-out data: 0.04917112737894058
Epoch: 68
Loss on hold-out set: 0.004108217603061348
MeanAbsoluteError value on hold-out data: 0.04596361517906189
Epoch: 69
Loss on hold-out set: 0.004665197568675994
MeanAbsoluteError value on hold-out data: 0.05329854413866997
Epoch: 70
Loss on hold-out set: 0.004409518425267092
MeanAbsoluteError value on hold-out data: 0.0522032268345356
Epoch: 71
Loss on hold-out set: 0.006212988902054923
MeanAbsoluteError value on hold-out data: 0.06464698165655136
Epoch: 72
Loss on hold-out set: 0.004093806827624671
MeanAbsoluteError value on hold-out data: 0.05194394662976265
Epoch: 73
Loss on hold-out set: 0.004843934806750009
MeanAbsoluteError value on hold-out data: 0.05443298816680908
Epoch: 74
Loss on hold-out set: 0.00406370389483575
MeanAbsoluteError value on hold-out data: 0.04508737847208977
Epoch: 75
Loss on hold-out set: 0.0046280512990626065
MeanAbsoluteError value on hold-out data: 0.05383893847465515
Epoch: 76
Loss on hold-out set: 0.004382390403311308
MeanAbsoluteError value on hold-out data: 0.04834115505218506
Epoch: 77
Loss on hold-out set: 0.003464164337952082
MeanAbsoluteError value on hold-out data: 0.046475864946842194
Epoch: 78
Loss on hold-out set: 0.005192942580355233
MeanAbsoluteError value on hold-out data: 0.05460433289408684
Epoch: 79
Loss on hold-out set: 0.005661914973691302
MeanAbsoluteError value on hold-out data: 0.05637047439813614
Epoch: 80
Loss on hold-out set: 0.005653481622606418
MeanAbsoluteError value on hold-out data: 0.056803811341524124
Epoch: 81
Loss on hold-out set: 0.003004002024873013
MeanAbsoluteError value on hold-out data: 0.04129662364721298
Epoch: 82
Loss on hold-out set: 0.005065345974320448
MeanAbsoluteError value on hold-out data: 0.05670306459069252
Epoch: 83
Loss on hold-out set: 0.005861592065469411
MeanAbsoluteError value on hold-out data: 0.05515319108963013
Epoch: 84
Loss on hold-out set: 0.003040701621150794
MeanAbsoluteError value on hold-out data: 0.040886737406253815
Epoch: 85
Loss on hold-out set: 0.006575799234652598
MeanAbsoluteError value on hold-out data: 0.06509649008512497
Epoch: 86
Loss on hold-out set: 0.0036014480528568753
MeanAbsoluteError value on hold-out data: 0.045968152582645416
Epoch: 87
Loss on hold-out set: 0.0034000335129492575
MeanAbsoluteError value on hold-out data: 0.04317089542746544
Epoch: 88
Loss on hold-out set: 0.005033801787679917
MeanAbsoluteError value on hold-out data: 0.05051025003194809
Epoch: 89
Loss on hold-out set: 0.004640953667388347
MeanAbsoluteError value on hold-out data: 0.04820301756262779
Epoch: 90
Loss on hold-out set: 0.004278595640483361
MeanAbsoluteError value on hold-out data: 0.04696953669190407
Epoch: 91
Loss on hold-out set: 0.00385535501960763
MeanAbsoluteError value on hold-out data: 0.047178253531455994
Epoch: 92
Loss on hold-out set: 0.004798595646494313
MeanAbsoluteError value on hold-out data: 0.051329657435417175
Epoch: 93
Loss on hold-out set: 0.004063006824397139
MeanAbsoluteError value on hold-out data: 0.04553618282079697
Epoch: 94
Loss on hold-out set: 0.003196471218344461
MeanAbsoluteError value on hold-out data: 0.0414997860789299
Epoch: 95
Loss on hold-out set: 0.003594063666624654
MeanAbsoluteError value on hold-out data: 0.04297053813934326
Epoch: 96
Loss on hold-out set: 0.003256017648565926
MeanAbsoluteError value on hold-out data: 0.041687559336423874
Epoch: 97
Loss on hold-out set: 0.004177482391241938
MeanAbsoluteError value on hold-out data: 0.049598176032304764
Epoch: 98
Loss on hold-out set: 0.003943223922856544
MeanAbsoluteError value on hold-out data: 0.04820382967591286
Epoch: 99
Loss on hold-out set: 0.005568026836140473
MeanAbsoluteError value on hold-out data: 0.06157048046588898
Epoch: 100
Loss on hold-out set: 0.004382458911430531
MeanAbsoluteError value on hold-out data: 0.04904875159263611
Epoch: 101
Loss on hold-out set: 0.003657840994970971
MeanAbsoluteError value on hold-out data: 0.04465354606509209
Epoch: 102
Loss on hold-out set: 0.004020773768915157
MeanAbsoluteError value on hold-out data: 0.04449153691530228
Epoch: 103
Loss on hold-out set: 0.0035411226685698096
MeanAbsoluteError value on hold-out data: 0.0450638085603714
Epoch: 104
Loss on hold-out set: 0.005348364634157501
MeanAbsoluteError value on hold-out data: 0.05484824627637863
Epoch: 105
Loss on hold-out set: 0.004487011063917491
MeanAbsoluteError value on hold-out data: 0.04741080850362778
Epoch: 106
Loss on hold-out set: 0.003383210181613992
MeanAbsoluteError value on hold-out data: 0.04156670719385147
Epoch: 107
Loss on hold-out set: 0.0051936057570856065
MeanAbsoluteError value on hold-out data: 0.05028459057211876
Epoch: 108
Loss on hold-out set: 0.0031467167512011273
MeanAbsoluteError value on hold-out data: 0.040702082216739655
Epoch: 109
Loss on hold-out set: 0.00510208167160224
MeanAbsoluteError value on hold-out data: 0.054676756262779236
Epoch: 110
Loss on hold-out set: 0.004125040304068917
MeanAbsoluteError value on hold-out data: 0.042862869799137115
Epoch: 111
Loss on hold-out set: 0.0034679077630004797
MeanAbsoluteError value on hold-out data: 0.04322469234466553
Epoch: 112
Loss on hold-out set: 0.004658777308098874
MeanAbsoluteError value on hold-out data: 0.052900560200214386
Epoch: 113
Loss on hold-out set: 0.004692989034657857
MeanAbsoluteError value on hold-out data: 0.04865110665559769
Epoch: 114
Loss on hold-out set: 0.004754808667042342
MeanAbsoluteError value on hold-out data: 0.0528593473136425
Epoch: 115
Loss on hold-out set: 0.0057855336467343334
MeanAbsoluteError value on hold-out data: 0.055894624441862106
Epoch: 116
Loss on hold-out set: 0.003928493936607418
MeanAbsoluteError value on hold-out data: 0.04488633945584297
Epoch: 117
Loss on hold-out set: 0.004172340504163386
MeanAbsoluteError value on hold-out data: 0.04702262207865715
Epoch: 118
Loss on hold-out set: 0.004807020886801183
MeanAbsoluteError value on hold-out data: 0.05176328495144844
Epoch: 119
Loss on hold-out set: 0.003811060187504872
MeanAbsoluteError value on hold-out data: 0.0469902865588665
Epoch: 120
Loss on hold-out set: 0.00381831550590792
MeanAbsoluteError value on hold-out data: 0.045641809701919556
Epoch: 121
Loss on hold-out set: 0.004248827191890757
MeanAbsoluteError value on hold-out data: 0.048966169357299805
Epoch: 122
Loss on hold-out set: 0.0036058369778880946
MeanAbsoluteError value on hold-out data: 0.04168381541967392
Epoch: 123
Loss on hold-out set: 0.004100773364035903
MeanAbsoluteError value on hold-out data: 0.04392334446310997
Epoch: 124
Loss on hold-out set: 0.0038997500975567257
MeanAbsoluteError value on hold-out data: 0.04550288990139961
Epoch: 125
Loss on hold-out set: 0.005308355455973039
MeanAbsoluteError value on hold-out data: 0.052313342690467834
Epoch: 126
Loss on hold-out set: 0.004008011054553974
MeanAbsoluteError value on hold-out data: 0.04870365932583809
Epoch: 127
Loss on hold-out set: 0.003267709898768532
MeanAbsoluteError value on hold-out data: 0.04302576184272766
Epoch: 128
Loss on hold-out set: 0.004233112305978705
MeanAbsoluteError value on hold-out data: 0.0471915528178215
Epoch: 129
Loss on hold-out set: 0.004118553460820725
MeanAbsoluteError value on hold-out data: 0.047210145741701126
Epoch: 130
Loss on hold-out set: 0.003971451626919014
MeanAbsoluteError value on hold-out data: 0.045585475862026215
Epoch: 131
Loss on hold-out set: 0.0038207559999519666
MeanAbsoluteError value on hold-out data: 0.0448627695441246
Epoch: 132
Loss on hold-out set: 0.003981325231602807
MeanAbsoluteError value on hold-out data: 0.04591643810272217
Epoch: 133
Loss on hold-out set: 0.003545386048867122
MeanAbsoluteError value on hold-out data: 0.041567642241716385
Epoch: 134
Loss on hold-out set: 0.005088228617463947
MeanAbsoluteError value on hold-out data: 0.05160125344991684
Epoch: 135
Loss on hold-out set: 0.0041962137819561915
MeanAbsoluteError value on hold-out data: 0.04911297932267189
Epoch: 136
Loss on hold-out set: 0.0037132081649217164
MeanAbsoluteError value on hold-out data: 0.04114154353737831
Epoch: 137
Loss on hold-out set: 0.0031011152114890713
MeanAbsoluteError value on hold-out data: 0.04059294983744621
Epoch: 138
Loss on hold-out set: 0.003995875285717806
MeanAbsoluteError value on hold-out data: 0.045139893889427185
Epoch: 139
Loss on hold-out set: 0.003122237845673226
MeanAbsoluteError value on hold-out data: 0.041640400886535645
Epoch: 140
Loss on hold-out set: 0.004281931158498321
MeanAbsoluteError value on hold-out data: 0.04771048203110695
Epoch: 141
Loss on hold-out set: 0.0032552267244012143
MeanAbsoluteError value on hold-out data: 0.039677198976278305
Epoch: 142
Loss on hold-out set: 0.00559848147493444
MeanAbsoluteError value on hold-out data: 0.05392390489578247
Epoch: 143
Loss on hold-out set: 0.0059323887184482855
MeanAbsoluteError value on hold-out data: 0.05441131442785263
Epoch: 144
Loss on hold-out set: 0.005214557082294242
MeanAbsoluteError value on hold-out data: 0.056880563497543335
Epoch: 145
Loss on hold-out set: 0.0045530792236891824
MeanAbsoluteError value on hold-out data: 0.04862723872065544
Epoch: 146
Loss on hold-out set: 0.0036236347054670517
MeanAbsoluteError value on hold-out data: 0.044475484639406204
Epoch: 147
Loss on hold-out set: 0.0033506386328218994
MeanAbsoluteError value on hold-out data: 0.04463585466146469
Epoch: 148
Loss on hold-out set: 0.005155291964336739
MeanAbsoluteError value on hold-out data: 0.0544474795460701
Epoch: 149
Loss on hold-out set: 0.004021008813747597
MeanAbsoluteError value on hold-out data: 0.04445909708738327
Epoch: 150
Loss on hold-out set: 0.004024541520170476
MeanAbsoluteError value on hold-out data: 0.04633030667901039
Epoch: 151
Loss on hold-out set: 0.007728476732920267
MeanAbsoluteError value on hold-out data: 0.0716855376958847
Epoch: 152
Loss on hold-out set: 0.005179071952098687
MeanAbsoluteError value on hold-out data: 0.05550815537571907
Epoch: 153
Loss on hold-out set: 0.004968357019702364
MeanAbsoluteError value on hold-out data: 0.04851960390806198
Epoch: 154
Loss on hold-out set: 0.00498737912551549
MeanAbsoluteError value on hold-out data: 0.055023446679115295
Epoch: 155
Loss on hold-out set: 0.005194889501006783
MeanAbsoluteError value on hold-out data: 0.05638764053583145
Epoch: 156
Loss on hold-out set: 0.004581515815133523
MeanAbsoluteError value on hold-out data: 0.05036319047212601
Epoch: 157
Loss on hold-out set: 0.00383222377307615
MeanAbsoluteError value on hold-out data: 0.04262305423617363
Epoch: 158
Loss on hold-out set: 0.004596868142375331
MeanAbsoluteError value on hold-out data: 0.05163036286830902
Epoch: 159
Loss on hold-out set: 0.00582751519304063
MeanAbsoluteError value on hold-out data: 0.05325257033109665
Epoch: 160
Loss on hold-out set: 0.005546956917418069
MeanAbsoluteError value on hold-out data: 0.05486201494932175
Epoch: 161
Loss on hold-out set: 0.0041823095288188936
MeanAbsoluteError value on hold-out data: 0.04575154557824135
Epoch: 162
Loss on hold-out set: 0.004053187184342134
MeanAbsoluteError value on hold-out data: 0.044609200209379196
Epoch: 163
Loss on hold-out set: 0.003805514929760983
MeanAbsoluteError value on hold-out data: 0.042562104761600494
Epoch: 164
Loss on hold-out set: 0.005286356415844669
MeanAbsoluteError value on hold-out data: 0.05336703732609749
Epoch: 165
Loss on hold-out set: 0.004364722578381924
MeanAbsoluteError value on hold-out data: 0.04756244644522667
Epoch: 166
Loss on hold-out set: 0.00312061566096657
MeanAbsoluteError value on hold-out data: 0.04058787226676941
Epoch: 167
Loss on hold-out set: 0.0033426759090568674
MeanAbsoluteError value on hold-out data: 0.04105984792113304
Epoch: 168
Loss on hold-out set: 0.003882623113704061
MeanAbsoluteError value on hold-out data: 0.04540020227432251
Epoch: 169
Loss on hold-out set: 0.0036574750832331026
MeanAbsoluteError value on hold-out data: 0.045290280133485794
Epoch: 170
Loss on hold-out set: 0.0034276863964470593
MeanAbsoluteError value on hold-out data: 0.04081539809703827
Epoch: 171
Loss on hold-out set: 0.0050402646149067505
MeanAbsoluteError value on hold-out data: 0.049163978546857834
Epoch: 172
Loss on hold-out set: 0.00442844652264428
MeanAbsoluteError value on hold-out data: 0.05376988649368286
Epoch: 173
Loss on hold-out set: 0.004365495671089248
MeanAbsoluteError value on hold-out data: 0.04857954755425453
Epoch: 174
Loss on hold-out set: 0.004306983284646106
MeanAbsoluteError value on hold-out data: 0.04532870650291443
Epoch: 175
Loss on hold-out set: 0.004948197606656896
MeanAbsoluteError value on hold-out data: 0.04947615787386894
Epoch: 176
Loss on hold-out set: 0.004334111007138793
MeanAbsoluteError value on hold-out data: 0.05064490810036659
Epoch: 177
Loss on hold-out set: 0.003789522501296903
MeanAbsoluteError value on hold-out data: 0.04495855048298836
Epoch: 178
Loss on hold-out set: 0.003371159717636673
MeanAbsoluteError value on hold-out data: 0.04400921240448952
Epoch: 179
Loss on hold-out set: 0.003332453472754232
MeanAbsoluteError value on hold-out data: 0.04150927811861038
Epoch: 180
Loss on hold-out set: 0.003682433631375285
MeanAbsoluteError value on hold-out data: 0.04549289122223854
Epoch: 181
Loss on hold-out set: 0.00671502588757951
MeanAbsoluteError value on hold-out data: 0.06365959346294403
Epoch: 182
Loss on hold-out set: 0.004040236011956279
MeanAbsoluteError value on hold-out data: 0.04688943549990654
Epoch: 183
Loss on hold-out set: 0.004277551090222244
MeanAbsoluteError value on hold-out data: 0.047735609114170074
Epoch: 184
Loss on hold-out set: 0.0041432393053056375
MeanAbsoluteError value on hold-out data: 0.04551463946700096
Epoch: 185
Loss on hold-out set: 0.0052848002524115145
MeanAbsoluteError value on hold-out data: 0.05551619082689285
Epoch: 186
Loss on hold-out set: 0.0030253246812591036
MeanAbsoluteError value on hold-out data: 0.03882633149623871
Epoch: 187
Loss on hold-out set: 0.0047862458511525275
MeanAbsoluteError value on hold-out data: 0.049808599054813385
Epoch: 188
Loss on hold-out set: 0.004595765856241709
MeanAbsoluteError value on hold-out data: 0.047034550458192825
Epoch: 189
Loss on hold-out set: 0.004179922267978422
MeanAbsoluteError value on hold-out data: 0.04890026897192001
Epoch: 190
Loss on hold-out set: 0.0031520021454382098
MeanAbsoluteError value on hold-out data: 0.041323140263557434
Epoch: 191
Loss on hold-out set: 0.0036009046169439038
MeanAbsoluteError value on hold-out data: 0.047276828438043594
Epoch: 192
Loss on hold-out set: 0.0044074908655602485
MeanAbsoluteError value on hold-out data: 0.04602205380797386
Epoch: 193
Loss on hold-out set: 0.006394909449705952
MeanAbsoluteError value on hold-out data: 0.06065796688199043
Epoch: 194
Loss on hold-out set: 0.004040199426909615
MeanAbsoluteError value on hold-out data: 0.04530983790755272
Epoch: 195
Loss on hold-out set: 0.0031861259700044207
MeanAbsoluteError value on hold-out data: 0.039863064885139465
Epoch: 196
Loss on hold-out set: 0.004324718029238284
MeanAbsoluteError value on hold-out data: 0.051073916256427765
Epoch: 197
Loss on hold-out set: 0.0037137808042308805
MeanAbsoluteError value on hold-out data: 0.045638345181941986
Epoch: 198
Loss on hold-out set: 0.004288719244007217
MeanAbsoluteError value on hold-out data: 0.04809904098510742
Epoch: 199
Loss on hold-out set: 0.004834075216326471
MeanAbsoluteError value on hold-out data: 0.04794275015592575
Epoch: 200
Loss on hold-out set: 0.004411204650654997
MeanAbsoluteError value on hold-out data: 0.05163556709885597
Epoch: 201
Loss on hold-out set: 0.004964075811011226
MeanAbsoluteError value on hold-out data: 0.04829327017068863
Epoch: 202
Loss on hold-out set: 0.004968832931665115
MeanAbsoluteError value on hold-out data: 0.05316203460097313
Epoch: 203
Loss on hold-out set: 0.004977127639760606
MeanAbsoluteError value on hold-out data: 0.05497246980667114
Epoch: 204
Loss on hold-out set: 0.0035314370164231056
MeanAbsoluteError value on hold-out data: 0.043174535036087036
Epoch: 205
Loss on hold-out set: 0.0036789040497847295
MeanAbsoluteError value on hold-out data: 0.04475150257349014
Epoch: 206
Loss on hold-out set: 0.004284350641108559
MeanAbsoluteError value on hold-out data: 0.045826416462659836
Epoch: 207
Loss on hold-out set: 0.004038673614176284
MeanAbsoluteError value on hold-out data: 0.044728729873895645
Epoch: 208
Loss on hold-out set: 0.004057773836968026
MeanAbsoluteError value on hold-out data: 0.04181160032749176
Epoch: 209
Loss on hold-out set: 0.004114836848059081
MeanAbsoluteError value on hold-out data: 0.04613488167524338
Early stopping at epoch 208
Returned to Spot: Validation loss: 0.004114836848059081
----------------------------------------------
spotPython tuning: 0.003368251623071142 [####------] 37.25% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.3109772494849313, 'lr_mult': 2.719514133188676, 'batch_size': 8, 'epochs': 65536, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adam', 'sgd_momentum': 0.8866060989462862}
Epoch: 1
Loss on hold-out set: 0.028808855843779287
MeanAbsoluteError value on hold-out data: 0.13357625901699066
Epoch: 2
Loss on hold-out set: 0.02934574014752319
MeanAbsoluteError value on hold-out data: 0.13693471252918243
Epoch: 3
Loss on hold-out set: 0.026530489840201642
MeanAbsoluteError value on hold-out data: 0.12992040812969208
Epoch: 4
Loss on hold-out set: 0.026456324432633425
MeanAbsoluteError value on hold-out data: 0.12832950055599213
Epoch: 5
Loss on hold-out set: 0.02253113167458459
MeanAbsoluteError value on hold-out data: 0.11814562231302261
Epoch: 6
Loss on hold-out set: 0.023566157115917457
MeanAbsoluteError value on hold-out data: 0.12261664122343063
Epoch: 7
Loss on hold-out set: 0.020825455418640847
MeanAbsoluteError value on hold-out data: 0.11783008277416229
Epoch: 8
Loss on hold-out set: 0.02055928840203897
MeanAbsoluteError value on hold-out data: 0.11389178037643433
Epoch: 9
Loss on hold-out set: 0.01779803658198369
MeanAbsoluteError value on hold-out data: 0.10740727931261063
Epoch: 10
Loss on hold-out set: 0.016801163394886413
MeanAbsoluteError value on hold-out data: 0.10431203246116638
Epoch: 11
Loss on hold-out set: 0.014275779825096068
MeanAbsoluteError value on hold-out data: 0.09331679344177246
Epoch: 12
Loss on hold-out set: 0.01717812782398572
MeanAbsoluteError value on hold-out data: 0.1065400019288063
Epoch: 13
Loss on hold-out set: 0.01430099788366964
MeanAbsoluteError value on hold-out data: 0.09553296864032745
Epoch: 14
Loss on hold-out set: 0.01676891378347615
MeanAbsoluteError value on hold-out data: 0.10222166776657104
Epoch: 15
Loss on hold-out set: 0.014422067379775015
MeanAbsoluteError value on hold-out data: 0.09603198617696762
Epoch: 16
Loss on hold-out set: 0.011165274907589742
MeanAbsoluteError value on hold-out data: 0.08732711523771286
Epoch: 17
Loss on hold-out set: 0.013165555202010038
MeanAbsoluteError value on hold-out data: 0.0921749696135521
Epoch: 18
Loss on hold-out set: 0.011957418057136238
MeanAbsoluteError value on hold-out data: 0.08355298638343811
Epoch: 19
Loss on hold-out set: 0.013487825550040916
MeanAbsoluteError value on hold-out data: 0.09066518396139145
Epoch: 20
Loss on hold-out set: 0.010705266656403086
MeanAbsoluteError value on hold-out data: 0.08150991052389145
Epoch: 21
Loss on hold-out set: 0.008595045815270982
MeanAbsoluteError value on hold-out data: 0.07205567508935928
Epoch: 22
Loss on hold-out set: 0.007985660585721857
MeanAbsoluteError value on hold-out data: 0.0691262036561966
Epoch: 23
Loss on hold-out set: 0.007607580539402797
MeanAbsoluteError value on hold-out data: 0.0656997337937355
Epoch: 24
Loss on hold-out set: 0.008858143076251605
MeanAbsoluteError value on hold-out data: 0.07370071113109589
Epoch: 25
Loss on hold-out set: 0.008524545211050855
MeanAbsoluteError value on hold-out data: 0.07107575982809067
Epoch: 26
Loss on hold-out set: 0.0072111993243819785
MeanAbsoluteError value on hold-out data: 0.06644042581319809
Epoch: 27
Loss on hold-out set: 0.007382404016281821
MeanAbsoluteError value on hold-out data: 0.06629405170679092
Epoch: 28
Loss on hold-out set: 0.007786900684311006
MeanAbsoluteError value on hold-out data: 0.06942614912986755
Epoch: 29
Loss on hold-out set: 0.007034299236501714
MeanAbsoluteError value on hold-out data: 0.06302906572818756
Epoch: 30
Loss on hold-out set: 0.007501931101279824
MeanAbsoluteError value on hold-out data: 0.06793062388896942
Epoch: 31
Loss on hold-out set: 0.005995530270554714
MeanAbsoluteError value on hold-out data: 0.060957685112953186
Epoch: 32
Loss on hold-out set: 0.004910927936802373
MeanAbsoluteError value on hold-out data: 0.05396965518593788
Epoch: 33
Loss on hold-out set: 0.0053180814935139525
MeanAbsoluteError value on hold-out data: 0.05641337111592293
Epoch: 34
Loss on hold-out set: 0.004978696454169327
MeanAbsoluteError value on hold-out data: 0.054727718234062195
Epoch: 35
Loss on hold-out set: 0.004395619549445416
MeanAbsoluteError value on hold-out data: 0.05113040283322334
Epoch: 36
Loss on hold-out set: 0.004474735854800153
MeanAbsoluteError value on hold-out data: 0.04916400462388992
Epoch: 37
Loss on hold-out set: 0.003713196172611788
MeanAbsoluteError value on hold-out data: 0.04629771411418915
Epoch: 38
Loss on hold-out set: 0.005267059176204432
MeanAbsoluteError value on hold-out data: 0.05380719527602196
Epoch: 39
Loss on hold-out set: 0.004706457969548769
MeanAbsoluteError value on hold-out data: 0.05020374432206154
Epoch: 40
Loss on hold-out set: 0.004074141263692199
MeanAbsoluteError value on hold-out data: 0.04467906802892685
Epoch: 41
Loss on hold-out set: 0.00443348130456319
MeanAbsoluteError value on hold-out data: 0.04800938814878464
Epoch: 42
Loss on hold-out set: 0.00419789208650687
MeanAbsoluteError value on hold-out data: 0.0493127815425396
Epoch: 43
Loss on hold-out set: 0.004726631447403251
MeanAbsoluteError value on hold-out data: 0.05107950046658516
Epoch: 44
Loss on hold-out set: 0.004314729999015598
MeanAbsoluteError value on hold-out data: 0.0472896434366703
Epoch: 45
Loss on hold-out set: 0.0040072707036559125
MeanAbsoluteError value on hold-out data: 0.046885594725608826
Epoch: 46
Loss on hold-out set: 0.0035352435201945667
MeanAbsoluteError value on hold-out data: 0.044082436710596085
Epoch: 47
Loss on hold-out set: 0.0034444587470620477
MeanAbsoluteError value on hold-out data: 0.04240681603550911
Epoch: 48
Loss on hold-out set: 0.004352668756741639
MeanAbsoluteError value on hold-out data: 0.05072614550590515
Epoch: 49
Loss on hold-out set: 0.0035258558254051757
MeanAbsoluteError value on hold-out data: 0.04270176962018013
Epoch: 50
Loss on hold-out set: 0.004551821529228044
MeanAbsoluteError value on hold-out data: 0.049717266112565994
Epoch: 51
Loss on hold-out set: 0.0035285188917585308
MeanAbsoluteError value on hold-out data: 0.04432922974228859
Epoch: 52
Loss on hold-out set: 0.0028999924298228792
MeanAbsoluteError value on hold-out data: 0.04122999683022499
Epoch: 53
Loss on hold-out set: 0.0034601382166759946
MeanAbsoluteError value on hold-out data: 0.04402974620461464
Epoch: 54
Loss on hold-out set: 0.00390862192235593
MeanAbsoluteError value on hold-out data: 0.04678460583090782
Epoch: 55
Loss on hold-out set: 0.004336440937262715
MeanAbsoluteError value on hold-out data: 0.05013314634561539
Epoch: 56
Loss on hold-out set: 0.003493002834913664
MeanAbsoluteError value on hold-out data: 0.04370970278978348
Epoch: 57
Loss on hold-out set: 0.0027604494626805383
MeanAbsoluteError value on hold-out data: 0.03882159665226936
Epoch: 58
Loss on hold-out set: 0.002842036600524903
MeanAbsoluteError value on hold-out data: 0.038848962634801865
Epoch: 59
Loss on hold-out set: 0.004102523824641187
MeanAbsoluteError value on hold-out data: 0.05149095132946968
Epoch: 60
Loss on hold-out set: 0.003382551512147888
MeanAbsoluteError value on hold-out data: 0.04143277183175087
Epoch: 61
Loss on hold-out set: 0.003048220025161036
MeanAbsoluteError value on hold-out data: 0.03585304692387581
Epoch: 62
Loss on hold-out set: 0.0034972668034147078
MeanAbsoluteError value on hold-out data: 0.0444197915494442
Epoch: 63
Loss on hold-out set: 0.004225864157840414
MeanAbsoluteError value on hold-out data: 0.04903310909867287
Epoch: 64
Loss on hold-out set: 0.0030959765779124083
MeanAbsoluteError value on hold-out data: 0.04119813069701195
Epoch: 65
Loss on hold-out set: 0.0025765875654638207
MeanAbsoluteError value on hold-out data: 0.03679788485169411
Epoch: 66
Loss on hold-out set: 0.0026625042450369187
MeanAbsoluteError value on hold-out data: 0.039023347198963165
Epoch: 67
Loss on hold-out set: 0.003213434231982223
MeanAbsoluteError value on hold-out data: 0.041186895221471786
Epoch: 68
Loss on hold-out set: 0.002946151543782387
MeanAbsoluteError value on hold-out data: 0.03724295273423195
Epoch: 69
Loss on hold-out set: 0.0024549261908855683
MeanAbsoluteError value on hold-out data: 0.03756091371178627
Epoch: 70
Loss on hold-out set: 0.002762195962101319
MeanAbsoluteError value on hold-out data: 0.03960909694433212
Epoch: 71
Loss on hold-out set: 0.0033710415354059812
MeanAbsoluteError value on hold-out data: 0.042982351034879684
Epoch: 72
Loss on hold-out set: 0.003266833123665205
MeanAbsoluteError value on hold-out data: 0.04647814854979515
Epoch: 73
Loss on hold-out set: 0.0029744563032995516
MeanAbsoluteError value on hold-out data: 0.040578704327344894
Epoch: 74
Loss on hold-out set: 0.002351904462557286
MeanAbsoluteError value on hold-out data: 0.03336485102772713
Epoch: 75
Loss on hold-out set: 0.0025888061255069546
MeanAbsoluteError value on hold-out data: 0.039163872599601746
Epoch: 76
Loss on hold-out set: 0.003551913743936702
MeanAbsoluteError value on hold-out data: 0.042717866599559784
Epoch: 77
Loss on hold-out set: 0.003311314684412393
MeanAbsoluteError value on hold-out data: 0.04005344212055206
Epoch: 78
Loss on hold-out set: 0.003059979921856307
MeanAbsoluteError value on hold-out data: 0.038170311599969864
Epoch: 79
Loss on hold-out set: 0.003352312416322284
MeanAbsoluteError value on hold-out data: 0.04073252156376839
Epoch: 80
Loss on hold-out set: 0.002882965792914068
MeanAbsoluteError value on hold-out data: 0.03811008483171463
Epoch: 81
Loss on hold-out set: 0.0023966473542570478
MeanAbsoluteError value on hold-out data: 0.03781232610344887
Epoch: 82
Loss on hold-out set: 0.0032117854509698717
MeanAbsoluteError value on hold-out data: 0.042987558990716934
Epoch: 83
Loss on hold-out set: 0.00297264085996798
MeanAbsoluteError value on hold-out data: 0.039024464786052704
Epoch: 84
Loss on hold-out set: 0.00273143813491946
MeanAbsoluteError value on hold-out data: 0.0394560731947422
Epoch: 85
Loss on hold-out set: 0.003490274556066939
MeanAbsoluteError value on hold-out data: 0.04496290907263756
Epoch: 86
Loss on hold-out set: 0.002343681540591397
MeanAbsoluteError value on hold-out data: 0.0358746275305748
Epoch: 87
Loss on hold-out set: 0.003195102098336639
MeanAbsoluteError value on hold-out data: 0.03984804451465607
Epoch: 88
Loss on hold-out set: 0.0029410681377875767
MeanAbsoluteError value on hold-out data: 0.03612300008535385
Epoch: 89
Loss on hold-out set: 0.0034626343492020263
MeanAbsoluteError value on hold-out data: 0.04153816029429436
Epoch: 90
Loss on hold-out set: 0.0028853736186743176
MeanAbsoluteError value on hold-out data: 0.03752165660262108
Epoch: 91
Loss on hold-out set: 0.003171302865283858
MeanAbsoluteError value on hold-out data: 0.041918329894542694
Epoch: 92
Loss on hold-out set: 0.003032038954858619
MeanAbsoluteError value on hold-out data: 0.04038674384355545
Epoch: 93
Loss on hold-out set: 0.002562156680812079
MeanAbsoluteError value on hold-out data: 0.03756994381546974
Epoch: 94
Loss on hold-out set: 0.0031585649336001984
MeanAbsoluteError value on hold-out data: 0.041899196803569794
Epoch: 95
Loss on hold-out set: 0.0034770835129740206
MeanAbsoluteError value on hold-out data: 0.04656809940934181
Epoch: 96
Loss on hold-out set: 0.002615913091607294
MeanAbsoluteError value on hold-out data: 0.03679464012384415
Epoch: 97
Loss on hold-out set: 0.001970147926170428
MeanAbsoluteError value on hold-out data: 0.03314230591058731
Epoch: 98
Loss on hold-out set: 0.0035127247453936817
MeanAbsoluteError value on hold-out data: 0.04368473216891289
Epoch: 99
Loss on hold-out set: 0.0025735004072837335
MeanAbsoluteError value on hold-out data: 0.03758443146944046
Epoch: 100
Loss on hold-out set: 0.002734968566648221
MeanAbsoluteError value on hold-out data: 0.03666577860713005
Epoch: 101
Loss on hold-out set: 0.002202157078212813
MeanAbsoluteError value on hold-out data: 0.03546050935983658
Epoch: 102
Loss on hold-out set: 0.002880204461306628
MeanAbsoluteError value on hold-out data: 0.041914165019989014
Epoch: 103
Loss on hold-out set: 0.00291013124239582
MeanAbsoluteError value on hold-out data: 0.04110118746757507
Epoch: 104
Loss on hold-out set: 0.0029571555067760577
MeanAbsoluteError value on hold-out data: 0.03956849128007889
Epoch: 105
Loss on hold-out set: 0.0025219905119707904
MeanAbsoluteError value on hold-out data: 0.035638514906167984
Epoch: 106
Loss on hold-out set: 0.0023214552217579788
MeanAbsoluteError value on hold-out data: 0.03529966622591019
Epoch: 107
Loss on hold-out set: 0.002470552690762193
MeanAbsoluteError value on hold-out data: 0.033914580941200256
Epoch: 108
Loss on hold-out set: 0.003051995062330542
MeanAbsoluteError value on hold-out data: 0.0402504988014698
Epoch: 109
Loss on hold-out set: 0.00234744660586952
MeanAbsoluteError value on hold-out data: 0.0364493727684021
Epoch: 110
Loss on hold-out set: 0.002367701977307565
MeanAbsoluteError value on hold-out data: 0.03516482561826706
Epoch: 111
Loss on hold-out set: 0.002376202253416475
MeanAbsoluteError value on hold-out data: 0.03703480586409569
Epoch: 112
Loss on hold-out set: 0.0030833615899992814
MeanAbsoluteError value on hold-out data: 0.041371919214725494
Epoch: 113
Loss on hold-out set: 0.0027778107783217963
MeanAbsoluteError value on hold-out data: 0.03875647485256195
Epoch: 114
Loss on hold-out set: 0.0020340654185642243
MeanAbsoluteError value on hold-out data: 0.0340954065322876
Epoch: 115
Loss on hold-out set: 0.003719407993852847
MeanAbsoluteError value on hold-out data: 0.04863536357879639
Epoch: 116
Loss on hold-out set: 0.0018798887590252746
MeanAbsoluteError value on hold-out data: 0.03144766017794609
Epoch: 117
Loss on hold-out set: 0.003505514026313138
MeanAbsoluteError value on hold-out data: 0.04707624763250351
Epoch: 118
Loss on hold-out set: 0.003386752889797974
MeanAbsoluteError value on hold-out data: 0.042054541409015656
Epoch: 119
Loss on hold-out set: 0.0030755483542299388
MeanAbsoluteError value on hold-out data: 0.04518696665763855
Epoch: 120
Loss on hold-out set: 0.002892901787019678
MeanAbsoluteError value on hold-out data: 0.03975996747612953
Epoch: 121
Loss on hold-out set: 0.0027022867311882835
MeanAbsoluteError value on hold-out data: 0.04114866629242897
Epoch: 122
Loss on hold-out set: 0.0024588177620898932
MeanAbsoluteError value on hold-out data: 0.03598293662071228
Epoch: 123
Loss on hold-out set: 0.00288838297159313
MeanAbsoluteError value on hold-out data: 0.03916892781853676
Epoch: 124
Loss on hold-out set: 0.004489827559537892
MeanAbsoluteError value on hold-out data: 0.0507410503923893
Epoch: 125
Loss on hold-out set: 0.0027301438891108296
MeanAbsoluteError value on hold-out data: 0.036141637712717056
Epoch: 126
Loss on hold-out set: 0.0025364499114833676
MeanAbsoluteError value on hold-out data: 0.035672370344400406
Epoch: 127
Loss on hold-out set: 0.0026723200495134256
MeanAbsoluteError value on hold-out data: 0.037059031426906586
Epoch: 128
Loss on hold-out set: 0.001970300134608375
MeanAbsoluteError value on hold-out data: 0.033223457634449005
Epoch: 129
Loss on hold-out set: 0.002724052061430963
MeanAbsoluteError value on hold-out data: 0.0384664423763752
Epoch: 130
Loss on hold-out set: 0.0032468737512030394
MeanAbsoluteError value on hold-out data: 0.03894685581326485
Epoch: 131
Loss on hold-out set: 0.0028757214022334665
MeanAbsoluteError value on hold-out data: 0.04118064045906067
Epoch: 132
Loss on hold-out set: 0.0033381646330541883
MeanAbsoluteError value on hold-out data: 0.04149344563484192
Epoch: 133
Loss on hold-out set: 0.0033040789835228537
MeanAbsoluteError value on hold-out data: 0.04108375310897827
Epoch: 134
Loss on hold-out set: 0.004196968275784074
MeanAbsoluteError value on hold-out data: 0.05342485383152962
Epoch: 135
Loss on hold-out set: 0.0033585049631686785
MeanAbsoluteError value on hold-out data: 0.04033457487821579
Epoch: 136
Loss on hold-out set: 0.0022895537687490056
MeanAbsoluteError value on hold-out data: 0.0354466512799263
Epoch: 137
Loss on hold-out set: 0.002748517989714042
MeanAbsoluteError value on hold-out data: 0.03812757134437561
Epoch: 138
Loss on hold-out set: 0.0027239214748413744
MeanAbsoluteError value on hold-out data: 0.039329223334789276
Epoch: 139
Loss on hold-out set: 0.0034351417347543724
MeanAbsoluteError value on hold-out data: 0.04412246122956276
Epoch: 140
Loss on hold-out set: 0.0027103152204194644
MeanAbsoluteError value on hold-out data: 0.03729460388422012
Epoch: 141
Loss on hold-out set: 0.0029632393546451473
MeanAbsoluteError value on hold-out data: 0.03786858171224594
Epoch: 142
Loss on hold-out set: 0.0027773194551149287
MeanAbsoluteError value on hold-out data: 0.041074976325035095
Epoch: 143
Loss on hold-out set: 0.0027369724243487183
MeanAbsoluteError value on hold-out data: 0.036134183406829834
Epoch: 144
Loss on hold-out set: 0.0027925701900752948
MeanAbsoluteError value on hold-out data: 0.039696332067251205
Epoch: 145
Loss on hold-out set: 0.0027987589059385322
MeanAbsoluteError value on hold-out data: 0.03830705210566521
Epoch: 146
Loss on hold-out set: 0.002118261270592675
MeanAbsoluteError value on hold-out data: 0.032048549503088
Epoch: 147
Loss on hold-out set: 0.0026702580921425436
MeanAbsoluteError value on hold-out data: 0.03913275897502899
Epoch: 148
Loss on hold-out set: 0.002973338904619021
MeanAbsoluteError value on hold-out data: 0.03874319791793823
Epoch: 149
Loss on hold-out set: 0.0027580581234743526
MeanAbsoluteError value on hold-out data: 0.03870348259806633
Epoch: 150
Loss on hold-out set: 0.002547500120463634
MeanAbsoluteError value on hold-out data: 0.037811677902936935
Epoch: 151
Loss on hold-out set: 0.002237480138367238
MeanAbsoluteError value on hold-out data: 0.03605836257338524
Epoch: 152
Loss on hold-out set: 0.002997440454476562
MeanAbsoluteError value on hold-out data: 0.04281832277774811
Epoch: 153
Loss on hold-out set: 0.002703139988864821
MeanAbsoluteError value on hold-out data: 0.03984465077519417
Epoch: 154
Loss on hold-out set: 0.0030321715411877163
MeanAbsoluteError value on hold-out data: 0.04317194223403931
Epoch: 155
Loss on hold-out set: 0.004170764329549121
MeanAbsoluteError value on hold-out data: 0.047389719635248184
Epoch: 156
Loss on hold-out set: 0.0029391617648989745
MeanAbsoluteError value on hold-out data: 0.037799932062625885
Epoch: 157
Loss on hold-out set: 0.0028489424546837413
MeanAbsoluteError value on hold-out data: 0.03721475228667259
Epoch: 158
Loss on hold-out set: 0.0022279692577859877
MeanAbsoluteError value on hold-out data: 0.03300301730632782
Epoch: 159
Loss on hold-out set: 0.0024600580202930266
MeanAbsoluteError value on hold-out data: 0.03824391961097717
Epoch: 160
Loss on hold-out set: 0.0027809503096106803
MeanAbsoluteError value on hold-out data: 0.04189863055944443
Epoch: 161
Loss on hold-out set: 0.0025374560439223913
MeanAbsoluteError value on hold-out data: 0.03916699439287186
Epoch: 162
Loss on hold-out set: 0.0024293435739022435
MeanAbsoluteError value on hold-out data: 0.03434930369257927
Epoch: 163
Loss on hold-out set: 0.003136819859623517
MeanAbsoluteError value on hold-out data: 0.039723217487335205
Epoch: 164
Loss on hold-out set: 0.002446730382201311
MeanAbsoluteError value on hold-out data: 0.03716033697128296
Epoch: 165
Loss on hold-out set: 0.002848062573129458
MeanAbsoluteError value on hold-out data: 0.039908744394779205
Epoch: 166
Loss on hold-out set: 0.0032810119308506777
MeanAbsoluteError value on hold-out data: 0.04243309795856476
Epoch: 167
Loss on hold-out set: 0.003748042199540099
MeanAbsoluteError value on hold-out data: 0.049865759909152985
Epoch: 168
Loss on hold-out set: 0.0022672825335145093
MeanAbsoluteError value on hold-out data: 0.03487110510468483
Epoch: 169
Loss on hold-out set: 0.0021118419183614222
MeanAbsoluteError value on hold-out data: 0.03438548743724823
Epoch: 170
Loss on hold-out set: 0.0025661303340089752
MeanAbsoluteError value on hold-out data: 0.03518914058804512
Epoch: 171
Loss on hold-out set: 0.0024890891463177182
MeanAbsoluteError value on hold-out data: 0.039675891399383545
Epoch: 172
Loss on hold-out set: 0.0019021226931056987
MeanAbsoluteError value on hold-out data: 0.031242765486240387
Epoch: 173
Loss on hold-out set: 0.0033775878209302106
MeanAbsoluteError value on hold-out data: 0.04128561168909073
Epoch: 174
Loss on hold-out set: 0.0024606048536952585
MeanAbsoluteError value on hold-out data: 0.03708546981215477
Epoch: 175
Loss on hold-out set: 0.002730675306673603
MeanAbsoluteError value on hold-out data: 0.0372406430542469
Epoch: 176
Loss on hold-out set: 0.0023838004631933905
MeanAbsoluteError value on hold-out data: 0.03548148646950722
Epoch: 177
Loss on hold-out set: 0.0026433400658118587
MeanAbsoluteError value on hold-out data: 0.036778584122657776
Epoch: 178
Loss on hold-out set: 0.00318054241085376
MeanAbsoluteError value on hold-out data: 0.041364528238773346
Epoch: 179
Loss on hold-out set: 0.002336847039834155
MeanAbsoluteError value on hold-out data: 0.03620268404483795
Epoch: 180
Loss on hold-out set: 0.001923860254464671
MeanAbsoluteError value on hold-out data: 0.03165613114833832
Epoch: 181
Loss on hold-out set: 0.0022659683477525647
MeanAbsoluteError value on hold-out data: 0.03660758584737778
Epoch: 182
Loss on hold-out set: 0.002373866059075992
MeanAbsoluteError value on hold-out data: 0.033969007432460785
Epoch: 183
Loss on hold-out set: 0.0021505274650591767
MeanAbsoluteError value on hold-out data: 0.03373769298195839
Epoch: 184
Loss on hold-out set: 0.00185963183129819
MeanAbsoluteError value on hold-out data: 0.03285226970911026
Epoch: 185
Loss on hold-out set: 0.0029601056747579654
MeanAbsoluteError value on hold-out data: 0.03807693347334862
Epoch: 186
Loss on hold-out set: 0.002492216908936634
MeanAbsoluteError value on hold-out data: 0.03644612804055214
Epoch: 187
Loss on hold-out set: 0.0025158773381630645
MeanAbsoluteError value on hold-out data: 0.03852403163909912
Epoch: 188
Loss on hold-out set: 0.0024633022104880134
MeanAbsoluteError value on hold-out data: 0.038114920258522034
Epoch: 189
Loss on hold-out set: 0.002626437271062873
MeanAbsoluteError value on hold-out data: 0.03989936783909798
Epoch: 190
Loss on hold-out set: 0.0024381603549332603
MeanAbsoluteError value on hold-out data: 0.035620927810668945
Epoch: 191
Loss on hold-out set: 0.003367828211354974
MeanAbsoluteError value on hold-out data: 0.041950467973947525
Epoch: 192
Loss on hold-out set: 0.002494623568245994
MeanAbsoluteError value on hold-out data: 0.035492192953825
Epoch: 193
Loss on hold-out set: 0.0027211303945238654
MeanAbsoluteError value on hold-out data: 0.0372777096927166
Epoch: 194
Loss on hold-out set: 0.003118603131856377
MeanAbsoluteError value on hold-out data: 0.04000675678253174
Epoch: 195
Loss on hold-out set: 0.00205903669580278
MeanAbsoluteError value on hold-out data: 0.033240970224142075
Epoch: 196
Loss on hold-out set: 0.0025116314737763453
MeanAbsoluteError value on hold-out data: 0.03723686560988426
Epoch: 197
Loss on hold-out set: 0.002468623223984124
MeanAbsoluteError value on hold-out data: 0.03759881481528282
Epoch: 198
Loss on hold-out set: 0.002325806593657226
MeanAbsoluteError value on hold-out data: 0.034989893436431885
Epoch: 199
Loss on hold-out set: 0.0019586004545042095
MeanAbsoluteError value on hold-out data: 0.033894818276166916
Epoch: 200
Loss on hold-out set: 0.002123175612436362
MeanAbsoluteError value on hold-out data: 0.03454357385635376
Epoch: 201
Loss on hold-out set: 0.0023341016931226477
MeanAbsoluteError value on hold-out data: 0.03506069257855415
Epoch: 202
Loss on hold-out set: 0.002763977997299088
MeanAbsoluteError value on hold-out data: 0.038737181574106216
Epoch: 203
Loss on hold-out set: 0.0019236830534952645
MeanAbsoluteError value on hold-out data: 0.03083854913711548
Epoch: 204
Loss on hold-out set: 0.0027278681411285347
MeanAbsoluteError value on hold-out data: 0.037600327283144
Epoch: 205
Loss on hold-out set: 0.003057119713814341
MeanAbsoluteError value on hold-out data: 0.041003599762916565
Epoch: 206
Loss on hold-out set: 0.0020753313736732756
MeanAbsoluteError value on hold-out data: 0.03326445445418358
Epoch: 207
Loss on hold-out set: 0.0020561618393434115
MeanAbsoluteError value on hold-out data: 0.03360302746295929
Epoch: 208
Loss on hold-out set: 0.00201691764538593
MeanAbsoluteError value on hold-out data: 0.032639242708683014
Epoch: 209
Loss on hold-out set: 0.003118973113535168
MeanAbsoluteError value on hold-out data: 0.040214311331510544
Epoch: 210
Loss on hold-out set: 0.002702362113938618
MeanAbsoluteError value on hold-out data: 0.03817174211144447
Epoch: 211
Loss on hold-out set: 0.0026874755230413654
MeanAbsoluteError value on hold-out data: 0.038264546543359756
Epoch: 212
Loss on hold-out set: 0.002990385194272293
MeanAbsoluteError value on hold-out data: 0.039705898612737656
Epoch: 213
Loss on hold-out set: 0.0026393066478991195
MeanAbsoluteError value on hold-out data: 0.03635413572192192
Epoch: 214
Loss on hold-out set: 0.0023868326419400738
MeanAbsoluteError value on hold-out data: 0.03674287721514702
Epoch: 215
Loss on hold-out set: 0.0019909137810923553
MeanAbsoluteError value on hold-out data: 0.03431449830532074
Epoch: 216
Loss on hold-out set: 0.0033009788940513603
MeanAbsoluteError value on hold-out data: 0.04548691585659981
Epoch: 217
Loss on hold-out set: 0.0025456675954812547
MeanAbsoluteError value on hold-out data: 0.035575900226831436
Epoch: 218
Loss on hold-out set: 0.00235386040999162
MeanAbsoluteError value on hold-out data: 0.03673693165183067
Epoch: 219
Loss on hold-out set: 0.002511094505806748
MeanAbsoluteError value on hold-out data: 0.034012243151664734
Epoch: 220
Loss on hold-out set: 0.0022236388605578164
MeanAbsoluteError value on hold-out data: 0.03443867340683937
Epoch: 221
Loss on hold-out set: 0.002340444656989635
MeanAbsoluteError value on hold-out data: 0.03513540327548981
Epoch: 222
Loss on hold-out set: 0.0019473401955206338
MeanAbsoluteError value on hold-out data: 0.03205731511116028
Epoch: 223
Loss on hold-out set: 0.001992399411392398
MeanAbsoluteError value on hold-out data: 0.032073117792606354
Epoch: 224
Loss on hold-out set: 0.001926261895278003
MeanAbsoluteError value on hold-out data: 0.03241703286767006
Epoch: 225
Loss on hold-out set: 0.002929074873559569
MeanAbsoluteError value on hold-out data: 0.03747331723570824
Epoch: 226
Loss on hold-out set: 0.002349058936631895
MeanAbsoluteError value on hold-out data: 0.03472162038087845
Epoch: 227
Loss on hold-out set: 0.0022662256715672187
MeanAbsoluteError value on hold-out data: 0.03337038308382034
Epoch: 228
Loss on hold-out set: 0.00287616520348054
MeanAbsoluteError value on hold-out data: 0.03575946018099785
Epoch: 229
Loss on hold-out set: 0.001928766825585626
MeanAbsoluteError value on hold-out data: 0.03143159672617912
Epoch: 230
Loss on hold-out set: 0.002731600140625807
MeanAbsoluteError value on hold-out data: 0.03871176019310951
Epoch: 231
Loss on hold-out set: 0.0023054307660602623
MeanAbsoluteError value on hold-out data: 0.03506891056895256
Epoch: 232
Loss on hold-out set: 0.0023352978054103197
MeanAbsoluteError value on hold-out data: 0.0360250361263752
Epoch: 233
Loss on hold-out set: 0.0023317649595954114
MeanAbsoluteError value on hold-out data: 0.03693224862217903
Epoch: 234
Loss on hold-out set: 0.0023997933848908075
MeanAbsoluteError value on hold-out data: 0.0342111811041832
Epoch: 235
Loss on hold-out set: 0.002134672067385461
MeanAbsoluteError value on hold-out data: 0.035412270575761795
Epoch: 236
Loss on hold-out set: 0.0025938858866299454
MeanAbsoluteError value on hold-out data: 0.03928161412477493
Epoch: 237
Loss on hold-out set: 0.002330377259855404
MeanAbsoluteError value on hold-out data: 0.03642522171139717
Epoch: 238
Loss on hold-out set: 0.002216273986146246
MeanAbsoluteError value on hold-out data: 0.03397803008556366
Epoch: 239
Loss on hold-out set: 0.0021937370520869366
MeanAbsoluteError value on hold-out data: 0.03582868352532387
Epoch: 240
Loss on hold-out set: 0.002061252139882479
MeanAbsoluteError value on hold-out data: 0.03185766935348511
Epoch: 241
Loss on hold-out set: 0.001987360241688102
MeanAbsoluteError value on hold-out data: 0.03170314431190491
Epoch: 242
Loss on hold-out set: 0.0022469812048305023
MeanAbsoluteError value on hold-out data: 0.03590289503335953
Epoch: 243
Loss on hold-out set: 0.0021175195472192413
MeanAbsoluteError value on hold-out data: 0.032654330134391785
Epoch: 244
Loss on hold-out set: 0.0019139778573605184
MeanAbsoluteError value on hold-out data: 0.031501855701208115
Epoch: 245
Loss on hold-out set: 0.0022820974615904944
MeanAbsoluteError value on hold-out data: 0.03417139872908592
Epoch: 246
Loss on hold-out set: 0.002244444268351225
MeanAbsoluteError value on hold-out data: 0.03446256369352341
Epoch: 247
Loss on hold-out set: 0.002683169749185541
MeanAbsoluteError value on hold-out data: 0.04007621854543686
Epoch: 248
Loss on hold-out set: 0.0027288013248165186
MeanAbsoluteError value on hold-out data: 0.037482596933841705
Epoch: 249
Loss on hold-out set: 0.0026156595099325244
MeanAbsoluteError value on hold-out data: 0.03837350383400917
Epoch: 250
Loss on hold-out set: 0.002929530543042347
MeanAbsoluteError value on hold-out data: 0.041764453053474426
Epoch: 251
Loss on hold-out set: 0.003119833494757155
MeanAbsoluteError value on hold-out data: 0.04136435687541962
Epoch: 252
Loss on hold-out set: 0.0021354400592635534
MeanAbsoluteError value on hold-out data: 0.03270137682557106
Epoch: 253
Loss on hold-out set: 0.0020667606578698675
MeanAbsoluteError value on hold-out data: 0.03219863772392273
Epoch: 254
Loss on hold-out set: 0.0018997484860990785
MeanAbsoluteError value on hold-out data: 0.032059602439403534
Epoch: 255
Loss on hold-out set: 0.002224106621916259
MeanAbsoluteError value on hold-out data: 0.03458153456449509
Epoch: 256
Loss on hold-out set: 0.0031048622898340815
MeanAbsoluteError value on hold-out data: 0.03971586003899574
Epoch: 257
Loss on hold-out set: 0.0022661392852713013
MeanAbsoluteError value on hold-out data: 0.03455143794417381
Epoch: 258
Loss on hold-out set: 0.0030917801517429517
MeanAbsoluteError value on hold-out data: 0.03902418538928032
Epoch: 259
Loss on hold-out set: 0.002848694081062843
MeanAbsoluteError value on hold-out data: 0.03657340630888939
Epoch: 260
Loss on hold-out set: 0.0017075912236530137
MeanAbsoluteError value on hold-out data: 0.0310507845133543
Epoch: 261
Loss on hold-out set: 0.002636663557112977
MeanAbsoluteError value on hold-out data: 0.0362427718937397
Epoch: 262
Loss on hold-out set: 0.0023608247544248833
MeanAbsoluteError value on hold-out data: 0.034732069820165634
Epoch: 263
Loss on hold-out set: 0.002810834612893431
MeanAbsoluteError value on hold-out data: 0.03845186531543732
Epoch: 264
Loss on hold-out set: 0.0030014309541959512
MeanAbsoluteError value on hold-out data: 0.040907178074121475
Epoch: 265
Loss on hold-out set: 0.002614907157533851
MeanAbsoluteError value on hold-out data: 0.037120793014764786
Epoch: 266
Loss on hold-out set: 0.0021114651746373917
MeanAbsoluteError value on hold-out data: 0.03375333547592163
Epoch: 267
Loss on hold-out set: 0.0028053808361475697
MeanAbsoluteError value on hold-out data: 0.03827633708715439
Epoch: 268
Loss on hold-out set: 0.002895405970967228
MeanAbsoluteError value on hold-out data: 0.03730730339884758
Epoch: 269
Loss on hold-out set: 0.002369586440373065
MeanAbsoluteError value on hold-out data: 0.03564135357737541
Epoch: 270
Loss on hold-out set: 0.0020547545833611174
MeanAbsoluteError value on hold-out data: 0.03394229710102081
Epoch: 271
Loss on hold-out set: 0.0021739642956833307
MeanAbsoluteError value on hold-out data: 0.03339829295873642
Epoch: 272
Loss on hold-out set: 0.0030794857226091586
MeanAbsoluteError value on hold-out data: 0.04515623301267624
Epoch: 273
Loss on hold-out set: 0.0029916393281095416
MeanAbsoluteError value on hold-out data: 0.04011210426688194
Epoch: 274
Loss on hold-out set: 0.0024130100064212456
MeanAbsoluteError value on hold-out data: 0.03588829189538956
Epoch: 275
Loss on hold-out set: 0.002775160916682676
MeanAbsoluteError value on hold-out data: 0.03543584793806076
Epoch: 276
Loss on hold-out set: 0.0027590162277001105
MeanAbsoluteError value on hold-out data: 0.03690433129668236
Epoch: 277
Loss on hold-out set: 0.001935140156523343
MeanAbsoluteError value on hold-out data: 0.032889217138290405
Epoch: 278
Loss on hold-out set: 0.001977274154533485
MeanAbsoluteError value on hold-out data: 0.03105400688946247
Epoch: 279
Loss on hold-out set: 0.0032632613897715743
MeanAbsoluteError value on hold-out data: 0.040724243968725204
Epoch: 280
Loss on hold-out set: 0.002164074716060177
MeanAbsoluteError value on hold-out data: 0.0342164970934391
Epoch: 281
Loss on hold-out set: 0.003674438713412536
MeanAbsoluteError value on hold-out data: 0.04828200861811638
Epoch: 282
Loss on hold-out set: 0.002242342388183859
MeanAbsoluteError value on hold-out data: 0.036047302186489105
Epoch: 283
Loss on hold-out set: 0.002436301018430018
MeanAbsoluteError value on hold-out data: 0.0339755043387413
Epoch: 284
Loss on hold-out set: 0.002624339632395851
MeanAbsoluteError value on hold-out data: 0.036041226238012314
Epoch: 285
Loss on hold-out set: 0.0020822503482984182
MeanAbsoluteError value on hold-out data: 0.03333286941051483
Epoch: 286
Loss on hold-out set: 0.0022224470847408825
MeanAbsoluteError value on hold-out data: 0.03517219051718712
Epoch: 287
Loss on hold-out set: 0.0023515372319563633
MeanAbsoluteError value on hold-out data: 0.03653329983353615
Epoch: 288
Loss on hold-out set: 0.0031503965889753184
MeanAbsoluteError value on hold-out data: 0.041412051767110825
Epoch: 289
Loss on hold-out set: 0.0023759028048707955
MeanAbsoluteError value on hold-out data: 0.034723155200481415
Epoch: 290
Loss on hold-out set: 0.001954907796492702
MeanAbsoluteError value on hold-out data: 0.0331200510263443
Epoch: 291
Loss on hold-out set: 0.0021567781774425193
MeanAbsoluteError value on hold-out data: 0.03434132784605026
Epoch: 292
Loss on hold-out set: 0.001961855711047783
MeanAbsoluteError value on hold-out data: 0.03245284780859947
Epoch: 293
Loss on hold-out set: 0.0019020762112248984
MeanAbsoluteError value on hold-out data: 0.032367851585149765
Epoch: 294
Loss on hold-out set: 0.0023243635981711314
MeanAbsoluteError value on hold-out data: 0.03446073830127716
Epoch: 295
Loss on hold-out set: 0.0025741689299282277
MeanAbsoluteError value on hold-out data: 0.03841293603181839
Epoch: 296
Loss on hold-out set: 0.002859183778606453
MeanAbsoluteError value on hold-out data: 0.04052061587572098
Epoch: 297
Loss on hold-out set: 0.0029398269750680285
MeanAbsoluteError value on hold-out data: 0.03857241943478584
Epoch: 298
Loss on hold-out set: 0.003150541843895457
MeanAbsoluteError value on hold-out data: 0.04339417442679405
Epoch: 299
Loss on hold-out set: 0.0031573618716241696
MeanAbsoluteError value on hold-out data: 0.04216242954134941
Epoch: 300
Loss on hold-out set: 0.00217031950045279
MeanAbsoluteError value on hold-out data: 0.03589525818824768
Epoch: 301
Loss on hold-out set: 0.0025306441606708654
MeanAbsoluteError value on hold-out data: 0.035687923431396484
Epoch: 302
Loss on hold-out set: 0.0027028869448450245
MeanAbsoluteError value on hold-out data: 0.03762075677514076
Epoch: 303
Loss on hold-out set: 0.002391685426884674
MeanAbsoluteError value on hold-out data: 0.03733542934060097
Epoch: 304
Loss on hold-out set: 0.0025518712553955418
MeanAbsoluteError value on hold-out data: 0.038472920656204224
Epoch: 305
Loss on hold-out set: 0.0027540582393014213
MeanAbsoluteError value on hold-out data: 0.039504602551460266
Epoch: 306
Loss on hold-out set: 0.002739803649570891
MeanAbsoluteError value on hold-out data: 0.03640884906053543
Epoch: 307
Loss on hold-out set: 0.0022758449531944565
MeanAbsoluteError value on hold-out data: 0.03211766108870506
Epoch: 308
Loss on hold-out set: 0.002638539959949221
MeanAbsoluteError value on hold-out data: 0.037336524575948715
Epoch: 309
Loss on hold-out set: 0.0024270781018697705
MeanAbsoluteError value on hold-out data: 0.03465631976723671
Epoch: 310
Loss on hold-out set: 0.0019805123010883108
MeanAbsoluteError value on hold-out data: 0.032930489629507065
Epoch: 311
Loss on hold-out set: 0.002549992471406432
MeanAbsoluteError value on hold-out data: 0.03847580775618553
Epoch: 312
Loss on hold-out set: 0.0029530425626465955
MeanAbsoluteError value on hold-out data: 0.03796922042965889
Epoch: 313
Loss on hold-out set: 0.0024955250662874037
MeanAbsoluteError value on hold-out data: 0.03653900325298309
Epoch: 314
Loss on hold-out set: 0.0020873318648419194
MeanAbsoluteError value on hold-out data: 0.034399230033159256
Epoch: 315
Loss on hold-out set: 0.001677552127818528
MeanAbsoluteError value on hold-out data: 0.030593687668442726
Epoch: 316
Loss on hold-out set: 0.0024312863549168563
MeanAbsoluteError value on hold-out data: 0.03659350797533989
Epoch: 317
Loss on hold-out set: 0.0020659202424499917
MeanAbsoluteError value on hold-out data: 0.03266250342130661
Epoch: 318
Loss on hold-out set: 0.0022499965163756555
MeanAbsoluteError value on hold-out data: 0.03467656299471855
Epoch: 319
Loss on hold-out set: 0.002289839502497527
MeanAbsoluteError value on hold-out data: 0.03571030870079994
Epoch: 320
Loss on hold-out set: 0.0036381397750167373
MeanAbsoluteError value on hold-out data: 0.044233351945877075
Epoch: 321
Loss on hold-out set: 0.002066712779005205
MeanAbsoluteError value on hold-out data: 0.033442422747612
Epoch: 322
Loss on hold-out set: 0.002428612154050681
MeanAbsoluteError value on hold-out data: 0.03699648007750511
Epoch: 323
Loss on hold-out set: 0.003406185999904808
MeanAbsoluteError value on hold-out data: 0.04452109709382057
Epoch: 324
Loss on hold-out set: 0.00202719475629764
MeanAbsoluteError value on hold-out data: 0.032891567796468735
Epoch: 325
Loss on hold-out set: 0.0027425945889645894
MeanAbsoluteError value on hold-out data: 0.037224654108285904
Epoch: 326
Loss on hold-out set: 0.0026199384592473507
MeanAbsoluteError value on hold-out data: 0.03881862759590149
Epoch: 327
Loss on hold-out set: 0.00253979940699585
MeanAbsoluteError value on hold-out data: 0.03577187657356262
Epoch: 328
Loss on hold-out set: 0.002301428888274945
MeanAbsoluteError value on hold-out data: 0.036056164652109146
Epoch: 329
Loss on hold-out set: 0.002530440977639764
MeanAbsoluteError value on hold-out data: 0.036971062421798706
Epoch: 330
Loss on hold-out set: 0.002559430333540628
MeanAbsoluteError value on hold-out data: 0.03860405087471008
Epoch: 331
Loss on hold-out set: 0.003011111200689093
MeanAbsoluteError value on hold-out data: 0.0439005009829998
Epoch: 332
Loss on hold-out set: 0.002485938476686562
MeanAbsoluteError value on hold-out data: 0.03499380871653557
Epoch: 333
Loss on hold-out set: 0.0020150693354049794
MeanAbsoluteError value on hold-out data: 0.034072551876306534
Epoch: 334
Loss on hold-out set: 0.0026149099078458292
MeanAbsoluteError value on hold-out data: 0.037094030529260635
Epoch: 335
Loss on hold-out set: 0.002423344399798416
MeanAbsoluteError value on hold-out data: 0.03431878983974457
Epoch: 336
Loss on hold-out set: 0.0023220331564325057
MeanAbsoluteError value on hold-out data: 0.03475513681769371
Epoch: 337
Loss on hold-out set: 0.0029807628735924433
MeanAbsoluteError value on hold-out data: 0.03880266472697258
Epoch: 338
Loss on hold-out set: 0.0018045065991923604
MeanAbsoluteError value on hold-out data: 0.031155923381447792
Epoch: 339
Loss on hold-out set: 0.002428926707484367
MeanAbsoluteError value on hold-out data: 0.03422600403428078
Epoch: 340
Loss on hold-out set: 0.002790375806446383
MeanAbsoluteError value on hold-out data: 0.037752047181129456
Epoch: 341
Loss on hold-out set: 0.0022006946635787913
MeanAbsoluteError value on hold-out data: 0.03339681774377823
Epoch: 342
Loss on hold-out set: 0.00218405726512796
MeanAbsoluteError value on hold-out data: 0.03437298908829689
Epoch: 343
Loss on hold-out set: 0.0018294203190108466
MeanAbsoluteError value on hold-out data: 0.0309623870998621
Epoch: 344
Loss on hold-out set: 0.0024162575535133088
MeanAbsoluteError value on hold-out data: 0.037665337324142456
Epoch: 345
Loss on hold-out set: 0.0033217157883643125
MeanAbsoluteError value on hold-out data: 0.04309093952178955
Epoch: 346
Loss on hold-out set: 0.0025517863258229276
MeanAbsoluteError value on hold-out data: 0.03903021663427353
Epoch: 347
Loss on hold-out set: 0.0018311513757860091
MeanAbsoluteError value on hold-out data: 0.031216692179441452
Epoch: 348
Loss on hold-out set: 0.0019252416256533348
MeanAbsoluteError value on hold-out data: 0.03386108577251434
Epoch: 349
Loss on hold-out set: 0.002405032610496212
MeanAbsoluteError value on hold-out data: 0.03570226579904556
Epoch: 350
Loss on hold-out set: 0.0023976083137217516
MeanAbsoluteError value on hold-out data: 0.03521696850657463
Epoch: 351
Loss on hold-out set: 0.0025036761040897353
MeanAbsoluteError value on hold-out data: 0.036834776401519775
Epoch: 352
Loss on hold-out set: 0.002228704093508177
MeanAbsoluteError value on hold-out data: 0.03351466357707977
Epoch: 353
Loss on hold-out set: 0.002660474087430262
MeanAbsoluteError value on hold-out data: 0.035297468304634094
Epoch: 354
Loss on hold-out set: 0.001695639824519228
MeanAbsoluteError value on hold-out data: 0.031212659552693367
Epoch: 355
Loss on hold-out set: 0.002410483188884284
MeanAbsoluteError value on hold-out data: 0.03577938303351402
Epoch: 356
Loss on hold-out set: 0.002124706701004853
MeanAbsoluteError value on hold-out data: 0.03257161006331444
Epoch: 357
Loss on hold-out set: 0.002439557194807812
MeanAbsoluteError value on hold-out data: 0.03613678738474846
Epoch: 358
Loss on hold-out set: 0.002581867508859815
MeanAbsoluteError value on hold-out data: 0.037428781390190125
Epoch: 359
Loss on hold-out set: 0.0026605052078498134
MeanAbsoluteError value on hold-out data: 0.03775331750512123
Epoch: 360
Loss on hold-out set: 0.002197592304774413
MeanAbsoluteError value on hold-out data: 0.03381218761205673
Epoch: 361
Loss on hold-out set: 0.0023246433840157757
MeanAbsoluteError value on hold-out data: 0.03561101108789444
Epoch: 362
Loss on hold-out set: 0.0029994043487883907
MeanAbsoluteError value on hold-out data: 0.0420827642083168
Epoch: 363
Loss on hold-out set: 0.002859372026777189
MeanAbsoluteError value on hold-out data: 0.03766573593020439
Epoch: 364
Loss on hold-out set: 0.002332326582338857
MeanAbsoluteError value on hold-out data: 0.03352559730410576
Epoch: 365
Loss on hold-out set: 0.0024507235227103686
MeanAbsoluteError value on hold-out data: 0.03770124912261963
Epoch: 366
Loss on hold-out set: 0.0024938822814300167
MeanAbsoluteError value on hold-out data: 0.033603083342313766
Epoch: 367
Loss on hold-out set: 0.0023627176154772506
MeanAbsoluteError value on hold-out data: 0.035066355019807816
Epoch: 368
Loss on hold-out set: 0.0029090574787819365
MeanAbsoluteError value on hold-out data: 0.03688685595989227
Epoch: 369
Loss on hold-out set: 0.001943917579314745
MeanAbsoluteError value on hold-out data: 0.03274200111627579
Epoch: 370
Loss on hold-out set: 0.002215645188698545
MeanAbsoluteError value on hold-out data: 0.03350064903497696
Epoch: 371
Loss on hold-out set: 0.0018292391396244057
MeanAbsoluteError value on hold-out data: 0.029991531744599342
Epoch: 372
Loss on hold-out set: 0.0021571897971290653
MeanAbsoluteError value on hold-out data: 0.03529942408204079
Epoch: 373
Loss on hold-out set: 0.002969582442586359
MeanAbsoluteError value on hold-out data: 0.03962764889001846
Epoch: 374
Loss on hold-out set: 0.0019345402343835878
MeanAbsoluteError value on hold-out data: 0.033358361572027206
Epoch: 375
Loss on hold-out set: 0.0020011082976308992
MeanAbsoluteError value on hold-out data: 0.034011658281087875
Epoch: 376
Loss on hold-out set: 0.0031055090964257127
MeanAbsoluteError value on hold-out data: 0.04348837211728096
Epoch: 377
Loss on hold-out set: 0.0023510695065947643
MeanAbsoluteError value on hold-out data: 0.033686380833387375
Epoch: 378
Loss on hold-out set: 0.0031726030237654128
MeanAbsoluteError value on hold-out data: 0.04421613737940788
Epoch: 379
Loss on hold-out set: 0.0024690130866426778
MeanAbsoluteError value on hold-out data: 0.038221195340156555
Epoch: 380
Loss on hold-out set: 0.001913767592142042
MeanAbsoluteError value on hold-out data: 0.030611973255872726
Epoch: 381
Loss on hold-out set: 0.002335686187602972
MeanAbsoluteError value on hold-out data: 0.03774447739124298
Epoch: 382
Loss on hold-out set: 0.0024165827826915405
MeanAbsoluteError value on hold-out data: 0.03582843393087387
Epoch: 383
Loss on hold-out set: 0.0024157019797712564
MeanAbsoluteError value on hold-out data: 0.033263105899095535
Epoch: 384
Loss on hold-out set: 0.002479614735899591
MeanAbsoluteError value on hold-out data: 0.0345679372549057
Epoch: 385
Loss on hold-out set: 0.003195507451891899
MeanAbsoluteError value on hold-out data: 0.04032246023416519
Epoch: 386
Loss on hold-out set: 0.002545160496466499
MeanAbsoluteError value on hold-out data: 0.03698697313666344
Epoch: 387
Loss on hold-out set: 0.0020901988831802123
MeanAbsoluteError value on hold-out data: 0.036321066319942474
Epoch: 388
Loss on hold-out set: 0.0023415756532861117
MeanAbsoluteError value on hold-out data: 0.03282485529780388
Epoch: 389
Loss on hold-out set: 0.00245738821410525
MeanAbsoluteError value on hold-out data: 0.036727700382471085
Epoch: 390
Loss on hold-out set: 0.0038389949079014754
MeanAbsoluteError value on hold-out data: 0.04697089269757271
Epoch: 391
Loss on hold-out set: 0.0024489324316259867
MeanAbsoluteError value on hold-out data: 0.03509031981229782
Epoch: 392
Loss on hold-out set: 0.0034268456036347502
MeanAbsoluteError value on hold-out data: 0.04427194222807884
Epoch: 393
Loss on hold-out set: 0.0020114606541985843
MeanAbsoluteError value on hold-out data: 0.032543204724788666
Epoch: 394
Loss on hold-out set: 0.002514150105478046
MeanAbsoluteError value on hold-out data: 0.040183041244745255
Epoch: 395
Loss on hold-out set: 0.0021643983161897936
MeanAbsoluteError value on hold-out data: 0.03355991840362549
Epoch: 396
Loss on hold-out set: 0.0031305453724742526
MeanAbsoluteError value on hold-out data: 0.04420793056488037
Epoch: 397
Loss on hold-out set: 0.002610604323164903
MeanAbsoluteError value on hold-out data: 0.0380370058119297
Epoch: 398
Loss on hold-out set: 0.0025505476376948585
MeanAbsoluteError value on hold-out data: 0.03640669584274292
Epoch: 399
Loss on hold-out set: 0.001840414488565569
MeanAbsoluteError value on hold-out data: 0.031126350164413452
Epoch: 400
Loss on hold-out set: 0.0025744441081769764
MeanAbsoluteError value on hold-out data: 0.034614063799381256
Epoch: 401
Loss on hold-out set: 0.0025228457693868365
MeanAbsoluteError value on hold-out data: 0.034558944404125214
Epoch: 402
Loss on hold-out set: 0.0023096084187272936
MeanAbsoluteError value on hold-out data: 0.03415999934077263
Epoch: 403
Loss on hold-out set: 0.002025796707082344
MeanAbsoluteError value on hold-out data: 0.03222121670842171
Epoch: 404
Loss on hold-out set: 0.004007127405585427
MeanAbsoluteError value on hold-out data: 0.0482189878821373
Epoch: 405
Loss on hold-out set: 0.00207965091096029
MeanAbsoluteError value on hold-out data: 0.032424721866846085
Epoch: 406
Loss on hold-out set: 0.002960237242452996
MeanAbsoluteError value on hold-out data: 0.038234613835811615
Epoch: 407
Loss on hold-out set: 0.002429373061443728
MeanAbsoluteError value on hold-out data: 0.035706013441085815
Epoch: 408
Loss on hold-out set: 0.002506227917987608
MeanAbsoluteError value on hold-out data: 0.037889812141656876
Epoch: 409
Loss on hold-out set: 0.0025621947333045107
MeanAbsoluteError value on hold-out data: 0.03551676496863365
Epoch: 410
Loss on hold-out set: 0.002768148553226829
MeanAbsoluteError value on hold-out data: 0.03881911560893059
Epoch: 411
Loss on hold-out set: 0.002169270177929368
MeanAbsoluteError value on hold-out data: 0.03284505754709244
Epoch: 412
Loss on hold-out set: 0.0027929275514141315
MeanAbsoluteError value on hold-out data: 0.038428325206041336
Epoch: 413
Loss on hold-out set: 0.002377262844483515
MeanAbsoluteError value on hold-out data: 0.03585251420736313
Epoch: 414
Loss on hold-out set: 0.0024719302983660448
MeanAbsoluteError value on hold-out data: 0.03705473989248276
Epoch: 415
Loss on hold-out set: 0.0020599627735607916
MeanAbsoluteError value on hold-out data: 0.032440412789583206
Epoch: 416
Loss on hold-out set: 0.00275785299048661
MeanAbsoluteError value on hold-out data: 0.03877227008342743
Epoch: 417
Loss on hold-out set: 0.002364080860340772
MeanAbsoluteError value on hold-out data: 0.03467905521392822
Epoch: 418
Loss on hold-out set: 0.0032189582278461834
MeanAbsoluteError value on hold-out data: 0.04210587590932846
Epoch: 419
Loss on hold-out set: 0.003583564254528794
MeanAbsoluteError value on hold-out data: 0.04591534286737442
Epoch: 420
Loss on hold-out set: 0.002910935777962502
MeanAbsoluteError value on hold-out data: 0.038403306156396866
Epoch: 421
Loss on hold-out set: 0.002870447609702272
MeanAbsoluteError value on hold-out data: 0.038276657462120056
Epoch: 422
Loss on hold-out set: 0.002061813344449834
MeanAbsoluteError value on hold-out data: 0.03471658378839493
Epoch: 423
Loss on hold-out set: 0.002048845332434499
MeanAbsoluteError value on hold-out data: 0.03540382161736488
Epoch: 424
Loss on hold-out set: 0.002648423722252789
MeanAbsoluteError value on hold-out data: 0.03517869487404823
Epoch: 425
Loss on hold-out set: 0.0022431814937398918
MeanAbsoluteError value on hold-out data: 0.03452211245894432
Epoch: 426
Loss on hold-out set: 0.0030591186399473564
MeanAbsoluteError value on hold-out data: 0.04141589254140854
Epoch: 427
Loss on hold-out set: 0.0021407787138933167
MeanAbsoluteError value on hold-out data: 0.033264193683862686
Epoch: 428
Loss on hold-out set: 0.001994178860944598
MeanAbsoluteError value on hold-out data: 0.03064822591841221
Epoch: 429
Loss on hold-out set: 0.002798439611644043
MeanAbsoluteError value on hold-out data: 0.04001428931951523
Epoch: 430
Loss on hold-out set: 0.0018968260801078653
MeanAbsoluteError value on hold-out data: 0.03182084858417511
Epoch: 431
Loss on hold-out set: 0.0020986705180563916
MeanAbsoluteError value on hold-out data: 0.03405867889523506
Epoch: 432
Loss on hold-out set: 0.002906622869072874
MeanAbsoluteError value on hold-out data: 0.04034982621669769
Epoch: 433
Loss on hold-out set: 0.002666090520889204
MeanAbsoluteError value on hold-out data: 0.03970355913043022
Epoch: 434
Loss on hold-out set: 0.0026612191202155756
MeanAbsoluteError value on hold-out data: 0.034680090844631195
Epoch: 435
Loss on hold-out set: 0.0029766241603187823
MeanAbsoluteError value on hold-out data: 0.04027120769023895
Epoch: 436
Loss on hold-out set: 0.002293376555347717
MeanAbsoluteError value on hold-out data: 0.03485538065433502
Epoch: 437
Loss on hold-out set: 0.0022500557587543306
MeanAbsoluteError value on hold-out data: 0.035494957119226456
Epoch: 438
Loss on hold-out set: 0.0019381929688327211
MeanAbsoluteError value on hold-out data: 0.03160687908530235
Epoch: 439
Loss on hold-out set: 0.00335920557048858
MeanAbsoluteError value on hold-out data: 0.04349365085363388
Epoch: 440
Loss on hold-out set: 0.003482251826330627
MeanAbsoluteError value on hold-out data: 0.045918382704257965
Epoch: 441
Loss on hold-out set: 0.002069131303103763
MeanAbsoluteError value on hold-out data: 0.03316016122698784
Epoch: 442
Loss on hold-out set: 0.0032590257821874203
MeanAbsoluteError value on hold-out data: 0.044507045298814774
Epoch: 443
Loss on hold-out set: 0.0026572136718497953
MeanAbsoluteError value on hold-out data: 0.03566008061170578
Early stopping at epoch 442
Returned to Spot: Validation loss: 0.0026572136718497953
----------------------------------------------
spotPython tuning: 0.0026572136718497953 [#####-----] 52.66% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 64, 'dropout_prob': 0.5748263192145762, 'lr_mult': 0.10600181531865231, 'batch_size': 8, 'epochs': 16, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.874448481556229}
Epoch: 1
Loss on hold-out set: 0.08862014095249929
MeanAbsoluteError value on hold-out data: 0.250710129737854
Epoch: 2
Loss on hold-out set: 0.0516286782038055
MeanAbsoluteError value on hold-out data: 0.18455609679222107
Epoch: 3
Loss on hold-out set: 0.04589457697186031
MeanAbsoluteError value on hold-out data: 0.17403659224510193
Epoch: 4
Loss on hold-out set: 0.03729149837684082
MeanAbsoluteError value on hold-out data: 0.1524467170238495
Epoch: 5
Loss on hold-out set: 0.04160977255454973
MeanAbsoluteError value on hold-out data: 0.16390979290008545
Epoch: 6
Loss on hold-out set: 0.03885896910766238
MeanAbsoluteError value on hold-out data: 0.15573275089263916
Epoch: 7
Loss on hold-out set: 0.03896806844951291
MeanAbsoluteError value on hold-out data: 0.15531869232654572
Epoch: 8
Loss on hold-out set: 0.03688523273817018
MeanAbsoluteError value on hold-out data: 0.15220563113689423
Epoch: 9
Loss on hold-out set: 0.03565652550835358
MeanAbsoluteError value on hold-out data: 0.1517723798751831
Epoch: 10
Loss on hold-out set: 0.04052354220153862
MeanAbsoluteError value on hold-out data: 0.15488481521606445
Epoch: 11
Loss on hold-out set: 0.03407077432463044
MeanAbsoluteError value on hold-out data: 0.1468440145254135
Epoch: 12
Loss on hold-out set: 0.034649010183975884
MeanAbsoluteError value on hold-out data: 0.14576584100723267
Epoch: 13
Loss on hold-out set: 0.036448514174768014
MeanAbsoluteError value on hold-out data: 0.15351368486881256
Epoch: 14
Loss on hold-out set: 0.03658460576920525
MeanAbsoluteError value on hold-out data: 0.1471903920173645
Epoch: 15
Loss on hold-out set: 0.0332791106775403
MeanAbsoluteError value on hold-out data: 0.1426648646593094
Epoch: 16
Loss on hold-out set: 0.03800049708469918
MeanAbsoluteError value on hold-out data: 0.15248963236808777
Returned to Spot: Validation loss: 0.03800049708469918
----------------------------------------------
spotPython tuning: 0.0026572136718497953 [#####-----] 54.30% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.038688319917069704, 'lr_mult': 0.1, 'batch_size': 8, 'epochs': 4, 'k_folds': 1, 'patience': 8, 'optimizer': 'Adam', 'sgd_momentum': 0.8766713139617808}
Epoch: 1
Loss on hold-out set: 0.47832597086304113
MeanAbsoluteError value on hold-out data: 0.6688703894615173
Epoch: 2
Loss on hold-out set: 0.42172510137683467
MeanAbsoluteError value on hold-out data: 0.6259499788284302
Epoch: 3
Loss on hold-out set: 0.372984883032347
MeanAbsoluteError value on hold-out data: 0.5868375897407532
Epoch: 4
Loss on hold-out set: 0.32708787643595744
MeanAbsoluteError value on hold-out data: 0.5468893647193909
Returned to Spot: Validation loss: 0.32708787643595744
----------------------------------------------
spotPython tuning: 0.0026572136718497953 [######----] 56.88% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.0, 'lr_mult': 10.0, 'batch_size': 16, 'epochs': 65536, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.0}
Epoch: 1
Loss on hold-out set: 0.02215034284285809
MeanAbsoluteError value on hold-out data: 0.11641044914722443
Epoch: 2
Loss on hold-out set: 0.019579334870765085
MeanAbsoluteError value on hold-out data: 0.1091453954577446
Epoch: 3
Loss on hold-out set: 0.011032890026016455
MeanAbsoluteError value on hold-out data: 0.08409986644983292
Epoch: 4
Loss on hold-out set: 0.007819449921187601
MeanAbsoluteError value on hold-out data: 0.07136107981204987
Epoch: 5
Loss on hold-out set: 0.0033498689360720547
MeanAbsoluteError value on hold-out data: 0.04570608213543892
Epoch: 6
Loss on hold-out set: 0.0026246288877078577
MeanAbsoluteError value on hold-out data: 0.04271278902888298
Epoch: 7
Loss on hold-out set: 0.0012760932502140733
MeanAbsoluteError value on hold-out data: 0.032061707228422165
Epoch: 8
Loss on hold-out set: 0.00011307478857098001
MeanAbsoluteError value on hold-out data: 0.008472781628370285
Epoch: 9
Loss on hold-out set: 4.5592372867088815e-05
MeanAbsoluteError value on hold-out data: 0.005222618114203215
Epoch: 10
Loss on hold-out set: 3.21853591518256e-05
MeanAbsoluteError value on hold-out data: 0.004171560052782297
Epoch: 11
Loss on hold-out set: 3.265534408120928e-05
MeanAbsoluteError value on hold-out data: 0.004610386677086353
Epoch: 12
Loss on hold-out set: 1.7541081337855613e-05
MeanAbsoluteError value on hold-out data: 0.0027503506280481815
Epoch: 13
Loss on hold-out set: 1.3345240081195553e-05
MeanAbsoluteError value on hold-out data: 0.0021272192243486643
Epoch: 14
Loss on hold-out set: 1.4611687076562943e-05
MeanAbsoluteError value on hold-out data: 0.002598369028419256
Epoch: 15
Loss on hold-out set: 1.7837236651087695e-05
MeanAbsoluteError value on hold-out data: 0.0032737492583692074
Epoch: 16
Loss on hold-out set: 1.2328892688329737e-05
MeanAbsoluteError value on hold-out data: 0.0023447079584002495
Epoch: 17
Loss on hold-out set: 7.289145912636741e-06
MeanAbsoluteError value on hold-out data: 0.0010724030435085297
Epoch: 18
Loss on hold-out set: 7.845784933267982e-06
MeanAbsoluteError value on hold-out data: 0.0013630179455503821
Epoch: 19
Loss on hold-out set: 9.039751411795518e-06
MeanAbsoluteError value on hold-out data: 0.0018297177739441395
Epoch: 20
Loss on hold-out set: 1.1105450755023508e-05
MeanAbsoluteError value on hold-out data: 0.0023787047248333693
Epoch: 21
Loss on hold-out set: 1.0977224184515714e-05
MeanAbsoluteError value on hold-out data: 0.0023761119227856398
Epoch: 22
Loss on hold-out set: 8.071579031820875e-06
MeanAbsoluteError value on hold-out data: 0.0016385680064558983
Epoch: 23
Loss on hold-out set: 6.722042766532947e-06
MeanAbsoluteError value on hold-out data: 0.0012146156514063478
Epoch: 24
Loss on hold-out set: 6.409642064921316e-06
MeanAbsoluteError value on hold-out data: 0.0011501047993078828
Epoch: 25
Loss on hold-out set: 5.711468979167253e-06
MeanAbsoluteError value on hold-out data: 0.0008849817677401006
Epoch: 26
Loss on hold-out set: 1.0107935538958133e-05
MeanAbsoluteError value on hold-out data: 0.002189227845519781
Epoch: 27
Loss on hold-out set: 1.80633164506473e-05
MeanAbsoluteError value on hold-out data: 0.003551273373886943
Epoch: 28
Loss on hold-out set: 1.1081248550525694e-05
MeanAbsoluteError value on hold-out data: 0.002368914196267724
Epoch: 29
Loss on hold-out set: 1.286542089330492e-05
MeanAbsoluteError value on hold-out data: 0.0027146402280777693
Epoch: 30
Loss on hold-out set: 2.082387044011787e-05
MeanAbsoluteError value on hold-out data: 0.0038957635406404734
Epoch: 31
Loss on hold-out set: 4.3443800103360495e-05
MeanAbsoluteError value on hold-out data: 0.006135858129709959
Epoch: 32
Loss on hold-out set: 5.043107222790193e-05
MeanAbsoluteError value on hold-out data: 0.006692508701235056
Epoch: 33
Loss on hold-out set: 1.4562257906379128e-05
MeanAbsoluteError value on hold-out data: 0.00305988360196352
Epoch: 34
Loss on hold-out set: 2.418518555427191e-05
MeanAbsoluteError value on hold-out data: 0.004309950862079859
Epoch: 35
Loss on hold-out set: 1.7444790118085956e-05
MeanAbsoluteError value on hold-out data: 0.0034901436883956194
Epoch: 36
Loss on hold-out set: 3.450930604518171e-05
MeanAbsoluteError value on hold-out data: 0.00536465784534812
Epoch: 37
Loss on hold-out set: 1.107804004469041e-05
MeanAbsoluteError value on hold-out data: 0.002353222807869315
Epoch: 38
Loss on hold-out set: 6.408295785389016e-06
MeanAbsoluteError value on hold-out data: 0.0012556046713143587
Epoch: 39
Loss on hold-out set: 1.0263860770608421e-05
MeanAbsoluteError value on hold-out data: 0.002409290987998247
Epoch: 40
Loss on hold-out set: 1.5598313869926833e-05
MeanAbsoluteError value on hold-out data: 0.0033283201046288013
Epoch: 41
Loss on hold-out set: 9.892998688979118e-06
MeanAbsoluteError value on hold-out data: 0.002141064265742898
Epoch: 42
Loss on hold-out set: 7.685374001946338e-06
MeanAbsoluteError value on hold-out data: 0.0017906272551044822
Epoch: 43
Loss on hold-out set: 8.630057518051839e-05
MeanAbsoluteError value on hold-out data: 0.008930770680308342
Epoch: 44
Loss on hold-out set: 1.5196117314381377e-05
MeanAbsoluteError value on hold-out data: 0.0030392094049602747
Epoch: 45
Loss on hold-out set: 2.4870145113565838e-05
MeanAbsoluteError value on hold-out data: 0.004039078019559383
Epoch: 46
Loss on hold-out set: 1.1473551191891984e-05
MeanAbsoluteError value on hold-out data: 0.0024900694843381643
Epoch: 47
Loss on hold-out set: 0.0001429296090990599
MeanAbsoluteError value on hold-out data: 0.011802268214523792
Epoch: 48
Loss on hold-out set: 0.00027640147967950294
MeanAbsoluteError value on hold-out data: 0.016474680975079536
Epoch: 49
Loss on hold-out set: 0.00020589861225361297
MeanAbsoluteError value on hold-out data: 0.01418441254645586
Epoch: 50
Loss on hold-out set: 1.1218225872174739e-05
MeanAbsoluteError value on hold-out data: 0.001895122928544879
Epoch: 51
Loss on hold-out set: 6.147834938019514e-06
MeanAbsoluteError value on hold-out data: 0.001080325455404818
Epoch: 52
Loss on hold-out set: 5.490802406807473e-06
MeanAbsoluteError value on hold-out data: 0.0009285984560847282
Epoch: 53
Loss on hold-out set: 5.42935343243076e-06
MeanAbsoluteError value on hold-out data: 0.0009933151304721832
Epoch: 54
Loss on hold-out set: 1.4673264223873909e-05
MeanAbsoluteError value on hold-out data: 0.0032109683379530907
Epoch: 55
Loss on hold-out set: 9.534133431244347e-05
MeanAbsoluteError value on hold-out data: 0.00958755612373352
Epoch: 56
Loss on hold-out set: 1.650545192732304e-05
MeanAbsoluteError value on hold-out data: 0.0032329242676496506
Epoch: 57
Loss on hold-out set: 1.7933615517425717e-05
MeanAbsoluteError value on hold-out data: 0.00366037804633379
Epoch: 58
Loss on hold-out set: 2.0259812931487287e-05
MeanAbsoluteError value on hold-out data: 0.0038477228954434395
Epoch: 59
Loss on hold-out set: 3.247128274539902e-05
MeanAbsoluteError value on hold-out data: 0.005215242505073547
Epoch: 60
Loss on hold-out set: 0.0003967487381918258
MeanAbsoluteError value on hold-out data: 0.019699787721037865
Epoch: 61
Loss on hold-out set: 1.1732914847590636e-05
MeanAbsoluteError value on hold-out data: 0.0018202459905296564
Epoch: 62
Loss on hold-out set: 1.4211028404755971e-05
MeanAbsoluteError value on hold-out data: 0.002644056687131524
Epoch: 63
Loss on hold-out set: 7.5400671029886945e-06
MeanAbsoluteError value on hold-out data: 0.001724526286125183
Epoch: 64
Loss on hold-out set: 1.1737463027154598e-05
MeanAbsoluteError value on hold-out data: 0.002691790694370866
Epoch: 65
Loss on hold-out set: 1.8289105882056328e-05
MeanAbsoluteError value on hold-out data: 0.0037246081046760082
Epoch: 66
Loss on hold-out set: 9.135772559506892e-06
MeanAbsoluteError value on hold-out data: 0.002130062086507678
Epoch: 67
Loss on hold-out set: 2.6289995251940318e-05
MeanAbsoluteError value on hold-out data: 0.00463969586417079
Epoch: 68
Loss on hold-out set: 1.0020916019321272e-05
MeanAbsoluteError value on hold-out data: 0.0023920077364891768
Epoch: 69
Loss on hold-out set: 0.00012466644961693274
MeanAbsoluteError value on hold-out data: 0.010882830247282982
Epoch: 70
Loss on hold-out set: 7.71477980857813e-05
MeanAbsoluteError value on hold-out data: 0.00850183330476284
Epoch: 71
Loss on hold-out set: 6.550970302717025e-05
MeanAbsoluteError value on hold-out data: 0.007632290478795767
Epoch: 72
Loss on hold-out set: 0.00013945273454546144
MeanAbsoluteError value on hold-out data: 0.011427823454141617
Epoch: 73
Loss on hold-out set: 1.7303348517759188e-05
MeanAbsoluteError value on hold-out data: 0.003383527509868145
Epoch: 74
Loss on hold-out set: 5.684600768960847e-06
MeanAbsoluteError value on hold-out data: 0.0010621568653732538
Epoch: 75
Loss on hold-out set: 2.6834604796022177e-05
MeanAbsoluteError value on hold-out data: 0.004807138815522194
Epoch: 76
Loss on hold-out set: 6.851155986671649e-06
MeanAbsoluteError value on hold-out data: 0.0014097981620579958
Epoch: 77
Loss on hold-out set: 5.643799905603948e-05
MeanAbsoluteError value on hold-out data: 0.007024442311376333
Epoch: 78
Loss on hold-out set: 0.00023826931091638185
MeanAbsoluteError value on hold-out data: 0.015261060558259487
Epoch: 79
Loss on hold-out set: 1.1776215375759516e-05
MeanAbsoluteError value on hold-out data: 0.0020781459752470255
Epoch: 80
Loss on hold-out set: 1.2127209054980134e-05
MeanAbsoluteError value on hold-out data: 0.0025506997480988503
Epoch: 81
Loss on hold-out set: 4.82096071975416e-06
MeanAbsoluteError value on hold-out data: 0.0010132485767826438
Epoch: 82
Loss on hold-out set: 1.4435263916598878e-05
MeanAbsoluteError value on hold-out data: 0.0032300371676683426
Epoch: 83
Loss on hold-out set: 5.158170851197945e-06
MeanAbsoluteError value on hold-out data: 0.0011222022585570812
Epoch: 84
Loss on hold-out set: 5.438226013977424e-06
MeanAbsoluteError value on hold-out data: 0.0012531866086646914
Epoch: 85
Loss on hold-out set: 7.348949503992979e-05
MeanAbsoluteError value on hold-out data: 0.008258204907178879
Epoch: 86
Loss on hold-out set: 4.903194061817454e-05
MeanAbsoluteError value on hold-out data: 0.006699222140014172
Epoch: 87
Loss on hold-out set: 0.00023258725751044325
MeanAbsoluteError value on hold-out data: 0.015110488049685955
Epoch: 88
Loss on hold-out set: 9.280216533481603e-06
MeanAbsoluteError value on hold-out data: 0.002157412003725767
Epoch: 89
Loss on hold-out set: 1.039140335323234e-05
MeanAbsoluteError value on hold-out data: 0.002542058704420924
Epoch: 90
Loss on hold-out set: 1.407906596509029e-05
MeanAbsoluteError value on hold-out data: 0.0031157045159488916
Epoch: 91
Loss on hold-out set: 6.885058265700201e-05
MeanAbsoluteError value on hold-out data: 0.007715169806033373
Epoch: 92
Loss on hold-out set: 1.20258737297263e-05
MeanAbsoluteError value on hold-out data: 0.002382745034992695
Epoch: 93
Loss on hold-out set: 1.2423094391890213e-05
MeanAbsoluteError value on hold-out data: 0.0027737829368561506
Epoch: 94
Loss on hold-out set: 1.1705402070411333e-05
MeanAbsoluteError value on hold-out data: 0.00275155296549201
Epoch: 95
Loss on hold-out set: 9.990711054055473e-06
MeanAbsoluteError value on hold-out data: 0.0024701023939996958
Epoch: 96
Loss on hold-out set: 5.705495919085622e-06
MeanAbsoluteError value on hold-out data: 0.0013248997274786234
Epoch: 97
Loss on hold-out set: 0.00011047285232435618
MeanAbsoluteError value on hold-out data: 0.010253388434648514
Epoch: 98
Loss on hold-out set: 2.1936560427236957e-05
MeanAbsoluteError value on hold-out data: 0.004140874370932579
Epoch: 99
Loss on hold-out set: 8.287588570965454e-05
MeanAbsoluteError value on hold-out data: 0.008181673474609852
Epoch: 100
Loss on hold-out set: 0.000288862224950112
MeanAbsoluteError value on hold-out data: 0.016661640256643295
Epoch: 101
Loss on hold-out set: 1.030931379749458e-05
MeanAbsoluteError value on hold-out data: 0.0018017905531451106
Epoch: 102
Loss on hold-out set: 6.897890545444266e-06
MeanAbsoluteError value on hold-out data: 0.0016555803595110774
Epoch: 103
Loss on hold-out set: 5.379574705138542e-06
MeanAbsoluteError value on hold-out data: 0.0013036862947046757
Epoch: 104
Loss on hold-out set: 3.21531007150617e-05
MeanAbsoluteError value on hold-out data: 0.005349901970475912
Epoch: 105
Loss on hold-out set: 7.088865382492689e-05
MeanAbsoluteError value on hold-out data: 0.008227262645959854
Epoch: 106
Loss on hold-out set: 5.659991228113588e-05
MeanAbsoluteError value on hold-out data: 0.007296483498066664
Epoch: 107
Loss on hold-out set: 7.479386747371264e-06
MeanAbsoluteError value on hold-out data: 0.0019477661699056625
Epoch: 108
Loss on hold-out set: 1.260321043542047e-05
MeanAbsoluteError value on hold-out data: 0.002959413919597864
Epoch: 109
Loss on hold-out set: 1.1185360826378823e-05
MeanAbsoluteError value on hold-out data: 0.0027878046967089176
Epoch: 110
Loss on hold-out set: 6.837492647766914e-06
MeanAbsoluteError value on hold-out data: 0.0016479581827297807
Epoch: 111
Loss on hold-out set: 2.1249925818043075e-05
MeanAbsoluteError value on hold-out data: 0.004005309659987688
Epoch: 112
Loss on hold-out set: 5.637528635074168e-06
MeanAbsoluteError value on hold-out data: 0.0011837128549814224
Epoch: 113
Loss on hold-out set: 5.7817809743267534e-05
MeanAbsoluteError value on hold-out data: 0.007296516094356775
Epoch: 114
Loss on hold-out set: 1.0469927713673219e-05
MeanAbsoluteError value on hold-out data: 0.0026215293910354376
Epoch: 115
Loss on hold-out set: 2.2029092035250198e-05
MeanAbsoluteError value on hold-out data: 0.004223237745463848
Epoch: 116
Loss on hold-out set: 8.622366524497538e-05
MeanAbsoluteError value on hold-out data: 0.009053448215126991
Epoch: 117
Loss on hold-out set: 6.353239318980884e-05
MeanAbsoluteError value on hold-out data: 0.007620601449161768
Epoch: 118
Loss on hold-out set: 0.00018094881517371456
MeanAbsoluteError value on hold-out data: 0.01318435836583376
Epoch: 119
Loss on hold-out set: 2.457814513802173e-05
MeanAbsoluteError value on hold-out data: 0.003918664064258337
Epoch: 120
Loss on hold-out set: 0.000267620507848302
MeanAbsoluteError value on hold-out data: 0.016088252887129784
Epoch: 121
Loss on hold-out set: 2.0951443921627576e-05
MeanAbsoluteError value on hold-out data: 0.0035726118367165327
Epoch: 122
Loss on hold-out set: 8.081827589098553e-06
MeanAbsoluteError value on hold-out data: 0.002049059607088566
Epoch: 123
Loss on hold-out set: 5.284317622729424e-06
MeanAbsoluteError value on hold-out data: 0.0013032745337113738
Epoch: 124
Loss on hold-out set: 9.760018632445472e-06
MeanAbsoluteError value on hold-out data: 0.0024506470654159784
Epoch: 125
Loss on hold-out set: 1.4575462572745318e-05
MeanAbsoluteError value on hold-out data: 0.00332790520042181
Epoch: 126
Loss on hold-out set: 1.610509432219643e-05
MeanAbsoluteError value on hold-out data: 0.0035516691859811544
Epoch: 127
Loss on hold-out set: 4.246651524466104e-06
MeanAbsoluteError value on hold-out data: 0.0009734088089317083
Epoch: 128
Loss on hold-out set: 1.5508378629946445e-05
MeanAbsoluteError value on hold-out data: 0.003433229634538293
Epoch: 129
Loss on hold-out set: 1.0947988094382086e-05
MeanAbsoluteError value on hold-out data: 0.002735792426392436
Epoch: 130
Loss on hold-out set: 2.6285355967334717e-05
MeanAbsoluteError value on hold-out data: 0.004781996365636587
Epoch: 131
Loss on hold-out set: 0.00012125107145708937
MeanAbsoluteError value on hold-out data: 0.010829628445208073
Epoch: 132
Loss on hold-out set: 6.702612172136325e-06
MeanAbsoluteError value on hold-out data: 0.0014922551345080137
Epoch: 133
Loss on hold-out set: 3.906597406679985e-05
MeanAbsoluteError value on hold-out data: 0.005663829855620861
Epoch: 134
Loss on hold-out set: 0.000312677457450742
MeanAbsoluteError value on hold-out data: 0.017504720017313957
Epoch: 135
Loss on hold-out set: 1.6234556465190652e-05
MeanAbsoluteError value on hold-out data: 0.0029741849284619093
Epoch: 136
Loss on hold-out set: 9.413289131101154e-06
MeanAbsoluteError value on hold-out data: 0.0022835240233689547
Epoch: 137
Loss on hold-out set: 9.226982408443674e-06
MeanAbsoluteError value on hold-out data: 0.002399975433945656
Epoch: 138
Loss on hold-out set: 1.4838858987786807e-05
MeanAbsoluteError value on hold-out data: 0.0033805472776293755
Epoch: 139
Loss on hold-out set: 1.3661404074427034e-05
MeanAbsoluteError value on hold-out data: 0.0032416977919638157
Epoch: 140
Loss on hold-out set: 3.898294030597371e-06
MeanAbsoluteError value on hold-out data: 0.001003739540465176
Epoch: 141
Loss on hold-out set: 5.7210970944173535e-05
MeanAbsoluteError value on hold-out data: 0.00732838548719883
Epoch: 142
Loss on hold-out set: 1.451269968368395e-05
MeanAbsoluteError value on hold-out data: 0.003322944976389408
Epoch: 143
Loss on hold-out set: 4.399251395769074e-05
MeanAbsoluteError value on hold-out data: 0.00630268594250083
Epoch: 144
Loss on hold-out set: 2.841745414403512e-05
MeanAbsoluteError value on hold-out data: 0.004916019272059202
Epoch: 145
Loss on hold-out set: 1.9699435956442213e-05
MeanAbsoluteError value on hold-out data: 0.0038390199188143015
Epoch: 146
Loss on hold-out set: 0.00012129797764110232
MeanAbsoluteError value on hold-out data: 0.010720601305365562
Epoch: 147
Loss on hold-out set: 1.384065657667203e-05
MeanAbsoluteError value on hold-out data: 0.0031172125600278378
Epoch: 148
Loss on hold-out set: 1.915847836866497e-05
MeanAbsoluteError value on hold-out data: 0.003983601927757263
Epoch: 149
Loss on hold-out set: 3.3486743919447214e-05
MeanAbsoluteError value on hold-out data: 0.005525351967662573
Epoch: 150
Loss on hold-out set: 4.547130390021362e-06
MeanAbsoluteError value on hold-out data: 0.0012761246180161834
Epoch: 151
Loss on hold-out set: 7.709977561669228e-05
MeanAbsoluteError value on hold-out data: 0.008562218397855759
Epoch: 152
Loss on hold-out set: 2.308074851354927e-05
MeanAbsoluteError value on hold-out data: 0.004437415394932032
Epoch: 153
Loss on hold-out set: 4.60086305876853e-06
MeanAbsoluteError value on hold-out data: 0.0012135766446590424
Epoch: 154
Loss on hold-out set: 1.213376550654893e-05
MeanAbsoluteError value on hold-out data: 0.0029416901525110006
Epoch: 155
Loss on hold-out set: 0.0001457241734514307
MeanAbsoluteError value on hold-out data: 0.011829843744635582
Epoch: 156
Loss on hold-out set: 4.762047568587341e-05
MeanAbsoluteError value on hold-out data: 0.006574020721018314
Epoch: 157
Loss on hold-out set: 6.775586849758647e-06
MeanAbsoluteError value on hold-out data: 0.0017999911215156317
Epoch: 158
Loss on hold-out set: 0.00011447797786738527
MeanAbsoluteError value on hold-out data: 0.01047541107982397
Epoch: 159
Loss on hold-out set: 6.565870985229451e-05
MeanAbsoluteError value on hold-out data: 0.007818696089088917
Epoch: 160
Loss on hold-out set: 1.3915495592779112e-05
MeanAbsoluteError value on hold-out data: 0.003209363901987672
Epoch: 161
Loss on hold-out set: 2.351835083620819e-05
MeanAbsoluteError value on hold-out data: 0.004484154749661684
Epoch: 162
Loss on hold-out set: 6.667512494268042e-05
MeanAbsoluteError value on hold-out data: 0.007919387891888618
Epoch: 163
Loss on hold-out set: 6.823508221331347e-05
MeanAbsoluteError value on hold-out data: 0.008021612651646137
Epoch: 164
Loss on hold-out set: 4.315994393484863e-05
MeanAbsoluteError value on hold-out data: 0.0062940665520727634
Epoch: 165
Loss on hold-out set: 3.3068910373626035e-05
MeanAbsoluteError value on hold-out data: 0.005452829413115978
Epoch: 166
Loss on hold-out set: 2.1650153844108755e-05
MeanAbsoluteError value on hold-out data: 0.0042985305190086365
Epoch: 167
Loss on hold-out set: 2.2542951371992547e-05
MeanAbsoluteError value on hold-out data: 0.004393429961055517
Epoch: 168
Loss on hold-out set: 4.119006420248632e-06
MeanAbsoluteError value on hold-out data: 0.0011872155591845512
Epoch: 169
Loss on hold-out set: 8.632705890034374e-05
MeanAbsoluteError value on hold-out data: 0.009061348624527454
Epoch: 170
Loss on hold-out set: 3.1510035688896955e-05
MeanAbsoluteError value on hold-out data: 0.004987487569451332
Epoch: 171
Loss on hold-out set: 4.738194619628637e-06
MeanAbsoluteError value on hold-out data: 0.0013631078181788325
Epoch: 172
Loss on hold-out set: 7.27292373133088e-05
MeanAbsoluteError value on hold-out data: 0.008342303335666656
Epoch: 173
Loss on hold-out set: 0.00022876110405808218
MeanAbsoluteError value on hold-out data: 0.014961018227040768
Epoch: 174
Loss on hold-out set: 1.2644174914480813e-05
MeanAbsoluteError value on hold-out data: 0.0029273717664182186
Epoch: 175
Loss on hold-out set: 2.9018150598858483e-05
MeanAbsoluteError value on hold-out data: 0.00490236422047019
Epoch: 176
Loss on hold-out set: 8.835383524503987e-06
MeanAbsoluteError value on hold-out data: 0.0025251021143049
Epoch: 177
Loss on hold-out set: 4.811669025098366e-05
MeanAbsoluteError value on hold-out data: 0.00670036394149065
Epoch: 178
Loss on hold-out set: 3.866530699413392e-05
MeanAbsoluteError value on hold-out data: 0.005982981063425541
Epoch: 179
Loss on hold-out set: 2.522089878192147e-05
MeanAbsoluteError value on hold-out data: 0.0047681196592748165
Epoch: 180
Loss on hold-out set: 5.9520830889500514e-06
MeanAbsoluteError value on hold-out data: 0.001863429555669427
Epoch: 181
Loss on hold-out set: 2.055600989000308e-05
MeanAbsoluteError value on hold-out data: 0.00423627533018589
Epoch: 182
Loss on hold-out set: 4.936752642798207e-06
MeanAbsoluteError value on hold-out data: 0.001640769885852933
Epoch: 183
Loss on hold-out set: 6.629582295365828e-05
MeanAbsoluteError value on hold-out data: 0.007909873500466347
Epoch: 184
Loss on hold-out set: 5.8860138731114076e-05
MeanAbsoluteError value on hold-out data: 0.0073846252635121346
Epoch: 185
Loss on hold-out set: 6.936874878623425e-05
MeanAbsoluteError value on hold-out data: 0.008069397881627083
Epoch: 186
Loss on hold-out set: 3.5628087732076986e-05
MeanAbsoluteError value on hold-out data: 0.005689021199941635
Epoch: 187
Loss on hold-out set: 2.5861684518627282e-05
MeanAbsoluteError value on hold-out data: 0.004839069675654173
Epoch: 188
Loss on hold-out set: 3.0150754116077317e-06
MeanAbsoluteError value on hold-out data: 0.0009329108288511634
Epoch: 189
Loss on hold-out set: 3.51016146611839e-05
MeanAbsoluteError value on hold-out data: 0.005712929647415876
Epoch: 190
Loss on hold-out set: 5.714065238000905e-06
MeanAbsoluteError value on hold-out data: 0.001839467091485858
Epoch: 191
Loss on hold-out set: 4.3781263014496196e-06
MeanAbsoluteError value on hold-out data: 0.0013371981913223863
Epoch: 192
Loss on hold-out set: 4.8168896395700835e-05
MeanAbsoluteError value on hold-out data: 0.006642406340688467
Epoch: 193
Loss on hold-out set: 9.736274353743188e-05
MeanAbsoluteError value on hold-out data: 0.009393015876412392
Epoch: 194
Loss on hold-out set: 6.15123476683565e-06
MeanAbsoluteError value on hold-out data: 0.001821027253754437
Epoch: 195
Loss on hold-out set: 4.7108433423808925e-05
MeanAbsoluteError value on hold-out data: 0.0066243186593055725
Epoch: 196
Loss on hold-out set: 7.868718354362308e-05
MeanAbsoluteError value on hold-out data: 0.008686847053468227
Epoch: 197
Loss on hold-out set: 6.492888649901081e-05
MeanAbsoluteError value on hold-out data: 0.007900556549429893
Epoch: 198
Loss on hold-out set: 2.0844608834043977e-05
MeanAbsoluteError value on hold-out data: 0.004301916807889938
Epoch: 199
Loss on hold-out set: 1.807094438271107e-05
MeanAbsoluteError value on hold-out data: 0.003935224376618862
Epoch: 200
Loss on hold-out set: 2.698610516840984e-05
MeanAbsoluteError value on hold-out data: 0.00496341846883297
Epoch: 201
Loss on hold-out set: 3.8799379114463685e-06
MeanAbsoluteError value on hold-out data: 0.001218498800881207
Epoch: 202
Loss on hold-out set: 4.261809015971314e-05
MeanAbsoluteError value on hold-out data: 0.006312764715403318
Epoch: 203
Loss on hold-out set: 5.354971892158669e-06
MeanAbsoluteError value on hold-out data: 0.0015960675664246082
Epoch: 204
Loss on hold-out set: 0.00011387325732931985
MeanAbsoluteError value on hold-out data: 0.010497274808585644
Epoch: 205
Loss on hold-out set: 2.932271034919004e-06
MeanAbsoluteError value on hold-out data: 0.000981419230811298
Epoch: 206
Loss on hold-out set: 1.6219609326646222e-05
MeanAbsoluteError value on hold-out data: 0.0035808540415018797
Epoch: 207
Loss on hold-out set: 6.337599897003536e-05
MeanAbsoluteError value on hold-out data: 0.007416060660034418
Epoch: 208
Loss on hold-out set: 0.00012365723064009982
MeanAbsoluteError value on hold-out data: 0.010876725427806377
Epoch: 209
Loss on hold-out set: 3.91006196878152e-05
MeanAbsoluteError value on hold-out data: 0.005924459546804428
Epoch: 210
Loss on hold-out set: 1.5071482505989384e-05
MeanAbsoluteError value on hold-out data: 0.003346031066030264
Epoch: 211
Loss on hold-out set: 3.0293836061900947e-06
MeanAbsoluteError value on hold-out data: 0.0010884504299610853
Epoch: 212
Loss on hold-out set: 3.760503616496479e-05
MeanAbsoluteError value on hold-out data: 0.005895628128200769
Epoch: 213
Loss on hold-out set: 5.882685409711772e-05
MeanAbsoluteError value on hold-out data: 0.007468859199434519
Epoch: 214
Loss on hold-out set: 5.343366712239865e-05
MeanAbsoluteError value on hold-out data: 0.00712905079126358
Epoch: 215
Loss on hold-out set: 3.0954765718074907e-05
MeanAbsoluteError value on hold-out data: 0.005351734347641468
Epoch: 216
Loss on hold-out set: 3.6862402100125203e-06
MeanAbsoluteError value on hold-out data: 0.001200436963699758
Epoch: 217
Loss on hold-out set: 3.094995487404767e-05
MeanAbsoluteError value on hold-out data: 0.005348916631191969
Epoch: 218
Loss on hold-out set: 5.358032252077369e-06
MeanAbsoluteError value on hold-out data: 0.0017654498806223273
Epoch: 219
Loss on hold-out set: 4.2541217429683644e-06
MeanAbsoluteError value on hold-out data: 0.0014417992206290364
Epoch: 220
Loss on hold-out set: 4.0547777069533414e-06
MeanAbsoluteError value on hold-out data: 0.0012275355402380228
Epoch: 221
Loss on hold-out set: 1.5446728938465975e-05
MeanAbsoluteError value on hold-out data: 0.003152000717818737
Epoch: 222
Loss on hold-out set: 0.00019602885387078124
MeanAbsoluteError value on hold-out data: 0.013768895529210567
Epoch: 223
Loss on hold-out set: 4.4777827210246436e-05
MeanAbsoluteError value on hold-out data: 0.006248375400900841
Epoch: 224
Loss on hold-out set: 9.6131441774847e-06
MeanAbsoluteError value on hold-out data: 0.0024520535953342915
Epoch: 225
Loss on hold-out set: 4.256086215623088e-06
MeanAbsoluteError value on hold-out data: 0.0012931479141116142
Epoch: 226
Loss on hold-out set: 3.2816746571178987e-06
MeanAbsoluteError value on hold-out data: 0.0011692856205627322
Epoch: 227
Loss on hold-out set: 9.235437119059497e-06
MeanAbsoluteError value on hold-out data: 0.002616290934383869
Epoch: 228
Loss on hold-out set: 3.0132714719480934e-05
MeanAbsoluteError value on hold-out data: 0.005245077423751354
Epoch: 229
Loss on hold-out set: 4.294959121340837e-05
MeanAbsoluteError value on hold-out data: 0.006365091539919376
Epoch: 230
Loss on hold-out set: 3.985352296503582e-06
MeanAbsoluteError value on hold-out data: 0.0013567673740908504
Epoch: 231
Loss on hold-out set: 2.19832691072952e-05
MeanAbsoluteError value on hold-out data: 0.004433194175362587
Epoch: 232
Loss on hold-out set: 2.973503216564591e-06
MeanAbsoluteError value on hold-out data: 0.0010193628259003162
Epoch: 233
Loss on hold-out set: 7.76508786178678e-06
MeanAbsoluteError value on hold-out data: 0.0023205725010484457
Epoch: 234
Loss on hold-out set: 9.181076319165234e-05
MeanAbsoluteError value on hold-out data: 0.009394251741468906
Epoch: 235
Loss on hold-out set: 7.122684062204299e-06
MeanAbsoluteError value on hold-out data: 0.0020210386719554663
Epoch: 236
Loss on hold-out set: 4.2432623104105005e-06
MeanAbsoluteError value on hold-out data: 0.0014303270727396011
Epoch: 237
Loss on hold-out set: 9.579352473864626e-05
MeanAbsoluteError value on hold-out data: 0.009579487144947052
Epoch: 238
Loss on hold-out set: 6.690906651017845e-05
MeanAbsoluteError value on hold-out data: 0.007979510352015495
Epoch: 239
Loss on hold-out set: 3.7826902131966657e-05
MeanAbsoluteError value on hold-out data: 0.005943688098341227
Epoch: 240
Loss on hold-out set: 1.4340130244243865e-05
MeanAbsoluteError value on hold-out data: 0.0034419759176671505
Epoch: 241
Loss on hold-out set: 1.003388948256064e-05
MeanAbsoluteError value on hold-out data: 0.0027202023193240166
Epoch: 242
Loss on hold-out set: 4.006451981216455e-06
MeanAbsoluteError value on hold-out data: 0.0013536550104618073
Epoch: 243
Loss on hold-out set: 7.627849730564968e-05
MeanAbsoluteError value on hold-out data: 0.008499371819198132
Epoch: 244
Loss on hold-out set: 3.5666649086794533e-06
MeanAbsoluteError value on hold-out data: 0.0013262754073366523
Epoch: 245
Loss on hold-out set: 0.0001643930116092394
MeanAbsoluteError value on hold-out data: 0.012604029849171638
Epoch: 246
Loss on hold-out set: 5.080330610278332e-06
MeanAbsoluteError value on hold-out data: 0.0013094525784254074
Epoch: 247
Loss on hold-out set: 1.703340326218351e-05
MeanAbsoluteError value on hold-out data: 0.003625908400863409
Epoch: 248
Loss on hold-out set: 2.2203799744602293e-05
MeanAbsoluteError value on hold-out data: 0.004437166266143322
Epoch: 249
Loss on hold-out set: 4.497224405273109e-05
MeanAbsoluteError value on hold-out data: 0.006441718433052301
Epoch: 250
Loss on hold-out set: 1.1036689341524739e-05
MeanAbsoluteError value on hold-out data: 0.002841139445081353
Epoch: 251
Loss on hold-out set: 3.079853839656272e-06
MeanAbsoluteError value on hold-out data: 0.0009887528140097857
Epoch: 252
Loss on hold-out set: 2.9642395612714416e-06
MeanAbsoluteError value on hold-out data: 0.0010000807233154774
Epoch: 253
Loss on hold-out set: 2.6546989691891405e-06
MeanAbsoluteError value on hold-out data: 0.0009285359410569072
Epoch: 254
Loss on hold-out set: 3.2273823379862157e-06
MeanAbsoluteError value on hold-out data: 0.0011293505085632205
Epoch: 255
Loss on hold-out set: 3.302821824036073e-06
MeanAbsoluteError value on hold-out data: 0.0011991970241069794
Epoch: 256
Loss on hold-out set: 2.1253804094924005e-05
MeanAbsoluteError value on hold-out data: 0.004298385698348284
Epoch: 257
Loss on hold-out set: 5.563003182224317e-06
MeanAbsoluteError value on hold-out data: 0.0017850775038823485
Epoch: 258
Loss on hold-out set: 3.606679427704014e-05
MeanAbsoluteError value on hold-out data: 0.00553046353161335
Epoch: 259
Loss on hold-out set: 0.00010515532669255902
MeanAbsoluteError value on hold-out data: 0.009970945306122303
Epoch: 260
Loss on hold-out set: 6.232048355358481e-06
MeanAbsoluteError value on hold-out data: 0.001905021839775145
Epoch: 261
Loss on hold-out set: 2.5598379196660398e-05
MeanAbsoluteError value on hold-out data: 0.004765601363033056
Epoch: 262
Loss on hold-out set: 0.00010077188773338046
MeanAbsoluteError value on hold-out data: 0.00986540224403143
Epoch: 263
Loss on hold-out set: 0.00012850875492930705
MeanAbsoluteError value on hold-out data: 0.011158868670463562
Epoch: 264
Loss on hold-out set: 4.973257564176349e-06
MeanAbsoluteError value on hold-out data: 0.0014883268158882856
Epoch: 265
Loss on hold-out set: 1.698653154323294e-05
MeanAbsoluteError value on hold-out data: 0.0036669934634119272
Epoch: 266
Loss on hold-out set: 2.6841536162847707e-06
MeanAbsoluteError value on hold-out data: 0.001019680523313582
Epoch: 267
Loss on hold-out set: 4.3637127658401275e-05
MeanAbsoluteError value on hold-out data: 0.006377957761287689
Epoch: 268
Loss on hold-out set: 0.00011474611949923106
MeanAbsoluteError value on hold-out data: 0.010538078844547272
Epoch: 269
Loss on hold-out set: 1.86434036597922e-05
MeanAbsoluteError value on hold-out data: 0.003913189750164747
Epoch: 270
Loss on hold-out set: 1.4950986329303736e-05
MeanAbsoluteError value on hold-out data: 0.0034313234500586987
Epoch: 271
Loss on hold-out set: 1.918544952978233e-05
MeanAbsoluteError value on hold-out data: 0.004061407875269651
Epoch: 272
Loss on hold-out set: 3.5734182718347017e-06
MeanAbsoluteError value on hold-out data: 0.0012978670420125127
Epoch: 273
Loss on hold-out set: 3.212743448736881e-05
MeanAbsoluteError value on hold-out data: 0.005456158425658941
Epoch: 274
Loss on hold-out set: 2.698825167164231e-05
MeanAbsoluteError value on hold-out data: 0.004964008461683989
Epoch: 275
Loss on hold-out set: 1.3317646239317438e-05
MeanAbsoluteError value on hold-out data: 0.0033047127071768045
Epoch: 276
Loss on hold-out set: 5.324057598811219e-06
MeanAbsoluteError value on hold-out data: 0.0018847098108381033
Epoch: 277
Loss on hold-out set: 4.573564173800773e-05
MeanAbsoluteError value on hold-out data: 0.006526998709887266
Epoch: 278
Loss on hold-out set: 8.553672370525371e-05
MeanAbsoluteError value on hold-out data: 0.009037179872393608
Epoch: 279
Loss on hold-out set: 0.00013387536072466326
MeanAbsoluteError value on hold-out data: 0.011375445872545242
Epoch: 280
Loss on hold-out set: 9.363420280064212e-05
MeanAbsoluteError value on hold-out data: 0.009519973769783974
Epoch: 281
Loss on hold-out set: 7.678346446482465e-05
MeanAbsoluteError value on hold-out data: 0.008547677658498287
Epoch: 282
Loss on hold-out set: 0.0001989123105120502
MeanAbsoluteError value on hold-out data: 0.01392284594476223
Epoch: 283
Loss on hold-out set: 0.00016750503211943922
MeanAbsoluteError value on hold-out data: 0.012675978243350983
Epoch: 284
Loss on hold-out set: 0.00012629671944427843
MeanAbsoluteError value on hold-out data: 0.010862932540476322
Epoch: 285
Loss on hold-out set: 3.303853181454255e-05
MeanAbsoluteError value on hold-out data: 0.005421480629593134
Epoch: 286
Loss on hold-out set: 2.5829064773126065e-05
MeanAbsoluteError value on hold-out data: 0.0046905288472771645
Epoch: 287
Loss on hold-out set: 8.554022195695373e-06
MeanAbsoluteError value on hold-out data: 0.002357810502871871
Epoch: 288
Loss on hold-out set: 4.042344022835957e-06
MeanAbsoluteError value on hold-out data: 0.0014053164049983025
Epoch: 289
Loss on hold-out set: 2.236487451131995e-05
MeanAbsoluteError value on hold-out data: 0.00447627529501915
Epoch: 290
Loss on hold-out set: 0.00010698425275653503
MeanAbsoluteError value on hold-out data: 0.010167363099753857
Epoch: 291
Loss on hold-out set: 7.809237668927955e-05
MeanAbsoluteError value on hold-out data: 0.008617490530014038
Epoch: 292
Loss on hold-out set: 4.238783449899959e-06
MeanAbsoluteError value on hold-out data: 0.0012516665738075972
Epoch: 293
Loss on hold-out set: 1.654006207804502e-05
MeanAbsoluteError value on hold-out data: 0.0036433697678148746
Epoch: 294
Loss on hold-out set: 5.431662286451013e-06
MeanAbsoluteError value on hold-out data: 0.0019051190465688705
Epoch: 295
Loss on hold-out set: 7.404310752846006e-05
MeanAbsoluteError value on hold-out data: 0.00840339157730341
Epoch: 296
Loss on hold-out set: 7.141977537110889e-05
MeanAbsoluteError value on hold-out data: 0.008225411176681519
Epoch: 297
Loss on hold-out set: 3.994031371085409e-06
MeanAbsoluteError value on hold-out data: 0.0012211180292069912
Epoch: 298
Loss on hold-out set: 1.9233270809069692e-05
MeanAbsoluteError value on hold-out data: 0.003983506001532078
Epoch: 299
Loss on hold-out set: 2.965622169731911e-06
MeanAbsoluteError value on hold-out data: 0.0011378917843103409
Epoch: 300
Loss on hold-out set: 5.4582872268694794e-05
MeanAbsoluteError value on hold-out data: 0.007165452465415001
Epoch: 301
Loss on hold-out set: 9.979873759316673e-05
MeanAbsoluteError value on hold-out data: 0.009790492244064808
Epoch: 302
Loss on hold-out set: 1.5697772859742766e-05
MeanAbsoluteError value on hold-out data: 0.003503934247419238
Epoch: 303
Loss on hold-out set: 1.6466625311295502e-05
MeanAbsoluteError value on hold-out data: 0.003587279235944152
Epoch: 304
Loss on hold-out set: 1.570430829719714e-05
MeanAbsoluteError value on hold-out data: 0.0035189748741686344
Epoch: 305
Loss on hold-out set: 6.166538361484479e-06
MeanAbsoluteError value on hold-out data: 0.0020500628743320704
Epoch: 306
Loss on hold-out set: 8.463469681660889e-05
MeanAbsoluteError value on hold-out data: 0.008995053358376026
Epoch: 307
Loss on hold-out set: 6.937694438659634e-05
MeanAbsoluteError value on hold-out data: 0.00813374575227499
Epoch: 308
Loss on hold-out set: 1.9560217352639148e-05
MeanAbsoluteError value on hold-out data: 0.004091619048267603
Epoch: 309
Loss on hold-out set: 4.162951798111623e-06
MeanAbsoluteError value on hold-out data: 0.0014627897180616856
Epoch: 310
Loss on hold-out set: 1.0927942639682442e-05
MeanAbsoluteError value on hold-out data: 0.002940512029454112
Epoch: 311
Loss on hold-out set: 1.1345224864175849e-05
MeanAbsoluteError value on hold-out data: 0.0029973210766911507
Epoch: 312
Loss on hold-out set: 5.000965122809775e-06
MeanAbsoluteError value on hold-out data: 0.0017792368307709694
Epoch: 313
Loss on hold-out set: 1.6463420730647876e-05
MeanAbsoluteError value on hold-out data: 0.0036871079355478287
Epoch: 314
Loss on hold-out set: 8.92677472189749e-06
MeanAbsoluteError value on hold-out data: 0.0025463460478931665
Epoch: 315
Loss on hold-out set: 3.1071346759410134e-05
MeanAbsoluteError value on hold-out data: 0.005192328244447708
Epoch: 316
Loss on hold-out set: 8.362856198417782e-06
MeanAbsoluteError value on hold-out data: 0.002340447623282671
Epoch: 317
Loss on hold-out set: 4.4823790008912943e-05
MeanAbsoluteError value on hold-out data: 0.006461252924054861
Early stopping at epoch 316
Returned to Spot: Validation loss: 4.4823790008912943e-05
----------------------------------------------
spotPython tuning: 4.4823790008912943e-05 [######----] 64.52% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.0, 'lr_mult': 10.0, 'batch_size': 16, 'epochs': 65536, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 1.0}
Epoch: 1
Loss on hold-out set: 0.024373027790141732
MeanAbsoluteError value on hold-out data: 0.12304873019456863
Epoch: 2
Loss on hold-out set: 0.02155137346371224
MeanAbsoluteError value on hold-out data: 0.1160816177725792
Epoch: 3
Loss on hold-out set: 0.01901265145524552
MeanAbsoluteError value on hold-out data: 0.10965079069137573
Epoch: 4
Loss on hold-out set: 0.016385361552238464
MeanAbsoluteError value on hold-out data: 0.10348924994468689
Epoch: 5
Loss on hold-out set: 0.010484920422497549
MeanAbsoluteError value on hold-out data: 0.0818931981921196
Epoch: 6
Loss on hold-out set: 0.006780695194672597
MeanAbsoluteError value on hold-out data: 0.0666203573346138
Epoch: 7
Loss on hold-out set: 0.0035433894770808124
MeanAbsoluteError value on hold-out data: 0.04766801744699478
Epoch: 8
Loss on hold-out set: 0.0017928837087789649
MeanAbsoluteError value on hold-out data: 0.03310246765613556
Epoch: 9
Loss on hold-out set: 0.0007577210168452247
MeanAbsoluteError value on hold-out data: 0.021661870181560516
Epoch: 10
Loss on hold-out set: 0.0004264385627864517
MeanAbsoluteError value on hold-out data: 0.016592172905802727
Epoch: 11
Loss on hold-out set: 0.00029849146468270764
MeanAbsoluteError value on hold-out data: 0.015266702510416508
Epoch: 12
Loss on hold-out set: 3.989209883576749e-05
MeanAbsoluteError value on hold-out data: 0.00510419299826026
Epoch: 13
Loss on hold-out set: 8.067311993823081e-06
MeanAbsoluteError value on hold-out data: 0.002293130150064826
Epoch: 14
Loss on hold-out set: 1.6699034703330989e-06
MeanAbsoluteError value on hold-out data: 0.0010324798058718443
Epoch: 15
Loss on hold-out set: 9.497403359665967e-07
MeanAbsoluteError value on hold-out data: 0.0007739271968603134
Epoch: 16
Loss on hold-out set: 7.832970224722215e-07
MeanAbsoluteError value on hold-out data: 0.0007026118109934032
Epoch: 17
Loss on hold-out set: 8.27853900145065e-07
MeanAbsoluteError value on hold-out data: 0.0007246945169754326
Epoch: 18
Loss on hold-out set: 1.1314059161362054e-06
MeanAbsoluteError value on hold-out data: 0.000863230146933347
Epoch: 19
Loss on hold-out set: 1.3387995322414338e-06
MeanAbsoluteError value on hold-out data: 0.000948730914387852
Epoch: 20
Loss on hold-out set: 1.4803565172290913e-06
MeanAbsoluteError value on hold-out data: 0.001004959107376635
Epoch: 21
Loss on hold-out set: 1.6099605503720676e-06
MeanAbsoluteError value on hold-out data: 0.0010569934966042638
Epoch: 22
Loss on hold-out set: 1.730398863449074e-06
MeanAbsoluteError value on hold-out data: 0.0011041969992220402
Epoch: 23
Loss on hold-out set: 1.765829432243711e-06
MeanAbsoluteError value on hold-out data: 0.0011187591589987278
Epoch: 24
Loss on hold-out set: 1.5754587372229206e-06
MeanAbsoluteError value on hold-out data: 0.0010431549744680524
Epoch: 25
Loss on hold-out set: 1.1212679941021826e-06
MeanAbsoluteError value on hold-out data: 0.0008573085069656372
Epoch: 26
Loss on hold-out set: 7.576599277794421e-07
MeanAbsoluteError value on hold-out data: 0.0006827728939242661
Epoch: 27
Loss on hold-out set: 7.81287392208852e-07
MeanAbsoluteError value on hold-out data: 0.0007054302841424942
Epoch: 28
Loss on hold-out set: 8.4502017958393e-07
MeanAbsoluteError value on hold-out data: 0.000733658205717802
Epoch: 29
Loss on hold-out set: 8.231588588770185e-07
MeanAbsoluteError value on hold-out data: 0.0007237238460220397
Epoch: 30
Loss on hold-out set: 8.027924093910673e-07
MeanAbsoluteError value on hold-out data: 0.0007142985123209655
Epoch: 31
Loss on hold-out set: 7.97734870909488e-07
MeanAbsoluteError value on hold-out data: 0.0007112610619515181
Epoch: 32
Loss on hold-out set: 8.018695564858621e-07
MeanAbsoluteError value on hold-out data: 0.0007122227689251304
Epoch: 33
Loss on hold-out set: 8.073623614803326e-07
MeanAbsoluteError value on hold-out data: 0.0007135717896744609
Epoch: 34
Loss on hold-out set: 8.03054225690702e-07
MeanAbsoluteError value on hold-out data: 0.0007109076832421124
Epoch: 35
Loss on hold-out set: 7.747404693921118e-07
MeanAbsoluteError value on hold-out data: 0.0006973134004510939
Epoch: 36
Loss on hold-out set: 7.505942018102169e-07
MeanAbsoluteError value on hold-out data: 0.0006857350235804915
Epoch: 37
Loss on hold-out set: 7.845376405600147e-07
MeanAbsoluteError value on hold-out data: 0.000706967490259558
Epoch: 38
Loss on hold-out set: 8.375305505500077e-07
MeanAbsoluteError value on hold-out data: 0.0007351182866841555
Epoch: 39
Loss on hold-out set: 8.559220046172892e-07
MeanAbsoluteError value on hold-out data: 0.0007436751620844007
Epoch: 40
Loss on hold-out set: 8.401675810737766e-07
MeanAbsoluteError value on hold-out data: 0.0007344147306866944
Epoch: 41
Loss on hold-out set: 7.922497158424927e-07
MeanAbsoluteError value on hold-out data: 0.0007082733791321516
Epoch: 42
Loss on hold-out set: 7.393424995502516e-07
MeanAbsoluteError value on hold-out data: 0.0006822638097219169
Epoch: 43
Loss on hold-out set: 8.172696024494622e-07
MeanAbsoluteError value on hold-out data: 0.0007211611955426633
Epoch: 44
Loss on hold-out set: 1.2993343955857103e-06
MeanAbsoluteError value on hold-out data: 0.0009247316047549248
Epoch: 45
Loss on hold-out set: 2.0145631950933754e-06
MeanAbsoluteError value on hold-out data: 0.0012040537549182773
Epoch: 46
Loss on hold-out set: 1.7874891323356821e-06
MeanAbsoluteError value on hold-out data: 0.0011181444860994816
Epoch: 47
Loss on hold-out set: 9.151556092116439e-07
MeanAbsoluteError value on hold-out data: 0.0007669918122701347
Epoch: 48
Loss on hold-out set: 7.489817484814634e-07
MeanAbsoluteError value on hold-out data: 0.0006864750175736845
Epoch: 49
Loss on hold-out set: 8.907793726034709e-07
MeanAbsoluteError value on hold-out data: 0.0007531666196882725
Epoch: 50
Loss on hold-out set: 1.1815851546783194e-06
MeanAbsoluteError value on hold-out data: 0.000882896885741502
Epoch: 51
Loss on hold-out set: 1.6533469240704635e-06
MeanAbsoluteError value on hold-out data: 0.0010696559911593795
Epoch: 52
Loss on hold-out set: 2.2414313081610183e-06
MeanAbsoluteError value on hold-out data: 0.001278066192753613
Epoch: 53
Loss on hold-out set: 2.526071715405315e-06
MeanAbsoluteError value on hold-out data: 0.0013681389391422272
Epoch: 54
Loss on hold-out set: 1.931395579982851e-06
MeanAbsoluteError value on hold-out data: 0.0011599783319979906
Epoch: 55
Loss on hold-out set: 9.644927521441405e-07
MeanAbsoluteError value on hold-out data: 0.0007825427455827594
Epoch: 56
Loss on hold-out set: 8.443463891102223e-07
MeanAbsoluteError value on hold-out data: 0.0007311171502806246
Epoch: 57
Loss on hold-out set: 9.700583683225933e-07
MeanAbsoluteError value on hold-out data: 0.0007831354741938412
Epoch: 58
Loss on hold-out set: 8.768424014473758e-07
MeanAbsoluteError value on hold-out data: 0.00074810313526541
Epoch: 59
Loss on hold-out set: 7.670771493083425e-07
MeanAbsoluteError value on hold-out data: 0.0006959514576010406
Epoch: 60
Loss on hold-out set: 2.0025169856365355e-06
MeanAbsoluteError value on hold-out data: 0.0012029128847643733
Epoch: 61
Loss on hold-out set: 6.528433794684181e-06
MeanAbsoluteError value on hold-out data: 0.002393224975094199
Epoch: 62
Loss on hold-out set: 5.939547774783262e-06
MeanAbsoluteError value on hold-out data: 0.002272859448567033
Epoch: 63
Loss on hold-out set: 3.008731656145277e-06
MeanAbsoluteError value on hold-out data: 0.0015412435168400407
Epoch: 64
Loss on hold-out set: 6.583896911730622e-06
MeanAbsoluteError value on hold-out data: 0.0024095745757222176
Epoch: 65
Loss on hold-out set: 7.982397260332763e-06
MeanAbsoluteError value on hold-out data: 0.00267908931709826
Epoch: 66
Loss on hold-out set: 1.5923684755810092e-06
MeanAbsoluteError value on hold-out data: 0.0010307889897376299
Epoch: 67
Loss on hold-out set: 8.327177439289364e-05
MeanAbsoluteError value on hold-out data: 0.009028160944581032
Epoch: 68
Loss on hold-out set: 1.5045138573106287e-06
MeanAbsoluteError value on hold-out data: 0.0009838697733357549
Epoch: 69
Loss on hold-out set: 2.040154772418502e-05
MeanAbsoluteError value on hold-out data: 0.00437580281868577
Epoch: 70
Loss on hold-out set: 0.00013628354875101266
MeanAbsoluteError value on hold-out data: 0.01157404575496912
Epoch: 71
Loss on hold-out set: 3.372808992265307e-05
MeanAbsoluteError value on hold-out data: 0.005619431380182505
Epoch: 72
Loss on hold-out set: 0.0001615060816555725
MeanAbsoluteError value on hold-out data: 0.012575564906001091
Epoch: 73
Loss on hold-out set: 8.33392091168973e-05
MeanAbsoluteError value on hold-out data: 0.008899363689124584
Epoch: 74
Loss on hold-out set: 6.315815809150656e-06
MeanAbsoluteError value on hold-out data: 0.002009606221690774
Epoch: 75
Loss on hold-out set: 8.42003083610172e-05
MeanAbsoluteError value on hold-out data: 0.008992401883006096
Epoch: 76
Loss on hold-out set: 7.660792705696382e-06
MeanAbsoluteError value on hold-out data: 0.0025866238866001368
Epoch: 77
Loss on hold-out set: 8.937425934020307e-06
MeanAbsoluteError value on hold-out data: 0.0028544387314468622
Epoch: 78
Loss on hold-out set: 2.4043498809221907e-06
MeanAbsoluteError value on hold-out data: 0.0013270436320453882
Epoch: 79
Loss on hold-out set: 6.6403256010074215e-06
MeanAbsoluteError value on hold-out data: 0.0024106211494654417
Epoch: 80
Loss on hold-out set: 1.0612383385633667e-06
MeanAbsoluteError value on hold-out data: 0.0008169933571480215
Epoch: 81
Loss on hold-out set: 3.807570560878192e-05
MeanAbsoluteError value on hold-out data: 0.006014394108206034
Epoch: 82
Loss on hold-out set: 8.621913055226047e-06
MeanAbsoluteError value on hold-out data: 0.002463605487719178
Epoch: 83
Loss on hold-out set: 4.906117115560367e-06
MeanAbsoluteError value on hold-out data: 0.0018182042986154556
Epoch: 84
Loss on hold-out set: 1.0645611669851382e-05
MeanAbsoluteError value on hold-out data: 0.00311275408603251
Epoch: 85
Loss on hold-out set: 2.016728480588139e-06
MeanAbsoluteError value on hold-out data: 0.0011692491825670004
Epoch: 86
Loss on hold-out set: 4.408880278405329e-06
MeanAbsoluteError value on hold-out data: 0.0018955309642478824
Epoch: 87
Loss on hold-out set: 3.611086227513289e-06
MeanAbsoluteError value on hold-out data: 0.0016701814020052552
Epoch: 88
Loss on hold-out set: 6.283748569713728e-06
MeanAbsoluteError value on hold-out data: 0.002219786634668708
Epoch: 89
Loss on hold-out set: 2.7091757721408565e-05
MeanAbsoluteError value on hold-out data: 0.004953805822879076
Epoch: 90
Loss on hold-out set: 1.594620105032319e-05
MeanAbsoluteError value on hold-out data: 0.0036106863990426064
Epoch: 91
Loss on hold-out set: 1.0356082958950489e-05
MeanAbsoluteError value on hold-out data: 0.0030022291466593742
Epoch: 92
Loss on hold-out set: 2.798413911358167e-06
MeanAbsoluteError value on hold-out data: 0.0013792653335258365
Epoch: 93
Loss on hold-out set: 1.9270318333790207e-06
MeanAbsoluteError value on hold-out data: 0.0011194568360224366
Epoch: 94
Loss on hold-out set: 1.0973459738076935e-05
MeanAbsoluteError value on hold-out data: 0.003115386702120304
Epoch: 95
Loss on hold-out set: 9.512945660772906e-06
MeanAbsoluteError value on hold-out data: 0.002769678132608533
Epoch: 96
Loss on hold-out set: 8.786720067483227e-05
MeanAbsoluteError value on hold-out data: 0.009240923449397087
Epoch: 97
Loss on hold-out set: 1.4564520011175008e-05
MeanAbsoluteError value on hold-out data: 0.003473705844953656
Epoch: 98
Loss on hold-out set: 8.471723145033283e-06
MeanAbsoluteError value on hold-out data: 0.0025606846902519464
Epoch: 99
Loss on hold-out set: 1.1625074086240553e-05
MeanAbsoluteError value on hold-out data: 0.0031434090342372656
Epoch: 100
Loss on hold-out set: 9.709079844661142e-07
MeanAbsoluteError value on hold-out data: 0.000774678192101419
Epoch: 101
Loss on hold-out set: 1.546275263152845e-05
MeanAbsoluteError value on hold-out data: 0.003806846449151635
Epoch: 102
Loss on hold-out set: 1.0549985512098876e-06
MeanAbsoluteError value on hold-out data: 0.0008349205018021166
Epoch: 103
Loss on hold-out set: 6.752328892233843e-06
MeanAbsoluteError value on hold-out data: 0.0023398995399475098
Epoch: 104
Loss on hold-out set: 5.491760193284503e-05
MeanAbsoluteError value on hold-out data: 0.00704305712133646
Epoch: 105
Loss on hold-out set: 4.777247063190627e-05
MeanAbsoluteError value on hold-out data: 0.006744791753590107
Epoch: 106
Loss on hold-out set: 5.306215915592666e-06
MeanAbsoluteError value on hold-out data: 0.0019265528535470366
Early stopping at epoch 105
Returned to Spot: Validation loss: 5.306215915592666e-06
----------------------------------------------
spotPython tuning: 5.306215915592666e-06 [#######---] 67.92% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.0, 'lr_mult': 4.7833950088489186, 'batch_size': 16, 'epochs': 65536, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.32513455962132365}
Epoch: 1
Loss on hold-out set: 0.02870625781973726
MeanAbsoluteError value on hold-out data: 0.13421575725078583
Epoch: 2
Loss on hold-out set: 0.025721200839861444
MeanAbsoluteError value on hold-out data: 0.1274544894695282
Epoch: 3
Loss on hold-out set: 0.024566612353450375
MeanAbsoluteError value on hold-out data: 0.12438318878412247
Epoch: 4
Loss on hold-out set: 0.023242814662425143
MeanAbsoluteError value on hold-out data: 0.1207493245601654
Epoch: 5
Loss on hold-out set: 0.021628917243919875
MeanAbsoluteError value on hold-out data: 0.11613968014717102
Epoch: 6
Loss on hold-out set: 0.01895518797008615
MeanAbsoluteError value on hold-out data: 0.10844665765762329
Epoch: 7
Loss on hold-out set: 0.015618679285245506
MeanAbsoluteError value on hold-out data: 0.09832839667797089
Epoch: 8
Loss on hold-out set: 0.012498117738256329
MeanAbsoluteError value on hold-out data: 0.08858608454465866
Epoch: 9
Loss on hold-out set: 0.00979041567954578
MeanAbsoluteError value on hold-out data: 0.07923799008131027
Epoch: 10
Loss on hold-out set: 0.007482504080000676
MeanAbsoluteError value on hold-out data: 0.06959783285856247
Epoch: 11
Loss on hold-out set: 0.005419875703457939
MeanAbsoluteError value on hold-out data: 0.05909206345677376
Epoch: 12
Loss on hold-out set: 0.0037070778014726543
MeanAbsoluteError value on hold-out data: 0.048647090792655945
Epoch: 13
Loss on hold-out set: 0.0023125550329783245
MeanAbsoluteError value on hold-out data: 0.038259126245975494
Epoch: 14
Loss on hold-out set: 0.0013650551248390816
MeanAbsoluteError value on hold-out data: 0.029221853241324425
Epoch: 15
Loss on hold-out set: 0.000711616442698103
MeanAbsoluteError value on hold-out data: 0.020705433562397957
Epoch: 16
Loss on hold-out set: 0.0003567373959843903
MeanAbsoluteError value on hold-out data: 0.013884051702916622
Epoch: 17
Loss on hold-out set: 0.00019983856499924228
MeanAbsoluteError value on hold-out data: 0.009137787856161594
Epoch: 18
Loss on hold-out set: 0.00012951376217978052
MeanAbsoluteError value on hold-out data: 0.005878611002117395
Epoch: 19
Loss on hold-out set: 0.00010039990478330047
MeanAbsoluteError value on hold-out data: 0.0038713098037987947
Epoch: 20
Loss on hold-out set: 8.790063642855354e-05
MeanAbsoluteError value on hold-out data: 0.0027631211560219526
Epoch: 21
Loss on hold-out set: 8.152875678110592e-05
MeanAbsoluteError value on hold-out data: 0.002290131989866495
Epoch: 22
Loss on hold-out set: 7.724679525572835e-05
MeanAbsoluteError value on hold-out data: 0.0021493888925760984
Epoch: 23
Loss on hold-out set: 7.364594667155631e-05
MeanAbsoluteError value on hold-out data: 0.0020861043594777584
Epoch: 24
Loss on hold-out set: 7.026814748051517e-05
MeanAbsoluteError value on hold-out data: 0.002011486329138279
Epoch: 25
Loss on hold-out set: 6.698930147757365e-05
MeanAbsoluteError value on hold-out data: 0.0019074158044531941
Epoch: 26
Loss on hold-out set: 6.383555486428649e-05
MeanAbsoluteError value on hold-out data: 0.001792679657228291
Epoch: 27
Loss on hold-out set: 6.086991971331276e-05
MeanAbsoluteError value on hold-out data: 0.0017078252276405692
Epoch: 28
Loss on hold-out set: 5.8087982064367485e-05
MeanAbsoluteError value on hold-out data: 0.0016581026138737798
Epoch: 29
Loss on hold-out set: 5.545439380452272e-05
MeanAbsoluteError value on hold-out data: 0.0016305538592860103
Epoch: 30
Loss on hold-out set: 5.2938563358470436e-05
MeanAbsoluteError value on hold-out data: 0.001611714600585401
Epoch: 31
Loss on hold-out set: 5.052845823995181e-05
MeanAbsoluteError value on hold-out data: 0.001595678273588419
Epoch: 32
Loss on hold-out set: 4.822200379880757e-05
MeanAbsoluteError value on hold-out data: 0.0015813832869753242
Epoch: 33
Loss on hold-out set: 4.601989039536803e-05
MeanAbsoluteError value on hold-out data: 0.0015689232386648655
Epoch: 34
Loss on hold-out set: 4.39231178066429e-05
MeanAbsoluteError value on hold-out data: 0.0015596033772453666
Epoch: 35
Loss on hold-out set: 4.1932065920192195e-05
MeanAbsoluteError value on hold-out data: 0.0015535189304500818
Epoch: 36
Loss on hold-out set: 4.004477780558533e-05
MeanAbsoluteError value on hold-out data: 0.0015499474247917533
Epoch: 37
Loss on hold-out set: 3.825418690439619e-05
MeanAbsoluteError value on hold-out data: 0.0015475702239200473
Epoch: 38
Loss on hold-out set: 3.65473192148688e-05
MeanAbsoluteError value on hold-out data: 0.0015410565538331866
Epoch: 39
Loss on hold-out set: 3.4902231310465335e-05
MeanAbsoluteError value on hold-out data: 0.0015210617566481233
Epoch: 40
Loss on hold-out set: 3.329473530225426e-05
MeanAbsoluteError value on hold-out data: 0.001485249842517078
Epoch: 41
Loss on hold-out set: 3.1690660322462795e-05
MeanAbsoluteError value on hold-out data: 0.0014242702163755894
Epoch: 42
Loss on hold-out set: 3.0147580687119108e-05
MeanAbsoluteError value on hold-out data: 0.0013586848508566618
Epoch: 43
Loss on hold-out set: 2.8742355006646615e-05
MeanAbsoluteError value on hold-out data: 0.0013375001726672053
Epoch: 44
Loss on hold-out set: 2.7494965596169525e-05
MeanAbsoluteError value on hold-out data: 0.001359358080662787
Epoch: 45
Loss on hold-out set: 2.6345998549004435e-05
MeanAbsoluteError value on hold-out data: 0.0013862295309081674
Epoch: 46
Loss on hold-out set: 2.523795000654086e-05
MeanAbsoluteError value on hold-out data: 0.0014006721321493387
Epoch: 47
Loss on hold-out set: 2.4164041397063174e-05
MeanAbsoluteError value on hold-out data: 0.0014038017252460122
Epoch: 48
Loss on hold-out set: 2.3135785044671236e-05
MeanAbsoluteError value on hold-out data: 0.0014007954159751534
Epoch: 49
Loss on hold-out set: 2.215726154992425e-05
MeanAbsoluteError value on hold-out data: 0.0014023621333763003
Epoch: 50
Loss on hold-out set: 2.118786315912458e-05
MeanAbsoluteError value on hold-out data: 0.0013934943126514554
Epoch: 51
Loss on hold-out set: 2.025395887908656e-05
MeanAbsoluteError value on hold-out data: 0.0013815609272569418
Epoch: 52
Loss on hold-out set: 1.9382867818469668e-05
MeanAbsoluteError value on hold-out data: 0.0013779548462480307
Epoch: 53
Loss on hold-out set: 1.854093722230525e-05
MeanAbsoluteError value on hold-out data: 0.0013692748034372926
Epoch: 54
Loss on hold-out set: 1.7734895822597634e-05
MeanAbsoluteError value on hold-out data: 0.0013583448017016053
Epoch: 55
Loss on hold-out set: 1.6955709716177425e-05
MeanAbsoluteError value on hold-out data: 0.001342003932222724
Epoch: 56
Loss on hold-out set: 1.6187562440145004e-05
MeanAbsoluteError value on hold-out data: 0.001314620953053236
Epoch: 57
Loss on hold-out set: 1.5416178353246468e-05
MeanAbsoluteError value on hold-out data: 0.001269955188035965
Epoch: 58
Loss on hold-out set: 1.4638153611725246e-05
MeanAbsoluteError value on hold-out data: 0.0012073357356712222
Epoch: 59
Loss on hold-out set: 1.387290276218329e-05
MeanAbsoluteError value on hold-out data: 0.0011370066786184907
Epoch: 60
Loss on hold-out set: 1.3165507012720474e-05
MeanAbsoluteError value on hold-out data: 0.0010745110921561718
Epoch: 61
Loss on hold-out set: 1.2552844021971204e-05
MeanAbsoluteError value on hold-out data: 0.0010322595480829477
Epoch: 62
Loss on hold-out set: 1.2023032375533435e-05
MeanAbsoluteError value on hold-out data: 0.0010146367130801082
Epoch: 63
Loss on hold-out set: 1.1534121432831804e-05
MeanAbsoluteError value on hold-out data: 0.0010034912265837193
Epoch: 64
Loss on hold-out set: 1.106818222608222e-05
MeanAbsoluteError value on hold-out data: 0.000989442109130323
Epoch: 65
Loss on hold-out set: 1.0633342846607488e-05
MeanAbsoluteError value on hold-out data: 0.0009757177322171628
Epoch: 66
Loss on hold-out set: 1.0234503801448705e-05
MeanAbsoluteError value on hold-out data: 0.000964582955930382
Epoch: 67
Loss on hold-out set: 9.869621171793896e-06
MeanAbsoluteError value on hold-out data: 0.0009570177644491196
Epoch: 68
Loss on hold-out set: 9.53465189767437e-06
MeanAbsoluteError value on hold-out data: 0.0009550481918267906
Epoch: 69
Loss on hold-out set: 9.22007248355409e-06
MeanAbsoluteError value on hold-out data: 0.0009514277917332947
Epoch: 70
Loss on hold-out set: 8.920855616691514e-06
MeanAbsoluteError value on hold-out data: 0.0009452507947571576
Epoch: 71
Loss on hold-out set: 8.63049003304408e-06
MeanAbsoluteError value on hold-out data: 0.0009350320906378329
Epoch: 72
Loss on hold-out set: 8.345114071959725e-06
MeanAbsoluteError value on hold-out data: 0.0009200443746522069
Epoch: 73
Loss on hold-out set: 8.08422665063278e-06
MeanAbsoluteError value on hold-out data: 0.0009078848524950445
Epoch: 74
Loss on hold-out set: 7.925274474018806e-06
MeanAbsoluteError value on hold-out data: 0.0009350733016617596
Epoch: 75
Loss on hold-out set: 8.020021428628274e-06
MeanAbsoluteError value on hold-out data: 0.0010721568251028657
Epoch: 76
Loss on hold-out set: 8.502031607206032e-06
MeanAbsoluteError value on hold-out data: 0.0013337214477360249
Epoch: 77
Loss on hold-out set: 9.253053654471219e-06
MeanAbsoluteError value on hold-out data: 0.0016353323590010405
Epoch: 78
Loss on hold-out set: 9.787215216611481e-06
MeanAbsoluteError value on hold-out data: 0.0018306099809706211
Epoch: 79
Loss on hold-out set: 9.706222559352204e-06
MeanAbsoluteError value on hold-out data: 0.0018463415326550603
Epoch: 80
Loss on hold-out set: 9.133969013562723e-06
MeanAbsoluteError value on hold-out data: 0.001728386851027608
Epoch: 81
Loss on hold-out set: 8.445013110615132e-06
MeanAbsoluteError value on hold-out data: 0.0015674654860049486
Epoch: 82
Loss on hold-out set: 7.835414120755127e-06
MeanAbsoluteError value on hold-out data: 0.0014176354743540287
Epoch: 83
Loss on hold-out set: 7.311248614434207e-06
MeanAbsoluteError value on hold-out data: 0.0012809769250452518
Epoch: 84
Loss on hold-out set: 6.839203500045474e-06
MeanAbsoluteError value on hold-out data: 0.0011490564793348312
Epoch: 85
Loss on hold-out set: 6.411108031263786e-06
MeanAbsoluteError value on hold-out data: 0.0010208281455561519
Epoch: 86
Loss on hold-out set: 6.065601990270041e-06
MeanAbsoluteError value on hold-out data: 0.0009169411496259272
Epoch: 87
Loss on hold-out set: 5.907161003530123e-06
MeanAbsoluteError value on hold-out data: 0.0009003484155982733
Epoch: 88
Loss on hold-out set: 6.081641261421043e-06
MeanAbsoluteError value on hold-out data: 0.0010060594649985433
Epoch: 89
Loss on hold-out set: 6.655364083934201e-06
MeanAbsoluteError value on hold-out data: 0.0012512665707617998
Epoch: 90
Loss on hold-out set: 7.46614689792056e-06
MeanAbsoluteError value on hold-out data: 0.0015349093591794372
Epoch: 91
Loss on hold-out set: 8.132603948309369e-06
MeanAbsoluteError value on hold-out data: 0.0017539316322654486
Epoch: 92
Loss on hold-out set: 8.301808209484749e-06
MeanAbsoluteError value on hold-out data: 0.0018225781386718154
Epoch: 93
Loss on hold-out set: 7.958483724666477e-06
MeanAbsoluteError value on hold-out data: 0.0017507533775642514
Epoch: 94
Loss on hold-out set: 7.387138650397231e-06
MeanAbsoluteError value on hold-out data: 0.0016089098062366247
Epoch: 95
Loss on hold-out set: 6.883559942587836e-06
MeanAbsoluteError value on hold-out data: 0.0014794530579820275
Epoch: 96
Loss on hold-out set: 6.549232646073888e-06
MeanAbsoluteError value on hold-out data: 0.0014002211391925812
Epoch: 97
Loss on hold-out set: 6.370397135182621e-06
MeanAbsoluteError value on hold-out data: 0.0013660650001838803
Epoch: 98
Loss on hold-out set: 6.323491262312593e-06
MeanAbsoluteError value on hold-out data: 0.001371759339235723
Epoch: 99
Loss on hold-out set: 6.399757341425452e-06
MeanAbsoluteError value on hold-out data: 0.0014147533802315593
Epoch: 100
Loss on hold-out set: 6.608834759821261e-06
MeanAbsoluteError value on hold-out data: 0.00149669055826962
Epoch: 101
Loss on hold-out set: 6.944163188611703e-06
MeanAbsoluteError value on hold-out data: 0.0016120634973049164
Epoch: 102
Loss on hold-out set: 7.362947862451333e-06
MeanAbsoluteError value on hold-out data: 0.0017497839871793985
Epoch: 103
Loss on hold-out set: 7.729192571117127e-06
MeanAbsoluteError value on hold-out data: 0.001869001192972064
Epoch: 104
Loss on hold-out set: 7.823081863247544e-06
MeanAbsoluteError value on hold-out data: 0.0019134082831442356
Epoch: 105
Loss on hold-out set: 7.444169425166604e-06
MeanAbsoluteError value on hold-out data: 0.0018344845157116652
Epoch: 106
Loss on hold-out set: 6.655197610502671e-06
MeanAbsoluteError value on hold-out data: 0.0016330423532053828
Epoch: 107
Loss on hold-out set: 5.837734163019616e-06
MeanAbsoluteError value on hold-out data: 0.0013976464979350567
Epoch: 108
Loss on hold-out set: 5.322784590445831e-06
MeanAbsoluteError value on hold-out data: 0.0012397170066833496
Epoch: 109
Loss on hold-out set: 5.123161866106928e-06
MeanAbsoluteError value on hold-out data: 0.001184552675113082
Epoch: 110
Loss on hold-out set: 5.11615358415216e-06
MeanAbsoluteError value on hold-out data: 0.001199638587422669
Epoch: 111
Loss on hold-out set: 5.207680846739861e-06
MeanAbsoluteError value on hold-out data: 0.001250021276064217
Epoch: 112
Loss on hold-out set: 5.341031193271001e-06
MeanAbsoluteError value on hold-out data: 0.0013125432888045907
Epoch: 113
Loss on hold-out set: 5.468899698108113e-06
MeanAbsoluteError value on hold-out data: 0.0013715438544750214
Epoch: 114
Loss on hold-out set: 5.56603435454331e-06
MeanAbsoluteError value on hold-out data: 0.0014192740200087428
Epoch: 115
Loss on hold-out set: 5.615261694689061e-06
MeanAbsoluteError value on hold-out data: 0.0014495218638330698
Epoch: 116
Loss on hold-out set: 5.613888465392704e-06
MeanAbsoluteError value on hold-out data: 0.001462334766983986
Epoch: 117
Loss on hold-out set: 5.56953277976534e-06
MeanAbsoluteError value on hold-out data: 0.0014605659525841475
Epoch: 118
Loss on hold-out set: 5.494764626459264e-06
MeanAbsoluteError value on hold-out data: 0.001448362716473639
Epoch: 119
Loss on hold-out set: 5.4049408294974314e-06
MeanAbsoluteError value on hold-out data: 0.001430522883310914
Epoch: 120
Loss on hold-out set: 5.3077839143761115e-06
MeanAbsoluteError value on hold-out data: 0.0014097158564254642
Epoch: 121
Loss on hold-out set: 5.2124547963965025e-06
MeanAbsoluteError value on hold-out data: 0.0013888380490243435
Epoch: 122
Loss on hold-out set: 5.123256145404746e-06
MeanAbsoluteError value on hold-out data: 0.001369330333545804
Epoch: 123
Loss on hold-out set: 5.040440747076278e-06
MeanAbsoluteError value on hold-out data: 0.0013515808386728168
Epoch: 124
Loss on hold-out set: 4.965436932922641e-06
MeanAbsoluteError value on hold-out data: 0.0013359743170440197
Epoch: 125
Loss on hold-out set: 4.8949721196167e-06
MeanAbsoluteError value on hold-out data: 0.0013216942315921187
Epoch: 126
Loss on hold-out set: 4.82919308284947e-06
MeanAbsoluteError value on hold-out data: 0.0013085728278383613
Epoch: 127
Loss on hold-out set: 4.767000692290342e-06
MeanAbsoluteError value on hold-out data: 0.0012961081229150295
Epoch: 128
Loss on hold-out set: 4.705825583522183e-06
MeanAbsoluteError value on hold-out data: 0.0012835926609113812
Epoch: 129
Loss on hold-out set: 4.647256811327488e-06
MeanAbsoluteError value on hold-out data: 0.0012716313358396292
Epoch: 130
Loss on hold-out set: 4.5891741999519966e-06
MeanAbsoluteError value on hold-out data: 0.0012593924766406417
Epoch: 131
Loss on hold-out set: 4.531395739760276e-06
MeanAbsoluteError value on hold-out data: 0.001246867934241891
Epoch: 132
Loss on hold-out set: 4.475465390753111e-06
MeanAbsoluteError value on hold-out data: 0.0012344877468422055
Epoch: 133
Loss on hold-out set: 4.420246296520322e-06
MeanAbsoluteError value on hold-out data: 0.0012218226911500096
Epoch: 134
Loss on hold-out set: 4.36640473373317e-06
MeanAbsoluteError value on hold-out data: 0.0012092390097677708
Epoch: 135
Loss on hold-out set: 4.312253876928719e-06
MeanAbsoluteError value on hold-out data: 0.0011962137650698423
Epoch: 136
Loss on hold-out set: 4.259219460771802e-06
MeanAbsoluteError value on hold-out data: 0.0011831277515739202
Epoch: 137
Loss on hold-out set: 4.2069886699449084e-06
MeanAbsoluteError value on hold-out data: 0.0011699447641149163
Epoch: 138
Loss on hold-out set: 4.154534310959877e-06
MeanAbsoluteError value on hold-out data: 0.0011561709688976407
Epoch: 139
Loss on hold-out set: 4.103864811393003e-06
MeanAbsoluteError value on hold-out data: 0.001142773195169866
Epoch: 140
Loss on hold-out set: 4.052240919798733e-06
MeanAbsoluteError value on hold-out data: 0.001128682284615934
Epoch: 141
Loss on hold-out set: 4.001868929710901e-06
MeanAbsoluteError value on hold-out data: 0.001114716287702322
Epoch: 142
Loss on hold-out set: 3.9501482995930066e-06
MeanAbsoluteError value on hold-out data: 0.0010998212965205312
Epoch: 143
Loss on hold-out set: 3.899682990561958e-06
MeanAbsoluteError value on hold-out data: 0.0010852647246792912
Epoch: 144
Loss on hold-out set: 3.848982098469078e-06
MeanAbsoluteError value on hold-out data: 0.001070372061803937
Epoch: 145
Loss on hold-out set: 3.7979391974754674e-06
MeanAbsoluteError value on hold-out data: 0.0010555470362305641
Epoch: 146
Loss on hold-out set: 3.7467141013573715e-06
MeanAbsoluteError value on hold-out data: 0.001040496863424778
Epoch: 147
Loss on hold-out set: 3.6954894749454215e-06
MeanAbsoluteError value on hold-out data: 0.0010251952335238457
Epoch: 148
Loss on hold-out set: 3.643125796172267e-06
MeanAbsoluteError value on hold-out data: 0.0010090998839586973
Epoch: 149
Loss on hold-out set: 3.590994541163558e-06
MeanAbsoluteError value on hold-out data: 0.0009923940524458885
Epoch: 150
Loss on hold-out set: 3.5381992144098866e-06
MeanAbsoluteError value on hold-out data: 0.0009752991609275341
Epoch: 151
Loss on hold-out set: 3.485035246117868e-06
MeanAbsoluteError value on hold-out data: 0.0009578774333931506
Epoch: 152
Loss on hold-out set: 3.429806012814209e-06
MeanAbsoluteError value on hold-out data: 0.0009406234021298587
Epoch: 153
Loss on hold-out set: 3.3816076372778823e-06
MeanAbsoluteError value on hold-out data: 0.0009251886513084173
Epoch: 154
Loss on hold-out set: 3.331789433727145e-06
MeanAbsoluteError value on hold-out data: 0.0009083177428692579
Epoch: 155
Loss on hold-out set: 3.2773781473033045e-06
MeanAbsoluteError value on hold-out data: 0.0008895693463273346
Epoch: 156
Loss on hold-out set: 3.2359955400208585e-06
MeanAbsoluteError value on hold-out data: 0.0008740968769416213
Epoch: 157
Loss on hold-out set: 3.2012366390469984e-06
MeanAbsoluteError value on hold-out data: 0.000859877560287714
Epoch: 158
Loss on hold-out set: 3.1811592533047494e-06
MeanAbsoluteError value on hold-out data: 0.0008520917035639286
Epoch: 159
Loss on hold-out set: 3.1812353561714476e-06
MeanAbsoluteError value on hold-out data: 0.000855750753544271
Epoch: 160
Loss on hold-out set: 3.2085498291005357e-06
MeanAbsoluteError value on hold-out data: 0.0008692358969710767
Epoch: 161
Loss on hold-out set: 3.2685445543584616e-06
MeanAbsoluteError value on hold-out data: 0.0008963541476987302
Epoch: 162
Loss on hold-out set: 3.3564047672179617e-06
MeanAbsoluteError value on hold-out data: 0.0009358467650599778
Epoch: 163
Loss on hold-out set: 3.450697001402372e-06
MeanAbsoluteError value on hold-out data: 0.0009757654624991119
Epoch: 164
Loss on hold-out set: 3.5144482688720974e-06
MeanAbsoluteError value on hold-out data: 0.0010020582703873515
Epoch: 165
Loss on hold-out set: 3.52394865606249e-06
MeanAbsoluteError value on hold-out data: 0.0010051120771095157
Epoch: 166
Loss on hold-out set: 3.495600807175498e-06
MeanAbsoluteError value on hold-out data: 0.0009917960269376636
Epoch: 167
Loss on hold-out set: 3.4490347981150798e-06
MeanAbsoluteError value on hold-out data: 0.0009700031368993223
Epoch: 168
Loss on hold-out set: 3.386828507844161e-06
MeanAbsoluteError value on hold-out data: 0.0009418128756806254
Epoch: 169
Loss on hold-out set: 3.302714741506095e-06
MeanAbsoluteError value on hold-out data: 0.000903027830645442
Epoch: 170
Loss on hold-out set: 3.2025526359958396e-06
MeanAbsoluteError value on hold-out data: 0.00085588195361197
Epoch: 171
Loss on hold-out set: 3.1309777664558314e-06
MeanAbsoluteError value on hold-out data: 0.0008211451931856573
Epoch: 172
Loss on hold-out set: 3.2074103339590167e-06
MeanAbsoluteError value on hold-out data: 0.0008655778365209699
Epoch: 173
Loss on hold-out set: 3.5431618692583517e-06
MeanAbsoluteError value on hold-out data: 0.0010020658373832703
Epoch: 174
Loss on hold-out set: 3.97737240794078e-06
MeanAbsoluteError value on hold-out data: 0.0011634636903181672
Epoch: 175
Loss on hold-out set: 4.086547284331525e-06
MeanAbsoluteError value on hold-out data: 0.0011997409164905548
Epoch: 176
Loss on hold-out set: 3.7580501719659016e-06
MeanAbsoluteError value on hold-out data: 0.0010788351064547896
Epoch: 177
Loss on hold-out set: 3.38228957580692e-06
MeanAbsoluteError value on hold-out data: 0.0009273692849092185
Epoch: 178
Loss on hold-out set: 3.3375751064867425e-06
MeanAbsoluteError value on hold-out data: 0.0008955032681114972
Epoch: 179
Loss on hold-out set: 3.5427848866962257e-06
MeanAbsoluteError value on hold-out data: 0.0009829953778535128
Epoch: 180
Loss on hold-out set: 3.731110552962491e-06
MeanAbsoluteError value on hold-out data: 0.0010634720092639327
Epoch: 181
Loss on hold-out set: 3.848522740817746e-06
MeanAbsoluteError value on hold-out data: 0.0011105772573500872
Epoch: 182
Loss on hold-out set: 3.939377168798704e-06
MeanAbsoluteError value on hold-out data: 0.0011442851973697543
Epoch: 183
Loss on hold-out set: 4.001291699751164e-06
MeanAbsoluteError value on hold-out data: 0.0011669929372146726
Epoch: 184
Loss on hold-out set: 4.040258533534238e-06
MeanAbsoluteError value on hold-out data: 0.001181547762826085
Epoch: 185
Loss on hold-out set: 4.0573915558333714e-06
MeanAbsoluteError value on hold-out data: 0.0011881383834406734
Epoch: 186
Loss on hold-out set: 4.066894435158917e-06
MeanAbsoluteError value on hold-out data: 0.001192058902233839
Epoch: 187
Loss on hold-out set: 4.068341073243094e-06
MeanAbsoluteError value on hold-out data: 0.0011931273620575666
Epoch: 188
Loss on hold-out set: 4.067515000746138e-06
MeanAbsoluteError value on hold-out data: 0.0011933761416003108
Epoch: 189
Loss on hold-out set: 4.065311630160738e-06
MeanAbsoluteError value on hold-out data: 0.0011931200278922915
Epoch: 190
Loss on hold-out set: 4.064327676563775e-06
MeanAbsoluteError value on hold-out data: 0.0011932518100365996
Epoch: 191
Loss on hold-out set: 4.060319003871739e-06
MeanAbsoluteError value on hold-out data: 0.0011922619305551052
Epoch: 192
Loss on hold-out set: 4.057493706448823e-06
MeanAbsoluteError value on hold-out data: 0.0011916334042325616
Epoch: 193
Loss on hold-out set: 4.054860363267883e-06
MeanAbsoluteError value on hold-out data: 0.0011910370085388422
Epoch: 194
Loss on hold-out set: 4.0504031451411336e-06
MeanAbsoluteError value on hold-out data: 0.0011897417716681957
Epoch: 195
Loss on hold-out set: 4.049227353980793e-06
MeanAbsoluteError value on hold-out data: 0.0011895786738023162
Epoch: 196
Loss on hold-out set: 4.046228372987427e-06
MeanAbsoluteError value on hold-out data: 0.0011887381551787257
Epoch: 197
Loss on hold-out set: 4.044432976594467e-06
MeanAbsoluteError value on hold-out data: 0.001188298687338829
Epoch: 198
Loss on hold-out set: 4.04123533682746e-06
MeanAbsoluteError value on hold-out data: 0.0011873171897605062
Epoch: 199
Loss on hold-out set: 4.040321854111091e-06
MeanAbsoluteError value on hold-out data: 0.0011871280148625374
Epoch: 200
Loss on hold-out set: 4.042724182646022e-06
MeanAbsoluteError value on hold-out data: 0.0011881125392392278
Epoch: 201
Loss on hold-out set: 4.042115781550437e-06
MeanAbsoluteError value on hold-out data: 0.0011879841331392527
Epoch: 202
Loss on hold-out set: 4.0454408343449406e-06
MeanAbsoluteError value on hold-out data: 0.0011892233742401004
Epoch: 203
Loss on hold-out set: 4.046590429664464e-06
MeanAbsoluteError value on hold-out data: 0.0011896868236362934
Epoch: 204
Loss on hold-out set: 4.049923904260236e-06
MeanAbsoluteError value on hold-out data: 0.0011909009190276265
Epoch: 205
Loss on hold-out set: 4.05443698750069e-06
MeanAbsoluteError value on hold-out data: 0.001192526426166296
Epoch: 206
Loss on hold-out set: 4.0583134812933214e-06
MeanAbsoluteError value on hold-out data: 0.0011939010582864285
Epoch: 207
Loss on hold-out set: 4.063345909942559e-06
MeanAbsoluteError value on hold-out data: 0.001195645658299327
Epoch: 208
Loss on hold-out set: 4.069181075369431e-06
MeanAbsoluteError value on hold-out data: 0.001197659526951611
Epoch: 209
Loss on hold-out set: 4.075148691945766e-06
MeanAbsoluteError value on hold-out data: 0.001199697726406157
Epoch: 210
Loss on hold-out set: 4.0791637311007144e-06
MeanAbsoluteError value on hold-out data: 0.0012010218342766166
Epoch: 211
Loss on hold-out set: 4.086376146747889e-06
MeanAbsoluteError value on hold-out data: 0.001203462714329362
Epoch: 212
Loss on hold-out set: 4.091553074359629e-06
MeanAbsoluteError value on hold-out data: 0.0012052441015839577
Epoch: 213
Loss on hold-out set: 4.096812885659586e-06
MeanAbsoluteError value on hold-out data: 0.0012071112869307399
Epoch: 214
Loss on hold-out set: 4.1037709240155985e-06
MeanAbsoluteError value on hold-out data: 0.001209585927426815
Epoch: 215
Loss on hold-out set: 4.10972655859759e-06
MeanAbsoluteError value on hold-out data: 0.0012117346050217748
Epoch: 216
Loss on hold-out set: 4.114778891418705e-06
MeanAbsoluteError value on hold-out data: 0.0012135590659454465
Epoch: 217
Loss on hold-out set: 4.119435665846763e-06
MeanAbsoluteError value on hold-out data: 0.0012152125127613544
Epoch: 218
Loss on hold-out set: 4.125391186741916e-06
MeanAbsoluteError value on hold-out data: 0.0012173264985904098
Epoch: 219
Loss on hold-out set: 4.128623560829606e-06
MeanAbsoluteError value on hold-out data: 0.0012184580555185676
Epoch: 220
Loss on hold-out set: 4.134091718218483e-06
MeanAbsoluteError value on hold-out data: 0.001220358652062714
Epoch: 221
Loss on hold-out set: 4.1374847976265685e-06
MeanAbsoluteError value on hold-out data: 0.0012215097667649388
Epoch: 222
Loss on hold-out set: 4.14303199728525e-06
MeanAbsoluteError value on hold-out data: 0.0012234046589583158
Epoch: 223
Loss on hold-out set: 4.14491051072362e-06
MeanAbsoluteError value on hold-out data: 0.001223979750648141
Epoch: 224
Loss on hold-out set: 4.1476711622204966e-06
MeanAbsoluteError value on hold-out data: 0.001224870327860117
Epoch: 225
Loss on hold-out set: 4.14399291433878e-06
MeanAbsoluteError value on hold-out data: 0.0012234303867444396
Epoch: 226
Loss on hold-out set: 4.145867867584074e-06
MeanAbsoluteError value on hold-out data: 0.001223975676111877
Epoch: 227
Loss on hold-out set: 4.149488224931319e-06
MeanAbsoluteError value on hold-out data: 0.001225166954100132
Epoch: 228
Loss on hold-out set: 4.148543289853765e-06
MeanAbsoluteError value on hold-out data: 0.0012247244594618678
Epoch: 229
Loss on hold-out set: 4.149378080336119e-06
MeanAbsoluteError value on hold-out data: 0.001224907231517136
Epoch: 230
Loss on hold-out set: 4.149564101920221e-06
MeanAbsoluteError value on hold-out data: 0.001224853447638452
Epoch: 231
Loss on hold-out set: 4.150463921273752e-06
MeanAbsoluteError value on hold-out data: 0.001225068117491901
Epoch: 232
Loss on hold-out set: 4.148147731460708e-06
MeanAbsoluteError value on hold-out data: 0.00122411351185292
Epoch: 233
Loss on hold-out set: 4.146670580427637e-06
MeanAbsoluteError value on hold-out data: 0.0012234533205628395
Epoch: 234
Loss on hold-out set: 4.145115847103098e-06
MeanAbsoluteError value on hold-out data: 0.0012227717088535428
Epoch: 235
Loss on hold-out set: 4.143963882310536e-06
MeanAbsoluteError value on hold-out data: 0.001222228049300611
Early stopping at epoch 234
Returned to Spot: Validation loss: 4.143963882310536e-06
----------------------------------------------
spotPython tuning: 4.143963882310536e-06 [########--] 77.80% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.9, 'lr_mult': 10.0, 'batch_size': 16, 'epochs': 65536, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.0}
Epoch: 1
Loss on hold-out set: 0.03484322738490606
MeanAbsoluteError value on hold-out data: 0.14705060422420502
Epoch: 2
Loss on hold-out set: 0.03133094251940125
MeanAbsoluteError value on hold-out data: 0.13855695724487305
Epoch: 3
Loss on hold-out set: 0.030245814864572725
MeanAbsoluteError value on hold-out data: 0.13760770857334137
Epoch: 4
Loss on hold-out set: 0.02940585760791835
MeanAbsoluteError value on hold-out data: 0.13482186198234558
Epoch: 5
Loss on hold-out set: 0.02947350861014504
MeanAbsoluteError value on hold-out data: 0.13527804613113403
Epoch: 6
Loss on hold-out set: 0.029527865399263407
MeanAbsoluteError value on hold-out data: 0.13550570607185364
Epoch: 7
Loss on hold-out set: 0.029866317238070463
MeanAbsoluteError value on hold-out data: 0.13602915406227112
Epoch: 8
Loss on hold-out set: 0.029627769695300805
MeanAbsoluteError value on hold-out data: 0.13585898280143738
Epoch: 9
Loss on hold-out set: 0.02958195489880286
MeanAbsoluteError value on hold-out data: 0.1357453614473343
Epoch: 10
Loss on hold-out set: 0.029679975178288787
MeanAbsoluteError value on hold-out data: 0.13601455092430115
Epoch: 11
Loss on hold-out set: 0.029569613992383604
MeanAbsoluteError value on hold-out data: 0.13575059175491333
Epoch: 12
Loss on hold-out set: 0.02951617715390105
MeanAbsoluteError value on hold-out data: 0.13540196418762207
Epoch: 13
Loss on hold-out set: 0.02956041551538204
MeanAbsoluteError value on hold-out data: 0.1355452537536621
Epoch: 14
Loss on hold-out set: 0.029566860316615356
MeanAbsoluteError value on hold-out data: 0.13550293445587158
Epoch: 15
Loss on hold-out set: 0.02953011723921487
MeanAbsoluteError value on hold-out data: 0.13544556498527527
Epoch: 16
Loss on hold-out set: 0.02953992377182371
MeanAbsoluteError value on hold-out data: 0.13548524677753448
Epoch: 17
Loss on hold-out set: 0.02955476179915039
MeanAbsoluteError value on hold-out data: 0.13552874326705933
Epoch: 18
Loss on hold-out set: 0.02954301782148449
MeanAbsoluteError value on hold-out data: 0.13549475371837616
Epoch: 19
Loss on hold-out set: 0.029531973218055146
MeanAbsoluteError value on hold-out data: 0.1354505568742752
Epoch: 20
Loss on hold-out set: 0.029540007541838446
MeanAbsoluteError value on hold-out data: 0.1354731172323227
Epoch: 21
Loss on hold-out set: 0.029541840041546447
MeanAbsoluteError value on hold-out data: 0.13548310101032257
Epoch: 22
Loss on hold-out set: 0.02954319041026266
MeanAbsoluteError value on hold-out data: 0.13548731803894043
Epoch: 23
Loss on hold-out set: 0.029543063897443444
MeanAbsoluteError value on hold-out data: 0.1354866325855255
Epoch: 24
Loss on hold-out set: 0.029543285258114338
MeanAbsoluteError value on hold-out data: 0.13548794388771057
Epoch: 25
Loss on hold-out set: 0.029543046300348482
MeanAbsoluteError value on hold-out data: 0.13548748195171356
Epoch: 26
Loss on hold-out set: 0.029542976892308184
MeanAbsoluteError value on hold-out data: 0.13548733294010162
Epoch: 27
Loss on hold-out set: 0.02954303674203785
MeanAbsoluteError value on hold-out data: 0.13548888266086578
Epoch: 28
Loss on hold-out set: 0.029542906552945312
MeanAbsoluteError value on hold-out data: 0.13548731803894043
Epoch: 29
Loss on hold-out set: 0.02954306296612087
MeanAbsoluteError value on hold-out data: 0.13548746705055237
Epoch: 30
Loss on hold-out set: 0.02954393350764325
MeanAbsoluteError value on hold-out data: 0.13548868894577026
Epoch: 31
Loss on hold-out set: 0.029543078504502773
MeanAbsoluteError value on hold-out data: 0.13548772037029266
Epoch: 32
Loss on hold-out set: 0.0295430020380177
MeanAbsoluteError value on hold-out data: 0.1354874223470688
Epoch: 33
Loss on hold-out set: 0.029543093405663967
MeanAbsoluteError value on hold-out data: 0.13548777997493744
Epoch: 34
Loss on hold-out set: 0.029543101689533183
MeanAbsoluteError value on hold-out data: 0.13548782467842102
Epoch: 35
Loss on hold-out set: 0.029543811847504816
MeanAbsoluteError value on hold-out data: 0.13548868894577026
Epoch: 36
Loss on hold-out set: 0.02954311409082852
MeanAbsoluteError value on hold-out data: 0.13548792898654938
Epoch: 37
Loss on hold-out set: 0.029543121737477026
MeanAbsoluteError value on hold-out data: 0.13548800349235535
Epoch: 38
Loss on hold-out set: 0.02954313026643113
MeanAbsoluteError value on hold-out data: 0.13548806309700012
Epoch: 39
Loss on hold-out set: 0.02954313516812889
MeanAbsoluteError value on hold-out data: 0.13548807799816132
Epoch: 40
Loss on hold-out set: 0.029543142618709488
MeanAbsoluteError value on hold-out data: 0.1354881227016449
Epoch: 41
Loss on hold-out set: 0.029543131197753706
MeanAbsoluteError value on hold-out data: 0.13548807799816132
Epoch: 42
Loss on hold-out set: 0.02954316310780613
MeanAbsoluteError value on hold-out data: 0.13548827171325684
Epoch: 43
Loss on hold-out set: 0.029543161441228892
MeanAbsoluteError value on hold-out data: 0.13548825681209564
Epoch: 44
Loss on hold-out set: 0.029543169038860423
MeanAbsoluteError value on hold-out data: 0.13548828661441803
Epoch: 45
Loss on hold-out set: 0.029543176783542884
MeanAbsoluteError value on hold-out data: 0.1354883760213852
Epoch: 46
Loss on hold-out set: 0.029543183106732995
MeanAbsoluteError value on hold-out data: 0.13548842072486877
Epoch: 47
Loss on hold-out set: 0.0295431883515496
MeanAbsoluteError value on hold-out data: 0.13548843562602997
Epoch: 48
Loss on hold-out set: 0.029543192959145495
MeanAbsoluteError value on hold-out data: 0.13548848032951355
Epoch: 49
Loss on hold-out set: 0.029543199919556316
MeanAbsoluteError value on hold-out data: 0.13548853993415833
Epoch: 50
Loss on hold-out set: 0.029543204233050346
MeanAbsoluteError value on hold-out data: 0.13548853993415833
Epoch: 51
Loss on hold-out set: 0.02954321070329139
MeanAbsoluteError value on hold-out data: 0.1354885846376419
Epoch: 52
Loss on hold-out set: 0.02954321521285333
MeanAbsoluteError value on hold-out data: 0.1354886144399643
Epoch: 53
Loss on hold-out set: 0.02954322055570389
MeanAbsoluteError value on hold-out data: 0.13548865914344788
Epoch: 54
Loss on hold-out set: 0.02954322364377348
MeanAbsoluteError value on hold-out data: 0.13548865914344788
Epoch: 55
Loss on hold-out set: 0.029543579997200715
MeanAbsoluteError value on hold-out data: 0.1354890912771225
Epoch: 56
Loss on hold-out set: 0.02954323457455949
MeanAbsoluteError value on hold-out data: 0.13548877835273743
Epoch: 57
Loss on hold-out set: 0.029543238397883743
MeanAbsoluteError value on hold-out data: 0.13548879325389862
Epoch: 58
Loss on hold-out set: 0.02954324295646266
MeanAbsoluteError value on hold-out data: 0.135488823056221
Epoch: 59
Loss on hold-out set: 0.02954324638765109
MeanAbsoluteError value on hold-out data: 0.13548880815505981
Epoch: 60
Loss on hold-out set: 0.029543252220671428
MeanAbsoluteError value on hold-out data: 0.13548889756202698
Epoch: 61
Loss on hold-out set: 0.029543255749893815
MeanAbsoluteError value on hold-out data: 0.13548889756202698
Epoch: 62
Loss on hold-out set: 0.029543259720269003
MeanAbsoluteError value on hold-out data: 0.13548891246318817
Epoch: 63
Loss on hold-out set: 0.029543263935729078
MeanAbsoluteError value on hold-out data: 0.13548894226551056
Epoch: 64
Loss on hold-out set: 0.029543267219866578
MeanAbsoluteError value on hold-out data: 0.13548897206783295
Epoch: 65
Loss on hold-out set: 0.029543269866783368
MeanAbsoluteError value on hold-out data: 0.13548900187015533
Epoch: 66
Loss on hold-out set: 0.02954340177147012
MeanAbsoluteError value on hold-out data: 0.13548916578292847
Epoch: 67
Loss on hold-out set: 0.02954327560176975
MeanAbsoluteError value on hold-out data: 0.13548901677131653
Epoch: 68
Loss on hold-out set: 0.029543279523127956
MeanAbsoluteError value on hold-out data: 0.1354890763759613
Early stopping at epoch 67
Returned to Spot: Validation loss: 0.029543279523127956
----------------------------------------------
spotPython tuning: 4.143963882310536e-06 [#########-] 85.50% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.1720379617312114, 'lr_mult': 10.0, 'batch_size': 2, 'epochs': 65536, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.0}
Epoch: 1
Loss on hold-out set: 0.0403297191445472
MeanAbsoluteError value on hold-out data: 0.1595991998910904
Epoch: 2
Loss on hold-out set: 0.0414189805323258
MeanAbsoluteError value on hold-out data: 0.16301855444908142
Epoch: 3
Loss on hold-out set: 0.022758076308236924
MeanAbsoluteError value on hold-out data: 0.11985636502504349
Epoch: 4
Loss on hold-out set: 0.022994960356263618
MeanAbsoluteError value on hold-out data: 0.12174840271472931
Epoch: 5
Loss on hold-out set: 0.014249609907128615
MeanAbsoluteError value on hold-out data: 0.09423665702342987
Epoch: 6
Loss on hold-out set: 0.02492988055649524
MeanAbsoluteError value on hold-out data: 0.131992906332016
Epoch: 7
Loss on hold-out set: 0.012445923779256797
MeanAbsoluteError value on hold-out data: 0.09271518886089325
Epoch: 8
Loss on hold-out set: 0.009661924928295776
MeanAbsoluteError value on hold-out data: 0.07080782204866409
Epoch: 9
Loss on hold-out set: 0.011046820447603144
MeanAbsoluteError value on hold-out data: 0.08376183360815048
Epoch: 10
Loss on hold-out set: 0.009905782293329442
MeanAbsoluteError value on hold-out data: 0.07259206473827362
Epoch: 11
Loss on hold-out set: 0.009013173466082663
MeanAbsoluteError value on hold-out data: 0.07496900111436844
Epoch: 12
Loss on hold-out set: 0.010750370816458599
MeanAbsoluteError value on hold-out data: 0.07322993874549866
Epoch: 13
Loss on hold-out set: 0.01172995774860586
MeanAbsoluteError value on hold-out data: 0.07974939048290253
Epoch: 14
Loss on hold-out set: 0.010966244128060984
MeanAbsoluteError value on hold-out data: 0.07312749326229095
Epoch: 15
Loss on hold-out set: 0.011429534369896525
MeanAbsoluteError value on hold-out data: 0.08074013888835907
Epoch: 16
Loss on hold-out set: 0.01104587111009702
MeanAbsoluteError value on hold-out data: 0.08200232684612274
Epoch: 17
Loss on hold-out set: 0.013805210440762798
MeanAbsoluteError value on hold-out data: 0.08925847709178925
Epoch: 18
Loss on hold-out set: 0.009436360502634973
MeanAbsoluteError value on hold-out data: 0.0675116628408432
Epoch: 19
Loss on hold-out set: 0.011860452830327025
MeanAbsoluteError value on hold-out data: 0.08698230981826782
Epoch: 20
Loss on hold-out set: 0.009264592957430675
MeanAbsoluteError value on hold-out data: 0.07350257784128189
Epoch: 21
Loss on hold-out set: 0.009833888761371175
MeanAbsoluteError value on hold-out data: 0.06704507768154144
Epoch: 22
Loss on hold-out set: 0.011379872003841834
MeanAbsoluteError value on hold-out data: 0.07210222631692886
Epoch: 23
Loss on hold-out set: 0.00989705821290651
MeanAbsoluteError value on hold-out data: 0.07259450107812881
Epoch: 24
Loss on hold-out set: 0.009315412285855019
MeanAbsoluteError value on hold-out data: 0.06387042999267578
Epoch: 25
Loss on hold-out set: 0.008278463755729415
MeanAbsoluteError value on hold-out data: 0.06679587811231613
Epoch: 26
Loss on hold-out set: 0.011638859386160523
MeanAbsoluteError value on hold-out data: 0.07835426926612854
Epoch: 27
Loss on hold-out set: 0.008727207730501807
MeanAbsoluteError value on hold-out data: 0.06419321149587631
Epoch: 28
Loss on hold-out set: 0.008530058900917842
MeanAbsoluteError value on hold-out data: 0.0653296634554863
Epoch: 29
Loss on hold-out set: 0.00917378757946911
MeanAbsoluteError value on hold-out data: 0.06369846314191818
Epoch: 30
Loss on hold-out set: 0.008874228904145033
MeanAbsoluteError value on hold-out data: 0.07446703314781189
Epoch: 31
Loss on hold-out set: 0.010678433252905961
MeanAbsoluteError value on hold-out data: 0.0799589529633522
Epoch: 32
Loss on hold-out set: 0.01033150527344939
MeanAbsoluteError value on hold-out data: 0.07884584367275238
Epoch: 33
Loss on hold-out set: 0.00793263530376862
MeanAbsoluteError value on hold-out data: 0.06122381240129471
Epoch: 34
Loss on hold-out set: 0.00907595132094381
MeanAbsoluteError value on hold-out data: 0.06494247913360596
Epoch: 35
Loss on hold-out set: 0.00845392910961588
MeanAbsoluteError value on hold-out data: 0.0640772357583046
Epoch: 36
Loss on hold-out set: 0.008764802877485635
MeanAbsoluteError value on hold-out data: 0.06634856015443802
Epoch: 37
Loss on hold-out set: 0.00931187540954852
MeanAbsoluteError value on hold-out data: 0.07082165032625198
Epoch: 38
Loss on hold-out set: 0.01008167219547128
MeanAbsoluteError value on hold-out data: 0.07733552902936935
Epoch: 39
Loss on hold-out set: 0.010470260784744218
MeanAbsoluteError value on hold-out data: 0.06786869466304779
Epoch: 40
Loss on hold-out set: 0.008883344840287464
MeanAbsoluteError value on hold-out data: 0.06365266442298889
Epoch: 41
Loss on hold-out set: 0.009633783984985106
MeanAbsoluteError value on hold-out data: 0.06751123070716858
Epoch: 42
Loss on hold-out set: 0.007403806801251752
MeanAbsoluteError value on hold-out data: 0.05301915481686592
Epoch: 43
Loss on hold-out set: 0.010151288639268993
MeanAbsoluteError value on hold-out data: 0.06711765378713608
Epoch: 44
Loss on hold-out set: 0.006512599493380549
MeanAbsoluteError value on hold-out data: 0.05978160351514816
Epoch: 45
Loss on hold-out set: 0.008089744304061241
MeanAbsoluteError value on hold-out data: 0.07307111471891403
Epoch: 46
Loss on hold-out set: 0.026613688584572325
MeanAbsoluteError value on hold-out data: 0.1462920606136322
Epoch: 47
Loss on hold-out set: 0.006160156994919817
MeanAbsoluteError value on hold-out data: 0.05076698586344719
Epoch: 48
Loss on hold-out set: 0.012086160018807277
MeanAbsoluteError value on hold-out data: 0.09199626743793488
Epoch: 49
Loss on hold-out set: 0.005752277424116983
MeanAbsoluteError value on hold-out data: 0.049762215465307236
Epoch: 50
Loss on hold-out set: 0.007524882350383753
MeanAbsoluteError value on hold-out data: 0.05171921104192734
Epoch: 51
Loss on hold-out set: 0.0075580487981945525
MeanAbsoluteError value on hold-out data: 0.06681640446186066
Epoch: 52
Loss on hold-out set: 0.006885603254413581
MeanAbsoluteError value on hold-out data: 0.0610688216984272
Epoch: 53
Loss on hold-out set: 0.008633354650616336
MeanAbsoluteError value on hold-out data: 0.06829328835010529
Epoch: 54
Loss on hold-out set: 0.006137869776478813
MeanAbsoluteError value on hold-out data: 0.05276832729578018
Epoch: 55
Loss on hold-out set: 0.00527490219232277
MeanAbsoluteError value on hold-out data: 0.04931357130408287
Epoch: 56
Loss on hold-out set: 0.010222095310067137
MeanAbsoluteError value on hold-out data: 0.08905275166034698
Epoch: 57
Loss on hold-out set: 0.01613542475233165
MeanAbsoluteError value on hold-out data: 0.11016938835382462
Epoch: 58
Loss on hold-out set: 0.006334889764354254
MeanAbsoluteError value on hold-out data: 0.05053267627954483
Epoch: 59
Loss on hold-out set: 0.016426515556716672
MeanAbsoluteError value on hold-out data: 0.11219613254070282
Epoch: 60
Loss on hold-out set: 0.007012500752166394
MeanAbsoluteError value on hold-out data: 0.04605157673358917
Epoch: 61
Loss on hold-out set: 0.01318518402670937
MeanAbsoluteError value on hold-out data: 0.09366120398044586
Epoch: 62
Loss on hold-out set: 0.008638084814817072
MeanAbsoluteError value on hold-out data: 0.07549876719713211
Epoch: 63
Loss on hold-out set: 0.006051600179398519
MeanAbsoluteError value on hold-out data: 0.05089818686246872
Epoch: 64
Loss on hold-out set: 0.00594121464372923
MeanAbsoluteError value on hold-out data: 0.05564462020993233
Epoch: 65
Loss on hold-out set: 0.010085704833424339
MeanAbsoluteError value on hold-out data: 0.07695916295051575
Epoch: 66
Loss on hold-out set: 0.00955595444048716
MeanAbsoluteError value on hold-out data: 0.07086968421936035
Epoch: 67
Loss on hold-out set: 0.006332831777363026
MeanAbsoluteError value on hold-out data: 0.044413600116968155
Epoch: 68
Loss on hold-out set: 0.008739901489583039
MeanAbsoluteError value on hold-out data: 0.06324196606874466
Epoch: 69
Loss on hold-out set: 0.006711031753823893
MeanAbsoluteError value on hold-out data: 0.04792140796780586
Epoch: 70
Loss on hold-out set: 0.008583774252134996
MeanAbsoluteError value on hold-out data: 0.06464019417762756
Epoch: 71
Loss on hold-out set: 0.008146925571369744
MeanAbsoluteError value on hold-out data: 0.058366559445858
Epoch: 72
Loss on hold-out set: 0.007815125748954111
MeanAbsoluteError value on hold-out data: 0.06161673367023468
Epoch: 73
Loss on hold-out set: 0.00806336343792888
MeanAbsoluteError value on hold-out data: 0.06386369466781616
Epoch: 74
Loss on hold-out set: 0.008175702907868374
MeanAbsoluteError value on hold-out data: 0.0481676310300827
Epoch: 75
Loss on hold-out set: 0.006079877047247919
MeanAbsoluteError value on hold-out data: 0.05232220143079758
Epoch: 76
Loss on hold-out set: 0.005205835275153277
MeanAbsoluteError value on hold-out data: 0.04137924686074257
Epoch: 77
Loss on hold-out set: 0.007876059764187933
MeanAbsoluteError value on hold-out data: 0.06545194983482361
Epoch: 78
Loss on hold-out set: 0.007474368523132094
MeanAbsoluteError value on hold-out data: 0.05376223847270012
Epoch: 79
Loss on hold-out set: 0.0057258165642633686
MeanAbsoluteError value on hold-out data: 0.048774201422929764
Epoch: 80
Loss on hold-out set: 0.006253878453526245
MeanAbsoluteError value on hold-out data: 0.04021778330206871
Epoch: 81
Loss on hold-out set: 0.007237424628256122
MeanAbsoluteError value on hold-out data: 0.057704538106918335
Epoch: 82
Loss on hold-out set: 0.006759794304037996
MeanAbsoluteError value on hold-out data: 0.04662039503455162
Epoch: 83
Loss on hold-out set: 0.007764812023863973
MeanAbsoluteError value on hold-out data: 0.0633251741528511
Epoch: 84
Loss on hold-out set: 0.00692127233473002
MeanAbsoluteError value on hold-out data: 0.060912124812603
Epoch: 85
Loss on hold-out set: 0.006903891797507337
MeanAbsoluteError value on hold-out data: 0.052888017147779465
Epoch: 86
Loss on hold-out set: 0.008538270850015881
MeanAbsoluteError value on hold-out data: 0.07435820996761322
Epoch: 87
Loss on hold-out set: 0.010153593144929498
MeanAbsoluteError value on hold-out data: 0.07383881509304047
Epoch: 88
Loss on hold-out set: 0.005514851071585554
MeanAbsoluteError value on hold-out data: 0.04374627396464348
Epoch: 89
Loss on hold-out set: 0.0059752890676736566
MeanAbsoluteError value on hold-out data: 0.050008680671453476
Epoch: 90
Loss on hold-out set: 0.005654297827386472
MeanAbsoluteError value on hold-out data: 0.048176366835832596
Epoch: 91
Loss on hold-out set: 0.007321268961689687
MeanAbsoluteError value on hold-out data: 0.05498410016298294
Epoch: 92
Loss on hold-out set: 0.009809219219435667
MeanAbsoluteError value on hold-out data: 0.06462790071964264
Epoch: 93
Loss on hold-out set: 0.00846939343076277
MeanAbsoluteError value on hold-out data: 0.06344085931777954
Epoch: 94
Loss on hold-out set: 0.010332437734711371
MeanAbsoluteError value on hold-out data: 0.06884314864873886
Epoch: 95
Loss on hold-out set: 0.0042416812624590725
MeanAbsoluteError value on hold-out data: 0.036746881902217865
Epoch: 96
Loss on hold-out set: 0.005757056988610809
MeanAbsoluteError value on hold-out data: 0.05424754321575165
Epoch: 97
Loss on hold-out set: 0.00671613258831106
MeanAbsoluteError value on hold-out data: 0.05746762081980705
Epoch: 98
Loss on hold-out set: 0.006229088505733671
MeanAbsoluteError value on hold-out data: 0.05544202774763107
Epoch: 99
Loss on hold-out set: 0.006651392192382559
MeanAbsoluteError value on hold-out data: 0.0511602908372879
Epoch: 100
Loss on hold-out set: 0.011291471759226018
MeanAbsoluteError value on hold-out data: 0.08737965673208237
Epoch: 101
Loss on hold-out set: 0.009001717121961217
MeanAbsoluteError value on hold-out data: 0.0812092199921608
Epoch: 102
Loss on hold-out set: 0.013670277584569703
MeanAbsoluteError value on hold-out data: 0.09998159110546112
Epoch: 103
Loss on hold-out set: 0.011692436268785968
MeanAbsoluteError value on hold-out data: 0.09132946282625198
Epoch: 104
Loss on hold-out set: 0.020712149004684762
MeanAbsoluteError value on hold-out data: 0.128340944647789
Epoch: 105
Loss on hold-out set: 0.004412992835180679
MeanAbsoluteError value on hold-out data: 0.0467727966606617
Epoch: 106
Loss on hold-out set: 0.007026974312369324
MeanAbsoluteError value on hold-out data: 0.060859277844429016
Epoch: 107
Loss on hold-out set: 0.00600230632466264
MeanAbsoluteError value on hold-out data: 0.057306550443172455
Epoch: 108
Loss on hold-out set: 0.009332571902972025
MeanAbsoluteError value on hold-out data: 0.07506593316793442
Epoch: 109
Loss on hold-out set: 0.007418426694918405
MeanAbsoluteError value on hold-out data: 0.05497151240706444
Epoch: 110
Loss on hold-out set: 0.005785943381927628
MeanAbsoluteError value on hold-out data: 0.04454565793275833
Epoch: 111
Loss on hold-out set: 0.006279415747719667
MeanAbsoluteError value on hold-out data: 0.05082098767161369
Epoch: 112
Loss on hold-out set: 0.009680761355612048
MeanAbsoluteError value on hold-out data: 0.07125041633844376
Epoch: 113
Loss on hold-out set: 0.008722043409565382
MeanAbsoluteError value on hold-out data: 0.052713487297296524
Epoch: 114
Loss on hold-out set: 0.006325424000800315
MeanAbsoluteError value on hold-out data: 0.054792728275060654
Epoch: 115
Loss on hold-out set: 0.005470652890917336
MeanAbsoluteError value on hold-out data: 0.04717222601175308
Epoch: 116
Loss on hold-out set: 0.008840436120517553
MeanAbsoluteError value on hold-out data: 0.0769890621304512
Epoch: 117
Loss on hold-out set: 0.013091868092305958
MeanAbsoluteError value on hold-out data: 0.09484021365642548
Epoch: 118
Loss on hold-out set: 0.008527714928325925
MeanAbsoluteError value on hold-out data: 0.05702050402760506
Epoch: 119
Loss on hold-out set: 0.006205554345553234
MeanAbsoluteError value on hold-out data: 0.048065800219774246
Epoch: 120
Loss on hold-out set: 0.004846574462717399
MeanAbsoluteError value on hold-out data: 0.044504545629024506
Epoch: 121
Loss on hold-out set: 0.005133500971132889
MeanAbsoluteError value on hold-out data: 0.046596985310316086
Epoch: 122
Loss on hold-out set: 0.00775029745651409
MeanAbsoluteError value on hold-out data: 0.06254860013723373
Epoch: 123
Loss on hold-out set: 0.006575412657251339
MeanAbsoluteError value on hold-out data: 0.04379235580563545
Epoch: 124
Loss on hold-out set: 0.010133410608450504
MeanAbsoluteError value on hold-out data: 0.07872655987739563
Epoch: 125
Loss on hold-out set: 0.006909231592906124
MeanAbsoluteError value on hold-out data: 0.04635751247406006
Epoch: 126
Loss on hold-out set: 0.008246213767048781
MeanAbsoluteError value on hold-out data: 0.051623694598674774
Epoch: 127
Loss on hold-out set: 0.008846868363034445
MeanAbsoluteError value on hold-out data: 0.06019039824604988
Epoch: 128
Loss on hold-out set: 0.008447097547511172
MeanAbsoluteError value on hold-out data: 0.053853925317525864
Epoch: 129
Loss on hold-out set: 0.0064038127475456955
MeanAbsoluteError value on hold-out data: 0.05821393430233002
Epoch: 130
Loss on hold-out set: 0.005560553579787969
MeanAbsoluteError value on hold-out data: 0.053076423704624176
Epoch: 131
Loss on hold-out set: 0.006324460865286407
MeanAbsoluteError value on hold-out data: 0.05178631469607353
Epoch: 132
Loss on hold-out set: 0.007244084670843828
MeanAbsoluteError value on hold-out data: 0.05182161554694176
Epoch: 133
Loss on hold-out set: 0.0070768743745672205
MeanAbsoluteError value on hold-out data: 0.0561290979385376
Epoch: 134
Loss on hold-out set: 0.009415505268843844
MeanAbsoluteError value on hold-out data: 0.06979097425937653
Epoch: 135
Loss on hold-out set: 0.007871977122023524
MeanAbsoluteError value on hold-out data: 0.04955451563000679
Epoch: 136
Loss on hold-out set: 0.006207922667948841
MeanAbsoluteError value on hold-out data: 0.03894776850938797
Epoch: 137
Loss on hold-out set: 0.008074465190147748
MeanAbsoluteError value on hold-out data: 0.06190786510705948
Epoch: 138
Loss on hold-out set: 0.006740943311936766
MeanAbsoluteError value on hold-out data: 0.05280425399541855
Epoch: 139
Loss on hold-out set: 0.007218563066344359
MeanAbsoluteError value on hold-out data: 0.05241980031132698
Epoch: 140
Loss on hold-out set: 0.007746730713794629
MeanAbsoluteError value on hold-out data: 0.065948985517025
Epoch: 141
Loss on hold-out set: 0.007577238313509345
MeanAbsoluteError value on hold-out data: 0.05313032492995262
Epoch: 142
Loss on hold-out set: 0.005875375209240398
MeanAbsoluteError value on hold-out data: 0.04748167470097542
Epoch: 143
Loss on hold-out set: 0.005617966010257381
MeanAbsoluteError value on hold-out data: 0.041442789137363434
Epoch: 144
Loss on hold-out set: 0.005525595851286198
MeanAbsoluteError value on hold-out data: 0.049897193908691406
Epoch: 145
Loss on hold-out set: 0.009439866004510501
MeanAbsoluteError value on hold-out data: 0.06364171206951141
Epoch: 146
Loss on hold-out set: 0.007602436180022778
MeanAbsoluteError value on hold-out data: 0.048925187438726425
Epoch: 147
Loss on hold-out set: 0.006745933991351194
MeanAbsoluteError value on hold-out data: 0.048932064324617386
Epoch: 148
Loss on hold-out set: 0.007817435099605063
MeanAbsoluteError value on hold-out data: 0.053459301590919495
Epoch: 149
Loss on hold-out set: 0.006580779936800051
MeanAbsoluteError value on hold-out data: 0.05047553777694702
Epoch: 150
Loss on hold-out set: 0.009080384498556669
MeanAbsoluteError value on hold-out data: 0.0690612718462944
Epoch: 151
Loss on hold-out set: 0.007358355408850912
MeanAbsoluteError value on hold-out data: 0.05201547592878342
Epoch: 152
Loss on hold-out set: 0.007577581041987287
MeanAbsoluteError value on hold-out data: 0.0569911003112793
Epoch: 153
Loss on hold-out set: 0.00605811260265303
MeanAbsoluteError value on hold-out data: 0.045082416385412216
Epoch: 154
Loss on hold-out set: 0.007515657744885781
MeanAbsoluteError value on hold-out data: 0.051253542304039
Epoch: 155
Loss on hold-out set: 0.005566900414244931
MeanAbsoluteError value on hold-out data: 0.05198225751519203
Epoch: 156
Loss on hold-out set: 0.007433390670665195
MeanAbsoluteError value on hold-out data: 0.04990449920296669
Epoch: 157
Loss on hold-out set: 0.007038694772054441
MeanAbsoluteError value on hold-out data: 0.055126603692770004
Epoch: 158
Loss on hold-out set: 0.009897552214727814
MeanAbsoluteError value on hold-out data: 0.0605999194085598
Epoch: 159
Loss on hold-out set: 0.012942626042522533
MeanAbsoluteError value on hold-out data: 0.09033035486936569
Early stopping at epoch 158
Returned to Spot: Validation loss: 0.012942626042522533
----------------------------------------------
spotPython tuning: 4.143963882310536e-06 [##########] 100.00% Done...
<spotPython.spot.spot.Spot at 0x2a63def50>

19.13 Tensorboard

The textual output shown in the console (or code cell) can be visualized with Tensorboard as described in Section 14.13.

19.14 Results

After the hyperparameter tuning run is finished, the results can be analyzed as described in Section 14.14.

spot_tuner.plot_progress(log_y=False,
    filename="./figures/" + experiment_name+"_progress.png")

Progress plot. Black dots denote results from the initial design. Red dots illustrate the improvement found by the surrogate model based optimization.
print(gen_design_table(fun_control=fun_control, spot=spot_tuner))
| name         | type   | default   |   lower |   upper |               tuned | transform             |   importance | stars   |
|--------------|--------|-----------|---------|---------|---------------------|-----------------------|--------------|---------|
| _L_in        | int    | 10        |    10.0 |    10.0 |                10.0 | None                  |         0.00 |         |
| _L_out       | int    | 1         |     1.0 |     1.0 |                 1.0 | None                  |         0.00 |         |
| l1           | int    | 3         |     3.0 |     8.0 |                 4.0 | transform_power_2_int |         0.01 |         |
| dropout_prob | float  | 0.01      |     0.0 |     0.9 |                 0.0 | None                  |         0.00 |         |
| lr_mult      | float  | 1.0       |     0.1 |    10.0 |  4.7833950088489186 | None                  |         0.09 |         |
| batch_size   | int    | 4         |     1.0 |     4.0 |                 4.0 | transform_power_2_int |         0.00 |         |
| epochs       | int    | 4         |     2.0 |    16.0 |                16.0 | transform_power_2_int |         0.00 |         |
| k_folds      | int    | 1         |     1.0 |     1.0 |                 1.0 | None                  |         0.00 |         |
| patience     | int    | 2         |     3.0 |     7.0 |                 6.0 | transform_power_2_int |       100.00 | ***     |
| optimizer    | factor | SGD       |     0.0 |     6.0 |                 2.0 | None                  |         8.67 | *       |
| sgd_momentum | float  | 0.0       |     0.0 |     1.0 | 0.32513455962132365 | None                  |         0.00 |         |
spot_tuner.plot_importance(threshold=0.025,
    filename="./figures/" + experiment_name+"_importance.png")

Variable importance plot, threshold 0.025.

19.15 Get the Tuned Architecture (SPOT Results)

from spotPython.hyperparameters.values import get_one_core_model_from_X
X = spot_tuner.to_all_dim(spot_tuner.min_X.reshape(1,-1))
model_spot = get_one_core_model_from_X(X, fun_control)
model_spot
Net_lin_reg(
  (fc1): Linear(in_features=10, out_features=16, bias=True)
  (fc2): Linear(in_features=16, out_features=8, bias=True)
  (fc3): Linear(in_features=8, out_features=1, bias=True)
  (relu): ReLU()
  (softmax): Softmax(dim=1)
  (dropout1): Dropout(p=0.0, inplace=False)
  (dropout2): Dropout(p=0.0, inplace=False)
)

19.16 Evaluation of the Tuned Architecture

from spotPython.torch.traintest import (
    train_tuned,
    test_tuned,
    )
train_tuned(net=model_spot, train_dataset=train,
        loss_function=fun_control["loss_function"],
        metric=fun_control["metric_torch"],
        shuffle=True,
        device = fun_control["device"],
        path=None,
        task=fun_control["task"],)
Epoch: 1
Loss on hold-out set: 0.02457448354873218
MeanAbsoluteError value on hold-out data: 0.12295899540185928
Epoch: 2
Loss on hold-out set: 0.020583767590946274
MeanAbsoluteError value on hold-out data: 0.1103353276848793
Epoch: 3
Loss on hold-out set: 0.01886014792283899
MeanAbsoluteError value on hold-out data: 0.10451680421829224
Epoch: 4
Loss on hold-out set: 0.017398623872156207
MeanAbsoluteError value on hold-out data: 0.10150101035833359
Epoch: 5
Loss on hold-out set: 0.015352103810169195
MeanAbsoluteError value on hold-out data: 0.09462275356054306
Epoch: 6
Loss on hold-out set: 0.013442249919630979
MeanAbsoluteError value on hold-out data: 0.08910461515188217
Epoch: 7
Loss on hold-out set: 0.011314531396094122
MeanAbsoluteError value on hold-out data: 0.08152422308921814
Epoch: 8
Loss on hold-out set: 0.009763634420539203
MeanAbsoluteError value on hold-out data: 0.07709288597106934
Epoch: 9
Loss on hold-out set: 0.009437663088503637
MeanAbsoluteError value on hold-out data: 0.07863190025091171
Epoch: 10
Loss on hold-out set: 0.0063764465433594425
MeanAbsoluteError value on hold-out data: 0.06384720653295517
Epoch: 11
Loss on hold-out set: 0.0046607582266197396
MeanAbsoluteError value on hold-out data: 0.05491650104522705
Epoch: 12
Loss on hold-out set: 0.005341601766351806
MeanAbsoluteError value on hold-out data: 0.06116623058915138
Epoch: 13
Loss on hold-out set: 0.003497450955604252
MeanAbsoluteError value on hold-out data: 0.047696515917778015
Epoch: 14
Loss on hold-out set: 0.0017738322004381764
MeanAbsoluteError value on hold-out data: 0.03350692614912987
Epoch: 15
Loss on hold-out set: 0.0015068185809803637
MeanAbsoluteError value on hold-out data: 0.03154609352350235
Epoch: 16
Loss on hold-out set: 0.0006969020729516878
MeanAbsoluteError value on hold-out data: 0.02143288590013981
Epoch: 17
Loss on hold-out set: 0.00044915599114335095
MeanAbsoluteError value on hold-out data: 0.01727721095085144
Epoch: 18
Loss on hold-out set: 0.00028533954096737464
MeanAbsoluteError value on hold-out data: 0.013762989081442356
Epoch: 19
Loss on hold-out set: 0.00016321923804322354
MeanAbsoluteError value on hold-out data: 0.01049956027418375
Epoch: 20
Loss on hold-out set: 0.00010000579239108207
MeanAbsoluteError value on hold-out data: 0.008024763315916061
Epoch: 21
Loss on hold-out set: 8.831597063506611e-05
MeanAbsoluteError value on hold-out data: 0.007719085086137056
Epoch: 22
Loss on hold-out set: 2.9377615742544693e-05
MeanAbsoluteError value on hold-out data: 0.004409946501255035
Epoch: 23
Loss on hold-out set: 1.2929659365717702e-05
MeanAbsoluteError value on hold-out data: 0.002836494008079171
Epoch: 24
Loss on hold-out set: 1.4620425573459789e-05
MeanAbsoluteError value on hold-out data: 0.0031928340904414654
Epoch: 25
Loss on hold-out set: 5.485693655397259e-06
MeanAbsoluteError value on hold-out data: 0.0017978557152673602
Epoch: 26
Loss on hold-out set: 7.3557331042569495e-06
MeanAbsoluteError value on hold-out data: 0.0023086825385689735
Epoch: 27
Loss on hold-out set: 2.0229935737341677e-06
MeanAbsoluteError value on hold-out data: 0.0009187654941342771
Epoch: 28
Loss on hold-out set: 1.705553870579024e-06
MeanAbsoluteError value on hold-out data: 0.0008375372271984816
Epoch: 29
Loss on hold-out set: 1.593539339314463e-06
MeanAbsoluteError value on hold-out data: 0.0007982193492352962
Epoch: 30
Loss on hold-out set: 1.6238857339981462e-06
MeanAbsoluteError value on hold-out data: 0.0008300125482492149
Epoch: 31
Loss on hold-out set: 1.5666931439658295e-06
MeanAbsoluteError value on hold-out data: 0.0008701257756911218
Epoch: 32
Loss on hold-out set: 2.213243174322231e-06
MeanAbsoluteError value on hold-out data: 0.0011644025798887014
Epoch: 33
Loss on hold-out set: 1.2361846571414054e-06
MeanAbsoluteError value on hold-out data: 0.0007535577169619501
Epoch: 34
Loss on hold-out set: 1.2084098422723112e-06
MeanAbsoluteError value on hold-out data: 0.000776172848418355
Epoch: 35
Loss on hold-out set: 2.3408948334834255e-06
MeanAbsoluteError value on hold-out data: 0.001147127361036837
Epoch: 36
Loss on hold-out set: 1.564445531250002e-06
MeanAbsoluteError value on hold-out data: 0.0009196555474773049
Epoch: 37
Loss on hold-out set: 2.9547647835371255e-06
MeanAbsoluteError value on hold-out data: 0.0014745463849976659
Epoch: 38
Loss on hold-out set: 2.1413203033884394e-06
MeanAbsoluteError value on hold-out data: 0.0011662542819976807
Epoch: 39
Loss on hold-out set: 1.0557444385851437e-06
MeanAbsoluteError value on hold-out data: 0.0007371716783381999
Epoch: 40
Loss on hold-out set: 1.1105336993391814e-06
MeanAbsoluteError value on hold-out data: 0.00079904351150617
Epoch: 41
Loss on hold-out set: 1.1454494507521111e-06
MeanAbsoluteError value on hold-out data: 0.0008134659146890044
Epoch: 42
Loss on hold-out set: 1.04843745044778e-06
MeanAbsoluteError value on hold-out data: 0.0007542620878666639
Epoch: 43
Loss on hold-out set: 2.244161979242084e-06
MeanAbsoluteError value on hold-out data: 0.001226310501806438
Epoch: 44
Loss on hold-out set: 9.056491367836747e-07
MeanAbsoluteError value on hold-out data: 0.0007093166350387037
Epoch: 45
Loss on hold-out set: 2.1910451341443004e-06
MeanAbsoluteError value on hold-out data: 0.001248510554432869
Epoch: 46
Loss on hold-out set: 1.3239441135450953e-06
MeanAbsoluteError value on hold-out data: 0.0009193708538077772
Epoch: 47
Loss on hold-out set: 1.9264360963988064e-06
MeanAbsoluteError value on hold-out data: 0.0011325065279379487
Epoch: 48
Loss on hold-out set: 2.1457924563755545e-06
MeanAbsoluteError value on hold-out data: 0.0012492761015892029
Epoch: 49
Loss on hold-out set: 3.821383236419551e-06
MeanAbsoluteError value on hold-out data: 0.0017657856224104762
Epoch: 50
Loss on hold-out set: 8.908897326053097e-07
MeanAbsoluteError value on hold-out data: 0.0007295969408005476
Epoch: 51
Loss on hold-out set: 8.280601617259794e-07
MeanAbsoluteError value on hold-out data: 0.000708678038790822
Epoch: 52
Loss on hold-out set: 8.948943035959115e-07
MeanAbsoluteError value on hold-out data: 0.0007304037571884692
Epoch: 53
Loss on hold-out set: 1.4124542172124309e-06
MeanAbsoluteError value on hold-out data: 0.0009658571216277778
Epoch: 54
Loss on hold-out set: 9.70462201920734e-07
MeanAbsoluteError value on hold-out data: 0.0007796227000653744
Epoch: 55
Loss on hold-out set: 3.0768694554545187e-06
MeanAbsoluteError value on hold-out data: 0.0015621654456481338
Epoch: 56
Loss on hold-out set: 1.7134738551536237e-06
MeanAbsoluteError value on hold-out data: 0.0010743633611127734
Epoch: 57
Loss on hold-out set: 9.762657474479248e-07
MeanAbsoluteError value on hold-out data: 0.0007705600000917912
Epoch: 58
Loss on hold-out set: 8.377146559125418e-07
MeanAbsoluteError value on hold-out data: 0.0007207608432509005
Epoch: 59
Loss on hold-out set: 9.631447366437465e-07
MeanAbsoluteError value on hold-out data: 0.0007708714110776782
Epoch: 60
Loss on hold-out set: 1.6497223662937405e-06
MeanAbsoluteError value on hold-out data: 0.0010785545455291867
Epoch: 61
Loss on hold-out set: 1.0263625181563072e-06
MeanAbsoluteError value on hold-out data: 0.0008170668152160943
Epoch: 62
Loss on hold-out set: 1.1510147011880402e-06
MeanAbsoluteError value on hold-out data: 0.0008672796539030969
Epoch: 63
Loss on hold-out set: 2.6258367741224663e-06
MeanAbsoluteError value on hold-out data: 0.0014065074501559138
Epoch: 64
Loss on hold-out set: 8.106806250763934e-06
MeanAbsoluteError value on hold-out data: 0.0027073195669800043
Epoch: 65
Loss on hold-out set: 8.928578626852724e-07
MeanAbsoluteError value on hold-out data: 0.0007565176347270608
Epoch: 66
Loss on hold-out set: 1.825832387830336e-06
MeanAbsoluteError value on hold-out data: 0.00113958609290421
Epoch: 67
Loss on hold-out set: 9.237918005199294e-06
MeanAbsoluteError value on hold-out data: 0.002900895895436406
Epoch: 68
Loss on hold-out set: 8.332066661415937e-07
MeanAbsoluteError value on hold-out data: 0.0007230022456496954
Epoch: 69
Loss on hold-out set: 7.975800698252562e-07
MeanAbsoluteError value on hold-out data: 0.0006868943455629051
Epoch: 70
Loss on hold-out set: 1.5928451016646393e-06
MeanAbsoluteError value on hold-out data: 0.0010571246966719627
Epoch: 71
Loss on hold-out set: 9.171681833657586e-07
MeanAbsoluteError value on hold-out data: 0.0007546985289081931
Epoch: 72
Loss on hold-out set: 1.3342223012027955e-06
MeanAbsoluteError value on hold-out data: 0.0009425737662240863
Epoch: 73
Loss on hold-out set: 1.2189472152768807e-05
MeanAbsoluteError value on hold-out data: 0.0033807894214987755
Epoch: 74
Loss on hold-out set: 1.0544614781338169e-06
MeanAbsoluteError value on hold-out data: 0.000817320600617677
Epoch: 75
Loss on hold-out set: 2.075533449155237e-06
MeanAbsoluteError value on hold-out data: 0.0012271840823814273
Epoch: 76
Loss on hold-out set: 1.3598125636498911e-06
MeanAbsoluteError value on hold-out data: 0.000955380208324641
Epoch: 77
Loss on hold-out set: 7.79053427897069e-06
MeanAbsoluteError value on hold-out data: 0.0026512902695685625
Epoch: 78
Loss on hold-out set: 8.187198456030992e-07
MeanAbsoluteError value on hold-out data: 0.000712686451151967
Epoch: 79
Loss on hold-out set: 1.1283267572013612e-05
MeanAbsoluteError value on hold-out data: 0.003237291006371379
Epoch: 80
Loss on hold-out set: 1.1382411218475777e-06
MeanAbsoluteError value on hold-out data: 0.000857246108353138
Epoch: 81
Loss on hold-out set: 1.6272884498616087e-06
MeanAbsoluteError value on hold-out data: 0.0010759365977719426
Epoch: 82
Loss on hold-out set: 7.857695765635168e-07
MeanAbsoluteError value on hold-out data: 0.0007020570919848979
Epoch: 83
Loss on hold-out set: 4.017548917545355e-06
MeanAbsoluteError value on hold-out data: 0.0018055661348626018
Epoch: 84
Loss on hold-out set: 5.891374066298963e-06
MeanAbsoluteError value on hold-out data: 0.0022554248571395874
Epoch: 85
Loss on hold-out set: 3.772828736864061e-06
MeanAbsoluteError value on hold-out data: 0.0017455967608839273
Epoch: 86
Loss on hold-out set: 4.818582056032028e-06
MeanAbsoluteError value on hold-out data: 0.0019958920311182737
Epoch: 87
Loss on hold-out set: 3.761010750742188e-06
MeanAbsoluteError value on hold-out data: 0.0017255254788324237
Epoch: 88
Loss on hold-out set: 1.1886502713758474e-05
MeanAbsoluteError value on hold-out data: 0.0033265657257288694
Epoch: 89
Loss on hold-out set: 4.609735493719008e-06
MeanAbsoluteError value on hold-out data: 0.0019152120221406221
Epoch: 90
Loss on hold-out set: 1.3063296783481125e-06
MeanAbsoluteError value on hold-out data: 0.000942498620133847
Epoch: 91
Loss on hold-out set: 2.028935969783082e-06
MeanAbsoluteError value on hold-out data: 0.0011928451713174582
Epoch: 92
Loss on hold-out set: 1.4325040249212561e-06
MeanAbsoluteError value on hold-out data: 0.0009786118753254414
Epoch: 93
Loss on hold-out set: 9.66401799623303e-06
MeanAbsoluteError value on hold-out data: 0.0029697853606194258
Epoch: 94
Loss on hold-out set: 2.352604491007744e-06
MeanAbsoluteError value on hold-out data: 0.0013023397186771035
Epoch: 95
Loss on hold-out set: 1.508017832843746e-05
MeanAbsoluteError value on hold-out data: 0.0037586574908345938
Epoch: 96
Loss on hold-out set: 8.169693749574722e-07
MeanAbsoluteError value on hold-out data: 0.0007136967615224421
Epoch: 97
Loss on hold-out set: 4.015879492152108e-06
MeanAbsoluteError value on hold-out data: 0.0018161728512495756
Epoch: 98
Loss on hold-out set: 1.796060270240368e-06
MeanAbsoluteError value on hold-out data: 0.0011167452903464437
Epoch: 99
Loss on hold-out set: 9.038984073509039e-07
MeanAbsoluteError value on hold-out data: 0.0007578268414363265
Epoch: 100
Loss on hold-out set: 7.58736291572859e-07
MeanAbsoluteError value on hold-out data: 0.0006892841192893684
Epoch: 101
Loss on hold-out set: 3.001898616467339e-06
MeanAbsoluteError value on hold-out data: 0.0015181114431470633
Epoch: 102
Loss on hold-out set: 8.036325461465535e-06
MeanAbsoluteError value on hold-out data: 0.002670374233275652
Epoch: 103
Loss on hold-out set: 2.1535143069310213e-05
MeanAbsoluteError value on hold-out data: 0.0045282235369086266
Epoch: 104
Loss on hold-out set: 1.6398378432457225e-06
MeanAbsoluteError value on hold-out data: 0.0010662184795364738
Epoch: 105
Loss on hold-out set: 4.978455966633383e-06
MeanAbsoluteError value on hold-out data: 0.002041305648162961
Epoch: 106
Loss on hold-out set: 2.742461784739709e-05
MeanAbsoluteError value on hold-out data: 0.005135983228683472
Epoch: 107
Loss on hold-out set: 3.665541896081873e-05
MeanAbsoluteError value on hold-out data: 0.00592405628412962
Epoch: 108
Loss on hold-out set: 9.690129110439508e-06
MeanAbsoluteError value on hold-out data: 0.002922750310972333
Epoch: 109
Loss on hold-out set: 8.311323366988768e-06
MeanAbsoluteError value on hold-out data: 0.0026099325623363256
Epoch: 110
Loss on hold-out set: 1.0556911739082639e-05
MeanAbsoluteError value on hold-out data: 0.0030503752641379833
Epoch: 111
Loss on hold-out set: 4.342663236169947e-06
MeanAbsoluteError value on hold-out data: 0.0018372948979958892
Epoch: 112
Loss on hold-out set: 7.961011856662625e-06
MeanAbsoluteError value on hold-out data: 0.0026852921582758427
Epoch: 113
Loss on hold-out set: 4.196187833976613e-06
MeanAbsoluteError value on hold-out data: 0.0018265469698235393
Epoch: 114
Loss on hold-out set: 3.3786000968623406e-06
MeanAbsoluteError value on hold-out data: 0.001571469008922577
Epoch: 115
Loss on hold-out set: 9.126638217008134e-06
MeanAbsoluteError value on hold-out data: 0.002779395552352071
Epoch: 116
Loss on hold-out set: 5.418194800050084e-06
MeanAbsoluteError value on hold-out data: 0.002075944561511278
Epoch: 117
Loss on hold-out set: 9.399847984145468e-06
MeanAbsoluteError value on hold-out data: 0.00291434652172029
Epoch: 118
Loss on hold-out set: 8.581937017401e-07
MeanAbsoluteError value on hold-out data: 0.0007347455830313265
Epoch: 119
Loss on hold-out set: 8.103915589392846e-06
MeanAbsoluteError value on hold-out data: 0.0026852900628000498
Epoch: 120
Loss on hold-out set: 7.608337885980482e-06
MeanAbsoluteError value on hold-out data: 0.002574027981609106
Epoch: 121
Loss on hold-out set: 1.0106932722321386e-06
MeanAbsoluteError value on hold-out data: 0.0008043186389841139
Epoch: 122
Loss on hold-out set: 7.384341499441928e-06
MeanAbsoluteError value on hold-out data: 0.0025581708177924156
Epoch: 123
Loss on hold-out set: 2.2231127714851604e-06
MeanAbsoluteError value on hold-out data: 0.0012468451168388128
Epoch: 124
Loss on hold-out set: 2.4231601281299892e-05
MeanAbsoluteError value on hold-out data: 0.0048223501071333885
Epoch: 125
Loss on hold-out set: 2.6720936208029774e-06
MeanAbsoluteError value on hold-out data: 0.0013586763525381684
Epoch: 126
Loss on hold-out set: 3.9684653074800735e-06
MeanAbsoluteError value on hold-out data: 0.001789393019862473
Epoch: 127
Loss on hold-out set: 1.483018626171734e-06
MeanAbsoluteError value on hold-out data: 0.0010124441469088197
Epoch: 128
Loss on hold-out set: 1.1142665483164723e-06
MeanAbsoluteError value on hold-out data: 0.0008667783113196492
Epoch: 129
Loss on hold-out set: 2.1433230310657037e-05
MeanAbsoluteError value on hold-out data: 0.004517564084380865
Epoch: 130
Loss on hold-out set: 1.6727477965392418e-05
MeanAbsoluteError value on hold-out data: 0.003963586408644915
Epoch: 131
Loss on hold-out set: 1.4628118677999163e-06
MeanAbsoluteError value on hold-out data: 0.0009899322176352143
Epoch: 132
Loss on hold-out set: 3.246670951882965e-05
MeanAbsoluteError value on hold-out data: 0.00558725418522954
Epoch: 133
Loss on hold-out set: 3.0167431017808236e-06
MeanAbsoluteError value on hold-out data: 0.0015038184355944395
Epoch: 134
Loss on hold-out set: 2.2600166822054523e-05
MeanAbsoluteError value on hold-out data: 0.004618624225258827
Epoch: 135
Loss on hold-out set: 5.9455735601276454e-06
MeanAbsoluteError value on hold-out data: 0.0021216897293925285
Epoch: 136
Loss on hold-out set: 5.990207481724945e-05
MeanAbsoluteError value on hold-out data: 0.0075645288452506065
Epoch: 137
Loss on hold-out set: 8.410007850263929e-06
MeanAbsoluteError value on hold-out data: 0.002376957330852747
Epoch: 138
Loss on hold-out set: 1.6684722954539067e-05
MeanAbsoluteError value on hold-out data: 0.0038968599401414394
Epoch: 139
Loss on hold-out set: 2.1514907003668332e-05
MeanAbsoluteError value on hold-out data: 0.0045182364992797375
Epoch: 140
Loss on hold-out set: 2.450555041976163e-06
MeanAbsoluteError value on hold-out data: 0.0012377965031191707
Epoch: 141
Loss on hold-out set: 8.740937884890867e-06
MeanAbsoluteError value on hold-out data: 0.0025507472455501556
Epoch: 142
Loss on hold-out set: 8.459731289851908e-06
MeanAbsoluteError value on hold-out data: 0.0027102287858724594
Epoch: 143
Loss on hold-out set: 6.385451749673321e-06
MeanAbsoluteError value on hold-out data: 0.002236872911453247
Epoch: 144
Loss on hold-out set: 4.2453641287322265e-06
MeanAbsoluteError value on hold-out data: 0.0016976259648799896
Epoch: 145
Loss on hold-out set: 2.140191566611879e-06
MeanAbsoluteError value on hold-out data: 0.0011954620713368058
Epoch: 146
Loss on hold-out set: 1.5898868600503957e-05
MeanAbsoluteError value on hold-out data: 0.003861358156427741
Epoch: 147
Loss on hold-out set: 2.2737755659220154e-05
MeanAbsoluteError value on hold-out data: 0.004591877572238445
Epoch: 148
Loss on hold-out set: 0.00015823992725927383
MeanAbsoluteError value on hold-out data: 0.012465526349842548
Epoch: 149
Loss on hold-out set: 2.6466612708693566e-05
MeanAbsoluteError value on hold-out data: 0.0050514196045696735
Epoch: 150
Loss on hold-out set: 7.342437196424918e-05
MeanAbsoluteError value on hold-out data: 0.008498530834913254
Epoch: 151
Loss on hold-out set: 4.867641588421784e-05
MeanAbsoluteError value on hold-out data: 0.006748482584953308
Epoch: 152
Loss on hold-out set: 8.464086429165419e-06
MeanAbsoluteError value on hold-out data: 0.0026828106492757797
Epoch: 153
Loss on hold-out set: 1.7469592900229862e-06
MeanAbsoluteError value on hold-out data: 0.0010890667326748371
Epoch: 154
Loss on hold-out set: 8.937116514349136e-06
MeanAbsoluteError value on hold-out data: 0.0028399634175002575
Epoch: 155
Loss on hold-out set: 7.859423093529921e-06
MeanAbsoluteError value on hold-out data: 0.0026343446224927902
Epoch: 156
Loss on hold-out set: 4.327234927060138e-06
MeanAbsoluteError value on hold-out data: 0.0018584809731692076
Epoch: 157
Loss on hold-out set: 7.96744528710597e-06
MeanAbsoluteError value on hold-out data: 0.002628598129376769
Epoch: 158
Loss on hold-out set: 1.2946762772595608e-05
MeanAbsoluteError value on hold-out data: 0.003449569456279278
Epoch: 159
Loss on hold-out set: 1.4696590884149804e-06
MeanAbsoluteError value on hold-out data: 0.0009761669207364321
Epoch: 160
Loss on hold-out set: 7.613748649466863e-06
MeanAbsoluteError value on hold-out data: 0.0022419807501137257
Epoch: 161
Loss on hold-out set: 8.103644703576146e-06
MeanAbsoluteError value on hold-out data: 0.002354490337893367
Epoch: 162
Loss on hold-out set: 1.2205848586171142e-05
MeanAbsoluteError value on hold-out data: 0.003263628575950861
Epoch: 163
Loss on hold-out set: 1.5109024771893593e-06
MeanAbsoluteError value on hold-out data: 0.0009535329299978912
Epoch: 164
Loss on hold-out set: 3.7248788717797174e-06
MeanAbsoluteError value on hold-out data: 0.0016314447857439518
Early stopping at epoch 163
Returned to Spot: Validation loss: 3.7248788717797174e-06
----------------------------------------------

If path is set to a filename, e.g., path = "model_spot_trained.pt", the weights of the trained model will be loaded from this file.

test_tuned(net=model_spot, test_dataset=test,
            shuffle=False,
            loss_function=fun_control["loss_function"],
            metric=fun_control["metric_torch"],
            device = fun_control["device"],
            task=fun_control["task"],)
Loss on hold-out set: 3.60266888321803e-06
MeanAbsoluteError value on hold-out data: 0.001521955942735076
Final evaluation: Validation loss: 3.60266888321803e-06
Final evaluation: Validation metric: 0.001521955942735076
----------------------------------------------
(3.60266888321803e-06, nan, tensor(0.0015))

19.17 Cross-validated Evaluations

  • This is the evaluation that will be used in the comparison (evaluatecv has to be updated before, to get metric vlaues!):
from spotPython.torch.traintest import evaluate_cv
# modify k-kolds:
setattr(model_spot, "k_folds",  10)
df_eval, df_preds, df_metrics = evaluate_cv(net=model_spot,
            dataset=fun_control["data"],
            loss_function=fun_control["loss_function"],
            metric=fun_control["metric_torch"],
            task=fun_control["task"],
            writer=fun_control["writer"],
            writerId="model_spot_cv",
            device = fun_control["device"])
Fold: 1
Epoch: 1
Loss on hold-out set: 0.024567218896533762
MeanAbsoluteError value on hold-out data: 0.12832732498645782
Epoch: 2
Loss on hold-out set: 0.016448039628033127
MeanAbsoluteError value on hold-out data: 0.10947396606206894
Epoch: 3
Loss on hold-out set: 0.013285827423845018
MeanAbsoluteError value on hold-out data: 0.09413010627031326
Epoch: 4
Loss on hold-out set: 0.00820016801091177
MeanAbsoluteError value on hold-out data: 0.07771562039852142
Epoch: 5
Loss on hold-out set: 0.0052353911367910245
MeanAbsoluteError value on hold-out data: 0.060920991003513336
Epoch: 6
Loss on hold-out set: 0.002706795698031783
MeanAbsoluteError value on hold-out data: 0.04311808571219444
Epoch: 7
Loss on hold-out set: 0.001181882099314992
MeanAbsoluteError value on hold-out data: 0.026686592027544975
Epoch: 8
Loss on hold-out set: 0.00041036274550216537
MeanAbsoluteError value on hold-out data: 0.01616167090833187
Epoch: 9
Loss on hold-out set: 6.670773655059747e-05
MeanAbsoluteError value on hold-out data: 0.006260226480662823
Epoch: 10
Loss on hold-out set: 1.377951360024911e-05
MeanAbsoluteError value on hold-out data: 0.0023454269394278526
Epoch: 11
Loss on hold-out set: 3.782141823600276e-06
MeanAbsoluteError value on hold-out data: 0.001147573348134756
Epoch: 12
Loss on hold-out set: 2.198360724443254e-06
MeanAbsoluteError value on hold-out data: 0.0009623933001421392
Epoch: 13
Loss on hold-out set: 2.154687308575376e-06
MeanAbsoluteError value on hold-out data: 0.0012432766379788518
Epoch: 14
Loss on hold-out set: 9.821015193470624e-07
MeanAbsoluteError value on hold-out data: 0.0007497626356780529
Epoch: 15
Loss on hold-out set: 6.993101838556218e-07
MeanAbsoluteError value on hold-out data: 0.0006704181432723999
Epoch: 16
Loss on hold-out set: 1.3946218635802715e-06
MeanAbsoluteError value on hold-out data: 0.0009449893259443343
Epoch: 17
Loss on hold-out set: 2.690837553538066e-06
MeanAbsoluteError value on hold-out data: 0.001445674104616046
Epoch: 18
Loss on hold-out set: 2.5134958962423426e-06
MeanAbsoluteError value on hold-out data: 0.001362545881420374
Epoch: 19
Loss on hold-out set: 1.519287041316732e-06
MeanAbsoluteError value on hold-out data: 0.00102034246083349
Epoch: 20
Loss on hold-out set: 2.2822796868890042e-06
MeanAbsoluteError value on hold-out data: 0.0013566756388172507
Epoch: 21
Loss on hold-out set: 7.393739512703437e-07
MeanAbsoluteError value on hold-out data: 0.0007119825459085405
Epoch: 22
Loss on hold-out set: 6.879619921359595e-07
MeanAbsoluteError value on hold-out data: 0.0006790298502892256
Epoch: 23
Loss on hold-out set: 1.7850536551122786e-06
MeanAbsoluteError value on hold-out data: 0.0010934141464531422
Epoch: 24
Loss on hold-out set: 2.2550472392270293e-06
MeanAbsoluteError value on hold-out data: 0.0013151337625458837
Epoch: 25
Loss on hold-out set: 3.0837506333877433e-06
MeanAbsoluteError value on hold-out data: 0.0015943229664117098
Epoch: 26
Loss on hold-out set: 3.652080262587073e-06
MeanAbsoluteError value on hold-out data: 0.0016922946088016033
Epoch: 27
Loss on hold-out set: 7.91367357676011e-07
MeanAbsoluteError value on hold-out data: 0.0006828230689279735
Epoch: 28
Loss on hold-out set: 1.766962230119264e-06
MeanAbsoluteError value on hold-out data: 0.0011267216177657247
Epoch: 29
Loss on hold-out set: 1.5878212756043858e-06
MeanAbsoluteError value on hold-out data: 0.000935244548600167
Epoch: 30
Loss on hold-out set: 6.556237792665343e-07
MeanAbsoluteError value on hold-out data: 0.0006380687700584531
Epoch: 31
Loss on hold-out set: 9.005387673661451e-07
MeanAbsoluteError value on hold-out data: 0.0006768524763174355
Epoch: 32
Loss on hold-out set: 1.940737986063011e-06
MeanAbsoluteError value on hold-out data: 0.001220081583596766
Epoch: 33
Loss on hold-out set: 2.869089192764867e-06
MeanAbsoluteError value on hold-out data: 0.0015309889568015933
Epoch: 34
Loss on hold-out set: 2.1915941163440167e-06
MeanAbsoluteError value on hold-out data: 0.001312314416281879
Epoch: 35
Loss on hold-out set: 1.0073567864310462e-06
MeanAbsoluteError value on hold-out data: 0.0008251780527643859
Epoch: 36
Loss on hold-out set: 3.1627095203085835e-06
MeanAbsoluteError value on hold-out data: 0.0016098933992907405
Epoch: 37
Loss on hold-out set: 8.56887043352929e-07
MeanAbsoluteError value on hold-out data: 0.000726883125025779
Epoch: 38
Loss on hold-out set: 1.1807286942452526e-06
MeanAbsoluteError value on hold-out data: 0.0009196099708788097
Epoch: 39
Loss on hold-out set: 1.090296162179324e-06
MeanAbsoluteError value on hold-out data: 0.0008524584700353444
Epoch: 40
Loss on hold-out set: 3.916706061448037e-06
MeanAbsoluteError value on hold-out data: 0.0018341470276936889
Epoch: 41
Loss on hold-out set: 3.037987555996681e-06
MeanAbsoluteError value on hold-out data: 0.0015609636902809143
Epoch: 42
Loss on hold-out set: 3.6509800663355108e-06
MeanAbsoluteError value on hold-out data: 0.0017045337008312345
Epoch: 43
Loss on hold-out set: 5.168660761358167e-06
MeanAbsoluteError value on hold-out data: 0.002000188920646906
Epoch: 44
Loss on hold-out set: 1.952222841542347e-06
MeanAbsoluteError value on hold-out data: 0.0012114685960114002
Epoch: 45
Loss on hold-out set: 2.1713904711110184e-06
MeanAbsoluteError value on hold-out data: 0.0011743089416995645
Epoch: 46
Loss on hold-out set: 1.1839014665123874e-06
MeanAbsoluteError value on hold-out data: 0.0009208069532178342
Epoch: 47
Loss on hold-out set: 8.31218163252093e-06
MeanAbsoluteError value on hold-out data: 0.002814913634210825
Epoch: 48
Loss on hold-out set: 2.191823179081049e-06
MeanAbsoluteError value on hold-out data: 0.0012858221307396889
Epoch: 49
Loss on hold-out set: 1.010787036648253e-05
MeanAbsoluteError value on hold-out data: 0.00307733123190701
Epoch: 50
Loss on hold-out set: 6.248468561612494e-07
MeanAbsoluteError value on hold-out data: 0.0006591096753254533
Epoch: 51
Loss on hold-out set: 8.796940554540405e-06
MeanAbsoluteError value on hold-out data: 0.0028160663787275553
Epoch: 52
Loss on hold-out set: 9.87641202852631e-07
MeanAbsoluteError value on hold-out data: 0.0008318668697029352
Epoch: 53
Loss on hold-out set: 1.0064410389531986e-06
MeanAbsoluteError value on hold-out data: 0.000820374465547502
Epoch: 54
Loss on hold-out set: 1.1776876947676231e-05
MeanAbsoluteError value on hold-out data: 0.00327315297909081
Epoch: 55
Loss on hold-out set: 1.3334553841559682e-05
MeanAbsoluteError value on hold-out data: 0.003228410379961133
Epoch: 56
Loss on hold-out set: 2.5535666281939484e-05
MeanAbsoluteError value on hold-out data: 0.00502388970926404
Epoch: 57
Loss on hold-out set: 3.2943013203683743e-06
MeanAbsoluteError value on hold-out data: 0.001618624897673726
Epoch: 58
Loss on hold-out set: 1.064988438364318e-05
MeanAbsoluteError value on hold-out data: 0.003124411916360259
Epoch: 59
Loss on hold-out set: 1.6513551599928178e-05
MeanAbsoluteError value on hold-out data: 0.003988740034401417
Epoch: 60
Loss on hold-out set: 1.1077644655545425e-06
MeanAbsoluteError value on hold-out data: 0.0008511461201123893
Epoch: 61
Loss on hold-out set: 9.86444255041923e-06
MeanAbsoluteError value on hold-out data: 0.002917179837822914
Epoch: 62
Loss on hold-out set: 6.550656429940968e-05
MeanAbsoluteError value on hold-out data: 0.008064812049269676
Epoch: 63
Loss on hold-out set: 7.310237638843578e-06
MeanAbsoluteError value on hold-out data: 0.0025665408466011286
Epoch: 64
Loss on hold-out set: 1.2519585327806584e-06
MeanAbsoluteError value on hold-out data: 0.0009338257950730622
Epoch: 65
Loss on hold-out set: 9.428397853688303e-06
MeanAbsoluteError value on hold-out data: 0.002765440382063389
Epoch: 66
Loss on hold-out set: 1.8778296829883142e-06
MeanAbsoluteError value on hold-out data: 0.0012087071081623435
Epoch: 67
Loss on hold-out set: 3.4799940554616375e-06
MeanAbsoluteError value on hold-out data: 0.0016719704726710916
Epoch: 68
Loss on hold-out set: 1.8029875978494863e-05
MeanAbsoluteError value on hold-out data: 0.003995528444647789
Epoch: 69
Loss on hold-out set: 2.390503758371259e-06
MeanAbsoluteError value on hold-out data: 0.001295729773119092
Epoch: 70
Loss on hold-out set: 4.737172080889909e-06
MeanAbsoluteError value on hold-out data: 0.0018950484227389097
Epoch: 71
Loss on hold-out set: 1.9199377386972368e-06
MeanAbsoluteError value on hold-out data: 0.0012154802680015564
Epoch: 72
Loss on hold-out set: 2.1425070956736036e-06
MeanAbsoluteError value on hold-out data: 0.0012135948054492474
Epoch: 73
Loss on hold-out set: 1.9608685306593543e-06
MeanAbsoluteError value on hold-out data: 0.0011815611505880952
Epoch: 74
Loss on hold-out set: 1.3515139731420536e-05
MeanAbsoluteError value on hold-out data: 0.0034878156147897243
Epoch: 75
Loss on hold-out set: 1.3483683168098131e-05
MeanAbsoluteError value on hold-out data: 0.003462329274043441
Epoch: 76
Loss on hold-out set: 1.3154357994998073e-05
MeanAbsoluteError value on hold-out data: 0.0035462104715406895
Epoch: 77
Loss on hold-out set: 7.276184533111518e-06
MeanAbsoluteError value on hold-out data: 0.002583706984296441
Epoch: 78
Loss on hold-out set: 4.969346621562311e-06
MeanAbsoluteError value on hold-out data: 0.0020445187110453844
Epoch: 79
Loss on hold-out set: 2.0386322960673298e-05
MeanAbsoluteError value on hold-out data: 0.004367392510175705
Epoch: 80
Loss on hold-out set: 2.321051186169955e-06
MeanAbsoluteError value on hold-out data: 0.0012734695337712765
Epoch: 81
Loss on hold-out set: 2.9394584544206737e-06
MeanAbsoluteError value on hold-out data: 0.0015163618372753263
Epoch: 82
Loss on hold-out set: 3.709161345406236e-05
MeanAbsoluteError value on hold-out data: 0.005833388771861792
Epoch: 83
Loss on hold-out set: 6.48678087600274e-06
MeanAbsoluteError value on hold-out data: 0.002270958386361599
Epoch: 84
Loss on hold-out set: 6.717953380887463e-06
MeanAbsoluteError value on hold-out data: 0.0025193928740918636
Epoch: 85
Loss on hold-out set: 3.617356196627952e-05
MeanAbsoluteError value on hold-out data: 0.00590614415705204
Epoch: 86
Loss on hold-out set: 1.5562217023606146e-05
MeanAbsoluteError value on hold-out data: 0.003827159758657217
Epoch: 87
Loss on hold-out set: 1.3327489016644125e-05
MeanAbsoluteError value on hold-out data: 0.0035190412309020758
Epoch: 88
Loss on hold-out set: 1.5199297844706702e-05
MeanAbsoluteError value on hold-out data: 0.0036449485924094915
Epoch: 89
Loss on hold-out set: 5.5125057899983536e-06
MeanAbsoluteError value on hold-out data: 0.002205813769251108
Epoch: 90
Loss on hold-out set: 6.362332767041932e-06
MeanAbsoluteError value on hold-out data: 0.0023008808493614197
Epoch: 91
Loss on hold-out set: 9.707174675505875e-06
MeanAbsoluteError value on hold-out data: 0.003100397065281868
Epoch: 92
Loss on hold-out set: 1.1546389941941015e-05
MeanAbsoluteError value on hold-out data: 0.003216369776055217
Epoch: 93
Loss on hold-out set: 1.3453867170807956e-06
MeanAbsoluteError value on hold-out data: 0.0009346562437713146
Epoch: 94
Loss on hold-out set: 5.0201183122616e-05
MeanAbsoluteError value on hold-out data: 0.006958397570997477
Epoch: 95
Loss on hold-out set: 1.5595891064939288e-06
MeanAbsoluteError value on hold-out data: 0.00099462631624192
Epoch: 96
Loss on hold-out set: 3.4071580817648543e-06
MeanAbsoluteError value on hold-out data: 0.0016235171351581812
Epoch: 97
Loss on hold-out set: 5.563244777866723e-07
MeanAbsoluteError value on hold-out data: 0.0006156991585157812
Epoch: 98
Loss on hold-out set: 1.6752366361418223e-06
MeanAbsoluteError value on hold-out data: 0.0010354641126468778
Epoch: 99
Loss on hold-out set: 8.621790259764697e-06
MeanAbsoluteError value on hold-out data: 0.0028052208945155144
Epoch: 100
Loss on hold-out set: 8.395067538913281e-07
MeanAbsoluteError value on hold-out data: 0.0007306754705496132
Epoch: 101
Loss on hold-out set: 8.095572606440068e-06
MeanAbsoluteError value on hold-out data: 0.002513472456485033
Epoch: 102
Loss on hold-out set: 6.774379926355323e-06
MeanAbsoluteError value on hold-out data: 0.0024912776425480843
Epoch: 103
Loss on hold-out set: 2.134694471221467e-06
MeanAbsoluteError value on hold-out data: 0.0012701313244178891
Epoch: 104
Loss on hold-out set: 9.146771714897892e-06
MeanAbsoluteError value on hold-out data: 0.002938677556812763
Epoch: 105
Loss on hold-out set: 9.566014081688731e-06
MeanAbsoluteError value on hold-out data: 0.0029468468856066465
Epoch: 106
Loss on hold-out set: 2.9223851275414096e-06
MeanAbsoluteError value on hold-out data: 0.001425676979124546
Epoch: 107
Loss on hold-out set: 8.717870676783994e-07
MeanAbsoluteError value on hold-out data: 0.0007525031105615199
Epoch: 108
Loss on hold-out set: 6.892759172062922e-06
MeanAbsoluteError value on hold-out data: 0.002411874011158943
Epoch: 109
Loss on hold-out set: 8.314082476447635e-06
MeanAbsoluteError value on hold-out data: 0.002721063094213605
Epoch: 110
Loss on hold-out set: 1.7853330323954912e-06
MeanAbsoluteError value on hold-out data: 0.001072642975486815
Epoch: 111
Loss on hold-out set: 1.559298912720156e-05
MeanAbsoluteError value on hold-out data: 0.0037858483847230673
Epoch: 112
Loss on hold-out set: 1.4138013674320454e-05
MeanAbsoluteError value on hold-out data: 0.0034923104103654623
Epoch: 113
Loss on hold-out set: 6.848677458037855e-06
MeanAbsoluteError value on hold-out data: 0.0023658135905861855
Epoch: 114
Loss on hold-out set: 2.5479762695925146e-06
MeanAbsoluteError value on hold-out data: 0.0013552084565162659
Epoch: 115
Loss on hold-out set: 6.684677016112671e-06
MeanAbsoluteError value on hold-out data: 0.0025074013974517584
Epoch: 116
Loss on hold-out set: 1.460767374997626e-05
MeanAbsoluteError value on hold-out data: 0.003753759665414691
Epoch: 117
Loss on hold-out set: 1.5624744914280848e-05
MeanAbsoluteError value on hold-out data: 0.0038674799725413322
Epoch: 118
Loss on hold-out set: 4.756912955729474e-06
MeanAbsoluteError value on hold-out data: 0.0018680829089134932
Epoch: 119
Loss on hold-out set: 3.3214576303310294e-05
MeanAbsoluteError value on hold-out data: 0.005750658456236124
Epoch: 120
Loss on hold-out set: 2.199720946854151e-06
MeanAbsoluteError value on hold-out data: 0.0012325957650318742
Epoch: 121
Loss on hold-out set: 2.791237810535157e-06
MeanAbsoluteError value on hold-out data: 0.0014705071225762367
Epoch: 122
Loss on hold-out set: 2.6869673612444397e-06
MeanAbsoluteError value on hold-out data: 0.0013585631968453526
Epoch: 123
Loss on hold-out set: 1.7122356959069812e-05
MeanAbsoluteError value on hold-out data: 0.004108965862542391
Epoch: 124
Loss on hold-out set: 6.7969175298847925e-06
MeanAbsoluteError value on hold-out data: 0.002535776235163212
Epoch: 125
Loss on hold-out set: 1.8304858583308358e-05
MeanAbsoluteError value on hold-out data: 0.004137996584177017
Epoch: 126
Loss on hold-out set: 2.92214733365524e-05
MeanAbsoluteError value on hold-out data: 0.0050779543817043304
Epoch: 127
Loss on hold-out set: 8.870006110685478e-06
MeanAbsoluteError value on hold-out data: 0.002562996931374073
Epoch: 128
Loss on hold-out set: 8.049125739262308e-07
MeanAbsoluteError value on hold-out data: 0.0007721756119281054
Epoch: 129
Loss on hold-out set: 1.5638529605764363e-05
MeanAbsoluteError value on hold-out data: 0.00357049354352057
Epoch: 130
Loss on hold-out set: 1.045672312167361e-06
MeanAbsoluteError value on hold-out data: 0.000834849604871124
Epoch: 131
Loss on hold-out set: 2.4349005473465823e-06
MeanAbsoluteError value on hold-out data: 0.0012430398492142558
Epoch: 132
Loss on hold-out set: 1.9739182042550444e-06
MeanAbsoluteError value on hold-out data: 0.0011876255739480257
Epoch: 133
Loss on hold-out set: 3.358691563854726e-06
MeanAbsoluteError value on hold-out data: 0.0016665736911818385
Epoch: 134
Loss on hold-out set: 4.079939597951514e-05
MeanAbsoluteError value on hold-out data: 0.006328151095658541
Epoch: 135
Loss on hold-out set: 1.7443651358917123e-06
MeanAbsoluteError value on hold-out data: 0.0010783333564177155
Epoch: 136
Loss on hold-out set: 2.5464777796254827e-06
MeanAbsoluteError value on hold-out data: 0.0014140785206109285
Epoch: 137
Loss on hold-out set: 2.6951346236663606e-06
MeanAbsoluteError value on hold-out data: 0.0014009688748046756
Epoch: 138
Loss on hold-out set: 5.637840112220667e-07
MeanAbsoluteError value on hold-out data: 0.0006285193376243114
Epoch: 139
Loss on hold-out set: 4.458859101370243e-06
MeanAbsoluteError value on hold-out data: 0.001941187772899866
Epoch: 140
Loss on hold-out set: 1.1169190413186567e-06
MeanAbsoluteError value on hold-out data: 0.0007908386178314686
Epoch: 141
Loss on hold-out set: 3.341193457474999e-05
MeanAbsoluteError value on hold-out data: 0.005044811870902777
Epoch: 142
Loss on hold-out set: 2.8196463647743386e-06
MeanAbsoluteError value on hold-out data: 0.00132388761267066
Epoch: 143
Loss on hold-out set: 2.6797706758381016e-06
MeanAbsoluteError value on hold-out data: 0.0014562839642167091
Epoch: 144
Loss on hold-out set: 5.771923172557893e-06
MeanAbsoluteError value on hold-out data: 0.0022875971626490355
Epoch: 145
Loss on hold-out set: 9.894839032702813e-06
MeanAbsoluteError value on hold-out data: 0.003054118249565363
Epoch: 146
Loss on hold-out set: 6.546832017712794e-06
MeanAbsoluteError value on hold-out data: 0.002447114558890462
Epoch: 147
Loss on hold-out set: 6.214213174514173e-06
MeanAbsoluteError value on hold-out data: 0.002327878260985017
Epoch: 148
Loss on hold-out set: 1.300101100046699e-06
MeanAbsoluteError value on hold-out data: 0.0009935731068253517
Epoch: 149
Loss on hold-out set: 1.1044643396676942e-06
MeanAbsoluteError value on hold-out data: 0.0008541906136088073
Epoch: 150
Loss on hold-out set: 2.9043760605418356e-06
MeanAbsoluteError value on hold-out data: 0.001489566988311708
Epoch: 151
Loss on hold-out set: 3.5626675461181937e-06
MeanAbsoluteError value on hold-out data: 0.0016936871688812971
Epoch: 152
Loss on hold-out set: 1.359201080828955e-06
MeanAbsoluteError value on hold-out data: 0.0009372165659442544
Epoch: 153
Loss on hold-out set: 9.021174187345033e-07
MeanAbsoluteError value on hold-out data: 0.000793253188021481
Epoch: 154
Loss on hold-out set: 5.897031964455632e-06
MeanAbsoluteError value on hold-out data: 0.0022222090046852827
Epoch: 155
Loss on hold-out set: 1.9573360045147377e-06
MeanAbsoluteError value on hold-out data: 0.0011480040848255157
Epoch: 156
Loss on hold-out set: 8.818705542320718e-06
MeanAbsoluteError value on hold-out data: 0.0028374309185892344
Epoch: 157
Loss on hold-out set: 4.836022916216669e-06
MeanAbsoluteError value on hold-out data: 0.0020699244923889637
Epoch: 158
Loss on hold-out set: 2.370537328845655e-06
MeanAbsoluteError value on hold-out data: 0.0013679336989298463
Epoch: 159
Loss on hold-out set: 3.0178215768371176e-05
MeanAbsoluteError value on hold-out data: 0.005124886054545641
Epoch: 160
Loss on hold-out set: 1.3781947489275938e-06
MeanAbsoluteError value on hold-out data: 0.0009868618799373507
Epoch: 161
Loss on hold-out set: 8.800428206866076e-06
MeanAbsoluteError value on hold-out data: 0.0026726103387773037
Early stopping at epoch 160
Fold: 2
Epoch: 1
Loss on hold-out set: 0.025250684869076525
MeanAbsoluteError value on hold-out data: 0.12835344672203064
Epoch: 2
Loss on hold-out set: 0.01589018651949508
MeanAbsoluteError value on hold-out data: 0.1011781245470047
Epoch: 3
Loss on hold-out set: 0.011227979923465423
MeanAbsoluteError value on hold-out data: 0.08535948395729065
Epoch: 4
Loss on hold-out set: 0.008364954597449728
MeanAbsoluteError value on hold-out data: 0.0685667023062706
Epoch: 5
Loss on hold-out set: 0.00464671866835228
MeanAbsoluteError value on hold-out data: 0.053872331976890564
Epoch: 6
Loss on hold-out set: 0.003062803198450378
MeanAbsoluteError value on hold-out data: 0.04529372602701187
Epoch: 7
Loss on hold-out set: 0.0010003834114676075
MeanAbsoluteError value on hold-out data: 0.025643670931458473
Epoch: 8
Loss on hold-out set: 0.0004937785769081009
MeanAbsoluteError value on hold-out data: 0.01831839792430401
Epoch: 9
Loss on hold-out set: 0.0001547434211326098
MeanAbsoluteError value on hold-out data: 0.010413144715130329
Epoch: 10
Loss on hold-out set: 1.65686283902947e-05
MeanAbsoluteError value on hold-out data: 0.0030326195992529392
Epoch: 11
Loss on hold-out set: 4.169735770379443e-06
MeanAbsoluteError value on hold-out data: 0.001379063236527145
Epoch: 12
Loss on hold-out set: 1.8268984587978463e-06
MeanAbsoluteError value on hold-out data: 0.0008237299043685198
Epoch: 13
Loss on hold-out set: 1.3580799012353445e-06
MeanAbsoluteError value on hold-out data: 0.00075327861122787
Epoch: 14
Loss on hold-out set: 1.3687921896884551e-06
MeanAbsoluteError value on hold-out data: 0.0008720892947167158
Epoch: 15
Loss on hold-out set: 2.0377253154687684e-06
MeanAbsoluteError value on hold-out data: 0.0011554444208741188
Epoch: 16
Loss on hold-out set: 1.6107023757935427e-06
MeanAbsoluteError value on hold-out data: 0.0009801305131986737
Epoch: 17
Loss on hold-out set: 1.344417025198449e-06
MeanAbsoluteError value on hold-out data: 0.0008907164447009563
Epoch: 18
Loss on hold-out set: 9.728823775796108e-07
MeanAbsoluteError value on hold-out data: 0.0007468230905942619
Epoch: 19
Loss on hold-out set: 7.860741634755999e-07
MeanAbsoluteError value on hold-out data: 0.0006859655841253698
Epoch: 20
Loss on hold-out set: 1.0878754121027408e-06
MeanAbsoluteError value on hold-out data: 0.000710439111571759
Epoch: 21
Loss on hold-out set: 1.1009185690064832e-06
MeanAbsoluteError value on hold-out data: 0.0008852537139318883
Epoch: 22
Loss on hold-out set: 7.018556524534298e-07
MeanAbsoluteError value on hold-out data: 0.0006948382942937315
Epoch: 23
Loss on hold-out set: 8.229379042339653e-07
MeanAbsoluteError value on hold-out data: 0.0006778745446354151
Epoch: 24
Loss on hold-out set: 7.544493314526335e-07
MeanAbsoluteError value on hold-out data: 0.0007245101151056588
Epoch: 25
Loss on hold-out set: 7.80448138877026e-07
MeanAbsoluteError value on hold-out data: 0.0007377755828201771
Epoch: 26
Loss on hold-out set: 7.644545852209766e-07
MeanAbsoluteError value on hold-out data: 0.0007223394350148737
Epoch: 27
Loss on hold-out set: 1.233039045343633e-06
MeanAbsoluteError value on hold-out data: 0.0009452703525312245
Epoch: 28
Loss on hold-out set: 2.417044210492999e-06
MeanAbsoluteError value on hold-out data: 0.0013619608944281936
Epoch: 29
Loss on hold-out set: 1.7891810070328314e-06
MeanAbsoluteError value on hold-out data: 0.0011396603658795357
Epoch: 30
Loss on hold-out set: 6.745183489848776e-07
MeanAbsoluteError value on hold-out data: 0.0006484822952188551
Epoch: 31
Loss on hold-out set: 6.96071424499678e-07
MeanAbsoluteError value on hold-out data: 0.0006835103267803788
Epoch: 32
Loss on hold-out set: 7.818487282358027e-07
MeanAbsoluteError value on hold-out data: 0.0007271216600202024
Epoch: 33
Loss on hold-out set: 9.460807583699144e-07
MeanAbsoluteError value on hold-out data: 0.0008455498609691858
Epoch: 34
Loss on hold-out set: 9.923273702432717e-07
MeanAbsoluteError value on hold-out data: 0.0007846495718695223
Epoch: 35
Loss on hold-out set: 6.398461615780044e-07
MeanAbsoluteError value on hold-out data: 0.000652862770948559
Epoch: 36
Loss on hold-out set: 7.9754991588743e-07
MeanAbsoluteError value on hold-out data: 0.0007216475787572563
Epoch: 37
Loss on hold-out set: 1.1376322065968582e-06
MeanAbsoluteError value on hold-out data: 0.0008409364381805062
Epoch: 38
Loss on hold-out set: 1.1279972714614165e-06
MeanAbsoluteError value on hold-out data: 0.000865170790348202
Epoch: 39
Loss on hold-out set: 8.436106294798915e-07
MeanAbsoluteError value on hold-out data: 0.0007581865647807717
Epoch: 40
Loss on hold-out set: 9.576075236899278e-07
MeanAbsoluteError value on hold-out data: 0.0008094191434793174
Epoch: 41
Loss on hold-out set: 7.243231355654903e-07
MeanAbsoluteError value on hold-out data: 0.0006833605584688485
Epoch: 42
Loss on hold-out set: 2.7732016535862513e-06
MeanAbsoluteError value on hold-out data: 0.0014822883531451225
Epoch: 43
Loss on hold-out set: 1.2558493592353313e-06
MeanAbsoluteError value on hold-out data: 0.0008945305598899722
Epoch: 44
Loss on hold-out set: 9.341821193434693e-07
MeanAbsoluteError value on hold-out data: 0.0007917543407529593
Epoch: 45
Loss on hold-out set: 2.1172127527993974e-06
MeanAbsoluteError value on hold-out data: 0.0012999809114262462
Epoch: 46
Loss on hold-out set: 5.9551280823403175e-06
MeanAbsoluteError value on hold-out data: 0.0023044601548463106
Epoch: 47
Loss on hold-out set: 1.1635248223943303e-06
MeanAbsoluteError value on hold-out data: 0.0008193860994651914
Epoch: 48
Loss on hold-out set: 1.3731241616759299e-06
MeanAbsoluteError value on hold-out data: 0.0009749974124133587
Epoch: 49
Loss on hold-out set: 1.9160648889737786e-06
MeanAbsoluteError value on hold-out data: 0.001216252101585269
Epoch: 50
Loss on hold-out set: 2.813909710701929e-06
MeanAbsoluteError value on hold-out data: 0.0014822152443230152
Epoch: 51
Loss on hold-out set: 6.651375425040637e-07
MeanAbsoluteError value on hold-out data: 0.0006708786822855473
Epoch: 52
Loss on hold-out set: 7.395487955363933e-07
MeanAbsoluteError value on hold-out data: 0.0007019591284915805
Epoch: 53
Loss on hold-out set: 2.8579298876658347e-06
MeanAbsoluteError value on hold-out data: 0.0014985481975600123
Epoch: 54
Loss on hold-out set: 5.128183179944504e-06
MeanAbsoluteError value on hold-out data: 0.0020241872407495975
Epoch: 55
Loss on hold-out set: 6.718935229140957e-07
MeanAbsoluteError value on hold-out data: 0.0006639400380663574
Epoch: 56
Loss on hold-out set: 7.8341031439777e-07
MeanAbsoluteError value on hold-out data: 0.00068064866354689
Epoch: 57
Loss on hold-out set: 9.809088835156996e-07
MeanAbsoluteError value on hold-out data: 0.0007953597814776003
Epoch: 58
Loss on hold-out set: 4.0185540391186284e-06
MeanAbsoluteError value on hold-out data: 0.0017192693194374442
Epoch: 59
Loss on hold-out set: 1.3490014509898174e-06
MeanAbsoluteError value on hold-out data: 0.0008896639919839799
Epoch: 60
Loss on hold-out set: 4.07634154596183e-06
MeanAbsoluteError value on hold-out data: 0.0017818836495280266
Epoch: 61
Loss on hold-out set: 8.850453241393552e-07
MeanAbsoluteError value on hold-out data: 0.0008026268915273249
Epoch: 62
Loss on hold-out set: 7.942029510234403e-07
MeanAbsoluteError value on hold-out data: 0.0007223187130875885
Epoch: 63
Loss on hold-out set: 5.3672613051146205e-06
MeanAbsoluteError value on hold-out data: 0.0021561328321695328
Epoch: 64
Loss on hold-out set: 1.210574712981075e-06
MeanAbsoluteError value on hold-out data: 0.0008924574940465391
Epoch: 65
Loss on hold-out set: 1.0062116026736995e-05
MeanAbsoluteError value on hold-out data: 0.0030484776943922043
Epoch: 66
Loss on hold-out set: 5.4823210900524695e-06
MeanAbsoluteError value on hold-out data: 0.0021718128118664026
Epoch: 67
Loss on hold-out set: 8.280835816419443e-07
MeanAbsoluteError value on hold-out data: 0.0007302549201995134
Epoch: 68
Loss on hold-out set: 2.1381079347650356e-06
MeanAbsoluteError value on hold-out data: 0.0012163779465481639
Epoch: 69
Loss on hold-out set: 4.15736583038649e-06
MeanAbsoluteError value on hold-out data: 0.0018766962457448244
Epoch: 70
Loss on hold-out set: 2.610535440388568e-06
MeanAbsoluteError value on hold-out data: 0.001430537668056786
Epoch: 71
Loss on hold-out set: 1.2355633641293804e-06
MeanAbsoluteError value on hold-out data: 0.0009015290415845811
Epoch: 72
Loss on hold-out set: 4.671230824117499e-06
MeanAbsoluteError value on hold-out data: 0.0019298909464851022
Epoch: 73
Loss on hold-out set: 1.3886417329039041e-06
MeanAbsoluteError value on hold-out data: 0.0009564027423039079
Epoch: 74
Loss on hold-out set: 2.594605364590409e-06
MeanAbsoluteError value on hold-out data: 0.0014631811063736677
Epoch: 75
Loss on hold-out set: 4.114482895342267e-06
MeanAbsoluteError value on hold-out data: 0.0018857899121940136
Epoch: 76
Loss on hold-out set: 2.404596248847416e-06
MeanAbsoluteError value on hold-out data: 0.0013511884026229382
Epoch: 77
Loss on hold-out set: 1.727338859122288e-06
MeanAbsoluteError value on hold-out data: 0.0010583266848698258
Epoch: 78
Loss on hold-out set: 1.304695953357233e-05
MeanAbsoluteError value on hold-out data: 0.0034847725182771683
Epoch: 79
Loss on hold-out set: 9.814484574885033e-07
MeanAbsoluteError value on hold-out data: 0.0007736034458503127
Epoch: 80
Loss on hold-out set: 6.561042482644552e-06
MeanAbsoluteError value on hold-out data: 0.0023722476325929165
Epoch: 81
Loss on hold-out set: 4.746384872435426e-06
MeanAbsoluteError value on hold-out data: 0.0019938130863010883
Epoch: 82
Loss on hold-out set: 1.1823811527327571e-06
MeanAbsoluteError value on hold-out data: 0.0008188656065613031
Epoch: 83
Loss on hold-out set: 2.8583697420409796e-06
MeanAbsoluteError value on hold-out data: 0.0015467378543689847
Epoch: 84
Loss on hold-out set: 1.6423301433730688e-06
MeanAbsoluteError value on hold-out data: 0.0009718170622363687
Epoch: 85
Loss on hold-out set: 1.653287511414549e-05
MeanAbsoluteError value on hold-out data: 0.0040603093802928925
Epoch: 86
Loss on hold-out set: 4.318727600808156e-06
MeanAbsoluteError value on hold-out data: 0.0019017893355339766
Epoch: 87
Loss on hold-out set: 1.8118925384312335e-05
MeanAbsoluteError value on hold-out data: 0.004161222837865353
Epoch: 88
Loss on hold-out set: 1.2345874113504709e-05
MeanAbsoluteError value on hold-out data: 0.003422185778617859
Epoch: 89
Loss on hold-out set: 4.032945753351669e-06
MeanAbsoluteError value on hold-out data: 0.001622812356799841
Epoch: 90
Loss on hold-out set: 2.3709230033221374e-06
MeanAbsoluteError value on hold-out data: 0.0012785907601937652
Epoch: 91
Loss on hold-out set: 1.8150411083947153e-06
MeanAbsoluteError value on hold-out data: 0.0010448169196024537
Epoch: 92
Loss on hold-out set: 1.5444189703625203e-06
MeanAbsoluteError value on hold-out data: 0.001036111731082201
Epoch: 93
Loss on hold-out set: 6.779879007418848e-07
MeanAbsoluteError value on hold-out data: 0.0006740124663338065
Epoch: 94
Loss on hold-out set: 4.643764571353261e-06
MeanAbsoluteError value on hold-out data: 0.0019670038018375635
Epoch: 95
Loss on hold-out set: 4.899166274948844e-06
MeanAbsoluteError value on hold-out data: 0.002042351057752967
Epoch: 96
Loss on hold-out set: 2.602608934206988e-06
MeanAbsoluteError value on hold-out data: 0.0014227948850020766
Epoch: 97
Loss on hold-out set: 9.574820946259673e-07
MeanAbsoluteError value on hold-out data: 0.0008123154984787107
Epoch: 98
Loss on hold-out set: 1.8686146177060436e-06
MeanAbsoluteError value on hold-out data: 0.0010820346651598811
Epoch: 99
Loss on hold-out set: 3.125669292915388e-06
MeanAbsoluteError value on hold-out data: 0.0016125802649185061
Early stopping at epoch 98
Fold: 3
Epoch: 1
Loss on hold-out set: 0.02281332721135446
MeanAbsoluteError value on hold-out data: 0.11952859163284302
Epoch: 2
Loss on hold-out set: 0.015898913012019227
MeanAbsoluteError value on hold-out data: 0.10546200722455978
Epoch: 3
Loss on hold-out set: 0.014305016890700375
MeanAbsoluteError value on hold-out data: 0.09691023826599121
Epoch: 4
Loss on hold-out set: 0.010282897523471288
MeanAbsoluteError value on hold-out data: 0.08324935287237167
Epoch: 5
Loss on hold-out set: 0.007706560460584504
MeanAbsoluteError value on hold-out data: 0.06965471059083939
Epoch: 6
Loss on hold-out set: 0.005742598557844758
MeanAbsoluteError value on hold-out data: 0.06010238826274872
Epoch: 7
Loss on hold-out set: 0.003752716417823519
MeanAbsoluteError value on hold-out data: 0.04826720058917999
Epoch: 8
Loss on hold-out set: 0.0027672205386417253
MeanAbsoluteError value on hold-out data: 0.042237743735313416
Epoch: 9
Loss on hold-out set: 0.001499526551924646
MeanAbsoluteError value on hold-out data: 0.03174806758761406
Epoch: 10
Loss on hold-out set: 0.0006676872393914632
MeanAbsoluteError value on hold-out data: 0.022273965179920197
Epoch: 11
Loss on hold-out set: 0.0004211692222660141
MeanAbsoluteError value on hold-out data: 0.015588375739753246
Epoch: 12
Loss on hold-out set: 0.00011824568874934422
MeanAbsoluteError value on hold-out data: 0.008984589017927647
Epoch: 13
Loss on hold-out set: 4.1612483723188885e-05
MeanAbsoluteError value on hold-out data: 0.004954113624989986
Epoch: 14
Loss on hold-out set: 1.2327881709747349e-05
MeanAbsoluteError value on hold-out data: 0.002987489802762866
Epoch: 15
Loss on hold-out set: 3.8443535166672e-06
MeanAbsoluteError value on hold-out data: 0.001636150642298162
Epoch: 16
Loss on hold-out set: 1.4284877189701156e-06
MeanAbsoluteError value on hold-out data: 0.0009989215759560466
Epoch: 17
Loss on hold-out set: 9.721202250797693e-07
MeanAbsoluteError value on hold-out data: 0.000787194527219981
Epoch: 18
Loss on hold-out set: 7.988964633958468e-07
MeanAbsoluteError value on hold-out data: 0.0007458648178726435
Epoch: 19
Loss on hold-out set: 7.020210586818263e-07
MeanAbsoluteError value on hold-out data: 0.0007222996791824698
Epoch: 20
Loss on hold-out set: 7.475657558383578e-07
MeanAbsoluteError value on hold-out data: 0.0007410311955027282
Epoch: 21
Loss on hold-out set: 7.94534530866388e-07
MeanAbsoluteError value on hold-out data: 0.0007187800365500152
Epoch: 22
Loss on hold-out set: 7.901868497940865e-07
MeanAbsoluteError value on hold-out data: 0.0007373644621111453
Epoch: 23
Loss on hold-out set: 7.050770745666211e-07
MeanAbsoluteError value on hold-out data: 0.0007266735774464905
Epoch: 24
Loss on hold-out set: 9.99390400530891e-07
MeanAbsoluteError value on hold-out data: 0.0007488168776035309
Epoch: 25
Loss on hold-out set: 8.939889458555886e-07
MeanAbsoluteError value on hold-out data: 0.0007605574792250991
Epoch: 26
Loss on hold-out set: 1.2173486863632985e-06
MeanAbsoluteError value on hold-out data: 0.0008888362208381295
Epoch: 27
Loss on hold-out set: 9.677273331882524e-07
MeanAbsoluteError value on hold-out data: 0.0008149337954819202
Epoch: 28
Loss on hold-out set: 7.398009894846577e-07
MeanAbsoluteError value on hold-out data: 0.0007277944823727012
Epoch: 29
Loss on hold-out set: 1.0113605201565536e-06
MeanAbsoluteError value on hold-out data: 0.0008010994060896337
Epoch: 30
Loss on hold-out set: 7.17512388551508e-07
MeanAbsoluteError value on hold-out data: 0.000724659999832511
Epoch: 31
Loss on hold-out set: 7.825809201936604e-07
MeanAbsoluteError value on hold-out data: 0.0007362987380474806
Epoch: 32
Loss on hold-out set: 8.181087675244012e-07
MeanAbsoluteError value on hold-out data: 0.0007358066504821181
Epoch: 33
Loss on hold-out set: 6.666992555486624e-07
MeanAbsoluteError value on hold-out data: 0.0007120780646800995
Epoch: 34
Loss on hold-out set: 1.0969207551170257e-06
MeanAbsoluteError value on hold-out data: 0.000773215142544359
Epoch: 35
Loss on hold-out set: 9.463314622085559e-07
MeanAbsoluteError value on hold-out data: 0.0008403542451560497
Epoch: 36
Loss on hold-out set: 3.257526665428096e-06
MeanAbsoluteError value on hold-out data: 0.0015375642105937004
Epoch: 37
Loss on hold-out set: 7.039729865709887e-07
MeanAbsoluteError value on hold-out data: 0.0007219387334771454
Epoch: 38
Loss on hold-out set: 1.8979972813732665e-06
MeanAbsoluteError value on hold-out data: 0.001202257233671844
Epoch: 39
Loss on hold-out set: 7.479245799199166e-07
MeanAbsoluteError value on hold-out data: 0.0007449293043464422
Epoch: 40
Loss on hold-out set: 1.2181626516394317e-06
MeanAbsoluteError value on hold-out data: 0.0008323620422743261
Epoch: 41
Loss on hold-out set: 7.21307125266841e-07
MeanAbsoluteError value on hold-out data: 0.0007188351592049003
Epoch: 42
Loss on hold-out set: 1.3431820775622327e-06
MeanAbsoluteError value on hold-out data: 0.0008985160384327173
Epoch: 43
Loss on hold-out set: 1.064484536072996e-06
MeanAbsoluteError value on hold-out data: 0.0008272837148979306
Epoch: 44
Loss on hold-out set: 6.687853755238393e-07
MeanAbsoluteError value on hold-out data: 0.0007047854596748948
Epoch: 45
Loss on hold-out set: 1.5479417925234884e-06
MeanAbsoluteError value on hold-out data: 0.0009669907158240676
Epoch: 46
Loss on hold-out set: 1.911015065810976e-06
MeanAbsoluteError value on hold-out data: 0.00119250628631562
Epoch: 47
Loss on hold-out set: 9.681575566641446e-07
MeanAbsoluteError value on hold-out data: 0.0008372673182748258
Epoch: 48
Loss on hold-out set: 1.0999352509445868e-06
MeanAbsoluteError value on hold-out data: 0.0007711662328802049
Epoch: 49
Loss on hold-out set: 6.762522275494121e-07
MeanAbsoluteError value on hold-out data: 0.0007075993926264346
Epoch: 50
Loss on hold-out set: 1.274862199807103e-06
MeanAbsoluteError value on hold-out data: 0.0009384411387145519
Epoch: 51
Loss on hold-out set: 2.5368637060247627e-06
MeanAbsoluteError value on hold-out data: 0.0014276392757892609
Epoch: 52
Loss on hold-out set: 2.193439578539775e-06
MeanAbsoluteError value on hold-out data: 0.0012594145955517888
Epoch: 53
Loss on hold-out set: 7.845185580533455e-07
MeanAbsoluteError value on hold-out data: 0.0007292662630788982
Epoch: 54
Loss on hold-out set: 8.729442129151721e-07
MeanAbsoluteError value on hold-out data: 0.0007537065539509058
Epoch: 55
Loss on hold-out set: 7.319455416368978e-07
MeanAbsoluteError value on hold-out data: 0.0007110744481906295
Epoch: 56
Loss on hold-out set: 1.6701602427409462e-06
MeanAbsoluteError value on hold-out data: 0.0010351523524150252
Epoch: 57
Loss on hold-out set: 7.351468614810333e-07
MeanAbsoluteError value on hold-out data: 0.0007154782069846988
Epoch: 58
Loss on hold-out set: 1.5620955378738342e-06
MeanAbsoluteError value on hold-out data: 0.0011002689134329557
Epoch: 59
Loss on hold-out set: 8.631826915461716e-07
MeanAbsoluteError value on hold-out data: 0.0007794296834617853
Epoch: 60
Loss on hold-out set: 7.434355779878388e-07
MeanAbsoluteError value on hold-out data: 0.0007256148965097964
Epoch: 61
Loss on hold-out set: 9.244049091908632e-07
MeanAbsoluteError value on hold-out data: 0.0007242675055749714
Epoch: 62
Loss on hold-out set: 9.92374387871158e-07
MeanAbsoluteError value on hold-out data: 0.0007570763118565083
Epoch: 63
Loss on hold-out set: 8.6898091922194e-07
MeanAbsoluteError value on hold-out data: 0.0007714167004451156
Epoch: 64
Loss on hold-out set: 1.112972467711058e-06
MeanAbsoluteError value on hold-out data: 0.000828107469715178
Epoch: 65
Loss on hold-out set: 1.4151668373025522e-06
MeanAbsoluteError value on hold-out data: 0.0009982046904042363
Epoch: 66
Loss on hold-out set: 1.0367204237939274e-06
MeanAbsoluteError value on hold-out data: 0.0007763989269733429
Epoch: 67
Loss on hold-out set: 1.5905710232086027e-06
MeanAbsoluteError value on hold-out data: 0.001065273187123239
Epoch: 68
Loss on hold-out set: 7.549302308364401e-07
MeanAbsoluteError value on hold-out data: 0.0007564324187114835
Epoch: 69
Loss on hold-out set: 1.1041222681537225e-06
MeanAbsoluteError value on hold-out data: 0.0008968964102678001
Epoch: 70
Loss on hold-out set: 8.853727747139471e-07
MeanAbsoluteError value on hold-out data: 0.0007315977127291262
Epoch: 71
Loss on hold-out set: 8.118844903037825e-07
MeanAbsoluteError value on hold-out data: 0.0007721988949924707
Epoch: 72
Loss on hold-out set: 3.894423766074137e-06
MeanAbsoluteError value on hold-out data: 0.0017921215621754527
Epoch: 73
Loss on hold-out set: 7.902961312668464e-07
MeanAbsoluteError value on hold-out data: 0.0007490204297937453
Epoch: 74
Loss on hold-out set: 7.991564367720067e-07
MeanAbsoluteError value on hold-out data: 0.0007435815059579909
Epoch: 75
Loss on hold-out set: 1.8413042133553453e-06
MeanAbsoluteError value on hold-out data: 0.0011585125466808677
Epoch: 76
Loss on hold-out set: 1.2885774205122807e-06
MeanAbsoluteError value on hold-out data: 0.0008926372393034399
Epoch: 77
Loss on hold-out set: 4.2877209450255445e-06
MeanAbsoluteError value on hold-out data: 0.0018471424700692296
Epoch: 78
Loss on hold-out set: 3.5624098667800093e-06
MeanAbsoluteError value on hold-out data: 0.0015955631388351321
Epoch: 79
Loss on hold-out set: 2.662869507373346e-06
MeanAbsoluteError value on hold-out data: 0.0014958186075091362
Epoch: 80
Loss on hold-out set: 2.5613406608369715e-06
MeanAbsoluteError value on hold-out data: 0.0012840713607147336
Epoch: 81
Loss on hold-out set: 2.7734101227646794e-06
MeanAbsoluteError value on hold-out data: 0.0014314133441075683
Epoch: 82
Loss on hold-out set: 6.301533046228412e-06
MeanAbsoluteError value on hold-out data: 0.0023268265649676323
Epoch: 83
Loss on hold-out set: 1.4139269166792343e-05
MeanAbsoluteError value on hold-out data: 0.003580582793802023
Epoch: 84
Loss on hold-out set: 4.721750201497343e-06
MeanAbsoluteError value on hold-out data: 0.001932825311087072
Epoch: 85
Loss on hold-out set: 1.5803778166757964e-05
MeanAbsoluteError value on hold-out data: 0.0038235276006162167
Epoch: 86
Loss on hold-out set: 1.0744407420913506e-06
MeanAbsoluteError value on hold-out data: 0.0008671745890751481
Epoch: 87
Loss on hold-out set: 8.263267931494868e-07
MeanAbsoluteError value on hold-out data: 0.0007972217863425612
Epoch: 88
Loss on hold-out set: 8.377766513539038e-07
MeanAbsoluteError value on hold-out data: 0.0007609645836055279
Epoch: 89
Loss on hold-out set: 1.0243653199332975e-06
MeanAbsoluteError value on hold-out data: 0.0007937183836475015
Epoch: 90
Loss on hold-out set: 4.768194198082451e-06
MeanAbsoluteError value on hold-out data: 0.0020636471454054117
Epoch: 91
Loss on hold-out set: 9.987568643867104e-07
MeanAbsoluteError value on hold-out data: 0.0008194050169549882
Epoch: 92
Loss on hold-out set: 1.1743727554858197e-06
MeanAbsoluteError value on hold-out data: 0.0008536771056242287
Epoch: 93
Loss on hold-out set: 7.609774846579447e-06
MeanAbsoluteError value on hold-out data: 0.002615325851365924
Epoch: 94
Loss on hold-out set: 6.49866231989498e-06
MeanAbsoluteError value on hold-out data: 0.002407553605735302
Epoch: 95
Loss on hold-out set: 9.091166199531082e-07
MeanAbsoluteError value on hold-out data: 0.0007679730770178139
Epoch: 96
Loss on hold-out set: 2.538022353551891e-06
MeanAbsoluteError value on hold-out data: 0.0014025226701050997
Epoch: 97
Loss on hold-out set: 1.0793722659790156e-06
MeanAbsoluteError value on hold-out data: 0.0008617323474027216
Early stopping at epoch 96
Fold: 4
Epoch: 1
Loss on hold-out set: 0.025508479880435125
MeanAbsoluteError value on hold-out data: 0.13015027344226837
Epoch: 2
Loss on hold-out set: 0.022457562386989594
MeanAbsoluteError value on hold-out data: 0.11932335793972015
Epoch: 3
Loss on hold-out set: 0.015520805626043252
MeanAbsoluteError value on hold-out data: 0.10426361858844757
Epoch: 4
Loss on hold-out set: 0.01267401288662638
MeanAbsoluteError value on hold-out data: 0.09034094959497452
Epoch: 5
Loss on hold-out set: 0.007731912325003317
MeanAbsoluteError value on hold-out data: 0.06794112920761108
Epoch: 6
Loss on hold-out set: 0.005419361405074596
MeanAbsoluteError value on hold-out data: 0.060408834367990494
Epoch: 7
Loss on hold-out set: 0.0025021868724642055
MeanAbsoluteError value on hold-out data: 0.04157767444849014
Epoch: 8
Loss on hold-out set: 0.0011985527983467495
MeanAbsoluteError value on hold-out data: 0.027755361050367355
Epoch: 9
Loss on hold-out set: 0.0004913839137381208
MeanAbsoluteError value on hold-out data: 0.018778884783387184
Epoch: 10
Loss on hold-out set: 0.00017699704351668646
MeanAbsoluteError value on hold-out data: 0.010973148047924042
Epoch: 11
Loss on hold-out set: 6.278953229151998e-05
MeanAbsoluteError value on hold-out data: 0.006337143015116453
Epoch: 12
Loss on hold-out set: 1.468242693850438e-05
MeanAbsoluteError value on hold-out data: 0.00315685267560184
Epoch: 13
Loss on hold-out set: 5.0250362164661055e-06
MeanAbsoluteError value on hold-out data: 0.001752925687469542
Epoch: 14
Loss on hold-out set: 2.9599162871818407e-06
MeanAbsoluteError value on hold-out data: 0.0014027717988938093
Epoch: 15
Loss on hold-out set: 1.0910273999797937e-06
MeanAbsoluteError value on hold-out data: 0.0008955682860687375
Epoch: 16
Loss on hold-out set: 9.186943706091759e-07
MeanAbsoluteError value on hold-out data: 0.0008352053118869662
Epoch: 17
Loss on hold-out set: 9.420519120340032e-07
MeanAbsoluteError value on hold-out data: 0.0008568071061745286
Epoch: 18
Loss on hold-out set: 8.033994366282318e-07
MeanAbsoluteError value on hold-out data: 0.000710700755007565
Epoch: 19
Loss on hold-out set: 1.4272448619781893e-06
MeanAbsoluteError value on hold-out data: 0.0009395724628120661
Epoch: 20
Loss on hold-out set: 2.143434617859644e-06
MeanAbsoluteError value on hold-out data: 0.0011640043230727315
Epoch: 21
Loss on hold-out set: 7.011143046448913e-07
MeanAbsoluteError value on hold-out data: 0.0007021118071861565
Epoch: 22
Loss on hold-out set: 6.545736255247903e-07
MeanAbsoluteError value on hold-out data: 0.0006805626908317208
Epoch: 23
Loss on hold-out set: 6.820573129776417e-07
MeanAbsoluteError value on hold-out data: 0.0007168335723690689
Epoch: 24
Loss on hold-out set: 8.140727426767366e-07
MeanAbsoluteError value on hold-out data: 0.0007540463702753186
Epoch: 25
Loss on hold-out set: 8.297090516862227e-07
MeanAbsoluteError value on hold-out data: 0.0007548888097517192
Epoch: 26
Loss on hold-out set: 7.877448037366516e-07
MeanAbsoluteError value on hold-out data: 0.0007228031172417104
Epoch: 27
Loss on hold-out set: 6.375061129152268e-07
MeanAbsoluteError value on hold-out data: 0.0006688527064397931
Epoch: 28
Loss on hold-out set: 9.561857560973813e-07
MeanAbsoluteError value on hold-out data: 0.000817882944829762
Epoch: 29
Loss on hold-out set: 1.3190983411602377e-06
MeanAbsoluteError value on hold-out data: 0.0009676532936282456
Epoch: 30
Loss on hold-out set: 6.460739387291272e-07
MeanAbsoluteError value on hold-out data: 0.0006834359373897314
Epoch: 31
Loss on hold-out set: 7.380264232129516e-07
MeanAbsoluteError value on hold-out data: 0.000682372075971216
Epoch: 32
Loss on hold-out set: 1.173744002309312e-06
MeanAbsoluteError value on hold-out data: 0.000886819208972156
Epoch: 33
Loss on hold-out set: 6.412742428502887e-07
MeanAbsoluteError value on hold-out data: 0.0006842794828116894
Epoch: 34
Loss on hold-out set: 7.293341143719902e-07
MeanAbsoluteError value on hold-out data: 0.0007298383861780167
Epoch: 35
Loss on hold-out set: 8.979400994186497e-07
MeanAbsoluteError value on hold-out data: 0.0007756213308311999
Epoch: 36
Loss on hold-out set: 1.3746984564022569e-06
MeanAbsoluteError value on hold-out data: 0.0009407435427419841
Epoch: 37
Loss on hold-out set: 1.9349985547835658e-06
MeanAbsoluteError value on hold-out data: 0.0012035674881190062
Epoch: 38
Loss on hold-out set: 8.901672247572736e-07
MeanAbsoluteError value on hold-out data: 0.0007410171092487872
Epoch: 39
Loss on hold-out set: 6.712396652476725e-07
MeanAbsoluteError value on hold-out data: 0.0006645409157499671
Epoch: 40
Loss on hold-out set: 1.159601838805559e-06
MeanAbsoluteError value on hold-out data: 0.0008861715323291719
Epoch: 41
Loss on hold-out set: 1.011819620089227e-06
MeanAbsoluteError value on hold-out data: 0.0008493611239828169
Epoch: 42
Loss on hold-out set: 7.011203828304653e-07
MeanAbsoluteError value on hold-out data: 0.0006731936591677368
Epoch: 43
Loss on hold-out set: 1.7930852728958207e-06
MeanAbsoluteError value on hold-out data: 0.0011632208479568362
Epoch: 44
Loss on hold-out set: 1.8432993848754059e-06
MeanAbsoluteError value on hold-out data: 0.0011428690049797297
Epoch: 45
Loss on hold-out set: 8.376454405021962e-07
MeanAbsoluteError value on hold-out data: 0.0007797995931468904
Epoch: 46
Loss on hold-out set: 6.154027809251212e-07
MeanAbsoluteError value on hold-out data: 0.0006718088407069445
Epoch: 47
Loss on hold-out set: 1.6862391122783395e-06
MeanAbsoluteError value on hold-out data: 0.0011185138719156384
Epoch: 48
Loss on hold-out set: 3.2513397789963553e-06
MeanAbsoluteError value on hold-out data: 0.0016494120936840773
Epoch: 49
Loss on hold-out set: 8.265234246859368e-07
MeanAbsoluteError value on hold-out data: 0.0006983868079259992
Epoch: 50
Loss on hold-out set: 2.787269717633275e-06
MeanAbsoluteError value on hold-out data: 0.001478001126088202
Epoch: 51
Loss on hold-out set: 1.7180999926884916e-06
MeanAbsoluteError value on hold-out data: 0.0009924073237925768
Epoch: 52
Loss on hold-out set: 3.943584618225161e-06
MeanAbsoluteError value on hold-out data: 0.001728901406750083
Epoch: 53
Loss on hold-out set: 9.280048313290276e-07
MeanAbsoluteError value on hold-out data: 0.000805653864517808
Epoch: 54
Loss on hold-out set: 1.0500709614851594e-06
MeanAbsoluteError value on hold-out data: 0.0008087975438684225
Epoch: 55
Loss on hold-out set: 2.6263296604156494e-06
MeanAbsoluteError value on hold-out data: 0.0013877559686079621
Epoch: 56
Loss on hold-out set: 7.269532440139821e-07
MeanAbsoluteError value on hold-out data: 0.0006835872773081064
Epoch: 57
Loss on hold-out set: 8.507519851264078e-06
MeanAbsoluteError value on hold-out data: 0.002782391384243965
Epoch: 58
Loss on hold-out set: 2.2454483671806102e-06
MeanAbsoluteError value on hold-out data: 0.0013086467515677214
Epoch: 59
Loss on hold-out set: 1.8136311967152454e-06
MeanAbsoluteError value on hold-out data: 0.0010842647170647979
Epoch: 60
Loss on hold-out set: 7.517896075829153e-07
MeanAbsoluteError value on hold-out data: 0.0006794538930989802
Epoch: 61
Loss on hold-out set: 6.849538587110666e-07
MeanAbsoluteError value on hold-out data: 0.0006708369473926723
Epoch: 62
Loss on hold-out set: 9.460217102384507e-07
MeanAbsoluteError value on hold-out data: 0.0007583207916468382
Epoch: 63
Loss on hold-out set: 2.091552703729706e-06
MeanAbsoluteError value on hold-out data: 0.0012472503585740924
Epoch: 64
Loss on hold-out set: 6.444039927698344e-07
MeanAbsoluteError value on hold-out data: 0.0006628273404203355
Epoch: 65
Loss on hold-out set: 1.7867360416598136e-06
MeanAbsoluteError value on hold-out data: 0.0010791566455736756
Epoch: 66
Loss on hold-out set: 2.1125179533295783e-06
MeanAbsoluteError value on hold-out data: 0.0010980656370520592
Epoch: 67
Loss on hold-out set: 6.601326236120388e-07
MeanAbsoluteError value on hold-out data: 0.0006899110157974064
Epoch: 68
Loss on hold-out set: 6.620587303781836e-07
MeanAbsoluteError value on hold-out data: 0.0006853947998024523
Epoch: 69
Loss on hold-out set: 9.46122416475451e-07
MeanAbsoluteError value on hold-out data: 0.0007674539810977876
Epoch: 70
Loss on hold-out set: 3.046475935012235e-06
MeanAbsoluteError value on hold-out data: 0.0015592112904414535
Epoch: 71
Loss on hold-out set: 2.4350312709689855e-06
MeanAbsoluteError value on hold-out data: 0.0013423070777207613
Epoch: 72
Loss on hold-out set: 1.858096636299576e-06
MeanAbsoluteError value on hold-out data: 0.001130355172790587
Epoch: 73
Loss on hold-out set: 7.821610016175587e-07
MeanAbsoluteError value on hold-out data: 0.000724976824130863
Epoch: 74
Loss on hold-out set: 1.0757018295797543e-06
MeanAbsoluteError value on hold-out data: 0.0008651679963804781
Epoch: 75
Loss on hold-out set: 3.462888019255063e-06
MeanAbsoluteError value on hold-out data: 0.0016535534523427486
Epoch: 76
Loss on hold-out set: 6.98192695023993e-07
MeanAbsoluteError value on hold-out data: 0.0006936037680134177
Epoch: 77
Loss on hold-out set: 2.5813802397221608e-06
MeanAbsoluteError value on hold-out data: 0.0013032101560384035
Epoch: 78
Loss on hold-out set: 1.819547078087323e-06
MeanAbsoluteError value on hold-out data: 0.0011681965552270412
Epoch: 79
Loss on hold-out set: 1.090261931884535e-05
MeanAbsoluteError value on hold-out data: 0.0030985092744231224
Epoch: 80
Loss on hold-out set: 1.0080336291399102e-06
MeanAbsoluteError value on hold-out data: 0.0008498188690282404
Epoch: 81
Loss on hold-out set: 8.170321312458587e-06
MeanAbsoluteError value on hold-out data: 0.002687173429876566
Epoch: 82
Loss on hold-out set: 2.1578720829243788e-06
MeanAbsoluteError value on hold-out data: 0.0012781636323779821
Epoch: 83
Loss on hold-out set: 7.872869770965605e-06
MeanAbsoluteError value on hold-out data: 0.002669139765202999
Epoch: 84
Loss on hold-out set: 6.287831313654481e-06
MeanAbsoluteError value on hold-out data: 0.002364029875025153
Epoch: 85
Loss on hold-out set: 8.916931229967823e-06
MeanAbsoluteError value on hold-out data: 0.0028658949304372072
Epoch: 86
Loss on hold-out set: 3.836937659278712e-06
MeanAbsoluteError value on hold-out data: 0.0016409957315772772
Epoch: 87
Loss on hold-out set: 6.997080877876474e-06
MeanAbsoluteError value on hold-out data: 0.002471175277605653
Epoch: 88
Loss on hold-out set: 9.179814039076259e-07
MeanAbsoluteError value on hold-out data: 0.0007384534692391753
Epoch: 89
Loss on hold-out set: 2.7224646146351006e-06
MeanAbsoluteError value on hold-out data: 0.0014047828735783696
Epoch: 90
Loss on hold-out set: 4.890953310418159e-06
MeanAbsoluteError value on hold-out data: 0.001980060711503029
Epoch: 91
Loss on hold-out set: 1.787856542380593e-05
MeanAbsoluteError value on hold-out data: 0.004002582281827927
Epoch: 92
Loss on hold-out set: 1.1134876314957052e-06
MeanAbsoluteError value on hold-out data: 0.0008248676313087344
Epoch: 93
Loss on hold-out set: 9.006837688372928e-07
MeanAbsoluteError value on hold-out data: 0.0008294146973639727
Epoch: 94
Loss on hold-out set: 3.6331889857267796e-06
MeanAbsoluteError value on hold-out data: 0.0017567495815455914
Epoch: 95
Loss on hold-out set: 2.7499336933293047e-06
MeanAbsoluteError value on hold-out data: 0.0014449331210926175
Epoch: 96
Loss on hold-out set: 7.064624055276778e-07
MeanAbsoluteError value on hold-out data: 0.0006757083465345204
Epoch: 97
Loss on hold-out set: 4.605094350803743e-06
MeanAbsoluteError value on hold-out data: 0.0018967310898005962
Epoch: 98
Loss on hold-out set: 9.572753063886402e-07
MeanAbsoluteError value on hold-out data: 0.000802075257524848
Epoch: 99
Loss on hold-out set: 1.0874821246683756e-06
MeanAbsoluteError value on hold-out data: 0.0008851721649989486
Epoch: 100
Loss on hold-out set: 4.579929314526712e-06
MeanAbsoluteError value on hold-out data: 0.001951680751517415
Epoch: 101
Loss on hold-out set: 2.5144161749527224e-06
MeanAbsoluteError value on hold-out data: 0.0013666377635672688
Epoch: 102
Loss on hold-out set: 9.105683359069059e-07
MeanAbsoluteError value on hold-out data: 0.0007452802965417504
Epoch: 103
Loss on hold-out set: 9.473047961299536e-07
MeanAbsoluteError value on hold-out data: 0.0008295353036373854
Epoch: 104
Loss on hold-out set: 2.0922674853604154e-06
MeanAbsoluteError value on hold-out data: 0.0011758441105484962
Epoch: 105
Loss on hold-out set: 2.359278525026249e-05
MeanAbsoluteError value on hold-out data: 0.004725998267531395
Epoch: 106
Loss on hold-out set: 3.820105933170583e-06
MeanAbsoluteError value on hold-out data: 0.0017172155203297734
Epoch: 107
Loss on hold-out set: 1.5511657563495516e-06
MeanAbsoluteError value on hold-out data: 0.0010064278030768037
Epoch: 108
Loss on hold-out set: 3.277778919904709e-06
MeanAbsoluteError value on hold-out data: 0.0015202283393591642
Epoch: 109
Loss on hold-out set: 1.7011841708024024e-06
MeanAbsoluteError value on hold-out data: 0.0010487562976777554
Epoch: 110
Loss on hold-out set: 6.987061129036322e-07
MeanAbsoluteError value on hold-out data: 0.0006651455769315362
Early stopping at epoch 109
Fold: 5
Epoch: 1
Loss on hold-out set: 0.023102713748812675
MeanAbsoluteError value on hold-out data: 0.1277102828025818
Epoch: 2
Loss on hold-out set: 0.019061800225504806
MeanAbsoluteError value on hold-out data: 0.11122334748506546
Epoch: 3
Loss on hold-out set: 0.009462493937462568
MeanAbsoluteError value on hold-out data: 0.08342865109443665
Epoch: 4
Loss on hold-out set: 0.003500938249219741
MeanAbsoluteError value on hold-out data: 0.04953213781118393
Epoch: 5
Loss on hold-out set: 0.0010937861225102097
MeanAbsoluteError value on hold-out data: 0.025863077491521835
Epoch: 6
Loss on hold-out set: 0.00044350996280887296
MeanAbsoluteError value on hold-out data: 0.017031807452440262
Epoch: 7
Loss on hold-out set: 5.751590028272143e-05
MeanAbsoluteError value on hold-out data: 0.006310651078820229
Epoch: 8
Loss on hold-out set: 7.3939640969911125e-06
MeanAbsoluteError value on hold-out data: 0.002274970756843686
Epoch: 9
Loss on hold-out set: 2.2133105760855998e-06
MeanAbsoluteError value on hold-out data: 0.001152481185272336
Epoch: 10
Loss on hold-out set: 9.059296205902813e-07
MeanAbsoluteError value on hold-out data: 0.0007361963507719338
Epoch: 11
Loss on hold-out set: 8.605063450366808e-07
MeanAbsoluteError value on hold-out data: 0.0007568839355371892
Epoch: 12
Loss on hold-out set: 7.180340406063936e-07
MeanAbsoluteError value on hold-out data: 0.00069542316487059
Epoch: 13
Loss on hold-out set: 1.0642515917425044e-06
MeanAbsoluteError value on hold-out data: 0.0008442976977676153
Epoch: 14
Loss on hold-out set: 1.4616481556523858e-06
MeanAbsoluteError value on hold-out data: 0.0010427481029182673
Epoch: 15
Loss on hold-out set: 1.0519428477501997e-06
MeanAbsoluteError value on hold-out data: 0.0008581834845244884
Epoch: 16
Loss on hold-out set: 8.199363118624856e-07
MeanAbsoluteError value on hold-out data: 0.0007544005056843162
Epoch: 17
Loss on hold-out set: 1.0604856665200453e-06
MeanAbsoluteError value on hold-out data: 0.0008380961371585727
Epoch: 18
Loss on hold-out set: 8.479912188314691e-07
MeanAbsoluteError value on hold-out data: 0.0007025187951512635
Epoch: 19
Loss on hold-out set: 1.0217847424038545e-06
MeanAbsoluteError value on hold-out data: 0.0008591189980506897
Epoch: 20
Loss on hold-out set: 7.863417051469566e-07
MeanAbsoluteError value on hold-out data: 0.0007237535901367664
Epoch: 21
Loss on hold-out set: 7.048282465608022e-07
MeanAbsoluteError value on hold-out data: 0.0007135480409488082
Epoch: 22
Loss on hold-out set: 1.0777660739742195e-06
MeanAbsoluteError value on hold-out data: 0.0008159711724147201
Epoch: 23
Loss on hold-out set: 9.337156825495185e-07
MeanAbsoluteError value on hold-out data: 0.0007533282041549683
Epoch: 24
Loss on hold-out set: 8.912986727084769e-07
MeanAbsoluteError value on hold-out data: 0.0007140687084756792
Epoch: 25
Loss on hold-out set: 7.168303690312834e-07
MeanAbsoluteError value on hold-out data: 0.0006971803377382457
Epoch: 26
Loss on hold-out set: 1.3264276503832662e-06
MeanAbsoluteError value on hold-out data: 0.0009793835924938321
Epoch: 27
Loss on hold-out set: 1.4242435375828272e-06
MeanAbsoluteError value on hold-out data: 0.0009225496905855834
Epoch: 28
Loss on hold-out set: 9.086406537660099e-07
MeanAbsoluteError value on hold-out data: 0.0007917377515695989
Epoch: 29
Loss on hold-out set: 1.1946780205107643e-06
MeanAbsoluteError value on hold-out data: 0.0009190181153826416
Epoch: 30
Loss on hold-out set: 8.437343862307703e-07
MeanAbsoluteError value on hold-out data: 0.0007482317159883678
Epoch: 31
Loss on hold-out set: 8.842905328622562e-07
MeanAbsoluteError value on hold-out data: 0.0007424494833685458
Epoch: 32
Loss on hold-out set: 7.551962093137783e-07
MeanAbsoluteError value on hold-out data: 0.0007197213126346469
Epoch: 33
Loss on hold-out set: 7.533163771508303e-07
MeanAbsoluteError value on hold-out data: 0.0006826499011367559
Epoch: 34
Loss on hold-out set: 1.3220696522304415e-06
MeanAbsoluteError value on hold-out data: 0.0009667432168498635
Epoch: 35
Loss on hold-out set: 1.383899383914208e-06
MeanAbsoluteError value on hold-out data: 0.0009160903282463551
Epoch: 36
Loss on hold-out set: 7.188607591095726e-07
MeanAbsoluteError value on hold-out data: 0.0006956660654395819
Epoch: 37
Loss on hold-out set: 7.671011417187401e-07
MeanAbsoluteError value on hold-out data: 0.0007404815987683833
Epoch: 38
Loss on hold-out set: 1.060936759651148e-06
MeanAbsoluteError value on hold-out data: 0.000792739971075207
Epoch: 39
Loss on hold-out set: 1.2726997462258233e-06
MeanAbsoluteError value on hold-out data: 0.0009915548143908381
Epoch: 40
Loss on hold-out set: 7.113828327679325e-07
MeanAbsoluteError value on hold-out data: 0.0007049840642139316
Epoch: 41
Loss on hold-out set: 1.2362054105454133e-06
MeanAbsoluteError value on hold-out data: 0.0009026766056194901
Epoch: 42
Loss on hold-out set: 7.414693170306107e-06
MeanAbsoluteError value on hold-out data: 0.002620226703584194
Epoch: 43
Loss on hold-out set: 1.3248353768956025e-06
MeanAbsoluteError value on hold-out data: 0.00097297178581357
Epoch: 44
Loss on hold-out set: 1.7638123738704183e-06
MeanAbsoluteError value on hold-out data: 0.001065475633367896
Epoch: 45
Loss on hold-out set: 9.205829160561864e-07
MeanAbsoluteError value on hold-out data: 0.0007388392114080489
Epoch: 46
Loss on hold-out set: 9.939964879127468e-07
MeanAbsoluteError value on hold-out data: 0.000862930144648999
Epoch: 47
Loss on hold-out set: 1.0557410843960367e-06
MeanAbsoluteError value on hold-out data: 0.000888377137016505
Epoch: 48
Loss on hold-out set: 2.2366798800378873e-06
MeanAbsoluteError value on hold-out data: 0.0012212051078677177
Epoch: 49
Loss on hold-out set: 1.9201849324547638e-06
MeanAbsoluteError value on hold-out data: 0.001129060867242515
Epoch: 50
Loss on hold-out set: 1.1422063274884359e-06
MeanAbsoluteError value on hold-out data: 0.0008915430516935885
Epoch: 51
Loss on hold-out set: 1.8423771410068314e-06
MeanAbsoluteError value on hold-out data: 0.0011729460675269365
Epoch: 52
Loss on hold-out set: 1.329176393483067e-05
MeanAbsoluteError value on hold-out data: 0.003466308116912842
Epoch: 53
Loss on hold-out set: 3.0387414621405436e-06
MeanAbsoluteError value on hold-out data: 0.0014916342915967107
Epoch: 54
Loss on hold-out set: 3.895851997575457e-06
MeanAbsoluteError value on hold-out data: 0.0017571764765307307
Epoch: 55
Loss on hold-out set: 8.507030315740849e-07
MeanAbsoluteError value on hold-out data: 0.0008107960456982255
Epoch: 56
Loss on hold-out set: 5.277355220251982e-06
MeanAbsoluteError value on hold-out data: 0.0021738619543612003
Epoch: 57
Loss on hold-out set: 9.502287850539557e-07
MeanAbsoluteError value on hold-out data: 0.0007865458610467613
Epoch: 58
Loss on hold-out set: 3.1353991484398388e-06
MeanAbsoluteError value on hold-out data: 0.0015043490566313267
Epoch: 59
Loss on hold-out set: 4.452826455495337e-06
MeanAbsoluteError value on hold-out data: 0.0018432197393849492
Epoch: 60
Loss on hold-out set: 1.4173748468238045e-06
MeanAbsoluteError value on hold-out data: 0.0009872752707451582
Epoch: 61
Loss on hold-out set: 4.870646047753066e-06
MeanAbsoluteError value on hold-out data: 0.0019679157994687557
Epoch: 62
Loss on hold-out set: 2.7968899628051858e-06
MeanAbsoluteError value on hold-out data: 0.0013940836070105433
Epoch: 63
Loss on hold-out set: 8.34991143148857e-07
MeanAbsoluteError value on hold-out data: 0.0007982930401340127
Epoch: 64
Loss on hold-out set: 5.927394697989387e-06
MeanAbsoluteError value on hold-out data: 0.002167083090171218
Epoch: 65
Loss on hold-out set: 4.8432107502906415e-06
MeanAbsoluteError value on hold-out data: 0.0020192197989672422
Epoch: 66
Loss on hold-out set: 3.001742616756279e-06
MeanAbsoluteError value on hold-out data: 0.0015584304928779602
Epoch: 67
Loss on hold-out set: 1.1192277611371537e-06
MeanAbsoluteError value on hold-out data: 0.0008497457019984722
Epoch: 68
Loss on hold-out set: 2.8552792628033785e-06
MeanAbsoluteError value on hold-out data: 0.0014407248236238956
Epoch: 69
Loss on hold-out set: 1.2546023364328512e-06
MeanAbsoluteError value on hold-out data: 0.0008933694916777313
Epoch: 70
Loss on hold-out set: 1.7746916033242347e-06
MeanAbsoluteError value on hold-out data: 0.0011473733466118574
Epoch: 71
Loss on hold-out set: 1.1796842695080808e-06
MeanAbsoluteError value on hold-out data: 0.0008882379624992609
Epoch: 72
Loss on hold-out set: 5.882767449553025e-06
MeanAbsoluteError value on hold-out data: 0.0022192057222127914
Epoch: 73
Loss on hold-out set: 9.347438013459655e-07
MeanAbsoluteError value on hold-out data: 0.0007045921520330012
Epoch: 74
Loss on hold-out set: 1.0326194179859677e-05
MeanAbsoluteError value on hold-out data: 0.003077819012105465
Epoch: 75
Loss on hold-out set: 6.203843700599723e-06
MeanAbsoluteError value on hold-out data: 0.0022615394555032253
Epoch: 76
Loss on hold-out set: 1.4121825740533365e-06
MeanAbsoluteError value on hold-out data: 0.0010284542804583907
Epoch: 77
Loss on hold-out set: 3.051654052147309e-05
MeanAbsoluteError value on hold-out data: 0.005252143368124962
Epoch: 78
Loss on hold-out set: 1.5904395305759473e-05
MeanAbsoluteError value on hold-out data: 0.0038026010151952505
Epoch: 79
Loss on hold-out set: 7.606171363607116e-06
MeanAbsoluteError value on hold-out data: 0.0023957747034728527
Epoch: 80
Loss on hold-out set: 8.71077889184692e-07
MeanAbsoluteError value on hold-out data: 0.0007553622126579285
Epoch: 81
Loss on hold-out set: 1.1406310704842326e-06
MeanAbsoluteError value on hold-out data: 0.000791845319326967
Epoch: 82
Loss on hold-out set: 9.298808111322745e-06
MeanAbsoluteError value on hold-out data: 0.002818821696564555
Epoch: 83
Loss on hold-out set: 1.2763379995054233e-05
MeanAbsoluteError value on hold-out data: 0.0033760457299649715
Epoch: 84
Loss on hold-out set: 1.4758332684193322e-06
MeanAbsoluteError value on hold-out data: 0.0010013339342549443
Epoch: 85
Loss on hold-out set: 1.185248663659877e-06
MeanAbsoluteError value on hold-out data: 0.0008923578425310552
Early stopping at epoch 84
Fold: 6
Epoch: 1
Loss on hold-out set: 0.03432626436863627
MeanAbsoluteError value on hold-out data: 0.13484413921833038
Epoch: 2
Loss on hold-out set: 0.02217177102076156
MeanAbsoluteError value on hold-out data: 0.11674493551254272
Epoch: 3
Loss on hold-out set: 0.009289790743163653
MeanAbsoluteError value on hold-out data: 0.07217401266098022
Epoch: 4
Loss on hold-out set: 0.0028781799067343983
MeanAbsoluteError value on hold-out data: 0.04182877019047737
Epoch: 5
Loss on hold-out set: 0.0008330673486593046
MeanAbsoluteError value on hold-out data: 0.021271977573633194
Epoch: 6
Loss on hold-out set: 0.00017797855668634708
MeanAbsoluteError value on hold-out data: 0.010044405236840248
Epoch: 7
Loss on hold-out set: 3.5536472166443544e-05
MeanAbsoluteError value on hold-out data: 0.0033569473307579756
Epoch: 8
Loss on hold-out set: 1.825450145328692e-05
MeanAbsoluteError value on hold-out data: 0.0016853383276611567
Epoch: 9
Loss on hold-out set: 1.4927309231487535e-05
MeanAbsoluteError value on hold-out data: 0.0018673102604225278
Epoch: 10
Loss on hold-out set: 1.116032774461928e-05
MeanAbsoluteError value on hold-out data: 0.0014983848668634892
Epoch: 11
Loss on hold-out set: 1.3535433611520733e-05
MeanAbsoluteError value on hold-out data: 0.0027100497391074896
Epoch: 12
Loss on hold-out set: 5.787909474617793e-06
MeanAbsoluteError value on hold-out data: 0.001224332838319242
Epoch: 13
Loss on hold-out set: 4.167279420081675e-06
MeanAbsoluteError value on hold-out data: 0.0011079397518187761
Epoch: 14
Loss on hold-out set: 3.1852265465204255e-06
MeanAbsoluteError value on hold-out data: 0.001024014549329877
Epoch: 15
Loss on hold-out set: 2.736750567627106e-06
MeanAbsoluteError value on hold-out data: 0.0010072240838781
Epoch: 16
Loss on hold-out set: 1.973996461401839e-06
MeanAbsoluteError value on hold-out data: 0.0009035936091095209
Epoch: 17
Loss on hold-out set: 2.4767744142601648e-06
MeanAbsoluteError value on hold-out data: 0.0012085805647075176
Epoch: 18
Loss on hold-out set: 1.4473215596158947e-06
MeanAbsoluteError value on hold-out data: 0.0008540548151358962
Epoch: 19
Loss on hold-out set: 1.3930121148015523e-06
MeanAbsoluteError value on hold-out data: 0.0008983571897260845
Epoch: 20
Loss on hold-out set: 1.2503204597383695e-06
MeanAbsoluteError value on hold-out data: 0.0009504568297415972
Epoch: 21
Loss on hold-out set: 1.1749014317631788e-06
MeanAbsoluteError value on hold-out data: 0.0008749306434765458
Epoch: 22
Loss on hold-out set: 1.8524337000209407e-06
MeanAbsoluteError value on hold-out data: 0.0011311197886243463
Epoch: 23
Loss on hold-out set: 1.1625458325527558e-06
MeanAbsoluteError value on hold-out data: 0.0007820177124813199
Epoch: 24
Loss on hold-out set: 1.0606322453960665e-06
MeanAbsoluteError value on hold-out data: 0.0009088407387025654
Epoch: 25
Loss on hold-out set: 2.4422621273905472e-06
MeanAbsoluteError value on hold-out data: 0.0013772327220067382
Epoch: 26
Loss on hold-out set: 3.3373504980512995e-06
MeanAbsoluteError value on hold-out data: 0.001536985975690186
Epoch: 27
Loss on hold-out set: 1.2701964026616354e-06
MeanAbsoluteError value on hold-out data: 0.0009709510486572981
Epoch: 28
Loss on hold-out set: 9.050649266230591e-07
MeanAbsoluteError value on hold-out data: 0.0007831003749743104
Epoch: 29
Loss on hold-out set: 2.9843075546003613e-06
MeanAbsoluteError value on hold-out data: 0.0013318720739334822
Epoch: 30
Loss on hold-out set: 2.671090620814149e-06
MeanAbsoluteError value on hold-out data: 0.0013315691612660885
Epoch: 31
Loss on hold-out set: 9.733025032281667e-07
MeanAbsoluteError value on hold-out data: 0.0007705020834691823
Epoch: 32
Loss on hold-out set: 9.22820772432585e-07
MeanAbsoluteError value on hold-out data: 0.0007650772458873689
Epoch: 33
Loss on hold-out set: 8.443558304601798e-07
MeanAbsoluteError value on hold-out data: 0.0007638564566150308
Epoch: 34
Loss on hold-out set: 3.154414863664507e-06
MeanAbsoluteError value on hold-out data: 0.0013636136427521706
Epoch: 35
Loss on hold-out set: 1.2045333619425946e-06
MeanAbsoluteError value on hold-out data: 0.0009638895862735808
Epoch: 36
Loss on hold-out set: 9.070147370948689e-07
MeanAbsoluteError value on hold-out data: 0.0007585303974337876
Epoch: 37
Loss on hold-out set: 1.5080641040705295e-06
MeanAbsoluteError value on hold-out data: 0.000858002167660743
Epoch: 38
Loss on hold-out set: 9.460974946965248e-07
MeanAbsoluteError value on hold-out data: 0.0007678089896216989
Epoch: 39
Loss on hold-out set: 9.892866086959527e-07
MeanAbsoluteError value on hold-out data: 0.0008658251026645303
Epoch: 40
Loss on hold-out set: 2.1062222036302306e-06
MeanAbsoluteError value on hold-out data: 0.001250883680768311
Epoch: 41
Loss on hold-out set: 1.0133336364300964e-06
MeanAbsoluteError value on hold-out data: 0.0008016115170903504
Epoch: 42
Loss on hold-out set: 1.0488264966365283e-06
MeanAbsoluteError value on hold-out data: 0.0007988358265720308
Epoch: 43
Loss on hold-out set: 1.3040682367610707e-06
MeanAbsoluteError value on hold-out data: 0.0009227296686731279
Epoch: 44
Loss on hold-out set: 9.316608904035612e-07
MeanAbsoluteError value on hold-out data: 0.0007793973200023174
Epoch: 45
Loss on hold-out set: 1.1694383853669673e-06
MeanAbsoluteError value on hold-out data: 0.0007649327162653208
Epoch: 46
Loss on hold-out set: 1.0961378507090558e-06
MeanAbsoluteError value on hold-out data: 0.0008284116047434509
Epoch: 47
Loss on hold-out set: 3.8044798397355147e-06
MeanAbsoluteError value on hold-out data: 0.0016973669407889247
Epoch: 48
Loss on hold-out set: 7.868956345191691e-06
MeanAbsoluteError value on hold-out data: 0.002548462711274624
Epoch: 49
Loss on hold-out set: 1.2058121358547526e-06
MeanAbsoluteError value on hold-out data: 0.0008626636699773371
Epoch: 50
Loss on hold-out set: 1.4077887726671179e-06
MeanAbsoluteError value on hold-out data: 0.0009908484062179923
Epoch: 51
Loss on hold-out set: 9.438718799564023e-07
MeanAbsoluteError value on hold-out data: 0.0007480781059712172
Epoch: 52
Loss on hold-out set: 5.682864899167076e-06
MeanAbsoluteError value on hold-out data: 0.0019881536718457937
Epoch: 53
Loss on hold-out set: 3.1321044226777824e-06
MeanAbsoluteError value on hold-out data: 0.0016284900484606624
Epoch: 54
Loss on hold-out set: 1.6159491614026983e-06
MeanAbsoluteError value on hold-out data: 0.0009882120648398995
Epoch: 55
Loss on hold-out set: 3.2085923261807433e-06
MeanAbsoluteError value on hold-out data: 0.0015491453232243657
Epoch: 56
Loss on hold-out set: 3.6630335346541998e-06
MeanAbsoluteError value on hold-out data: 0.0016992188757285476
Epoch: 57
Loss on hold-out set: 4.053937345815939e-06
MeanAbsoluteError value on hold-out data: 0.0018099643057212234
Epoch: 58
Loss on hold-out set: 7.836546696385735e-06
MeanAbsoluteError value on hold-out data: 0.0026097893714904785
Epoch: 59
Loss on hold-out set: 3.4630552363523748e-06
MeanAbsoluteError value on hold-out data: 0.0014276433503255248
Epoch: 60
Loss on hold-out set: 2.032936314273164e-06
MeanAbsoluteError value on hold-out data: 0.0011109807528555393
Epoch: 61
Loss on hold-out set: 9.788469331592102e-07
MeanAbsoluteError value on hold-out data: 0.0007874092552810907
Epoch: 62
Loss on hold-out set: 1.412242506505988e-05
MeanAbsoluteError value on hold-out data: 0.0035810312256217003
Epoch: 63
Loss on hold-out set: 7.237719858364601e-06
MeanAbsoluteError value on hold-out data: 0.0024544866755604744
Epoch: 64
Loss on hold-out set: 1.4070946170769666e-06
MeanAbsoluteError value on hold-out data: 0.000999385491013527
Epoch: 65
Loss on hold-out set: 1.7415737992061103e-05
MeanAbsoluteError value on hold-out data: 0.0039834873750805855
Epoch: 66
Loss on hold-out set: 1.0625517786268444e-06
MeanAbsoluteError value on hold-out data: 0.0008586875628679991
Epoch: 67
Loss on hold-out set: 2.7543860921598806e-06
MeanAbsoluteError value on hold-out data: 0.0014810696011409163
Epoch: 68
Loss on hold-out set: 1.1992632705317061e-06
MeanAbsoluteError value on hold-out data: 0.0008392533054575324
Epoch: 69
Loss on hold-out set: 1.1228136470111037e-06
MeanAbsoluteError value on hold-out data: 0.000791864818893373
Epoch: 70
Loss on hold-out set: 2.5798475624989285e-06
MeanAbsoluteError value on hold-out data: 0.0014109838521108031
Epoch: 71
Loss on hold-out set: 2.5117458660263637e-06
MeanAbsoluteError value on hold-out data: 0.0012674450408667326
Epoch: 72
Loss on hold-out set: 1.2408809685179482e-06
MeanAbsoluteError value on hold-out data: 0.0008820613729767501
Epoch: 73
Loss on hold-out set: 3.680007434273388e-06
MeanAbsoluteError value on hold-out data: 0.0017143706791102886
Epoch: 74
Loss on hold-out set: 1.1941611757850166e-06
MeanAbsoluteError value on hold-out data: 0.0009375917143188417
Epoch: 75
Loss on hold-out set: 4.534476894540214e-06
MeanAbsoluteError value on hold-out data: 0.001943248207680881
Epoch: 76
Loss on hold-out set: 3.1512871763490172e-06
MeanAbsoluteError value on hold-out data: 0.0015054740943014622
Epoch: 77
Loss on hold-out set: 9.270194060003892e-07
MeanAbsoluteError value on hold-out data: 0.0008346199756488204
Epoch: 78
Loss on hold-out set: 1.2359365817766438e-05
MeanAbsoluteError value on hold-out data: 0.003226332599297166
Epoch: 79
Loss on hold-out set: 1.025864719395031e-06
MeanAbsoluteError value on hold-out data: 0.0007986749988049269
Epoch: 80
Loss on hold-out set: 1.6626960392126682e-05
MeanAbsoluteError value on hold-out data: 0.0037684624549001455
Epoch: 81
Loss on hold-out set: 1.0005786797202226e-06
MeanAbsoluteError value on hold-out data: 0.0008301165653392673
Epoch: 82
Loss on hold-out set: 1.1882597488823064e-06
MeanAbsoluteError value on hold-out data: 0.0008886801660992205
Epoch: 83
Loss on hold-out set: 1.9029512178089395e-06
MeanAbsoluteError value on hold-out data: 0.00110527069773525
Epoch: 84
Loss on hold-out set: 1.6366834643122274e-06
MeanAbsoluteError value on hold-out data: 0.0009514117846265435
Epoch: 85
Loss on hold-out set: 2.4669751967719223e-05
MeanAbsoluteError value on hold-out data: 0.004803979769349098
Epoch: 86
Loss on hold-out set: 6.032478625326933e-06
MeanAbsoluteError value on hold-out data: 0.002140446798875928
Epoch: 87
Loss on hold-out set: 4.579891797870264e-06
MeanAbsoluteError value on hold-out data: 0.00193079246673733
Epoch: 88
Loss on hold-out set: 3.945525114496766e-06
MeanAbsoluteError value on hold-out data: 0.0018205293454229832
Epoch: 89
Loss on hold-out set: 1.5598847572359124e-06
MeanAbsoluteError value on hold-out data: 0.0010859083849936724
Epoch: 90
Loss on hold-out set: 9.741117505005344e-07
MeanAbsoluteError value on hold-out data: 0.0007602979312650859
Epoch: 91
Loss on hold-out set: 4.39848115872467e-06
MeanAbsoluteError value on hold-out data: 0.0017587895272299647
Epoch: 92
Loss on hold-out set: 1.6488202650829668e-06
MeanAbsoluteError value on hold-out data: 0.0011220877058804035
Epoch: 93
Loss on hold-out set: 4.883378941095933e-06
MeanAbsoluteError value on hold-out data: 0.00195422419346869
Epoch: 94
Loss on hold-out set: 7.083746498080602e-06
MeanAbsoluteError value on hold-out data: 0.002442633267492056
Epoch: 95
Loss on hold-out set: 4.8595871768546724e-06
MeanAbsoluteError value on hold-out data: 0.0018248772248625755
Epoch: 96
Loss on hold-out set: 1.1460583794230064e-05
MeanAbsoluteError value on hold-out data: 0.003218800527974963
Epoch: 97
Loss on hold-out set: 1.167493490835828e-06
MeanAbsoluteError value on hold-out data: 0.0008905059075914323
Early stopping at epoch 96
Fold: 7
Epoch: 1
Loss on hold-out set: 0.01885193107383592
MeanAbsoluteError value on hold-out data: 0.11213977634906769
Epoch: 2
Loss on hold-out set: 0.008943759902779545
MeanAbsoluteError value on hold-out data: 0.07871796935796738
Epoch: 3
Loss on hold-out set: 0.007124792584883315
MeanAbsoluteError value on hold-out data: 0.06811222434043884
Epoch: 4
Loss on hold-out set: 0.0010036891492615854
MeanAbsoluteError value on hold-out data: 0.02604692615568638
Epoch: 5
Loss on hold-out set: 0.0001990256298865591
MeanAbsoluteError value on hold-out data: 0.011093879118561745
Epoch: 6
Loss on hold-out set: 2.961334056245895e-05
MeanAbsoluteError value on hold-out data: 0.004212158266454935
Epoch: 7
Loss on hold-out set: 2.441038272341497e-06
MeanAbsoluteError value on hold-out data: 0.0010699585545808077
Epoch: 8
Loss on hold-out set: 1.0452239840625616e-06
MeanAbsoluteError value on hold-out data: 0.0007961287628859282
Epoch: 9
Loss on hold-out set: 1.0998340331168168e-06
MeanAbsoluteError value on hold-out data: 0.0009075123234651983
Epoch: 10
Loss on hold-out set: 1.1280917371030746e-06
MeanAbsoluteError value on hold-out data: 0.0009070995729416609
Epoch: 11
Loss on hold-out set: 1.0272895321707307e-06
MeanAbsoluteError value on hold-out data: 0.000826168863568455
Epoch: 12
Loss on hold-out set: 8.169985343491655e-07
MeanAbsoluteError value on hold-out data: 0.0007420720066875219
Epoch: 13
Loss on hold-out set: 1.2739163090762823e-06
MeanAbsoluteError value on hold-out data: 0.0009156077867373824
Epoch: 14
Loss on hold-out set: 8.056192939420725e-07
MeanAbsoluteError value on hold-out data: 0.0007252268260344863
Epoch: 15
Loss on hold-out set: 9.55033304502909e-07
MeanAbsoluteError value on hold-out data: 0.0008204740006476641
Epoch: 16
Loss on hold-out set: 9.348254122544728e-07
MeanAbsoluteError value on hold-out data: 0.0007789100054651499
Epoch: 17
Loss on hold-out set: 1.029751453123546e-06
MeanAbsoluteError value on hold-out data: 0.0007875817827880383
Epoch: 18
Loss on hold-out set: 8.507417663037944e-07
MeanAbsoluteError value on hold-out data: 0.0007602515979669988
Epoch: 19
Loss on hold-out set: 7.828021101171803e-07
MeanAbsoluteError value on hold-out data: 0.0007380281458608806
Epoch: 20
Loss on hold-out set: 9.152174941716242e-07
MeanAbsoluteError value on hold-out data: 0.0007151338504627347
Epoch: 21
Loss on hold-out set: 1.2673019195322662e-06
MeanAbsoluteError value on hold-out data: 0.0008745227823965251
Epoch: 22
Loss on hold-out set: 7.310757114607571e-07
MeanAbsoluteError value on hold-out data: 0.0007077720947563648
Epoch: 23
Loss on hold-out set: 1.1069524735570927e-06
MeanAbsoluteError value on hold-out data: 0.0009093914413824677
Epoch: 24
Loss on hold-out set: 8.46478814407549e-07
MeanAbsoluteError value on hold-out data: 0.000701115292031318
Epoch: 25
Loss on hold-out set: 8.125927674232766e-07
MeanAbsoluteError value on hold-out data: 0.0007036688039079309
Epoch: 26
Loss on hold-out set: 9.07265554620348e-07
MeanAbsoluteError value on hold-out data: 0.000696675619110465
Epoch: 27
Loss on hold-out set: 7.929125526321254e-07
MeanAbsoluteError value on hold-out data: 0.0006979097379371524
Epoch: 28
Loss on hold-out set: 1.4641742771865601e-06
MeanAbsoluteError value on hold-out data: 0.001016189344227314
Epoch: 29
Loss on hold-out set: 1.2713825218010503e-06
MeanAbsoluteError value on hold-out data: 0.0009517212165519595
Epoch: 30
Loss on hold-out set: 1.6271610872666185e-06
MeanAbsoluteError value on hold-out data: 0.0010364328045397997
Epoch: 31
Loss on hold-out set: 8.237210075939012e-07
MeanAbsoluteError value on hold-out data: 0.0007408691453747451
Epoch: 32
Loss on hold-out set: 9.534186387684583e-07
MeanAbsoluteError value on hold-out data: 0.0007258315454237163
Epoch: 33
Loss on hold-out set: 9.022279121901582e-07
MeanAbsoluteError value on hold-out data: 0.0007553790346719325
Epoch: 34
Loss on hold-out set: 2.0768977070214793e-06
MeanAbsoluteError value on hold-out data: 0.001168603077530861
Epoch: 35
Loss on hold-out set: 1.2219407007510848e-06
MeanAbsoluteError value on hold-out data: 0.0009062689496204257
Epoch: 36
Loss on hold-out set: 8.748951704059696e-07
MeanAbsoluteError value on hold-out data: 0.0007761003798805177
Epoch: 37
Loss on hold-out set: 2.6204320582629796e-06
MeanAbsoluteError value on hold-out data: 0.001290445332415402
Epoch: 38
Loss on hold-out set: 8.265683918905e-07
MeanAbsoluteError value on hold-out data: 0.0007275365060195327
Epoch: 39
Loss on hold-out set: 3.1336678603111068e-06
MeanAbsoluteError value on hold-out data: 0.0014695103745907545
Epoch: 40
Loss on hold-out set: 2.00831349112767e-06
MeanAbsoluteError value on hold-out data: 0.0012134218122810125
Epoch: 41
Loss on hold-out set: 1.2257613661859068e-06
MeanAbsoluteError value on hold-out data: 0.0008811243460513651
Epoch: 42
Loss on hold-out set: 2.175357540831361e-06
MeanAbsoluteError value on hold-out data: 0.0013260660925880075
Epoch: 43
Loss on hold-out set: 5.54908495230068e-06
MeanAbsoluteError value on hold-out data: 0.002211512764915824
Epoch: 44
Loss on hold-out set: 8.227429800302031e-07
MeanAbsoluteError value on hold-out data: 0.0007253240328282118
Epoch: 45
Loss on hold-out set: 1.1974214463147552e-06
MeanAbsoluteError value on hold-out data: 0.0007991928141564131
Epoch: 46
Loss on hold-out set: 1.0130222075791347e-06
MeanAbsoluteError value on hold-out data: 0.0008097030804492533
Epoch: 47
Loss on hold-out set: 1.495380347803023e-06
MeanAbsoluteError value on hold-out data: 0.001055752974934876
Epoch: 48
Loss on hold-out set: 9.269879618451731e-06
MeanAbsoluteError value on hold-out data: 0.0029675818514078856
Epoch: 49
Loss on hold-out set: 1.2913445581424249e-06
MeanAbsoluteError value on hold-out data: 0.0009113054256886244
Epoch: 50
Loss on hold-out set: 1.9475757946046154e-06
MeanAbsoluteError value on hold-out data: 0.001102434005588293
Epoch: 51
Loss on hold-out set: 2.9507749396933443e-06
MeanAbsoluteError value on hold-out data: 0.001509997877292335
Epoch: 52
Loss on hold-out set: 1.6880371244302036e-06
MeanAbsoluteError value on hold-out data: 0.001030409592203796
Epoch: 53
Loss on hold-out set: 5.982727153812968e-06
MeanAbsoluteError value on hold-out data: 0.0022532548755407333
Epoch: 54
Loss on hold-out set: 2.241727104644399e-06
MeanAbsoluteError value on hold-out data: 0.0012628653785213828
Epoch: 55
Loss on hold-out set: 7.512328303554179e-07
MeanAbsoluteError value on hold-out data: 0.0006914609111845493
Epoch: 56
Loss on hold-out set: 8.149368276073281e-07
MeanAbsoluteError value on hold-out data: 0.0007269215420819819
Epoch: 57
Loss on hold-out set: 3.6006159202120865e-06
MeanAbsoluteError value on hold-out data: 0.0017493239138275385
Epoch: 58
Loss on hold-out set: 1.2777284479982752e-06
MeanAbsoluteError value on hold-out data: 0.0009584499639458954
Epoch: 59
Loss on hold-out set: 6.280101972931464e-06
MeanAbsoluteError value on hold-out data: 0.002315880497917533
Epoch: 60
Loss on hold-out set: 3.438679024319364e-06
MeanAbsoluteError value on hold-out data: 0.001661753049120307
Epoch: 61
Loss on hold-out set: 1.5282738396698342e-05
MeanAbsoluteError value on hold-out data: 0.003798901103436947
Epoch: 62
Loss on hold-out set: 4.042319330567677e-06
MeanAbsoluteError value on hold-out data: 0.0018047221237793565
Epoch: 63
Loss on hold-out set: 7.6106814828693e-06
MeanAbsoluteError value on hold-out data: 0.0026646715123206377
Epoch: 64
Loss on hold-out set: 9.64561187239659e-07
MeanAbsoluteError value on hold-out data: 0.0007540870574302971
Epoch: 65
Loss on hold-out set: 2.1410404055391804e-06
MeanAbsoluteError value on hold-out data: 0.0011456061620265245
Epoch: 66
Loss on hold-out set: 5.31795616812555e-06
MeanAbsoluteError value on hold-out data: 0.0021203700453042984
Epoch: 67
Loss on hold-out set: 1.3619594970545483e-06
MeanAbsoluteError value on hold-out data: 0.000976848998107016
Epoch: 68
Loss on hold-out set: 9.778670541241548e-07
MeanAbsoluteError value on hold-out data: 0.0008391732699237764
Epoch: 69
Loss on hold-out set: 8.419513782038328e-07
MeanAbsoluteError value on hold-out data: 0.0007460684282705188
Epoch: 70
Loss on hold-out set: 3.066931835097161e-06
MeanAbsoluteError value on hold-out data: 0.0014721517218276858
Epoch: 71
Loss on hold-out set: 3.232272384983454e-06
MeanAbsoluteError value on hold-out data: 0.0016392454272136092
Epoch: 72
Loss on hold-out set: 1.1791413580145412e-06
MeanAbsoluteError value on hold-out data: 0.0008739791228435934
Epoch: 73
Loss on hold-out set: 1.172425413642486e-06
MeanAbsoluteError value on hold-out data: 0.0008218495640903711
Epoch: 74
Loss on hold-out set: 1.2161496312858487e-06
MeanAbsoluteError value on hold-out data: 0.0008836167398840189
Epoch: 75
Loss on hold-out set: 1.0942162832959314e-06
MeanAbsoluteError value on hold-out data: 0.0008222386240959167
Epoch: 76
Loss on hold-out set: 1.4666631906428457e-06
MeanAbsoluteError value on hold-out data: 0.0009759917156770825
Epoch: 77
Loss on hold-out set: 1.0091003007671264e-05
MeanAbsoluteError value on hold-out data: 0.003010023618116975
Epoch: 78
Loss on hold-out set: 2.0090199541300535e-05
MeanAbsoluteError value on hold-out data: 0.004362659528851509
Epoch: 79
Loss on hold-out set: 1.6156031051650643e-05
MeanAbsoluteError value on hold-out data: 0.0038428879342973232
Epoch: 80
Loss on hold-out set: 6.496087150610817e-06
MeanAbsoluteError value on hold-out data: 0.0023328857496380806
Epoch: 81
Loss on hold-out set: 1.2614520496104627e-06
MeanAbsoluteError value on hold-out data: 0.0008810406434349716
Epoch: 82
Loss on hold-out set: 1.4859486847334274e-06
MeanAbsoluteError value on hold-out data: 0.0009751251200214028
Epoch: 83
Loss on hold-out set: 3.515399761714174e-05
MeanAbsoluteError value on hold-out data: 0.005875365808606148
Epoch: 84
Loss on hold-out set: 1.1140485055096048e-05
MeanAbsoluteError value on hold-out data: 0.003138270927593112
Epoch: 85
Loss on hold-out set: 8.297809728219363e-07
MeanAbsoluteError value on hold-out data: 0.000723175355233252
Epoch: 86
Loss on hold-out set: 4.9958997741279224e-06
MeanAbsoluteError value on hold-out data: 0.0020552913192659616
Early stopping at epoch 85
Fold: 8
Epoch: 1
Loss on hold-out set: 0.023107926095170633
MeanAbsoluteError value on hold-out data: 0.12274296581745148
Epoch: 2
Loss on hold-out set: 0.011191984106387411
MeanAbsoluteError value on hold-out data: 0.09001699090003967
Epoch: 3
Loss on hold-out set: 0.00291095777148647
MeanAbsoluteError value on hold-out data: 0.04175300523638725
Epoch: 4
Loss on hold-out set: 0.00042870075308850834
MeanAbsoluteError value on hold-out data: 0.0152667798101902
Epoch: 5
Loss on hold-out set: 2.8042730004277212e-05
MeanAbsoluteError value on hold-out data: 0.00461235735565424
Epoch: 6
Loss on hold-out set: 4.972484508211242e-06
MeanAbsoluteError value on hold-out data: 0.001917704357765615
Epoch: 7
Loss on hold-out set: 1.9406130767103084e-06
MeanAbsoluteError value on hold-out data: 0.001169669791124761
Epoch: 8
Loss on hold-out set: 4.625127855563603e-06
MeanAbsoluteError value on hold-out data: 0.0019240258261561394
Epoch: 9
Loss on hold-out set: 1.3031995942063595e-06
MeanAbsoluteError value on hold-out data: 0.0009174034930765629
Epoch: 10
Loss on hold-out set: 1.5686560378266482e-06
MeanAbsoluteError value on hold-out data: 0.0009422464063391089
Epoch: 11
Loss on hold-out set: 9.532512795625994e-07
MeanAbsoluteError value on hold-out data: 0.00072656967677176
Epoch: 12
Loss on hold-out set: 1.3997930312013653e-06
MeanAbsoluteError value on hold-out data: 0.0009728696895763278
Epoch: 13
Loss on hold-out set: 1.1797662864410086e-06
MeanAbsoluteError value on hold-out data: 0.0008705090149305761
Epoch: 14
Loss on hold-out set: 1.2704702336512646e-06
MeanAbsoluteError value on hold-out data: 0.0009411071077920496
Epoch: 15
Loss on hold-out set: 8.666587843565919e-07
MeanAbsoluteError value on hold-out data: 0.0007731048972345889
Epoch: 16
Loss on hold-out set: 8.355594900422147e-07
MeanAbsoluteError value on hold-out data: 0.0007569639128632843
Epoch: 17
Loss on hold-out set: 8.700899099624491e-07
MeanAbsoluteError value on hold-out data: 0.0007905017118901014
Epoch: 18
Loss on hold-out set: 2.0609919114836624e-06
MeanAbsoluteError value on hold-out data: 0.001247352221980691
Epoch: 19
Loss on hold-out set: 3.7866762210926808e-06
MeanAbsoluteError value on hold-out data: 0.001735348254442215
Epoch: 20
Loss on hold-out set: 1.3922111910298035e-06
MeanAbsoluteError value on hold-out data: 0.0010116402991116047
Epoch: 21
Loss on hold-out set: 2.618441612867173e-06
MeanAbsoluteError value on hold-out data: 0.0014116254169493914
Epoch: 22
Loss on hold-out set: 2.105525108423275e-06
MeanAbsoluteError value on hold-out data: 0.0012487188214436173
Epoch: 23
Loss on hold-out set: 8.763678189487629e-07
MeanAbsoluteError value on hold-out data: 0.0007779747829772532
Epoch: 24
Loss on hold-out set: 1.1384704034104028e-06
MeanAbsoluteError value on hold-out data: 0.0008993493975140154
Epoch: 25
Loss on hold-out set: 4.81470488011837e-06
MeanAbsoluteError value on hold-out data: 0.0019522837828844786
Epoch: 26
Loss on hold-out set: 1.089687771127501e-06
MeanAbsoluteError value on hold-out data: 0.0008626591297797859
Epoch: 27
Loss on hold-out set: 7.786865483337482e-06
MeanAbsoluteError value on hold-out data: 0.002665275242179632
Epoch: 28
Loss on hold-out set: 1.0767732062179545e-06
MeanAbsoluteError value on hold-out data: 0.0008065919391810894
Epoch: 29
Loss on hold-out set: 2.5886631565949107e-06
MeanAbsoluteError value on hold-out data: 0.00143749441485852
Epoch: 30
Loss on hold-out set: 6.037142416711763e-06
MeanAbsoluteError value on hold-out data: 0.0023112103808671236
Epoch: 31
Loss on hold-out set: 9.337270837152443e-07
MeanAbsoluteError value on hold-out data: 0.0007932931766845286
Epoch: 32
Loss on hold-out set: 1.2882614685492757e-06
MeanAbsoluteError value on hold-out data: 0.0009138233726844192
Epoch: 33
Loss on hold-out set: 1.03495282896152e-06
MeanAbsoluteError value on hold-out data: 0.0008411088492721319
Epoch: 34
Loss on hold-out set: 4.048052103046627e-06
MeanAbsoluteError value on hold-out data: 0.0017394236056134105
Epoch: 35
Loss on hold-out set: 4.751681931988319e-06
MeanAbsoluteError value on hold-out data: 0.0019325150642544031
Epoch: 36
Loss on hold-out set: 1.4090810347105226e-06
MeanAbsoluteError value on hold-out data: 0.0009427398908883333
Epoch: 37
Loss on hold-out set: 8.412065294497292e-07
MeanAbsoluteError value on hold-out data: 0.0007823582272976637
Epoch: 38
Loss on hold-out set: 1.5172516084151409e-06
MeanAbsoluteError value on hold-out data: 0.0010103577515110373
Epoch: 39
Loss on hold-out set: 9.106444005218301e-07
MeanAbsoluteError value on hold-out data: 0.0007558903307653964
Epoch: 40
Loss on hold-out set: 7.408229911171864e-06
MeanAbsoluteError value on hold-out data: 0.0025869407691061497
Epoch: 41
Loss on hold-out set: 3.2617562380567378e-06
MeanAbsoluteError value on hold-out data: 0.0015158168971538544
Epoch: 42
Loss on hold-out set: 1.865604441978316e-06
MeanAbsoluteError value on hold-out data: 0.001186681562103331
Epoch: 43
Loss on hold-out set: 9.133911232441148e-07
MeanAbsoluteError value on hold-out data: 0.0007781736785545945
Epoch: 44
Loss on hold-out set: 1.6587924684634864e-06
MeanAbsoluteError value on hold-out data: 0.0010686269961297512
Epoch: 45
Loss on hold-out set: 7.937388805398119e-06
MeanAbsoluteError value on hold-out data: 0.0026483312249183655
Epoch: 46
Loss on hold-out set: 1.0009496479921966e-06
MeanAbsoluteError value on hold-out data: 0.0007593549671582878
Epoch: 47
Loss on hold-out set: 1.753152803628057e-06
MeanAbsoluteError value on hold-out data: 0.001094569219276309
Epoch: 48
Loss on hold-out set: 1.3217816428680505e-06
MeanAbsoluteError value on hold-out data: 0.000937853823415935
Epoch: 49
Loss on hold-out set: 1.4232810566941875e-05
MeanAbsoluteError value on hold-out data: 0.003629336366429925
Epoch: 50
Loss on hold-out set: 1.2814095628397939e-06
MeanAbsoluteError value on hold-out data: 0.000901932769920677
Epoch: 51
Loss on hold-out set: 8.73830958880717e-06
MeanAbsoluteError value on hold-out data: 0.0027792146429419518
Epoch: 52
Loss on hold-out set: 2.441691789759456e-05
MeanAbsoluteError value on hold-out data: 0.004875967279076576
Epoch: 53
Loss on hold-out set: 1.218098637829306e-06
MeanAbsoluteError value on hold-out data: 0.0009226305992342532
Epoch: 54
Loss on hold-out set: 4.885533469080526e-06
MeanAbsoluteError value on hold-out data: 0.0018625252414494753
Epoch: 55
Loss on hold-out set: 3.020401728852968e-06
MeanAbsoluteError value on hold-out data: 0.0015305908164009452
Epoch: 56
Loss on hold-out set: 9.806361325510288e-07
MeanAbsoluteError value on hold-out data: 0.0008342587971128523
Epoch: 57
Loss on hold-out set: 1.2533992535931508e-06
MeanAbsoluteError value on hold-out data: 0.0008572466904297471
Epoch: 58
Loss on hold-out set: 1.835919476889103e-06
MeanAbsoluteError value on hold-out data: 0.001120436587370932
Epoch: 59
Loss on hold-out set: 6.962038813591269e-05
MeanAbsoluteError value on hold-out data: 0.008240020833909512
Epoch: 60
Loss on hold-out set: 4.959852276442689e-06
MeanAbsoluteError value on hold-out data: 0.0018087923526763916
Epoch: 61
Loss on hold-out set: 2.8399336120596024e-05
MeanAbsoluteError value on hold-out data: 0.005236742552369833
Epoch: 62
Loss on hold-out set: 1.1814874239592297e-06
MeanAbsoluteError value on hold-out data: 0.0009042886085808277
Epoch: 63
Loss on hold-out set: 1.3993109860166442e-05
MeanAbsoluteError value on hold-out data: 0.003605139907449484
Epoch: 64
Loss on hold-out set: 2.056096283402959e-05
MeanAbsoluteError value on hold-out data: 0.004449297674000263
Epoch: 65
Loss on hold-out set: 7.767553597659571e-06
MeanAbsoluteError value on hold-out data: 0.00258779083378613
Epoch: 66
Loss on hold-out set: 1.0876564147110912e-06
MeanAbsoluteError value on hold-out data: 0.0008219006704166532
Epoch: 67
Loss on hold-out set: 1.02554136641889e-05
MeanAbsoluteError value on hold-out data: 0.0030199200846254826
Epoch: 68
Loss on hold-out set: 7.063506018312182e-06
MeanAbsoluteError value on hold-out data: 0.002366641303524375
Epoch: 69
Loss on hold-out set: 1.882209393703046e-05
MeanAbsoluteError value on hold-out data: 0.0042358036153018475
Epoch: 70
Loss on hold-out set: 6.818613201176049e-06
MeanAbsoluteError value on hold-out data: 0.0023131973575800657
Epoch: 71
Loss on hold-out set: 1.5913837549825466e-05
MeanAbsoluteError value on hold-out data: 0.0036436710506677628
Epoch: 72
Loss on hold-out set: 1.2173317242871104e-05
MeanAbsoluteError value on hold-out data: 0.00336332805454731
Epoch: 73
Loss on hold-out set: 2.4264676020331016e-05
MeanAbsoluteError value on hold-out data: 0.004635566845536232
Epoch: 74
Loss on hold-out set: 7.254277988977265e-06
MeanAbsoluteError value on hold-out data: 0.0024734986945986748
Epoch: 75
Loss on hold-out set: 1.6251809508308464e-06
MeanAbsoluteError value on hold-out data: 0.0010794863337650895
Epoch: 76
Loss on hold-out set: 1.087430765827386e-05
MeanAbsoluteError value on hold-out data: 0.0031013768166303635
Epoch: 77
Loss on hold-out set: 2.021256737602276e-06
MeanAbsoluteError value on hold-out data: 0.001210166490636766
Epoch: 78
Loss on hold-out set: 1.807319300236746e-05
MeanAbsoluteError value on hold-out data: 0.004055761732161045
Epoch: 79
Loss on hold-out set: 1.985810610806636e-05
MeanAbsoluteError value on hold-out data: 0.004385685548186302
Epoch: 80
Loss on hold-out set: 1.886916493276658e-06
MeanAbsoluteError value on hold-out data: 0.0011312335263937712
Early stopping at epoch 79
Fold: 9
Epoch: 1
Loss on hold-out set: 0.020928870753518174
MeanAbsoluteError value on hold-out data: 0.12102428078651428
Epoch: 2
Loss on hold-out set: 0.006200987413259489
MeanAbsoluteError value on hold-out data: 0.06226036697626114
Epoch: 3
Loss on hold-out set: 0.002365007996559143
MeanAbsoluteError value on hold-out data: 0.04034321755170822
Epoch: 4
Loss on hold-out set: 0.0006773984475460436
MeanAbsoluteError value on hold-out data: 0.02026807703077793
Epoch: 5
Loss on hold-out set: 0.00028373907636185843
MeanAbsoluteError value on hold-out data: 0.014542796649038792
Epoch: 6
Loss on hold-out set: 1.1733886692257198e-05
MeanAbsoluteError value on hold-out data: 0.0020839814096689224
Epoch: 7
Loss on hold-out set: 6.403378392860759e-06
MeanAbsoluteError value on hold-out data: 0.001607015379704535
Epoch: 8
Loss on hold-out set: 2.2002173441900856e-06
MeanAbsoluteError value on hold-out data: 0.0008629264775663614
Epoch: 9
Loss on hold-out set: 1.880462791957273e-06
MeanAbsoluteError value on hold-out data: 0.0008500033873133361
Epoch: 10
Loss on hold-out set: 2.147782333444021e-06
MeanAbsoluteError value on hold-out data: 0.0012398294638842344
Epoch: 11
Loss on hold-out set: 1.759937260560816e-06
MeanAbsoluteError value on hold-out data: 0.0007861688500270247
Epoch: 12
Loss on hold-out set: 1.733704315094136e-06
MeanAbsoluteError value on hold-out data: 0.001096587860956788
Epoch: 13
Loss on hold-out set: 8.537193788730033e-07
MeanAbsoluteError value on hold-out data: 0.0007299248827621341
Epoch: 14
Loss on hold-out set: 1.061961264830253e-06
MeanAbsoluteError value on hold-out data: 0.0007933509186841547
Epoch: 15
Loss on hold-out set: 1.7180672589997163e-06
MeanAbsoluteError value on hold-out data: 0.0009929793886840343
Epoch: 16
Loss on hold-out set: 1.929171194855631e-06
MeanAbsoluteError value on hold-out data: 0.0011544445296749473
Epoch: 17
Loss on hold-out set: 1.2380164743522722e-06
MeanAbsoluteError value on hold-out data: 0.0008243463234975934
Epoch: 18
Loss on hold-out set: 2.0494787642227104e-06
MeanAbsoluteError value on hold-out data: 0.0011506457813084126
Epoch: 19
Loss on hold-out set: 1.6671606967325455e-06
MeanAbsoluteError value on hold-out data: 0.0010200862307101488
Epoch: 20
Loss on hold-out set: 1.7553956825265362e-06
MeanAbsoluteError value on hold-out data: 0.0011503043351694942
Epoch: 21
Loss on hold-out set: 2.969360269032352e-06
MeanAbsoluteError value on hold-out data: 0.0014665939379483461
Epoch: 22
Loss on hold-out set: 1.3318010831296436e-06
MeanAbsoluteError value on hold-out data: 0.0009037761483341455
Epoch: 23
Loss on hold-out set: 9.740042920774222e-07
MeanAbsoluteError value on hold-out data: 0.0007602574187330902
Epoch: 24
Loss on hold-out set: 9.816648360226412e-07
MeanAbsoluteError value on hold-out data: 0.0007632611086592078
Epoch: 25
Loss on hold-out set: 1.0228085106486366e-06
MeanAbsoluteError value on hold-out data: 0.0008010773453861475
Epoch: 26
Loss on hold-out set: 8.954759859339642e-07
MeanAbsoluteError value on hold-out data: 0.0007340255542658269
Epoch: 27
Loss on hold-out set: 4.240032597278644e-06
MeanAbsoluteError value on hold-out data: 0.0018317601643502712
Epoch: 28
Loss on hold-out set: 3.1815835492514973e-06
MeanAbsoluteError value on hold-out data: 0.0015919973375275731
Epoch: 29
Loss on hold-out set: 2.1447078454782187e-06
MeanAbsoluteError value on hold-out data: 0.001258361735381186
Epoch: 30
Loss on hold-out set: 8.914945180801428e-07
MeanAbsoluteError value on hold-out data: 0.0007226938032545149
Epoch: 31
Loss on hold-out set: 1.0315136315901846e-06
MeanAbsoluteError value on hold-out data: 0.0007526919944211841
Epoch: 32
Loss on hold-out set: 1.120915718339737e-06
MeanAbsoluteError value on hold-out data: 0.0008372914744541049
Epoch: 33
Loss on hold-out set: 1.0391392168328042e-06
MeanAbsoluteError value on hold-out data: 0.0007676735986024141
Epoch: 34
Loss on hold-out set: 1.3692065660312177e-06
MeanAbsoluteError value on hold-out data: 0.0009241424268111587
Epoch: 35
Loss on hold-out set: 1.4215208515062322e-06
MeanAbsoluteError value on hold-out data: 0.0009951710235327482
Epoch: 36
Loss on hold-out set: 3.5706408587949615e-06
MeanAbsoluteError value on hold-out data: 0.0015709850704297423
Epoch: 37
Loss on hold-out set: 2.359319312615428e-06
MeanAbsoluteError value on hold-out data: 0.0013142116367816925
Epoch: 38
Loss on hold-out set: 1.1008066361942577e-06
MeanAbsoluteError value on hold-out data: 0.0007972288294695318
Epoch: 39
Loss on hold-out set: 4.353288042174037e-06
MeanAbsoluteError value on hold-out data: 0.0019046160159632564
Epoch: 40
Loss on hold-out set: 2.4639058843994074e-06
MeanAbsoluteError value on hold-out data: 0.0013653486967086792
Epoch: 41
Loss on hold-out set: 1.805001456237473e-06
MeanAbsoluteError value on hold-out data: 0.001033179578371346
Epoch: 42
Loss on hold-out set: 1.7682561325013272e-06
MeanAbsoluteError value on hold-out data: 0.0009972797706723213
Epoch: 43
Loss on hold-out set: 9.18497016755282e-06
MeanAbsoluteError value on hold-out data: 0.0028245069552212954
Epoch: 44
Loss on hold-out set: 9.370258940829704e-07
MeanAbsoluteError value on hold-out data: 0.000746101897675544
Epoch: 45
Loss on hold-out set: 1.3354880690842817e-06
MeanAbsoluteError value on hold-out data: 0.0008466223371215165
Epoch: 46
Loss on hold-out set: 2.4085818690114786e-05
MeanAbsoluteError value on hold-out data: 0.004832547158002853
Epoch: 47
Loss on hold-out set: 1.6509816305187996e-06
MeanAbsoluteError value on hold-out data: 0.000806289492174983
Epoch: 48
Loss on hold-out set: 1.1640457314245265e-06
MeanAbsoluteError value on hold-out data: 0.0008098337566480041
Epoch: 49
Loss on hold-out set: 2.4709437736549134e-06
MeanAbsoluteError value on hold-out data: 0.0013436840381473303
Epoch: 50
Loss on hold-out set: 1.062149229775449e-06
MeanAbsoluteError value on hold-out data: 0.000799568893853575
Epoch: 51
Loss on hold-out set: 2.3432514483699507e-06
MeanAbsoluteError value on hold-out data: 0.0012549778912216425
Epoch: 52
Loss on hold-out set: 3.663220728152997e-06
MeanAbsoluteError value on hold-out data: 0.001765096210874617
Epoch: 53
Loss on hold-out set: 4.233498300111803e-06
MeanAbsoluteError value on hold-out data: 0.0017787773394957185
Epoch: 54
Loss on hold-out set: 1.0314441608118483e-06
MeanAbsoluteError value on hold-out data: 0.0007595110218971968
Epoch: 55
Loss on hold-out set: 2.0901183778018354e-06
MeanAbsoluteError value on hold-out data: 0.0012669314164668322
Epoch: 56
Loss on hold-out set: 2.0783854779438116e-06
MeanAbsoluteError value on hold-out data: 0.0011088087921962142
Epoch: 57
Loss on hold-out set: 1.3095079225422523e-06
MeanAbsoluteError value on hold-out data: 0.0008731905254535377
Epoch: 58
Loss on hold-out set: 1.2325994264626518e-06
MeanAbsoluteError value on hold-out data: 0.00085738196503371
Epoch: 59
Loss on hold-out set: 1.3130442612561768e-06
MeanAbsoluteError value on hold-out data: 0.0009162527276203036
Epoch: 60
Loss on hold-out set: 3.62837542655013e-05
MeanAbsoluteError value on hold-out data: 0.005949793383479118
Epoch: 61
Loss on hold-out set: 5.497999609360704e-06
MeanAbsoluteError value on hold-out data: 0.002088971668854356
Epoch: 62
Loss on hold-out set: 4.420398714241206e-06
MeanAbsoluteError value on hold-out data: 0.0019127940759062767
Epoch: 63
Loss on hold-out set: 5.578064831622344e-06
MeanAbsoluteError value on hold-out data: 0.0022871335968375206
Epoch: 64
Loss on hold-out set: 1.381301144322476e-06
MeanAbsoluteError value on hold-out data: 0.0008840186637826264
Epoch: 65
Loss on hold-out set: 1.4615049102368565e-05
MeanAbsoluteError value on hold-out data: 0.0035628890618681908
Epoch: 66
Loss on hold-out set: 7.488906378837003e-06
MeanAbsoluteError value on hold-out data: 0.0025001447647809982
Epoch: 67
Loss on hold-out set: 3.688299378674336e-06
MeanAbsoluteError value on hold-out data: 0.0016423797933384776
Epoch: 68
Loss on hold-out set: 8.860954559557805e-06
MeanAbsoluteError value on hold-out data: 0.002827135846018791
Epoch: 69
Loss on hold-out set: 3.1734834919916466e-06
MeanAbsoluteError value on hold-out data: 0.001312565989792347
Epoch: 70
Loss on hold-out set: 1.3694695439880888e-06
MeanAbsoluteError value on hold-out data: 0.0009405120508745313
Epoch: 71
Loss on hold-out set: 1.2186296649880596e-06
MeanAbsoluteError value on hold-out data: 0.000869159703142941
Epoch: 72
Loss on hold-out set: 2.451798380726749e-05
MeanAbsoluteError value on hold-out data: 0.004751446191221476
Epoch: 73
Loss on hold-out set: 2.5260689134094198e-06
MeanAbsoluteError value on hold-out data: 0.001343744806945324
Epoch: 74
Loss on hold-out set: 6.147740545462252e-06
MeanAbsoluteError value on hold-out data: 0.0020727033261209726
Epoch: 75
Loss on hold-out set: 1.9021099920532184e-06
MeanAbsoluteError value on hold-out data: 0.0010829897364601493
Epoch: 76
Loss on hold-out set: 1.024990114371706e-06
MeanAbsoluteError value on hold-out data: 0.0007505965186282992
Epoch: 77
Loss on hold-out set: 4.537890942758947e-06
MeanAbsoluteError value on hold-out data: 0.00187768938485533
Early stopping at epoch 76
Fold: 10
Epoch: 1
Loss on hold-out set: 0.027120580231504782
MeanAbsoluteError value on hold-out data: 0.13557204604148865
Epoch: 2
Loss on hold-out set: 0.012869915459305048
MeanAbsoluteError value on hold-out data: 0.09391576796770096
Epoch: 3
Loss on hold-out set: 0.005579129260565553
MeanAbsoluteError value on hold-out data: 0.05855463445186615
Epoch: 4
Loss on hold-out set: 0.001060161556649421
MeanAbsoluteError value on hold-out data: 0.024943353608250618
Epoch: 5
Loss on hold-out set: 0.0004304999830700191
MeanAbsoluteError value on hold-out data: 0.014722227118909359
Epoch: 6
Loss on hold-out set: 2.258102800364473e-05
MeanAbsoluteError value on hold-out data: 0.003906760364770889
Epoch: 7
Loss on hold-out set: 3.551175983115432e-06
MeanAbsoluteError value on hold-out data: 0.0015189762925729156
Epoch: 8
Loss on hold-out set: 1.4258882856665878e-06
MeanAbsoluteError value on hold-out data: 0.0009986705845221877
Epoch: 9
Loss on hold-out set: 1.383276688622053e-06
MeanAbsoluteError value on hold-out data: 0.0009487295756116509
Epoch: 10
Loss on hold-out set: 6.575323823199142e-07
MeanAbsoluteError value on hold-out data: 0.0006436624098569155
Epoch: 11
Loss on hold-out set: 9.20869329742605e-07
MeanAbsoluteError value on hold-out data: 0.0007181207183748484
Epoch: 12
Loss on hold-out set: 7.910838673654195e-07
MeanAbsoluteError value on hold-out data: 0.000671377987600863
Epoch: 13
Loss on hold-out set: 9.478106335336633e-07
MeanAbsoluteError value on hold-out data: 0.0007287568878382444
Epoch: 14
Loss on hold-out set: 7.729835747990624e-07
MeanAbsoluteError value on hold-out data: 0.0007152336183935404
Epoch: 15
Loss on hold-out set: 2.2909214294486446e-06
MeanAbsoluteError value on hold-out data: 0.0013153955806046724
Epoch: 16
Loss on hold-out set: 6.759155520999879e-07
MeanAbsoluteError value on hold-out data: 0.0006734053022228181
Epoch: 17
Loss on hold-out set: 7.14113558128052e-07
MeanAbsoluteError value on hold-out data: 0.0006502619944512844
Epoch: 18
Loss on hold-out set: 1.323246924097735e-06
MeanAbsoluteError value on hold-out data: 0.0010014621075242758
Epoch: 19
Loss on hold-out set: 7.499382641234271e-07
MeanAbsoluteError value on hold-out data: 0.0007447146344929934
Epoch: 20
Loss on hold-out set: 1.0949936820127602e-06
MeanAbsoluteError value on hold-out data: 0.0008777481853030622
Epoch: 21
Loss on hold-out set: 8.671613532637171e-07
MeanAbsoluteError value on hold-out data: 0.0007595846545882523
Epoch: 22
Loss on hold-out set: 2.8139112860766806e-06
MeanAbsoluteError value on hold-out data: 0.0015165209770202637
Epoch: 23
Loss on hold-out set: 1.287866723487241e-06
MeanAbsoluteError value on hold-out data: 0.0009804643923416734
Epoch: 24
Loss on hold-out set: 1.3726425314481666e-06
MeanAbsoluteError value on hold-out data: 0.001026514102704823
Epoch: 25
Loss on hold-out set: 9.172429713544261e-07
MeanAbsoluteError value on hold-out data: 0.0007660258561372757
Epoch: 26
Loss on hold-out set: 1.081643737117182e-06
MeanAbsoluteError value on hold-out data: 0.0008386948029510677
Epoch: 27
Loss on hold-out set: 2.513047596559253e-06
MeanAbsoluteError value on hold-out data: 0.0013326358748599887
Epoch: 28
Loss on hold-out set: 2.1122416131090304e-06
MeanAbsoluteError value on hold-out data: 0.001244142884388566
Epoch: 29
Loss on hold-out set: 7.816767281708183e-07
MeanAbsoluteError value on hold-out data: 0.0006808409816585481
Epoch: 30
Loss on hold-out set: 3.448269719033955e-06
MeanAbsoluteError value on hold-out data: 0.0017591372597962618
Epoch: 31
Loss on hold-out set: 7.289838533454583e-07
MeanAbsoluteError value on hold-out data: 0.0006519455346278846
Epoch: 32
Loss on hold-out set: 1.042873667042191e-06
MeanAbsoluteError value on hold-out data: 0.0008552079671062529
Epoch: 33
Loss on hold-out set: 6.98488097076019e-07
MeanAbsoluteError value on hold-out data: 0.0006945746135897934
Epoch: 34
Loss on hold-out set: 8.288162202266644e-07
MeanAbsoluteError value on hold-out data: 0.0007183138513937593
Epoch: 35
Loss on hold-out set: 9.103950304734099e-07
MeanAbsoluteError value on hold-out data: 0.0008068501483649015
Epoch: 36
Loss on hold-out set: 6.265388654875486e-07
MeanAbsoluteError value on hold-out data: 0.0006595272570848465
Epoch: 37
Loss on hold-out set: 7.265871317940764e-07
MeanAbsoluteError value on hold-out data: 0.000728868180885911
Epoch: 38
Loss on hold-out set: 9.111237854345486e-07
MeanAbsoluteError value on hold-out data: 0.0007291654474101961
Epoch: 39
Loss on hold-out set: 7.532513320386767e-07
MeanAbsoluteError value on hold-out data: 0.0007168745505623519
Epoch: 40
Loss on hold-out set: 9.269741748799529e-07
MeanAbsoluteError value on hold-out data: 0.0008005042909644544
Epoch: 41
Loss on hold-out set: 3.9189735616673715e-06
MeanAbsoluteError value on hold-out data: 0.00174326216802001
Epoch: 42
Loss on hold-out set: 1.0582808280495165e-06
MeanAbsoluteError value on hold-out data: 0.0007968175923451781
Epoch: 43
Loss on hold-out set: 1.919927691622953e-06
MeanAbsoluteError value on hold-out data: 0.0012046181363984942
Epoch: 44
Loss on hold-out set: 5.057335524075565e-06
MeanAbsoluteError value on hold-out data: 0.0020092970225960016
Epoch: 45
Loss on hold-out set: 7.693531886486329e-07
MeanAbsoluteError value on hold-out data: 0.000697936920914799
Epoch: 46
Loss on hold-out set: 2.5972499315685127e-06
MeanAbsoluteError value on hold-out data: 0.0013735032407566905
Epoch: 47
Loss on hold-out set: 2.8178787943033967e-06
MeanAbsoluteError value on hold-out data: 0.001366795040667057
Epoch: 48
Loss on hold-out set: 7.114168576143649e-07
MeanAbsoluteError value on hold-out data: 0.0006843652809038758
Epoch: 49
Loss on hold-out set: 1.8650919011114247e-06
MeanAbsoluteError value on hold-out data: 0.0011876707430928946
Epoch: 50
Loss on hold-out set: 4.770997130825501e-06
MeanAbsoluteError value on hold-out data: 0.0020346278324723244
Epoch: 51
Loss on hold-out set: 9.306383617513347e-06
MeanAbsoluteError value on hold-out data: 0.002843810711055994
Epoch: 52
Loss on hold-out set: 8.038202590146934e-06
MeanAbsoluteError value on hold-out data: 0.0026984780561178923
Epoch: 53
Loss on hold-out set: 1.099431715699341e-06
MeanAbsoluteError value on hold-out data: 0.0008405616390518844
Epoch: 54
Loss on hold-out set: 1.8045799541661317e-06
MeanAbsoluteError value on hold-out data: 0.0011267290683463216
Epoch: 55
Loss on hold-out set: 7.80366771583171e-07
MeanAbsoluteError value on hold-out data: 0.0007187863229773939
Epoch: 56
Loss on hold-out set: 7.99250902413665e-07
MeanAbsoluteError value on hold-out data: 0.0007378927548415959
Epoch: 57
Loss on hold-out set: 9.125365587741336e-06
MeanAbsoluteError value on hold-out data: 0.002944857580587268
Epoch: 58
Loss on hold-out set: 3.4772125608079866e-06
MeanAbsoluteError value on hold-out data: 0.0015723268734291196
Epoch: 59
Loss on hold-out set: 3.6389870794144893e-06
MeanAbsoluteError value on hold-out data: 0.0017016640631482005
Epoch: 60
Loss on hold-out set: 5.9669274118537686e-06
MeanAbsoluteError value on hold-out data: 0.0021797490771859884
Epoch: 61
Loss on hold-out set: 9.414684996045253e-07
MeanAbsoluteError value on hold-out data: 0.00080476189032197
Epoch: 62
Loss on hold-out set: 5.023447231776247e-06
MeanAbsoluteError value on hold-out data: 0.0020985370501875877
Epoch: 63
Loss on hold-out set: 1.4558725232356146e-06
MeanAbsoluteError value on hold-out data: 0.001053250627592206
Epoch: 64
Loss on hold-out set: 2.562738879013133e-06
MeanAbsoluteError value on hold-out data: 0.0014336890308186412
Epoch: 65
Loss on hold-out set: 9.338643719404769e-06
MeanAbsoluteError value on hold-out data: 0.002914923243224621
Epoch: 66
Loss on hold-out set: 1.281583942207882e-06
MeanAbsoluteError value on hold-out data: 0.0008597039268352091
Epoch: 67
Loss on hold-out set: 9.151742444503595e-07
MeanAbsoluteError value on hold-out data: 0.0007997445063665509
Epoch: 68
Loss on hold-out set: 2.5505825403472826e-06
MeanAbsoluteError value on hold-out data: 0.0013867942616343498
Epoch: 69
Loss on hold-out set: 7.47055703901164e-07
MeanAbsoluteError value on hold-out data: 0.0006974387797527015
Epoch: 70
Loss on hold-out set: 3.364846471803113e-06
MeanAbsoluteError value on hold-out data: 0.0016294141532853246
Epoch: 71
Loss on hold-out set: 1.296878293390234e-06
MeanAbsoluteError value on hold-out data: 0.0009560612379573286
Epoch: 72
Loss on hold-out set: 1.0852241108036001e-05
MeanAbsoluteError value on hold-out data: 0.003195021999999881
Epoch: 73
Loss on hold-out set: 5.434994104039756e-06
MeanAbsoluteError value on hold-out data: 0.0021790398750454187
Epoch: 74
Loss on hold-out set: 3.239242752377842e-06
MeanAbsoluteError value on hold-out data: 0.001634589396417141
Epoch: 75
Loss on hold-out set: 1.8257645673916807e-05
MeanAbsoluteError value on hold-out data: 0.004052973818033934
Epoch: 76
Loss on hold-out set: 1.3128906955119288e-05
MeanAbsoluteError value on hold-out data: 0.003438615705817938
Epoch: 77
Loss on hold-out set: 4.477613174458384e-06
MeanAbsoluteError value on hold-out data: 0.0018990524113178253
Epoch: 78
Loss on hold-out set: 1.010647520161001e-05
MeanAbsoluteError value on hold-out data: 0.003059289650991559
Epoch: 79
Loss on hold-out set: 4.712018023513208e-06
MeanAbsoluteError value on hold-out data: 0.0019001063192263246
Epoch: 80
Loss on hold-out set: 2.2540298394752815e-06
MeanAbsoluteError value on hold-out data: 0.0012839597184211016
Epoch: 81
Loss on hold-out set: 4.0672956986652154e-05
MeanAbsoluteError value on hold-out data: 0.006177336443215609
Epoch: 82
Loss on hold-out set: 1.27150642421319e-06
MeanAbsoluteError value on hold-out data: 0.0008935881196521223
Epoch: 83
Loss on hold-out set: 2.0506648914826135e-06
MeanAbsoluteError value on hold-out data: 0.0011463535483926535
Epoch: 84
Loss on hold-out set: 3.0815620318337878e-06
MeanAbsoluteError value on hold-out data: 0.0014597767731174827
Epoch: 85
Loss on hold-out set: 2.0511280516594915e-05
MeanAbsoluteError value on hold-out data: 0.004389593377709389
Epoch: 86
Loss on hold-out set: 7.4232810740275975e-06
MeanAbsoluteError value on hold-out data: 0.0024797627702355385
Epoch: 87
Loss on hold-out set: 2.2677169389291002e-05
MeanAbsoluteError value on hold-out data: 0.0046585905365645885
Epoch: 88
Loss on hold-out set: 1.0484100211475119e-06
MeanAbsoluteError value on hold-out data: 0.0008171597728505731
Epoch: 89
Loss on hold-out set: 1.8398701545915435e-05
MeanAbsoluteError value on hold-out data: 0.004169836640357971
Epoch: 90
Loss on hold-out set: 3.638455382315442e-06
MeanAbsoluteError value on hold-out data: 0.0017012960743159056
Epoch: 91
Loss on hold-out set: 5.53805658195675e-06
MeanAbsoluteError value on hold-out data: 0.0022465151268988848
Epoch: 92
Loss on hold-out set: 3.295763073245845e-06
MeanAbsoluteError value on hold-out data: 0.0014721531188115478
Epoch: 93
Loss on hold-out set: 1.3973747984761888e-06
MeanAbsoluteError value on hold-out data: 0.001017552800476551
Epoch: 94
Loss on hold-out set: 8.652752382788873e-06
MeanAbsoluteError value on hold-out data: 0.002868188079446554
Epoch: 95
Loss on hold-out set: 1.1502259959732847e-06
MeanAbsoluteError value on hold-out data: 0.0008785534882918
Epoch: 96
Loss on hold-out set: 2.6032561858560906e-06
MeanAbsoluteError value on hold-out data: 0.001389757264405489
Epoch: 97
Loss on hold-out set: 5.871174380445154e-06
MeanAbsoluteError value on hold-out data: 0.002169033046811819
Epoch: 98
Loss on hold-out set: 7.900287885474557e-07
MeanAbsoluteError value on hold-out data: 0.000701964134350419
Epoch: 99
Loss on hold-out set: 2.162240759519461e-06
MeanAbsoluteError value on hold-out data: 0.0012356690131127834
Epoch: 100
Loss on hold-out set: 1.1115488608278871e-06
MeanAbsoluteError value on hold-out data: 0.0008625886403024197
Early stopping at epoch 99
metric_name = type(fun_control["metric_torch"]).__name__
print(f"loss: {df_eval}, Cross-validated {metric_name}: {df_metrics}")
loss: 2.8589174104151233e-06, Cross-validated MeanAbsoluteError: 0.0013521736254915595

19.18 Detailed Hyperparameter Plots

filename = "./figures/" + experiment_name
spot_tuner.plot_important_hyperparameter_contour(filename=filename)
lr_mult:  0.09377167500449451
patience:  100.0
optimizer:  8.66909922718558

Contour plots.

19.19 Parallel Coordinates Plot

spot_tuner.parallel_plot()

Parallel coordinates plots

19.20 Summary and Outlook

This tutorial presents the hyperparameter tuning open source software spotPython for PyTorch. Some of the advantages of spotPython are:

  • Numerical and categorical hyperparameters.
  • Powerful surrogate models.
  • Flexible approach and easy to use.
  • Simple JSON files for the specification of the hyperparameters.
  • Extension of default and user specified network classes.
  • Noise handling techniques.
  • Online visualization of the hyperparameter tuning process with tensorboard.

Currently, only rudimentary parallel and distributed neural network training is possible, but these capabilities will be extended in the future. The next version of spotPython will also include a more detailed documentation and more examples.

Important

Important: This tutorial does not present a complete benchmarking study (Bartz-Beielstein et al. 2020). The results are only preliminary and highly dependent on the local configuration (hard- and software). Our goal is to provide a first impression of the performance of the hyperparameter tuning package spotPython. The results should be interpreted with care.