18  HPT PyTorch: Regression

In this tutorial, we will show how spotPython can be integrated into the PyTorch training workflow for regreession tasks.

This document refers to the following software versions:

pip list | grep  "spot[RiverPython]"
spotPython                 0.2.33
spotRiver                  0.0.93
Note: you may need to restart the kernel to use updated packages.

spotPython can be installed via pip. Alternatively, the source code can be downloaded from gitHub: https://github.com/sequential-parameter-optimization/spotPython.

!pip install spotPython
# import sys
# !{sys.executable} -m pip install --upgrade build
# !{sys.executable} -m pip install --upgrade --force-reinstall spotPython

18.1 Setup

Before we consider the detailed experimental setup, we select the parameters that affect run time, initial design size and the device that is used.

MAX_TIME = 1
INIT_SIZE = 5
DEVICE = "cpu" # "cuda:0"
from spotPython.utils.device import getDevice
DEVICE = getDevice(DEVICE)
print(DEVICE)
cpu
import os
import copy
import socket
from datetime import datetime
from dateutil.tz import tzlocal
start_time = datetime.now(tzlocal())
HOSTNAME = socket.gethostname().split(".")[0]
experiment_name = '24-torch' + "_" + HOSTNAME + "_" + str(MAX_TIME) + "min_" + str(INIT_SIZE) + "init_" + str(start_time).split(".", 1)[0].replace(' ', '_')
experiment_name = experiment_name.replace(':', '-')
print(experiment_name)
if not os.path.exists('./figures'):
    os.makedirs('./figures')
24-torch_p040025_1min_5init_2023-06-17_02-13-42

18.2 Initialization of the fun_control Dictionary

spotPython uses a Python dictionary for storing the information required for the hyperparameter tuning process, which was described in Section 13.2.

from spotPython.utils.init import fun_control_init
fun_control = fun_control_init(task="regression",
 tensorboard_path="runs/24_spot_torch_regression",
 device=DEVICE)

18.3 PyTorch Data Loading

# Create dataset
import pandas as pd
import numpy as np
from sklearn import datasets as sklearn_datasets
from sklearn.preprocessing import MinMaxScaler
from sklearn.model_selection import train_test_split
X, y = sklearn_datasets.make_regression(
    n_samples=1000, n_features=10, noise=1, random_state=123)
y = y.reshape(-1, 1)

# Normalize the data
X_scaler = MinMaxScaler()
X_scaled = X_scaler.fit_transform(X)
y_scaler = MinMaxScaler()
y_scaled = y_scaler.fit_transform(y)

# combine the features and target into a single dataframe named train_df
train_df = pd.DataFrame(np.hstack((X_scaled, y_scaled)))

target_column = "y"
n_samples = train_df.shape[0]
n_features = train_df.shape[1] - 1
train_df.columns = [f"x{i}" for i in range(1, n_features+1)] + [target_column]
X_train, X_test, y_train, y_test = train_test_split(train_df.drop(target_column,
    axis=1), 
    train_df[target_column],
    random_state=42,
    test_size=0.25)
trainset = pd.DataFrame(np.hstack((X_train, np.array(y_train).reshape(-1, 1))))
testset = pd.DataFrame(np.hstack((X_test, np.array(y_test).reshape(-1, 1))))
trainset.columns = [f"x{i}" for i in range(1, n_features+1)] + [target_column]
testset.columns = [f"x{i}" for i in range(1, n_features+1)] + [target_column]
print(train_df.shape)
print(trainset.shape)
print(testset.shape)
(1000, 11)
(750, 11)
(250, 11)
import torch
from spotPython.torch.dataframedataset import DataFrameDataset
dtype_x = torch.float32
dtype_y = torch.float32
train_df = DataFrameDataset(train_df, target_column=target_column,
    dtype_x=dtype_x, dtype_y=dtype_y)
train = DataFrameDataset(trainset, target_column=target_column,
    dtype_x=dtype_x, dtype_y=dtype_y)
test = DataFrameDataset(testset, target_column=target_column,
    dtype_x=dtype_x, dtype_y=dtype_y)
n_samples = len(train)
  • Now we can test the data loading:
from spotPython.torch.traintest import create_train_val_data_loaders
trainloader, testloader = create_train_val_data_loaders(train, 2, True, 0)
for i, data in enumerate(trainloader, 0):
    inputs, labels = data
    print(inputs.shape)
    print(labels.shape)
    print(inputs)
    print(labels)
    break
torch.Size([2, 10])
torch.Size([2])
tensor([[0.3344, 0.6868, 0.6351, 0.2967, 0.5846, 0.5621, 0.4318, 0.3901, 0.4451,
         0.5040],
        [0.5576, 0.6493, 0.2854, 0.6640, 0.5235, 0.3708, 0.7574, 0.3415, 0.5727,
         0.4925]])
tensor([0.5386, 0.5709])
  • Since this works fine, we can add the data loading to the fun_control dictionary:
# add the dataset to the fun_control
fun_control.update({"data": train_df, # full dataset,
               "train": train,
               "test": test,
               "n_samples": n_samples,
               "target_column": target_column,})

18.4 The Model (Algorithm) to be Tuned

18.5 Specification of the Preprocessing Model

After the training and test data are specified and added to the fun_control dictionary, spotPython allows the specification of a data preprocessing pipeline, e.g., for the scaling of the data or for the one-hot encoding of categorical variables, see Section 13.4.1. This feature is not used here, so we do not change the default value (which is None).

18.6 Select algorithm and core_model_hyper_dict

18.6.1 Implementing a Configurable Neural Network With spotPython

spotPython includes the Net_lin_reg class which is implemented in the file netregression.py.

This class inherits from the class Net_Core which is implemented in the file netcore.py, see ?sec-the-net-core-class-24.

from torch import nn
import spotPython.torch.netcore as netcore


class Net_lin_reg(netcore.Net_Core):
    def __init__(
        self, _L_in, _L_out, l1, dropout_prob, lr_mult,
        batch_size, epochs, k_folds, patience, optimizer,
        sgd_momentum
    ):
        super(Net_lin_reg, self).__init__(
            lr_mult=lr_mult,
            batch_size=batch_size,
            epochs=epochs,
            k_folds=k_folds,
            patience=patience,
            optimizer=optimizer,
            sgd_momentum=sgd_momentum,
        )
        l2 = max(l1 // 2, 4)
        self.fc1 = nn.Linear(_L_in, l1)
        self.fc2 = nn.Linear(l1, l2)
        self.fc3 = nn.Linear(l2, _L_out)
        self.relu = nn.ReLU()
        self.softmax = nn.Softmax(dim=1)
        self.dropout1 = nn.Dropout(p=dropout_prob)
        self.dropout2 = nn.Dropout(p=dropout_prob / 2)

    def forward(self, x):
        x = self.fc1(x)
        x = self.relu(x)
        x = self.dropout1(x)
        x = self.fc2(x)
        x = self.relu(x)
        x = self.dropout2(x)
        x = self.fc3(x)
        return x

18.6.1.1 The Net_Core class

Net_lin_reg inherits from the class Net_Core which is implemented in the file netcore.py. This class was described in Section 13.4.3.

from spotPython.torch.netregression import Net_lin_reg
from spotPython.data.torch_hyper_dict import TorchHyperDict
from spotPython.hyperparameters.values import add_core_model_to_fun_control
fun_control = add_core_model_to_fun_control(core_model=Net_lin_reg,
                              fun_control=fun_control,
                              hyper_dict=TorchHyperDict,
                              filename=None)

18.7 The Search Space

18.7.1 Configuring the Search Space With spotPython

18.7.1.1 The hyper_dict Hyperparameters for the Selected Algorithm

spotPython uses JSON files for the specification of the hyperparameters, which were described in Section 13.5.2.

The corresponding entries for the Net_lin_reg class are shown below.

    "Net_lin_reg":
    {
        "_L_in": {
            "type": "int",
            "default": 10,
            "transform": "None",
            "lower": 10,
            "upper": 10},
        "_L_out": {
            "type": "int",
            "default": 1,
            "transform": "None",
            "lower": 1,
            "upper": 1},
        "l1": {
            "type": "int",
            "default": 3,
            "transform": "transform_power_2_int",
            "lower": 3,
            "upper": 8},
        "dropout_prob": {
            "type": "float",
            "default": 0.01,
            "transform": "None",
            "lower": 0.0,
            "upper": 0.9},
        "lr_mult": {
            "type": "float",
            "default": 1.0,
            "transform": "None",
            "lower": 0.1,
            "upper": 10.0},
        "batch_size": {
            "type": "int",
            "default": 4,
            "transform": "transform_power_2_int",
            "lower": 1,
            "upper": 4},
        "epochs": {
            "type": "int",
            "default": 4,
            "transform": "transform_power_2_int",
            "lower": 4,
            "upper": 9},
        "k_folds": {
            "type": "int",
            "default": 1,
            "transform": "None",
            "lower": 1,
            "upper": 1},
        "patience": {
            "type": "int",
            "default": 2,
            "transform": "transform_power_2_int",
            "lower": 1,
            "upper": 5
        },
        "optimizer": {
            "levels": ["Adadelta",
                       "Adagrad",
                       "Adam",
                       "AdamW",
                       "SparseAdam",
                       "Adamax",
                       "ASGD",
                       "NAdam",
                       "RAdam",
                       "RMSprop",
                       "Rprop",
                       "SGD"],
            "type": "factor",
            "default": "SGD",
            "transform": "None",
            "class_name": "torch.optim",
            "core_model_parameter_type": "str",
            "lower": 0,
            "upper": 12},
        "sgd_momentum": {
            "type": "float",
            "default": 0.0,
            "transform": "None",
            "lower": 0.0,
            "upper": 1.0}
    },

18.8 Modifying the Hyperparameters

spotPython provides functions for modifying the hyperparameters, their bounds and factors as well as for activating and de-activating hyperparameters without re-compilation of the Python source code. These functions were described in Section 13.5.3.

18.8.1 Modify hyper_dict Hyperparameters for the Selected Algorithm aka core_model

18.8.1.1 Modify Hyperparameters of Type numeric and integer (boolean)

from spotPython.hyperparameters.values import modify_hyper_parameter_bounds

fun_control = modify_hyper_parameter_bounds(fun_control, "epochs", bounds=[2, 16])
fun_control = modify_hyper_parameter_bounds(fun_control, "patience", bounds=[3, 7])

18.8.1.2 Modify Hyperparameter of Type factor

from spotPython.hyperparameters.values import modify_hyper_parameter_levels
fun_control = modify_hyper_parameter_levels(fun_control, "optimizer",
    ["Adadelta", "Adagrad", "Adam", "AdamW", "Adamax", "ASGD", "NAdam"])


fun_control.update({
               "_L_in": n_features,
               "_L_out": 1,})

18.8.2 Optimizers

Optimizers are described in Section 13.6.

18.9 Evaluation

The evaluation procedure requires the specification of two elements:

  1. the way how the data is split into a train and a test set (see Section 13.7)
  2. the loss function (and a metric).

18.9.1 Loss Functions and Metrics

The key "loss_function" specifies the loss function which is used during the optimization, see Section 13.8.

We will use MSE loss for the regression task.

from torch.nn import MSELoss
loss_torch = MSELoss()
fun_control.update({"loss_function": loss_torch})

18.9.2 Metric

from torchmetrics import MeanAbsoluteError
metric_torch = MeanAbsoluteError().to(fun_control["device"])
fun_control.update({"metric_torch": metric_torch})

18.10 Preparing the SPOT Call

The following code passes the information about the parameter ranges and bounds to spot.

# extract the variable types, names, and bounds
from spotPython.hyperparameters.values import (get_bound_values,
    get_var_name,
    get_var_type,)
var_type = get_var_type(fun_control)
var_name = get_var_name(fun_control)
fun_control.update({"var_type": var_type,
                    "var_name": var_name})
lower = get_bound_values(fun_control, "lower")
upper = get_bound_values(fun_control, "upper")
from spotPython.utils.eda import gen_design_table
print(gen_design_table(fun_control))
| name         | type   | default   |   lower |   upper | transform             |
|--------------|--------|-----------|---------|---------|-----------------------|
| _L_in        | int    | 10        |    10   |    10   | None                  |
| _L_out       | int    | 1         |     1   |     1   | None                  |
| l1           | int    | 3         |     3   |     8   | transform_power_2_int |
| dropout_prob | float  | 0.01      |     0   |     0.9 | None                  |
| lr_mult      | float  | 1.0       |     0.1 |    10   | None                  |
| batch_size   | int    | 4         |     1   |     4   | transform_power_2_int |
| epochs       | int    | 4         |     2   |    16   | transform_power_2_int |
| k_folds      | int    | 1         |     1   |     1   | None                  |
| patience     | int    | 2         |     3   |     7   | transform_power_2_int |
| optimizer    | factor | SGD       |     0   |     6   | None                  |
| sgd_momentum | float  | 0.0       |     0   |     1   | None                  |

18.11 The Objective Function fun_torch

The objective function fun_torch is selected next. It implements an interface from PyTorch’s training, validation, and testing methods to spotPython.

from spotPython.fun.hypertorch import HyperTorch
fun = HyperTorch().fun_torch
from spotPython.hyperparameters.values import get_default_hyperparameters_as_array
hyper_dict=TorchHyperDict().load()
X_start = get_default_hyperparameters_as_array(fun_control, hyper_dict)

18.12 Starting the Hyperparameter Tuning

The spotPython hyperparameter tuning is started by calling the Spot function as described in Section 13.12.

from spotPython.spot import spot
from math import inf
spot_tuner = spot.Spot(fun=fun,
                   lower = lower,
                   upper = upper,
                   fun_evals = inf,
                   fun_repeats = 1,
                   max_time = MAX_TIME,
                   noise = False,
                   tolerance_x = np.sqrt(np.spacing(1)),
                   var_type = var_type,
                   var_name = var_name,
                   infill_criterion = "y",
                   n_points = 1,
                   seed=123,
                   log_level = 50,
                   show_models= False,
                   show_progress= True,
                   fun_control = fun_control,
                   design_control={"init_size": INIT_SIZE,
                                   "repeats": 1},
                   surrogate_control={"noise": True,
                                      "cod_type": "norm",
                                      "min_theta": -4,
                                      "max_theta": 3,
                                      "n_theta": len(var_name),
                                      "model_fun_evals": 10_000,
                                      "log_level": 50
                                      })
spot_tuner.run(X_start=X_start)

config: {'_L_in': 10, '_L_out': 1, 'l1': 64, 'dropout_prob': 0.7103122166156, 'lr_mult': 3.62368745191023, 'batch_size': 8, 'epochs': 128, 'k_folds': 1, 'patience': 16, 'optimizer': 'Adam', 'sgd_momentum': 0.5446851204405787}
Epoch: 1
Loss on hold-out set: 0.04119848254087724
MeanAbsoluteError value on hold-out data: 0.1620417982339859
Epoch: 2
Loss on hold-out set: 0.03553037823324925
MeanAbsoluteError value on hold-out data: 0.15143921971321106
Epoch: 3
Loss on hold-out set: 0.02958609055923788
MeanAbsoluteError value on hold-out data: 0.13660193979740143
Epoch: 4
Loss on hold-out set: 0.03013585309350961
MeanAbsoluteError value on hold-out data: 0.13507364690303802
Epoch: 5
Loss on hold-out set: 0.03203173979234539
MeanAbsoluteError value on hold-out data: 0.1455485075712204
Epoch: 6
Loss on hold-out set: 0.02843239437788725
MeanAbsoluteError value on hold-out data: 0.13090945780277252
Epoch: 7
Loss on hold-out set: 0.02859631974838282
MeanAbsoluteError value on hold-out data: 0.13495849072933197
Epoch: 8
Loss on hold-out set: 0.027949725277721882
MeanAbsoluteError value on hold-out data: 0.13539482653141022
Epoch: 9
Loss on hold-out set: 0.02628261409699917
MeanAbsoluteError value on hold-out data: 0.12842492759227753
Epoch: 10
Loss on hold-out set: 0.02476115451243363
MeanAbsoluteError value on hold-out data: 0.12518028914928436
Epoch: 11
Loss on hold-out set: 0.022808362049736866
MeanAbsoluteError value on hold-out data: 0.11970288306474686
Epoch: 12
Loss on hold-out set: 0.02325476258748064
MeanAbsoluteError value on hold-out data: 0.12017356604337692
Epoch: 13
Loss on hold-out set: 0.025151742254628948
MeanAbsoluteError value on hold-out data: 0.12174010276794434
Epoch: 14
Loss on hold-out set: 0.023241102768990555
MeanAbsoluteError value on hold-out data: 0.11976943910121918
Epoch: 15
Loss on hold-out set: 0.020609656103739615
MeanAbsoluteError value on hold-out data: 0.1118519976735115
Epoch: 16
Loss on hold-out set: 0.01946125299620785
MeanAbsoluteError value on hold-out data: 0.10916125029325485
Epoch: 17
Loss on hold-out set: 0.023232422989646073
MeanAbsoluteError value on hold-out data: 0.11934071779251099
Epoch: 18
Loss on hold-out set: 0.017458730867426647
MeanAbsoluteError value on hold-out data: 0.10380567610263824
Epoch: 19
Loss on hold-out set: 0.020063674935188732
MeanAbsoluteError value on hold-out data: 0.11021031439304352
Epoch: 20
Loss on hold-out set: 0.020199101258951583
MeanAbsoluteError value on hold-out data: 0.11304182559251785
Epoch: 21
Loss on hold-out set: 0.01953089387940341
MeanAbsoluteError value on hold-out data: 0.11246389895677567
Epoch: 22
Loss on hold-out set: 0.017512150182339706
MeanAbsoluteError value on hold-out data: 0.10697536170482635
Epoch: 23
Loss on hold-out set: 0.01615051768328014
MeanAbsoluteError value on hold-out data: 0.09965535253286362
Epoch: 24
Loss on hold-out set: 0.017628287001954096
MeanAbsoluteError value on hold-out data: 0.10353326797485352
Epoch: 25
Loss on hold-out set: 0.013366559508109563
MeanAbsoluteError value on hold-out data: 0.09184445440769196
Epoch: 26
Loss on hold-out set: 0.017924403532800313
MeanAbsoluteError value on hold-out data: 0.10558844357728958
Epoch: 27
Loss on hold-out set: 0.01435932923892611
MeanAbsoluteError value on hold-out data: 0.09278683364391327
Epoch: 28
Loss on hold-out set: 0.014124940290409876
MeanAbsoluteError value on hold-out data: 0.08995089679956436
Epoch: 29
Loss on hold-out set: 0.013310860983390165
MeanAbsoluteError value on hold-out data: 0.08739347755908966
Epoch: 30
Loss on hold-out set: 0.014011123291167774
MeanAbsoluteError value on hold-out data: 0.09163140505552292
Epoch: 31
Loss on hold-out set: 0.014150112940880814
MeanAbsoluteError value on hold-out data: 0.09392796456813812
Epoch: 32
Loss on hold-out set: 0.012101514761238113
MeanAbsoluteError value on hold-out data: 0.08589934557676315
Epoch: 33
Loss on hold-out set: 0.01153131380162545
MeanAbsoluteError value on hold-out data: 0.08169915527105331
Epoch: 34
Loss on hold-out set: 0.011019138147515295
MeanAbsoluteError value on hold-out data: 0.07856626808643341
Epoch: 35
Loss on hold-out set: 0.011225792266869624
MeanAbsoluteError value on hold-out data: 0.08209528028964996
Epoch: 36
Loss on hold-out set: 0.01411980084192596
MeanAbsoluteError value on hold-out data: 0.09055435657501221
Epoch: 37
Loss on hold-out set: 0.011010398071161226
MeanAbsoluteError value on hold-out data: 0.0778571218252182
Epoch: 38
Loss on hold-out set: 0.012114477386747143
MeanAbsoluteError value on hold-out data: 0.08148310333490372
Epoch: 39
Loss on hold-out set: 0.011289942825801279
MeanAbsoluteError value on hold-out data: 0.08104723691940308
Epoch: 40
Loss on hold-out set: 0.012027327810708238
MeanAbsoluteError value on hold-out data: 0.08256758004426956
Epoch: 41
Loss on hold-out set: 0.014655819940870922
MeanAbsoluteError value on hold-out data: 0.09079692512750626
Epoch: 42
Loss on hold-out set: 0.011298679523047452
MeanAbsoluteError value on hold-out data: 0.07982762902975082
Epoch: 43
Loss on hold-out set: 0.010538141022583372
MeanAbsoluteError value on hold-out data: 0.07620814442634583
Epoch: 44
Loss on hold-out set: 0.011107894864644072
MeanAbsoluteError value on hold-out data: 0.07871702313423157
Epoch: 45
Loss on hold-out set: 0.011423732025401765
MeanAbsoluteError value on hold-out data: 0.07810109853744507
Epoch: 46
Loss on hold-out set: 0.00845424061040639
MeanAbsoluteError value on hold-out data: 0.06951973587274551
Epoch: 47
Loss on hold-out set: 0.010521387509805592
MeanAbsoluteError value on hold-out data: 0.07926751673221588
Epoch: 48
Loss on hold-out set: 0.014055569625557646
MeanAbsoluteError value on hold-out data: 0.0880722776055336
Epoch: 49
Loss on hold-out set: 0.009248968178565664
MeanAbsoluteError value on hold-out data: 0.06967992335557938
Epoch: 50
Loss on hold-out set: 0.010561582359705904
MeanAbsoluteError value on hold-out data: 0.0767359733581543
Epoch: 51
Loss on hold-out set: 0.008790309672660538
MeanAbsoluteError value on hold-out data: 0.06744665652513504
Epoch: 52
Loss on hold-out set: 0.012205774463884728
MeanAbsoluteError value on hold-out data: 0.07450175285339355
Epoch: 53
Loss on hold-out set: 0.013155622842819676
MeanAbsoluteError value on hold-out data: 0.0844012200832367
Epoch: 54
Loss on hold-out set: 0.009591732808315245
MeanAbsoluteError value on hold-out data: 0.07613542675971985
Epoch: 55
Loss on hold-out set: 0.009687081141715967
MeanAbsoluteError value on hold-out data: 0.07092435657978058
Epoch: 56
Loss on hold-out set: 0.00883764091658553
MeanAbsoluteError value on hold-out data: 0.06774278730154037
Epoch: 57
Loss on hold-out set: 0.010810543660466609
MeanAbsoluteError value on hold-out data: 0.07628268003463745
Epoch: 58
Loss on hold-out set: 0.009635920029770779
MeanAbsoluteError value on hold-out data: 0.0717688500881195
Epoch: 59
Loss on hold-out set: 0.012331882136334715
MeanAbsoluteError value on hold-out data: 0.07507925480604172
Epoch: 60
Loss on hold-out set: 0.008923974583587168
MeanAbsoluteError value on hold-out data: 0.06801169365644455
Epoch: 61
Loss on hold-out set: 0.008295140385407171
MeanAbsoluteError value on hold-out data: 0.06413847953081131
Epoch: 62
Loss on hold-out set: 0.009738409946868686
MeanAbsoluteError value on hold-out data: 0.0675385445356369
Epoch: 63
Loss on hold-out set: 0.011011485411712018
MeanAbsoluteError value on hold-out data: 0.07191281020641327
Epoch: 64
Loss on hold-out set: 0.010324712196291474
MeanAbsoluteError value on hold-out data: 0.07391194999217987
Epoch: 65
Loss on hold-out set: 0.009444988629854234
MeanAbsoluteError value on hold-out data: 0.06921794265508652
Epoch: 66
Loss on hold-out set: 0.011183559621904829
MeanAbsoluteError value on hold-out data: 0.07696205377578735
Epoch: 67
Loss on hold-out set: 0.010133536909339264
MeanAbsoluteError value on hold-out data: 0.07197541743516922
Epoch: 68
Loss on hold-out set: 0.01281746149700331
MeanAbsoluteError value on hold-out data: 0.08406703174114227
Epoch: 69
Loss on hold-out set: 0.00823093019425869
MeanAbsoluteError value on hold-out data: 0.06595811992883682
Epoch: 70
Loss on hold-out set: 0.008085967862586441
MeanAbsoluteError value on hold-out data: 0.06556864827871323
Epoch: 71
Loss on hold-out set: 0.00885554035439303
MeanAbsoluteError value on hold-out data: 0.06680303812026978
Epoch: 72
Loss on hold-out set: 0.011171759945634557
MeanAbsoluteError value on hold-out data: 0.07615578919649124
Epoch: 73
Loss on hold-out set: 0.007891454691018322
MeanAbsoluteError value on hold-out data: 0.06686297059059143
Epoch: 74
Loss on hold-out set: 0.009633732683907607
MeanAbsoluteError value on hold-out data: 0.07305347174406052
Epoch: 75
Loss on hold-out set: 0.014706545809626971
MeanAbsoluteError value on hold-out data: 0.08815611153841019
Epoch: 76
Loss on hold-out set: 0.013270399006279675
MeanAbsoluteError value on hold-out data: 0.08841101825237274
Epoch: 77
Loss on hold-out set: 0.010342448352419428
MeanAbsoluteError value on hold-out data: 0.0735640749335289
Epoch: 78
Loss on hold-out set: 0.01100198475423416
MeanAbsoluteError value on hold-out data: 0.07325659692287445
Epoch: 79
Loss on hold-out set: 0.009218206313610273
MeanAbsoluteError value on hold-out data: 0.06931892037391663
Epoch: 80
Loss on hold-out set: 0.009538231325629903
MeanAbsoluteError value on hold-out data: 0.06972208619117737
Epoch: 81
Loss on hold-out set: 0.009539596283024079
MeanAbsoluteError value on hold-out data: 0.07115380465984344
Epoch: 82
Loss on hold-out set: 0.009982664517960265
MeanAbsoluteError value on hold-out data: 0.07273399829864502
Epoch: 83
Loss on hold-out set: 0.009188235853798687
MeanAbsoluteError value on hold-out data: 0.06830304861068726
Epoch: 84
Loss on hold-out set: 0.009687465434820441
MeanAbsoluteError value on hold-out data: 0.0714622512459755
Epoch: 85
Loss on hold-out set: 0.010077715483739189
MeanAbsoluteError value on hold-out data: 0.07570722699165344
Epoch: 86
Loss on hold-out set: 0.00879601492105346
MeanAbsoluteError value on hold-out data: 0.06695086508989334
Epoch: 87
Loss on hold-out set: 0.006914345366806772
MeanAbsoluteError value on hold-out data: 0.05908849090337753
Epoch: 88
Loss on hold-out set: 0.012421582990914191
MeanAbsoluteError value on hold-out data: 0.07331830263137817
Epoch: 89
Loss on hold-out set: 0.009421795762854776
MeanAbsoluteError value on hold-out data: 0.0642414391040802
Epoch: 90
Loss on hold-out set: 0.008567611380529246
MeanAbsoluteError value on hold-out data: 0.06684629619121552
Epoch: 91
Loss on hold-out set: 0.008667940347406426
MeanAbsoluteError value on hold-out data: 0.07080075889825821
Epoch: 92
Loss on hold-out set: 0.008638949605244162
MeanAbsoluteError value on hold-out data: 0.06755506992340088
Epoch: 93
Loss on hold-out set: 0.013527016743625464
MeanAbsoluteError value on hold-out data: 0.08086350560188293
Epoch: 94
Loss on hold-out set: 0.009532245703188605
MeanAbsoluteError value on hold-out data: 0.06714905798435211
Epoch: 95
Loss on hold-out set: 0.009314702499020649
MeanAbsoluteError value on hold-out data: 0.06801077723503113
Epoch: 96
Loss on hold-out set: 0.010343404312152416
MeanAbsoluteError value on hold-out data: 0.06876478344202042
Epoch: 97
Loss on hold-out set: 0.009395918153275392
MeanAbsoluteError value on hold-out data: 0.06930423527956009
Epoch: 98
Loss on hold-out set: 0.00874652512873964
MeanAbsoluteError value on hold-out data: 0.06853694468736649
Epoch: 99
Loss on hold-out set: 0.011231844837311655
MeanAbsoluteError value on hold-out data: 0.07496839761734009
Epoch: 100
Loss on hold-out set: 0.008881487246406706
MeanAbsoluteError value on hold-out data: 0.06827972084283829
Epoch: 101
Loss on hold-out set: 0.010841324104388294
MeanAbsoluteError value on hold-out data: 0.07570116221904755
Epoch: 102
Loss on hold-out set: 0.007904276545894774
MeanAbsoluteError value on hold-out data: 0.06205671280622482
Epoch: 103
Loss on hold-out set: 0.008193578013513041
MeanAbsoluteError value on hold-out data: 0.06481563299894333
Early stopping at epoch 102
Returned to Spot: Validation loss: 0.008193578013513041
----------------------------------------------

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.19981931523998656, 'lr_mult': 7.004318498645526, 'batch_size': 16, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.07401195908206384}
Epoch: 1
Loss on hold-out set: 0.03283170098438859
MeanAbsoluteError value on hold-out data: 0.14404599368572235
Epoch: 2
Loss on hold-out set: 0.027301813132668797
MeanAbsoluteError value on hold-out data: 0.13512957096099854
Epoch: 3
Loss on hold-out set: 0.040790069848299026
MeanAbsoluteError value on hold-out data: 0.1688394993543625
Epoch: 4
Loss on hold-out set: 0.019451884846938283
MeanAbsoluteError value on hold-out data: 0.1094430536031723
Epoch: 5
Loss on hold-out set: 0.0221121712146621
MeanAbsoluteError value on hold-out data: 0.11839473992586136
Epoch: 6
Loss on hold-out set: 0.018887689484185295
MeanAbsoluteError value on hold-out data: 0.10989953577518463
Epoch: 7
Loss on hold-out set: 0.021599624354980494
MeanAbsoluteError value on hold-out data: 0.11715453118085861
Epoch: 8
Loss on hold-out set: 0.01831802461100252
MeanAbsoluteError value on hold-out data: 0.10850206762552261
Epoch: 9
Loss on hold-out set: 0.016939483043786726
MeanAbsoluteError value on hold-out data: 0.10361695289611816
Epoch: 10
Loss on hold-out set: 0.022546979157548202
MeanAbsoluteError value on hold-out data: 0.12378977239131927
Epoch: 11
Loss on hold-out set: 0.03542065541995199
MeanAbsoluteError value on hold-out data: 0.16319170594215393
Epoch: 12
Loss on hold-out set: 0.010213676521456555
MeanAbsoluteError value on hold-out data: 0.07990782707929611
Epoch: 13
Loss on hold-out set: 0.032319696129936924
MeanAbsoluteError value on hold-out data: 0.15266306698322296
Epoch: 14
Loss on hold-out set: 0.01087769557182726
MeanAbsoluteError value on hold-out data: 0.08125859498977661
Epoch: 15
Loss on hold-out set: 0.0073248687396316155
MeanAbsoluteError value on hold-out data: 0.07048169523477554
Epoch: 16
Loss on hold-out set: 0.027021995941667182
MeanAbsoluteError value on hold-out data: 0.14222000539302826
Epoch: 17
Loss on hold-out set: 0.014672704727241867
MeanAbsoluteError value on hold-out data: 0.09871537238359451
Epoch: 18
Loss on hold-out set: 0.014676078418759923
MeanAbsoluteError value on hold-out data: 0.09573782235383987
Epoch: 19
Loss on hold-out set: 0.009273314248084238
MeanAbsoluteError value on hold-out data: 0.07794113457202911
Epoch: 20
Loss on hold-out set: 0.011143022118822524
MeanAbsoluteError value on hold-out data: 0.08760632574558258
Epoch: 21
Loss on hold-out set: 0.025014593560052544
MeanAbsoluteError value on hold-out data: 0.13447783887386322
Epoch: 22
Loss on hold-out set: 0.006948847973131035
MeanAbsoluteError value on hold-out data: 0.0647619217634201
Epoch: 23
Loss on hold-out set: 0.016333517544951878
MeanAbsoluteError value on hold-out data: 0.11364883184432983
Epoch: 24
Loss on hold-out set: 0.0072857329719945
MeanAbsoluteError value on hold-out data: 0.06549392640590668
Epoch: 25
Loss on hold-out set: 0.011326535163741363
MeanAbsoluteError value on hold-out data: 0.08732933551073074
Epoch: 26
Loss on hold-out set: 0.013856759417409959
MeanAbsoluteError value on hold-out data: 0.09221533685922623
Epoch: 27
Loss on hold-out set: 0.015207890127050249
MeanAbsoluteError value on hold-out data: 0.09679415076971054
Epoch: 28
Loss on hold-out set: 0.015488214594753165
MeanAbsoluteError value on hold-out data: 0.10383512824773788
Epoch: 29
Loss on hold-out set: 0.009718003290656366
MeanAbsoluteError value on hold-out data: 0.07980860769748688
Epoch: 30
Loss on hold-out set: 0.027204643934965134
MeanAbsoluteError value on hold-out data: 0.1434674859046936
Epoch: 31
Loss on hold-out set: 0.003412679174767905
MeanAbsoluteError value on hold-out data: 0.04369843378663063
Epoch: 32
Loss on hold-out set: 0.006040783304917185
MeanAbsoluteError value on hold-out data: 0.05818545073270798
Epoch: 33
Loss on hold-out set: 0.024809708475674454
MeanAbsoluteError value on hold-out data: 0.14286383986473083
Epoch: 34
Loss on hold-out set: 0.003275478736644513
MeanAbsoluteError value on hold-out data: 0.04456501454114914
Epoch: 35
Loss on hold-out set: 0.0035396038346286666
MeanAbsoluteError value on hold-out data: 0.04199950397014618
Epoch: 36
Loss on hold-out set: 0.0038433222369732042
MeanAbsoluteError value on hold-out data: 0.047526001930236816
Epoch: 37
Loss on hold-out set: 0.02579952207835097
MeanAbsoluteError value on hold-out data: 0.1445699781179428
Epoch: 38
Loss on hold-out set: 0.0067661252411964695
MeanAbsoluteError value on hold-out data: 0.07048158347606659
Epoch: 39
Loss on hold-out set: 0.003074680283469589
MeanAbsoluteError value on hold-out data: 0.04030832275748253
Epoch: 40
Loss on hold-out set: 0.008231818283859053
MeanAbsoluteError value on hold-out data: 0.07218653708696365
Epoch: 41
Loss on hold-out set: 0.008074853520252202
MeanAbsoluteError value on hold-out data: 0.07118376344442368
Epoch: 42
Loss on hold-out set: 0.014679805424652602
MeanAbsoluteError value on hold-out data: 0.10355532169342041
Epoch: 43
Loss on hold-out set: 0.004228856383920892
MeanAbsoluteError value on hold-out data: 0.04509606957435608
Epoch: 44
Loss on hold-out set: 0.007887131019838546
MeanAbsoluteError value on hold-out data: 0.07704266160726547
Epoch: 45
Loss on hold-out set: 0.004438770401879753
MeanAbsoluteError value on hold-out data: 0.04878991097211838
Epoch: 46
Loss on hold-out set: 0.004907133413086596
MeanAbsoluteError value on hold-out data: 0.05157478153705597
Epoch: 47
Loss on hold-out set: 0.002985615546717063
MeanAbsoluteError value on hold-out data: 0.04096994549036026
Epoch: 48
Loss on hold-out set: 0.004520032818331138
MeanAbsoluteError value on hold-out data: 0.047529879957437515
Epoch: 49
Loss on hold-out set: 0.006883626926298204
MeanAbsoluteError value on hold-out data: 0.06260934472084045
Epoch: 50
Loss on hold-out set: 0.01190259584568833
MeanAbsoluteError value on hold-out data: 0.08991031348705292
Epoch: 51
Loss on hold-out set: 0.003912779373901063
MeanAbsoluteError value on hold-out data: 0.048132043331861496
Epoch: 52
Loss on hold-out set: 0.008228762197847428
MeanAbsoluteError value on hold-out data: 0.07106117159128189
Epoch: 53
Loss on hold-out set: 0.002760932744039517
MeanAbsoluteError value on hold-out data: 0.0383739098906517
Epoch: 54
Loss on hold-out set: 0.012290874496102333
MeanAbsoluteError value on hold-out data: 0.08801400661468506
Epoch: 55
Loss on hold-out set: 0.008701554058413757
MeanAbsoluteError value on hold-out data: 0.08380576968193054
Epoch: 56
Loss on hold-out set: 0.0062178605432180985
MeanAbsoluteError value on hold-out data: 0.06444203108549118
Epoch: 57
Loss on hold-out set: 0.006589234892376943
MeanAbsoluteError value on hold-out data: 0.0666731670498848
Epoch: 58
Loss on hold-out set: 0.010234019694555747
MeanAbsoluteError value on hold-out data: 0.07954999059438705
Epoch: 59
Loss on hold-out set: 0.007423295284082231
MeanAbsoluteError value on hold-out data: 0.0666884183883667
Epoch: 60
Loss on hold-out set: 0.012281982081108972
MeanAbsoluteError value on hold-out data: 0.09012436121702194
Epoch: 61
Loss on hold-out set: 0.004080955674381633
MeanAbsoluteError value on hold-out data: 0.0497441366314888
Epoch: 62
Loss on hold-out set: 0.008429211172226229
MeanAbsoluteError value on hold-out data: 0.0687018483877182
Epoch: 63
Loss on hold-out set: 0.006933526356557482
MeanAbsoluteError value on hold-out data: 0.06121228635311127
Epoch: 64
Loss on hold-out set: 0.006609460265424691
MeanAbsoluteError value on hold-out data: 0.062474556267261505
Epoch: 65
Loss on hold-out set: 0.004211906723580078
MeanAbsoluteError value on hold-out data: 0.0488181933760643
Epoch: 66
Loss on hold-out set: 0.011872933197178338
MeanAbsoluteError value on hold-out data: 0.09826575964689255
Epoch: 67
Loss on hold-out set: 0.011133617647972546
MeanAbsoluteError value on hold-out data: 0.0837690457701683
Epoch: 68
Loss on hold-out set: 0.018402069365899814
MeanAbsoluteError value on hold-out data: 0.12435409426689148
Epoch: 69
Loss on hold-out set: 0.0037937688114317624
MeanAbsoluteError value on hold-out data: 0.045278292149305344
Epoch: 70
Loss on hold-out set: 0.003467693538895171
MeanAbsoluteError value on hold-out data: 0.04492272809147835
Epoch: 71
Loss on hold-out set: 0.011145245921062795
MeanAbsoluteError value on hold-out data: 0.09132108092308044
Epoch: 72
Loss on hold-out set: 0.005972663737147262
MeanAbsoluteError value on hold-out data: 0.05904541164636612
Epoch: 73
Loss on hold-out set: 0.004692457377371427
MeanAbsoluteError value on hold-out data: 0.051779936999082565
Epoch: 74
Loss on hold-out set: 0.005862343161808033
MeanAbsoluteError value on hold-out data: 0.05550317093729973
Epoch: 75
Loss on hold-out set: 0.005180474628057135
MeanAbsoluteError value on hold-out data: 0.05137458071112633
Epoch: 76
Loss on hold-out set: 0.008719962641694829
MeanAbsoluteError value on hold-out data: 0.07501501590013504
Epoch: 77
Loss on hold-out set: 0.004494184297264407
MeanAbsoluteError value on hold-out data: 0.05293765664100647
Epoch: 78
Loss on hold-out set: 0.0028258713121574962
MeanAbsoluteError value on hold-out data: 0.03849508613348007
Epoch: 79
Loss on hold-out set: 0.004413969630963709
MeanAbsoluteError value on hold-out data: 0.052742693573236465
Epoch: 80
Loss on hold-out set: 0.0055156020741713675
MeanAbsoluteError value on hold-out data: 0.058511681854724884
Epoch: 81
Loss on hold-out set: 0.0026790842959216157
MeanAbsoluteError value on hold-out data: 0.04025442525744438
Epoch: 82
Loss on hold-out set: 0.003930808339071901
MeanAbsoluteError value on hold-out data: 0.046123288571834564
Epoch: 83
Loss on hold-out set: 0.0050467977079709896
MeanAbsoluteError value on hold-out data: 0.05980696901679039
Epoch: 84
Loss on hold-out set: 0.014779143868700453
MeanAbsoluteError value on hold-out data: 0.11253628134727478
Epoch: 85
Loss on hold-out set: 0.0017874639230094065
MeanAbsoluteError value on hold-out data: 0.03348074480891228
Epoch: 86
Loss on hold-out set: 0.011505230624032648
MeanAbsoluteError value on hold-out data: 0.09854570031166077
Epoch: 87
Loss on hold-out set: 0.005036052610529096
MeanAbsoluteError value on hold-out data: 0.060174185782670975
Epoch: 88
Loss on hold-out set: 0.004236792823863461
MeanAbsoluteError value on hold-out data: 0.04692454636096954
Epoch: 89
Loss on hold-out set: 0.005909139076002727
MeanAbsoluteError value on hold-out data: 0.05798729509115219
Epoch: 90
Loss on hold-out set: 0.018173289534292723
MeanAbsoluteError value on hold-out data: 0.11801453679800034
Epoch: 91
Loss on hold-out set: 0.006788486381992698
MeanAbsoluteError value on hold-out data: 0.07076677680015564
Epoch: 92
Loss on hold-out set: 0.00609950669796059
MeanAbsoluteError value on hold-out data: 0.06685715168714523
Epoch: 93
Loss on hold-out set: 0.004472820235318259
MeanAbsoluteError value on hold-out data: 0.04940259829163551
Epoch: 94
Loss on hold-out set: 0.015163805311251628
MeanAbsoluteError value on hold-out data: 0.10112667828798294
Epoch: 95
Loss on hold-out set: 0.004475592758114401
MeanAbsoluteError value on hold-out data: 0.05199559032917023
Epoch: 96
Loss on hold-out set: 0.002164377723697965
MeanAbsoluteError value on hold-out data: 0.03312701731920242
Epoch: 97
Loss on hold-out set: 0.0020047008568470025
MeanAbsoluteError value on hold-out data: 0.032185398042201996
Epoch: 98
Loss on hold-out set: 0.005231806297639483
MeanAbsoluteError value on hold-out data: 0.062182534486055374
Epoch: 99
Loss on hold-out set: 0.003075437179129375
MeanAbsoluteError value on hold-out data: 0.035611413419246674
Epoch: 100
Loss on hold-out set: 0.0060762831524602675
MeanAbsoluteError value on hold-out data: 0.05769430845975876
Epoch: 101
Loss on hold-out set: 0.0037854288300303253
MeanAbsoluteError value on hold-out data: 0.0415504090487957
Epoch: 102
Loss on hold-out set: 0.0028905859370225748
MeanAbsoluteError value on hold-out data: 0.0362815335392952
Epoch: 103
Loss on hold-out set: 0.0035984069354047903
MeanAbsoluteError value on hold-out data: 0.04219730198383331
Epoch: 104
Loss on hold-out set: 0.0020644566852991517
MeanAbsoluteError value on hold-out data: 0.035839322954416275
Epoch: 105
Loss on hold-out set: 0.003373739576138752
MeanAbsoluteError value on hold-out data: 0.04227259382605553
Epoch: 106
Loss on hold-out set: 0.0036178420628666095
MeanAbsoluteError value on hold-out data: 0.0466524213552475
Epoch: 107
Loss on hold-out set: 0.0023762033210675184
MeanAbsoluteError value on hold-out data: 0.03679397702217102
Epoch: 108
Loss on hold-out set: 0.007127216723012297
MeanAbsoluteError value on hold-out data: 0.06855949759483337
Epoch: 109
Loss on hold-out set: 0.0032755683090439753
MeanAbsoluteError value on hold-out data: 0.04283033683896065
Epoch: 110
Loss on hold-out set: 0.00816179068121863
MeanAbsoluteError value on hold-out data: 0.0668363943696022
Epoch: 111
Loss on hold-out set: 0.0017868843186940801
MeanAbsoluteError value on hold-out data: 0.03147841617465019
Epoch: 112
Loss on hold-out set: 0.00290117353678828
MeanAbsoluteError value on hold-out data: 0.04307248815894127
Epoch: 113
Loss on hold-out set: 0.0032849092600180916
MeanAbsoluteError value on hold-out data: 0.04773402586579323
Epoch: 114
Loss on hold-out set: 0.006793305473892312
MeanAbsoluteError value on hold-out data: 0.0692690759897232
Epoch: 115
Loss on hold-out set: 0.0024309135195309003
MeanAbsoluteError value on hold-out data: 0.03472533077001572
Epoch: 116
Loss on hold-out set: 0.002495058787692534
MeanAbsoluteError value on hold-out data: 0.036343663930892944
Epoch: 117
Loss on hold-out set: 0.004911392535033979
MeanAbsoluteError value on hold-out data: 0.05500476807355881
Epoch: 118
Loss on hold-out set: 0.0030656098388135433
MeanAbsoluteError value on hold-out data: 0.04191651567816734
Epoch: 119
Loss on hold-out set: 0.004461804208786864
MeanAbsoluteError value on hold-out data: 0.05108734592795372
Epoch: 120
Loss on hold-out set: 0.0061717571837729525
MeanAbsoluteError value on hold-out data: 0.06579316407442093
Epoch: 121
Loss on hold-out set: 0.0047746400201791215
MeanAbsoluteError value on hold-out data: 0.056808874011039734
Epoch: 122
Loss on hold-out set: 0.004506836620796668
MeanAbsoluteError value on hold-out data: 0.04958547279238701
Epoch: 123
Loss on hold-out set: 0.004544438647204324
MeanAbsoluteError value on hold-out data: 0.054375577718019485
Epoch: 124
Loss on hold-out set: 0.009700530184138762
MeanAbsoluteError value on hold-out data: 0.08162858337163925
Epoch: 125
Loss on hold-out set: 0.00544661909684931
MeanAbsoluteError value on hold-out data: 0.055684927850961685
Epoch: 126
Loss on hold-out set: 0.0038902908441071447
MeanAbsoluteError value on hold-out data: 0.04789404198527336
Epoch: 127
Loss on hold-out set: 0.004886112960153504
MeanAbsoluteError value on hold-out data: 0.05182486027479172
Epoch: 128
Loss on hold-out set: 0.0038920050290854355
MeanAbsoluteError value on hold-out data: 0.05201384797692299
Epoch: 129
Loss on hold-out set: 0.0022856158228885186
MeanAbsoluteError value on hold-out data: 0.03332371637225151
Epoch: 130
Loss on hold-out set: 0.0023742198888947698
MeanAbsoluteError value on hold-out data: 0.03659065067768097
Epoch: 131
Loss on hold-out set: 0.005334347658055394
MeanAbsoluteError value on hold-out data: 0.060546234250068665
Epoch: 132
Loss on hold-out set: 0.0015634392299321725
MeanAbsoluteError value on hold-out data: 0.02861679159104824
Epoch: 133
Loss on hold-out set: 0.001997568846778258
MeanAbsoluteError value on hold-out data: 0.030922502279281616
Epoch: 134
Loss on hold-out set: 0.002886946735854604
MeanAbsoluteError value on hold-out data: 0.04284201189875603
Epoch: 135
Loss on hold-out set: 0.00310286415409983
MeanAbsoluteError value on hold-out data: 0.04189164936542511
Epoch: 136
Loss on hold-out set: 0.005570017475340711
MeanAbsoluteError value on hold-out data: 0.06275812536478043
Epoch: 137
Loss on hold-out set: 0.0050600628907743255
MeanAbsoluteError value on hold-out data: 0.0540313720703125
Epoch: 138
Loss on hold-out set: 0.0035598608420083395
MeanAbsoluteError value on hold-out data: 0.049653273075819016
Epoch: 139
Loss on hold-out set: 0.0022553180001283948
MeanAbsoluteError value on hold-out data: 0.034724161028862
Epoch: 140
Loss on hold-out set: 0.002904645455265908
MeanAbsoluteError value on hold-out data: 0.040002427995204926
Epoch: 141
Loss on hold-out set: 0.00344123687644146
MeanAbsoluteError value on hold-out data: 0.045274678617715836
Epoch: 142
Loss on hold-out set: 0.0021026432406966037
MeanAbsoluteError value on hold-out data: 0.032557811588048935
Epoch: 143
Loss on hold-out set: 0.00821710684287705
MeanAbsoluteError value on hold-out data: 0.07941911369562149
Epoch: 144
Loss on hold-out set: 0.003560869819729736
MeanAbsoluteError value on hold-out data: 0.046576667577028275
Epoch: 145
Loss on hold-out set: 0.0075673569287908705
MeanAbsoluteError value on hold-out data: 0.0626969188451767
Epoch: 146
Loss on hold-out set: 0.0021940922352338306
MeanAbsoluteError value on hold-out data: 0.03488607704639435
Epoch: 147
Loss on hold-out set: 0.004868925818683286
MeanAbsoluteError value on hold-out data: 0.059435032308101654
Epoch: 148
Loss on hold-out set: 0.005859389607059329
MeanAbsoluteError value on hold-out data: 0.06336697190999985
Epoch: 149
Loss on hold-out set: 0.0031364135578960963
MeanAbsoluteError value on hold-out data: 0.04506363347172737
Epoch: 150
Loss on hold-out set: 0.013743887067233262
MeanAbsoluteError value on hold-out data: 0.10633803904056549
Epoch: 151
Loss on hold-out set: 0.003437397296932575
MeanAbsoluteError value on hold-out data: 0.04220578446984291
Epoch: 152
Loss on hold-out set: 0.0018799770163911347
MeanAbsoluteError value on hold-out data: 0.030013112351298332
Epoch: 153
Loss on hold-out set: 0.007726805603229686
MeanAbsoluteError value on hold-out data: 0.07664818316698074
Epoch: 154
Loss on hold-out set: 0.0017858353553731974
MeanAbsoluteError value on hold-out data: 0.030273497104644775
Epoch: 155
Loss on hold-out set: 0.007289392714339651
MeanAbsoluteError value on hold-out data: 0.06755734235048294
Epoch: 156
Loss on hold-out set: 0.0020806711154842845
MeanAbsoluteError value on hold-out data: 0.03348277881741524
Epoch: 157
Loss on hold-out set: 0.004325031900263734
MeanAbsoluteError value on hold-out data: 0.04291388392448425
Epoch: 158
Loss on hold-out set: 0.008645231271848866
MeanAbsoluteError value on hold-out data: 0.07533643394708633
Epoch: 159
Loss on hold-out set: 0.008941814303398132
MeanAbsoluteError value on hold-out data: 0.08484239131212234
Epoch: 160
Loss on hold-out set: 0.011540948364295457
MeanAbsoluteError value on hold-out data: 0.0963955894112587
Epoch: 161
Loss on hold-out set: 0.003691524561298521
MeanAbsoluteError value on hold-out data: 0.05338883027434349
Epoch: 162
Loss on hold-out set: 0.005974004425010399
MeanAbsoluteError value on hold-out data: 0.058933600783348083
Epoch: 163
Loss on hold-out set: 0.0028866394300405916
MeanAbsoluteError value on hold-out data: 0.04017362743616104
Epoch: 164
Loss on hold-out set: 0.002442199632672495
MeanAbsoluteError value on hold-out data: 0.0344165600836277
Early stopping at epoch 163
Returned to Spot: Validation loss: 0.002442199632672495
----------------------------------------------

config: {'_L_in': 10, '_L_out': 1, 'l1': 128, 'dropout_prob': 0.8582565260508446, 'lr_mult': 0.4977322453322358, 'batch_size': 2, 'epochs': 32768, 'k_folds': 1, 'patience': 128, 'optimizer': 'ASGD', 'sgd_momentum': 0.6834550718769361}
Epoch: 1
Loss on hold-out set: 0.07015652484590343
MeanAbsoluteError value on hold-out data: 0.21037979423999786
Epoch: 2
Loss on hold-out set: 0.05593298513015422
MeanAbsoluteError value on hold-out data: 0.19045957922935486
Epoch: 3
Loss on hold-out set: 0.04452167635919371
MeanAbsoluteError value on hold-out data: 0.16636089980602264
Epoch: 4
Loss on hold-out set: 0.04063992647720928
MeanAbsoluteError value on hold-out data: 0.16077539324760437
Epoch: 5
Loss on hold-out set: 0.03486201688746708
MeanAbsoluteError value on hold-out data: 0.14719229936599731
Epoch: 6
Loss on hold-out set: 0.03489555946667679
MeanAbsoluteError value on hold-out data: 0.1508200764656067
Epoch: 7
Loss on hold-out set: 0.03231547642879984
MeanAbsoluteError value on hold-out data: 0.14358212053775787
Epoch: 8
Loss on hold-out set: 0.029455706783531543
MeanAbsoluteError value on hold-out data: 0.13851763308048248
Epoch: 9
Loss on hold-out set: 0.030862522829168786
MeanAbsoluteError value on hold-out data: 0.14230285584926605
Epoch: 10
Loss on hold-out set: 0.030658481842062126
MeanAbsoluteError value on hold-out data: 0.14182442426681519
Epoch: 11
Loss on hold-out set: 0.029917036508559248
MeanAbsoluteError value on hold-out data: 0.13933540880680084
Epoch: 12
Loss on hold-out set: 0.02927794676962852
MeanAbsoluteError value on hold-out data: 0.1368902325630188
Epoch: 13
Loss on hold-out set: 0.02911063709044053
MeanAbsoluteError value on hold-out data: 0.1357230842113495
Epoch: 14
Loss on hold-out set: 0.03003860074832725
MeanAbsoluteError value on hold-out data: 0.13929958641529083
Epoch: 15
Loss on hold-out set: 0.026129776038481697
MeanAbsoluteError value on hold-out data: 0.13060061633586884
Epoch: 16
Loss on hold-out set: 0.028531189517040426
MeanAbsoluteError value on hold-out data: 0.13626576960086823
Epoch: 17
Loss on hold-out set: 0.02710760757593865
MeanAbsoluteError value on hold-out data: 0.1303868591785431
Epoch: 18
Loss on hold-out set: 0.027027593371070302
MeanAbsoluteError value on hold-out data: 0.13167138397693634
Epoch: 19
Loss on hold-out set: 0.02939551226484279
MeanAbsoluteError value on hold-out data: 0.13854655623435974
Epoch: 20
Loss on hold-out set: 0.02827342822851885
MeanAbsoluteError value on hold-out data: 0.1341254711151123
Epoch: 21
Loss on hold-out set: 0.02574134070193395
MeanAbsoluteError value on hold-out data: 0.129588782787323
Epoch: 22
Loss on hold-out set: 0.027725653401915528
MeanAbsoluteError value on hold-out data: 0.13340218365192413
Epoch: 23
Loss on hold-out set: 0.028682545318636888
MeanAbsoluteError value on hold-out data: 0.1339399665594101
Epoch: 24
Loss on hold-out set: 0.026356908293285717
MeanAbsoluteError value on hold-out data: 0.13055607676506042
Epoch: 25
Loss on hold-out set: 0.02806145685724914
MeanAbsoluteError value on hold-out data: 0.13466019928455353
Epoch: 26
Loss on hold-out set: 0.026285095950200534
MeanAbsoluteError value on hold-out data: 0.12941662967205048
Epoch: 27
Loss on hold-out set: 0.026573649943553997
MeanAbsoluteError value on hold-out data: 0.13338685035705566
Epoch: 28
Loss on hold-out set: 0.0275312755839938
MeanAbsoluteError value on hold-out data: 0.13262657821178436
Epoch: 29
Loss on hold-out set: 0.026917179116038217
MeanAbsoluteError value on hold-out data: 0.13035152852535248
Epoch: 30
Loss on hold-out set: 0.027532424384650464
MeanAbsoluteError value on hold-out data: 0.1334734410047531
Epoch: 31
Loss on hold-out set: 0.027722181984378647
MeanAbsoluteError value on hold-out data: 0.13380184769630432
Epoch: 32
Loss on hold-out set: 0.028381522397200265
MeanAbsoluteError value on hold-out data: 0.13704814016819
Epoch: 33
Loss on hold-out set: 0.02712161470806071
MeanAbsoluteError value on hold-out data: 0.13237330317497253
Epoch: 34
Loss on hold-out set: 0.027073075135510105
MeanAbsoluteError value on hold-out data: 0.13228784501552582
Epoch: 35
Loss on hold-out set: 0.0275012705672998
MeanAbsoluteError value on hold-out data: 0.1348523050546646
Epoch: 36
Loss on hold-out set: 0.026596950293327003
MeanAbsoluteError value on hold-out data: 0.1307557374238968
Epoch: 37
Loss on hold-out set: 0.03021235986185881
MeanAbsoluteError value on hold-out data: 0.13681386411190033
Epoch: 38
Loss on hold-out set: 0.026739324040536302
MeanAbsoluteError value on hold-out data: 0.13014526665210724
Epoch: 39
Loss on hold-out set: 0.027429156876557195
MeanAbsoluteError value on hold-out data: 0.1311652511358261
Epoch: 40
Loss on hold-out set: 0.025296570133359637
MeanAbsoluteError value on hold-out data: 0.12762439250946045
Epoch: 41
Loss on hold-out set: 0.027976215480982017
MeanAbsoluteError value on hold-out data: 0.1342136710882187
Epoch: 42
Loss on hold-out set: 0.026670043651944676
MeanAbsoluteError value on hold-out data: 0.1320599466562271
Epoch: 43
Loss on hold-out set: 0.028029223982593977
MeanAbsoluteError value on hold-out data: 0.13528354465961456
Epoch: 44
Loss on hold-out set: 0.026950469674387325
MeanAbsoluteError value on hold-out data: 0.13207100331783295
Epoch: 45
Loss on hold-out set: 0.025839191602826758
MeanAbsoluteError value on hold-out data: 0.12845946848392487
Epoch: 46
Loss on hold-out set: 0.027625145355220107
MeanAbsoluteError value on hold-out data: 0.13102219998836517
Epoch: 47
Loss on hold-out set: 0.026454858483048155
MeanAbsoluteError value on hold-out data: 0.1302591860294342
Epoch: 48
Loss on hold-out set: 0.028254795866038573
MeanAbsoluteError value on hold-out data: 0.13371741771697998
Epoch: 49
Loss on hold-out set: 0.02714617465060049
MeanAbsoluteError value on hold-out data: 0.13199086487293243
Epoch: 50
Loss on hold-out set: 0.025775854587263895
MeanAbsoluteError value on hold-out data: 0.12794260680675507
Epoch: 51
Loss on hold-out set: 0.026227447741645545
MeanAbsoluteError value on hold-out data: 0.12839296460151672
Epoch: 52
Loss on hold-out set: 0.02735351926103855
MeanAbsoluteError value on hold-out data: 0.1322803944349289
Epoch: 53
Loss on hold-out set: 0.027475151052494765
MeanAbsoluteError value on hold-out data: 0.13258075714111328
Epoch: 54
Loss on hold-out set: 0.026547290301144433
MeanAbsoluteError value on hold-out data: 0.13148078322410583
Epoch: 55
Loss on hold-out set: 0.027111835055184202
MeanAbsoluteError value on hold-out data: 0.131748229265213
Epoch: 56
Loss on hold-out set: 0.028062213183220594
MeanAbsoluteError value on hold-out data: 0.1345800906419754
Epoch: 57
Loss on hold-out set: 0.0274783627782017
MeanAbsoluteError value on hold-out data: 0.13372090458869934
Epoch: 58
Loss on hold-out set: 0.026652635201850596
MeanAbsoluteError value on hold-out data: 0.1292378306388855
Epoch: 59
Loss on hold-out set: 0.026525728789468607
MeanAbsoluteError value on hold-out data: 0.13154733180999756
Epoch: 60
Loss on hold-out set: 0.026810968213928088
MeanAbsoluteError value on hold-out data: 0.1304389238357544
Epoch: 61
Loss on hold-out set: 0.026200732074988384
MeanAbsoluteError value on hold-out data: 0.1309666931629181
Epoch: 62
Loss on hold-out set: 0.026906112749008268
MeanAbsoluteError value on hold-out data: 0.13053253293037415
Epoch: 63
Loss on hold-out set: 0.02911974117838933
MeanAbsoluteError value on hold-out data: 0.13657905161380768
Epoch: 64
Loss on hold-out set: 0.026645900165846493
MeanAbsoluteError value on hold-out data: 0.13185741007328033
Epoch: 65
Loss on hold-out set: 0.026095351862701743
MeanAbsoluteError value on hold-out data: 0.13091115653514862
Epoch: 66
Loss on hold-out set: 0.027373296105943155
MeanAbsoluteError value on hold-out data: 0.1316385567188263
Epoch: 67
Loss on hold-out set: 0.026991281922285757
MeanAbsoluteError value on hold-out data: 0.13036470115184784
Epoch: 68
Loss on hold-out set: 0.028028136218975607
MeanAbsoluteError value on hold-out data: 0.1348019391298294
Epoch: 69
Loss on hold-out set: 0.027139658862142823
MeanAbsoluteError value on hold-out data: 0.13317818939685822
Epoch: 70
Loss on hold-out set: 0.027682760358244803
MeanAbsoluteError value on hold-out data: 0.1333046853542328
Epoch: 71
Loss on hold-out set: 0.02537700246781848
MeanAbsoluteError value on hold-out data: 0.12894387543201447
Epoch: 72
Loss on hold-out set: 0.02635588136841155
MeanAbsoluteError value on hold-out data: 0.12835636734962463
Epoch: 73
Loss on hold-out set: 0.026663258426512283
MeanAbsoluteError value on hold-out data: 0.13073492050170898
Epoch: 74
Loss on hold-out set: 0.027161437009926886
MeanAbsoluteError value on hold-out data: 0.1323106586933136
Epoch: 75
Loss on hold-out set: 0.02490365806365541
MeanAbsoluteError value on hold-out data: 0.12670113146305084
Epoch: 76
Loss on hold-out set: 0.02924396338838657
MeanAbsoluteError value on hold-out data: 0.13678507506847382
Epoch: 77
Loss on hold-out set: 0.025673199364391622
MeanAbsoluteError value on hold-out data: 0.12830409407615662
Epoch: 78
Loss on hold-out set: 0.026183621982151333
MeanAbsoluteError value on hold-out data: 0.1323140263557434
Epoch: 79
Loss on hold-out set: 0.027667703143476198
MeanAbsoluteError value on hold-out data: 0.13511060178279877
Epoch: 80
Loss on hold-out set: 0.02629119502045796
MeanAbsoluteError value on hold-out data: 0.12925291061401367
Epoch: 81
Loss on hold-out set: 0.02623063484657905
MeanAbsoluteError value on hold-out data: 0.12831905484199524
Epoch: 82
Loss on hold-out set: 0.02689965840509103
MeanAbsoluteError value on hold-out data: 0.13092444837093353
Epoch: 83
Loss on hold-out set: 0.026553540036159878
MeanAbsoluteError value on hold-out data: 0.13106544315814972
Epoch: 84
Loss on hold-out set: 0.02587279093359636
MeanAbsoluteError value on hold-out data: 0.1297226995229721
Epoch: 85
Loss on hold-out set: 0.027479607273611085
MeanAbsoluteError value on hold-out data: 0.13274134695529938
Epoch: 86
Loss on hold-out set: 0.024980708951091703
MeanAbsoluteError value on hold-out data: 0.12495958060026169
Epoch: 87
Loss on hold-out set: 0.027524308423356462
MeanAbsoluteError value on hold-out data: 0.13170790672302246
Epoch: 88
Loss on hold-out set: 0.026236503470960695
MeanAbsoluteError value on hold-out data: 0.1301235556602478
Epoch: 89
Loss on hold-out set: 0.02644532933520774
MeanAbsoluteError value on hold-out data: 0.1295141726732254
Epoch: 90
Loss on hold-out set: 0.02563621427572798
MeanAbsoluteError value on hold-out data: 0.12785157561302185
Epoch: 91
Loss on hold-out set: 0.026731511798958916
MeanAbsoluteError value on hold-out data: 0.130771666765213
Epoch: 92
Loss on hold-out set: 0.024617250244676446
MeanAbsoluteError value on hold-out data: 0.12561295926570892
Epoch: 93
Loss on hold-out set: 0.02696243114619089
MeanAbsoluteError value on hold-out data: 0.13070270419120789
Epoch: 94
Loss on hold-out set: 0.02614330208860338
MeanAbsoluteError value on hold-out data: 0.13131046295166016
Epoch: 95
Loss on hold-out set: 0.025463000853196718
MeanAbsoluteError value on hold-out data: 0.1293845921754837
Epoch: 96
Loss on hold-out set: 0.026116079177785044
MeanAbsoluteError value on hold-out data: 0.1307147592306137
Epoch: 97
Loss on hold-out set: 0.026196348445373586
MeanAbsoluteError value on hold-out data: 0.1297415941953659
Epoch: 98
Loss on hold-out set: 0.026997608410650475
MeanAbsoluteError value on hold-out data: 0.13237746059894562
Epoch: 99
Loss on hold-out set: 0.026098760843718385
MeanAbsoluteError value on hold-out data: 0.1283368617296219
Epoch: 100
Loss on hold-out set: 0.024479309266898782
MeanAbsoluteError value on hold-out data: 0.1263207495212555
Epoch: 101
Loss on hold-out set: 0.02522566007479327
MeanAbsoluteError value on hold-out data: 0.12699948251247406
Epoch: 102
Loss on hold-out set: 0.02658737533847064
MeanAbsoluteError value on hold-out data: 0.13233350217342377
Epoch: 103
Loss on hold-out set: 0.024888101002822318
MeanAbsoluteError value on hold-out data: 0.12703649699687958
Epoch: 104
Loss on hold-out set: 0.025599720055033685
MeanAbsoluteError value on hold-out data: 0.12881788611412048
Epoch: 105
Loss on hold-out set: 0.024385904702794507
MeanAbsoluteError value on hold-out data: 0.1258431375026703
Epoch: 106
Loss on hold-out set: 0.025550228432124036
MeanAbsoluteError value on hold-out data: 0.1275002658367157
Epoch: 107
Loss on hold-out set: 0.02515750142900894
MeanAbsoluteError value on hold-out data: 0.12606732547283173
Epoch: 108
Loss on hold-out set: 0.023995031557763773
MeanAbsoluteError value on hold-out data: 0.12416109442710876
Epoch: 109
Loss on hold-out set: 0.02532391315990632
MeanAbsoluteError value on hold-out data: 0.1259363740682602
Epoch: 110
Loss on hold-out set: 0.02521208421026434
MeanAbsoluteError value on hold-out data: 0.12723369896411896
Epoch: 111
Loss on hold-out set: 0.025602661972758747
MeanAbsoluteError value on hold-out data: 0.12887293100357056
Epoch: 112
Loss on hold-out set: 0.025254659181518944
MeanAbsoluteError value on hold-out data: 0.12820671498775482
Epoch: 113
Loss on hold-out set: 0.024694879985860705
MeanAbsoluteError value on hold-out data: 0.12479109317064285
Epoch: 114
Loss on hold-out set: 0.02660858361166902
MeanAbsoluteError value on hold-out data: 0.13444636762142181
Epoch: 115
Loss on hold-out set: 0.027731715066862915
MeanAbsoluteError value on hold-out data: 0.13407747447490692
Epoch: 116
Loss on hold-out set: 0.025849573013062278
MeanAbsoluteError value on hold-out data: 0.1286136955022812
Epoch: 117
Loss on hold-out set: 0.026105292769837737
MeanAbsoluteError value on hold-out data: 0.13059206306934357
Epoch: 118
Loss on hold-out set: 0.02578633297108657
MeanAbsoluteError value on hold-out data: 0.12901423871517181
Epoch: 119
Loss on hold-out set: 0.02758412237977609
MeanAbsoluteError value on hold-out data: 0.1334642916917801
Epoch: 120
Loss on hold-out set: 0.025743833038873162
MeanAbsoluteError value on hold-out data: 0.1288500279188156
Epoch: 121
Loss on hold-out set: 0.02704004743718542
MeanAbsoluteError value on hold-out data: 0.12911376357078552
Epoch: 122
Loss on hold-out set: 0.025858213774263276
MeanAbsoluteError value on hold-out data: 0.12916548550128937
Epoch: 123
Loss on hold-out set: 0.025198182569195825
MeanAbsoluteError value on hold-out data: 0.12634247541427612
Epoch: 124
Loss on hold-out set: 0.02695869012910407
MeanAbsoluteError value on hold-out data: 0.13196615874767303
Epoch: 125
Loss on hold-out set: 0.025775082239803546
MeanAbsoluteError value on hold-out data: 0.1287539303302765
Epoch: 126
Loss on hold-out set: 0.02631357599844705
MeanAbsoluteError value on hold-out data: 0.12686997652053833
Epoch: 127
Loss on hold-out set: 0.026023233436474887
MeanAbsoluteError value on hold-out data: 0.13240979611873627
Epoch: 128
Loss on hold-out set: 0.024282099628314124
MeanAbsoluteError value on hold-out data: 0.12469007819890976
Epoch: 129
Loss on hold-out set: 0.024871447325955767
MeanAbsoluteError value on hold-out data: 0.12628598511219025
Epoch: 130
Loss on hold-out set: 0.0262837332404888
MeanAbsoluteError value on hold-out data: 0.12938135862350464
Epoch: 131
Loss on hold-out set: 0.025439588979740316
MeanAbsoluteError value on hold-out data: 0.1283777356147766
Epoch: 132
Loss on hold-out set: 0.025320995629202418
MeanAbsoluteError value on hold-out data: 0.12868624925613403
Epoch: 133
Loss on hold-out set: 0.02540975956202601
MeanAbsoluteError value on hold-out data: 0.130036860704422
Epoch: 134
Loss on hold-out set: 0.027319462508894502
MeanAbsoluteError value on hold-out data: 0.13340936601161957
Epoch: 135
Loss on hold-out set: 0.025762302179209655
MeanAbsoluteError value on hold-out data: 0.12778763473033905
Epoch: 136
Loss on hold-out set: 0.025625603722680048
MeanAbsoluteError value on hold-out data: 0.12567904591560364
Epoch: 137
Loss on hold-out set: 0.02618820842646528
MeanAbsoluteError value on hold-out data: 0.13162316381931305
Epoch: 138
Loss on hold-out set: 0.025108869581769493
MeanAbsoluteError value on hold-out data: 0.1261584311723709
Epoch: 139
Loss on hold-out set: 0.025975137866237976
MeanAbsoluteError value on hold-out data: 0.12900397181510925
Epoch: 140
Loss on hold-out set: 0.026001797971354487
MeanAbsoluteError value on hold-out data: 0.13026343286037445
Epoch: 141
Loss on hold-out set: 0.02698390036480608
MeanAbsoluteError value on hold-out data: 0.13174644112586975
Epoch: 142
Loss on hold-out set: 0.025047144431417413
MeanAbsoluteError value on hold-out data: 0.12681297957897186
Epoch: 143
Loss on hold-out set: 0.026662429423595313
MeanAbsoluteError value on hold-out data: 0.1312812864780426
Epoch: 144
Loss on hold-out set: 0.02729188411295278
MeanAbsoluteError value on hold-out data: 0.13259519636631012
Epoch: 145
Loss on hold-out set: 0.02491351835021002
MeanAbsoluteError value on hold-out data: 0.1238599494099617
Epoch: 146
Loss on hold-out set: 0.0246945590681086
MeanAbsoluteError value on hold-out data: 0.1268114596605301
Epoch: 147
Loss on hold-out set: 0.023672429658084488
MeanAbsoluteError value on hold-out data: 0.12360824644565582
Epoch: 148
Loss on hold-out set: 0.026033741527280652
MeanAbsoluteError value on hold-out data: 0.12943057715892792
Epoch: 149
Loss on hold-out set: 0.02590201046031628
MeanAbsoluteError value on hold-out data: 0.12996532022953033
Epoch: 150
Loss on hold-out set: 0.02483003911280927
MeanAbsoluteError value on hold-out data: 0.1264764815568924
Epoch: 151
Loss on hold-out set: 0.025994858473568458
MeanAbsoluteError value on hold-out data: 0.1292797476053238
Epoch: 152
Loss on hold-out set: 0.025356934764616503
MeanAbsoluteError value on hold-out data: 0.12704439461231232
Epoch: 153
Loss on hold-out set: 0.026620715580162747
MeanAbsoluteError value on hold-out data: 0.1293075978755951
Epoch: 154
Loss on hold-out set: 0.025629019651957304
MeanAbsoluteError value on hold-out data: 0.12647554278373718
Epoch: 155
Loss on hold-out set: 0.025213181083866706
MeanAbsoluteError value on hold-out data: 0.1265910267829895
Epoch: 156
Loss on hold-out set: 0.02501770026011703
MeanAbsoluteError value on hold-out data: 0.12733373045921326
Epoch: 157
Loss on hold-out set: 0.023208913223061244
MeanAbsoluteError value on hold-out data: 0.12356086820363998
Epoch: 158
Loss on hold-out set: 0.026331979636937224
MeanAbsoluteError value on hold-out data: 0.13112206757068634
Epoch: 159
Loss on hold-out set: 0.025373111865483224
MeanAbsoluteError value on hold-out data: 0.12704788148403168
Epoch: 160
Loss on hold-out set: 0.0244453612938014
MeanAbsoluteError value on hold-out data: 0.12335014343261719
Epoch: 161
Loss on hold-out set: 0.025752298891893587
MeanAbsoluteError value on hold-out data: 0.12644392251968384
Epoch: 162
Loss on hold-out set: 0.025726831447391307
MeanAbsoluteError value on hold-out data: 0.1255757212638855
Epoch: 163
Loss on hold-out set: 0.025756753696114174
MeanAbsoluteError value on hold-out data: 0.12692105770111084
Epoch: 164
Loss on hold-out set: 0.02449417158253103
MeanAbsoluteError value on hold-out data: 0.1258159726858139
Epoch: 165
Loss on hold-out set: 0.02476217939615405
MeanAbsoluteError value on hold-out data: 0.12555280327796936
Epoch: 166
Loss on hold-out set: 0.02641927201359067
MeanAbsoluteError value on hold-out data: 0.13173727691173553
Epoch: 167
Loss on hold-out set: 0.02447256200791647
MeanAbsoluteError value on hold-out data: 0.12692669034004211
Epoch: 168
Loss on hold-out set: 0.025627354521032732
MeanAbsoluteError value on hold-out data: 0.12714850902557373
Epoch: 169
Loss on hold-out set: 0.024582125333836302
MeanAbsoluteError value on hold-out data: 0.12646079063415527
Epoch: 170
Loss on hold-out set: 0.023451570346951486
MeanAbsoluteError value on hold-out data: 0.12106004357337952
Epoch: 171
Loss on hold-out set: 0.025417615718518694
MeanAbsoluteError value on hold-out data: 0.1261674463748932
Epoch: 172
Loss on hold-out set: 0.025579316531220683
MeanAbsoluteError value on hold-out data: 0.1265944093465805
Epoch: 173
Loss on hold-out set: 0.025356326926654824
MeanAbsoluteError value on hold-out data: 0.12670327723026276
Epoch: 174
Loss on hold-out set: 0.0243252309395272
MeanAbsoluteError value on hold-out data: 0.12380259484052658
Epoch: 175
Loss on hold-out set: 0.021985668325893735
MeanAbsoluteError value on hold-out data: 0.11854875832796097
Epoch: 176
Loss on hold-out set: 0.025345253211756548
MeanAbsoluteError value on hold-out data: 0.12678810954093933
Epoch: 177
Loss on hold-out set: 0.02451430987411489
MeanAbsoluteError value on hold-out data: 0.12777195870876312
Epoch: 178
Loss on hold-out set: 0.024588651158846914
MeanAbsoluteError value on hold-out data: 0.1243734210729599
Epoch: 179
Loss on hold-out set: 0.023935369169339537
MeanAbsoluteError value on hold-out data: 0.12123256921768188
Epoch: 180
Loss on hold-out set: 0.02443427387624979
MeanAbsoluteError value on hold-out data: 0.12754791975021362
Epoch: 181
Loss on hold-out set: 0.0256067277204905
MeanAbsoluteError value on hold-out data: 0.12948589026927948
Epoch: 182
Loss on hold-out set: 0.023566897989221614
MeanAbsoluteError value on hold-out data: 0.12410493195056915
Epoch: 183
Loss on hold-out set: 0.02369332681167483
MeanAbsoluteError value on hold-out data: 0.12360214442014694
Epoch: 184
Loss on hold-out set: 0.024333944968724004
MeanAbsoluteError value on hold-out data: 0.12293574213981628
Epoch: 185
Loss on hold-out set: 0.023200245489667093
MeanAbsoluteError value on hold-out data: 0.1218806803226471
Epoch: 186
Loss on hold-out set: 0.024671346992448284
MeanAbsoluteError value on hold-out data: 0.12697726488113403
Epoch: 187
Loss on hold-out set: 0.023617401303199587
MeanAbsoluteError value on hold-out data: 0.12148265540599823
Epoch: 188
Loss on hold-out set: 0.024558660603991787
MeanAbsoluteError value on hold-out data: 0.12380512058734894
Epoch: 189
Loss on hold-out set: 0.025083465937592943
MeanAbsoluteError value on hold-out data: 0.12831495702266693
Epoch: 190
Loss on hold-out set: 0.024210689195315355
MeanAbsoluteError value on hold-out data: 0.1266104280948639
Epoch: 191
Loss on hold-out set: 0.02567102611940451
MeanAbsoluteError value on hold-out data: 0.1267555058002472
Epoch: 192
Loss on hold-out set: 0.02393911635192732
MeanAbsoluteError value on hold-out data: 0.12291956692934036
Epoch: 193
Loss on hold-out set: 0.024442520145482073
MeanAbsoluteError value on hold-out data: 0.12779399752616882
Epoch: 194
Loss on hold-out set: 0.02501750871553668
MeanAbsoluteError value on hold-out data: 0.1253117024898529
Epoch: 195
Loss on hold-out set: 0.024350580983640006
MeanAbsoluteError value on hold-out data: 0.1253483146429062
Epoch: 196
Loss on hold-out set: 0.02489719005068764
MeanAbsoluteError value on hold-out data: 0.1263362616300583
Epoch: 197
Loss on hold-out set: 0.02467438868431297
MeanAbsoluteError value on hold-out data: 0.12540803849697113
Epoch: 198
Loss on hold-out set: 0.024415599374333397
MeanAbsoluteError value on hold-out data: 0.1253628432750702
Epoch: 199
Loss on hold-out set: 0.02496466974436771
MeanAbsoluteError value on hold-out data: 0.12656329572200775
Epoch: 200
Loss on hold-out set: 0.024600857255015096
MeanAbsoluteError value on hold-out data: 0.12715421617031097
Epoch: 201
Loss on hold-out set: 0.023740253508246194
MeanAbsoluteError value on hold-out data: 0.12328919768333435
Epoch: 202
Loss on hold-out set: 0.025048021778347904
MeanAbsoluteError value on hold-out data: 0.12775254249572754
Epoch: 203
Loss on hold-out set: 0.022284958639065735
MeanAbsoluteError value on hold-out data: 0.12085885554552078
Epoch: 204
Loss on hold-out set: 0.025023564496659673
MeanAbsoluteError value on hold-out data: 0.1281086504459381
Epoch: 205
Loss on hold-out set: 0.024216181644781804
MeanAbsoluteError value on hold-out data: 0.12438660860061646
Epoch: 206
Loss on hold-out set: 0.02418965316620112
MeanAbsoluteError value on hold-out data: 0.12554816901683807
Epoch: 207
Loss on hold-out set: 0.02253275437821382
MeanAbsoluteError value on hold-out data: 0.1201193779706955
Epoch: 208
Loss on hold-out set: 0.02403694740103674
MeanAbsoluteError value on hold-out data: 0.12660375237464905
Epoch: 209
Loss on hold-out set: 0.023540881374598636
MeanAbsoluteError value on hold-out data: 0.12316291779279709
Epoch: 210
Loss on hold-out set: 0.02301045627920151
MeanAbsoluteError value on hold-out data: 0.12028613686561584
Epoch: 211
Loss on hold-out set: 0.025344707071296095
MeanAbsoluteError value on hold-out data: 0.12780174612998962
Epoch: 212
Loss on hold-out set: 0.023481236162090986
MeanAbsoluteError value on hold-out data: 0.12381868809461594
Epoch: 213
Loss on hold-out set: 0.023698539668063557
MeanAbsoluteError value on hold-out data: 0.122614786028862
Epoch: 214
Loss on hold-out set: 0.023682534741819836
MeanAbsoluteError value on hold-out data: 0.11971291899681091
Epoch: 215
Loss on hold-out set: 0.02404723417789986
MeanAbsoluteError value on hold-out data: 0.12589779496192932
Epoch: 216
Loss on hold-out set: 0.024459509392036127
MeanAbsoluteError value on hold-out data: 0.1270417720079422
Epoch: 217
Loss on hold-out set: 0.022697116608857565
MeanAbsoluteError value on hold-out data: 0.1228187158703804
Epoch: 218
Loss on hold-out set: 0.024970404951115296
MeanAbsoluteError value on hold-out data: 0.12584486603736877
Epoch: 219
Loss on hold-out set: 0.026014423308767316
MeanAbsoluteError value on hold-out data: 0.12694406509399414
Epoch: 220
Loss on hold-out set: 0.023591160456320117
MeanAbsoluteError value on hold-out data: 0.12380281090736389
Epoch: 221
Loss on hold-out set: 0.022659389311253716
MeanAbsoluteError value on hold-out data: 0.1197587102651596
Epoch: 222
Loss on hold-out set: 0.024352691012706297
MeanAbsoluteError value on hold-out data: 0.12468573451042175
Epoch: 223
Loss on hold-out set: 0.024012701111302402
MeanAbsoluteError value on hold-out data: 0.12426793575286865
Epoch: 224
Loss on hold-out set: 0.024032797290031643
MeanAbsoluteError value on hold-out data: 0.12426687777042389
Epoch: 225
Loss on hold-out set: 0.0240967767945646
MeanAbsoluteError value on hold-out data: 0.12385816872119904
Epoch: 226
Loss on hold-out set: 0.024350132662414883
MeanAbsoluteError value on hold-out data: 0.12260220944881439
Epoch: 227
Loss on hold-out set: 0.023067742869219122
MeanAbsoluteError value on hold-out data: 0.12251842767000198
Epoch: 228
Loss on hold-out set: 0.022607006659770074
MeanAbsoluteError value on hold-out data: 0.120975561439991
Epoch: 229
Loss on hold-out set: 0.024380026052143268
MeanAbsoluteError value on hold-out data: 0.12267258018255234
Epoch: 230
Loss on hold-out set: 0.022857551542110742
MeanAbsoluteError value on hold-out data: 0.12085090577602386
Epoch: 231
Loss on hold-out set: 0.024402608347154454
MeanAbsoluteError value on hold-out data: 0.12533792853355408
Epoch: 232
Loss on hold-out set: 0.0239667580157402
MeanAbsoluteError value on hold-out data: 0.1227579116821289
Epoch: 233
Loss on hold-out set: 0.02377364028148198
MeanAbsoluteError value on hold-out data: 0.12263183295726776
Epoch: 234
Loss on hold-out set: 0.023473615392576905
MeanAbsoluteError value on hold-out data: 0.12350838631391525
Epoch: 235
Loss on hold-out set: 0.02205092747618134
MeanAbsoluteError value on hold-out data: 0.12047724425792694
Epoch: 236
Loss on hold-out set: 0.023667391970617853
MeanAbsoluteError value on hold-out data: 0.12270054221153259
Epoch: 237
Loss on hold-out set: 0.022132363667187748
MeanAbsoluteError value on hold-out data: 0.11930712312459946
Epoch: 238
Loss on hold-out set: 0.022259157819401784
MeanAbsoluteError value on hold-out data: 0.12156432121992111
Epoch: 239
Loss on hold-out set: 0.02329278698739169
MeanAbsoluteError value on hold-out data: 0.12257644534111023
Epoch: 240
Loss on hold-out set: 0.021775195354809207
MeanAbsoluteError value on hold-out data: 0.1177767813205719
Epoch: 241
Loss on hold-out set: 0.024811067805470276
MeanAbsoluteError value on hold-out data: 0.12478645145893097
Epoch: 242
Loss on hold-out set: 0.02259714017475441
MeanAbsoluteError value on hold-out data: 0.12112224847078323
Epoch: 243
Loss on hold-out set: 0.022854700549360132
MeanAbsoluteError value on hold-out data: 0.1200013980269432
Epoch: 244
Loss on hold-out set: 0.02356973481718645
MeanAbsoluteError value on hold-out data: 0.12241309881210327
Epoch: 245
Loss on hold-out set: 0.023931837311635416
MeanAbsoluteError value on hold-out data: 0.12494789063930511
Epoch: 246
Loss on hold-out set: 0.02202692065446172
MeanAbsoluteError value on hold-out data: 0.11692237854003906
Epoch: 247
Loss on hold-out set: 0.02272966408849849
MeanAbsoluteError value on hold-out data: 0.12027686089277267
Epoch: 248
Loss on hold-out set: 0.021899491203851842
MeanAbsoluteError value on hold-out data: 0.11722991615533829
Epoch: 249
Loss on hold-out set: 0.0241051366951433
MeanAbsoluteError value on hold-out data: 0.12352320551872253
Epoch: 250
Loss on hold-out set: 0.021676002815699272
MeanAbsoluteError value on hold-out data: 0.11952350288629532
Epoch: 251
Loss on hold-out set: 0.02358679726603441
MeanAbsoluteError value on hold-out data: 0.1223079189658165
Epoch: 252
Loss on hold-out set: 0.023447111875478488
MeanAbsoluteError value on hold-out data: 0.1237075924873352
Epoch: 253
Loss on hold-out set: 0.021884290218780127
MeanAbsoluteError value on hold-out data: 0.11965012550354004
Epoch: 254
Loss on hold-out set: 0.022231621500686742
MeanAbsoluteError value on hold-out data: 0.12120842188596725
Epoch: 255
Loss on hold-out set: 0.025036282165553227
MeanAbsoluteError value on hold-out data: 0.1263388693332672
Epoch: 256
Loss on hold-out set: 0.02119450255840396
MeanAbsoluteError value on hold-out data: 0.11643030494451523
Epoch: 257
Loss on hold-out set: 0.02429967206141252
MeanAbsoluteError value on hold-out data: 0.12307323515415192
Epoch: 258
Loss on hold-out set: 0.02247865036595613
MeanAbsoluteError value on hold-out data: 0.11995235085487366
Epoch: 259
Loss on hold-out set: 0.02239756144990679
MeanAbsoluteError value on hold-out data: 0.11909807473421097
Epoch: 260
Loss on hold-out set: 0.023992487018573837
MeanAbsoluteError value on hold-out data: 0.12408445030450821
Epoch: 261
Loss on hold-out set: 0.02198662817895335
MeanAbsoluteError value on hold-out data: 0.11885061860084534
Epoch: 262
Loss on hold-out set: 0.02352129132739113
MeanAbsoluteError value on hold-out data: 0.1248118057847023
Epoch: 263
Loss on hold-out set: 0.02329955815599533
MeanAbsoluteError value on hold-out data: 0.12492575496435165
Epoch: 264
Loss on hold-out set: 0.02410616594463742
MeanAbsoluteError value on hold-out data: 0.12611401081085205
Epoch: 265
Loss on hold-out set: 0.02236117697621618
MeanAbsoluteError value on hold-out data: 0.12188175320625305
Epoch: 266
Loss on hold-out set: 0.022594070422055666
MeanAbsoluteError value on hold-out data: 0.12029655277729034
Epoch: 267
Loss on hold-out set: 0.021535032514463336
MeanAbsoluteError value on hold-out data: 0.11599074304103851
Epoch: 268
Loss on hold-out set: 0.022071868365455886
MeanAbsoluteError value on hold-out data: 0.11989062279462814
Epoch: 269
Loss on hold-out set: 0.020802710171750127
MeanAbsoluteError value on hold-out data: 0.11414074152708054
Epoch: 270
Loss on hold-out set: 0.022945216154136385
MeanAbsoluteError value on hold-out data: 0.12029207497835159
Epoch: 271
Loss on hold-out set: 0.02210625787556637
MeanAbsoluteError value on hold-out data: 0.11614689975976944
Epoch: 272
Loss on hold-out set: 0.020907503946909857
MeanAbsoluteError value on hold-out data: 0.11211550235748291
Epoch: 273
Loss on hold-out set: 0.021463737001953025
MeanAbsoluteError value on hold-out data: 0.11529586464166641
Epoch: 274
Loss on hold-out set: 0.02188758145503622
MeanAbsoluteError value on hold-out data: 0.11921438574790955
Epoch: 275
Loss on hold-out set: 0.023358859418331122
MeanAbsoluteError value on hold-out data: 0.12369062751531601
Epoch: 276
Loss on hold-out set: 0.022094929155306697
MeanAbsoluteError value on hold-out data: 0.11889082938432693
Epoch: 277
Loss on hold-out set: 0.02284931741445689
MeanAbsoluteError value on hold-out data: 0.12170343846082687
Epoch: 278
Loss on hold-out set: 0.02360770120518282
MeanAbsoluteError value on hold-out data: 0.12280023097991943
Epoch: 279
Loss on hold-out set: 0.022368406399376303
MeanAbsoluteError value on hold-out data: 0.11661069095134735
Epoch: 280
Loss on hold-out set: 0.02448157634624901
MeanAbsoluteError value on hold-out data: 0.12716899812221527
Epoch: 281
Loss on hold-out set: 0.022260331192907566
MeanAbsoluteError value on hold-out data: 0.11899366974830627
Epoch: 282
Loss on hold-out set: 0.021228509390700007
MeanAbsoluteError value on hold-out data: 0.11556041985750198
Epoch: 283
Loss on hold-out set: 0.02432537317664052
MeanAbsoluteError value on hold-out data: 0.12497817724943161
Epoch: 284
Loss on hold-out set: 0.020291006806267737
MeanAbsoluteError value on hold-out data: 0.11527597159147263
Epoch: 285
Loss on hold-out set: 0.022640862938569626
MeanAbsoluteError value on hold-out data: 0.11795234680175781
Epoch: 286
Loss on hold-out set: 0.021266101466996284
MeanAbsoluteError value on hold-out data: 0.11980466544628143
Epoch: 287
Loss on hold-out set: 0.021369637874740874
MeanAbsoluteError value on hold-out data: 0.11600775271654129
Epoch: 288
Loss on hold-out set: 0.022171092659844665
MeanAbsoluteError value on hold-out data: 0.12129394710063934
Epoch: 289
Loss on hold-out set: 0.018700393905795257
MeanAbsoluteError value on hold-out data: 0.1091577410697937
Epoch: 290
Loss on hold-out set: 0.021723329662975934
MeanAbsoluteError value on hold-out data: 0.11623236536979675
Epoch: 291
Loss on hold-out set: 0.019849524474387484
MeanAbsoluteError value on hold-out data: 0.11293575167655945
Epoch: 292
Loss on hold-out set: 0.022558602114440874
MeanAbsoluteError value on hold-out data: 0.12272768467664719
Epoch: 293
Loss on hold-out set: 0.021356866067120183
MeanAbsoluteError value on hold-out data: 0.11697392910718918
Epoch: 294
Loss on hold-out set: 0.024094398951371356
MeanAbsoluteError value on hold-out data: 0.12702088057994843
Epoch: 295
Loss on hold-out set: 0.022874528599107484
MeanAbsoluteError value on hold-out data: 0.12187127768993378
Epoch: 296
Loss on hold-out set: 0.023610323429456914
MeanAbsoluteError value on hold-out data: 0.12309371680021286
Epoch: 297
Loss on hold-out set: 0.021872223833634054
MeanAbsoluteError value on hold-out data: 0.11795180290937424
Epoch: 298
Loss on hold-out set: 0.02151740744059983
MeanAbsoluteError value on hold-out data: 0.11922755837440491
Epoch: 299
Loss on hold-out set: 0.021438606900046578
MeanAbsoluteError value on hold-out data: 0.1149507686495781
Epoch: 300
Loss on hold-out set: 0.02292541093750818
MeanAbsoluteError value on hold-out data: 0.11905297636985779
Epoch: 301
Loss on hold-out set: 0.021547842183693624
MeanAbsoluteError value on hold-out data: 0.12085166573524475
Epoch: 302
Loss on hold-out set: 0.022123888038889466
MeanAbsoluteError value on hold-out data: 0.1212693303823471
Epoch: 303
Loss on hold-out set: 0.0205013505423752
MeanAbsoluteError value on hold-out data: 0.11581120640039444
Epoch: 304
Loss on hold-out set: 0.022647724096653596
MeanAbsoluteError value on hold-out data: 0.11962815374135971
Epoch: 305
Loss on hold-out set: 0.02053437533865993
MeanAbsoluteError value on hold-out data: 0.11698078364133835
Epoch: 306
Loss on hold-out set: 0.020948966019786894
MeanAbsoluteError value on hold-out data: 0.11595930904150009
Epoch: 307
Loss on hold-out set: 0.022558615823024108
MeanAbsoluteError value on hold-out data: 0.11929328739643097
Epoch: 308
Loss on hold-out set: 0.020688466495424412
MeanAbsoluteError value on hold-out data: 0.11253351718187332
Epoch: 309
Loss on hold-out set: 0.022381944453130322
MeanAbsoluteError value on hold-out data: 0.11802205443382263
Epoch: 310
Loss on hold-out set: 0.02119494791176597
MeanAbsoluteError value on hold-out data: 0.11404436826705933
Epoch: 311
Loss on hold-out set: 0.01873069426742101
MeanAbsoluteError value on hold-out data: 0.10774090141057968
Epoch: 312
Loss on hold-out set: 0.022672217814833858
MeanAbsoluteError value on hold-out data: 0.12165096402168274
Epoch: 313
Loss on hold-out set: 0.02062759704296089
MeanAbsoluteError value on hold-out data: 0.11751758307218552
Epoch: 314
Loss on hold-out set: 0.022352855117205764
MeanAbsoluteError value on hold-out data: 0.11978064477443695
Epoch: 315
Loss on hold-out set: 0.022131391952983297
MeanAbsoluteError value on hold-out data: 0.11671825498342514
Epoch: 316
Loss on hold-out set: 0.021346900479402395
MeanAbsoluteError value on hold-out data: 0.11460745334625244
Epoch: 317
Loss on hold-out set: 0.021601234564635283
MeanAbsoluteError value on hold-out data: 0.11624762415885925
Epoch: 318
Loss on hold-out set: 0.021087244696682318
MeanAbsoluteError value on hold-out data: 0.11457857489585876
Epoch: 319
Loss on hold-out set: 0.022213427904061972
MeanAbsoluteError value on hold-out data: 0.11920074373483658
Epoch: 320
Loss on hold-out set: 0.02167412512654361
MeanAbsoluteError value on hold-out data: 0.11772944033145905
Epoch: 321
Loss on hold-out set: 0.020667243746186916
MeanAbsoluteError value on hold-out data: 0.11620038002729416
Epoch: 322
Loss on hold-out set: 0.022656655667427306
MeanAbsoluteError value on hold-out data: 0.1193496584892273
Epoch: 323
Loss on hold-out set: 0.020068755442237792
MeanAbsoluteError value on hold-out data: 0.1133454293012619
Epoch: 324
Loss on hold-out set: 0.02088179334673138
MeanAbsoluteError value on hold-out data: 0.115103580057621
Epoch: 325
Loss on hold-out set: 0.021698947604600106
MeanAbsoluteError value on hold-out data: 0.11816548556089401
Epoch: 326
Loss on hold-out set: 0.022460143786277816
MeanAbsoluteError value on hold-out data: 0.12101031094789505
Epoch: 327
Loss on hold-out set: 0.02151428377959746
MeanAbsoluteError value on hold-out data: 0.12000150233507156
Epoch: 328
Loss on hold-out set: 0.020545324494402547
MeanAbsoluteError value on hold-out data: 0.11383608728647232
Epoch: 329
Loss on hold-out set: 0.01984762436002105
MeanAbsoluteError value on hold-out data: 0.11264578253030777
Epoch: 330
Loss on hold-out set: 0.019969574648033207
MeanAbsoluteError value on hold-out data: 0.11125174164772034
Epoch: 331
Loss on hold-out set: 0.02175281378615182
MeanAbsoluteError value on hold-out data: 0.1144561767578125
Epoch: 332
Loss on hold-out set: 0.022714230908071235
MeanAbsoluteError value on hold-out data: 0.11692565679550171
Epoch: 333
Loss on hold-out set: 0.021163653932793142
MeanAbsoluteError value on hold-out data: 0.11630218476057053
Epoch: 334
Loss on hold-out set: 0.020523792275004477
MeanAbsoluteError value on hold-out data: 0.11395994573831558
Epoch: 335
Loss on hold-out set: 0.01876316719756384
MeanAbsoluteError value on hold-out data: 0.11132863163948059
Epoch: 336
Loss on hold-out set: 0.019748985845277883
MeanAbsoluteError value on hold-out data: 0.11367468535900116
Epoch: 337
Loss on hold-out set: 0.023553312219131234
MeanAbsoluteError value on hold-out data: 0.12172796577215195
Epoch: 338
Loss on hold-out set: 0.020519593121862273
MeanAbsoluteError value on hold-out data: 0.11467048525810242
Epoch: 339
Loss on hold-out set: 0.019392963594970447
MeanAbsoluteError value on hold-out data: 0.11135920137166977
Epoch: 340
Loss on hold-out set: 0.021119915035863718
MeanAbsoluteError value on hold-out data: 0.11765701323747635
Epoch: 341
Loss on hold-out set: 0.01967683384694586
MeanAbsoluteError value on hold-out data: 0.1110941469669342
Epoch: 342
Loss on hold-out set: 0.020970575987303165
MeanAbsoluteError value on hold-out data: 0.11365798860788345
Epoch: 343
Loss on hold-out set: 0.02028263046774858
MeanAbsoluteError value on hold-out data: 0.11152370274066925
Epoch: 344
Loss on hold-out set: 0.021139353103426402
MeanAbsoluteError value on hold-out data: 0.11655969172716141
Epoch: 345
Loss on hold-out set: 0.02194706030228796
MeanAbsoluteError value on hold-out data: 0.11748495697975159
Epoch: 346
Loss on hold-out set: 0.020683848777310533
MeanAbsoluteError value on hold-out data: 0.11408291012048721
Epoch: 347
Loss on hold-out set: 0.018076388556316183
MeanAbsoluteError value on hold-out data: 0.10671642422676086
Epoch: 348
Loss on hold-out set: 0.018256041825667733
MeanAbsoluteError value on hold-out data: 0.10857763886451721
Epoch: 349
Loss on hold-out set: 0.020315740527051578
MeanAbsoluteError value on hold-out data: 0.11393707245588303
Epoch: 350
Loss on hold-out set: 0.02214968243856371
MeanAbsoluteError value on hold-out data: 0.11855796724557877
Epoch: 351
Loss on hold-out set: 0.020910255180933746
MeanAbsoluteError value on hold-out data: 0.11552490293979645
Epoch: 352
Loss on hold-out set: 0.017969255630905536
MeanAbsoluteError value on hold-out data: 0.11047220975160599
Epoch: 353
Loss on hold-out set: 0.020177305663819426
MeanAbsoluteError value on hold-out data: 0.11342275887727737
Epoch: 354
Loss on hold-out set: 0.019870136051322332
MeanAbsoluteError value on hold-out data: 0.11350405216217041
Epoch: 355
Loss on hold-out set: 0.019103179972347183
MeanAbsoluteError value on hold-out data: 0.10797929018735886
Epoch: 356
Loss on hold-out set: 0.020549718334538437
MeanAbsoluteError value on hold-out data: 0.11669732630252838
Epoch: 357
Loss on hold-out set: 0.020033708264745657
MeanAbsoluteError value on hold-out data: 0.11371280997991562
Epoch: 358
Loss on hold-out set: 0.020906848261268655
MeanAbsoluteError value on hold-out data: 0.1125299483537674
Epoch: 359
Loss on hold-out set: 0.019376178900250427
MeanAbsoluteError value on hold-out data: 0.10847199708223343
Epoch: 360
Loss on hold-out set: 0.020246514105043995
MeanAbsoluteError value on hold-out data: 0.1137266531586647
Epoch: 361
Loss on hold-out set: 0.019809321080780744
MeanAbsoluteError value on hold-out data: 0.11167612671852112
Epoch: 362
Loss on hold-out set: 0.019209810873471723
MeanAbsoluteError value on hold-out data: 0.11128205806016922
Epoch: 363
Loss on hold-out set: 0.019798834002479757
MeanAbsoluteError value on hold-out data: 0.11229053139686584
Epoch: 364
Loss on hold-out set: 0.018001085666473956
MeanAbsoluteError value on hold-out data: 0.10707300901412964
Epoch: 365
Loss on hold-out set: 0.019743187008110303
MeanAbsoluteError value on hold-out data: 0.11143502593040466
Epoch: 366
Loss on hold-out set: 0.02012766558570244
MeanAbsoluteError value on hold-out data: 0.11252500861883163
Epoch: 367
Loss on hold-out set: 0.019829366099050578
MeanAbsoluteError value on hold-out data: 0.11301764100790024
Epoch: 368
Loss on hold-out set: 0.02204598459194434
MeanAbsoluteError value on hold-out data: 0.11928550899028778
Epoch: 369
Loss on hold-out set: 0.02004594273438367
MeanAbsoluteError value on hold-out data: 0.11087998747825623
Epoch: 370
Loss on hold-out set: 0.019083743069942708
MeanAbsoluteError value on hold-out data: 0.11166540533304214
Epoch: 371
Loss on hold-out set: 0.01969405487771534
MeanAbsoluteError value on hold-out data: 0.10969988256692886
Epoch: 372
Loss on hold-out set: 0.0198821322794538
MeanAbsoluteError value on hold-out data: 0.11479638516902924
Epoch: 373
Loss on hold-out set: 0.02064704127064336
MeanAbsoluteError value on hold-out data: 0.11277599632740021
Epoch: 374
Loss on hold-out set: 0.01969436999337631
MeanAbsoluteError value on hold-out data: 0.11365023255348206
Epoch: 375
Loss on hold-out set: 0.01963778342086395
MeanAbsoluteError value on hold-out data: 0.11229713261127472
Epoch: 376
Loss on hold-out set: 0.019991790314707034
MeanAbsoluteError value on hold-out data: 0.11264608800411224
Epoch: 377
Loss on hold-out set: 0.021078343840296537
MeanAbsoluteError value on hold-out data: 0.11699488013982773
Epoch: 378
Loss on hold-out set: 0.020479457861122985
MeanAbsoluteError value on hold-out data: 0.11534703522920609
Epoch: 379
Loss on hold-out set: 0.018795479624144112
MeanAbsoluteError value on hold-out data: 0.10878073424100876
Epoch: 380
Loss on hold-out set: 0.01708497863985637
MeanAbsoluteError value on hold-out data: 0.1029009073972702
Epoch: 381
Loss on hold-out set: 0.02241074708804566
MeanAbsoluteError value on hold-out data: 0.11628512293100357
Epoch: 382
Loss on hold-out set: 0.020402097780412683
MeanAbsoluteError value on hold-out data: 0.1151157021522522
Epoch: 383
Loss on hold-out set: 0.019574593312378662
MeanAbsoluteError value on hold-out data: 0.11403299868106842
Epoch: 384
Loss on hold-out set: 0.0181387314182939
MeanAbsoluteError value on hold-out data: 0.10933249443769455
Epoch: 385
Loss on hold-out set: 0.019687457045353463
MeanAbsoluteError value on hold-out data: 0.11219798028469086
Epoch: 386
Loss on hold-out set: 0.019927481712851053
MeanAbsoluteError value on hold-out data: 0.10951428860425949
Epoch: 387
Loss on hold-out set: 0.021044743905974127
MeanAbsoluteError value on hold-out data: 0.11344130337238312
Epoch: 388
Loss on hold-out set: 0.01891690812190063
MeanAbsoluteError value on hold-out data: 0.11081024259328842
Epoch: 389
Loss on hold-out set: 0.018853650893482458
MeanAbsoluteError value on hold-out data: 0.10842876136302948
Epoch: 390
Loss on hold-out set: 0.018849406883018675
MeanAbsoluteError value on hold-out data: 0.1112220510840416
Epoch: 391
Loss on hold-out set: 0.020512250474615332
MeanAbsoluteError value on hold-out data: 0.11401937156915665
Epoch: 392
Loss on hold-out set: 0.018392907879800382
MeanAbsoluteError value on hold-out data: 0.10879810154438019
Epoch: 393
Loss on hold-out set: 0.02092975602646978
MeanAbsoluteError value on hold-out data: 0.11624038964509964
Epoch: 394
Loss on hold-out set: 0.019785645708519345
MeanAbsoluteError value on hold-out data: 0.11084463447332382
Epoch: 395
Loss on hold-out set: 0.018209122673142702
MeanAbsoluteError value on hold-out data: 0.10893397033214569
Epoch: 396
Loss on hold-out set: 0.020584622627914845
MeanAbsoluteError value on hold-out data: 0.1134655773639679
Epoch: 397
Loss on hold-out set: 0.019371289422851986
MeanAbsoluteError value on hold-out data: 0.10958653688430786
Epoch: 398
Loss on hold-out set: 0.017923768430482597
MeanAbsoluteError value on hold-out data: 0.10879354923963547
Epoch: 399
Loss on hold-out set: 0.019226850336223532
MeanAbsoluteError value on hold-out data: 0.11056838929653168
Epoch: 400
Loss on hold-out set: 0.02099299133667955
MeanAbsoluteError value on hold-out data: 0.11327078193426132
Epoch: 401
Loss on hold-out set: 0.019656165084209837
MeanAbsoluteError value on hold-out data: 0.11059537529945374
Epoch: 402
Loss on hold-out set: 0.019782452387541224
MeanAbsoluteError value on hold-out data: 0.1130046471953392
Epoch: 403
Loss on hold-out set: 0.018999913270721057
MeanAbsoluteError value on hold-out data: 0.1086873784661293
Epoch: 404
Loss on hold-out set: 0.019605722932271117
MeanAbsoluteError value on hold-out data: 0.111094169318676
Epoch: 405
Loss on hold-out set: 0.01756290398722437
MeanAbsoluteError value on hold-out data: 0.10472745448350906
Epoch: 406
Loss on hold-out set: 0.019725861187959406
MeanAbsoluteError value on hold-out data: 0.11217675358057022
Epoch: 407
Loss on hold-out set: 0.01988512525325253
MeanAbsoluteError value on hold-out data: 0.11297497898340225
Epoch: 408
Loss on hold-out set: 0.01839422772929538
MeanAbsoluteError value on hold-out data: 0.11128883063793182
Epoch: 409
Loss on hold-out set: 0.01982417897367365
MeanAbsoluteError value on hold-out data: 0.11141449213027954
Epoch: 410
Loss on hold-out set: 0.01974858328549696
MeanAbsoluteError value on hold-out data: 0.11285549402236938
Epoch: 411
Loss on hold-out set: 0.018244984496938437
MeanAbsoluteError value on hold-out data: 0.10794157534837723
Epoch: 412
Loss on hold-out set: 0.018266719481616747
MeanAbsoluteError value on hold-out data: 0.10846420377492905
Epoch: 413
Loss on hold-out set: 0.02161038276972704
MeanAbsoluteError value on hold-out data: 0.1134047731757164
Epoch: 414
Loss on hold-out set: 0.019060296938987448
MeanAbsoluteError value on hold-out data: 0.11183195561170578
Epoch: 415
Loss on hold-out set: 0.017731492434783527
MeanAbsoluteError value on hold-out data: 0.10444491356611252
Epoch: 416
Loss on hold-out set: 0.01990994821828887
MeanAbsoluteError value on hold-out data: 0.11257918179035187
Epoch: 417
Loss on hold-out set: 0.01719435617516865
MeanAbsoluteError value on hold-out data: 0.10200642794370651
Epoch: 418
Loss on hold-out set: 0.017921959086864565
MeanAbsoluteError value on hold-out data: 0.10752697288990021
Epoch: 419
Loss on hold-out set: 0.018188363478742153
MeanAbsoluteError value on hold-out data: 0.10900071263313293
Epoch: 420
Loss on hold-out set: 0.018082982183647497
MeanAbsoluteError value on hold-out data: 0.10648579895496368
Epoch: 421
Loss on hold-out set: 0.01697053363853532
MeanAbsoluteError value on hold-out data: 0.10411300510168076
Epoch: 422
Loss on hold-out set: 0.018055269861166987
MeanAbsoluteError value on hold-out data: 0.10673756897449493
Epoch: 423
Loss on hold-out set: 0.01705868380694786
MeanAbsoluteError value on hold-out data: 0.10500310361385345
Epoch: 424
Loss on hold-out set: 0.016846013261092595
MeanAbsoluteError value on hold-out data: 0.1039196103811264
Epoch: 425
Loss on hold-out set: 0.019496059127607927
MeanAbsoluteError value on hold-out data: 0.11098863929510117
Epoch: 426
Loss on hold-out set: 0.019096565002400895
MeanAbsoluteError value on hold-out data: 0.10975144803524017
Epoch: 427
Loss on hold-out set: 0.018046696107388318
MeanAbsoluteError value on hold-out data: 0.1081840917468071
Epoch: 428
Loss on hold-out set: 0.017242805094380552
MeanAbsoluteError value on hold-out data: 0.10596828907728195
Epoch: 429
Loss on hold-out set: 0.018770614744701864
MeanAbsoluteError value on hold-out data: 0.10782277584075928
Epoch: 430
Loss on hold-out set: 0.01862804684084646
MeanAbsoluteError value on hold-out data: 0.10615771263837814
Epoch: 431
Loss on hold-out set: 0.0204471913377832
MeanAbsoluteError value on hold-out data: 0.11363577842712402
Epoch: 432
Loss on hold-out set: 0.018788751109144262
MeanAbsoluteError value on hold-out data: 0.10865456610918045
Epoch: 433
Loss on hold-out set: 0.01724777905154042
MeanAbsoluteError value on hold-out data: 0.10232105106115341
Epoch: 434
Loss on hold-out set: 0.01900229074022112
MeanAbsoluteError value on hold-out data: 0.11071856319904327
Epoch: 435
Loss on hold-out set: 0.018320083547296237
MeanAbsoluteError value on hold-out data: 0.10880910605192184
Epoch: 436
Loss on hold-out set: 0.01951010252669221
MeanAbsoluteError value on hold-out data: 0.11322677880525589
Epoch: 437
Loss on hold-out set: 0.01796095527582414
MeanAbsoluteError value on hold-out data: 0.10354073345661163
Epoch: 438
Loss on hold-out set: 0.018563594902516342
MeanAbsoluteError value on hold-out data: 0.10825631767511368
Epoch: 439
Loss on hold-out set: 0.01828872761320478
MeanAbsoluteError value on hold-out data: 0.1052214503288269
Epoch: 440
Loss on hold-out set: 0.015776011807999264
MeanAbsoluteError value on hold-out data: 0.10241834074258804
Epoch: 441
Loss on hold-out set: 0.018329231512446618
MeanAbsoluteError value on hold-out data: 0.1045655831694603
Epoch: 442
Loss on hold-out set: 0.017097296480933437
MeanAbsoluteError value on hold-out data: 0.10320796072483063
Epoch: 443
Loss on hold-out set: 0.020574179474109163
MeanAbsoluteError value on hold-out data: 0.1151375100016594
Epoch: 444
Loss on hold-out set: 0.01840581975018722
MeanAbsoluteError value on hold-out data: 0.10848106443881989
Epoch: 445
Loss on hold-out set: 0.01767504639913871
MeanAbsoluteError value on hold-out data: 0.10406258702278137
Epoch: 446
Loss on hold-out set: 0.01885254772399397
MeanAbsoluteError value on hold-out data: 0.10921329259872437
Epoch: 447
Loss on hold-out set: 0.018643465156474123
MeanAbsoluteError value on hold-out data: 0.1046842560172081
Epoch: 448
Loss on hold-out set: 0.016628624320049613
MeanAbsoluteError value on hold-out data: 0.10606048256158829
Epoch: 449
Loss on hold-out set: 0.020072930190650973
MeanAbsoluteError value on hold-out data: 0.11260659247636795
Epoch: 450
Loss on hold-out set: 0.018231768014860185
MeanAbsoluteError value on hold-out data: 0.10505546629428864
Epoch: 451
Loss on hold-out set: 0.018948971942627395
MeanAbsoluteError value on hold-out data: 0.10505357384681702
Epoch: 452
Loss on hold-out set: 0.01763761884329142
MeanAbsoluteError value on hold-out data: 0.10561119765043259
Epoch: 453
Loss on hold-out set: 0.017063333064628143
MeanAbsoluteError value on hold-out data: 0.1054261177778244
Epoch: 454
Loss on hold-out set: 0.01874464075905659
MeanAbsoluteError value on hold-out data: 0.10985586792230606
Epoch: 455
Loss on hold-out set: 0.017782797940793293
MeanAbsoluteError value on hold-out data: 0.10277053713798523
Epoch: 456
Loss on hold-out set: 0.016495951775165548
MeanAbsoluteError value on hold-out data: 0.10200928151607513
Epoch: 457
Loss on hold-out set: 0.01862025945156347
MeanAbsoluteError value on hold-out data: 0.10930471122264862
Epoch: 458
Loss on hold-out set: 0.01698210552732538
MeanAbsoluteError value on hold-out data: 0.10228515416383743
Epoch: 459
Loss on hold-out set: 0.018075272411876238
MeanAbsoluteError value on hold-out data: 0.10549842566251755
Epoch: 460
Loss on hold-out set: 0.019136866688835047
MeanAbsoluteError value on hold-out data: 0.10945092886686325
Epoch: 461
Loss on hold-out set: 0.018262950941862074
MeanAbsoluteError value on hold-out data: 0.10725512355566025
Epoch: 462
Loss on hold-out set: 0.016741548871893126
MeanAbsoluteError value on hold-out data: 0.10202011466026306
Epoch: 463
Loss on hold-out set: 0.016625417629499376
MeanAbsoluteError value on hold-out data: 0.10200444608926773
Epoch: 464
Loss on hold-out set: 0.01688135491941163
MeanAbsoluteError value on hold-out data: 0.1002386212348938
Epoch: 465
Loss on hold-out set: 0.017165490983461495
MeanAbsoluteError value on hold-out data: 0.10517778992652893
Epoch: 466
Loss on hold-out set: 0.01678078538995275
MeanAbsoluteError value on hold-out data: 0.10455087572336197
Epoch: 467
Loss on hold-out set: 0.017457894396454017
MeanAbsoluteError value on hold-out data: 0.10453687608242035
Epoch: 468
Loss on hold-out set: 0.01638021405949985
MeanAbsoluteError value on hold-out data: 0.1011182889342308
Epoch: 469
Loss on hold-out set: 0.017976959572668153
MeanAbsoluteError value on hold-out data: 0.10494391620159149
Epoch: 470
Loss on hold-out set: 0.018664259450354923
MeanAbsoluteError value on hold-out data: 0.11041808873414993
Epoch: 471
Loss on hold-out set: 0.016646568605210632
MeanAbsoluteError value on hold-out data: 0.10326950997114182
Epoch: 472
Loss on hold-out set: 0.017120848559983037
MeanAbsoluteError value on hold-out data: 0.10316313058137894
Epoch: 473
Loss on hold-out set: 0.017502256304348218
MeanAbsoluteError value on hold-out data: 0.10582735389471054
Epoch: 474
Loss on hold-out set: 0.017742402495726613
MeanAbsoluteError value on hold-out data: 0.10827057808637619
Epoch: 475
Loss on hold-out set: 0.01828877220104914
MeanAbsoluteError value on hold-out data: 0.10629316419363022
Epoch: 476
Loss on hold-out set: 0.016672906557068927
MeanAbsoluteError value on hold-out data: 0.10392805188894272
Epoch: 477
Loss on hold-out set: 0.01768840210454073
MeanAbsoluteError value on hold-out data: 0.10418079048395157
Epoch: 478
Loss on hold-out set: 0.016796588893339504
MeanAbsoluteError value on hold-out data: 0.10160835832357407
Epoch: 479
Loss on hold-out set: 0.01625109669121836
MeanAbsoluteError value on hold-out data: 0.10195039212703705
Epoch: 480
Loss on hold-out set: 0.017589620803870883
MeanAbsoluteError value on hold-out data: 0.10366034507751465
Epoch: 481
Loss on hold-out set: 0.017122721093182917
MeanAbsoluteError value on hold-out data: 0.10216782987117767
Epoch: 482
Loss on hold-out set: 0.017352832487013074
MeanAbsoluteError value on hold-out data: 0.10447853058576584
Epoch: 483
Loss on hold-out set: 0.016924560028322353
MeanAbsoluteError value on hold-out data: 0.10327739268541336
Epoch: 484
Loss on hold-out set: 0.015696586687360348
MeanAbsoluteError value on hold-out data: 0.1002945601940155
Epoch: 485
Loss on hold-out set: 0.017913533122142934
MeanAbsoluteError value on hold-out data: 0.10676826536655426
Epoch: 486
Loss on hold-out set: 0.017526450224783427
MeanAbsoluteError value on hold-out data: 0.10622205585241318
Epoch: 487
Loss on hold-out set: 0.01667264716466889
MeanAbsoluteError value on hold-out data: 0.10466020554304123
Epoch: 488
Loss on hold-out set: 0.015451769696446717
MeanAbsoluteError value on hold-out data: 0.09707428514957428
Epoch: 489
Loss on hold-out set: 0.018890144417722087
MeanAbsoluteError value on hold-out data: 0.10932109504938126
Epoch: 490
Loss on hold-out set: 0.017827409494881673
MeanAbsoluteError value on hold-out data: 0.10652030259370804
Epoch: 491
Loss on hold-out set: 0.017611276442282057
MeanAbsoluteError value on hold-out data: 0.10247763246297836
Epoch: 492
Loss on hold-out set: 0.018430675695514463
MeanAbsoluteError value on hold-out data: 0.11035297065973282
Epoch: 493
Loss on hold-out set: 0.017891636106651277
MeanAbsoluteError value on hold-out data: 0.10516806691884995
Epoch: 494
Loss on hold-out set: 0.0149411395864657
MeanAbsoluteError value on hold-out data: 0.09687335789203644
Epoch: 495
Loss on hold-out set: 0.015715526416315698
MeanAbsoluteError value on hold-out data: 0.10023298859596252
Epoch: 496
Loss on hold-out set: 0.017242846749334906
MeanAbsoluteError value on hold-out data: 0.10323794931173325
Epoch: 497
Loss on hold-out set: 0.0159889336853909
MeanAbsoluteError value on hold-out data: 0.1012006476521492
Epoch: 498
Loss on hold-out set: 0.017191181352827697
MeanAbsoluteError value on hold-out data: 0.10373911261558533
Epoch: 499
Loss on hold-out set: 0.015845576678963576
MeanAbsoluteError value on hold-out data: 0.09712395071983337
Epoch: 500
Loss on hold-out set: 0.017361426907591522
MeanAbsoluteError value on hold-out data: 0.1044704020023346
Epoch: 501
Loss on hold-out set: 0.016558794030218753
MeanAbsoluteError value on hold-out data: 0.10300976783037186
Epoch: 502
Loss on hold-out set: 0.015197034622057496
MeanAbsoluteError value on hold-out data: 0.09772759675979614
Epoch: 503
Loss on hold-out set: 0.01735284251519867
MeanAbsoluteError value on hold-out data: 0.1048295795917511
Epoch: 504
Loss on hold-out set: 0.014857562258354544
MeanAbsoluteError value on hold-out data: 0.09570644050836563
Epoch: 505
Loss on hold-out set: 0.017220948882168158
MeanAbsoluteError value on hold-out data: 0.10160800814628601
Epoch: 506
Loss on hold-out set: 0.01545804788581639
MeanAbsoluteError value on hold-out data: 0.09759094566106796
Epoch: 507
Loss on hold-out set: 0.015907079772623546
MeanAbsoluteError value on hold-out data: 0.10008668899536133
Epoch: 508
Loss on hold-out set: 0.014784880545947393
MeanAbsoluteError value on hold-out data: 0.0985725075006485
Epoch: 509
Loss on hold-out set: 0.0184313238109947
MeanAbsoluteError value on hold-out data: 0.1079145073890686
Epoch: 510
Loss on hold-out set: 0.01794032708106291
MeanAbsoluteError value on hold-out data: 0.10720276087522507
Epoch: 511
Loss on hold-out set: 0.017394277614876046
MeanAbsoluteError value on hold-out data: 0.10267346352338791
Epoch: 512
Loss on hold-out set: 0.01724483585518707
MeanAbsoluteError value on hold-out data: 0.10623032599687576
Epoch: 513
Loss on hold-out set: 0.016030586181574713
MeanAbsoluteError value on hold-out data: 0.10244276374578476
Epoch: 514
Loss on hold-out set: 0.01543297407159116
MeanAbsoluteError value on hold-out data: 0.09982430189847946
Epoch: 515
Loss on hold-out set: 0.017815067649353297
MeanAbsoluteError value on hold-out data: 0.10093226283788681
Epoch: 516
Loss on hold-out set: 0.015170024346928889
MeanAbsoluteError value on hold-out data: 0.09874675422906876
Epoch: 517
Loss on hold-out set: 0.01429101151782864
MeanAbsoluteError value on hold-out data: 0.09542864561080933
Epoch: 518
Loss on hold-out set: 0.015484979990793969
MeanAbsoluteError value on hold-out data: 0.10047390311956406
Epoch: 519
Loss on hold-out set: 0.016213976550473793
MeanAbsoluteError value on hold-out data: 0.0994553342461586
Epoch: 520
Loss on hold-out set: 0.01604699120861672
MeanAbsoluteError value on hold-out data: 0.09886301308870316
Epoch: 521
Loss on hold-out set: 0.017219297559471065
MeanAbsoluteError value on hold-out data: 0.10398205369710922
Epoch: 522
Loss on hold-out set: 0.016376531052034505
MeanAbsoluteError value on hold-out data: 0.1002635657787323
Epoch: 523
Loss on hold-out set: 0.016184560899661544
MeanAbsoluteError value on hold-out data: 0.10112734138965607
Epoch: 524
Loss on hold-out set: 0.016941221031956957
MeanAbsoluteError value on hold-out data: 0.10414097458124161
Epoch: 525
Loss on hold-out set: 0.01599037664654285
MeanAbsoluteError value on hold-out data: 0.09876761585474014
Epoch: 526
Loss on hold-out set: 0.015688660875506077
MeanAbsoluteError value on hold-out data: 0.09832999855279922
Epoch: 527
Loss on hold-out set: 0.015379237916822603
MeanAbsoluteError value on hold-out data: 0.09764561057090759
Epoch: 528
Loss on hold-out set: 0.016070095886073735
MeanAbsoluteError value on hold-out data: 0.10001388937234879
Epoch: 529
Loss on hold-out set: 0.016571616550111988
MeanAbsoluteError value on hold-out data: 0.1017853319644928
Epoch: 530
Loss on hold-out set: 0.012978675235499395
MeanAbsoluteError value on hold-out data: 0.09045178443193436
Epoch: 531
Loss on hold-out set: 0.017445625251178473
MeanAbsoluteError value on hold-out data: 0.10349847376346588
Epoch: 532
Loss on hold-out set: 0.016567486005321066
MeanAbsoluteError value on hold-out data: 0.10237037390470505
Epoch: 533
Loss on hold-out set: 0.016500017218835032
MeanAbsoluteError value on hold-out data: 0.10218687355518341
Epoch: 534
Loss on hold-out set: 0.017036243241745977
MeanAbsoluteError value on hold-out data: 0.10028775036334991
Epoch: 535
Loss on hold-out set: 0.014649783001417139
MeanAbsoluteError value on hold-out data: 0.098085917532444
Epoch: 536
Loss on hold-out set: 0.018789879503068128
MeanAbsoluteError value on hold-out data: 0.10719955712556839
Epoch: 537
Loss on hold-out set: 0.013711185052026545
MeanAbsoluteError value on hold-out data: 0.09140849858522415
Epoch: 538
Loss on hold-out set: 0.01639368487543834
MeanAbsoluteError value on hold-out data: 0.09957612305879593
Epoch: 539
Loss on hold-out set: 0.014396200542153868
MeanAbsoluteError value on hold-out data: 0.09608495980501175
Epoch: 540
Loss on hold-out set: 0.018022028328487066
MeanAbsoluteError value on hold-out data: 0.10349193960428238
Epoch: 541
Loss on hold-out set: 0.01509356853440598
MeanAbsoluteError value on hold-out data: 0.09686312079429626
Epoch: 542
Loss on hold-out set: 0.013990069263187858
MeanAbsoluteError value on hold-out data: 0.09526720643043518
Epoch: 543
Loss on hold-out set: 0.015373114348670546
MeanAbsoluteError value on hold-out data: 0.09629610925912857
Epoch: 544
Loss on hold-out set: 0.015141846513198895
MeanAbsoluteError value on hold-out data: 0.09453809261322021
Epoch: 545
Loss on hold-out set: 0.015478656352958448
MeanAbsoluteError value on hold-out data: 0.09891442954540253
Epoch: 546
Loss on hold-out set: 0.01390060651387709
MeanAbsoluteError value on hold-out data: 0.09393607079982758
Epoch: 547
Loss on hold-out set: 0.01790460113360799
MeanAbsoluteError value on hold-out data: 0.10337674617767334
Epoch: 548
Loss on hold-out set: 0.016228663548924185
MeanAbsoluteError value on hold-out data: 0.10097288340330124
Epoch: 549
Loss on hold-out set: 0.014286067141741417
MeanAbsoluteError value on hold-out data: 0.09507322311401367
Epoch: 550
Loss on hold-out set: 0.01753104530774484
MeanAbsoluteError value on hold-out data: 0.1031491830945015
Epoch: 551
Loss on hold-out set: 0.016885787770881202
MeanAbsoluteError value on hold-out data: 0.09994325041770935
Epoch: 552
Loss on hold-out set: 0.015911119228743095
MeanAbsoluteError value on hold-out data: 0.10012953728437424
Epoch: 553
Loss on hold-out set: 0.016610775150644866
MeanAbsoluteError value on hold-out data: 0.1015501618385315
Epoch: 554
Loss on hold-out set: 0.017326219691555404
MeanAbsoluteError value on hold-out data: 0.10405503958463669
Epoch: 555
Loss on hold-out set: 0.014720436197409677
MeanAbsoluteError value on hold-out data: 0.09676341712474823
Epoch: 556
Loss on hold-out set: 0.016057758370922482
MeanAbsoluteError value on hold-out data: 0.10029876977205276
Epoch: 557
Loss on hold-out set: 0.01622469314626263
MeanAbsoluteError value on hold-out data: 0.10159461200237274
Epoch: 558
Loss on hold-out set: 0.01588592256548509
MeanAbsoluteError value on hold-out data: 0.09458298981189728
Epoch: 559
Loss on hold-out set: 0.013809239569709461
MeanAbsoluteError value on hold-out data: 0.09154084324836731
Epoch: 560
Loss on hold-out set: 0.013484313614038304
MeanAbsoluteError value on hold-out data: 0.0943402349948883
Epoch: 561
Loss on hold-out set: 0.013648387024986733
MeanAbsoluteError value on hold-out data: 0.09205252677202225
Epoch: 562
Loss on hold-out set: 0.016334406885046823
MeanAbsoluteError value on hold-out data: 0.10039561986923218
Epoch: 563
Loss on hold-out set: 0.01498707060047309
MeanAbsoluteError value on hold-out data: 0.09706087410449982
Epoch: 564
Loss on hold-out set: 0.015538758013323483
MeanAbsoluteError value on hold-out data: 0.09881306439638138
Epoch: 565
Loss on hold-out set: 0.014049778049035618
MeanAbsoluteError value on hold-out data: 0.09332137554883957
Epoch: 566
Loss on hold-out set: 0.014604939155348499
MeanAbsoluteError value on hold-out data: 0.09267575293779373
Epoch: 567
Loss on hold-out set: 0.01487654018899775
MeanAbsoluteError value on hold-out data: 0.0963146910071373
Epoch: 568
Loss on hold-out set: 0.015562353560962947
MeanAbsoluteError value on hold-out data: 0.09802626818418503
Epoch: 569
Loss on hold-out set: 0.013576824675061895
MeanAbsoluteError value on hold-out data: 0.09331800788640976
Epoch: 570
Loss on hold-out set: 0.015195012831753351
MeanAbsoluteError value on hold-out data: 0.09346885979175568
Epoch: 571
Loss on hold-out set: 0.016335878363364222
MeanAbsoluteError value on hold-out data: 0.10020330548286438
Epoch: 572
Loss on hold-out set: 0.01466379166522529
MeanAbsoluteError value on hold-out data: 0.09398268908262253
Epoch: 573
Loss on hold-out set: 0.016654503393911
MeanAbsoluteError value on hold-out data: 0.10030928254127502
Epoch: 574
Loss on hold-out set: 0.01458110098465113
MeanAbsoluteError value on hold-out data: 0.09563234448432922
Epoch: 575
Loss on hold-out set: 0.014284570799209178
MeanAbsoluteError value on hold-out data: 0.09669949859380722
Epoch: 576
Loss on hold-out set: 0.014325058131701856
MeanAbsoluteError value on hold-out data: 0.09342288970947266
Epoch: 577
Loss on hold-out set: 0.014026721487850106
MeanAbsoluteError value on hold-out data: 0.09394785761833191
Epoch: 578
Loss on hold-out set: 0.01548249001238825
MeanAbsoluteError value on hold-out data: 0.09435918927192688
Epoch: 579
Loss on hold-out set: 0.015078297683309453
MeanAbsoluteError value on hold-out data: 0.09855479747056961
Epoch: 580
Loss on hold-out set: 0.013528102570091202
MeanAbsoluteError value on hold-out data: 0.09065745025873184
Epoch: 581
Loss on hold-out set: 0.01563114592960725
MeanAbsoluteError value on hold-out data: 0.10002844035625458
Epoch: 582
Loss on hold-out set: 0.014629279635361552
MeanAbsoluteError value on hold-out data: 0.09156286716461182
Epoch: 583
Loss on hold-out set: 0.016369377482502993
MeanAbsoluteError value on hold-out data: 0.09832792729139328
Epoch: 584
Loss on hold-out set: 0.014451998181563492
MeanAbsoluteError value on hold-out data: 0.09175466001033783
Epoch: 585
Loss on hold-out set: 0.01475962005688416
MeanAbsoluteError value on hold-out data: 0.09537242352962494
Epoch: 586
Loss on hold-out set: 0.015724751118953766
MeanAbsoluteError value on hold-out data: 0.09736502915620804
Epoch: 587
Loss on hold-out set: 0.014366313947599943
MeanAbsoluteError value on hold-out data: 0.09269607067108154
Epoch: 588
Loss on hold-out set: 0.015059298385640432
MeanAbsoluteError value on hold-out data: 0.09410074353218079
Epoch: 589
Loss on hold-out set: 0.014563630500269938
MeanAbsoluteError value on hold-out data: 0.09636276215314865
Epoch: 590
Loss on hold-out set: 0.014948412045099151
MeanAbsoluteError value on hold-out data: 0.09718827903270721
Epoch: 591
Loss on hold-out set: 0.014477996934680656
MeanAbsoluteError value on hold-out data: 0.09541628509759903
Epoch: 592
Loss on hold-out set: 0.014665010130447626
MeanAbsoluteError value on hold-out data: 0.09322018176317215
Epoch: 593
Loss on hold-out set: 0.014278909537242725
MeanAbsoluteError value on hold-out data: 0.09326254576444626
Epoch: 594
Loss on hold-out set: 0.014825306200194366
MeanAbsoluteError value on hold-out data: 0.09387599676847458
Epoch: 595
Loss on hold-out set: 0.015424944195644153
MeanAbsoluteError value on hold-out data: 0.09827277809381485
Epoch: 596
Loss on hold-out set: 0.014611984732716033
MeanAbsoluteError value on hold-out data: 0.09446951001882553
Epoch: 597
Loss on hold-out set: 0.015650154897496882
MeanAbsoluteError value on hold-out data: 0.09848602861166
Epoch: 598
Loss on hold-out set: 0.01410756452033335
MeanAbsoluteError value on hold-out data: 0.09319790452718735
Epoch: 599
Loss on hold-out set: 0.014287467774608254
MeanAbsoluteError value on hold-out data: 0.09305716305971146
Epoch: 600
Loss on hold-out set: 0.013529001417813333
MeanAbsoluteError value on hold-out data: 0.08726966381072998
Epoch: 601
Loss on hold-out set: 0.014822467891769466
MeanAbsoluteError value on hold-out data: 0.09344727545976639
Epoch: 602
Loss on hold-out set: 0.014103373342077247
MeanAbsoluteError value on hold-out data: 0.09492230415344238
Epoch: 603
Loss on hold-out set: 0.015778168945447153
MeanAbsoluteError value on hold-out data: 0.09851492196321487
Epoch: 604
Loss on hold-out set: 0.014558465083803943
MeanAbsoluteError value on hold-out data: 0.09209667891263962
Epoch: 605
Loss on hold-out set: 0.01486572213885059
MeanAbsoluteError value on hold-out data: 0.09374437481164932
Epoch: 606
Loss on hold-out set: 0.015064175613879342
MeanAbsoluteError value on hold-out data: 0.09473440796136856
Epoch: 607
Loss on hold-out set: 0.014425909834511306
MeanAbsoluteError value on hold-out data: 0.09267984330654144
Epoch: 608
Loss on hold-out set: 0.01563408229073199
MeanAbsoluteError value on hold-out data: 0.09916012734174728
Epoch: 609
Loss on hold-out set: 0.013949672136222944
MeanAbsoluteError value on hold-out data: 0.09092294424772263
Epoch: 610
Loss on hold-out set: 0.014418375931563787
MeanAbsoluteError value on hold-out data: 0.0951988697052002
Epoch: 611
Loss on hold-out set: 0.0136715847188619
MeanAbsoluteError value on hold-out data: 0.09181510657072067
Epoch: 612
Loss on hold-out set: 0.012782050814421382
MeanAbsoluteError value on hold-out data: 0.08975503593683243
Epoch: 613
Loss on hold-out set: 0.013963610312051363
MeanAbsoluteError value on hold-out data: 0.09213334321975708
Epoch: 614
Loss on hold-out set: 0.013554981305242108
MeanAbsoluteError value on hold-out data: 0.09305527806282043
Epoch: 615
Loss on hold-out set: 0.013362136104090799
MeanAbsoluteError value on hold-out data: 0.08924611657857895
Epoch: 616
Loss on hold-out set: 0.01528584510621537
MeanAbsoluteError value on hold-out data: 0.09240587055683136
Epoch: 617
Loss on hold-out set: 0.013713795310250134
MeanAbsoluteError value on hold-out data: 0.0939006581902504
Epoch: 618
Loss on hold-out set: 0.014164377118189199
MeanAbsoluteError value on hold-out data: 0.09374970942735672
Epoch: 619
Loss on hold-out set: 0.014947949947866922
MeanAbsoluteError value on hold-out data: 0.09501877427101135
Epoch: 620
Loss on hold-out set: 0.014283895830521942
MeanAbsoluteError value on hold-out data: 0.09471771121025085
Epoch: 621
Loss on hold-out set: 0.013636818792995957
MeanAbsoluteError value on hold-out data: 0.09062140434980392
Epoch: 622
Loss on hold-out set: 0.016261060371931913
MeanAbsoluteError value on hold-out data: 0.09878785163164139
Epoch: 623
Loss on hold-out set: 0.013427151023352053
MeanAbsoluteError value on hold-out data: 0.09096934646368027
Epoch: 624
Loss on hold-out set: 0.01541620186539755
MeanAbsoluteError value on hold-out data: 0.09524501115083694
Epoch: 625
Loss on hold-out set: 0.014052361181359932
MeanAbsoluteError value on hold-out data: 0.09437425434589386
Epoch: 626
Loss on hold-out set: 0.012295605887787437
MeanAbsoluteError value on hold-out data: 0.08657211065292358
Epoch: 627
Loss on hold-out set: 0.014952558587877623
MeanAbsoluteError value on hold-out data: 0.09469272941350937
Epoch: 628
Loss on hold-out set: 0.016161989611719038
MeanAbsoluteError value on hold-out data: 0.09727109968662262
Epoch: 629
Loss on hold-out set: 0.013244195537214789
MeanAbsoluteError value on hold-out data: 0.08825672417879105
Epoch: 630
Loss on hold-out set: 0.012353408853911485
MeanAbsoluteError value on hold-out data: 0.08655953407287598
Epoch: 631
Loss on hold-out set: 0.015455039249967134
MeanAbsoluteError value on hold-out data: 0.09449964016675949
Epoch: 632
Loss on hold-out set: 0.01435483787121484
MeanAbsoluteError value on hold-out data: 0.09287720918655396
Epoch: 633
Loss on hold-out set: 0.014717527575655065
MeanAbsoluteError value on hold-out data: 0.09799574315547943
Epoch: 634
Loss on hold-out set: 0.015548572824591246
MeanAbsoluteError value on hold-out data: 0.09445223957300186
Epoch: 635
Loss on hold-out set: 0.013313023406541712
MeanAbsoluteError value on hold-out data: 0.09141413867473602
Epoch: 636
Loss on hold-out set: 0.01259593245775856
MeanAbsoluteError value on hold-out data: 0.0882144421339035
Epoch: 637
Loss on hold-out set: 0.01526362360176184
MeanAbsoluteError value on hold-out data: 0.09562113881111145
Epoch: 638
Loss on hold-out set: 0.013557046853141705
MeanAbsoluteError value on hold-out data: 0.09010560810565948
Epoch: 639
Loss on hold-out set: 0.015374014776898547
MeanAbsoluteError value on hold-out data: 0.09639353305101395
Epoch: 640
Loss on hold-out set: 0.016302277575141487
MeanAbsoluteError value on hold-out data: 0.10109040886163712
Epoch: 641
Loss on hold-out set: 0.015379177707927738
MeanAbsoluteError value on hold-out data: 0.09693016111850739
Epoch: 642
Loss on hold-out set: 0.015484363549040174
MeanAbsoluteError value on hold-out data: 0.09676296263933182
Epoch: 643
Loss on hold-out set: 0.015549978621080906
MeanAbsoluteError value on hold-out data: 0.09888330847024918
Epoch: 644
Loss on hold-out set: 0.012822280698649895
MeanAbsoluteError value on hold-out data: 0.08908011764287949
Epoch: 645
Loss on hold-out set: 0.012106036321589879
MeanAbsoluteError value on hold-out data: 0.08596400916576385
Epoch: 646
Loss on hold-out set: 0.014538140916847624
MeanAbsoluteError value on hold-out data: 0.09249808639287949
Epoch: 647
Loss on hold-out set: 0.014057443695007048
MeanAbsoluteError value on hold-out data: 0.09267629683017731
Epoch: 648
Loss on hold-out set: 0.013527121246855435
MeanAbsoluteError value on hold-out data: 0.09149264544248581
Epoch: 649
Loss on hold-out set: 0.01299065199920733
MeanAbsoluteError value on hold-out data: 0.08784367889165878
Epoch: 650
Loss on hold-out set: 0.014034214640378195
MeanAbsoluteError value on hold-out data: 0.09164974838495255
Epoch: 651
Loss on hold-out set: 0.012204154356149957
MeanAbsoluteError value on hold-out data: 0.0865323543548584
Epoch: 652
Loss on hold-out set: 0.01392240395834809
MeanAbsoluteError value on hold-out data: 0.09264511615037918
Epoch: 653
Loss on hold-out set: 0.014722467995484293
MeanAbsoluteError value on hold-out data: 0.09285802394151688
Epoch: 654
Loss on hold-out set: 0.013393289971205983
MeanAbsoluteError value on hold-out data: 0.09040539711713791
Epoch: 655
Loss on hold-out set: 0.014570566005689518
MeanAbsoluteError value on hold-out data: 0.09222154319286346
Epoch: 656
Loss on hold-out set: 0.012163803978158588
MeanAbsoluteError value on hold-out data: 0.08649276196956635
Epoch: 657
Loss on hold-out set: 0.013084598024045893
MeanAbsoluteError value on hold-out data: 0.08928382396697998
Epoch: 658
Loss on hold-out set: 0.013872668187929472
MeanAbsoluteError value on hold-out data: 0.0901680737733841
Epoch: 659
Loss on hold-out set: 0.014204979774282644
MeanAbsoluteError value on hold-out data: 0.09162555634975433
Epoch: 660
Loss on hold-out set: 0.012990223062351258
MeanAbsoluteError value on hold-out data: 0.08997189998626709
Epoch: 661
Loss on hold-out set: 0.015509023251045922
MeanAbsoluteError value on hold-out data: 0.09346423298120499
Epoch: 662
Loss on hold-out set: 0.013721077597341112
MeanAbsoluteError value on hold-out data: 0.08987933397293091
Epoch: 663
Loss on hold-out set: 0.013619247122648327
MeanAbsoluteError value on hold-out data: 0.09120398014783859
Epoch: 664
Loss on hold-out set: 0.012764995139586972
MeanAbsoluteError value on hold-out data: 0.08887051790952682
Epoch: 665
Loss on hold-out set: 0.013748123813226508
MeanAbsoluteError value on hold-out data: 0.09317526966333389
Epoch: 666
Loss on hold-out set: 0.011855615790870312
MeanAbsoluteError value on hold-out data: 0.08668381720781326
Epoch: 667
Loss on hold-out set: 0.012823349496963298
MeanAbsoluteError value on hold-out data: 0.08921634405851364
Epoch: 668
Loss on hold-out set: 0.013904479005626247
MeanAbsoluteError value on hold-out data: 0.09320327639579773
Epoch: 669
Loss on hold-out set: 0.012760913368450323
MeanAbsoluteError value on hold-out data: 0.08886924386024475
Epoch: 670
Loss on hold-out set: 0.01380171881474477
MeanAbsoluteError value on hold-out data: 0.08923608064651489
Epoch: 671
Loss on hold-out set: 0.012075712798687164
MeanAbsoluteError value on hold-out data: 0.0844569280743599
Epoch: 672
Loss on hold-out set: 0.012869233525852905
MeanAbsoluteError value on hold-out data: 0.08781604468822479
Epoch: 673
Loss on hold-out set: 0.013682479441874118
MeanAbsoluteError value on hold-out data: 0.09146670252084732
Epoch: 674
Loss on hold-out set: 0.013411862316352198
MeanAbsoluteError value on hold-out data: 0.08789549022912979
Epoch: 675
Loss on hold-out set: 0.011941602499997922
MeanAbsoluteError value on hold-out data: 0.08475131541490555
Epoch: 676
Loss on hold-out set: 0.013127753283139707
MeanAbsoluteError value on hold-out data: 0.08919910341501236
Epoch: 677
Loss on hold-out set: 0.013304364735910592
MeanAbsoluteError value on hold-out data: 0.08956814557313919
Epoch: 678
Loss on hold-out set: 0.014535426642263094
MeanAbsoluteError value on hold-out data: 0.09326102584600449
Epoch: 679
Loss on hold-out set: 0.013620110429474152
MeanAbsoluteError value on hold-out data: 0.08939574658870697
Epoch: 680
Loss on hold-out set: 0.012224895387795793
MeanAbsoluteError value on hold-out data: 0.08464132994413376
Epoch: 681
Loss on hold-out set: 0.01410494636191288
MeanAbsoluteError value on hold-out data: 0.09017062187194824
Epoch: 682
Loss on hold-out set: 0.014801231722570567
MeanAbsoluteError value on hold-out data: 0.0932379886507988
Epoch: 683
Loss on hold-out set: 0.014347165408786774
MeanAbsoluteError value on hold-out data: 0.09627961367368698
Epoch: 684
Loss on hold-out set: 0.0128902943857247
MeanAbsoluteError value on hold-out data: 0.09016433358192444
Epoch: 685
Loss on hold-out set: 0.01174660645260398
MeanAbsoluteError value on hold-out data: 0.08375780284404755
Epoch: 686
Loss on hold-out set: 0.012789092576446516
MeanAbsoluteError value on hold-out data: 0.08781054615974426
Epoch: 687
Loss on hold-out set: 0.013739881745035138
MeanAbsoluteError value on hold-out data: 0.092937171459198
Epoch: 688
Loss on hold-out set: 0.014784111922587424
MeanAbsoluteError value on hold-out data: 0.09330065548419952
Epoch: 689
Loss on hold-out set: 0.01188306352355236
MeanAbsoluteError value on hold-out data: 0.08427049964666367
Epoch: 690
Loss on hold-out set: 0.011637647338059954
MeanAbsoluteError value on hold-out data: 0.08446691930294037
Epoch: 691
Loss on hold-out set: 0.012679958637830472
MeanAbsoluteError value on hold-out data: 0.08809924125671387
Epoch: 692
Loss on hold-out set: 0.012490537864287034
MeanAbsoluteError value on hold-out data: 0.08306282013654709
Epoch: 693
Loss on hold-out set: 0.012984042050496403
MeanAbsoluteError value on hold-out data: 0.09007719159126282
Epoch: 694
Loss on hold-out set: 0.01271962936152704
MeanAbsoluteError value on hold-out data: 0.08911731094121933
Epoch: 695
Loss on hold-out set: 0.012560574713279492
MeanAbsoluteError value on hold-out data: 0.08570380508899689
Epoch: 696
Loss on hold-out set: 0.011699344693612753
MeanAbsoluteError value on hold-out data: 0.08374793082475662
Epoch: 697
Loss on hold-out set: 0.01269750418922437
MeanAbsoluteError value on hold-out data: 0.0884777158498764
Epoch: 698
Loss on hold-out set: 0.011898184588984199
MeanAbsoluteError value on hold-out data: 0.08353111147880554
Epoch: 699
Loss on hold-out set: 0.013030852624894274
MeanAbsoluteError value on hold-out data: 0.08687397837638855
Epoch: 700
Loss on hold-out set: 0.01234522435159306
MeanAbsoluteError value on hold-out data: 0.08662113547325134
Epoch: 701
Loss on hold-out set: 0.014054352522167997
MeanAbsoluteError value on hold-out data: 0.0933900997042656
Epoch: 702
Loss on hold-out set: 0.01314544826150268
MeanAbsoluteError value on hold-out data: 0.08905284106731415
Epoch: 703
Loss on hold-out set: 0.012033538013699096
MeanAbsoluteError value on hold-out data: 0.08765152096748352
Epoch: 704
Loss on hold-out set: 0.012468185067215623
MeanAbsoluteError value on hold-out data: 0.08579941093921661
Epoch: 705
Loss on hold-out set: 0.013153744921049414
MeanAbsoluteError value on hold-out data: 0.0911434143781662
Epoch: 706
Loss on hold-out set: 0.012524091368735148
MeanAbsoluteError value on hold-out data: 0.08798504620790482
Epoch: 707
Loss on hold-out set: 0.013210052508845061
MeanAbsoluteError value on hold-out data: 0.08904681354761124
Epoch: 708
Loss on hold-out set: 0.013598107386860648
MeanAbsoluteError value on hold-out data: 0.09119119495153427
Epoch: 709
Loss on hold-out set: 0.014141371486760666
MeanAbsoluteError value on hold-out data: 0.09073790907859802
Epoch: 710
Loss on hold-out set: 0.012820781704455537
MeanAbsoluteError value on hold-out data: 0.08785681426525116
Epoch: 711
Loss on hold-out set: 0.012866330686204795
MeanAbsoluteError value on hold-out data: 0.09056821465492249
Epoch: 712
Loss on hold-out set: 0.014465242898877477
MeanAbsoluteError value on hold-out data: 0.09147734940052032
Epoch: 713
Loss on hold-out set: 0.013697852689277474
MeanAbsoluteError value on hold-out data: 0.09009963274002075
Epoch: 714
Loss on hold-out set: 0.013242653588191993
MeanAbsoluteError value on hold-out data: 0.08999785035848618
Epoch: 715
Loss on hold-out set: 0.013084735667216591
MeanAbsoluteError value on hold-out data: 0.08778665959835052
Epoch: 716
Loss on hold-out set: 0.01430531723065845
MeanAbsoluteError value on hold-out data: 0.09265326708555222
Epoch: 717
Loss on hold-out set: 0.011770772607972806
MeanAbsoluteError value on hold-out data: 0.08654747903347015
Epoch: 718
Loss on hold-out set: 0.012620663928585903
MeanAbsoluteError value on hold-out data: 0.08611008524894714
Epoch: 719
Loss on hold-out set: 0.012181189011510772
MeanAbsoluteError value on hold-out data: 0.0852796733379364
Epoch: 720
Loss on hold-out set: 0.011925678347761277
MeanAbsoluteError value on hold-out data: 0.08495573699474335
Epoch: 721
Loss on hold-out set: 0.014349375255903093
MeanAbsoluteError value on hold-out data: 0.09411577135324478
Epoch: 722
Loss on hold-out set: 0.012351640255656094
MeanAbsoluteError value on hold-out data: 0.08812856674194336
Epoch: 723
Loss on hold-out set: 0.013054473199414739
MeanAbsoluteError value on hold-out data: 0.08619922399520874
Epoch: 724
Loss on hold-out set: 0.012665810012695147
MeanAbsoluteError value on hold-out data: 0.08578064292669296
Epoch: 725
Loss on hold-out set: 0.011133429372615258
MeanAbsoluteError value on hold-out data: 0.08171672374010086
Epoch: 726
Loss on hold-out set: 0.012114941911713686
MeanAbsoluteError value on hold-out data: 0.08497874438762665
Epoch: 727
Loss on hold-out set: 0.012958208239385082
MeanAbsoluteError value on hold-out data: 0.08857624232769012
Epoch: 728
Loss on hold-out set: 0.01358864083973458
MeanAbsoluteError value on hold-out data: 0.09441044926643372
Epoch: 729
Loss on hold-out set: 0.012326415392381022
MeanAbsoluteError value on hold-out data: 0.08616271615028381
Epoch: 730
Loss on hold-out set: 0.014654912042096839
MeanAbsoluteError value on hold-out data: 0.09384692460298538
Epoch: 731
Loss on hold-out set: 0.012183641204974265
MeanAbsoluteError value on hold-out data: 0.08626497536897659
Epoch: 732
Loss on hold-out set: 0.012818603818983925
MeanAbsoluteError value on hold-out data: 0.0857371836900711
Epoch: 733
Loss on hold-out set: 0.01261325540469746
MeanAbsoluteError value on hold-out data: 0.08627191185951233
Epoch: 734
Loss on hold-out set: 0.012626241226292526
MeanAbsoluteError value on hold-out data: 0.08745123445987701
Epoch: 735
Loss on hold-out set: 0.013011171805264893
MeanAbsoluteError value on hold-out data: 0.0891122967004776
Epoch: 736
Loss on hold-out set: 0.012861932909872848
MeanAbsoluteError value on hold-out data: 0.08727499097585678
Epoch: 737
Loss on hold-out set: 0.010715143421790951
MeanAbsoluteError value on hold-out data: 0.07913891971111298
Epoch: 738
Loss on hold-out set: 0.013597574444105098
MeanAbsoluteError value on hold-out data: 0.08969129621982574
Epoch: 739
Loss on hold-out set: 0.014265067936236542
MeanAbsoluteError value on hold-out data: 0.08970477432012558
Epoch: 740
Loss on hold-out set: 0.01299637900578091
MeanAbsoluteError value on hold-out data: 0.08720935136079788
Epoch: 741
Loss on hold-out set: 0.0119786833843591
MeanAbsoluteError value on hold-out data: 0.08473580330610275
Epoch: 742
Loss on hold-out set: 0.013926942048662265
MeanAbsoluteError value on hold-out data: 0.08845304697751999
Epoch: 743
Loss on hold-out set: 0.011798695513571147
MeanAbsoluteError value on hold-out data: 0.08280456066131592
Epoch: 744
Loss on hold-out set: 0.011462782865322273
MeanAbsoluteError value on hold-out data: 0.08435072749853134
Epoch: 745
Loss on hold-out set: 0.013294922906983022
MeanAbsoluteError value on hold-out data: 0.08772669732570648
Epoch: 746
Loss on hold-out set: 0.013753324885765323
MeanAbsoluteError value on hold-out data: 0.08961501717567444
Epoch: 747
Loss on hold-out set: 0.011996443930159634
MeanAbsoluteError value on hold-out data: 0.08775123953819275
Epoch: 748
Loss on hold-out set: 0.01109041397034313
MeanAbsoluteError value on hold-out data: 0.08418910950422287
Epoch: 749
Loss on hold-out set: 0.013004380193015095
MeanAbsoluteError value on hold-out data: 0.08965165168046951
Epoch: 750
Loss on hold-out set: 0.01180291889810178
MeanAbsoluteError value on hold-out data: 0.08493354171514511
Epoch: 751
Loss on hold-out set: 0.012480430217159059
MeanAbsoluteError value on hold-out data: 0.08616279810667038
Epoch: 752
Loss on hold-out set: 0.013574927137609242
MeanAbsoluteError value on hold-out data: 0.08957617729902267
Epoch: 753
Loss on hold-out set: 0.012100999832291563
MeanAbsoluteError value on hold-out data: 0.08573054522275925
Epoch: 754
Loss on hold-out set: 0.01180320963672178
MeanAbsoluteError value on hold-out data: 0.08742079138755798
Epoch: 755
Loss on hold-out set: 0.011516064378859785
MeanAbsoluteError value on hold-out data: 0.08355271816253662
Epoch: 756
Loss on hold-out set: 0.012287774001670186
MeanAbsoluteError value on hold-out data: 0.0848066657781601
Epoch: 757
Loss on hold-out set: 0.01216318772911715
MeanAbsoluteError value on hold-out data: 0.0855807289481163
Epoch: 758
Loss on hold-out set: 0.012241646413137157
MeanAbsoluteError value on hold-out data: 0.08664602041244507
Epoch: 759
Loss on hold-out set: 0.012485339085202819
MeanAbsoluteError value on hold-out data: 0.08774613589048386
Epoch: 760
Loss on hold-out set: 0.013973361970453577
MeanAbsoluteError value on hold-out data: 0.09040163457393646
Epoch: 761
Loss on hold-out set: 0.012458859768266849
MeanAbsoluteError value on hold-out data: 0.08438430726528168
Epoch: 762
Loss on hold-out set: 0.013375750701913299
MeanAbsoluteError value on hold-out data: 0.09222891926765442
Epoch: 763
Loss on hold-out set: 0.011056985749455635
MeanAbsoluteError value on hold-out data: 0.08333223313093185
Epoch: 764
Loss on hold-out set: 0.010242504973624212
MeanAbsoluteError value on hold-out data: 0.08101566880941391
Epoch: 765
Loss on hold-out set: 0.012098881852289196
MeanAbsoluteError value on hold-out data: 0.08631699532270432
Epoch: 766
Loss on hold-out set: 0.014141004553093807
MeanAbsoluteError value on hold-out data: 0.09138122946023941
Epoch: 767
Loss on hold-out set: 0.012919074203455238
MeanAbsoluteError value on hold-out data: 0.08367440849542618
Epoch: 768
Loss on hold-out set: 0.011799216322639647
MeanAbsoluteError value on hold-out data: 0.0864100456237793
Epoch: 769
Loss on hold-out set: 0.011981926263591352
MeanAbsoluteError value on hold-out data: 0.08330660313367844
Epoch: 770
Loss on hold-out set: 0.01342455411880413
MeanAbsoluteError value on hold-out data: 0.08769085258245468
Epoch: 771
Loss on hold-out set: 0.012303375237000485
MeanAbsoluteError value on hold-out data: 0.08904960751533508
Epoch: 772
Loss on hold-out set: 0.012884925896166048
MeanAbsoluteError value on hold-out data: 0.08779892325401306
Epoch: 773
Loss on hold-out set: 0.01342523778512259
MeanAbsoluteError value on hold-out data: 0.09038350731134415
Epoch: 774
Loss on hold-out set: 0.010851069331038162
MeanAbsoluteError value on hold-out data: 0.0823388397693634
Epoch: 775
Loss on hold-out set: 0.011227956468089056
MeanAbsoluteError value on hold-out data: 0.08212043344974518
Epoch: 776
Loss on hold-out set: 0.012443963936821092
MeanAbsoluteError value on hold-out data: 0.08889316767454147
Epoch: 777
Loss on hold-out set: 0.011040048626115701
MeanAbsoluteError value on hold-out data: 0.08010250329971313
Epoch: 778
Loss on hold-out set: 0.011998433564828399
MeanAbsoluteError value on hold-out data: 0.08634712547063828
Epoch: 779
Loss on hold-out set: 0.013291294168933139
MeanAbsoluteError value on hold-out data: 0.08886051923036575
Epoch: 780
Loss on hold-out set: 0.011425939345887553
MeanAbsoluteError value on hold-out data: 0.08427557349205017
Epoch: 781
Loss on hold-out set: 0.013387170296967572
MeanAbsoluteError value on hold-out data: 0.08951973915100098
Epoch: 782
Loss on hold-out set: 0.011049545040550583
MeanAbsoluteError value on hold-out data: 0.08177652209997177
Epoch: 783
Loss on hold-out set: 0.011979788466705941
MeanAbsoluteError value on hold-out data: 0.08643443137407303
Epoch: 784
Loss on hold-out set: 0.01211766721464907
MeanAbsoluteError value on hold-out data: 0.08466245979070663
Epoch: 785
Loss on hold-out set: 0.012873961796152193
MeanAbsoluteError value on hold-out data: 0.08672527968883514
Epoch: 786
Loss on hold-out set: 0.013870939981934498
MeanAbsoluteError value on hold-out data: 0.09261983633041382
Epoch: 787
Loss on hold-out set: 0.010635371442228158
MeanAbsoluteError value on hold-out data: 0.07820173352956772
Epoch: 788
Loss on hold-out set: 0.012671568899822887
MeanAbsoluteError value on hold-out data: 0.08972571045160294
Epoch: 789
Loss on hold-out set: 0.014468685647952952
MeanAbsoluteError value on hold-out data: 0.09122655540704727
Epoch: 790
Loss on hold-out set: 0.011901643021822868
MeanAbsoluteError value on hold-out data: 0.08493802696466446
Epoch: 791
Loss on hold-out set: 0.011601468781524698
MeanAbsoluteError value on hold-out data: 0.08108171075582504
Epoch: 792
Loss on hold-out set: 0.012160943084939693
MeanAbsoluteError value on hold-out data: 0.08367742598056793
Epoch: 793
Loss on hold-out set: 0.013027104284313584
MeanAbsoluteError value on hold-out data: 0.08472678810358047
Epoch: 794
Loss on hold-out set: 0.011405488517775666
MeanAbsoluteError value on hold-out data: 0.08189181983470917
Epoch: 795
Loss on hold-out set: 0.011776490182067695
MeanAbsoluteError value on hold-out data: 0.08248760551214218
Epoch: 796
Loss on hold-out set: 0.011303512883217385
MeanAbsoluteError value on hold-out data: 0.08201848715543747
Epoch: 797
Loss on hold-out set: 0.011618876383217867
MeanAbsoluteError value on hold-out data: 0.08553403615951538
Epoch: 798
Loss on hold-out set: 0.011672140774559617
MeanAbsoluteError value on hold-out data: 0.08502933382987976
Epoch: 799
Loss on hold-out set: 0.010662167545039363
MeanAbsoluteError value on hold-out data: 0.08136638253927231
Epoch: 800
Loss on hold-out set: 0.011274817948618268
MeanAbsoluteError value on hold-out data: 0.08448804914951324
Epoch: 801
Loss on hold-out set: 0.010784141200056184
MeanAbsoluteError value on hold-out data: 0.079198457300663
Epoch: 802
Loss on hold-out set: 0.011039089182935034
MeanAbsoluteError value on hold-out data: 0.08179257065057755
Epoch: 803
Loss on hold-out set: 0.013828555932802071
MeanAbsoluteError value on hold-out data: 0.08979856222867966
Epoch: 804
Loss on hold-out set: 0.011586666209235166
MeanAbsoluteError value on hold-out data: 0.08371501415967941
Epoch: 805
Loss on hold-out set: 0.013490127457092362
MeanAbsoluteError value on hold-out data: 0.08852682262659073
Epoch: 806
Loss on hold-out set: 0.011095156997034792
MeanAbsoluteError value on hold-out data: 0.0812486782670021
Epoch: 807
Loss on hold-out set: 0.011507817926079345
MeanAbsoluteError value on hold-out data: 0.08361614495515823
Epoch: 808
Loss on hold-out set: 0.011008284379252775
MeanAbsoluteError value on hold-out data: 0.08174049109220505
Epoch: 809
Loss on hold-out set: 0.011108640988920039
MeanAbsoluteError value on hold-out data: 0.08199521154165268
Epoch: 810
Loss on hold-out set: 0.011518515779644077
MeanAbsoluteError value on hold-out data: 0.08282718062400818
Epoch: 811
Loss on hold-out set: 0.011967540004673842
MeanAbsoluteError value on hold-out data: 0.082037553191185
Epoch: 812
Loss on hold-out set: 0.011611448961969776
MeanAbsoluteError value on hold-out data: 0.08389236778020859
Epoch: 813
Loss on hold-out set: 0.011980677560356222
MeanAbsoluteError value on hold-out data: 0.08308465033769608
Epoch: 814
Loss on hold-out set: 0.011500616886975573
MeanAbsoluteError value on hold-out data: 0.08375483006238937
Epoch: 815
Loss on hold-out set: 0.011432845077652019
MeanAbsoluteError value on hold-out data: 0.08162788301706314
Epoch: 816
Loss on hold-out set: 0.012313522117644122
MeanAbsoluteError value on hold-out data: 0.08670057356357574
Epoch: 817
Loss on hold-out set: 0.012256287412601524
MeanAbsoluteError value on hold-out data: 0.0866534411907196
Epoch: 818
Loss on hold-out set: 0.012908929718105356
MeanAbsoluteError value on hold-out data: 0.08779755234718323
Epoch: 819
Loss on hold-out set: 0.012240995044024506
MeanAbsoluteError value on hold-out data: 0.08413910865783691
Epoch: 820
Loss on hold-out set: 0.010930234648840268
MeanAbsoluteError value on hold-out data: 0.0791812613606453
Epoch: 821
Loss on hold-out set: 0.011936716669685363
MeanAbsoluteError value on hold-out data: 0.08415084332227707
Epoch: 822
Loss on hold-out set: 0.011230126950279858
MeanAbsoluteError value on hold-out data: 0.08141020685434341
Epoch: 823
Loss on hold-out set: 0.011164294381892433
MeanAbsoluteError value on hold-out data: 0.08047421276569366
Epoch: 824
Loss on hold-out set: 0.010624449126759524
MeanAbsoluteError value on hold-out data: 0.08102314919233322
Epoch: 825
Loss on hold-out set: 0.011338629017118365
MeanAbsoluteError value on hold-out data: 0.08278010785579681
Epoch: 826
Loss on hold-out set: 0.010555658434326081
MeanAbsoluteError value on hold-out data: 0.07884190231561661
Epoch: 827
Loss on hold-out set: 0.011935888835723744
MeanAbsoluteError value on hold-out data: 0.08288687467575073
Epoch: 828
Loss on hold-out set: 0.011583926765694438
MeanAbsoluteError value on hold-out data: 0.08206073939800262
Epoch: 829
Loss on hold-out set: 0.014087004375360266
MeanAbsoluteError value on hold-out data: 0.0908716544508934
Epoch: 830
Loss on hold-out set: 0.010682029907184188
MeanAbsoluteError value on hold-out data: 0.0804421454668045
Epoch: 831
Loss on hold-out set: 0.010381664615658034
MeanAbsoluteError value on hold-out data: 0.07955286651849747
Epoch: 832
Loss on hold-out set: 0.011529517546587159
MeanAbsoluteError value on hold-out data: 0.08365439623594284
Epoch: 833
Loss on hold-out set: 0.01316332909448344
MeanAbsoluteError value on hold-out data: 0.08688691258430481
Epoch: 834
Loss on hold-out set: 0.011936328006559051
MeanAbsoluteError value on hold-out data: 0.08250074088573456
Epoch: 835
Loss on hold-out set: 0.011281562968451907
MeanAbsoluteError value on hold-out data: 0.08245930075645447
Epoch: 836
Loss on hold-out set: 0.010315238280236371
MeanAbsoluteError value on hold-out data: 0.07801496237516403
Epoch: 837
Loss on hold-out set: 0.011670130225199197
MeanAbsoluteError value on hold-out data: 0.08337120711803436
Epoch: 838
Loss on hold-out set: 0.0120641632253925
MeanAbsoluteError value on hold-out data: 0.08370015770196915
Epoch: 839
Loss on hold-out set: 0.010843678280646902
MeanAbsoluteError value on hold-out data: 0.07919090986251831
Epoch: 840
Loss on hold-out set: 0.011693526269179225
MeanAbsoluteError value on hold-out data: 0.08371320366859436
Epoch: 841
Loss on hold-out set: 0.011069020242794068
MeanAbsoluteError value on hold-out data: 0.08100102841854095
Epoch: 842
Loss on hold-out set: 0.01034281872266547
MeanAbsoluteError value on hold-out data: 0.07875091582536697
Epoch: 843
Loss on hold-out set: 0.012247307965444633
MeanAbsoluteError value on hold-out data: 0.0831490233540535
Epoch: 844
Loss on hold-out set: 0.01091521096725046
MeanAbsoluteError value on hold-out data: 0.07879704236984253
Epoch: 845
Loss on hold-out set: 0.011131199973945816
MeanAbsoluteError value on hold-out data: 0.08216004818677902
Epoch: 846
Loss on hold-out set: 0.00993901727575576
MeanAbsoluteError value on hold-out data: 0.07765551656484604
Epoch: 847
Loss on hold-out set: 0.010726211102301021
MeanAbsoluteError value on hold-out data: 0.08032229542732239
Epoch: 848
Loss on hold-out set: 0.012744686646134748
MeanAbsoluteError value on hold-out data: 0.08745589107275009
Epoch: 849
Loss on hold-out set: 0.012627774894693479
MeanAbsoluteError value on hold-out data: 0.08677123486995697
Epoch: 850
Loss on hold-out set: 0.011101351561956107
MeanAbsoluteError value on hold-out data: 0.08267340809106827
Epoch: 851
Loss on hold-out set: 0.011002069694380529
MeanAbsoluteError value on hold-out data: 0.08048713952302933
Epoch: 852
Loss on hold-out set: 0.010767496138432761
MeanAbsoluteError value on hold-out data: 0.081229567527771
Epoch: 853
Loss on hold-out set: 0.01018395329156192
MeanAbsoluteError value on hold-out data: 0.0767625942826271
Epoch: 854
Loss on hold-out set: 0.011596547325801414
MeanAbsoluteError value on hold-out data: 0.08505874872207642
Epoch: 855
Loss on hold-out set: 0.011319401988924558
MeanAbsoluteError value on hold-out data: 0.08222608268260956
Epoch: 856
Loss on hold-out set: 0.011260001235047336
MeanAbsoluteError value on hold-out data: 0.08116014301776886
Epoch: 857
Loss on hold-out set: 0.011189392602088143
MeanAbsoluteError value on hold-out data: 0.08273845165967941
Epoch: 858
Loss on hold-out set: 0.01017409069861363
MeanAbsoluteError value on hold-out data: 0.07705404609441757
Epoch: 859
Loss on hold-out set: 0.009581510087785622
MeanAbsoluteError value on hold-out data: 0.07375685125589371
Epoch: 860
Loss on hold-out set: 0.012045689486294578
MeanAbsoluteError value on hold-out data: 0.08342054486274719
Epoch: 861
Loss on hold-out set: 0.011037766601184558
MeanAbsoluteError value on hold-out data: 0.08211993426084518
Epoch: 862
Loss on hold-out set: 0.011883186729198011
MeanAbsoluteError value on hold-out data: 0.0832231417298317
Epoch: 863
Loss on hold-out set: 0.012449861841111366
MeanAbsoluteError value on hold-out data: 0.08695417642593384
Epoch: 864
Loss on hold-out set: 0.009714270307197997
MeanAbsoluteError value on hold-out data: 0.07330384850502014
Epoch: 865
Loss on hold-out set: 0.012020599166426109
MeanAbsoluteError value on hold-out data: 0.08357254415750504
Epoch: 866
Loss on hold-out set: 0.011527140414254972
MeanAbsoluteError value on hold-out data: 0.08035433292388916
Epoch: 867
Loss on hold-out set: 0.012636652699457044
MeanAbsoluteError value on hold-out data: 0.08602447807788849
Epoch: 868
Loss on hold-out set: 0.009657222447447869
MeanAbsoluteError value on hold-out data: 0.07362610846757889
Epoch: 869
Loss on hold-out set: 0.010846543497852206
MeanAbsoluteError value on hold-out data: 0.08212128281593323
Epoch: 870
Loss on hold-out set: 0.012415880424353721
MeanAbsoluteError value on hold-out data: 0.08488207310438156
Epoch: 871
Loss on hold-out set: 0.009936146672504644
MeanAbsoluteError value on hold-out data: 0.07739043235778809
Epoch: 872
Loss on hold-out set: 0.010411124652103657
MeanAbsoluteError value on hold-out data: 0.07802010327577591
Epoch: 873
Loss on hold-out set: 0.011898804070733604
MeanAbsoluteError value on hold-out data: 0.08232010900974274
Epoch: 874
Loss on hold-out set: 0.011238187746588059
MeanAbsoluteError value on hold-out data: 0.08148813992738724
Epoch: 875
Loss on hold-out set: 0.010350608478765934
MeanAbsoluteError value on hold-out data: 0.07636826485395432
Epoch: 876
Loss on hold-out set: 0.013180579276401356
MeanAbsoluteError value on hold-out data: 0.08693882077932358
Epoch: 877
Loss on hold-out set: 0.010692943736939924
MeanAbsoluteError value on hold-out data: 0.08147761225700378
Epoch: 878
Loss on hold-out set: 0.009824059649254195
MeanAbsoluteError value on hold-out data: 0.07660999149084091
Epoch: 879
Loss on hold-out set: 0.010092309808484667
MeanAbsoluteError value on hold-out data: 0.07760817557573318
Epoch: 880
Loss on hold-out set: 0.009043683046487179
MeanAbsoluteError value on hold-out data: 0.07335129380226135
Epoch: 881
Loss on hold-out set: 0.009530710670533153
MeanAbsoluteError value on hold-out data: 0.07323633879423141
Epoch: 882
Loss on hold-out set: 0.010491269551663815
MeanAbsoluteError value on hold-out data: 0.08048603683710098
Epoch: 883
Loss on hold-out set: 0.010930845852805456
MeanAbsoluteError value on hold-out data: 0.08128991723060608
Epoch: 884
Loss on hold-out set: 0.010460088675439086
MeanAbsoluteError value on hold-out data: 0.07993011176586151
Epoch: 885
Loss on hold-out set: 0.012758019605292551
MeanAbsoluteError value on hold-out data: 0.08459124714136124
Epoch: 886
Loss on hold-out set: 0.011770714810215093
MeanAbsoluteError value on hold-out data: 0.08216031640768051
Epoch: 887
Loss on hold-out set: 0.008571091348870444
MeanAbsoluteError value on hold-out data: 0.07301763445138931
Epoch: 888
Loss on hold-out set: 0.009787933603899244
MeanAbsoluteError value on hold-out data: 0.07502167671918869
Epoch: 889
Loss on hold-out set: 0.012312814409178828
MeanAbsoluteError value on hold-out data: 0.08393819630146027
Epoch: 890
Loss on hold-out set: 0.010086323127761716
MeanAbsoluteError value on hold-out data: 0.07574021816253662
Epoch: 891
Loss on hold-out set: 0.010510929646649554
MeanAbsoluteError value on hold-out data: 0.07885991036891937
Epoch: 892
Loss on hold-out set: 0.011650932160888866
MeanAbsoluteError value on hold-out data: 0.07822158187627792
Epoch: 893
Loss on hold-out set: 0.012865283436331082
MeanAbsoluteError value on hold-out data: 0.08588545769453049
Epoch: 894
Loss on hold-out set: 0.010196647540149872
MeanAbsoluteError value on hold-out data: 0.07666347175836563
Epoch: 895
Loss on hold-out set: 0.009998383710917552
MeanAbsoluteError value on hold-out data: 0.07920150458812714
Epoch: 896
Loss on hold-out set: 0.01132343448291067
MeanAbsoluteError value on hold-out data: 0.08139953017234802
Epoch: 897
Loss on hold-out set: 0.009667114522647655
MeanAbsoluteError value on hold-out data: 0.07537037134170532
Epoch: 898
Loss on hold-out set: 0.009620765826596956
MeanAbsoluteError value on hold-out data: 0.07492302358150482
Epoch: 899
Loss on hold-out set: 0.010322365018558533
MeanAbsoluteError value on hold-out data: 0.0766887292265892
Epoch: 900
Loss on hold-out set: 0.011886825458398864
MeanAbsoluteError value on hold-out data: 0.08389817923307419
Epoch: 901
Loss on hold-out set: 0.009921770253513387
MeanAbsoluteError value on hold-out data: 0.07962053269147873
Epoch: 902
Loss on hold-out set: 0.011594705942552536
MeanAbsoluteError value on hold-out data: 0.08278374373912811
Epoch: 903
Loss on hold-out set: 0.008923180823452033
MeanAbsoluteError value on hold-out data: 0.07346943020820618
Epoch: 904
Loss on hold-out set: 0.009698941410933913
MeanAbsoluteError value on hold-out data: 0.07446165382862091
Epoch: 905
Loss on hold-out set: 0.011191319830965465
MeanAbsoluteError value on hold-out data: 0.07768368721008301
Epoch: 906
Loss on hold-out set: 0.011489188829630924
MeanAbsoluteError value on hold-out data: 0.08518160134553909
Epoch: 907
Loss on hold-out set: 0.00980612563022684
MeanAbsoluteError value on hold-out data: 0.07580678164958954
Epoch: 908
Loss on hold-out set: 0.010788866267782093
MeanAbsoluteError value on hold-out data: 0.0811467319726944
Epoch: 909
Loss on hold-out set: 0.010648849982195922
MeanAbsoluteError value on hold-out data: 0.07759436219930649
Epoch: 910
Loss on hold-out set: 0.010181586553937147
MeanAbsoluteError value on hold-out data: 0.07620266824960709
Epoch: 911
Loss on hold-out set: 0.011637296385573185
MeanAbsoluteError value on hold-out data: 0.08072564750909805
Epoch: 912
Loss on hold-out set: 0.009753079028450884
MeanAbsoluteError value on hold-out data: 0.07639852911233902
Epoch: 913
Loss on hold-out set: 0.010925624020267909
MeanAbsoluteError value on hold-out data: 0.0797857865691185
Epoch: 914
Loss on hold-out set: 0.011447302356294434
MeanAbsoluteError value on hold-out data: 0.08382344990968704
Epoch: 915
Loss on hold-out set: 0.011283781160285193
MeanAbsoluteError value on hold-out data: 0.08178950846195221
Epoch: 916
Loss on hold-out set: 0.01149926573173919
MeanAbsoluteError value on hold-out data: 0.08149708807468414
Epoch: 917
Loss on hold-out set: 0.009685684936133233
MeanAbsoluteError value on hold-out data: 0.07535754889249802
Epoch: 918
Loss on hold-out set: 0.01112926283092141
MeanAbsoluteError value on hold-out data: 0.08087322860956192
Epoch: 919
Loss on hold-out set: 0.011208657756748532
MeanAbsoluteError value on hold-out data: 0.07959631830453873
Epoch: 920
Loss on hold-out set: 0.00963024061613093
MeanAbsoluteError value on hold-out data: 0.07530762255191803
Epoch: 921
Loss on hold-out set: 0.010469882827892433
MeanAbsoluteError value on hold-out data: 0.07819490134716034
Epoch: 922
Loss on hold-out set: 0.012223835750458724
MeanAbsoluteError value on hold-out data: 0.08147012442350388
Epoch: 923
Loss on hold-out set: 0.009363636859634426
MeanAbsoluteError value on hold-out data: 0.07406962662935257
Epoch: 924
Loss on hold-out set: 0.01068465577426347
MeanAbsoluteError value on hold-out data: 0.07824739813804626
Epoch: 925
Loss on hold-out set: 0.010228417920977033
MeanAbsoluteError value on hold-out data: 0.0777050107717514
Epoch: 926
Loss on hold-out set: 0.009460290012575569
MeanAbsoluteError value on hold-out data: 0.07570652663707733
Epoch: 927
Loss on hold-out set: 0.012148361420355892
MeanAbsoluteError value on hold-out data: 0.08110832422971725
Epoch: 928
Loss on hold-out set: 0.010441628073834485
MeanAbsoluteError value on hold-out data: 0.0764390081167221
Epoch: 929
Loss on hold-out set: 0.010344230524788145
MeanAbsoluteError value on hold-out data: 0.07888161391019821
Epoch: 930
Loss on hold-out set: 0.010578811253556827
MeanAbsoluteError value on hold-out data: 0.0776449665427208
Epoch: 931
Loss on hold-out set: 0.010818881153318216
MeanAbsoluteError value on hold-out data: 0.08194637298583984
Epoch: 932
Loss on hold-out set: 0.011305747826263542
MeanAbsoluteError value on hold-out data: 0.0847720131278038
Epoch: 933
Loss on hold-out set: 0.010216349559511097
MeanAbsoluteError value on hold-out data: 0.07781703025102615
Epoch: 934
Loss on hold-out set: 0.010673111585447259
MeanAbsoluteError value on hold-out data: 0.08156239986419678
Epoch: 935
Loss on hold-out set: 0.009442055633759688
MeanAbsoluteError value on hold-out data: 0.07321459800004959
Epoch: 936
Loss on hold-out set: 0.009603187029618614
MeanAbsoluteError value on hold-out data: 0.07700745016336441
Epoch: 937
Loss on hold-out set: 0.012300327897216145
MeanAbsoluteError value on hold-out data: 0.08000442385673523
Epoch: 938
Loss on hold-out set: 0.009919422459400569
MeanAbsoluteError value on hold-out data: 0.07508837431669235
Epoch: 939
Loss on hold-out set: 0.011393129071804347
MeanAbsoluteError value on hold-out data: 0.08039872348308563
Epoch: 940
Loss on hold-out set: 0.009329245655268702
MeanAbsoluteError value on hold-out data: 0.0757722407579422
Epoch: 941
Loss on hold-out set: 0.011735394475836073
MeanAbsoluteError value on hold-out data: 0.07997515052556992
Epoch: 942
Loss on hold-out set: 0.00905605819883931
MeanAbsoluteError value on hold-out data: 0.07426174730062485
Epoch: 943
Loss on hold-out set: 0.009828533759755374
MeanAbsoluteError value on hold-out data: 0.07670848071575165
Epoch: 944
Loss on hold-out set: 0.011459527563359492
MeanAbsoluteError value on hold-out data: 0.07962018996477127
Epoch: 945
Loss on hold-out set: 0.010743568845167223
MeanAbsoluteError value on hold-out data: 0.08020272850990295
Epoch: 946
Loss on hold-out set: 0.009788208157324334
MeanAbsoluteError value on hold-out data: 0.07533377408981323
Epoch: 947
Loss on hold-out set: 0.008806327874626731
MeanAbsoluteError value on hold-out data: 0.07087283581495285
Epoch: 948
Loss on hold-out set: 0.010362649094046598
MeanAbsoluteError value on hold-out data: 0.07875249534845352
Epoch: 949
Loss on hold-out set: 0.009212878400733947
MeanAbsoluteError value on hold-out data: 0.07466551661491394
Epoch: 950
Loss on hold-out set: 0.009756038544728653
MeanAbsoluteError value on hold-out data: 0.07526512444019318
Epoch: 951
Loss on hold-out set: 0.010304971674340777
MeanAbsoluteError value on hold-out data: 0.07650909572839737
Epoch: 952
Loss on hold-out set: 0.009332118636739323
MeanAbsoluteError value on hold-out data: 0.07305598258972168
Epoch: 953
Loss on hold-out set: 0.009913195461801175
MeanAbsoluteError value on hold-out data: 0.07612424343824387
Epoch: 954
Loss on hold-out set: 0.009712812347909978
MeanAbsoluteError value on hold-out data: 0.0759115070104599
Epoch: 955
Loss on hold-out set: 0.0106108248228702
MeanAbsoluteError value on hold-out data: 0.07803580164909363
Epoch: 956
Loss on hold-out set: 0.010694061802350916
MeanAbsoluteError value on hold-out data: 0.07820043712854385
Epoch: 957
Loss on hold-out set: 0.010872460028501034
MeanAbsoluteError value on hold-out data: 0.07296457886695862
Epoch: 958
Loss on hold-out set: 0.011210595083454488
MeanAbsoluteError value on hold-out data: 0.08183058351278305
Epoch: 959
Loss on hold-out set: 0.009406058641179698
MeanAbsoluteError value on hold-out data: 0.07388607412576675
Epoch: 960
Loss on hold-out set: 0.009373827574502986
MeanAbsoluteError value on hold-out data: 0.07419221848249435
Epoch: 961
Loss on hold-out set: 0.011036212439333516
MeanAbsoluteError value on hold-out data: 0.07802502065896988
Epoch: 962
Loss on hold-out set: 0.009454057110997383
MeanAbsoluteError value on hold-out data: 0.07698939740657806
Epoch: 963
Loss on hold-out set: 0.010507154296719818
MeanAbsoluteError value on hold-out data: 0.0788377970457077
Epoch: 964
Loss on hold-out set: 0.011663131368501733
MeanAbsoluteError value on hold-out data: 0.08046978712081909
Epoch: 965
Loss on hold-out set: 0.010330935567374884
MeanAbsoluteError value on hold-out data: 0.07680422067642212
Epoch: 966
Loss on hold-out set: 0.009434807906557884
MeanAbsoluteError value on hold-out data: 0.07246711105108261
Epoch: 967
Loss on hold-out set: 0.00963090285261084
MeanAbsoluteError value on hold-out data: 0.07431209832429886
Epoch: 968
Loss on hold-out set: 0.009517166421113265
MeanAbsoluteError value on hold-out data: 0.0723995789885521
Epoch: 969
Loss on hold-out set: 0.010253295194961537
MeanAbsoluteError value on hold-out data: 0.07555851340293884
Epoch: 970
Loss on hold-out set: 0.011613360470679861
MeanAbsoluteError value on hold-out data: 0.08136185258626938
Epoch: 971
Loss on hold-out set: 0.009578481784895605
MeanAbsoluteError value on hold-out data: 0.07791154831647873
Epoch: 972
Loss on hold-out set: 0.009575991954140288
MeanAbsoluteError value on hold-out data: 0.07213268429040909
Epoch: 973
Loss on hold-out set: 0.011447737076669
MeanAbsoluteError value on hold-out data: 0.08059965819120407
Epoch: 974
Loss on hold-out set: 0.011248948663366416
MeanAbsoluteError value on hold-out data: 0.07986027747392654
Epoch: 975
Loss on hold-out set: 0.011044749349772853
MeanAbsoluteError value on hold-out data: 0.07986459881067276
Epoch: 976
Loss on hold-out set: 0.011007376743449034
MeanAbsoluteError value on hold-out data: 0.0781758576631546
Epoch: 977
Loss on hold-out set: 0.009616293346043676
MeanAbsoluteError value on hold-out data: 0.07407193630933762
Epoch: 978
Loss on hold-out set: 0.0109226624971537
MeanAbsoluteError value on hold-out data: 0.08016619086265564
Epoch: 979
Loss on hold-out set: 0.011053751774137102
MeanAbsoluteError value on hold-out data: 0.07844670861959457
Epoch: 980
Loss on hold-out set: 0.010211983267605926
MeanAbsoluteError value on hold-out data: 0.07649590075016022
Epoch: 981
Loss on hold-out set: 0.011979776965243522
MeanAbsoluteError value on hold-out data: 0.08374187350273132
Epoch: 982
Loss on hold-out set: 0.008401206894801968
MeanAbsoluteError value on hold-out data: 0.06820829957723618
Epoch: 983
Loss on hold-out set: 0.010702291525376495
MeanAbsoluteError value on hold-out data: 0.07759542763233185
Epoch: 984
Loss on hold-out set: 0.009038299289192461
MeanAbsoluteError value on hold-out data: 0.07268133014440536
Epoch: 985
Loss on hold-out set: 0.01165526556116068
MeanAbsoluteError value on hold-out data: 0.07808268815279007
Epoch: 986
Loss on hold-out set: 0.008848559235290546
MeanAbsoluteError value on hold-out data: 0.07100924849510193
Epoch: 987
Loss on hold-out set: 0.011627281225592014
MeanAbsoluteError value on hold-out data: 0.07964054495096207
Epoch: 988
Loss on hold-out set: 0.010490323477854228
MeanAbsoluteError value on hold-out data: 0.07779710739850998
Epoch: 989
Loss on hold-out set: 0.010166846054926282
MeanAbsoluteError value on hold-out data: 0.07428087294101715
Epoch: 990
Loss on hold-out set: 0.009111096979904688
MeanAbsoluteError value on hold-out data: 0.07309652864933014
Epoch: 991
Loss on hold-out set: 0.010705855964770307
MeanAbsoluteError value on hold-out data: 0.07670044898986816
Epoch: 992
Loss on hold-out set: 0.01164819191462205
MeanAbsoluteError value on hold-out data: 0.08096406608819962
Epoch: 993
Loss on hold-out set: 0.009000820468694049
MeanAbsoluteError value on hold-out data: 0.07011554390192032
Epoch: 994
Loss on hold-out set: 0.00936661943420404
MeanAbsoluteError value on hold-out data: 0.07302839308977127
Epoch: 995
Loss on hold-out set: 0.011347725258298549
MeanAbsoluteError value on hold-out data: 0.08240678906440735
Epoch: 996
Loss on hold-out set: 0.010263648862504245
MeanAbsoluteError value on hold-out data: 0.07722072303295135
Epoch: 997
Loss on hold-out set: 0.009305958612676477
MeanAbsoluteError value on hold-out data: 0.0737026184797287
Epoch: 998
Loss on hold-out set: 0.010239192196161942
MeanAbsoluteError value on hold-out data: 0.08073072135448456
Epoch: 999
Loss on hold-out set: 0.009265589652204653
MeanAbsoluteError value on hold-out data: 0.07277515530586243
Epoch: 1000
Loss on hold-out set: 0.009725177163005961
MeanAbsoluteError value on hold-out data: 0.0726209506392479
Epoch: 1001
Loss on hold-out set: 0.01057377405550748
MeanAbsoluteError value on hold-out data: 0.07680947333574295
Epoch: 1002
Loss on hold-out set: 0.008551288229306616
MeanAbsoluteError value on hold-out data: 0.07063751667737961
Epoch: 1003
Loss on hold-out set: 0.009007729387046007
MeanAbsoluteError value on hold-out data: 0.07416406273841858
Epoch: 1004
Loss on hold-out set: 0.010618984085837535
MeanAbsoluteError value on hold-out data: 0.07838640362024307
Epoch: 1005
Loss on hold-out set: 0.00981269650515363
MeanAbsoluteError value on hold-out data: 0.07259254157543182
Epoch: 1006
Loss on hold-out set: 0.008242796239198167
MeanAbsoluteError value on hold-out data: 0.0682816281914711
Epoch: 1007
Loss on hold-out set: 0.010701726933087533
MeanAbsoluteError value on hold-out data: 0.0757194459438324
Epoch: 1008
Loss on hold-out set: 0.009299660897716725
MeanAbsoluteError value on hold-out data: 0.07220444828271866
Epoch: 1009
Loss on hold-out set: 0.008815709301513076
MeanAbsoluteError value on hold-out data: 0.0692988932132721
Epoch: 1010
Loss on hold-out set: 0.009899442928841987
MeanAbsoluteError value on hold-out data: 0.07601785659790039
Epoch: 1011
Loss on hold-out set: 0.009442518367265318
MeanAbsoluteError value on hold-out data: 0.07360150665044785
Epoch: 1012
Loss on hold-out set: 0.010013406508272359
MeanAbsoluteError value on hold-out data: 0.07644147425889969
Epoch: 1013
Loss on hold-out set: 0.009923798941890709
MeanAbsoluteError value on hold-out data: 0.07623566687107086
Epoch: 1014
Loss on hold-out set: 0.010784489700163248
MeanAbsoluteError value on hold-out data: 0.07818920910358429
Epoch: 1015
Loss on hold-out set: 0.009575447645862975
MeanAbsoluteError value on hold-out data: 0.07377425581216812
Epoch: 1016
Loss on hold-out set: 0.009681069523697563
MeanAbsoluteError value on hold-out data: 0.07617112994194031
Epoch: 1017
Loss on hold-out set: 0.010476114135769118
MeanAbsoluteError value on hold-out data: 0.07820925116539001
Epoch: 1018
Loss on hold-out set: 0.008877308187705543
MeanAbsoluteError value on hold-out data: 0.07127714157104492
Epoch: 1019
Loss on hold-out set: 0.010939375042871688
MeanAbsoluteError value on hold-out data: 0.07741646468639374
Epoch: 1020
Loss on hold-out set: 0.010234183436356641
MeanAbsoluteError value on hold-out data: 0.07625936716794968
Epoch: 1021
Loss on hold-out set: 0.010127170478614668
MeanAbsoluteError value on hold-out data: 0.07577290385961533
Epoch: 1022
Loss on hold-out set: 0.008944955305217566
MeanAbsoluteError value on hold-out data: 0.0710829570889473
Epoch: 1023
Loss on hold-out set: 0.009506895463488641
MeanAbsoluteError value on hold-out data: 0.07444889843463898
Epoch: 1024
Loss on hold-out set: 0.010560885810652204
MeanAbsoluteError value on hold-out data: 0.07781943678855896
Epoch: 1025
Loss on hold-out set: 0.009172637738144356
MeanAbsoluteError value on hold-out data: 0.06878434866666794
Epoch: 1026
Loss on hold-out set: 0.009400842401429752
MeanAbsoluteError value on hold-out data: 0.07478435337543488
Epoch: 1027
Loss on hold-out set: 0.00920798099740447
MeanAbsoluteError value on hold-out data: 0.07251756638288498
Epoch: 1028
Loss on hold-out set: 0.0097352374374168
MeanAbsoluteError value on hold-out data: 0.072421133518219
Epoch: 1029
Loss on hold-out set: 0.010944139965091988
MeanAbsoluteError value on hold-out data: 0.07767704129219055
Epoch: 1030
Loss on hold-out set: 0.009096001321789421
MeanAbsoluteError value on hold-out data: 0.07248464971780777
Epoch: 1031
Loss on hold-out set: 0.010415190253424952
MeanAbsoluteError value on hold-out data: 0.07700499147176743
Epoch: 1032
Loss on hold-out set: 0.008779714605916525
MeanAbsoluteError value on hold-out data: 0.07101061195135117
Epoch: 1033
Loss on hold-out set: 0.009094875795320452
MeanAbsoluteError value on hold-out data: 0.07386770099401474
Epoch: 1034
Loss on hold-out set: 0.011587884503339106
MeanAbsoluteError value on hold-out data: 0.07914580404758453
Epoch: 1035
Loss on hold-out set: 0.009593814690209304
MeanAbsoluteError value on hold-out data: 0.07651621848344803
Epoch: 1036
Loss on hold-out set: 0.008852881978491496
MeanAbsoluteError value on hold-out data: 0.06883078813552856
Epoch: 1037
Loss on hold-out set: 0.009914584590878803
MeanAbsoluteError value on hold-out data: 0.07783263176679611
Epoch: 1038
Loss on hold-out set: 0.009577070357142172
MeanAbsoluteError value on hold-out data: 0.07241222262382507
Epoch: 1039
Loss on hold-out set: 0.010668134774702291
MeanAbsoluteError value on hold-out data: 0.08023978769779205
Epoch: 1040
Loss on hold-out set: 0.012204886810698857
MeanAbsoluteError value on hold-out data: 0.07767055183649063
Epoch: 1041
Loss on hold-out set: 0.009490576878476228
MeanAbsoluteError value on hold-out data: 0.07322178781032562
Epoch: 1042
Loss on hold-out set: 0.009607587611559817
MeanAbsoluteError value on hold-out data: 0.07229162007570267
Epoch: 1043
Loss on hold-out set: 0.010004673800463024
MeanAbsoluteError value on hold-out data: 0.07492479681968689
Epoch: 1044
Loss on hold-out set: 0.00939705253438054
MeanAbsoluteError value on hold-out data: 0.07245824486017227
Epoch: 1045
Loss on hold-out set: 0.009670741640147753
MeanAbsoluteError value on hold-out data: 0.0742420181632042
Epoch: 1046
Loss on hold-out set: 0.009701374628978859
MeanAbsoluteError value on hold-out data: 0.07183480262756348
Epoch: 1047
Loss on hold-out set: 0.011103885439321554
MeanAbsoluteError value on hold-out data: 0.07779032737016678
Epoch: 1048
Loss on hold-out set: 0.00972941862962519
MeanAbsoluteError value on hold-out data: 0.07358883321285248
Epoch: 1049
Loss on hold-out set: 0.01062763389168443
MeanAbsoluteError value on hold-out data: 0.07459551841020584
Epoch: 1050
Loss on hold-out set: 0.010967192182947656
MeanAbsoluteError value on hold-out data: 0.07746878266334534
Epoch: 1051
Loss on hold-out set: 0.009690024474390763
MeanAbsoluteError value on hold-out data: 0.07377322018146515
Epoch: 1052
Loss on hold-out set: 0.009615584232475764
MeanAbsoluteError value on hold-out data: 0.07535289227962494
Epoch: 1053
Loss on hold-out set: 0.010683490657635655
MeanAbsoluteError value on hold-out data: 0.07701701670885086
Epoch: 1054
Loss on hold-out set: 0.008800420523863674
MeanAbsoluteError value on hold-out data: 0.07029798626899719
Epoch: 1055
Loss on hold-out set: 0.00867760675716757
MeanAbsoluteError value on hold-out data: 0.07197795063257217
Epoch: 1056
Loss on hold-out set: 0.009676776751487827
MeanAbsoluteError value on hold-out data: 0.07557012885808945
Epoch: 1057
Loss on hold-out set: 0.009255457454000861
MeanAbsoluteError value on hold-out data: 0.07276075333356857
Epoch: 1058
Loss on hold-out set: 0.010332659839477856
MeanAbsoluteError value on hold-out data: 0.07773642241954803
Epoch: 1059
Loss on hold-out set: 0.009316380627181691
MeanAbsoluteError value on hold-out data: 0.07255306094884872
Epoch: 1060
Loss on hold-out set: 0.011221307128337988
MeanAbsoluteError value on hold-out data: 0.07917321473360062
Epoch: 1061
Loss on hold-out set: 0.00930377825764784
MeanAbsoluteError value on hold-out data: 0.07373562455177307
Epoch: 1062
Loss on hold-out set: 0.00836077066642853
MeanAbsoluteError value on hold-out data: 0.0683092251420021
Epoch: 1063
Loss on hold-out set: 0.009681385268631857
MeanAbsoluteError value on hold-out data: 0.0766412541270256
Epoch: 1064
Loss on hold-out set: 0.009453886235401115
MeanAbsoluteError value on hold-out data: 0.072292260825634
Epoch: 1065
Loss on hold-out set: 0.00880414295205507
MeanAbsoluteError value on hold-out data: 0.07157590240240097
Epoch: 1066
Loss on hold-out set: 0.009413119602734998
MeanAbsoluteError value on hold-out data: 0.07232949882745743
Epoch: 1067
Loss on hold-out set: 0.01002874103357802
MeanAbsoluteError value on hold-out data: 0.076018325984478
Epoch: 1068
Loss on hold-out set: 0.009271467554741926
MeanAbsoluteError value on hold-out data: 0.07375795394182205
Epoch: 1069
Loss on hold-out set: 0.010589722027895428
MeanAbsoluteError value on hold-out data: 0.07812722772359848
Epoch: 1070
Loss on hold-out set: 0.010470951288953074
MeanAbsoluteError value on hold-out data: 0.07578606903553009
Epoch: 1071
Loss on hold-out set: 0.008538380886626935
MeanAbsoluteError value on hold-out data: 0.07120708376169205
Epoch: 1072
Loss on hold-out set: 0.010886410580472633
MeanAbsoluteError value on hold-out data: 0.08096170425415039
Epoch: 1073
Loss on hold-out set: 0.009664775416725509
MeanAbsoluteError value on hold-out data: 0.07347369194030762
Epoch: 1074
Loss on hold-out set: 0.008829343399702339
MeanAbsoluteError value on hold-out data: 0.07182877510786057
Epoch: 1075
Loss on hold-out set: 0.009038036361610768
MeanAbsoluteError value on hold-out data: 0.07066932320594788
Epoch: 1076
Loss on hold-out set: 0.009924541874036852
MeanAbsoluteError value on hold-out data: 0.073118194937706
Epoch: 1077
Loss on hold-out set: 0.009053778801705145
MeanAbsoluteError value on hold-out data: 0.07218649238348007
Epoch: 1078
Loss on hold-out set: 0.009988562721215809
MeanAbsoluteError value on hold-out data: 0.0732426717877388
Epoch: 1079
Loss on hold-out set: 0.010222030878482353
MeanAbsoluteError value on hold-out data: 0.07583165168762207
Epoch: 1080
Loss on hold-out set: 0.009071722915602246
MeanAbsoluteError value on hold-out data: 0.07386162132024765
Epoch: 1081
Loss on hold-out set: 0.008692576937408679
MeanAbsoluteError value on hold-out data: 0.07048815488815308
Epoch: 1082
Loss on hold-out set: 0.00953705134945873
MeanAbsoluteError value on hold-out data: 0.07170874625444412
Epoch: 1083
Loss on hold-out set: 0.009092231263142216
MeanAbsoluteError value on hold-out data: 0.07457441836595535
Epoch: 1084
Loss on hold-out set: 0.009293985647066924
MeanAbsoluteError value on hold-out data: 0.07363389432430267
Epoch: 1085
Loss on hold-out set: 0.008552578561381476
MeanAbsoluteError value on hold-out data: 0.07003049552440643
Epoch: 1086
Loss on hold-out set: 0.008803707690967713
MeanAbsoluteError value on hold-out data: 0.06893104314804077
Epoch: 1087
Loss on hold-out set: 0.008608129738898546
MeanAbsoluteError value on hold-out data: 0.06762033700942993
Epoch: 1088
Loss on hold-out set: 0.008757056253404396
MeanAbsoluteError value on hold-out data: 0.07182010263204575
Epoch: 1089
Loss on hold-out set: 0.00968268856678454
MeanAbsoluteError value on hold-out data: 0.07222871482372284
Epoch: 1090
Loss on hold-out set: 0.010482477949311337
MeanAbsoluteError value on hold-out data: 0.07621856778860092
Epoch: 1091
Loss on hold-out set: 0.009093571106738333
MeanAbsoluteError value on hold-out data: 0.07304556667804718
Epoch: 1092
Loss on hold-out set: 0.009245372861101183
MeanAbsoluteError value on hold-out data: 0.07104018330574036
Epoch: 1093
Loss on hold-out set: 0.008287690867121758
MeanAbsoluteError value on hold-out data: 0.07051204890012741
Epoch: 1094
Loss on hold-out set: 0.009231776316592005
MeanAbsoluteError value on hold-out data: 0.07218114286661148
Epoch: 1095
Loss on hold-out set: 0.009438872565709366
MeanAbsoluteError value on hold-out data: 0.07279074192047119
Epoch: 1096
Loss on hold-out set: 0.00789041826549995
MeanAbsoluteError value on hold-out data: 0.06715129315853119
Epoch: 1097
Loss on hold-out set: 0.011105660020378612
MeanAbsoluteError value on hold-out data: 0.08023377507925034
Epoch: 1098
Loss on hold-out set: 0.009125573697001527
MeanAbsoluteError value on hold-out data: 0.06866702437400818
Epoch: 1099
Loss on hold-out set: 0.00877805572381476
MeanAbsoluteError value on hold-out data: 0.07189040631055832
Epoch: 1100
Loss on hold-out set: 0.009617252025248794
MeanAbsoluteError value on hold-out data: 0.07547428458929062
Epoch: 1101
Loss on hold-out set: 0.008447098259057383
MeanAbsoluteError value on hold-out data: 0.07170986384153366
Epoch: 1102
Loss on hold-out set: 0.009003251993563026
MeanAbsoluteError value on hold-out data: 0.07218333333730698
Epoch: 1103
Loss on hold-out set: 0.009476389316356896
MeanAbsoluteError value on hold-out data: 0.07126861065626144
Epoch: 1104
Loss on hold-out set: 0.00974071442001635
MeanAbsoluteError value on hold-out data: 0.0763765498995781
Epoch: 1105
Loss on hold-out set: 0.008826807441170483
MeanAbsoluteError value on hold-out data: 0.0709325522184372
Epoch: 1106
Loss on hold-out set: 0.00871875398690463
MeanAbsoluteError value on hold-out data: 0.0699661448597908
Epoch: 1107
Loss on hold-out set: 0.0096210126059547
MeanAbsoluteError value on hold-out data: 0.07366893440485
Epoch: 1108
Loss on hold-out set: 0.009569658441954136
MeanAbsoluteError value on hold-out data: 0.07556498795747757
Epoch: 1109
Loss on hold-out set: 0.00941581903180122
MeanAbsoluteError value on hold-out data: 0.07015448063611984
Epoch: 1110
Loss on hold-out set: 0.008631181838597209
MeanAbsoluteError value on hold-out data: 0.06973371654748917
Epoch: 1111
Loss on hold-out set: 0.010138266916352829
MeanAbsoluteError value on hold-out data: 0.07794439047574997
Epoch: 1112
Loss on hold-out set: 0.007802360465478463
MeanAbsoluteError value on hold-out data: 0.06491702049970627
Epoch: 1113
Loss on hold-out set: 0.009878222316110623
MeanAbsoluteError value on hold-out data: 0.07639477401971817
Epoch: 1114
Loss on hold-out set: 0.009524286591513373
MeanAbsoluteError value on hold-out data: 0.07221706956624985
Epoch: 1115
Loss on hold-out set: 0.0095035681372489
MeanAbsoluteError value on hold-out data: 0.07117138057947159
Epoch: 1116
Loss on hold-out set: 0.009265291707597498
MeanAbsoluteError value on hold-out data: 0.07233592867851257
Epoch: 1117
Loss on hold-out set: 0.007881294821612149
MeanAbsoluteError value on hold-out data: 0.06846657395362854
Epoch: 1118
Loss on hold-out set: 0.008892809252113996
MeanAbsoluteError value on hold-out data: 0.07089365273714066
Epoch: 1119
Loss on hold-out set: 0.00902490562149372
MeanAbsoluteError value on hold-out data: 0.06932413578033447
Epoch: 1120
Loss on hold-out set: 0.00995202525848678
MeanAbsoluteError value on hold-out data: 0.07474277168512344
Epoch: 1121
Loss on hold-out set: 0.009641138482074894
MeanAbsoluteError value on hold-out data: 0.07318715006113052
Epoch: 1122
Loss on hold-out set: 0.008503998874233124
MeanAbsoluteError value on hold-out data: 0.06759624928236008
Epoch: 1123
Loss on hold-out set: 0.009782559835851619
MeanAbsoluteError value on hold-out data: 0.07433163374662399
Epoch: 1124
Loss on hold-out set: 0.0103852202790533
MeanAbsoluteError value on hold-out data: 0.07545942813158035
Epoch: 1125
Loss on hold-out set: 0.0075212915581990576
MeanAbsoluteError value on hold-out data: 0.06409978121519089
Epoch: 1126
Loss on hold-out set: 0.00832811896194471
MeanAbsoluteError value on hold-out data: 0.068243607878685
Epoch: 1127
Loss on hold-out set: 0.008819865557014358
MeanAbsoluteError value on hold-out data: 0.06974400579929352
Epoch: 1128
Loss on hold-out set: 0.008096458827640162
MeanAbsoluteError value on hold-out data: 0.06996361166238785
Epoch: 1129
Loss on hold-out set: 0.008591694594263875
MeanAbsoluteError value on hold-out data: 0.06983459740877151
Epoch: 1130
Loss on hold-out set: 0.008718842400921857
MeanAbsoluteError value on hold-out data: 0.07145986706018448
Epoch: 1131
Loss on hold-out set: 0.009638039893034148
MeanAbsoluteError value on hold-out data: 0.07187040895223618
Epoch: 1132
Loss on hold-out set: 0.0076876930855845176
MeanAbsoluteError value on hold-out data: 0.066415935754776
Epoch: 1133
Loss on hold-out set: 0.009413150898593207
MeanAbsoluteError value on hold-out data: 0.07261180877685547
Epoch: 1134
Loss on hold-out set: 0.009454770263594885
MeanAbsoluteError value on hold-out data: 0.07388591766357422
Epoch: 1135
Loss on hold-out set: 0.007600467691190715
MeanAbsoluteError value on hold-out data: 0.06649903208017349
Epoch: 1136
Loss on hold-out set: 0.010331159622037376
MeanAbsoluteError value on hold-out data: 0.07313767820596695
Epoch: 1137
Loss on hold-out set: 0.009969776441381934
MeanAbsoluteError value on hold-out data: 0.07573647797107697
Epoch: 1138
Loss on hold-out set: 0.008566666598593049
MeanAbsoluteError value on hold-out data: 0.07060754299163818
Epoch: 1139
Loss on hold-out set: 0.009385002343988163
MeanAbsoluteError value on hold-out data: 0.07255112379789352
Epoch: 1140
Loss on hold-out set: 0.008867471677998158
MeanAbsoluteError value on hold-out data: 0.06888972967863083
Epoch: 1141
Loss on hold-out set: 0.008713894049966864
MeanAbsoluteError value on hold-out data: 0.07196514308452606
Epoch: 1142
Loss on hold-out set: 0.008881130767889166
MeanAbsoluteError value on hold-out data: 0.07174346596002579
Epoch: 1143
Loss on hold-out set: 0.00913056512523023
MeanAbsoluteError value on hold-out data: 0.06970586627721786
Epoch: 1144
Loss on hold-out set: 0.007698695442522876
MeanAbsoluteError value on hold-out data: 0.06674277037382126
Epoch: 1145
Loss on hold-out set: 0.009485309362947494
MeanAbsoluteError value on hold-out data: 0.07325571030378342
Epoch: 1146
Loss on hold-out set: 0.01024058326874486
MeanAbsoluteError value on hold-out data: 0.0747070461511612
Epoch: 1147
Loss on hold-out set: 0.009163475816846282
MeanAbsoluteError value on hold-out data: 0.0710197314620018
Epoch: 1148
Loss on hold-out set: 0.007874617930162154
MeanAbsoluteError value on hold-out data: 0.06728100776672363
Epoch: 1149
Loss on hold-out set: 0.00869858145596178
MeanAbsoluteError value on hold-out data: 0.06942151486873627
Epoch: 1150
Loss on hold-out set: 0.010477544151738887
MeanAbsoluteError value on hold-out data: 0.07280315458774567
Epoch: 1151
Loss on hold-out set: 0.009654606690989264
MeanAbsoluteError value on hold-out data: 0.07380277663469315
Epoch: 1152
Loss on hold-out set: 0.009441290698759227
MeanAbsoluteError value on hold-out data: 0.0732991024851799
Epoch: 1153
Loss on hold-out set: 0.00929603060988787
MeanAbsoluteError value on hold-out data: 0.0715143233537674
Epoch: 1154
Loss on hold-out set: 0.00801890515627747
MeanAbsoluteError value on hold-out data: 0.06819862872362137
Epoch: 1155
Loss on hold-out set: 0.008817256434073594
MeanAbsoluteError value on hold-out data: 0.0702916756272316
Epoch: 1156
Loss on hold-out set: 0.008398926276762116
MeanAbsoluteError value on hold-out data: 0.06756085157394409
Epoch: 1157
Loss on hold-out set: 0.007825997158458145
MeanAbsoluteError value on hold-out data: 0.06626369059085846
Epoch: 1158
Loss on hold-out set: 0.009335939399485748
MeanAbsoluteError value on hold-out data: 0.07054734975099564
Epoch: 1159
Loss on hold-out set: 0.008180809853499038
MeanAbsoluteError value on hold-out data: 0.06638054549694061
Epoch: 1160
Loss on hold-out set: 0.010228647209636014
MeanAbsoluteError value on hold-out data: 0.07649761438369751
Epoch: 1161
Loss on hold-out set: 0.008657732720506222
MeanAbsoluteError value on hold-out data: 0.06953009963035583
Epoch: 1162
Loss on hold-out set: 0.010397837666338698
MeanAbsoluteError value on hold-out data: 0.07518979907035828
Epoch: 1163
Loss on hold-out set: 0.008958264892777758
MeanAbsoluteError value on hold-out data: 0.07053501158952713
Epoch: 1164
Loss on hold-out set: 0.008985330437353696
MeanAbsoluteError value on hold-out data: 0.07126415520906448
Epoch: 1165
Loss on hold-out set: 0.009897751372627682
MeanAbsoluteError value on hold-out data: 0.07574305683374405
Epoch: 1166
Loss on hold-out set: 0.009333715315394026
MeanAbsoluteError value on hold-out data: 0.0692436546087265
Epoch: 1167
Loss on hold-out set: 0.008787722677176741
MeanAbsoluteError value on hold-out data: 0.07060522586107254
Epoch: 1168
Loss on hold-out set: 0.008131421861762647
MeanAbsoluteError value on hold-out data: 0.07038623094558716
Epoch: 1169
Loss on hold-out set: 0.00841879333689576
MeanAbsoluteError value on hold-out data: 0.07049582898616791
Epoch: 1170
Loss on hold-out set: 0.00786206152214921
MeanAbsoluteError value on hold-out data: 0.06529413163661957
Epoch: 1171
Loss on hold-out set: 0.008940474494902446
MeanAbsoluteError value on hold-out data: 0.07362020760774612
Epoch: 1172
Loss on hold-out set: 0.00959996285950183
MeanAbsoluteError value on hold-out data: 0.07383736968040466
Epoch: 1173
Loss on hold-out set: 0.009155454731713537
MeanAbsoluteError value on hold-out data: 0.07271799445152283
Epoch: 1174
Loss on hold-out set: 0.00848563080636571
MeanAbsoluteError value on hold-out data: 0.06838629394769669
Epoch: 1175
Loss on hold-out set: 0.009853800208641133
MeanAbsoluteError value on hold-out data: 0.07414787262678146
Epoch: 1176
Loss on hold-out set: 0.00924537751120321
MeanAbsoluteError value on hold-out data: 0.0743248462677002
Epoch: 1177
Loss on hold-out set: 0.009849237689389459
MeanAbsoluteError value on hold-out data: 0.07415568083524704
Epoch: 1178
Loss on hold-out set: 0.009431699812509275
MeanAbsoluteError value on hold-out data: 0.07133302092552185
Epoch: 1179
Loss on hold-out set: 0.007914451148817534
MeanAbsoluteError value on hold-out data: 0.06613541394472122
Epoch: 1180
Loss on hold-out set: 0.0080448436911441
MeanAbsoluteError value on hold-out data: 0.06631012260913849
Epoch: 1181
Loss on hold-out set: 0.007590416009467541
MeanAbsoluteError value on hold-out data: 0.06668341159820557
Epoch: 1182
Loss on hold-out set: 0.00927004460999645
MeanAbsoluteError value on hold-out data: 0.07221899181604385
Epoch: 1183
Loss on hold-out set: 0.007514481910802715
MeanAbsoluteError value on hold-out data: 0.0666644498705864
Epoch: 1184
Loss on hold-out set: 0.00851411163144803
MeanAbsoluteError value on hold-out data: 0.06868209689855576
Epoch: 1185
Loss on hold-out set: 0.008663649004326241
MeanAbsoluteError value on hold-out data: 0.06590044498443604
Epoch: 1186
Loss on hold-out set: 0.008423587499467734
MeanAbsoluteError value on hold-out data: 0.0678950622677803
Epoch: 1187
Loss on hold-out set: 0.007561170620028861
MeanAbsoluteError value on hold-out data: 0.06516295671463013
Epoch: 1188
Loss on hold-out set: 0.009407716052689162
MeanAbsoluteError value on hold-out data: 0.0722714513540268
Epoch: 1189
Loss on hold-out set: 0.007892170354752844
MeanAbsoluteError value on hold-out data: 0.06790497899055481
Epoch: 1190
Loss on hold-out set: 0.008160189884438295
MeanAbsoluteError value on hold-out data: 0.06527079641819
Epoch: 1191
Loss on hold-out set: 0.01000018757772826
MeanAbsoluteError value on hold-out data: 0.07339419424533844
Epoch: 1192
Loss on hold-out set: 0.008251129727917335
MeanAbsoluteError value on hold-out data: 0.06670358777046204
Epoch: 1193
Loss on hold-out set: 0.007824169938273067
MeanAbsoluteError value on hold-out data: 0.06679950654506683
Epoch: 1194
Loss on hold-out set: 0.009414102042367934
MeanAbsoluteError value on hold-out data: 0.07124470174312592
Epoch: 1195
Loss on hold-out set: 0.007133207895991897
MeanAbsoluteError value on hold-out data: 0.06300443410873413
Epoch: 1196
Loss on hold-out set: 0.008863140394726845
MeanAbsoluteError value on hold-out data: 0.07077916711568832
Epoch: 1197
Loss on hold-out set: 0.010269965640388061
MeanAbsoluteError value on hold-out data: 0.0726114809513092
Epoch: 1198
Loss on hold-out set: 0.009061244983213328
MeanAbsoluteError value on hold-out data: 0.07263635843992233
Epoch: 1199
Loss on hold-out set: 0.008743874565583004
MeanAbsoluteError value on hold-out data: 0.07093558460474014
Epoch: 1200
Loss on hold-out set: 0.008974689956012298
MeanAbsoluteError value on hold-out data: 0.06861589848995209
Epoch: 1201
Loss on hold-out set: 0.010838156531778319
MeanAbsoluteError value on hold-out data: 0.07683760672807693
Epoch: 1202
Loss on hold-out set: 0.009012264097412601
MeanAbsoluteError value on hold-out data: 0.07095874100923538
Epoch: 1203
Loss on hold-out set: 0.007905627343182762
MeanAbsoluteError value on hold-out data: 0.06723464280366898
Epoch: 1204
Loss on hold-out set: 0.008260235687736591
MeanAbsoluteError value on hold-out data: 0.06652550399303436
Epoch: 1205
Loss on hold-out set: 0.009496158139700128
MeanAbsoluteError value on hold-out data: 0.06665921211242676
Epoch: 1206
Loss on hold-out set: 0.009625802805894637
MeanAbsoluteError value on hold-out data: 0.07025858014822006
Epoch: 1207
Loss on hold-out set: 0.009772460867467695
MeanAbsoluteError value on hold-out data: 0.07121794670820236
Epoch: 1208
Loss on hold-out set: 0.007297780741476648
MeanAbsoluteError value on hold-out data: 0.065667524933815
Epoch: 1209
Loss on hold-out set: 0.00675786423265284
MeanAbsoluteError value on hold-out data: 0.061995524913072586
Epoch: 1210
Loss on hold-out set: 0.0072983165266244515
MeanAbsoluteError value on hold-out data: 0.06465352326631546
Epoch: 1211
Loss on hold-out set: 0.008797632619516662
MeanAbsoluteError value on hold-out data: 0.07010708004236221
Epoch: 1212
Loss on hold-out set: 0.009149578046708485
MeanAbsoluteError value on hold-out data: 0.06917556375265121
Epoch: 1213
Loss on hold-out set: 0.008480645334905905
MeanAbsoluteError value on hold-out data: 0.06989013403654099
Epoch: 1214
Loss on hold-out set: 0.009183607474842575
MeanAbsoluteError value on hold-out data: 0.07194451242685318
Epoch: 1215
Loss on hold-out set: 0.0076067245743221676
MeanAbsoluteError value on hold-out data: 0.06492357701063156
Epoch: 1216
Loss on hold-out set: 0.007426233392628395
MeanAbsoluteError value on hold-out data: 0.06530644744634628
Epoch: 1217
Loss on hold-out set: 0.008881219570175744
MeanAbsoluteError value on hold-out data: 0.06650423258543015
Epoch: 1218
Loss on hold-out set: 0.007291640126495622
MeanAbsoluteError value on hold-out data: 0.06467515975236893
Epoch: 1219
Loss on hold-out set: 0.0078585070829043
MeanAbsoluteError value on hold-out data: 0.06789813190698624
Epoch: 1220
Loss on hold-out set: 0.010933700047050176
MeanAbsoluteError value on hold-out data: 0.07691092789173126
Epoch: 1221
Loss on hold-out set: 0.009340883120660995
MeanAbsoluteError value on hold-out data: 0.07115495204925537
Epoch: 1222
Loss on hold-out set: 0.008169285474771944
MeanAbsoluteError value on hold-out data: 0.06779686361551285
Epoch: 1223
Loss on hold-out set: 0.009353095073699176
MeanAbsoluteError value on hold-out data: 0.07248201221227646
Epoch: 1224
Loss on hold-out set: 0.008757691565448719
MeanAbsoluteError value on hold-out data: 0.06773275882005692
Epoch: 1225
Loss on hold-out set: 0.008800564246812428
MeanAbsoluteError value on hold-out data: 0.06872667372226715
Epoch: 1226
Loss on hold-out set: 0.009412487409402577
MeanAbsoluteError value on hold-out data: 0.07257363200187683
Epoch: 1227
Loss on hold-out set: 0.008262155587605473
MeanAbsoluteError value on hold-out data: 0.06822290271520615
Epoch: 1228
Loss on hold-out set: 0.008827985257582138
MeanAbsoluteError value on hold-out data: 0.06881257146596909
Epoch: 1229
Loss on hold-out set: 0.009765787863725563
MeanAbsoluteError value on hold-out data: 0.06981337815523148
Epoch: 1230
Loss on hold-out set: 0.008142783119061884
MeanAbsoluteError value on hold-out data: 0.06726822257041931
Epoch: 1231
Loss on hold-out set: 0.009374093552711809
MeanAbsoluteError value on hold-out data: 0.07030824571847916
Epoch: 1232
Loss on hold-out set: 0.008383299994008364
MeanAbsoluteError value on hold-out data: 0.06765606999397278
Epoch: 1233
Loss on hold-out set: 0.007798008604877396
MeanAbsoluteError value on hold-out data: 0.06530702859163284
Epoch: 1234
Loss on hold-out set: 0.007644505859971105
MeanAbsoluteError value on hold-out data: 0.06526170670986176
Epoch: 1235
Loss on hold-out set: 0.007989120265313735
MeanAbsoluteError value on hold-out data: 0.06808625161647797
Epoch: 1236
Loss on hold-out set: 0.00785686419742054
MeanAbsoluteError value on hold-out data: 0.06877303123474121
Epoch: 1237
Loss on hold-out set: 0.009400652816129878
MeanAbsoluteError value on hold-out data: 0.07086622714996338
Epoch: 1238
Loss on hold-out set: 0.008827918988633126
MeanAbsoluteError value on hold-out data: 0.06830728054046631
Epoch: 1239
Loss on hold-out set: 0.00863662682143816
MeanAbsoluteError value on hold-out data: 0.07070434838533401
Epoch: 1240
Loss on hold-out set: 0.0082328780425208
MeanAbsoluteError value on hold-out data: 0.06713294982910156
Epoch: 1241
Loss on hold-out set: 0.008891613652910262
MeanAbsoluteError value on hold-out data: 0.07114913314580917
Epoch: 1242
Loss on hold-out set: 0.007871796356266714
MeanAbsoluteError value on hold-out data: 0.06305782496929169
Epoch: 1243
Loss on hold-out set: 0.007522555536709963
MeanAbsoluteError value on hold-out data: 0.06296377629041672
Epoch: 1244
Loss on hold-out set: 0.007568121839910115
MeanAbsoluteError value on hold-out data: 0.06587927043437958
Epoch: 1245
Loss on hold-out set: 0.009677612894459647
MeanAbsoluteError value on hold-out data: 0.0725494995713234
Epoch: 1246
Loss on hold-out set: 0.007330002476713465
MeanAbsoluteError value on hold-out data: 0.0638953223824501
Epoch: 1247
Loss on hold-out set: 0.007586467880076574
MeanAbsoluteError value on hold-out data: 0.06588584184646606
Epoch: 1248
Loss on hold-out set: 0.00902645016736642
MeanAbsoluteError value on hold-out data: 0.06749075651168823
Epoch: 1249
Loss on hold-out set: 0.008261920580771402
MeanAbsoluteError value on hold-out data: 0.067941814661026
Epoch: 1250
Loss on hold-out set: 0.007750222484114602
MeanAbsoluteError value on hold-out data: 0.06734830886125565
Epoch: 1251
Loss on hold-out set: 0.007376858765704431
MeanAbsoluteError value on hold-out data: 0.06430558860301971
Epoch: 1252
Loss on hold-out set: 0.008994307257623102
MeanAbsoluteError value on hold-out data: 0.06803226470947266
Epoch: 1253
Loss on hold-out set: 0.008599625081842532
MeanAbsoluteError value on hold-out data: 0.07100876420736313
Epoch: 1254
Loss on hold-out set: 0.009302062985104081
MeanAbsoluteError value on hold-out data: 0.07166147232055664
Epoch: 1255
Loss on hold-out set: 0.0077727736681117675
MeanAbsoluteError value on hold-out data: 0.06650883704423904
Epoch: 1256
Loss on hold-out set: 0.009345366997489085
MeanAbsoluteError value on hold-out data: 0.0701308473944664
Epoch: 1257
Loss on hold-out set: 0.007853606402871567
MeanAbsoluteError value on hold-out data: 0.06611692160367966
Epoch: 1258
Loss on hold-out set: 0.008115008692257106
MeanAbsoluteError value on hold-out data: 0.064864382147789
Epoch: 1259
Loss on hold-out set: 0.008770303403919873
MeanAbsoluteError value on hold-out data: 0.07180502265691757
Epoch: 1260
Loss on hold-out set: 0.008511763575515943
MeanAbsoluteError value on hold-out data: 0.06799806654453278
Epoch: 1261
Loss on hold-out set: 0.007644988770492394
MeanAbsoluteError value on hold-out data: 0.0665329247713089
Epoch: 1262
Loss on hold-out set: 0.008835304188226777
MeanAbsoluteError value on hold-out data: 0.07141575217247009
Epoch: 1263
Loss on hold-out set: 0.009047964875417923
MeanAbsoluteError value on hold-out data: 0.06958139687776566
Epoch: 1264
Loss on hold-out set: 0.007600942253896695
MeanAbsoluteError value on hold-out data: 0.06586215645074844
Epoch: 1265
Loss on hold-out set: 0.00768124782332355
MeanAbsoluteError value on hold-out data: 0.06476181745529175
Epoch: 1266
Loss on hold-out set: 0.00811149097459444
MeanAbsoluteError value on hold-out data: 0.06793349981307983
Epoch: 1267
Loss on hold-out set: 0.008770809747754052
MeanAbsoluteError value on hold-out data: 0.0694015696644783
Epoch: 1268
Loss on hold-out set: 0.008134366652739118
MeanAbsoluteError value on hold-out data: 0.06745557487010956
Epoch: 1269
Loss on hold-out set: 0.010129838876867628
MeanAbsoluteError value on hold-out data: 0.07241452485322952
Epoch: 1270
Loss on hold-out set: 0.008284536121179069
MeanAbsoluteError value on hold-out data: 0.06826476752758026
Epoch: 1271
Loss on hold-out set: 0.008963167436218101
MeanAbsoluteError value on hold-out data: 0.0693054050207138
Epoch: 1272
Loss on hold-out set: 0.007225940201757718
MeanAbsoluteError value on hold-out data: 0.06282684206962585
Epoch: 1273
Loss on hold-out set: 0.008260614643653052
MeanAbsoluteError value on hold-out data: 0.06664799898862839
Epoch: 1274
Loss on hold-out set: 0.006654680923675187
MeanAbsoluteError value on hold-out data: 0.06307568401098251
Epoch: 1275
Loss on hold-out set: 0.007150917808515563
MeanAbsoluteError value on hold-out data: 0.06345345824956894
Epoch: 1276
Loss on hold-out set: 0.008673026216371605
MeanAbsoluteError value on hold-out data: 0.06890122592449188
Epoch: 1277
Loss on hold-out set: 0.008987168699143998
MeanAbsoluteError value on hold-out data: 0.06860233843326569
Epoch: 1278
Loss on hold-out set: 0.007886308476687797
MeanAbsoluteError value on hold-out data: 0.06584589928388596
Epoch: 1279
Loss on hold-out set: 0.008817288527388882
MeanAbsoluteError value on hold-out data: 0.06867588311433792
Epoch: 1280
Loss on hold-out set: 0.007430860164179952
MeanAbsoluteError value on hold-out data: 0.06469763070344925
Epoch: 1281
Loss on hold-out set: 0.008171817133479635
MeanAbsoluteError value on hold-out data: 0.0634067952632904
Epoch: 1282
Loss on hold-out set: 0.008081080808963937
MeanAbsoluteError value on hold-out data: 0.06861378252506256
Epoch: 1283
Loss on hold-out set: 0.008181483337866667
MeanAbsoluteError value on hold-out data: 0.06677743047475815
Epoch: 1284
Loss on hold-out set: 0.009482518536691107
MeanAbsoluteError value on hold-out data: 0.06761656701564789
Epoch: 1285
Loss on hold-out set: 0.008100837749613371
MeanAbsoluteError value on hold-out data: 0.06705141067504883
Epoch: 1286
Loss on hold-out set: 0.009225137456311738
MeanAbsoluteError value on hold-out data: 0.06975925713777542
Epoch: 1287
Loss on hold-out set: 0.008222749935242368
MeanAbsoluteError value on hold-out data: 0.0694635882973671
Epoch: 1288
Loss on hold-out set: 0.008154733453144825
MeanAbsoluteError value on hold-out data: 0.06929472088813782
Epoch: 1289
Loss on hold-out set: 0.00715222619521531
MeanAbsoluteError value on hold-out data: 0.06227000057697296
Epoch: 1290
Loss on hold-out set: 0.008074170726322336
MeanAbsoluteError value on hold-out data: 0.06766019761562347
Epoch: 1291
Loss on hold-out set: 0.008731126173273273
MeanAbsoluteError value on hold-out data: 0.06934326887130737
Epoch: 1292
Loss on hold-out set: 0.007026249352590336
MeanAbsoluteError value on hold-out data: 0.06336626410484314
Epoch: 1293
Loss on hold-out set: 0.007869833599882744
MeanAbsoluteError value on hold-out data: 0.0646136924624443
Epoch: 1294
Loss on hold-out set: 0.007991952859799008
MeanAbsoluteError value on hold-out data: 0.06462433189153671
Epoch: 1295
Loss on hold-out set: 0.008566678043086237
MeanAbsoluteError value on hold-out data: 0.06855563074350357
Epoch: 1296
Loss on hold-out set: 0.00790340283693998
MeanAbsoluteError value on hold-out data: 0.0642736405134201
Epoch: 1297
Loss on hold-out set: 0.007389927355834516
MeanAbsoluteError value on hold-out data: 0.06394194811582565
Epoch: 1298
Loss on hold-out set: 0.007718468762323028
MeanAbsoluteError value on hold-out data: 0.0666695311665535
Epoch: 1299
Loss on hold-out set: 0.00813558700455663
MeanAbsoluteError value on hold-out data: 0.06659755110740662
Epoch: 1300
Loss on hold-out set: 0.007272580623878942
MeanAbsoluteError value on hold-out data: 0.06358914077281952
Epoch: 1301
Loss on hold-out set: 0.007789746813632519
MeanAbsoluteError value on hold-out data: 0.06521336734294891
Epoch: 1302
Loss on hold-out set: 0.008772846711314439
MeanAbsoluteError value on hold-out data: 0.07241353392601013
Epoch: 1303
Loss on hold-out set: 0.007660547452251194
MeanAbsoluteError value on hold-out data: 0.06369781494140625
Epoch: 1304
Loss on hold-out set: 0.00781238148813524
MeanAbsoluteError value on hold-out data: 0.06710274517536163
Epoch: 1305
Loss on hold-out set: 0.007514169582670244
MeanAbsoluteError value on hold-out data: 0.0669761523604393
Epoch: 1306
Loss on hold-out set: 0.008541544447786388
MeanAbsoluteError value on hold-out data: 0.06963354349136353
Epoch: 1307
Loss on hold-out set: 0.008711133539909497
MeanAbsoluteError value on hold-out data: 0.07135025411844254
Epoch: 1308
Loss on hold-out set: 0.0074210851779632015
MeanAbsoluteError value on hold-out data: 0.0637320727109909
Epoch: 1309
Loss on hold-out set: 0.008290685980100534
MeanAbsoluteError value on hold-out data: 0.07025857269763947
Epoch: 1310
Loss on hold-out set: 0.007830298310727813
MeanAbsoluteError value on hold-out data: 0.06579992175102234
Epoch: 1311
Loss on hold-out set: 0.009304577367887153
MeanAbsoluteError value on hold-out data: 0.06921501457691193
Epoch: 1312
Loss on hold-out set: 0.007640867807980006
MeanAbsoluteError value on hold-out data: 0.06571817398071289
Epoch: 1313
Loss on hold-out set: 0.008025494146519728
MeanAbsoluteError value on hold-out data: 0.06804486364126205
Epoch: 1314
Loss on hold-out set: 0.007778881426299146
MeanAbsoluteError value on hold-out data: 0.06641824543476105
Epoch: 1315
Loss on hold-out set: 0.007758687305480029
MeanAbsoluteError value on hold-out data: 0.0658046081662178
Epoch: 1316
Loss on hold-out set: 0.007128426739363931
MeanAbsoluteError value on hold-out data: 0.06496980786323547
Epoch: 1317
Loss on hold-out set: 0.00828031331482028
MeanAbsoluteError value on hold-out data: 0.06547730416059494
Epoch: 1318
Loss on hold-out set: 0.0073712841699307315
MeanAbsoluteError value on hold-out data: 0.0645994022488594
Epoch: 1319
Loss on hold-out set: 0.007917771801530762
MeanAbsoluteError value on hold-out data: 0.0655825287103653
Epoch: 1320
Loss on hold-out set: 0.008648563409939622
MeanAbsoluteError value on hold-out data: 0.06677377969026566
Epoch: 1321
Loss on hold-out set: 0.007059692888797145
MeanAbsoluteError value on hold-out data: 0.06489339470863342
Epoch: 1322
Loss on hold-out set: 0.00715157483384246
MeanAbsoluteError value on hold-out data: 0.06268958747386932
Epoch: 1323
Loss on hold-out set: 0.007804863325742417
MeanAbsoluteError value on hold-out data: 0.06582296639680862
Epoch: 1324
Loss on hold-out set: 0.007294906444049048
MeanAbsoluteError value on hold-out data: 0.06379303336143494
Epoch: 1325
Loss on hold-out set: 0.00685576137456034
MeanAbsoluteError value on hold-out data: 0.06199723482131958
Epoch: 1326
Loss on hold-out set: 0.007924316467336516
MeanAbsoluteError value on hold-out data: 0.06694360822439194
Epoch: 1327
Loss on hold-out set: 0.0073558083025758
MeanAbsoluteError value on hold-out data: 0.06451684236526489
Epoch: 1328
Loss on hold-out set: 0.006996011751264936
MeanAbsoluteError value on hold-out data: 0.06321243941783905
Epoch: 1329
Loss on hold-out set: 0.00881165555744398
MeanAbsoluteError value on hold-out data: 0.0665363147854805
Epoch: 1330
Loss on hold-out set: 0.00836789986002259
MeanAbsoluteError value on hold-out data: 0.06673110276460648
Epoch: 1331
Loss on hold-out set: 0.008271067234818474
MeanAbsoluteError value on hold-out data: 0.0657283365726471
Epoch: 1332
Loss on hold-out set: 0.00879690785703133
MeanAbsoluteError value on hold-out data: 0.06756837666034698
Epoch: 1333
Loss on hold-out set: 0.007948039407589627
MeanAbsoluteError value on hold-out data: 0.06727134436368942
Epoch: 1334
Loss on hold-out set: 0.008709641521951805
MeanAbsoluteError value on hold-out data: 0.06858840584754944
Epoch: 1335
Loss on hold-out set: 0.007771693794699483
MeanAbsoluteError value on hold-out data: 0.06418959051370621
Epoch: 1336
Loss on hold-out set: 0.008583807314895846
MeanAbsoluteError value on hold-out data: 0.06957040727138519
Epoch: 1337
Loss on hold-out set: 0.008894439549476375
MeanAbsoluteError value on hold-out data: 0.07140778750181198
Epoch: 1338
Loss on hold-out set: 0.008260535464960412
MeanAbsoluteError value on hold-out data: 0.06886445730924606
Epoch: 1339
Loss on hold-out set: 0.007678483628648488
MeanAbsoluteError value on hold-out data: 0.0647488534450531
Epoch: 1340
Loss on hold-out set: 0.007656856647511935
MeanAbsoluteError value on hold-out data: 0.06512819975614548
Epoch: 1341
Loss on hold-out set: 0.009761026191990823
MeanAbsoluteError value on hold-out data: 0.07235746830701828
Epoch: 1342
Loss on hold-out set: 0.007322536356865991
MeanAbsoluteError value on hold-out data: 0.06511732190847397
Epoch: 1343
Loss on hold-out set: 0.008435514229240652
MeanAbsoluteError value on hold-out data: 0.06587069481611252
Epoch: 1344
Loss on hold-out set: 0.00787433763033429
MeanAbsoluteError value on hold-out data: 0.06604745984077454
Epoch: 1345
Loss on hold-out set: 0.007496242795380871
MeanAbsoluteError value on hold-out data: 0.06362580507993698
Epoch: 1346
Loss on hold-out set: 0.007350334806833416
MeanAbsoluteError value on hold-out data: 0.06418774276971817
Epoch: 1347
Loss on hold-out set: 0.008055468582897447
MeanAbsoluteError value on hold-out data: 0.06892711669206619
Epoch: 1348
Loss on hold-out set: 0.007433419052225266
MeanAbsoluteError value on hold-out data: 0.0647050067782402
Epoch: 1349
Loss on hold-out set: 0.008730291481842869
MeanAbsoluteError value on hold-out data: 0.07084035128355026
Epoch: 1350
Loss on hold-out set: 0.00806844319437611
MeanAbsoluteError value on hold-out data: 0.06780128926038742
Epoch: 1351
Loss on hold-out set: 0.008063973809245605
MeanAbsoluteError value on hold-out data: 0.06309651583433151
Epoch: 1352
Loss on hold-out set: 0.008485552680179656
MeanAbsoluteError value on hold-out data: 0.06784497946500778
Epoch: 1353
Loss on hold-out set: 0.007244655445538229
MeanAbsoluteError value on hold-out data: 0.0628344938158989
Epoch: 1354
Loss on hold-out set: 0.00912056508930012
MeanAbsoluteError value on hold-out data: 0.06867197901010513
Epoch: 1355
Loss on hold-out set: 0.00736659996741461
MeanAbsoluteError value on hold-out data: 0.06284493952989578
Epoch: 1356
Loss on hold-out set: 0.00852388815927649
MeanAbsoluteError value on hold-out data: 0.06758779287338257
Epoch: 1357
Loss on hold-out set: 0.008364668965708309
MeanAbsoluteError value on hold-out data: 0.06587166339159012
Epoch: 1358
Loss on hold-out set: 0.008019512025372629
MeanAbsoluteError value on hold-out data: 0.06738413870334625
Epoch: 1359
Loss on hold-out set: 0.008132527745916983
MeanAbsoluteError value on hold-out data: 0.06580609828233719
Epoch: 1360
Loss on hold-out set: 0.006961726972063834
MeanAbsoluteError value on hold-out data: 0.062175050377845764
Epoch: 1361
Loss on hold-out set: 0.006628504816665858
MeanAbsoluteError value on hold-out data: 0.05890526995062828
Epoch: 1362
Loss on hold-out set: 0.006634375868695012
MeanAbsoluteError value on hold-out data: 0.061829909682273865
Epoch: 1363
Loss on hold-out set: 0.008697608934962773
MeanAbsoluteError value on hold-out data: 0.06929796189069748
Epoch: 1364
Loss on hold-out set: 0.007823805230230695
MeanAbsoluteError value on hold-out data: 0.0643923208117485
Epoch: 1365
Loss on hold-out set: 0.007409210649590629
MeanAbsoluteError value on hold-out data: 0.0638328567147255
Epoch: 1366
Loss on hold-out set: 0.006480055597967294
MeanAbsoluteError value on hold-out data: 0.05976519361138344
Epoch: 1367
Loss on hold-out set: 0.007885617918824816
MeanAbsoluteError value on hold-out data: 0.06708196550607681
Epoch: 1368
Loss on hold-out set: 0.008020497677612183
MeanAbsoluteError value on hold-out data: 0.06485868245363235
Epoch: 1369
Loss on hold-out set: 0.007706012363972453
MeanAbsoluteError value on hold-out data: 0.0646609291434288
Epoch: 1370
Loss on hold-out set: 0.009096032704449803
MeanAbsoluteError value on hold-out data: 0.07121365517377853
Epoch: 1371
Loss on hold-out set: 0.008219032530469121
MeanAbsoluteError value on hold-out data: 0.07083933055400848
Epoch: 1372
Loss on hold-out set: 0.008070334501571779
MeanAbsoluteError value on hold-out data: 0.06881795823574066
Epoch: 1373
Loss on hold-out set: 0.007080577156545284
MeanAbsoluteError value on hold-out data: 0.06332571804523468
Epoch: 1374
Loss on hold-out set: 0.0076491234980009416
MeanAbsoluteError value on hold-out data: 0.06316270679235458
Epoch: 1375
Loss on hold-out set: 0.007843871460824327
MeanAbsoluteError value on hold-out data: 0.06654854118824005
Epoch: 1376
Loss on hold-out set: 0.0075072268424113036
MeanAbsoluteError value on hold-out data: 0.06553764641284943
Epoch: 1377
Loss on hold-out set: 0.008358190310703624
MeanAbsoluteError value on hold-out data: 0.06587403267621994
Epoch: 1378
Loss on hold-out set: 0.007621892409370048
MeanAbsoluteError value on hold-out data: 0.06441012769937515
Epoch: 1379
Loss on hold-out set: 0.00848174813882603
MeanAbsoluteError value on hold-out data: 0.0663723424077034
Epoch: 1380
Loss on hold-out set: 0.007155989615275757
MeanAbsoluteError value on hold-out data: 0.062473494559526443
Epoch: 1381
Loss on hold-out set: 0.007682034682376677
MeanAbsoluteError value on hold-out data: 0.0638623908162117
Epoch: 1382
Loss on hold-out set: 0.008776045967291186
MeanAbsoluteError value on hold-out data: 0.07005005329847336
Epoch: 1383
Loss on hold-out set: 0.008040455447729376
MeanAbsoluteError value on hold-out data: 0.0625421404838562
Epoch: 1384
Loss on hold-out set: 0.008276948615409008
MeanAbsoluteError value on hold-out data: 0.06624803692102432
Epoch: 1385
Loss on hold-out set: 0.00707840209720113
MeanAbsoluteError value on hold-out data: 0.06345287710428238
Epoch: 1386
Loss on hold-out set: 0.00714648350913194
MeanAbsoluteError value on hold-out data: 0.06367551535367966
Epoch: 1387
Loss on hold-out set: 0.008174926240571949
MeanAbsoluteError value on hold-out data: 0.06559132039546967
Epoch: 1388
Loss on hold-out set: 0.007099790655677983
MeanAbsoluteError value on hold-out data: 0.06205161288380623
Epoch: 1389
Loss on hold-out set: 0.007741993348608958
MeanAbsoluteError value on hold-out data: 0.06663112342357635
Epoch: 1390
Loss on hold-out set: 0.007723609067616053
MeanAbsoluteError value on hold-out data: 0.06505231559276581
Epoch: 1391
Loss on hold-out set: 0.00810748228735368
MeanAbsoluteError value on hold-out data: 0.06594040244817734
Epoch: 1392
Loss on hold-out set: 0.009371341868184875
MeanAbsoluteError value on hold-out data: 0.06997713446617126
Epoch: 1393
Loss on hold-out set: 0.007382423871710368
MeanAbsoluteError value on hold-out data: 0.06187620759010315
Epoch: 1394
Loss on hold-out set: 0.007077288133468755
MeanAbsoluteError value on hold-out data: 0.06309503316879272
Epoch: 1395
Loss on hold-out set: 0.007779051747572036
MeanAbsoluteError value on hold-out data: 0.06451993435621262
Epoch: 1396
Loss on hold-out set: 0.00803502570425432
MeanAbsoluteError value on hold-out data: 0.06644609570503235
Epoch: 1397
Loss on hold-out set: 0.007423764120324752
MeanAbsoluteError value on hold-out data: 0.062369465827941895
Epoch: 1398
Loss on hold-out set: 0.008199635736758259
MeanAbsoluteError value on hold-out data: 0.06620024889707565
Epoch: 1399
Loss on hold-out set: 0.0058058741173552635
MeanAbsoluteError value on hold-out data: 0.05770301818847656
Epoch: 1400
Loss on hold-out set: 0.00722127960752914
MeanAbsoluteError value on hold-out data: 0.061613693833351135
Epoch: 1401
Loss on hold-out set: 0.008141655536516433
MeanAbsoluteError value on hold-out data: 0.0642760619521141
Epoch: 1402
Loss on hold-out set: 0.006865412314291461
MeanAbsoluteError value on hold-out data: 0.0600755549967289
Epoch: 1403
Loss on hold-out set: 0.007028620555514256
MeanAbsoluteError value on hold-out data: 0.062006399035453796
Epoch: 1404
Loss on hold-out set: 0.008085722380783408
MeanAbsoluteError value on hold-out data: 0.06701668351888657
Epoch: 1405
Loss on hold-out set: 0.007562314666071567
MeanAbsoluteError value on hold-out data: 0.06434932351112366
Epoch: 1406
Loss on hold-out set: 0.0067652397909599435
MeanAbsoluteError value on hold-out data: 0.060449931770563126
Epoch: 1407
Loss on hold-out set: 0.007432117101528395
MeanAbsoluteError value on hold-out data: 0.06327193975448608
Epoch: 1408
Loss on hold-out set: 0.007169192946118225
MeanAbsoluteError value on hold-out data: 0.0637197494506836
Epoch: 1409
Loss on hold-out set: 0.008072809512450476
MeanAbsoluteError value on hold-out data: 0.06707914173603058
Epoch: 1410
Loss on hold-out set: 0.006704159578960874
MeanAbsoluteError value on hold-out data: 0.05959291383624077
Epoch: 1411
Loss on hold-out set: 0.00862401036063602
MeanAbsoluteError value on hold-out data: 0.0663716122508049
Epoch: 1412
Loss on hold-out set: 0.008545040318592025
MeanAbsoluteError value on hold-out data: 0.06676368415355682
Epoch: 1413
Loss on hold-out set: 0.006625488007218034
MeanAbsoluteError value on hold-out data: 0.06205625459551811
Epoch: 1414
Loss on hold-out set: 0.006870218676219035
MeanAbsoluteError value on hold-out data: 0.061509862542152405
Epoch: 1415
Loss on hold-out set: 0.007335443939167211
MeanAbsoluteError value on hold-out data: 0.0637543722987175
Epoch: 1416
Loss on hold-out set: 0.007931249591979394
MeanAbsoluteError value on hold-out data: 0.06494753062725067
Epoch: 1417
Loss on hold-out set: 0.007976736404622594
MeanAbsoluteError value on hold-out data: 0.0683891773223877
Epoch: 1418
Loss on hold-out set: 0.00701527442659426
MeanAbsoluteError value on hold-out data: 0.06280351430177689
Epoch: 1419
Loss on hold-out set: 0.009559619531743616
MeanAbsoluteError value on hold-out data: 0.07167337089776993
Epoch: 1420
Loss on hold-out set: 0.008595845319820607
MeanAbsoluteError value on hold-out data: 0.0661795362830162
Epoch: 1421
Loss on hold-out set: 0.00702618321521489
MeanAbsoluteError value on hold-out data: 0.061954740434885025
Epoch: 1422
Loss on hold-out set: 0.007301084194841679
MeanAbsoluteError value on hold-out data: 0.06278189271688461
Epoch: 1423
Loss on hold-out set: 0.007259578238311709
MeanAbsoluteError value on hold-out data: 0.06160401180386543
Epoch: 1424
Loss on hold-out set: 0.008520677380013997
MeanAbsoluteError value on hold-out data: 0.06756888329982758
Epoch: 1425
Loss on hold-out set: 0.008058254041194838
MeanAbsoluteError value on hold-out data: 0.06612954288721085
Epoch: 1426
Loss on hold-out set: 0.007548868455281384
MeanAbsoluteError value on hold-out data: 0.06168711185455322
Epoch: 1427
Loss on hold-out set: 0.008342438576721444
MeanAbsoluteError value on hold-out data: 0.0682152658700943
Epoch: 1428
Loss on hold-out set: 0.007171224367581696
MeanAbsoluteError value on hold-out data: 0.06262779980897903
Epoch: 1429
Loss on hold-out set: 0.006915767011062902
MeanAbsoluteError value on hold-out data: 0.0627226009964943
Epoch: 1430
Loss on hold-out set: 0.007856471295429704
MeanAbsoluteError value on hold-out data: 0.06516139954328537
Epoch: 1431
Loss on hold-out set: 0.007101579494871354
MeanAbsoluteError value on hold-out data: 0.0589723065495491
Epoch: 1432
Loss on hold-out set: 0.007879834473036074
MeanAbsoluteError value on hold-out data: 0.0669345036149025
Epoch: 1433
Loss on hold-out set: 0.0074118318330511105
MeanAbsoluteError value on hold-out data: 0.06284149736166
Epoch: 1434
Loss on hold-out set: 0.008294958903473646
MeanAbsoluteError value on hold-out data: 0.06516458094120026
Epoch: 1435
Loss on hold-out set: 0.007800076296566658
MeanAbsoluteError value on hold-out data: 0.06345964968204498
Epoch: 1436
Loss on hold-out set: 0.0074386512113687785
MeanAbsoluteError value on hold-out data: 0.062354493886232376
Epoch: 1437
Loss on hold-out set: 0.007690656979345173
MeanAbsoluteError value on hold-out data: 0.06378848105669022
Epoch: 1438
Loss on hold-out set: 0.007616600136486037
MeanAbsoluteError value on hold-out data: 0.0651438906788826
Epoch: 1439
Loss on hold-out set: 0.007439403476552494
MeanAbsoluteError value on hold-out data: 0.06260493397712708
Epoch: 1440
Loss on hold-out set: 0.008021158163561875
MeanAbsoluteError value on hold-out data: 0.06537460535764694
Epoch: 1441
Loss on hold-out set: 0.007651532945322591
MeanAbsoluteError value on hold-out data: 0.06445415318012238
Epoch: 1442
Loss on hold-out set: 0.006860570421037361
MeanAbsoluteError value on hold-out data: 0.0612214021384716
Epoch: 1443
Loss on hold-out set: 0.00778884751474834
MeanAbsoluteError value on hold-out data: 0.06672738492488861
Epoch: 1444
Loss on hold-out set: 0.00829485739537631
MeanAbsoluteError value on hold-out data: 0.0669470801949501
Epoch: 1445
Loss on hold-out set: 0.007070951960582003
MeanAbsoluteError value on hold-out data: 0.06300053000450134
Epoch: 1446
Loss on hold-out set: 0.007287574849712352
MeanAbsoluteError value on hold-out data: 0.0616871640086174
Epoch: 1447
Loss on hold-out set: 0.008356591590175716
MeanAbsoluteError value on hold-out data: 0.06767959892749786
Epoch: 1448
Loss on hold-out set: 0.007025916684375868
MeanAbsoluteError value on hold-out data: 0.0627157986164093
Epoch: 1449
Loss on hold-out set: 0.009592758838552982
MeanAbsoluteError value on hold-out data: 0.06958530098199844
Epoch: 1450
Loss on hold-out set: 0.007561509182996815
MeanAbsoluteError value on hold-out data: 0.0662907063961029
Epoch: 1451
Loss on hold-out set: 0.008342616553885213
MeanAbsoluteError value on hold-out data: 0.06705524027347565
Epoch: 1452
Loss on hold-out set: 0.0063819072460319145
MeanAbsoluteError value on hold-out data: 0.057926394045352936
Epoch: 1453
Loss on hold-out set: 0.009822380522352129
MeanAbsoluteError value on hold-out data: 0.06890102475881577
Epoch: 1454
Loss on hold-out set: 0.006313208771227134
MeanAbsoluteError value on hold-out data: 0.060571130365133286
Epoch: 1455
Loss on hold-out set: 0.0058990240586414685
MeanAbsoluteError value on hold-out data: 0.05813926085829735
Epoch: 1456
Loss on hold-out set: 0.007734232512399709
MeanAbsoluteError value on hold-out data: 0.0642402321100235
Epoch: 1457
Loss on hold-out set: 0.007037937158262745
MeanAbsoluteError value on hold-out data: 0.06153957545757294
Epoch: 1458
Loss on hold-out set: 0.007767378430135068
MeanAbsoluteError value on hold-out data: 0.06403855234384537
Epoch: 1459
Loss on hold-out set: 0.00792042263464585
MeanAbsoluteError value on hold-out data: 0.06556658446788788
Epoch: 1460
Loss on hold-out set: 0.006668290950983646
MeanAbsoluteError value on hold-out data: 0.059334348887205124
Epoch: 1461
Loss on hold-out set: 0.0073765277918270535
MeanAbsoluteError value on hold-out data: 0.061461079865694046
Epoch: 1462
Loss on hold-out set: 0.0068815284009906465
MeanAbsoluteError value on hold-out data: 0.06241860240697861
Epoch: 1463
Loss on hold-out set: 0.008749042687089361
MeanAbsoluteError value on hold-out data: 0.0672624483704567
Epoch: 1464
Loss on hold-out set: 0.007483176480952049
MeanAbsoluteError value on hold-out data: 0.06411516666412354
Epoch: 1465
Loss on hold-out set: 0.008184417079358658
MeanAbsoluteError value on hold-out data: 0.06552771478891373
Epoch: 1466
Loss on hold-out set: 0.007520872821987723
MeanAbsoluteError value on hold-out data: 0.06388091295957565
Epoch: 1467
Loss on hold-out set: 0.0077308096341221245
MeanAbsoluteError value on hold-out data: 0.06343396753072739
Epoch: 1468
Loss on hold-out set: 0.0069194848994144804
MeanAbsoluteError value on hold-out data: 0.061684124171733856
Epoch: 1469
Loss on hold-out set: 0.006877075084679139
MeanAbsoluteError value on hold-out data: 0.061812516301870346
Epoch: 1470
Loss on hold-out set: 0.0076072708892085455
MeanAbsoluteError value on hold-out data: 0.0628805011510849
Epoch: 1471
Loss on hold-out set: 0.006849914763455066
MeanAbsoluteError value on hold-out data: 0.0612175315618515
Epoch: 1472
Loss on hold-out set: 0.00787422926815149
MeanAbsoluteError value on hold-out data: 0.06555570662021637
Epoch: 1473
Loss on hold-out set: 0.007416789225123163
MeanAbsoluteError value on hold-out data: 0.06410834938287735
Epoch: 1474
Loss on hold-out set: 0.009265808218915482
MeanAbsoluteError value on hold-out data: 0.06725021451711655
Epoch: 1475
Loss on hold-out set: 0.0061452278935879194
MeanAbsoluteError value on hold-out data: 0.05877423658967018
Epoch: 1476
Loss on hold-out set: 0.008122437775406676
MeanAbsoluteError value on hold-out data: 0.06556470692157745
Epoch: 1477
Loss on hold-out set: 0.008518060094696314
MeanAbsoluteError value on hold-out data: 0.06761761009693146
Epoch: 1478
Loss on hold-out set: 0.0069132522567997515
MeanAbsoluteError value on hold-out data: 0.06117728725075722
Epoch: 1479
Loss on hold-out set: 0.007732361470746885
MeanAbsoluteError value on hold-out data: 0.06588520854711533
Epoch: 1480
Loss on hold-out set: 0.008336692868809526
MeanAbsoluteError value on hold-out data: 0.06764981895685196
Epoch: 1481
Loss on hold-out set: 0.006550837470507152
MeanAbsoluteError value on hold-out data: 0.05898429825901985
Epoch: 1482
Loss on hold-out set: 0.006220869274043253
MeanAbsoluteError value on hold-out data: 0.05643514543771744
Epoch: 1483
Loss on hold-out set: 0.007521109708759468
MeanAbsoluteError value on hold-out data: 0.06440658867359161
Epoch: 1484
Loss on hold-out set: 0.008302384456704507
MeanAbsoluteError value on hold-out data: 0.06748274713754654
Epoch: 1485
Loss on hold-out set: 0.007988100783453168
MeanAbsoluteError value on hold-out data: 0.06634722650051117
Epoch: 1486
Loss on hold-out set: 0.007037833030966188
MeanAbsoluteError value on hold-out data: 0.06160802021622658
Epoch: 1487
Loss on hold-out set: 0.008042051072928491
MeanAbsoluteError value on hold-out data: 0.0665428638458252
Epoch: 1488
Loss on hold-out set: 0.007550627708224056
MeanAbsoluteError value on hold-out data: 0.06372664123773575
Epoch: 1489
Loss on hold-out set: 0.006865944058420913
MeanAbsoluteError value on hold-out data: 0.06194094941020012
Epoch: 1490
Loss on hold-out set: 0.006695408868205656
MeanAbsoluteError value on hold-out data: 0.06263765692710876
Epoch: 1491
Loss on hold-out set: 0.006707165754002441
MeanAbsoluteError value on hold-out data: 0.06132638454437256
Epoch: 1492
Loss on hold-out set: 0.0077082748410854645
MeanAbsoluteError value on hold-out data: 0.06434047222137451
Epoch: 1493
Loss on hold-out set: 0.007998422392253512
MeanAbsoluteError value on hold-out data: 0.06345683336257935
Epoch: 1494
Loss on hold-out set: 0.007350629842840135
MeanAbsoluteError value on hold-out data: 0.06186942383646965
Epoch: 1495
Loss on hold-out set: 0.007136603516349472
MeanAbsoluteError value on hold-out data: 0.06307275593280792
Epoch: 1496
Loss on hold-out set: 0.007550167676624066
MeanAbsoluteError value on hold-out data: 0.059158727526664734
Epoch: 1497
Loss on hold-out set: 0.007480159186816309
MeanAbsoluteError value on hold-out data: 0.06369096040725708
Epoch: 1498
Loss on hold-out set: 0.0063120247524178314
MeanAbsoluteError value on hold-out data: 0.06025022640824318
Epoch: 1499
Loss on hold-out set: 0.007600101146854285
MeanAbsoluteError value on hold-out data: 0.0652119442820549
Epoch: 1500
Loss on hold-out set: 0.007966068623112126
MeanAbsoluteError value on hold-out data: 0.06345687061548233
Epoch: 1501
Loss on hold-out set: 0.007216895436771059
MeanAbsoluteError value on hold-out data: 0.061664968729019165
Epoch: 1502
Loss on hold-out set: 0.006765022454613548
MeanAbsoluteError value on hold-out data: 0.05982891097664833
Epoch: 1503
Loss on hold-out set: 0.007257830580953547
MeanAbsoluteError value on hold-out data: 0.06292640417814255
Epoch: 1504
Loss on hold-out set: 0.006839991919284027
MeanAbsoluteError value on hold-out data: 0.06184932589530945
Epoch: 1505
Loss on hold-out set: 0.00765293895792638
MeanAbsoluteError value on hold-out data: 0.06253764778375626
Epoch: 1506
Loss on hold-out set: 0.00805865205907594
MeanAbsoluteError value on hold-out data: 0.0656416192650795
Epoch: 1507
Loss on hold-out set: 0.007746699538699128
MeanAbsoluteError value on hold-out data: 0.06608667969703674
Epoch: 1508
Loss on hold-out set: 0.0083428154373784
MeanAbsoluteError value on hold-out data: 0.06617502123117447
Epoch: 1509
Loss on hold-out set: 0.006456546720298017
MeanAbsoluteError value on hold-out data: 0.0593857504427433
Epoch: 1510
Loss on hold-out set: 0.007250416567549109
MeanAbsoluteError value on hold-out data: 0.0610542856156826
Epoch: 1511
Loss on hold-out set: 0.008081136764061133
MeanAbsoluteError value on hold-out data: 0.0654006227850914
Epoch: 1512
Loss on hold-out set: 0.0062895364421031745
MeanAbsoluteError value on hold-out data: 0.05843280255794525
Epoch: 1513
Loss on hold-out set: 0.008419669237309791
MeanAbsoluteError value on hold-out data: 0.06485031545162201
Epoch: 1514
Loss on hold-out set: 0.007271825619354786
MeanAbsoluteError value on hold-out data: 0.06505057215690613
Epoch: 1515
Loss on hold-out set: 0.007202322443190496
MeanAbsoluteError value on hold-out data: 0.06321631371974945
Epoch: 1516
Loss on hold-out set: 0.006273168332700152
MeanAbsoluteError value on hold-out data: 0.058231715112924576
Epoch: 1517
Loss on hold-out set: 0.008171942167841735
MeanAbsoluteError value on hold-out data: 0.06502459943294525
Epoch: 1518
Loss on hold-out set: 0.008346891013018953
MeanAbsoluteError value on hold-out data: 0.06566137820482254
Epoch: 1519
Loss on hold-out set: 0.009049407299001663
MeanAbsoluteError value on hold-out data: 0.06458084285259247
Epoch: 1520
Loss on hold-out set: 0.006409643513300883
MeanAbsoluteError value on hold-out data: 0.06074349209666252
Epoch: 1521
Loss on hold-out set: 0.006458874988323563
MeanAbsoluteError value on hold-out data: 0.05908901244401932
Epoch: 1522
Loss on hold-out set: 0.00864294717076215
MeanAbsoluteError value on hold-out data: 0.06837634742259979
Epoch: 1523
Loss on hold-out set: 0.007970862372603733
MeanAbsoluteError value on hold-out data: 0.06717745214700699
Epoch: 1524
Loss on hold-out set: 0.008116813424858265
MeanAbsoluteError value on hold-out data: 0.06581944972276688
Epoch: 1525
Loss on hold-out set: 0.007430084310896442
MeanAbsoluteError value on hold-out data: 0.06386429071426392
Epoch: 1526
Loss on hold-out set: 0.006763433174370827
MeanAbsoluteError value on hold-out data: 0.06105370074510574
Epoch: 1527
Loss on hold-out set: 0.007153262997126149
MeanAbsoluteError value on hold-out data: 0.06055718660354614
Early stopping at epoch 1526
Returned to Spot: Validation loss: 0.007153262997126149
----------------------------------------------

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.1773189149831582, 'lr_mult': 9.06715620679689, 'batch_size': 4, 'epochs': 4, 'k_folds': 1, 'patience': 8, 'optimizer': 'Adamax', 'sgd_momentum': 0.22706194978124503}
Epoch: 1
Loss on hold-out set: 0.034361703678344686
MeanAbsoluteError value on hold-out data: 0.1483273059129715
Epoch: 2
Loss on hold-out set: 0.027543756123632194
MeanAbsoluteError value on hold-out data: 0.13386479020118713
Epoch: 3
Loss on hold-out set: 0.027133535298829278
MeanAbsoluteError value on hold-out data: 0.12997154891490936
Epoch: 4
Loss on hold-out set: 0.02281195464466388
MeanAbsoluteError value on hold-out data: 0.12259048223495483
Returned to Spot: Validation loss: 0.02281195464466388
----------------------------------------------

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.3840970624671163, 'lr_mult': 4.593111165984917, 'batch_size': 8, 'epochs': 256, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.8945915831939406}
Epoch: 1
Loss on hold-out set: 0.04209181840384477
MeanAbsoluteError value on hold-out data: 0.16215310990810394
Epoch: 2
Loss on hold-out set: 0.03963152178881788
MeanAbsoluteError value on hold-out data: 0.16119369864463806
Epoch: 3
Loss on hold-out set: 0.0327016004900399
MeanAbsoluteError value on hold-out data: 0.14716875553131104
Epoch: 4
Loss on hold-out set: 0.02498048773237602
MeanAbsoluteError value on hold-out data: 0.1253553181886673
Epoch: 5
Loss on hold-out set: 0.028619804934255387
MeanAbsoluteError value on hold-out data: 0.13353581726551056
Epoch: 6
Loss on hold-out set: 0.022597819370658773
MeanAbsoluteError value on hold-out data: 0.11922604590654373
Epoch: 7
Loss on hold-out set: 0.023464137008168587
MeanAbsoluteError value on hold-out data: 0.12530377507209778
Epoch: 8
Loss on hold-out set: 0.02126168191285902
MeanAbsoluteError value on hold-out data: 0.11638008058071136
Epoch: 9
Loss on hold-out set: 0.019153860385382648
MeanAbsoluteError value on hold-out data: 0.10831602662801743
Epoch: 10
Loss on hold-out set: 0.015790384514012226
MeanAbsoluteError value on hold-out data: 0.09948066622018814
Epoch: 11
Loss on hold-out set: 0.012795366714463421
MeanAbsoluteError value on hold-out data: 0.08909136801958084
Epoch: 12
Loss on hold-out set: 0.013990139533569547
MeanAbsoluteError value on hold-out data: 0.09427205473184586
Epoch: 13
Loss on hold-out set: 0.014332403649428957
MeanAbsoluteError value on hold-out data: 0.09468749165534973
Epoch: 14
Loss on hold-out set: 0.01182584196182066
MeanAbsoluteError value on hold-out data: 0.0883338674902916
Epoch: 15
Loss on hold-out set: 0.009252938922911295
MeanAbsoluteError value on hold-out data: 0.07216621935367584
Epoch: 16
Loss on hold-out set: 0.009629372642130443
MeanAbsoluteError value on hold-out data: 0.07550381869077682
Epoch: 17
Loss on hold-out set: 0.00911574118072167
MeanAbsoluteError value on hold-out data: 0.07282613217830658
Epoch: 18
Loss on hold-out set: 0.011304131182106701
MeanAbsoluteError value on hold-out data: 0.07796940207481384
Epoch: 19
Loss on hold-out set: 0.008288956195189568
MeanAbsoluteError value on hold-out data: 0.06999485194683075
Epoch: 20
Loss on hold-out set: 0.009518225554768977
MeanAbsoluteError value on hold-out data: 0.07438059896230698
Epoch: 21
Loss on hold-out set: 0.007042618273867686
MeanAbsoluteError value on hold-out data: 0.06400284171104431
Epoch: 22
Loss on hold-out set: 0.0072288608582886426
MeanAbsoluteError value on hold-out data: 0.06305050849914551
Epoch: 23
Loss on hold-out set: 0.00693668897177926
MeanAbsoluteError value on hold-out data: 0.061326492577791214
Epoch: 24
Loss on hold-out set: 0.005993553746712247
MeanAbsoluteError value on hold-out data: 0.06092235445976257
Epoch: 25
Loss on hold-out set: 0.007001461807368814
MeanAbsoluteError value on hold-out data: 0.06483720988035202
Epoch: 26
Loss on hold-out set: 0.005560669789127515
MeanAbsoluteError value on hold-out data: 0.05575902760028839
Epoch: 27
Loss on hold-out set: 0.006778363787912224
MeanAbsoluteError value on hold-out data: 0.062093671411275864
Epoch: 28
Loss on hold-out set: 0.006377126071847191
MeanAbsoluteError value on hold-out data: 0.059659991413354874
Epoch: 29
Loss on hold-out set: 0.006683701627863277
MeanAbsoluteError value on hold-out data: 0.06652594357728958
Epoch: 30
Loss on hold-out set: 0.00705320066404774
MeanAbsoluteError value on hold-out data: 0.06350995600223541
Epoch: 31
Loss on hold-out set: 0.005897417606320232
MeanAbsoluteError value on hold-out data: 0.05872475355863571
Epoch: 32
Loss on hold-out set: 0.006718622575710087
MeanAbsoluteError value on hold-out data: 0.05728516727685928
Epoch: 33
Loss on hold-out set: 0.005306914696120657
MeanAbsoluteError value on hold-out data: 0.05382249131798744
Epoch: 34
Loss on hold-out set: 0.004941408618163366
MeanAbsoluteError value on hold-out data: 0.054181404411792755
Epoch: 35
Loss on hold-out set: 0.006026847772055159
MeanAbsoluteError value on hold-out data: 0.056063879281282425
Epoch: 36
Loss on hold-out set: 0.0058108241983542315
MeanAbsoluteError value on hold-out data: 0.05806573107838631
Epoch: 37
Loss on hold-out set: 0.004031314151545398
MeanAbsoluteError value on hold-out data: 0.04963703081011772
Epoch: 38
Loss on hold-out set: 0.005792812304877627
MeanAbsoluteError value on hold-out data: 0.058660734444856644
Epoch: 39
Loss on hold-out set: 0.006112012050212606
MeanAbsoluteError value on hold-out data: 0.05529021471738815
Epoch: 40
Loss on hold-out set: 0.005381465672000654
MeanAbsoluteError value on hold-out data: 0.055170707404613495
Epoch: 41
Loss on hold-out set: 0.004175439673034768
MeanAbsoluteError value on hold-out data: 0.049428582191467285
Epoch: 42
Loss on hold-out set: 0.004652109183983779
MeanAbsoluteError value on hold-out data: 0.05044576898217201
Epoch: 43
Loss on hold-out set: 0.004988699357981156
MeanAbsoluteError value on hold-out data: 0.053315915167331696
Epoch: 44
Loss on hold-out set: 0.005195402089923032
MeanAbsoluteError value on hold-out data: 0.050753552466630936
Epoch: 45
Loss on hold-out set: 0.004831175218752928
MeanAbsoluteError value on hold-out data: 0.050129346549510956
Epoch: 46
Loss on hold-out set: 0.005801456908413552
MeanAbsoluteError value on hold-out data: 0.057092513889074326
Epoch: 47
Loss on hold-out set: 0.004815139491448032
MeanAbsoluteError value on hold-out data: 0.05002845451235771
Epoch: 48
Loss on hold-out set: 0.005474952890500917
MeanAbsoluteError value on hold-out data: 0.05816163867712021
Epoch: 49
Loss on hold-out set: 0.0048678095014398235
MeanAbsoluteError value on hold-out data: 0.053055763244628906
Epoch: 50
Loss on hold-out set: 0.004636162101585222
MeanAbsoluteError value on hold-out data: 0.04978427663445473
Epoch: 51
Loss on hold-out set: 0.004480846230044814
MeanAbsoluteError value on hold-out data: 0.04978995770215988
Epoch: 52
Loss on hold-out set: 0.0046743022363730955
MeanAbsoluteError value on hold-out data: 0.05102294310927391
Epoch: 53
Loss on hold-out set: 0.005261933161435943
MeanAbsoluteError value on hold-out data: 0.055048953741788864
Epoch: 54
Loss on hold-out set: 0.005451670895318354
MeanAbsoluteError value on hold-out data: 0.052647192031145096
Epoch: 55
Loss on hold-out set: 0.005770848825034734
MeanAbsoluteError value on hold-out data: 0.05853675305843353
Epoch: 56
Loss on hold-out set: 0.004658536968666962
MeanAbsoluteError value on hold-out data: 0.049457449465990067
Epoch: 57
Loss on hold-out set: 0.005160625852448375
MeanAbsoluteError value on hold-out data: 0.0523221418261528
Epoch: 58
Loss on hold-out set: 0.003789360659491075
MeanAbsoluteError value on hold-out data: 0.04422588646411896
Epoch: 59
Loss on hold-out set: 0.005899474101361672
MeanAbsoluteError value on hold-out data: 0.05592048540711403
Epoch: 60
Loss on hold-out set: 0.004353325434893027
MeanAbsoluteError value on hold-out data: 0.04622308909893036
Epoch: 61
Loss on hold-out set: 0.005724958324878428
MeanAbsoluteError value on hold-out data: 0.0605894960463047
Epoch: 62
Loss on hold-out set: 0.004608765226102581
MeanAbsoluteError value on hold-out data: 0.052036404609680176
Epoch: 63
Loss on hold-out set: 0.004344728879483515
MeanAbsoluteError value on hold-out data: 0.05030643939971924
Epoch: 64
Loss on hold-out set: 0.003993028986243237
MeanAbsoluteError value on hold-out data: 0.04928259924054146
Epoch: 65
Loss on hold-out set: 0.005140318228146306
MeanAbsoluteError value on hold-out data: 0.047764625400304794
Epoch: 66
Loss on hold-out set: 0.005610023138088812
MeanAbsoluteError value on hold-out data: 0.054763082414865494
Epoch: 67
Loss on hold-out set: 0.0045993401252321505
MeanAbsoluteError value on hold-out data: 0.04609664902091026
Epoch: 68
Loss on hold-out set: 0.005256819443801712
MeanAbsoluteError value on hold-out data: 0.053891271352767944
Epoch: 69
Loss on hold-out set: 0.004768477726764486
MeanAbsoluteError value on hold-out data: 0.051322709769010544
Epoch: 70
Loss on hold-out set: 0.005099707730359545
MeanAbsoluteError value on hold-out data: 0.051991138607263565
Epoch: 71
Loss on hold-out set: 0.005434173998717023
MeanAbsoluteError value on hold-out data: 0.05334220081567764
Epoch: 72
Loss on hold-out set: 0.005023407072784673
MeanAbsoluteError value on hold-out data: 0.05497552081942558
Epoch: 73
Loss on hold-out set: 0.004516628909378166
MeanAbsoluteError value on hold-out data: 0.05149334296584129
Epoch: 74
Loss on hold-out set: 0.0052839931603030936
MeanAbsoluteError value on hold-out data: 0.05530553311109543
Epoch: 75
Loss on hold-out set: 0.003978489472310206
MeanAbsoluteError value on hold-out data: 0.045159727334976196
Epoch: 76
Loss on hold-out set: 0.006545037803191103
MeanAbsoluteError value on hold-out data: 0.06379158049821854
Epoch: 77
Loss on hold-out set: 0.004112523024607646
MeanAbsoluteError value on hold-out data: 0.04607049375772476
Epoch: 78
Loss on hold-out set: 0.004722725578559269
MeanAbsoluteError value on hold-out data: 0.05249161273241043
Epoch: 79
Loss on hold-out set: 0.006059928248807984
MeanAbsoluteError value on hold-out data: 0.05779505521059036
Epoch: 80
Loss on hold-out set: 0.004281791723578384
MeanAbsoluteError value on hold-out data: 0.04955582693219185
Epoch: 81
Loss on hold-out set: 0.005923802463497084
MeanAbsoluteError value on hold-out data: 0.057617492973804474
Epoch: 82
Loss on hold-out set: 0.0067313957199650375
MeanAbsoluteError value on hold-out data: 0.06568524241447449
Epoch: 83
Loss on hold-out set: 0.005731233228672002
MeanAbsoluteError value on hold-out data: 0.055635228753089905
Epoch: 84
Loss on hold-out set: 0.003922355546628272
MeanAbsoluteError value on hold-out data: 0.04717600718140602
Epoch: 85
Loss on hold-out set: 0.004501209830203534
MeanAbsoluteError value on hold-out data: 0.05158026143908501
Epoch: 86
Loss on hold-out set: 0.004326099140790144
MeanAbsoluteError value on hold-out data: 0.04810550436377525
Epoch: 87
Loss on hold-out set: 0.0039553348492757465
MeanAbsoluteError value on hold-out data: 0.04373818635940552
Epoch: 88
Loss on hold-out set: 0.003896257582757818
MeanAbsoluteError value on hold-out data: 0.04454079642891884
Epoch: 89
Loss on hold-out set: 0.005875980224166261
MeanAbsoluteError value on hold-out data: 0.06070137023925781
Epoch: 90
Loss on hold-out set: 0.004719807725019851
MeanAbsoluteError value on hold-out data: 0.053683046251535416
Epoch: 91
Loss on hold-out set: 0.004862350692028964
MeanAbsoluteError value on hold-out data: 0.054017290472984314
Epoch: 92
Loss on hold-out set: 0.004322407235648777
MeanAbsoluteError value on hold-out data: 0.04934661090373993
Epoch: 93
Loss on hold-out set: 0.004295103873836955
MeanAbsoluteError value on hold-out data: 0.048769742250442505
Epoch: 94
Loss on hold-out set: 0.004069374933973641
MeanAbsoluteError value on hold-out data: 0.04859202727675438
Epoch: 95
Loss on hold-out set: 0.004779413736143492
MeanAbsoluteError value on hold-out data: 0.052960075438022614
Epoch: 96
Loss on hold-out set: 0.0038792260502783678
MeanAbsoluteError value on hold-out data: 0.04734024032950401
Epoch: 97
Loss on hold-out set: 0.004305753346814431
MeanAbsoluteError value on hold-out data: 0.04539920389652252
Epoch: 98
Loss on hold-out set: 0.004645849882906891
MeanAbsoluteError value on hold-out data: 0.047746337950229645
Epoch: 99
Loss on hold-out set: 0.004532101003477644
MeanAbsoluteError value on hold-out data: 0.049592651426792145
Epoch: 100
Loss on hold-out set: 0.0032289056827338705
MeanAbsoluteError value on hold-out data: 0.04363878816366196
Epoch: 101
Loss on hold-out set: 0.006270652465326221
MeanAbsoluteError value on hold-out data: 0.06505493819713593
Epoch: 102
Loss on hold-out set: 0.005532582341019358
MeanAbsoluteError value on hold-out data: 0.051477331668138504
Epoch: 103
Loss on hold-out set: 0.005558108120519472
MeanAbsoluteError value on hold-out data: 0.058027662336826324
Epoch: 104
Loss on hold-out set: 0.00510713017521132
MeanAbsoluteError value on hold-out data: 0.052739862352609634
Epoch: 105
Loss on hold-out set: 0.005157854936490031
MeanAbsoluteError value on hold-out data: 0.05315771326422691
Epoch: 106
Loss on hold-out set: 0.006166989719005008
MeanAbsoluteError value on hold-out data: 0.0571834072470665
Epoch: 107
Loss on hold-out set: 0.0064381372618587005
MeanAbsoluteError value on hold-out data: 0.05726802349090576
Epoch: 108
Loss on hold-out set: 0.004611377627282452
MeanAbsoluteError value on hold-out data: 0.049325328320264816
Epoch: 109
Loss on hold-out set: 0.004538381878151803
MeanAbsoluteError value on hold-out data: 0.04822593927383423
Epoch: 110
Loss on hold-out set: 0.00461544343852438
MeanAbsoluteError value on hold-out data: 0.04675477370619774
Epoch: 111
Loss on hold-out set: 0.0039199662094592655
MeanAbsoluteError value on hold-out data: 0.04420500248670578
Epoch: 112
Loss on hold-out set: 0.005579201777245065
MeanAbsoluteError value on hold-out data: 0.05591202899813652
Epoch: 113
Loss on hold-out set: 0.005247213200690519
MeanAbsoluteError value on hold-out data: 0.05601857602596283
Epoch: 114
Loss on hold-out set: 0.004054635658241368
MeanAbsoluteError value on hold-out data: 0.047200605273246765
Epoch: 115
Loss on hold-out set: 0.006906192973378654
MeanAbsoluteError value on hold-out data: 0.0657275840640068
Epoch: 116
Loss on hold-out set: 0.004043566265241488
MeanAbsoluteError value on hold-out data: 0.04656868055462837
Epoch: 117
Loss on hold-out set: 0.0037196947316835193
MeanAbsoluteError value on hold-out data: 0.04676659777760506
Epoch: 118
Loss on hold-out set: 0.0038761485928645065
MeanAbsoluteError value on hold-out data: 0.04739794880151749
Epoch: 119
Loss on hold-out set: 0.003986565935376443
MeanAbsoluteError value on hold-out data: 0.04460018500685692
Epoch: 120
Loss on hold-out set: 0.0037403541025828177
MeanAbsoluteError value on hold-out data: 0.04590190574526787
Epoch: 121
Loss on hold-out set: 0.0045758229174871785
MeanAbsoluteError value on hold-out data: 0.048881080001592636
Epoch: 122
Loss on hold-out set: 0.004890065689228083
MeanAbsoluteError value on hold-out data: 0.052980244159698486
Epoch: 123
Loss on hold-out set: 0.0060482844143591235
MeanAbsoluteError value on hold-out data: 0.05489850416779518
Epoch: 124
Loss on hold-out set: 0.00504908886413384
MeanAbsoluteError value on hold-out data: 0.051789622753858566
Epoch: 125
Loss on hold-out set: 0.004619053898893885
MeanAbsoluteError value on hold-out data: 0.04825063794851303
Epoch: 126
Loss on hold-out set: 0.004078888980745289
MeanAbsoluteError value on hold-out data: 0.047283921390771866
Epoch: 127
Loss on hold-out set: 0.006208731480383952
MeanAbsoluteError value on hold-out data: 0.06272894889116287
Epoch: 128
Loss on hold-out set: 0.003809286501276993
MeanAbsoluteError value on hold-out data: 0.044681474566459656
Epoch: 129
Loss on hold-out set: 0.004895741432464044
MeanAbsoluteError value on hold-out data: 0.0501922070980072
Epoch: 130
Loss on hold-out set: 0.004431644716532901
MeanAbsoluteError value on hold-out data: 0.05024807155132294
Epoch: 131
Loss on hold-out set: 0.0051366802485733245
MeanAbsoluteError value on hold-out data: 0.052542027086019516
Epoch: 132
Loss on hold-out set: 0.004392089463133169
MeanAbsoluteError value on hold-out data: 0.04735495522618294
Epoch: 133
Loss on hold-out set: 0.004215923821136944
MeanAbsoluteError value on hold-out data: 0.04961245879530907
Epoch: 134
Loss on hold-out set: 0.0043943911510531935
MeanAbsoluteError value on hold-out data: 0.04658305644989014
Epoch: 135
Loss on hold-out set: 0.003752975826500915
MeanAbsoluteError value on hold-out data: 0.04713822528719902
Epoch: 136
Loss on hold-out set: 0.0046074141604262155
MeanAbsoluteError value on hold-out data: 0.05150889977812767
Epoch: 137
Loss on hold-out set: 0.004911707294492149
MeanAbsoluteError value on hold-out data: 0.05214590206742287
Epoch: 138
Loss on hold-out set: 0.004784133931695435
MeanAbsoluteError value on hold-out data: 0.05223836377263069
Epoch: 139
Loss on hold-out set: 0.0054064359129896685
MeanAbsoluteError value on hold-out data: 0.05224623158574104
Epoch: 140
Loss on hold-out set: 0.005881964880054032
MeanAbsoluteError value on hold-out data: 0.055140420794487
Epoch: 141
Loss on hold-out set: 0.004328326719635362
MeanAbsoluteError value on hold-out data: 0.04837013781070709
Epoch: 142
Loss on hold-out set: 0.004266637031258525
MeanAbsoluteError value on hold-out data: 0.0449305884540081
Epoch: 143
Loss on hold-out set: 0.0044042774947899346
MeanAbsoluteError value on hold-out data: 0.04898227006196976
Epoch: 144
Loss on hold-out set: 0.005069494261222549
MeanAbsoluteError value on hold-out data: 0.05117310583591461
Epoch: 145
Loss on hold-out set: 0.006197547497178771
MeanAbsoluteError value on hold-out data: 0.0660579651594162
Epoch: 146
Loss on hold-out set: 0.004464961565406013
MeanAbsoluteError value on hold-out data: 0.04831308871507645
Epoch: 147
Loss on hold-out set: 0.004144919466374344
MeanAbsoluteError value on hold-out data: 0.046073924750089645
Epoch: 148
Loss on hold-out set: 0.0042341470103373895
MeanAbsoluteError value on hold-out data: 0.047152481973171234
Epoch: 149
Loss on hold-out set: 0.004560478806716243
MeanAbsoluteError value on hold-out data: 0.049268025904893875
Epoch: 150
Loss on hold-out set: 0.00531044243344743
MeanAbsoluteError value on hold-out data: 0.049274154007434845
Epoch: 151
Loss on hold-out set: 0.004972255149991007
MeanAbsoluteError value on hold-out data: 0.050027716904878616
Epoch: 152
Loss on hold-out set: 0.0047292551178926305
MeanAbsoluteError value on hold-out data: 0.056873418390750885
Epoch: 153
Loss on hold-out set: 0.004486263162873097
MeanAbsoluteError value on hold-out data: 0.04573547840118408
Epoch: 154
Loss on hold-out set: 0.005494097086882807
MeanAbsoluteError value on hold-out data: 0.05312347784638405
Epoch: 155
Loss on hold-out set: 0.004174725411423041
MeanAbsoluteError value on hold-out data: 0.04694068431854248
Epoch: 156
Loss on hold-out set: 0.00449992734540597
MeanAbsoluteError value on hold-out data: 0.04819692298769951
Epoch: 157
Loss on hold-out set: 0.004147348747784762
MeanAbsoluteError value on hold-out data: 0.04641798138618469
Epoch: 158
Loss on hold-out set: 0.0037894197673602704
MeanAbsoluteError value on hold-out data: 0.048514798283576965
Epoch: 159
Loss on hold-out set: 0.0035814777978597895
MeanAbsoluteError value on hold-out data: 0.045909781008958817
Epoch: 160
Loss on hold-out set: 0.006826134873431568
MeanAbsoluteError value on hold-out data: 0.06229698285460472
Epoch: 161
Loss on hold-out set: 0.004895865385677959
MeanAbsoluteError value on hold-out data: 0.053634561598300934
Epoch: 162
Loss on hold-out set: 0.0041756168173282945
MeanAbsoluteError value on hold-out data: 0.04659661650657654
Epoch: 163
Loss on hold-out set: 0.005730116804203901
MeanAbsoluteError value on hold-out data: 0.05602237209677696
Epoch: 164
Loss on hold-out set: 0.003715163125889376
MeanAbsoluteError value on hold-out data: 0.046580296009778976
Early stopping at epoch 163
Returned to Spot: Validation loss: 0.003715163125889376
----------------------------------------------

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.028212293289955948, 'lr_mult': 5.512295634964, 'batch_size': 8, 'epochs': 1024, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adam', 'sgd_momentum': 0.972653859609415}
Epoch: 1
Loss on hold-out set: 0.02276590965247076
MeanAbsoluteError value on hold-out data: 0.12010054290294647
Epoch: 2
Loss on hold-out set: 0.021579293191040818
MeanAbsoluteError value on hold-out data: 0.1155470758676529
Epoch: 3
Loss on hold-out set: 0.020696441508143357
MeanAbsoluteError value on hold-out data: 0.11192086338996887
Epoch: 4
Loss on hold-out set: 0.01913396825425719
MeanAbsoluteError value on hold-out data: 0.10703561455011368
Epoch: 5
Loss on hold-out set: 0.015256487519333237
MeanAbsoluteError value on hold-out data: 0.09491129219532013
Epoch: 6
Loss on hold-out set: 0.011600391265298975
MeanAbsoluteError value on hold-out data: 0.08345692604780197
Epoch: 7
Loss on hold-out set: 0.011126216476489054
MeanAbsoluteError value on hold-out data: 0.08071637153625488
Epoch: 8
Loss on hold-out set: 0.012490439375764445
MeanAbsoluteError value on hold-out data: 0.09238291531801224
Epoch: 9
Loss on hold-out set: 0.009367704752979702
MeanAbsoluteError value on hold-out data: 0.07802662253379822
Epoch: 10
Loss on hold-out set: 0.0072472564888333806
MeanAbsoluteError value on hold-out data: 0.06346942484378815
Epoch: 11
Loss on hold-out set: 0.009441532451953543
MeanAbsoluteError value on hold-out data: 0.08492004126310349
Epoch: 12
Loss on hold-out set: 0.00553659711792869
MeanAbsoluteError value on hold-out data: 0.057171497493982315
Epoch: 13
Loss on hold-out set: 0.0055751517739784165
MeanAbsoluteError value on hold-out data: 0.05444580689072609
Epoch: 14
Loss on hold-out set: 0.004020697428036089
MeanAbsoluteError value on hold-out data: 0.04242941364645958
Epoch: 15
Loss on hold-out set: 0.002820247484027947
MeanAbsoluteError value on hold-out data: 0.039650507271289825
Epoch: 16
Loss on hold-out set: 0.004637236752865934
MeanAbsoluteError value on hold-out data: 0.04181390255689621
Epoch: 17
Loss on hold-out set: 0.00502304621285906
MeanAbsoluteError value on hold-out data: 0.05467217043042183
Epoch: 18
Loss on hold-out set: 0.0046651519430605205
MeanAbsoluteError value on hold-out data: 0.0609142929315567
Epoch: 19
Loss on hold-out set: 0.00285914157575462
MeanAbsoluteError value on hold-out data: 0.03514477238059044
Epoch: 20
Loss on hold-out set: 0.004485663302291773
MeanAbsoluteError value on hold-out data: 0.05407065525650978
Epoch: 21
Loss on hold-out set: 0.002888874532225983
MeanAbsoluteError value on hold-out data: 0.039731379598379135
Epoch: 22
Loss on hold-out set: 0.002447010441660256
MeanAbsoluteError value on hold-out data: 0.027442744001746178
Epoch: 23
Loss on hold-out set: 0.0023991738531836553
MeanAbsoluteError value on hold-out data: 0.03488548472523689
Epoch: 24
Loss on hold-out set: 0.0028530043108682883
MeanAbsoluteError value on hold-out data: 0.04610997810959816
Epoch: 25
Loss on hold-out set: 0.0023954254682298356
MeanAbsoluteError value on hold-out data: 0.03704560920596123
Epoch: 26
Loss on hold-out set: 0.001672011090130055
MeanAbsoluteError value on hold-out data: 0.03132588043808937
Epoch: 27
Loss on hold-out set: 0.003072941862659431
MeanAbsoluteError value on hold-out data: 0.045385416597127914
Epoch: 28
Loss on hold-out set: 0.001970076936566712
MeanAbsoluteError value on hold-out data: 0.028733421117067337
Epoch: 29
Loss on hold-out set: 0.001616895534664907
MeanAbsoluteError value on hold-out data: 0.026208318769931793
Epoch: 30
Loss on hold-out set: 0.0017466215059884188
MeanAbsoluteError value on hold-out data: 0.021776270121335983
Epoch: 31
Loss on hold-out set: 0.0016433574146503815
MeanAbsoluteError value on hold-out data: 0.02198324166238308
Epoch: 32
Loss on hold-out set: 0.002394873637393558
MeanAbsoluteError value on hold-out data: 0.03352008014917374
Epoch: 33
Loss on hold-out set: 0.00262959364887425
MeanAbsoluteError value on hold-out data: 0.04201354458928108
Epoch: 34
Loss on hold-out set: 0.0017718166636768728
MeanAbsoluteError value on hold-out data: 0.025951990857720375
Epoch: 35
Loss on hold-out set: 0.003015803697053343
MeanAbsoluteError value on hold-out data: 0.048101987689733505
Epoch: 36
Loss on hold-out set: 0.003484430493125202
MeanAbsoluteError value on hold-out data: 0.03789487108588219
Epoch: 37
Loss on hold-out set: 0.0012246206997109479
MeanAbsoluteError value on hold-out data: 0.02254011482000351
Epoch: 38
Loss on hold-out set: 0.0016267026210124115
MeanAbsoluteError value on hold-out data: 0.02655734121799469
Epoch: 39
Loss on hold-out set: 0.0012544587015757937
MeanAbsoluteError value on hold-out data: 0.019819756969809532
Epoch: 40
Loss on hold-out set: 0.0019878186251030697
MeanAbsoluteError value on hold-out data: 0.025205299258232117
Epoch: 41
Loss on hold-out set: 0.0010142459995174584
MeanAbsoluteError value on hold-out data: 0.019883297383785248
Epoch: 42
Loss on hold-out set: 0.002369652669011358
MeanAbsoluteError value on hold-out data: 0.027326026931405067
Epoch: 43
Loss on hold-out set: 0.0019041372502933403
MeanAbsoluteError value on hold-out data: 0.03632199391722679
Epoch: 44
Loss on hold-out set: 0.002201345444375061
MeanAbsoluteError value on hold-out data: 0.03670572116971016
Epoch: 45
Loss on hold-out set: 0.0021275465788724098
MeanAbsoluteError value on hold-out data: 0.032063040882349014
Epoch: 46
Loss on hold-out set: 0.001309866631728303
MeanAbsoluteError value on hold-out data: 0.02601735293865204
Epoch: 47
Loss on hold-out set: 0.0018015881826757227
MeanAbsoluteError value on hold-out data: 0.02181469462811947
Epoch: 48
Loss on hold-out set: 0.0014015449551631096
MeanAbsoluteError value on hold-out data: 0.021393729373812675
Epoch: 49
Loss on hold-out set: 0.0015871408376321931
MeanAbsoluteError value on hold-out data: 0.020579898729920387
Epoch: 50
Loss on hold-out set: 0.0012689221728482824
MeanAbsoluteError value on hold-out data: 0.02610386349260807
Epoch: 51
Loss on hold-out set: 0.0023354699078481644
MeanAbsoluteError value on hold-out data: 0.03582325950264931
Epoch: 52
Loss on hold-out set: 0.0012383958654888709
MeanAbsoluteError value on hold-out data: 0.02228665165603161
Epoch: 53
Loss on hold-out set: 0.0013567612901457132
MeanAbsoluteError value on hold-out data: 0.02111726999282837
Epoch: 54
Loss on hold-out set: 0.0017291156063469028
MeanAbsoluteError value on hold-out data: 0.03518369048833847
Epoch: 55
Loss on hold-out set: 0.0014169672285788693
MeanAbsoluteError value on hold-out data: 0.019131969660520554
Epoch: 56
Loss on hold-out set: 0.0011411052657517996
MeanAbsoluteError value on hold-out data: 0.018232034519314766
Epoch: 57
Loss on hold-out set: 0.0015086083796249066
MeanAbsoluteError value on hold-out data: 0.023317484185099602
Epoch: 58
Loss on hold-out set: 0.0012846823012391962
MeanAbsoluteError value on hold-out data: 0.02143372967839241
Epoch: 59
Loss on hold-out set: 0.0011384229294076488
MeanAbsoluteError value on hold-out data: 0.0223920289427042
Epoch: 60
Loss on hold-out set: 0.0014051819223248841
MeanAbsoluteError value on hold-out data: 0.026243014261126518
Epoch: 61
Loss on hold-out set: 0.0011471890806876075
MeanAbsoluteError value on hold-out data: 0.025833027437329292
Epoch: 62
Loss on hold-out set: 0.0015627878291477252
MeanAbsoluteError value on hold-out data: 0.02334574982523918
Epoch: 63
Loss on hold-out set: 0.001723577418248935
MeanAbsoluteError value on hold-out data: 0.022347385063767433
Epoch: 64
Loss on hold-out set: 0.0014797043871734978
MeanAbsoluteError value on hold-out data: 0.02100997045636177
Epoch: 65
Loss on hold-out set: 0.001523293521658113
MeanAbsoluteError value on hold-out data: 0.02516810968518257
Epoch: 66
Loss on hold-out set: 0.00151004693256446
MeanAbsoluteError value on hold-out data: 0.027783865109086037
Epoch: 67
Loss on hold-out set: 0.0010464172103303625
MeanAbsoluteError value on hold-out data: 0.01762811280786991
Epoch: 68
Loss on hold-out set: 0.0008226692443713546
MeanAbsoluteError value on hold-out data: 0.02266409620642662
Epoch: 69
Loss on hold-out set: 0.0009428951567602589
MeanAbsoluteError value on hold-out data: 0.024416200816631317
Epoch: 70
Loss on hold-out set: 0.0008504867246301728
MeanAbsoluteError value on hold-out data: 0.0165705569088459
Epoch: 71
Loss on hold-out set: 0.0013434237005544435
MeanAbsoluteError value on hold-out data: 0.02445898950099945
Epoch: 72
Loss on hold-out set: 0.001316645887288216
MeanAbsoluteError value on hold-out data: 0.0279830414801836
Epoch: 73
Loss on hold-out set: 0.0011570367494545951
MeanAbsoluteError value on hold-out data: 0.021391641348600388
Epoch: 74
Loss on hold-out set: 0.0009413783342384512
MeanAbsoluteError value on hold-out data: 0.020198525860905647
Epoch: 75
Loss on hold-out set: 0.0012756369821880454
MeanAbsoluteError value on hold-out data: 0.022098245099186897
Epoch: 76
Loss on hold-out set: 0.0018909819796375047
MeanAbsoluteError value on hold-out data: 0.0296938456594944
Epoch: 77
Loss on hold-out set: 0.0011755741137389314
MeanAbsoluteError value on hold-out data: 0.022191226482391357
Epoch: 78
Loss on hold-out set: 0.0011294961942966391
MeanAbsoluteError value on hold-out data: 0.021169045940041542
Epoch: 79
Loss on hold-out set: 0.0008409032223808984
MeanAbsoluteError value on hold-out data: 0.015573670156300068
Epoch: 80
Loss on hold-out set: 0.0007216055777175107
MeanAbsoluteError value on hold-out data: 0.019462063908576965
Epoch: 81
Loss on hold-out set: 0.0007530256729009316
MeanAbsoluteError value on hold-out data: 0.02023218385875225
Epoch: 82
Loss on hold-out set: 0.0008696505688739739
MeanAbsoluteError value on hold-out data: 0.01850907877087593
Epoch: 83
Loss on hold-out set: 0.0014144644473593584
MeanAbsoluteError value on hold-out data: 0.023989509791135788
Epoch: 84
Loss on hold-out set: 0.0007240567351561223
MeanAbsoluteError value on hold-out data: 0.01700609177350998
Epoch: 85
Loss on hold-out set: 0.0011833659583843608
MeanAbsoluteError value on hold-out data: 0.020089346915483475
Epoch: 86
Loss on hold-out set: 0.0018318799266126007
MeanAbsoluteError value on hold-out data: 0.03135157749056816
Epoch: 87
Loss on hold-out set: 0.0014081825337550406
MeanAbsoluteError value on hold-out data: 0.025978930294513702
Epoch: 88
Loss on hold-out set: 0.0009170991098998409
MeanAbsoluteError value on hold-out data: 0.020202063024044037
Epoch: 89
Loss on hold-out set: 0.001444321118852761
MeanAbsoluteError value on hold-out data: 0.023747151717543602
Epoch: 90
Loss on hold-out set: 0.0013982115396126908
MeanAbsoluteError value on hold-out data: 0.0311988927423954
Epoch: 91
Loss on hold-out set: 0.0009101782414195201
MeanAbsoluteError value on hold-out data: 0.01689322292804718
Epoch: 92
Loss on hold-out set: 0.003259373338598954
MeanAbsoluteError value on hold-out data: 0.05347716808319092
Epoch: 93
Loss on hold-out set: 0.0008995814873503006
MeanAbsoluteError value on hold-out data: 0.019712019711732864
Epoch: 94
Loss on hold-out set: 0.0013663000205078309
MeanAbsoluteError value on hold-out data: 0.024174951016902924
Epoch: 95
Loss on hold-out set: 0.0010871130836772192
MeanAbsoluteError value on hold-out data: 0.022735510021448135
Epoch: 96
Loss on hold-out set: 0.0008427780452812409
MeanAbsoluteError value on hold-out data: 0.018199631944298744
Epoch: 97
Loss on hold-out set: 0.0008319819812880413
MeanAbsoluteError value on hold-out data: 0.015784606337547302
Epoch: 98
Loss on hold-out set: 0.0009822005771351733
MeanAbsoluteError value on hold-out data: 0.01847892254590988
Epoch: 99
Loss on hold-out set: 0.0008506002369885161
MeanAbsoluteError value on hold-out data: 0.019930128008127213
Epoch: 100
Loss on hold-out set: 0.0008093564314262231
MeanAbsoluteError value on hold-out data: 0.017357049509882927
Epoch: 101
Loss on hold-out set: 0.0007972330631195004
MeanAbsoluteError value on hold-out data: 0.01869777962565422
Epoch: 102
Loss on hold-out set: 0.0011079377049770158
MeanAbsoluteError value on hold-out data: 0.02350262925028801
Epoch: 103
Loss on hold-out set: 0.0010125306438758823
MeanAbsoluteError value on hold-out data: 0.018013622611761093
Epoch: 104
Loss on hold-out set: 0.0013637990912110055
MeanAbsoluteError value on hold-out data: 0.02332695946097374
Epoch: 105
Loss on hold-out set: 0.001168774278611588
MeanAbsoluteError value on hold-out data: 0.021166857331991196
Epoch: 106
Loss on hold-out set: 0.0009269374731478532
MeanAbsoluteError value on hold-out data: 0.016145991161465645
Epoch: 107
Loss on hold-out set: 0.0007913705464345281
MeanAbsoluteError value on hold-out data: 0.01938728243112564
Epoch: 108
Loss on hold-out set: 0.0015565620081983262
MeanAbsoluteError value on hold-out data: 0.027045192196965218
Epoch: 109
Loss on hold-out set: 0.0007985431382047338
MeanAbsoluteError value on hold-out data: 0.014479786157608032
Epoch: 110
Loss on hold-out set: 0.0009049637628777418
MeanAbsoluteError value on hold-out data: 0.01750880293548107
Epoch: 111
Loss on hold-out set: 0.0009779362541226682
MeanAbsoluteError value on hold-out data: 0.019558217376470566
Epoch: 112
Loss on hold-out set: 0.0008730768138201185
MeanAbsoluteError value on hold-out data: 0.015267467126250267
Epoch: 113
Loss on hold-out set: 0.0010976014087454562
MeanAbsoluteError value on hold-out data: 0.024049298837780952
Epoch: 114
Loss on hold-out set: 0.0008934561399081232
MeanAbsoluteError value on hold-out data: 0.018748626112937927
Epoch: 115
Loss on hold-out set: 0.0009059734636952941
MeanAbsoluteError value on hold-out data: 0.017381804063916206
Epoch: 116
Loss on hold-out set: 0.0009456694750425461
MeanAbsoluteError value on hold-out data: 0.015450221486389637
Epoch: 117
Loss on hold-out set: 0.0008559604968085248
MeanAbsoluteError value on hold-out data: 0.018093138933181763
Epoch: 118
Loss on hold-out set: 0.0011500321653377461
MeanAbsoluteError value on hold-out data: 0.01842702366411686
Epoch: 119
Loss on hold-out set: 0.0016443471670898266
MeanAbsoluteError value on hold-out data: 0.025809625163674355
Epoch: 120
Loss on hold-out set: 0.0008532599901005405
MeanAbsoluteError value on hold-out data: 0.017671259120106697
Epoch: 121
Loss on hold-out set: 0.0007803316697582455
MeanAbsoluteError value on hold-out data: 0.021802084520459175
Epoch: 122
Loss on hold-out set: 0.0009863611916156706
MeanAbsoluteError value on hold-out data: 0.017773590981960297
Epoch: 123
Loss on hold-out set: 0.0008625416261278779
MeanAbsoluteError value on hold-out data: 0.018906623125076294
Epoch: 124
Loss on hold-out set: 0.001042159289538272
MeanAbsoluteError value on hold-out data: 0.025593243539333344
Epoch: 125
Loss on hold-out set: 0.0009518378915105897
MeanAbsoluteError value on hold-out data: 0.02502252347767353
Epoch: 126
Loss on hold-out set: 0.0012254581463486446
MeanAbsoluteError value on hold-out data: 0.02797635644674301
Epoch: 127
Loss on hold-out set: 0.0010380292256549613
MeanAbsoluteError value on hold-out data: 0.022079339250922203
Epoch: 128
Loss on hold-out set: 0.0014473315118505668
MeanAbsoluteError value on hold-out data: 0.026229791343212128
Epoch: 129
Loss on hold-out set: 0.0007388140585183129
MeanAbsoluteError value on hold-out data: 0.01450728252530098
Epoch: 130
Loss on hold-out set: 0.0007670707215622411
MeanAbsoluteError value on hold-out data: 0.021989163011312485
Epoch: 131
Loss on hold-out set: 0.0018713138141672396
MeanAbsoluteError value on hold-out data: 0.024265479296445847
Epoch: 132
Loss on hold-out set: 0.0008200697162752285
MeanAbsoluteError value on hold-out data: 0.01854056864976883
Epoch: 133
Loss on hold-out set: 0.0008772766098589177
MeanAbsoluteError value on hold-out data: 0.016485340893268585
Epoch: 134
Loss on hold-out set: 0.0009331129274295037
MeanAbsoluteError value on hold-out data: 0.01625039055943489
Epoch: 135
Loss on hold-out set: 0.001213749602404852
MeanAbsoluteError value on hold-out data: 0.020251106470823288
Epoch: 136
Loss on hold-out set: 0.0010861274587162036
MeanAbsoluteError value on hold-out data: 0.02702646516263485
Epoch: 137
Loss on hold-out set: 0.0008614430808895696
MeanAbsoluteError value on hold-out data: 0.016555970534682274
Epoch: 138
Loss on hold-out set: 0.0010532204047960572
MeanAbsoluteError value on hold-out data: 0.027851982042193413
Epoch: 139
Loss on hold-out set: 0.0014333974253723251
MeanAbsoluteError value on hold-out data: 0.0245602298527956
Epoch: 140
Loss on hold-out set: 0.0006837653731724315
MeanAbsoluteError value on hold-out data: 0.013753673061728477
Epoch: 141
Loss on hold-out set: 0.001989035076372889
MeanAbsoluteError value on hold-out data: 0.0294579416513443
Epoch: 142
Loss on hold-out set: 0.0011051947247228543
MeanAbsoluteError value on hold-out data: 0.016815349459648132
Epoch: 143
Loss on hold-out set: 0.0008270912766372356
MeanAbsoluteError value on hold-out data: 0.016951538622379303
Epoch: 144
Loss on hold-out set: 0.0012675262405537069
MeanAbsoluteError value on hold-out data: 0.031311824917793274
Epoch: 145
Loss on hold-out set: 0.0008394867623122225
MeanAbsoluteError value on hold-out data: 0.016255280002951622
Epoch: 146
Loss on hold-out set: 0.0017763025963703466
MeanAbsoluteError value on hold-out data: 0.02898319810628891
Epoch: 147
Loss on hold-out set: 0.000510814240681755
MeanAbsoluteError value on hold-out data: 0.016104035079479218
Epoch: 148
Loss on hold-out set: 0.0010861035169862014
MeanAbsoluteError value on hold-out data: 0.028449522331357002
Epoch: 149
Loss on hold-out set: 0.0009247376564369341
MeanAbsoluteError value on hold-out data: 0.019533416256308556
Epoch: 150
Loss on hold-out set: 0.001101378552879109
MeanAbsoluteError value on hold-out data: 0.023176409304142
Epoch: 151
Loss on hold-out set: 0.000790056335589677
MeanAbsoluteError value on hold-out data: 0.02040993608534336
Epoch: 152
Loss on hold-out set: 0.001011738192908907
MeanAbsoluteError value on hold-out data: 0.023053163662552834
Epoch: 153
Loss on hold-out set: 0.000992908074151369
MeanAbsoluteError value on hold-out data: 0.01803419180214405
Epoch: 154
Loss on hold-out set: 0.001123772417964861
MeanAbsoluteError value on hold-out data: 0.01624302752315998
Epoch: 155
Loss on hold-out set: 0.0014414401766292652
MeanAbsoluteError value on hold-out data: 0.02478768117725849
Epoch: 156
Loss on hold-out set: 0.0020096245536574556
MeanAbsoluteError value on hold-out data: 0.02475910261273384
Epoch: 157
Loss on hold-out set: 0.0006326897604786178
MeanAbsoluteError value on hold-out data: 0.018066711723804474
Epoch: 158
Loss on hold-out set: 0.0007402600768775875
MeanAbsoluteError value on hold-out data: 0.021794574335217476
Epoch: 159
Loss on hold-out set: 0.001510640198064625
MeanAbsoluteError value on hold-out data: 0.02529512159526348
Epoch: 160
Loss on hold-out set: 0.00049092810604634
MeanAbsoluteError value on hold-out data: 0.012548950500786304
Epoch: 161
Loss on hold-out set: 0.0012458769426877169
MeanAbsoluteError value on hold-out data: 0.0296879094094038
Epoch: 162
Loss on hold-out set: 0.0007276668779683716
MeanAbsoluteError value on hold-out data: 0.019761230796575546
Epoch: 163
Loss on hold-out set: 0.0010230255988732864
MeanAbsoluteError value on hold-out data: 0.02459089085459709
Epoch: 164
Loss on hold-out set: 0.0008274333507104434
MeanAbsoluteError value on hold-out data: 0.021663587540388107
Epoch: 165
Loss on hold-out set: 0.0009820198067341391
MeanAbsoluteError value on hold-out data: 0.021607903763651848
Epoch: 166
Loss on hold-out set: 0.0007717363053081116
MeanAbsoluteError value on hold-out data: 0.019785506650805473
Epoch: 167
Loss on hold-out set: 0.0007797292196061646
MeanAbsoluteError value on hold-out data: 0.01746124029159546
Epoch: 168
Loss on hold-out set: 0.0016345692136766094
MeanAbsoluteError value on hold-out data: 0.030497433617711067
Epoch: 169
Loss on hold-out set: 0.0010247202463736023
MeanAbsoluteError value on hold-out data: 0.02285393886268139
Epoch: 170
Loss on hold-out set: 0.0007607724719012989
MeanAbsoluteError value on hold-out data: 0.018340254202485085
Epoch: 171
Loss on hold-out set: 0.0006466468026031324
MeanAbsoluteError value on hold-out data: 0.016157099977135658
Epoch: 172
Loss on hold-out set: 0.0009591724699834901
MeanAbsoluteError value on hold-out data: 0.01929575763642788
Epoch: 173
Loss on hold-out set: 0.0011612461461673344
MeanAbsoluteError value on hold-out data: 0.02290435880422592
Epoch: 174
Loss on hold-out set: 0.0007153577918009097
MeanAbsoluteError value on hold-out data: 0.01965378038585186
Epoch: 175
Loss on hold-out set: 0.0014547327053534038
MeanAbsoluteError value on hold-out data: 0.018271712586283684
Epoch: 176
Loss on hold-out set: 0.001328886237292624
MeanAbsoluteError value on hold-out data: 0.02005106210708618
Epoch: 177
Loss on hold-out set: 0.0005227629046298956
MeanAbsoluteError value on hold-out data: 0.01687198504805565
Epoch: 178
Loss on hold-out set: 0.0008852142767098389
MeanAbsoluteError value on hold-out data: 0.02054457738995552
Epoch: 179
Loss on hold-out set: 0.0011510254239271347
MeanAbsoluteError value on hold-out data: 0.022542497143149376
Epoch: 180
Loss on hold-out set: 0.0011540032962664938
MeanAbsoluteError value on hold-out data: 0.019190074875950813
Epoch: 181
Loss on hold-out set: 0.0008691552877855046
MeanAbsoluteError value on hold-out data: 0.022765981033444405
Epoch: 182
Loss on hold-out set: 0.0006547413569550324
MeanAbsoluteError value on hold-out data: 0.017475230619311333
Epoch: 183
Loss on hold-out set: 0.0006174234172488612
MeanAbsoluteError value on hold-out data: 0.01611742004752159
Epoch: 184
Loss on hold-out set: 0.0010814277957730443
MeanAbsoluteError value on hold-out data: 0.015821019187569618
Epoch: 185
Loss on hold-out set: 0.0015768009532046946
MeanAbsoluteError value on hold-out data: 0.0363820344209671
Epoch: 186
Loss on hold-out set: 0.0007286107434801556
MeanAbsoluteError value on hold-out data: 0.016418717801570892
Epoch: 187
Loss on hold-out set: 0.0009700925487490359
MeanAbsoluteError value on hold-out data: 0.015750983729958534
Epoch: 188
Loss on hold-out set: 0.0007753540222486327
MeanAbsoluteError value on hold-out data: 0.014875832945108414
Epoch: 189
Loss on hold-out set: 0.0005445477575114254
MeanAbsoluteError value on hold-out data: 0.014902602881193161
Epoch: 190
Loss on hold-out set: 0.0005683777304320278
MeanAbsoluteError value on hold-out data: 0.01696825586259365
Epoch: 191
Loss on hold-out set: 0.0007217012841321871
MeanAbsoluteError value on hold-out data: 0.01865977793931961
Epoch: 192
Loss on hold-out set: 0.0005328516807295321
MeanAbsoluteError value on hold-out data: 0.012485149316489697
Epoch: 193
Loss on hold-out set: 0.0005022307364254773
MeanAbsoluteError value on hold-out data: 0.014049127697944641
Epoch: 194
Loss on hold-out set: 0.001413661797797479
MeanAbsoluteError value on hold-out data: 0.023190323263406754
Epoch: 195
Loss on hold-out set: 0.0007537538698862159
MeanAbsoluteError value on hold-out data: 0.018689138814806938
Epoch: 196
Loss on hold-out set: 0.0006913997180833432
MeanAbsoluteError value on hold-out data: 0.019226936623454094
Epoch: 197
Loss on hold-out set: 0.0011647030907241923
MeanAbsoluteError value on hold-out data: 0.02730339765548706
Epoch: 198
Loss on hold-out set: 0.0012715161033395959
MeanAbsoluteError value on hold-out data: 0.018603671342134476
Epoch: 199
Loss on hold-out set: 0.0016291038862522999
MeanAbsoluteError value on hold-out data: 0.02328997105360031
Epoch: 200
Loss on hold-out set: 0.0007450770461123044
MeanAbsoluteError value on hold-out data: 0.02268402650952339
Epoch: 201
Loss on hold-out set: 0.0011171812994258577
MeanAbsoluteError value on hold-out data: 0.024222716689109802
Epoch: 202
Loss on hold-out set: 0.001503780994282447
MeanAbsoluteError value on hold-out data: 0.035061802715063095
Epoch: 203
Loss on hold-out set: 0.0008973449886597289
MeanAbsoluteError value on hold-out data: 0.01700817421078682
Epoch: 204
Loss on hold-out set: 0.0010336266167494039
MeanAbsoluteError value on hold-out data: 0.01794266141951084
Epoch: 205
Loss on hold-out set: 0.0007475416204646248
MeanAbsoluteError value on hold-out data: 0.01589043065905571
Epoch: 206
Loss on hold-out set: 0.0007566149002071286
MeanAbsoluteError value on hold-out data: 0.015991443768143654
Epoch: 207
Loss on hold-out set: 0.0009116128496412115
MeanAbsoluteError value on hold-out data: 0.0205036923289299
Epoch: 208
Loss on hold-out set: 0.0009522884952036149
MeanAbsoluteError value on hold-out data: 0.01855071634054184
Epoch: 209
Loss on hold-out set: 0.0008501180407045851
MeanAbsoluteError value on hold-out data: 0.014591007493436337
Epoch: 210
Loss on hold-out set: 0.000854078079148741
MeanAbsoluteError value on hold-out data: 0.01891637034714222
Epoch: 211
Loss on hold-out set: 0.0006709620817290622
MeanAbsoluteError value on hold-out data: 0.013534147292375565
Epoch: 212
Loss on hold-out set: 0.0009428977527453466
MeanAbsoluteError value on hold-out data: 0.01999029889702797
Epoch: 213
Loss on hold-out set: 0.0011429838831597742
MeanAbsoluteError value on hold-out data: 0.018795384094119072
Epoch: 214
Loss on hold-out set: 0.0009853388316849688
MeanAbsoluteError value on hold-out data: 0.023184487596154213
Epoch: 215
Loss on hold-out set: 0.0005957854943852382
MeanAbsoluteError value on hold-out data: 0.020003516227006912
Epoch: 216
Loss on hold-out set: 0.0011800127052227158
MeanAbsoluteError value on hold-out data: 0.01904621720314026
Epoch: 217
Loss on hold-out set: 0.0008208259002314758
MeanAbsoluteError value on hold-out data: 0.01691437140107155
Epoch: 218
Loss on hold-out set: 0.00128123984770929
MeanAbsoluteError value on hold-out data: 0.014446103014051914
Epoch: 219
Loss on hold-out set: 0.0008140826811493179
MeanAbsoluteError value on hold-out data: 0.018715139478445053
Epoch: 220
Loss on hold-out set: 0.0008275264783725632
MeanAbsoluteError value on hold-out data: 0.01778794452548027
Epoch: 221
Loss on hold-out set: 0.0009250050260513825
MeanAbsoluteError value on hold-out data: 0.023805921897292137
Epoch: 222
Loss on hold-out set: 0.0008850373049330971
MeanAbsoluteError value on hold-out data: 0.01849074475467205
Epoch: 223
Loss on hold-out set: 0.0006401190062445638
MeanAbsoluteError value on hold-out data: 0.01631351001560688
Epoch: 224
Loss on hold-out set: 0.0007401748049520201
MeanAbsoluteError value on hold-out data: 0.02140040695667267
Epoch: 225
Loss on hold-out set: 0.0009011808018074493
MeanAbsoluteError value on hold-out data: 0.017929954454302788
Epoch: 226
Loss on hold-out set: 0.0010721380125400365
MeanAbsoluteError value on hold-out data: 0.024259572848677635
Epoch: 227
Loss on hold-out set: 0.0005527072406900851
MeanAbsoluteError value on hold-out data: 0.017721697688102722
Epoch: 228
Loss on hold-out set: 0.000720137354954587
MeanAbsoluteError value on hold-out data: 0.0192659143358469
Epoch: 229
Loss on hold-out set: 0.0014357345585746149
MeanAbsoluteError value on hold-out data: 0.017607372254133224
Epoch: 230
Loss on hold-out set: 0.0012467034954936121
MeanAbsoluteError value on hold-out data: 0.02427545003592968
Epoch: 231
Loss on hold-out set: 0.001313460978532308
MeanAbsoluteError value on hold-out data: 0.02660737745463848
Epoch: 232
Loss on hold-out set: 0.0014072700471029077
MeanAbsoluteError value on hold-out data: 0.03338927403092384
Epoch: 233
Loss on hold-out set: 0.0008754619737278278
MeanAbsoluteError value on hold-out data: 0.017422733828425407
Epoch: 234
Loss on hold-out set: 0.0007861087192156303
MeanAbsoluteError value on hold-out data: 0.021192653104662895
Epoch: 235
Loss on hold-out set: 0.0012344383350481574
MeanAbsoluteError value on hold-out data: 0.01987089402973652
Epoch: 236
Loss on hold-out set: 0.0008444702400179507
MeanAbsoluteError value on hold-out data: 0.01814340613782406
Epoch: 237
Loss on hold-out set: 0.0009787517755237211
MeanAbsoluteError value on hold-out data: 0.020442508161067963
Epoch: 238
Loss on hold-out set: 0.0011817063576400916
MeanAbsoluteError value on hold-out data: 0.02320762723684311
Epoch: 239
Loss on hold-out set: 0.001082988851090991
MeanAbsoluteError value on hold-out data: 0.024536674842238426
Epoch: 240
Loss on hold-out set: 0.0007806110334058758
MeanAbsoluteError value on hold-out data: 0.019262371584773064
Epoch: 241
Loss on hold-out set: 0.0008707928944587413
MeanAbsoluteError value on hold-out data: 0.01707576774060726
Epoch: 242
Loss on hold-out set: 0.0007437259109313967
MeanAbsoluteError value on hold-out data: 0.01610283926129341
Epoch: 243
Loss on hold-out set: 0.0015474638593763015
MeanAbsoluteError value on hold-out data: 0.02802073210477829
Epoch: 244
Loss on hold-out set: 0.0007594381229290249
MeanAbsoluteError value on hold-out data: 0.016122031956911087
Epoch: 245
Loss on hold-out set: 0.000708014525152497
MeanAbsoluteError value on hold-out data: 0.013117236085236073
Epoch: 246
Loss on hold-out set: 0.0007672504955400271
MeanAbsoluteError value on hold-out data: 0.02330724149942398
Epoch: 247
Loss on hold-out set: 0.0011185601793649287
MeanAbsoluteError value on hold-out data: 0.020699501037597656
Epoch: 248
Loss on hold-out set: 0.0008975524320512226
MeanAbsoluteError value on hold-out data: 0.026219060644507408
Epoch: 249
Loss on hold-out set: 0.000856941207817535
MeanAbsoluteError value on hold-out data: 0.017862368375062943
Epoch: 250
Loss on hold-out set: 0.0007867871667928595
MeanAbsoluteError value on hold-out data: 0.017010683193802834
Epoch: 251
Loss on hold-out set: 0.0012356097147283819
MeanAbsoluteError value on hold-out data: 0.019261322915554047
Epoch: 252
Loss on hold-out set: 0.0011276498277622618
MeanAbsoluteError value on hold-out data: 0.03001072257757187
Epoch: 253
Loss on hold-out set: 0.0011032911812722695
MeanAbsoluteError value on hold-out data: 0.01936260238289833
Epoch: 254
Loss on hold-out set: 0.0012145904857118837
MeanAbsoluteError value on hold-out data: 0.017925551161170006
Epoch: 255
Loss on hold-out set: 0.0005494049630789576
MeanAbsoluteError value on hold-out data: 0.018647484481334686
Epoch: 256
Loss on hold-out set: 0.0007570414401063891
MeanAbsoluteError value on hold-out data: 0.016359366476535797
Epoch: 257
Loss on hold-out set: 0.0008033461557428573
MeanAbsoluteError value on hold-out data: 0.018471797928214073
Epoch: 258
Loss on hold-out set: 0.0009508877921785155
MeanAbsoluteError value on hold-out data: 0.01953043043613434
Epoch: 259
Loss on hold-out set: 0.0010523532180645577
MeanAbsoluteError value on hold-out data: 0.020089469850063324
Epoch: 260
Loss on hold-out set: 0.000637434429671358
MeanAbsoluteError value on hold-out data: 0.01370182540267706
Epoch: 261
Loss on hold-out set: 0.0007504445077900432
MeanAbsoluteError value on hold-out data: 0.014895165339112282
Epoch: 262
Loss on hold-out set: 0.0010141649097357387
MeanAbsoluteError value on hold-out data: 0.021712612360715866
Epoch: 263
Loss on hold-out set: 0.0007122533501579279
MeanAbsoluteError value on hold-out data: 0.01894855685532093
Epoch: 264
Loss on hold-out set: 0.0007666771526649091
MeanAbsoluteError value on hold-out data: 0.01649332605302334
Epoch: 265
Loss on hold-out set: 0.0009240143944177697
MeanAbsoluteError value on hold-out data: 0.016537943854928017
Epoch: 266
Loss on hold-out set: 0.0013004730809418681
MeanAbsoluteError value on hold-out data: 0.026984723284840584
Epoch: 267
Loss on hold-out set: 0.0007574292074806229
MeanAbsoluteError value on hold-out data: 0.014302819967269897
Epoch: 268
Loss on hold-out set: 0.0013638711690490662
MeanAbsoluteError value on hold-out data: 0.018804457038640976
Epoch: 269
Loss on hold-out set: 0.0009784657530345659
MeanAbsoluteError value on hold-out data: 0.01951296254992485
Epoch: 270
Loss on hold-out set: 0.0008625251165971062
MeanAbsoluteError value on hold-out data: 0.017778949812054634
Epoch: 271
Loss on hold-out set: 0.0009494675239119189
MeanAbsoluteError value on hold-out data: 0.021630434319376945
Epoch: 272
Loss on hold-out set: 0.000725137168525467
MeanAbsoluteError value on hold-out data: 0.01690117083489895
Epoch: 273
Loss on hold-out set: 0.0008819006800063347
MeanAbsoluteError value on hold-out data: 0.019826514646410942
Epoch: 274
Loss on hold-out set: 0.0007108380277235195
MeanAbsoluteError value on hold-out data: 0.017181986942887306
Epoch: 275
Loss on hold-out set: 0.0009957298036744376
MeanAbsoluteError value on hold-out data: 0.020927608013153076
Epoch: 276
Loss on hold-out set: 0.0005450537585267356
MeanAbsoluteError value on hold-out data: 0.01875213533639908
Epoch: 277
Loss on hold-out set: 0.0006007655172078031
MeanAbsoluteError value on hold-out data: 0.01427771057933569
Epoch: 278
Loss on hold-out set: 0.0007577170232599727
MeanAbsoluteError value on hold-out data: 0.015772391110658646
Epoch: 279
Loss on hold-out set: 0.0012865527946575497
MeanAbsoluteError value on hold-out data: 0.03253914788365364
Epoch: 280
Loss on hold-out set: 0.0007995024643605575
MeanAbsoluteError value on hold-out data: 0.021569320932030678
Epoch: 281
Loss on hold-out set: 0.001088885336158503
MeanAbsoluteError value on hold-out data: 0.019375402480363846
Epoch: 282
Loss on hold-out set: 0.0008450561998822531
MeanAbsoluteError value on hold-out data: 0.01836215890944004
Epoch: 283
Loss on hold-out set: 0.0008555904653468659
MeanAbsoluteError value on hold-out data: 0.018158335238695145
Epoch: 284
Loss on hold-out set: 0.0010994404391998327
MeanAbsoluteError value on hold-out data: 0.020768236368894577
Epoch: 285
Loss on hold-out set: 0.0014180827473817196
MeanAbsoluteError value on hold-out data: 0.03364099934697151
Epoch: 286
Loss on hold-out set: 0.0007701349922602898
MeanAbsoluteError value on hold-out data: 0.02357013151049614
Epoch: 287
Loss on hold-out set: 0.0006415556249282274
MeanAbsoluteError value on hold-out data: 0.017577670514583588
Epoch: 288
Loss on hold-out set: 0.0006857007820623327
MeanAbsoluteError value on hold-out data: 0.015334496274590492
Early stopping at epoch 287
Returned to Spot: Validation loss: 0.0006857007820623327
----------------------------------------------
spotPython tuning: 0.0006857007820623327 [#---------] 9.23% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 8, 'dropout_prob': 0.024036264668299723, 'lr_mult': 7.731060508215689, 'batch_size': 8, 'epochs': 16384, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adam', 'sgd_momentum': 0.9704168242047014}
Epoch: 1
Loss on hold-out set: 0.02640691970622069
MeanAbsoluteError value on hold-out data: 0.12451178580522537
Epoch: 2
Loss on hold-out set: 0.027339773509945525
MeanAbsoluteError value on hold-out data: 0.12846025824546814
Epoch: 3
Loss on hold-out set: 0.023217814631367985
MeanAbsoluteError value on hold-out data: 0.11957070976495743
Epoch: 4
Loss on hold-out set: 0.02041462207164027
MeanAbsoluteError value on hold-out data: 0.11092531681060791
Epoch: 5
Loss on hold-out set: 0.02409820909317779
MeanAbsoluteError value on hold-out data: 0.11483918875455856
Epoch: 6
Loss on hold-out set: 0.01530332715667196
MeanAbsoluteError value on hold-out data: 0.09112168103456497
Epoch: 7
Loss on hold-out set: 0.013136999902168387
MeanAbsoluteError value on hold-out data: 0.08544319868087769
Epoch: 8
Loss on hold-out set: 0.009323827671132198
MeanAbsoluteError value on hold-out data: 0.0693342313170433
Epoch: 9
Loss on hold-out set: 0.012885821015132885
MeanAbsoluteError value on hold-out data: 0.07316023856401443
Epoch: 10
Loss on hold-out set: 0.009356001969488142
MeanAbsoluteError value on hold-out data: 0.059524454176425934
Epoch: 11
Loss on hold-out set: 0.005872901601833291
MeanAbsoluteError value on hold-out data: 0.04737663269042969
Epoch: 12
Loss on hold-out set: 0.004536248987470141
MeanAbsoluteError value on hold-out data: 0.03669152408838272
Epoch: 13
Loss on hold-out set: 0.004045655399462895
MeanAbsoluteError value on hold-out data: 0.033141687512397766
Epoch: 14
Loss on hold-out set: 0.006430256778242581
MeanAbsoluteError value on hold-out data: 0.033856600522994995
Epoch: 15
Loss on hold-out set: 0.0028724897185479917
MeanAbsoluteError value on hold-out data: 0.02568945102393627
Epoch: 16
Loss on hold-out set: 0.003561960863360008
MeanAbsoluteError value on hold-out data: 0.03083386830985546
Epoch: 17
Loss on hold-out set: 0.005014034729499958
MeanAbsoluteError value on hold-out data: 0.054632510989904404
Epoch: 18
Loss on hold-out set: 0.00639349023051756
MeanAbsoluteError value on hold-out data: 0.037283726036548615
Epoch: 19
Loss on hold-out set: 0.0035223141865954907
MeanAbsoluteError value on hold-out data: 0.021245768293738365
Epoch: 20
Loss on hold-out set: 0.0028596019841356075
MeanAbsoluteError value on hold-out data: 0.018467847257852554
Epoch: 21
Loss on hold-out set: 0.00450955231893826
MeanAbsoluteError value on hold-out data: 0.02442340925335884
Epoch: 22
Loss on hold-out set: 0.003305796511037778
MeanAbsoluteError value on hold-out data: 0.021255381405353546
Epoch: 23
Loss on hold-out set: 0.005833523421451422
MeanAbsoluteError value on hold-out data: 0.025321194902062416
Epoch: 24
Loss on hold-out set: 0.0026039546462829763
MeanAbsoluteError value on hold-out data: 0.033870622515678406
Epoch: 25
Loss on hold-out set: 0.003350830383121655
MeanAbsoluteError value on hold-out data: 0.023239251226186752
Epoch: 26
Loss on hold-out set: 0.0024959438791914805
MeanAbsoluteError value on hold-out data: 0.01759262941777706
Epoch: 27
Loss on hold-out set: 0.0036192634811742976
MeanAbsoluteError value on hold-out data: 0.017494134604930878
Epoch: 28
Loss on hold-out set: 0.003372658153921293
MeanAbsoluteError value on hold-out data: 0.02015012688934803
Epoch: 29
Loss on hold-out set: 0.0024601305179825623
MeanAbsoluteError value on hold-out data: 0.017636975273489952
Epoch: 30
Loss on hold-out set: 0.0037990386818388573
MeanAbsoluteError value on hold-out data: 0.04200040549039841
Epoch: 31
Loss on hold-out set: 0.0025257361653769437
MeanAbsoluteError value on hold-out data: 0.019270312041044235
Epoch: 32
Loss on hold-out set: 0.001558228964217721
MeanAbsoluteError value on hold-out data: 0.013707596808671951
Epoch: 33
Loss on hold-out set: 0.003795695579092832
MeanAbsoluteError value on hold-out data: 0.017939677461981773
Epoch: 34
Loss on hold-out set: 0.0028393279507757767
MeanAbsoluteError value on hold-out data: 0.016462046653032303
Epoch: 35
Loss on hold-out set: 0.0024692483695951907
MeanAbsoluteError value on hold-out data: 0.01903846673667431
Epoch: 36
Loss on hold-out set: 0.0029509482102950736
MeanAbsoluteError value on hold-out data: 0.016994623467326164
Epoch: 37
Loss on hold-out set: 0.002201988411941688
MeanAbsoluteError value on hold-out data: 0.015088542364537716
Epoch: 38
Loss on hold-out set: 0.0035394744596774935
MeanAbsoluteError value on hold-out data: 0.03412556275725365
Epoch: 39
Loss on hold-out set: 0.0013502683638618787
MeanAbsoluteError value on hold-out data: 0.013538610190153122
Epoch: 40
Loss on hold-out set: 0.0016879663621933248
MeanAbsoluteError value on hold-out data: 0.014124802313745022
Epoch: 41
Loss on hold-out set: 0.0014462275559804095
MeanAbsoluteError value on hold-out data: 0.015457088127732277
Epoch: 42
Loss on hold-out set: 0.0019514761324420473
MeanAbsoluteError value on hold-out data: 0.030240068212151527
Epoch: 43
Loss on hold-out set: 0.002302777186023856
MeanAbsoluteError value on hold-out data: 0.02156890742480755
Epoch: 44
Loss on hold-out set: 0.001618360096328711
MeanAbsoluteError value on hold-out data: 0.014773906208574772
Epoch: 45
Loss on hold-out set: 0.001876236842546955
MeanAbsoluteError value on hold-out data: 0.027464717626571655
Epoch: 46
Loss on hold-out set: 0.0024652912888038707
MeanAbsoluteError value on hold-out data: 0.03323063626885414
Epoch: 47
Loss on hold-out set: 0.002695489760586306
MeanAbsoluteError value on hold-out data: 0.022617027163505554
Epoch: 48
Loss on hold-out set: 0.0034473547156697974
MeanAbsoluteError value on hold-out data: 0.027808405458927155
Epoch: 49
Loss on hold-out set: 0.0017356641144368424
MeanAbsoluteError value on hold-out data: 0.014965192414820194
Epoch: 50
Loss on hold-out set: 0.0016453706402420434
MeanAbsoluteError value on hold-out data: 0.014263366349041462
Epoch: 51
Loss on hold-out set: 0.002796868997393176
MeanAbsoluteError value on hold-out data: 0.030424267053604126
Epoch: 52
Loss on hold-out set: 0.0019379066599963391
MeanAbsoluteError value on hold-out data: 0.018834233283996582
Epoch: 53
Loss on hold-out set: 0.0028884956533913376
MeanAbsoluteError value on hold-out data: 0.02250106818974018
Epoch: 54
Loss on hold-out set: 0.003281046272796199
MeanAbsoluteError value on hold-out data: 0.026657911017537117
Epoch: 55
Loss on hold-out set: 0.0018130312503336953
MeanAbsoluteError value on hold-out data: 0.019100606441497803
Epoch: 56
Loss on hold-out set: 0.00443669056684676
MeanAbsoluteError value on hold-out data: 0.019428979605436325
Epoch: 57
Loss on hold-out set: 0.0014738647215907757
MeanAbsoluteError value on hold-out data: 0.01515605952590704
Epoch: 58
Loss on hold-out set: 0.0027521805983556796
MeanAbsoluteError value on hold-out data: 0.018389545381069183
Epoch: 59
Loss on hold-out set: 0.0014635148794408643
MeanAbsoluteError value on hold-out data: 0.02220306545495987
Epoch: 60
Loss on hold-out set: 0.0041009439798807236
MeanAbsoluteError value on hold-out data: 0.05066405609250069
Epoch: 61
Loss on hold-out set: 0.0013078366959785182
MeanAbsoluteError value on hold-out data: 0.011999215930700302
Epoch: 62
Loss on hold-out set: 0.0014414376314921117
MeanAbsoluteError value on hold-out data: 0.013210199773311615
Epoch: 63
Loss on hold-out set: 0.002399350388977358
MeanAbsoluteError value on hold-out data: 0.0175803080201149
Epoch: 64
Loss on hold-out set: 0.0009135809832813672
MeanAbsoluteError value on hold-out data: 0.009819001890718937
Epoch: 65
Loss on hold-out set: 0.0016193608806277457
MeanAbsoluteError value on hold-out data: 0.011949238367378712
Epoch: 66
Loss on hold-out set: 0.002688804402408239
MeanAbsoluteError value on hold-out data: 0.02802226133644581
Epoch: 67
Loss on hold-out set: 0.0016208023585261942
MeanAbsoluteError value on hold-out data: 0.013866772875189781
Epoch: 68
Loss on hold-out set: 0.0017967372904853331
MeanAbsoluteError value on hold-out data: 0.02050972543656826
Epoch: 69
Loss on hold-out set: 0.0012109861444945349
MeanAbsoluteError value on hold-out data: 0.01732727326452732
Epoch: 70
Loss on hold-out set: 0.0026256531656192812
MeanAbsoluteError value on hold-out data: 0.028307316824793816
Epoch: 71
Loss on hold-out set: 0.002294521822501625
MeanAbsoluteError value on hold-out data: 0.016516519710421562
Epoch: 72
Loss on hold-out set: 0.0020445562105650375
MeanAbsoluteError value on hold-out data: 0.03154138848185539
Epoch: 73
Loss on hold-out set: 0.0016564875950280111
MeanAbsoluteError value on hold-out data: 0.020370488986372948
Epoch: 74
Loss on hold-out set: 0.0010228363540878299
MeanAbsoluteError value on hold-out data: 0.017845742404460907
Epoch: 75
Loss on hold-out set: 0.0014362448420893327
MeanAbsoluteError value on hold-out data: 0.01407303474843502
Epoch: 76
Loss on hold-out set: 0.0015738690612794783
MeanAbsoluteError value on hold-out data: 0.01469760574400425
Epoch: 77
Loss on hold-out set: 0.0010601720071128128
MeanAbsoluteError value on hold-out data: 0.015563247725367546
Epoch: 78
Loss on hold-out set: 0.0015547814331703673
MeanAbsoluteError value on hold-out data: 0.02992154471576214
Epoch: 79
Loss on hold-out set: 0.00225239247160253
MeanAbsoluteError value on hold-out data: 0.025128163397312164
Epoch: 80
Loss on hold-out set: 0.0015478321251736673
MeanAbsoluteError value on hold-out data: 0.015858907252550125
Epoch: 81
Loss on hold-out set: 0.00240235944970903
MeanAbsoluteError value on hold-out data: 0.03765995427966118
Epoch: 82
Loss on hold-out set: 0.002662844012344354
MeanAbsoluteError value on hold-out data: 0.0391177199780941
Epoch: 83
Loss on hold-out set: 0.0014137342603996665
MeanAbsoluteError value on hold-out data: 0.020349346101284027
Epoch: 84
Loss on hold-out set: 0.0018976628024048342
MeanAbsoluteError value on hold-out data: 0.02054586634039879
Epoch: 85
Loss on hold-out set: 0.0017727196346688863
MeanAbsoluteError value on hold-out data: 0.01545705646276474
Epoch: 86
Loss on hold-out set: 0.0030369129292107814
MeanAbsoluteError value on hold-out data: 0.02273758500814438
Epoch: 87
Loss on hold-out set: 0.0014555592536716606
MeanAbsoluteError value on hold-out data: 0.013844829052686691
Epoch: 88
Loss on hold-out set: 0.0011476963402521122
MeanAbsoluteError value on hold-out data: 0.012188035994768143
Epoch: 89
Loss on hold-out set: 0.0011170559075349285
MeanAbsoluteError value on hold-out data: 0.013744697906076908
Epoch: 90
Loss on hold-out set: 0.0017142886857096815
MeanAbsoluteError value on hold-out data: 0.015276440419256687
Epoch: 91
Loss on hold-out set: 0.0015314644199526427
MeanAbsoluteError value on hold-out data: 0.02398780547082424
Epoch: 92
Loss on hold-out set: 0.0013611235752872936
MeanAbsoluteError value on hold-out data: 0.013655777089297771
Epoch: 93
Loss on hold-out set: 0.0009273870682112541
MeanAbsoluteError value on hold-out data: 0.013177004642784595
Epoch: 94
Loss on hold-out set: 0.0014030639877570426
MeanAbsoluteError value on hold-out data: 0.018650172278285027
Epoch: 95
Loss on hold-out set: 0.0036105579990697535
MeanAbsoluteError value on hold-out data: 0.05367361754179001
Epoch: 96
Loss on hold-out set: 0.0021019766260762574
MeanAbsoluteError value on hold-out data: 0.024052979424595833
Epoch: 97
Loss on hold-out set: 0.0023593551725896666
MeanAbsoluteError value on hold-out data: 0.019606294110417366
Epoch: 98
Loss on hold-out set: 0.0013990846088183006
MeanAbsoluteError value on hold-out data: 0.012459957972168922
Epoch: 99
Loss on hold-out set: 0.0013969328203744993
MeanAbsoluteError value on hold-out data: 0.01212336029857397
Epoch: 100
Loss on hold-out set: 0.001205490671916203
MeanAbsoluteError value on hold-out data: 0.022626133635640144
Epoch: 101
Loss on hold-out set: 0.0013080036470982076
MeanAbsoluteError value on hold-out data: 0.01681026816368103
Epoch: 102
Loss on hold-out set: 0.0023900972243465824
MeanAbsoluteError value on hold-out data: 0.023730285465717316
Epoch: 103
Loss on hold-out set: 0.0018056921873817612
MeanAbsoluteError value on hold-out data: 0.02786230482161045
Epoch: 104
Loss on hold-out set: 0.0009437581166869341
MeanAbsoluteError value on hold-out data: 0.010418960824608803
Epoch: 105
Loss on hold-out set: 0.001220450206969154
MeanAbsoluteError value on hold-out data: 0.016690334305167198
Epoch: 106
Loss on hold-out set: 0.000998213419447175
MeanAbsoluteError value on hold-out data: 0.01669078692793846
Epoch: 107
Loss on hold-out set: 0.0021599195874602486
MeanAbsoluteError value on hold-out data: 0.020174261182546616
Epoch: 108
Loss on hold-out set: 0.0024825100945714725
MeanAbsoluteError value on hold-out data: 0.017130661755800247
Epoch: 109
Loss on hold-out set: 0.001611950717400951
MeanAbsoluteError value on hold-out data: 0.015156718902289867
Epoch: 110
Loss on hold-out set: 0.002183311501683324
MeanAbsoluteError value on hold-out data: 0.027319718152284622
Epoch: 111
Loss on hold-out set: 0.0007865177469380127
MeanAbsoluteError value on hold-out data: 0.014744510874152184
Epoch: 112
Loss on hold-out set: 0.002131992405207041
MeanAbsoluteError value on hold-out data: 0.01641429215669632
Epoch: 113
Loss on hold-out set: 0.0016734967748083076
MeanAbsoluteError value on hold-out data: 0.02219948172569275
Epoch: 114
Loss on hold-out set: 0.0025224845632548843
MeanAbsoluteError value on hold-out data: 0.016791457310318947
Epoch: 115
Loss on hold-out set: 0.0010592355072755087
MeanAbsoluteError value on hold-out data: 0.013338111340999603
Epoch: 116
Loss on hold-out set: 0.001975862088760263
MeanAbsoluteError value on hold-out data: 0.03662485256791115
Epoch: 117
Loss on hold-out set: 0.0020433763830193415
MeanAbsoluteError value on hold-out data: 0.02540547214448452
Epoch: 118
Loss on hold-out set: 0.0024194870164041945
MeanAbsoluteError value on hold-out data: 0.030277160927653313
Epoch: 119
Loss on hold-out set: 0.001218493297385162
MeanAbsoluteError value on hold-out data: 0.018222607672214508
Epoch: 120
Loss on hold-out set: 0.0028245025406297493
MeanAbsoluteError value on hold-out data: 0.041821952909231186
Epoch: 121
Loss on hold-out set: 0.0020763210298259524
MeanAbsoluteError value on hold-out data: 0.014381904155015945
Epoch: 122
Loss on hold-out set: 0.0008818446084133987
MeanAbsoluteError value on hold-out data: 0.013451778329908848
Epoch: 123
Loss on hold-out set: 0.001493016378318364
MeanAbsoluteError value on hold-out data: 0.017288004979491234
Epoch: 124
Loss on hold-out set: 0.0024594307726242973
MeanAbsoluteError value on hold-out data: 0.026355748996138573
Epoch: 125
Loss on hold-out set: 0.0016816145196475861
MeanAbsoluteError value on hold-out data: 0.015717441216111183
Epoch: 126
Loss on hold-out set: 0.0010789309962523188
MeanAbsoluteError value on hold-out data: 0.012350756675004959
Epoch: 127
Loss on hold-out set: 0.0012692568521551469
MeanAbsoluteError value on hold-out data: 0.021140115335583687
Epoch: 128
Loss on hold-out set: 0.002521748491170384
MeanAbsoluteError value on hold-out data: 0.01672418601810932
Epoch: 129
Loss on hold-out set: 0.001039592849003001
MeanAbsoluteError value on hold-out data: 0.010958647355437279
Epoch: 130
Loss on hold-out set: 0.002081172128351969
MeanAbsoluteError value on hold-out data: 0.024109594523906708
Epoch: 131
Loss on hold-out set: 0.00263164207449575
MeanAbsoluteError value on hold-out data: 0.042124949395656586
Epoch: 132
Loss on hold-out set: 0.0018346633554947882
MeanAbsoluteError value on hold-out data: 0.013912621885538101
Epoch: 133
Loss on hold-out set: 0.008304499592141886
MeanAbsoluteError value on hold-out data: 0.08936791121959686
Epoch: 134
Loss on hold-out set: 0.0018064061129591305
MeanAbsoluteError value on hold-out data: 0.020794015377759933
Epoch: 135
Loss on hold-out set: 0.0021035779904387277
MeanAbsoluteError value on hold-out data: 0.019345734268426895
Epoch: 136
Loss on hold-out set: 0.0010998943291724572
MeanAbsoluteError value on hold-out data: 0.010602744296193123
Epoch: 137
Loss on hold-out set: 0.0011124188370702445
MeanAbsoluteError value on hold-out data: 0.022022945806384087
Epoch: 138
Loss on hold-out set: 0.0008020968441422539
MeanAbsoluteError value on hold-out data: 0.011816074140369892
Epoch: 139
Loss on hold-out set: 0.002375083713846643
MeanAbsoluteError value on hold-out data: 0.017869526520371437
Epoch: 140
Loss on hold-out set: 0.0024146230207406916
MeanAbsoluteError value on hold-out data: 0.022097362205386162
Epoch: 141
Loss on hold-out set: 0.002000401263390622
MeanAbsoluteError value on hold-out data: 0.015329981222748756
Epoch: 142
Loss on hold-out set: 0.0021973642962237997
MeanAbsoluteError value on hold-out data: 0.017274366691708565
Epoch: 143
Loss on hold-out set: 0.0015703871433384177
MeanAbsoluteError value on hold-out data: 0.019890792667865753
Epoch: 144
Loss on hold-out set: 0.0036267433503158635
MeanAbsoluteError value on hold-out data: 0.02487257681787014
Epoch: 145
Loss on hold-out set: 0.00272115662485368
MeanAbsoluteError value on hold-out data: 0.014276565052568913
Epoch: 146
Loss on hold-out set: 0.002041618828415219
MeanAbsoluteError value on hold-out data: 0.015496465377509594
Epoch: 147
Loss on hold-out set: 0.002863285526951873
MeanAbsoluteError value on hold-out data: 0.04190680384635925
Epoch: 148
Loss on hold-out set: 0.0012481882026086648
MeanAbsoluteError value on hold-out data: 0.016744891181588173
Epoch: 149
Loss on hold-out set: 0.0015911118442473754
MeanAbsoluteError value on hold-out data: 0.015862073749303818
Epoch: 150
Loss on hold-out set: 0.0013639808653052616
MeanAbsoluteError value on hold-out data: 0.01156170479953289
Epoch: 151
Loss on hold-out set: 0.0016286870155262907
MeanAbsoluteError value on hold-out data: 0.022451259195804596
Epoch: 152
Loss on hold-out set: 0.0018077212668303172
MeanAbsoluteError value on hold-out data: 0.016231661662459373
Epoch: 153
Loss on hold-out set: 0.002037406002943355
MeanAbsoluteError value on hold-out data: 0.028418054804205894
Epoch: 154
Loss on hold-out set: 0.0012289109656290077
MeanAbsoluteError value on hold-out data: 0.01824585720896721
Epoch: 155
Loss on hold-out set: 0.0025744951011514978
MeanAbsoluteError value on hold-out data: 0.03655066341161728
Epoch: 156
Loss on hold-out set: 0.0013693800559083588
MeanAbsoluteError value on hold-out data: 0.022868633270263672
Epoch: 157
Loss on hold-out set: 0.00223481256407946
MeanAbsoluteError value on hold-out data: 0.017248280346393585
Epoch: 158
Loss on hold-out set: 0.0014862223944969867
MeanAbsoluteError value on hold-out data: 0.021929800510406494
Epoch: 159
Loss on hold-out set: 0.002265996823888073
MeanAbsoluteError value on hold-out data: 0.014499667100608349
Epoch: 160
Loss on hold-out set: 0.0015696235654295858
MeanAbsoluteError value on hold-out data: 0.015202967450022697
Epoch: 161
Loss on hold-out set: 0.0013633958854035498
MeanAbsoluteError value on hold-out data: 0.01968979649245739
Epoch: 162
Loss on hold-out set: 0.00205115474665562
MeanAbsoluteError value on hold-out data: 0.029735825955867767
Epoch: 163
Loss on hold-out set: 0.0012736380942538073
MeanAbsoluteError value on hold-out data: 0.01485538762062788
Epoch: 164
Loss on hold-out set: 0.0009023712675690675
MeanAbsoluteError value on hold-out data: 0.012499869801104069
Epoch: 165
Loss on hold-out set: 0.0026826455895819605
MeanAbsoluteError value on hold-out data: 0.019110796973109245
Epoch: 166
Loss on hold-out set: 0.0015999415692548563
MeanAbsoluteError value on hold-out data: 0.019774822518229485
Epoch: 167
Loss on hold-out set: 0.0017274346793879215
MeanAbsoluteError value on hold-out data: 0.03178513050079346
Epoch: 168
Loss on hold-out set: 0.0014565740388757388
MeanAbsoluteError value on hold-out data: 0.013438411988317966
Epoch: 169
Loss on hold-out set: 0.0018650763740879484
MeanAbsoluteError value on hold-out data: 0.01810731552541256
Epoch: 170
Loss on hold-out set: 0.002378726569938743
MeanAbsoluteError value on hold-out data: 0.025788430124521255
Epoch: 171
Loss on hold-out set: 0.0021108088334777244
MeanAbsoluteError value on hold-out data: 0.03438751399517059
Epoch: 172
Loss on hold-out set: 0.0014772901979271363
MeanAbsoluteError value on hold-out data: 0.011139103211462498
Epoch: 173
Loss on hold-out set: 0.0008914545480940049
MeanAbsoluteError value on hold-out data: 0.01971271261572838
Epoch: 174
Loss on hold-out set: 0.0019284519703911716
MeanAbsoluteError value on hold-out data: 0.022294119000434875
Epoch: 175
Loss on hold-out set: 0.0019673637863745264
MeanAbsoluteError value on hold-out data: 0.01374316681176424
Epoch: 176
Loss on hold-out set: 0.0013069293554029795
MeanAbsoluteError value on hold-out data: 0.018310368061065674
Epoch: 177
Loss on hold-out set: 0.0007087985655552506
MeanAbsoluteError value on hold-out data: 0.011518538929522038
Epoch: 178
Loss on hold-out set: 0.001619494132587294
MeanAbsoluteError value on hold-out data: 0.01954810880124569
Epoch: 179
Loss on hold-out set: 0.0018724249553327497
MeanAbsoluteError value on hold-out data: 0.022433893755078316
Epoch: 180
Loss on hold-out set: 0.0006753814783510997
MeanAbsoluteError value on hold-out data: 0.019433680921792984
Epoch: 181
Loss on hold-out set: 0.0015584686135346267
MeanAbsoluteError value on hold-out data: 0.02384176105260849
Epoch: 182
Loss on hold-out set: 0.0014387953794994246
MeanAbsoluteError value on hold-out data: 0.012691063806414604
Epoch: 183
Loss on hold-out set: 0.0015445478270282222
MeanAbsoluteError value on hold-out data: 0.013840700499713421
Epoch: 184
Loss on hold-out set: 0.0014533010690731892
MeanAbsoluteError value on hold-out data: 0.016946477815508842
Epoch: 185
Loss on hold-out set: 0.0021287681639047436
MeanAbsoluteError value on hold-out data: 0.032801590859889984
Epoch: 186
Loss on hold-out set: 0.0015608792311085334
MeanAbsoluteError value on hold-out data: 0.012795803137123585
Epoch: 187
Loss on hold-out set: 0.0017754302994274582
MeanAbsoluteError value on hold-out data: 0.031611405313014984
Epoch: 188
Loss on hold-out set: 0.0008960026349972108
MeanAbsoluteError value on hold-out data: 0.009702533483505249
Epoch: 189
Loss on hold-out set: 0.001201986515046596
MeanAbsoluteError value on hold-out data: 0.011618883349001408
Epoch: 190
Loss on hold-out set: 0.0013680026601689047
MeanAbsoluteError value on hold-out data: 0.012893863953649998
Epoch: 191
Loss on hold-out set: 0.001969409427195052
MeanAbsoluteError value on hold-out data: 0.028869889676570892
Epoch: 192
Loss on hold-out set: 0.001684031467639694
MeanAbsoluteError value on hold-out data: 0.03029930405318737
Epoch: 193
Loss on hold-out set: 0.001222577021005571
MeanAbsoluteError value on hold-out data: 0.012408917769789696
Epoch: 194
Loss on hold-out set: 0.0033240098865031827
MeanAbsoluteError value on hold-out data: 0.017969271168112755
Epoch: 195
Loss on hold-out set: 0.0015610293533511236
MeanAbsoluteError value on hold-out data: 0.012363778427243233
Epoch: 196
Loss on hold-out set: 0.0018142338194593322
MeanAbsoluteError value on hold-out data: 0.01854260452091694
Epoch: 197
Loss on hold-out set: 0.003131198126969761
MeanAbsoluteError value on hold-out data: 0.0482763908803463
Epoch: 198
Loss on hold-out set: 0.0017241271012416722
MeanAbsoluteError value on hold-out data: 0.015708239749073982
Epoch: 199
Loss on hold-out set: 0.0028110239601406455
MeanAbsoluteError value on hold-out data: 0.014810836873948574
Epoch: 200
Loss on hold-out set: 0.0022039026702450905
MeanAbsoluteError value on hold-out data: 0.02233654446899891
Epoch: 201
Loss on hold-out set: 0.0024034893485804787
MeanAbsoluteError value on hold-out data: 0.016223948448896408
Epoch: 202
Loss on hold-out set: 0.001380918777158513
MeanAbsoluteError value on hold-out data: 0.012523068115115166
Epoch: 203
Loss on hold-out set: 0.0014595528192857226
MeanAbsoluteError value on hold-out data: 0.01258811354637146
Epoch: 204
Loss on hold-out set: 0.0012896935456984992
MeanAbsoluteError value on hold-out data: 0.011557533405721188
Epoch: 205
Loss on hold-out set: 0.0011052610938541445
MeanAbsoluteError value on hold-out data: 0.020257296040654182
Epoch: 206
Loss on hold-out set: 0.0017070792930194568
MeanAbsoluteError value on hold-out data: 0.018288979306817055
Epoch: 207
Loss on hold-out set: 0.0022071299502290217
MeanAbsoluteError value on hold-out data: 0.015478970482945442
Epoch: 208
Loss on hold-out set: 0.0012801306375865209
MeanAbsoluteError value on hold-out data: 0.012042839080095291
Epoch: 209
Loss on hold-out set: 0.0014604137492441576
MeanAbsoluteError value on hold-out data: 0.011923020705580711
Epoch: 210
Loss on hold-out set: 0.0010142451099538544
MeanAbsoluteError value on hold-out data: 0.009899169206619263
Epoch: 211
Loss on hold-out set: 0.0005469831151437551
MeanAbsoluteError value on hold-out data: 0.006248899269849062
Epoch: 212
Loss on hold-out set: 0.0015097513019818028
MeanAbsoluteError value on hold-out data: 0.02262687124311924
Epoch: 213
Loss on hold-out set: 0.0016069912207728378
MeanAbsoluteError value on hold-out data: 0.013060205616056919
Epoch: 214
Loss on hold-out set: 0.0011709567215877758
MeanAbsoluteError value on hold-out data: 0.009952470660209656
Epoch: 215
Loss on hold-out set: 0.0011546031910735397
MeanAbsoluteError value on hold-out data: 0.013143465854227543
Epoch: 216
Loss on hold-out set: 0.0017514118586093805
MeanAbsoluteError value on hold-out data: 0.011710261926054955
Epoch: 217
Loss on hold-out set: 0.0006031637241520864
MeanAbsoluteError value on hold-out data: 0.007273469585925341
Epoch: 218
Loss on hold-out set: 0.0015823244498966759
MeanAbsoluteError value on hold-out data: 0.01051812432706356
Epoch: 219
Loss on hold-out set: 0.0010487421647643427
MeanAbsoluteError value on hold-out data: 0.010084039531648159
Epoch: 220
Loss on hold-out set: 0.0009421020051951544
MeanAbsoluteError value on hold-out data: 0.012129726819694042
Epoch: 221
Loss on hold-out set: 0.0024003872705706223
MeanAbsoluteError value on hold-out data: 0.02171725034713745
Epoch: 222
Loss on hold-out set: 0.0028273476866735635
MeanAbsoluteError value on hold-out data: 0.02613324299454689
Epoch: 223
Loss on hold-out set: 0.0014168325464867706
MeanAbsoluteError value on hold-out data: 0.014512005262076855
Epoch: 224
Loss on hold-out set: 0.0020772432464199434
MeanAbsoluteError value on hold-out data: 0.025248199701309204
Epoch: 225
Loss on hold-out set: 0.0010047214169677126
MeanAbsoluteError value on hold-out data: 0.0103720398619771
Epoch: 226
Loss on hold-out set: 0.0012825238569157112
MeanAbsoluteError value on hold-out data: 0.015441653318703175
Epoch: 227
Loss on hold-out set: 0.001231314158710455
MeanAbsoluteError value on hold-out data: 0.017552673816680908
Epoch: 228
Loss on hold-out set: 0.002790301181149564
MeanAbsoluteError value on hold-out data: 0.01601569540798664
Epoch: 229
Loss on hold-out set: 0.0012090979841475832
MeanAbsoluteError value on hold-out data: 0.010069484822452068
Epoch: 230
Loss on hold-out set: 0.001506352725156926
MeanAbsoluteError value on hold-out data: 0.029337424784898758
Epoch: 231
Loss on hold-out set: 0.004675287030343162
MeanAbsoluteError value on hold-out data: 0.06453902274370193
Epoch: 232
Loss on hold-out set: 0.0011223444131055178
MeanAbsoluteError value on hold-out data: 0.012797526083886623
Epoch: 233
Loss on hold-out set: 0.0012476396809568925
MeanAbsoluteError value on hold-out data: 0.011357174254953861
Epoch: 234
Loss on hold-out set: 0.001452349651548215
MeanAbsoluteError value on hold-out data: 0.013363205827772617
Epoch: 235
Loss on hold-out set: 0.001902739557815374
MeanAbsoluteError value on hold-out data: 0.013863326981663704
Epoch: 236
Loss on hold-out set: 0.0017697123541055542
MeanAbsoluteError value on hold-out data: 0.022989559918642044
Epoch: 237
Loss on hold-out set: 0.0004301562944733991
MeanAbsoluteError value on hold-out data: 0.005223965737968683
Epoch: 238
Loss on hold-out set: 0.001110392449366995
MeanAbsoluteError value on hold-out data: 0.016415512189269066
Epoch: 239
Loss on hold-out set: 0.001523735031935901
MeanAbsoluteError value on hold-out data: 0.018283415585756302
Epoch: 240
Loss on hold-out set: 0.0014387852143523847
MeanAbsoluteError value on hold-out data: 0.017753012478351593
Epoch: 241
Loss on hold-out set: 0.004353442210949173
MeanAbsoluteError value on hold-out data: 0.06187117099761963
Epoch: 242
Loss on hold-out set: 0.001535502902123354
MeanAbsoluteError value on hold-out data: 0.014823677018284798
Epoch: 243
Loss on hold-out set: 0.0013429867621629168
MeanAbsoluteError value on hold-out data: 0.01613130420446396
Epoch: 244
Loss on hold-out set: 0.001743871703518763
MeanAbsoluteError value on hold-out data: 0.019085854291915894
Epoch: 245
Loss on hold-out set: 0.0007513626988168797
MeanAbsoluteError value on hold-out data: 0.010908640921115875
Epoch: 246
Loss on hold-out set: 0.0024891510576325296
MeanAbsoluteError value on hold-out data: 0.02035086415708065
Epoch: 247
Loss on hold-out set: 0.0008995350375112378
MeanAbsoluteError value on hold-out data: 0.009609933011233807
Epoch: 248
Loss on hold-out set: 0.0012760715492875438
MeanAbsoluteError value on hold-out data: 0.016262933611869812
Epoch: 249
Loss on hold-out set: 0.002214038807204289
MeanAbsoluteError value on hold-out data: 0.016691500321030617
Epoch: 250
Loss on hold-out set: 0.0028840822985665383
MeanAbsoluteError value on hold-out data: 0.0318998284637928
Epoch: 251
Loss on hold-out set: 0.0013194362995280148
MeanAbsoluteError value on hold-out data: 0.012938780710101128
Epoch: 252
Loss on hold-out set: 0.0008544246161124503
MeanAbsoluteError value on hold-out data: 0.011244283057749271
Epoch: 253
Loss on hold-out set: 0.0011018531967788715
MeanAbsoluteError value on hold-out data: 0.010466272011399269
Epoch: 254
Loss on hold-out set: 0.0015099873045600315
MeanAbsoluteError value on hold-out data: 0.020069073885679245
Epoch: 255
Loss on hold-out set: 0.0018732539025031177
MeanAbsoluteError value on hold-out data: 0.021993935108184814
Epoch: 256
Loss on hold-out set: 0.001691500306390624
MeanAbsoluteError value on hold-out data: 0.014073246158659458
Epoch: 257
Loss on hold-out set: 0.0013253449831513297
MeanAbsoluteError value on hold-out data: 0.011744873598217964
Epoch: 258
Loss on hold-out set: 0.000963178965895694
MeanAbsoluteError value on hold-out data: 0.01593717932701111
Epoch: 259
Loss on hold-out set: 0.0012995783093318
MeanAbsoluteError value on hold-out data: 0.022023769095540047
Epoch: 260
Loss on hold-out set: 0.002411845022212028
MeanAbsoluteError value on hold-out data: 0.025659464299678802
Epoch: 261
Loss on hold-out set: 0.0007426535868202528
MeanAbsoluteError value on hold-out data: 0.008712999522686005
Epoch: 262
Loss on hold-out set: 0.0020272686701661626
MeanAbsoluteError value on hold-out data: 0.016891637817025185
Epoch: 263
Loss on hold-out set: 0.0016024363244229647
MeanAbsoluteError value on hold-out data: 0.013216198422014713
Epoch: 264
Loss on hold-out set: 0.001288229799300959
MeanAbsoluteError value on hold-out data: 0.017193228006362915
Epoch: 265
Loss on hold-out set: 0.0014661524972708368
MeanAbsoluteError value on hold-out data: 0.015697956085205078
Epoch: 266
Loss on hold-out set: 0.0015976549822258484
MeanAbsoluteError value on hold-out data: 0.013452266342937946
Epoch: 267
Loss on hold-out set: 0.0008989310567573595
MeanAbsoluteError value on hold-out data: 0.013119175098836422
Epoch: 268
Loss on hold-out set: 0.0018623724706565937
MeanAbsoluteError value on hold-out data: 0.017561763525009155
Epoch: 269
Loss on hold-out set: 0.0012739526070713748
MeanAbsoluteError value on hold-out data: 0.012342852540314198
Epoch: 270
Loss on hold-out set: 0.0011256894255271426
MeanAbsoluteError value on hold-out data: 0.019465407356619835
Epoch: 271
Loss on hold-out set: 0.0016771265693119187
MeanAbsoluteError value on hold-out data: 0.023309843614697456
Epoch: 272
Loss on hold-out set: 0.0011493230998128542
MeanAbsoluteError value on hold-out data: 0.011279496364295483
Epoch: 273
Loss on hold-out set: 0.002191562784566103
MeanAbsoluteError value on hold-out data: 0.02260557748377323
Epoch: 274
Loss on hold-out set: 0.0023910076814134206
MeanAbsoluteError value on hold-out data: 0.016910318285226822
Epoch: 275
Loss on hold-out set: 0.0023424176707569706
MeanAbsoluteError value on hold-out data: 0.036566853523254395
Epoch: 276
Loss on hold-out set: 0.0011053651625939221
MeanAbsoluteError value on hold-out data: 0.012415701523423195
Epoch: 277
Loss on hold-out set: 0.0009103972376913972
MeanAbsoluteError value on hold-out data: 0.010035821236670017
Epoch: 278
Loss on hold-out set: 0.0018607409656756079
MeanAbsoluteError value on hold-out data: 0.013256949372589588
Epoch: 279
Loss on hold-out set: 0.003140988496230229
MeanAbsoluteError value on hold-out data: 0.04036131873726845
Epoch: 280
Loss on hold-out set: 0.001982560860740609
MeanAbsoluteError value on hold-out data: 0.02317141927778721
Epoch: 281
Loss on hold-out set: 0.0011755125696685067
MeanAbsoluteError value on hold-out data: 0.01677672006189823
Epoch: 282
Loss on hold-out set: 0.003062908177717442
MeanAbsoluteError value on hold-out data: 0.03833878040313721
Epoch: 283
Loss on hold-out set: 0.001440707061862524
MeanAbsoluteError value on hold-out data: 0.021157650277018547
Epoch: 284
Loss on hold-out set: 0.0012590281427324762
MeanAbsoluteError value on hold-out data: 0.013322454877197742
Epoch: 285
Loss on hold-out set: 0.001476814829593901
MeanAbsoluteError value on hold-out data: 0.013189790770411491
Epoch: 286
Loss on hold-out set: 0.0017608771550409361
MeanAbsoluteError value on hold-out data: 0.015126088634133339
Epoch: 287
Loss on hold-out set: 0.0012522336619201126
MeanAbsoluteError value on hold-out data: 0.011005095206201077
Epoch: 288
Loss on hold-out set: 0.0024976170412197747
MeanAbsoluteError value on hold-out data: 0.012985533103346825
Epoch: 289
Loss on hold-out set: 0.0015111618313791329
MeanAbsoluteError value on hold-out data: 0.01611286960542202
Epoch: 290
Loss on hold-out set: 0.0010715274541948211
MeanAbsoluteError value on hold-out data: 0.013934955932199955
Epoch: 291
Loss on hold-out set: 0.0013542462823974539
MeanAbsoluteError value on hold-out data: 0.011577720753848553
Epoch: 292
Loss on hold-out set: 0.001127491894677453
MeanAbsoluteError value on hold-out data: 0.02193833515048027
Epoch: 293
Loss on hold-out set: 0.001523321474977772
MeanAbsoluteError value on hold-out data: 0.012985476292669773
Epoch: 294
Loss on hold-out set: 0.002173578609998865
MeanAbsoluteError value on hold-out data: 0.01966872625052929
Epoch: 295
Loss on hold-out set: 0.0016538712194520294
MeanAbsoluteError value on hold-out data: 0.025155607610940933
Epoch: 296
Loss on hold-out set: 0.0014189536217312899
MeanAbsoluteError value on hold-out data: 0.013921569101512432
Epoch: 297
Loss on hold-out set: 0.004653153898336888
MeanAbsoluteError value on hold-out data: 0.022884082049131393
Epoch: 298
Loss on hold-out set: 0.0010040588662569032
MeanAbsoluteError value on hold-out data: 0.013476776890456676
Epoch: 299
Loss on hold-out set: 0.0017541045433876877
MeanAbsoluteError value on hold-out data: 0.015559020452201366
Epoch: 300
Loss on hold-out set: 0.0024145908211817427
MeanAbsoluteError value on hold-out data: 0.025644542649388313
Epoch: 301
Loss on hold-out set: 0.001337545088302393
MeanAbsoluteError value on hold-out data: 0.015217695385217667
Epoch: 302
Loss on hold-out set: 0.0012762264825716173
MeanAbsoluteError value on hold-out data: 0.01827388070523739
Epoch: 303
Loss on hold-out set: 0.0013299531930035875
MeanAbsoluteError value on hold-out data: 0.01519155502319336
Epoch: 304
Loss on hold-out set: 0.0023365443412330933
MeanAbsoluteError value on hold-out data: 0.018563875928521156
Epoch: 305
Loss on hold-out set: 0.0016112487447619635
MeanAbsoluteError value on hold-out data: 0.02756023406982422
Epoch: 306
Loss on hold-out set: 0.0012794034831274889
MeanAbsoluteError value on hold-out data: 0.013822699896991253
Epoch: 307
Loss on hold-out set: 0.0014067461694426847
MeanAbsoluteError value on hold-out data: 0.017015798017382622
Epoch: 308
Loss on hold-out set: 0.0011785111618289527
MeanAbsoluteError value on hold-out data: 0.01778438873589039
Epoch: 309
Loss on hold-out set: 0.001870010997639551
MeanAbsoluteError value on hold-out data: 0.013819865882396698
Epoch: 310
Loss on hold-out set: 0.00186172885189176
MeanAbsoluteError value on hold-out data: 0.03075696900486946
Epoch: 311
Loss on hold-out set: 0.003749385267790211
MeanAbsoluteError value on hold-out data: 0.05729876831173897
Epoch: 312
Loss on hold-out set: 0.0013040962476524281
MeanAbsoluteError value on hold-out data: 0.013206006959080696
Epoch: 313
Loss on hold-out set: 0.0010784831745121138
MeanAbsoluteError value on hold-out data: 0.013376639224588871
Epoch: 314
Loss on hold-out set: 0.0007730851970527988
MeanAbsoluteError value on hold-out data: 0.011232951655983925
Epoch: 315
Loss on hold-out set: 0.0014232299069446622
MeanAbsoluteError value on hold-out data: 0.01617610640823841
Epoch: 316
Loss on hold-out set: 0.0026116300378864828
MeanAbsoluteError value on hold-out data: 0.017816446721553802
Epoch: 317
Loss on hold-out set: 0.0016249118999487684
MeanAbsoluteError value on hold-out data: 0.0167344082146883
Epoch: 318
Loss on hold-out set: 0.0019567926065064967
MeanAbsoluteError value on hold-out data: 0.03303738683462143
Epoch: 319
Loss on hold-out set: 0.0008700951533874582
MeanAbsoluteError value on hold-out data: 0.014273373410105705
Epoch: 320
Loss on hold-out set: 0.001614435028913201
MeanAbsoluteError value on hold-out data: 0.014387818984687328
Epoch: 321
Loss on hold-out set: 0.0014742487574518524
MeanAbsoluteError value on hold-out data: 0.014813963323831558
Epoch: 322
Loss on hold-out set: 0.0011600001184888242
MeanAbsoluteError value on hold-out data: 0.011426722630858421
Epoch: 323
Loss on hold-out set: 0.0014726842943529942
MeanAbsoluteError value on hold-out data: 0.017160935327410698
Epoch: 324
Loss on hold-out set: 0.0010432412512416608
MeanAbsoluteError value on hold-out data: 0.012364082038402557
Epoch: 325
Loss on hold-out set: 0.0014059189255165524
MeanAbsoluteError value on hold-out data: 0.0161318127065897
Epoch: 326
Loss on hold-out set: 0.0019016997877387392
MeanAbsoluteError value on hold-out data: 0.020888127386569977
Epoch: 327
Loss on hold-out set: 0.0018036976992956816
MeanAbsoluteError value on hold-out data: 0.018950048834085464
Epoch: 328
Loss on hold-out set: 0.0017964296746772323
MeanAbsoluteError value on hold-out data: 0.02393590845167637
Epoch: 329
Loss on hold-out set: 0.0016167842296980733
MeanAbsoluteError value on hold-out data: 0.014456751756370068
Epoch: 330
Loss on hold-out set: 0.0019454925237895576
MeanAbsoluteError value on hold-out data: 0.012613811530172825
Epoch: 331
Loss on hold-out set: 0.0025294027007858907
MeanAbsoluteError value on hold-out data: 0.030762992799282074
Epoch: 332
Loss on hold-out set: 0.001667073482837479
MeanAbsoluteError value on hold-out data: 0.012598239816725254
Epoch: 333
Loss on hold-out set: 0.0014530431848183262
MeanAbsoluteError value on hold-out data: 0.0119482958689332
Epoch: 334
Loss on hold-out set: 0.001864024352950142
MeanAbsoluteError value on hold-out data: 0.027996761724352837
Epoch: 335
Loss on hold-out set: 0.0016437659490436904
MeanAbsoluteError value on hold-out data: 0.03244321048259735
Epoch: 336
Loss on hold-out set: 0.001288559561209312
MeanAbsoluteError value on hold-out data: 0.02056802064180374
Epoch: 337
Loss on hold-out set: 0.001385225342681607
MeanAbsoluteError value on hold-out data: 0.017986290156841278
Epoch: 338
Loss on hold-out set: 0.0011551629271323055
MeanAbsoluteError value on hold-out data: 0.009186549112200737
Epoch: 339
Loss on hold-out set: 0.002438113283316948
MeanAbsoluteError value on hold-out data: 0.03752867132425308
Epoch: 340
Loss on hold-out set: 0.0017695656894686277
MeanAbsoluteError value on hold-out data: 0.014352982863783836
Epoch: 341
Loss on hold-out set: 0.0013629200185924244
MeanAbsoluteError value on hold-out data: 0.012200312688946724
Epoch: 342
Loss on hold-out set: 0.0015553944849671097
MeanAbsoluteError value on hold-out data: 0.016432585194706917
Epoch: 343
Loss on hold-out set: 0.002107362507989532
MeanAbsoluteError value on hold-out data: 0.03017396852374077
Epoch: 344
Loss on hold-out set: 0.0022077017201809213
MeanAbsoluteError value on hold-out data: 0.03137943521142006
Epoch: 345
Loss on hold-out set: 0.0020842913226691677
MeanAbsoluteError value on hold-out data: 0.013106766156852245
Epoch: 346
Loss on hold-out set: 0.001860381467658475
MeanAbsoluteError value on hold-out data: 0.02220466546714306
Epoch: 347
Loss on hold-out set: 0.0015565679530386422
MeanAbsoluteError value on hold-out data: 0.019431620836257935
Epoch: 348
Loss on hold-out set: 0.0018647975245441653
MeanAbsoluteError value on hold-out data: 0.022202014923095703
Epoch: 349
Loss on hold-out set: 0.001150311814189751
MeanAbsoluteError value on hold-out data: 0.012072085402905941
Epoch: 350
Loss on hold-out set: 0.0012535859598421283
MeanAbsoluteError value on hold-out data: 0.015004720538854599
Epoch: 351
Loss on hold-out set: 0.0022902443580446025
MeanAbsoluteError value on hold-out data: 0.012915544211864471
Epoch: 352
Loss on hold-out set: 0.0013759058109778714
MeanAbsoluteError value on hold-out data: 0.016178540885448456
Epoch: 353
Loss on hold-out set: 0.0016971864120861075
MeanAbsoluteError value on hold-out data: 0.01350849773734808
Epoch: 354
Loss on hold-out set: 0.0013388401944451431
MeanAbsoluteError value on hold-out data: 0.013406775891780853
Epoch: 355
Loss on hold-out set: 0.0009442666218283671
MeanAbsoluteError value on hold-out data: 0.01153667364269495
Epoch: 356
Loss on hold-out set: 0.0012356611869108747
MeanAbsoluteError value on hold-out data: 0.011717620305716991
Epoch: 357
Loss on hold-out set: 0.0008567862946201307
MeanAbsoluteError value on hold-out data: 0.010127237997949123
Epoch: 358
Loss on hold-out set: 0.0023282032251652133
MeanAbsoluteError value on hold-out data: 0.018122930079698563
Epoch: 359
Loss on hold-out set: 0.0010217255462880292
MeanAbsoluteError value on hold-out data: 0.010113565251231194
Epoch: 360
Loss on hold-out set: 0.002064794952562615
MeanAbsoluteError value on hold-out data: 0.014596293680369854
Epoch: 361
Loss on hold-out set: 0.001058561044613414
MeanAbsoluteError value on hold-out data: 0.012022281996905804
Epoch: 362
Loss on hold-out set: 0.001544209586642721
MeanAbsoluteError value on hold-out data: 0.014187434688210487
Epoch: 363
Loss on hold-out set: 0.001349485811308688
MeanAbsoluteError value on hold-out data: 0.020434103906154633
Epoch: 364
Loss on hold-out set: 0.0011399999869019283
MeanAbsoluteError value on hold-out data: 0.01734660193324089
Epoch: 365
Loss on hold-out set: 0.0015656590187159293
MeanAbsoluteError value on hold-out data: 0.01787997968494892
Early stopping at epoch 364
Returned to Spot: Validation loss: 0.0015656590187159293
----------------------------------------------
spotPython tuning: 0.0006857007820623327 [##--------] 21.26% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 256, 'dropout_prob': 0.046835173779860295, 'lr_mult': 0.2822001579326203, 'batch_size': 8, 'epochs': 4, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adam', 'sgd_momentum': 0.9932348888200393}
Epoch: 1
Loss on hold-out set: 0.020527190577827002
MeanAbsoluteError value on hold-out data: 0.11121012270450592
Epoch: 2
Loss on hold-out set: 0.01613506862869192
MeanAbsoluteError value on hold-out data: 0.0987163707613945
Epoch: 3
Loss on hold-out set: 0.011630837670772484
MeanAbsoluteError value on hold-out data: 0.08526024222373962
Epoch: 4
Loss on hold-out set: 0.0061201411850848484
MeanAbsoluteError value on hold-out data: 0.060073643922805786
Returned to Spot: Validation loss: 0.0061201411850848484
----------------------------------------------
spotPython tuning: 0.0006857007820623327 [##--------] 22.60% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.0, 'lr_mult': 0.9993075555216703, 'batch_size': 8, 'epochs': 4, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adam', 'sgd_momentum': 0.9919385615900639}
Epoch: 1
Loss on hold-out set: 0.027560678408726266
MeanAbsoluteError value on hold-out data: 0.13355320692062378
Epoch: 2
Loss on hold-out set: 0.022215154873648363
MeanAbsoluteError value on hold-out data: 0.11763365566730499
Epoch: 3
Loss on hold-out set: 0.021093918690703026
MeanAbsoluteError value on hold-out data: 0.11440899223089218
Epoch: 4
Loss on hold-out set: 0.019821074656455925
MeanAbsoluteError value on hold-out data: 0.11069641262292862
Returned to Spot: Validation loss: 0.019821074656455925
----------------------------------------------
spotPython tuning: 0.0006857007820623327 [##--------] 23.95% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.24605955291281917, 'lr_mult': 6.5736358006916715, 'batch_size': 8, 'epochs': 2048, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adam', 'sgd_momentum': 0.9627246004506791}
Epoch: 1
Loss on hold-out set: 0.05203613050674137
MeanAbsoluteError value on hold-out data: 0.17944499850273132
Epoch: 2
Loss on hold-out set: 0.04658914016755788
MeanAbsoluteError value on hold-out data: 0.16389822959899902
Epoch: 3
Loss on hold-out set: 0.03545422094727033
MeanAbsoluteError value on hold-out data: 0.1426110714673996
Epoch: 4
Loss on hold-out set: 0.034200917684326045
MeanAbsoluteError value on hold-out data: 0.14525030553340912
Epoch: 5
Loss on hold-out set: 0.03402702490750112
MeanAbsoluteError value on hold-out data: 0.14518436789512634
Epoch: 6
Loss on hold-out set: 0.028288331618042367
MeanAbsoluteError value on hold-out data: 0.13174840807914734
Epoch: 7
Loss on hold-out set: 0.02858413496103726
MeanAbsoluteError value on hold-out data: 0.13397163152694702
Epoch: 8
Loss on hold-out set: 0.02629760716502604
MeanAbsoluteError value on hold-out data: 0.12665289640426636
Epoch: 9
Loss on hold-out set: 0.026062872285317434
MeanAbsoluteError value on hold-out data: 0.1271478235721588
Epoch: 10
Loss on hold-out set: 0.0216416553594172
MeanAbsoluteError value on hold-out data: 0.11857273429632187
Epoch: 11
Loss on hold-out set: 0.02070067060719195
MeanAbsoluteError value on hold-out data: 0.11237532645463943
Epoch: 12
Loss on hold-out set: 0.020727162837590043
MeanAbsoluteError value on hold-out data: 0.11176062375307083
Epoch: 13
Loss on hold-out set: 0.02287509126931821
MeanAbsoluteError value on hold-out data: 0.11502370238304138
Epoch: 14
Loss on hold-out set: 0.02137422175024097
MeanAbsoluteError value on hold-out data: 0.11326432228088379
Epoch: 15
Loss on hold-out set: 0.01851366169285029
MeanAbsoluteError value on hold-out data: 0.10342845320701599
Epoch: 16
Loss on hold-out set: 0.0157588405081218
MeanAbsoluteError value on hold-out data: 0.09557975828647614
Epoch: 17
Loss on hold-out set: 0.014139767331806453
MeanAbsoluteError value on hold-out data: 0.09263191372156143
Epoch: 18
Loss on hold-out set: 0.015811670252955275
MeanAbsoluteError value on hold-out data: 0.09487072378396988
Epoch: 19
Loss on hold-out set: 0.010551036078188764
MeanAbsoluteError value on hold-out data: 0.07433778047561646
Epoch: 20
Loss on hold-out set: 0.015331775764934719
MeanAbsoluteError value on hold-out data: 0.08745866268873215
Epoch: 21
Loss on hold-out set: 0.012018134572396153
MeanAbsoluteError value on hold-out data: 0.08140739798545837
Epoch: 22
Loss on hold-out set: 0.011315115611068904
MeanAbsoluteError value on hold-out data: 0.08121978491544724
Epoch: 23
Loss on hold-out set: 0.014354734559004245
MeanAbsoluteError value on hold-out data: 0.09061133116483688
Epoch: 24
Loss on hold-out set: 0.012491054416291024
MeanAbsoluteError value on hold-out data: 0.07973454147577286
Epoch: 25
Loss on hold-out set: 0.012339634551225524
MeanAbsoluteError value on hold-out data: 0.07725925743579865
Epoch: 26
Loss on hold-out set: 0.01117062750333724
MeanAbsoluteError value on hold-out data: 0.08042480051517487
Epoch: 27
Loss on hold-out set: 0.008441706486337353
MeanAbsoluteError value on hold-out data: 0.066085085272789
Epoch: 28
Loss on hold-out set: 0.01258924299556958
MeanAbsoluteError value on hold-out data: 0.08269652724266052
Epoch: 29
Loss on hold-out set: 0.010496864456830448
MeanAbsoluteError value on hold-out data: 0.07721943408250809
Epoch: 30
Loss on hold-out set: 0.00840247891794302
MeanAbsoluteError value on hold-out data: 0.07017061114311218
Epoch: 31
Loss on hold-out set: 0.008620330500171372
MeanAbsoluteError value on hold-out data: 0.06635134667158127
Epoch: 32
Loss on hold-out set: 0.009161211289833054
MeanAbsoluteError value on hold-out data: 0.07081230729818344
Epoch: 33
Loss on hold-out set: 0.0074081669659598875
MeanAbsoluteError value on hold-out data: 0.06335490942001343
Epoch: 34
Loss on hold-out set: 0.0106799937294502
MeanAbsoluteError value on hold-out data: 0.07759732753038406
Epoch: 35
Loss on hold-out set: 0.008198565181565323
MeanAbsoluteError value on hold-out data: 0.0671864002943039
Epoch: 36
Loss on hold-out set: 0.00790702464904538
MeanAbsoluteError value on hold-out data: 0.06410695612430573
Epoch: 37
Loss on hold-out set: 0.0094446994082414
MeanAbsoluteError value on hold-out data: 0.07018448412418365
Epoch: 38
Loss on hold-out set: 0.008671240439932597
MeanAbsoluteError value on hold-out data: 0.07276920229196548
Epoch: 39
Loss on hold-out set: 0.008835757806848147
MeanAbsoluteError value on hold-out data: 0.07652191072702408
Epoch: 40
Loss on hold-out set: 0.006013584942066748
MeanAbsoluteError value on hold-out data: 0.0611577108502388
Epoch: 41
Loss on hold-out set: 0.006497515241407152
MeanAbsoluteError value on hold-out data: 0.05953412503004074
Epoch: 42
Loss on hold-out set: 0.011100050472458335
MeanAbsoluteError value on hold-out data: 0.07432325929403305
Epoch: 43
Loss on hold-out set: 0.006356984499449793
MeanAbsoluteError value on hold-out data: 0.06005216762423515
Epoch: 44
Loss on hold-out set: 0.006696827029564271
MeanAbsoluteError value on hold-out data: 0.06112813949584961
Epoch: 45
Loss on hold-out set: 0.009380591322520846
MeanAbsoluteError value on hold-out data: 0.07079129666090012
Epoch: 46
Loss on hold-out set: 0.007750794960884377
MeanAbsoluteError value on hold-out data: 0.06375187635421753
Epoch: 47
Loss on hold-out set: 0.009632416761872408
MeanAbsoluteError value on hold-out data: 0.07340099662542343
Epoch: 48
Loss on hold-out set: 0.007382109926670398
MeanAbsoluteError value on hold-out data: 0.059429824352264404
Epoch: 49
Loss on hold-out set: 0.006409501901974804
MeanAbsoluteError value on hold-out data: 0.05948156490921974
Epoch: 50
Loss on hold-out set: 0.007827133883869178
MeanAbsoluteError value on hold-out data: 0.06575760990381241
Epoch: 51
Loss on hold-out set: 0.006292453412530257
MeanAbsoluteError value on hold-out data: 0.05466431379318237
Epoch: 52
Loss on hold-out set: 0.007906522762679839
MeanAbsoluteError value on hold-out data: 0.06202234327793121
Epoch: 53
Loss on hold-out set: 0.006104311728114753
MeanAbsoluteError value on hold-out data: 0.05536619946360588
Epoch: 54
Loss on hold-out set: 0.005997591550878592
MeanAbsoluteError value on hold-out data: 0.059325020760297775
Epoch: 55
Loss on hold-out set: 0.006371865418163668
MeanAbsoluteError value on hold-out data: 0.05469164997339249
Epoch: 56
Loss on hold-out set: 0.006181803724949101
MeanAbsoluteError value on hold-out data: 0.058531589806079865
Epoch: 57
Loss on hold-out set: 0.006798707728433472
MeanAbsoluteError value on hold-out data: 0.05544581636786461
Epoch: 58
Loss on hold-out set: 0.005691121771968411
MeanAbsoluteError value on hold-out data: 0.05293743312358856
Epoch: 59
Loss on hold-out set: 0.0061520802103730505
MeanAbsoluteError value on hold-out data: 0.05328340455889702
Epoch: 60
Loss on hold-out set: 0.006568373992769538
MeanAbsoluteError value on hold-out data: 0.05990453064441681
Epoch: 61
Loss on hold-out set: 0.006988117595411543
MeanAbsoluteError value on hold-out data: 0.053532276302576065
Epoch: 62
Loss on hold-out set: 0.006345526473045251
MeanAbsoluteError value on hold-out data: 0.054277922958135605
Epoch: 63
Loss on hold-out set: 0.006737719561083634
MeanAbsoluteError value on hold-out data: 0.05723222717642784
Epoch: 64
Loss on hold-out set: 0.006403410355376668
MeanAbsoluteError value on hold-out data: 0.0537087507545948
Epoch: 65
Loss on hold-out set: 0.007238031306769699
MeanAbsoluteError value on hold-out data: 0.05512753874063492
Epoch: 66
Loss on hold-out set: 0.007586267214623819
MeanAbsoluteError value on hold-out data: 0.05820350721478462
Epoch: 67
Loss on hold-out set: 0.008475664500637274
MeanAbsoluteError value on hold-out data: 0.07454169541597366
Epoch: 68
Loss on hold-out set: 0.008947595041000136
MeanAbsoluteError value on hold-out data: 0.06256704777479172
Epoch: 69
Loss on hold-out set: 0.0065431880173395926
MeanAbsoluteError value on hold-out data: 0.05497213825583458
Epoch: 70
Loss on hold-out set: 0.006237866577545279
MeanAbsoluteError value on hold-out data: 0.05698258802294731
Epoch: 71
Loss on hold-out set: 0.0072865033120921765
MeanAbsoluteError value on hold-out data: 0.05526323243975639
Epoch: 72
Loss on hold-out set: 0.005957875131188254
MeanAbsoluteError value on hold-out data: 0.054381441324949265
Epoch: 73
Loss on hold-out set: 0.0071327085208490884
MeanAbsoluteError value on hold-out data: 0.06040779873728752
Epoch: 74
Loss on hold-out set: 0.00796353814228879
MeanAbsoluteError value on hold-out data: 0.05961774289608002
Epoch: 75
Loss on hold-out set: 0.008689949935375663
MeanAbsoluteError value on hold-out data: 0.0726047158241272
Epoch: 76
Loss on hold-out set: 0.006428724888552863
MeanAbsoluteError value on hold-out data: 0.05467923358082771
Epoch: 77
Loss on hold-out set: 0.005858621897028857
MeanAbsoluteError value on hold-out data: 0.05788179486989975
Epoch: 78
Loss on hold-out set: 0.006481183188857119
MeanAbsoluteError value on hold-out data: 0.05257851630449295
Epoch: 79
Loss on hold-out set: 0.005906135343186753
MeanAbsoluteError value on hold-out data: 0.054659221321344376
Epoch: 80
Loss on hold-out set: 0.007263819203025808
MeanAbsoluteError value on hold-out data: 0.06528118997812271
Epoch: 81
Loss on hold-out set: 0.00847037631932548
MeanAbsoluteError value on hold-out data: 0.05898591876029968
Epoch: 82
Loss on hold-out set: 0.007937543961911854
MeanAbsoluteError value on hold-out data: 0.056967005133628845
Epoch: 83
Loss on hold-out set: 0.005740252720179821
MeanAbsoluteError value on hold-out data: 0.04709320887923241
Epoch: 84
Loss on hold-out set: 0.00822335156599844
MeanAbsoluteError value on hold-out data: 0.06316988915205002
Epoch: 85
Loss on hold-out set: 0.006073734251243111
MeanAbsoluteError value on hold-out data: 0.06057159602642059
Epoch: 86
Loss on hold-out set: 0.005733226692475574
MeanAbsoluteError value on hold-out data: 0.05051396042108536
Epoch: 87
Loss on hold-out set: 0.005788301882076715
MeanAbsoluteError value on hold-out data: 0.05221456661820412
Epoch: 88
Loss on hold-out set: 0.005429928381712862
MeanAbsoluteError value on hold-out data: 0.04840746894478798
Epoch: 89
Loss on hold-out set: 0.006594834677678974
MeanAbsoluteError value on hold-out data: 0.05971108749508858
Epoch: 90
Loss on hold-out set: 0.008574494614118808
MeanAbsoluteError value on hold-out data: 0.07101704925298691
Epoch: 91
Loss on hold-out set: 0.006646825775724689
MeanAbsoluteError value on hold-out data: 0.051917675882577896
Epoch: 92
Loss on hold-out set: 0.005508477228240257
MeanAbsoluteError value on hold-out data: 0.052537303417921066
Epoch: 93
Loss on hold-out set: 0.006933269057251317
MeanAbsoluteError value on hold-out data: 0.05959716811776161
Epoch: 94
Loss on hold-out set: 0.00676287667700212
MeanAbsoluteError value on hold-out data: 0.050503022968769073
Epoch: 95
Loss on hold-out set: 0.004964017684534683
MeanAbsoluteError value on hold-out data: 0.05040113627910614
Epoch: 96
Loss on hold-out set: 0.0075235153566800845
MeanAbsoluteError value on hold-out data: 0.06480475515127182
Epoch: 97
Loss on hold-out set: 0.00594864679365664
MeanAbsoluteError value on hold-out data: 0.048715800046920776
Epoch: 98
Loss on hold-out set: 0.0055297555840010506
MeanAbsoluteError value on hold-out data: 0.0496356301009655
Epoch: 99
Loss on hold-out set: 0.0056428566562030215
MeanAbsoluteError value on hold-out data: 0.047678444534540176
Epoch: 100
Loss on hold-out set: 0.006705477977735235
MeanAbsoluteError value on hold-out data: 0.06414961069822311
Epoch: 101
Loss on hold-out set: 0.004669943337304224
MeanAbsoluteError value on hold-out data: 0.044419415295124054
Epoch: 102
Loss on hold-out set: 0.0046512613587669635
MeanAbsoluteError value on hold-out data: 0.04712623730301857
Epoch: 103
Loss on hold-out set: 0.0076757294193253315
MeanAbsoluteError value on hold-out data: 0.05918094143271446
Epoch: 104
Loss on hold-out set: 0.008915057822473739
MeanAbsoluteError value on hold-out data: 0.07585634291172028
Epoch: 105
Loss on hold-out set: 0.005729313065163105
MeanAbsoluteError value on hold-out data: 0.0498005673289299
Epoch: 106
Loss on hold-out set: 0.006527160583860486
MeanAbsoluteError value on hold-out data: 0.05389626324176788
Epoch: 107
Loss on hold-out set: 0.005618798917183946
MeanAbsoluteError value on hold-out data: 0.056685518473386765
Epoch: 108
Loss on hold-out set: 0.007154177290718316
MeanAbsoluteError value on hold-out data: 0.05692914500832558
Epoch: 109
Loss on hold-out set: 0.004182082652972129
MeanAbsoluteError value on hold-out data: 0.04045918956398964
Epoch: 110
Loss on hold-out set: 0.01489811595284233
MeanAbsoluteError value on hold-out data: 0.1004180908203125
Epoch: 111
Loss on hold-out set: 0.007838188462253464
MeanAbsoluteError value on hold-out data: 0.07013586163520813
Epoch: 112
Loss on hold-out set: 0.006925152898092117
MeanAbsoluteError value on hold-out data: 0.05406631529331207
Epoch: 113
Loss on hold-out set: 0.005623434196949299
MeanAbsoluteError value on hold-out data: 0.0521090030670166
Epoch: 114
Loss on hold-out set: 0.006772815847254701
MeanAbsoluteError value on hold-out data: 0.06037626415491104
Epoch: 115
Loss on hold-out set: 0.005419099254619428
MeanAbsoluteError value on hold-out data: 0.050599850714206696
Epoch: 116
Loss on hold-out set: 0.007065281242830679
MeanAbsoluteError value on hold-out data: 0.05196724459528923
Epoch: 117
Loss on hold-out set: 0.006824077059527075
MeanAbsoluteError value on hold-out data: 0.054800644516944885
Epoch: 118
Loss on hold-out set: 0.0069214140331544174
MeanAbsoluteError value on hold-out data: 0.05273984745144844
Epoch: 119
Loss on hold-out set: 0.006786501868382881
MeanAbsoluteError value on hold-out data: 0.05315055698156357
Epoch: 120
Loss on hold-out set: 0.006191393165959437
MeanAbsoluteError value on hold-out data: 0.052956245839595795
Epoch: 121
Loss on hold-out set: 0.006422707826315768
MeanAbsoluteError value on hold-out data: 0.048513513058423996
Epoch: 122
Loss on hold-out set: 0.005692746952837824
MeanAbsoluteError value on hold-out data: 0.054704125970602036
Epoch: 123
Loss on hold-out set: 0.006686551232920273
MeanAbsoluteError value on hold-out data: 0.05570090562105179
Epoch: 124
Loss on hold-out set: 0.005545063587640853
MeanAbsoluteError value on hold-out data: 0.05236564576625824
Epoch: 125
Loss on hold-out set: 0.005928609717796606
MeanAbsoluteError value on hold-out data: 0.051325853914022446
Epoch: 126
Loss on hold-out set: 0.007187171154471703
MeanAbsoluteError value on hold-out data: 0.05143105238676071
Epoch: 127
Loss on hold-out set: 0.00702825601145282
MeanAbsoluteError value on hold-out data: 0.05688958615064621
Epoch: 128
Loss on hold-out set: 0.005433267417461856
MeanAbsoluteError value on hold-out data: 0.05165216326713562
Epoch: 129
Loss on hold-out set: 0.006079128389645025
MeanAbsoluteError value on hold-out data: 0.048634570091962814
Epoch: 130
Loss on hold-out set: 0.00470165841895658
MeanAbsoluteError value on hold-out data: 0.04398693889379501
Epoch: 131
Loss on hold-out set: 0.0054787251099600994
MeanAbsoluteError value on hold-out data: 0.05942922085523605
Epoch: 132
Loss on hold-out set: 0.006798558654018531
MeanAbsoluteError value on hold-out data: 0.06138431653380394
Epoch: 133
Loss on hold-out set: 0.005278554193577484
MeanAbsoluteError value on hold-out data: 0.052548788487911224
Epoch: 134
Loss on hold-out set: 0.006925494073105878
MeanAbsoluteError value on hold-out data: 0.06565086543560028
Epoch: 135
Loss on hold-out set: 0.006953214742488375
MeanAbsoluteError value on hold-out data: 0.058881726115942
Epoch: 136
Loss on hold-out set: 0.007496625361167581
MeanAbsoluteError value on hold-out data: 0.053923435509204865
Epoch: 137
Loss on hold-out set: 0.008090538205578923
MeanAbsoluteError value on hold-out data: 0.06397899240255356
Epoch: 138
Loss on hold-out set: 0.006880185079736341
MeanAbsoluteError value on hold-out data: 0.05523347854614258
Epoch: 139
Loss on hold-out set: 0.005462885935374193
MeanAbsoluteError value on hold-out data: 0.048266518861055374
Epoch: 140
Loss on hold-out set: 0.011829471742538246
MeanAbsoluteError value on hold-out data: 0.07660268992185593
Epoch: 141
Loss on hold-out set: 0.006792620355937336
MeanAbsoluteError value on hold-out data: 0.052824318408966064
Epoch: 142
Loss on hold-out set: 0.006282113034486477
MeanAbsoluteError value on hold-out data: 0.052216388285160065
Epoch: 143
Loss on hold-out set: 0.006825898838303003
MeanAbsoluteError value on hold-out data: 0.06399348378181458
Epoch: 144
Loss on hold-out set: 0.008158900200597648
MeanAbsoluteError value on hold-out data: 0.05873233079910278
Epoch: 145
Loss on hold-out set: 0.005150274254112064
MeanAbsoluteError value on hold-out data: 0.04961980879306793
Epoch: 146
Loss on hold-out set: 0.008692739194406099
MeanAbsoluteError value on hold-out data: 0.07726126164197922
Epoch: 147
Loss on hold-out set: 0.005376514473219255
MeanAbsoluteError value on hold-out data: 0.05317900702357292
Epoch: 148
Loss on hold-out set: 0.0056011461940790085
MeanAbsoluteError value on hold-out data: 0.056299544870853424
Epoch: 149
Loss on hold-out set: 0.007036082857092352
MeanAbsoluteError value on hold-out data: 0.059258975088596344
Epoch: 150
Loss on hold-out set: 0.007711621712108976
MeanAbsoluteError value on hold-out data: 0.0617213137447834
Epoch: 151
Loss on hold-out set: 0.007794052723942227
MeanAbsoluteError value on hold-out data: 0.06456386297941208
Epoch: 152
Loss on hold-out set: 0.007215707231999228
MeanAbsoluteError value on hold-out data: 0.060233935713768005
Epoch: 153
Loss on hold-out set: 0.005099468204303105
MeanAbsoluteError value on hold-out data: 0.05117054656147957
Epoch: 154
Loss on hold-out set: 0.0092083897662202
MeanAbsoluteError value on hold-out data: 0.07012688368558884
Epoch: 155
Loss on hold-out set: 0.0047480963893528835
MeanAbsoluteError value on hold-out data: 0.05024631321430206
Epoch: 156
Loss on hold-out set: 0.0063968948793205384
MeanAbsoluteError value on hold-out data: 0.0589328370988369
Epoch: 157
Loss on hold-out set: 0.00692070850881895
MeanAbsoluteError value on hold-out data: 0.05807678401470184
Epoch: 158
Loss on hold-out set: 0.006377778126318988
MeanAbsoluteError value on hold-out data: 0.06423026323318481
Epoch: 159
Loss on hold-out set: 0.006032920761897817
MeanAbsoluteError value on hold-out data: 0.0514817014336586
Epoch: 160
Loss on hold-out set: 0.00676703587247941
MeanAbsoluteError value on hold-out data: 0.054805539548397064
Epoch: 161
Loss on hold-out set: 0.004972466430014097
MeanAbsoluteError value on hold-out data: 0.047809287905693054
Epoch: 162
Loss on hold-out set: 0.0062389063379286154
MeanAbsoluteError value on hold-out data: 0.0587981715798378
Epoch: 163
Loss on hold-out set: 0.006625626207096502
MeanAbsoluteError value on hold-out data: 0.05801602825522423
Epoch: 164
Loss on hold-out set: 0.004639715412754174
MeanAbsoluteError value on hold-out data: 0.04750586301088333
Epoch: 165
Loss on hold-out set: 0.005349467577424979
MeanAbsoluteError value on hold-out data: 0.05516848713159561
Epoch: 166
Loss on hold-out set: 0.0069187425052453025
MeanAbsoluteError value on hold-out data: 0.06489868462085724
Epoch: 167
Loss on hold-out set: 0.005485562691893919
MeanAbsoluteError value on hold-out data: 0.05200667306780815
Epoch: 168
Loss on hold-out set: 0.007631648177170734
MeanAbsoluteError value on hold-out data: 0.06523777544498444
Epoch: 169
Loss on hold-out set: 0.006084298530798773
MeanAbsoluteError value on hold-out data: 0.04648081585764885
Epoch: 170
Loss on hold-out set: 0.008010050232865308
MeanAbsoluteError value on hold-out data: 0.06906378269195557
Epoch: 171
Loss on hold-out set: 0.009441894836000804
MeanAbsoluteError value on hold-out data: 0.06571986526250839
Epoch: 172
Loss on hold-out set: 0.005994013067959857
MeanAbsoluteError value on hold-out data: 0.054406002163887024
Epoch: 173
Loss on hold-out set: 0.008728745301548196
MeanAbsoluteError value on hold-out data: 0.06568306684494019
Epoch: 174
Loss on hold-out set: 0.007478674922726657
MeanAbsoluteError value on hold-out data: 0.06196533888578415
Epoch: 175
Loss on hold-out set: 0.0072723874136021265
MeanAbsoluteError value on hold-out data: 0.06542307138442993
Epoch: 176
Loss on hold-out set: 0.006854529091230545
MeanAbsoluteError value on hold-out data: 0.05929489806294441
Epoch: 177
Loss on hold-out set: 0.007466177174233292
MeanAbsoluteError value on hold-out data: 0.07006878405809402
Epoch: 178
Loss on hold-out set: 0.0056224147893341354
MeanAbsoluteError value on hold-out data: 0.0552210696041584
Epoch: 179
Loss on hold-out set: 0.00884689214198213
MeanAbsoluteError value on hold-out data: 0.07827679067850113
Epoch: 180
Loss on hold-out set: 0.0069314598329487795
MeanAbsoluteError value on hold-out data: 0.0552942268550396
Epoch: 181
Loss on hold-out set: 0.0064651741842298134
MeanAbsoluteError value on hold-out data: 0.06459391117095947
Epoch: 182
Loss on hold-out set: 0.006684084591382232
MeanAbsoluteError value on hold-out data: 0.056071218103170395
Epoch: 183
Loss on hold-out set: 0.005636716812181189
MeanAbsoluteError value on hold-out data: 0.04557053744792938
Epoch: 184
Loss on hold-out set: 0.0069630937375079255
MeanAbsoluteError value on hold-out data: 0.05451385676860809
Epoch: 185
Loss on hold-out set: 0.005688501809153853
MeanAbsoluteError value on hold-out data: 0.050984546542167664
Epoch: 186
Loss on hold-out set: 0.006210735567085641
MeanAbsoluteError value on hold-out data: 0.05221985653042793
Epoch: 187
Loss on hold-out set: 0.007476874254950273
MeanAbsoluteError value on hold-out data: 0.05516956374049187
Epoch: 188
Loss on hold-out set: 0.0070121814420226174
MeanAbsoluteError value on hold-out data: 0.05352743715047836
Epoch: 189
Loss on hold-out set: 0.006357818174077884
MeanAbsoluteError value on hold-out data: 0.061883073300123215
Epoch: 190
Loss on hold-out set: 0.008018970164764477
MeanAbsoluteError value on hold-out data: 0.06685441732406616
Epoch: 191
Loss on hold-out set: 0.006380543814310313
MeanAbsoluteError value on hold-out data: 0.059555817395448685
Epoch: 192
Loss on hold-out set: 0.0061263001621945905
MeanAbsoluteError value on hold-out data: 0.05270642042160034
Epoch: 193
Loss on hold-out set: 0.0058329102665945695
MeanAbsoluteError value on hold-out data: 0.05141887813806534
Epoch: 194
Loss on hold-out set: 0.005960725859040394
MeanAbsoluteError value on hold-out data: 0.051969852298498154
Epoch: 195
Loss on hold-out set: 0.005708404136576543
MeanAbsoluteError value on hold-out data: 0.04637960344552994
Epoch: 196
Loss on hold-out set: 0.006076097194301455
MeanAbsoluteError value on hold-out data: 0.05409893020987511
Epoch: 197
Loss on hold-out set: 0.006916360977093542
MeanAbsoluteError value on hold-out data: 0.05610758438706398
Epoch: 198
Loss on hold-out set: 0.006419313521626846
MeanAbsoluteError value on hold-out data: 0.05149802193045616
Epoch: 199
Loss on hold-out set: 0.007771066794367998
MeanAbsoluteError value on hold-out data: 0.061447110027074814
Epoch: 200
Loss on hold-out set: 0.006372506122141586
MeanAbsoluteError value on hold-out data: 0.05398688092827797
Epoch: 201
Loss on hold-out set: 0.006791754026811472
MeanAbsoluteError value on hold-out data: 0.051693204790353775
Epoch: 202
Loss on hold-out set: 0.00488585438334236
MeanAbsoluteError value on hold-out data: 0.04791111499071121
Epoch: 203
Loss on hold-out set: 0.005789825491343723
MeanAbsoluteError value on hold-out data: 0.047494981437921524
Epoch: 204
Loss on hold-out set: 0.006333063923337154
MeanAbsoluteError value on hold-out data: 0.056408870965242386
Epoch: 205
Loss on hold-out set: 0.008106324729803754
MeanAbsoluteError value on hold-out data: 0.061298638582229614
Epoch: 206
Loss on hold-out set: 0.006141924872185643
MeanAbsoluteError value on hold-out data: 0.051933880895376205
Epoch: 207
Loss on hold-out set: 0.00481373856018763
MeanAbsoluteError value on hold-out data: 0.0441611185669899
Epoch: 208
Loss on hold-out set: 0.0058560822224918456
MeanAbsoluteError value on hold-out data: 0.044999994337558746
Epoch: 209
Loss on hold-out set: 0.00524188712542558
MeanAbsoluteError value on hold-out data: 0.05000927671790123
Epoch: 210
Loss on hold-out set: 0.005422158796327973
MeanAbsoluteError value on hold-out data: 0.05729157105088234
Epoch: 211
Loss on hold-out set: 0.006177528643380164
MeanAbsoluteError value on hold-out data: 0.05042240396142006
Epoch: 212
Loss on hold-out set: 0.006488979564317943
MeanAbsoluteError value on hold-out data: 0.055107299238443375
Epoch: 213
Loss on hold-out set: 0.005459354962161007
MeanAbsoluteError value on hold-out data: 0.0534757599234581
Epoch: 214
Loss on hold-out set: 0.00602254771939969
MeanAbsoluteError value on hold-out data: 0.0539521723985672
Epoch: 215
Loss on hold-out set: 0.004914290954873554
MeanAbsoluteError value on hold-out data: 0.04979735240340233
Epoch: 216
Loss on hold-out set: 0.0057084524948885175
MeanAbsoluteError value on hold-out data: 0.05512360855937004
Epoch: 217
Loss on hold-out set: 0.007456092486360208
MeanAbsoluteError value on hold-out data: 0.05351797863841057
Epoch: 218
Loss on hold-out set: 0.005051081709098071
MeanAbsoluteError value on hold-out data: 0.05029164254665375
Epoch: 219
Loss on hold-out set: 0.00839199979887589
MeanAbsoluteError value on hold-out data: 0.06088773161172867
Epoch: 220
Loss on hold-out set: 0.006158567666333463
MeanAbsoluteError value on hold-out data: 0.055864691734313965
Epoch: 221
Loss on hold-out set: 0.005481878768861
MeanAbsoluteError value on hold-out data: 0.05193381384015083
Epoch: 222
Loss on hold-out set: 0.007148871673148517
MeanAbsoluteError value on hold-out data: 0.06151261180639267
Epoch: 223
Loss on hold-out set: 0.0068746940753618745
MeanAbsoluteError value on hold-out data: 0.05898605287075043
Epoch: 224
Loss on hold-out set: 0.006765994494535813
MeanAbsoluteError value on hold-out data: 0.058078180998563766
Epoch: 225
Loss on hold-out set: 0.006017669202073624
MeanAbsoluteError value on hold-out data: 0.053133249282836914
Epoch: 226
Loss on hold-out set: 0.005810358484986385
MeanAbsoluteError value on hold-out data: 0.04884224757552147
Epoch: 227
Loss on hold-out set: 0.007050112202322404
MeanAbsoluteError value on hold-out data: 0.0605614073574543
Epoch: 228
Loss on hold-out set: 0.0086825766177897
MeanAbsoluteError value on hold-out data: 0.07197387516498566
Epoch: 229
Loss on hold-out set: 0.007901453691853308
MeanAbsoluteError value on hold-out data: 0.0595424510538578
Epoch: 230
Loss on hold-out set: 0.00593644152334156
MeanAbsoluteError value on hold-out data: 0.052927564829587936
Epoch: 231
Loss on hold-out set: 0.006086883318187718
MeanAbsoluteError value on hold-out data: 0.05030106008052826
Epoch: 232
Loss on hold-out set: 0.007545285446164934
MeanAbsoluteError value on hold-out data: 0.05280761420726776
Epoch: 233
Loss on hold-out set: 0.006773914895204239
MeanAbsoluteError value on hold-out data: 0.05033457279205322
Epoch: 234
Loss on hold-out set: 0.0065631207620945615
MeanAbsoluteError value on hold-out data: 0.05410261079668999
Epoch: 235
Loss on hold-out set: 0.006529461941681802
MeanAbsoluteError value on hold-out data: 0.06294094771146774
Epoch: 236
Loss on hold-out set: 0.005592491669200459
MeanAbsoluteError value on hold-out data: 0.04897747561335564
Epoch: 237
Loss on hold-out set: 0.005729787044018801
MeanAbsoluteError value on hold-out data: 0.04840024188160896
Early stopping at epoch 236
Returned to Spot: Validation loss: 0.005729787044018801
----------------------------------------------
spotPython tuning: 0.0006857007820623327 [###-------] 31.65% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.004691304195240165, 'lr_mult': 5.511635215296183, 'batch_size': 8, 'epochs': 512, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adam', 'sgd_momentum': 0.9064101434902031}
Epoch: 1
Loss on hold-out set: 0.025791122994728778
MeanAbsoluteError value on hold-out data: 0.1261587291955948
Epoch: 2
Loss on hold-out set: 0.022947351362458186
MeanAbsoluteError value on hold-out data: 0.11889862269163132
Epoch: 3
Loss on hold-out set: 0.017792978042148445
MeanAbsoluteError value on hold-out data: 0.10450602322816849
Epoch: 4
Loss on hold-out set: 0.012513358409418479
MeanAbsoluteError value on hold-out data: 0.0874844342470169
Epoch: 5
Loss on hold-out set: 0.00842424044017925
MeanAbsoluteError value on hold-out data: 0.07269322872161865
Epoch: 6
Loss on hold-out set: 0.006837702141829619
MeanAbsoluteError value on hold-out data: 0.06665275245904922
Epoch: 7
Loss on hold-out set: 0.005500648694578558
MeanAbsoluteError value on hold-out data: 0.06162538379430771
Epoch: 8
Loss on hold-out set: 0.00259455786343958
MeanAbsoluteError value on hold-out data: 0.041249267756938934
Epoch: 9
Loss on hold-out set: 0.003219782735916516
MeanAbsoluteError value on hold-out data: 0.033018212765455246
Epoch: 10
Loss on hold-out set: 0.0016988303221679463
MeanAbsoluteError value on hold-out data: 0.025611335411667824
Epoch: 11
Loss on hold-out set: 0.0017799653283681867
MeanAbsoluteError value on hold-out data: 0.026121048256754875
Epoch: 12
Loss on hold-out set: 0.0007669392790543689
MeanAbsoluteError value on hold-out data: 0.012934486381709576
Epoch: 13
Loss on hold-out set: 0.0013875564358099119
MeanAbsoluteError value on hold-out data: 0.021026182919740677
Epoch: 14
Loss on hold-out set: 0.0007130001274498156
MeanAbsoluteError value on hold-out data: 0.016555042937397957
Epoch: 15
Loss on hold-out set: 0.0007931532088964319
MeanAbsoluteError value on hold-out data: 0.015131451189517975
Epoch: 16
Loss on hold-out set: 0.0010097378714195465
MeanAbsoluteError value on hold-out data: 0.01539639662951231
Epoch: 17
Loss on hold-out set: 0.0011358296927889903
MeanAbsoluteError value on hold-out data: 0.01165546104311943
Epoch: 18
Loss on hold-out set: 0.0008559881816357741
MeanAbsoluteError value on hold-out data: 0.014023927040398121
Epoch: 19
Loss on hold-out set: 0.0017959190253781056
MeanAbsoluteError value on hold-out data: 0.030461177229881287
Epoch: 20
Loss on hold-out set: 0.001121929562175769
MeanAbsoluteError value on hold-out data: 0.02254498563706875
Epoch: 21
Loss on hold-out set: 0.0005190080028114608
MeanAbsoluteError value on hold-out data: 0.011943396180868149
Epoch: 22
Loss on hold-out set: 0.0008838726782031651
MeanAbsoluteError value on hold-out data: 0.01661493070423603
Epoch: 23
Loss on hold-out set: 0.0007407699569835371
MeanAbsoluteError value on hold-out data: 0.009936410933732986
Epoch: 24
Loss on hold-out set: 0.0006707512322081081
MeanAbsoluteError value on hold-out data: 0.010990646667778492
Epoch: 25
Loss on hold-out set: 0.0008904047787454099
MeanAbsoluteError value on hold-out data: 0.01084232795983553
Epoch: 26
Loss on hold-out set: 0.0009046397349984067
MeanAbsoluteError value on hold-out data: 0.01763169839978218
Epoch: 27
Loss on hold-out set: 0.0005797242795922916
MeanAbsoluteError value on hold-out data: 0.010826795361936092
Epoch: 28
Loss on hold-out set: 0.0029620350473315306
MeanAbsoluteError value on hold-out data: 0.051883552223443985
Epoch: 29
Loss on hold-out set: 0.0012854101311715663
MeanAbsoluteError value on hold-out data: 0.02261538617312908
Epoch: 30
Loss on hold-out set: 0.0028629270581356984
MeanAbsoluteError value on hold-out data: 0.03665533661842346
Epoch: 31
Loss on hold-out set: 0.0006216744594128517
MeanAbsoluteError value on hold-out data: 0.01074225828051567
Epoch: 32
Loss on hold-out set: 0.0008340150410444231
MeanAbsoluteError value on hold-out data: 0.01159267220646143
Epoch: 33
Loss on hold-out set: 0.0006318904220997387
MeanAbsoluteError value on hold-out data: 0.011214536614716053
Epoch: 34
Loss on hold-out set: 0.0007772204530977577
MeanAbsoluteError value on hold-out data: 0.01189816277474165
Epoch: 35
Loss on hold-out set: 0.0007090179577445317
MeanAbsoluteError value on hold-out data: 0.01894940622150898
Epoch: 36
Loss on hold-out set: 0.0016976551529583766
MeanAbsoluteError value on hold-out data: 0.03078959509730339
Epoch: 37
Loss on hold-out set: 0.0011227982047689454
MeanAbsoluteError value on hold-out data: 0.016361713409423828
Epoch: 38
Loss on hold-out set: 0.0006069343414346326
MeanAbsoluteError value on hold-out data: 0.010409965179860592
Epoch: 39
Loss on hold-out set: 0.00034463029020882557
MeanAbsoluteError value on hold-out data: 0.01144382543861866
Epoch: 40
Loss on hold-out set: 0.0005712373610405944
MeanAbsoluteError value on hold-out data: 0.011915442533791065
Epoch: 41
Loss on hold-out set: 0.0004771833726791604
MeanAbsoluteError value on hold-out data: 0.010336500592529774
Epoch: 42
Loss on hold-out set: 0.0003634667434892579
MeanAbsoluteError value on hold-out data: 0.008459847420454025
Epoch: 43
Loss on hold-out set: 0.000675432962662183
MeanAbsoluteError value on hold-out data: 0.010251394473016262
Epoch: 44
Loss on hold-out set: 0.0006188815643183357
MeanAbsoluteError value on hold-out data: 0.010171318426728249
Epoch: 45
Loss on hold-out set: 0.0005017690861055407
MeanAbsoluteError value on hold-out data: 0.012989675626158714
Epoch: 46
Loss on hold-out set: 0.002734649607813672
MeanAbsoluteError value on hold-out data: 0.04965049400925636
Epoch: 47
Loss on hold-out set: 0.0010640834738488163
MeanAbsoluteError value on hold-out data: 0.017536332830786705
Epoch: 48
Loss on hold-out set: 0.0012198319648297528
MeanAbsoluteError value on hold-out data: 0.015990063548088074
Epoch: 49
Loss on hold-out set: 0.0011256088644071688
MeanAbsoluteError value on hold-out data: 0.009985462762415409
Epoch: 50
Loss on hold-out set: 0.00044117888020130184
MeanAbsoluteError value on hold-out data: 0.007929826155304909
Epoch: 51
Loss on hold-out set: 0.0006151418264153108
MeanAbsoluteError value on hold-out data: 0.011941828764975071
Epoch: 52
Loss on hold-out set: 0.00036199899334046916
MeanAbsoluteError value on hold-out data: 0.008391653187572956
Epoch: 53
Loss on hold-out set: 0.00140538890187408
MeanAbsoluteError value on hold-out data: 0.024288641288876534
Epoch: 54
Loss on hold-out set: 0.000717717491768685
MeanAbsoluteError value on hold-out data: 0.010222765617072582
Epoch: 55
Loss on hold-out set: 0.0010774704525446349
MeanAbsoluteError value on hold-out data: 0.017909111455082893
Epoch: 56
Loss on hold-out set: 0.0007119190604977408
MeanAbsoluteError value on hold-out data: 0.013087083585560322
Epoch: 57
Loss on hold-out set: 0.0008700344053642383
MeanAbsoluteError value on hold-out data: 0.01666291430592537
Epoch: 58
Loss on hold-out set: 0.001074749774871682
MeanAbsoluteError value on hold-out data: 0.013702486641705036
Epoch: 59
Loss on hold-out set: 0.000472329109195351
MeanAbsoluteError value on hold-out data: 0.007513747084885836
Epoch: 60
Loss on hold-out set: 0.0032730874188832545
MeanAbsoluteError value on hold-out data: 0.0547470785677433
Epoch: 61
Loss on hold-out set: 0.0008499843516849643
MeanAbsoluteError value on hold-out data: 0.018359990790486336
Epoch: 62
Loss on hold-out set: 0.0005832911114052159
MeanAbsoluteError value on hold-out data: 0.012449037283658981
Epoch: 63
Loss on hold-out set: 0.0004872749642871847
MeanAbsoluteError value on hold-out data: 0.012710215523838997
Epoch: 64
Loss on hold-out set: 0.00042488808721349126
MeanAbsoluteError value on hold-out data: 0.009216442704200745
Epoch: 65
Loss on hold-out set: 0.0006065545102333808
MeanAbsoluteError value on hold-out data: 0.009512683376669884
Epoch: 66
Loss on hold-out set: 0.0007435025956606536
MeanAbsoluteError value on hold-out data: 0.009891029447317123
Epoch: 67
Loss on hold-out set: 0.00047468021801633817
MeanAbsoluteError value on hold-out data: 0.009264683350920677
Epoch: 68
Loss on hold-out set: 0.0007378955387091418
MeanAbsoluteError value on hold-out data: 0.009226790629327297
Epoch: 69
Loss on hold-out set: 0.0004419159712549452
MeanAbsoluteError value on hold-out data: 0.009305991232395172
Epoch: 70
Loss on hold-out set: 0.0003380203404384175
MeanAbsoluteError value on hold-out data: 0.007981420494616032
Epoch: 71
Loss on hold-out set: 0.0006183755191925325
MeanAbsoluteError value on hold-out data: 0.009680358693003654
Epoch: 72
Loss on hold-out set: 0.0009674775123322002
MeanAbsoluteError value on hold-out data: 0.01469464786350727
Epoch: 73
Loss on hold-out set: 0.0008934768295722805
MeanAbsoluteError value on hold-out data: 0.01491362601518631
Epoch: 74
Loss on hold-out set: 0.0002988124369949219
MeanAbsoluteError value on hold-out data: 0.006959257181733847
Epoch: 75
Loss on hold-out set: 0.0006761363558780431
MeanAbsoluteError value on hold-out data: 0.009427467361092567
Epoch: 76
Loss on hold-out set: 0.0004520301959377991
MeanAbsoluteError value on hold-out data: 0.008058520033955574
Epoch: 77
Loss on hold-out set: 0.00023904555183961698
MeanAbsoluteError value on hold-out data: 0.007814529351890087
Epoch: 78
Loss on hold-out set: 0.00026673004930145047
MeanAbsoluteError value on hold-out data: 0.009088304825127125
Epoch: 79
Loss on hold-out set: 0.0005909840992719756
MeanAbsoluteError value on hold-out data: 0.00886618997901678
Epoch: 80
Loss on hold-out set: 0.000955378611012604
MeanAbsoluteError value on hold-out data: 0.011429987847805023
Epoch: 81
Loss on hold-out set: 0.0038016447674875196
MeanAbsoluteError value on hold-out data: 0.06026860699057579
Epoch: 82
Loss on hold-out set: 0.0006873093156364599
MeanAbsoluteError value on hold-out data: 0.017831601202487946
Epoch: 83
Loss on hold-out set: 0.000629021265464608
MeanAbsoluteError value on hold-out data: 0.008334069512784481
Epoch: 84
Loss on hold-out set: 0.0003568929304683958
MeanAbsoluteError value on hold-out data: 0.008547917939722538
Epoch: 85
Loss on hold-out set: 0.001108256895541241
MeanAbsoluteError value on hold-out data: 0.012582724913954735
Epoch: 86
Loss on hold-out set: 0.0009393656751183842
MeanAbsoluteError value on hold-out data: 0.02135811187326908
Epoch: 87
Loss on hold-out set: 0.0007039824540697737
MeanAbsoluteError value on hold-out data: 0.010573938488960266
Epoch: 88
Loss on hold-out set: 0.00022711649339008115
MeanAbsoluteError value on hold-out data: 0.007035094778984785
Epoch: 89
Loss on hold-out set: 0.0012948460812606897
MeanAbsoluteError value on hold-out data: 0.02808370627462864
Epoch: 90
Loss on hold-out set: 0.0010038795544938981
MeanAbsoluteError value on hold-out data: 0.013566880486905575
Epoch: 91
Loss on hold-out set: 0.0007510354377078137
MeanAbsoluteError value on hold-out data: 0.019771933555603027
Epoch: 92
Loss on hold-out set: 0.000286352766651314
MeanAbsoluteError value on hold-out data: 0.007753050420433283
Epoch: 93
Loss on hold-out set: 0.0005055534685754394
MeanAbsoluteError value on hold-out data: 0.007972517982125282
Epoch: 94
Loss on hold-out set: 0.00034427978805165606
MeanAbsoluteError value on hold-out data: 0.008110587485134602
Epoch: 95
Loss on hold-out set: 0.0004986188500400825
MeanAbsoluteError value on hold-out data: 0.007847112603485584
Epoch: 96
Loss on hold-out set: 0.0010808442362567324
MeanAbsoluteError value on hold-out data: 0.011410393752157688
Epoch: 97
Loss on hold-out set: 0.0007314177645113025
MeanAbsoluteError value on hold-out data: 0.017644038423895836
Epoch: 98
Loss on hold-out set: 0.0005212251106441775
MeanAbsoluteError value on hold-out data: 0.007879816927015781
Epoch: 99
Loss on hold-out set: 0.0008021714349381096
MeanAbsoluteError value on hold-out data: 0.010488546453416348
Epoch: 100
Loss on hold-out set: 0.0005455563148547968
MeanAbsoluteError value on hold-out data: 0.013800856657326221
Epoch: 101
Loss on hold-out set: 0.00026933871882456036
MeanAbsoluteError value on hold-out data: 0.009733588434755802
Epoch: 102
Loss on hold-out set: 0.000730160435762771
MeanAbsoluteError value on hold-out data: 0.012689598836004734
Epoch: 103
Loss on hold-out set: 0.0005448184888097641
MeanAbsoluteError value on hold-out data: 0.0139840142801404
Epoch: 104
Loss on hold-out set: 0.00037650087075522415
MeanAbsoluteError value on hold-out data: 0.010537936352193356
Epoch: 105
Loss on hold-out set: 0.0002398434562205933
MeanAbsoluteError value on hold-out data: 0.006344211753457785
Epoch: 106
Loss on hold-out set: 0.0008255914949945451
MeanAbsoluteError value on hold-out data: 0.00878373347222805
Epoch: 107
Loss on hold-out set: 0.00045538566734505464
MeanAbsoluteError value on hold-out data: 0.010571020655333996
Epoch: 108
Loss on hold-out set: 0.0008240654026035612
MeanAbsoluteError value on hold-out data: 0.02256735786795616
Epoch: 109
Loss on hold-out set: 0.0003998997611377394
MeanAbsoluteError value on hold-out data: 0.00902149174362421
Epoch: 110
Loss on hold-out set: 0.0006924301126338449
MeanAbsoluteError value on hold-out data: 0.012349667027592659
Epoch: 111
Loss on hold-out set: 0.0004704003748596925
MeanAbsoluteError value on hold-out data: 0.009317783638834953
Epoch: 112
Loss on hold-out set: 0.00044973362558888957
MeanAbsoluteError value on hold-out data: 0.013997422531247139
Epoch: 113
Loss on hold-out set: 0.000273080113354234
MeanAbsoluteError value on hold-out data: 0.008153418079018593
Epoch: 114
Loss on hold-out set: 0.0004747497129014128
MeanAbsoluteError value on hold-out data: 0.010056303814053535
Epoch: 115
Loss on hold-out set: 0.00018736509392319452
MeanAbsoluteError value on hold-out data: 0.005714559927582741
Epoch: 116
Loss on hold-out set: 0.0007928716639932981
MeanAbsoluteError value on hold-out data: 0.011295796371996403
Epoch: 117
Loss on hold-out set: 0.00036512268812466094
MeanAbsoluteError value on hold-out data: 0.0122483866289258
Epoch: 118
Loss on hold-out set: 0.0014118903916249493
MeanAbsoluteError value on hold-out data: 0.014411293901503086
Epoch: 119
Loss on hold-out set: 0.0003586827011938447
MeanAbsoluteError value on hold-out data: 0.006891609635204077
Epoch: 120
Loss on hold-out set: 0.0004219102506316344
MeanAbsoluteError value on hold-out data: 0.00691584125161171
Epoch: 121
Loss on hold-out set: 0.004657773748285284
MeanAbsoluteError value on hold-out data: 0.06731889396905899
Epoch: 122
Loss on hold-out set: 0.000370439877434891
MeanAbsoluteError value on hold-out data: 0.013091128319501877
Epoch: 123
Loss on hold-out set: 0.00024567566439552476
MeanAbsoluteError value on hold-out data: 0.007505739573389292
Epoch: 124
Loss on hold-out set: 0.0008697133332469477
MeanAbsoluteError value on hold-out data: 0.01738990843296051
Epoch: 125
Loss on hold-out set: 0.0002726666463343607
MeanAbsoluteError value on hold-out data: 0.007005759049206972
Epoch: 126
Loss on hold-out set: 0.0004499255349066133
MeanAbsoluteError value on hold-out data: 0.011633425951004028
Epoch: 127
Loss on hold-out set: 0.0005130760886171821
MeanAbsoluteError value on hold-out data: 0.010581695474684238
Epoch: 128
Loss on hold-out set: 0.0011324745145621388
MeanAbsoluteError value on hold-out data: 0.008663719519972801
Epoch: 129
Loss on hold-out set: 0.0003868985691461172
MeanAbsoluteError value on hold-out data: 0.0057949465699493885
Epoch: 130
Loss on hold-out set: 0.0007421784510035266
MeanAbsoluteError value on hold-out data: 0.009518157690763474
Epoch: 131
Loss on hold-out set: 0.0009949910552103048
MeanAbsoluteError value on hold-out data: 0.015233699232339859
Epoch: 132
Loss on hold-out set: 0.0003825139069225483
MeanAbsoluteError value on hold-out data: 0.007535263895988464
Epoch: 133
Loss on hold-out set: 0.0004957348097664898
MeanAbsoluteError value on hold-out data: 0.009012148715555668
Epoch: 134
Loss on hold-out set: 0.00020528012941075472
MeanAbsoluteError value on hold-out data: 0.0063662463799119
Epoch: 135
Loss on hold-out set: 0.005022847430633479
MeanAbsoluteError value on hold-out data: 0.06962652504444122
Epoch: 136
Loss on hold-out set: 0.0003749257561331002
MeanAbsoluteError value on hold-out data: 0.015027599409222603
Epoch: 137
Loss on hold-out set: 0.00013931817396664164
MeanAbsoluteError value on hold-out data: 0.00604357710108161
Epoch: 138
Loss on hold-out set: 0.0003608828726435987
MeanAbsoluteError value on hold-out data: 0.011171095073223114
Epoch: 139
Loss on hold-out set: 0.00034969928435059144
MeanAbsoluteError value on hold-out data: 0.007664968259632587
Epoch: 140
Loss on hold-out set: 0.00038329357640146843
MeanAbsoluteError value on hold-out data: 0.00987306796014309
Epoch: 141
Loss on hold-out set: 0.00026614977775209
MeanAbsoluteError value on hold-out data: 0.012798178941011429
Epoch: 142
Loss on hold-out set: 0.00021353545221963462
MeanAbsoluteError value on hold-out data: 0.007706071715801954
Epoch: 143
Loss on hold-out set: 0.0005109550023151218
MeanAbsoluteError value on hold-out data: 0.01267787255346775
Epoch: 144
Loss on hold-out set: 0.000639312628424561
MeanAbsoluteError value on hold-out data: 0.010368186980485916
Epoch: 145
Loss on hold-out set: 0.0004497199854660338
MeanAbsoluteError value on hold-out data: 0.01811395399272442
Epoch: 146
Loss on hold-out set: 0.00016803509510952464
MeanAbsoluteError value on hold-out data: 0.006678579840809107
Epoch: 147
Loss on hold-out set: 0.0005100018067751259
MeanAbsoluteError value on hold-out data: 0.006282835267484188
Epoch: 148
Loss on hold-out set: 0.0003197579513461709
MeanAbsoluteError value on hold-out data: 0.01239140797406435
Epoch: 149
Loss on hold-out set: 0.00021987661070373802
MeanAbsoluteError value on hold-out data: 0.008229246363043785
Epoch: 150
Loss on hold-out set: 0.00026950783505622224
MeanAbsoluteError value on hold-out data: 0.010655024088919163
Epoch: 151
Loss on hold-out set: 0.0014580742603069858
MeanAbsoluteError value on hold-out data: 0.03719280660152435
Epoch: 152
Loss on hold-out set: 0.0003452900836189081
MeanAbsoluteError value on hold-out data: 0.014538097195327282
Epoch: 153
Loss on hold-out set: 0.00033885002968465986
MeanAbsoluteError value on hold-out data: 0.007312779314815998
Epoch: 154
Loss on hold-out set: 0.0013329005236492346
MeanAbsoluteError value on hold-out data: 0.034388136118650436
Epoch: 155
Loss on hold-out set: 0.0004272400585346316
MeanAbsoluteError value on hold-out data: 0.016944611445069313
Epoch: 156
Loss on hold-out set: 0.00031576264781937137
MeanAbsoluteError value on hold-out data: 0.010144085623323917
Epoch: 157
Loss on hold-out set: 0.00041940750749123063
MeanAbsoluteError value on hold-out data: 0.008375946432352066
Epoch: 158
Loss on hold-out set: 0.0006548128999144721
MeanAbsoluteError value on hold-out data: 0.020112497732043266
Epoch: 159
Loss on hold-out set: 0.00013743403056459531
MeanAbsoluteError value on hold-out data: 0.005544071551412344
Epoch: 160
Loss on hold-out set: 0.00016616334753387875
MeanAbsoluteError value on hold-out data: 0.006868201773613691
Epoch: 161
Loss on hold-out set: 0.0003148400824820304
MeanAbsoluteError value on hold-out data: 0.009826124645769596
Epoch: 162
Loss on hold-out set: 0.0006405450851496809
MeanAbsoluteError value on hold-out data: 0.00918757077306509
Epoch: 163
Loss on hold-out set: 0.00024299072759659843
MeanAbsoluteError value on hold-out data: 0.006173740141093731
Epoch: 164
Loss on hold-out set: 0.0013012633426114917
MeanAbsoluteError value on hold-out data: 0.03518712520599365
Epoch: 165
Loss on hold-out set: 0.00018220677980264699
MeanAbsoluteError value on hold-out data: 0.008063282817602158
Epoch: 166
Loss on hold-out set: 0.0003884498826090222
MeanAbsoluteError value on hold-out data: 0.01206488348543644
Epoch: 167
Loss on hold-out set: 0.0005201905807648712
MeanAbsoluteError value on hold-out data: 0.012205272912979126
Epoch: 168
Loss on hold-out set: 0.00016605194392277074
MeanAbsoluteError value on hold-out data: 0.009693680331110954
Epoch: 169
Loss on hold-out set: 0.00020329385954123848
MeanAbsoluteError value on hold-out data: 0.009513407945632935
Epoch: 170
Loss on hold-out set: 0.0005088268717372557
MeanAbsoluteError value on hold-out data: 0.011023428291082382
Epoch: 171
Loss on hold-out set: 0.0003110324304495742
MeanAbsoluteError value on hold-out data: 0.013025117106735706
Epoch: 172
Loss on hold-out set: 0.0001780478420235005
MeanAbsoluteError value on hold-out data: 0.008368521928787231
Epoch: 173
Loss on hold-out set: 0.0007687977666041421
MeanAbsoluteError value on hold-out data: 0.01899614743888378
Epoch: 174
Loss on hold-out set: 0.000596765576741937
MeanAbsoluteError value on hold-out data: 0.01077719684690237
Epoch: 175
Loss on hold-out set: 0.000752879753188034
MeanAbsoluteError value on hold-out data: 0.023458942770957947
Epoch: 176
Loss on hold-out set: 0.00025872864781424713
MeanAbsoluteError value on hold-out data: 0.008312953636050224
Epoch: 177
Loss on hold-out set: 0.00035029251911940885
MeanAbsoluteError value on hold-out data: 0.014641531743109226
Epoch: 178
Loss on hold-out set: 0.0009067377211881409
MeanAbsoluteError value on hold-out data: 0.02430041879415512
Epoch: 179
Loss on hold-out set: 0.00024341860377094954
MeanAbsoluteError value on hold-out data: 0.013378183357417583
Epoch: 180
Loss on hold-out set: 0.00030900224038831717
MeanAbsoluteError value on hold-out data: 0.011093128472566605
Epoch: 181
Loss on hold-out set: 0.00022587524816978992
MeanAbsoluteError value on hold-out data: 0.0070070186629891396
Epoch: 182
Loss on hold-out set: 0.0007940351313568259
MeanAbsoluteError value on hold-out data: 0.019767552614212036
Epoch: 183
Loss on hold-out set: 0.0003783285597149332
MeanAbsoluteError value on hold-out data: 0.016888761892914772
Epoch: 184
Loss on hold-out set: 0.0001401360131192058
MeanAbsoluteError value on hold-out data: 0.006016251631081104
Epoch: 185
Loss on hold-out set: 0.0002274393891160511
MeanAbsoluteError value on hold-out data: 0.008134509436786175
Epoch: 186
Loss on hold-out set: 0.0008006907890759114
MeanAbsoluteError value on hold-out data: 0.02495172806084156
Epoch: 187
Loss on hold-out set: 0.000343657999206028
MeanAbsoluteError value on hold-out data: 0.013444358482956886
Epoch: 188
Loss on hold-out set: 0.0001543986041892104
MeanAbsoluteError value on hold-out data: 0.006967178080230951
Epoch: 189
Loss on hold-out set: 0.0005511229760546293
MeanAbsoluteError value on hold-out data: 0.0071230316534638405
Epoch: 190
Loss on hold-out set: 0.000573227669902783
MeanAbsoluteError value on hold-out data: 0.01829879730939865
Epoch: 191
Loss on hold-out set: 0.00021564727586864088
MeanAbsoluteError value on hold-out data: 0.008732500486075878
Epoch: 192
Loss on hold-out set: 0.00012305614913394063
MeanAbsoluteError value on hold-out data: 0.007568701170384884
Epoch: 193
Loss on hold-out set: 0.00027155813189126904
MeanAbsoluteError value on hold-out data: 0.00891818106174469
Epoch: 194
Loss on hold-out set: 0.00016357313709130196
MeanAbsoluteError value on hold-out data: 0.005420558620244265
Epoch: 195
Loss on hold-out set: 0.0003775209989714169
MeanAbsoluteError value on hold-out data: 0.007757238578051329
Epoch: 196
Loss on hold-out set: 0.0003794064464991128
MeanAbsoluteError value on hold-out data: 0.017053062096238136
Epoch: 197
Loss on hold-out set: 0.00028911643408048945
MeanAbsoluteError value on hold-out data: 0.013695449568331242
Epoch: 198
Loss on hold-out set: 9.166472967823019e-05
MeanAbsoluteError value on hold-out data: 0.004219814669340849
Epoch: 199
Loss on hold-out set: 0.0003114202758488797
MeanAbsoluteError value on hold-out data: 0.009934884496033192
Epoch: 200
Loss on hold-out set: 0.00020020677359417803
MeanAbsoluteError value on hold-out data: 0.00784205086529255
Epoch: 201
Loss on hold-out set: 0.00048291756272527363
MeanAbsoluteError value on hold-out data: 0.012559827417135239
Epoch: 202
Loss on hold-out set: 0.0003497593798293134
MeanAbsoluteError value on hold-out data: 0.00660167308524251
Epoch: 203
Loss on hold-out set: 0.00035350332549760903
MeanAbsoluteError value on hold-out data: 0.010356769897043705
Epoch: 204
Loss on hold-out set: 0.00012272423902303623
MeanAbsoluteError value on hold-out data: 0.007152504753321409
Epoch: 205
Loss on hold-out set: 0.00011878566865083198
MeanAbsoluteError value on hold-out data: 0.00515660410746932
Epoch: 206
Loss on hold-out set: 0.0008650093376146335
MeanAbsoluteError value on hold-out data: 0.02275390364229679
Epoch: 207
Loss on hold-out set: 0.00021438016226152525
MeanAbsoluteError value on hold-out data: 0.006134572438895702
Epoch: 208
Loss on hold-out set: 0.0001997241298867218
MeanAbsoluteError value on hold-out data: 0.010277257300913334
Epoch: 209
Loss on hold-out set: 0.0001936544498388876
MeanAbsoluteError value on hold-out data: 0.008863355033099651
Epoch: 210
Loss on hold-out set: 0.0001374720058576809
MeanAbsoluteError value on hold-out data: 0.00553917046636343
Epoch: 211
Loss on hold-out set: 0.0004747806183571045
MeanAbsoluteError value on hold-out data: 0.018559258431196213
Epoch: 212
Loss on hold-out set: 0.00015283747320369768
MeanAbsoluteError value on hold-out data: 0.006990350782871246
Epoch: 213
Loss on hold-out set: 0.00030687462183203406
MeanAbsoluteError value on hold-out data: 0.008899958804249763
Epoch: 214
Loss on hold-out set: 0.0002701894715612166
MeanAbsoluteError value on hold-out data: 0.009315933100879192
Epoch: 215
Loss on hold-out set: 0.00017720963978717919
MeanAbsoluteError value on hold-out data: 0.005533397197723389
Epoch: 216
Loss on hold-out set: 7.831731839982432e-05
MeanAbsoluteError value on hold-out data: 0.005581841804087162
Epoch: 217
Loss on hold-out set: 0.0002480871180523536
MeanAbsoluteError value on hold-out data: 0.009284927509725094
Epoch: 218
Loss on hold-out set: 0.00034710622486799317
MeanAbsoluteError value on hold-out data: 0.012129519134759903
Epoch: 219
Loss on hold-out set: 7.736600378537237e-05
MeanAbsoluteError value on hold-out data: 0.004807889461517334
Epoch: 220
Loss on hold-out set: 0.00019261897757946587
MeanAbsoluteError value on hold-out data: 0.009495158679783344
Epoch: 221
Loss on hold-out set: 0.0002544180500224588
MeanAbsoluteError value on hold-out data: 0.010582455433905125
Epoch: 222
Loss on hold-out set: 0.0004002074626776831
MeanAbsoluteError value on hold-out data: 0.018246402963995934
Epoch: 223
Loss on hold-out set: 0.0003492816676474544
MeanAbsoluteError value on hold-out data: 0.013903770595788956
Epoch: 224
Loss on hold-out set: 0.0003874125832674891
MeanAbsoluteError value on hold-out data: 0.006200868170708418
Epoch: 225
Loss on hold-out set: 0.00012200216779571125
MeanAbsoluteError value on hold-out data: 0.007998019456863403
Epoch: 226
Loss on hold-out set: 0.0003390903465946107
MeanAbsoluteError value on hold-out data: 0.01699848659336567
Epoch: 227
Loss on hold-out set: 0.00015353968171295587
MeanAbsoluteError value on hold-out data: 0.009007127955555916
Epoch: 228
Loss on hold-out set: 0.000527838676996333
MeanAbsoluteError value on hold-out data: 0.015819108113646507
Epoch: 229
Loss on hold-out set: 0.0004547991460353124
MeanAbsoluteError value on hold-out data: 0.00895383208990097
Epoch: 230
Loss on hold-out set: 0.0004587118493969013
MeanAbsoluteError value on hold-out data: 0.016769837588071823
Epoch: 231
Loss on hold-out set: 0.0002845673778294536
MeanAbsoluteError value on hold-out data: 0.005614529363811016
Epoch: 232
Loss on hold-out set: 0.000470311768271801
MeanAbsoluteError value on hold-out data: 0.017300458624958992
Epoch: 233
Loss on hold-out set: 0.0006695362815088103
MeanAbsoluteError value on hold-out data: 0.019294893369078636
Epoch: 234
Loss on hold-out set: 0.00015626826236831746
MeanAbsoluteError value on hold-out data: 0.007752595003694296
Epoch: 235
Loss on hold-out set: 0.0003602665706598361
MeanAbsoluteError value on hold-out data: 0.009558944031596184
Epoch: 236
Loss on hold-out set: 0.00028722931050364613
MeanAbsoluteError value on hold-out data: 0.013320665806531906
Epoch: 237
Loss on hold-out set: 9.87455413882057e-05
MeanAbsoluteError value on hold-out data: 0.0057541741989552975
Epoch: 238
Loss on hold-out set: 0.00028396598339129825
MeanAbsoluteError value on hold-out data: 0.013045595027506351
Epoch: 239
Loss on hold-out set: 0.0006983093944176002
MeanAbsoluteError value on hold-out data: 0.014838636852800846
Epoch: 240
Loss on hold-out set: 0.0002653139576738651
MeanAbsoluteError value on hold-out data: 0.013524462468922138
Epoch: 241
Loss on hold-out set: 0.0002045505656209762
MeanAbsoluteError value on hold-out data: 0.010274583473801613
Epoch: 242
Loss on hold-out set: 0.00035507681049669993
MeanAbsoluteError value on hold-out data: 0.008768339641392231
Epoch: 243
Loss on hold-out set: 8.381228461698093e-05
MeanAbsoluteError value on hold-out data: 0.004956372547894716
Epoch: 244
Loss on hold-out set: 0.0001872456166318826
MeanAbsoluteError value on hold-out data: 0.010776353068649769
Epoch: 245
Loss on hold-out set: 0.00043141509262281224
MeanAbsoluteError value on hold-out data: 0.018947813659906387
Epoch: 246
Loss on hold-out set: 0.0002659850814732061
MeanAbsoluteError value on hold-out data: 0.013607821427285671
Epoch: 247
Loss on hold-out set: 0.0002763331581502969
MeanAbsoluteError value on hold-out data: 0.010208056308329105
Epoch: 248
Loss on hold-out set: 0.0003743910998118257
MeanAbsoluteError value on hold-out data: 0.011130847036838531
Epoch: 249
Loss on hold-out set: 0.0002789438026172176
MeanAbsoluteError value on hold-out data: 0.00983892846852541
Epoch: 250
Loss on hold-out set: 0.00036346907826986064
MeanAbsoluteError value on hold-out data: 0.017092851921916008
Epoch: 251
Loss on hold-out set: 0.00028760168822229487
MeanAbsoluteError value on hold-out data: 0.006164254155009985
Epoch: 252
Loss on hold-out set: 0.00012918309249997898
MeanAbsoluteError value on hold-out data: 0.009205766953527927
Epoch: 253
Loss on hold-out set: 0.00024548661378120365
MeanAbsoluteError value on hold-out data: 0.010500320233404636
Epoch: 254
Loss on hold-out set: 0.00048469522153027356
MeanAbsoluteError value on hold-out data: 0.01967654936015606
Epoch: 255
Loss on hold-out set: 0.0003750702320829939
MeanAbsoluteError value on hold-out data: 0.009175888262689114
Epoch: 256
Loss on hold-out set: 0.00016761731117903285
MeanAbsoluteError value on hold-out data: 0.0077552469447255135
Epoch: 257
Loss on hold-out set: 0.00023595946846686084
MeanAbsoluteError value on hold-out data: 0.011196664534509182
Epoch: 258
Loss on hold-out set: 0.00020154205891518168
MeanAbsoluteError value on hold-out data: 0.012093956582248211
Epoch: 259
Loss on hold-out set: 0.0004335280682425946
MeanAbsoluteError value on hold-out data: 0.012871544808149338
Epoch: 260
Loss on hold-out set: 0.00017715917869951992
MeanAbsoluteError value on hold-out data: 0.007326214108616114
Epoch: 261
Loss on hold-out set: 0.0003000997648517736
MeanAbsoluteError value on hold-out data: 0.00918196514248848
Epoch: 262
Loss on hold-out set: 0.00017512794281509216
MeanAbsoluteError value on hold-out data: 0.008018283173441887
Epoch: 263
Loss on hold-out set: 0.00016311321452408984
MeanAbsoluteError value on hold-out data: 0.007303135469555855
Epoch: 264
Loss on hold-out set: 0.00011343342363321234
MeanAbsoluteError value on hold-out data: 0.006034344434738159
Epoch: 265
Loss on hold-out set: 0.00022177381355217412
MeanAbsoluteError value on hold-out data: 0.011670541018247604
Epoch: 266
Loss on hold-out set: 0.00037916044656364985
MeanAbsoluteError value on hold-out data: 0.012087907642126083
Epoch: 267
Loss on hold-out set: 0.00012835340957233137
MeanAbsoluteError value on hold-out data: 0.0070470478385686874
Epoch: 268
Loss on hold-out set: 0.0003669645497881758
MeanAbsoluteError value on hold-out data: 0.01396713126450777
Epoch: 269
Loss on hold-out set: 0.00017784097010582243
MeanAbsoluteError value on hold-out data: 0.01085994578897953
Epoch: 270
Loss on hold-out set: 0.0002177346061791085
MeanAbsoluteError value on hold-out data: 0.008474563248455524
Epoch: 271
Loss on hold-out set: 0.0003826248764294417
MeanAbsoluteError value on hold-out data: 0.009066580794751644
Epoch: 272
Loss on hold-out set: 0.0001858183239547591
MeanAbsoluteError value on hold-out data: 0.008650451898574829
Epoch: 273
Loss on hold-out set: 0.0002951266111554823
MeanAbsoluteError value on hold-out data: 0.014585339464247227
Epoch: 274
Loss on hold-out set: 0.00020990256789924674
MeanAbsoluteError value on hold-out data: 0.010971525683999062
Epoch: 275
Loss on hold-out set: 0.00012698977466722058
MeanAbsoluteError value on hold-out data: 0.005261833779513836
Epoch: 276
Loss on hold-out set: 0.0001298196875184562
MeanAbsoluteError value on hold-out data: 0.004215689841657877
Epoch: 277
Loss on hold-out set: 0.00017128573323900223
MeanAbsoluteError value on hold-out data: 0.009524237364530563
Epoch: 278
Loss on hold-out set: 0.00016711697753635235
MeanAbsoluteError value on hold-out data: 0.008319946937263012
Epoch: 279
Loss on hold-out set: 0.0012459017728504382
MeanAbsoluteError value on hold-out data: 0.0340825691819191
Epoch: 280
Loss on hold-out set: 0.00032175341819215406
MeanAbsoluteError value on hold-out data: 0.008679252117872238
Epoch: 281
Loss on hold-out set: 0.00019489642593390797
MeanAbsoluteError value on hold-out data: 0.010005219839513302
Epoch: 282
Loss on hold-out set: 0.00014199671440301724
MeanAbsoluteError value on hold-out data: 0.0068619996309280396
Epoch: 283
Loss on hold-out set: 0.0002620965738778499
MeanAbsoluteError value on hold-out data: 0.00788070261478424
Epoch: 284
Loss on hold-out set: 7.286611022257268e-05
MeanAbsoluteError value on hold-out data: 0.005089654587209225
Epoch: 285
Loss on hold-out set: 0.0005085954931258273
MeanAbsoluteError value on hold-out data: 0.021238386631011963
Epoch: 286
Loss on hold-out set: 0.00018405138431070985
MeanAbsoluteError value on hold-out data: 0.010609081946313381
Epoch: 287
Loss on hold-out set: 0.00027616492951366175
MeanAbsoluteError value on hold-out data: 0.008317197673022747
Epoch: 288
Loss on hold-out set: 0.0006628972635218432
MeanAbsoluteError value on hold-out data: 0.021368442103266716
Epoch: 289
Loss on hold-out set: 8.436108323382398e-05
MeanAbsoluteError value on hold-out data: 0.0068437703885138035
Epoch: 290
Loss on hold-out set: 0.0001328052300873663
MeanAbsoluteError value on hold-out data: 0.005325491540133953
Epoch: 291
Loss on hold-out set: 0.0010680108419987128
MeanAbsoluteError value on hold-out data: 0.029397910460829735
Epoch: 292
Loss on hold-out set: 0.00036913842364140833
MeanAbsoluteError value on hold-out data: 0.013746735639870167
Epoch: 293
Loss on hold-out set: 0.00043037143251766744
MeanAbsoluteError value on hold-out data: 0.014312796294689178
Epoch: 294
Loss on hold-out set: 0.0004059282245132061
MeanAbsoluteError value on hold-out data: 0.00844381470233202
Epoch: 295
Loss on hold-out set: 0.00011396990612411173
MeanAbsoluteError value on hold-out data: 0.007087573409080505
Epoch: 296
Loss on hold-out set: 0.00036055231420935963
MeanAbsoluteError value on hold-out data: 0.01243577990680933
Epoch: 297
Loss on hold-out set: 0.00015997555553775257
MeanAbsoluteError value on hold-out data: 0.009707199409604073
Epoch: 298
Loss on hold-out set: 0.00020075309696135504
MeanAbsoluteError value on hold-out data: 0.009140094742178917
Epoch: 299
Loss on hold-out set: 0.00019280195819622973
MeanAbsoluteError value on hold-out data: 0.005621875170618296
Epoch: 300
Loss on hold-out set: 0.000186141572109926
MeanAbsoluteError value on hold-out data: 0.008765529841184616
Epoch: 301
Loss on hold-out set: 0.00037910137659405576
MeanAbsoluteError value on hold-out data: 0.007915605790913105
Epoch: 302
Loss on hold-out set: 0.00010116081624513946
MeanAbsoluteError value on hold-out data: 0.0062899417243897915
Epoch: 303
Loss on hold-out set: 0.0002931051604527487
MeanAbsoluteError value on hold-out data: 0.008311429992318153
Epoch: 304
Loss on hold-out set: 0.00014783155107148845
MeanAbsoluteError value on hold-out data: 0.006421306170523167
Epoch: 305
Loss on hold-out set: 0.00025558105416597466
MeanAbsoluteError value on hold-out data: 0.010306422598659992
Epoch: 306
Loss on hold-out set: 0.00013758938781082084
MeanAbsoluteError value on hold-out data: 0.0060928924940526485
Epoch: 307
Loss on hold-out set: 0.0001502656047322441
MeanAbsoluteError value on hold-out data: 0.006278482265770435
Epoch: 308
Loss on hold-out set: 0.00011332779544509801
MeanAbsoluteError value on hold-out data: 0.0060750339180231094
Epoch: 309
Loss on hold-out set: 0.00017666036934602553
MeanAbsoluteError value on hold-out data: 0.00949858222156763
Epoch: 310
Loss on hold-out set: 0.00016651341655616356
MeanAbsoluteError value on hold-out data: 0.00875040888786316
Epoch: 311
Loss on hold-out set: 0.00022414955894514845
MeanAbsoluteError value on hold-out data: 0.011295468546450138
Epoch: 312
Loss on hold-out set: 6.0688053508783923e-05
MeanAbsoluteError value on hold-out data: 0.005301550030708313
Epoch: 313
Loss on hold-out set: 0.00032726153657629194
MeanAbsoluteError value on hold-out data: 0.008775681257247925
Epoch: 314
Loss on hold-out set: 8.573867805688151e-05
MeanAbsoluteError value on hold-out data: 0.007500821724534035
Epoch: 315
Loss on hold-out set: 5.6935995279385874e-05
MeanAbsoluteError value on hold-out data: 0.0031609637662768364
Epoch: 316
Loss on hold-out set: 0.00022514191959999152
MeanAbsoluteError value on hold-out data: 0.007965459488332272
Epoch: 317
Loss on hold-out set: 8.443977094430011e-05
MeanAbsoluteError value on hold-out data: 0.006723130587488413
Epoch: 318
Loss on hold-out set: 0.0003148441305950799
MeanAbsoluteError value on hold-out data: 0.013496516272425652
Epoch: 319
Loss on hold-out set: 0.0001661252660453197
MeanAbsoluteError value on hold-out data: 0.009026236832141876
Epoch: 320
Loss on hold-out set: 0.0007018577004936034
MeanAbsoluteError value on hold-out data: 0.018258335068821907
Epoch: 321
Loss on hold-out set: 0.00012391213023851092
MeanAbsoluteError value on hold-out data: 0.006072004791349173
Epoch: 322
Loss on hold-out set: 0.0002228799759282801
MeanAbsoluteError value on hold-out data: 0.007163773290812969
Epoch: 323
Loss on hold-out set: 0.00019505993240224933
MeanAbsoluteError value on hold-out data: 0.012228745967149734
Epoch: 324
Loss on hold-out set: 0.0013329558408402495
MeanAbsoluteError value on hold-out data: 0.03531298041343689
Epoch: 325
Loss on hold-out set: 0.00018061884369863516
MeanAbsoluteError value on hold-out data: 0.009260340593755245
Epoch: 326
Loss on hold-out set: 0.0002461427111962908
MeanAbsoluteError value on hold-out data: 0.01152560580521822
Epoch: 327
Loss on hold-out set: 0.0004771098967084024
MeanAbsoluteError value on hold-out data: 0.013202441856265068
Epoch: 328
Loss on hold-out set: 0.00035340237354830606
MeanAbsoluteError value on hold-out data: 0.011639799922704697
Epoch: 329
Loss on hold-out set: 0.00014876619206916075
MeanAbsoluteError value on hold-out data: 0.008039634674787521
Epoch: 330
Loss on hold-out set: 0.000183052532520378
MeanAbsoluteError value on hold-out data: 0.00779750244691968
Epoch: 331
Loss on hold-out set: 0.00016192584330622739
MeanAbsoluteError value on hold-out data: 0.007448937278240919
Epoch: 332
Loss on hold-out set: 0.00014492922687886196
MeanAbsoluteError value on hold-out data: 0.008036546409130096
Epoch: 333
Loss on hold-out set: 0.00026062611537350965
MeanAbsoluteError value on hold-out data: 0.0055138166062533855
Epoch: 334
Loss on hold-out set: 0.0002639661205122186
MeanAbsoluteError value on hold-out data: 0.008350727148354053
Epoch: 335
Loss on hold-out set: 0.0005633528191155117
MeanAbsoluteError value on hold-out data: 0.021961631253361702
Epoch: 336
Loss on hold-out set: 0.00018218672903458355
MeanAbsoluteError value on hold-out data: 0.006303154397755861
Epoch: 337
Loss on hold-out set: 0.0001432723461699712
MeanAbsoluteError value on hold-out data: 0.00729049276560545
Epoch: 338
Loss on hold-out set: 0.00015281349381343477
MeanAbsoluteError value on hold-out data: 0.006341240368783474
Epoch: 339
Loss on hold-out set: 0.00011536116265855718
MeanAbsoluteError value on hold-out data: 0.006305007729679346
Epoch: 340
Loss on hold-out set: 0.0002486067609616408
MeanAbsoluteError value on hold-out data: 0.014381885528564453
Epoch: 341
Loss on hold-out set: 0.0002545718457680012
MeanAbsoluteError value on hold-out data: 0.011126438155770302
Epoch: 342
Loss on hold-out set: 0.0003906117735344819
MeanAbsoluteError value on hold-out data: 0.011679333634674549
Epoch: 343
Loss on hold-out set: 0.00016061996173352542
MeanAbsoluteError value on hold-out data: 0.008633304387331009
Epoch: 344
Loss on hold-out set: 0.0001007762120456104
MeanAbsoluteError value on hold-out data: 0.006775400601327419
Epoch: 345
Loss on hold-out set: 0.0003566331943147816
MeanAbsoluteError value on hold-out data: 0.013950161635875702
Epoch: 346
Loss on hold-out set: 8.109064463879852e-05
MeanAbsoluteError value on hold-out data: 0.006847701966762543
Epoch: 347
Loss on hold-out set: 0.0005592120476074726
MeanAbsoluteError value on hold-out data: 0.016671283170580864
Epoch: 348
Loss on hold-out set: 0.000370677695938962
MeanAbsoluteError value on hold-out data: 0.0121698509901762
Epoch: 349
Loss on hold-out set: 0.00021695896468468403
MeanAbsoluteError value on hold-out data: 0.0085790129378438
Epoch: 350
Loss on hold-out set: 4.880139025724355e-05
MeanAbsoluteError value on hold-out data: 0.003737264545634389
Epoch: 351
Loss on hold-out set: 0.00011156145578034308
MeanAbsoluteError value on hold-out data: 0.007401600480079651
Epoch: 352
Loss on hold-out set: 0.00011200946166929115
MeanAbsoluteError value on hold-out data: 0.0065940930508077145
Epoch: 353
Loss on hold-out set: 0.00022004964193911292
MeanAbsoluteError value on hold-out data: 0.010779841803014278
Epoch: 354
Loss on hold-out set: 0.00023189730487310474
MeanAbsoluteError value on hold-out data: 0.012374245561659336
Epoch: 355
Loss on hold-out set: 0.00030005333916817206
MeanAbsoluteError value on hold-out data: 0.013731137849390507
Epoch: 356
Loss on hold-out set: 0.00011174155416052887
MeanAbsoluteError value on hold-out data: 0.00801105983555317
Epoch: 357
Loss on hold-out set: 0.00020611086285115513
MeanAbsoluteError value on hold-out data: 0.008838056586682796
Epoch: 358
Loss on hold-out set: 0.0008365695118156605
MeanAbsoluteError value on hold-out data: 0.02406243234872818
Epoch: 359
Loss on hold-out set: 0.00018307959333852572
MeanAbsoluteError value on hold-out data: 0.008547244593501091
Epoch: 360
Loss on hold-out set: 0.00019173841141501295
MeanAbsoluteError value on hold-out data: 0.011869505047798157
Epoch: 361
Loss on hold-out set: 0.00024076260084065755
MeanAbsoluteError value on hold-out data: 0.011015369556844234
Epoch: 362
Loss on hold-out set: 0.0001551920716002841
MeanAbsoluteError value on hold-out data: 0.008887012489140034
Epoch: 363
Loss on hold-out set: 0.00010994941468604673
MeanAbsoluteError value on hold-out data: 0.004533748608082533
Epoch: 364
Loss on hold-out set: 3.923420793302954e-05
MeanAbsoluteError value on hold-out data: 0.004458405077457428
Epoch: 365
Loss on hold-out set: 0.00031060955198451045
MeanAbsoluteError value on hold-out data: 0.01299959234893322
Epoch: 366
Loss on hold-out set: 0.00031536797694953797
MeanAbsoluteError value on hold-out data: 0.014502037316560745
Epoch: 367
Loss on hold-out set: 0.0001097950951403666
MeanAbsoluteError value on hold-out data: 0.0037916977889835835
Epoch: 368
Loss on hold-out set: 6.418146935366646e-05
MeanAbsoluteError value on hold-out data: 0.005878257565200329
Epoch: 369
Loss on hold-out set: 0.00023957267694640905
MeanAbsoluteError value on hold-out data: 0.010940714739263058
Epoch: 370
Loss on hold-out set: 0.00019307710308088359
MeanAbsoluteError value on hold-out data: 0.008914000354707241
Epoch: 371
Loss on hold-out set: 0.0012823047536106682
MeanAbsoluteError value on hold-out data: 0.03466877341270447
Epoch: 372
Loss on hold-out set: 0.00010708002317091756
MeanAbsoluteError value on hold-out data: 0.007420748937875032
Epoch: 373
Loss on hold-out set: 8.50106412862691e-05
MeanAbsoluteError value on hold-out data: 0.006271685939282179
Epoch: 374
Loss on hold-out set: 0.00012954233749807922
MeanAbsoluteError value on hold-out data: 0.00577479787170887
Epoch: 375
Loss on hold-out set: 0.00021465227837325074
MeanAbsoluteError value on hold-out data: 0.009639124386012554
Epoch: 376
Loss on hold-out set: 0.00010310339331753264
MeanAbsoluteError value on hold-out data: 0.005295626353472471
Epoch: 377
Loss on hold-out set: 8.419376741872646e-05
MeanAbsoluteError value on hold-out data: 0.004481166135519743
Epoch: 378
Loss on hold-out set: 0.00019900456022457403
MeanAbsoluteError value on hold-out data: 0.00910131260752678
Epoch: 379
Loss on hold-out set: 0.00022071825649043987
MeanAbsoluteError value on hold-out data: 0.01187060959637165
Epoch: 380
Loss on hold-out set: 7.01521110888854e-05
MeanAbsoluteError value on hold-out data: 0.004390303511172533
Epoch: 381
Loss on hold-out set: 0.0003627517312691596
MeanAbsoluteError value on hold-out data: 0.012583122588694096
Epoch: 382
Loss on hold-out set: 0.0002690848269642294
MeanAbsoluteError value on hold-out data: 0.01077444851398468
Epoch: 383
Loss on hold-out set: 0.00022649430229648715
MeanAbsoluteError value on hold-out data: 0.007253548130393028
Epoch: 384
Loss on hold-out set: 0.00012402957784280787
MeanAbsoluteError value on hold-out data: 0.004883396439254284
Epoch: 385
Loss on hold-out set: 0.0001776555177217999
MeanAbsoluteError value on hold-out data: 0.009552886709570885
Epoch: 386
Loss on hold-out set: 0.0017569430653422483
MeanAbsoluteError value on hold-out data: 0.04016725718975067
Epoch: 387
Loss on hold-out set: 0.00018209959676153775
MeanAbsoluteError value on hold-out data: 0.009351126849651337
Epoch: 388
Loss on hold-out set: 0.00012488036727039512
MeanAbsoluteError value on hold-out data: 0.006764848250895739
Epoch: 389
Loss on hold-out set: 0.0001031756109305685
MeanAbsoluteError value on hold-out data: 0.006591060198843479
Epoch: 390
Loss on hold-out set: 0.0007499916629106002
MeanAbsoluteError value on hold-out data: 0.026366569101810455
Epoch: 391
Loss on hold-out set: 7.721994179040561e-05
MeanAbsoluteError value on hold-out data: 0.005757353734225035
Epoch: 392
Loss on hold-out set: 0.00018028243204370434
MeanAbsoluteError value on hold-out data: 0.007098427042365074
Epoch: 393
Loss on hold-out set: 3.820437505534133e-05
MeanAbsoluteError value on hold-out data: 0.004092297051101923
Epoch: 394
Loss on hold-out set: 0.00017231121426831172
MeanAbsoluteError value on hold-out data: 0.007770469877868891
Epoch: 395
Loss on hold-out set: 0.00012334722836576954
MeanAbsoluteError value on hold-out data: 0.007831785827875137
Epoch: 396
Loss on hold-out set: 0.0002801870829515744
MeanAbsoluteError value on hold-out data: 0.009198584593832493
Epoch: 397
Loss on hold-out set: 0.00011306368888223293
MeanAbsoluteError value on hold-out data: 0.006199076771736145
Epoch: 398
Loss on hold-out set: 0.0004753228769052504
MeanAbsoluteError value on hold-out data: 0.013975086621940136
Epoch: 399
Loss on hold-out set: 0.0006511831015814096
MeanAbsoluteError value on hold-out data: 0.02278449572622776
Epoch: 400
Loss on hold-out set: 0.00014132267570905816
MeanAbsoluteError value on hold-out data: 0.006293620448559523
Epoch: 401
Loss on hold-out set: 0.00016301331614062962
MeanAbsoluteError value on hold-out data: 0.005645045079290867
Epoch: 402
Loss on hold-out set: 0.0001274053615576888
MeanAbsoluteError value on hold-out data: 0.008251585066318512
Epoch: 403
Loss on hold-out set: 0.00039127239649946875
MeanAbsoluteError value on hold-out data: 0.007504773326218128
Epoch: 404
Loss on hold-out set: 0.0002622528556553573
MeanAbsoluteError value on hold-out data: 0.010652389377355576
Epoch: 405
Loss on hold-out set: 6.063613433357923e-05
MeanAbsoluteError value on hold-out data: 0.0053461650386452675
Epoch: 406
Loss on hold-out set: 8.128118995381029e-05
MeanAbsoluteError value on hold-out data: 0.00592455081641674
Epoch: 407
Loss on hold-out set: 0.00021739134071570957
MeanAbsoluteError value on hold-out data: 0.008375815115869045
Epoch: 408
Loss on hold-out set: 0.0005439587523716526
MeanAbsoluteError value on hold-out data: 0.013935471884906292
Epoch: 409
Loss on hold-out set: 0.003064091923940731
MeanAbsoluteError value on hold-out data: 0.054181717336177826
Epoch: 410
Loss on hold-out set: 0.0007034374460712762
MeanAbsoluteError value on hold-out data: 0.02489222213625908
Epoch: 411
Loss on hold-out set: 0.00014780325833080017
MeanAbsoluteError value on hold-out data: 0.008533155545592308
Epoch: 412
Loss on hold-out set: 0.0009041642174691477
MeanAbsoluteError value on hold-out data: 0.017162585631012917
Epoch: 413
Loss on hold-out set: 0.00011641593794976009
MeanAbsoluteError value on hold-out data: 0.0052634491585195065
Epoch: 414
Loss on hold-out set: 7.60635878003469e-05
MeanAbsoluteError value on hold-out data: 0.00555951613932848
Epoch: 415
Loss on hold-out set: 0.00023683524628531334
MeanAbsoluteError value on hold-out data: 0.011206051334738731
Epoch: 416
Loss on hold-out set: 0.00029587251437509333
MeanAbsoluteError value on hold-out data: 0.012306011281907558
Epoch: 417
Loss on hold-out set: 0.00010065840371297734
MeanAbsoluteError value on hold-out data: 0.0071631139144301414
Epoch: 418
Loss on hold-out set: 0.00011288113972496878
MeanAbsoluteError value on hold-out data: 0.0066841403022408485
Epoch: 419
Loss on hold-out set: 0.0002739624762015362
MeanAbsoluteError value on hold-out data: 0.00837735366076231
Epoch: 420
Loss on hold-out set: 0.00015983131696597602
MeanAbsoluteError value on hold-out data: 0.005963191855698824
Epoch: 421
Loss on hold-out set: 0.00026303041752391055
MeanAbsoluteError value on hold-out data: 0.009530031122267246
Epoch: 422
Loss on hold-out set: 0.00012428692348533476
MeanAbsoluteError value on hold-out data: 0.00693936925381422
Epoch: 423
Loss on hold-out set: 0.0002817912318278104
MeanAbsoluteError value on hold-out data: 0.011511932127177715
Epoch: 424
Loss on hold-out set: 0.0001301410074551026
MeanAbsoluteError value on hold-out data: 0.007619472220540047
Epoch: 425
Loss on hold-out set: 0.00030398112319648805
MeanAbsoluteError value on hold-out data: 0.01036098413169384
Epoch: 426
Loss on hold-out set: 0.00016808105821933408
MeanAbsoluteError value on hold-out data: 0.0070772734470665455
Epoch: 427
Loss on hold-out set: 5.910211015553183e-05
MeanAbsoluteError value on hold-out data: 0.004676150623708963
Epoch: 428
Loss on hold-out set: 0.0001691695949590978
MeanAbsoluteError value on hold-out data: 0.004999129567295313
Epoch: 429
Loss on hold-out set: 4.344103417440094e-05
MeanAbsoluteError value on hold-out data: 0.0044836984016001225
Epoch: 430
Loss on hold-out set: 0.0001181546800389218
MeanAbsoluteError value on hold-out data: 0.005825425498187542
Epoch: 431
Loss on hold-out set: 0.00015014041644845796
MeanAbsoluteError value on hold-out data: 0.011008048430085182
Epoch: 432
Loss on hold-out set: 0.00022368143000724223
MeanAbsoluteError value on hold-out data: 0.010644525289535522
Epoch: 433
Loss on hold-out set: 0.00018433814451973855
MeanAbsoluteError value on hold-out data: 0.007090643979609013
Epoch: 434
Loss on hold-out set: 0.00022976618856773712
MeanAbsoluteError value on hold-out data: 0.012686803005635738
Epoch: 435
Loss on hold-out set: 0.0002132876604599388
MeanAbsoluteError value on hold-out data: 0.011765680275857449
Epoch: 436
Loss on hold-out set: 0.000200981361941606
MeanAbsoluteError value on hold-out data: 0.008820018731057644
Epoch: 437
Loss on hold-out set: 0.0001410011771344886
MeanAbsoluteError value on hold-out data: 0.008606539107859135
Epoch: 438
Loss on hold-out set: 0.0003727077650852918
MeanAbsoluteError value on hold-out data: 0.014656130224466324
Epoch: 439
Loss on hold-out set: 0.0003021351378839953
MeanAbsoluteError value on hold-out data: 0.01553815696388483
Epoch: 440
Loss on hold-out set: 0.00015649767939114674
MeanAbsoluteError value on hold-out data: 0.008545590564608574
Epoch: 441
Loss on hold-out set: 0.00018175297382664498
MeanAbsoluteError value on hold-out data: 0.010401658713817596
Epoch: 442
Loss on hold-out set: 0.0006389075884056327
MeanAbsoluteError value on hold-out data: 0.02438095211982727
Epoch: 443
Loss on hold-out set: 0.000903480472563962
MeanAbsoluteError value on hold-out data: 0.028049441054463387
Epoch: 444
Loss on hold-out set: 0.00033180993188197086
MeanAbsoluteError value on hold-out data: 0.014835831709206104
Epoch: 445
Loss on hold-out set: 0.00029187645199463556
MeanAbsoluteError value on hold-out data: 0.012857021763920784
Epoch: 446
Loss on hold-out set: 0.00018326416863457875
MeanAbsoluteError value on hold-out data: 0.009070352651178837
Epoch: 447
Loss on hold-out set: 0.00012684632383752614
MeanAbsoluteError value on hold-out data: 0.008035766892135143
Epoch: 448
Loss on hold-out set: 0.00029443728156988263
MeanAbsoluteError value on hold-out data: 0.0072080595418810844
Epoch: 449
Loss on hold-out set: 0.00011546722400549027
MeanAbsoluteError value on hold-out data: 0.008386163040995598
Epoch: 450
Loss on hold-out set: 0.00040046966310719175
MeanAbsoluteError value on hold-out data: 0.010798823088407516
Epoch: 451
Loss on hold-out set: 0.00010498304178135616
MeanAbsoluteError value on hold-out data: 0.007402488961815834
Epoch: 452
Loss on hold-out set: 0.00017047262286053555
MeanAbsoluteError value on hold-out data: 0.00851653702557087
Epoch: 453
Loss on hold-out set: 9.017311994715496e-05
MeanAbsoluteError value on hold-out data: 0.007311808876693249
Epoch: 454
Loss on hold-out set: 9.720318643016263e-05
MeanAbsoluteError value on hold-out data: 0.007234197575598955
Epoch: 455
Loss on hold-out set: 0.00013007061218224024
MeanAbsoluteError value on hold-out data: 0.010032309219241142
Epoch: 456
Loss on hold-out set: 0.0003650953467034637
MeanAbsoluteError value on hold-out data: 0.016899432986974716
Epoch: 457
Loss on hold-out set: 0.0002456304706165132
MeanAbsoluteError value on hold-out data: 0.007457834668457508
Epoch: 458
Loss on hold-out set: 6.78097620122667e-05
MeanAbsoluteError value on hold-out data: 0.00466420641168952
Epoch: 459
Loss on hold-out set: 8.039887195895732e-05
MeanAbsoluteError value on hold-out data: 0.004534532316029072
Epoch: 460
Loss on hold-out set: 0.0001468633418569784
MeanAbsoluteError value on hold-out data: 0.005207824055105448
Epoch: 461
Loss on hold-out set: 0.00021395226081279505
MeanAbsoluteError value on hold-out data: 0.009576444514095783
Epoch: 462
Loss on hold-out set: 0.00020702316224311575
MeanAbsoluteError value on hold-out data: 0.010472578927874565
Epoch: 463
Loss on hold-out set: 0.00020012954538335754
MeanAbsoluteError value on hold-out data: 0.00905572809278965
Epoch: 464
Loss on hold-out set: 8.023428738038332e-05
MeanAbsoluteError value on hold-out data: 0.004130153451114893
Epoch: 465
Loss on hold-out set: 0.00010745329279272578
MeanAbsoluteError value on hold-out data: 0.0044351546093821526
Epoch: 466
Loss on hold-out set: 0.00021523469034658965
MeanAbsoluteError value on hold-out data: 0.007561240345239639
Epoch: 467
Loss on hold-out set: 0.00013159704686634206
MeanAbsoluteError value on hold-out data: 0.0069143325090408325
Epoch: 468
Loss on hold-out set: 8.428264551472047e-05
MeanAbsoluteError value on hold-out data: 0.005750487558543682
Epoch: 469
Loss on hold-out set: 0.001087291052834572
MeanAbsoluteError value on hold-out data: 0.028397826477885246
Epoch: 470
Loss on hold-out set: 0.00031093296873127416
MeanAbsoluteError value on hold-out data: 0.010616288520395756
Epoch: 471
Loss on hold-out set: 0.000116846178535094
MeanAbsoluteError value on hold-out data: 0.0044171735644340515
Epoch: 472
Loss on hold-out set: 0.00019654748144890428
MeanAbsoluteError value on hold-out data: 0.009708283469080925
Epoch: 473
Loss on hold-out set: 0.00011955968820506027
MeanAbsoluteError value on hold-out data: 0.005187435075640678
Epoch: 474
Loss on hold-out set: 0.00043867597470412684
MeanAbsoluteError value on hold-out data: 0.008477912284433842
Epoch: 475
Loss on hold-out set: 0.0003157688094904044
MeanAbsoluteError value on hold-out data: 0.006018178071826696
Epoch: 476
Loss on hold-out set: 0.00047115917952492294
MeanAbsoluteError value on hold-out data: 0.010671477764844894
Epoch: 477
Loss on hold-out set: 0.00018118085771627528
MeanAbsoluteError value on hold-out data: 0.01025716308504343
Epoch: 478
Loss on hold-out set: 0.0012887794827723777
MeanAbsoluteError value on hold-out data: 0.03343483433127403
Epoch: 479
Loss on hold-out set: 0.00020992072064760387
MeanAbsoluteError value on hold-out data: 0.012206501327455044
Epoch: 480
Loss on hold-out set: 0.00022783763747132694
MeanAbsoluteError value on hold-out data: 0.005773717537522316
Epoch: 481
Loss on hold-out set: 0.00028453361741604137
MeanAbsoluteError value on hold-out data: 0.009350507520139217
Epoch: 482
Loss on hold-out set: 0.00015273526452418943
MeanAbsoluteError value on hold-out data: 0.007606135215610266
Epoch: 483
Loss on hold-out set: 0.0002620880864254248
MeanAbsoluteError value on hold-out data: 0.012686957605183125
Epoch: 484
Loss on hold-out set: 0.00015428471708314886
MeanAbsoluteError value on hold-out data: 0.009380229748785496
Epoch: 485
Loss on hold-out set: 0.00011387149712199492
MeanAbsoluteError value on hold-out data: 0.008158168755471706
Epoch: 486
Loss on hold-out set: 0.00021323519161485724
MeanAbsoluteError value on hold-out data: 0.011426109820604324
Epoch: 487
Loss on hold-out set: 0.00035525804466822973
MeanAbsoluteError value on hold-out data: 0.00863676518201828
Epoch: 488
Loss on hold-out set: 0.0002394489939002884
MeanAbsoluteError value on hold-out data: 0.012558207847177982
Epoch: 489
Loss on hold-out set: 0.00011928769741811458
MeanAbsoluteError value on hold-out data: 0.005012793000787497
Epoch: 490
Loss on hold-out set: 0.00011020855426498823
MeanAbsoluteError value on hold-out data: 0.005503826774656773
Epoch: 491
Loss on hold-out set: 0.0001050764740045308
MeanAbsoluteError value on hold-out data: 0.006413729395717382
Epoch: 492
Loss on hold-out set: 6.909683691590449e-05
MeanAbsoluteError value on hold-out data: 0.006278995890170336
Epoch: 493
Loss on hold-out set: 0.00013793527061448243
MeanAbsoluteError value on hold-out data: 0.006837338674813509
Epoch: 494
Loss on hold-out set: 0.00040610382367097035
MeanAbsoluteError value on hold-out data: 0.017748739570379257
Epoch: 495
Loss on hold-out set: 0.0003872911250877415
MeanAbsoluteError value on hold-out data: 0.01314335223287344
Epoch: 496
Loss on hold-out set: 0.00033907780169484844
MeanAbsoluteError value on hold-out data: 0.016124527901411057
Epoch: 497
Loss on hold-out set: 9.204239062168391e-05
MeanAbsoluteError value on hold-out data: 0.007894222624599934
Epoch: 498
Loss on hold-out set: 0.00015236252722005653
MeanAbsoluteError value on hold-out data: 0.007297319360077381
Epoch: 499
Loss on hold-out set: 0.00014495625021625433
MeanAbsoluteError value on hold-out data: 0.006932885851711035
Epoch: 500
Loss on hold-out set: 0.0003202317981815309
MeanAbsoluteError value on hold-out data: 0.010301284492015839
Epoch: 501
Loss on hold-out set: 0.00021220138172027778
MeanAbsoluteError value on hold-out data: 0.010729965753853321
Epoch: 502
Loss on hold-out set: 0.00023601441697744456
MeanAbsoluteError value on hold-out data: 0.008266475982964039
Epoch: 503
Loss on hold-out set: 0.00022268396821202354
MeanAbsoluteError value on hold-out data: 0.007116193883121014
Epoch: 504
Loss on hold-out set: 0.0001516267897578042
MeanAbsoluteError value on hold-out data: 0.005816255230456591
Epoch: 505
Loss on hold-out set: 0.0002810709890917152
MeanAbsoluteError value on hold-out data: 0.00798612367361784
Epoch: 506
Loss on hold-out set: 0.00016046564848549774
MeanAbsoluteError value on hold-out data: 0.008043134585022926
Epoch: 507
Loss on hold-out set: 0.0011946301444703223
MeanAbsoluteError value on hold-out data: 0.028489278629422188
Epoch: 508
Loss on hold-out set: 0.00021439979862311463
MeanAbsoluteError value on hold-out data: 0.01168552041053772
Epoch: 509
Loss on hold-out set: 0.000175662252188072
MeanAbsoluteError value on hold-out data: 0.008785096928477287
Epoch: 510
Loss on hold-out set: 0.0005341689094692763
MeanAbsoluteError value on hold-out data: 0.021341338753700256
Epoch: 511
Loss on hold-out set: 0.00029167896843175284
MeanAbsoluteError value on hold-out data: 0.012328707613050938
Epoch: 512
Loss on hold-out set: 0.00013470325345559488
MeanAbsoluteError value on hold-out data: 0.008171889930963516
Returned to Spot: Validation loss: 0.00013470325345559488
----------------------------------------------
spotPython tuning: 0.00013470325345559488 [#####-----] 47.78% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.0, 'lr_mult': 6.250309843689794, 'batch_size': 8, 'epochs': 4, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adam', 'sgd_momentum': 0.314374102208462}
Epoch: 1
Loss on hold-out set: 0.021298968735592144
MeanAbsoluteError value on hold-out data: 0.113848976790905
Epoch: 2
Loss on hold-out set: 0.015392267338220814
MeanAbsoluteError value on hold-out data: 0.09698204696178436
Epoch: 3
Loss on hold-out set: 0.01146421252786623
MeanAbsoluteError value on hold-out data: 0.08326104283332825
Epoch: 4
Loss on hold-out set: 0.009298379882238805
MeanAbsoluteError value on hold-out data: 0.07606924325227737
Returned to Spot: Validation loss: 0.009298379882238805
----------------------------------------------
spotPython tuning: 0.00013470325345559488 [#####-----] 49.36% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.018014235268322465, 'lr_mult': 5.233927607203788, 'batch_size': 8, 'epochs': 256, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adam', 'sgd_momentum': 0.7676671847523139}
Epoch: 1
Loss on hold-out set: 0.02425997668730193
MeanAbsoluteError value on hold-out data: 0.12163519859313965
Epoch: 2
Loss on hold-out set: 0.022909411596820542
MeanAbsoluteError value on hold-out data: 0.11808319389820099
Epoch: 3
Loss on hold-out set: 0.022590714151431854
MeanAbsoluteError value on hold-out data: 0.1206728145480156
Epoch: 4
Loss on hold-out set: 0.02085217722005358
MeanAbsoluteError value on hold-out data: 0.11745113134384155
Epoch: 5
Loss on hold-out set: 0.016623113733275158
MeanAbsoluteError value on hold-out data: 0.10467479377985
Epoch: 6
Loss on hold-out set: 0.016207069268842276
MeanAbsoluteError value on hold-out data: 0.10096444934606552
Epoch: 7
Loss on hold-out set: 0.010771153635639501
MeanAbsoluteError value on hold-out data: 0.08152127265930176
Epoch: 8
Loss on hold-out set: 0.011094421715058974
MeanAbsoluteError value on hold-out data: 0.07611767947673798
Epoch: 9
Loss on hold-out set: 0.006357376270706912
MeanAbsoluteError value on hold-out data: 0.062402356415987015
Epoch: 10
Loss on hold-out set: 0.006140171248453522
MeanAbsoluteError value on hold-out data: 0.05633801594376564
Epoch: 11
Loss on hold-out set: 0.0036514846326195097
MeanAbsoluteError value on hold-out data: 0.04660315439105034
Epoch: 12
Loss on hold-out set: 0.00528198661203006
MeanAbsoluteError value on hold-out data: 0.045329250395298004
Epoch: 13
Loss on hold-out set: 0.003178311559359396
MeanAbsoluteError value on hold-out data: 0.038196075707674026
Epoch: 14
Loss on hold-out set: 0.002971750316455176
MeanAbsoluteError value on hold-out data: 0.034355372190475464
Epoch: 15
Loss on hold-out set: 0.002220958778037273
MeanAbsoluteError value on hold-out data: 0.023825127631425858
Epoch: 16
Loss on hold-out set: 0.0025698778244029534
MeanAbsoluteError value on hold-out data: 0.044800955802202225
Epoch: 17
Loss on hold-out set: 0.0022052380028119507
MeanAbsoluteError value on hold-out data: 0.03349504992365837
Epoch: 18
Loss on hold-out set: 0.0030770250412292385
MeanAbsoluteError value on hold-out data: 0.048186611384153366
Epoch: 19
Loss on hold-out set: 0.002306903191646071
MeanAbsoluteError value on hold-out data: 0.03401244431734085
Epoch: 20
Loss on hold-out set: 0.0015862212289663915
MeanAbsoluteError value on hold-out data: 0.02765473909676075
Epoch: 21
Loss on hold-out set: 0.0025870329531914506
MeanAbsoluteError value on hold-out data: 0.03072405233979225
Epoch: 22
Loss on hold-out set: 0.004327060538344085
MeanAbsoluteError value on hold-out data: 0.0594402439892292
Epoch: 23
Loss on hold-out set: 0.0022950585491918517
MeanAbsoluteError value on hold-out data: 0.021858034655451775
Epoch: 24
Loss on hold-out set: 0.0015783394803388785
MeanAbsoluteError value on hold-out data: 0.019268019124865532
Epoch: 25
Loss on hold-out set: 0.0015906943215094017
MeanAbsoluteError value on hold-out data: 0.02888125739991665
Epoch: 26
Loss on hold-out set: 0.002177286047586485
MeanAbsoluteError value on hold-out data: 0.03380211070179939
Epoch: 27
Loss on hold-out set: 0.0022560684194200134
MeanAbsoluteError value on hold-out data: 0.03654126077890396
Epoch: 28
Loss on hold-out set: 0.0014768319310142512
MeanAbsoluteError value on hold-out data: 0.028215250000357628
Epoch: 29
Loss on hold-out set: 0.001703980685162701
MeanAbsoluteError value on hold-out data: 0.022330163046717644
Epoch: 30
Loss on hold-out set: 0.0018323773087774355
MeanAbsoluteError value on hold-out data: 0.024642853066325188
Epoch: 31
Loss on hold-out set: 0.0020563803525299974
MeanAbsoluteError value on hold-out data: 0.023594487458467484
Epoch: 32
Loss on hold-out set: 0.0012930100573085885
MeanAbsoluteError value on hold-out data: 0.014367789961397648
Epoch: 33
Loss on hold-out set: 0.00139286748229719
MeanAbsoluteError value on hold-out data: 0.01615426316857338
Epoch: 34
Loss on hold-out set: 0.0013250941427893274
MeanAbsoluteError value on hold-out data: 0.01709970086812973
Epoch: 35
Loss on hold-out set: 0.001874970714772261
MeanAbsoluteError value on hold-out data: 0.018729008734226227
Epoch: 36
Loss on hold-out set: 0.0015385307564620713
MeanAbsoluteError value on hold-out data: 0.023093916475772858
Epoch: 37
Loss on hold-out set: 0.002177889998021879
MeanAbsoluteError value on hold-out data: 0.022329797968268394
Epoch: 38
Loss on hold-out set: 0.001884153856065639
MeanAbsoluteError value on hold-out data: 0.026609232649207115
Epoch: 39
Loss on hold-out set: 0.0022401357794622433
MeanAbsoluteError value on hold-out data: 0.019934359937906265
Epoch: 40
Loss on hold-out set: 0.0009900371369440109
MeanAbsoluteError value on hold-out data: 0.017951959744095802
Epoch: 41
Loss on hold-out set: 0.001943402514658182
MeanAbsoluteError value on hold-out data: 0.037255190312862396
Epoch: 42
Loss on hold-out set: 0.0010893470883418463
MeanAbsoluteError value on hold-out data: 0.02265271358191967
Epoch: 43
Loss on hold-out set: 0.0015570296167616586
MeanAbsoluteError value on hold-out data: 0.03335481137037277
Epoch: 44
Loss on hold-out set: 0.0013131866483395004
MeanAbsoluteError value on hold-out data: 0.01624315045773983
Epoch: 45
Loss on hold-out set: 0.0021894798028130793
MeanAbsoluteError value on hold-out data: 0.020625706762075424
Epoch: 46
Loss on hold-out set: 0.002238927649542395
MeanAbsoluteError value on hold-out data: 0.034791264683008194
Epoch: 47
Loss on hold-out set: 0.0016066768577346873
MeanAbsoluteError value on hold-out data: 0.028409866616129875
Epoch: 48
Loss on hold-out set: 0.0014171222520465228
MeanAbsoluteError value on hold-out data: 0.026556409895420074
Epoch: 49
Loss on hold-out set: 0.0015172727504058888
MeanAbsoluteError value on hold-out data: 0.03111775778234005
Epoch: 50
Loss on hold-out set: 0.0017565472149535229
MeanAbsoluteError value on hold-out data: 0.03564045578241348
Epoch: 51
Loss on hold-out set: 0.0015328229371190996
MeanAbsoluteError value on hold-out data: 0.019819611683487892
Epoch: 52
Loss on hold-out set: 0.0016015136156248015
MeanAbsoluteError value on hold-out data: 0.02169220894575119
Epoch: 53
Loss on hold-out set: 0.0010851582276365278
MeanAbsoluteError value on hold-out data: 0.019982611760497093
Epoch: 54
Loss on hold-out set: 0.0018882590696816088
MeanAbsoluteError value on hold-out data: 0.03286271169781685
Epoch: 55
Loss on hold-out set: 0.0015298626883457856
MeanAbsoluteError value on hold-out data: 0.031058339402079582
Epoch: 56
Loss on hold-out set: 0.0011018049840219504
MeanAbsoluteError value on hold-out data: 0.015054711140692234
Epoch: 57
Loss on hold-out set: 0.0017908344054472093
MeanAbsoluteError value on hold-out data: 0.021524328738451004
Epoch: 58
Loss on hold-out set: 0.0015306207782199827
MeanAbsoluteError value on hold-out data: 0.022831274196505547
Epoch: 59
Loss on hold-out set: 0.0013270394602410594
MeanAbsoluteError value on hold-out data: 0.02540777251124382
Epoch: 60
Loss on hold-out set: 0.001219924847215512
MeanAbsoluteError value on hold-out data: 0.02294459380209446
Epoch: 61
Loss on hold-out set: 0.0012502517973572186
MeanAbsoluteError value on hold-out data: 0.01540637668222189
Epoch: 62
Loss on hold-out set: 0.0019204478142599232
MeanAbsoluteError value on hold-out data: 0.03192218393087387
Epoch: 63
Loss on hold-out set: 0.0012924643964843678
MeanAbsoluteError value on hold-out data: 0.02231861650943756
Epoch: 64
Loss on hold-out set: 0.0016156058028220861
MeanAbsoluteError value on hold-out data: 0.020334839820861816
Epoch: 65
Loss on hold-out set: 0.0014123358594492618
MeanAbsoluteError value on hold-out data: 0.019114715978503227
Epoch: 66
Loss on hold-out set: 0.001282740962204499
MeanAbsoluteError value on hold-out data: 0.026350881904363632
Epoch: 67
Loss on hold-out set: 0.0012306030631455207
MeanAbsoluteError value on hold-out data: 0.017042454332113266
Epoch: 68
Loss on hold-out set: 0.0008217774694984607
MeanAbsoluteError value on hold-out data: 0.018222512677311897
Epoch: 69
Loss on hold-out set: 0.0020072796633987884
MeanAbsoluteError value on hold-out data: 0.027766894549131393
Epoch: 70
Loss on hold-out set: 0.001261781943005764
MeanAbsoluteError value on hold-out data: 0.01712009124457836
Epoch: 71
Loss on hold-out set: 0.0012214394779508247
MeanAbsoluteError value on hold-out data: 0.022545455023646355
Epoch: 72
Loss on hold-out set: 0.001067508792115596
MeanAbsoluteError value on hold-out data: 0.01590038649737835
Epoch: 73
Loss on hold-out set: 0.0018491616210667416
MeanAbsoluteError value on hold-out data: 0.031717702746391296
Epoch: 74
Loss on hold-out set: 0.0008226291929053044
MeanAbsoluteError value on hold-out data: 0.01944664493203163
Epoch: 75
Loss on hold-out set: 0.0013832758360015425
MeanAbsoluteError value on hold-out data: 0.023703746497631073
Epoch: 76
Loss on hold-out set: 0.0010593601224459953
MeanAbsoluteError value on hold-out data: 0.023787830024957657
Epoch: 77
Loss on hold-out set: 0.0007773882107836758
MeanAbsoluteError value on hold-out data: 0.018135325983166695
Epoch: 78
Loss on hold-out set: 0.001514081801611897
MeanAbsoluteError value on hold-out data: 0.014866474084556103
Epoch: 79
Loss on hold-out set: 0.0007656343471975752
MeanAbsoluteError value on hold-out data: 0.020396187901496887
Epoch: 80
Loss on hold-out set: 0.0010399628203901414
MeanAbsoluteError value on hold-out data: 0.02058989368379116
Epoch: 81
Loss on hold-out set: 0.0015833303719103384
MeanAbsoluteError value on hold-out data: 0.026777559891343117
Epoch: 82
Loss on hold-out set: 0.0011836649680749122
MeanAbsoluteError value on hold-out data: 0.021992243826389313
Epoch: 83
Loss on hold-out set: 0.0006891172615723917
MeanAbsoluteError value on hold-out data: 0.012765439227223396
Epoch: 84
Loss on hold-out set: 0.0006309010450183307
MeanAbsoluteError value on hold-out data: 0.013880905695259571
Epoch: 85
Loss on hold-out set: 0.001070001024106061
MeanAbsoluteError value on hold-out data: 0.01653226464986801
Epoch: 86
Loss on hold-out set: 0.00148966493648722
MeanAbsoluteError value on hold-out data: 0.02890719659626484
Epoch: 87
Loss on hold-out set: 0.0009174024871754227
MeanAbsoluteError value on hold-out data: 0.016616621986031532
Epoch: 88
Loss on hold-out set: 0.0009283317079902382
MeanAbsoluteError value on hold-out data: 0.01939147338271141
Epoch: 89
Loss on hold-out set: 0.0009254162750470354
MeanAbsoluteError value on hold-out data: 0.0199397262185812
Epoch: 90
Loss on hold-out set: 0.0008585706318148081
MeanAbsoluteError value on hold-out data: 0.014868052676320076
Epoch: 91
Loss on hold-out set: 0.0009188996703079809
MeanAbsoluteError value on hold-out data: 0.015643764287233353
Epoch: 92
Loss on hold-out set: 0.0007049780562834042
MeanAbsoluteError value on hold-out data: 0.014256731607019901
Epoch: 93
Loss on hold-out set: 0.0015448682752321474
MeanAbsoluteError value on hold-out data: 0.02705618552863598
Epoch: 94
Loss on hold-out set: 0.000941517993372767
MeanAbsoluteError value on hold-out data: 0.016171440482139587
Epoch: 95
Loss on hold-out set: 0.0009488454235045202
MeanAbsoluteError value on hold-out data: 0.017370393499732018
Epoch: 96
Loss on hold-out set: 0.0006582670934173956
MeanAbsoluteError value on hold-out data: 0.012630240991711617
Epoch: 97
Loss on hold-out set: 0.0006554459479574641
MeanAbsoluteError value on hold-out data: 0.013209178112447262
Epoch: 98
Loss on hold-out set: 0.0005462591549064056
MeanAbsoluteError value on hold-out data: 0.011087906546890736
Epoch: 99
Loss on hold-out set: 0.0009949926511341658
MeanAbsoluteError value on hold-out data: 0.017475908622145653
Epoch: 100
Loss on hold-out set: 0.0007924396394580407
MeanAbsoluteError value on hold-out data: 0.01750948838889599
Epoch: 101
Loss on hold-out set: 0.0007101962199062415
MeanAbsoluteError value on hold-out data: 0.014738615602254868
Epoch: 102
Loss on hold-out set: 0.0013141274256141561
MeanAbsoluteError value on hold-out data: 0.032163914293050766
Epoch: 103
Loss on hold-out set: 0.001704822604599605
MeanAbsoluteError value on hold-out data: 0.030506661161780357
Epoch: 104
Loss on hold-out set: 0.0008369459888184027
MeanAbsoluteError value on hold-out data: 0.015436592511832714
Epoch: 105
Loss on hold-out set: 0.001281138867182706
MeanAbsoluteError value on hold-out data: 0.027409791946411133
Epoch: 106
Loss on hold-out set: 0.0007899651140369793
MeanAbsoluteError value on hold-out data: 0.015671487897634506
Epoch: 107
Loss on hold-out set: 0.0008921791350554773
MeanAbsoluteError value on hold-out data: 0.020225314423441887
Epoch: 108
Loss on hold-out set: 0.000834790230950794
MeanAbsoluteError value on hold-out data: 0.018481988459825516
Epoch: 109
Loss on hold-out set: 0.0006301755085204556
MeanAbsoluteError value on hold-out data: 0.016353586688637733
Epoch: 110
Loss on hold-out set: 0.0008953166754125911
MeanAbsoluteError value on hold-out data: 0.02167612873017788
Epoch: 111
Loss on hold-out set: 0.0008063296773846224
MeanAbsoluteError value on hold-out data: 0.016624854877591133
Epoch: 112
Loss on hold-out set: 0.001073770693605375
MeanAbsoluteError value on hold-out data: 0.016973458230495453
Epoch: 113
Loss on hold-out set: 0.0006669209952202724
MeanAbsoluteError value on hold-out data: 0.01853971555829048
Epoch: 114
Loss on hold-out set: 0.0006968110874846676
MeanAbsoluteError value on hold-out data: 0.01448223739862442
Epoch: 115
Loss on hold-out set: 0.0006593215048748167
MeanAbsoluteError value on hold-out data: 0.017103884369134903
Epoch: 116
Loss on hold-out set: 0.0016763841359581995
MeanAbsoluteError value on hold-out data: 0.0328960195183754
Epoch: 117
Loss on hold-out set: 0.0007836910659343152
MeanAbsoluteError value on hold-out data: 0.019298803061246872
Epoch: 118
Loss on hold-out set: 0.0008735960733534547
MeanAbsoluteError value on hold-out data: 0.01616263948380947
Epoch: 119
Loss on hold-out set: 0.0006021375015016498
MeanAbsoluteError value on hold-out data: 0.01610415242612362
Epoch: 120
Loss on hold-out set: 0.0005224617488190569
MeanAbsoluteError value on hold-out data: 0.013771538622677326
Epoch: 121
Loss on hold-out set: 0.0008633304132672492
MeanAbsoluteError value on hold-out data: 0.018857484683394432
Epoch: 122
Loss on hold-out set: 0.0009126383051089329
MeanAbsoluteError value on hold-out data: 0.01765170693397522
Epoch: 123
Loss on hold-out set: 0.0007713340945835961
MeanAbsoluteError value on hold-out data: 0.02238357625901699
Epoch: 124
Loss on hold-out set: 0.0010360722251214994
MeanAbsoluteError value on hold-out data: 0.019490620121359825
Epoch: 125
Loss on hold-out set: 0.0004726182633021381
MeanAbsoluteError value on hold-out data: 0.013112199492752552
Epoch: 126
Loss on hold-out set: 0.000459125127523102
MeanAbsoluteError value on hold-out data: 0.012133674696087837
Epoch: 127
Loss on hold-out set: 0.0004637000804570179
MeanAbsoluteError value on hold-out data: 0.01184115745127201
Epoch: 128
Loss on hold-out set: 0.0004791679114676203
MeanAbsoluteError value on hold-out data: 0.014978298917412758
Epoch: 129
Loss on hold-out set: 0.0004656140917249056
MeanAbsoluteError value on hold-out data: 0.011416670866310596
Epoch: 130
Loss on hold-out set: 0.0006060642376963331
MeanAbsoluteError value on hold-out data: 0.014368327334523201
Epoch: 131
Loss on hold-out set: 0.000568154492372598
MeanAbsoluteError value on hold-out data: 0.017020208761096
Epoch: 132
Loss on hold-out set: 0.0009705196019862534
MeanAbsoluteError value on hold-out data: 0.02106708660721779
Epoch: 133
Loss on hold-out set: 0.0017095530270843913
MeanAbsoluteError value on hold-out data: 0.038560234010219574
Epoch: 134
Loss on hold-out set: 0.0007928782764984613
MeanAbsoluteError value on hold-out data: 0.015119577758014202
Epoch: 135
Loss on hold-out set: 0.0005186643637850801
MeanAbsoluteError value on hold-out data: 0.01443732250481844
Epoch: 136
Loss on hold-out set: 0.0004484356487218496
MeanAbsoluteError value on hold-out data: 0.010502892546355724
Epoch: 137
Loss on hold-out set: 0.000629169251624262
MeanAbsoluteError value on hold-out data: 0.016243768855929375
Epoch: 138
Loss on hold-out set: 0.0007071878940941564
MeanAbsoluteError value on hold-out data: 0.014280397444963455
Epoch: 139
Loss on hold-out set: 0.00092444424396825
MeanAbsoluteError value on hold-out data: 0.01728159561753273
Epoch: 140
Loss on hold-out set: 0.0008891247803388213
MeanAbsoluteError value on hold-out data: 0.019413745030760765
Epoch: 141
Loss on hold-out set: 0.0009932998394728393
MeanAbsoluteError value on hold-out data: 0.025474270805716515
Epoch: 142
Loss on hold-out set: 0.0007043499357869701
MeanAbsoluteError value on hold-out data: 0.02018715627491474
Epoch: 143
Loss on hold-out set: 0.00055931687567959
MeanAbsoluteError value on hold-out data: 0.016486775130033493
Epoch: 144
Loss on hold-out set: 0.0004458982960051416
MeanAbsoluteError value on hold-out data: 0.012016760185360909
Epoch: 145
Loss on hold-out set: 0.0007235846469963068
MeanAbsoluteError value on hold-out data: 0.0171933863312006
Epoch: 146
Loss on hold-out set: 0.0006793624711702394
MeanAbsoluteError value on hold-out data: 0.013455230742692947
Epoch: 147
Loss on hold-out set: 0.0008062462415852535
MeanAbsoluteError value on hold-out data: 0.02126382105052471
Epoch: 148
Loss on hold-out set: 0.0008276824932851779
MeanAbsoluteError value on hold-out data: 0.02362866885960102
Epoch: 149
Loss on hold-out set: 0.0006591395576833747
MeanAbsoluteError value on hold-out data: 0.015305797569453716
Epoch: 150
Loss on hold-out set: 0.0008676692234171481
MeanAbsoluteError value on hold-out data: 0.01492976862937212
Epoch: 151
Loss on hold-out set: 0.0006188824045239016
MeanAbsoluteError value on hold-out data: 0.018936151638627052
Epoch: 152
Loss on hold-out set: 0.0009368513863974888
MeanAbsoluteError value on hold-out data: 0.014706996269524097
Epoch: 153
Loss on hold-out set: 0.00034651318084175537
MeanAbsoluteError value on hold-out data: 0.009663938544690609
Epoch: 154
Loss on hold-out set: 0.0003523653694245647
MeanAbsoluteError value on hold-out data: 0.008435025811195374
Epoch: 155
Loss on hold-out set: 0.0007648699157518996
MeanAbsoluteError value on hold-out data: 0.015296265482902527
Epoch: 156
Loss on hold-out set: 0.0009570907419210447
MeanAbsoluteError value on hold-out data: 0.021992137655615807
Epoch: 157
Loss on hold-out set: 0.0015324157690261735
MeanAbsoluteError value on hold-out data: 0.03550584241747856
Epoch: 158
Loss on hold-out set: 0.0009077283366901898
MeanAbsoluteError value on hold-out data: 0.02180415205657482
Epoch: 159
Loss on hold-out set: 0.0005406105630820429
MeanAbsoluteError value on hold-out data: 0.012352698482573032
Epoch: 160
Loss on hold-out set: 0.0010308426024398375
MeanAbsoluteError value on hold-out data: 0.022493280470371246
Epoch: 161
Loss on hold-out set: 0.0006427732887938251
MeanAbsoluteError value on hold-out data: 0.014398529194295406
Epoch: 162
Loss on hold-out set: 0.0008669692160765408
MeanAbsoluteError value on hold-out data: 0.01710030622780323
Epoch: 163
Loss on hold-out set: 0.0007168958017198173
MeanAbsoluteError value on hold-out data: 0.019974414259195328
Epoch: 164
Loss on hold-out set: 0.0005653085530818652
MeanAbsoluteError value on hold-out data: 0.010218397714197636
Epoch: 165
Loss on hold-out set: 0.0013798350501977104
MeanAbsoluteError value on hold-out data: 0.03059484250843525
Epoch: 166
Loss on hold-out set: 0.0006897869648367449
MeanAbsoluteError value on hold-out data: 0.013901274651288986
Epoch: 167
Loss on hold-out set: 0.0007248504443850834
MeanAbsoluteError value on hold-out data: 0.014802800491452217
Epoch: 168
Loss on hold-out set: 0.0005180910289039419
MeanAbsoluteError value on hold-out data: 0.012624530121684074
Epoch: 169
Loss on hold-out set: 0.000676606184673514
MeanAbsoluteError value on hold-out data: 0.014216173440217972
Epoch: 170
Loss on hold-out set: 0.0003451256255318999
MeanAbsoluteError value on hold-out data: 0.013870826922357082
Epoch: 171
Loss on hold-out set: 0.0005264756795153708
MeanAbsoluteError value on hold-out data: 0.014085369184613228
Epoch: 172
Loss on hold-out set: 0.000881731807902198
MeanAbsoluteError value on hold-out data: 0.0175663772970438
Epoch: 173
Loss on hold-out set: 0.001196557705713387
MeanAbsoluteError value on hold-out data: 0.020465953275561333
Epoch: 174
Loss on hold-out set: 0.0008949578663496619
MeanAbsoluteError value on hold-out data: 0.020430682227015495
Epoch: 175
Loss on hold-out set: 0.0013970412983326241
MeanAbsoluteError value on hold-out data: 0.025397317484021187
Epoch: 176
Loss on hold-out set: 0.0008270221294783129
MeanAbsoluteError value on hold-out data: 0.017295081168413162
Epoch: 177
Loss on hold-out set: 0.0008591014492068146
MeanAbsoluteError value on hold-out data: 0.01615745760500431
Epoch: 178
Loss on hold-out set: 0.0005282462905023223
MeanAbsoluteError value on hold-out data: 0.016222797334194183
Epoch: 179
Loss on hold-out set: 0.0006058621695142632
MeanAbsoluteError value on hold-out data: 0.014207941479980946
Epoch: 180
Loss on hold-out set: 0.0005793009440822061
MeanAbsoluteError value on hold-out data: 0.015791835263371468
Epoch: 181
Loss on hold-out set: 0.0006443469290771693
MeanAbsoluteError value on hold-out data: 0.018671512603759766
Epoch: 182
Loss on hold-out set: 0.0006299920423771255
MeanAbsoluteError value on hold-out data: 0.018858181312680244
Epoch: 183
Loss on hold-out set: 0.0004411685805747
MeanAbsoluteError value on hold-out data: 0.010081395506858826
Epoch: 184
Loss on hold-out set: 0.0007111044560827539
MeanAbsoluteError value on hold-out data: 0.011910364031791687
Epoch: 185
Loss on hold-out set: 0.0005642568902610373
MeanAbsoluteError value on hold-out data: 0.013742051087319851
Epoch: 186
Loss on hold-out set: 0.0011720881483549754
MeanAbsoluteError value on hold-out data: 0.018938742578029633
Epoch: 187
Loss on hold-out set: 0.000590878489004497
MeanAbsoluteError value on hold-out data: 0.015328874811530113
Epoch: 188
Loss on hold-out set: 0.0006746492799720727
MeanAbsoluteError value on hold-out data: 0.021675558760762215
Epoch: 189
Loss on hold-out set: 0.00045015269577226337
MeanAbsoluteError value on hold-out data: 0.01020349096506834
Epoch: 190
Loss on hold-out set: 0.000538880139796866
MeanAbsoluteError value on hold-out data: 0.013715177774429321
Epoch: 191
Loss on hold-out set: 0.0005197567992773225
MeanAbsoluteError value on hold-out data: 0.0115558672696352
Epoch: 192
Loss on hold-out set: 0.0005559363436125415
MeanAbsoluteError value on hold-out data: 0.014428842812776566
Epoch: 193
Loss on hold-out set: 0.0006224774153547754
MeanAbsoluteError value on hold-out data: 0.018273217603564262
Epoch: 194
Loss on hold-out set: 0.0007647204551367873
MeanAbsoluteError value on hold-out data: 0.0224017184227705
Epoch: 195
Loss on hold-out set: 0.0008398786047492697
MeanAbsoluteError value on hold-out data: 0.015479275025427341
Epoch: 196
Loss on hold-out set: 0.0009180759910745301
MeanAbsoluteError value on hold-out data: 0.023562276735901833
Epoch: 197
Loss on hold-out set: 0.0005769320271754527
MeanAbsoluteError value on hold-out data: 0.013745789416134357
Epoch: 198
Loss on hold-out set: 0.0006418009568158979
MeanAbsoluteError value on hold-out data: 0.018855569884181023
Epoch: 199
Loss on hold-out set: 0.0006330539087541279
MeanAbsoluteError value on hold-out data: 0.013588178902864456
Epoch: 200
Loss on hold-out set: 0.0007094703842564119
MeanAbsoluteError value on hold-out data: 0.01268002949655056
Epoch: 201
Loss on hold-out set: 0.0004966548399112837
MeanAbsoluteError value on hold-out data: 0.013550474308431149
Epoch: 202
Loss on hold-out set: 0.0006294970597465229
MeanAbsoluteError value on hold-out data: 0.015510529279708862
Epoch: 203
Loss on hold-out set: 0.000686210841530211
MeanAbsoluteError value on hold-out data: 0.01539512351155281
Epoch: 204
Loss on hold-out set: 0.0007763167079582146
MeanAbsoluteError value on hold-out data: 0.010647187940776348
Epoch: 205
Loss on hold-out set: 0.0010107446417494334
MeanAbsoluteError value on hold-out data: 0.02629336714744568
Epoch: 206
Loss on hold-out set: 0.0010823602244368214
MeanAbsoluteError value on hold-out data: 0.029592571780085564
Epoch: 207
Loss on hold-out set: 0.0006779310608276558
MeanAbsoluteError value on hold-out data: 0.015905320644378662
Epoch: 208
Loss on hold-out set: 0.0006940117738467004
MeanAbsoluteError value on hold-out data: 0.02168704941868782
Epoch: 209
Loss on hold-out set: 0.0007877135258719423
MeanAbsoluteError value on hold-out data: 0.018388794735074043
Epoch: 210
Loss on hold-out set: 0.0007249158187206424
MeanAbsoluteError value on hold-out data: 0.013701440766453743
Epoch: 211
Loss on hold-out set: 0.0005479522109166474
MeanAbsoluteError value on hold-out data: 0.01575137861073017
Epoch: 212
Loss on hold-out set: 0.0004132631827240785
MeanAbsoluteError value on hold-out data: 0.014618311077356339
Epoch: 213
Loss on hold-out set: 0.0010546959033251226
MeanAbsoluteError value on hold-out data: 0.02244661934673786
Epoch: 214
Loss on hold-out set: 0.0008229372481429508
MeanAbsoluteError value on hold-out data: 0.018266284838318825
Epoch: 215
Loss on hold-out set: 0.000807906749718026
MeanAbsoluteError value on hold-out data: 0.017144018784165382
Epoch: 216
Loss on hold-out set: 0.0006590063191987084
MeanAbsoluteError value on hold-out data: 0.02273886650800705
Epoch: 217
Loss on hold-out set: 0.0010231335763819516
MeanAbsoluteError value on hold-out data: 0.029377348721027374
Epoch: 218
Loss on hold-out set: 0.0009130393698701243
MeanAbsoluteError value on hold-out data: 0.022207146510481834
Epoch: 219
Loss on hold-out set: 0.0010263037953623815
MeanAbsoluteError value on hold-out data: 0.027194010093808174
Epoch: 220
Loss on hold-out set: 0.0006268098755084027
MeanAbsoluteError value on hold-out data: 0.01795954629778862
Epoch: 221
Loss on hold-out set: 0.0005211215853992862
MeanAbsoluteError value on hold-out data: 0.014043466188013554
Epoch: 222
Loss on hold-out set: 0.0011916624092631728
MeanAbsoluteError value on hold-out data: 0.026202021166682243
Epoch: 223
Loss on hold-out set: 0.0007752034783295944
MeanAbsoluteError value on hold-out data: 0.02221224270761013
Epoch: 224
Loss on hold-out set: 0.001084385900819478
MeanAbsoluteError value on hold-out data: 0.02511947602033615
Epoch: 225
Loss on hold-out set: 0.0006366680128466166
MeanAbsoluteError value on hold-out data: 0.016384894028306007
Epoch: 226
Loss on hold-out set: 0.0008099593308686867
MeanAbsoluteError value on hold-out data: 0.020485252141952515
Epoch: 227
Loss on hold-out set: 0.0006916418857910781
MeanAbsoluteError value on hold-out data: 0.014662257395684719
Epoch: 228
Loss on hold-out set: 0.0005978758902194002
MeanAbsoluteError value on hold-out data: 0.01196123007684946
Epoch: 229
Loss on hold-out set: 0.0006111684713112865
MeanAbsoluteError value on hold-out data: 0.014204328879714012
Epoch: 230
Loss on hold-out set: 0.0008531916442543183
MeanAbsoluteError value on hold-out data: 0.015498124994337559
Epoch: 231
Loss on hold-out set: 0.0005200308113623913
MeanAbsoluteError value on hold-out data: 0.014184487983584404
Epoch: 232
Loss on hold-out set: 0.0005224704417694164
MeanAbsoluteError value on hold-out data: 0.01303857658058405
Epoch: 233
Loss on hold-out set: 0.0008897104554834138
MeanAbsoluteError value on hold-out data: 0.02181103266775608
Epoch: 234
Loss on hold-out set: 0.0007374879205599427
MeanAbsoluteError value on hold-out data: 0.017734739929437637
Epoch: 235
Loss on hold-out set: 0.0005664181794121472
MeanAbsoluteError value on hold-out data: 0.011837459169328213
Epoch: 236
Loss on hold-out set: 0.0006985394504322597
MeanAbsoluteError value on hold-out data: 0.01417912170290947
Epoch: 237
Loss on hold-out set: 0.000538438547377346
MeanAbsoluteError value on hold-out data: 0.01353154145181179
Epoch: 238
Loss on hold-out set: 0.0004352477975005872
MeanAbsoluteError value on hold-out data: 0.01619577966630459
Epoch: 239
Loss on hold-out set: 0.0008633247828248912
MeanAbsoluteError value on hold-out data: 0.015414044260978699
Epoch: 240
Loss on hold-out set: 0.0005582788419958792
MeanAbsoluteError value on hold-out data: 0.019705843180418015
Epoch: 241
Loss on hold-out set: 0.00045998979178301324
MeanAbsoluteError value on hold-out data: 0.010777241550385952
Epoch: 242
Loss on hold-out set: 0.0011936937030680526
MeanAbsoluteError value on hold-out data: 0.020860819146037102
Epoch: 243
Loss on hold-out set: 0.0012010685520516219
MeanAbsoluteError value on hold-out data: 0.028567763045430183
Epoch: 244
Loss on hold-out set: 0.0006914719304308834
MeanAbsoluteError value on hold-out data: 0.0181060079485178
Epoch: 245
Loss on hold-out set: 0.00040696603441335214
MeanAbsoluteError value on hold-out data: 0.015224989503622055
Epoch: 246
Loss on hold-out set: 0.0006171505975592146
MeanAbsoluteError value on hold-out data: 0.013475654646754265
Epoch: 247
Loss on hold-out set: 0.00048280167773459413
MeanAbsoluteError value on hold-out data: 0.010469334200024605
Epoch: 248
Loss on hold-out set: 0.0009510934408018855
MeanAbsoluteError value on hold-out data: 0.02493918687105179
Epoch: 249
Loss on hold-out set: 0.0009378301972327264
MeanAbsoluteError value on hold-out data: 0.018101634457707405
Epoch: 250
Loss on hold-out set: 0.00047947186746904135
MeanAbsoluteError value on hold-out data: 0.010876059532165527
Epoch: 251
Loss on hold-out set: 0.0005229610468105468
MeanAbsoluteError value on hold-out data: 0.011837221682071686
Epoch: 252
Loss on hold-out set: 0.0006138124034278965
MeanAbsoluteError value on hold-out data: 0.013697698712348938
Epoch: 253
Loss on hold-out set: 0.000364913902013828
MeanAbsoluteError value on hold-out data: 0.009775793179869652
Epoch: 254
Loss on hold-out set: 0.00033189903279219976
MeanAbsoluteError value on hold-out data: 0.008817395195364952
Epoch: 255
Loss on hold-out set: 0.0008436049024327842
MeanAbsoluteError value on hold-out data: 0.014353605918586254
Epoch: 256
Loss on hold-out set: 0.0013607206109506813
MeanAbsoluteError value on hold-out data: 0.029465828090906143
Returned to Spot: Validation loss: 0.0013607206109506813
----------------------------------------------
spotPython tuning: 0.00013470325345559488 [######----] 58.16% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 1.7424743763427841e-06, 'lr_mult': 7.216809201331276, 'batch_size': 8, 'epochs': 512, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adam', 'sgd_momentum': 0.9497556776100443}
Epoch: 1
Loss on hold-out set: 0.022862531845212766
MeanAbsoluteError value on hold-out data: 0.11802183836698532
Epoch: 2
Loss on hold-out set: 0.01905098671436702
MeanAbsoluteError value on hold-out data: 0.10858365148305893
Epoch: 3
Loss on hold-out set: 0.01139383997130943
MeanAbsoluteError value on hold-out data: 0.08264564722776413
Epoch: 4
Loss on hold-out set: 0.007614402532405955
MeanAbsoluteError value on hold-out data: 0.06795451790094376
Epoch: 5
Loss on hold-out set: 0.0030319973922910562
MeanAbsoluteError value on hold-out data: 0.04251173511147499
Epoch: 6
Loss on hold-out set: 0.0009328957542158222
MeanAbsoluteError value on hold-out data: 0.022222893312573433
Epoch: 7
Loss on hold-out set: 0.0003370824832401061
MeanAbsoluteError value on hold-out data: 0.01055399514734745
Epoch: 8
Loss on hold-out set: 0.00017633358252647953
MeanAbsoluteError value on hold-out data: 0.004317829385399818
Epoch: 9
Loss on hold-out set: 0.00012821829903941762
MeanAbsoluteError value on hold-out data: 0.0028603775426745415
Epoch: 10
Loss on hold-out set: 9.775532423436504e-05
MeanAbsoluteError value on hold-out data: 0.0024180833715945482
Epoch: 11
Loss on hold-out set: 7.541217550660324e-05
MeanAbsoluteError value on hold-out data: 0.0022591459564864635
Epoch: 12
Loss on hold-out set: 5.679587579116311e-05
MeanAbsoluteError value on hold-out data: 0.0020214233081787825
Epoch: 13
Loss on hold-out set: 4.260953268367542e-05
MeanAbsoluteError value on hold-out data: 0.001908690552227199
Epoch: 14
Loss on hold-out set: 3.187330859969064e-05
MeanAbsoluteError value on hold-out data: 0.0018606382654979825
Epoch: 15
Loss on hold-out set: 2.34600790738688e-05
MeanAbsoluteError value on hold-out data: 0.0016642108093947172
Epoch: 16
Loss on hold-out set: 1.7522735450520006e-05
MeanAbsoluteError value on hold-out data: 0.0016046080272644758
Epoch: 17
Loss on hold-out set: 1.4453731619381105e-05
MeanAbsoluteError value on hold-out data: 0.001975986873731017
Epoch: 18
Loss on hold-out set: 1.2184216619684057e-05
MeanAbsoluteError value on hold-out data: 0.0021858017425984144
Epoch: 19
Loss on hold-out set: 1.0539618211910956e-05
MeanAbsoluteError value on hold-out data: 0.002296833321452141
Epoch: 20
Loss on hold-out set: 8.653078746072807e-06
MeanAbsoluteError value on hold-out data: 0.0022113521117717028
Epoch: 21
Loss on hold-out set: 6.399849864560804e-06
MeanAbsoluteError value on hold-out data: 0.0019224504940211773
Epoch: 22
Loss on hold-out set: 4.026401035461229e-06
MeanAbsoluteError value on hold-out data: 0.0014533457579091191
Epoch: 23
Loss on hold-out set: 2.60496813995671e-06
MeanAbsoluteError value on hold-out data: 0.0011385881807655096
Epoch: 24
Loss on hold-out set: 2.188956864002696e-06
MeanAbsoluteError value on hold-out data: 0.0011001056991517544
Epoch: 25
Loss on hold-out set: 1.576528481749799e-06
MeanAbsoluteError value on hold-out data: 0.0009288156288675964
Epoch: 26
Loss on hold-out set: 1.3650502299505637e-06
MeanAbsoluteError value on hold-out data: 0.0008926594164222479
Epoch: 27
Loss on hold-out set: 2.8057956994512336e-06
MeanAbsoluteError value on hold-out data: 0.0014416036428883672
Epoch: 28
Loss on hold-out set: 6.236668827784199e-06
MeanAbsoluteError value on hold-out data: 0.0023139126133173704
Epoch: 29
Loss on hold-out set: 1.1798540454995083e-05
MeanAbsoluteError value on hold-out data: 0.0032709273509681225
Epoch: 30
Loss on hold-out set: 1.0833270547855614e-05
MeanAbsoluteError value on hold-out data: 0.0030969989020377398
Epoch: 31
Loss on hold-out set: 3.1898438117806155e-06
MeanAbsoluteError value on hold-out data: 0.0015254755271598697
Epoch: 32
Loss on hold-out set: 1.0040134880209974e-06
MeanAbsoluteError value on hold-out data: 0.0007882458739914
Epoch: 33
Loss on hold-out set: 1.2548194773312628e-06
MeanAbsoluteError value on hold-out data: 0.0009009949280880392
Epoch: 34
Loss on hold-out set: 2.0413710435724695e-06
MeanAbsoluteError value on hold-out data: 0.001195988617837429
Epoch: 35
Loss on hold-out set: 1.6380657376957014e-06
MeanAbsoluteError value on hold-out data: 0.0010370990494266152
Epoch: 36
Loss on hold-out set: 1.179110275242429e-06
MeanAbsoluteError value on hold-out data: 0.0008596805855631828
Epoch: 37
Loss on hold-out set: 1.588725416019387e-06
MeanAbsoluteError value on hold-out data: 0.0010135008487850428
Epoch: 38
Loss on hold-out set: 1.5991914801516988e-06
MeanAbsoluteError value on hold-out data: 0.0010145001579076052
Epoch: 39
Loss on hold-out set: 1.4228888992898935e-06
MeanAbsoluteError value on hold-out data: 0.0009431986836716533
Epoch: 40
Loss on hold-out set: 2.0910384310618132e-06
MeanAbsoluteError value on hold-out data: 0.0011638081632554531
Epoch: 41
Loss on hold-out set: 5.376674284649964e-06
MeanAbsoluteError value on hold-out data: 0.00207220995798707
Epoch: 42
Loss on hold-out set: 5.732827820506109e-06
MeanAbsoluteError value on hold-out data: 0.002189269522204995
Epoch: 43
Loss on hold-out set: 3.718138262492606e-06
MeanAbsoluteError value on hold-out data: 0.0016998543869704008
Epoch: 44
Loss on hold-out set: 3.253455277349291e-06
MeanAbsoluteError value on hold-out data: 0.0015593565767630935
Epoch: 45
Loss on hold-out set: 1.4718514927081789e-06
MeanAbsoluteError value on hold-out data: 0.0009891979862004519
Epoch: 46
Loss on hold-out set: 7.468072740984529e-06
MeanAbsoluteError value on hold-out data: 0.0024921810254454613
Epoch: 47
Loss on hold-out set: 2.501228680940633e-05
MeanAbsoluteError value on hold-out data: 0.004831211641430855
Epoch: 48
Loss on hold-out set: 1.568802154475921e-05
MeanAbsoluteError value on hold-out data: 0.0037737726233899593
Epoch: 49
Loss on hold-out set: 1.2363169066463198e-05
MeanAbsoluteError value on hold-out data: 0.0032805197406560183
Epoch: 50
Loss on hold-out set: 1.6045866902315635e-05
MeanAbsoluteError value on hold-out data: 0.0037433067336678505
Epoch: 51
Loss on hold-out set: 1.8581978948580064e-05
MeanAbsoluteError value on hold-out data: 0.004036557860672474
Epoch: 52
Loss on hold-out set: 1.7815197153188484e-05
MeanAbsoluteError value on hold-out data: 0.003937455825507641
Epoch: 53
Loss on hold-out set: 1.2289619989085048e-05
MeanAbsoluteError value on hold-out data: 0.0032160331029444933
Epoch: 54
Loss on hold-out set: 4.067481753329623e-06
MeanAbsoluteError value on hold-out data: 0.0017192931845784187
Epoch: 55
Loss on hold-out set: 1.2187513508060396e-05
MeanAbsoluteError value on hold-out data: 0.0032819369807839394
Epoch: 56
Loss on hold-out set: 0.0001314127500671403
MeanAbsoluteError value on hold-out data: 0.011159950867295265
Epoch: 57
Loss on hold-out set: 0.00010941985271385515
MeanAbsoluteError value on hold-out data: 0.009535377845168114
Epoch: 58
Loss on hold-out set: 3.5305214516100885e-06
MeanAbsoluteError value on hold-out data: 0.0015645523089915514
Epoch: 59
Loss on hold-out set: 1.194688072820626e-06
MeanAbsoluteError value on hold-out data: 0.0008600067812949419
Epoch: 60
Loss on hold-out set: 1.547770883061467e-06
MeanAbsoluteError value on hold-out data: 0.0009985134238377213
Epoch: 61
Loss on hold-out set: 1.1988178122716196e-06
MeanAbsoluteError value on hold-out data: 0.0008619738509878516
Epoch: 62
Loss on hold-out set: 1.3849936305189801e-06
MeanAbsoluteError value on hold-out data: 0.000938164594117552
Epoch: 63
Loss on hold-out set: 3.2654300196698293e-06
MeanAbsoluteError value on hold-out data: 0.0015485124895349145
Epoch: 64
Loss on hold-out set: 4.671079816369839e-06
MeanAbsoluteError value on hold-out data: 0.00195058505050838
Epoch: 65
Loss on hold-out set: 1.1831576717656246e-06
MeanAbsoluteError value on hold-out data: 0.000879682891536504
Epoch: 66
Loss on hold-out set: 9.022101622983763e-07
MeanAbsoluteError value on hold-out data: 0.0007534663891419768
Epoch: 67
Loss on hold-out set: 3.0277116467770705e-06
MeanAbsoluteError value on hold-out data: 0.0015097669092938304
Epoch: 68
Loss on hold-out set: 1.1460072552213923e-05
MeanAbsoluteError value on hold-out data: 0.0032199642155319452
Epoch: 69
Loss on hold-out set: 8.860191141330257e-06
MeanAbsoluteError value on hold-out data: 0.002780989743769169
Epoch: 70
Loss on hold-out set: 1.1604362570276288e-05
MeanAbsoluteError value on hold-out data: 0.003188270842656493
Epoch: 71
Loss on hold-out set: 1.4583696874500387e-05
MeanAbsoluteError value on hold-out data: 0.003579963929951191
Epoch: 72
Loss on hold-out set: 1.631730323855376e-05
MeanAbsoluteError value on hold-out data: 0.0037879692390561104
Epoch: 73
Loss on hold-out set: 1.5179026772066687e-05
MeanAbsoluteError value on hold-out data: 0.003636253299191594
Epoch: 74
Loss on hold-out set: 1.0551472338480189e-05
MeanAbsoluteError value on hold-out data: 0.002972372341901064
Epoch: 75
Loss on hold-out set: 2.397577391452375e-06
MeanAbsoluteError value on hold-out data: 0.0012573287822306156
Epoch: 76
Loss on hold-out set: 1.6303049673488683e-05
MeanAbsoluteError value on hold-out data: 0.003839875105768442
Epoch: 77
Loss on hold-out set: 0.00014647174056766458
MeanAbsoluteError value on hold-out data: 0.011822706088423729
Epoch: 78
Loss on hold-out set: 7.381365809889853e-05
MeanAbsoluteError value on hold-out data: 0.007703588809818029
Epoch: 79
Loss on hold-out set: 1.8777762914181182e-06
MeanAbsoluteError value on hold-out data: 0.0010816535213962197
Epoch: 80
Loss on hold-out set: 1.1471831069648511e-06
MeanAbsoluteError value on hold-out data: 0.0008454024791717529
Epoch: 81
Loss on hold-out set: 1.4943604095438594e-06
MeanAbsoluteError value on hold-out data: 0.000979247153736651
Epoch: 82
Loss on hold-out set: 1.165554887225689e-06
MeanAbsoluteError value on hold-out data: 0.0008505266159772873
Epoch: 83
Loss on hold-out set: 1.381404673177138e-06
MeanAbsoluteError value on hold-out data: 0.0009359083487652242
Epoch: 84
Loss on hold-out set: 3.301158181712756e-06
MeanAbsoluteError value on hold-out data: 0.0015660012140870094
Epoch: 85
Loss on hold-out set: 4.000630987751433e-06
MeanAbsoluteError value on hold-out data: 0.001784899621270597
Epoch: 86
Loss on hold-out set: 9.713547303578564e-07
MeanAbsoluteError value on hold-out data: 0.0007893303409218788
Epoch: 87
Loss on hold-out set: 9.160121744631206e-07
MeanAbsoluteError value on hold-out data: 0.0007534290780313313
Epoch: 88
Loss on hold-out set: 2.9343349775732157e-06
MeanAbsoluteError value on hold-out data: 0.0014837647322565317
Epoch: 89
Loss on hold-out set: 1.0480490094491152e-05
MeanAbsoluteError value on hold-out data: 0.003071253653615713
Epoch: 90
Loss on hold-out set: 7.70814520030016e-06
MeanAbsoluteError value on hold-out data: 0.002573528792709112
Epoch: 91
Loss on hold-out set: 1.3014735989264936e-05
MeanAbsoluteError value on hold-out data: 0.0033988268114626408
Epoch: 92
Loss on hold-out set: 1.4724532906927235e-05
MeanAbsoluteError value on hold-out data: 0.0036069334018975496
Epoch: 93
Loss on hold-out set: 1.9697063084765288e-05
MeanAbsoluteError value on hold-out data: 0.004200390540063381
Epoch: 94
Loss on hold-out set: 2.2589715698766094e-05
MeanAbsoluteError value on hold-out data: 0.004518026951700449
Epoch: 95
Loss on hold-out set: 2.6021570264626797e-05
MeanAbsoluteError value on hold-out data: 0.004870301112532616
Epoch: 96
Loss on hold-out set: 2.4945264086502567e-05
MeanAbsoluteError value on hold-out data: 0.004776994232088327
Epoch: 97
Loss on hold-out set: 2.6358318312926904e-05
MeanAbsoluteError value on hold-out data: 0.004919625353068113
Epoch: 98
Loss on hold-out set: 2.2678012316502743e-05
MeanAbsoluteError value on hold-out data: 0.004551471211016178
Epoch: 99
Loss on hold-out set: 2.3919613508233422e-05
MeanAbsoluteError value on hold-out data: 0.004674495197832584
Epoch: 100
Loss on hold-out set: 2.1042779400503558e-05
MeanAbsoluteError value on hold-out data: 0.004370903130620718
Epoch: 101
Loss on hold-out set: 2.4061612700614588e-05
MeanAbsoluteError value on hold-out data: 0.004684812854975462
Epoch: 102
Loss on hold-out set: 2.2487590381627486e-05
MeanAbsoluteError value on hold-out data: 0.004525205120444298
Epoch: 103
Loss on hold-out set: 2.5641056685057456e-05
MeanAbsoluteError value on hold-out data: 0.0048473007045686245
Epoch: 104
Loss on hold-out set: 2.1751941762647076e-05
MeanAbsoluteError value on hold-out data: 0.004448274150490761
Epoch: 105
Loss on hold-out set: 2.6258720553366737e-05
MeanAbsoluteError value on hold-out data: 0.004908135160803795
Epoch: 106
Loss on hold-out set: 2.0018316191501645e-05
MeanAbsoluteError value on hold-out data: 0.004256363958120346
Epoch: 107
Loss on hold-out set: 2.6540514969191893e-05
MeanAbsoluteError value on hold-out data: 0.004938190802931786
Epoch: 108
Loss on hold-out set: 2.332368340399913e-05
MeanAbsoluteError value on hold-out data: 0.004612111020833254
Epoch: 109
Loss on hold-out set: 2.401229712153221e-05
MeanAbsoluteError value on hold-out data: 0.004686653148382902
Epoch: 110
Loss on hold-out set: 2.59288767186885e-05
MeanAbsoluteError value on hold-out data: 0.004883773159235716
Epoch: 111
Loss on hold-out set: 2.488293603164493e-05
MeanAbsoluteError value on hold-out data: 0.004777316935360432
Epoch: 112
Loss on hold-out set: 2.2931236966733675e-05
MeanAbsoluteError value on hold-out data: 0.0045809452421963215
Epoch: 113
Loss on hold-out set: 2.2728543195913325e-05
MeanAbsoluteError value on hold-out data: 0.004556960891932249
Epoch: 114
Loss on hold-out set: 2.548516170607304e-05
MeanAbsoluteError value on hold-out data: 0.004835763014853001
Epoch: 115
Loss on hold-out set: 2.0905504003933044e-05
MeanAbsoluteError value on hold-out data: 0.004359185695648193
Epoch: 116
Loss on hold-out set: 2.633174330855438e-05
MeanAbsoluteError value on hold-out data: 0.00492094736546278
Epoch: 117
Loss on hold-out set: 2.6295327092827248e-05
MeanAbsoluteError value on hold-out data: 0.004919237457215786
Epoch: 118
Loss on hold-out set: 2.2359692354113674e-05
MeanAbsoluteError value on hold-out data: 0.0045210570096969604
Epoch: 119
Loss on hold-out set: 2.4388703686303127e-05
MeanAbsoluteError value on hold-out data: 0.004732081200927496
Epoch: 120
Loss on hold-out set: 2.5253151187299456e-05
MeanAbsoluteError value on hold-out data: 0.004816100001335144
Epoch: 121
Loss on hold-out set: 2.110108866154884e-05
MeanAbsoluteError value on hold-out data: 0.004382973071187735
Epoch: 122
Loss on hold-out set: 2.5516729788490155e-05
MeanAbsoluteError value on hold-out data: 0.004845939576625824
Epoch: 123
Loss on hold-out set: 2.2981823062046285e-05
MeanAbsoluteError value on hold-out data: 0.004581314045935869
Epoch: 124
Loss on hold-out set: 2.3064097771758068e-05
MeanAbsoluteError value on hold-out data: 0.004592608194798231
Epoch: 125
Loss on hold-out set: 2.575332674544035e-05
MeanAbsoluteError value on hold-out data: 0.004870119970291853
Epoch: 126
Loss on hold-out set: 2.4069283450731554e-05
MeanAbsoluteError value on hold-out data: 0.004697382915765047
Epoch: 127
Loss on hold-out set: 2.2621051668561688e-05
MeanAbsoluteError value on hold-out data: 0.004548150580376387
Epoch: 128
Loss on hold-out set: 2.5278931963456624e-05
MeanAbsoluteError value on hold-out data: 0.004824492149055004
Epoch: 129
Loss on hold-out set: 2.3317795263497637e-05
MeanAbsoluteError value on hold-out data: 0.004619175568223
Epoch: 130
Loss on hold-out set: 2.2459553891071426e-05
MeanAbsoluteError value on hold-out data: 0.004530509002506733
Epoch: 131
Loss on hold-out set: 2.4794222458455662e-05
MeanAbsoluteError value on hold-out data: 0.004774273838847876
Epoch: 132
Loss on hold-out set: 2.6720717295048463e-05
MeanAbsoluteError value on hold-out data: 0.004964998923242092
Epoch: 133
Loss on hold-out set: 2.0922917668174608e-05
MeanAbsoluteError value on hold-out data: 0.0043668788857758045
Epoch: 134
Loss on hold-out set: 2.3381526836218607e-05
MeanAbsoluteError value on hold-out data: 0.004630247130990028
Epoch: 135
Loss on hold-out set: 2.5209742967777665e-05
MeanAbsoluteError value on hold-out data: 0.004817587323486805
Epoch: 136
Loss on hold-out set: 2.4182731330687314e-05
MeanAbsoluteError value on hold-out data: 0.004711964633315802
Epoch: 137
Loss on hold-out set: 2.2786445721354348e-05
MeanAbsoluteError value on hold-out data: 0.004568242467939854
Epoch: 138
Loss on hold-out set: 2.4823276697517078e-05
MeanAbsoluteError value on hold-out data: 0.004780179355293512
Epoch: 139
Loss on hold-out set: 2.6733162389734245e-05
MeanAbsoluteError value on hold-out data: 0.004968286957591772
Epoch: 140
Loss on hold-out set: 1.9139141793283143e-05
MeanAbsoluteError value on hold-out data: 0.004166030790656805
Epoch: 141
Loss on hold-out set: 2.2980696437451498e-05
MeanAbsoluteError value on hold-out data: 0.0045868707820773125
Epoch: 142
Loss on hold-out set: 0.0014430163029924426
MeanAbsoluteError value on hold-out data: 0.03783675655722618
Epoch: 143
Loss on hold-out set: 2.0854977660028933e-05
MeanAbsoluteError value on hold-out data: 0.0034735456574708223
Epoch: 144
Loss on hold-out set: 1.9991613959590676e-06
MeanAbsoluteError value on hold-out data: 0.0010925480164587498
Epoch: 145
Loss on hold-out set: 2.139585201408217e-06
MeanAbsoluteError value on hold-out data: 0.00114809803199023
Epoch: 146
Loss on hold-out set: 1.8521225333762759e-06
MeanAbsoluteError value on hold-out data: 0.0010741926962509751
Epoch: 147
Loss on hold-out set: 1.181062109211732e-06
MeanAbsoluteError value on hold-out data: 0.0008383720996789634
Epoch: 148
Loss on hold-out set: 1.1419010317431935e-06
MeanAbsoluteError value on hold-out data: 0.0008247459190897644
Epoch: 149
Loss on hold-out set: 1.1776265266330723e-06
MeanAbsoluteError value on hold-out data: 0.0008374711032956839
Epoch: 150
Loss on hold-out set: 1.0488402668478988e-06
MeanAbsoluteError value on hold-out data: 0.0008029053569771349
Epoch: 151
Loss on hold-out set: 1.3138594650136407e-06
MeanAbsoluteError value on hold-out data: 0.0009221368236467242
Epoch: 152
Loss on hold-out set: 1.256646177993341e-06
MeanAbsoluteError value on hold-out data: 0.0008863686234690249
Epoch: 153
Loss on hold-out set: 3.331686873240726e-06
MeanAbsoluteError value on hold-out data: 0.0015707534039393067
Epoch: 154
Loss on hold-out set: 3.0981585903071775e-06
MeanAbsoluteError value on hold-out data: 0.001526263658888638
Epoch: 155
Loss on hold-out set: 8.923125331026122e-07
MeanAbsoluteError value on hold-out data: 0.0007514245226047933
Epoch: 156
Loss on hold-out set: 1.046105369159465e-06
MeanAbsoluteError value on hold-out data: 0.000810337602160871
Epoch: 157
Loss on hold-out set: 3.338767798093039e-06
MeanAbsoluteError value on hold-out data: 0.0015959265874698758
Epoch: 158
Loss on hold-out set: 9.197720134436263e-06
MeanAbsoluteError value on hold-out data: 0.002852111356332898
Epoch: 159
Loss on hold-out set: 6.29931193878675e-06
MeanAbsoluteError value on hold-out data: 0.002287025097757578
Epoch: 160
Loss on hold-out set: 1.9687966486296654e-05
MeanAbsoluteError value on hold-out data: 0.004244000650942326
Epoch: 161
Loss on hold-out set: 1.3261490278780816e-05
MeanAbsoluteError value on hold-out data: 0.0034118788316845894
Epoch: 162
Loss on hold-out set: 3.159018452654556e-05
MeanAbsoluteError value on hold-out data: 0.005411968100816011
Epoch: 163
Loss on hold-out set: 2.3085629029657484e-05
MeanAbsoluteError value on hold-out data: 0.004595431964844465
Epoch: 164
Loss on hold-out set: 2.6965917976141147e-05
MeanAbsoluteError value on hold-out data: 0.004997106269001961
Epoch: 165
Loss on hold-out set: 2.4794092975131016e-05
MeanAbsoluteError value on hold-out data: 0.004774665925651789
Epoch: 166
Loss on hold-out set: 2.2997672539005227e-05
MeanAbsoluteError value on hold-out data: 0.004595582839101553
Epoch: 167
Loss on hold-out set: 1.960977476157591e-05
MeanAbsoluteError value on hold-out data: 0.004221220035105944
Epoch: 168
Loss on hold-out set: 2.9814085648563616e-05
MeanAbsoluteError value on hold-out data: 0.005260665435343981
Epoch: 169
Loss on hold-out set: 1.394049496938303e-05
MeanAbsoluteError value on hold-out data: 0.0035065992269665003
Epoch: 170
Loss on hold-out set: 3.2957249842231826e-05
MeanAbsoluteError value on hold-out data: 0.005539926700294018
Epoch: 171
Loss on hold-out set: 1.2675775068553202e-05
MeanAbsoluteError value on hold-out data: 0.0033255659509450197
Epoch: 172
Loss on hold-out set: 3.650201372358041e-05
MeanAbsoluteError value on hold-out data: 0.0058434829115867615
Epoch: 173
Loss on hold-out set: 1.4083607502949522e-05
MeanAbsoluteError value on hold-out data: 0.003528076922520995
Epoch: 174
Loss on hold-out set: 2.9725421403494884e-05
MeanAbsoluteError value on hold-out data: 0.005254288204014301
Epoch: 175
Loss on hold-out set: 1.3625725937584465e-05
MeanAbsoluteError value on hold-out data: 0.0034563587978482246
Epoch: 176
Loss on hold-out set: 2.505102307431547e-05
MeanAbsoluteError value on hold-out data: 0.0047936588525772095
Epoch: 177
Loss on hold-out set: 1.7343810477062728e-05
MeanAbsoluteError value on hold-out data: 0.003939751069992781
Epoch: 178
Loss on hold-out set: 3.448538528142595e-05
MeanAbsoluteError value on hold-out data: 0.005674405954778194
Epoch: 179
Loss on hold-out set: 1.747708057863699e-05
MeanAbsoluteError value on hold-out data: 0.003960154484957457
Epoch: 180
Loss on hold-out set: 2.1191341004037224e-05
MeanAbsoluteError value on hold-out data: 0.004393432755023241
Epoch: 181
Loss on hold-out set: 1.9817139912591204e-05
MeanAbsoluteError value on hold-out data: 0.004239281173795462
Epoch: 182
Loss on hold-out set: 2.214925100480813e-05
MeanAbsoluteError value on hold-out data: 0.004492731299251318
Epoch: 183
Loss on hold-out set: 1.8684643787549393e-05
MeanAbsoluteError value on hold-out data: 0.004103445913642645
Epoch: 184
Loss on hold-out set: 1.986163916674406e-05
MeanAbsoluteError value on hold-out data: 0.004235325381159782
Epoch: 185
Loss on hold-out set: 1.6963626182443574e-05
MeanAbsoluteError value on hold-out data: 0.003887946717441082
Epoch: 186
Loss on hold-out set: 2.945233408306529e-05
MeanAbsoluteError value on hold-out data: 0.00521481316536665
Epoch: 187
Loss on hold-out set: 1.3428243786811914e-05
MeanAbsoluteError value on hold-out data: 0.003428746946156025
Epoch: 188
Loss on hold-out set: 2.46234281372668e-05
MeanAbsoluteError value on hold-out data: 0.004747599828988314
Epoch: 189
Loss on hold-out set: 1.7748539400934915e-05
MeanAbsoluteError value on hold-out data: 0.003987095784395933
Epoch: 190
Loss on hold-out set: 2.3000777218840085e-05
MeanAbsoluteError value on hold-out data: 0.004580033011734486
Epoch: 191
Loss on hold-out set: 1.872716800215513e-05
MeanAbsoluteError value on hold-out data: 0.004098210949450731
Epoch: 192
Loss on hold-out set: 2.8359058983608664e-05
MeanAbsoluteError value on hold-out data: 0.005118167959153652
Epoch: 193
Loss on hold-out set: 1.309378286637902e-05
MeanAbsoluteError value on hold-out data: 0.0033770862501114607
Epoch: 194
Loss on hold-out set: 2.9406684724993904e-05
MeanAbsoluteError value on hold-out data: 0.005217207595705986
Epoch: 195
Loss on hold-out set: 1.0516215118179006e-05
MeanAbsoluteError value on hold-out data: 0.00299959909170866
Epoch: 196
Loss on hold-out set: 2.8716248954496176e-05
MeanAbsoluteError value on hold-out data: 0.005149063188582659
Epoch: 197
Loss on hold-out set: 1.4844618530524281e-05
MeanAbsoluteError value on hold-out data: 0.003618926275521517
Epoch: 198
Loss on hold-out set: 2.622447767096578e-05
MeanAbsoluteError value on hold-out data: 0.004912499338388443
Epoch: 199
Loss on hold-out set: 1.2950441307686178e-05
MeanAbsoluteError value on hold-out data: 0.0033567047212272882
Epoch: 200
Loss on hold-out set: 2.43912706393626e-05
MeanAbsoluteError value on hold-out data: 0.004723540972918272
Epoch: 201
Loss on hold-out set: 1.6711898297216976e-05
MeanAbsoluteError value on hold-out data: 0.003858701791614294
Epoch: 202
Loss on hold-out set: 2.8506683376786224e-05
MeanAbsoluteError value on hold-out data: 0.005134379956871271
Epoch: 203
Loss on hold-out set: 1.4621247756670192e-05
MeanAbsoluteError value on hold-out data: 0.0035893884487450123
Epoch: 204
Loss on hold-out set: 2.493026369464994e-05
MeanAbsoluteError value on hold-out data: 0.00478548975661397
Epoch: 205
Loss on hold-out set: 1.3284126046193323e-05
MeanAbsoluteError value on hold-out data: 0.003409085562452674
Epoch: 206
Loss on hold-out set: 2.4721642603253713e-05
MeanAbsoluteError value on hold-out data: 0.004758539143949747
Epoch: 207
Loss on hold-out set: 1.5643242597051493e-05
MeanAbsoluteError value on hold-out data: 0.0037188343703746796
Epoch: 208
Loss on hold-out set: 2.332315393447827e-05
MeanAbsoluteError value on hold-out data: 0.004615013021975756
Epoch: 209
Loss on hold-out set: 1.5657128427081164e-05
MeanAbsoluteError value on hold-out data: 0.0037214518524706364
Epoch: 210
Loss on hold-out set: 2.1653095221776503e-05
MeanAbsoluteError value on hold-out data: 0.004432337824255228
Epoch: 211
Loss on hold-out set: 1.4070071995918529e-05
MeanAbsoluteError value on hold-out data: 0.0035062707029283047
Epoch: 212
Loss on hold-out set: 2.444961774017429e-05
MeanAbsoluteError value on hold-out data: 0.004723597317934036
Epoch: 213
Loss on hold-out set: 1.7345961982516056e-05
MeanAbsoluteError value on hold-out data: 0.003932090941816568
Epoch: 214
Loss on hold-out set: 2.3029378026924524e-05
MeanAbsoluteError value on hold-out data: 0.004586941096931696
Epoch: 215
Loss on hold-out set: 1.4084574726630786e-05
MeanAbsoluteError value on hold-out data: 0.0035102705005556345
Epoch: 216
Loss on hold-out set: 2.4220964932235228e-05
MeanAbsoluteError value on hold-out data: 0.0047050523571670055
Epoch: 217
Loss on hold-out set: 1.5162944907244405e-05
MeanAbsoluteError value on hold-out data: 0.003655174979940057
Epoch: 218
Loss on hold-out set: 2.1651116807525366e-05
MeanAbsoluteError value on hold-out data: 0.004435633774846792
Epoch: 219
Loss on hold-out set: 1.445070730417348e-05
MeanAbsoluteError value on hold-out data: 0.003557833144441247
Epoch: 220
Loss on hold-out set: 2.05765211974626e-05
MeanAbsoluteError value on hold-out data: 0.0043100155889987946
Epoch: 221
Loss on hold-out set: 1.604732539674028e-05
MeanAbsoluteError value on hold-out data: 0.003763069398701191
Epoch: 222
Loss on hold-out set: 2.2096248286336623e-05
MeanAbsoluteError value on hold-out data: 0.00447715213522315
Epoch: 223
Loss on hold-out set: 1.600251480819057e-05
MeanAbsoluteError value on hold-out data: 0.003761216066777706
Epoch: 224
Loss on hold-out set: 2.0807936547690158e-05
MeanAbsoluteError value on hold-out data: 0.004338548984378576
Epoch: 225
Loss on hold-out set: 1.4882596659797281e-05
MeanAbsoluteError value on hold-out data: 0.00361346872523427
Epoch: 226
Loss on hold-out set: 2.017287167626292e-05
MeanAbsoluteError value on hold-out data: 0.004262453876435757
Epoch: 227
Loss on hold-out set: 1.565644309888931e-05
MeanAbsoluteError value on hold-out data: 0.00371106737293303
Epoch: 228
Loss on hold-out set: 2.1280519137546532e-05
MeanAbsoluteError value on hold-out data: 0.004385579843074083
Epoch: 229
Loss on hold-out set: 1.590507159371076e-05
MeanAbsoluteError value on hold-out data: 0.003745607566088438
Epoch: 230
Loss on hold-out set: 2.048646245767534e-05
MeanAbsoluteError value on hold-out data: 0.0042994022369384766
Epoch: 231
Loss on hold-out set: 1.547234854258836e-05
MeanAbsoluteError value on hold-out data: 0.003689854172989726
Epoch: 232
Loss on hold-out set: 1.9253274283408628e-05
MeanAbsoluteError value on hold-out data: 0.0041553727351129055
Epoch: 233
Loss on hold-out set: 1.594479980619661e-05
MeanAbsoluteError value on hold-out data: 0.003747993614524603
Epoch: 234
Loss on hold-out set: 1.9698476870345122e-05
MeanAbsoluteError value on hold-out data: 0.004204271361231804
Epoch: 235
Loss on hold-out set: 1.6605012158259725e-05
MeanAbsoluteError value on hold-out data: 0.003832787973806262
Epoch: 236
Loss on hold-out set: 1.999028417661688e-05
MeanAbsoluteError value on hold-out data: 0.00424003042280674
Epoch: 237
Loss on hold-out set: 1.564664554328039e-05
MeanAbsoluteError value on hold-out data: 0.0037031734827905893
Epoch: 238
Loss on hold-out set: 2.1745322364471288e-05
MeanAbsoluteError value on hold-out data: 0.004438790958374739
Epoch: 239
Loss on hold-out set: 1.4214230292820598e-05
MeanAbsoluteError value on hold-out data: 0.0035144502762705088
Epoch: 240
Loss on hold-out set: 2.2004841077049558e-05
MeanAbsoluteError value on hold-out data: 0.004468901082873344
Epoch: 241
Loss on hold-out set: 1.3525638139885574e-05
MeanAbsoluteError value on hold-out data: 0.003417234867811203
Epoch: 242
Loss on hold-out set: 2.0955800305512783e-05
MeanAbsoluteError value on hold-out data: 0.0043477159924805164
Epoch: 243
Loss on hold-out set: 1.2409210584289548e-05
MeanAbsoluteError value on hold-out data: 0.003263088408857584
Epoch: 244
Loss on hold-out set: 1.8701118039500313e-05
MeanAbsoluteError value on hold-out data: 0.004089259076863527
Epoch: 245
Loss on hold-out set: 1.397253668313313e-05
MeanAbsoluteError value on hold-out data: 0.0034800542052835226
Epoch: 246
Loss on hold-out set: 1.9125603270559193e-05
MeanAbsoluteError value on hold-out data: 0.004132397007197142
Epoch: 247
Loss on hold-out set: 1.6327642505960905e-05
MeanAbsoluteError value on hold-out data: 0.0037893331609666348
Epoch: 248
Loss on hold-out set: 2.251062804996189e-05
MeanAbsoluteError value on hold-out data: 0.004514426924288273
Epoch: 249
Loss on hold-out set: 3.0104762381118856e-05
MeanAbsoluteError value on hold-out data: 0.004010380245745182
Epoch: 250
Loss on hold-out set: 2.2777446726027656e-05
MeanAbsoluteError value on hold-out data: 0.004554117564111948
Epoch: 251
Loss on hold-out set: 1.4738753825919335e-05
MeanAbsoluteError value on hold-out data: 0.003593766363337636
Epoch: 252
Loss on hold-out set: 2.2443436663659094e-05
MeanAbsoluteError value on hold-out data: 0.004518759436905384
Epoch: 253
Loss on hold-out set: 1.4839037942836417e-05
MeanAbsoluteError value on hold-out data: 0.0036045380402356386
Epoch: 254
Loss on hold-out set: 2.3362881405007914e-05
MeanAbsoluteError value on hold-out data: 0.0046163504011929035
Epoch: 255
Loss on hold-out set: 1.491207663811541e-05
MeanAbsoluteError value on hold-out data: 0.0036127630155533552
Epoch: 256
Loss on hold-out set: 2.4971864389188243e-05
MeanAbsoluteError value on hold-out data: 0.0047826156951487064
Epoch: 257
Loss on hold-out set: 1.4097503074146134e-05
MeanAbsoluteError value on hold-out data: 0.00350920925848186
Epoch: 258
Loss on hold-out set: 2.7842688675599148e-05
MeanAbsoluteError value on hold-out data: 0.005071175284683704
Epoch: 259
Loss on hold-out set: 1.1462035277681456e-05
MeanAbsoluteError value on hold-out data: 0.0031264733988791704
Epoch: 260
Loss on hold-out set: 3.0028039251000766e-05
MeanAbsoluteError value on hold-out data: 0.005278465803712606
Epoch: 261
Loss on hold-out set: 9.486967380661027e-06
MeanAbsoluteError value on hold-out data: 0.0028074232395738363
Epoch: 262
Loss on hold-out set: 3.46652712706648e-05
MeanAbsoluteError value on hold-out data: 0.005691084545105696
Epoch: 263
Loss on hold-out set: 6.7059586040398385e-06
MeanAbsoluteError value on hold-out data: 0.0022847631480544806
Epoch: 264
Loss on hold-out set: 3.673600382937462e-05
MeanAbsoluteError value on hold-out data: 0.0058664013631641865
Epoch: 265
Loss on hold-out set: 4.042769501809648e-06
MeanAbsoluteError value on hold-out data: 0.0016739177517592907
Epoch: 266
Loss on hold-out set: 4.240064974606197e-05
MeanAbsoluteError value on hold-out data: 0.006318662315607071
Epoch: 267
Loss on hold-out set: 2.7759751310740238e-06
MeanAbsoluteError value on hold-out data: 0.0013221381232142448
Epoch: 268
Loss on hold-out set: 4.81344390879569e-05
MeanAbsoluteError value on hold-out data: 0.00674967048689723
Epoch: 269
Loss on hold-out set: 1.486810232545634e-06
MeanAbsoluteError value on hold-out data: 0.000931941787712276
Epoch: 270
Loss on hold-out set: 6.232490858038593e-05
MeanAbsoluteError value on hold-out data: 0.0077154189348220825
Epoch: 271
Loss on hold-out set: 3.89687698100859e-06
MeanAbsoluteError value on hold-out data: 0.0016454599099233747
Epoch: 272
Loss on hold-out set: 0.0001339277916581762
MeanAbsoluteError value on hold-out data: 0.011437490582466125
Epoch: 273
Loss on hold-out set: 7.623662743059724e-06
MeanAbsoluteError value on hold-out data: 0.0022936025634407997
Epoch: 274
Loss on hold-out set: 3.19140316557758e-05
MeanAbsoluteError value on hold-out data: 0.005489536561071873
Epoch: 275
Loss on hold-out set: 2.301278388621971e-06
MeanAbsoluteError value on hold-out data: 0.001196713070385158
Epoch: 276
Loss on hold-out set: 1.2017354085975584e-05
MeanAbsoluteError value on hold-out data: 0.003268537577241659
Epoch: 277
Loss on hold-out set: 2.5931841521828334e-06
MeanAbsoluteError value on hold-out data: 0.0012756353244185448
Epoch: 278
Loss on hold-out set: 2.915475852205418e-05
MeanAbsoluteError value on hold-out data: 0.005225721281021833
Epoch: 279
Loss on hold-out set: 1.430698941586989e-06
MeanAbsoluteError value on hold-out data: 0.000863129273056984
Epoch: 280
Loss on hold-out set: 6.415603744052963e-05
MeanAbsoluteError value on hold-out data: 0.00783430878072977
Epoch: 281
Loss on hold-out set: 3.7754366770202884e-06
MeanAbsoluteError value on hold-out data: 0.0015932924579828978
Epoch: 282
Loss on hold-out set: 0.000156696235966305
MeanAbsoluteError value on hold-out data: 0.012389245443046093
Epoch: 283
Loss on hold-out set: 2.978018945118253e-05
MeanAbsoluteError value on hold-out data: 0.004952393006533384
Early stopping at epoch 282
Returned to Spot: Validation loss: 2.978018945118253e-05
----------------------------------------------
spotPython tuning: 2.978018945118253e-05 [#######---] 68.23% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.0, 'lr_mult': 9.990865993232859, 'batch_size': 8, 'epochs': 512, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adam', 'sgd_momentum': 0.9999940873895596}
Epoch: 1
Loss on hold-out set: 0.023185982754895168
MeanAbsoluteError value on hold-out data: 0.11759676784276962
Epoch: 2
Loss on hold-out set: 0.017238603996750163
MeanAbsoluteError value on hold-out data: 0.1018974632024765
Epoch: 3
Loss on hold-out set: 0.009952579147035354
MeanAbsoluteError value on hold-out data: 0.07757579535245895
Epoch: 4
Loss on hold-out set: 0.002925675110370656
MeanAbsoluteError value on hold-out data: 0.04303337633609772
Epoch: 5
Loss on hold-out set: 0.0002512059577144866
MeanAbsoluteError value on hold-out data: 0.01280287466943264
Epoch: 6
Loss on hold-out set: 1.7647635702719288e-05
MeanAbsoluteError value on hold-out data: 0.0031132849399000406
Epoch: 7
Loss on hold-out set: 4.426428555342155e-06
MeanAbsoluteError value on hold-out data: 0.0010234150104224682
Epoch: 8
Loss on hold-out set: 4.309893581110277e-06
MeanAbsoluteError value on hold-out data: 0.0010703890584409237
Epoch: 9
Loss on hold-out set: 4.732069201233906e-06
MeanAbsoluteError value on hold-out data: 0.0012982558691874146
Epoch: 10
Loss on hold-out set: 4.430966390899764e-06
MeanAbsoluteError value on hold-out data: 0.0012336381478235126
Epoch: 11
Loss on hold-out set: 3.401571241942005e-06
MeanAbsoluteError value on hold-out data: 0.0008735967567190528
Epoch: 12
Loss on hold-out set: 3.618961444903777e-06
MeanAbsoluteError value on hold-out data: 0.0010095289908349514
Epoch: 13
Loss on hold-out set: 3.9416078137540016e-06
MeanAbsoluteError value on hold-out data: 0.0011457637883722782
Epoch: 14
Loss on hold-out set: 4.833403076980558e-06
MeanAbsoluteError value on hold-out data: 0.0014478174271062016
Epoch: 15
Loss on hold-out set: 7.564160844259804e-06
MeanAbsoluteError value on hold-out data: 0.002166157588362694
Epoch: 16
Loss on hold-out set: 4.9083358159183075e-06
MeanAbsoluteError value on hold-out data: 0.0014348889235407114
Epoch: 17
Loss on hold-out set: 4.1566358360892325e-06
MeanAbsoluteError value on hold-out data: 0.001169158611446619
Epoch: 18
Loss on hold-out set: 4.934541472697387e-06
MeanAbsoluteError value on hold-out data: 0.0014510138425976038
Epoch: 19
Loss on hold-out set: 4.552793122432999e-06
MeanAbsoluteError value on hold-out data: 0.0013144046533852816
Epoch: 20
Loss on hold-out set: 9.325382483151962e-06
MeanAbsoluteError value on hold-out data: 0.002516996581107378
Epoch: 21
Loss on hold-out set: 1.58799322985272e-05
MeanAbsoluteError value on hold-out data: 0.0036116624251008034
Epoch: 22
Loss on hold-out set: 2.8305218429044255e-05
MeanAbsoluteError value on hold-out data: 0.005049636587500572
Epoch: 23
Loss on hold-out set: 5.504658292920794e-05
MeanAbsoluteError value on hold-out data: 0.007231519091874361
Epoch: 24
Loss on hold-out set: 3.7300300391507335e-05
MeanAbsoluteError value on hold-out data: 0.005850064102560282
Epoch: 25
Loss on hold-out set: 4.166246014248923e-05
MeanAbsoluteError value on hold-out data: 0.0061922501772642136
Epoch: 26
Loss on hold-out set: 3.79069221564446e-05
MeanAbsoluteError value on hold-out data: 0.0058532338589429855
Epoch: 27
Loss on hold-out set: 2.3565174543412132e-05
MeanAbsoluteError value on hold-out data: 0.0043266876600682735
Epoch: 28
Loss on hold-out set: 6.391332602250163e-06
MeanAbsoluteError value on hold-out data: 0.0015419007977470756
Epoch: 29
Loss on hold-out set: 4.79716094422369e-06
MeanAbsoluteError value on hold-out data: 0.0013615029165521264
Epoch: 30
Loss on hold-out set: 7.396057696951175e-06
MeanAbsoluteError value on hold-out data: 0.001985160866752267
Epoch: 31
Loss on hold-out set: 2.1069205750360486e-05
MeanAbsoluteError value on hold-out data: 0.004150113556534052
Epoch: 32
Loss on hold-out set: 4.2749406690602066e-05
MeanAbsoluteError value on hold-out data: 0.006254592444747686
Epoch: 33
Loss on hold-out set: 4.4105800617743575e-05
MeanAbsoluteError value on hold-out data: 0.006320667918771505
Epoch: 34
Loss on hold-out set: 7.252102362767083e-05
MeanAbsoluteError value on hold-out data: 0.008342666551470757
Epoch: 35
Loss on hold-out set: 0.00013213390028747534
MeanAbsoluteError value on hold-out data: 0.011380708776414394
Epoch: 36
Loss on hold-out set: 0.00021038704366410936
MeanAbsoluteError value on hold-out data: 0.014269943349063396
Epoch: 37
Loss on hold-out set: 0.00012906657464459146
MeanAbsoluteError value on hold-out data: 0.010506829246878624
Epoch: 38
Loss on hold-out set: 0.00019576393242459744
MeanAbsoluteError value on hold-out data: 0.013230270706117153
Epoch: 39
Loss on hold-out set: 9.034497865238672e-06
MeanAbsoluteError value on hold-out data: 0.002200697548687458
Epoch: 40
Loss on hold-out set: 1.2787099858781547e-05
MeanAbsoluteError value on hold-out data: 0.0028687715530395508
Epoch: 41
Loss on hold-out set: 2.9845014978491236e-05
MeanAbsoluteError value on hold-out data: 0.005076650995761156
Epoch: 42
Loss on hold-out set: 4.913779434900789e-06
MeanAbsoluteError value on hold-out data: 0.001304092351347208
Epoch: 43
Loss on hold-out set: 3.439484881757955e-05
MeanAbsoluteError value on hold-out data: 0.00547088123857975
Epoch: 44
Loss on hold-out set: 5.543634927705984e-05
MeanAbsoluteError value on hold-out data: 0.007123835850507021
Epoch: 45
Loss on hold-out set: 3.0837379127708695e-05
MeanAbsoluteError value on hold-out data: 0.005142192356288433
Epoch: 46
Loss on hold-out set: 0.0001241206551448589
MeanAbsoluteError value on hold-out data: 0.011016090400516987
Epoch: 47
Loss on hold-out set: 0.00012478708097325196
MeanAbsoluteError value on hold-out data: 0.01094922237098217
Epoch: 48
Loss on hold-out set: 0.0001281799821682446
MeanAbsoluteError value on hold-out data: 0.01099466998130083
Epoch: 49
Loss on hold-out set: 1.6188403139351164e-05
MeanAbsoluteError value on hold-out data: 0.0032423571683466434
Epoch: 50
Loss on hold-out set: 5.138953211395634e-05
MeanAbsoluteError value on hold-out data: 0.006872924976050854
Epoch: 51
Loss on hold-out set: 6.742626484131171e-05
MeanAbsoluteError value on hold-out data: 0.007974440231919289
Epoch: 52
Loss on hold-out set: 0.0001325254530743941
MeanAbsoluteError value on hold-out data: 0.011351595632731915
Epoch: 53
Loss on hold-out set: 0.00012561211712492973
MeanAbsoluteError value on hold-out data: 0.010898750275373459
Epoch: 54
Loss on hold-out set: 6.131889887527857e-05
MeanAbsoluteError value on hold-out data: 0.007192772347480059
Epoch: 55
Loss on hold-out set: 4.102630196269418e-05
MeanAbsoluteError value on hold-out data: 0.0058462610468268394
Epoch: 56
Loss on hold-out set: 4.9623713685401815e-05
MeanAbsoluteError value on hold-out data: 0.006674375385046005
Epoch: 57
Loss on hold-out set: 9.014485227740614e-05
MeanAbsoluteError value on hold-out data: 0.009284175001084805
Epoch: 58
Loss on hold-out set: 9.992367267841473e-05
MeanAbsoluteError value on hold-out data: 0.009756521321833134
Epoch: 59
Loss on hold-out set: 0.00012951207444482287
MeanAbsoluteError value on hold-out data: 0.011082581244409084
Epoch: 60
Loss on hold-out set: 4.832154124750033e-05
MeanAbsoluteError value on hold-out data: 0.006262854672968388
Epoch: 61
Loss on hold-out set: 0.00013596833454549166
MeanAbsoluteError value on hold-out data: 0.011377634480595589
Epoch: 62
Loss on hold-out set: 3.354116415721364e-05
MeanAbsoluteError value on hold-out data: 0.005098511464893818
Epoch: 63
Loss on hold-out set: 5.394961437176742e-05
MeanAbsoluteError value on hold-out data: 0.0069758216850459576
Epoch: 64
Loss on hold-out set: 4.687102754312371e-05
MeanAbsoluteError value on hold-out data: 0.006443916819989681
Epoch: 65
Loss on hold-out set: 0.00011574961497803758
MeanAbsoluteError value on hold-out data: 0.010554536245763302
Epoch: 66
Loss on hold-out set: 0.00012639213271445202
MeanAbsoluteError value on hold-out data: 0.010890219360589981
Epoch: 67
Loss on hold-out set: 7.87822020930961e-05
MeanAbsoluteError value on hold-out data: 0.008276958018541336
Epoch: 68
Loss on hold-out set: 1.0238668299902393e-05
MeanAbsoluteError value on hold-out data: 0.0025379331782460213
Epoch: 69
Loss on hold-out set: 2.670050963914898e-05
MeanAbsoluteError value on hold-out data: 0.004716288298368454
Epoch: 70
Loss on hold-out set: 7.333439077085227e-05
MeanAbsoluteError value on hold-out data: 0.008277881890535355
Epoch: 71
Loss on hold-out set: 8.75771406036189e-05
MeanAbsoluteError value on hold-out data: 0.009092029184103012
Epoch: 72
Loss on hold-out set: 0.00010007596230073097
MeanAbsoluteError value on hold-out data: 0.009681672789156437
Epoch: 73
Loss on hold-out set: 5.4119364377632005e-05
MeanAbsoluteError value on hold-out data: 0.006814983673393726
Epoch: 74
Loss on hold-out set: 0.00014391848775343724
MeanAbsoluteError value on hold-out data: 0.011720814742147923
Epoch: 75
Loss on hold-out set: 3.566088908930971e-05
MeanAbsoluteError value on hold-out data: 0.005233068019151688
Epoch: 76
Loss on hold-out set: 4.393573568737147e-05
MeanAbsoluteError value on hold-out data: 0.006170560140162706
Epoch: 77
Loss on hold-out set: 3.6105947018720476e-05
MeanAbsoluteError value on hold-out data: 0.005562956910580397
Epoch: 78
Loss on hold-out set: 9.927847809433985e-05
MeanAbsoluteError value on hold-out data: 0.00976333487778902
Epoch: 79
Loss on hold-out set: 0.00010867325545405038
MeanAbsoluteError value on hold-out data: 0.010076404549181461
Epoch: 80
Loss on hold-out set: 9.362364442878108e-05
MeanAbsoluteError value on hold-out data: 0.009156860411167145
Epoch: 81
Loss on hold-out set: 9.600160859391557e-06
MeanAbsoluteError value on hold-out data: 0.0024763650726526976
Epoch: 82
Loss on hold-out set: 4.954841173649153e-05
MeanAbsoluteError value on hold-out data: 0.006753523368388414
Epoch: 83
Loss on hold-out set: 2.8753710849789632e-05
MeanAbsoluteError value on hold-out data: 0.004866316448897123
Epoch: 84
Loss on hold-out set: 0.00014736855576445937
MeanAbsoluteError value on hold-out data: 0.01196270901709795
Epoch: 85
Loss on hold-out set: 6.087461291539703e-05
MeanAbsoluteError value on hold-out data: 0.007205117493867874
Epoch: 86
Loss on hold-out set: 5.9881213402197895e-05
MeanAbsoluteError value on hold-out data: 0.007251176983118057
Epoch: 87
Loss on hold-out set: 2.9396295519147413e-05
MeanAbsoluteError value on hold-out data: 0.004800715483725071
Epoch: 88
Loss on hold-out set: 0.00010165172524897284
MeanAbsoluteError value on hold-out data: 0.009798327460885048
Epoch: 89
Loss on hold-out set: 4.705351889960615e-05
MeanAbsoluteError value on hold-out data: 0.006272996310144663
Epoch: 90
Loss on hold-out set: 6.065537960047981e-05
MeanAbsoluteError value on hold-out data: 0.007393606472760439
Epoch: 91
Loss on hold-out set: 4.1426302519348134e-05
MeanAbsoluteError value on hold-out data: 0.00594229344278574
Epoch: 92
Loss on hold-out set: 6.832770486653317e-05
MeanAbsoluteError value on hold-out data: 0.007914376445114613
Epoch: 93
Loss on hold-out set: 4.3038996265845764e-05
MeanAbsoluteError value on hold-out data: 0.006058863829821348
Epoch: 94
Loss on hold-out set: 0.00011156812883870628
MeanAbsoluteError value on hold-out data: 0.010283547453582287
Epoch: 95
Loss on hold-out set: 4.726203999445332e-05
MeanAbsoluteError value on hold-out data: 0.006162227131426334
Epoch: 96
Loss on hold-out set: 1.8835465078537756e-05
MeanAbsoluteError value on hold-out data: 0.0036774491891264915
Epoch: 97
Loss on hold-out set: 2.407375804499392e-05
MeanAbsoluteError value on hold-out data: 0.004357014317065477
Epoch: 98
Loss on hold-out set: 3.423452596363955e-05
MeanAbsoluteError value on hold-out data: 0.005320222582668066
Epoch: 99
Loss on hold-out set: 6.965738018487555e-05
MeanAbsoluteError value on hold-out data: 0.00788117852061987
Epoch: 100
Loss on hold-out set: 3.993980930030566e-05
MeanAbsoluteError value on hold-out data: 0.005577783565968275
Epoch: 101
Loss on hold-out set: 1.000127931667138e-05
MeanAbsoluteError value on hold-out data: 0.0025172890163958073
Epoch: 102
Loss on hold-out set: 7.508025176823714e-06
MeanAbsoluteError value on hold-out data: 0.002134152688086033
Epoch: 103
Loss on hold-out set: 2.3427450742019573e-05
MeanAbsoluteError value on hold-out data: 0.0042807781137526035
Epoch: 104
Loss on hold-out set: 2.68631351422013e-05
MeanAbsoluteError value on hold-out data: 0.004688739776611328
Epoch: 105
Loss on hold-out set: 3.2856246817621136e-05
MeanAbsoluteError value on hold-out data: 0.005233295727521181
Epoch: 106
Loss on hold-out set: 2.3428552044367135e-05
MeanAbsoluteError value on hold-out data: 0.004282382782548666
Epoch: 107
Loss on hold-out set: 3.5192885135122774e-05
MeanAbsoluteError value on hold-out data: 0.005468807648867369
Epoch: 108
Loss on hold-out set: 3.306581651199131e-05
MeanAbsoluteError value on hold-out data: 0.0051544420421123505
Epoch: 109
Loss on hold-out set: 3.8355102285430276e-05
MeanAbsoluteError value on hold-out data: 0.005593497771769762
Epoch: 110
Loss on hold-out set: 9.035005405166885e-06
MeanAbsoluteError value on hold-out data: 0.0024253856390714645
Epoch: 111
Loss on hold-out set: 1.181524271487433e-05
MeanAbsoluteError value on hold-out data: 0.0028457744047045708
Epoch: 112
Loss on hold-out set: 1.3910364474979456e-05
MeanAbsoluteError value on hold-out data: 0.0031234240159392357
Epoch: 113
Loss on hold-out set: 3.3550407256131476e-05
MeanAbsoluteError value on hold-out data: 0.0053106751292943954
Epoch: 114
Loss on hold-out set: 2.9355032654022677e-05
MeanAbsoluteError value on hold-out data: 0.004807948600500822
Epoch: 115
Loss on hold-out set: 1.3522507096671402e-05
MeanAbsoluteError value on hold-out data: 0.003059010487049818
Epoch: 116
Loss on hold-out set: 1.821889777362996e-05
MeanAbsoluteError value on hold-out data: 0.0037020198069512844
Epoch: 117
Loss on hold-out set: 1.9869527573303602e-05
MeanAbsoluteError value on hold-out data: 0.003852758789435029
Epoch: 118
Loss on hold-out set: 2.7917351465140727e-05
MeanAbsoluteError value on hold-out data: 0.004654675256460905
Epoch: 119
Loss on hold-out set: 2.8443396666644777e-05
MeanAbsoluteError value on hold-out data: 0.004657585173845291
Epoch: 120
Loss on hold-out set: 1.0319795903438047e-05
MeanAbsoluteError value on hold-out data: 0.0026372745633125305
Epoch: 121
Loss on hold-out set: 1.3290759810795288e-05
MeanAbsoluteError value on hold-out data: 0.003020481439307332
Epoch: 122
Loss on hold-out set: 1.4071893761674323e-05
MeanAbsoluteError value on hold-out data: 0.0030831126496195793
Epoch: 123
Loss on hold-out set: 3.406590779999724e-05
MeanAbsoluteError value on hold-out data: 0.005087055265903473
Epoch: 124
Loss on hold-out set: 1.704765252509931e-05
MeanAbsoluteError value on hold-out data: 0.0034304701257497072
Epoch: 125
Loss on hold-out set: 1.140275179822263e-05
MeanAbsoluteError value on hold-out data: 0.002748426515609026
Epoch: 126
Loss on hold-out set: 1.2362188744861525e-05
MeanAbsoluteError value on hold-out data: 0.0028419108130037785
Epoch: 127
Loss on hold-out set: 1.6420546480252308e-05
MeanAbsoluteError value on hold-out data: 0.003328566439449787
Epoch: 128
Loss on hold-out set: 2.646233427807793e-05
MeanAbsoluteError value on hold-out data: 0.004311676602810621
Epoch: 129
Loss on hold-out set: 2.6674442156754114e-05
MeanAbsoluteError value on hold-out data: 0.004374600946903229
Epoch: 130
Loss on hold-out set: 1.669432942052433e-05
MeanAbsoluteError value on hold-out data: 0.003372662467882037
Epoch: 131
Loss on hold-out set: 1.568450661101164e-05
MeanAbsoluteError value on hold-out data: 0.0032356095034629107
Epoch: 132
Loss on hold-out set: 1.7335570694405378e-05
MeanAbsoluteError value on hold-out data: 0.0034219848457723856
Epoch: 133
Loss on hold-out set: 2.5096466707078723e-05
MeanAbsoluteError value on hold-out data: 0.004118621349334717
Epoch: 134
Loss on hold-out set: 1.4885598058131827e-05
MeanAbsoluteError value on hold-out data: 0.0031445184722542763
Epoch: 135
Loss on hold-out set: 1.1727938008813285e-05
MeanAbsoluteError value on hold-out data: 0.0027926249895244837
Epoch: 136
Loss on hold-out set: 1.0351117632461338e-05
MeanAbsoluteError value on hold-out data: 0.002576932543888688
Epoch: 137
Loss on hold-out set: 1.7338998855178178e-05
MeanAbsoluteError value on hold-out data: 0.003415183164179325
Epoch: 138
Loss on hold-out set: 2.1701112497172098e-05
MeanAbsoluteError value on hold-out data: 0.003855562536045909
Epoch: 139
Loss on hold-out set: 1.6505701571651643e-05
MeanAbsoluteError value on hold-out data: 0.0033191200345754623
Early stopping at epoch 138
Returned to Spot: Validation loss: 1.6505701571651643e-05
----------------------------------------------
spotPython tuning: 1.6505701571651643e-05 [########--] 75.28% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 2.0222288954485634e-08, 'lr_mult': 5.550747204406788, 'batch_size': 8, 'epochs': 512, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adam', 'sgd_momentum': 0.9927288826070495}
Epoch: 1
Loss on hold-out set: 0.020729084848426282
MeanAbsoluteError value on hold-out data: 0.11294376105070114
Epoch: 2
Loss on hold-out set: 0.017009873304663126
MeanAbsoluteError value on hold-out data: 0.10363196581602097
Epoch: 3
Loss on hold-out set: 0.013017789019565833
MeanAbsoluteError value on hold-out data: 0.09080656617879868
Epoch: 4
Loss on hold-out set: 0.008726754427985534
MeanAbsoluteError value on hold-out data: 0.07387479394674301
Epoch: 5
Loss on hold-out set: 0.006474509908768691
MeanAbsoluteError value on hold-out data: 0.06356819719076157
Epoch: 6
Loss on hold-out set: 0.004664159281865547
MeanAbsoluteError value on hold-out data: 0.05376826599240303
Epoch: 7
Loss on hold-out set: 0.002954423465876301
MeanAbsoluteError value on hold-out data: 0.042420435696840286
Epoch: 8
Loss on hold-out set: 0.0022000609958348306
MeanAbsoluteError value on hold-out data: 0.036488380283117294
Epoch: 9
Loss on hold-out set: 0.0013309008852382632
MeanAbsoluteError value on hold-out data: 0.028460875153541565
Epoch: 10
Loss on hold-out set: 0.0005915787689063061
MeanAbsoluteError value on hold-out data: 0.0188604649156332
Epoch: 11
Loss on hold-out set: 0.0002333994699782986
MeanAbsoluteError value on hold-out data: 0.011828096583485603
Epoch: 12
Loss on hold-out set: 8.688246845466845e-05
MeanAbsoluteError value on hold-out data: 0.007323155179619789
Epoch: 13
Loss on hold-out set: 3.405053252878899e-05
MeanAbsoluteError value on hold-out data: 0.004626819863915443
Epoch: 14
Loss on hold-out set: 1.0705593207436131e-05
MeanAbsoluteError value on hold-out data: 0.0022185726556926966
Epoch: 15
Loss on hold-out set: 5.594284551672277e-06
MeanAbsoluteError value on hold-out data: 0.0011934969807043672
Epoch: 16
Loss on hold-out set: 4.648345517996165e-06
MeanAbsoluteError value on hold-out data: 0.0009618911426514387
Epoch: 17
Loss on hold-out set: 4.410342335266873e-06
MeanAbsoluteError value on hold-out data: 0.0009331167675554752
Epoch: 18
Loss on hold-out set: 4.357070989008686e-06
MeanAbsoluteError value on hold-out data: 0.0009549189708195627
Epoch: 19
Loss on hold-out set: 4.379705490159243e-06
MeanAbsoluteError value on hold-out data: 0.0010058750631287694
Epoch: 20
Loss on hold-out set: 4.458343804452325e-06
MeanAbsoluteError value on hold-out data: 0.0010692804353311658
Epoch: 21
Loss on hold-out set: 4.543338583199616e-06
MeanAbsoluteError value on hold-out data: 0.0011291508562862873
Epoch: 22
Loss on hold-out set: 4.47380926298018e-06
MeanAbsoluteError value on hold-out data: 0.0011281976476311684
Epoch: 23
Loss on hold-out set: 4.174509685203463e-06
MeanAbsoluteError value on hold-out data: 0.001040806993842125
Epoch: 24
Loss on hold-out set: 3.855256442133587e-06
MeanAbsoluteError value on hold-out data: 0.0009353854111395776
Epoch: 25
Loss on hold-out set: 3.661714686131745e-06
MeanAbsoluteError value on hold-out data: 0.0008821421070024371
Epoch: 26
Loss on hold-out set: 3.577608508577082e-06
MeanAbsoluteError value on hold-out data: 0.0008707032538950443
Epoch: 27
Loss on hold-out set: 3.538837647061661e-06
MeanAbsoluteError value on hold-out data: 0.0008698984747752547
Epoch: 28
Loss on hold-out set: 3.511156687315071e-06
MeanAbsoluteError value on hold-out data: 0.0008631407981738448
Epoch: 29
Loss on hold-out set: 3.5251448450349256e-06
MeanAbsoluteError value on hold-out data: 0.000870437128469348
Epoch: 30
Loss on hold-out set: 3.5282738000013955e-06
MeanAbsoluteError value on hold-out data: 0.0008781509823165834
Epoch: 31
Loss on hold-out set: 3.4948458672988036e-06
MeanAbsoluteError value on hold-out data: 0.0008744468213990331
Epoch: 32
Loss on hold-out set: 3.457201463120148e-06
MeanAbsoluteError value on hold-out data: 0.0008779284544289112
Epoch: 33
Loss on hold-out set: 3.532915691924867e-06
MeanAbsoluteError value on hold-out data: 0.000932542490772903
Epoch: 34
Loss on hold-out set: 3.820766928853166e-06
MeanAbsoluteError value on hold-out data: 0.0010635866783559322
Epoch: 35
Loss on hold-out set: 4.368935405732612e-06
MeanAbsoluteError value on hold-out data: 0.0012700906954705715
Epoch: 36
Loss on hold-out set: 5.427438841371967e-06
MeanAbsoluteError value on hold-out data: 0.0016251313500106335
Epoch: 37
Loss on hold-out set: 7.172805022779166e-06
MeanAbsoluteError value on hold-out data: 0.0020975612569600344
Epoch: 38
Loss on hold-out set: 8.772182091457867e-06
MeanAbsoluteError value on hold-out data: 0.002451101550832391
Epoch: 39
Loss on hold-out set: 9.170322928902782e-06
MeanAbsoluteError value on hold-out data: 0.0025267195887863636
Epoch: 40
Loss on hold-out set: 9.586873638430629e-06
MeanAbsoluteError value on hold-out data: 0.0026069777086377144
Epoch: 41
Loss on hold-out set: 1.0766078958113212e-05
MeanAbsoluteError value on hold-out data: 0.002826641546562314
Epoch: 42
Loss on hold-out set: 1.1298163683118459e-05
MeanAbsoluteError value on hold-out data: 0.002920093247666955
Epoch: 43
Loss on hold-out set: 9.458750678516625e-06
MeanAbsoluteError value on hold-out data: 0.0025824951007962227
Epoch: 44
Loss on hold-out set: 6.663668243259292e-06
MeanAbsoluteError value on hold-out data: 0.001960186054930091
Epoch: 45
Loss on hold-out set: 5.437518564720353e-06
MeanAbsoluteError value on hold-out data: 0.0016193536575883627
Epoch: 46
Loss on hold-out set: 4.67864748543434e-06
MeanAbsoluteError value on hold-out data: 0.0013891264097765088
Epoch: 47
Loss on hold-out set: 3.4946770387920733e-06
MeanAbsoluteError value on hold-out data: 0.0009539501625113189
Epoch: 48
Loss on hold-out set: 6.643038770298996e-06
MeanAbsoluteError value on hold-out data: 0.0018800061661750078
Epoch: 49
Loss on hold-out set: 9.26090280915416e-06
MeanAbsoluteError value on hold-out data: 0.002479132730513811
Epoch: 50
Loss on hold-out set: 7.099540701011919e-06
MeanAbsoluteError value on hold-out data: 0.0020158588886260986
Epoch: 51
Loss on hold-out set: 7.593515198622251e-06
MeanAbsoluteError value on hold-out data: 0.0021332819014787674
Epoch: 52
Loss on hold-out set: 7.5729141024950015e-06
MeanAbsoluteError value on hold-out data: 0.002129368484020233
Epoch: 53
Loss on hold-out set: 6.7905446389647154e-06
MeanAbsoluteError value on hold-out data: 0.0019430341199040413
Epoch: 54
Loss on hold-out set: 6.219453478264002e-06
MeanAbsoluteError value on hold-out data: 0.001793406787328422
Epoch: 55
Loss on hold-out set: 5.371971691434546e-06
MeanAbsoluteError value on hold-out data: 0.0015537600265815854
Epoch: 56
Loss on hold-out set: 4.161356999900004e-06
MeanAbsoluteError value on hold-out data: 0.0011521248379722238
Epoch: 57
Loss on hold-out set: 4.047958062127882e-06
MeanAbsoluteError value on hold-out data: 0.0011209434596821666
Epoch: 58
Loss on hold-out set: 5.320172909095115e-06
MeanAbsoluteError value on hold-out data: 0.0015358536038547754
Epoch: 59
Loss on hold-out set: 8.430677134559741e-06
MeanAbsoluteError value on hold-out data: 0.0022937431931495667
Epoch: 60
Loss on hold-out set: 9.061203220545921e-06
MeanAbsoluteError value on hold-out data: 0.0024127159267663956
Epoch: 61
Loss on hold-out set: 4.309496911278793e-06
MeanAbsoluteError value on hold-out data: 0.0012073039542883635
Epoch: 62
Loss on hold-out set: 5.086688693274099e-06
MeanAbsoluteError value on hold-out data: 0.001523760613054037
Epoch: 63
Loss on hold-out set: 5.451965618799716e-06
MeanAbsoluteError value on hold-out data: 0.001658261870034039
Epoch: 64
Loss on hold-out set: 6.880994204182475e-06
MeanAbsoluteError value on hold-out data: 0.002007709816098213
Epoch: 65
Loss on hold-out set: 4.50811060210598e-06
MeanAbsoluteError value on hold-out data: 0.0013585370033979416
Epoch: 66
Loss on hold-out set: 3.4274874849415937e-06
MeanAbsoluteError value on hold-out data: 0.001041465438902378
Epoch: 67
Loss on hold-out set: 6.0711686722625974e-06
MeanAbsoluteError value on hold-out data: 0.0017781913047656417
Epoch: 68
Loss on hold-out set: 7.08177852079404e-06
MeanAbsoluteError value on hold-out data: 0.0020262522157281637
Epoch: 69
Loss on hold-out set: 6.601927605300405e-06
MeanAbsoluteError value on hold-out data: 0.0019071064889431
Epoch: 70
Loss on hold-out set: 4.977897981162689e-06
MeanAbsoluteError value on hold-out data: 0.0014629208017140627
Epoch: 71
Loss on hold-out set: 4.391751103508125e-06
MeanAbsoluteError value on hold-out data: 0.0012861118884757161
Epoch: 72
Loss on hold-out set: 4.171597300671094e-06
MeanAbsoluteError value on hold-out data: 0.0011443204712122679
Epoch: 73
Loss on hold-out set: 8.440049216580136e-05
MeanAbsoluteError value on hold-out data: 0.008927701972424984
Epoch: 74
Loss on hold-out set: 4.518749902540788e-06
MeanAbsoluteError value on hold-out data: 0.0012569442624226213
Epoch: 75
Loss on hold-out set: 1.3572807981625757e-05
MeanAbsoluteError value on hold-out data: 0.0032560627441853285
Epoch: 76
Loss on hold-out set: 3.357704833424697e-06
MeanAbsoluteError value on hold-out data: 0.0009638234041631222
Epoch: 77
Loss on hold-out set: 5.438425944248593e-06
MeanAbsoluteError value on hold-out data: 0.0016327681951224804
Epoch: 78
Loss on hold-out set: 6.297149680951981e-06
MeanAbsoluteError value on hold-out data: 0.0017821904039010406
Epoch: 79
Loss on hold-out set: 5.075924663718692e-05
MeanAbsoluteError value on hold-out data: 0.006842494942247868
Epoch: 80
Loss on hold-out set: 3.3877401827902233e-06
MeanAbsoluteError value on hold-out data: 0.0009886964689940214
Epoch: 81
Loss on hold-out set: 1.0306391979946439e-05
MeanAbsoluteError value on hold-out data: 0.002716404851526022
Epoch: 82
Loss on hold-out set: 3.3139102331042044e-06
MeanAbsoluteError value on hold-out data: 0.0009883801685646176
Epoch: 83
Loss on hold-out set: 6.977819889710334e-06
MeanAbsoluteError value on hold-out data: 0.0019458051538094878
Epoch: 84
Loss on hold-out set: 7.409584931768845e-05
MeanAbsoluteError value on hold-out data: 0.008383178152143955
Epoch: 85
Loss on hold-out set: 4.396354361353205e-06
MeanAbsoluteError value on hold-out data: 0.0013788618380203843
Epoch: 86
Loss on hold-out set: 3.77846033523766e-05
MeanAbsoluteError value on hold-out data: 0.005915534682571888
Epoch: 87
Loss on hold-out set: 7.950648942393232e-06
MeanAbsoluteError value on hold-out data: 0.0023185217287391424
Epoch: 88
Loss on hold-out set: 4.235234155203216e-05
MeanAbsoluteError value on hold-out data: 0.006265729665756226
Epoch: 89
Loss on hold-out set: 4.374692647807503e-06
MeanAbsoluteError value on hold-out data: 0.0014486960135400295
Epoch: 90
Loss on hold-out set: 8.042831932710359e-06
MeanAbsoluteError value on hold-out data: 0.0023371463175863028
Epoch: 91
Loss on hold-out set: 3.4897693171244194e-06
MeanAbsoluteError value on hold-out data: 0.0011586662149056792
Epoch: 92
Loss on hold-out set: 3.2256151251586794e-05
MeanAbsoluteError value on hold-out data: 0.005364654120057821
Epoch: 93
Loss on hold-out set: 5.621500774491563e-06
MeanAbsoluteError value on hold-out data: 0.0018151616677641869
Epoch: 94
Loss on hold-out set: 2.719990491366269e-06
MeanAbsoluteError value on hold-out data: 0.0009568894165568054
Epoch: 95
Loss on hold-out set: 3.549635220984352e-06
MeanAbsoluteError value on hold-out data: 0.001209129812195897
Epoch: 96
Loss on hold-out set: 0.00012893661685091886
MeanAbsoluteError value on hold-out data: 0.011153983883559704
Epoch: 97
Loss on hold-out set: 4.2240171257832885e-06
MeanAbsoluteError value on hold-out data: 0.0014612801605835557
Epoch: 98
Loss on hold-out set: 6.155942990541294e-06
MeanAbsoluteError value on hold-out data: 0.00204260740429163
Epoch: 99
Loss on hold-out set: 5.8752510528249425e-06
MeanAbsoluteError value on hold-out data: 0.001971084624528885
Epoch: 100
Loss on hold-out set: 3.814853567076314e-06
MeanAbsoluteError value on hold-out data: 0.001428502146154642
Epoch: 101
Loss on hold-out set: 3.159362936039064e-06
MeanAbsoluteError value on hold-out data: 0.0012344870483502746
Epoch: 102
Loss on hold-out set: 2.378879846045684e-06
MeanAbsoluteError value on hold-out data: 0.0009432204533368349
Epoch: 103
Loss on hold-out set: 2.2910690571925923e-05
MeanAbsoluteError value on hold-out data: 0.004442584700882435
Epoch: 104
Loss on hold-out set: 1.2951247155893055e-05
MeanAbsoluteError value on hold-out data: 0.0033166094217449427
Epoch: 105
Loss on hold-out set: 2.359264420037059e-06
MeanAbsoluteError value on hold-out data: 0.0009684906690381467
Epoch: 106
Loss on hold-out set: 3.167520044431321e-06
MeanAbsoluteError value on hold-out data: 0.0012503742473199964
Epoch: 107
Loss on hold-out set: 1.1207942353202701e-05
MeanAbsoluteError value on hold-out data: 0.002896831836551428
Epoch: 108
Loss on hold-out set: 3.819373944823287e-05
MeanAbsoluteError value on hold-out data: 0.005991062149405479
Epoch: 109
Loss on hold-out set: 2.80352011079805e-06
MeanAbsoluteError value on hold-out data: 0.0011345219099894166
Epoch: 110
Loss on hold-out set: 3.285357820459467e-06
MeanAbsoluteError value on hold-out data: 0.0013409450184553862
Epoch: 111
Loss on hold-out set: 3.0553130293834615e-06
MeanAbsoluteError value on hold-out data: 0.0012430320493876934
Epoch: 112
Loss on hold-out set: 8.701847869624065e-05
MeanAbsoluteError value on hold-out data: 0.009137796238064766
Epoch: 113
Loss on hold-out set: 2.6142711518380232e-06
MeanAbsoluteError value on hold-out data: 0.0011351509019732475
Epoch: 114
Loss on hold-out set: 7.58732986875992e-06
MeanAbsoluteError value on hold-out data: 0.0024496165569871664
Epoch: 115
Loss on hold-out set: 2.1219438321539107e-06
MeanAbsoluteError value on hold-out data: 0.000997553113847971
Epoch: 116
Loss on hold-out set: 1.830902511893615e-06
MeanAbsoluteError value on hold-out data: 0.0008981006103567779
Epoch: 117
Loss on hold-out set: 2.9850869704037713e-06
MeanAbsoluteError value on hold-out data: 0.00127471424639225
Epoch: 118
Loss on hold-out set: 0.00011177473942026202
MeanAbsoluteError value on hold-out data: 0.010396016761660576
Epoch: 119
Loss on hold-out set: 2.7845592038482594e-06
MeanAbsoluteError value on hold-out data: 0.001244995859451592
Epoch: 120
Loss on hold-out set: 5.162616269827643e-06
MeanAbsoluteError value on hold-out data: 0.0019371934467926621
Epoch: 121
Loss on hold-out set: 3.945798225327292e-06
MeanAbsoluteError value on hold-out data: 0.001614673645235598
Epoch: 122
Loss on hold-out set: 2.809584784520331e-06
MeanAbsoluteError value on hold-out data: 0.0012892532395198941
Epoch: 123
Loss on hold-out set: 1.6354858123696958e-06
MeanAbsoluteError value on hold-out data: 0.0008811444859020412
Epoch: 124
Loss on hold-out set: 2.441318861500756e-06
MeanAbsoluteError value on hold-out data: 0.0011443314142525196
Epoch: 125
Loss on hold-out set: 0.00012031645670312603
MeanAbsoluteError value on hold-out data: 0.010792112909257412
Epoch: 126
Loss on hold-out set: 3.2500477791592473e-06
MeanAbsoluteError value on hold-out data: 0.0013828128576278687
Epoch: 127
Loss on hold-out set: 3.4735099377844324e-06
MeanAbsoluteError value on hold-out data: 0.0015356728108599782
Epoch: 128
Loss on hold-out set: 5.912644921504819e-06
MeanAbsoluteError value on hold-out data: 0.0021389706525951624
Epoch: 129
Loss on hold-out set: 1.852853391650761e-06
MeanAbsoluteError value on hold-out data: 0.0010071361903101206
Epoch: 130
Loss on hold-out set: 2.5406265161851287e-06
MeanAbsoluteError value on hold-out data: 0.0012628608383238316
Epoch: 131
Loss on hold-out set: 1.7515231060147734e-06
MeanAbsoluteError value on hold-out data: 0.0009514284320175648
Epoch: 132
Loss on hold-out set: 7.007916515009895e-05
MeanAbsoluteError value on hold-out data: 0.008179371245205402
Epoch: 133
Loss on hold-out set: 3.394921631489093e-06
MeanAbsoluteError value on hold-out data: 0.0014774358132854104
Epoch: 134
Loss on hold-out set: 3.487874703535597e-06
MeanAbsoluteError value on hold-out data: 0.0015447863843291998
Epoch: 135
Loss on hold-out set: 2.303636475026475e-06
MeanAbsoluteError value on hold-out data: 0.0011922428384423256
Epoch: 136
Loss on hold-out set: 1.620779424028665e-06
MeanAbsoluteError value on hold-out data: 0.0009267657878808677
Epoch: 137
Loss on hold-out set: 1.7051649353417913e-05
MeanAbsoluteError value on hold-out data: 0.003839814569801092
Epoch: 138
Loss on hold-out set: 1.958720794822224e-05
MeanAbsoluteError value on hold-out data: 0.004251031670719385
Epoch: 139
Loss on hold-out set: 1.8917045311259005e-06
MeanAbsoluteError value on hold-out data: 0.0010437865275889635
Epoch: 140
Loss on hold-out set: 2.048669279319208e-06
MeanAbsoluteError value on hold-out data: 0.001072291866876185
Epoch: 141
Loss on hold-out set: 6.571008869191007e-06
MeanAbsoluteError value on hold-out data: 0.0022044996730983257
Epoch: 142
Loss on hold-out set: 7.881444502058194e-05
MeanAbsoluteError value on hold-out data: 0.008713890798389912
Epoch: 143
Loss on hold-out set: 2.2223594585643456e-06
MeanAbsoluteError value on hold-out data: 0.0011532607022672892
Epoch: 144
Loss on hold-out set: 1.785799278016049e-05
MeanAbsoluteError value on hold-out data: 0.004063584841787815
Epoch: 145
Loss on hold-out set: 1.7409957048417517e-06
MeanAbsoluteError value on hold-out data: 0.0009994549909606576
Epoch: 146
Loss on hold-out set: 1.5337676496815938e-06
MeanAbsoluteError value on hold-out data: 0.0009613257716409862
Epoch: 147
Loss on hold-out set: 2.4373484025449886e-06
MeanAbsoluteError value on hold-out data: 0.0012682103551924229
Epoch: 148
Loss on hold-out set: 9.526127503608892e-05
MeanAbsoluteError value on hold-out data: 0.009584418497979641
Epoch: 149
Loss on hold-out set: 2.237238926514501e-06
MeanAbsoluteError value on hold-out data: 0.0011601923033595085
Epoch: 150
Loss on hold-out set: 3.5122503642301843e-06
MeanAbsoluteError value on hold-out data: 0.0015784158604219556
Epoch: 151
Loss on hold-out set: 3.1530242291697313e-06
MeanAbsoluteError value on hold-out data: 0.0014662012690678239
Epoch: 152
Loss on hold-out set: 1.7762573005903074e-06
MeanAbsoluteError value on hold-out data: 0.0010427014203742146
Epoch: 153
Loss on hold-out set: 1.6925683815908375e-06
MeanAbsoluteError value on hold-out data: 0.0009609895059838891
Epoch: 154
Loss on hold-out set: 6.076269059313314e-05
MeanAbsoluteError value on hold-out data: 0.007589487358927727
Epoch: 155
Loss on hold-out set: 5.953853836241538e-06
MeanAbsoluteError value on hold-out data: 0.0021332968026399612
Epoch: 156
Loss on hold-out set: 1.5732809618827416e-06
MeanAbsoluteError value on hold-out data: 0.0009574572322890162
Epoch: 157
Loss on hold-out set: 2.0683914565205143e-06
MeanAbsoluteError value on hold-out data: 0.001156125101260841
Epoch: 158
Loss on hold-out set: 1.5521625659618478e-06
MeanAbsoluteError value on hold-out data: 0.00091359339421615
Epoch: 159
Loss on hold-out set: 8.560168230599772e-05
MeanAbsoluteError value on hold-out data: 0.00905601680278778
Epoch: 160
Loss on hold-out set: 5.241773608663368e-06
MeanAbsoluteError value on hold-out data: 0.0019449176033958793
Epoch: 161
Loss on hold-out set: 1.4535449342869662e-06
MeanAbsoluteError value on hold-out data: 0.0009292716858908534
Epoch: 162
Loss on hold-out set: 6.7216785857071e-06
MeanAbsoluteError value on hold-out data: 0.002345734741538763
Epoch: 163
Loss on hold-out set: 1.4811915657506496e-06
MeanAbsoluteError value on hold-out data: 0.000936511845793575
Epoch: 164
Loss on hold-out set: 1.9694925149930272e-06
MeanAbsoluteError value on hold-out data: 0.0010668470058590174
Epoch: 165
Loss on hold-out set: 6.120563289426316e-05
MeanAbsoluteError value on hold-out data: 0.007615040056407452
Epoch: 166
Loss on hold-out set: 6.9191780886811965e-06
MeanAbsoluteError value on hold-out data: 0.0023380499333143234
Epoch: 167
Loss on hold-out set: 1.3568252658489512e-06
MeanAbsoluteError value on hold-out data: 0.0008883275440894067
Epoch: 168
Loss on hold-out set: 2.8867879617983386e-06
MeanAbsoluteError value on hold-out data: 0.0014161233557388186
Epoch: 169
Loss on hold-out set: 1.3821071587322445e-06
MeanAbsoluteError value on hold-out data: 0.0008716688607819378
Epoch: 170
Loss on hold-out set: 4.809411151846258e-05
MeanAbsoluteError value on hold-out data: 0.0067237624898552895
Epoch: 171
Loss on hold-out set: 6.2341038313350415e-06
MeanAbsoluteError value on hold-out data: 0.002220744267106056
Epoch: 172
Loss on hold-out set: 1.8395197834682843e-06
MeanAbsoluteError value on hold-out data: 0.0010647306917235255
Epoch: 173
Loss on hold-out set: 1.2482418239151708e-06
MeanAbsoluteError value on hold-out data: 0.0008473909110762179
Epoch: 174
Loss on hold-out set: 2.1647481703798564e-06
MeanAbsoluteError value on hold-out data: 0.0011724847136065364
Epoch: 175
Loss on hold-out set: 0.0001265622846212385
MeanAbsoluteError value on hold-out data: 0.011070036329329014
Epoch: 176
Loss on hold-out set: 2.68840679346364e-06
MeanAbsoluteError value on hold-out data: 0.0012879756977781653
Epoch: 177
Loss on hold-out set: 1.841563512303573e-06
MeanAbsoluteError value on hold-out data: 0.0010914974845945835
Epoch: 178
Loss on hold-out set: 6.211175739161645e-06
MeanAbsoluteError value on hold-out data: 0.0022399660665541887
Epoch: 179
Loss on hold-out set: 1.3775015355277948e-06
MeanAbsoluteError value on hold-out data: 0.0009091946412809193
Epoch: 180
Loss on hold-out set: 3.5465573330982713e-06
MeanAbsoluteError value on hold-out data: 0.0016027913661673665
Epoch: 181
Loss on hold-out set: 1.2423368981504417e-06
MeanAbsoluteError value on hold-out data: 0.0008367762202396989
Epoch: 182
Loss on hold-out set: 1.496692354856733e-05
MeanAbsoluteError value on hold-out data: 0.0035861139185726643
Epoch: 183
Loss on hold-out set: 2.1596584534372116e-05
MeanAbsoluteError value on hold-out data: 0.004472536966204643
Epoch: 184
Loss on hold-out set: 2.5818375565665374e-06
MeanAbsoluteError value on hold-out data: 0.001307217520661652
Epoch: 185
Loss on hold-out set: 1.5488763581647379e-06
MeanAbsoluteError value on hold-out data: 0.0009294588235206902
Epoch: 186
Loss on hold-out set: 1.8716102886173758e-05
MeanAbsoluteError value on hold-out data: 0.0040380265563726425
Epoch: 187
Loss on hold-out set: 2.7388975037243462e-05
MeanAbsoluteError value on hold-out data: 0.0050692083314061165
Epoch: 188
Loss on hold-out set: 1.691178688271353e-06
MeanAbsoluteError value on hold-out data: 0.000988864921964705
Epoch: 189
Loss on hold-out set: 1.306025254540313e-06
MeanAbsoluteError value on hold-out data: 0.0008806386613287032
Epoch: 190
Loss on hold-out set: 1.987505744170305e-06
MeanAbsoluteError value on hold-out data: 0.0011049958411604166
Epoch: 191
Loss on hold-out set: 0.00013161954465383468
MeanAbsoluteError value on hold-out data: 0.011289114132523537
Epoch: 192
Loss on hold-out set: 3.7751770043158966e-06
MeanAbsoluteError value on hold-out data: 0.0015284314285963774
Epoch: 193
Loss on hold-out set: 1.8227064223789345e-06
MeanAbsoluteError value on hold-out data: 0.001098288455978036
Epoch: 194
Loss on hold-out set: 5.0392147691606005e-06
MeanAbsoluteError value on hold-out data: 0.0019748746417462826
Epoch: 195
Loss on hold-out set: 1.8882124603997477e-06
MeanAbsoluteError value on hold-out data: 0.0011003948748111725
Epoch: 196
Loss on hold-out set: 3.5496896956781135e-06
MeanAbsoluteError value on hold-out data: 0.0016005224315449595
Epoch: 197
Loss on hold-out set: 1.339375842235313e-06
MeanAbsoluteError value on hold-out data: 0.0009124423959292471
Epoch: 198
Loss on hold-out set: 1.5862014249915103e-06
MeanAbsoluteError value on hold-out data: 0.0009460417204536498
Epoch: 199
Loss on hold-out set: 0.0001237427936039718
MeanAbsoluteError value on hold-out data: 0.01094098575413227
Epoch: 200
Loss on hold-out set: 2.8569395797866922e-06
MeanAbsoluteError value on hold-out data: 0.0013340890873223543
Epoch: 201
Loss on hold-out set: 1.4901480870764174e-06
MeanAbsoluteError value on hold-out data: 0.0009625201346352696
Epoch: 202
Loss on hold-out set: 6.859688883914235e-06
MeanAbsoluteError value on hold-out data: 0.002381543628871441
Epoch: 203
Loss on hold-out set: 1.4331893695677871e-06
MeanAbsoluteError value on hold-out data: 0.0009370410698466003
Epoch: 204
Loss on hold-out set: 4.726244451615601e-06
MeanAbsoluteError value on hold-out data: 0.0018993554404005408
Epoch: 205
Loss on hold-out set: 1.2930818562339435e-06
MeanAbsoluteError value on hold-out data: 0.0008920775726437569
Epoch: 206
Loss on hold-out set: 1.648638986077793e-06
MeanAbsoluteError value on hold-out data: 0.0009822010761126876
Epoch: 207
Loss on hold-out set: 0.00012632198061175202
MeanAbsoluteError value on hold-out data: 0.011057401075959206
Epoch: 208
Loss on hold-out set: 2.6392400125012884e-06
MeanAbsoluteError value on hold-out data: 0.0012749986490234733
Epoch: 209
Loss on hold-out set: 1.5568482916406585e-06
MeanAbsoluteError value on hold-out data: 0.0010042977519333363
Epoch: 210
Loss on hold-out set: 5.7308523920303404e-06
MeanAbsoluteError value on hold-out data: 0.0021367056760936975
Epoch: 211
Loss on hold-out set: 1.7075317089165765e-06
MeanAbsoluteError value on hold-out data: 0.0010410528630018234
Epoch: 212
Loss on hold-out set: 4.124600913631807e-06
MeanAbsoluteError value on hold-out data: 0.0017515667714178562
Epoch: 213
Loss on hold-out set: 1.3771796865943255e-06
MeanAbsoluteError value on hold-out data: 0.0009311334579251707
Epoch: 214
Loss on hold-out set: 1.6008768104831306e-06
MeanAbsoluteError value on hold-out data: 0.0009613425354473293
Epoch: 215
Loss on hold-out set: 0.00012107051856889341
MeanAbsoluteError value on hold-out data: 0.010820363648235798
Epoch: 216
Loss on hold-out set: 2.4312059161658046e-06
MeanAbsoluteError value on hold-out data: 0.0012299340451136231
Epoch: 217
Loss on hold-out set: 1.4565585105760635e-06
MeanAbsoluteError value on hold-out data: 0.0009539477177895606
Epoch: 218
Loss on hold-out set: 6.522560606993609e-06
MeanAbsoluteError value on hold-out data: 0.00231163133867085
Epoch: 219
Loss on hold-out set: 1.5458113542883056e-06
MeanAbsoluteError value on hold-out data: 0.0009832436917349696
Epoch: 220
Loss on hold-out set: 4.622843355742876e-06
MeanAbsoluteError value on hold-out data: 0.0018746498972177505
Epoch: 221
Loss on hold-out set: 1.3767603040773075e-06
MeanAbsoluteError value on hold-out data: 0.0009325360297225416
Epoch: 222
Loss on hold-out set: 1.6080243251568198e-06
MeanAbsoluteError value on hold-out data: 0.0009644176461733878
Epoch: 223
Loss on hold-out set: 0.0001214869733207467
MeanAbsoluteError value on hold-out data: 0.010838364250957966
Epoch: 224
Loss on hold-out set: 2.668818353120179e-06
MeanAbsoluteError value on hold-out data: 0.0012817414244636893
Epoch: 225
Loss on hold-out set: 1.4543896559129472e-06
MeanAbsoluteError value on hold-out data: 0.0009618436452001333
Epoch: 226
Loss on hold-out set: 5.695335265667573e-06
MeanAbsoluteError value on hold-out data: 0.002130609704181552
Epoch: 227
Loss on hold-out set: 1.8410922429642308e-06
MeanAbsoluteError value on hold-out data: 0.0010913272853940725
Epoch: 228
Loss on hold-out set: 4.0824510338815775e-06
MeanAbsoluteError value on hold-out data: 0.0017412416636943817
Epoch: 229
Loss on hold-out set: 1.5171759143509246e-06
MeanAbsoluteError value on hold-out data: 0.0009873356902971864
Epoch: 230
Loss on hold-out set: 1.5699533152332821e-06
MeanAbsoluteError value on hold-out data: 0.0009623618680052459
Epoch: 231
Loss on hold-out set: 0.00010591328483362878
MeanAbsoluteError value on hold-out data: 0.01010867953300476
Epoch: 232
Loss on hold-out set: 5.651476846268404e-06
MeanAbsoluteError value on hold-out data: 0.002022907603532076
Epoch: 233
Loss on hold-out set: 1.4381933989457856e-06
MeanAbsoluteError value on hold-out data: 0.0009430662612430751
Epoch: 234
Loss on hold-out set: 8.800203120603998e-06
MeanAbsoluteError value on hold-out data: 0.0027542798779904842
Epoch: 235
Loss on hold-out set: 1.235110072696587e-06
MeanAbsoluteError value on hold-out data: 0.0008815845940262079
Epoch: 236
Loss on hold-out set: 5.289785714299605e-06
MeanAbsoluteError value on hold-out data: 0.00203215004876256
Epoch: 237
Loss on hold-out set: 1.2310591043872495e-06
MeanAbsoluteError value on hold-out data: 0.0008711417322047055
Epoch: 238
Loss on hold-out set: 6.294649462066254e-06
MeanAbsoluteError value on hold-out data: 0.0022025341168045998
Epoch: 239
Loss on hold-out set: 5.4137726596979375e-05
MeanAbsoluteError value on hold-out data: 0.007179521024227142
Epoch: 240
Loss on hold-out set: 1.4470433426008879e-06
MeanAbsoluteError value on hold-out data: 0.0009201797074638307
Epoch: 241
Loss on hold-out set: 1.0280919085696377e-05
MeanAbsoluteError value on hold-out data: 0.002992583904415369
Epoch: 242
Loss on hold-out set: 1.449684518954535e-06
MeanAbsoluteError value on hold-out data: 0.0009601079509593546
Epoch: 243
Loss on hold-out set: 1.8022317407796532e-06
MeanAbsoluteError value on hold-out data: 0.0010394436540082097
Epoch: 244
Loss on hold-out set: 0.00011719115086874042
MeanAbsoluteError value on hold-out data: 0.010637721978127956
Epoch: 245
Loss on hold-out set: 4.4864771098218625e-06
MeanAbsoluteError value on hold-out data: 0.0016961997607722878
Epoch: 246
Loss on hold-out set: 1.4008010007154026e-06
MeanAbsoluteError value on hold-out data: 0.0009499920415692031
Epoch: 247
Loss on hold-out set: 4.532378733002636e-06
MeanAbsoluteError value on hold-out data: 0.0018589459359645844
Epoch: 248
Loss on hold-out set: 2.2731579702538417e-06
MeanAbsoluteError value on hold-out data: 0.0012357592349871993
Epoch: 249
Loss on hold-out set: 3.1496061356655877e-06
MeanAbsoluteError value on hold-out data: 0.001492812531068921
Epoch: 250
Loss on hold-out set: 1.7210960804373156e-06
MeanAbsoluteError value on hold-out data: 0.001065450836904347
Epoch: 251
Loss on hold-out set: 1.3626396501446213e-06
MeanAbsoluteError value on hold-out data: 0.0008962771389633417
Epoch: 252
Loss on hold-out set: 7.472468764478292e-05
MeanAbsoluteError value on hold-out data: 0.008453079499304295
Epoch: 253
Loss on hold-out set: 9.19192732333996e-06
MeanAbsoluteError value on hold-out data: 0.002743886783719063
Epoch: 254
Loss on hold-out set: 1.329247041326198e-06
MeanAbsoluteError value on hold-out data: 0.0009106880170293152
Epoch: 255
Loss on hold-out set: 1.020256070803857e-05
MeanAbsoluteError value on hold-out data: 0.0029855770990252495
Epoch: 256
Loss on hold-out set: 1.5925525562615325e-06
MeanAbsoluteError value on hold-out data: 0.0009951743995770812
Epoch: 257
Loss on hold-out set: 1.205398021584726e-06
MeanAbsoluteError value on hold-out data: 0.0008551147766411304
Epoch: 258
Loss on hold-out set: 1.5007264688679961e-05
MeanAbsoluteError value on hold-out data: 0.0035846049431711435
Epoch: 259
Loss on hold-out set: 2.6103451617880063e-05
MeanAbsoluteError value on hold-out data: 0.004933530930429697
Epoch: 260
Loss on hold-out set: 2.109474271611888e-06
MeanAbsoluteError value on hold-out data: 0.0011623844038695097
Epoch: 261
Loss on hold-out set: 1.2706568376667125e-06
MeanAbsoluteError value on hold-out data: 0.0008948909235186875
Epoch: 262
Loss on hold-out set: 1.1308978424782062e-05
MeanAbsoluteError value on hold-out data: 0.0030644370708614588
Epoch: 263
Loss on hold-out set: 3.056062565807033e-05
MeanAbsoluteError value on hold-out data: 0.005347535014152527
Epoch: 264
Loss on hold-out set: 2.2033548681951e-06
MeanAbsoluteError value on hold-out data: 0.001194960088469088
Epoch: 265
Loss on hold-out set: 1.6067731379328171e-06
MeanAbsoluteError value on hold-out data: 0.0010204380378127098
Epoch: 266
Loss on hold-out set: 6.353992271095577e-06
MeanAbsoluteError value on hold-out data: 0.0022171020973473787
Epoch: 267
Loss on hold-out set: 5.151832316953101e-05
MeanAbsoluteError value on hold-out data: 0.006997847463935614
Epoch: 268
Loss on hold-out set: 1.5861103577208269e-06
MeanAbsoluteError value on hold-out data: 0.0009775444632396102
Epoch: 269
Loss on hold-out set: 7.09030904258007e-06
MeanAbsoluteError value on hold-out data: 0.002416639355942607
Epoch: 270
Loss on hold-out set: 1.2737378582983183e-06
MeanAbsoluteError value on hold-out data: 0.0008996962569653988
Epoch: 271
Loss on hold-out set: 1.8948008445070292e-06
MeanAbsoluteError value on hold-out data: 0.0011069270549342036
Epoch: 272
Loss on hold-out set: 0.00011645450783697398
MeanAbsoluteError value on hold-out data: 0.010617309249937534
Epoch: 273
Loss on hold-out set: 2.7950539507209645e-06
MeanAbsoluteError value on hold-out data: 0.0013177826767787337
Epoch: 274
Loss on hold-out set: 1.37565718648004e-06
MeanAbsoluteError value on hold-out data: 0.0009389541810378432
Epoch: 275
Loss on hold-out set: 5.57726974947352e-06
MeanAbsoluteError value on hold-out data: 0.00210264278575778
Epoch: 276
Loss on hold-out set: 1.61350062012987e-06
MeanAbsoluteError value on hold-out data: 0.0010189921595156193
Epoch: 277
Loss on hold-out set: 4.2905865269092734e-06
MeanAbsoluteError value on hold-out data: 0.0017936909571290016
Epoch: 278
Loss on hold-out set: 1.519045999256569e-06
MeanAbsoluteError value on hold-out data: 0.0009962802287191153
Epoch: 279
Loss on hold-out set: 1.3968996940224985e-06
MeanAbsoluteError value on hold-out data: 0.0009058997966349125
Epoch: 280
Loss on hold-out set: 0.00010823773654441251
MeanAbsoluteError value on hold-out data: 0.01022234745323658
Epoch: 281
Loss on hold-out set: 2.3363031911422264e-06
MeanAbsoluteError value on hold-out data: 0.0012032744707539678
Epoch: 282
Loss on hold-out set: 1.3741658515180843e-06
MeanAbsoluteError value on hold-out data: 0.0009406147291883826
Epoch: 283
Loss on hold-out set: 6.508799216183099e-06
MeanAbsoluteError value on hold-out data: 0.002307045040652156
Epoch: 284
Loss on hold-out set: 1.6012648288958525e-06
MeanAbsoluteError value on hold-out data: 0.0010099048959091306
Epoch: 285
Loss on hold-out set: 4.453593565980746e-06
MeanAbsoluteError value on hold-out data: 0.001832129550166428
Epoch: 286
Loss on hold-out set: 1.5063706954558591e-06
MeanAbsoluteError value on hold-out data: 0.0009904891485348344
Epoch: 287
Loss on hold-out set: 1.4436626920811297e-06
MeanAbsoluteError value on hold-out data: 0.0009167706011794508
Epoch: 288
Loss on hold-out set: 0.00010926481895455111
MeanAbsoluteError value on hold-out data: 0.010269333608448505
Epoch: 289
Loss on hold-out set: 7.17244465943766e-06
MeanAbsoluteError value on hold-out data: 0.002240861766040325
Epoch: 290
Loss on hold-out set: 1.5246133117623111e-06
MeanAbsoluteError value on hold-out data: 0.0010045971721410751
Epoch: 291
Loss on hold-out set: 4.025254366081897e-06
MeanAbsoluteError value on hold-out data: 0.0017333081923425198
Epoch: 292
Loss on hold-out set: 2.183215545564484e-06
MeanAbsoluteError value on hold-out data: 0.0012110068928450346
Epoch: 293
Loss on hold-out set: 3.2944647270333486e-06
MeanAbsoluteError value on hold-out data: 0.0015324011910706758
Epoch: 294
Loss on hold-out set: 1.923707702046254e-06
MeanAbsoluteError value on hold-out data: 0.0011334187583997846
Epoch: 295
Loss on hold-out set: 1.2132829160063203e-06
MeanAbsoluteError value on hold-out data: 0.0008572684600949287
Epoch: 296
Loss on hold-out set: 5.378138896623185e-05
MeanAbsoluteError value on hold-out data: 0.007133406586945057
Epoch: 297
Loss on hold-out set: 9.015385713658025e-06
MeanAbsoluteError value on hold-out data: 0.0027497708797454834
Epoch: 298
Loss on hold-out set: 1.2520561485841523e-06
MeanAbsoluteError value on hold-out data: 0.0008905145805329084
Epoch: 299
Loss on hold-out set: 5.807316076817714e-06
MeanAbsoluteError value on hold-out data: 0.0021414393559098244
Epoch: 300
Loss on hold-out set: 1.3481328263322355e-06
MeanAbsoluteError value on hold-out data: 0.0009319008677266538
Epoch: 301
Loss on hold-out set: 5.539379206933709e-06
MeanAbsoluteError value on hold-out data: 0.0020534414798021317
Epoch: 302
Loss on hold-out set: 5.519831708960211e-05
MeanAbsoluteError value on hold-out data: 0.007242491934448481
Epoch: 303
Loss on hold-out set: 1.7696815948092512e-06
MeanAbsoluteError value on hold-out data: 0.00104505755007267
Epoch: 304
Loss on hold-out set: 7.512488728504027e-06
MeanAbsoluteError value on hold-out data: 0.0024947253987193108
Epoch: 305
Loss on hold-out set: 1.903646344652244e-06
MeanAbsoluteError value on hold-out data: 0.0011224722256883979
Epoch: 306
Loss on hold-out set: 1.5935580101337397e-06
MeanAbsoluteError value on hold-out data: 0.0009798663668334484
Epoch: 307
Loss on hold-out set: 9.317934324683033e-05
MeanAbsoluteError value on hold-out data: 0.009441009722650051
Epoch: 308
Loss on hold-out set: 1.2442608582013667e-05
MeanAbsoluteError value on hold-out data: 0.003217893885448575
Epoch: 309
Loss on hold-out set: 2.384896573092096e-06
MeanAbsoluteError value on hold-out data: 0.0012623763177543879
Epoch: 310
Loss on hold-out set: 7.565764809968593e-06
MeanAbsoluteError value on hold-out data: 0.0025117038749158382
Epoch: 311
Loss on hold-out set: 1.3620455750864686e-06
MeanAbsoluteError value on hold-out data: 0.0009257104829885066
Epoch: 312
Loss on hold-out set: 4.029255239258514e-06
MeanAbsoluteError value on hold-out data: 0.0017262023175135255
Epoch: 313
Loss on hold-out set: 1.2047702770850696e-06
MeanAbsoluteError value on hold-out data: 0.0008775583119131625
Epoch: 314
Loss on hold-out set: 1.4985978946481881e-05
MeanAbsoluteError value on hold-out data: 0.0035740549210458994
Epoch: 315
Loss on hold-out set: 2.5039016140669302e-05
MeanAbsoluteError value on hold-out data: 0.0048131817020475864
Epoch: 316
Loss on hold-out set: 4.315666579283348e-06
MeanAbsoluteError value on hold-out data: 0.0017862268723547459
Epoch: 317
Loss on hold-out set: 1.4275220743498768e-06
MeanAbsoluteError value on hold-out data: 0.0009610896231606603
Epoch: 318
Loss on hold-out set: 1.1089482924082978e-05
MeanAbsoluteError value on hold-out data: 0.0030143766198307276
Epoch: 319
Loss on hold-out set: 3.542237443884675e-05
MeanAbsoluteError value on hold-out data: 0.005761732347309589
Epoch: 320
Loss on hold-out set: 3.108999915244376e-06
MeanAbsoluteError value on hold-out data: 0.0014683384215459228
Epoch: 321
Loss on hold-out set: 3.128864202488713e-06
MeanAbsoluteError value on hold-out data: 0.001473908661864698
Epoch: 322
Loss on hold-out set: 1.74339917061903e-06
MeanAbsoluteError value on hold-out data: 0.0010222200071439147
Epoch: 323
Loss on hold-out set: 0.00010025073635532815
MeanAbsoluteError value on hold-out data: 0.009808345697820187
Epoch: 324
Loss on hold-out set: 2.558731629757236e-06
MeanAbsoluteError value on hold-out data: 0.0012182813370600343
Epoch: 325
Loss on hold-out set: 3.2276916768798977e-06
MeanAbsoluteError value on hold-out data: 0.0015235847095027566
Epoch: 326
Loss on hold-out set: 5.9191527719504894e-06
MeanAbsoluteError value on hold-out data: 0.002169935265555978
Epoch: 327
Loss on hold-out set: 1.6845528106937548e-06
MeanAbsoluteError value on hold-out data: 0.0010422825580462813
Epoch: 328
Loss on hold-out set: 3.654235043588989e-06
MeanAbsoluteError value on hold-out data: 0.0016259278636425734
Epoch: 329
Loss on hold-out set: 1.957167310557021e-06
MeanAbsoluteError value on hold-out data: 0.0011463310802355409
Epoch: 330
Loss on hold-out set: 1.5127554597053237e-06
MeanAbsoluteError value on hold-out data: 0.0009461715817451477
Epoch: 331
Loss on hold-out set: 9.185672120350461e-05
MeanAbsoluteError value on hold-out data: 0.009376518428325653
Epoch: 332
Loss on hold-out set: 5.9225461714767766e-06
MeanAbsoluteError value on hold-out data: 0.001982136396691203
Epoch: 333
Loss on hold-out set: 3.8108089932776285e-06
MeanAbsoluteError value on hold-out data: 0.001684300135821104
Epoch: 334
Loss on hold-out set: 4.667563183303221e-06
MeanAbsoluteError value on hold-out data: 0.0018805701984092593
Epoch: 335
Loss on hold-out set: 2.126500214372802e-06
MeanAbsoluteError value on hold-out data: 0.0011867402354255319
Epoch: 336
Loss on hold-out set: 3.054086098592578e-06
MeanAbsoluteError value on hold-out data: 0.001461201230995357
Epoch: 337
Loss on hold-out set: 2.1361192367701157e-06
MeanAbsoluteError value on hold-out data: 0.0011976865353062749
Epoch: 338
Loss on hold-out set: 1.6608313736218118e-06
MeanAbsoluteError value on hold-out data: 0.0010021126363426447
Epoch: 339
Loss on hold-out set: 8.566025338184677e-05
MeanAbsoluteError value on hold-out data: 0.009049615822732449
Epoch: 340
Loss on hold-out set: 2.2737366362578447e-06
MeanAbsoluteError value on hold-out data: 0.001167261740192771
Epoch: 341
Loss on hold-out set: 2.5968589206489637e-06
MeanAbsoluteError value on hold-out data: 0.0013386530335992575
Epoch: 342
Loss on hold-out set: 5.193123318971821e-06
MeanAbsoluteError value on hold-out data: 0.0019999949727207422
Epoch: 343
Loss on hold-out set: 1.7754545802673467e-06
MeanAbsoluteError value on hold-out data: 0.0010686510941013694
Epoch: 344
Loss on hold-out set: 3.416351712590576e-06
MeanAbsoluteError value on hold-out data: 0.0015583231579512358
Epoch: 345
Loss on hold-out set: 1.338258767334896e-06
MeanAbsoluteError value on hold-out data: 0.0009330990142188966
Epoch: 346
Loss on hold-out set: 3.761865352651895e-06
MeanAbsoluteError value on hold-out data: 0.0016498935874551535
Epoch: 347
Loss on hold-out set: 6.131142072263174e-05
MeanAbsoluteError value on hold-out data: 0.007649637758731842
Epoch: 348
Loss on hold-out set: 1.572324973751979e-06
MeanAbsoluteError value on hold-out data: 0.0009778847452253103
Epoch: 349
Loss on hold-out set: 1.2574309194908556e-05
MeanAbsoluteError value on hold-out data: 0.003338254289701581
Epoch: 350
Loss on hold-out set: 1.4578006163159636e-06
MeanAbsoluteError value on hold-out data: 0.0009493728284724057
Epoch: 351
Loss on hold-out set: 2.7963079120533954e-06
MeanAbsoluteError value on hold-out data: 0.001382094924338162
Epoch: 352
Loss on hold-out set: 1.6841987180788765e-06
MeanAbsoluteError value on hold-out data: 0.0010214722715318203
Epoch: 353
Loss on hold-out set: 7.257480252806808e-05
MeanAbsoluteError value on hold-out data: 0.008318562060594559
Epoch: 354
Loss on hold-out set: 2.0365788150169657e-06
MeanAbsoluteError value on hold-out data: 0.0011245280038565397
Epoch: 355
Loss on hold-out set: 1.7822970963415604e-06
MeanAbsoluteError value on hold-out data: 0.0010807570070028305
Epoch: 356
Loss on hold-out set: 6.384204694816282e-06
MeanAbsoluteError value on hold-out data: 0.002264658221974969
Epoch: 357
Loss on hold-out set: 1.493673351367426e-06
MeanAbsoluteError value on hold-out data: 0.0009652225417084992
Epoch: 358
Loss on hold-out set: 3.0965187534093275e-06
MeanAbsoluteError value on hold-out data: 0.0014694371493533254
Epoch: 359
Loss on hold-out set: 1.255644977280362e-06
MeanAbsoluteError value on hold-out data: 0.000880762527231127
Epoch: 360
Loss on hold-out set: 4.740201582439783e-05
MeanAbsoluteError value on hold-out data: 0.006670766044408083
Epoch: 361
Loss on hold-out set: 3.2875318747995297e-06
MeanAbsoluteError value on hold-out data: 0.0015092723770067096
Epoch: 362
Loss on hold-out set: 3.0519982353301826e-06
MeanAbsoluteError value on hold-out data: 0.001447484246455133
Epoch: 363
Loss on hold-out set: 3.90618217986565e-06
MeanAbsoluteError value on hold-out data: 0.0016699647530913353
Epoch: 364
Loss on hold-out set: 2.5364400701882436e-06
MeanAbsoluteError value on hold-out data: 0.0013011414557695389
Epoch: 365
Loss on hold-out set: 1.7444673598052567e-06
MeanAbsoluteError value on hold-out data: 0.0010340082226321101
Epoch: 366
Loss on hold-out set: 7.22091455444522e-05
MeanAbsoluteError value on hold-out data: 0.008295532315969467
Epoch: 367
Loss on hold-out set: 3.4745550848176785e-06
MeanAbsoluteError value on hold-out data: 0.0015355515060946345
Epoch: 368
Loss on hold-out set: 1.9696258733933734e-06
MeanAbsoluteError value on hold-out data: 0.001140695996582508
Epoch: 369
Loss on hold-out set: 4.641467183462641e-06
MeanAbsoluteError value on hold-out data: 0.001868012361228466
Epoch: 370
Loss on hold-out set: 1.800907932348357e-06
MeanAbsoluteError value on hold-out data: 0.0010716499527916312
Epoch: 371
Loss on hold-out set: 2.9769584288212505e-06
MeanAbsoluteError value on hold-out data: 0.0014321194030344486
Epoch: 372
Loss on hold-out set: 1.3405210703348003e-06
MeanAbsoluteError value on hold-out data: 0.0009089151280932128
Epoch: 373
Loss on hold-out set: 4.2056129802260424e-05
MeanAbsoluteError value on hold-out data: 0.006266955751925707
Epoch: 374
Loss on hold-out set: 3.1000645306951477e-06
MeanAbsoluteError value on hold-out data: 0.0014593667583540082
Epoch: 375
Loss on hold-out set: 2.818633205199723e-06
MeanAbsoluteError value on hold-out data: 0.0013785866321995854
Epoch: 376
Loss on hold-out set: 3.760496972996694e-06
MeanAbsoluteError value on hold-out data: 0.0016293295193463564
Epoch: 377
Loss on hold-out set: 2.733675822690585e-06
MeanAbsoluteError value on hold-out data: 0.0013527896953746676
Epoch: 378
Loss on hold-out set: 1.8756960649942524e-06
MeanAbsoluteError value on hold-out data: 0.0010845573851838708
Epoch: 379
Loss on hold-out set: 5.00263006056469e-05
MeanAbsoluteError value on hold-out data: 0.006859887391328812
Epoch: 380
Loss on hold-out set: 3.503651253379901e-06
MeanAbsoluteError value on hold-out data: 0.0015623271465301514
Epoch: 381
Loss on hold-out set: 2.421292404470047e-06
MeanAbsoluteError value on hold-out data: 0.0012688899878412485
Epoch: 382
Loss on hold-out set: 3.770134191271561e-06
MeanAbsoluteError value on hold-out data: 0.0016400411259382963
Epoch: 383
Loss on hold-out set: 3.183571411263505e-06
MeanAbsoluteError value on hold-out data: 0.001476328237913549
Epoch: 384
Loss on hold-out set: 1.3744861047221571e-06
MeanAbsoluteError value on hold-out data: 0.0009285423438996077
Epoch: 385
Loss on hold-out set: 2.506110175952352e-05
MeanAbsoluteError value on hold-out data: 0.004752239678055048
Epoch: 386
Loss on hold-out set: 7.750496784434577e-06
MeanAbsoluteError value on hold-out data: 0.0025535780005156994
Epoch: 387
Loss on hold-out set: 2.4527712487030695e-06
MeanAbsoluteError value on hold-out data: 0.0012661507353186607
Epoch: 388
Loss on hold-out set: 3.9271250754705095e-06
MeanAbsoluteError value on hold-out data: 0.0016548255225643516
Epoch: 389
Loss on hold-out set: 1.350273077910539e-06
MeanAbsoluteError value on hold-out data: 0.0009358163806609809
Epoch: 390
Loss on hold-out set: 6.827493743793112e-06
MeanAbsoluteError value on hold-out data: 0.0022873736452311277
Epoch: 391
Loss on hold-out set: 2.0071526322633298e-05
MeanAbsoluteError value on hold-out data: 0.004284583032131195
Epoch: 392
Loss on hold-out set: 3.6981628299097216e-06
MeanAbsoluteError value on hold-out data: 0.0016329057980328798
Epoch: 393
Loss on hold-out set: 1.7364403061635944e-06
MeanAbsoluteError value on hold-out data: 0.00105840596370399
Epoch: 394
Loss on hold-out set: 1.7357437805661614e-06
MeanAbsoluteError value on hold-out data: 0.0010279066627845168
Epoch: 395
Loss on hold-out set: 7.300630855560915e-05
MeanAbsoluteError value on hold-out data: 0.008353430777788162
Epoch: 396
Loss on hold-out set: 2.711304900733586e-06
MeanAbsoluteError value on hold-out data: 0.0012867894256487489
Epoch: 397
Loss on hold-out set: 1.7609931246086393e-06
MeanAbsoluteError value on hold-out data: 0.0010634736390784383
Epoch: 398
Loss on hold-out set: 2.803928081998732e-06
MeanAbsoluteError value on hold-out data: 0.001372417900711298
Epoch: 399
Loss on hold-out set: 1.4799571862280765e-06
MeanAbsoluteError value on hold-out data: 0.0009475458646193147
Epoch: 400
Loss on hold-out set: 3.075795783496161e-06
MeanAbsoluteError value on hold-out data: 0.001439464744180441
Epoch: 401
Loss on hold-out set: 3.129201436542261e-06
MeanAbsoluteError value on hold-out data: 0.001441900385543704
Epoch: 402
Loss on hold-out set: 3.2108944765241176e-06
MeanAbsoluteError value on hold-out data: 0.001458201208151877
Epoch: 403
Loss on hold-out set: 1.993097311239317e-06
MeanAbsoluteError value on hold-out data: 0.0011336382012814283
Epoch: 404
Loss on hold-out set: 2.1473989112277387e-06
MeanAbsoluteError value on hold-out data: 0.0011809308780357242
Epoch: 405
Loss on hold-out set: 5.121813305059301e-05
MeanAbsoluteError value on hold-out data: 0.00698826415464282
Epoch: 406
Loss on hold-out set: 2.322100924270911e-06
MeanAbsoluteError value on hold-out data: 0.0012269463622942567
Epoch: 407
Loss on hold-out set: 8.651885967705503e-06
MeanAbsoluteError value on hold-out data: 0.0027131892275065184
Epoch: 408
Loss on hold-out set: 1.4580672149421797e-06
MeanAbsoluteError value on hold-out data: 0.0009590364643372595
Epoch: 409
Loss on hold-out set: 3.9060740487241815e-06
MeanAbsoluteError value on hold-out data: 0.0016660786932334304
Epoch: 410
Loss on hold-out set: 2.002822143547172e-06
MeanAbsoluteError value on hold-out data: 0.001130526652559638
Epoch: 411
Loss on hold-out set: 2.281040167417814e-06
MeanAbsoluteError value on hold-out data: 0.0012449308997020125
Epoch: 412
Loss on hold-out set: 1.826250885534663e-06
MeanAbsoluteError value on hold-out data: 0.0010478843469172716
Epoch: 413
Loss on hold-out set: 6.887438336745713e-05
MeanAbsoluteError value on hold-out data: 0.008116692304611206
Epoch: 414
Loss on hold-out set: 2.4165760207420373e-05
MeanAbsoluteError value on hold-out data: 0.004516960121691227
Epoch: 415
Loss on hold-out set: 1.5606102676345376e-06
MeanAbsoluteError value on hold-out data: 0.0009966235375031829
Epoch: 416
Loss on hold-out set: 1.62190755646993e-06
MeanAbsoluteError value on hold-out data: 0.0010108158458024263
Epoch: 417
Loss on hold-out set: 2.346871911497242e-06
MeanAbsoluteError value on hold-out data: 0.0012397110695019364
Epoch: 418
Loss on hold-out set: 1.6428473223210237e-06
MeanAbsoluteError value on hold-out data: 0.0010126958368346095
Epoch: 419
Loss on hold-out set: 2.432670955063019e-06
MeanAbsoluteError value on hold-out data: 0.0012616614112630486
Epoch: 420
Loss on hold-out set: 2.2842536216222995e-06
MeanAbsoluteError value on hold-out data: 0.001214940450154245
Epoch: 421
Loss on hold-out set: 1.560274097899214e-06
MeanAbsoluteError value on hold-out data: 0.00098902708850801
Epoch: 422
Loss on hold-out set: 1.6487638680772714e-06
MeanAbsoluteError value on hold-out data: 0.000996268237940967
Epoch: 423
Loss on hold-out set: 7.001352098182236e-05
MeanAbsoluteError value on hold-out data: 0.008199939504265785
Epoch: 424
Loss on hold-out set: 7.756337816700628e-06
MeanAbsoluteError value on hold-out data: 0.00237085809931159
Epoch: 425
Loss on hold-out set: 1.3878371305509063e-06
MeanAbsoluteError value on hold-out data: 0.0009368332102894783
Epoch: 426
Loss on hold-out set: 3.3867415822896874e-06
MeanAbsoluteError value on hold-out data: 0.0015454903477802873
Epoch: 427
Loss on hold-out set: 1.351306059704209e-06
MeanAbsoluteError value on hold-out data: 0.0009150754194706678
Epoch: 428
Loss on hold-out set: 3.2626425754762365e-06
MeanAbsoluteError value on hold-out data: 0.0015073546674102545
Epoch: 429
Loss on hold-out set: 2.166603096791158e-06
MeanAbsoluteError value on hold-out data: 0.0011827322887256742
Epoch: 430
Loss on hold-out set: 1.4466007569368638e-06
MeanAbsoluteError value on hold-out data: 0.0009479979635216296
Epoch: 431
Loss on hold-out set: 1.5901169541321953e-06
MeanAbsoluteError value on hold-out data: 0.0009857210097834468
Epoch: 432
Loss on hold-out set: 7.04362972005344e-05
MeanAbsoluteError value on hold-out data: 0.008229563012719154
Epoch: 433
Loss on hold-out set: 6.48359776421689e-06
MeanAbsoluteError value on hold-out data: 0.002133972942829132
Epoch: 434
Loss on hold-out set: 1.451306393332025e-06
MeanAbsoluteError value on hold-out data: 0.0009517492726445198
Epoch: 435
Loss on hold-out set: 4.796115523444505e-06
MeanAbsoluteError value on hold-out data: 0.0019017048180103302
Epoch: 436
Loss on hold-out set: 1.3045728285245979e-06
MeanAbsoluteError value on hold-out data: 0.0009064435726031661
Epoch: 437
Loss on hold-out set: 3.5253775978928482e-06
MeanAbsoluteError value on hold-out data: 0.0015816991217434406
Epoch: 438
Loss on hold-out set: 2.021179674808369e-06
MeanAbsoluteError value on hold-out data: 0.001143811154179275
Epoch: 439
Loss on hold-out set: 1.6362830656272596e-06
MeanAbsoluteError value on hold-out data: 0.0010217909002676606
Epoch: 440
Loss on hold-out set: 1.9538471148830707e-06
MeanAbsoluteError value on hold-out data: 0.0011280567850917578
Epoch: 441
Loss on hold-out set: 5.9514866542916645e-05
MeanAbsoluteError value on hold-out data: 0.007554797455668449
Early stopping at epoch 440
Returned to Spot: Validation loss: 5.9514866542916645e-05
----------------------------------------------
spotPython tuning: 1.6505701571651643e-05 [#########-] 91.17% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.0, 'lr_mult': 9.991076489740422, 'batch_size': 8, 'epochs': 512, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.9366082179588401}
Epoch: 1
Loss on hold-out set: 0.011902531621193415
MeanAbsoluteError value on hold-out data: 0.08744370937347412
Epoch: 2
Loss on hold-out set: 0.008561573058709894
MeanAbsoluteError value on hold-out data: 0.07304684072732925
Epoch: 3
Loss on hold-out set: 0.004358511225099822
MeanAbsoluteError value on hold-out data: 0.05233778804540634
Epoch: 4
Loss on hold-out set: 0.0012973164404301268
MeanAbsoluteError value on hold-out data: 0.028809137642383575
Epoch: 5
Loss on hold-out set: 0.0002846736470497777
MeanAbsoluteError value on hold-out data: 0.013258454389870167
Epoch: 6
Loss on hold-out set: 4.236993997533558e-05
MeanAbsoluteError value on hold-out data: 0.00428439537063241
Epoch: 7
Loss on hold-out set: 8.223878859625027e-05
MeanAbsoluteError value on hold-out data: 0.008188817650079727
Epoch: 8
Loss on hold-out set: 7.351833540413186e-05
MeanAbsoluteError value on hold-out data: 0.00785649660974741
Epoch: 9
Loss on hold-out set: 2.5516996976492872e-05
MeanAbsoluteError value on hold-out data: 0.003922637086361647
Epoch: 10
Loss on hold-out set: 1.393046325478951e-05
MeanAbsoluteError value on hold-out data: 0.002283364301547408
Epoch: 11
Loss on hold-out set: 1.2373027354777533e-05
MeanAbsoluteError value on hold-out data: 0.002116825431585312
Epoch: 12
Loss on hold-out set: 1.1727838191769766e-05
MeanAbsoluteError value on hold-out data: 0.00215552537702024
Epoch: 13
Loss on hold-out set: 1.0671660196461935e-05
MeanAbsoluteError value on hold-out data: 0.0020310503896325827
Epoch: 14
Loss on hold-out set: 1.138415774747907e-05
MeanAbsoluteError value on hold-out data: 0.0022730715572834015
Epoch: 15
Loss on hold-out set: 1.0874788615996964e-05
MeanAbsoluteError value on hold-out data: 0.002222127513960004
Epoch: 16
Loss on hold-out set: 7.554546511444546e-06
MeanAbsoluteError value on hold-out data: 0.0013623831328004599
Epoch: 17
Loss on hold-out set: 7.279427207825058e-06
MeanAbsoluteError value on hold-out data: 0.0013242906425148249
Epoch: 18
Loss on hold-out set: 7.087114369142e-06
MeanAbsoluteError value on hold-out data: 0.0012568366946652532
Epoch: 19
Loss on hold-out set: 9.35649173446731e-06
MeanAbsoluteError value on hold-out data: 0.0017822826048359275
Epoch: 20
Loss on hold-out set: 9.591315269493575e-06
MeanAbsoluteError value on hold-out data: 0.0016913978615775704
Epoch: 21
Loss on hold-out set: 1.708332237476976e-05
MeanAbsoluteError value on hold-out data: 0.0031869823578745127
Epoch: 22
Loss on hold-out set: 3.589766741865069e-05
MeanAbsoluteError value on hold-out data: 0.005329520907253027
Epoch: 23
Loss on hold-out set: 4.618450006283207e-05
MeanAbsoluteError value on hold-out data: 0.0061042336747050285
Epoch: 24
Loss on hold-out set: 3.2246546915733854e-05
MeanAbsoluteError value on hold-out data: 0.004837505053728819
Epoch: 25
Loss on hold-out set: 1.263410362490073e-05
MeanAbsoluteError value on hold-out data: 0.0025123648811131716
Epoch: 26
Loss on hold-out set: 8.518443454058319e-06
MeanAbsoluteError value on hold-out data: 0.0018073972314596176
Epoch: 27
Loss on hold-out set: 7.991161775060774e-06
MeanAbsoluteError value on hold-out data: 0.0016757146222516894
Epoch: 28
Loss on hold-out set: 6.775201206802481e-06
MeanAbsoluteError value on hold-out data: 0.0013838104205206037
Epoch: 29
Loss on hold-out set: 7.143758895871973e-06
MeanAbsoluteError value on hold-out data: 0.0015103822806850076
Epoch: 30
Loss on hold-out set: 6.648379176591621e-06
MeanAbsoluteError value on hold-out data: 0.0014273939887061715
Epoch: 31
Loss on hold-out set: 1.138074636449011e-05
MeanAbsoluteError value on hold-out data: 0.002491049701347947
Epoch: 32
Loss on hold-out set: 5.750412272295522e-05
MeanAbsoluteError value on hold-out data: 0.007086127530783415
Epoch: 33
Loss on hold-out set: 9.318017519514175e-05
MeanAbsoluteError value on hold-out data: 0.009127145633101463
Epoch: 34
Loss on hold-out set: 8.182990725464678e-05
MeanAbsoluteError value on hold-out data: 0.008593161590397358
Epoch: 35
Loss on hold-out set: 4.358189639070157e-05
MeanAbsoluteError value on hold-out data: 0.006198802962899208
Epoch: 36
Loss on hold-out set: 5.723482162896911e-05
MeanAbsoluteError value on hold-out data: 0.007104543037712574
Epoch: 37
Loss on hold-out set: 9.155132169038744e-05
MeanAbsoluteError value on hold-out data: 0.00906029436737299
Epoch: 38
Loss on hold-out set: 8.015461418452967e-05
MeanAbsoluteError value on hold-out data: 0.008501455187797546
Epoch: 39
Loss on hold-out set: 6.723732239104146e-05
MeanAbsoluteError value on hold-out data: 0.007755112834274769
Epoch: 40
Loss on hold-out set: 6.704239115750074e-05
MeanAbsoluteError value on hold-out data: 0.007778914645314217
Epoch: 41
Loss on hold-out set: 8.008992354964568e-05
MeanAbsoluteError value on hold-out data: 0.008419389836490154
Epoch: 42
Loss on hold-out set: 6.450476470682158e-05
MeanAbsoluteError value on hold-out data: 0.007618557661771774
Epoch: 43
Loss on hold-out set: 0.00011842411492436536
MeanAbsoluteError value on hold-out data: 0.010451827198266983
Epoch: 44
Loss on hold-out set: 8.256774957484787e-05
MeanAbsoluteError value on hold-out data: 0.008653324097394943
Epoch: 45
Loss on hold-out set: 2.7651142940349498e-05
MeanAbsoluteError value on hold-out data: 0.004750214982777834
Epoch: 46
Loss on hold-out set: 9.049065594904517e-05
MeanAbsoluteError value on hold-out data: 0.009167522192001343
Epoch: 47
Loss on hold-out set: 9.20192579590213e-05
MeanAbsoluteError value on hold-out data: 0.009170956909656525
Epoch: 48
Loss on hold-out set: 6.965877199897812e-05
MeanAbsoluteError value on hold-out data: 0.00803997553884983
Epoch: 49
Loss on hold-out set: 5.3481791742103125e-05
MeanAbsoluteError value on hold-out data: 0.0069348858669400215
Epoch: 50
Loss on hold-out set: 7.881485659086856e-05
MeanAbsoluteError value on hold-out data: 0.008590721525251865
Epoch: 51
Loss on hold-out set: 7.520390653026927e-05
MeanAbsoluteError value on hold-out data: 0.00835485104471445
Epoch: 52
Loss on hold-out set: 7.673414582218117e-05
MeanAbsoluteError value on hold-out data: 0.008465981110930443
Epoch: 53
Loss on hold-out set: 3.9609064515389036e-05
MeanAbsoluteError value on hold-out data: 0.005818571895360947
Epoch: 54
Loss on hold-out set: 3.68508247591212e-05
MeanAbsoluteError value on hold-out data: 0.005607936531305313
Epoch: 55
Loss on hold-out set: 7.589138007652334e-05
MeanAbsoluteError value on hold-out data: 0.00839111115783453
Epoch: 56
Loss on hold-out set: 9.660446410539168e-05
MeanAbsoluteError value on hold-out data: 0.009546332061290741
Epoch: 57
Loss on hold-out set: 1.4331198575459175e-05
MeanAbsoluteError value on hold-out data: 0.002999755321070552
Epoch: 58
Loss on hold-out set: 3.535957507426103e-05
MeanAbsoluteError value on hold-out data: 0.005473628174513578
Epoch: 59
Loss on hold-out set: 0.00017265560133015052
MeanAbsoluteError value on hold-out data: 0.012848333455622196
Epoch: 60
Loss on hold-out set: 2.1556390780269314e-05
MeanAbsoluteError value on hold-out data: 0.004063610918819904
Epoch: 61
Loss on hold-out set: 4.070907471032115e-05
MeanAbsoluteError value on hold-out data: 0.006000571418553591
Epoch: 62
Loss on hold-out set: 0.00013780854236469358
MeanAbsoluteError value on hold-out data: 0.011446326971054077
Epoch: 63
Loss on hold-out set: 0.0001582193521914489
MeanAbsoluteError value on hold-out data: 0.01229928620159626
Epoch: 64
Loss on hold-out set: 2.046066547815204e-05
MeanAbsoluteError value on hold-out data: 0.003621176118031144
Epoch: 65
Loss on hold-out set: 6.167027373449903e-06
MeanAbsoluteError value on hold-out data: 0.0015170188853517175
Epoch: 66
Loss on hold-out set: 5.412778380942702e-05
MeanAbsoluteError value on hold-out data: 0.007008620072156191
Epoch: 67
Loss on hold-out set: 0.00015565394623033506
MeanAbsoluteError value on hold-out data: 0.012163522653281689
Epoch: 68
Loss on hold-out set: 0.00012076281927875243
MeanAbsoluteError value on hold-out data: 0.010746510699391365
Epoch: 69
Loss on hold-out set: 1.074053531474898e-05
MeanAbsoluteError value on hold-out data: 0.002254005055874586
Epoch: 70
Loss on hold-out set: 9.657184388120904e-06
MeanAbsoluteError value on hold-out data: 0.002205907367169857
Epoch: 71
Loss on hold-out set: 8.841922891932834e-05
MeanAbsoluteError value on hold-out data: 0.00909430906176567
Epoch: 72
Loss on hold-out set: 0.00015327250290092227
MeanAbsoluteError value on hold-out data: 0.012071935459971428
Epoch: 73
Loss on hold-out set: 9.552088876692946e-06
MeanAbsoluteError value on hold-out data: 0.002227040473371744
Epoch: 74
Loss on hold-out set: 1.7125092151553345e-05
MeanAbsoluteError value on hold-out data: 0.003500398015603423
Epoch: 75
Loss on hold-out set: 6.677019250913106e-05
MeanAbsoluteError value on hold-out data: 0.00785780604928732
Epoch: 76
Loss on hold-out set: 0.00014527359541572973
MeanAbsoluteError value on hold-out data: 0.01176475826650858
Epoch: 77
Loss on hold-out set: 7.661591304871476e-06
MeanAbsoluteError value on hold-out data: 0.0016735539538785815
Epoch: 78
Loss on hold-out set: 2.9183934872746347e-05
MeanAbsoluteError value on hold-out data: 0.004866476636379957
Epoch: 79
Loss on hold-out set: 9.588984041903658e-05
MeanAbsoluteError value on hold-out data: 0.009497853927314281
Epoch: 80
Loss on hold-out set: 3.6452967211325336e-05
MeanAbsoluteError value on hold-out data: 0.00557316280901432
Epoch: 81
Loss on hold-out set: 3.571599163957504e-05
MeanAbsoluteError value on hold-out data: 0.005458632949739695
Epoch: 82
Loss on hold-out set: 1.899711261151089e-05
MeanAbsoluteError value on hold-out data: 0.003690354060381651
Epoch: 83
Loss on hold-out set: 1.9311234011279577e-05
MeanAbsoluteError value on hold-out data: 0.0037342680152505636
Epoch: 84
Loss on hold-out set: 7.275842261534356e-05
MeanAbsoluteError value on hold-out data: 0.008222600445151329
Epoch: 85
Loss on hold-out set: 4.6394441405458276e-05
MeanAbsoluteError value on hold-out data: 0.006377644371241331
Epoch: 86
Loss on hold-out set: 2.9312037728040625e-05
MeanAbsoluteError value on hold-out data: 0.004832456819713116
Epoch: 87
Loss on hold-out set: 1.1153644885253974e-05
MeanAbsoluteError value on hold-out data: 0.002503584371879697
Epoch: 88
Loss on hold-out set: 5.741637333382019e-05
MeanAbsoluteError value on hold-out data: 0.007241484243422747
Epoch: 89
Loss on hold-out set: 5.1283445684116725e-05
MeanAbsoluteError value on hold-out data: 0.006774428766220808
Epoch: 90
Loss on hold-out set: 1.842388056310914e-05
MeanAbsoluteError value on hold-out data: 0.0035327549558132887
Epoch: 91
Loss on hold-out set: 9.291112369761609e-06
MeanAbsoluteError value on hold-out data: 0.002165700774639845
Epoch: 92
Loss on hold-out set: 6.91087055824219e-05
MeanAbsoluteError value on hold-out data: 0.00801188312470913
Epoch: 93
Loss on hold-out set: 0.00010600422568754048
MeanAbsoluteError value on hold-out data: 0.010016839019954205
Epoch: 94
Loss on hold-out set: 5.7277297424949016e-05
MeanAbsoluteError value on hold-out data: 0.00689762132242322
Epoch: 95
Loss on hold-out set: 7.663968930453274e-06
MeanAbsoluteError value on hold-out data: 0.0017271750839427114
Epoch: 96
Loss on hold-out set: 1.7315455483855513e-05
MeanAbsoluteError value on hold-out data: 0.003390716388821602
Epoch: 97
Loss on hold-out set: 6.0905599974304146e-05
MeanAbsoluteError value on hold-out data: 0.007415351923555136
Epoch: 98
Loss on hold-out set: 0.00012654213979227565
MeanAbsoluteError value on hold-out data: 0.010881608352065086
Epoch: 99
Loss on hold-out set: 6.256354639557877e-05
MeanAbsoluteError value on hold-out data: 0.007560964208096266
Epoch: 100
Loss on hold-out set: 3.975965410063509e-05
MeanAbsoluteError value on hold-out data: 0.005927118472754955
Epoch: 101
Loss on hold-out set: 9.968273144821931e-05
MeanAbsoluteError value on hold-out data: 0.009703622199594975
Epoch: 102
Loss on hold-out set: 0.0001283968072369278
MeanAbsoluteError value on hold-out data: 0.011047392152249813
Epoch: 103
Loss on hold-out set: 7.499885721603947e-05
MeanAbsoluteError value on hold-out data: 0.008367354050278664
Epoch: 104
Loss on hold-out set: 5.142819588256412e-05
MeanAbsoluteError value on hold-out data: 0.006779063493013382
Epoch: 105
Loss on hold-out set: 8.174114459267769e-05
MeanAbsoluteError value on hold-out data: 0.008667618036270142
Epoch: 106
Loss on hold-out set: 7.645139727461164e-06
MeanAbsoluteError value on hold-out data: 0.0017844840185716748
Epoch: 107
Loss on hold-out set: 4.678913893784691e-05
MeanAbsoluteError value on hold-out data: 0.006508029531687498
Epoch: 108
Loss on hold-out set: 0.00011299529164956
MeanAbsoluteError value on hold-out data: 0.010359409265220165
Epoch: 109
Loss on hold-out set: 0.00027719145107671226
MeanAbsoluteError value on hold-out data: 0.016361968591809273
Epoch: 110
Loss on hold-out set: 0.0001913648187550471
MeanAbsoluteError value on hold-out data: 0.01344569493085146
Epoch: 111
Loss on hold-out set: 1.0767907518153439e-05
MeanAbsoluteError value on hold-out data: 0.002193025080487132
Epoch: 112
Loss on hold-out set: 8.418518892707844e-06
MeanAbsoluteError value on hold-out data: 0.0018995398422703147
Epoch: 113
Loss on hold-out set: 8.44096648147809e-06
MeanAbsoluteError value on hold-out data: 0.0019456190057098866
Epoch: 114
Loss on hold-out set: 2.1189785959569762e-05
MeanAbsoluteError value on hold-out data: 0.004004062153398991
Epoch: 115
Loss on hold-out set: 5.487203107852685e-05
MeanAbsoluteError value on hold-out data: 0.007005307823419571
Epoch: 116
Loss on hold-out set: 6.443923283720658e-05
MeanAbsoluteError value on hold-out data: 0.007589938584715128
Epoch: 117
Loss on hold-out set: 5.212210491759164e-05
MeanAbsoluteError value on hold-out data: 0.006746160332113504
Epoch: 118
Loss on hold-out set: 4.89236967232979e-05
MeanAbsoluteError value on hold-out data: 0.006453321781009436
Epoch: 119
Loss on hold-out set: 3.8016805918136686e-05
MeanAbsoluteError value on hold-out data: 0.005629057064652443
Epoch: 120
Loss on hold-out set: 3.084491431524695e-05
MeanAbsoluteError value on hold-out data: 0.004980316385626793
Epoch: 121
Loss on hold-out set: 3.710609574849705e-05
MeanAbsoluteError value on hold-out data: 0.005559958051890135
Epoch: 122
Loss on hold-out set: 3.7698097912652884e-05
MeanAbsoluteError value on hold-out data: 0.005578916985541582
Epoch: 123
Loss on hold-out set: 3.32606342262328e-05
MeanAbsoluteError value on hold-out data: 0.005161076318472624
Epoch: 124
Loss on hold-out set: 5.3058408028798445e-05
MeanAbsoluteError value on hold-out data: 0.006778940558433533
Epoch: 125
Loss on hold-out set: 3.979792362722372e-05
MeanAbsoluteError value on hold-out data: 0.005705547519028187
Epoch: 126
Loss on hold-out set: 3.637653332445648e-05
MeanAbsoluteError value on hold-out data: 0.005556067451834679
Epoch: 127
Loss on hold-out set: 1.1005110979424085e-05
MeanAbsoluteError value on hold-out data: 0.0025487691164016724
Epoch: 128
Loss on hold-out set: 1.94725157598441e-05
MeanAbsoluteError value on hold-out data: 0.003865412436425686
Epoch: 129
Loss on hold-out set: 9.907191347816766e-06
MeanAbsoluteError value on hold-out data: 0.0022249650210142136
Early stopping at epoch 128
Returned to Spot: Validation loss: 9.907191347816766e-06
----------------------------------------------
spotPython tuning: 9.907191347816766e-06 [##########] 97.34% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.0, 'lr_mult': 9.999938574862249, 'batch_size': 8, 'epochs': 512, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.9601290602249235}
Epoch: 1
Loss on hold-out set: 0.020779798040166497
MeanAbsoluteError value on hold-out data: 0.11277328431606293
Epoch: 2
Loss on hold-out set: 0.016914939507842064
MeanAbsoluteError value on hold-out data: 0.10257727652788162
Epoch: 3
Loss on hold-out set: 0.007948934774551736
MeanAbsoluteError value on hold-out data: 0.07002272456884384
Epoch: 4
Loss on hold-out set: 0.0023201747987370348
MeanAbsoluteError value on hold-out data: 0.038483891636133194
Epoch: 5
Loss on hold-out set: 0.0006043091458482913
MeanAbsoluteError value on hold-out data: 0.019380073994398117
Epoch: 6
Loss on hold-out set: 0.0001791967553895359
MeanAbsoluteError value on hold-out data: 0.010438930243253708
Epoch: 7
Loss on hold-out set: 9.887239790068154e-05
MeanAbsoluteError value on hold-out data: 0.007561267353594303
Epoch: 8
Loss on hold-out set: 4.371799797067261e-05
MeanAbsoluteError value on hold-out data: 0.002011345000937581
Epoch: 9
Loss on hold-out set: 4.867716590620388e-05
MeanAbsoluteError value on hold-out data: 0.004026518668979406
Epoch: 10
Loss on hold-out set: 4.304548206403668e-05
MeanAbsoluteError value on hold-out data: 0.003855518065392971
Epoch: 11
Loss on hold-out set: 4.2164357541639075e-05
MeanAbsoluteError value on hold-out data: 0.00417478010058403
Epoch: 12
Loss on hold-out set: 3.608028558980885e-05
MeanAbsoluteError value on hold-out data: 0.003667086362838745
Epoch: 13
Loss on hold-out set: 3.104762156094933e-05
MeanAbsoluteError value on hold-out data: 0.003209958551451564
Epoch: 14
Loss on hold-out set: 2.4971538526810228e-05
MeanAbsoluteError value on hold-out data: 0.002378325443714857
Epoch: 15
Loss on hold-out set: 2.0845479910074e-05
MeanAbsoluteError value on hold-out data: 0.001576278475113213
Epoch: 16
Loss on hold-out set: 2.1414616879299404e-05
MeanAbsoluteError value on hold-out data: 0.0022979953791946173
Epoch: 17
Loss on hold-out set: 2.1626122403224718e-05
MeanAbsoluteError value on hold-out data: 0.0026763081550598145
Epoch: 18
Loss on hold-out set: 1.495638127162118e-05
MeanAbsoluteError value on hold-out data: 0.0013174435589462519
Epoch: 19
Loss on hold-out set: 1.4690994710894015e-05
MeanAbsoluteError value on hold-out data: 0.0016095710452646017
Epoch: 20
Loss on hold-out set: 1.2787101421227626e-05
MeanAbsoluteError value on hold-out data: 0.0013299820711836219
Epoch: 21
Loss on hold-out set: 1.139558381842227e-05
MeanAbsoluteError value on hold-out data: 0.0011028143344447017
Epoch: 22
Loss on hold-out set: 1.0654867165870105e-05
MeanAbsoluteError value on hold-out data: 0.0011773188598453999
Epoch: 23
Loss on hold-out set: 9.948620458251417e-06
MeanAbsoluteError value on hold-out data: 0.001156574347987771
Epoch: 24
Loss on hold-out set: 1.1979924263833278e-05
MeanAbsoluteError value on hold-out data: 0.0019233159255236387
Epoch: 25
Loss on hold-out set: 1.2296632054118928e-05
MeanAbsoluteError value on hold-out data: 0.0021039117127656937
Epoch: 26
Loss on hold-out set: 1.7033734533661598e-05
MeanAbsoluteError value on hold-out data: 0.003169231116771698
Epoch: 27
Loss on hold-out set: 2.895444375003296e-05
MeanAbsoluteError value on hold-out data: 0.004786279052495956
Epoch: 28
Loss on hold-out set: 6.951081339043173e-05
MeanAbsoluteError value on hold-out data: 0.0079345703125
Epoch: 29
Loss on hold-out set: 0.00015800606476994673
MeanAbsoluteError value on hold-out data: 0.012215270660817623
Epoch: 30
Loss on hold-out set: 0.00021720833970711713
MeanAbsoluteError value on hold-out data: 0.014280697330832481
Epoch: 31
Loss on hold-out set: 8.285370418697742e-05
MeanAbsoluteError value on hold-out data: 0.008476752787828445
Epoch: 32
Loss on hold-out set: 6.984700226702874e-05
MeanAbsoluteError value on hold-out data: 0.007985368371009827
Epoch: 33
Loss on hold-out set: 8.611220044641461e-05
MeanAbsoluteError value on hold-out data: 0.008879178203642368
Epoch: 34
Loss on hold-out set: 0.00012587993191310058
MeanAbsoluteError value on hold-out data: 0.010836461558938026
Epoch: 35
Loss on hold-out set: 0.00015885911833672588
MeanAbsoluteError value on hold-out data: 0.012164187617599964
Epoch: 36
Loss on hold-out set: 0.00012514140249358637
MeanAbsoluteError value on hold-out data: 0.010714544914662838
Epoch: 37
Loss on hold-out set: 8.39224427947652e-05
MeanAbsoluteError value on hold-out data: 0.008758751675486565
Epoch: 38
Loss on hold-out set: 8.878004518919624e-05
MeanAbsoluteError value on hold-out data: 0.008994799107313156
Epoch: 39
Loss on hold-out set: 0.00011451647400175908
MeanAbsoluteError value on hold-out data: 0.010333769023418427
Epoch: 40
Loss on hold-out set: 0.000135993489254217
MeanAbsoluteError value on hold-out data: 0.011232633143663406
Epoch: 41
Loss on hold-out set: 0.0001246886610093306
MeanAbsoluteError value on hold-out data: 0.010728022083640099
Epoch: 42
Loss on hold-out set: 8.837657275618862e-05
MeanAbsoluteError value on hold-out data: 0.008968769572675228
Epoch: 43
Loss on hold-out set: 8.87831323971592e-05
MeanAbsoluteError value on hold-out data: 0.009040135890245438
Epoch: 44
Loss on hold-out set: 0.00011568321075939916
MeanAbsoluteError value on hold-out data: 0.010359581559896469
Epoch: 45
Loss on hold-out set: 0.00011792752200945917
MeanAbsoluteError value on hold-out data: 0.010445527732372284
Epoch: 46
Loss on hold-out set: 0.00013174323535885808
MeanAbsoluteError value on hold-out data: 0.0110614700242877
Epoch: 47
Loss on hold-out set: 0.00010513931087380594
MeanAbsoluteError value on hold-out data: 0.009795762598514557
Epoch: 48
Loss on hold-out set: 9.629003292694076e-05
MeanAbsoluteError value on hold-out data: 0.009379773400723934
Epoch: 49
Loss on hold-out set: 0.00011388845393268734
MeanAbsoluteError value on hold-out data: 0.01029104832559824
Epoch: 50
Loss on hold-out set: 9.929368111203842e-05
MeanAbsoluteError value on hold-out data: 0.009510064497590065
Epoch: 51
Loss on hold-out set: 9.334067736314242e-05
MeanAbsoluteError value on hold-out data: 0.009260711260139942
Epoch: 52
Loss on hold-out set: 0.00012103596006789686
MeanAbsoluteError value on hold-out data: 0.010593092069029808
Epoch: 53
Loss on hold-out set: 0.00010386273549413186
MeanAbsoluteError value on hold-out data: 0.009724816307425499
Epoch: 54
Loss on hold-out set: 9.481229273277629e-05
MeanAbsoluteError value on hold-out data: 0.009332258254289627
Epoch: 55
Loss on hold-out set: 0.00011964167022501657
MeanAbsoluteError value on hold-out data: 0.01052046474069357
Epoch: 56
Loss on hold-out set: 0.00010071848488510831
MeanAbsoluteError value on hold-out data: 0.00957986619323492
Epoch: 57
Loss on hold-out set: 9.516562041474237e-05
MeanAbsoluteError value on hold-out data: 0.00932864286005497
Epoch: 58
Loss on hold-out set: 0.00011357630654330071
MeanAbsoluteError value on hold-out data: 0.010238168761134148
Epoch: 59
Loss on hold-out set: 0.00010929922217129435
MeanAbsoluteError value on hold-out data: 0.010005238465964794
Epoch: 60
Loss on hold-out set: 0.00010737692383899182
MeanAbsoluteError value on hold-out data: 0.009958397597074509
Epoch: 61
Loss on hold-out set: 0.00010631915115242776
MeanAbsoluteError value on hold-out data: 0.009856188669800758
Epoch: 62
Loss on hold-out set: 9.502199205407554e-05
MeanAbsoluteError value on hold-out data: 0.009323123842477798
Epoch: 63
Loss on hold-out set: 0.0001002498046498084
MeanAbsoluteError value on hold-out data: 0.00957266055047512
Epoch: 64
Loss on hold-out set: 0.00010231812551577797
MeanAbsoluteError value on hold-out data: 0.009712635539472103
Epoch: 65
Loss on hold-out set: 9.557273781530584e-05
MeanAbsoluteError value on hold-out data: 0.009327363222837448
Epoch: 66
Loss on hold-out set: 9.347362854321928e-05
MeanAbsoluteError value on hold-out data: 0.009235553443431854
Epoch: 67
Loss on hold-out set: 0.00010116429793446227
MeanAbsoluteError value on hold-out data: 0.009625276550650597
Epoch: 68
Loss on hold-out set: 0.00010431601358026168
MeanAbsoluteError value on hold-out data: 0.00979119073599577
Epoch: 69
Loss on hold-out set: 0.00010134131116501521
MeanAbsoluteError value on hold-out data: 0.009604018181562424
Epoch: 70
Loss on hold-out set: 0.00011010525897865209
MeanAbsoluteError value on hold-out data: 0.010047021321952343
Epoch: 71
Loss on hold-out set: 9.36783739904824e-05
MeanAbsoluteError value on hold-out data: 0.009187495335936546
Epoch: 72
Loss on hold-out set: 8.723660108731373e-05
MeanAbsoluteError value on hold-out data: 0.008927902206778526
Epoch: 73
Loss on hold-out set: 9.223128788442792e-05
MeanAbsoluteError value on hold-out data: 0.009121505543589592
Epoch: 74
Loss on hold-out set: 8.311297049084188e-05
MeanAbsoluteError value on hold-out data: 0.008666143752634525
Epoch: 75
Loss on hold-out set: 9.175860137283483e-05
MeanAbsoluteError value on hold-out data: 0.009099003858864307
Epoch: 76
Loss on hold-out set: 8.03495244518241e-05
MeanAbsoluteError value on hold-out data: 0.00856576394289732
Epoch: 77
Loss on hold-out set: 7.674384745003313e-05
MeanAbsoluteError value on hold-out data: 0.008280002512037754
Epoch: 78
Loss on hold-out set: 7.53594844067457e-05
MeanAbsoluteError value on hold-out data: 0.008219776675105095
Epoch: 79
Loss on hold-out set: 9.538629417779463e-05
MeanAbsoluteError value on hold-out data: 0.009303203783929348
Epoch: 80
Loss on hold-out set: 7.712373333465381e-05
MeanAbsoluteError value on hold-out data: 0.008271431550383568
Epoch: 81
Loss on hold-out set: 6.585955806689239e-05
MeanAbsoluteError value on hold-out data: 0.007634073030203581
Epoch: 82
Loss on hold-out set: 7.774428750532312e-05
MeanAbsoluteError value on hold-out data: 0.008350214920938015
Epoch: 83
Loss on hold-out set: 8.220834627680138e-05
MeanAbsoluteError value on hold-out data: 0.008564355783164501
Epoch: 84
Loss on hold-out set: 7.671466406272405e-05
MeanAbsoluteError value on hold-out data: 0.008300849236547947
Epoch: 85
Loss on hold-out set: 8.767702705594466e-05
MeanAbsoluteError value on hold-out data: 0.008866304531693459
Epoch: 86
Loss on hold-out set: 7.67096127291504e-05
MeanAbsoluteError value on hold-out data: 0.008271090686321259
Epoch: 87
Loss on hold-out set: 8.273595468429113e-05
MeanAbsoluteError value on hold-out data: 0.00859504658728838
Early stopping at epoch 86
Returned to Spot: Validation loss: 8.273595468429113e-05
----------------------------------------------
spotPython tuning: 9.907191347816766e-06 [##########] 100.00% Done...
<spotPython.spot.spot.Spot at 0x15282a9e0>

18.13 Tensorboard

The textual output shown in the console (or code cell) can be visualized with Tensorboard as described in Section 13.13.

18.14 Results

After the hyperparameter tuning run is finished, the results can be analyzed as described in Section 13.14.

spot_tuner.plot_progress(log_y=False,
    filename="./figures/" + experiment_name+"_progress.png")

Progress plot. Black dots denote results from the initial design. Red dots illustrate the improvement found by the surrogate model based optimization.
print(gen_design_table(fun_control=fun_control, spot=spot_tuner))
| name         | type   | default   |   lower |   upper |              tuned | transform             |   importance | stars   |
|--------------|--------|-----------|---------|---------|--------------------|-----------------------|--------------|---------|
| _L_in        | int    | 10        |    10.0 |    10.0 |               10.0 | None                  |         0.00 |         |
| _L_out       | int    | 1         |     1.0 |     1.0 |                1.0 | None                  |         0.00 |         |
| l1           | int    | 3         |     3.0 |     8.0 |                5.0 | transform_power_2_int |        21.81 | *       |
| dropout_prob | float  | 0.01      |     0.0 |     0.9 |                0.0 | None                  |        13.65 | *       |
| lr_mult      | float  | 1.0       |     0.1 |    10.0 |  9.991076489740422 | None                  |         0.00 |         |
| batch_size   | int    | 4         |     1.0 |     4.0 |                3.0 | transform_power_2_int |       100.00 | ***     |
| epochs       | int    | 4         |     2.0 |    16.0 |                9.0 | transform_power_2_int |        62.14 | **      |
| k_folds      | int    | 1         |     1.0 |     1.0 |                1.0 | None                  |         0.00 |         |
| patience     | int    | 2         |     3.0 |     7.0 |                6.0 | transform_power_2_int |         0.02 |         |
| optimizer    | factor | SGD       |     0.0 |     6.0 |                2.0 | None                  |         0.01 |         |
| sgd_momentum | float  | 0.0       |     0.0 |     1.0 | 0.9366082179588401 | None                  |         9.15 | *       |
spot_tuner.plot_importance(threshold=0.025,
    filename="./figures/" + experiment_name+"_importance.png")

Variable importance plot, threshold 0.025.

18.15 Get the Tuned Architecture (SPOT Results)

from spotPython.hyperparameters.values import get_one_core_model_from_X
X = spot_tuner.to_all_dim(spot_tuner.min_X.reshape(1,-1))
model_spot = get_one_core_model_from_X(X, fun_control)
model_spot
Net_lin_reg(
  (fc1): Linear(in_features=10, out_features=32, bias=True)
  (fc2): Linear(in_features=32, out_features=16, bias=True)
  (fc3): Linear(in_features=16, out_features=1, bias=True)
  (relu): ReLU()
  (softmax): Softmax(dim=1)
  (dropout1): Dropout(p=0.0, inplace=False)
  (dropout2): Dropout(p=0.0, inplace=False)
)

18.16 Evaluation of the Tuned Architecture

from spotPython.torch.traintest import (
    train_tuned,
    test_tuned,
    )
train_tuned(net=model_spot, train_dataset=train,
        loss_function=fun_control["loss_function"],
        metric=fun_control["metric_torch"],
        shuffle=True,
        device = fun_control["device"],
        path=None,
        task=fun_control["task"],)
Epoch: 1
Loss on hold-out set: 0.019651484173281414
MeanAbsoluteError value on hold-out data: 0.11023375391960144
Epoch: 2
Loss on hold-out set: 0.013567663018444651
MeanAbsoluteError value on hold-out data: 0.09294840693473816
Epoch: 3
Loss on hold-out set: 0.006556109473182771
MeanAbsoluteError value on hold-out data: 0.064596027135849
Epoch: 4
Loss on hold-out set: 0.00232995196711272
MeanAbsoluteError value on hold-out data: 0.03854019194841385
Epoch: 5
Loss on hold-out set: 0.0007837395276414769
MeanAbsoluteError value on hold-out data: 0.022327417507767677
Epoch: 6
Loss on hold-out set: 9.740777185422638e-05
MeanAbsoluteError value on hold-out data: 0.007378413807600737
Epoch: 7
Loss on hold-out set: 2.4558303628533683e-05
MeanAbsoluteError value on hold-out data: 0.002470357110723853
Epoch: 8
Loss on hold-out set: 2.123528185237726e-05
MeanAbsoluteError value on hold-out data: 0.0028405198827385902
Epoch: 9
Loss on hold-out set: 3.0918195869545394e-05
MeanAbsoluteError value on hold-out data: 0.004441232420504093
Epoch: 10
Loss on hold-out set: 2.809521959677927e-05
MeanAbsoluteError value on hold-out data: 0.004590923432260752
Epoch: 11
Loss on hold-out set: 1.2222404716579293e-05
MeanAbsoluteError value on hold-out data: 0.0022355380933731794
Epoch: 12
Loss on hold-out set: 8.328451131271658e-06
MeanAbsoluteError value on hold-out data: 0.0014498698292300105
Epoch: 13
Loss on hold-out set: 1.7357653034291854e-05
MeanAbsoluteError value on hold-out data: 0.0034674564376473427
Epoch: 14
Loss on hold-out set: 1.4929677861705146e-05
MeanAbsoluteError value on hold-out data: 0.0030309422872960567
Epoch: 15
Loss on hold-out set: 5.875462300172043e-06
MeanAbsoluteError value on hold-out data: 0.001264595310203731
Epoch: 16
Loss on hold-out set: 6.336297716595589e-06
MeanAbsoluteError value on hold-out data: 0.0014574035303667188
Epoch: 17
Loss on hold-out set: 6.1977445263413466e-06
MeanAbsoluteError value on hold-out data: 0.0015831191558390856
Epoch: 18
Loss on hold-out set: 4.634538386557994e-06
MeanAbsoluteError value on hold-out data: 0.001117709674872458
Epoch: 19
Loss on hold-out set: 4.8221497524393365e-06
MeanAbsoluteError value on hold-out data: 0.0013179925736039877
Epoch: 20
Loss on hold-out set: 8.356937829184493e-06
MeanAbsoluteError value on hold-out data: 0.0020699130836874247
Epoch: 21
Loss on hold-out set: 7.65159808523956e-06
MeanAbsoluteError value on hold-out data: 0.002194889821112156
Epoch: 22
Loss on hold-out set: 8.515825665031834e-06
MeanAbsoluteError value on hold-out data: 0.0021290313452482224
Epoch: 23
Loss on hold-out set: 7.960466315413023e-06
MeanAbsoluteError value on hold-out data: 0.002306105801835656
Epoch: 24
Loss on hold-out set: 4.909170009544764e-06
MeanAbsoluteError value on hold-out data: 0.0015436948742717505
Epoch: 25
Loss on hold-out set: 8.110041293500552e-06
MeanAbsoluteError value on hold-out data: 0.0024183469358831644
Epoch: 26
Loss on hold-out set: 2.3833424548731847e-05
MeanAbsoluteError value on hold-out data: 0.0046961321495473385
Epoch: 27
Loss on hold-out set: 1.5887664966086096e-05
MeanAbsoluteError value on hold-out data: 0.0037197612691670656
Epoch: 28
Loss on hold-out set: 1.0097543496924213e-05
MeanAbsoluteError value on hold-out data: 0.002758638933300972
Epoch: 29
Loss on hold-out set: 3.3762056815296668e-06
MeanAbsoluteError value on hold-out data: 0.001197422039695084
Epoch: 30
Loss on hold-out set: 4.448835092692829e-06
MeanAbsoluteError value on hold-out data: 0.0015802241396158934
Epoch: 31
Loss on hold-out set: 3.051495045120215e-05
MeanAbsoluteError value on hold-out data: 0.005324693862348795
Epoch: 32
Loss on hold-out set: 1.2667845088512159e-05
MeanAbsoluteError value on hold-out data: 0.0032031338196247816
Epoch: 33
Loss on hold-out set: 3.919117957414193e-06
MeanAbsoluteError value on hold-out data: 0.0013291360810399055
Epoch: 34
Loss on hold-out set: 5.032390677833494e-06
MeanAbsoluteError value on hold-out data: 0.0016986047849059105
Epoch: 35
Loss on hold-out set: 3.925852162841406e-06
MeanAbsoluteError value on hold-out data: 0.0014282965566962957
Epoch: 36
Loss on hold-out set: 1.3087081482042681e-05
MeanAbsoluteError value on hold-out data: 0.003203839063644409
Epoch: 37
Loss on hold-out set: 2.3881052464658798e-05
MeanAbsoluteError value on hold-out data: 0.004462566692382097
Epoch: 38
Loss on hold-out set: 3.754409581353301e-06
MeanAbsoluteError value on hold-out data: 0.0014755346346646547
Epoch: 39
Loss on hold-out set: 3.7041836264961603e-06
MeanAbsoluteError value on hold-out data: 0.0013993509346619248
Epoch: 40
Loss on hold-out set: 1.0523476835020885e-05
MeanAbsoluteError value on hold-out data: 0.002696853829547763
Epoch: 41
Loss on hold-out set: 2.8206976199534867e-05
MeanAbsoluteError value on hold-out data: 0.005095171742141247
Epoch: 42
Loss on hold-out set: 3.545905184634385e-06
MeanAbsoluteError value on hold-out data: 0.0013024647487327456
Epoch: 43
Loss on hold-out set: 3.8920703553613795e-06
MeanAbsoluteError value on hold-out data: 0.0014704137574881315
Epoch: 44
Loss on hold-out set: 2.5582523640447396e-05
MeanAbsoluteError value on hold-out data: 0.004919031634926796
Epoch: 45
Loss on hold-out set: 0.00014241896745883614
MeanAbsoluteError value on hold-out data: 0.011739874258637428
Epoch: 46
Loss on hold-out set: 9.84958981127037e-05
MeanAbsoluteError value on hold-out data: 0.00968820322304964
Epoch: 47
Loss on hold-out set: 1.4907471806605157e-05
MeanAbsoluteError value on hold-out data: 0.002979717683047056
Epoch: 48
Loss on hold-out set: 5.9439600746420755e-06
MeanAbsoluteError value on hold-out data: 0.0018260793294757605
Epoch: 49
Loss on hold-out set: 1.6538060447744913e-05
MeanAbsoluteError value on hold-out data: 0.0036427322775125504
Epoch: 50
Loss on hold-out set: 4.447258932391139e-06
MeanAbsoluteError value on hold-out data: 0.001646639546379447
Epoch: 51
Loss on hold-out set: 0.00014228895413811857
MeanAbsoluteError value on hold-out data: 0.011730419471859932
Epoch: 52
Loss on hold-out set: 4.441464165881227e-05
MeanAbsoluteError value on hold-out data: 0.006411413662135601
Epoch: 53
Loss on hold-out set: 3.7021713859231615e-06
MeanAbsoluteError value on hold-out data: 0.0014502403791993856
Epoch: 54
Loss on hold-out set: 1.930013118716919e-05
MeanAbsoluteError value on hold-out data: 0.003697904059663415
Epoch: 55
Loss on hold-out set: 5.207566841578993e-05
MeanAbsoluteError value on hold-out data: 0.00706461351364851
Epoch: 56
Loss on hold-out set: 3.074935672262463e-05
MeanAbsoluteError value on hold-out data: 0.0053037493489682674
Epoch: 57
Loss on hold-out set: 0.00017216790691140647
MeanAbsoluteError value on hold-out data: 0.012582535855472088
Epoch: 58
Loss on hold-out set: 9.897472371353375e-05
MeanAbsoluteError value on hold-out data: 0.00977624487131834
Epoch: 59
Loss on hold-out set: 1.810899026933935e-05
MeanAbsoluteError value on hold-out data: 0.003874598303809762
Epoch: 60
Loss on hold-out set: 0.0001118766677360614
MeanAbsoluteError value on hold-out data: 0.009878503158688545
Epoch: 61
Loss on hold-out set: 9.116921043977e-06
MeanAbsoluteError value on hold-out data: 0.0024547409266233444
Epoch: 62
Loss on hold-out set: 0.0002889215841270542
MeanAbsoluteError value on hold-out data: 0.016860472038388252
Epoch: 63
Loss on hold-out set: 0.00032589671900495887
MeanAbsoluteError value on hold-out data: 0.01782466657459736
Epoch: 64
Loss on hold-out set: 7.859206207764433e-05
MeanAbsoluteError value on hold-out data: 0.008536180481314659
Epoch: 65
Loss on hold-out set: 4.091880744358365e-05
MeanAbsoluteError value on hold-out data: 0.005866121035069227
Epoch: 66
Loss on hold-out set: 7.435616623153787e-05
MeanAbsoluteError value on hold-out data: 0.008227535523474216
Epoch: 67
Loss on hold-out set: 1.4737102949431191e-05
MeanAbsoluteError value on hold-out data: 0.003390905447304249
Epoch: 68
Loss on hold-out set: 1.0470896732409815e-05
MeanAbsoluteError value on hold-out data: 0.002928338944911957
Epoch: 69
Loss on hold-out set: 3.3742061364855066e-06
MeanAbsoluteError value on hold-out data: 0.0014495487557724118
Epoch: 70
Loss on hold-out set: 3.0746001958672615e-06
MeanAbsoluteError value on hold-out data: 0.001339194132015109
Epoch: 71
Loss on hold-out set: 2.70541499958199e-06
MeanAbsoluteError value on hold-out data: 0.0012872912921011448
Epoch: 72
Loss on hold-out set: 2.706746229071206e-06
MeanAbsoluteError value on hold-out data: 0.0012912965612486005
Epoch: 73
Loss on hold-out set: 0.00028563695071314116
MeanAbsoluteError value on hold-out data: 0.01673833280801773
Epoch: 74
Loss on hold-out set: 2.454958786601262e-05
MeanAbsoluteError value on hold-out data: 0.004493703134357929
Epoch: 75
Loss on hold-out set: 5.4627199412942373e-05
MeanAbsoluteError value on hold-out data: 0.007197813130915165
Epoch: 76
Loss on hold-out set: 5.283277316362058e-06
MeanAbsoluteError value on hold-out data: 0.0017945595318451524
Epoch: 77
Loss on hold-out set: 0.00015982837449930804
MeanAbsoluteError value on hold-out data: 0.012504537589848042
Epoch: 78
Loss on hold-out set: 1.6098081759034693e-05
MeanAbsoluteError value on hold-out data: 0.003651278791949153
Epoch: 79
Loss on hold-out set: 2.2403702671095072e-05
MeanAbsoluteError value on hold-out data: 0.004176016431301832
Epoch: 80
Loss on hold-out set: 0.0009510403783918408
MeanAbsoluteError value on hold-out data: 0.030191166326403618
Epoch: 81
Loss on hold-out set: 6.206938862880251e-05
MeanAbsoluteError value on hold-out data: 0.006969857960939407
Epoch: 82
Loss on hold-out set: 3.330804448571718e-05
MeanAbsoluteError value on hold-out data: 0.005502993706613779
Epoch: 83
Loss on hold-out set: 7.157509823005775e-06
MeanAbsoluteError value on hold-out data: 0.0023479450028389692
Epoch: 84
Loss on hold-out set: 1.878601367659365e-06
MeanAbsoluteError value on hold-out data: 0.0009661439107730985
Epoch: 85
Loss on hold-out set: 1.7822448976283722e-06
MeanAbsoluteError value on hold-out data: 0.0009330214816145599
Epoch: 86
Loss on hold-out set: 3.456576685398192e-05
MeanAbsoluteError value on hold-out data: 0.005656104534864426
Epoch: 87
Loss on hold-out set: 8.474182658047587e-05
MeanAbsoluteError value on hold-out data: 0.008628890849649906
Epoch: 88
Loss on hold-out set: 8.29115963609327e-06
MeanAbsoluteError value on hold-out data: 0.0024887234903872013
Epoch: 89
Loss on hold-out set: 1.9122236491329514e-06
MeanAbsoluteError value on hold-out data: 0.0010411754483357072
Epoch: 90
Loss on hold-out set: 4.5798413339070976e-05
MeanAbsoluteError value on hold-out data: 0.006630503572523594
Epoch: 91
Loss on hold-out set: 2.349254634138656e-05
MeanAbsoluteError value on hold-out data: 0.004612828139215708
Epoch: 92
Loss on hold-out set: 2.7370730666270423e-06
MeanAbsoluteError value on hold-out data: 0.0012490934459492564
Epoch: 93
Loss on hold-out set: 5.110965275889612e-06
MeanAbsoluteError value on hold-out data: 0.001969433855265379
Epoch: 94
Loss on hold-out set: 1.5144544122629094e-06
MeanAbsoluteError value on hold-out data: 0.0008952416246756911
Epoch: 95
Loss on hold-out set: 3.8623969837652494e-05
MeanAbsoluteError value on hold-out data: 0.005309021566063166
Epoch: 96
Loss on hold-out set: 9.861539106886515e-05
MeanAbsoluteError value on hold-out data: 0.009530075825750828
Epoch: 97
Loss on hold-out set: 1.536649018649577e-05
MeanAbsoluteError value on hold-out data: 0.0032677839044481516
Epoch: 98
Loss on hold-out set: 2.1415820260460206e-05
MeanAbsoluteError value on hold-out data: 0.004407363012433052
Epoch: 99
Loss on hold-out set: 1.2838153464288457e-05
MeanAbsoluteError value on hold-out data: 0.0029254627879709005
Epoch: 100
Loss on hold-out set: 5.7048103324057975e-05
MeanAbsoluteError value on hold-out data: 0.0069040474481880665
Epoch: 101
Loss on hold-out set: 0.00042615298757721717
MeanAbsoluteError value on hold-out data: 0.019999247044324875
Epoch: 102
Loss on hold-out set: 2.0496584714859828e-05
MeanAbsoluteError value on hold-out data: 0.0036168836522847414
Epoch: 103
Loss on hold-out set: 9.734865996410678e-05
MeanAbsoluteError value on hold-out data: 0.00945985596626997
Epoch: 104
Loss on hold-out set: 3.967310036793941e-06
MeanAbsoluteError value on hold-out data: 0.00158857018686831
Epoch: 105
Loss on hold-out set: 7.334948900518755e-06
MeanAbsoluteError value on hold-out data: 0.0024566869251430035
Epoch: 106
Loss on hold-out set: 1.8906821352222897e-05
MeanAbsoluteError value on hold-out data: 0.004138257820159197
Epoch: 107
Loss on hold-out set: 6.447508392164692e-06
MeanAbsoluteError value on hold-out data: 0.002258013002574444
Epoch: 108
Loss on hold-out set: 2.469922594777448e-06
MeanAbsoluteError value on hold-out data: 0.0012028992641717196
Epoch: 109
Loss on hold-out set: 1.455031761416218e-06
MeanAbsoluteError value on hold-out data: 0.0008801401709206402
Epoch: 110
Loss on hold-out set: 3.268710459355804e-06
MeanAbsoluteError value on hold-out data: 0.001491977134719491
Epoch: 111
Loss on hold-out set: 1.4042625210956765e-06
MeanAbsoluteError value on hold-out data: 0.0008495230576954782
Epoch: 112
Loss on hold-out set: 1.131202300616439e-05
MeanAbsoluteError value on hold-out data: 0.0031731014605611563
Epoch: 113
Loss on hold-out set: 4.772949371032921e-06
MeanAbsoluteError value on hold-out data: 0.001704307389445603
Epoch: 114
Loss on hold-out set: 1.3801934175573574e-05
MeanAbsoluteError value on hold-out data: 0.002965350868180394
Epoch: 115
Loss on hold-out set: 0.00019425246979440808
MeanAbsoluteError value on hold-out data: 0.013771322555840015
Epoch: 116
Loss on hold-out set: 0.0001557624273118563
MeanAbsoluteError value on hold-out data: 0.01171713974326849
Epoch: 117
Loss on hold-out set: 0.00017490305158150333
MeanAbsoluteError value on hold-out data: 0.013030605390667915
Epoch: 118
Loss on hold-out set: 7.019755068875766e-06
MeanAbsoluteError value on hold-out data: 0.002304777503013611
Epoch: 119
Loss on hold-out set: 2.1824457354868126e-05
MeanAbsoluteError value on hold-out data: 0.004294505342841148
Epoch: 120
Loss on hold-out set: 1.1455041766040316e-05
MeanAbsoluteError value on hold-out data: 0.003109630197286606
Epoch: 121
Loss on hold-out set: 2.5745345616793488e-06
MeanAbsoluteError value on hold-out data: 0.0011947896564379334
Epoch: 122
Loss on hold-out set: 1.0904087467248533e-05
MeanAbsoluteError value on hold-out data: 0.003135007107630372
Epoch: 123
Loss on hold-out set: 2.5565527287677755e-06
MeanAbsoluteError value on hold-out data: 0.0012282761745154858
Epoch: 124
Loss on hold-out set: 9.427938996515494e-06
MeanAbsoluteError value on hold-out data: 0.002674116985872388
Epoch: 125
Loss on hold-out set: 7.977010185593253e-06
MeanAbsoluteError value on hold-out data: 0.0024383023846894503
Epoch: 126
Loss on hold-out set: 3.784196847714396e-06
MeanAbsoluteError value on hold-out data: 0.0015871953219175339
Epoch: 127
Loss on hold-out set: 0.00019540899972382344
MeanAbsoluteError value on hold-out data: 0.01376862172037363
Epoch: 128
Loss on hold-out set: 3.26869265719372e-05
MeanAbsoluteError value on hold-out data: 0.0055062794126570225
Epoch: 129
Loss on hold-out set: 0.00010915778396960569
MeanAbsoluteError value on hold-out data: 0.010208613239228725
Epoch: 130
Loss on hold-out set: 0.00015052655936941797
MeanAbsoluteError value on hold-out data: 0.012084237299859524
Epoch: 131
Loss on hold-out set: 5.339039815130251e-05
MeanAbsoluteError value on hold-out data: 0.006801879499107599
Epoch: 132
Loss on hold-out set: 6.4412089805524665e-06
MeanAbsoluteError value on hold-out data: 0.0021241523791104555
Epoch: 133
Loss on hold-out set: 2.0787281323165236e-06
MeanAbsoluteError value on hold-out data: 0.0010414280695840716
Epoch: 134
Loss on hold-out set: 1.6307263585328034e-06
MeanAbsoluteError value on hold-out data: 0.0009227027767337859
Epoch: 135
Loss on hold-out set: 2.2479220230084856e-05
MeanAbsoluteError value on hold-out data: 0.004270059987902641
Epoch: 136
Loss on hold-out set: 4.735296339743543e-06
MeanAbsoluteError value on hold-out data: 0.0017407933482900262
Epoch: 137
Loss on hold-out set: 5.415234711922255e-06
MeanAbsoluteError value on hold-out data: 0.0020643924362957478
Epoch: 138
Loss on hold-out set: 5.1506516492257727e-05
MeanAbsoluteError value on hold-out data: 0.006960009690374136
Epoch: 139
Loss on hold-out set: 1.3472575634104464e-05
MeanAbsoluteError value on hold-out data: 0.003326418111100793
Epoch: 140
Loss on hold-out set: 2.5377121346537024e-05
MeanAbsoluteError value on hold-out data: 0.00490744411945343
Epoch: 141
Loss on hold-out set: 3.852066770617201e-05
MeanAbsoluteError value on hold-out data: 0.006013630889356136
Epoch: 142
Loss on hold-out set: 0.00012451510089081958
MeanAbsoluteError value on hold-out data: 0.010709214024245739
Epoch: 143
Loss on hold-out set: 6.930225254109246e-06
MeanAbsoluteError value on hold-out data: 0.0020968737080693245
Epoch: 144
Loss on hold-out set: 6.330447937024904e-05
MeanAbsoluteError value on hold-out data: 0.007781287655234337
Epoch: 145
Loss on hold-out set: 5.670005275772526e-06
MeanAbsoluteError value on hold-out data: 0.002079866360872984
Epoch: 146
Loss on hold-out set: 1.1769649254825995e-05
MeanAbsoluteError value on hold-out data: 0.0031919865868985653
Epoch: 147
Loss on hold-out set: 1.08772046467876e-05
MeanAbsoluteError value on hold-out data: 0.003057145746424794
Epoch: 148
Loss on hold-out set: 3.574191774341192e-05
MeanAbsoluteError value on hold-out data: 0.005010912194848061
Epoch: 149
Loss on hold-out set: 8.695985417561085e-05
MeanAbsoluteError value on hold-out data: 0.007427242584526539
Epoch: 150
Loss on hold-out set: 1.9816909463387627e-05
MeanAbsoluteError value on hold-out data: 0.0035913153551518917
Epoch: 151
Loss on hold-out set: 5.748183770935468e-06
MeanAbsoluteError value on hold-out data: 0.0019052120624110103
Epoch: 152
Loss on hold-out set: 9.250397983793702e-06
MeanAbsoluteError value on hold-out data: 0.0028211819007992744
Epoch: 153
Loss on hold-out set: 1.3671137331153946e-05
MeanAbsoluteError value on hold-out data: 0.003454832127317786
Epoch: 154
Loss on hold-out set: 2.69002280399371e-06
MeanAbsoluteError value on hold-out data: 0.0012754591880366206
Epoch: 155
Loss on hold-out set: 9.482821125953036e-06
MeanAbsoluteError value on hold-out data: 0.0027725256513804197
Epoch: 156
Loss on hold-out set: 7.75745382653488e-06
MeanAbsoluteError value on hold-out data: 0.002515543019399047
Epoch: 157
Loss on hold-out set: 1.3063092042461664e-06
MeanAbsoluteError value on hold-out data: 0.0008238679147325456
Epoch: 158
Loss on hold-out set: 4.971821142948772e-06
MeanAbsoluteError value on hold-out data: 0.001998242689296603
Epoch: 159
Loss on hold-out set: 7.747793298269818e-05
MeanAbsoluteError value on hold-out data: 0.008587805554270744
Epoch: 160
Loss on hold-out set: 5.739294860368797e-06
MeanAbsoluteError value on hold-out data: 0.0020033728796988726
Epoch: 161
Loss on hold-out set: 1.1502965423316805e-05
MeanAbsoluteError value on hold-out data: 0.003159566316753626
Epoch: 162
Loss on hold-out set: 2.5063140990249322e-05
MeanAbsoluteError value on hold-out data: 0.00485498970374465
Epoch: 163
Loss on hold-out set: 1.8636480526287126e-06
MeanAbsoluteError value on hold-out data: 0.0010343400062993169
Epoch: 164
Loss on hold-out set: 3.069458734061252e-06
MeanAbsoluteError value on hold-out data: 0.001405205111950636
Epoch: 165
Loss on hold-out set: 2.0995624667145754e-06
MeanAbsoluteError value on hold-out data: 0.001059317379258573
Epoch: 166
Loss on hold-out set: 4.660664237420813e-06
MeanAbsoluteError value on hold-out data: 0.001718036481179297
Epoch: 167
Loss on hold-out set: 2.1484799114994914e-06
MeanAbsoluteError value on hold-out data: 0.0011410322040319443
Epoch: 168
Loss on hold-out set: 4.998800508665705e-05
MeanAbsoluteError value on hold-out data: 0.006669075693935156
Epoch: 169
Loss on hold-out set: 1.5507518606969633e-05
MeanAbsoluteError value on hold-out data: 0.0037004081532359123
Epoch: 170
Loss on hold-out set: 2.7990425893987874e-05
MeanAbsoluteError value on hold-out data: 0.004890676122158766
Epoch: 171
Loss on hold-out set: 1.8585415522178855e-05
MeanAbsoluteError value on hold-out data: 0.004117037635296583
Epoch: 172
Loss on hold-out set: 3.7176424101696616e-05
MeanAbsoluteError value on hold-out data: 0.0058794948272407055
Epoch: 173
Loss on hold-out set: 1.6570867824396517e-05
MeanAbsoluteError value on hold-out data: 0.0037137786857783794
Epoch: 174
Loss on hold-out set: 6.054304740724834e-06
MeanAbsoluteError value on hold-out data: 0.002137604635208845
Epoch: 175
Loss on hold-out set: 2.0773226915001656e-06
MeanAbsoluteError value on hold-out data: 0.0011104870354756713
Epoch: 176
Loss on hold-out set: 0.0001319291372247359
MeanAbsoluteError value on hold-out data: 0.01128348521888256
Epoch: 177
Loss on hold-out set: 5.080576934951272e-05
MeanAbsoluteError value on hold-out data: 0.006532269064337015
Epoch: 178
Loss on hold-out set: 2.9947305506539124e-06
MeanAbsoluteError value on hold-out data: 0.001373924664221704
Epoch: 179
Loss on hold-out set: 1.5962490459443008e-05
MeanAbsoluteError value on hold-out data: 0.0035741606261581182
Epoch: 180
Loss on hold-out set: 6.387036215097683e-06
MeanAbsoluteError value on hold-out data: 0.002228670986369252
Epoch: 181
Loss on hold-out set: 6.501431054953412e-05
MeanAbsoluteError value on hold-out data: 0.00787130557000637
Epoch: 182
Loss on hold-out set: 6.417960886258362e-05
MeanAbsoluteError value on hold-out data: 0.007711126934736967
Epoch: 183
Loss on hold-out set: 5.645474034640517e-06
MeanAbsoluteError value on hold-out data: 0.0019008730305358768
Epoch: 184
Loss on hold-out set: 0.00011760149285883496
MeanAbsoluteError value on hold-out data: 0.010649997740983963
Epoch: 185
Loss on hold-out set: 7.155650648296853e-06
MeanAbsoluteError value on hold-out data: 0.002405773615464568
Epoch: 186
Loss on hold-out set: 1.5697968843883963e-06
MeanAbsoluteError value on hold-out data: 0.0009316625073552132
Epoch: 187
Loss on hold-out set: 1.797025045166983e-06
MeanAbsoluteError value on hold-out data: 0.0010702979052439332
Epoch: 188
Loss on hold-out set: 3.395319460028795e-05
MeanAbsoluteError value on hold-out data: 0.005275218281894922
Epoch: 189
Loss on hold-out set: 0.0007948650286140802
MeanAbsoluteError value on hold-out data: 0.027724899351596832
Epoch: 190
Loss on hold-out set: 2.0695618188351784e-05
MeanAbsoluteError value on hold-out data: 0.004048416391015053
Epoch: 191
Loss on hold-out set: 3.4423982757097725e-05
MeanAbsoluteError value on hold-out data: 0.005616921931505203
Epoch: 192
Loss on hold-out set: 6.965379599789326e-06
MeanAbsoluteError value on hold-out data: 0.0021805947180837393
Epoch: 193
Loss on hold-out set: 3.7328380663462953e-06
MeanAbsoluteError value on hold-out data: 0.0015616279561072588
Epoch: 194
Loss on hold-out set: 1.463992646222323e-06
MeanAbsoluteError value on hold-out data: 0.000906852656044066
Epoch: 195
Loss on hold-out set: 1.7642870931778913e-05
MeanAbsoluteError value on hold-out data: 0.004039790015667677
Epoch: 196
Loss on hold-out set: 7.217661722710258e-05
MeanAbsoluteError value on hold-out data: 0.008391817100346088
Epoch: 197
Loss on hold-out set: 2.9661925306132424e-06
MeanAbsoluteError value on hold-out data: 0.0013605598360300064
Epoch: 198
Loss on hold-out set: 3.684757757582702e-05
MeanAbsoluteError value on hold-out data: 0.005530443508177996
Epoch: 199
Loss on hold-out set: 0.00011088500277286297
MeanAbsoluteError value on hold-out data: 0.01039163675159216
Epoch: 200
Loss on hold-out set: 9.822916737041515e-06
MeanAbsoluteError value on hold-out data: 0.00252639502286911
Epoch: 201
Loss on hold-out set: 2.9691569388409046e-05
MeanAbsoluteError value on hold-out data: 0.004675738979130983
Epoch: 202
Loss on hold-out set: 4.486845969758609e-05
MeanAbsoluteError value on hold-out data: 0.00646878220140934
Epoch: 203
Loss on hold-out set: 1.8321224449604607e-06
MeanAbsoluteError value on hold-out data: 0.0010393450502306223
Epoch: 204
Loss on hold-out set: 6.072961397014871e-06
MeanAbsoluteError value on hold-out data: 0.002183555392548442
Epoch: 205
Loss on hold-out set: 5.23949159909726e-05
MeanAbsoluteError value on hold-out data: 0.0071148802526295185
Epoch: 206
Loss on hold-out set: 1.6986374057045107e-05
MeanAbsoluteError value on hold-out data: 0.0038916226476430893
Epoch: 207
Loss on hold-out set: 2.8007639756603902e-05
MeanAbsoluteError value on hold-out data: 0.005126688629388809
Epoch: 208
Loss on hold-out set: 1.8378129438863317e-06
MeanAbsoluteError value on hold-out data: 0.001041435869410634
Epoch: 209
Loss on hold-out set: 1.9285242461221154e-06
MeanAbsoluteError value on hold-out data: 0.0010731262154877186
Epoch: 210
Loss on hold-out set: 2.0072824416896957e-06
MeanAbsoluteError value on hold-out data: 0.0011314651928842068
Epoch: 211
Loss on hold-out set: 6.053891405300467e-06
MeanAbsoluteError value on hold-out data: 0.0021965722553431988
Epoch: 212
Loss on hold-out set: 5.475268494592456e-06
MeanAbsoluteError value on hold-out data: 0.0018517037387937307
Epoch: 213
Loss on hold-out set: 1.3592608512992324e-05
MeanAbsoluteError value on hold-out data: 0.0029516832437366247
Epoch: 214
Loss on hold-out set: 0.00033030641421455105
MeanAbsoluteError value on hold-out data: 0.01803991198539734
Epoch: 215
Loss on hold-out set: 0.000107399557141195
MeanAbsoluteError value on hold-out data: 0.009974547661840916
Epoch: 216
Loss on hold-out set: 1.4687609300859836e-05
MeanAbsoluteError value on hold-out data: 0.0035630830097943544
Epoch: 217
Loss on hold-out set: 3.2255423359641245e-06
MeanAbsoluteError value on hold-out data: 0.0013802042230963707
Epoch: 218
Loss on hold-out set: 7.493094831021919e-06
MeanAbsoluteError value on hold-out data: 0.002515283413231373
Epoch: 219
Loss on hold-out set: 1.056583635928339e-05
MeanAbsoluteError value on hold-out data: 0.003013680223375559
Epoch: 220
Loss on hold-out set: 1.711887360120033e-05
MeanAbsoluteError value on hold-out data: 0.003956168424338102
Epoch: 221
Loss on hold-out set: 2.2720183695032336e-05
MeanAbsoluteError value on hold-out data: 0.004351167008280754
Early stopping at epoch 220
Returned to Spot: Validation loss: 2.2720183695032336e-05
----------------------------------------------

If path is set to a filename, e.g., path = "model_spot_trained.pt", the weights of the trained model will be loaded from this file.

test_tuned(net=model_spot, test_dataset=test,
            shuffle=False,
            loss_function=fun_control["loss_function"],
            metric=fun_control["metric_torch"],
            device = fun_control["device"],
            task=fun_control["task"],)
Loss on hold-out set: 2.459835815216138e-05
MeanAbsoluteError value on hold-out data: 0.00449945917353034
Final evaluation: Validation loss: 2.459835815216138e-05
Final evaluation: Validation metric: 0.00449945917353034
----------------------------------------------
(2.459835815216138e-05, nan, tensor(0.0045))

18.17 Cross-validated Evaluations

  • This is the evaluation that will be used in the comparison (evaluatecv has to be updated before, to get metric vlaues!):
from spotPython.torch.traintest import evaluate_cv
# modify k-kolds:
setattr(model_spot, "k_folds",  10)
df_eval, df_preds, df_metrics = evaluate_cv(net=model_spot,
            dataset=fun_control["data"],
            loss_function=fun_control["loss_function"],
            metric=fun_control["metric_torch"],
            task=fun_control["task"],
            writer=fun_control["writer"],
            writerId="model_spot_cv",
            device = fun_control["device"])
Fold: 1
Epoch: 1
Loss on hold-out set: 0.02065299401203027
MeanAbsoluteError value on hold-out data: 0.11512971669435501
Epoch: 2
Loss on hold-out set: 0.01234287775766391
MeanAbsoluteError value on hold-out data: 0.09301143884658813
Epoch: 3
Loss on hold-out set: 0.005254059815062926
MeanAbsoluteError value on hold-out data: 0.06027333438396454
Epoch: 4
Loss on hold-out set: 0.0014413250475906981
MeanAbsoluteError value on hold-out data: 0.030940959230065346
Epoch: 5
Loss on hold-out set: 0.00018456904497445346
MeanAbsoluteError value on hold-out data: 0.011003231629729271
Epoch: 6
Loss on hold-out set: 1.4162756682568355e-05
MeanAbsoluteError value on hold-out data: 0.00325019215233624
Epoch: 7
Loss on hold-out set: 1.7997439971832837e-06
MeanAbsoluteError value on hold-out data: 0.0011448994046077132
Epoch: 8
Loss on hold-out set: 7.15069868070154e-07
MeanAbsoluteError value on hold-out data: 0.0006763696437701583
Epoch: 9
Loss on hold-out set: 6.912887077812859e-07
MeanAbsoluteError value on hold-out data: 0.0006624010275118053
Epoch: 10
Loss on hold-out set: 1.8018160359973151e-06
MeanAbsoluteError value on hold-out data: 0.0011509788455441594
Epoch: 11
Loss on hold-out set: 6.815204122071568e-07
MeanAbsoluteError value on hold-out data: 0.0006706601125188172
Epoch: 12
Loss on hold-out set: 1.560867343204546e-06
MeanAbsoluteError value on hold-out data: 0.0010274335509166121
Epoch: 13
Loss on hold-out set: 6.602264739705369e-07
MeanAbsoluteError value on hold-out data: 0.0006646370748057961
Epoch: 14
Loss on hold-out set: 1.353155804158982e-06
MeanAbsoluteError value on hold-out data: 0.0009613469010218978
Epoch: 15
Loss on hold-out set: 8.789862726224293e-07
MeanAbsoluteError value on hold-out data: 0.0007612446206621826
Epoch: 16
Loss on hold-out set: 7.158344426618266e-07
MeanAbsoluteError value on hold-out data: 0.0006953209522180259
Epoch: 17
Loss on hold-out set: 9.818222482548522e-07
MeanAbsoluteError value on hold-out data: 0.0008096828823909163
Epoch: 18
Loss on hold-out set: 6.377569959043355e-06
MeanAbsoluteError value on hold-out data: 0.002368643181398511
Epoch: 19
Loss on hold-out set: 9.858042412466043e-07
MeanAbsoluteError value on hold-out data: 0.0007976934430189431
Epoch: 20
Loss on hold-out set: 1.0655909735445534e-06
MeanAbsoluteError value on hold-out data: 0.0008358174818567932
Epoch: 21
Loss on hold-out set: 1.8571672626421787e-06
MeanAbsoluteError value on hold-out data: 0.0011154928943142295
Epoch: 22
Loss on hold-out set: 2.146033239114331e-06
MeanAbsoluteError value on hold-out data: 0.001201446633785963
Epoch: 23
Loss on hold-out set: 1.1533942741747383e-06
MeanAbsoluteError value on hold-out data: 0.000844193680677563
Epoch: 24
Loss on hold-out set: 2.210573619812259e-06
MeanAbsoluteError value on hold-out data: 0.001183437998406589
Epoch: 25
Loss on hold-out set: 3.932325669736131e-06
MeanAbsoluteError value on hold-out data: 0.0016974711325019598
Epoch: 26
Loss on hold-out set: 9.87455653627806e-06
MeanAbsoluteError value on hold-out data: 0.0026042007375508547
Epoch: 27
Loss on hold-out set: 3.312643667203911e-05
MeanAbsoluteError value on hold-out data: 0.005582431331276894
Epoch: 28
Loss on hold-out set: 1.233923106051057e-06
MeanAbsoluteError value on hold-out data: 0.0008433118346147239
Epoch: 29
Loss on hold-out set: 8.843244498935886e-06
MeanAbsoluteError value on hold-out data: 0.0026882216334342957
Epoch: 30
Loss on hold-out set: 9.190874012487116e-06
MeanAbsoluteError value on hold-out data: 0.0027512283995747566
Epoch: 31
Loss on hold-out set: 3.973932465529427e-05
MeanAbsoluteError value on hold-out data: 0.006092244293540716
Epoch: 32
Loss on hold-out set: 6.0972258115026096e-05
MeanAbsoluteError value on hold-out data: 0.007428175304085016
Epoch: 33
Loss on hold-out set: 1.3217210633998688e-06
MeanAbsoluteError value on hold-out data: 0.0009502813336439431
Epoch: 34
Loss on hold-out set: 4.911513315164484e-05
MeanAbsoluteError value on hold-out data: 0.006698485463857651
Epoch: 35
Loss on hold-out set: 5.5349037561077585e-06
MeanAbsoluteError value on hold-out data: 0.0020685577765107155
Epoch: 36
Loss on hold-out set: 1.1827799566022944e-05
MeanAbsoluteError value on hold-out data: 0.003337341593578458
Epoch: 37
Loss on hold-out set: 5.81071558721865e-05
MeanAbsoluteError value on hold-out data: 0.006790547166019678
Epoch: 38
Loss on hold-out set: 4.0002654014432875e-05
MeanAbsoluteError value on hold-out data: 0.006145922467112541
Epoch: 39
Loss on hold-out set: 0.0002553447254915507
MeanAbsoluteError value on hold-out data: 0.015639424324035645
Epoch: 40
Loss on hold-out set: 0.00018463422803996273
MeanAbsoluteError value on hold-out data: 0.013228870928287506
Epoch: 41
Loss on hold-out set: 4.253111963127874e-06
MeanAbsoluteError value on hold-out data: 0.0017181751318275928
Epoch: 42
Loss on hold-out set: 1.4464753453816788e-06
MeanAbsoluteError value on hold-out data: 0.0009673589374870062
Epoch: 43
Loss on hold-out set: 1.732693747796405e-05
MeanAbsoluteError value on hold-out data: 0.004018240608274937
Epoch: 44
Loss on hold-out set: 1.0715090481356197e-05
MeanAbsoluteError value on hold-out data: 0.0029248257633298635
Epoch: 45
Loss on hold-out set: 1.8776007681691015e-05
MeanAbsoluteError value on hold-out data: 0.004113689996302128
Epoch: 46
Loss on hold-out set: 0.00019220163588985227
MeanAbsoluteError value on hold-out data: 0.013361041434109211
Epoch: 47
Loss on hold-out set: 4.079405992412761e-05
MeanAbsoluteError value on hold-out data: 0.00590872997418046
Epoch: 48
Loss on hold-out set: 0.00014912494561240936
MeanAbsoluteError value on hold-out data: 0.011904698796570301
Epoch: 49
Loss on hold-out set: 1.710793307770823e-05
MeanAbsoluteError value on hold-out data: 0.003868703730404377
Epoch: 50
Loss on hold-out set: 3.86927730197875e-05
MeanAbsoluteError value on hold-out data: 0.006052255630493164
Epoch: 51
Loss on hold-out set: 3.3547859787246966e-06
MeanAbsoluteError value on hold-out data: 0.0015182152856141329
Epoch: 52
Loss on hold-out set: 1.5403153296434677e-05
MeanAbsoluteError value on hold-out data: 0.0036258413456380367
Epoch: 53
Loss on hold-out set: 1.814586189888919e-05
MeanAbsoluteError value on hold-out data: 0.003401524620130658
Epoch: 54
Loss on hold-out set: 2.0688913047286824e-05
MeanAbsoluteError value on hold-out data: 0.004386305809020996
Epoch: 55
Loss on hold-out set: 2.7290915166024488e-06
MeanAbsoluteError value on hold-out data: 0.00145645288284868
Epoch: 56
Loss on hold-out set: 0.00012927473849581124
MeanAbsoluteError value on hold-out data: 0.011039652861654758
Epoch: 57
Loss on hold-out set: 3.4560933779805336e-06
MeanAbsoluteError value on hold-out data: 0.0015811070334166288
Epoch: 58
Loss on hold-out set: 4.3678022428558994e-05
MeanAbsoluteError value on hold-out data: 0.006514048669487238
Epoch: 59
Loss on hold-out set: 3.220579660242388e-05
MeanAbsoluteError value on hold-out data: 0.005443612113595009
Epoch: 60
Loss on hold-out set: 9.82652745033892e-06
MeanAbsoluteError value on hold-out data: 0.0029796757735311985
Epoch: 61
Loss on hold-out set: 9.333057592952033e-06
MeanAbsoluteError value on hold-out data: 0.0025042309425771236
Epoch: 62
Loss on hold-out set: 8.009108744143025e-06
MeanAbsoluteError value on hold-out data: 0.0025124922394752502
Epoch: 63
Loss on hold-out set: 5.726036009106722e-06
MeanAbsoluteError value on hold-out data: 0.0022030326072126627
Epoch: 64
Loss on hold-out set: 1.61631781408617e-05
MeanAbsoluteError value on hold-out data: 0.0033084540627896786
Epoch: 65
Loss on hold-out set: 2.9614447647383295e-05
MeanAbsoluteError value on hold-out data: 0.004735034424811602
Epoch: 66
Loss on hold-out set: 2.2129431027469063e-06
MeanAbsoluteError value on hold-out data: 0.0011461719404906034
Epoch: 67
Loss on hold-out set: 1.1971248988209902e-05
MeanAbsoluteError value on hold-out data: 0.0033153570257127285
Epoch: 68
Loss on hold-out set: 4.600444942927705e-05
MeanAbsoluteError value on hold-out data: 0.00671636825427413
Epoch: 69
Loss on hold-out set: 5.8927025887756965e-05
MeanAbsoluteError value on hold-out data: 0.007255886681377888
Epoch: 70
Loss on hold-out set: 1.3833383674794347e-06
MeanAbsoluteError value on hold-out data: 0.0009378155809827149
Epoch: 71
Loss on hold-out set: 1.3002540435116737e-06
MeanAbsoluteError value on hold-out data: 0.0009255501790903509
Epoch: 72
Loss on hold-out set: 4.122609761207759e-05
MeanAbsoluteError value on hold-out data: 0.006125122308731079
Epoch: 73
Loss on hold-out set: 6.67230555196651e-05
MeanAbsoluteError value on hold-out data: 0.007930259220302105
Epoch: 74
Loss on hold-out set: 1.5361589738369312e-05
MeanAbsoluteError value on hold-out data: 0.0033631515689194202
Epoch: 75
Loss on hold-out set: 2.6840917668708313e-05
MeanAbsoluteError value on hold-out data: 0.004469124600291252
Epoch: 76
Loss on hold-out set: 1.3685109824844124e-06
MeanAbsoluteError value on hold-out data: 0.0009398108813911676
Epoch: 77
Loss on hold-out set: 9.50263239036968e-06
MeanAbsoluteError value on hold-out data: 0.002941798884421587
Early stopping at epoch 76
Fold: 2
Epoch: 1
Loss on hold-out set: 0.01127390182003952
MeanAbsoluteError value on hold-out data: 0.08612485229969025
Epoch: 2
Loss on hold-out set: 0.0014762248969278657
MeanAbsoluteError value on hold-out data: 0.03340683877468109
Epoch: 3
Loss on hold-out set: 7.576417802878356e-07
MeanAbsoluteError value on hold-out data: 0.0006999062024988234
Epoch: 4
Loss on hold-out set: 1.1853010864097787e-06
MeanAbsoluteError value on hold-out data: 0.0008943213615566492
Epoch: 5
Loss on hold-out set: 6.428478798170545e-07
MeanAbsoluteError value on hold-out data: 0.0006422384176403284
Epoch: 6
Loss on hold-out set: 2.235060033119505e-06
MeanAbsoluteError value on hold-out data: 0.001205002423375845
Epoch: 7
Loss on hold-out set: 3.235693585478517e-06
MeanAbsoluteError value on hold-out data: 0.0015731042949482799
Epoch: 8
Loss on hold-out set: 8.743510744142651e-07
MeanAbsoluteError value on hold-out data: 0.0007714438252151012
Epoch: 9
Loss on hold-out set: 6.217736556051862e-07
MeanAbsoluteError value on hold-out data: 0.0006288423901423812
Epoch: 10
Loss on hold-out set: 1.4255844707104889e-06
MeanAbsoluteError value on hold-out data: 0.0009727907017804682
Epoch: 11
Loss on hold-out set: 6.737447130525163e-06
MeanAbsoluteError value on hold-out data: 0.0023843462113291025
Epoch: 12
Loss on hold-out set: 2.4121497622567963e-06
MeanAbsoluteError value on hold-out data: 0.0013534208992496133
Epoch: 13
Loss on hold-out set: 1.214290224337534e-06
MeanAbsoluteError value on hold-out data: 0.0008789473795332015
Epoch: 14
Loss on hold-out set: 7.931792494603612e-07
MeanAbsoluteError value on hold-out data: 0.0007303489837795496
Epoch: 15
Loss on hold-out set: 9.131181100813662e-07
MeanAbsoluteError value on hold-out data: 0.0007679539849050343
Epoch: 16
Loss on hold-out set: 3.1640803661922782e-06
MeanAbsoluteError value on hold-out data: 0.0015537056606262922
Epoch: 17
Loss on hold-out set: 2.5056575448336216e-06
MeanAbsoluteError value on hold-out data: 0.001329269609414041
Epoch: 18
Loss on hold-out set: 7.629061116176672e-07
MeanAbsoluteError value on hold-out data: 0.000685228849761188
Epoch: 19
Loss on hold-out set: 4.919607415733761e-06
MeanAbsoluteError value on hold-out data: 0.0020050338935106993
Epoch: 20
Loss on hold-out set: 5.9553418535730225e-06
MeanAbsoluteError value on hold-out data: 0.00222999625839293
Epoch: 21
Loss on hold-out set: 2.220990626693282e-06
MeanAbsoluteError value on hold-out data: 0.0012478397693485022
Epoch: 22
Loss on hold-out set: 1.6696348027905444e-06
MeanAbsoluteError value on hold-out data: 0.0010666699381545186
Epoch: 23
Loss on hold-out set: 1.2577635691111656e-05
MeanAbsoluteError value on hold-out data: 0.0033463004510849714
Epoch: 24
Loss on hold-out set: 2.1474177069299352e-05
MeanAbsoluteError value on hold-out data: 0.00434035575017333
Epoch: 25
Loss on hold-out set: 1.15375769732614e-05
MeanAbsoluteError value on hold-out data: 0.00312831811606884
Epoch: 26
Loss on hold-out set: 3.4215367332553096e-06
MeanAbsoluteError value on hold-out data: 0.0016017460729926825
Epoch: 27
Loss on hold-out set: 2.0330387411167276e-06
MeanAbsoluteError value on hold-out data: 0.0011678622104227543
Epoch: 28
Loss on hold-out set: 1.8638938198679311e-06
MeanAbsoluteError value on hold-out data: 0.0011019327212125063
Epoch: 29
Loss on hold-out set: 5.123689278172186e-05
MeanAbsoluteError value on hold-out data: 0.006924115587025881
Epoch: 30
Loss on hold-out set: 6.818817505168577e-06
MeanAbsoluteError value on hold-out data: 0.0022713749203830957
Epoch: 31
Loss on hold-out set: 8.487540596364011e-06
MeanAbsoluteError value on hold-out data: 0.0025640910025686026
Epoch: 32
Loss on hold-out set: 3.211172938440891e-05
MeanAbsoluteError value on hold-out data: 0.00535967480391264
Epoch: 33
Loss on hold-out set: 0.00018343371854056246
MeanAbsoluteError value on hold-out data: 0.012876234948635101
Epoch: 34
Loss on hold-out set: 1.8452908184721869e-06
MeanAbsoluteError value on hold-out data: 0.0011395658366382122
Epoch: 35
Loss on hold-out set: 9.43175403405733e-06
MeanAbsoluteError value on hold-out data: 0.0028748721815645695
Epoch: 36
Loss on hold-out set: 2.5507101991724296e-05
MeanAbsoluteError value on hold-out data: 0.004859269130975008
Epoch: 37
Loss on hold-out set: 2.721744408518134e-06
MeanAbsoluteError value on hold-out data: 0.0014335039304569364
Epoch: 38
Loss on hold-out set: 1.9587032511481084e-05
MeanAbsoluteError value on hold-out data: 0.004222211427986622
Epoch: 39
Loss on hold-out set: 0.0003492153594449449
MeanAbsoluteError value on hold-out data: 0.018093613907694817
Epoch: 40
Loss on hold-out set: 2.0050391421696427e-06
MeanAbsoluteError value on hold-out data: 0.0012290376471355557
Epoch: 41
Loss on hold-out set: 8.105718244713409e-06
MeanAbsoluteError value on hold-out data: 0.0026713197585195303
Epoch: 42
Loss on hold-out set: 2.5525859690298184e-05
MeanAbsoluteError value on hold-out data: 0.004681686870753765
Epoch: 43
Loss on hold-out set: 4.4677291253510004e-05
MeanAbsoluteError value on hold-out data: 0.006427832879126072
Epoch: 44
Loss on hold-out set: 1.1015344577677192e-06
MeanAbsoluteError value on hold-out data: 0.0008229162776842713
Epoch: 45
Loss on hold-out set: 2.140914463010491e-06
MeanAbsoluteError value on hold-out data: 0.0011728758690878749
Epoch: 46
Loss on hold-out set: 3.883136348402051e-06
MeanAbsoluteError value on hold-out data: 0.0015472460072487593
Epoch: 47
Loss on hold-out set: 5.9356072877282995e-06
MeanAbsoluteError value on hold-out data: 0.0022302204743027687
Epoch: 48
Loss on hold-out set: 7.022134293667757e-05
MeanAbsoluteError value on hold-out data: 0.008307510055601597
Epoch: 49
Loss on hold-out set: 1.0795543438199764e-05
MeanAbsoluteError value on hold-out data: 0.0026537582743912935
Epoch: 50
Loss on hold-out set: 1.1424797391485368e-05
MeanAbsoluteError value on hold-out data: 0.0029710037633776665
Epoch: 51
Loss on hold-out set: 4.320933332844736e-06
MeanAbsoluteError value on hold-out data: 0.0018091020174324512
Epoch: 52
Loss on hold-out set: 6.946433743975761e-06
MeanAbsoluteError value on hold-out data: 0.002308137249201536
Epoch: 53
Loss on hold-out set: 1.8644557223104548e-05
MeanAbsoluteError value on hold-out data: 0.004135419614613056
Epoch: 54
Loss on hold-out set: 4.874755422161587e-06
MeanAbsoluteError value on hold-out data: 0.0019816397689282894
Epoch: 55
Loss on hold-out set: 3.3262962320944866e-06
MeanAbsoluteError value on hold-out data: 0.0016084484523162246
Epoch: 56
Loss on hold-out set: 3.5584382308465697e-06
MeanAbsoluteError value on hold-out data: 0.0016246421728283167
Epoch: 57
Loss on hold-out set: 9.828060963347805e-06
MeanAbsoluteError value on hold-out data: 0.002925629960373044
Epoch: 58
Loss on hold-out set: 3.768507163980618e-05
MeanAbsoluteError value on hold-out data: 0.0054155816324055195
Epoch: 59
Loss on hold-out set: 3.6309115085504554e-06
MeanAbsoluteError value on hold-out data: 0.0016275065718218684
Epoch: 60
Loss on hold-out set: 4.663701334860749e-05
MeanAbsoluteError value on hold-out data: 0.006598527543246746
Epoch: 61
Loss on hold-out set: 3.606480277085211e-05
MeanAbsoluteError value on hold-out data: 0.005533924791961908
Epoch: 62
Loss on hold-out set: 3.235682190559321e-06
MeanAbsoluteError value on hold-out data: 0.001539055723696947
Epoch: 63
Loss on hold-out set: 1.4325182466843846e-05
MeanAbsoluteError value on hold-out data: 0.003588000312447548
Epoch: 64
Loss on hold-out set: 1.4605596823877511e-05
MeanAbsoluteError value on hold-out data: 0.0034903555642813444
Epoch: 65
Loss on hold-out set: 2.519304145537787e-06
MeanAbsoluteError value on hold-out data: 0.0013320703292265534
Epoch: 66
Loss on hold-out set: 3.3759264222401098e-06
MeanAbsoluteError value on hold-out data: 0.0014613675884902477
Epoch: 67
Loss on hold-out set: 1.3113621351889237e-06
MeanAbsoluteError value on hold-out data: 0.0009220902575179935
Epoch: 68
Loss on hold-out set: 5.031596139395753e-05
MeanAbsoluteError value on hold-out data: 0.006931868847459555
Epoch: 69
Loss on hold-out set: 4.121343819791106e-06
MeanAbsoluteError value on hold-out data: 0.0017893563490360975
Epoch: 70
Loss on hold-out set: 3.3374018445241604e-06
MeanAbsoluteError value on hold-out data: 0.0015589484246447682
Epoch: 71
Loss on hold-out set: 4.6111990216629165e-06
MeanAbsoluteError value on hold-out data: 0.001761218998581171
Epoch: 72
Loss on hold-out set: 1.6054740696675322e-05
MeanAbsoluteError value on hold-out data: 0.0037652619648724794
Epoch: 73
Loss on hold-out set: 5.160148178289931e-05
MeanAbsoluteError value on hold-out data: 0.00695548951625824
Early stopping at epoch 72
Fold: 3
Epoch: 1
Loss on hold-out set: 0.008427240652963519
MeanAbsoluteError value on hold-out data: 0.07616186141967773
Epoch: 2
Loss on hold-out set: 0.003167695500171528
MeanAbsoluteError value on hold-out data: 0.04719529673457146
Epoch: 3
Loss on hold-out set: 1.2266539827648488e-05
MeanAbsoluteError value on hold-out data: 0.0022129241842776537
Epoch: 4
Loss on hold-out set: 2.2966964304662095e-05
MeanAbsoluteError value on hold-out data: 0.00460561690852046
Epoch: 5
Loss on hold-out set: 5.90137765007407e-06
MeanAbsoluteError value on hold-out data: 0.0021997166331857443
Epoch: 6
Loss on hold-out set: 1.4398753478417348e-06
MeanAbsoluteError value on hold-out data: 0.0009370704647153616
Epoch: 7
Loss on hold-out set: 1.9850687329800658e-06
MeanAbsoluteError value on hold-out data: 0.0011979646515101194
Epoch: 8
Loss on hold-out set: 8.476971144178746e-07
MeanAbsoluteError value on hold-out data: 0.0007534505566582084
Epoch: 9
Loss on hold-out set: 1.7933851644067124e-06
MeanAbsoluteError value on hold-out data: 0.0011100542033091187
Epoch: 10
Loss on hold-out set: 1.0983250327001315e-06
MeanAbsoluteError value on hold-out data: 0.0008356116595678031
Epoch: 11
Loss on hold-out set: 8.584201334717643e-07
MeanAbsoluteError value on hold-out data: 0.0007556197233498096
Epoch: 12
Loss on hold-out set: 8.763469299293109e-07
MeanAbsoluteError value on hold-out data: 0.0007772435201331973
Epoch: 13
Loss on hold-out set: 3.228336446717059e-06
MeanAbsoluteError value on hold-out data: 0.0016226287698373199
Epoch: 14
Loss on hold-out set: 5.445052868078794e-06
MeanAbsoluteError value on hold-out data: 0.0021723543759435415
Epoch: 15
Loss on hold-out set: 1.5390835458744662e-06
MeanAbsoluteError value on hold-out data: 0.0009805416921153665
Epoch: 16
Loss on hold-out set: 3.1799072268348446e-06
MeanAbsoluteError value on hold-out data: 0.001556043280288577
Epoch: 17
Loss on hold-out set: 1.8462023376741854e-06
MeanAbsoluteError value on hold-out data: 0.001151437172666192
Epoch: 18
Loss on hold-out set: 6.7169227210027975e-06
MeanAbsoluteError value on hold-out data: 0.0022744564339518547
Epoch: 19
Loss on hold-out set: 7.952297074517936e-07
MeanAbsoluteError value on hold-out data: 0.0007519500213675201
Epoch: 20
Loss on hold-out set: 1.1003260300850134e-06
MeanAbsoluteError value on hold-out data: 0.0008439593948423862
Epoch: 21
Loss on hold-out set: 2.7647785495551384e-06
MeanAbsoluteError value on hold-out data: 0.0014149303315207362
Epoch: 22
Loss on hold-out set: 1.7085418142834476e-06
MeanAbsoluteError value on hold-out data: 0.0011134372325614095
Epoch: 23
Loss on hold-out set: 2.8739612197079205e-06
MeanAbsoluteError value on hold-out data: 0.0014418592909350991
Epoch: 24
Loss on hold-out set: 4.8362435336457565e-06
MeanAbsoluteError value on hold-out data: 0.0019407722866162658
Epoch: 25
Loss on hold-out set: 1.0467380959128674e-05
MeanAbsoluteError value on hold-out data: 0.002972603542730212
Epoch: 26
Loss on hold-out set: 2.731616619327654e-06
MeanAbsoluteError value on hold-out data: 0.0013272555079311132
Epoch: 27
Loss on hold-out set: 1.4200730333868705e-06
MeanAbsoluteError value on hold-out data: 0.0009763310081325471
Epoch: 28
Loss on hold-out set: 4.61640846739241e-06
MeanAbsoluteError value on hold-out data: 0.0019041805062443018
Epoch: 29
Loss on hold-out set: 1.3953121337041151e-05
MeanAbsoluteError value on hold-out data: 0.0034542938228696585
Epoch: 30
Loss on hold-out set: 2.4486275343896032e-05
MeanAbsoluteError value on hold-out data: 0.004587761126458645
Epoch: 31
Loss on hold-out set: 1.092255832610625e-05
MeanAbsoluteError value on hold-out data: 0.0026133963838219643
Epoch: 32
Loss on hold-out set: 1.1023155890982778e-06
MeanAbsoluteError value on hold-out data: 0.0008711083792150021
Epoch: 33
Loss on hold-out set: 3.814932516923783e-05
MeanAbsoluteError value on hold-out data: 0.005942244548350573
Epoch: 34
Loss on hold-out set: 1.8612787689912343e-06
MeanAbsoluteError value on hold-out data: 0.001128294738009572
Epoch: 35
Loss on hold-out set: 3.395172615665405e-06
MeanAbsoluteError value on hold-out data: 0.001456776401028037
Epoch: 36
Loss on hold-out set: 9.56576363145919e-07
MeanAbsoluteError value on hold-out data: 0.0008004768169485033
Epoch: 37
Loss on hold-out set: 2.4858188016178945e-05
MeanAbsoluteError value on hold-out data: 0.004660305567085743
Epoch: 38
Loss on hold-out set: 0.00016526954893309338
MeanAbsoluteError value on hold-out data: 0.012210705317556858
Epoch: 39
Loss on hold-out set: 5.152542913632575e-06
MeanAbsoluteError value on hold-out data: 0.0018455919343978167
Epoch: 40
Loss on hold-out set: 2.6156911128684724e-06
MeanAbsoluteError value on hold-out data: 0.0013575832126662135
Epoch: 41
Loss on hold-out set: 1.8224579977098842e-06
MeanAbsoluteError value on hold-out data: 0.001051876344718039
Epoch: 42
Loss on hold-out set: 1.786286252179427e-06
MeanAbsoluteError value on hold-out data: 0.0010641149710863829
Epoch: 43
Loss on hold-out set: 5.481743406002911e-05
MeanAbsoluteError value on hold-out data: 0.0067292628809809685
Epoch: 44
Loss on hold-out set: 0.0001506358071660193
MeanAbsoluteError value on hold-out data: 0.012096970342099667
Epoch: 45
Loss on hold-out set: 4.299788298130107e-05
MeanAbsoluteError value on hold-out data: 0.006238063797354698
Epoch: 46
Loss on hold-out set: 1.0256808265624456e-06
MeanAbsoluteError value on hold-out data: 0.0008563686278648674
Epoch: 47
Loss on hold-out set: 1.2078145542860652e-06
MeanAbsoluteError value on hold-out data: 0.000865844136569649
Epoch: 48
Loss on hold-out set: 1.5945695657557315e-06
MeanAbsoluteError value on hold-out data: 0.0009989242535084486
Epoch: 49
Loss on hold-out set: 1.3750182775905929e-05
MeanAbsoluteError value on hold-out data: 0.0035429156851023436
Epoch: 50
Loss on hold-out set: 2.2351551916262208e-05
MeanAbsoluteError value on hold-out data: 0.004190615378320217
Epoch: 51
Loss on hold-out set: 6.5548176910222255e-06
MeanAbsoluteError value on hold-out data: 0.002354451920837164
Epoch: 52
Loss on hold-out set: 0.0005028736329852388
MeanAbsoluteError value on hold-out data: 0.02199261635541916
Epoch: 53
Loss on hold-out set: 5.798422535008285e-06
MeanAbsoluteError value on hold-out data: 0.0021753946784883738
Epoch: 54
Loss on hold-out set: 1.9211692465257957e-06
MeanAbsoluteError value on hold-out data: 0.0010813053231686354
Epoch: 55
Loss on hold-out set: 1.134823854114914e-05
MeanAbsoluteError value on hold-out data: 0.0032010055147111416
Epoch: 56
Loss on hold-out set: 5.013182817492634e-05
MeanAbsoluteError value on hold-out data: 0.006910228636115789
Epoch: 57
Loss on hold-out set: 1.0618425641531268e-05
MeanAbsoluteError value on hold-out data: 0.0029913189355283976
Epoch: 58
Loss on hold-out set: 4.479792579121959e-05
MeanAbsoluteError value on hold-out data: 0.005955494474619627
Epoch: 59
Loss on hold-out set: 4.6077246644507304e-06
MeanAbsoluteError value on hold-out data: 0.0018728758441284299
Epoch: 60
Loss on hold-out set: 2.3248124180624404e-06
MeanAbsoluteError value on hold-out data: 0.0012537686852738261
Epoch: 61
Loss on hold-out set: 1.1601964755615112e-05
MeanAbsoluteError value on hold-out data: 0.0032334360294044018
Epoch: 62
Loss on hold-out set: 5.453885128540255e-06
MeanAbsoluteError value on hold-out data: 0.0020547499880194664
Epoch: 63
Loss on hold-out set: 1.4969786696803147e-05
MeanAbsoluteError value on hold-out data: 0.0035926068667322397
Epoch: 64
Loss on hold-out set: 2.2090036439364598e-05
MeanAbsoluteError value on hold-out data: 0.004330947529524565
Epoch: 65
Loss on hold-out set: 4.343684542198809e-05
MeanAbsoluteError value on hold-out data: 0.006434979382902384
Epoch: 66
Loss on hold-out set: 3.7500817073193434e-06
MeanAbsoluteError value on hold-out data: 0.0016150119481608272
Epoch: 67
Loss on hold-out set: 2.8225415112851456e-06
MeanAbsoluteError value on hold-out data: 0.0013922997750341892
Epoch: 68
Loss on hold-out set: 1.7468105550751016e-06
MeanAbsoluteError value on hold-out data: 0.001105316448956728
Epoch: 69
Loss on hold-out set: 8.335640219369312e-06
MeanAbsoluteError value on hold-out data: 0.0023103300482034683
Epoch: 70
Loss on hold-out set: 1.8630336853675544e-05
MeanAbsoluteError value on hold-out data: 0.004238060675561428
Epoch: 71
Loss on hold-out set: 1.046705593720477e-05
MeanAbsoluteError value on hold-out data: 0.0026795673184096813
Epoch: 72
Loss on hold-out set: 1.0517489219917199e-05
MeanAbsoluteError value on hold-out data: 0.003010275075212121
Epoch: 73
Loss on hold-out set: 2.4041184168219424e-06
MeanAbsoluteError value on hold-out data: 0.001274565584026277
Epoch: 74
Loss on hold-out set: 0.00015139431735196224
MeanAbsoluteError value on hold-out data: 0.011445602402091026
Epoch: 75
Loss on hold-out set: 4.380845754125263e-06
MeanAbsoluteError value on hold-out data: 0.001626294106245041
Epoch: 76
Loss on hold-out set: 8.201202560415437e-06
MeanAbsoluteError value on hold-out data: 0.0026461526285856962
Epoch: 77
Loss on hold-out set: 6.482221071844553e-06
MeanAbsoluteError value on hold-out data: 0.0020264845807105303
Epoch: 78
Loss on hold-out set: 1.3050910778334723e-05
MeanAbsoluteError value on hold-out data: 0.0034937269520014524
Epoch: 79
Loss on hold-out set: 0.0001912505506949786
MeanAbsoluteError value on hold-out data: 0.01369716040790081
Epoch: 80
Loss on hold-out set: 3.0822404124382256e-06
MeanAbsoluteError value on hold-out data: 0.001496282173320651
Epoch: 81
Loss on hold-out set: 4.623295073822821e-06
MeanAbsoluteError value on hold-out data: 0.00181763235013932
Epoch: 82
Loss on hold-out set: 2.5777514495600302e-05
MeanAbsoluteError value on hold-out data: 0.004666619002819061
Epoch: 83
Loss on hold-out set: 2.7256120216197114e-06
MeanAbsoluteError value on hold-out data: 0.0014454034389927983
Early stopping at epoch 82
Fold: 4
Epoch: 1
Loss on hold-out set: 0.004405820867619836
MeanAbsoluteError value on hold-out data: 0.053194236010313034
Epoch: 2
Loss on hold-out set: 4.4476567311973595e-05
MeanAbsoluteError value on hold-out data: 0.005642654839903116
Epoch: 3
Loss on hold-out set: 1.4201732133537566e-06
MeanAbsoluteError value on hold-out data: 0.000914377102162689
Epoch: 4
Loss on hold-out set: 2.4181566861723413e-06
MeanAbsoluteError value on hold-out data: 0.0013138465583324432
Epoch: 5
Loss on hold-out set: 1.2955935609135429e-06
MeanAbsoluteError value on hold-out data: 0.0008723598439246416
Epoch: 6
Loss on hold-out set: 3.365407521344493e-06
MeanAbsoluteError value on hold-out data: 0.001610520645044744
Epoch: 7
Loss on hold-out set: 2.258579430557662e-06
MeanAbsoluteError value on hold-out data: 0.0012739177327603102
Epoch: 8
Loss on hold-out set: 1.308017020234659e-06
MeanAbsoluteError value on hold-out data: 0.000900952669326216
Epoch: 9
Loss on hold-out set: 1.47741193665332e-06
MeanAbsoluteError value on hold-out data: 0.0009359158575534821
Epoch: 10
Loss on hold-out set: 7.3508065095386255e-06
MeanAbsoluteError value on hold-out data: 0.002539712702855468
Epoch: 11
Loss on hold-out set: 9.001788349940817e-07
MeanAbsoluteError value on hold-out data: 0.0007798807346262038
Epoch: 12
Loss on hold-out set: 3.821487964090081e-06
MeanAbsoluteError value on hold-out data: 0.0016875839792191982
Epoch: 13
Loss on hold-out set: 1.3610198769024114e-06
MeanAbsoluteError value on hold-out data: 0.0009244541870430112
Epoch: 14
Loss on hold-out set: 1.0060962057860497e-05
MeanAbsoluteError value on hold-out data: 0.003020885633304715
Epoch: 15
Loss on hold-out set: 3.82137075296039e-06
MeanAbsoluteError value on hold-out data: 0.0017308463575318456
Epoch: 16
Loss on hold-out set: 4.2605414189613206e-05
MeanAbsoluteError value on hold-out data: 0.006422645878046751
Epoch: 17
Loss on hold-out set: 1.1765691983083134e-06
MeanAbsoluteError value on hold-out data: 0.0008989163325168192
Epoch: 18
Loss on hold-out set: 2.806214948892515e-06
MeanAbsoluteError value on hold-out data: 0.0011833570897579193
Epoch: 19
Loss on hold-out set: 8.941130580261904e-06
MeanAbsoluteError value on hold-out data: 0.002748098922893405
Epoch: 20
Loss on hold-out set: 5.354367046423319e-06
MeanAbsoluteError value on hold-out data: 0.001836444833315909
Epoch: 21
Loss on hold-out set: 8.652258097404578e-06
MeanAbsoluteError value on hold-out data: 0.002424228936433792
Epoch: 22
Loss on hold-out set: 2.7152399297847296e-06
MeanAbsoluteError value on hold-out data: 0.0013310823123902082
Epoch: 23
Loss on hold-out set: 7.272670472957543e-06
MeanAbsoluteError value on hold-out data: 0.0021889484487473965
Epoch: 24
Loss on hold-out set: 1.7059599949439312e-06
MeanAbsoluteError value on hold-out data: 0.001029199454933405
Epoch: 25
Loss on hold-out set: 4.100712151109921e-05
MeanAbsoluteError value on hold-out data: 0.005729270167648792
Epoch: 26
Loss on hold-out set: 6.383781632953637e-06
MeanAbsoluteError value on hold-out data: 0.002200684743002057
Epoch: 27
Loss on hold-out set: 2.040617542976319e-06
MeanAbsoluteError value on hold-out data: 0.0011679667513817549
Epoch: 28
Loss on hold-out set: 2.2392220881346686e-05
MeanAbsoluteError value on hold-out data: 0.004492476582527161
Epoch: 29
Loss on hold-out set: 3.556632547175608e-06
MeanAbsoluteError value on hold-out data: 0.0014816868351772428
Epoch: 30
Loss on hold-out set: 0.00045424354119369615
MeanAbsoluteError value on hold-out data: 0.020486216992139816
Epoch: 31
Loss on hold-out set: 7.387300026423942e-05
MeanAbsoluteError value on hold-out data: 0.00793352909386158
Epoch: 32
Loss on hold-out set: 1.8035926683086682e-06
MeanAbsoluteError value on hold-out data: 0.0011184174800291657
Epoch: 33
Loss on hold-out set: 1.3050386677640256e-06
MeanAbsoluteError value on hold-out data: 0.0009247939451597631
Epoch: 34
Loss on hold-out set: 1.5165061890561796e-05
MeanAbsoluteError value on hold-out data: 0.0038262445013970137
Epoch: 35
Loss on hold-out set: 1.3445473086903803e-05
MeanAbsoluteError value on hold-out data: 0.0035687191411852837
Epoch: 36
Loss on hold-out set: 1.938732608463257e-05
MeanAbsoluteError value on hold-out data: 0.004244793206453323
Epoch: 37
Loss on hold-out set: 2.512816941956631e-05
MeanAbsoluteError value on hold-out data: 0.0048678480088710785
Epoch: 38
Loss on hold-out set: 1.6340114388395494e-05
MeanAbsoluteError value on hold-out data: 0.0038293171674013138
Epoch: 39
Loss on hold-out set: 3.7643172618118115e-05
MeanAbsoluteError value on hold-out data: 0.005973367486149073
Epoch: 40
Loss on hold-out set: 9.721226958320654e-06
MeanAbsoluteError value on hold-out data: 0.0027383374981582165
Epoch: 41
Loss on hold-out set: 8.857890413939738e-05
MeanAbsoluteError value on hold-out data: 0.008856125175952911
Epoch: 42
Loss on hold-out set: 8.185951670524306e-05
MeanAbsoluteError value on hold-out data: 0.008231655694544315
Epoch: 43
Loss on hold-out set: 6.849857125136903e-06
MeanAbsoluteError value on hold-out data: 0.002195472829043865
Epoch: 44
Loss on hold-out set: 2.2948200003506477e-06
MeanAbsoluteError value on hold-out data: 0.0011917846277356148
Epoch: 45
Loss on hold-out set: 1.935254308941344e-05
MeanAbsoluteError value on hold-out data: 0.004170581698417664
Epoch: 46
Loss on hold-out set: 3.392947659309497e-06
MeanAbsoluteError value on hold-out data: 0.001471235416829586
Epoch: 47
Loss on hold-out set: 1.5678523385968918e-05
MeanAbsoluteError value on hold-out data: 0.0037473677657544613
Epoch: 48
Loss on hold-out set: 0.00020461128420160653
MeanAbsoluteError value on hold-out data: 0.014066041447222233
Epoch: 49
Loss on hold-out set: 4.974502679453088e-05
MeanAbsoluteError value on hold-out data: 0.00685478188097477
Epoch: 50
Loss on hold-out set: 5.546538257196797e-06
MeanAbsoluteError value on hold-out data: 0.002085608895868063
Epoch: 51
Loss on hold-out set: 1.662021427014574e-05
MeanAbsoluteError value on hold-out data: 0.003777172649279237
Epoch: 52
Loss on hold-out set: 1.5474802274603953e-05
MeanAbsoluteError value on hold-out data: 0.003236998338252306
Epoch: 53
Loss on hold-out set: 1.7994868637917814e-05
MeanAbsoluteError value on hold-out data: 0.004062698222696781
Epoch: 54
Loss on hold-out set: 6.161335393419274e-05
MeanAbsoluteError value on hold-out data: 0.007385244593024254
Epoch: 55
Loss on hold-out set: 7.165359665332989e-06
MeanAbsoluteError value on hold-out data: 0.002362041501328349
Epoch: 56
Loss on hold-out set: 1.080270694641373e-06
MeanAbsoluteError value on hold-out data: 0.0008456206414848566
Epoch: 57
Loss on hold-out set: 6.738458418672403e-06
MeanAbsoluteError value on hold-out data: 0.0022075576707720757
Epoch: 58
Loss on hold-out set: 3.2439730393189864e-05
MeanAbsoluteError value on hold-out data: 0.00537054892629385
Epoch: 59
Loss on hold-out set: 2.5981159366822863e-06
MeanAbsoluteError value on hold-out data: 0.0013465906959027052
Epoch: 60
Loss on hold-out set: 2.8668098803581624e-06
MeanAbsoluteError value on hold-out data: 0.0013944364618510008
Epoch: 61
Loss on hold-out set: 2.944159524094385e-05
MeanAbsoluteError value on hold-out data: 0.005147654563188553
Epoch: 62
Loss on hold-out set: 5.112473218105151e-06
MeanAbsoluteError value on hold-out data: 0.0019939234480261803
Epoch: 63
Loss on hold-out set: 1.7441324346761507e-05
MeanAbsoluteError value on hold-out data: 0.0038086322601884604
Epoch: 64
Loss on hold-out set: 1.2949019387283792e-05
MeanAbsoluteError value on hold-out data: 0.0034588235430419445
Epoch: 65
Loss on hold-out set: 5.821221062573246e-05
MeanAbsoluteError value on hold-out data: 0.007208751514554024
Epoch: 66
Loss on hold-out set: 0.00012638385669561103
MeanAbsoluteError value on hold-out data: 0.01108601689338684
Epoch: 67
Loss on hold-out set: 4.192056149594674e-06
MeanAbsoluteError value on hold-out data: 0.001677743624895811
Epoch: 68
Loss on hold-out set: 1.4010802610405684e-05
MeanAbsoluteError value on hold-out data: 0.0035478537902235985
Epoch: 69
Loss on hold-out set: 1.412283574189552e-06
MeanAbsoluteError value on hold-out data: 0.0010031828423961997
Epoch: 70
Loss on hold-out set: 4.194760776954354e-06
MeanAbsoluteError value on hold-out data: 0.001866218401119113
Epoch: 71
Loss on hold-out set: 1.9433738648681006e-05
MeanAbsoluteError value on hold-out data: 0.004253068473190069
Epoch: 72
Loss on hold-out set: 6.250916283953792e-05
MeanAbsoluteError value on hold-out data: 0.007588212378323078
Epoch: 73
Loss on hold-out set: 7.499783508207586e-06
MeanAbsoluteError value on hold-out data: 0.0023564256262034178
Epoch: 74
Loss on hold-out set: 3.8450486342229014e-06
MeanAbsoluteError value on hold-out data: 0.0016949583077803254
Epoch: 75
Loss on hold-out set: 0.00011543103307933331
MeanAbsoluteError value on hold-out data: 0.010637901723384857
Early stopping at epoch 74
Fold: 5
Epoch: 1
Loss on hold-out set: 0.006001131734452569
MeanAbsoluteError value on hold-out data: 0.06384283304214478
Epoch: 2
Loss on hold-out set: 0.0003722665916519383
MeanAbsoluteError value on hold-out data: 0.015383042395114899
Epoch: 3
Loss on hold-out set: 6.541026725524436e-06
MeanAbsoluteError value on hold-out data: 0.002028643386438489
Epoch: 4
Loss on hold-out set: 1.348332694725776e-06
MeanAbsoluteError value on hold-out data: 0.0008923184941522777
Epoch: 5
Loss on hold-out set: 2.2319972572404367e-06
MeanAbsoluteError value on hold-out data: 0.0011854268377646804
Epoch: 6
Loss on hold-out set: 1.6592578224215406e-06
MeanAbsoluteError value on hold-out data: 0.0010302686132490635
Epoch: 7
Loss on hold-out set: 1.0296787335251934e-06
MeanAbsoluteError value on hold-out data: 0.0008012620965018868
Epoch: 8
Loss on hold-out set: 1.293055720889942e-06
MeanAbsoluteError value on hold-out data: 0.0008525505545549095
Epoch: 9
Loss on hold-out set: 9.80412293162002e-07
MeanAbsoluteError value on hold-out data: 0.000836012652143836
Epoch: 10
Loss on hold-out set: 2.375881640895946e-06
MeanAbsoluteError value on hold-out data: 0.0013498545158654451
Epoch: 11
Loss on hold-out set: 2.1985093081429322e-06
MeanAbsoluteError value on hold-out data: 0.0012619548942893744
Epoch: 12
Loss on hold-out set: 2.5930344323709364e-06
MeanAbsoluteError value on hold-out data: 0.0013657318195328116
Epoch: 13
Loss on hold-out set: 1.4948892044230888e-06
MeanAbsoluteError value on hold-out data: 0.0010588954901322722
Epoch: 14
Loss on hold-out set: 9.200328091852638e-07
MeanAbsoluteError value on hold-out data: 0.0007427853415720165
Epoch: 15
Loss on hold-out set: 1.6007914911579764e-06
MeanAbsoluteError value on hold-out data: 0.0010055601596832275
Epoch: 16
Loss on hold-out set: 2.1656388797125078e-06
MeanAbsoluteError value on hold-out data: 0.0011745721567422152
Epoch: 17
Loss on hold-out set: 1.30290338190137e-06
MeanAbsoluteError value on hold-out data: 0.0008792594308033586
Epoch: 18
Loss on hold-out set: 8.040882798573316e-07
MeanAbsoluteError value on hold-out data: 0.0007467764662578702
Epoch: 19
Loss on hold-out set: 2.724128854389654e-06
MeanAbsoluteError value on hold-out data: 0.0014348633121699095
Epoch: 20
Loss on hold-out set: 1.345509675642321e-06
MeanAbsoluteError value on hold-out data: 0.0009685049881227314
Epoch: 21
Loss on hold-out set: 3.4380968477657566e-06
MeanAbsoluteError value on hold-out data: 0.0016077448381111026
Epoch: 22
Loss on hold-out set: 3.3249701538387362e-06
MeanAbsoluteError value on hold-out data: 0.001463080057874322
Epoch: 23
Loss on hold-out set: 3.976600447248739e-05
MeanAbsoluteError value on hold-out data: 0.006197615060955286
Epoch: 24
Loss on hold-out set: 1.9775248854505034e-06
MeanAbsoluteError value on hold-out data: 0.0010772623354569077
Epoch: 25
Loss on hold-out set: 3.8800596590030745e-06
MeanAbsoluteError value on hold-out data: 0.001713228179141879
Epoch: 26
Loss on hold-out set: 5.292948309523546e-06
MeanAbsoluteError value on hold-out data: 0.0018485672771930695
Epoch: 27
Loss on hold-out set: 3.7857824264182664e-06
MeanAbsoluteError value on hold-out data: 0.0016431179828941822
Epoch: 28
Loss on hold-out set: 7.029906555544585e-06
MeanAbsoluteError value on hold-out data: 0.0022512106224894524
Epoch: 29
Loss on hold-out set: 5.495466386771743e-06
MeanAbsoluteError value on hold-out data: 0.0019336189143359661
Epoch: 30
Loss on hold-out set: 5.7739136256993966e-05
MeanAbsoluteError value on hold-out data: 0.0073361885733902454
Epoch: 31
Loss on hold-out set: 8.231700765183911e-05
MeanAbsoluteError value on hold-out data: 0.008822877891361713
Epoch: 32
Loss on hold-out set: 1.341716037691535e-06
MeanAbsoluteError value on hold-out data: 0.0009441724396310747
Epoch: 33
Loss on hold-out set: 7.165477346951285e-05
MeanAbsoluteError value on hold-out data: 0.00795561820268631
Epoch: 34
Loss on hold-out set: 3.0215475572521636e-06
MeanAbsoluteError value on hold-out data: 0.0014859394868835807
Epoch: 35
Loss on hold-out set: 1.8131728910912687e-05
MeanAbsoluteError value on hold-out data: 0.004018762614578009
Epoch: 36
Loss on hold-out set: 1.0766845522224545e-05
MeanAbsoluteError value on hold-out data: 0.0028978874906897545
Epoch: 37
Loss on hold-out set: 4.287505614159342e-05
MeanAbsoluteError value on hold-out data: 0.006346338428556919
Epoch: 38
Loss on hold-out set: 4.109627315511506e-06
MeanAbsoluteError value on hold-out data: 0.00170323031488806
Epoch: 39
Loss on hold-out set: 9.398830409806508e-05
MeanAbsoluteError value on hold-out data: 0.009449026547372341
Epoch: 40
Loss on hold-out set: 3.6119101983226406e-05
MeanAbsoluteError value on hold-out data: 0.005898256320506334
Epoch: 41
Loss on hold-out set: 6.45274365244684e-05
MeanAbsoluteError value on hold-out data: 0.007838086225092411
Epoch: 42
Loss on hold-out set: 9.307840663006153e-06
MeanAbsoluteError value on hold-out data: 0.0026221401058137417
Epoch: 43
Loss on hold-out set: 4.937892430671826e-06
MeanAbsoluteError value on hold-out data: 0.001740642823278904
Epoch: 44
Loss on hold-out set: 2.317867798550511e-06
MeanAbsoluteError value on hold-out data: 0.0012678219936788082
Epoch: 45
Loss on hold-out set: 4.190472833005725e-06
MeanAbsoluteError value on hold-out data: 0.001626650569960475
Epoch: 46
Loss on hold-out set: 0.0001110213566929675
MeanAbsoluteError value on hold-out data: 0.01029030792415142
Epoch: 47
Loss on hold-out set: 4.17216983455896e-05
MeanAbsoluteError value on hold-out data: 0.006099538411945105
Epoch: 48
Loss on hold-out set: 4.096876278498922e-06
MeanAbsoluteError value on hold-out data: 0.0017735330620780587
Epoch: 49
Loss on hold-out set: 1.2907693845730905e-06
MeanAbsoluteError value on hold-out data: 0.0009007623884826899
Epoch: 50
Loss on hold-out set: 2.4039352725734578e-05
MeanAbsoluteError value on hold-out data: 0.004781715106219053
Epoch: 51
Loss on hold-out set: 5.051791381797207e-06
MeanAbsoluteError value on hold-out data: 0.0017985053127631545
Epoch: 52
Loss on hold-out set: 1.4125412935055256e-05
MeanAbsoluteError value on hold-out data: 0.003244477789849043
Epoch: 53
Loss on hold-out set: 1.1151627124770759e-05
MeanAbsoluteError value on hold-out data: 0.0027771685272455215
Epoch: 54
Loss on hold-out set: 8.284296703865178e-05
MeanAbsoluteError value on hold-out data: 0.008893152698874474
Epoch: 55
Loss on hold-out set: 2.350896649589301e-06
MeanAbsoluteError value on hold-out data: 0.0013080282369628549
Epoch: 56
Loss on hold-out set: 1.6629265631378916e-05
MeanAbsoluteError value on hold-out data: 0.0036457327660173178
Epoch: 57
Loss on hold-out set: 4.1127967996054885e-06
MeanAbsoluteError value on hold-out data: 0.001762112369760871
Epoch: 58
Loss on hold-out set: 9.315170070924349e-06
MeanAbsoluteError value on hold-out data: 0.0028532736469060183
Epoch: 59
Loss on hold-out set: 3.605444248933054e-06
MeanAbsoluteError value on hold-out data: 0.0016110354335978627
Epoch: 60
Loss on hold-out set: 1.61364641826367e-05
MeanAbsoluteError value on hold-out data: 0.0037908919621258974
Epoch: 61
Loss on hold-out set: 6.26941106509968e-06
MeanAbsoluteError value on hold-out data: 0.0020979251712560654
Epoch: 62
Loss on hold-out set: 2.3055268684402108e-05
MeanAbsoluteError value on hold-out data: 0.004629319533705711
Epoch: 63
Loss on hold-out set: 3.407712336831117e-05
MeanAbsoluteError value on hold-out data: 0.005292713176459074
Epoch: 64
Loss on hold-out set: 4.192637307963965e-06
MeanAbsoluteError value on hold-out data: 0.001745450310409069
Epoch: 65
Loss on hold-out set: 5.99069996426876e-06
MeanAbsoluteError value on hold-out data: 0.001922737224958837
Epoch: 66
Loss on hold-out set: 7.568428827653406e-06
MeanAbsoluteError value on hold-out data: 0.002300475724041462
Epoch: 67
Loss on hold-out set: 7.000185919773336e-05
MeanAbsoluteError value on hold-out data: 0.008152686059474945
Epoch: 68
Loss on hold-out set: 7.0123774793710954e-06
MeanAbsoluteError value on hold-out data: 0.002279797801747918
Epoch: 69
Loss on hold-out set: 1.7254260674585216e-06
MeanAbsoluteError value on hold-out data: 0.001010372769087553
Epoch: 70
Loss on hold-out set: 2.219097167163944e-05
MeanAbsoluteError value on hold-out data: 0.004402877297252417
Epoch: 71
Loss on hold-out set: 4.278212670145037e-06
MeanAbsoluteError value on hold-out data: 0.0018227684777230024
Epoch: 72
Loss on hold-out set: 4.55995193358551e-06
MeanAbsoluteError value on hold-out data: 0.0018447005422785878
Epoch: 73
Loss on hold-out set: 1.067451697823484e-05
MeanAbsoluteError value on hold-out data: 0.0027270799037069082
Epoch: 74
Loss on hold-out set: 4.757100563997833e-05
MeanAbsoluteError value on hold-out data: 0.00673792976886034
Epoch: 75
Loss on hold-out set: 6.986360473932179e-06
MeanAbsoluteError value on hold-out data: 0.002314450219273567
Epoch: 76
Loss on hold-out set: 2.865583461733387e-06
MeanAbsoluteError value on hold-out data: 0.0014086938463151455
Epoch: 77
Loss on hold-out set: 1.0722664788213128e-06
MeanAbsoluteError value on hold-out data: 0.0008343958761543036
Epoch: 78
Loss on hold-out set: 1.906183208269305e-06
MeanAbsoluteError value on hold-out data: 0.0010871686972677708
Epoch: 79
Loss on hold-out set: 8.159058910888024e-07
MeanAbsoluteError value on hold-out data: 0.0007265186286531389
Epoch: 80
Loss on hold-out set: 1.233053622994563e-05
MeanAbsoluteError value on hold-out data: 0.0031795690301805735
Epoch: 81
Loss on hold-out set: 4.141068468645524e-06
MeanAbsoluteError value on hold-out data: 0.0016947361873462796
Epoch: 82
Loss on hold-out set: 2.327091239679318e-05
MeanAbsoluteError value on hold-out data: 0.004569310694932938
Early stopping at epoch 81
Fold: 6
Epoch: 1
Loss on hold-out set: 0.008295125238454113
MeanAbsoluteError value on hold-out data: 0.07298213988542557
Epoch: 2
Loss on hold-out set: 0.0004495201137615368
MeanAbsoluteError value on hold-out data: 0.017847327515482903
Epoch: 3
Loss on hold-out set: 7.863048678630617e-06
MeanAbsoluteError value on hold-out data: 0.001698319218121469
Epoch: 4
Loss on hold-out set: 1.4272696192235275e-05
MeanAbsoluteError value on hold-out data: 0.003485463559627533
Epoch: 5
Loss on hold-out set: 1.1793474151580505e-05
MeanAbsoluteError value on hold-out data: 0.003261544741690159
Epoch: 6
Loss on hold-out set: 1.285251742571675e-06
MeanAbsoluteError value on hold-out data: 0.0009440192370675504
Epoch: 7
Loss on hold-out set: 3.6152995422666068e-06
MeanAbsoluteError value on hold-out data: 0.0016625996213406324
Epoch: 8
Loss on hold-out set: 4.157069383836642e-06
MeanAbsoluteError value on hold-out data: 0.0017782124923542142
Epoch: 9
Loss on hold-out set: 4.946941789267629e-06
MeanAbsoluteError value on hold-out data: 0.0019532821606844664
Epoch: 10
Loss on hold-out set: 2.357439064745939e-06
MeanAbsoluteError value on hold-out data: 0.0012496289564296603
Epoch: 11
Loss on hold-out set: 2.6454379254713645e-06
MeanAbsoluteError value on hold-out data: 0.0014062141999602318
Epoch: 12
Loss on hold-out set: 2.5715205057307544e-06
MeanAbsoluteError value on hold-out data: 0.0012910770019516349
Epoch: 13
Loss on hold-out set: 4.845296923751728e-06
MeanAbsoluteError value on hold-out data: 0.001999438274651766
Epoch: 14
Loss on hold-out set: 1.3895597003983521e-06
MeanAbsoluteError value on hold-out data: 0.0009366653393954039
Epoch: 15
Loss on hold-out set: 9.404697476174289e-07
MeanAbsoluteError value on hold-out data: 0.0007901668432168663
Epoch: 16
Loss on hold-out set: 2.1978013102433088e-06
MeanAbsoluteError value on hold-out data: 0.001227129134349525
Epoch: 17
Loss on hold-out set: 1.7500797009863443e-06
MeanAbsoluteError value on hold-out data: 0.0011136340908706188
Epoch: 18
Loss on hold-out set: 2.301294627544009e-06
MeanAbsoluteError value on hold-out data: 0.0013039943296462297
Epoch: 19
Loss on hold-out set: 1.6023742174498834e-06
MeanAbsoluteError value on hold-out data: 0.0010027997195720673
Epoch: 20
Loss on hold-out set: 2.207578474483923e-06
MeanAbsoluteError value on hold-out data: 0.0012893464881926775
Epoch: 21
Loss on hold-out set: 6.330239504957437e-06
MeanAbsoluteError value on hold-out data: 0.0020240701269358397
Epoch: 22
Loss on hold-out set: 7.1516947523028084e-06
MeanAbsoluteError value on hold-out data: 0.002271372824907303
Epoch: 23
Loss on hold-out set: 3.401959656912368e-05
MeanAbsoluteError value on hold-out data: 0.00571471219882369
Epoch: 24
Loss on hold-out set: 5.085227194985446e-05
MeanAbsoluteError value on hold-out data: 0.0066955662332475185
Epoch: 25
Loss on hold-out set: 8.098552685763794e-06
MeanAbsoluteError value on hold-out data: 0.002524681156501174
Epoch: 26
Loss on hold-out set: 1.3536815878559048e-05
MeanAbsoluteError value on hold-out data: 0.0035258003044873476
Epoch: 27
Loss on hold-out set: 2.7382337206150762e-05
MeanAbsoluteError value on hold-out data: 0.004933464340865612
Epoch: 28
Loss on hold-out set: 5.435179271164368e-06
MeanAbsoluteError value on hold-out data: 0.0018617361783981323
Epoch: 29
Loss on hold-out set: 3.408475584784845e-06
MeanAbsoluteError value on hold-out data: 0.0015200756024569273
Epoch: 30
Loss on hold-out set: 6.713673288826473e-05
MeanAbsoluteError value on hold-out data: 0.007771793752908707
Epoch: 31
Loss on hold-out set: 2.8047657040658055e-06
MeanAbsoluteError value on hold-out data: 0.0010552210733294487
Epoch: 32
Loss on hold-out set: 8.729897952154995e-06
MeanAbsoluteError value on hold-out data: 0.0026644424069672823
Epoch: 33
Loss on hold-out set: 3.552806461252308e-05
MeanAbsoluteError value on hold-out data: 0.0059076035395264626
Epoch: 34
Loss on hold-out set: 2.7158831961479827e-05
MeanAbsoluteError value on hold-out data: 0.004516816232353449
Epoch: 35
Loss on hold-out set: 1.8257411642690176e-06
MeanAbsoluteError value on hold-out data: 0.0010303559247404337
Epoch: 36
Loss on hold-out set: 2.5099798991644864e-05
MeanAbsoluteError value on hold-out data: 0.004656173754483461
Epoch: 37
Loss on hold-out set: 1.0701617926455443e-05
MeanAbsoluteError value on hold-out data: 0.003079012967646122
Epoch: 38
Loss on hold-out set: 8.972198044760331e-06
MeanAbsoluteError value on hold-out data: 0.0024704274255782366
Epoch: 39
Loss on hold-out set: 1.6643632849221692e-05
MeanAbsoluteError value on hold-out data: 0.003770186100155115
Epoch: 40
Loss on hold-out set: 5.431963822607381e-05
MeanAbsoluteError value on hold-out data: 0.007056832313537598
Epoch: 41
Loss on hold-out set: 2.666057718250578e-06
MeanAbsoluteError value on hold-out data: 0.0012330273166298866
Epoch: 42
Loss on hold-out set: 0.00020751817926513747
MeanAbsoluteError value on hold-out data: 0.014102267101407051
Epoch: 43
Loss on hold-out set: 1.037119472340027e-05
MeanAbsoluteError value on hold-out data: 0.002534140134230256
Epoch: 44
Loss on hold-out set: 1.416919137507368e-06
MeanAbsoluteError value on hold-out data: 0.0009459145949222147
Epoch: 45
Loss on hold-out set: 1.3067214909439756e-06
MeanAbsoluteError value on hold-out data: 0.0008954419754445553
Epoch: 46
Loss on hold-out set: 2.782571178053891e-06
MeanAbsoluteError value on hold-out data: 0.0013922241050750017
Epoch: 47
Loss on hold-out set: 3.6536968169597317e-06
MeanAbsoluteError value on hold-out data: 0.0015404641162604094
Epoch: 48
Loss on hold-out set: 0.00018382500051162564
MeanAbsoluteError value on hold-out data: 0.01349582802504301
Epoch: 49
Loss on hold-out set: 4.324376235532467e-05
MeanAbsoluteError value on hold-out data: 0.005815892014652491
Epoch: 50
Loss on hold-out set: 1.0291353506685342e-05
MeanAbsoluteError value on hold-out data: 0.0026774099096655846
Epoch: 51
Loss on hold-out set: 3.49589660905062e-06
MeanAbsoluteError value on hold-out data: 0.0016415960853919387
Epoch: 52
Loss on hold-out set: 3.6089022877114567e-06
MeanAbsoluteError value on hold-out data: 0.0015343654667958617
Epoch: 53
Loss on hold-out set: 1.6209662834836097e-05
MeanAbsoluteError value on hold-out data: 0.003523097140714526
Epoch: 54
Loss on hold-out set: 9.643844868360947e-05
MeanAbsoluteError value on hold-out data: 0.009650088846683502
Epoch: 55
Loss on hold-out set: 7.248548067414399e-06
MeanAbsoluteError value on hold-out data: 0.0024065012112259865
Epoch: 56
Loss on hold-out set: 1.8943549618527938e-06
MeanAbsoluteError value on hold-out data: 0.0010737325064837933
Epoch: 57
Loss on hold-out set: 5.040204436786903e-06
MeanAbsoluteError value on hold-out data: 0.0018224514788016677
Epoch: 58
Loss on hold-out set: 0.00024427621526858554
MeanAbsoluteError value on hold-out data: 0.01491522416472435
Epoch: 59
Loss on hold-out set: 3.664539200634373e-05
MeanAbsoluteError value on hold-out data: 0.005341242533177137
Epoch: 60
Loss on hold-out set: 1.9500392437084185e-05
MeanAbsoluteError value on hold-out data: 0.0040563312359154224
Epoch: 61
Loss on hold-out set: 1.2796550794729019e-06
MeanAbsoluteError value on hold-out data: 0.0008643887704238296
Epoch: 62
Loss on hold-out set: 1.4914406235150707e-06
MeanAbsoluteError value on hold-out data: 0.0009632902801968157
Epoch: 63
Loss on hold-out set: 1.4013512817165554e-06
MeanAbsoluteError value on hold-out data: 0.0010009052930399776
Epoch: 64
Loss on hold-out set: 2.7163752607660943e-05
MeanAbsoluteError value on hold-out data: 0.005037688184529543
Epoch: 65
Loss on hold-out set: 1.4091418751587089e-05
MeanAbsoluteError value on hold-out data: 0.0033559768926352262
Epoch: 66
Loss on hold-out set: 4.279431795321915e-06
MeanAbsoluteError value on hold-out data: 0.001718840328976512
Epoch: 67
Loss on hold-out set: 8.364399561217466e-06
MeanAbsoluteError value on hold-out data: 0.002500352915376425
Epoch: 68
Loss on hold-out set: 1.2073827607449717e-05
MeanAbsoluteError value on hold-out data: 0.0032365513034164906
Epoch: 69
Loss on hold-out set: 1.049193018004119e-05
MeanAbsoluteError value on hold-out data: 0.0030393751803785563
Epoch: 70
Loss on hold-out set: 4.058651785061766e-05
MeanAbsoluteError value on hold-out data: 0.006133093032985926
Epoch: 71
Loss on hold-out set: 0.00013249188598890143
MeanAbsoluteError value on hold-out data: 0.011191051453351974
Epoch: 72
Loss on hold-out set: 1.857171082519926e-05
MeanAbsoluteError value on hold-out data: 0.003716121893376112
Epoch: 73
Loss on hold-out set: 2.4290892847252858e-06
MeanAbsoluteError value on hold-out data: 0.001326881698332727
Epoch: 74
Loss on hold-out set: 5.42400595385026e-06
MeanAbsoluteError value on hold-out data: 0.0020505336578935385
Epoch: 75
Loss on hold-out set: 1.5712777562489814e-06
MeanAbsoluteError value on hold-out data: 0.0009969765087589622
Epoch: 76
Loss on hold-out set: 1.4585215362435869e-05
MeanAbsoluteError value on hold-out data: 0.0035479452926665545
Epoch: 77
Loss on hold-out set: 8.856147465289374e-06
MeanAbsoluteError value on hold-out data: 0.0026628493797034025
Epoch: 78
Loss on hold-out set: 2.9030489503594044e-06
MeanAbsoluteError value on hold-out data: 0.0013129342114552855
Epoch: 79
Loss on hold-out set: 1.4148249717366594e-05
MeanAbsoluteError value on hold-out data: 0.0034456963185220957
Early stopping at epoch 78
Fold: 7
Epoch: 1
Loss on hold-out set: 0.009240250246456036
MeanAbsoluteError value on hold-out data: 0.07663515955209732
Epoch: 2
Loss on hold-out set: 0.0009764540580083401
MeanAbsoluteError value on hold-out data: 0.02402309700846672
Epoch: 3
Loss on hold-out set: 8.706506133211615e-06
MeanAbsoluteError value on hold-out data: 0.00265223765745759
Epoch: 4
Loss on hold-out set: 1.4641111516329356e-06
MeanAbsoluteError value on hold-out data: 0.0009289481677114964
Epoch: 5
Loss on hold-out set: 7.682140064319425e-06
MeanAbsoluteError value on hold-out data: 0.0025713425129652023
Epoch: 6
Loss on hold-out set: 1.3157206677323511e-06
MeanAbsoluteError value on hold-out data: 0.0008761424105614424
Epoch: 7
Loss on hold-out set: 1.9154469179319185e-06
MeanAbsoluteError value on hold-out data: 0.0010891082929447293
Epoch: 8
Loss on hold-out set: 1.649430257744965e-06
MeanAbsoluteError value on hold-out data: 0.000985179329290986
Epoch: 9
Loss on hold-out set: 2.312215665020071e-06
MeanAbsoluteError value on hold-out data: 0.001193857635371387
Epoch: 10
Loss on hold-out set: 1.7858481249697013e-06
MeanAbsoluteError value on hold-out data: 0.0010203835554420948
Epoch: 11
Loss on hold-out set: 1.1844210715795411e-06
MeanAbsoluteError value on hold-out data: 0.0008141772705130279
Epoch: 12
Loss on hold-out set: 1.67237423581285e-06
MeanAbsoluteError value on hold-out data: 0.0009952428517863154
Epoch: 13
Loss on hold-out set: 7.262234843297987e-06
MeanAbsoluteError value on hold-out data: 0.0024931570515036583
Epoch: 14
Loss on hold-out set: 1.384897488448517e-06
MeanAbsoluteError value on hold-out data: 0.0009453351958654821
Epoch: 15
Loss on hold-out set: 3.2160932662988603e-06
MeanAbsoluteError value on hold-out data: 0.0015221982030197978
Epoch: 16
Loss on hold-out set: 1.2912190028985676e-06
MeanAbsoluteError value on hold-out data: 0.0008689415990374982
Epoch: 17
Loss on hold-out set: 5.578536239716834e-06
MeanAbsoluteError value on hold-out data: 0.0021158496383577585
Epoch: 18
Loss on hold-out set: 8.972913187440448e-06
MeanAbsoluteError value on hold-out data: 0.002817542292177677
Epoch: 19
Loss on hold-out set: 3.151824898850464e-06
MeanAbsoluteError value on hold-out data: 0.0014948289608582854
Epoch: 20
Loss on hold-out set: 9.560225092942486e-06
MeanAbsoluteError value on hold-out data: 0.0027595525607466698
Epoch: 21
Loss on hold-out set: 4.235539266189265e-06
MeanAbsoluteError value on hold-out data: 0.001795967691577971
Epoch: 22
Loss on hold-out set: 2.0788392458388655e-05
MeanAbsoluteError value on hold-out data: 0.004403038416057825
Epoch: 23
Loss on hold-out set: 2.4060424038907513e-05
MeanAbsoluteError value on hold-out data: 0.004648747853934765
Epoch: 24
Loss on hold-out set: 8.446413015078109e-05
MeanAbsoluteError value on hold-out data: 0.008721081539988518
Epoch: 25
Loss on hold-out set: 1.4805401895920602e-05
MeanAbsoluteError value on hold-out data: 0.0036208212841302156
Epoch: 26
Loss on hold-out set: 7.543371793872211e-06
MeanAbsoluteError value on hold-out data: 0.0025501137133687735
Epoch: 27
Loss on hold-out set: 1.3335942779891551e-05
MeanAbsoluteError value on hold-out data: 0.0034296391531825066
Epoch: 28
Loss on hold-out set: 1.6050994330586177e-06
MeanAbsoluteError value on hold-out data: 0.0010156756034120917
Epoch: 29
Loss on hold-out set: 5.3309120700690146e-06
MeanAbsoluteError value on hold-out data: 0.0018735415069386363
Epoch: 30
Loss on hold-out set: 1.2443460666243202e-05
MeanAbsoluteError value on hold-out data: 0.0032095033675432205
Epoch: 31
Loss on hold-out set: 8.118996685460353e-05
MeanAbsoluteError value on hold-out data: 0.007948002777993679
Epoch: 32
Loss on hold-out set: 1.7823881255306052e-05
MeanAbsoluteError value on hold-out data: 0.0040665981359779835
Epoch: 33
Loss on hold-out set: 2.6717376001145635e-06
MeanAbsoluteError value on hold-out data: 0.0013649164466187358
Epoch: 34
Loss on hold-out set: 1.5320459108527127e-06
MeanAbsoluteError value on hold-out data: 0.000953691778704524
Epoch: 35
Loss on hold-out set: 7.047641954089228e-05
MeanAbsoluteError value on hold-out data: 0.008072047494351864
Epoch: 36
Loss on hold-out set: 7.487469002416429e-06
MeanAbsoluteError value on hold-out data: 0.00232392898760736
Epoch: 37
Loss on hold-out set: 1.1844368434419896e-06
MeanAbsoluteError value on hold-out data: 0.0008317233878187835
Epoch: 38
Loss on hold-out set: 7.858705290485747e-05
MeanAbsoluteError value on hold-out data: 0.00869027990847826
Epoch: 39
Loss on hold-out set: 7.942898719193181e-06
MeanAbsoluteError value on hold-out data: 0.0025433944538235664
Epoch: 40
Loss on hold-out set: 4.8733992081486995e-06
MeanAbsoluteError value on hold-out data: 0.002010451629757881
Epoch: 41
Loss on hold-out set: 5.923205977663971e-06
MeanAbsoluteError value on hold-out data: 0.0020846452098339796
Epoch: 42
Loss on hold-out set: 5.509453523280592e-06
MeanAbsoluteError value on hold-out data: 0.0021048677153885365
Epoch: 43
Loss on hold-out set: 2.3385754712552836e-05
MeanAbsoluteError value on hold-out data: 0.004301111213862896
Epoch: 44
Loss on hold-out set: 8.309302512106324e-06
MeanAbsoluteError value on hold-out data: 0.0026167077012360096
Epoch: 45
Loss on hold-out set: 1.1167997644616453e-05
MeanAbsoluteError value on hold-out data: 0.0031400704756379128
Epoch: 46
Loss on hold-out set: 9.369775223324094e-06
MeanAbsoluteError value on hold-out data: 0.002614288590848446
Epoch: 47
Loss on hold-out set: 2.6359415852102056e-06
MeanAbsoluteError value on hold-out data: 0.0012694272445514798
Epoch: 48
Loss on hold-out set: 7.24090168660041e-05
MeanAbsoluteError value on hold-out data: 0.008218949660658836
Epoch: 49
Loss on hold-out set: 3.281642924636029e-05
MeanAbsoluteError value on hold-out data: 0.00551227293908596
Epoch: 50
Loss on hold-out set: 6.725599632773083e-06
MeanAbsoluteError value on hold-out data: 0.002375866984948516
Epoch: 51
Loss on hold-out set: 4.648413306103276e-06
MeanAbsoluteError value on hold-out data: 0.001791725168004632
Epoch: 52
Loss on hold-out set: 2.0046332303116706e-05
MeanAbsoluteError value on hold-out data: 0.004167277365922928
Epoch: 53
Loss on hold-out set: 4.618763691374065e-05
MeanAbsoluteError value on hold-out data: 0.00645417021587491
Epoch: 54
Loss on hold-out set: 2.4116749251299134e-06
MeanAbsoluteError value on hold-out data: 0.0011832497548311949
Epoch: 55
Loss on hold-out set: 6.273303772384399e-06
MeanAbsoluteError value on hold-out data: 0.0019344057654961944
Epoch: 56
Loss on hold-out set: 2.0908286509998456e-06
MeanAbsoluteError value on hold-out data: 0.0011387752601876855
Epoch: 57
Loss on hold-out set: 9.670233535311687e-05
MeanAbsoluteError value on hold-out data: 0.009492823854088783
Epoch: 58
Loss on hold-out set: 3.294896095422491e-05
MeanAbsoluteError value on hold-out data: 0.005557936616241932
Epoch: 59
Loss on hold-out set: 3.908172769885054e-06
MeanAbsoluteError value on hold-out data: 0.0017580634448677301
Epoch: 60
Loss on hold-out set: 1.327730123316192e-06
MeanAbsoluteError value on hold-out data: 0.0009420937276445329
Epoch: 61
Loss on hold-out set: 1.6393709468222648e-06
MeanAbsoluteError value on hold-out data: 0.0010081001091748476
Epoch: 62
Loss on hold-out set: 5.99601950782996e-05
MeanAbsoluteError value on hold-out data: 0.007665997836738825
Epoch: 63
Loss on hold-out set: 5.1009913687056935e-05
MeanAbsoluteError value on hold-out data: 0.00684552313759923
Epoch: 64
Loss on hold-out set: 2.789014493268601e-06
MeanAbsoluteError value on hold-out data: 0.0013873918214812875
Epoch: 65
Loss on hold-out set: 3.6248031812227476e-05
MeanAbsoluteError value on hold-out data: 0.005530309863388538
Epoch: 66
Loss on hold-out set: 2.524052984671681e-06
MeanAbsoluteError value on hold-out data: 0.0013218214735388756
Epoch: 67
Loss on hold-out set: 3.05383479406793e-06
MeanAbsoluteError value on hold-out data: 0.001464624423533678
Epoch: 68
Loss on hold-out set: 2.572300156946137e-06
MeanAbsoluteError value on hold-out data: 0.001285405014641583
Epoch: 69
Loss on hold-out set: 1.3270407919208083e-06
MeanAbsoluteError value on hold-out data: 0.000898814934771508
Epoch: 70
Loss on hold-out set: 1.94979723416439e-06
MeanAbsoluteError value on hold-out data: 0.0010888163233175874
Epoch: 71
Loss on hold-out set: 3.34347786030356e-05
MeanAbsoluteError value on hold-out data: 0.005449919495731592
Epoch: 72
Loss on hold-out set: 6.969742606508169e-06
MeanAbsoluteError value on hold-out data: 0.0022972358856350183
Epoch: 73
Loss on hold-out set: 5.101128653432869e-06
MeanAbsoluteError value on hold-out data: 0.0020022718235850334
Epoch: 74
Loss on hold-out set: 1.8919217487004622e-05
MeanAbsoluteError value on hold-out data: 0.004120339639484882
Epoch: 75
Loss on hold-out set: 9.330808377573983e-06
MeanAbsoluteError value on hold-out data: 0.0028190782759338617
Early stopping at epoch 74
Fold: 8
Epoch: 1
Loss on hold-out set: 0.009926837779438267
MeanAbsoluteError value on hold-out data: 0.07920727878808975
Epoch: 2
Loss on hold-out set: 0.00014271278408929132
MeanAbsoluteError value on hold-out data: 0.00921973679214716
Epoch: 3
Loss on hold-out set: 3.4459225686917375e-06
MeanAbsoluteError value on hold-out data: 0.0013393147382885218
Epoch: 4
Loss on hold-out set: 4.01720708745975e-06
MeanAbsoluteError value on hold-out data: 0.0016988624120131135
Epoch: 5
Loss on hold-out set: 3.644766331070479e-06
MeanAbsoluteError value on hold-out data: 0.0016603247495368123
Epoch: 6
Loss on hold-out set: 9.856795880016132e-07
MeanAbsoluteError value on hold-out data: 0.0007789808441884816
Epoch: 7
Loss on hold-out set: 9.916885058093892e-07
MeanAbsoluteError value on hold-out data: 0.0008022758411243558
Epoch: 8
Loss on hold-out set: 1.5641149695091792e-06
MeanAbsoluteError value on hold-out data: 0.0010353262769058347
Epoch: 9
Loss on hold-out set: 2.469120011902795e-06
MeanAbsoluteError value on hold-out data: 0.001327656558714807
Epoch: 10
Loss on hold-out set: 8.745295233963518e-07
MeanAbsoluteError value on hold-out data: 0.0007628906751051545
Epoch: 11
Loss on hold-out set: 1.7554569703511684e-06
MeanAbsoluteError value on hold-out data: 0.0010136025957763195
Epoch: 12
Loss on hold-out set: 1.0913927938488016e-06
MeanAbsoluteError value on hold-out data: 0.0008454032940790057
Epoch: 13
Loss on hold-out set: 2.1253382862176713e-06
MeanAbsoluteError value on hold-out data: 0.0011895999778062105
Epoch: 14
Loss on hold-out set: 1.3111687560642447e-06
MeanAbsoluteError value on hold-out data: 0.0009238366619683802
Epoch: 15
Loss on hold-out set: 2.565433935440244e-06
MeanAbsoluteError value on hold-out data: 0.0013338789576664567
Epoch: 16
Loss on hold-out set: 1.737240075691751e-06
MeanAbsoluteError value on hold-out data: 0.0010923563968390226
Epoch: 17
Loss on hold-out set: 1.1410855817163024e-06
MeanAbsoluteError value on hold-out data: 0.0008747513638809323
Epoch: 18
Loss on hold-out set: 1.0692920091934445e-06
MeanAbsoluteError value on hold-out data: 0.0008306099334731698
Epoch: 19
Loss on hold-out set: 3.6873740152889068e-06
MeanAbsoluteError value on hold-out data: 0.001664604526013136
Epoch: 20
Loss on hold-out set: 1.4390597453502078e-05
MeanAbsoluteError value on hold-out data: 0.003667710116133094
Epoch: 21
Loss on hold-out set: 2.7015095506263046e-06
MeanAbsoluteError value on hold-out data: 0.0013744118623435497
Epoch: 22
Loss on hold-out set: 2.22917652326242e-05
MeanAbsoluteError value on hold-out data: 0.004426952451467514
Epoch: 23
Loss on hold-out set: 4.094936405006312e-06
MeanAbsoluteError value on hold-out data: 0.0017936181975528598
Epoch: 24
Loss on hold-out set: 5.006150279139267e-06
MeanAbsoluteError value on hold-out data: 0.0019439035095274448
Epoch: 25
Loss on hold-out set: 1.1339717555249361e-05
MeanAbsoluteError value on hold-out data: 0.003009775886312127
Epoch: 26
Loss on hold-out set: 1.2268086545820832e-05
MeanAbsoluteError value on hold-out data: 0.0031997717451304197
Epoch: 27
Loss on hold-out set: 2.2744549447942027e-06
MeanAbsoluteError value on hold-out data: 0.0012465192703530192
Epoch: 28
Loss on hold-out set: 1.3273118191556512e-05
MeanAbsoluteError value on hold-out data: 0.0033485584426671267
Epoch: 29
Loss on hold-out set: 6.972533055187132e-05
MeanAbsoluteError value on hold-out data: 0.008170065470039845
Epoch: 30
Loss on hold-out set: 9.01839431697646e-05
MeanAbsoluteError value on hold-out data: 0.009243049658834934
Epoch: 31
Loss on hold-out set: 9.450617929255363e-07
MeanAbsoluteError value on hold-out data: 0.0008147195912897587
Epoch: 32
Loss on hold-out set: 4.183323317892455e-05
MeanAbsoluteError value on hold-out data: 0.00626168679445982
Epoch: 33
Loss on hold-out set: 2.846270271780108e-06
MeanAbsoluteError value on hold-out data: 0.0013910771813243628
Epoch: 34
Loss on hold-out set: 1.0917313117121153e-06
MeanAbsoluteError value on hold-out data: 0.0008784357341937721
Epoch: 35
Loss on hold-out set: 0.00015739485836372926
MeanAbsoluteError value on hold-out data: 0.01244012825191021
Epoch: 36
Loss on hold-out set: 1.9237787245611587e-05
MeanAbsoluteError value on hold-out data: 0.004221122246235609
Epoch: 37
Loss on hold-out set: 3.367323580068142e-05
MeanAbsoluteError value on hold-out data: 0.005349935498088598
Epoch: 38
Loss on hold-out set: 2.5059087140387137e-06
MeanAbsoluteError value on hold-out data: 0.0013335965340957046
Epoch: 39
Loss on hold-out set: 4.2437088548187885e-06
MeanAbsoluteError value on hold-out data: 0.0018811485497280955
Epoch: 40
Loss on hold-out set: 2.848117647912519e-06
MeanAbsoluteError value on hold-out data: 0.0014292194973677397
Epoch: 41
Loss on hold-out set: 1.185888351074027e-06
MeanAbsoluteError value on hold-out data: 0.0008182727615348995
Epoch: 42
Loss on hold-out set: 1.6005506530256334e-05
MeanAbsoluteError value on hold-out data: 0.003745308145880699
Epoch: 43
Loss on hold-out set: 1.2000966543942363e-06
MeanAbsoluteError value on hold-out data: 0.0008925639558583498
Epoch: 44
Loss on hold-out set: 5.630042533784245e-06
MeanAbsoluteError value on hold-out data: 0.002096923068165779
Epoch: 45
Loss on hold-out set: 3.441947998138718e-05
MeanAbsoluteError value on hold-out data: 0.005505931563675404
Epoch: 46
Loss on hold-out set: 2.0439377364639836e-06
MeanAbsoluteError value on hold-out data: 0.001158102648332715
Epoch: 47
Loss on hold-out set: 3.299158414357897e-06
MeanAbsoluteError value on hold-out data: 0.0015888635534793139
Epoch: 48
Loss on hold-out set: 4.40660673680563e-06
MeanAbsoluteError value on hold-out data: 0.001844006939791143
Epoch: 49
Loss on hold-out set: 2.5036752888879095e-05
MeanAbsoluteError value on hold-out data: 0.004735202062875032
Epoch: 50
Loss on hold-out set: 4.231214041703004e-06
MeanAbsoluteError value on hold-out data: 0.0018822827842086554
Epoch: 51
Loss on hold-out set: 8.25526921499449e-05
MeanAbsoluteError value on hold-out data: 0.008974610827863216
Epoch: 52
Loss on hold-out set: 8.487363419799994e-06
MeanAbsoluteError value on hold-out data: 0.0026884672697633505
Epoch: 53
Loss on hold-out set: 3.2391058959127313e-06
MeanAbsoluteError value on hold-out data: 0.001562247984111309
Epoch: 54
Loss on hold-out set: 1.6637249674344134e-06
MeanAbsoluteError value on hold-out data: 0.0009921434102579951
Epoch: 55
Loss on hold-out set: 3.689657261510057e-05
MeanAbsoluteError value on hold-out data: 0.005910760257393122
Epoch: 56
Loss on hold-out set: 1.0247708246424736e-06
MeanAbsoluteError value on hold-out data: 0.0008504581637680531
Epoch: 57
Loss on hold-out set: 1.2061558943689586e-05
MeanAbsoluteError value on hold-out data: 0.0032773532439023256
Epoch: 58
Loss on hold-out set: 6.208938989752473e-06
MeanAbsoluteError value on hold-out data: 0.002198015106841922
Epoch: 59
Loss on hold-out set: 2.6266793961090466e-06
MeanAbsoluteError value on hold-out data: 0.0013602592516690493
Epoch: 60
Loss on hold-out set: 6.995452832388065e-06
MeanAbsoluteError value on hold-out data: 0.002204803517088294
Epoch: 61
Loss on hold-out set: 2.4537485763595705e-06
MeanAbsoluteError value on hold-out data: 0.001288031809963286
Epoch: 62
Loss on hold-out set: 1.0624104841274227e-05
MeanAbsoluteError value on hold-out data: 0.003012650413438678
Epoch: 63
Loss on hold-out set: 2.114362807613081e-05
MeanAbsoluteError value on hold-out data: 0.004261172376573086
Epoch: 64
Loss on hold-out set: 7.82938262161154e-05
MeanAbsoluteError value on hold-out data: 0.008658195845782757
Epoch: 65
Loss on hold-out set: 2.135152282370165e-05
MeanAbsoluteError value on hold-out data: 0.004260553512722254
Epoch: 66
Loss on hold-out set: 3.104650218469592e-05
MeanAbsoluteError value on hold-out data: 0.005311182700097561
Epoch: 67
Loss on hold-out set: 0.00013533985587016033
MeanAbsoluteError value on hold-out data: 0.01156009640544653
Epoch: 68
Loss on hold-out set: 8.056965585777876e-06
MeanAbsoluteError value on hold-out data: 0.0026531966868788004
Epoch: 69
Loss on hold-out set: 6.692303297593474e-05
MeanAbsoluteError value on hold-out data: 0.0077321529388427734
Epoch: 70
Loss on hold-out set: 5.7236263903457884e-06
MeanAbsoluteError value on hold-out data: 0.0020746798254549503
Epoch: 71
Loss on hold-out set: 1.109179674603393e-06
MeanAbsoluteError value on hold-out data: 0.0008379303617402911
Epoch: 72
Loss on hold-out set: 2.0231414859713717e-05
MeanAbsoluteError value on hold-out data: 0.003889624495059252
Epoch: 73
Loss on hold-out set: 6.656361742548493e-06
MeanAbsoluteError value on hold-out data: 0.002180906245484948
Epoch: 74
Loss on hold-out set: 4.732339500780934e-05
MeanAbsoluteError value on hold-out data: 0.006699370685964823
Early stopping at epoch 73
Fold: 9
Epoch: 1
Loss on hold-out set: 0.005268024370217552
MeanAbsoluteError value on hold-out data: 0.05516525357961655
Epoch: 2
Loss on hold-out set: 0.0001566354792605405
MeanAbsoluteError value on hold-out data: 0.00921974703669548
Epoch: 3
Loss on hold-out set: 0.00010474102740632728
MeanAbsoluteError value on hold-out data: 0.007473724894225597
Epoch: 4
Loss on hold-out set: 5.5624767845494294e-05
MeanAbsoluteError value on hold-out data: 0.003762980457395315
Epoch: 5
Loss on hold-out set: 3.9103996431759486e-05
MeanAbsoluteError value on hold-out data: 0.002178377006202936
Epoch: 6
Loss on hold-out set: 3.6627940936831204e-05
MeanAbsoluteError value on hold-out data: 0.0031523494981229305
Epoch: 7
Loss on hold-out set: 3.2620071963789924e-05
MeanAbsoluteError value on hold-out data: 0.003243244020268321
Epoch: 8
Loss on hold-out set: 2.5937902154719966e-05
MeanAbsoluteError value on hold-out data: 0.0023619194980710745
Epoch: 9
Loss on hold-out set: 2.0570409167073824e-05
MeanAbsoluteError value on hold-out data: 0.0014636052073910832
Epoch: 10
Loss on hold-out set: 1.9047819215792024e-05
MeanAbsoluteError value on hold-out data: 0.0014720553299412131
Epoch: 11
Loss on hold-out set: 1.8964856578280047e-05
MeanAbsoluteError value on hold-out data: 0.0017462633550167084
Epoch: 12
Loss on hold-out set: 3.920045709002387e-05
MeanAbsoluteError value on hold-out data: 0.0034973151050508022
Epoch: 13
Loss on hold-out set: 1.6862066506571584e-05
MeanAbsoluteError value on hold-out data: 0.0019994531758129597
Epoch: 14
Loss on hold-out set: 1.4468169061169297e-05
MeanAbsoluteError value on hold-out data: 0.0013860840117558837
Epoch: 15
Loss on hold-out set: 1.3629387008397596e-05
MeanAbsoluteError value on hold-out data: 0.0014845745172351599
Epoch: 16
Loss on hold-out set: 1.5356154458109253e-05
MeanAbsoluteError value on hold-out data: 0.0021306013222783804
Epoch: 17
Loss on hold-out set: 1.568344613098396e-05
MeanAbsoluteError value on hold-out data: 0.002332061529159546
Epoch: 18
Loss on hold-out set: 5.420500327510616e-05
MeanAbsoluteError value on hold-out data: 0.006799450144171715
Epoch: 19
Loss on hold-out set: 1.0642890827100997e-05
MeanAbsoluteError value on hold-out data: 0.0011108496692031622
Epoch: 20
Loss on hold-out set: 1.2537246675492497e-05
MeanAbsoluteError value on hold-out data: 0.0017326038796454668
Epoch: 21
Loss on hold-out set: 1.2402782168954638e-05
MeanAbsoluteError value on hold-out data: 0.0018015046371147037
Epoch: 22
Loss on hold-out set: 1.793973436948503e-05
MeanAbsoluteError value on hold-out data: 0.0030683623626828194
Epoch: 23
Loss on hold-out set: 0.00010063473018817604
MeanAbsoluteError value on hold-out data: 0.009565534070134163
Epoch: 24
Loss on hold-out set: 1.57529111850006e-05
MeanAbsoluteError value on hold-out data: 0.0028676099609583616
Epoch: 25
Loss on hold-out set: 1.803399796839445e-05
MeanAbsoluteError value on hold-out data: 0.003107346361503005
Epoch: 26
Loss on hold-out set: 9.140484962699702e-06
MeanAbsoluteError value on hold-out data: 0.0012990768300369382
Epoch: 27
Loss on hold-out set: 5.792412803902362e-05
MeanAbsoluteError value on hold-out data: 0.006762184668332338
Epoch: 28
Loss on hold-out set: 4.6593892805573814e-05
MeanAbsoluteError value on hold-out data: 0.006313519552350044
Epoch: 29
Loss on hold-out set: 8.51570810202527e-06
MeanAbsoluteError value on hold-out data: 0.0012895410181954503
Epoch: 30
Loss on hold-out set: 0.00011394963971374986
MeanAbsoluteError value on hold-out data: 0.010459836572408676
Epoch: 31
Loss on hold-out set: 8.743414454670528e-06
MeanAbsoluteError value on hold-out data: 0.0012496309354901314
Epoch: 32
Loss on hold-out set: 9.051950082021694e-05
MeanAbsoluteError value on hold-out data: 0.008927791379392147
Epoch: 33
Loss on hold-out set: 1.8487983792371008e-05
MeanAbsoluteError value on hold-out data: 0.0032482699025422335
Epoch: 34
Loss on hold-out set: 0.0004077809706079559
MeanAbsoluteError value on hold-out data: 0.020062647759914398
Epoch: 35
Loss on hold-out set: 1.3048595764513057e-05
MeanAbsoluteError value on hold-out data: 0.00230198260396719
Epoch: 36
Loss on hold-out set: 4.52962642437062e-05
MeanAbsoluteError value on hold-out data: 0.005557256750762463
Epoch: 37
Loss on hold-out set: 8.232213553163512e-06
MeanAbsoluteError value on hold-out data: 0.0012807216262444854
Epoch: 38
Loss on hold-out set: 9.947288276634936e-06
MeanAbsoluteError value on hold-out data: 0.0016761843580752611
Epoch: 39
Loss on hold-out set: 2.66491984942919e-05
MeanAbsoluteError value on hold-out data: 0.004566374234855175
Epoch: 40
Loss on hold-out set: 1.3142162375655831e-05
MeanAbsoluteError value on hold-out data: 0.002531489124521613
Epoch: 41
Loss on hold-out set: 5.350305498443329e-05
MeanAbsoluteError value on hold-out data: 0.006736193783581257
Epoch: 42
Loss on hold-out set: 3.438584875626615e-05
MeanAbsoluteError value on hold-out data: 0.00456796633079648
Epoch: 43
Loss on hold-out set: 2.4541985112591647e-05
MeanAbsoluteError value on hold-out data: 0.004191269166767597
Epoch: 44
Loss on hold-out set: 4.50840284779238e-05
MeanAbsoluteError value on hold-out data: 0.005834454204887152
Epoch: 45
Loss on hold-out set: 8.714827429055452e-05
MeanAbsoluteError value on hold-out data: 0.008195224218070507
Epoch: 46
Loss on hold-out set: 4.058578801610006e-05
MeanAbsoluteError value on hold-out data: 0.0057289861142635345
Epoch: 47
Loss on hold-out set: 9.728148630581647e-06
MeanAbsoluteError value on hold-out data: 0.001257757656276226
Epoch: 48
Loss on hold-out set: 1.0774760351768446e-05
MeanAbsoluteError value on hold-out data: 0.001553551061078906
Epoch: 49
Loss on hold-out set: 1.1891582857970207e-05
MeanAbsoluteError value on hold-out data: 0.0019625730346888304
Epoch: 50
Loss on hold-out set: 5.013233805164838e-05
MeanAbsoluteError value on hold-out data: 0.006401603110134602
Epoch: 51
Loss on hold-out set: 1.7552067499939138e-05
MeanAbsoluteError value on hold-out data: 0.0031220412347465754
Epoch: 52
Loss on hold-out set: 3.518781438917638e-05
MeanAbsoluteError value on hold-out data: 0.005262133665382862
Epoch: 53
Loss on hold-out set: 2.9894869210413442e-05
MeanAbsoluteError value on hold-out data: 0.004804474301636219
Epoch: 54
Loss on hold-out set: 4.0840757160017696e-05
MeanAbsoluteError value on hold-out data: 0.005511553958058357
Epoch: 55
Loss on hold-out set: 3.601123759066328e-05
MeanAbsoluteError value on hold-out data: 0.00541688920930028
Epoch: 56
Loss on hold-out set: 1.1007614686010269e-05
MeanAbsoluteError value on hold-out data: 0.0017561668064445257
Epoch: 57
Loss on hold-out set: 9.098693646172671e-06
MeanAbsoluteError value on hold-out data: 0.0010099790524691343
Epoch: 58
Loss on hold-out set: 1.1622797125290583e-05
MeanAbsoluteError value on hold-out data: 0.0019227913580834866
Epoch: 59
Loss on hold-out set: 1.4725209439347964e-05
MeanAbsoluteError value on hold-out data: 0.0025366025511175394
Epoch: 60
Loss on hold-out set: 1.1615544998186613e-05
MeanAbsoluteError value on hold-out data: 0.0019731444772332907
Epoch: 61
Loss on hold-out set: 1.1870861735238017e-05
MeanAbsoluteError value on hold-out data: 0.0019888172391802073
Epoch: 62
Loss on hold-out set: 1.8142274886765965e-05
MeanAbsoluteError value on hold-out data: 0.0029969611205160618
Epoch: 63
Loss on hold-out set: 9.43434698945986e-05
MeanAbsoluteError value on hold-out data: 0.009189913049340248
Epoch: 64
Loss on hold-out set: 1.6650257363765446e-05
MeanAbsoluteError value on hold-out data: 0.002533058635890484
Epoch: 65
Loss on hold-out set: 1.0843487897405934e-05
MeanAbsoluteError value on hold-out data: 0.0016054287552833557
Epoch: 66
Loss on hold-out set: 1.0726451032146892e-05
MeanAbsoluteError value on hold-out data: 0.0016875341534614563
Epoch: 67
Loss on hold-out set: 3.942847111969828e-05
MeanAbsoluteError value on hold-out data: 0.004746993072330952
Epoch: 68
Loss on hold-out set: 1.2345625044382849e-05
MeanAbsoluteError value on hold-out data: 0.0017607404151931405
Epoch: 69
Loss on hold-out set: 1.435251629380638e-05
MeanAbsoluteError value on hold-out data: 0.002296425634995103
Epoch: 70
Loss on hold-out set: 1.361947908243075e-05
MeanAbsoluteError value on hold-out data: 0.00221129204146564
Epoch: 71
Loss on hold-out set: 1.1152556020568647e-05
MeanAbsoluteError value on hold-out data: 0.001509991125203669
Epoch: 72
Loss on hold-out set: 0.00013860349785178326
MeanAbsoluteError value on hold-out data: 0.011380009353160858
Epoch: 73
Loss on hold-out set: 3.94309075860432e-05
MeanAbsoluteError value on hold-out data: 0.00567002734169364
Epoch: 74
Loss on hold-out set: 2.1782143588867395e-05
MeanAbsoluteError value on hold-out data: 0.003746724920347333
Epoch: 75
Loss on hold-out set: 3.0455586196554716e-05
MeanAbsoluteError value on hold-out data: 0.0047031003050506115
Epoch: 76
Loss on hold-out set: 4.579538500155859e-05
MeanAbsoluteError value on hold-out data: 0.006318249739706516
Epoch: 77
Loss on hold-out set: 9.608919566079958e-06
MeanAbsoluteError value on hold-out data: 0.0012454006355255842
Epoch: 78
Loss on hold-out set: 1.2677797677987166e-05
MeanAbsoluteError value on hold-out data: 0.0019654298666864634
Epoch: 79
Loss on hold-out set: 6.113057819535382e-05
MeanAbsoluteError value on hold-out data: 0.0072527192533016205
Epoch: 80
Loss on hold-out set: 5.042009252065327e-05
MeanAbsoluteError value on hold-out data: 0.0060561723075807095
Epoch: 81
Loss on hold-out set: 1.1297517839527525e-05
MeanAbsoluteError value on hold-out data: 0.0014015277847647667
Epoch: 82
Loss on hold-out set: 1.9339271043113862e-05
MeanAbsoluteError value on hold-out data: 0.0033894237130880356
Epoch: 83
Loss on hold-out set: 9.94713697257164e-06
MeanAbsoluteError value on hold-out data: 0.0013963425299152732
Epoch: 84
Loss on hold-out set: 0.00010353384613363932
MeanAbsoluteError value on hold-out data: 0.009414637461304665
Epoch: 85
Loss on hold-out set: 7.071412983350456e-05
MeanAbsoluteError value on hold-out data: 0.007799975108355284
Epoch: 86
Loss on hold-out set: 1.537495423830338e-05
MeanAbsoluteError value on hold-out data: 0.0026370033156126738
Epoch: 87
Loss on hold-out set: 1.5903879155023158e-05
MeanAbsoluteError value on hold-out data: 0.0027617772575467825
Epoch: 88
Loss on hold-out set: 5.4260144399729775e-05
MeanAbsoluteError value on hold-out data: 0.006821839604526758
Epoch: 89
Loss on hold-out set: 3.4964103738625105e-05
MeanAbsoluteError value on hold-out data: 0.005211979150772095
Epoch: 90
Loss on hold-out set: 1.968849771244025e-05
MeanAbsoluteError value on hold-out data: 0.0013885397929698229
Epoch: 91
Loss on hold-out set: 1.1408775958552898e-05
MeanAbsoluteError value on hold-out data: 0.0016284629236906767
Epoch: 92
Loss on hold-out set: 2.5218048974168665e-05
MeanAbsoluteError value on hold-out data: 0.004170442931354046
Epoch: 93
Loss on hold-out set: 1.6019854666200656e-05
MeanAbsoluteError value on hold-out data: 0.002616746351122856
Epoch: 94
Loss on hold-out set: 1.1291345790945903e-05
MeanAbsoluteError value on hold-out data: 0.0014589126221835613
Epoch: 95
Loss on hold-out set: 1.1852912887906523e-05
MeanAbsoluteError value on hold-out data: 0.0015317252837121487
Epoch: 96
Loss on hold-out set: 1.8103036311983418e-05
MeanAbsoluteError value on hold-out data: 0.003143562702462077
Epoch: 97
Loss on hold-out set: 1.0713562967514288e-05
MeanAbsoluteError value on hold-out data: 0.0014951537596061826
Epoch: 98
Loss on hold-out set: 9.818460162373063e-06
MeanAbsoluteError value on hold-out data: 0.001223397208377719
Epoch: 99
Loss on hold-out set: 1.3305752155737047e-05
MeanAbsoluteError value on hold-out data: 0.0021395140793174505
Epoch: 100
Loss on hold-out set: 2.2882070040325813e-05
MeanAbsoluteError value on hold-out data: 0.003942093811929226
Epoch: 101
Loss on hold-out set: 1.18085161095503e-05
MeanAbsoluteError value on hold-out data: 0.001897403271868825
Early stopping at epoch 100
Fold: 10
Epoch: 1
Loss on hold-out set: 0.007105873629020957
MeanAbsoluteError value on hold-out data: 0.06846216320991516
Epoch: 2
Loss on hold-out set: 0.00016589721585310495
MeanAbsoluteError value on hold-out data: 0.008710464462637901
Epoch: 3
Loss on hold-out set: 6.801540596020808e-05
MeanAbsoluteError value on hold-out data: 0.0023560947738587856
Epoch: 4
Loss on hold-out set: 3.71453795301372e-05
MeanAbsoluteError value on hold-out data: 0.0029837987385690212
Epoch: 5
Loss on hold-out set: 2.7157298098665287e-05
MeanAbsoluteError value on hold-out data: 0.003527044551447034
Epoch: 6
Loss on hold-out set: 1.9162760544042194e-05
MeanAbsoluteError value on hold-out data: 0.0028388970531523228
Epoch: 7
Loss on hold-out set: 1.3420058538625968e-05
MeanAbsoluteError value on hold-out data: 0.0018468229100108147
Epoch: 8
Loss on hold-out set: 1.2420618234570542e-05
MeanAbsoluteError value on hold-out data: 0.0020442213863134384
Epoch: 9
Loss on hold-out set: 8.620491402010744e-06
MeanAbsoluteError value on hold-out data: 0.0011888735461980104
Epoch: 10
Loss on hold-out set: 1.0553230122940686e-05
MeanAbsoluteError value on hold-out data: 0.0021815977524966
Epoch: 11
Loss on hold-out set: 6.145804587294361e-06
MeanAbsoluteError value on hold-out data: 0.0010498471092432737
Epoch: 12
Loss on hold-out set: 6.70705880495986e-06
MeanAbsoluteError value on hold-out data: 0.0012791716726496816
Epoch: 13
Loss on hold-out set: 6.08110342717247e-06
MeanAbsoluteError value on hold-out data: 0.0012570562539622188
Epoch: 14
Loss on hold-out set: 1.5143444215937052e-05
MeanAbsoluteError value on hold-out data: 0.003435959806665778
Epoch: 15
Loss on hold-out set: 8.806908349120371e-06
MeanAbsoluteError value on hold-out data: 0.001972287893295288
Epoch: 16
Loss on hold-out set: 5.866719308099933e-06
MeanAbsoluteError value on hold-out data: 0.0013287480687722564
Epoch: 17
Loss on hold-out set: 2.6089979795730098e-05
MeanAbsoluteError value on hold-out data: 0.004715904127806425
Epoch: 18
Loss on hold-out set: 2.628191270140143e-05
MeanAbsoluteError value on hold-out data: 0.004715778399258852
Epoch: 19
Loss on hold-out set: 1.2055444935518048e-05
MeanAbsoluteError value on hold-out data: 0.0028386651538312435
Epoch: 20
Loss on hold-out set: 6.627773025404447e-05
MeanAbsoluteError value on hold-out data: 0.007928670383989811
Epoch: 21
Loss on hold-out set: 4.980782377445464e-06
MeanAbsoluteError value on hold-out data: 0.001476421020925045
Epoch: 22
Loss on hold-out set: 1.635956764053285e-05
MeanAbsoluteError value on hold-out data: 0.0035210687201470137
Epoch: 23
Loss on hold-out set: 4.9536103705787145e-06
MeanAbsoluteError value on hold-out data: 0.0014668403891846538
Epoch: 24
Loss on hold-out set: 2.2982307760125528e-05
MeanAbsoluteError value on hold-out data: 0.004560070112347603
Epoch: 25
Loss on hold-out set: 4.8272587194402986e-05
MeanAbsoluteError value on hold-out data: 0.0066414629109203815
Epoch: 26
Loss on hold-out set: 1.231384067068575e-05
MeanAbsoluteError value on hold-out data: 0.003187391208484769
Epoch: 27
Loss on hold-out set: 9.43773564078863e-06
MeanAbsoluteError value on hold-out data: 0.002877824939787388
Epoch: 28
Loss on hold-out set: 6.2956434808606554e-06
MeanAbsoluteError value on hold-out data: 0.002106801839545369
Epoch: 29
Loss on hold-out set: 2.313725039689766e-05
MeanAbsoluteError value on hold-out data: 0.0044753653928637505
Epoch: 30
Loss on hold-out set: 1.2605489176236846e-05
MeanAbsoluteError value on hold-out data: 0.0030119484290480614
Epoch: 31
Loss on hold-out set: 5.550314164373469e-06
MeanAbsoluteError value on hold-out data: 0.00209267670288682
Epoch: 32
Loss on hold-out set: 2.0937003586578403e-06
MeanAbsoluteError value on hold-out data: 0.0009957917500287294
Epoch: 33
Loss on hold-out set: 1.3089676660736306e-05
MeanAbsoluteError value on hold-out data: 0.00332591962069273
Epoch: 34
Loss on hold-out set: 0.0011350077469474995
MeanAbsoluteError value on hold-out data: 0.033634308725595474
Epoch: 35
Loss on hold-out set: 5.6268541811732575e-05
MeanAbsoluteError value on hold-out data: 0.007115294225513935
Epoch: 36
Loss on hold-out set: 6.840321580407012e-06
MeanAbsoluteError value on hold-out data: 0.0023031386081129313
Epoch: 37
Loss on hold-out set: 4.136948991100116e-06
MeanAbsoluteError value on hold-out data: 0.0017557106912136078
Epoch: 38
Loss on hold-out set: 1.3484541131429769e-05
MeanAbsoluteError value on hold-out data: 0.0032952988985925913
Epoch: 39
Loss on hold-out set: 0.00013588412828259886
MeanAbsoluteError value on hold-out data: 0.00995459221303463
Epoch: 40
Loss on hold-out set: 1.7965527682953018e-06
MeanAbsoluteError value on hold-out data: 0.0010218718089163303
Epoch: 41
Loss on hold-out set: 1.744398935863081e-06
MeanAbsoluteError value on hold-out data: 0.0009604633087292314
Epoch: 42
Loss on hold-out set: 9.993468176197404e-06
MeanAbsoluteError value on hold-out data: 0.0028895747382193804
Epoch: 43
Loss on hold-out set: 0.0004339967854321003
MeanAbsoluteError value on hold-out data: 0.020700650289654732
Epoch: 44
Loss on hold-out set: 1.1313424465697608e-05
MeanAbsoluteError value on hold-out data: 0.0031190901063382626
Epoch: 45
Loss on hold-out set: 5.331804546725694e-06
MeanAbsoluteError value on hold-out data: 0.002042926149442792
Epoch: 46
Loss on hold-out set: 6.129498160589719e-06
MeanAbsoluteError value on hold-out data: 0.002278768690302968
Epoch: 47
Loss on hold-out set: 2.540920106114824e-06
MeanAbsoluteError value on hold-out data: 0.0012778175296261907
Epoch: 48
Loss on hold-out set: 5.646904408142571e-06
MeanAbsoluteError value on hold-out data: 0.002070040674880147
Epoch: 49
Loss on hold-out set: 1.4683623703604098e-05
MeanAbsoluteError value on hold-out data: 0.003655912820249796
Epoch: 50
Loss on hold-out set: 1.6571301225317606e-05
MeanAbsoluteError value on hold-out data: 0.0038835150189697742
Epoch: 51
Loss on hold-out set: 6.518470036098734e-05
MeanAbsoluteError value on hold-out data: 0.007882713340222836
Epoch: 52
Loss on hold-out set: 1.7323075973343714e-06
MeanAbsoluteError value on hold-out data: 0.0010622151894494891
Epoch: 53
Loss on hold-out set: 1.6645285759645608e-06
MeanAbsoluteError value on hold-out data: 0.001051527913659811
Epoch: 54
Loss on hold-out set: 8.199192297279997e-06
MeanAbsoluteError value on hold-out data: 0.002564150607213378
Epoch: 55
Loss on hold-out set: 8.734897402553962e-05
MeanAbsoluteError value on hold-out data: 0.0080579724162817
Epoch: 56
Loss on hold-out set: 4.2623375170828345e-05
MeanAbsoluteError value on hold-out data: 0.005988063756376505
Epoch: 57
Loss on hold-out set: 6.414810356475825e-06
MeanAbsoluteError value on hold-out data: 0.002242200542241335
Epoch: 58
Loss on hold-out set: 1.705393029939072e-06
MeanAbsoluteError value on hold-out data: 0.0010206735460087657
Epoch: 59
Loss on hold-out set: 6.672130054469632e-06
MeanAbsoluteError value on hold-out data: 0.002275698585435748
Epoch: 60
Loss on hold-out set: 5.6040953495539725e-05
MeanAbsoluteError value on hold-out data: 0.007263088133186102
Epoch: 61
Loss on hold-out set: 1.3425291469432592e-05
MeanAbsoluteError value on hold-out data: 0.0030518516432493925
Epoch: 62
Loss on hold-out set: 3.2390468312279645e-06
MeanAbsoluteError value on hold-out data: 0.0013755911495536566
Epoch: 63
Loss on hold-out set: 5.5121907700175565e-05
MeanAbsoluteError value on hold-out data: 0.007083430420607328
Epoch: 64
Loss on hold-out set: 1.6848550750672494e-05
MeanAbsoluteError value on hold-out data: 0.0039204866625368595
Epoch: 65
Loss on hold-out set: 1.737020326030548e-05
MeanAbsoluteError value on hold-out data: 0.004037870559841394
Epoch: 66
Loss on hold-out set: 6.969590738383256e-06
MeanAbsoluteError value on hold-out data: 0.002139580436050892
Epoch: 67
Loss on hold-out set: 2.227960941616822e-05
MeanAbsoluteError value on hold-out data: 0.00422038696706295
Epoch: 68
Loss on hold-out set: 2.988462774038243e-05
MeanAbsoluteError value on hold-out data: 0.005260355304926634
Epoch: 69
Loss on hold-out set: 2.3807788938239146e-06
MeanAbsoluteError value on hold-out data: 0.001259610173292458
Epoch: 70
Loss on hold-out set: 1.2273900560663045e-05
MeanAbsoluteError value on hold-out data: 0.003017239971086383
Epoch: 71
Loss on hold-out set: 8.882941004300777e-05
MeanAbsoluteError value on hold-out data: 0.009235036559402943
Epoch: 72
Loss on hold-out set: 2.0906751860121192e-05
MeanAbsoluteError value on hold-out data: 0.0037820914294570684
Epoch: 73
Loss on hold-out set: 8.234823081483437e-06
MeanAbsoluteError value on hold-out data: 0.0024336364585906267
Epoch: 74
Loss on hold-out set: 1.84883119931538e-06
MeanAbsoluteError value on hold-out data: 0.0009649700950831175
Epoch: 75
Loss on hold-out set: 2.2993275260537653e-06
MeanAbsoluteError value on hold-out data: 0.001023959252052009
Epoch: 76
Loss on hold-out set: 2.162392271342329e-05
MeanAbsoluteError value on hold-out data: 0.004442248959094286
Epoch: 77
Loss on hold-out set: 9.482506671842062e-06
MeanAbsoluteError value on hold-out data: 0.0025051450356841087
Epoch: 78
Loss on hold-out set: 8.905559857689346e-06
MeanAbsoluteError value on hold-out data: 0.0022784157190471888
Epoch: 79
Loss on hold-out set: 0.0001865665130585862
MeanAbsoluteError value on hold-out data: 0.012476984411478043
Epoch: 80
Loss on hold-out set: 6.171575985438092e-06
MeanAbsoluteError value on hold-out data: 0.0019861580803990364
Epoch: 81
Loss on hold-out set: 1.3463282532309397e-05
MeanAbsoluteError value on hold-out data: 0.003336752764880657
Epoch: 82
Loss on hold-out set: 3.314723009960009e-05
MeanAbsoluteError value on hold-out data: 0.005543168634176254
Epoch: 83
Loss on hold-out set: 8.531290124945092e-06
MeanAbsoluteError value on hold-out data: 0.0026108515448868275
Epoch: 84
Loss on hold-out set: 1.853735357844226e-05
MeanAbsoluteError value on hold-out data: 0.0037365080788731575
Epoch: 85
Loss on hold-out set: 4.651403269935355e-06
MeanAbsoluteError value on hold-out data: 0.001632571336813271
Epoch: 86
Loss on hold-out set: 2.1077574064502886e-05
MeanAbsoluteError value on hold-out data: 0.004366949666291475
Epoch: 87
Loss on hold-out set: 1.2129844610451702e-05
MeanAbsoluteError value on hold-out data: 0.002976387506350875
Epoch: 88
Loss on hold-out set: 1.4513787776265348e-05
MeanAbsoluteError value on hold-out data: 0.0034577823244035244
Epoch: 89
Loss on hold-out set: 6.558334084379916e-05
MeanAbsoluteError value on hold-out data: 0.007820476777851582
Epoch: 90
Loss on hold-out set: 2.0723220910230548e-06
MeanAbsoluteError value on hold-out data: 0.00112534046638757
Epoch: 91
Loss on hold-out set: 2.1224872258384355e-05
MeanAbsoluteError value on hold-out data: 0.004313262179493904
Epoch: 92
Loss on hold-out set: 1.7122724522358533e-06
MeanAbsoluteError value on hold-out data: 0.0008839908987283707
Epoch: 93
Loss on hold-out set: 0.00040810646560902777
MeanAbsoluteError value on hold-out data: 0.018854402005672455
Epoch: 94
Loss on hold-out set: 1.8024847402277654e-05
MeanAbsoluteError value on hold-out data: 0.0039013223722577095
Epoch: 95
Loss on hold-out set: 2.515673433943168e-06
MeanAbsoluteError value on hold-out data: 0.0012507359497249126
Epoch: 96
Loss on hold-out set: 3.0784840112993643e-06
MeanAbsoluteError value on hold-out data: 0.0012851549545302987
Epoch: 97
Loss on hold-out set: 1.8985255127727913e-05
MeanAbsoluteError value on hold-out data: 0.004234119784086943
Epoch: 98
Loss on hold-out set: 1.6184769125315004e-05
MeanAbsoluteError value on hold-out data: 0.003881072625517845
Epoch: 99
Loss on hold-out set: 2.1287208465554824e-05
MeanAbsoluteError value on hold-out data: 0.0035598052199929953
Epoch: 100
Loss on hold-out set: 4.612594956107876e-06
MeanAbsoluteError value on hold-out data: 0.0016706271562725306
Epoch: 101
Loss on hold-out set: 2.132672307197936e-05
MeanAbsoluteError value on hold-out data: 0.0044622356072068214
Epoch: 102
Loss on hold-out set: 1.8369429776262573e-06
MeanAbsoluteError value on hold-out data: 0.000984637183137238
Epoch: 103
Loss on hold-out set: 1.9454391060837506e-06
MeanAbsoluteError value on hold-out data: 0.0011593865929171443
Epoch: 104
Loss on hold-out set: 1.4420098033532178e-05
MeanAbsoluteError value on hold-out data: 0.0036654856521636248
Epoch: 105
Loss on hold-out set: 3.1326088499274474e-06
MeanAbsoluteError value on hold-out data: 0.0014400972286239266
Epoch: 106
Loss on hold-out set: 2.381604032892098e-06
MeanAbsoluteError value on hold-out data: 0.0012337607331573963
Epoch: 107
Loss on hold-out set: 7.767542047076859e-05
MeanAbsoluteError value on hold-out data: 0.007435043342411518
Epoch: 108
Loss on hold-out set: 6.791448308481799e-06
MeanAbsoluteError value on hold-out data: 0.0020153322257101536
Epoch: 109
Loss on hold-out set: 4.223210579276873e-05
MeanAbsoluteError value on hold-out data: 0.006171933375298977
Epoch: 110
Loss on hold-out set: 1.3029240248075579e-05
MeanAbsoluteError value on hold-out data: 0.003241512691602111
Epoch: 111
Loss on hold-out set: 7.0255952008525265e-06
MeanAbsoluteError value on hold-out data: 0.0023452634923160076
Epoch: 112
Loss on hold-out set: 5.232314073020041e-06
MeanAbsoluteError value on hold-out data: 0.0017872856697067618
Epoch: 113
Loss on hold-out set: 2.3363853520445096e-05
MeanAbsoluteError value on hold-out data: 0.004661081824451685
Epoch: 114
Loss on hold-out set: 2.4717768951632024e-06
MeanAbsoluteError value on hold-out data: 0.0011667448561638594
Epoch: 115
Loss on hold-out set: 6.45263424723033e-06
MeanAbsoluteError value on hold-out data: 0.0019280489068478346
Epoch: 116
Loss on hold-out set: 2.0767854808722266e-05
MeanAbsoluteError value on hold-out data: 0.004221739713102579
Epoch: 117
Loss on hold-out set: 8.892041093461627e-06
MeanAbsoluteError value on hold-out data: 0.002651605289429426
Early stopping at epoch 116
metric_name = type(fun_control["metric_torch"]).__name__
print(f"loss: {df_eval}, Cross-validated {metric_name}: {df_metrics}")
loss: 2.9403468197677706e-05, Cross-validated MeanAbsoluteError: 0.0044063059613108635

18.18 Detailed Hyperparameter Plots

filename = "./figures/" + experiment_name
spot_tuner.plot_important_hyperparameter_contour(filename=filename)
l1:  21.805417711276903
dropout_prob:  13.65140667466867
batch_size:  100.0
epochs:  62.13776202588252
sgd_momentum:  9.153430223193602

Contour plots.

18.19 Parallel Coordinates Plot

spot_tuner.parallel_plot()

Parallel coordinates plots

18.20 Summary and Outlook

This tutorial presents the hyperparameter tuning open source software spotPython for PyTorch. Some of the advantages of spotPython are:

  • Numerical and categorical hyperparameters.
  • Powerful surrogate models.
  • Flexible approach and easy to use.
  • Simple JSON files for the specification of the hyperparameters.
  • Extension of default and user specified network classes.
  • Noise handling techniques.
  • Online visualization of the hyperparameter tuning process with tensorboard.

Currently, only rudimentary parallel and distributed neural network training is possible, but these capabilities will be extended in the future. The next version of spotPython will also include a more detailed documentation and more examples.

Important

Important: This tutorial does not present a complete benchmarking study (Bartz-Beielstein et al. 2020). The results are only preliminary and highly dependent on the local configuration (hard- and software). Our goal is to provide a first impression of the performance of the hyperparameter tuning package spotPython. The results should be interpreted with care.