19  HPT PyTorch: Regression

In this tutorial, we will show how spotPython can be integrated into the PyTorch training workflow for regreession tasks.

This document refers to the following software versions:

pip list | grep  "spot[RiverPython]"
spotPython               0.2.51
spotRiver                0.0.94
Note: you may need to restart the kernel to use updated packages.

spotPython can be installed via pip. Alternatively, the source code can be downloaded from gitHub: https://github.com/sequential-parameter-optimization/spotPython.

!pip install spotPython
# import sys
# !{sys.executable} -m pip install --upgrade build
# !{sys.executable} -m pip install --upgrade --force-reinstall spotPython

19.1 Step 1: Setup

Before we consider the detailed experimental setup, we select the parameters that affect run time, initial design size and the device that is used.

Caution: Run time and initial design size should be increased for real experiments
  • MAX_TIME is set to one minute for demonstration purposes. For real experiments, this should be increased to at least 1 hour.
  • INIT_SIZE is set to 5 for demonstration purposes. For real experiments, this should be increased to at least 10.
Note: Device selection
  • The device can be selected by setting the variable DEVICE.
  • Since we are using a simple neural net, the setting "cpu" is preferred (on Mac).
  • If you have a GPU, you can use "cuda:0" instead.
  • If DEVICE is set to None, spotPython will automatically select the device.
    • This might result in "mps" on Macs, which is not the best choice for simple neural nets.
MAX_TIME = 1
INIT_SIZE = 5
DEVICE = "cpu" # "cuda:0"
from spotPython.utils.device import getDevice
DEVICE = getDevice(DEVICE)
print(DEVICE)
cpu
import os
import copy
import socket
from datetime import datetime
from dateutil.tz import tzlocal
start_time = datetime.now(tzlocal())
HOSTNAME = socket.gethostname().split(".")[0]
experiment_name = '24-torch' + "_" + HOSTNAME + "_" + str(MAX_TIME) + "min_" + str(INIT_SIZE) + "init_" + str(start_time).split(".", 1)[0].replace(' ', '_')
experiment_name = experiment_name.replace(':', '-')
print(experiment_name)
if not os.path.exists('./figures'):
    os.makedirs('./figures')
24-torch_maans05_1min_5init_2023-06-28_17-23-08

19.2 Step 2: Initialization of the fun_control Dictionary

Caution: Tensorboard does not work under Windows
  • Since tensorboard does not work under Windows, we recommend setting the parameter tensorboard_path to None if you are working under Windows.

spotPython uses a Python dictionary for storing the information required for the hyperparameter tuning process, which was described in Section 14.2.

from spotPython.utils.init import fun_control_init
fun_control = fun_control_init(task="regression",
 tensorboard_path="runs/24_spot_torch_regression",
 device=DEVICE)

19.3 Step 3: PyTorch Data Loading

# Create dataset
import pandas as pd
import numpy as np
from sklearn import datasets as sklearn_datasets
from sklearn.preprocessing import MinMaxScaler
from sklearn.model_selection import train_test_split
X, y = sklearn_datasets.make_regression(
    n_samples=1000, n_features=10, noise=1, random_state=123)
y = y.reshape(-1, 1)

# Normalize the data
X_scaler = MinMaxScaler()
X_scaled = X_scaler.fit_transform(X)
y_scaler = MinMaxScaler()
y_scaled = y_scaler.fit_transform(y)

# combine the features and target into a single dataframe named train_df
train_df = pd.DataFrame(np.hstack((X_scaled, y_scaled)))

target_column = "y"
n_samples = train_df.shape[0]
n_features = train_df.shape[1] - 1
train_df.columns = [f"x{i}" for i in range(1, n_features+1)] + [target_column]
X_train, X_test, y_train, y_test = train_test_split(train_df.drop(target_column,
    axis=1), 
    train_df[target_column],
    random_state=42,
    test_size=0.25)
trainset = pd.DataFrame(np.hstack((X_train, np.array(y_train).reshape(-1, 1))))
testset = pd.DataFrame(np.hstack((X_test, np.array(y_test).reshape(-1, 1))))
trainset.columns = [f"x{i}" for i in range(1, n_features+1)] + [target_column]
testset.columns = [f"x{i}" for i in range(1, n_features+1)] + [target_column]
print(train_df.shape)
print(trainset.shape)
print(testset.shape)
(1000, 11)
(750, 11)
(250, 11)
import torch
from spotPython.torch.dataframedataset import DataFrameDataset
dtype_x = torch.float32
dtype_y = torch.float32
train_df = DataFrameDataset(train_df, target_column=target_column,
    dtype_x=dtype_x, dtype_y=dtype_y)
train = DataFrameDataset(trainset, target_column=target_column,
    dtype_x=dtype_x, dtype_y=dtype_y)
test = DataFrameDataset(testset, target_column=target_column,
    dtype_x=dtype_x, dtype_y=dtype_y)
n_samples = len(train)
  • Now we can test the data loading:
from spotPython.torch.traintest import create_train_val_data_loaders
trainloader, testloader = create_train_val_data_loaders(train, 2, True, 0)
for i, data in enumerate(trainloader, 0):
    inputs, labels = data
    print(inputs.shape)
    print(labels.shape)
    print(inputs)
    print(labels)
    break
torch.Size([2, 10])
torch.Size([2])
tensor([[0.6507, 0.7383, 0.7545, 0.2938, 0.2538, 0.6036, 0.5250, 0.3715, 0.5398,
         0.3967],
        [0.5860, 0.4255, 0.4700, 0.3699, 0.2841, 0.6425, 0.6557, 0.5598, 0.8093,
         0.8054]])
tensor([0.5271, 0.6047])
  • Since this works fine, we can add the data loading to the fun_control dictionary:
# add the dataset to the fun_control
fun_control.update({"data": train_df, # full dataset,
               "train": train,
               "test": test,
               "n_samples": n_samples,
               "target_column": target_column,})

19.4 Step 4: Specification of the Preprocessing Model

After the training and test data are specified and added to the fun_control dictionary, spotPython allows the specification of a data preprocessing pipeline, e.g., for the scaling of the data or for the one-hot encoding of categorical variables, see Section 14.4. This feature is not used here, so we do not change the default value (which is None).

19.5 Step 5: Select Model (algorithm) and core_model_hyper_dict

19.5.1 Implementing a Configurable Neural Network With spotPython

spotPython includes the Net_lin_reg class which is implemented in the file netregression.py.

This class inherits from the class Net_Core which is implemented in the file netcore.py, see Section 14.5.1.

from torch import nn
import spotPython.torch.netcore as netcore


class Net_lin_reg(netcore.Net_Core):
    def __init__(
        self, _L_in, _L_out, l1, dropout_prob, lr_mult,
        batch_size, epochs, k_folds, patience, optimizer,
        sgd_momentum
    ):
        super(Net_lin_reg, self).__init__(
            lr_mult=lr_mult,
            batch_size=batch_size,
            epochs=epochs,
            k_folds=k_folds,
            patience=patience,
            optimizer=optimizer,
            sgd_momentum=sgd_momentum,
        )
        l2 = max(l1 // 2, 4)
        self.fc1 = nn.Linear(_L_in, l1)
        self.fc2 = nn.Linear(l1, l2)
        self.fc3 = nn.Linear(l2, _L_out)
        self.relu = nn.ReLU()
        self.softmax = nn.Softmax(dim=1)
        self.dropout1 = nn.Dropout(p=dropout_prob)
        self.dropout2 = nn.Dropout(p=dropout_prob / 2)

    def forward(self, x):
        x = self.fc1(x)
        x = self.relu(x)
        x = self.dropout1(x)
        x = self.fc2(x)
        x = self.relu(x)
        x = self.dropout2(x)
        x = self.fc3(x)
        return x

19.5.1.1 The Net_Core class

Net_lin_reg inherits from the class Net_Core which is implemented in the file netcore.py. This class was described in Section 14.5.1.

from spotPython.torch.netregression import Net_lin_reg
from spotPython.data.torch_hyper_dict import TorchHyperDict
from spotPython.hyperparameters.values import add_core_model_to_fun_control
fun_control = add_core_model_to_fun_control(core_model=Net_lin_reg,
                              fun_control=fun_control,
                              hyper_dict=TorchHyperDict,
                              filename=None)

19.5.2 The Search Space

19.5.3 Configuring the Search Space With spotPython

19.5.3.1 The hyper_dict Hyperparameters for the Selected Algorithm

spotPython uses JSON files for the specification of the hyperparameters, which were described in Section 14.5.5.

The corresponding entries for the core_model class are shown below.

fun_control['core_model_hyper_dict']
{'_L_in': {'type': 'int',
  'default': 10,
  'transform': 'None',
  'lower': 10,
  'upper': 10},
 '_L_out': {'type': 'int',
  'default': 1,
  'transform': 'None',
  'lower': 1,
  'upper': 1},
 'l1': {'type': 'int',
  'default': 3,
  'transform': 'transform_power_2_int',
  'lower': 3,
  'upper': 8},
 'dropout_prob': {'type': 'float',
  'default': 0.01,
  'transform': 'None',
  'lower': 0.0,
  'upper': 0.9},
 'lr_mult': {'type': 'float',
  'default': 1.0,
  'transform': 'None',
  'lower': 0.1,
  'upper': 10.0},
 'batch_size': {'type': 'int',
  'default': 4,
  'transform': 'transform_power_2_int',
  'lower': 1,
  'upper': 4},
 'epochs': {'type': 'int',
  'default': 4,
  'transform': 'transform_power_2_int',
  'lower': 4,
  'upper': 9},
 'k_folds': {'type': 'int',
  'default': 1,
  'transform': 'None',
  'lower': 1,
  'upper': 1},
 'patience': {'type': 'int',
  'default': 2,
  'transform': 'transform_power_2_int',
  'lower': 1,
  'upper': 5},
 'optimizer': {'levels': ['Adadelta',
   'Adagrad',
   'Adam',
   'AdamW',
   'SparseAdam',
   'Adamax',
   'ASGD',
   'NAdam',
   'RAdam',
   'RMSprop',
   'Rprop',
   'SGD'],
  'type': 'factor',
  'default': 'SGD',
  'transform': 'None',
  'class_name': 'torch.optim',
  'core_model_parameter_type': 'str',
  'lower': 0,
  'upper': 12},
 'sgd_momentum': {'type': 'float',
  'default': 0.0,
  'transform': 'None',
  'lower': 0.0,
  'upper': 1.0}}

19.6 Step 6: Modify hyper_dict Hyperparameters for the Selected Algorithm aka core_model

spotPython provides functions for modifying the hyperparameters, their bounds and factors as well as for activating and de-activating hyperparameters without re-compilation of the Python source code. These functions were described in Section 14.6.

19.6.1 Modify hyper_dict Hyperparameters for the Selected Algorithm aka core_model

19.6.1.1 Modify Hyperparameters of Type numeric and integer (boolean)

from spotPython.hyperparameters.values import modify_hyper_parameter_bounds

fun_control = modify_hyper_parameter_bounds(fun_control, "epochs", bounds=[2, 16])
fun_control = modify_hyper_parameter_bounds(fun_control, "patience", bounds=[3, 7])

19.6.1.2 Modify Hyperparameter of Type factor

from spotPython.hyperparameters.values import modify_hyper_parameter_levels
fun_control = modify_hyper_parameter_levels(fun_control, "optimizer",
    ["Adadelta", "Adagrad", "Adam", "AdamW", "Adamax", "ASGD", "NAdam"])


fun_control.update({
               "_L_in": n_features,
               "_L_out": 1,})

19.6.2 Optimizers

Optimizers are described in Section 14.6.1.

19.7 Step 7: Selection of the Objective (Loss) Function

19.7.1 Evaluation

The evaluation procedure requires the specification of two elements:

  1. the way how the data is split into a train and a test set (see Section 14.7.1)
  2. the loss function (and a metric).

19.7.2 Loss Functions and Metrics

The key "loss_function" specifies the loss function which is used during the optimization, see Section 14.7.5.

We will use MSE loss for the regression task.

from torch.nn import MSELoss
loss_torch = MSELoss()
fun_control.update({"loss_function": loss_torch})

19.7.3 Metric

from torchmetrics import MeanAbsoluteError
metric_torch = MeanAbsoluteError().to(fun_control["device"])
fun_control.update({"metric_torch": metric_torch})

19.8 Step 8: Calling the SPOT Function

19.8.1 Preparing the SPOT Call

The following code passes the information about the parameter ranges and bounds to spot.

# extract the variable types, names, and bounds
from spotPython.hyperparameters.values import (get_bound_values,
    get_var_name,
    get_var_type,)
var_type = get_var_type(fun_control)
var_name = get_var_name(fun_control)
fun_control.update({"var_type": var_type,
                    "var_name": var_name})
lower = get_bound_values(fun_control, "lower")
upper = get_bound_values(fun_control, "upper")
from spotPython.utils.eda import gen_design_table
print(gen_design_table(fun_control))
| name         | type   | default   |   lower |   upper | transform             |
|--------------|--------|-----------|---------|---------|-----------------------|
| _L_in        | int    | 10        |    10   |    10   | None                  |
| _L_out       | int    | 1         |     1   |     1   | None                  |
| l1           | int    | 3         |     3   |     8   | transform_power_2_int |
| dropout_prob | float  | 0.01      |     0   |     0.9 | None                  |
| lr_mult      | float  | 1.0       |     0.1 |    10   | None                  |
| batch_size   | int    | 4         |     1   |     4   | transform_power_2_int |
| epochs       | int    | 4         |     2   |    16   | transform_power_2_int |
| k_folds      | int    | 1         |     1   |     1   | None                  |
| patience     | int    | 2         |     3   |     7   | transform_power_2_int |
| optimizer    | factor | SGD       |     0   |     6   | None                  |
| sgd_momentum | float  | 0.0       |     0   |     1   | None                  |

19.8.2 The Objective Function fun_torch

The objective function fun_torch is selected next. It implements an interface from PyTorch’s training, validation, and testing methods to spotPython.

from spotPython.fun.hypertorch import HyperTorch
fun = HyperTorch().fun_torch
from spotPython.hyperparameters.values import get_default_hyperparameters_as_array
hyper_dict=TorchHyperDict().load()
X_start = get_default_hyperparameters_as_array(fun_control, hyper_dict)

19.8.3 Starting the Hyperparameter Tuning

The spotPython hyperparameter tuning is started by calling the Spot function as described in Section 14.8.4.

from spotPython.spot import spot
from math import inf
spot_tuner = spot.Spot(fun=fun,
                   lower = lower,
                   upper = upper,
                   fun_evals = inf,
                   fun_repeats = 1,
                   max_time = MAX_TIME,
                   noise = False,
                   tolerance_x = np.sqrt(np.spacing(1)),
                   var_type = var_type,
                   var_name = var_name,
                   infill_criterion = "y",
                   n_points = 1,
                   seed=123,
                   log_level = 50,
                   show_models= False,
                   show_progress= True,
                   fun_control = fun_control,
                   design_control={"init_size": INIT_SIZE,
                                   "repeats": 1},
                   surrogate_control={"noise": True,
                                      "cod_type": "norm",
                                      "min_theta": -4,
                                      "max_theta": 3,
                                      "n_theta": len(var_name),
                                      "model_fun_evals": 10_000,
                                      "log_level": 50
                                      })
spot_tuner.run(X_start=X_start)

config: {'_L_in': 10, '_L_out': 1, 'l1': 64, 'dropout_prob': 0.7103122166156, 'lr_mult': 3.62368745191023, 'batch_size': 8, 'epochs': 128, 'k_folds': 1, 'patience': 16, 'optimizer': 'Adam', 'sgd_momentum': 0.5446851204405787}
Epoch: 1 | MeanAbsoluteError: 0.1862211376428604 | Loss: 0.0531789669276852 | Epoch: 2 | MeanAbsoluteError: 0.1528289765119553 | Loss: 0.0376607825685489 | Epoch: 3 | 
MeanAbsoluteError: 0.1628590524196625 | Loss: 0.0404916645860986 | Epoch: 4 | MeanAbsoluteError: 0.1438457071781158 | Loss: 0.0330522636956486 | Epoch: 5 | MeanAbsoluteError: 0.1454998403787613 | Loss: 0.0328915732496075 | Epoch: 6 | MeanAbsoluteError: 0.1360227316617966 | Loss: 0.0287883681594394 | Epoch: 7 | 
MeanAbsoluteError: 0.1327107995748520 | Loss: 0.0277469738533622 | Epoch: 8 | MeanAbsoluteError: 0.1292717009782791 | Loss: 0.0269186469040027 | Epoch: 9 | MeanAbsoluteError: 0.1274883449077606 | Loss: 0.0261684107643209 | Epoch: 10 | MeanAbsoluteError: 0.1313546299934387 | Loss: 0.0261813781322225 | Epoch: 11 | 
MeanAbsoluteError: 0.1170096620917320 | Loss: 0.0226605568130158 | Epoch: 12 | MeanAbsoluteError: 0.1162498742341995 | Loss: 0.0213531058183626 | Epoch: 13 | MeanAbsoluteError: 0.1177887246012688 | Loss: 0.0220565802760814 | Epoch: 14 | MeanAbsoluteError: 0.1192767173051834 | Loss: 0.0227511290117706 | Epoch: 15 | 
MeanAbsoluteError: 0.1206810623407364 | Loss: 0.0236044490807935 | Epoch: 16 | MeanAbsoluteError: 0.1125072613358498 | Loss: 0.0204663467164593 | Epoch: 17 | MeanAbsoluteError: 0.1137556806206703 | Loss: 0.0201349573724560 | Epoch: 18 | MeanAbsoluteError: 0.1048675328493118 | Loss: 0.0166989017008363 | Epoch: 19 | 
MeanAbsoluteError: 0.1050077155232430 | Loss: 0.0175835848785937 | Epoch: 20 | MeanAbsoluteError: 0.1062842160463333 | Loss: 0.0178719245412044 | Epoch: 21 | MeanAbsoluteError: 0.1096999719738960 | Loss: 0.0199405165376926 | Epoch: 22 | MeanAbsoluteError: 0.0953515619039536 | Loss: 0.0147800916487253 | Epoch: 23 | 
MeanAbsoluteError: 0.0965785235166550 | Loss: 0.0154584659459560 | Epoch: 24 | MeanAbsoluteError: 0.0934761390089989 | Loss: 0.0149845551196976 | Epoch: 25 | MeanAbsoluteError: 0.0989117324352264 | Loss: 0.0160191505657215 | Epoch: 26 | MeanAbsoluteError: 0.0948993489146233 | Loss: 0.0158466591597780 | Epoch: 27 | 
MeanAbsoluteError: 0.0992281809449196 | Loss: 0.0156315688386952 | Epoch: 28 | MeanAbsoluteError: 0.1028372421860695 | Loss: 0.0170055719974794 | Epoch: 29 | MeanAbsoluteError: 0.0950427874922752 | Loss: 0.0158028109060404 | Epoch: 30 | MeanAbsoluteError: 0.0946590006351471 | Loss: 0.0148337760964703 | Epoch: 31 | 
MeanAbsoluteError: 0.0963578373193741 | Loss: 0.0154814289784745 | Epoch: 32 | MeanAbsoluteError: 0.0945703983306885 | Loss: 0.0150349233299494 | Epoch: 33 | MeanAbsoluteError: 0.0917693674564362 | Loss: 0.0139220884731530 | Epoch: 34 | MeanAbsoluteError: 0.0858584567904472 | Loss: 0.0136423425957266 | Epoch: 35 | 
MeanAbsoluteError: 0.0842845141887665 | Loss: 0.0122107737758932 | Epoch: 36 | MeanAbsoluteError: 0.0912431553006172 | Loss: 0.0144135637858294 | Epoch: 37 | MeanAbsoluteError: 0.0882962718605995 | Loss: 0.0122817281547836 | Epoch: 38 | MeanAbsoluteError: 0.0812088251113892 | Loss: 0.0119740609202142 | Epoch: 39 | 
MeanAbsoluteError: 0.0823240950703621 | Loss: 0.0119354340529658 | Epoch: 40 | MeanAbsoluteError: 0.0835372358560562 | Loss: 0.0119175451109186 | Epoch: 41 | MeanAbsoluteError: 0.0839081481099129 | Loss: 0.0106111220145402 | Epoch: 42 | MeanAbsoluteError: 0.0826822817325592 | Loss: 0.0125513698256231 | Epoch: 43 | 
MeanAbsoluteError: 0.0823262184858322 | Loss: 0.0114715108801121 | Epoch: 44 | MeanAbsoluteError: 0.0867415592074394 | Loss: 0.0131506415047242 | Epoch: 45 | MeanAbsoluteError: 0.0899396911263466 | Loss: 0.0129660029380925 | Epoch: 46 | MeanAbsoluteError: 0.0768903493881226 | Loss: 0.0113905284884631 | Epoch: 47 | 
MeanAbsoluteError: 0.0746367648243904 | Loss: 0.0096540892018790 | Epoch: 48 | MeanAbsoluteError: 0.0902866572141647 | Loss: 0.0124709154969375 | Epoch: 49 | MeanAbsoluteError: 0.0765513554215431 | Loss: 0.0111072564108518 | Epoch: 50 | MeanAbsoluteError: 0.0686681419610977 | Loss: 0.0090937665479846 | Epoch: 51 | 
MeanAbsoluteError: 0.0744860619306564 | Loss: 0.0103710428260169 | Epoch: 52 | MeanAbsoluteError: 0.0790098980069160 | Loss: 0.0119581109504093 | Epoch: 53 | MeanAbsoluteError: 0.0749179199337959 | Loss: 0.0106090809230840 | Epoch: 54 | MeanAbsoluteError: 0.0740580856800079 | Loss: 0.0110560577044165 | Epoch: 55 | 
MeanAbsoluteError: 0.0780316516757011 | Loss: 0.0126402515375766 | Epoch: 56 | MeanAbsoluteError: 0.0808897987008095 | Loss: 0.0114590200460761 | Epoch: 57 | MeanAbsoluteError: 0.0729138180613518 | Loss: 0.0102469548797480 | Epoch: 58 | MeanAbsoluteError: 0.0733921751379967 | Loss: 0.0098574817866871 | Epoch: 59 | 
MeanAbsoluteError: 0.0796083062887192 | Loss: 0.0101185058133285 | Epoch: 60 | MeanAbsoluteError: 0.0764205157756805 | Loss: 0.0095667783906193 | Epoch: 61 | MeanAbsoluteError: 0.0748680606484413 | Loss: 0.0096297391665805 | Epoch: 62 | MeanAbsoluteError: 0.0860462933778763 | Loss: 0.0141370919238972 | Epoch: 63 | 
MeanAbsoluteError: 0.0826658606529236 | Loss: 0.0126258763729742 | Epoch: 64 | MeanAbsoluteError: 0.0707025751471519 | Loss: 0.0097042272529124 | Epoch: 65 | MeanAbsoluteError: 0.0931352153420448 | Loss: 0.0161537192516813 | Epoch: 66 | MeanAbsoluteError: 0.0750603005290031 | Loss: 0.0100019440348995 | Early stopping at epoch 65
Returned to Spot: Validation loss: 0.010001944034899535

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.19981931523998656, 'lr_mult': 7.004318498645526, 'batch_size': 16, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.07401195908206384}
Epoch: 1 | 
MeanAbsoluteError: 0.2170260399580002 | Loss: 0.0643199103835382 | Epoch: 2 | MeanAbsoluteError: 0.1982067823410034 | Loss: 0.0551889947566547 | Epoch: 3 | MeanAbsoluteError: 0.2001865357160568 | Loss: 0.0548668281224213 | Epoch: 4 | MeanAbsoluteError: 0.2055182158946991 | Loss: 0.0572787356611929 | Epoch: 5 | MeanAbsoluteError: 0.1169487759470940 | Loss: 0.0213941854277724 | Epoch: 6 | MeanAbsoluteError: 0.1052771955728531 | Loss: 0.0177236578525289 | Epoch: 7 | MeanAbsoluteError: 0.1297297477722168 | Loss: 0.0246567956515049 | Epoch: 8 | 
MeanAbsoluteError: 0.0953107997775078 | Loss: 0.0147578469967764 | Epoch: 9 | MeanAbsoluteError: 0.0818230658769608 | Loss: 0.0111959630157799 | Epoch: 10 | MeanAbsoluteError: 0.1301938295364380 | Loss: 0.0240480066522172 | Epoch: 11 | MeanAbsoluteError: 0.1075836792588234 | Loss: 0.0170290123083090 | Epoch: 12 | MeanAbsoluteError: 0.2146381586790085 | Loss: 0.0556593745162613 | Epoch: 13 | MeanAbsoluteError: 0.0979087129235268 | Loss: 0.0143157968444652 | Epoch: 14 | MeanAbsoluteError: 0.1897766888141632 | Loss: 0.0450584650235741 | Epoch: 15 | 
MeanAbsoluteError: 0.0917645543813705 | Loss: 0.0135280816129556 | Epoch: 16 | MeanAbsoluteError: 0.1946595162153244 | Loss: 0.0457051177754214 | Epoch: 17 | MeanAbsoluteError: 0.1400345861911774 | Loss: 0.0250366994817006 | Epoch: 18 | MeanAbsoluteError: 0.1526944041252136 | Loss: 0.0295909958842554 | Epoch: 19 | MeanAbsoluteError: 0.1158209368586540 | Loss: 0.0182247686346895 | Epoch: 20 | MeanAbsoluteError: 0.2044928818941116 | Loss: 0.0484318964575466 | Epoch: 21 | MeanAbsoluteError: 0.0704182460904121 | Loss: 0.0072804192497738 | Epoch: 22 | 
MeanAbsoluteError: 0.0628048852086067 | Loss: 0.0066022970591133 | Epoch: 23 | MeanAbsoluteError: 0.0592337176203728 | Loss: 0.0060263793106730 | Epoch: 24 | MeanAbsoluteError: 0.0578042604029179 | Loss: 0.0058038992145540 | Epoch: 25 | MeanAbsoluteError: 0.0614662431180477 | Loss: 0.0062058142410885 | Epoch: 26 | MeanAbsoluteError: 0.1449615061283112 | Loss: 0.0253943668580369 | Epoch: 27 | MeanAbsoluteError: 0.0803314000368118 | Loss: 0.0104519579755632 | Epoch: 28 | MeanAbsoluteError: 0.0892275422811508 | Loss: 0.0127338343790095 | Epoch: 29 | 
MeanAbsoluteError: 0.0794837102293968 | Loss: 0.0092932230694906 | Epoch: 30 | MeanAbsoluteError: 0.1641017645597458 | Loss: 0.0310981607946910 | Epoch: 31 | MeanAbsoluteError: 0.0611114688217640 | Loss: 0.0065526843781730 | Epoch: 32 | MeanAbsoluteError: 0.1296459883451462 | Loss: 0.0210928306669781 | Epoch: 33 | MeanAbsoluteError: 0.0491557121276855 | Loss: 0.0041263090311795 | Epoch: 34 | MeanAbsoluteError: 0.0402942709624767 | Loss: 0.0030241838815671 | Epoch: 35 | MeanAbsoluteError: 0.0865089744329453 | Loss: 0.0113700046694200 | Epoch: 36 | 
MeanAbsoluteError: 0.0984164476394653 | Loss: 0.0149244994758383 | Epoch: 37 | MeanAbsoluteError: 0.1491353362798691 | Loss: 0.0255120664246772 | Epoch: 38 | MeanAbsoluteError: 0.0798945352435112 | Loss: 0.0098956464789808 | Epoch: 39 | MeanAbsoluteError: 0.0601675920188427 | Loss: 0.0057852504358284 | Epoch: 40 | MeanAbsoluteError: 0.1603928059339523 | Loss: 0.0290617827129991 | Epoch: 41 | MeanAbsoluteError: 0.0533400923013687 | Loss: 0.0044230546214079 | Epoch: 42 | MeanAbsoluteError: 0.1527850031852722 | Loss: 0.0266609822252863 | Epoch: 43 | 
MeanAbsoluteError: 0.0469899959862232 | Loss: 0.0040785649019343 | Epoch: 44 | MeanAbsoluteError: 0.1103504151105881 | Loss: 0.0156493185970344 | Epoch: 45 | MeanAbsoluteError: 0.0671936348080635 | Loss: 0.0071743071128271 | Epoch: 46 | MeanAbsoluteError: 0.0797956436872482 | Loss: 0.0087034756954955 | Epoch: 47 | MeanAbsoluteError: 0.0685648098587990 | Loss: 0.0073159260332192 | Epoch: 48 | MeanAbsoluteError: 0.0832141712307930 | Loss: 0.0108279889988664 | Epoch: 49 | MeanAbsoluteError: 0.1413671523332596 | Loss: 0.0243335309389390 | Epoch: 50 | 
MeanAbsoluteError: 0.0371407791972160 | Loss: 0.0027877991271548 | Epoch: 51 | MeanAbsoluteError: 0.0880594477057457 | Loss: 0.0101803664216085 | Epoch: 52 | MeanAbsoluteError: 0.0669189319014549 | Loss: 0.0074772270224792 | Epoch: 53 | MeanAbsoluteError: 0.1095920205116272 | Loss: 0.0146583543698254 | Epoch: 54 | MeanAbsoluteError: 0.0651596784591675 | Loss: 0.0057275217688201 | Epoch: 55 | MeanAbsoluteError: 0.0790520161390305 | Loss: 0.0099514898917589 | Epoch: 56 | MeanAbsoluteError: 0.0585873462259769 | Loss: 0.0062029854529292 | Epoch: 57 | 
MeanAbsoluteError: 0.0883614420890808 | Loss: 0.0109268834961480 | Epoch: 58 | MeanAbsoluteError: 0.1183425262570381 | Loss: 0.0165297213059507 | Epoch: 59 | MeanAbsoluteError: 0.1120398938655853 | Loss: 0.0154702973208929 | Epoch: 60 | MeanAbsoluteError: 0.0823159292340279 | Loss: 0.0095496447634344 | Epoch: 61 | MeanAbsoluteError: 0.0368183068931103 | Loss: 0.0026263563317786 | Epoch: 62 | MeanAbsoluteError: 0.0391080938279629 | Loss: 0.0032477551354340 | Epoch: 63 | MeanAbsoluteError: 0.0710690915584564 | Loss: 0.0089749648407298 | Epoch: 64 | 
MeanAbsoluteError: 0.0685643255710602 | Loss: 0.0064546688900966 | Epoch: 65 | MeanAbsoluteError: 0.0433518551290035 | Loss: 0.0034045159056979 | Epoch: 66 | MeanAbsoluteError: 0.0640567541122437 | Loss: 0.0064958153341554 | Epoch: 67 | MeanAbsoluteError: 0.0472691878676414 | Loss: 0.0037215694380728 | Epoch: 68 | MeanAbsoluteError: 0.0606027394533157 | Loss: 0.0055803578763612 | Epoch: 69 | MeanAbsoluteError: 0.0488300174474716 | Loss: 0.0040956918321746 | Epoch: 70 | MeanAbsoluteError: 0.0655859336256981 | Loss: 0.0066314477988176 | Epoch: 71 | 
MeanAbsoluteError: 0.1024632081389427 | Loss: 0.0143317264063578 | Epoch: 72 | MeanAbsoluteError: 0.0996813550591469 | Loss: 0.0157561876664036 | Epoch: 73 | MeanAbsoluteError: 0.1361047774553299 | Loss: 0.0211541723263891 | Epoch: 74 | MeanAbsoluteError: 0.0780454874038696 | Loss: 0.0085766915182926 | Epoch: 75 | MeanAbsoluteError: 0.0602273419499397 | Loss: 0.0054573611797471 | Epoch: 76 | MeanAbsoluteError: 0.0541294850409031 | Loss: 0.0045228712015638 | Epoch: 77 | MeanAbsoluteError: 0.0623770654201508 | Loss: 0.0058847698505576 | Epoch: 78 | 
MeanAbsoluteError: 0.1272453814744949 | Loss: 0.0188976564983788 | Epoch: 79 | MeanAbsoluteError: 0.0662338808178902 | Loss: 0.0065702461686574 | Epoch: 80 | MeanAbsoluteError: 0.0634147301316261 | Loss: 0.0064538123184129 | Epoch: 81 | MeanAbsoluteError: 0.0618331544101238 | Loss: 0.0064126672958465 | Epoch: 82 | MeanAbsoluteError: 0.0357165783643723 | Loss: 0.0020520875144652 | Epoch: 83 | MeanAbsoluteError: 0.0997556447982788 | Loss: 0.0128710353747010 | Epoch: 84 | MeanAbsoluteError: 0.0674017965793610 | Loss: 0.0075078784046989 | Epoch: 85 | 
MeanAbsoluteError: 0.1380956023931503 | Loss: 0.0231847232697826 | Epoch: 86 | MeanAbsoluteError: 0.0406474098563194 | Loss: 0.0028855984871227 | Epoch: 87 | MeanAbsoluteError: 0.0762751102447510 | Loss: 0.0091569704420276 | Epoch: 88 | MeanAbsoluteError: 0.0696611329913139 | Loss: 0.0063440350595077 | Epoch: 89 | MeanAbsoluteError: 0.0993817299604416 | Loss: 0.0112923818003190 | Epoch: 90 | MeanAbsoluteError: 0.1239029467105865 | Loss: 0.0183011338506874 | Epoch: 91 | MeanAbsoluteError: 0.0463007092475891 | Loss: 0.0031378444553794 | Epoch: 92 | 
MeanAbsoluteError: 0.0389584414660931 | Loss: 0.0027645385615822 | Epoch: 93 | MeanAbsoluteError: 0.0383484512567520 | Loss: 0.0033817234767699 | Epoch: 94 | MeanAbsoluteError: 0.0743273571133614 | Loss: 0.0085064707519977 | Epoch: 95 | MeanAbsoluteError: 0.0500453487038612 | Loss: 0.0040142360008567 | Epoch: 96 | MeanAbsoluteError: 0.0849343836307526 | Loss: 0.0085358010653995 | Epoch: 97 | MeanAbsoluteError: 0.0528084896504879 | Loss: 0.0039449049968665 | Epoch: 98 | MeanAbsoluteError: 0.0576685890555382 | Loss: 0.0053890955291296 | Epoch: 99 | 
MeanAbsoluteError: 0.1102609783411026 | Loss: 0.0159771124293145 | Epoch: 100 | MeanAbsoluteError: 0.0407493188977242 | Loss: 0.0029755921813806 | Epoch: 101 | MeanAbsoluteError: 0.0377986468374729 | Loss: 0.0027785987599361 | Epoch: 102 | MeanAbsoluteError: 0.0725285187363625 | Loss: 0.0069713656006283 | Epoch: 103 | MeanAbsoluteError: 0.0457399003207684 | Loss: 0.0033059604588504 | Epoch: 104 | MeanAbsoluteError: 0.0466333143413067 | Loss: 0.0032323692729206 | Epoch: 105 | MeanAbsoluteError: 0.0794983282685280 | Loss: 0.0096491513724782 | Epoch: 106 | 
MeanAbsoluteError: 0.1499924063682556 | Loss: 0.0246756819910125 | Epoch: 107 | MeanAbsoluteError: 0.0332919470965862 | Loss: 0.0021627159348052 | Epoch: 108 | MeanAbsoluteError: 0.1139807477593422 | Loss: 0.0155032648165759 | Epoch: 109 | MeanAbsoluteError: 0.0647946894168854 | Loss: 0.0070188057633411 | Epoch: 110 | MeanAbsoluteError: 0.0709265843033791 | Loss: 0.0080843533781406 | Epoch: 111 | MeanAbsoluteError: 0.0328720472753048 | Loss: 0.0018159280359549 | Epoch: 112 | MeanAbsoluteError: 0.0467270575463772 | Loss: 0.0035268022972894 | Epoch: 113 | 
MeanAbsoluteError: 0.0679348334670067 | Loss: 0.0077289665289419 | Epoch: 114 | MeanAbsoluteError: 0.0898695737123489 | Loss: 0.0110510058799072 | Epoch: 115 | MeanAbsoluteError: 0.0525050051510334 | Loss: 0.0037999674187679 | Epoch: 116 | MeanAbsoluteError: 0.0636699721217155 | Loss: 0.0072779110632837 | Epoch: 117 | MeanAbsoluteError: 0.0451525822281837 | Loss: 0.0031058252850351 | Epoch: 118 | MeanAbsoluteError: 0.0564189665019512 | Loss: 0.0049141885737251 | Epoch: 119 | MeanAbsoluteError: 0.0782202184200287 | Loss: 0.0094336471275279 | Epoch: 120 | 
MeanAbsoluteError: 0.0287431422621012 | Loss: 0.0015870694708275 | Epoch: 121 | MeanAbsoluteError: 0.0639675557613373 | Loss: 0.0055702496932721 | Epoch: 122 | MeanAbsoluteError: 0.0375543236732483 | Loss: 0.0023005376141028 | Epoch: 123 | MeanAbsoluteError: 0.0702826976776123 | Loss: 0.0082681596303653 | Epoch: 124 | MeanAbsoluteError: 0.0510893538594246 | Loss: 0.0048886138308597 | Epoch: 125 | MeanAbsoluteError: 0.0371376536786556 | Loss: 0.0024827772867866 | Epoch: 126 | MeanAbsoluteError: 0.0478169657289982 | Loss: 0.0039616793970038 | Epoch: 127 | 
MeanAbsoluteError: 0.0503851808607578 | Loss: 0.0043073195020521 | Epoch: 128 | MeanAbsoluteError: 0.0315896682441235 | Loss: 0.0017370770464798 | Epoch: 129 | MeanAbsoluteError: 0.0593962669372559 | Loss: 0.0046730690243605 | Epoch: 130 | MeanAbsoluteError: 0.0373179279267788 | Loss: 0.0023308533525683 | Epoch: 131 | MeanAbsoluteError: 0.0590629689395428 | Loss: 0.0048055316713688 | Epoch: 132 | MeanAbsoluteError: 0.0337876938283443 | Loss: 0.0022514882914134 | Epoch: 133 | MeanAbsoluteError: 0.0689857825636864 | Loss: 0.0078296117043417 | Epoch: 134 | 
MeanAbsoluteError: 0.0585650578141212 | Loss: 0.0062125628985661 | Epoch: 135 | MeanAbsoluteError: 0.0450528599321842 | Loss: 0.0035193541675414 | Epoch: 136 | MeanAbsoluteError: 0.0446033589541912 | Loss: 0.0032220336510555 | Epoch: 137 | MeanAbsoluteError: 0.0736811757087708 | Loss: 0.0085369027342255 | Epoch: 138 | MeanAbsoluteError: 0.0346476361155510 | Loss: 0.0022691093219787 | Epoch: 139 | MeanAbsoluteError: 0.0502140410244465 | Loss: 0.0041594098469144 | Epoch: 140 | MeanAbsoluteError: 0.0460287965834141 | Loss: 0.0035168578370327 | Epoch: 141 | 
MeanAbsoluteError: 0.0702097043395042 | Loss: 0.0065116248534698 | Epoch: 142 | MeanAbsoluteError: 0.0499952733516693 | Loss: 0.0033908245202742 | Epoch: 143 | MeanAbsoluteError: 0.0609849914908409 | Loss: 0.0047706742893512 | Epoch: 144 | MeanAbsoluteError: 0.0705016925930977 | Loss: 0.0070836181556316 | Epoch: 145 | MeanAbsoluteError: 0.0757961049675941 | Loss: 0.0096629973084323 | Epoch: 146 | MeanAbsoluteError: 0.0647848099470139 | Loss: 0.0061515280976892 | Epoch: 147 | MeanAbsoluteError: 0.0930826440453529 | Loss: 0.0101084759409883 | Epoch: 148 | 
MeanAbsoluteError: 0.0523704625666142 | Loss: 0.0057449406931961 | Epoch: 149 | MeanAbsoluteError: 0.0384775921702385 | Loss: 0.0026100954886428 | Epoch: 150 | MeanAbsoluteError: 0.0703046992421150 | Loss: 0.0069880535531985 | Epoch: 151 | MeanAbsoluteError: 0.0354413017630577 | Loss: 0.0021305621362683 | Epoch: 152 | MeanAbsoluteError: 0.0421507917344570 | Loss: 0.0031685928421977 | Early stopping at epoch 151
Returned to Spot: Validation loss: 0.0031685928421977317

config: {'_L_in': 10, '_L_out': 1, 'l1': 128, 'dropout_prob': 0.8582565260508446, 'lr_mult': 0.4977322453322358, 'batch_size': 2, 'epochs': 32768, 'k_folds': 1, 'patience': 128, 'optimizer': 'ASGD', 'sgd_momentum': 0.6834550718769361}
Epoch: 1 | 
MeanAbsoluteError: 0.2162313014268875 | Loss: 0.0740126949595287 | Epoch: 2 | 
MeanAbsoluteError: 0.1742797046899796 | Loss: 0.0475910527441495 | Epoch: 3 | 
MeanAbsoluteError: 0.1803575158119202 | Loss: 0.0514760169540144 | Epoch: 4 | 
MeanAbsoluteError: 0.1558050215244293 | Loss: 0.0371747437432835 | Epoch: 5 | 
MeanAbsoluteError: 0.1589803993701935 | Loss: 0.0407370967350289 | Epoch: 6 | 
MeanAbsoluteError: 0.1466106325387955 | Loss: 0.0347552871461570 | Epoch: 7 | 
MeanAbsoluteError: 0.1453838795423508 | Loss: 0.0332946716172592 | Epoch: 8 | 
MeanAbsoluteError: 0.1404749304056168 | Loss: 0.0332439999483540 | Epoch: 9 | 
MeanAbsoluteError: 0.1466600596904755 | Loss: 0.0330659339914564 | Epoch: 10 | 
MeanAbsoluteError: 0.1358268558979034 | Loss: 0.0303475866240721 | Epoch: 11 | 
MeanAbsoluteError: 0.1353979110717773 | Loss: 0.0301662577294822 | Epoch: 12 | 
MeanAbsoluteError: 0.1374111324548721 | Loss: 0.0298830669375699 | Epoch: 13 | 
MeanAbsoluteError: 0.1311012804508209 | Loss: 0.0290235121010725 | Epoch: 14 | 
MeanAbsoluteError: 0.1313004791736603 | Loss: 0.0278234296897426 | Epoch: 15 | 
MeanAbsoluteError: 0.1276115775108337 | Loss: 0.0278953314573998 | Epoch: 16 | 
MeanAbsoluteError: 0.1324527561664581 | Loss: 0.0295277795696105 | Epoch: 17 | 
MeanAbsoluteError: 0.1251592487096786 | Loss: 0.0262468914205480 | Epoch: 18 | 
MeanAbsoluteError: 0.1316768974065781 | Loss: 0.0278523109917781 | Epoch: 19 | 
MeanAbsoluteError: 0.1360661983489990 | Loss: 0.0298102219603121 | Epoch: 20 | 
MeanAbsoluteError: 0.1303184926509857 | Loss: 0.0291838310170958 | Epoch: 21 | 
MeanAbsoluteError: 0.1259477287530899 | Loss: 0.0266295788367006 | Epoch: 22 | 
MeanAbsoluteError: 0.1330218613147736 | Loss: 0.0290553485161702 | Epoch: 23 | 
MeanAbsoluteError: 0.1314955800771713 | Loss: 0.0278512411340489 | Epoch: 24 | 
MeanAbsoluteError: 0.1287994980812073 | Loss: 0.0278935407008006 | Epoch: 25 | 
MeanAbsoluteError: 0.1349661201238632 | Loss: 0.0287846119085831 | Epoch: 26 | 
MeanAbsoluteError: 0.1298883706331253 | Loss: 0.0274041553126638 | Epoch: 27 | 
MeanAbsoluteError: 0.1271236091852188 | Loss: 0.0273949894650529 | Epoch: 28 | 
MeanAbsoluteError: 0.1300144195556641 | Loss: 0.0271359878004296 | Epoch: 29 | 
MeanAbsoluteError: 0.1295804828405380 | Loss: 0.0282652741727846 | Epoch: 30 | 
MeanAbsoluteError: 0.1295201927423477 | Loss: 0.0275200149036876 | Epoch: 31 | 
MeanAbsoluteError: 0.1257367730140686 | Loss: 0.0264597344568998 | Epoch: 32 | 
MeanAbsoluteError: 0.1272802352905273 | Loss: 0.0268746766265637 | Epoch: 33 | 
MeanAbsoluteError: 0.1323407441377640 | Loss: 0.0281432775842647 | Epoch: 34 | 
MeanAbsoluteError: 0.1288720816373825 | Loss: 0.0269943512174723 | Epoch: 35 | 
MeanAbsoluteError: 0.1286525428295135 | Loss: 0.0271759048381258 | Epoch: 36 | 
MeanAbsoluteError: 0.1302885115146637 | Loss: 0.0284204110872815 | Epoch: 37 | 
MeanAbsoluteError: 0.1315612494945526 | Loss: 0.0274610846912644 | Epoch: 38 | 
MeanAbsoluteError: 0.1311129927635193 | Loss: 0.0275682180027070 | Epoch: 39 | 
MeanAbsoluteError: 0.1308739483356476 | Loss: 0.0277676118077943 | Epoch: 40 | 
MeanAbsoluteError: 0.1272562593221664 | Loss: 0.0272206796092602 | Epoch: 41 | 
MeanAbsoluteError: 0.1298545897006989 | Loss: 0.0272036310631665 | Epoch: 42 | 
MeanAbsoluteError: 0.1292580366134644 | Loss: 0.0273014176656337 | Epoch: 43 | 
MeanAbsoluteError: 0.1288748979568481 | Loss: 0.0266833678921345 | Epoch: 44 | 
MeanAbsoluteError: 0.1317290365695953 | Loss: 0.0277091647698156 | Epoch: 45 | 
MeanAbsoluteError: 0.1312966197729111 | Loss: 0.0281154887583155 | Epoch: 46 | 
MeanAbsoluteError: 0.1282702386379242 | Loss: 0.0272339328207575 | Epoch: 47 | 
MeanAbsoluteError: 0.1274122297763824 | Loss: 0.0273083293734817 | Epoch: 48 | 
MeanAbsoluteError: 0.1287680715322495 | Loss: 0.0274929765932029 | Epoch: 49 | 
MeanAbsoluteError: 0.1263497322797775 | Loss: 0.0265669695479543 | Epoch: 50 | 
MeanAbsoluteError: 0.1289729177951813 | Loss: 0.0278860222493919 | Epoch: 51 | 
MeanAbsoluteError: 0.1293365061283112 | Loss: 0.0273839892450390 | Epoch: 52 | 
MeanAbsoluteError: 0.1271700859069824 | Loss: 0.0265666486144376 | Epoch: 53 | 
MeanAbsoluteError: 0.1270207911729813 | Loss: 0.0270354962940110 | Epoch: 54 | 
MeanAbsoluteError: 0.1279944628477097 | Loss: 0.0269006764491011 | Epoch: 55 | 
MeanAbsoluteError: 0.1280926614999771 | Loss: 0.0270718594217033 | Epoch: 56 | 
MeanAbsoluteError: 0.1298025548458099 | Loss: 0.0269144302594941 | Epoch: 57 | 
MeanAbsoluteError: 0.1258192658424377 | Loss: 0.0268759703938849 | Epoch: 58 | 
MeanAbsoluteError: 0.1295852363109589 | Loss: 0.0270436101735686 | Epoch: 59 | 
MeanAbsoluteError: 0.1265488564968109 | Loss: 0.0267204396073551 | Epoch: 60 | 
MeanAbsoluteError: 0.1237979009747505 | Loss: 0.0264863197147376 | Epoch: 61 | 
MeanAbsoluteError: 0.1284715235233307 | Loss: 0.0269010719057830 | Epoch: 62 | 
MeanAbsoluteError: 0.1274104267358780 | Loss: 0.0266015811995506 | Epoch: 63 | 
MeanAbsoluteError: 0.1246495172381401 | Loss: 0.0262713203610959 | Epoch: 64 | 
MeanAbsoluteError: 0.1275535225868225 | Loss: 0.0277072369877715 | Epoch: 65 | 
MeanAbsoluteError: 0.1308088004589081 | Loss: 0.0276355221270933 | Epoch: 66 | 
MeanAbsoluteError: 0.1295672804117203 | Loss: 0.0277277243017064 | Epoch: 67 | 
MeanAbsoluteError: 0.1270465254783630 | Loss: 0.0267462816133533 | Epoch: 68 | 
MeanAbsoluteError: 0.1268158853054047 | Loss: 0.0264994471081688 | Epoch: 69 | 
MeanAbsoluteError: 0.1284733265638351 | Loss: 0.0266629659320461 | Epoch: 70 | 
MeanAbsoluteError: 0.1311332136392593 | Loss: 0.0275338177064320 | Epoch: 71 | 
MeanAbsoluteError: 0.1282575726509094 | Loss: 0.0271142028679121 | Epoch: 72 | 
MeanAbsoluteError: 0.1269020140171051 | Loss: 0.0268847974096813 | Epoch: 73 | 
MeanAbsoluteError: 0.1314021497964859 | Loss: 0.0273846473367424 | Epoch: 74 | 
MeanAbsoluteError: 0.1295284330844879 | Loss: 0.0274592219400074 | Epoch: 75 | 
MeanAbsoluteError: 0.1270292103290558 | Loss: 0.0264790398740539 | Epoch: 76 | 
MeanAbsoluteError: 0.1301124989986420 | Loss: 0.0278501162440322 | Epoch: 77 | 
MeanAbsoluteError: 0.1285019963979721 | Loss: 0.0271172195176041 | Epoch: 78 | 
MeanAbsoluteError: 0.1274753510951996 | Loss: 0.0267845926949910 | Epoch: 79 | 
MeanAbsoluteError: 0.1257493197917938 | Loss: 0.0258359265647596 | Epoch: 80 | 
MeanAbsoluteError: 0.1291931569576263 | Loss: 0.0279578925016540 | Epoch: 81 | 
MeanAbsoluteError: 0.1251598000526428 | Loss: 0.0254576608063265 | Epoch: 82 | 
MeanAbsoluteError: 0.1287410706281662 | Loss: 0.0265688695739179 | Epoch: 83 | 
MeanAbsoluteError: 0.1254981309175491 | Loss: 0.0261608382883181 | Epoch: 84 | 
MeanAbsoluteError: 0.1258307397365570 | Loss: 0.0254603145914977 | Epoch: 85 | 
MeanAbsoluteError: 0.1257123947143555 | Loss: 0.0268128746049479 | Epoch: 86 | 
MeanAbsoluteError: 0.1274431645870209 | Loss: 0.0267898252273638 | Epoch: 87 | 
MeanAbsoluteError: 0.1274195164442062 | Loss: 0.0266800032085060 | Epoch: 88 | 
MeanAbsoluteError: 0.1271768212318420 | Loss: 0.0270175966616565 | Epoch: 89 | 
MeanAbsoluteError: 0.1276493072509766 | Loss: 0.0268803880448589 | Epoch: 90 | 
MeanAbsoluteError: 0.1258430331945419 | Loss: 0.0266406158191967 | Epoch: 91 | 
MeanAbsoluteError: 0.1282989531755447 | Loss: 0.0280279256744325 | Epoch: 92 | 
MeanAbsoluteError: 0.1227452233433723 | Loss: 0.0253796326552159 | Epoch: 93 | 
MeanAbsoluteError: 0.1258153021335602 | Loss: 0.0265207273059544 | Epoch: 94 | 
MeanAbsoluteError: 0.1314909309148788 | Loss: 0.0280583311310329 | Epoch: 95 | 
MeanAbsoluteError: 0.1249741241335869 | Loss: 0.0263344278639609 | Epoch: 96 | 
MeanAbsoluteError: 0.1249646395444870 | Loss: 0.0263719909230106 | Epoch: 97 | 
MeanAbsoluteError: 0.1281134784221649 | Loss: 0.0277485038483671 | Epoch: 98 | 
MeanAbsoluteError: 0.1228562146425247 | Loss: 0.0247701680763081 | Epoch: 99 | 
MeanAbsoluteError: 0.1302743852138519 | Loss: 0.0280601238133386 | Epoch: 100 | 
MeanAbsoluteError: 0.1276168078184128 | Loss: 0.0260842501138298 | Epoch: 101 | 
MeanAbsoluteError: 0.1292039901018143 | Loss: 0.0268867193622282 | Epoch: 102 | 
MeanAbsoluteError: 0.1299726814031601 | Loss: 0.0277728307122015 | Epoch: 103 | 
MeanAbsoluteError: 0.1293202191591263 | Loss: 0.0270426685770023 | Epoch: 104 | 
MeanAbsoluteError: 0.1304493546485901 | Loss: 0.0277626610826701 | Epoch: 105 | 
MeanAbsoluteError: 0.1279255151748657 | Loss: 0.0271990619080437 | Epoch: 106 | 
MeanAbsoluteError: 0.1262729167938232 | Loss: 0.0266032559079273 | Epoch: 107 | 
MeanAbsoluteError: 0.1262089610099792 | Loss: 0.0266546245058028 | Epoch: 108 | 
MeanAbsoluteError: 0.1262970864772797 | Loss: 0.0264072214118399 | Epoch: 109 | 
MeanAbsoluteError: 0.1229232549667358 | Loss: 0.0251872689746475 | Epoch: 110 | 
MeanAbsoluteError: 0.1279698014259338 | Loss: 0.0269535544661630 | Epoch: 111 | 
MeanAbsoluteError: 0.1263606995344162 | Loss: 0.0255421969710248 | Epoch: 112 | 
MeanAbsoluteError: 0.1253151148557663 | Loss: 0.0264217836791067 | Epoch: 113 | 
MeanAbsoluteError: 0.1270378679037094 | Loss: 0.0260218667927741 | Epoch: 114 | 
MeanAbsoluteError: 0.1285784393548965 | Loss: 0.0260892601445569 | Epoch: 115 | 
MeanAbsoluteError: 0.1310714185237885 | Loss: 0.0277759253510158 | Epoch: 116 | 
MeanAbsoluteError: 0.1277997791767120 | Loss: 0.0268976706738128 | Epoch: 117 | 
MeanAbsoluteError: 0.1293750703334808 | Loss: 0.0270445472821787 | Epoch: 118 | 
MeanAbsoluteError: 0.1263696551322937 | Loss: 0.0264282538418774 | Epoch: 119 | 
MeanAbsoluteError: 0.1280913501977921 | Loss: 0.0264637799445093 | Epoch: 120 | 
MeanAbsoluteError: 0.1292262077331543 | Loss: 0.0270057924249462 | Epoch: 121 | 
MeanAbsoluteError: 0.1271984279155731 | Loss: 0.0260433915364653 | Epoch: 122 | 
MeanAbsoluteError: 0.1243688613176346 | Loss: 0.0263179327739878 | Epoch: 123 | 
MeanAbsoluteError: 0.1267984956502914 | Loss: 0.0272688230947824 | Epoch: 124 | 
MeanAbsoluteError: 0.1276752352714539 | Loss: 0.0267076607005826 | Epoch: 125 | 
MeanAbsoluteError: 0.1304469704627991 | Loss: 0.0270014498456051 | Epoch: 126 | 
MeanAbsoluteError: 0.1297636181116104 | Loss: 0.0265614341852779 | Epoch: 127 | 
MeanAbsoluteError: 0.1267556101083755 | Loss: 0.0261640376820772 | Epoch: 128 | 
MeanAbsoluteError: 0.1246914789080620 | Loss: 0.0257862723787912 | Epoch: 129 | 
MeanAbsoluteError: 0.1298929005861282 | Loss: 0.0281116822544027 | Epoch: 130 | 
MeanAbsoluteError: 0.1249397024512291 | Loss: 0.0257053977548882 | Epoch: 131 | 
MeanAbsoluteError: 0.1274957358837128 | Loss: 0.0272935207590005 | Epoch: 132 | 
MeanAbsoluteError: 0.1267165690660477 | Loss: 0.0265844066154386 | Epoch: 133 | 
MeanAbsoluteError: 0.1249929144978523 | Loss: 0.0242824657429204 | Epoch: 134 | 
MeanAbsoluteError: 0.1281521916389465 | Loss: 0.0265463342476384 | Epoch: 135 | 
MeanAbsoluteError: 0.1263331919908524 | Loss: 0.0265050234296602 | Epoch: 136 | 
MeanAbsoluteError: 0.1245691031217575 | Loss: 0.0258758975790503 | Epoch: 137 | 
MeanAbsoluteError: 0.1283690631389618 | Loss: 0.0265663440014274 | Epoch: 138 | 
MeanAbsoluteError: 0.1232256293296814 | Loss: 0.0260967146530796 | Epoch: 139 | 
MeanAbsoluteError: 0.1229017376899719 | Loss: 0.0254876439637155 | Epoch: 140 | 
MeanAbsoluteError: 0.1291151344776154 | Loss: 0.0273550233166407 | Epoch: 141 | 
MeanAbsoluteError: 0.1274841278791428 | Loss: 0.0266855402689544 | Epoch: 142 | 
MeanAbsoluteError: 0.1321513950824738 | Loss: 0.0274197864741533 | Epoch: 143 | 
MeanAbsoluteError: 0.1267387866973877 | Loss: 0.0254579650597104 | Epoch: 144 | 
MeanAbsoluteError: 0.1261513829231262 | Loss: 0.0254231113745482 | Epoch: 145 | 
MeanAbsoluteError: 0.1266850233078003 | Loss: 0.0258837325176379 | Epoch: 146 | 
MeanAbsoluteError: 0.1273324936628342 | Loss: 0.0258724498311252 | Epoch: 147 | 
MeanAbsoluteError: 0.1284706443548203 | Loss: 0.0268012152614150 | Epoch: 148 | 
MeanAbsoluteError: 0.1227068677544594 | Loss: 0.0250557425290511 | Epoch: 149 | 
MeanAbsoluteError: 0.1229768618941307 | Loss: 0.0251230984852494 | Epoch: 150 | 
MeanAbsoluteError: 0.1231495440006256 | Loss: 0.0253890097965814 | Epoch: 151 | 
MeanAbsoluteError: 0.1282660216093063 | Loss: 0.0270411750494774 | Epoch: 152 | 
MeanAbsoluteError: 0.1174519583582878 | Loss: 0.0245257598730192 | Epoch: 153 | 
MeanAbsoluteError: 0.1288040429353714 | Loss: 0.0261827692090689 | Epoch: 154 | 
MeanAbsoluteError: 0.1249107718467712 | Loss: 0.0252220756999547 | Epoch: 155 | 
MeanAbsoluteError: 0.1267158836126328 | Loss: 0.0260786364956099 | Epoch: 156 | 
MeanAbsoluteError: 0.1258791685104370 | Loss: 0.0265074526409201 | Epoch: 157 | 
MeanAbsoluteError: 0.1251357197761536 | Loss: 0.0251470457095032 | Epoch: 158 | 
MeanAbsoluteError: 0.1275046765804291 | Loss: 0.0268740058462330 | Epoch: 159 | 
MeanAbsoluteError: 0.1236916109919548 | Loss: 0.0248551576481744 | Epoch: 160 | 
MeanAbsoluteError: 0.1283152699470520 | Loss: 0.0278045782840248 | Epoch: 161 | 
MeanAbsoluteError: 0.1281623244285583 | Loss: 0.0262476051319391 | Epoch: 162 | 
MeanAbsoluteError: 0.1252334266901016 | Loss: 0.0257837437851898 | Epoch: 163 | 
MeanAbsoluteError: 0.1221790090203285 | Loss: 0.0247614111055736 | Epoch: 164 | 
MeanAbsoluteError: 0.1211759299039841 | Loss: 0.0244968626648066 | Epoch: 165 | 
MeanAbsoluteError: 0.1184776574373245 | Loss: 0.0250672624159809 | Epoch: 166 | 
MeanAbsoluteError: 0.1282489448785782 | Loss: 0.0272124911482873 | Epoch: 167 | 
MeanAbsoluteError: 0.1275444924831390 | Loss: 0.0263843223191119 | Epoch: 168 | 
MeanAbsoluteError: 0.1241131201386452 | Loss: 0.0255502102083604 | Epoch: 169 | 
MeanAbsoluteError: 0.1238500848412514 | Loss: 0.0261504141715704 | Epoch: 170 | 
MeanAbsoluteError: 0.1268853694200516 | Loss: 0.0254687473300146 | Epoch: 171 | 
MeanAbsoluteError: 0.1274765431880951 | Loss: 0.0264402764776848 | Epoch: 172 | 
MeanAbsoluteError: 0.1247872933745384 | Loss: 0.0256785257182006 | Epoch: 173 | 
MeanAbsoluteError: 0.1228190958499908 | Loss: 0.0248443450694564 | Epoch: 174 | 
MeanAbsoluteError: 0.1230476275086403 | Loss: 0.0244290292326332 | Epoch: 175 | 
MeanAbsoluteError: 0.1262668073177338 | Loss: 0.0267840295259536 | Epoch: 176 | 
MeanAbsoluteError: 0.1288088709115982 | Loss: 0.0269924719415333 | Epoch: 177 | 
MeanAbsoluteError: 0.1244065091013908 | Loss: 0.0260225333118190 | Epoch: 178 | 
MeanAbsoluteError: 0.1213441565632820 | Loss: 0.0245976270279304 | Epoch: 179 | 
MeanAbsoluteError: 0.1288704425096512 | Loss: 0.0261625228843332 | Epoch: 180 | 
MeanAbsoluteError: 0.1209281757473946 | Loss: 0.0245390282981922 | Epoch: 181 | 
MeanAbsoluteError: 0.1275695562362671 | Loss: 0.0263882727443706 | Epoch: 182 | 
MeanAbsoluteError: 0.1223098337650299 | Loss: 0.0243605811961849 | Epoch: 183 | 
MeanAbsoluteError: 0.1253885328769684 | Loss: 0.0263168567204654 | Epoch: 184 | 
MeanAbsoluteError: 0.1258746981620789 | Loss: 0.0258553577138809 | Epoch: 185 | 
MeanAbsoluteError: 0.1214182823896408 | Loss: 0.0255009953076175 | Epoch: 186 | 
MeanAbsoluteError: 0.1244157627224922 | Loss: 0.0254235086997505 | Epoch: 187 | 
MeanAbsoluteError: 0.1234458759427071 | Loss: 0.0247334814368029 | Epoch: 188 | 
MeanAbsoluteError: 0.1277476251125336 | Loss: 0.0269817785813939 | Epoch: 189 | 
MeanAbsoluteError: 0.1226269900798798 | Loss: 0.0246425236959476 | Epoch: 190 | 
MeanAbsoluteError: 0.1217502951622009 | Loss: 0.0243382091437767 | Epoch: 191 | 
MeanAbsoluteError: 0.1252538561820984 | Loss: 0.0250893245195039 | Epoch: 192 | 
MeanAbsoluteError: 0.1232189461588860 | Loss: 0.0241208042815560 | Epoch: 193 | 
MeanAbsoluteError: 0.1181051135063171 | Loss: 0.0245130395279072 | Epoch: 194 | 
MeanAbsoluteError: 0.1193992644548416 | Loss: 0.0237623605150778 | Epoch: 195 | 
MeanAbsoluteError: 0.1262214332818985 | Loss: 0.0254042702957910 | Epoch: 196 | 
MeanAbsoluteError: 0.1276382356882095 | Loss: 0.0257615320648377 | Epoch: 197 | 
MeanAbsoluteError: 0.1281724721193314 | Loss: 0.0274715572709829 | Epoch: 198 | 
MeanAbsoluteError: 0.1217612326145172 | Loss: 0.0252958266824377 | Epoch: 199 | 
MeanAbsoluteError: 0.1232008859515190 | Loss: 0.0252692776520295 | Epoch: 200 | 
MeanAbsoluteError: 0.1217600107192993 | Loss: 0.0248212775365876 | Epoch: 201 | 
MeanAbsoluteError: 0.1250593662261963 | Loss: 0.0248191917132741 | Epoch: 202 | 
MeanAbsoluteError: 0.1250228732824326 | Loss: 0.0246364101234576 | Epoch: 203 | 
MeanAbsoluteError: 0.1260859370231628 | Loss: 0.0265473399093510 | Epoch: 204 | 
MeanAbsoluteError: 0.1196770220994949 | Loss: 0.0237290434801253 | Epoch: 205 | 
MeanAbsoluteError: 0.1294351667165756 | Loss: 0.0277534730448194 | Epoch: 206 | 
MeanAbsoluteError: 0.1250063776969910 | Loss: 0.0245467372804220 | Epoch: 207 | 
MeanAbsoluteError: 0.1206320300698280 | Loss: 0.0251305501088306 | Epoch: 208 | 
MeanAbsoluteError: 0.1225442662835121 | Loss: 0.0239632942263658 | Epoch: 209 | 
MeanAbsoluteError: 0.1226943433284760 | Loss: 0.0240814697775204 | Epoch: 210 | 
MeanAbsoluteError: 0.1178548559546471 | Loss: 0.0232877981684093 | Epoch: 211 | 
MeanAbsoluteError: 0.1178724914789200 | Loss: 0.0234902899483010 | Epoch: 212 | 
MeanAbsoluteError: 0.1261524111032486 | Loss: 0.0271816289025931 | Epoch: 213 | 
MeanAbsoluteError: 0.1254207193851471 | Loss: 0.0252202423286508 | Epoch: 214 | 
MeanAbsoluteError: 0.1220773309469223 | Loss: 0.0250870575165997 | Epoch: 215 | 
MeanAbsoluteError: 0.1200960129499435 | Loss: 0.0236727703736202 | Epoch: 216 | 
MeanAbsoluteError: 0.1245300918817520 | Loss: 0.0246593751426796 | Epoch: 217 | 
MeanAbsoluteError: 0.1233514025807381 | Loss: 0.0254181742470246 | Epoch: 218 | 
MeanAbsoluteError: 0.1244238540530205 | Loss: 0.0249699351566990 | Epoch: 219 | 
MeanAbsoluteError: 0.1177687942981720 | Loss: 0.0228922928697284 | Epoch: 220 | 
MeanAbsoluteError: 0.1229540631175041 | Loss: 0.0232648654454715 | Epoch: 221 | 
MeanAbsoluteError: 0.1169819533824921 | Loss: 0.0229923148493011 | Epoch: 222 | 
MeanAbsoluteError: 0.1243974268436432 | Loss: 0.0257226379855031 | Epoch: 223 | MeanAbsoluteError: 0.1235198304057121 | Loss: 0.0244101720710751 | Epoch: 224 | 
MeanAbsoluteError: 0.1221108660101891 | Loss: 0.0240980412387095 | Epoch: 225 | MeanAbsoluteError: 0.1262190788984299 | Loss: 0.0255857649156193 | 
Epoch: 226 | 
MeanAbsoluteError: 0.1303817480802536 | Loss: 0.0267818356906840 | Epoch: 227 | 
MeanAbsoluteError: 0.1242330521345139 | Loss: 0.0249707129149465 | Epoch: 228 | MeanAbsoluteError: 0.1194009110331535 | Loss: 0.0242462040234144 | 
Epoch: 229 | 
MeanAbsoluteError: 0.1215517967939377 | Loss: 0.0235283989416591 | Epoch: 230 | 
MeanAbsoluteError: 0.1260516196489334 | Loss: 0.0247083936964191 | Epoch: 231 | 
MeanAbsoluteError: 0.1236908882856369 | Loss: 0.0249598389473977 | Epoch: 232 | 
MeanAbsoluteError: 0.1188591793179512 | Loss: 0.0234567357742344 | Epoch: 233 | 
MeanAbsoluteError: 0.1215015798807144 | Loss: 0.0231724975537509 | Epoch: 234 | 
MeanAbsoluteError: 0.1171121746301651 | Loss: 0.0232418374952006 | Epoch: 235 | 
MeanAbsoluteError: 0.1200275272130966 | Loss: 0.0239610015567329 | Epoch: 236 | MeanAbsoluteError: 0.1290446519851685 | Loss: 0.0269760655125720 | Epoch: 237 | 
MeanAbsoluteError: 0.1216948032379150 | Loss: 0.0244442893383287 | Epoch: 238 | MeanAbsoluteError: 0.1260020881891251 | Loss: 0.0253784762506742 | 
Epoch: 239 | 
MeanAbsoluteError: 0.1205223724246025 | Loss: 0.0244185891626936 | Epoch: 240 | MeanAbsoluteError: 0.1203150451183319 | Loss: 0.0231297666593067 | 
Epoch: 241 | 
MeanAbsoluteError: 0.1206090450286865 | Loss: 0.0245205799777371 | Epoch: 242 | 
MeanAbsoluteError: 0.1244349703192711 | Loss: 0.0257810783028151 | Epoch: 243 | 
MeanAbsoluteError: 0.1261664032936096 | Loss: 0.0258528501851348 | Epoch: 244 | 
MeanAbsoluteError: 0.1169305443763733 | Loss: 0.0231018148643003 | Epoch: 245 | 
MeanAbsoluteError: 0.1193901598453522 | Loss: 0.0225160753495099 | Epoch: 246 | 
MeanAbsoluteError: 0.1202266588807106 | Loss: 0.0246745338726517 | Epoch: 247 | 
MeanAbsoluteError: 0.1150268018245697 | Loss: 0.0228754782360799 | Epoch: 248 | MeanAbsoluteError: 0.1212256625294685 | Loss: 0.0234655221972935 | 
Epoch: 249 | 
MeanAbsoluteError: 0.1239097714424133 | Loss: 0.0255074419165976 | Epoch: 250 | MeanAbsoluteError: 0.1217732504010201 | Loss: 0.0245675212769614 | 
Epoch: 251 | 
MeanAbsoluteError: 0.1196418628096581 | Loss: 0.0231697324688624 | Epoch: 252 | 
MeanAbsoluteError: 0.1205672323703766 | Loss: 0.0238207235197448 | Epoch: 253 | MeanAbsoluteError: 0.1172203570604324 | Loss: 0.0223486496297240 | 
Epoch: 254 | 
MeanAbsoluteError: 0.1204604059457779 | Loss: 0.0234729421716717 | Epoch: 255 | MeanAbsoluteError: 0.1171985268592834 | Loss: 0.0228326212901932 | 
Epoch: 256 | 
MeanAbsoluteError: 0.1212934330105782 | Loss: 0.0248364521913512 | Epoch: 257 | 
MeanAbsoluteError: 0.1218501031398773 | Loss: 0.0251468701521420 | Epoch: 258 | 
MeanAbsoluteError: 0.1167827472090721 | Loss: 0.0220921086598537 | Epoch: 259 | MeanAbsoluteError: 0.1225574463605881 | Loss: 0.0240582411540284 | Epoch: 260 | 
MeanAbsoluteError: 0.1206003427505493 | Loss: 0.0233953804142463 | Epoch: 261 | 
MeanAbsoluteError: 0.1175554245710373 | Loss: 0.0231947922477654 | Epoch: 262 | MeanAbsoluteError: 0.1214633211493492 | Loss: 0.0230667531174549 | 
Epoch: 263 | MeanAbsoluteError: 0.1194924935698509 | Loss: 0.0244988047635949 | Epoch: 264 | 
MeanAbsoluteError: 0.1214776486158371 | Loss: 0.0242716153627650 | Epoch: 265 | MeanAbsoluteError: 0.1210695430636406 | Loss: 0.0251524821396257 | 
Epoch: 266 | 
MeanAbsoluteError: 0.1227644607424736 | Loss: 0.0245207756728632 | Epoch: 267 | 
MeanAbsoluteError: 0.1249113082885742 | Loss: 0.0249231072507488 | Epoch: 268 | 
MeanAbsoluteError: 0.1185615509748459 | Loss: 0.0223681534682692 | Epoch: 269 | MeanAbsoluteError: 0.1197065487504005 | Loss: 0.0238802415259609 | 
Epoch: 270 | 
MeanAbsoluteError: 0.1268927603960037 | Loss: 0.0260394804429961 | Epoch: 271 | MeanAbsoluteError: 0.1227156668901443 | Loss: 0.0246263159830899 | 
Epoch: 272 | MeanAbsoluteError: 0.1201130151748657 | Loss: 0.0240622084815186 | Epoch: 273 | 
MeanAbsoluteError: 0.1216487511992455 | Loss: 0.0238991049281321 | Epoch: 274 | MeanAbsoluteError: 0.1186709105968475 | Loss: 0.0222911625990431 | 
Epoch: 275 | MeanAbsoluteError: 0.1231149062514305 | Loss: 0.0244690727155345 | 
Epoch: 276 | 
MeanAbsoluteError: 0.1202613413333893 | Loss: 0.0230156781810122 | Epoch: 277 | MeanAbsoluteError: 0.1166344955563545 | Loss: 0.0228732625217162 | 
Epoch: 278 | MeanAbsoluteError: 0.1231908947229385 | Loss: 0.0239133667738255 | 
Epoch: 279 | MeanAbsoluteError: 0.1218987032771111 | Loss: 0.0239296703173507 | 
Epoch: 280 | MeanAbsoluteError: 0.1143383681774139 | Loss: 0.0214089341425764 | Epoch: 281 | 
MeanAbsoluteError: 0.1152838170528412 | Loss: 0.0223052642180119 | Epoch: 282 | 
MeanAbsoluteError: 0.1205451041460037 | Loss: 0.0234476938411050 | Epoch: 283 | 
MeanAbsoluteError: 0.1220461130142212 | Loss: 0.0239683037262876 | Epoch: 284 | MeanAbsoluteError: 0.1190551519393921 | Loss: 0.0237350993629661 | 
Epoch: 285 | MeanAbsoluteError: 0.1201073676347733 | Loss: 0.0233496499923543 | Epoch: 286 | 
MeanAbsoluteError: 0.1152789443731308 | Loss: 0.0213530939406094 | Epoch: 287 | MeanAbsoluteError: 0.1190806850790977 | Loss: 0.0231452527932318 | 
Epoch: 288 | MeanAbsoluteError: 0.1138155236840248 | Loss: 0.0214904712772841 | 
Epoch: 289 | MeanAbsoluteError: 0.1183066144585609 | Loss: 0.0225589690063498 | 
Epoch: 290 | MeanAbsoluteError: 0.1153899505734444 | Loss: 0.0225554487369178 | Epoch: 291 | 
MeanAbsoluteError: 0.1205148473381996 | Loss: 0.0236445212998660 | Epoch: 292 | 
MeanAbsoluteError: 0.1200763806700706 | Loss: 0.0232863564377703 | Epoch: 293 | 
MeanAbsoluteError: 0.1135963276028633 | Loss: 0.0208953681814455 | Epoch: 294 | 
MeanAbsoluteError: 0.1170440316200256 | Loss: 0.0219887436997669 | Epoch: 295 | 
MeanAbsoluteError: 0.1237962990999222 | Loss: 0.0250117100082571 | Epoch: 296 | 
MeanAbsoluteError: 0.1148732006549835 | Loss: 0.0220939146927170 | Epoch: 297 | 
MeanAbsoluteError: 0.1173302456736565 | Loss: 0.0230617262314809 | Epoch: 298 | 
MeanAbsoluteError: 0.1151757687330246 | Loss: 0.0217379280389287 | Epoch: 299 | MeanAbsoluteError: 0.1220011785626411 | Loss: 0.0249443685352647 | 
Epoch: 300 | 
MeanAbsoluteError: 0.1149630621075630 | Loss: 0.0226113181928425 | Epoch: 301 | 
MeanAbsoluteError: 0.1233971118927002 | Loss: 0.0234046257962473 | Epoch: 302 | MeanAbsoluteError: 0.1184995546936989 | Loss: 0.0231774416237992 | 
Epoch: 303 | MeanAbsoluteError: 0.1156401336193085 | Loss: 0.0222966737891450 | 
Epoch: 304 | 
MeanAbsoluteError: 0.1237171962857246 | Loss: 0.0239866879929711 | Epoch: 305 | MeanAbsoluteError: 0.1172227486968040 | Loss: 0.0225741579991882 | 
Epoch: 306 | 
MeanAbsoluteError: 0.1152120977640152 | Loss: 0.0214464093210700 | Epoch: 307 | 
MeanAbsoluteError: 0.1173054873943329 | Loss: 0.0226736574942576 | Epoch: 308 | MeanAbsoluteError: 0.1217757910490036 | Loss: 0.0251292172148048 | Epoch: 309 | 
MeanAbsoluteError: 0.1164209619164467 | Loss: 0.0223684598892093 | Epoch: 310 | MeanAbsoluteError: 0.1187366992235184 | Loss: 0.0233779225175628 | Epoch: 311 | 
MeanAbsoluteError: 0.1149239838123322 | Loss: 0.0214802439956596 | Epoch: 312 | 
MeanAbsoluteError: 0.1194129809737206 | Loss: 0.0237363090349694 | Epoch: 313 | 
MeanAbsoluteError: 0.1178379803895950 | Loss: 0.0225885391149010 | Epoch: 314 | 
MeanAbsoluteError: 0.1274621486663818 | Loss: 0.0254272003846321 | Epoch: 315 | 
MeanAbsoluteError: 0.1203947812318802 | Loss: 0.0228395949438467 | Epoch: 316 | 
MeanAbsoluteError: 0.1224687546491623 | Loss: 0.0241162454901981 | Epoch: 317 | 
MeanAbsoluteError: 0.1225944906473160 | Loss: 0.0241748928484352 | Epoch: 318 | 
MeanAbsoluteError: 0.1174458786845207 | Loss: 0.0228923060727539 | Epoch: 319 | MeanAbsoluteError: 0.1146612837910652 | Loss: 0.0213051523329098 | 
Epoch: 320 | MeanAbsoluteError: 0.1211938485503197 | Loss: 0.0233427957633103 | Epoch: 321 | 
MeanAbsoluteError: 0.1129488497972488 | Loss: 0.0215949949537753 | Epoch: 322 | 
MeanAbsoluteError: 0.1251284480094910 | Loss: 0.0249484217648084 | Epoch: 323 | MeanAbsoluteError: 0.1146386712789536 | Loss: 0.0218623299948134 | 
Epoch: 324 | 
MeanAbsoluteError: 0.1161561682820320 | Loss: 0.0225554254594802 | Epoch: 325 | MeanAbsoluteError: 0.1174706742167473 | Loss: 0.0224796895787586 | 
Epoch: 326 | MeanAbsoluteError: 0.1124466061592102 | Loss: 0.0206882543546574 | 
Epoch: 327 | MeanAbsoluteError: 0.1125646308064461 | Loss: 0.0209143083659001 | 
Epoch: 328 | MeanAbsoluteError: 0.1106811538338661 | Loss: 0.0205393939451703 | 
Epoch: 329 | MeanAbsoluteError: 0.1205495223402977 | Loss: 0.0231176830147160 | 
Epoch: 330 | MeanAbsoluteError: 0.1168560013175011 | Loss: 0.0229822399026792 | 
Epoch: 331 | MeanAbsoluteError: 0.1198332086205482 | Loss: 0.0232020274178528 | 
Epoch: 332 | 
MeanAbsoluteError: 0.1161526367068291 | Loss: 0.0227044501974403 | Epoch: 333 | MeanAbsoluteError: 0.1123912185430527 | Loss: 0.0205132553675746 | Epoch: 334 | 
MeanAbsoluteError: 0.1188278049230576 | Loss: 0.0228772153809162 | Epoch: 335 | 
MeanAbsoluteError: 0.1158842369914055 | Loss: 0.0211482760335396 | Epoch: 336 | MeanAbsoluteError: 0.1111297234892845 | Loss: 0.0206482743879800 | 
Epoch: 337 | MeanAbsoluteError: 0.1184876263141632 | Loss: 0.0227431129717055 | Epoch: 338 | 
MeanAbsoluteError: 0.1180168911814690 | Loss: 0.0225341576997501 | Epoch: 339 | 
MeanAbsoluteError: 0.1179928854107857 | Loss: 0.0223297876003926 | Epoch: 340 | 
MeanAbsoluteError: 0.1188248321413994 | Loss: 0.0225399632396875 | Epoch: 341 | 
MeanAbsoluteError: 0.1193658858537674 | Loss: 0.0229450882909199 | Epoch: 342 | 
MeanAbsoluteError: 0.1176074370741844 | Loss: 0.0225225872992693 | Epoch: 343 | 
MeanAbsoluteError: 0.1120129525661469 | Loss: 0.0208672646159054 | Epoch: 344 | MeanAbsoluteError: 0.1072963103652000 | Loss: 0.0193328193095901 | 
Epoch: 345 | MeanAbsoluteError: 0.1144194677472115 | Loss: 0.0210863712425150 | 
Epoch: 346 | 
MeanAbsoluteError: 0.1141861379146576 | Loss: 0.0210847896721073 | Epoch: 347 | 
MeanAbsoluteError: 0.1136732846498489 | Loss: 0.0209066335393679 | Epoch: 348 | MeanAbsoluteError: 0.1162676364183426 | Loss: 0.0224749756811555 | 
Epoch: 349 | MeanAbsoluteError: 0.1174222305417061 | Loss: 0.0227060273408036 | Epoch: 350 | 
MeanAbsoluteError: 0.1124298721551895 | Loss: 0.0205368519131055 | Epoch: 351 | MeanAbsoluteError: 0.1134537756443024 | Loss: 0.0215011636062991 | 
Epoch: 352 | MeanAbsoluteError: 0.1183082610368729 | Loss: 0.0229579146333041 | 
Epoch: 353 | 
MeanAbsoluteError: 0.1152101159095764 | Loss: 0.0213190090145023 | Epoch: 354 | MeanAbsoluteError: 0.1089946478605270 | Loss: 0.0200856052781334 | Epoch: 355 | 
MeanAbsoluteError: 0.1091477572917938 | Loss: 0.0195654893902247 | Epoch: 356 | 
MeanAbsoluteError: 0.1151931136846542 | Loss: 0.0214725800459079 | Epoch: 357 | 
MeanAbsoluteError: 0.1139367148280144 | Loss: 0.0212455780592669 | Epoch: 358 | 
MeanAbsoluteError: 0.1201814785599709 | Loss: 0.0233484294487668 | Epoch: 359 | 
MeanAbsoluteError: 0.1140871718525887 | Loss: 0.0208187216145840 | Epoch: 360 | MeanAbsoluteError: 0.1148395016789436 | Loss: 0.0223351383000651 | 
Epoch: 361 | MeanAbsoluteError: 0.1132430657744408 | Loss: 0.0202571175187525 | 
Epoch: 362 | MeanAbsoluteError: 0.1132954433560371 | Loss: 0.0214550772198224 | Epoch: 363 | 
MeanAbsoluteError: 0.1159745529294014 | Loss: 0.0211182378622955 | Epoch: 364 | 
MeanAbsoluteError: 0.1204751059412956 | Loss: 0.0232486718030608 | Epoch: 365 | 
MeanAbsoluteError: 0.1221903115510941 | Loss: 0.0241964138175050 | Epoch: 366 | MeanAbsoluteError: 0.1122211292386055 | Loss: 0.0207658377002614 | 
Epoch: 367 | 
MeanAbsoluteError: 0.1096213534474373 | Loss: 0.0194815217462019 | Epoch: 368 | 
MeanAbsoluteError: 0.1157890483736992 | Loss: 0.0210688598681979 | Epoch: 369 | 
MeanAbsoluteError: 0.1154494509100914 | Loss: 0.0236352594211348 | Epoch: 370 | MeanAbsoluteError: 0.1100044995546341 | Loss: 0.0201255751662635 | 
Epoch: 371 | 
MeanAbsoluteError: 0.1176503971219063 | Loss: 0.0214192213420756 | Epoch: 372 | MeanAbsoluteError: 0.1186127737164497 | Loss: 0.0223189677763245 | 
Epoch: 373 | 
MeanAbsoluteError: 0.1138149276375771 | Loss: 0.0205933330949241 | Epoch: 374 | 
MeanAbsoluteError: 0.1124522686004639 | Loss: 0.0201905379394399 | Epoch: 375 | MeanAbsoluteError: 0.1124351099133492 | Loss: 0.0206701890402474 | 
Epoch: 376 | MeanAbsoluteError: 0.1112532541155815 | Loss: 0.0199392477738790 | 
Epoch: 377 | MeanAbsoluteError: 0.1165968850255013 | Loss: 0.0215326044347603 | 
Epoch: 378 | 
MeanAbsoluteError: 0.1192753463983536 | Loss: 0.0235380110202338 | Epoch: 379 | 
MeanAbsoluteError: 0.1146788373589516 | Loss: 0.0217224176726692 | Epoch: 380 | MeanAbsoluteError: 0.1093887165188789 | Loss: 0.0190112697223473 | 
Epoch: 381 | MeanAbsoluteError: 0.1139978542923927 | Loss: 0.0221144948016930 | Epoch: 382 | 
MeanAbsoluteError: 0.1121679842472076 | Loss: 0.0205759198993474 | Epoch: 383 | 
MeanAbsoluteError: 0.1161942034959793 | Loss: 0.0216678714774874 | Epoch: 384 | 
MeanAbsoluteError: 0.1132017746567726 | Loss: 0.0214914176226497 | Epoch: 385 | MeanAbsoluteError: 0.1125351339578629 | Loss: 0.0216097992309369 | 
Epoch: 386 | MeanAbsoluteError: 0.1143845617771149 | Loss: 0.0215209922425129 | 
Epoch: 387 | 
MeanAbsoluteError: 0.1142784133553505 | Loss: 0.0217137805087259 | Epoch: 388 | 
MeanAbsoluteError: 0.1107266843318939 | Loss: 0.0211247344915561 | Epoch: 389 | 
MeanAbsoluteError: 0.1120016500353813 | Loss: 0.0198979545754022 | Epoch: 390 | 
MeanAbsoluteError: 0.1138659939169884 | Loss: 0.0209360362620646 | Epoch: 391 | 
MeanAbsoluteError: 0.1117540374398232 | Loss: 0.0209056926226155 | Epoch: 392 | 
MeanAbsoluteError: 0.1060031056404114 | Loss: 0.0178454120641982 | Epoch: 393 | MeanAbsoluteError: 0.1140504851937294 | Loss: 0.0200391498724639 | 
Epoch: 394 | 
MeanAbsoluteError: 0.1138610094785690 | Loss: 0.0210635045732003 | Epoch: 395 | 
MeanAbsoluteError: 0.1141640692949295 | Loss: 0.0215360572271553 | Epoch: 396 | 
MeanAbsoluteError: 0.1189307942986488 | Loss: 0.0235949377374103 | Epoch: 397 | 
MeanAbsoluteError: 0.1079745516180992 | Loss: 0.0189774788052697 | Epoch: 398 | 
MeanAbsoluteError: 0.1102911010384560 | Loss: 0.0199786246553170 | Epoch: 399 | 
MeanAbsoluteError: 0.1146251037716866 | Loss: 0.0206784738335409 | Epoch: 400 | 
MeanAbsoluteError: 0.1168952062726021 | Loss: 0.0215997736474189 | Epoch: 401 | 
MeanAbsoluteError: 0.1099215820431709 | Loss: 0.0200120342216784 | Epoch: 402 | 
MeanAbsoluteError: 0.1140449643135071 | Loss: 0.0209911050998198 | Epoch: 403 | MeanAbsoluteError: 0.1111587360501289 | Loss: 0.0201140325395378 | 
Epoch: 404 | MeanAbsoluteError: 0.1126073598861694 | Loss: 0.0222964669593299 | 
Epoch: 405 | MeanAbsoluteError: 0.1161445379257202 | Loss: 0.0218129108229186 | Epoch: 406 | 
MeanAbsoluteError: 0.1025420874357224 | Loss: 0.0170635877140254 | Epoch: 407 | 
MeanAbsoluteError: 0.1099018231034279 | Loss: 0.0203406969399718 | Epoch: 408 | 
MeanAbsoluteError: 0.1219169721007347 | Loss: 0.0236436332806867 | Epoch: 409 | 
MeanAbsoluteError: 0.1104287877678871 | Loss: 0.0203950086988273 | Epoch: 410 | MeanAbsoluteError: 0.1106413379311562 | Loss: 0.0195115149752625 | 
Epoch: 411 | MeanAbsoluteError: 0.1134453490376472 | Loss: 0.0211695539875169 | 
Epoch: 412 | MeanAbsoluteError: 0.1118364855647087 | Loss: 0.0203389934578930 | 
Epoch: 413 | 
MeanAbsoluteError: 0.1058793440461159 | Loss: 0.0190703416320806 | Epoch: 414 | 
MeanAbsoluteError: 0.1050413399934769 | Loss: 0.0190597239333632 | Epoch: 415 | 
MeanAbsoluteError: 0.1069965586066246 | Loss: 0.0189699352767154 | Epoch: 416 | MeanAbsoluteError: 0.1120396032929420 | Loss: 0.0206693510842160 | Epoch: 417 | 
MeanAbsoluteError: 0.1112992763519287 | Loss: 0.0202907635819914 | Epoch: 418 | MeanAbsoluteError: 0.1115342602133751 | Loss: 0.0204824629403690 | 
Epoch: 419 | MeanAbsoluteError: 0.1091386303305626 | Loss: 0.0200577650257522 | 
Epoch: 420 | MeanAbsoluteError: 0.1114372611045837 | Loss: 0.0195238992014977 | 
Epoch: 421 | MeanAbsoluteError: 0.1105079501867294 | Loss: 0.0200907055560674 | Epoch: 422 | 
MeanAbsoluteError: 0.1122846826910973 | Loss: 0.0202957607065521 | Epoch: 423 | 
MeanAbsoluteError: 0.1134943664073944 | Loss: 0.0209597903979496 | Epoch: 424 | 
MeanAbsoluteError: 0.1099628731608391 | Loss: 0.0198976233912617 | Epoch: 425 | 
MeanAbsoluteError: 0.1074872314929962 | Loss: 0.0184298550390910 | Epoch: 426 | MeanAbsoluteError: 0.1060255318880081 | Loss: 0.0180349898036851 | 
Epoch: 427 | 
MeanAbsoluteError: 0.1067961603403091 | Loss: 0.0189812191430125 | Epoch: 428 | 
MeanAbsoluteError: 0.1107726916670799 | Loss: 0.0196563279970576 | Epoch: 429 | 
MeanAbsoluteError: 0.1039937660098076 | Loss: 0.0178507626337038 | Epoch: 430 | 
MeanAbsoluteError: 0.1152602657675743 | Loss: 0.0213247689965647 | Epoch: 431 | MeanAbsoluteError: 0.1065768748521805 | Loss: 0.0191787688978851 | 
Epoch: 432 | MeanAbsoluteError: 0.1081743985414505 | Loss: 0.0196512265128937 | 
Epoch: 433 | MeanAbsoluteError: 0.1131374612450600 | Loss: 0.0208312512552463 | 
Epoch: 434 | 
MeanAbsoluteError: 0.1126370728015900 | Loss: 0.0204462138027884 | Epoch: 435 | 
MeanAbsoluteError: 0.1105848848819733 | Loss: 0.0197761881557138 | Epoch: 436 | MeanAbsoluteError: 0.1078645735979080 | Loss: 0.0191360157605474 | 
Epoch: 437 | MeanAbsoluteError: 0.1081829741597176 | Loss: 0.0199784294657184 | Epoch: 438 | 
MeanAbsoluteError: 0.1087886020541191 | Loss: 0.0193302929373264 | Epoch: 439 | 
MeanAbsoluteError: 0.1055235639214516 | Loss: 0.0184507830508664 | Epoch: 440 | MeanAbsoluteError: 0.1092723608016968 | Loss: 0.0201252459713335 | 
Epoch: 441 | 
MeanAbsoluteError: 0.1121366769075394 | Loss: 0.0203578371047236 | Epoch: 442 | 
MeanAbsoluteError: 0.1078839600086212 | Loss: 0.0185276531545484 | Epoch: 443 | MeanAbsoluteError: 0.1096212863922119 | Loss: 0.0202923448034335 | 
Epoch: 444 | 
MeanAbsoluteError: 0.1111598461866379 | Loss: 0.0203891880630787 | Epoch: 445 | 
MeanAbsoluteError: 0.1109410971403122 | Loss: 0.0204977853260546 | Epoch: 446 | 
MeanAbsoluteError: 0.1047794073820114 | Loss: 0.0187588703717241 | Epoch: 447 | 
MeanAbsoluteError: 0.1032050177454948 | Loss: 0.0183709355279764 | Epoch: 448 | 
MeanAbsoluteError: 0.1027021408081055 | Loss: 0.0173780729569747 | Epoch: 449 | 
MeanAbsoluteError: 0.1080451831221581 | Loss: 0.0193756380333131 | Epoch: 450 | 
MeanAbsoluteError: 0.1077416837215424 | Loss: 0.0183523920836160 | Epoch: 451 | MeanAbsoluteError: 0.1048254817724228 | Loss: 0.0178249830707015 | 
Epoch: 452 | 
MeanAbsoluteError: 0.1057790666818619 | Loss: 0.0185019657539184 | Epoch: 453 | 
MeanAbsoluteError: 0.1071599721908569 | Loss: 0.0200165319573231 | Epoch: 454 | 
MeanAbsoluteError: 0.1096796914935112 | Loss: 0.0194581934325591 | Epoch: 455 | 
MeanAbsoluteError: 0.1080341190099716 | Loss: 0.0208792306904797 | Epoch: 456 | 
MeanAbsoluteError: 0.1048747971653938 | Loss: 0.0190175970656370 | Epoch: 457 | 
MeanAbsoluteError: 0.1099504604935646 | Loss: 0.0196791773844355 | Epoch: 458 | 
MeanAbsoluteError: 0.1045039892196655 | Loss: 0.0182045333499264 | Epoch: 459 | 
MeanAbsoluteError: 0.1052615493535995 | Loss: 0.0185222477456409 | Epoch: 460 | 
MeanAbsoluteError: 0.1127508133649826 | Loss: 0.0207546464254422 | Epoch: 461 | 
MeanAbsoluteError: 0.1054803654551506 | Loss: 0.0191281324336645 | Epoch: 462 | 
MeanAbsoluteError: 0.1077136844396591 | Loss: 0.0190649881926098 | Epoch: 463 | 
MeanAbsoluteError: 0.1031266301870346 | Loss: 0.0171521282572940 | Epoch: 464 | 
MeanAbsoluteError: 0.1053140684962273 | Loss: 0.0181306064106078 | Epoch: 465 | 
MeanAbsoluteError: 0.1123087331652641 | Loss: 0.0211908594857960 | Epoch: 466 | 
MeanAbsoluteError: 0.1124177277088165 | Loss: 0.0213538915832275 | Epoch: 467 | 
MeanAbsoluteError: 0.1099998354911804 | Loss: 0.0196402860959643 | Epoch: 468 | 
MeanAbsoluteError: 0.1045606583356857 | Loss: 0.0190302192702317 | Epoch: 469 | 
MeanAbsoluteError: 0.1092386245727539 | Loss: 0.0193406329602779 | Epoch: 470 | 
MeanAbsoluteError: 0.1047090366482735 | Loss: 0.0180840824490345 | Epoch: 471 | 
MeanAbsoluteError: 0.1097614318132401 | Loss: 0.0193447970240959 | Epoch: 472 | 
MeanAbsoluteError: 0.1072610989212990 | Loss: 0.0200021076650592 | Epoch: 473 | 
MeanAbsoluteError: 0.1058957129716873 | Loss: 0.0180609531278606 | Epoch: 474 | 
MeanAbsoluteError: 0.1093868985772133 | Loss: 0.0192204931349261 | Epoch: 475 | 
MeanAbsoluteError: 0.1061858832836151 | Loss: 0.0185479683677355 | Epoch: 476 | 
MeanAbsoluteError: 0.1064695343375206 | Loss: 0.0190399838701645 | Epoch: 477 | 
MeanAbsoluteError: 0.1051656305789948 | Loss: 0.0184663967553145 | Epoch: 478 | 
MeanAbsoluteError: 0.1043271943926811 | Loss: 0.0181205158686013 | Epoch: 479 | 
MeanAbsoluteError: 0.1092506572604179 | Loss: 0.0188120211641459 | Epoch: 480 | 
MeanAbsoluteError: 0.1081049889326096 | Loss: 0.0195367666603609 | Epoch: 481 | 
MeanAbsoluteError: 0.1111646816134453 | Loss: 0.0206518376107852 | Epoch: 482 | 
MeanAbsoluteError: 0.1067446544766426 | Loss: 0.0189102723761365 | Epoch: 483 | 
MeanAbsoluteError: 0.1069771572947502 | Loss: 0.0184874792830063 | Epoch: 484 | 
MeanAbsoluteError: 0.1070499196648598 | Loss: 0.0192251519220493 | Epoch: 485 | 
MeanAbsoluteError: 0.1063282936811447 | Loss: 0.0178543047950370 | Epoch: 486 | 
MeanAbsoluteError: 0.1028483361005783 | Loss: 0.0172796297558428 | Epoch: 487 | 
MeanAbsoluteError: 0.0982882454991341 | Loss: 0.0169526712723988 | Epoch: 488 | 
MeanAbsoluteError: 0.1061766967177391 | Loss: 0.0181519037784165 | Epoch: 489 | 
MeanAbsoluteError: 0.1090507283806801 | Loss: 0.0194250878627645 | Epoch: 490 | 
MeanAbsoluteError: 0.1051526218652725 | Loss: 0.0184907814522739 | Epoch: 491 | 
MeanAbsoluteError: 0.1069169342517853 | Loss: 0.0186960819839927 | Epoch: 492 | 
MeanAbsoluteError: 0.1050663441419601 | Loss: 0.0185836636446281 | Epoch: 493 | 
MeanAbsoluteError: 0.1058423146605492 | Loss: 0.0182319339807858 | Epoch: 494 | 
MeanAbsoluteError: 0.1085148602724075 | Loss: 0.0192022799470578 | Epoch: 495 | 
MeanAbsoluteError: 0.1037621274590492 | Loss: 0.0179783985312315 | Epoch: 496 | 
MeanAbsoluteError: 0.1029782518744469 | Loss: 0.0177003130872617 | Epoch: 497 | 
MeanAbsoluteError: 0.1050393804907799 | Loss: 0.0180967735184822 | Epoch: 498 | 
MeanAbsoluteError: 0.1111681908369064 | Loss: 0.0193052893026227 | Epoch: 499 | 
MeanAbsoluteError: 0.1054508686065674 | Loss: 0.0184395503912068 | Epoch: 500 | 
MeanAbsoluteError: 0.1033028438687325 | Loss: 0.0185718655094388 | Epoch: 501 | 
MeanAbsoluteError: 0.1034333705902100 | Loss: 0.0180791442478949 | Epoch: 502 | 
MeanAbsoluteError: 0.1121982857584953 | Loss: 0.0199097541211207 | Epoch: 503 | 
MeanAbsoluteError: 0.1012641936540604 | Loss: 0.0175646452865719 | Epoch: 504 | 
MeanAbsoluteError: 0.1041248068213463 | Loss: 0.0172203031688938 | Epoch: 505 | 
MeanAbsoluteError: 0.1089893728494644 | Loss: 0.0192037861079734 | Epoch: 506 | 
MeanAbsoluteError: 0.0995503365993500 | Loss: 0.0174846071295009 | Epoch: 507 | 
MeanAbsoluteError: 0.1048380061984062 | Loss: 0.0186670419979570 | Epoch: 508 | 
MeanAbsoluteError: 0.1018332391977310 | Loss: 0.0162055602573673 | Epoch: 509 | 
MeanAbsoluteError: 0.1067211404442787 | Loss: 0.0185688463795183 | Epoch: 510 | 
MeanAbsoluteError: 0.1056406721472740 | Loss: 0.0180923358134654 | Epoch: 511 | 
MeanAbsoluteError: 0.1073437258601189 | Loss: 0.0180807479522385 | Epoch: 512 | 
MeanAbsoluteError: 0.1018644124269485 | Loss: 0.0171477293630596 | Epoch: 513 | 
MeanAbsoluteError: 0.0983493179082870 | Loss: 0.0161446507693715 | Epoch: 514 | 
MeanAbsoluteError: 0.1016005724668503 | Loss: 0.0174755219699000 | Epoch: 515 | 
MeanAbsoluteError: 0.1064597293734550 | Loss: 0.0192001887634008 | Epoch: 516 | 
MeanAbsoluteError: 0.0974328964948654 | Loss: 0.0163360014774177 | Epoch: 517 | 
MeanAbsoluteError: 0.1041125059127808 | Loss: 0.0175526035405831 | Epoch: 518 | 
MeanAbsoluteError: 0.1029879748821259 | Loss: 0.0177151972234909 | Epoch: 519 | 
MeanAbsoluteError: 0.1023287251591682 | Loss: 0.0168019721903450 | Epoch: 520 | 
MeanAbsoluteError: 0.1008856520056725 | Loss: 0.0174761512224116 | Epoch: 521 | 
MeanAbsoluteError: 0.1026103496551514 | Loss: 0.0175074554139671 | Epoch: 522 | 
MeanAbsoluteError: 0.1111264675855637 | Loss: 0.0197274142778285 | Epoch: 523 | 
MeanAbsoluteError: 0.1036160141229630 | Loss: 0.0182641460329614 | Epoch: 524 | 
MeanAbsoluteError: 0.1059733554720879 | Loss: 0.0184806841185006 | Epoch: 525 | 
MeanAbsoluteError: 0.1077455654740334 | Loss: 0.0193321030160102 | Epoch: 526 | 
MeanAbsoluteError: 0.1000378429889679 | Loss: 0.0173757580043093 | Epoch: 527 | 
MeanAbsoluteError: 0.1005928516387939 | Loss: 0.0177941929931694 | Epoch: 528 | 
MeanAbsoluteError: 0.0986546799540520 | Loss: 0.0163089140340647 | Epoch: 529 | 
MeanAbsoluteError: 0.1095010265707970 | Loss: 0.0188999854379411 | Epoch: 530 | 
MeanAbsoluteError: 0.1034931614995003 | Loss: 0.0180130533214833 | Epoch: 531 | 
MeanAbsoluteError: 0.1028421819210052 | Loss: 0.0167634829402474 | Epoch: 532 | 
MeanAbsoluteError: 0.1020027697086334 | Loss: 0.0173117576443474 | Epoch: 533 | 
MeanAbsoluteError: 0.1045951247215271 | Loss: 0.0179184063861127 | Epoch: 534 | 
MeanAbsoluteError: 0.1036185920238495 | Loss: 0.0173841216385093 | Epoch: 535 | 
MeanAbsoluteError: 0.0991597175598145 | Loss: 0.0161222725195694 | Epoch: 536 | 
MeanAbsoluteError: 0.1063578203320503 | Loss: 0.0184577531765293 | Epoch: 537 | 
MeanAbsoluteError: 0.1024966165423393 | Loss: 0.0167330475380732 | Epoch: 538 | 
MeanAbsoluteError: 0.1022238433361053 | Loss: 0.0165505753110726 | Epoch: 539 | 
MeanAbsoluteError: 0.1077656075358391 | Loss: 0.0187425992486533 | Epoch: 540 | 
MeanAbsoluteError: 0.0968084707856178 | Loss: 0.0152177766066817 | Epoch: 541 | 
MeanAbsoluteError: 0.0957460477948189 | Loss: 0.0153126350572711 | Epoch: 542 | 
MeanAbsoluteError: 0.1000461727380753 | Loss: 0.0166222645266923 | Epoch: 543 | 
MeanAbsoluteError: 0.1047977581620216 | Loss: 0.0185365320813677 | Epoch: 544 | 
MeanAbsoluteError: 0.1000418886542320 | Loss: 0.0182775770754961 | Epoch: 545 | 
MeanAbsoluteError: 0.0967819094657898 | Loss: 0.0161495606097257 | Epoch: 546 | 
MeanAbsoluteError: 0.0994831770658493 | Loss: 0.0166432016370042 | Epoch: 547 | 
MeanAbsoluteError: 0.0981779918074608 | Loss: 0.0168105395492360 | Epoch: 548 | 
MeanAbsoluteError: 0.1013365387916565 | Loss: 0.0167703708920938 | Epoch: 549 | 
MeanAbsoluteError: 0.0998711809515953 | Loss: 0.0171294100239174 | Epoch: 550 | 
MeanAbsoluteError: 0.0991242676973343 | Loss: 0.0173586843260697 | Epoch: 551 | 
MeanAbsoluteError: 0.0975798517465591 | Loss: 0.0153231647198360 | Epoch: 552 | 
MeanAbsoluteError: 0.1017773598432541 | Loss: 0.0166249855861921 | Epoch: 553 | 
MeanAbsoluteError: 0.0972071290016174 | Loss: 0.0165257393887805 | Epoch: 554 | 
MeanAbsoluteError: 0.0984334275126457 | Loss: 0.0158290209861298 | Epoch: 555 | 
MeanAbsoluteError: 0.1016365066170692 | Loss: 0.0170877837741379 | Epoch: 556 | 
MeanAbsoluteError: 0.0949864611029625 | Loss: 0.0158636089132536 | Epoch: 557 | 
MeanAbsoluteError: 0.0977094992995262 | Loss: 0.0169964239608089 | Epoch: 558 | 
MeanAbsoluteError: 0.0965513363480568 | Loss: 0.0155295364744112 | Epoch: 559 | 
MeanAbsoluteError: 0.0916410163044930 | Loss: 0.0144365066140987 | Epoch: 560 | 
MeanAbsoluteError: 0.0986627414822578 | Loss: 0.0153781755737145 | Epoch: 561 | 
MeanAbsoluteError: 0.0992661789059639 | Loss: 0.0162426265556132 | Epoch: 562 | 
MeanAbsoluteError: 0.1056438162922859 | Loss: 0.0179667600743899 | Epoch: 563 | 
MeanAbsoluteError: 0.1036620587110519 | Loss: 0.0173848233448128 | Epoch: 564 | 
MeanAbsoluteError: 0.1008339896798134 | Loss: 0.0166954496557203 | Epoch: 565 | 
MeanAbsoluteError: 0.1033020690083504 | Loss: 0.0172393361131738 | Epoch: 566 | 
MeanAbsoluteError: 0.0985452458262444 | Loss: 0.0158412123294086 | Epoch: 567 | 
MeanAbsoluteError: 0.0966590046882629 | Loss: 0.0155633481970290 | Epoch: 568 | 
MeanAbsoluteError: 0.0965000838041306 | Loss: 0.0158282044289323 | Epoch: 569 | 
MeanAbsoluteError: 0.0938652306795120 | Loss: 0.0157174817913134 | Epoch: 570 | 
MeanAbsoluteError: 0.0971868634223938 | Loss: 0.0152036488015680 | Epoch: 571 | 
MeanAbsoluteError: 0.0976239740848541 | Loss: 0.0162508915116632 | Epoch: 572 | 
MeanAbsoluteError: 0.1023496463894844 | Loss: 0.0179904699228306 | Epoch: 573 | 
MeanAbsoluteError: 0.1057886630296707 | Loss: 0.0186330913434116 | Epoch: 574 | 
MeanAbsoluteError: 0.1063495799899101 | Loss: 0.0182715391284728 | Epoch: 575 | 
MeanAbsoluteError: 0.1021667867898941 | Loss: 0.0167955265212125 | Epoch: 576 | 
MeanAbsoluteError: 0.0964000672101974 | Loss: 0.0159471078883507 | Epoch: 577 | 
MeanAbsoluteError: 0.0964375659823418 | Loss: 0.0149016282744560 | Epoch: 578 | 
MeanAbsoluteError: 0.0981053188443184 | Loss: 0.0160649696843272 | Epoch: 579 | 
MeanAbsoluteError: 0.0982892513275146 | Loss: 0.0162119729327484 | Epoch: 580 | 
MeanAbsoluteError: 0.0971998944878578 | Loss: 0.0160651781485164 | Epoch: 581 | 
MeanAbsoluteError: 0.0966883525252342 | Loss: 0.0159653324291442 | Epoch: 582 | 
MeanAbsoluteError: 0.1022556126117706 | Loss: 0.0170496873979816 | Epoch: 583 | 
MeanAbsoluteError: 0.1001680716872215 | Loss: 0.0172060123447348 | Epoch: 584 | 
MeanAbsoluteError: 0.1007959321141243 | Loss: 0.0171146582166936 | Epoch: 585 | 
MeanAbsoluteError: 0.0952490270137787 | Loss: 0.0141580119781914 | Epoch: 586 | 
MeanAbsoluteError: 0.0955220907926559 | Loss: 0.0154504491847183 | Epoch: 587 | 
MeanAbsoluteError: 0.1020119190216064 | Loss: 0.0174271692284189 | Epoch: 588 | 
MeanAbsoluteError: 0.0977933183312416 | Loss: 0.0161638874185761 | Epoch: 589 | 
MeanAbsoluteError: 0.1019045859575272 | Loss: 0.0176625805395694 | Epoch: 590 | 
MeanAbsoluteError: 0.1021035611629486 | Loss: 0.0180144511610221 | Epoch: 591 | 
MeanAbsoluteError: 0.1055828481912613 | Loss: 0.0184446361654288 | Epoch: 592 | 
MeanAbsoluteError: 0.0971306413412094 | Loss: 0.0148761961826676 | Epoch: 593 | 
MeanAbsoluteError: 0.0994997546076775 | Loss: 0.0170712210101192 | Epoch: 594 | 
MeanAbsoluteError: 0.0948349833488464 | Loss: 0.0149982487137459 | Epoch: 595 | 
MeanAbsoluteError: 0.1018685996532440 | Loss: 0.0171831170436902 | Epoch: 596 | 
MeanAbsoluteError: 0.1035825982689857 | Loss: 0.0189560226214235 | Epoch: 597 | 
MeanAbsoluteError: 0.0898749828338623 | Loss: 0.0145800809006808 | Epoch: 598 | 
MeanAbsoluteError: 0.0954632237553596 | Loss: 0.0149080001657906 | Epoch: 599 | 
MeanAbsoluteError: 0.0938707366585732 | Loss: 0.0142562387881723 | Epoch: 600 | 
MeanAbsoluteError: 0.0991406515240669 | Loss: 0.0156693647547703 | Epoch: 601 | 
MeanAbsoluteError: 0.1036648675799370 | Loss: 0.0176376876773429 | Epoch: 602 | 
MeanAbsoluteError: 0.0990258529782295 | Loss: 0.0167410717192494 | Epoch: 603 | 
MeanAbsoluteError: 0.0991589128971100 | Loss: 0.0157412033772622 | Epoch: 604 | 
MeanAbsoluteError: 0.0956952124834061 | Loss: 0.0151544138839624 | Epoch: 605 | 
MeanAbsoluteError: 0.0959919244050980 | Loss: 0.0152873448120954 | Epoch: 606 | 
MeanAbsoluteError: 0.0986571907997131 | Loss: 0.0166608868480337 | Epoch: 607 | 
MeanAbsoluteError: 0.0894979909062386 | Loss: 0.0149056707603692 | Epoch: 608 | 
MeanAbsoluteError: 0.0991910696029663 | Loss: 0.0159729160319936 | Epoch: 609 | 
MeanAbsoluteError: 0.1023504212498665 | Loss: 0.0177421980457924 | Epoch: 610 | 
MeanAbsoluteError: 0.0984010770916939 | Loss: 0.0163563329244547 | Epoch: 611 | 
MeanAbsoluteError: 0.1006080657243729 | Loss: 0.0167430227449707 | Epoch: 612 | 
MeanAbsoluteError: 0.0987238138914108 | Loss: 0.0164173974147100 | Epoch: 613 | 
MeanAbsoluteError: 0.0915517359972000 | Loss: 0.0143809679155432 | Epoch: 614 | 
MeanAbsoluteError: 0.0899464637041092 | Loss: 0.0131250896931306 | Epoch: 615 | 
MeanAbsoluteError: 0.0920626297593117 | Loss: 0.0137892742795975 | Epoch: 616 | 
MeanAbsoluteError: 0.0972831174731255 | Loss: 0.0152246236059000 | Epoch: 617 | 
MeanAbsoluteError: 0.0981414094567299 | Loss: 0.0160176271759944 | Epoch: 618 | 
MeanAbsoluteError: 0.0962992534041405 | Loss: 0.0153088440730547 | Epoch: 619 | 
MeanAbsoluteError: 0.0999752506613731 | Loss: 0.0169127532860148 | Epoch: 620 | 
MeanAbsoluteError: 0.0937448069453239 | Loss: 0.0147565515071619 | Epoch: 621 | 
MeanAbsoluteError: 0.0968071594834328 | Loss: 0.0156368070765166 | Epoch: 622 | 
MeanAbsoluteError: 0.0998653173446655 | Loss: 0.0167350592199364 | Epoch: 623 | 
MeanAbsoluteError: 0.0921605676412582 | Loss: 0.0140624608326470 | Epoch: 624 | 
MeanAbsoluteError: 0.0984031409025192 | Loss: 0.0163133661535297 | Epoch: 625 | 
MeanAbsoluteError: 0.0976839810609818 | Loss: 0.0163178977970771 | Epoch: 626 | 
MeanAbsoluteError: 0.1021412312984467 | Loss: 0.0178150567380362 | Epoch: 627 | 
MeanAbsoluteError: 0.0933820828795433 | Loss: 0.0149830158314338 | Epoch: 628 | 
MeanAbsoluteError: 0.0936914905905724 | Loss: 0.0149004963831976 | Epoch: 629 | 
MeanAbsoluteError: 0.0929592102766037 | Loss: 0.0151987803130275 | Epoch: 630 | 
MeanAbsoluteError: 0.0992168262600899 | Loss: 0.0163632883310978 | Epoch: 631 | 
MeanAbsoluteError: 0.0924168750643730 | Loss: 0.0147067143334910 | Epoch: 632 | 
MeanAbsoluteError: 0.0925002992153168 | Loss: 0.0137776648267754 | Epoch: 633 | 
MeanAbsoluteError: 0.0996461361646652 | Loss: 0.0162838718511436 | Epoch: 634 | 
MeanAbsoluteError: 0.0908901542425156 | Loss: 0.0138354752965036 | Epoch: 635 | 
MeanAbsoluteError: 0.0943921506404877 | Loss: 0.0153116699003537 | Epoch: 636 | 
MeanAbsoluteError: 0.0983828529715538 | Loss: 0.0162021155821276 | Epoch: 637 | 
MeanAbsoluteError: 0.0958603248000145 | Loss: 0.0148534738235564 | Epoch: 638 | 
MeanAbsoluteError: 0.0974648073315620 | Loss: 0.0160409137816411 | Epoch: 639 | 
MeanAbsoluteError: 0.0949994251132011 | Loss: 0.0154549964934995 | Epoch: 640 | 
MeanAbsoluteError: 0.0959820672869682 | Loss: 0.0157775198526118 | Epoch: 641 | 
MeanAbsoluteError: 0.0915736034512520 | Loss: 0.0147742954505520 | Epoch: 642 | 
MeanAbsoluteError: 0.1029129326343536 | Loss: 0.0179682637300054 | Epoch: 643 | 
MeanAbsoluteError: 0.0977876707911491 | Loss: 0.0164800719711153 | Epoch: 644 | 
MeanAbsoluteError: 0.1014000698924065 | Loss: 0.0167665147141694 | Epoch: 645 | 
MeanAbsoluteError: 0.0955473482608795 | Loss: 0.0154922209509944 | Epoch: 646 | 
MeanAbsoluteError: 0.0924907177686691 | Loss: 0.0150665790298748 | Epoch: 647 | 
MeanAbsoluteError: 0.0938669368624687 | Loss: 0.0144680825946004 | Epoch: 648 | 
MeanAbsoluteError: 0.0879606753587723 | Loss: 0.0146665584995450 | Epoch: 649 | 
MeanAbsoluteError: 0.0871637836098671 | Loss: 0.0126462054468963 | Epoch: 650 | 
MeanAbsoluteError: 0.0991797074675560 | Loss: 0.0160685585359533 | Epoch: 651 | 
MeanAbsoluteError: 0.0923891291022301 | Loss: 0.0145093286546034 | Epoch: 652 | 
MeanAbsoluteError: 0.0981099084019661 | Loss: 0.0175745330435166 | Epoch: 653 | 
MeanAbsoluteError: 0.0966252833604813 | Loss: 0.0157153930565354 | Epoch: 654 | 
MeanAbsoluteError: 0.0955988392233849 | Loss: 0.0150515035894932 | Epoch: 655 | 
MeanAbsoluteError: 0.0974342003464699 | Loss: 0.0168738812833908 | Epoch: 656 | 
MeanAbsoluteError: 0.0924386084079742 | Loss: 0.0148557328289068 | Epoch: 657 | 
MeanAbsoluteError: 0.0997181981801987 | Loss: 0.0159533967164559 | Epoch: 658 | 
MeanAbsoluteError: 0.0951269790530205 | Loss: 0.0154796181770953 | Epoch: 659 | 
MeanAbsoluteError: 0.0992441326379776 | Loss: 0.0163594162492033 | Epoch: 660 | 
MeanAbsoluteError: 0.0870714634656906 | Loss: 0.0137660027265398 | Epoch: 661 | 
MeanAbsoluteError: 0.0963858291506767 | Loss: 0.0156075492320815 | Epoch: 662 | 
MeanAbsoluteError: 0.1023838818073273 | Loss: 0.0169916269955381 | Epoch: 663 | 
MeanAbsoluteError: 0.0929759666323662 | Loss: 0.0151205363031234 | Epoch: 664 | 
MeanAbsoluteError: 0.0953603312373161 | Loss: 0.0159091208797569 | Epoch: 665 | 
MeanAbsoluteError: 0.0964830890297890 | Loss: 0.0163943427138535 | Epoch: 666 | 
MeanAbsoluteError: 0.0967492237687111 | Loss: 0.0158299448085018 | Epoch: 667 | 
MeanAbsoluteError: 0.0942273736000061 | Loss: 0.0146629354376152 | Epoch: 668 | 
MeanAbsoluteError: 0.0995192602276802 | Loss: 0.0167689061405448 | Epoch: 669 | 
MeanAbsoluteError: 0.0944493710994720 | Loss: 0.0150443492850657 | Epoch: 670 | 
MeanAbsoluteError: 0.0983238518238068 | Loss: 0.0160817699143081 | Epoch: 671 | 
MeanAbsoluteError: 0.0977324321866035 | Loss: 0.0166618579400044 | Epoch: 672 | 
MeanAbsoluteError: 0.0945104733109474 | Loss: 0.0149295916938824 | Epoch: 673 | 
MeanAbsoluteError: 0.0895805209875107 | Loss: 0.0146929149007580 | Epoch: 674 | 
MeanAbsoluteError: 0.0923970192670822 | Loss: 0.0146255422434357 | Epoch: 675 | 
MeanAbsoluteError: 0.0957006514072418 | Loss: 0.0149610077409307 | Epoch: 676 | 
MeanAbsoluteError: 0.0900438353419304 | Loss: 0.0133846045312748 | Epoch: 677 | 
MeanAbsoluteError: 0.0932398885488510 | Loss: 0.0152802845256520 | Epoch: 678 | 
MeanAbsoluteError: 0.0919127687811852 | Loss: 0.0144098645410850 | Epoch: 679 | 
MeanAbsoluteError: 0.0924439951777458 | Loss: 0.0138074047576811 | Epoch: 680 | 
MeanAbsoluteError: 0.0940561667084694 | Loss: 0.0162835719190237 | Epoch: 681 | 
MeanAbsoluteError: 0.0924582257866859 | Loss: 0.0147226894988368 | Epoch: 682 | 
MeanAbsoluteError: 0.0946274548768997 | Loss: 0.0149721043500661 | Epoch: 683 | 
MeanAbsoluteError: 0.0869927257299423 | Loss: 0.0127120091140114 | Epoch: 684 | 
MeanAbsoluteError: 0.0908119529485703 | Loss: 0.0136182271740836 | Epoch: 685 | 
MeanAbsoluteError: 0.0879271253943443 | Loss: 0.0128837078004532 | Epoch: 686 | 
MeanAbsoluteError: 0.0919343978166580 | Loss: 0.0135608499794459 | Epoch: 687 | 
MeanAbsoluteError: 0.0938471406698227 | Loss: 0.0150266592081365 | Epoch: 688 | 
MeanAbsoluteError: 0.0907789841294289 | Loss: 0.0141536141804439 | Epoch: 689 | 
MeanAbsoluteError: 0.0933983251452446 | Loss: 0.0150642287060327 | Epoch: 690 | 
MeanAbsoluteError: 0.0901884064078331 | Loss: 0.0144109858425933 | Epoch: 691 | 
MeanAbsoluteError: 0.0879632011055946 | Loss: 0.0138156074239184 | Epoch: 692 | 
MeanAbsoluteError: 0.0911311730742455 | Loss: 0.0144295989996560 | Epoch: 693 | 
MeanAbsoluteError: 0.1003509089350700 | Loss: 0.0166307314361135 | Epoch: 694 | 
MeanAbsoluteError: 0.0871712788939476 | Loss: 0.0127307614510452 | Epoch: 695 | 
MeanAbsoluteError: 0.0991902574896812 | Loss: 0.0170431839809559 | Epoch: 696 | 
MeanAbsoluteError: 0.0867665261030197 | Loss: 0.0122707903054834 | Epoch: 697 | 
MeanAbsoluteError: 0.0938550904393196 | Loss: 0.0148354972058830 | Epoch: 698 | 
MeanAbsoluteError: 0.0816858261823654 | Loss: 0.0116383856926950 | Epoch: 699 | 
MeanAbsoluteError: 0.0943992733955383 | Loss: 0.0162377221308998 | Epoch: 700 | 
MeanAbsoluteError: 0.0924285650253296 | Loss: 0.0135552534977129 | Epoch: 701 | 
MeanAbsoluteError: 0.0935317352414131 | Loss: 0.0152494879954611 | Epoch: 702 | 
MeanAbsoluteError: 0.0953548550605774 | Loss: 0.0154050846563769 | Epoch: 703 | 
MeanAbsoluteError: 0.0894265770912170 | Loss: 0.0135528358977657 | Epoch: 704 | 
MeanAbsoluteError: 0.0922556295990944 | Loss: 0.0143245523367417 | Epoch: 705 | 
MeanAbsoluteError: 0.0963410586118698 | Loss: 0.0168658703129040 | Epoch: 706 | 
MeanAbsoluteError: 0.0925026237964630 | Loss: 0.0146460348689895 | Epoch: 707 | 
MeanAbsoluteError: 0.0873633474111557 | Loss: 0.0135313592524350 | Epoch: 708 | 
MeanAbsoluteError: 0.0939099341630936 | Loss: 0.0141468388817642 | Epoch: 709 | 
MeanAbsoluteError: 0.0920238941907883 | Loss: 0.0139975084098114 | Epoch: 710 | 
MeanAbsoluteError: 0.0827618688344955 | Loss: 0.0118657636426512 | Epoch: 711 | 
MeanAbsoluteError: 0.0893041267991066 | Loss: 0.0143449539114469 | Epoch: 712 | 
MeanAbsoluteError: 0.0954639017581940 | Loss: 0.0160103465299471 | Epoch: 713 | 
MeanAbsoluteError: 0.0863977745175362 | Loss: 0.0127266296451368 | Epoch: 714 | 
MeanAbsoluteError: 0.0910070613026619 | Loss: 0.0134041573029632 | Epoch: 715 | 
MeanAbsoluteError: 0.0913464352488518 | Loss: 0.0144172037358051 | Epoch: 716 | 
MeanAbsoluteError: 0.0953437834978104 | Loss: 0.0149114057798094 | Epoch: 717 | 
MeanAbsoluteError: 0.0947113558650017 | Loss: 0.0150121717826066 | Epoch: 718 | 
MeanAbsoluteError: 0.0872437953948975 | Loss: 0.0136311113425957 | Epoch: 719 | 
MeanAbsoluteError: 0.0913559347391129 | Loss: 0.0145207647865512 | Epoch: 720 | 
MeanAbsoluteError: 0.0941783934831619 | Loss: 0.0149929877082225 | Epoch: 721 | 
MeanAbsoluteError: 0.0917710587382317 | Loss: 0.0134310949016071 | Epoch: 722 | 
MeanAbsoluteError: 0.0860369503498077 | Loss: 0.0125679287321206 | Epoch: 723 | 
MeanAbsoluteError: 0.0942544266581535 | Loss: 0.0155194802815822 | Epoch: 724 | 
MeanAbsoluteError: 0.0918127223849297 | Loss: 0.0138776901075713 | Epoch: 725 | 
MeanAbsoluteError: 0.0853195413947105 | Loss: 0.0130463086248104 | Epoch: 726 | 
MeanAbsoluteError: 0.0942899733781815 | Loss: 0.0154948412012163 | Epoch: 727 | 
MeanAbsoluteError: 0.0929641574621201 | Loss: 0.0145041096036099 | Epoch: 728 | 
MeanAbsoluteError: 0.0906566828489304 | Loss: 0.0139942052489884 | Epoch: 729 | 
MeanAbsoluteError: 0.0867295190691948 | Loss: 0.0134193564300949 | Epoch: 730 | 
MeanAbsoluteError: 0.0914596319198608 | Loss: 0.0138015089398444 | Epoch: 731 | 
MeanAbsoluteError: 0.0869269892573357 | Loss: 0.0132089514336500 | Epoch: 732 | 
MeanAbsoluteError: 0.0873283669352531 | Loss: 0.0137341069531976 | Epoch: 733 | 
MeanAbsoluteError: 0.0932632461190224 | Loss: 0.0145120307814129 | Epoch: 734 | 
MeanAbsoluteError: 0.0894854515790939 | Loss: 0.0139444764492024 | Epoch: 735 | 
MeanAbsoluteError: 0.0907288268208504 | Loss: 0.0141855161250714 | Epoch: 736 | 
MeanAbsoluteError: 0.0888077095150948 | Loss: 0.0136812632332537 | Epoch: 737 | 
MeanAbsoluteError: 0.0917812883853912 | Loss: 0.0142194264760959 | Epoch: 738 | 
MeanAbsoluteError: 0.0959126576781273 | Loss: 0.0156937681113292 | Epoch: 739 | 
MeanAbsoluteError: 0.0962710529565811 | Loss: 0.0161879706704106 | Epoch: 740 | 
MeanAbsoluteError: 0.0926849693059921 | Loss: 0.0141635530692292 | Epoch: 741 | 
MeanAbsoluteError: 0.0868639051914215 | Loss: 0.0128033614273591 | Epoch: 742 | 
MeanAbsoluteError: 0.0853101760149002 | Loss: 0.0119755603721084 | Epoch: 743 | 
MeanAbsoluteError: 0.0898127332329750 | Loss: 0.0134858075715965 | Epoch: 744 | 
MeanAbsoluteError: 0.0899120867252350 | Loss: 0.0135118172971306 | Epoch: 745 | 
MeanAbsoluteError: 0.0885064601898193 | Loss: 0.0135539328497058 | Epoch: 746 | 
MeanAbsoluteError: 0.0922390818595886 | Loss: 0.0145748031366384 | Epoch: 747 | 
MeanAbsoluteError: 0.0886254161596298 | Loss: 0.0129564287962664 | Epoch: 748 | 
MeanAbsoluteError: 0.0893342494964600 | Loss: 0.0142027887910566 | Epoch: 749 | 
MeanAbsoluteError: 0.0939878448843956 | Loss: 0.0146272350488016 | Epoch: 750 | 
MeanAbsoluteError: 0.0880578681826591 | Loss: 0.0127172450619886 | Epoch: 751 | 
MeanAbsoluteError: 0.0930289179086685 | Loss: 0.0143410575182255 | Epoch: 752 | 
MeanAbsoluteError: 0.0850253999233246 | Loss: 0.0124274987626510 | Epoch: 753 | 
MeanAbsoluteError: 0.0916183739900589 | Loss: 0.0139422912001586 | Epoch: 754 | 
MeanAbsoluteError: 0.0931582897901535 | Loss: 0.0147614577386169 | Epoch: 755 | 
MeanAbsoluteError: 0.0879132300615311 | Loss: 0.0135193385735329 | Epoch: 756 | 
MeanAbsoluteError: 0.0892444252967834 | Loss: 0.0130889576218518 | Epoch: 757 | 
MeanAbsoluteError: 0.0834388211369514 | Loss: 0.0127539721110710 | Epoch: 758 | 
MeanAbsoluteError: 0.0891023129224777 | Loss: 0.0129073039164117 | Epoch: 759 | 
MeanAbsoluteError: 0.0819920375943184 | Loss: 0.0114960092145338 | Epoch: 760 | 
MeanAbsoluteError: 0.0884372293949127 | Loss: 0.0134676260623655 | Epoch: 761 | 
MeanAbsoluteError: 0.0844760164618492 | Loss: 0.0122891277244101 | Epoch: 762 | 
MeanAbsoluteError: 0.0867143943905830 | Loss: 0.0131740048213578 | Epoch: 763 | 
MeanAbsoluteError: 0.0871374383568764 | Loss: 0.0129752854970866 | Epoch: 764 | 
MeanAbsoluteError: 0.0832744464278221 | Loss: 0.0114184871824060 | Epoch: 765 | 
MeanAbsoluteError: 0.0863066092133522 | Loss: 0.0131613200573338 | Epoch: 766 | 
MeanAbsoluteError: 0.0888545960187912 | Loss: 0.0135947683189988 | Epoch: 767 | 
MeanAbsoluteError: 0.0849562808871269 | Loss: 0.0120620973510389 | Epoch: 768 | 
MeanAbsoluteError: 0.0868842080235481 | Loss: 0.0127979694514458 | Epoch: 769 | 
MeanAbsoluteError: 0.0919987037777901 | Loss: 0.0141404241129203 | Epoch: 770 | 
MeanAbsoluteError: 0.0949999392032623 | Loss: 0.0152391682419936 | Epoch: 771 | 
MeanAbsoluteError: 0.0863811448216438 | Loss: 0.0123480506124785 | Epoch: 772 | 
MeanAbsoluteError: 0.0916225165128708 | Loss: 0.0142663508794309 | Epoch: 773 | 
MeanAbsoluteError: 0.0836758688092232 | Loss: 0.0127257299787743 | Epoch: 774 | 
MeanAbsoluteError: 0.0883963182568550 | Loss: 0.0137475387056626 | Epoch: 775 | 
MeanAbsoluteError: 0.0900346189737320 | Loss: 0.0134276046326462 | Epoch: 776 | 
MeanAbsoluteError: 0.0832481905817986 | Loss: 0.0114031407003252 | Epoch: 777 | 
MeanAbsoluteError: 0.0847537815570831 | Loss: 0.0126537108204017 | Epoch: 778 | 
MeanAbsoluteError: 0.0799710452556610 | Loss: 0.0109770287739351 | Epoch: 779 | 
MeanAbsoluteError: 0.0936660543084145 | Loss: 0.0139491714484757 | Epoch: 780 | 
MeanAbsoluteError: 0.0919484049081802 | Loss: 0.0142953087501398 | Epoch: 781 | 
MeanAbsoluteError: 0.0825063139200211 | Loss: 0.0117602097738594 | Epoch: 782 | 
MeanAbsoluteError: 0.0910854935646057 | Loss: 0.0137701798926112 | Epoch: 783 | 
MeanAbsoluteError: 0.0842835977673531 | Loss: 0.0128374684638402 | Epoch: 784 | 
MeanAbsoluteError: 0.0872000232338905 | Loss: 0.0136503072837756 | Epoch: 785 | 
MeanAbsoluteError: 0.0915301591157913 | Loss: 0.0134748054452939 | Epoch: 786 | 
MeanAbsoluteError: 0.0895491465926170 | Loss: 0.0137426976555677 | Epoch: 787 | 
MeanAbsoluteError: 0.0880388543009758 | Loss: 0.0134906165735447 | Epoch: 788 | 
MeanAbsoluteError: 0.0861438736319542 | Loss: 0.0125704502156198 | Epoch: 789 | 
MeanAbsoluteError: 0.0929221436381340 | Loss: 0.0145094412261096 | Epoch: 790 | 
MeanAbsoluteError: 0.0877918973565102 | Loss: 0.0139202241956203 | Epoch: 791 | 
MeanAbsoluteError: 0.0854865759611130 | Loss: 0.0127539436424073 | Epoch: 792 | 
MeanAbsoluteError: 0.0928922146558762 | Loss: 0.0155283784660545 | Epoch: 793 | 
MeanAbsoluteError: 0.0846396833658218 | Loss: 0.0128096459877755 | Epoch: 794 | 
MeanAbsoluteError: 0.0879991799592972 | Loss: 0.0130216205915834 | Epoch: 795 | 
MeanAbsoluteError: 0.0875809863209724 | Loss: 0.0128992994066114 | Epoch: 796 | 
MeanAbsoluteError: 0.0900469794869423 | Loss: 0.0139849237681483 | Epoch: 797 | 
MeanAbsoluteError: 0.0797033533453941 | Loss: 0.0107717093817094 | Epoch: 798 | 
MeanAbsoluteError: 0.0873648002743721 | Loss: 0.0122912524668694 | Epoch: 799 | 
MeanAbsoluteError: 0.0843571498990059 | Loss: 0.0125714832855010 | Epoch: 800 | 
MeanAbsoluteError: 0.0855488106608391 | Loss: 0.0121638380535054 | Epoch: 801 | 
MeanAbsoluteError: 0.0866462811827660 | Loss: 0.0126349423417317 | Epoch: 802 | 
MeanAbsoluteError: 0.0923146605491638 | Loss: 0.0144947521866319 | Epoch: 803 | 
MeanAbsoluteError: 0.0892526209354401 | Loss: 0.0134537431736923 | Epoch: 804 | 
MeanAbsoluteError: 0.0903970748186111 | Loss: 0.0137233388495224 | Epoch: 805 | 
MeanAbsoluteError: 0.0846530869603157 | Loss: 0.0123086926693941 | Epoch: 806 | 
MeanAbsoluteError: 0.0874916836619377 | Loss: 0.0132678427596450 | Epoch: 807 | 
MeanAbsoluteError: 0.0880352333188057 | Loss: 0.0125253551361190 | Epoch: 808 | 
MeanAbsoluteError: 0.0810754671692848 | Loss: 0.0114060470012434 | Epoch: 809 | 
MeanAbsoluteError: 0.0814329534769058 | Loss: 0.0111651009086442 | Epoch: 810 | 
MeanAbsoluteError: 0.0827483460307121 | Loss: 0.0115719130086836 | Epoch: 811 | 
MeanAbsoluteError: 0.0897439196705818 | Loss: 0.0130772317266868 | Epoch: 812 | 
MeanAbsoluteError: 0.0880335867404938 | Loss: 0.0135278750921013 | Epoch: 813 | 
MeanAbsoluteError: 0.0836574360728264 | Loss: 0.0122424311130211 | Epoch: 814 | 
MeanAbsoluteError: 0.0929969102144241 | Loss: 0.0148698893177789 | Epoch: 815 | 
MeanAbsoluteError: 0.0901521891355515 | Loss: 0.0139640412662993 | Epoch: 816 | 
MeanAbsoluteError: 0.0898836329579353 | Loss: 0.0135736242364510 | Epoch: 817 | 
MeanAbsoluteError: 0.0824376791715622 | Loss: 0.0119631376703668 | Epoch: 818 | 
MeanAbsoluteError: 0.0806188806891441 | Loss: 0.0118086837160081 | Epoch: 819 | 
MeanAbsoluteError: 0.0909961313009262 | Loss: 0.0138336719850971 | Epoch: 820 | 
MeanAbsoluteError: 0.0869518518447876 | Loss: 0.0130316733186191 | Epoch: 821 | 
MeanAbsoluteError: 0.0887115225195885 | Loss: 0.0135067391248109 | Epoch: 822 | 
MeanAbsoluteError: 0.0869904235005379 | Loss: 0.0131753684242722 | Epoch: 823 | 
MeanAbsoluteError: 0.0852245241403580 | Loss: 0.0127137407443540 | Epoch: 824 | 
MeanAbsoluteError: 0.0902094617486000 | Loss: 0.0141241360795296 | Epoch: 825 | 
MeanAbsoluteError: 0.0886627808213234 | Loss: 0.0133826902402992 | Epoch: 826 | 
MeanAbsoluteError: 0.0857482627034187 | Loss: 0.0125397661603832 | Epoch: 827 | 
MeanAbsoluteError: 0.0833484455943108 | Loss: 0.0125609906387399 | Epoch: 828 | 
MeanAbsoluteError: 0.0817477479577065 | Loss: 0.0121171412124446 | Epoch: 829 | 
MeanAbsoluteError: 0.0842658281326294 | Loss: 0.0117447371700352 | Epoch: 830 | 
MeanAbsoluteError: 0.0871846228837967 | Loss: 0.0139425835052437 | Epoch: 831 | 
MeanAbsoluteError: 0.0870299562811852 | Loss: 0.0131563913405262 | Epoch: 832 | 
MeanAbsoluteError: 0.0877682045102119 | Loss: 0.0125310282797727 | Epoch: 833 | 
MeanAbsoluteError: 0.0868611708283424 | Loss: 0.0132450058987888 | Epoch: 834 | 
MeanAbsoluteError: 0.0920709222555161 | Loss: 0.0151191704400117 | Epoch: 835 | 
MeanAbsoluteError: 0.0884208008646965 | Loss: 0.0132920880292174 | Epoch: 836 | 
MeanAbsoluteError: 0.0906057581305504 | Loss: 0.0138476270401831 | Epoch: 837 | 
MeanAbsoluteError: 0.0808502361178398 | Loss: 0.0104835611656987 | Epoch: 838 | 
MeanAbsoluteError: 0.0819362476468086 | Loss: 0.0118256371819977 | Epoch: 839 | 
MeanAbsoluteError: 0.0889340117573738 | Loss: 0.0134225178162160 | Epoch: 840 | 
MeanAbsoluteError: 0.0835704132914543 | Loss: 0.0122420353926524 | Epoch: 841 | 
MeanAbsoluteError: 0.0878375172615051 | Loss: 0.0136762607487617 | Epoch: 842 | 
MeanAbsoluteError: 0.0883241072297096 | Loss: 0.0140489444909326 | Epoch: 843 | 
MeanAbsoluteError: 0.0896683856844902 | Loss: 0.0144584663680143 | Epoch: 844 | 
MeanAbsoluteError: 0.0872910469770432 | Loss: 0.0139972856088207 | Epoch: 845 | 
MeanAbsoluteError: 0.0866050943732262 | Loss: 0.0120046326166145 | Epoch: 846 | 
MeanAbsoluteError: 0.0873705893754959 | Loss: 0.0143076343258144 | Epoch: 847 | 
MeanAbsoluteError: 0.0841135159134865 | Loss: 0.0112895985421953 | Epoch: 848 | 
MeanAbsoluteError: 0.0831866711378098 | Loss: 0.0111039653957899 | Epoch: 849 | 
MeanAbsoluteError: 0.0849915146827698 | Loss: 0.0122677227672587 | Epoch: 850 | 
MeanAbsoluteError: 0.0861410498619080 | Loss: 0.0120053149315936 | Epoch: 851 | 
MeanAbsoluteError: 0.0797359347343445 | Loss: 0.0110615584130058 | Epoch: 852 | 
MeanAbsoluteError: 0.0824270546436310 | Loss: 0.0118020916102978 | Epoch: 853 | 
MeanAbsoluteError: 0.0825547873973846 | Loss: 0.0114322506546402 | Epoch: 854 | 
MeanAbsoluteError: 0.0836223363876343 | Loss: 0.0113243397374026 | Epoch: 855 | 
MeanAbsoluteError: 0.0835014060139656 | Loss: 0.0124559646317721 | Epoch: 856 | 
MeanAbsoluteError: 0.0810412764549255 | Loss: 0.0114242599781695 | Epoch: 857 | 
MeanAbsoluteError: 0.0806427672505379 | Loss: 0.0111035087325339 | Epoch: 858 | 
MeanAbsoluteError: 0.0810064524412155 | Loss: 0.0123277884490866 | Epoch: 859 | 
MeanAbsoluteError: 0.0791274234652519 | Loss: 0.0108994583824339 | Epoch: 860 | 
MeanAbsoluteError: 0.0783944875001907 | Loss: 0.0099420752198178 | Epoch: 861 | 
MeanAbsoluteError: 0.0823949202895164 | Loss: 0.0112552326860896 | Epoch: 862 | 
MeanAbsoluteError: 0.0894614383578300 | Loss: 0.0136572599528881 | Epoch: 863 | 
MeanAbsoluteError: 0.0863790437579155 | Loss: 0.0126034568144494 | Epoch: 864 | 
MeanAbsoluteError: 0.0907753333449364 | Loss: 0.0141260660986397 | Epoch: 865 | 
MeanAbsoluteError: 0.0831019729375839 | Loss: 0.0121043237547201 | Epoch: 866 | 
MeanAbsoluteError: 0.0851116329431534 | Loss: 0.0125735149813894 | Epoch: 867 | 
MeanAbsoluteError: 0.0828711017966270 | Loss: 0.0122386341357681 | Epoch: 868 | 
MeanAbsoluteError: 0.0765050947666168 | Loss: 0.0096323578024991 | Epoch: 869 | 
MeanAbsoluteError: 0.0849293097853661 | Loss: 0.0122914087764608 | Epoch: 870 | 
MeanAbsoluteError: 0.0807559043169022 | Loss: 0.0117121008424268 | Epoch: 871 | 
MeanAbsoluteError: 0.0861147716641426 | Loss: 0.0129100536167971 | Epoch: 872 | 
MeanAbsoluteError: 0.0872435942292213 | Loss: 0.0123327162051282 | Epoch: 873 | 
MeanAbsoluteError: 0.0822911635041237 | Loss: 0.0119200499290673 | Epoch: 874 | 
MeanAbsoluteError: 0.0796175673604012 | Loss: 0.0105244221832648 | Epoch: 875 | 
MeanAbsoluteError: 0.0819516330957413 | Loss: 0.0114625034241582 | Epoch: 876 | 
MeanAbsoluteError: 0.0880689471960068 | Loss: 0.0133859314202952 | Epoch: 877 | 
MeanAbsoluteError: 0.0800118967890739 | Loss: 0.0105819492466010 | Epoch: 878 | 
MeanAbsoluteError: 0.0785520896315575 | Loss: 0.0111523001175374 | Epoch: 879 | 
MeanAbsoluteError: 0.0806205570697784 | Loss: 0.0122499843170711 | Epoch: 880 | 
MeanAbsoluteError: 0.0860678702592850 | Loss: 0.0129279877278532 | Epoch: 881 | 
MeanAbsoluteError: 0.0799272879958153 | Loss: 0.0107222714416275 | Epoch: 882 | 
MeanAbsoluteError: 0.0865813493728638 | Loss: 0.0123245433981356 | Epoch: 883 | 
MeanAbsoluteError: 0.0861902162432671 | Loss: 0.0127474921333260 | Epoch: 884 | 
MeanAbsoluteError: 0.0866646692156792 | Loss: 0.0145842113878947 | Epoch: 885 | 
MeanAbsoluteError: 0.0841978043317795 | Loss: 0.0116978826907871 | Epoch: 886 | 
MeanAbsoluteError: 0.0778910741209984 | Loss: 0.0115401813024558 | Epoch: 887 | 
MeanAbsoluteError: 0.0811155512928963 | Loss: 0.0113010334543166 | Epoch: 888 | 
MeanAbsoluteError: 0.0747473463416100 | Loss: 0.0103355552636882 | Epoch: 889 | 
MeanAbsoluteError: 0.0753644481301308 | Loss: 0.0105962576877164 | Epoch: 890 | 
MeanAbsoluteError: 0.0916491299867630 | Loss: 0.0142058635533006 | Epoch: 891 | 
MeanAbsoluteError: 0.0873054638504982 | Loss: 0.0134220599845745 | Epoch: 892 | 
MeanAbsoluteError: 0.0808307677507401 | Loss: 0.0114402376304921 | Epoch: 893 | 
MeanAbsoluteError: 0.0840054824948311 | Loss: 0.0124045257416219 | Epoch: 894 | 
MeanAbsoluteError: 0.0839438289403915 | Loss: 0.0117082501059970 | Epoch: 895 | 
MeanAbsoluteError: 0.0770802274346352 | Loss: 0.0108311541835913 | Epoch: 896 | 
MeanAbsoluteError: 0.0830468386411667 | Loss: 0.0118357291347699 | Epoch: 897 | 
MeanAbsoluteError: 0.0838904231786728 | Loss: 0.0119038096502482 | Epoch: 898 | 
MeanAbsoluteError: 0.0747644305229187 | Loss: 0.0106877915603718 | Epoch: 899 | 
MeanAbsoluteError: 0.0849007368087769 | Loss: 0.0128037197812228 | Epoch: 900 | 
MeanAbsoluteError: 0.0765923336148262 | Loss: 0.0108215025806324 | Epoch: 901 | 
MeanAbsoluteError: 0.0790987387299538 | Loss: 0.0114839105073133 | Epoch: 902 | 
MeanAbsoluteError: 0.0761547759175301 | Loss: 0.0105909185757628 | Epoch: 903 | 
MeanAbsoluteError: 0.0898035541176796 | Loss: 0.0145354269122618 | Epoch: 904 | 
MeanAbsoluteError: 0.0819872319698334 | Loss: 0.0118008420636761 | Epoch: 905 | 
MeanAbsoluteError: 0.0849971696734428 | Loss: 0.0121128790875082 | Epoch: 906 | 
MeanAbsoluteError: 0.0766666457056999 | Loss: 0.0107988218236157 | Epoch: 907 | 
MeanAbsoluteError: 0.0824203267693520 | Loss: 0.0123254595393640 | Epoch: 908 | 
MeanAbsoluteError: 0.0820598825812340 | Loss: 0.0120072473305724 | Epoch: 909 | 
MeanAbsoluteError: 0.0746518597006798 | Loss: 0.0094403029312707 | Epoch: 910 | 
MeanAbsoluteError: 0.0795890316367149 | Loss: 0.0114428887276154 | Epoch: 911 | 
MeanAbsoluteError: 0.0816016122698784 | Loss: 0.0112825424782447 | Epoch: 912 | 
MeanAbsoluteError: 0.0768093466758728 | Loss: 0.0107147265024832 | Epoch: 913 | 
MeanAbsoluteError: 0.0836746022105217 | Loss: 0.0121148643181853 | Epoch: 914 | 
MeanAbsoluteError: 0.0744383186101913 | Loss: 0.0091809631374296 | Epoch: 915 | 
MeanAbsoluteError: 0.0842925310134888 | Loss: 0.0117967272193831 | Epoch: 916 | 
MeanAbsoluteError: 0.0818516984581947 | Loss: 0.0114838488610015 | Epoch: 917 | 
MeanAbsoluteError: 0.0781620815396309 | Loss: 0.0102551146401674 | Epoch: 918 | 
MeanAbsoluteError: 0.0730510875582695 | Loss: 0.0095358708634740 | Epoch: 919 | 
MeanAbsoluteError: 0.0848490595817566 | Loss: 0.0116682689756756 | Epoch: 920 | 
MeanAbsoluteError: 0.0812708288431168 | Loss: 0.0114951715608155 | Epoch: 921 | 
MeanAbsoluteError: 0.0823918730020523 | Loss: 0.0123720712066885 | Epoch: 922 | 
MeanAbsoluteError: 0.0764409899711609 | Loss: 0.0100645103666466 | Epoch: 923 | 
MeanAbsoluteError: 0.0793168544769287 | Loss: 0.0099609627607424 | Epoch: 924 | 
MeanAbsoluteError: 0.0805307403206825 | Loss: 0.0110954995955823 | Epoch: 925 | 
MeanAbsoluteError: 0.0838173627853394 | Loss: 0.0126094026923723 | Epoch: 926 | 
MeanAbsoluteError: 0.0775885879993439 | Loss: 0.0109663456859562 | Epoch: 927 | 
MeanAbsoluteError: 0.0772282257676125 | Loss: 0.0108195010727165 | Epoch: 928 | 
MeanAbsoluteError: 0.0767353326082230 | Loss: 0.0102082654767825 | Epoch: 929 | 
MeanAbsoluteError: 0.0798811838030815 | Loss: 0.0110609729360537 | Epoch: 930 | 
MeanAbsoluteError: 0.0736504122614861 | Loss: 0.0098176758139395 | Epoch: 931 | 
MeanAbsoluteError: 0.0754480287432671 | Loss: 0.0099439434951879 | Epoch: 932 | 
MeanAbsoluteError: 0.0786996334791183 | Loss: 0.0101678258836425 | Epoch: 933 | 
MeanAbsoluteError: 0.0795818790793419 | Loss: 0.0107766626313484 | Epoch: 934 | 
MeanAbsoluteError: 0.0810948088765144 | Loss: 0.0111731286907889 | Epoch: 935 | 
MeanAbsoluteError: 0.0820129513740540 | Loss: 0.0117051359474923 | Epoch: 936 | 
MeanAbsoluteError: 0.0724137425422668 | Loss: 0.0099749385782828 | Epoch: 937 | 
MeanAbsoluteError: 0.0862825959920883 | Loss: 0.0134445546920809 | Epoch: 938 | 
MeanAbsoluteError: 0.0758122503757477 | Loss: 0.0097058245006095 | Epoch: 939 | 
MeanAbsoluteError: 0.0725324973464012 | Loss: 0.0093475336427946 | Epoch: 940 | 
MeanAbsoluteError: 0.0772158950567245 | Loss: 0.0101984158892689 | Epoch: 941 | 
MeanAbsoluteError: 0.0797809138894081 | Loss: 0.0120883794381613 | Epoch: 942 | 
MeanAbsoluteError: 0.0836029723286629 | Loss: 0.0122133425992312 | Epoch: 943 | 
MeanAbsoluteError: 0.0759155750274658 | Loss: 0.0098240173328668 | Epoch: 944 | 
MeanAbsoluteError: 0.0794696062803268 | Loss: 0.0114210713648208 | Epoch: 945 | 
MeanAbsoluteError: 0.0857197493314743 | Loss: 0.0122764789538390 | Epoch: 946 | 
MeanAbsoluteError: 0.0758408755064011 | Loss: 0.0097005047810429 | Epoch: 947 | 
MeanAbsoluteError: 0.0772101804614067 | Loss: 0.0106710157655471 | Epoch: 948 | 
MeanAbsoluteError: 0.0766051784157753 | Loss: 0.0109997727473152 | Epoch: 949 | 
MeanAbsoluteError: 0.0818463042378426 | Loss: 0.0116441060185025 | Epoch: 950 | 
MeanAbsoluteError: 0.0819623023271561 | Loss: 0.0126936828950905 | Epoch: 951 | 
MeanAbsoluteError: 0.0834140628576279 | Loss: 0.0123610178699043 | Epoch: 952 | 
MeanAbsoluteError: 0.0774013996124268 | Loss: 0.0106197238736058 | Epoch: 953 | 
MeanAbsoluteError: 0.0755377188324928 | Loss: 0.0101476725790417 | Epoch: 954 | 
MeanAbsoluteError: 0.0784030333161354 | Loss: 0.0103724843181165 | Epoch: 955 | 
MeanAbsoluteError: 0.0776715055108070 | Loss: 0.0108854988198755 | Epoch: 956 | 
MeanAbsoluteError: 0.0794568061828613 | Loss: 0.0107601086278449 | Epoch: 957 | 
MeanAbsoluteError: 0.0829780325293541 | Loss: 0.0122616098986085 | Epoch: 958 | 
MeanAbsoluteError: 0.0781153514981270 | Loss: 0.0111228533902007 | Epoch: 959 | 
MeanAbsoluteError: 0.0792361795902252 | Loss: 0.0102534637312541 | Epoch: 960 | 
MeanAbsoluteError: 0.0807512849569321 | Loss: 0.0119225356969158 | Epoch: 961 | 
MeanAbsoluteError: 0.0761894509196281 | Loss: 0.0100464200965386 | Epoch: 962 | 
MeanAbsoluteError: 0.0785582885146141 | Loss: 0.0114586555079768 | Epoch: 963 | 
MeanAbsoluteError: 0.0819670930504799 | Loss: 0.0117768204184055 | Epoch: 964 | 
MeanAbsoluteError: 0.0775058045983315 | Loss: 0.0106426456686556 | Epoch: 965 | 
MeanAbsoluteError: 0.0813422277569771 | Loss: 0.0115925175791684 | Epoch: 966 | 
MeanAbsoluteError: 0.0781940445303917 | Loss: 0.0111676379531370 | Epoch: 967 | 
MeanAbsoluteError: 0.0740225985646248 | Loss: 0.0094262914665160 | Epoch: 968 | 
MeanAbsoluteError: 0.0819175690412521 | Loss: 0.0117454024038064 | Epoch: 969 | 
MeanAbsoluteError: 0.0810184031724930 | Loss: 0.0118117030216536 | Epoch: 970 | 
MeanAbsoluteError: 0.0734857618808746 | Loss: 0.0095107572166065 | Epoch: 971 | 
MeanAbsoluteError: 0.0751635581254959 | Loss: 0.0097982566737846 | Epoch: 972 | 
MeanAbsoluteError: 0.0797876641154289 | Loss: 0.0115818757638044 | Epoch: 973 | 
MeanAbsoluteError: 0.0801390558481216 | Loss: 0.0112204107195430 | Epoch: 974 | 
MeanAbsoluteError: 0.0779407173395157 | Loss: 0.0110046385489356 | Epoch: 975 | 
MeanAbsoluteError: 0.0786664485931396 | Loss: 0.0108494746837338 | Epoch: 976 | 
MeanAbsoluteError: 0.0763820111751556 | Loss: 0.0100635144367698 | Epoch: 977 | 
MeanAbsoluteError: 0.0734482929110527 | Loss: 0.0093932644184194 | Epoch: 978 | 
MeanAbsoluteError: 0.0733522772789001 | Loss: 0.0097754629474366 | Epoch: 979 | 
MeanAbsoluteError: 0.0786308944225311 | Loss: 0.0107528141833609 | Epoch: 980 | 
MeanAbsoluteError: 0.0812944173812866 | Loss: 0.0119555190703492 | Epoch: 981 | 
MeanAbsoluteError: 0.0797763168811798 | Loss: 0.0108480479968118 | Epoch: 982 | 
MeanAbsoluteError: 0.0770209357142448 | Loss: 0.0102153962227870 | Epoch: 983 | 
MeanAbsoluteError: 0.0783471688628197 | Loss: 0.0113205710164038 | Epoch: 984 | 
MeanAbsoluteError: 0.0794938877224922 | Loss: 0.0112247198174615 | Epoch: 985 | 
MeanAbsoluteError: 0.0781744718551636 | Loss: 0.0118110524697598 | Epoch: 986 | 
MeanAbsoluteError: 0.0768333002924919 | Loss: 0.0102383820823161 | Epoch: 987 | 
MeanAbsoluteError: 0.0734845772385597 | Loss: 0.0094514922984915 | Epoch: 988 | 
MeanAbsoluteError: 0.0761157944798470 | Loss: 0.0105915941962545 | Epoch: 989 | 
MeanAbsoluteError: 0.0771826654672623 | Loss: 0.0109485472840121 | Epoch: 990 | 
MeanAbsoluteError: 0.0773909315466881 | Loss: 0.0101458786516256 | Epoch: 991 | 
MeanAbsoluteError: 0.0763303413987160 | Loss: 0.0100289757783078 | Epoch: 992 | 
MeanAbsoluteError: 0.0767453312873840 | Loss: 0.0104340730251230 | Epoch: 993 | 
MeanAbsoluteError: 0.0743090808391571 | Loss: 0.0100353585333748 | Epoch: 994 | 
MeanAbsoluteError: 0.0788866728544235 | Loss: 0.0100324173354117 | Epoch: 995 | 
MeanAbsoluteError: 0.0754096731543541 | Loss: 0.0099916345883442 | Epoch: 996 | 
MeanAbsoluteError: 0.0757913440465927 | Loss: 0.0105360941051974 | Epoch: 997 | 
MeanAbsoluteError: 0.0785523578524590 | Loss: 0.0107217661379279 | Epoch: 998 | 
MeanAbsoluteError: 0.0757029950618744 | Loss: 0.0111351517576744 | Epoch: 999 | 
MeanAbsoluteError: 0.0753809809684753 | Loss: 0.0106560913736272 | Epoch: 1000 | 
MeanAbsoluteError: 0.0771473124623299 | Loss: 0.0102486538700517 | Epoch: 1001 | 
MeanAbsoluteError: 0.0750893279910088 | Loss: 0.0093866995780263 | Epoch: 1002 | 
MeanAbsoluteError: 0.0724954679608345 | Loss: 0.0086315698409453 | Epoch: 1003 | 
MeanAbsoluteError: 0.0716400593519211 | Loss: 0.0091167931699116 | Epoch: 1004 | 
MeanAbsoluteError: 0.0766166374087334 | Loss: 0.0104198445554357 | Epoch: 1005 | 
MeanAbsoluteError: 0.0840846896171570 | Loss: 0.0120928364159045 | Epoch: 1006 | MeanAbsoluteError: 0.0838327258825302 | Loss: 0.0121519312852858 | 
Epoch: 1007 | 
MeanAbsoluteError: 0.0754724144935608 | Loss: 0.0099779280242365 | Epoch: 1008 | 
MeanAbsoluteError: 0.0769871845841408 | Loss: 0.0105353803468461 | Epoch: 1009 | 
MeanAbsoluteError: 0.0789048671722412 | Loss: 0.0114314637853628 | Epoch: 1010 | 
MeanAbsoluteError: 0.0769540816545486 | Loss: 0.0095977533931121 | Epoch: 1011 | 
MeanAbsoluteError: 0.0800327956676483 | Loss: 0.0108647001947975 | Epoch: 1012 | 
MeanAbsoluteError: 0.0771972760558128 | Loss: 0.0107224949578085 | Epoch: 1013 | 
MeanAbsoluteError: 0.0790066495537758 | Loss: 0.0113103264718332 | Epoch: 1014 | 
MeanAbsoluteError: 0.0776085630059242 | Loss: 0.0101981280321055 | Epoch: 1015 | MeanAbsoluteError: 0.0809082761406898 | Loss: 0.0118847660014641 | 
Epoch: 1016 | 
MeanAbsoluteError: 0.0729884281754494 | Loss: 0.0088556977075010 | Epoch: 1017 | MeanAbsoluteError: 0.0749734714627266 | Loss: 0.0102841658946030 | Epoch: 1018 | 
MeanAbsoluteError: 0.0706926062703133 | Loss: 0.0092040726929190 | Epoch: 1019 | MeanAbsoluteError: 0.0773494318127632 | Loss: 0.0106258611122030 | 
Epoch: 1020 | MeanAbsoluteError: 0.0730524659156799 | Loss: 0.0091917541812533 | Epoch: 1021 | 
MeanAbsoluteError: 0.0759474188089371 | Loss: 0.0101527077875047 | Epoch: 1022 | 
MeanAbsoluteError: 0.0734947174787521 | Loss: 0.0101795340611534 | Epoch: 1023 | MeanAbsoluteError: 0.0783502534031868 | Loss: 0.0096225852596399 | 
Epoch: 1024 | MeanAbsoluteError: 0.0744913145899773 | Loss: 0.0096922348795245 | 
Epoch: 1025 | MeanAbsoluteError: 0.0760797336697578 | Loss: 0.0106008873561402 | 
Epoch: 1026 | MeanAbsoluteError: 0.0711916536092758 | Loss: 0.0088341701492421 | Epoch: 1027 | 
MeanAbsoluteError: 0.0758967101573944 | Loss: 0.0108914518901292 | Epoch: 1028 | 
MeanAbsoluteError: 0.0733629390597343 | Loss: 0.0100295339285852 | Epoch: 1029 | 
MeanAbsoluteError: 0.0726016014814377 | Loss: 0.0091414923602133 | Epoch: 1030 | MeanAbsoluteError: 0.0756615847349167 | Loss: 0.0099941990692362 | 
Epoch: 1031 | MeanAbsoluteError: 0.0686070993542671 | Loss: 0.0087467342926781 | Epoch: 1032 | 
MeanAbsoluteError: 0.0697863698005676 | Loss: 0.0091944912794012 | Epoch: 1033 | 
MeanAbsoluteError: 0.0793323144316673 | Loss: 0.0112644252877605 | Epoch: 1034 | 
MeanAbsoluteError: 0.0716265067458153 | Loss: 0.0094665235365877 | Epoch: 1035 | 
MeanAbsoluteError: 0.0735871195793152 | Loss: 0.0096991634360529 | Epoch: 1036 | 
MeanAbsoluteError: 0.0729820355772972 | Loss: 0.0091549253003905 | Epoch: 1037 | 
MeanAbsoluteError: 0.0743240639567375 | Loss: 0.0100976939908772 | Epoch: 1038 | 
MeanAbsoluteError: 0.0726394057273865 | Loss: 0.0094688063816284 | Epoch: 1039 | 
MeanAbsoluteError: 0.0757391229271889 | Loss: 0.0096585064073952 | Epoch: 1040 | 
MeanAbsoluteError: 0.0715169906616211 | Loss: 0.0091191405737967 | Epoch: 1041 | 
MeanAbsoluteError: 0.0707442909479141 | Loss: 0.0097205472553893 | Epoch: 1042 | MeanAbsoluteError: 0.0768945068120956 | Loss: 0.0106180890888209 | Epoch: 1043 | 
MeanAbsoluteError: 0.0775644034147263 | Loss: 0.0100190014705489 | Epoch: 1044 | 
MeanAbsoluteError: 0.0780894234776497 | Loss: 0.0112718566710343 | Epoch: 1045 | 
MeanAbsoluteError: 0.0732187554240227 | Loss: 0.0093296029105234 | Epoch: 1046 | MeanAbsoluteError: 0.0776601955294609 | Loss: 0.0107819290286110 | Epoch: 1047 | 
MeanAbsoluteError: 0.0772246345877647 | Loss: 0.0113569213585288 | Epoch: 1048 | MeanAbsoluteError: 0.0749025419354439 | Loss: 0.0111781068460732 | 
Epoch: 1049 | MeanAbsoluteError: 0.0749238803982735 | Loss: 0.0097150410269251 | 
Epoch: 1050 | MeanAbsoluteError: 0.0787318870425224 | Loss: 0.0116390669031898 | 
Epoch: 1051 | MeanAbsoluteError: 0.0721973851323128 | Loss: 0.0092415835819944 | 
Epoch: 1052 | 
MeanAbsoluteError: 0.0721325203776360 | Loss: 0.0095206649231356 | Epoch: 1053 | MeanAbsoluteError: 0.0716163218021393 | Loss: 0.0100266223034608 | 
Epoch: 1054 | MeanAbsoluteError: 0.0680576264858246 | Loss: 0.0083594763606773 | 
Epoch: 1055 | MeanAbsoluteError: 0.0733379051089287 | Loss: 0.0097652368442626 | 
Epoch: 1056 | MeanAbsoluteError: 0.0759685635566711 | Loss: 0.0096014733688207 | Epoch: 1057 | 
MeanAbsoluteError: 0.0771747305989265 | Loss: 0.0113493017353737 | Epoch: 1058 | MeanAbsoluteError: 0.0726660117506981 | Loss: 0.0092057909969056 | Epoch: 1059 | 
MeanAbsoluteError: 0.0777314454317093 | Loss: 0.0109833599072590 | Epoch: 1060 | 
MeanAbsoluteError: 0.0765407234430313 | Loss: 0.0094529975352392 | Epoch: 1061 | 
MeanAbsoluteError: 0.0744642764329910 | Loss: 0.0098258785107343 | Epoch: 1062 | 
MeanAbsoluteError: 0.0754998102784157 | Loss: 0.0107154979131155 | Epoch: 1063 | 
MeanAbsoluteError: 0.0769806578755379 | Loss: 0.0105263171170615 | Epoch: 1064 | 
MeanAbsoluteError: 0.0700255110859871 | Loss: 0.0081949480725962 | Epoch: 1065 | MeanAbsoluteError: 0.0719128623604774 | Loss: 0.0094276631510002 | 
Epoch: 1066 | MeanAbsoluteError: 0.0762575194239616 | Loss: 0.0104698017210467 | 
Epoch: 1067 | 
MeanAbsoluteError: 0.0712803155183792 | Loss: 0.0094434189789414 | Epoch: 1068 | 
MeanAbsoluteError: 0.0752073749899864 | Loss: 0.0106265653851248 | Epoch: 1069 | MeanAbsoluteError: 0.0727315098047256 | Loss: 0.0094261637126328 | 
Epoch: 1070 | 
MeanAbsoluteError: 0.0728951394557953 | Loss: 0.0094275357698401 | Epoch: 1071 | 
MeanAbsoluteError: 0.0703418925404549 | Loss: 0.0089604130323884 | Epoch: 1072 | MeanAbsoluteError: 0.0648873671889305 | Loss: 0.0078946679211610 | Epoch: 1073 | 
MeanAbsoluteError: 0.0741628035902977 | Loss: 0.0095838821845003 | Epoch: 1074 | 
MeanAbsoluteError: 0.0741706341505051 | Loss: 0.0098946656053401 | Epoch: 1075 | 
MeanAbsoluteError: 0.0751260593533516 | Loss: 0.0104930942339464 | Epoch: 1076 | MeanAbsoluteError: 0.0746205151081085 | Loss: 0.0105231018549118 | 
Epoch: 1077 | MeanAbsoluteError: 0.0757023170590401 | Loss: 0.0106848834887690 | 
Epoch: 1078 | MeanAbsoluteError: 0.0705666020512581 | Loss: 0.0089422907079279 | Epoch: 1079 | 
MeanAbsoluteError: 0.0769000947475433 | Loss: 0.0100799039609168 | Epoch: 1080 | MeanAbsoluteError: 0.0703075006604195 | Loss: 0.0083094889091080 | 
Epoch: 1081 | MeanAbsoluteError: 0.0756723359227180 | Loss: 0.0099668441046379 | Epoch: 1082 | 
MeanAbsoluteError: 0.0730056539177895 | Loss: 0.0097417938734240 | Epoch: 1083 | MeanAbsoluteError: 0.0727160423994064 | Loss: 0.0095443807503519 | 
Epoch: 1084 | 
MeanAbsoluteError: 0.0677308142185211 | Loss: 0.0084053743633982 | Epoch: 1085 | 
MeanAbsoluteError: 0.0743219926953316 | Loss: 0.0103247974737315 | Epoch: 1086 | MeanAbsoluteError: 0.0752597823739052 | Loss: 0.0107360527116301 | 
Epoch: 1087 | 
MeanAbsoluteError: 0.0732763409614563 | Loss: 0.0089729820447246 | Epoch: 1088 | 
MeanAbsoluteError: 0.0712302699685097 | Loss: 0.0090931703431124 | Epoch: 1089 | MeanAbsoluteError: 0.0721306800842285 | Loss: 0.0097164367645261 | 
Epoch: 1090 | 
MeanAbsoluteError: 0.0768599361181259 | Loss: 0.0103508076928847 | Epoch: 1091 | MeanAbsoluteError: 0.0773864537477493 | Loss: 0.0103436287182437 | 
Epoch: 1092 | 
MeanAbsoluteError: 0.0732245147228241 | Loss: 0.0099261446379630 | Epoch: 1093 | 
MeanAbsoluteError: 0.0740446969866753 | Loss: 0.0092950980860276 | Epoch: 1094 | MeanAbsoluteError: 0.0743721798062325 | Loss: 0.0096188930278489 | 
Epoch: 1095 | 
MeanAbsoluteError: 0.0712162405252457 | Loss: 0.0087795766250929 | Epoch: 1096 | 
MeanAbsoluteError: 0.0739038437604904 | Loss: 0.0099026006585943 | Epoch: 1097 | 
MeanAbsoluteError: 0.0731679126620293 | Loss: 0.0100934337388238 | Epoch: 1098 | 
MeanAbsoluteError: 0.0716250762343407 | Loss: 0.0092544472049243 | Epoch: 1099 | MeanAbsoluteError: 0.0755271688103676 | Loss: 0.0102817084928301 | 
Epoch: 1100 | MeanAbsoluteError: 0.0708120688796043 | Loss: 0.0099097254531201 | 
Epoch: 1101 | MeanAbsoluteError: 0.0694018676877022 | Loss: 0.0092001059525865 | 
Epoch: 1102 | 
MeanAbsoluteError: 0.0741465538740158 | Loss: 0.0094997187578944 | Epoch: 1103 | MeanAbsoluteError: 0.0728128328919411 | Loss: 0.0099073256755825 | Epoch: 1104 | 
MeanAbsoluteError: 0.0757154971361160 | Loss: 0.0101243046575109 | Epoch: 1105 | 
MeanAbsoluteError: 0.0722437873482704 | Loss: 0.0102219509839900 | Epoch: 1106 | MeanAbsoluteError: 0.0688144937157631 | Loss: 0.0094961131749475 | 
Epoch: 1107 | 
MeanAbsoluteError: 0.0657520368695259 | Loss: 0.0080563768470089 | Epoch: 1108 | 
MeanAbsoluteError: 0.0720821619033813 | Loss: 0.0095708194661711 | Epoch: 1109 | MeanAbsoluteError: 0.0715263634920120 | Loss: 0.0089969492757033 | Epoch: 1110 | 
MeanAbsoluteError: 0.0660584643483162 | Loss: 0.0081046364630917 | Epoch: 1111 | MeanAbsoluteError: 0.0823633894324303 | Loss: 0.0122449827783324 | 
Epoch: 1112 | 
MeanAbsoluteError: 0.0739020183682442 | Loss: 0.0096407347854741 | Epoch: 1113 | 
MeanAbsoluteError: 0.0700414255261421 | Loss: 0.0088838937206795 | Epoch: 1114 | 
MeanAbsoluteError: 0.0685109943151474 | Loss: 0.0088273383133249 | Epoch: 1115 | 
MeanAbsoluteError: 0.0683066248893738 | Loss: 0.0085620576831404 | Epoch: 1116 | MeanAbsoluteError: 0.0680524483323097 | Loss: 0.0080059578495760 | 
Epoch: 1117 | MeanAbsoluteError: 0.0721969008445740 | Loss: 0.0088572199735305 | 
Epoch: 1118 | 
MeanAbsoluteError: 0.0703648030757904 | Loss: 0.0085833540033567 | Epoch: 1119 | MeanAbsoluteError: 0.0755193978548050 | Loss: 0.0102038991439743 | 
Epoch: 1120 | 
MeanAbsoluteError: 0.0697172433137894 | Loss: 0.0088168482268035 | Epoch: 1121 | 
MeanAbsoluteError: 0.0718121156096458 | Loss: 0.0094217023543994 | Epoch: 1122 | MeanAbsoluteError: 0.0692456960678101 | Loss: 0.0087005105939776 | 
Epoch: 1123 | 
MeanAbsoluteError: 0.0720628648996353 | Loss: 0.0087952011220477 | Epoch: 1124 | MeanAbsoluteError: 0.0737296417355537 | Loss: 0.0093592568601283 | 
Epoch: 1125 | 
MeanAbsoluteError: 0.0736025944352150 | Loss: 0.0097043280438326 | Epoch: 1126 | MeanAbsoluteError: 0.0717158466577530 | Loss: 0.0089479699023711 | 
Epoch: 1127 | MeanAbsoluteError: 0.0713864639401436 | Loss: 0.0099129165636017 | 
Epoch: 1128 | MeanAbsoluteError: 0.0682451277971268 | Loss: 0.0084134282459854 | 
Epoch: 1129 | MeanAbsoluteError: 0.0725530385971069 | Loss: 0.0094400257635334 | 
Epoch: 1130 | 
MeanAbsoluteError: 0.0731755793094635 | Loss: 0.0097842342715497 | Epoch: 1131 | 
MeanAbsoluteError: 0.0771176442503929 | Loss: 0.0103041060842467 | Epoch: 1132 | MeanAbsoluteError: 0.0653812438249588 | Loss: 0.0083929497825132 | 
Epoch: 1133 | 
MeanAbsoluteError: 0.0664915367960930 | Loss: 0.0084261205209380 | Epoch: 1134 | 
MeanAbsoluteError: 0.0711762309074402 | Loss: 0.0086918230353452 | Epoch: 1135 | 
MeanAbsoluteError: 0.0705112442374229 | Loss: 0.0095124172458509 | Epoch: 1136 | 
MeanAbsoluteError: 0.0697087720036507 | Loss: 0.0086721632158075 | Epoch: 1137 | 
MeanAbsoluteError: 0.0706131383776665 | Loss: 0.0092648686888181 | Epoch: 1138 | MeanAbsoluteError: 0.0710665062069893 | Loss: 0.0084848327396806 | 
Epoch: 1139 | 
MeanAbsoluteError: 0.0730783194303513 | Loss: 0.0097875917136480 | Epoch: 1140 | 
MeanAbsoluteError: 0.0650372356176376 | Loss: 0.0078875130193774 | Epoch: 1141 | 
MeanAbsoluteError: 0.0722160413861275 | Loss: 0.0101066312852708 | Epoch: 1142 | 
MeanAbsoluteError: 0.0739113390445709 | Loss: 0.0102724440912425 | Epoch: 1143 | MeanAbsoluteError: 0.0707102045416832 | Loss: 0.0091179795215430 | 
Epoch: 1144 | MeanAbsoluteError: 0.0732046291232109 | Loss: 0.0092424001775119 | 
Epoch: 1145 | MeanAbsoluteError: 0.0648970678448677 | Loss: 0.0079142689968285 | 
Epoch: 1146 | MeanAbsoluteError: 0.0716101750731468 | Loss: 0.0092090098777650 | Epoch: 1147 | 
MeanAbsoluteError: 0.0659089982509613 | Loss: 0.0075736206042347 | Epoch: 1148 | 
MeanAbsoluteError: 0.0719774514436722 | Loss: 0.0092289340968515 | Epoch: 1149 | 
MeanAbsoluteError: 0.0703535676002502 | Loss: 0.0093053536194808 | Epoch: 1150 | 
MeanAbsoluteError: 0.0661001130938530 | Loss: 0.0081170465022539 | Epoch: 1151 | MeanAbsoluteError: 0.0697185024619102 | Loss: 0.0090841000659566 | 
Epoch: 1152 | MeanAbsoluteError: 0.0667841881513596 | Loss: 0.0085157626894124 | Epoch: 1153 | 
MeanAbsoluteError: 0.0700109452009201 | Loss: 0.0090260726241589 | Epoch: 1154 | MeanAbsoluteError: 0.0734894871711731 | Loss: 0.0099366087295736 | 
Epoch: 1155 | 
MeanAbsoluteError: 0.0649701803922653 | Loss: 0.0081530889866311 | Epoch: 1156 | MeanAbsoluteError: 0.0719567611813545 | Loss: 0.0098498268399150 | 
Epoch: 1157 | 
MeanAbsoluteError: 0.0697389915585518 | Loss: 0.0096384700382320 | Epoch: 1158 | MeanAbsoluteError: 0.0745852366089821 | Loss: 0.0102603533479366 | 
Epoch: 1159 | MeanAbsoluteError: 0.0670888274908066 | Loss: 0.0078984938216551 | Epoch: 1160 | 
MeanAbsoluteError: 0.0724674835801125 | Loss: 0.0099603198287878 | Epoch: 1161 | MeanAbsoluteError: 0.0695672482252121 | Loss: 0.0096984304853171 | 
Epoch: 1162 | 
MeanAbsoluteError: 0.0656505450606346 | Loss: 0.0085634731831669 | Epoch: 1163 | 
MeanAbsoluteError: 0.0690006539225578 | Loss: 0.0088253411346280 | Epoch: 1164 | 
MeanAbsoluteError: 0.0704276114702225 | Loss: 0.0093655873087603 | Epoch: 1165 | 
MeanAbsoluteError: 0.0693157985806465 | Loss: 0.0081011226080591 | Epoch: 1166 | 
MeanAbsoluteError: 0.0660896524786949 | Loss: 0.0077022022242090 | Epoch: 1167 | 
MeanAbsoluteError: 0.0675795525312424 | Loss: 0.0087408954638037 | Epoch: 1168 | MeanAbsoluteError: 0.0739976689219475 | Loss: 0.0105862413896466 | 
Epoch: 1169 | 
MeanAbsoluteError: 0.0705810189247131 | Loss: 0.0087255465357642 | Epoch: 1170 | 
MeanAbsoluteError: 0.0687527060508728 | Loss: 0.0090004131408932 | Epoch: 1171 | 
MeanAbsoluteError: 0.0679787546396255 | Loss: 0.0089871029775046 | Epoch: 1172 | 
MeanAbsoluteError: 0.0708588734269142 | Loss: 0.0092209607830197 | Epoch: 1173 | MeanAbsoluteError: 0.0635537207126617 | Loss: 0.0073359886398248 | Epoch: 1174 | 
MeanAbsoluteError: 0.0719224289059639 | Loss: 0.0088254506027079 | Epoch: 1175 | MeanAbsoluteError: 0.0685162767767906 | Loss: 0.0091444504437095 | 
Epoch: 1176 | MeanAbsoluteError: 0.0682813897728920 | Loss: 0.0087855926960037 | 
Epoch: 1177 | 
MeanAbsoluteError: 0.0689527541399002 | Loss: 0.0087738436866736 | Epoch: 1178 | MeanAbsoluteError: 0.0663936734199524 | Loss: 0.0081101582916623 | Epoch: 1179 | 
MeanAbsoluteError: 0.0645903423428535 | Loss: 0.0076194656511264 | Epoch: 1180 | 
MeanAbsoluteError: 0.0690056756138802 | Loss: 0.0088831921093879 | Epoch: 1181 | 
MeanAbsoluteError: 0.0716745331883430 | Loss: 0.0096123906900417 | Epoch: 1182 | 
MeanAbsoluteError: 0.0705098435282707 | Loss: 0.0091537391250131 | Epoch: 1183 | 
MeanAbsoluteError: 0.0645064637064934 | Loss: 0.0078526124888413 | Epoch: 1184 | 
MeanAbsoluteError: 0.0703385919332504 | Loss: 0.0097502162910678 | Epoch: 1185 | 
MeanAbsoluteError: 0.0669044181704521 | Loss: 0.0092274018547323 | Epoch: 1186 | MeanAbsoluteError: 0.0724317356944084 | Loss: 0.0096883230982348 | 
Epoch: 1187 | 
MeanAbsoluteError: 0.0674530565738678 | Loss: 0.0084695522375872 | Epoch: 1188 | MeanAbsoluteError: 0.0645680204033852 | Loss: 0.0074194852411771 | Epoch: 1189 | 
MeanAbsoluteError: 0.0701265037059784 | Loss: 0.0092223971989612 | Epoch: 1190 | MeanAbsoluteError: 0.0665633752942085 | Loss: 0.0081848095749107 | 
Epoch: 1191 | 
MeanAbsoluteError: 0.0693166255950928 | Loss: 0.0085213685101917 | Epoch: 1192 | MeanAbsoluteError: 0.0652243569493294 | Loss: 0.0076548196082149 | 
Epoch: 1193 | MeanAbsoluteError: 0.0653137043118477 | Loss: 0.0075478482692173 | Epoch: 1194 | 
MeanAbsoluteError: 0.0686157792806625 | Loss: 0.0084854981901117 | Epoch: 1195 | 
MeanAbsoluteError: 0.0663376897573471 | Loss: 0.0082883336484883 | Epoch: 1196 | 
MeanAbsoluteError: 0.0702687650918961 | Loss: 0.0090225046781901 | Epoch: 1197 | 
MeanAbsoluteError: 0.0707634463906288 | Loss: 0.0093778949699602 | Epoch: 1198 | MeanAbsoluteError: 0.0684383288025856 | Loss: 0.0081732866061308 | 
Epoch: 1199 | 
MeanAbsoluteError: 0.0653007701039314 | Loss: 0.0084251872169383 | Epoch: 1200 | 
MeanAbsoluteError: 0.0668916404247284 | Loss: 0.0082498241982034 | Epoch: 1201 | 
MeanAbsoluteError: 0.0651753917336464 | Loss: 0.0072234372386447 | Epoch: 1202 | 
MeanAbsoluteError: 0.0669360384345055 | Loss: 0.0080233031955140 | Epoch: 1203 | 
MeanAbsoluteError: 0.0621679611504078 | Loss: 0.0072893037933803 | Epoch: 1204 | 
MeanAbsoluteError: 0.0632463768124580 | Loss: 0.0070700316129660 | Epoch: 1205 | 
MeanAbsoluteError: 0.0635954216122627 | Loss: 0.0089095651530109 | Epoch: 1206 | 
MeanAbsoluteError: 0.0653205066919327 | Loss: 0.0080152743327441 | Epoch: 1207 | 
MeanAbsoluteError: 0.0671157613396645 | Loss: 0.0081957499999317 | Epoch: 1208 | 
MeanAbsoluteError: 0.0666139274835587 | Loss: 0.0079394377347004 | Epoch: 1209 | 
MeanAbsoluteError: 0.0617994554340839 | Loss: 0.0069003349391035 | Epoch: 1210 | 
MeanAbsoluteError: 0.0666597932577133 | Loss: 0.0089753188656323 | Epoch: 1211 | 
MeanAbsoluteError: 0.0693782642483711 | Loss: 0.0086475794187178 | Epoch: 1212 | 
MeanAbsoluteError: 0.0689074546098709 | Loss: 0.0087882711871255 | Epoch: 1213 | 
MeanAbsoluteError: 0.0743047967553139 | Loss: 0.0105168271603300 | Epoch: 1214 | 
MeanAbsoluteError: 0.0688557624816895 | Loss: 0.0078570942312217 | Epoch: 1215 | 
MeanAbsoluteError: 0.0675202906131744 | Loss: 0.0082834138088947 | Epoch: 1216 | 
MeanAbsoluteError: 0.0671270340681076 | Loss: 0.0078630962222329 | Epoch: 1217 | 
MeanAbsoluteError: 0.0643287599086761 | Loss: 0.0076481939046547 | Epoch: 1218 | 
MeanAbsoluteError: 0.0651486068964005 | Loss: 0.0082987105965367 | Epoch: 1219 | 
MeanAbsoluteError: 0.0734120681881905 | Loss: 0.0104761798047790 | Epoch: 1220 | 
MeanAbsoluteError: 0.0648582950234413 | Loss: 0.0072460742937740 | Epoch: 1221 | 
MeanAbsoluteError: 0.0663196071982384 | Loss: 0.0078379361281016 | Epoch: 1222 | 
MeanAbsoluteError: 0.0671830102801323 | Loss: 0.0091950496888603 | Epoch: 1223 | 
MeanAbsoluteError: 0.0649891868233681 | Loss: 0.0083868175054401 | Epoch: 1224 | 
MeanAbsoluteError: 0.0652585849165916 | Loss: 0.0077855610994447 | Epoch: 1225 | 
MeanAbsoluteError: 0.0693099722266197 | Loss: 0.0084362222762684 | Epoch: 1226 | 
MeanAbsoluteError: 0.0689284801483154 | Loss: 0.0087636749450879 | Epoch: 1227 | 
MeanAbsoluteError: 0.0671661347150803 | Loss: 0.0096063336638448 | Epoch: 1228 | 
MeanAbsoluteError: 0.0646582171320915 | Loss: 0.0078252064934092 | Epoch: 1229 | 
MeanAbsoluteError: 0.0698486715555191 | Loss: 0.0090547104366124 | Epoch: 1230 | 
MeanAbsoluteError: 0.0705250203609467 | Loss: 0.0087905469884208 | Epoch: 1231 | 
MeanAbsoluteError: 0.0647104904055595 | Loss: 0.0076205765937023 | Epoch: 1232 | 
MeanAbsoluteError: 0.0685428604483604 | Loss: 0.0090808262094652 | Epoch: 1233 | 
MeanAbsoluteError: 0.0671604648232460 | Loss: 0.0078667164862175 | Epoch: 1234 | 
MeanAbsoluteError: 0.0657881125807762 | Loss: 0.0082650482406704 | Epoch: 1235 | MeanAbsoluteError: 0.0597230605781078 | Loss: 0.0066937588557236 | 
Epoch: 1236 | MeanAbsoluteError: 0.0658877491950989 | Loss: 0.0078347621999759 | Epoch: 1237 | 
MeanAbsoluteError: 0.0681611001491547 | Loss: 0.0085070663797463 | Epoch: 1238 | 
MeanAbsoluteError: 0.0660139843821526 | Loss: 0.0084426600097383 | Epoch: 1239 | 
MeanAbsoluteError: 0.0654293596744537 | Loss: 0.0076485306919252 | Epoch: 1240 | 
MeanAbsoluteError: 0.0683790221810341 | Loss: 0.0086758617895733 | Epoch: 1241 | 
MeanAbsoluteError: 0.0628909468650818 | Loss: 0.0079269839097348 | Epoch: 1242 | MeanAbsoluteError: 0.0619311891496181 | Loss: 0.0072231707943138 | 
Epoch: 1243 | MeanAbsoluteError: 0.0665015801787376 | Loss: 0.0080980676562346 | 
Epoch: 1244 | MeanAbsoluteError: 0.0651184916496277 | Loss: 0.0080330068881691 | 
Epoch: 1245 | MeanAbsoluteError: 0.0634329840540886 | Loss: 0.0074445623240657 | Epoch: 1246 | 
MeanAbsoluteError: 0.0676447972655296 | Loss: 0.0088607198216247 | Epoch: 1247 | MeanAbsoluteError: 0.0656333640217781 | Loss: 0.0081435770099779 | 
Epoch: 1248 | MeanAbsoluteError: 0.0587381571531296 | Loss: 0.0060975480369295 | Epoch: 1249 | 
MeanAbsoluteError: 0.0717562735080719 | Loss: 0.0098258529245019 | Epoch: 1250 | 
MeanAbsoluteError: 0.0689298212528229 | Loss: 0.0087784419481594 | Epoch: 1251 | 
MeanAbsoluteError: 0.0664610490202904 | Loss: 0.0080467126428872 | Epoch: 1252 | 
MeanAbsoluteError: 0.0654579997062683 | Loss: 0.0071042130063021 | Epoch: 1253 | 
MeanAbsoluteError: 0.0669261142611504 | Loss: 0.0089866327814525 | Epoch: 1254 | MeanAbsoluteError: 0.0647382065653801 | Loss: 0.0077401265346756 | 
Epoch: 1255 | 
MeanAbsoluteError: 0.0648774206638336 | Loss: 0.0077774753717191 | Epoch: 1256 | 
MeanAbsoluteError: 0.0657313764095306 | Loss: 0.0082211349437906 | Epoch: 1257 | MeanAbsoluteError: 0.0665403082966805 | Loss: 0.0074313055654541 | Epoch: 1258 | 
MeanAbsoluteError: 0.0594211593270302 | Loss: 0.0071143017717986 | Epoch: 1259 | 
MeanAbsoluteError: 0.0705323219299316 | Loss: 0.0091244872695097 | Epoch: 1260 | 
MeanAbsoluteError: 0.0674189627170563 | Loss: 0.0089160714470199 | Epoch: 1261 | 
MeanAbsoluteError: 0.0643175095319748 | Loss: 0.0073061738864635 | Epoch: 1262 | 
MeanAbsoluteError: 0.0635986030101776 | Loss: 0.0078439055049936 | Epoch: 1263 | MeanAbsoluteError: 0.0644236728549004 | Loss: 0.0079309019672549 | Epoch: 1264 | 
MeanAbsoluteError: 0.0694456100463867 | Loss: 0.0094946528280949 | Epoch: 1265 | 
MeanAbsoluteError: 0.0634358301758766 | Loss: 0.0082128785838722 | Epoch: 1266 | 
MeanAbsoluteError: 0.0651962310075760 | Loss: 0.0073334626987829 | Epoch: 1267 | 
MeanAbsoluteError: 0.0672739148139954 | Loss: 0.0084770667766376 | Epoch: 1268 | 
MeanAbsoluteError: 0.0627108663320541 | Loss: 0.0074870041342789 | Epoch: 1269 | 
MeanAbsoluteError: 0.0624081678688526 | Loss: 0.0069907065386845 | Epoch: 1270 | 
MeanAbsoluteError: 0.0634052753448486 | Loss: 0.0074634668356157 | Epoch: 1271 | 
MeanAbsoluteError: 0.0633597299456596 | Loss: 0.0071482634958132 | Epoch: 1272 | 
MeanAbsoluteError: 0.0664746984839439 | Loss: 0.0082736198373823 | Epoch: 1273 | 
MeanAbsoluteError: 0.0686904415488243 | Loss: 0.0087281206722643 | Epoch: 1274 | 
MeanAbsoluteError: 0.0639363825321198 | Loss: 0.0074545509466407 | Epoch: 1275 | 
MeanAbsoluteError: 0.0661009848117828 | Loss: 0.0084051849620179 | Epoch: 1276 | 
MeanAbsoluteError: 0.0614057853817940 | Loss: 0.0072057031167302 | Epoch: 1277 | 
MeanAbsoluteError: 0.0640324279665947 | Loss: 0.0078374590064110 | Epoch: 1278 | 
MeanAbsoluteError: 0.0600649751722813 | Loss: 0.0066643592929662 | Epoch: 1279 | 
MeanAbsoluteError: 0.0607883185148239 | Loss: 0.0072975866975927 | Epoch: 1280 | 
MeanAbsoluteError: 0.0718839392066002 | Loss: 0.0093292304640014 | Epoch: 1281 | 
MeanAbsoluteError: 0.0655750110745430 | Loss: 0.0075120319563393 | Epoch: 1282 | 
MeanAbsoluteError: 0.0669796690344810 | Loss: 0.0084868403728494 | Epoch: 1283 | 
MeanAbsoluteError: 0.0651040747761726 | Loss: 0.0082138723378375 | Epoch: 1284 | MeanAbsoluteError: 0.0693097338080406 | Loss: 0.0092157860000589 | 
Epoch: 1285 | MeanAbsoluteError: 0.0631799772381783 | Loss: 0.0075566027365130 | 
Epoch: 1286 | MeanAbsoluteError: 0.0690412297844887 | Loss: 0.0083828805428736 | 
Epoch: 1287 | 
MeanAbsoluteError: 0.0639232248067856 | Loss: 0.0075265670817074 | Epoch: 1288 | MeanAbsoluteError: 0.0664776414632797 | Loss: 0.0088944718481556 | 
Epoch: 1289 | 
MeanAbsoluteError: 0.0655241906642914 | Loss: 0.0081414124612396 | Epoch: 1290 | MeanAbsoluteError: 0.0618889443576336 | Loss: 0.0067200147344677 | 
Epoch: 1291 | 
MeanAbsoluteError: 0.0629813820123672 | Loss: 0.0073662087672852 | Epoch: 1292 | 
MeanAbsoluteError: 0.0673960968852043 | Loss: 0.0082834121698761 | Epoch: 1293 | 
MeanAbsoluteError: 0.0626662448048592 | Loss: 0.0075431399355390 | Epoch: 1294 | 
MeanAbsoluteError: 0.0596313923597336 | Loss: 0.0065619179316612 | Epoch: 1295 | MeanAbsoluteError: 0.0633628293871880 | Loss: 0.0073429322274023 | 
Epoch: 1296 | MeanAbsoluteError: 0.0650448128581047 | Loss: 0.0078565289918288 | Epoch: 1297 | 
MeanAbsoluteError: 0.0624983347952366 | Loss: 0.0078371777636009 | Epoch: 1298 | 
MeanAbsoluteError: 0.0659194886684418 | Loss: 0.0085747726432813 | Epoch: 1299 | 
MeanAbsoluteError: 0.0615764483809471 | Loss: 0.0072739258453779 | Epoch: 1300 | 
MeanAbsoluteError: 0.0599266737699509 | Loss: 0.0067805788278262 | Epoch: 1301 | MeanAbsoluteError: 0.0583244189620018 | Loss: 0.0062805204397834 | 
Epoch: 1302 | MeanAbsoluteError: 0.0664184167981148 | Loss: 0.0088970508809143 | 
Epoch: 1303 | MeanAbsoluteError: 0.0609658546745777 | Loss: 0.0079523470536030 | Epoch: 1304 | 
MeanAbsoluteError: 0.0639075115323067 | Loss: 0.0075326331617119 | Epoch: 1305 | MeanAbsoluteError: 0.0650974437594414 | Loss: 0.0078477685475324 | Epoch: 1306 | 
MeanAbsoluteError: 0.0605361163616180 | Loss: 0.0071639920091699 | Epoch: 1307 | 
MeanAbsoluteError: 0.0639371797442436 | Loss: 0.0075140639692715 | Epoch: 1308 | MeanAbsoluteError: 0.0644419491291046 | Loss: 0.0072471413043240 | 
Epoch: 1309 | MeanAbsoluteError: 0.0651714950799942 | Loss: 0.0079086994905811 | 
Epoch: 1310 | MeanAbsoluteError: 0.0634796619415283 | Loss: 0.0074316046450076 | 
Epoch: 1311 | MeanAbsoluteError: 0.0613344274461269 | Loss: 0.0080873673409102 | 
Epoch: 1312 | MeanAbsoluteError: 0.0674634501338005 | Loss: 0.0084773492600046 | 
Epoch: 1313 | MeanAbsoluteError: 0.0692832320928574 | Loss: 0.0093603506915762 | Epoch: 1314 | 
MeanAbsoluteError: 0.0669421628117561 | Loss: 0.0087778464366602 | Epoch: 1315 | MeanAbsoluteError: 0.0628866776823997 | Loss: 0.0071531579957324 | Epoch: 1316 | 
MeanAbsoluteError: 0.0641941279172897 | Loss: 0.0075257386034961 | Epoch: 1317 | 
MeanAbsoluteError: 0.0650552734732628 | Loss: 0.0084716473028372 | Epoch: 1318 | 
MeanAbsoluteError: 0.0613015666604042 | Loss: 0.0067663395120568 | Epoch: 1319 | 
MeanAbsoluteError: 0.0661559477448463 | Loss: 0.0083376711673858 | Epoch: 1320 | 
MeanAbsoluteError: 0.0609213821589947 | Loss: 0.0073655017345178 | Epoch: 1321 | 
MeanAbsoluteError: 0.0626262128353119 | Loss: 0.0075482088549688 | Epoch: 1322 | MeanAbsoluteError: 0.0627662762999535 | Loss: 0.0070840526077639 | 
Epoch: 1323 | MeanAbsoluteError: 0.0643920451402664 | Loss: 0.0074859523924230 | Epoch: 1324 | 
MeanAbsoluteError: 0.0687405988574028 | Loss: 0.0086557271608520 | Epoch: 1325 | 
MeanAbsoluteError: 0.0650735870003700 | Loss: 0.0079075570284112 | Epoch: 1326 | 
MeanAbsoluteError: 0.0676467195153236 | Loss: 0.0086018665975522 | Epoch: 1327 | 
MeanAbsoluteError: 0.0611396729946136 | Loss: 0.0066818422503032 | Epoch: 1328 | 
MeanAbsoluteError: 0.0621335282921791 | Loss: 0.0073809573082205 | Epoch: 1329 | 
MeanAbsoluteError: 0.0630192160606384 | Loss: 0.0082602394720683 | Epoch: 1330 | MeanAbsoluteError: 0.0644593313336372 | Loss: 0.0077901630451379 | Epoch: 1331 | 
MeanAbsoluteError: 0.0652192682027817 | Loss: 0.0083026122138520 | Epoch: 1332 | MeanAbsoluteError: 0.0570003651082516 | Loss: 0.0063843136325947 | 
Epoch: 1333 | 
MeanAbsoluteError: 0.0629063099622726 | Loss: 0.0078364033956499 | Epoch: 1334 | 
MeanAbsoluteError: 0.0669872462749481 | Loss: 0.0082991496360046 | Epoch: 1335 | MeanAbsoluteError: 0.0638418197631836 | Loss: 0.0069086087629936 | 
Epoch: 1336 | MeanAbsoluteError: 0.0577014237642288 | Loss: 0.0060680720299873 | Epoch: 1337 | 
MeanAbsoluteError: 0.0638778880238533 | Loss: 0.0076598808684503 | Epoch: 1338 | MeanAbsoluteError: 0.0584987178444862 | Loss: 0.0067154806591801 | Epoch: 1339 | 
MeanAbsoluteError: 0.0613247603178024 | Loss: 0.0072391873157540 | Epoch: 1340 | MeanAbsoluteError: 0.0670353397727013 | Loss: 0.0079014289566718 | 
Epoch: 1341 | 
MeanAbsoluteError: 0.0623135752975941 | Loss: 0.0072253558705173 | Epoch: 1342 | 
MeanAbsoluteError: 0.0689655616879463 | Loss: 0.0084667255408931 | Epoch: 1343 | 
MeanAbsoluteError: 0.0651328042149544 | Loss: 0.0089974856616269 | Epoch: 1344 | MeanAbsoluteError: 0.0630819275975227 | Loss: 0.0079188625942334 | 
Epoch: 1345 | MeanAbsoluteError: 0.0652848482131958 | Loss: 0.0074944380611366 | Epoch: 1346 | 
MeanAbsoluteError: 0.0618101432919502 | Loss: 0.0070387101832299 | Epoch: 1347 | 
MeanAbsoluteError: 0.0618291087448597 | Loss: 0.0070676803772949 | Epoch: 1348 | MeanAbsoluteError: 0.0658891648054123 | Loss: 0.0079724905274513 | 
Epoch: 1349 | MeanAbsoluteError: 0.0608063377439976 | Loss: 0.0074788347536802 | Epoch: 1350 | 
MeanAbsoluteError: 0.0645716935396194 | Loss: 0.0076710211109942 | Epoch: 1351 | MeanAbsoluteError: 0.0619952119886875 | Loss: 0.0073502735146515 | 
Epoch: 1352 | 
MeanAbsoluteError: 0.0584329143166542 | Loss: 0.0064359137129213 | Epoch: 1353 | MeanAbsoluteError: 0.0622574426233768 | Loss: 0.0073395805500816 | 
Epoch: 1354 | MeanAbsoluteError: 0.0620938874781132 | Loss: 0.0076676057224540 | 
Epoch: 1355 | 
MeanAbsoluteError: 0.0614140257239342 | Loss: 0.0070069796116271 | Epoch: 1356 | MeanAbsoluteError: 0.0605843663215637 | Loss: 0.0066789569820927 | 
Epoch: 1357 | MeanAbsoluteError: 0.0652402713894844 | Loss: 0.0080024173239599 | 
Epoch: 1358 | 
MeanAbsoluteError: 0.0615686662495136 | Loss: 0.0077614386483037 | Epoch: 1359 | MeanAbsoluteError: 0.0613305978477001 | Loss: 0.0070129908362772 | 
Epoch: 1360 | MeanAbsoluteError: 0.0615418739616871 | Loss: 0.0065187516012035 | 
Epoch: 1361 | MeanAbsoluteError: 0.0549152679741383 | Loss: 0.0064165410424539 | 
Epoch: 1362 | MeanAbsoluteError: 0.0626999363303185 | Loss: 0.0083868734924666 | 
Epoch: 1363 | 
MeanAbsoluteError: 0.0618818849325180 | Loss: 0.0077586175793840 | Epoch: 1364 | 
MeanAbsoluteError: 0.0651904419064522 | Loss: 0.0085174372291719 | Epoch: 1365 | MeanAbsoluteError: 0.0580070763826370 | Loss: 0.0063553628180064 | 
Epoch: 1366 | MeanAbsoluteError: 0.0593474581837654 | Loss: 0.0066333810169575 | Epoch: 1367 | 
MeanAbsoluteError: 0.0657116100192070 | Loss: 0.0080446169629674 | Epoch: 1368 | 
MeanAbsoluteError: 0.0649689510464668 | Loss: 0.0082688099567410 | Epoch: 1369 | 
MeanAbsoluteError: 0.0617036633193493 | Loss: 0.0072765414456808 | Epoch: 1370 | 
MeanAbsoluteError: 0.0579741299152374 | Loss: 0.0060690352244698 | Epoch: 1371 | 
MeanAbsoluteError: 0.0624091215431690 | Loss: 0.0071853614837649 | Epoch: 1372 | 
MeanAbsoluteError: 0.0592091195285320 | Loss: 0.0068633585108182 | Epoch: 1373 | MeanAbsoluteError: 0.0612926818430424 | Loss: 0.0070898822831562 | 
Epoch: 1374 | 
MeanAbsoluteError: 0.0629625320434570 | Loss: 0.0075403450663180 | Epoch: 1375 | 
MeanAbsoluteError: 0.0561533533036709 | Loss: 0.0062398110347931 | Epoch: 1376 | 
MeanAbsoluteError: 0.0575803257524967 | Loss: 0.0057463484369267 | Epoch: 1377 | 
MeanAbsoluteError: 0.0605554133653641 | Loss: 0.0067975494034181 | Epoch: 1378 | 
MeanAbsoluteError: 0.0617023259401321 | Loss: 0.0078316315116657 | Epoch: 1379 | 
MeanAbsoluteError: 0.0647420883178711 | Loss: 0.0081279200118661 | Epoch: 1380 | 
MeanAbsoluteError: 0.0636060759425163 | Loss: 0.0078124542846005 | Epoch: 1381 | 
MeanAbsoluteError: 0.0628845915198326 | Loss: 0.0075298600523577 | Epoch: 1382 | 
MeanAbsoluteError: 0.0587870739400387 | Loss: 0.0068017562795527 | Epoch: 1383 | 
MeanAbsoluteError: 0.0594340823590755 | Loss: 0.0068100866147385 | Epoch: 1384 | MeanAbsoluteError: 0.0597005002200603 | Loss: 0.0071213143156516 | Epoch: 1385 | 
MeanAbsoluteError: 0.0617785528302193 | Loss: 0.0078751244283861 | Epoch: 1386 | 
MeanAbsoluteError: 0.0580284260213375 | Loss: 0.0061319394700968 | Epoch: 1387 | 
MeanAbsoluteError: 0.0563828349113464 | Loss: 0.0064195158785393 | Epoch: 1388 | 
MeanAbsoluteError: 0.0616265982389450 | Loss: 0.0076148502353711 | Epoch: 1389 | 
MeanAbsoluteError: 0.0606330633163452 | Loss: 0.0071510705161927 | Epoch: 1390 | MeanAbsoluteError: 0.0635909959673882 | Loss: 0.0077244020106809 | 
Epoch: 1391 | MeanAbsoluteError: 0.0572359971702099 | Loss: 0.0061959959114514 | 
Epoch: 1392 | MeanAbsoluteError: 0.0644156709313393 | Loss: 0.0092480228634183 | Epoch: 1393 | 
MeanAbsoluteError: 0.0630799829959869 | Loss: 0.0069712111572638 | Epoch: 1394 | 
MeanAbsoluteError: 0.0624783337116241 | Loss: 0.0077148909074701 | Epoch: 1395 | MeanAbsoluteError: 0.0601760111749172 | Loss: 0.0073478211397439 | Epoch: 1396 | 
MeanAbsoluteError: 0.0642025768756866 | Loss: 0.0079764742399599 | Epoch: 1397 | MeanAbsoluteError: 0.0577466003596783 | Loss: 0.0065671451571385 | 
Epoch: 1398 | 
MeanAbsoluteError: 0.0576646998524666 | Loss: 0.0061059473397957 | Epoch: 1399 | 
MeanAbsoluteError: 0.0621245056390762 | Loss: 0.0071846413112871 | Epoch: 1400 | 
MeanAbsoluteError: 0.0617429167032242 | Loss: 0.0074266857305095 | Epoch: 1401 | 
MeanAbsoluteError: 0.0606677643954754 | Loss: 0.0071803368915304 | Epoch: 1402 | 
MeanAbsoluteError: 0.0571188814938068 | Loss: 0.0063726523913344 | Epoch: 1403 | 
MeanAbsoluteError: 0.0615469031035900 | Loss: 0.0070547169857734 | Epoch: 1404 | 
MeanAbsoluteError: 0.0568328984081745 | Loss: 0.0066136538643059 | Epoch: 1405 | 
MeanAbsoluteError: 0.0610471479594707 | Loss: 0.0074914616866049 | Epoch: 1406 | 
MeanAbsoluteError: 0.0637210905551910 | Loss: 0.0073622973146735 | Epoch: 1407 | MeanAbsoluteError: 0.0608988888561726 | Loss: 0.0069650646187680 | 
Epoch: 1408 | 
MeanAbsoluteError: 0.0635083913803101 | Loss: 0.0073744419755773 | Epoch: 1409 | MeanAbsoluteError: 0.0613607615232468 | Loss: 0.0074132001782770 | 
Epoch: 1410 | 
MeanAbsoluteError: 0.0567573979496956 | Loss: 0.0058836983298776 | Epoch: 1411 | MeanAbsoluteError: 0.0614082664251328 | Loss: 0.0071818019973125 | 
Epoch: 1412 | MeanAbsoluteError: 0.0579419881105423 | Loss: 0.0062258491461883 | 
Epoch: 1413 | 
MeanAbsoluteError: 0.0673705488443375 | Loss: 0.0081560910822979 | Epoch: 1414 | MeanAbsoluteError: 0.0590078085660934 | Loss: 0.0067387137226009 | 
Epoch: 1415 | 
MeanAbsoluteError: 0.0640071555972099 | Loss: 0.0077066556567055 | Epoch: 1416 | 
MeanAbsoluteError: 0.0615480281412601 | Loss: 0.0073057862646419 | Epoch: 1417 | MeanAbsoluteError: 0.0606927499175072 | Loss: 0.0070515984458386 | 
Epoch: 1418 | MeanAbsoluteError: 0.0623196922242641 | Loss: 0.0078783802397265 | 
Epoch: 1419 | 
MeanAbsoluteError: 0.0598662197589874 | Loss: 0.0076764356167769 | Epoch: 1420 | 
MeanAbsoluteError: 0.0592813678085804 | Loss: 0.0063383084298827 | Epoch: 1421 | 
MeanAbsoluteError: 0.0579121261835098 | Loss: 0.0061046122705678 | Epoch: 1422 | 
MeanAbsoluteError: 0.0560657307505608 | Loss: 0.0064951893142279 | Epoch: 1423 | 
MeanAbsoluteError: 0.0569301173090935 | Loss: 0.0062127352823397 | Epoch: 1424 | MeanAbsoluteError: 0.0527590811252594 | Loss: 0.0050304352430067 | 
Epoch: 1425 | 
MeanAbsoluteError: 0.0586816966533661 | Loss: 0.0068195015386664 | Epoch: 1426 | MeanAbsoluteError: 0.0595063529908657 | Loss: 0.0060832207591981 | 
Epoch: 1427 | 
MeanAbsoluteError: 0.0562875941395760 | Loss: 0.0061537421516702 | Epoch: 1428 | 
MeanAbsoluteError: 0.0600663870573044 | Loss: 0.0068046588498934 | Epoch: 1429 | MeanAbsoluteError: 0.0616033822298050 | Loss: 0.0065643374404074 | 
Epoch: 1430 | MeanAbsoluteError: 0.0598269961774349 | Loss: 0.0069182044872650 | Epoch: 1431 | 
MeanAbsoluteError: 0.0537859611213207 | Loss: 0.0054748233892436 | Epoch: 1432 | 
MeanAbsoluteError: 0.0651909038424492 | Loss: 0.0077589493902512 | Epoch: 1433 | 
MeanAbsoluteError: 0.0549605451524258 | Loss: 0.0057096990491542 | Epoch: 1434 | 
MeanAbsoluteError: 0.0538289658725262 | Loss: 0.0052405099209379 | Epoch: 1435 | 
MeanAbsoluteError: 0.0646826028823853 | Loss: 0.0083447102749051 | Epoch: 1436 | 
MeanAbsoluteError: 0.0562140159308910 | Loss: 0.0057327284998610 | Epoch: 1437 | 
MeanAbsoluteError: 0.0546111725270748 | Loss: 0.0054308736422202 | Epoch: 1438 | 
MeanAbsoluteError: 0.0621035061776638 | Loss: 0.0082557260732816 | Epoch: 1439 | MeanAbsoluteError: 0.0612522810697556 | Loss: 0.0065742105081457 | Epoch: 1440 | 
MeanAbsoluteError: 0.0624395683407784 | Loss: 0.0074228892755218 | Epoch: 1441 | 
MeanAbsoluteError: 0.0605133138597012 | Loss: 0.0070000586498160 | Epoch: 1442 | 
MeanAbsoluteError: 0.0583111308515072 | Loss: 0.0062003673713070 | Epoch: 1443 | 
MeanAbsoluteError: 0.0612367764115334 | Loss: 0.0077210576906661 | Epoch: 1444 | 
MeanAbsoluteError: 0.0603519193828106 | Loss: 0.0070293695759271 | Epoch: 1445 | MeanAbsoluteError: 0.0574449785053730 | Loss: 0.0068637881725590 | 
Epoch: 1446 | 
MeanAbsoluteError: 0.0586618222296238 | Loss: 0.0072572660199664 | Epoch: 1447 | 
MeanAbsoluteError: 0.0581373646855354 | Loss: 0.0062438236448361 | Epoch: 1448 | 
MeanAbsoluteError: 0.0561316683888435 | Loss: 0.0059570278080234 | Epoch: 1449 | 
MeanAbsoluteError: 0.0531123839318752 | Loss: 0.0053813544320049 | Epoch: 1450 | 
MeanAbsoluteError: 0.0605618022382259 | Loss: 0.0070625037391558 | Epoch: 1451 | 
MeanAbsoluteError: 0.0600062385201454 | Loss: 0.0069021751472853 | Epoch: 1452 | 
MeanAbsoluteError: 0.0619427114725113 | Loss: 0.0073997796530117 | Epoch: 1453 | 
MeanAbsoluteError: 0.0585625395178795 | Loss: 0.0064291408429563 | Epoch: 1454 | 
MeanAbsoluteError: 0.0597041063010693 | Loss: 0.0071885842996077 | Epoch: 1455 | MeanAbsoluteError: 0.0607596337795258 | Loss: 0.0067394550360526 | 
Epoch: 1456 | 
MeanAbsoluteError: 0.0598204806447029 | Loss: 0.0065294747847171 | Epoch: 1457 | 
MeanAbsoluteError: 0.0565281026065350 | Loss: 0.0063075853128021 | Epoch: 1458 | MeanAbsoluteError: 0.0555839650332928 | Loss: 0.0062608029239163 | Epoch: 1459 | 
MeanAbsoluteError: 0.0614841729402542 | Loss: 0.0081304591986797 | Epoch: 1460 | 
MeanAbsoluteError: 0.0552633851766586 | Loss: 0.0059549865265338 | Epoch: 1461 | MeanAbsoluteError: 0.0553292706608772 | Loss: 0.0058042430022397 | Epoch: 1462 | 
MeanAbsoluteError: 0.0574290007352829 | Loss: 0.0060889334260476 | Epoch: 1463 | 
MeanAbsoluteError: 0.0612221024930477 | Loss: 0.0072655291863581 | Epoch: 1464 | MeanAbsoluteError: 0.0637930184602737 | Loss: 0.0080412526382618 | 
Epoch: 1465 | MeanAbsoluteError: 0.0626364201307297 | Loss: 0.0074383433024377 | 
Epoch: 1466 | 
MeanAbsoluteError: 0.0632826909422874 | Loss: 0.0073553862503104 | Epoch: 1467 | 
MeanAbsoluteError: 0.0601125732064247 | Loss: 0.0068412058156537 | Epoch: 1468 | 
MeanAbsoluteError: 0.0547050610184669 | Loss: 0.0057929950214627 | Epoch: 1469 | 
MeanAbsoluteError: 0.0574987605214119 | Loss: 0.0067555753073975 | Epoch: 1470 | MeanAbsoluteError: 0.0599563606083393 | Loss: 0.0068831633474717 | 
Epoch: 1471 | 
MeanAbsoluteError: 0.0609124936163425 | Loss: 0.0071652110119855 | Epoch: 1472 | 
MeanAbsoluteError: 0.0602326653897762 | Loss: 0.0070969055715068 | Epoch: 1473 | 
MeanAbsoluteError: 0.0604992173612118 | Loss: 0.0078409553711632 | Epoch: 1474 | 
MeanAbsoluteError: 0.0574817731976509 | Loss: 0.0067319622900929 | Epoch: 1475 | 
MeanAbsoluteError: 0.0592858828604221 | Loss: 0.0073775004538235 | Epoch: 1476 | 
MeanAbsoluteError: 0.0584270097315311 | Loss: 0.0068589029441546 | Epoch: 1477 | 
MeanAbsoluteError: 0.0618195533752441 | Loss: 0.0076179647534991 | Epoch: 1478 | 
MeanAbsoluteError: 0.0551564544439316 | Loss: 0.0060430459433125 | Epoch: 1479 | 
MeanAbsoluteError: 0.0586338490247726 | Loss: 0.0067790360786724 | Epoch: 1480 | MeanAbsoluteError: 0.0592064596712589 | Loss: 0.0067620668967174 | 
Epoch: 1481 | 
MeanAbsoluteError: 0.0581419877707958 | Loss: 0.0064459922106956 | Epoch: 1482 | MeanAbsoluteError: 0.0557206086814404 | Loss: 0.0059676565448960 | 
Epoch: 1483 | MeanAbsoluteError: 0.0562057383358479 | Loss: 0.0058941997820875 | 
Epoch: 1484 | MeanAbsoluteError: 0.0566939786076546 | Loss: 0.0060878976977013 | 
Epoch: 1485 | 
MeanAbsoluteError: 0.0585381053388119 | Loss: 0.0068140000216702 | Epoch: 1486 | 
MeanAbsoluteError: 0.0580348223447800 | Loss: 0.0069604242613908 | Epoch: 1487 | 
MeanAbsoluteError: 0.0585049167275429 | Loss: 0.0067485037241568 | Epoch: 1488 | MeanAbsoluteError: 0.0544857904314995 | Loss: 0.0055074304901549 | 
Epoch: 1489 | MeanAbsoluteError: 0.0611697696149349 | Loss: 0.0071358514653184 | 
Epoch: 1490 | MeanAbsoluteError: 0.0571858845651150 | Loss: 0.0069123283736250 | 
Epoch: 1491 | 
MeanAbsoluteError: 0.0605738572776318 | Loss: 0.0071932318024847 | Epoch: 1492 | MeanAbsoluteError: 0.0571141988039017 | Loss: 0.0068854281157943 | 
Epoch: 1493 | 
MeanAbsoluteError: 0.0588979646563530 | Loss: 0.0071295073148152 | Epoch: 1494 | 
MeanAbsoluteError: 0.0590602234005928 | Loss: 0.0077468334687243 | Epoch: 1495 | 
MeanAbsoluteError: 0.0577758029103279 | Loss: 0.0068189770966728 | Epoch: 1496 | 
MeanAbsoluteError: 0.0556981787085533 | Loss: 0.0062483728310144 | Epoch: 1497 | 
MeanAbsoluteError: 0.0624555535614491 | Loss: 0.0084951591963075 | Epoch: 1498 | MeanAbsoluteError: 0.0594521462917328 | Loss: 0.0065498049907334 | 
Epoch: 1499 | MeanAbsoluteError: 0.0569459795951843 | Loss: 0.0065109532973778 | Epoch: 1500 | 
MeanAbsoluteError: 0.0572051256895065 | Loss: 0.0062725787358977 | Epoch: 1501 | 
MeanAbsoluteError: 0.0579050369560719 | Loss: 0.0065122515457551 | Epoch: 1502 | MeanAbsoluteError: 0.0602398738265038 | Loss: 0.0071718297031475 | 
Epoch: 1503 | MeanAbsoluteError: 0.0628710240125656 | Loss: 0.0071787373888098 | Epoch: 1504 | 
MeanAbsoluteError: 0.0614717677235603 | Loss: 0.0074525330553176 | Epoch: 1505 | 
MeanAbsoluteError: 0.0568235963582993 | Loss: 0.0063992594845089 | Epoch: 1506 | 
MeanAbsoluteError: 0.0656926035881042 | Loss: 0.0076966449267244 | Epoch: 1507 | MeanAbsoluteError: 0.0583155825734138 | Loss: 0.0066921212287298 | 
Epoch: 1508 | 
MeanAbsoluteError: 0.0546230450272560 | Loss: 0.0056010982424292 | Epoch: 1509 | MeanAbsoluteError: 0.0609026402235031 | Loss: 0.0067506487021213 | Epoch: 1510 | 
MeanAbsoluteError: 0.0574485771358013 | Loss: 0.0069769152178075 | Epoch: 1511 | MeanAbsoluteError: 0.0581541582942009 | Loss: 0.0070822620452236 | Epoch: 1512 | 
MeanAbsoluteError: 0.0589680783450603 | Loss: 0.0069121905045775 | Epoch: 1513 | 
MeanAbsoluteError: 0.0597947314381599 | Loss: 0.0075521854117687 | Epoch: 1514 | 
MeanAbsoluteError: 0.0581994131207466 | Loss: 0.0067354070377284 | Epoch: 1515 | 
MeanAbsoluteError: 0.0574324354529381 | Loss: 0.0068835451498429 | Epoch: 1516 | 
MeanAbsoluteError: 0.0612603873014450 | Loss: 0.0068838027463304 | Epoch: 1517 | 
MeanAbsoluteError: 0.0613778606057167 | Loss: 0.0073705107199567 | Epoch: 1518 | 
MeanAbsoluteError: 0.0540207549929619 | Loss: 0.0056230659691983 | Epoch: 1519 | 
MeanAbsoluteError: 0.0600142590701580 | Loss: 0.0070824590088159 | Epoch: 1520 | 
MeanAbsoluteError: 0.0593801997601986 | Loss: 0.0071738721338140 | Epoch: 1521 | 
MeanAbsoluteError: 0.0591307580471039 | Loss: 0.0076687757637834 | Epoch: 1522 | 
MeanAbsoluteError: 0.0613984316587448 | Loss: 0.0075668017810252 | Epoch: 1523 | 
MeanAbsoluteError: 0.0519859045743942 | Loss: 0.0055548936529643 | Epoch: 1524 | 
MeanAbsoluteError: 0.0572373643517494 | Loss: 0.0064360815734108 | Epoch: 1525 | 
MeanAbsoluteError: 0.0568256638944149 | Loss: 0.0068366313751888 | Epoch: 1526 | MeanAbsoluteError: 0.0560141764581203 | Loss: 0.0066479151138750 | 
Epoch: 1527 | MeanAbsoluteError: 0.0579391047358513 | Loss: 0.0069133332093891 | 
Epoch: 1528 | 
MeanAbsoluteError: 0.0568515323102474 | Loss: 0.0060166301703187 | Epoch: 1529 | MeanAbsoluteError: 0.0531413778662682 | Loss: 0.0053584218056737 | 
Epoch: 1530 | MeanAbsoluteError: 0.0516725331544876 | Loss: 0.0051637854285703 | 
Epoch: 1531 | 
MeanAbsoluteError: 0.0635213479399681 | Loss: 0.0085200831424784 | Epoch: 1532 | 
MeanAbsoluteError: 0.0548870004713535 | Loss: 0.0054869659042288 | Epoch: 1533 | 
MeanAbsoluteError: 0.0543977916240692 | Loss: 0.0062838464575240 | Epoch: 1534 | 
MeanAbsoluteError: 0.0559631362557411 | Loss: 0.0061966231177864 | Epoch: 1535 | 
MeanAbsoluteError: 0.0573723800480366 | Loss: 0.0061494984872115 | Epoch: 1536 | 
MeanAbsoluteError: 0.0545851066708565 | Loss: 0.0053469536591486 | Epoch: 1537 | 
MeanAbsoluteError: 0.0557450875639915 | Loss: 0.0059958375368054 | Epoch: 1538 | 
MeanAbsoluteError: 0.0521581023931503 | Loss: 0.0051886941197275 | Epoch: 1539 | MeanAbsoluteError: 0.0548775494098663 | Loss: 0.0064664579504279 | 
Epoch: 1540 | 
MeanAbsoluteError: 0.0560318641364574 | Loss: 0.0068612438691586 | Epoch: 1541 | 
MeanAbsoluteError: 0.0525587089359760 | Loss: 0.0050358057881143 | Epoch: 1542 | MeanAbsoluteError: 0.0547960661351681 | Loss: 0.0064907479914079 | 
Epoch: 1543 | 
MeanAbsoluteError: 0.0536576136946678 | Loss: 0.0057773111634500 | Epoch: 1544 | 
MeanAbsoluteError: 0.0581754930317402 | Loss: 0.0065883908386210 | Epoch: 1545 | 
MeanAbsoluteError: 0.0579884015023708 | Loss: 0.0064958385331556 | Epoch: 1546 | MeanAbsoluteError: 0.0568933673202991 | Loss: 0.0059873535339890 | 
Epoch: 1547 | 
MeanAbsoluteError: 0.0580458752810955 | Loss: 0.0067858155452753 | Epoch: 1548 | 
MeanAbsoluteError: 0.0561802089214325 | Loss: 0.0061599961700025 | Epoch: 1549 | 
MeanAbsoluteError: 0.0606594905257225 | Loss: 0.0072828062880823 | Epoch: 1550 | MeanAbsoluteError: 0.0567925944924355 | Loss: 0.0064821334317579 | 
Epoch: 1551 | MeanAbsoluteError: 0.0597822964191437 | Loss: 0.0071329457094089 | Epoch: 1552 | 
MeanAbsoluteError: 0.0519101433455944 | Loss: 0.0052813458700287 | Early stopping at epoch 1551
Returned to Spot: Validation loss: 0.005281345870028721

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.1773189149831582, 'lr_mult': 9.06715620679689, 'batch_size': 4, 'epochs': 4, 'k_folds': 1, 'patience': 8, 'optimizer': 'Adamax', 'sgd_momentum': 0.22706194978124503}
Epoch: 1 | MeanAbsoluteError: 0.1309555470943451 | Loss: 0.0267664993337045 | Epoch: 2 | 
MeanAbsoluteError: 0.1181874051690102 | Loss: 0.0225058259597669 | Epoch: 3 | MeanAbsoluteError: 0.1104716509580612 | Loss: 0.0204033222872143 | Epoch: 4 | 
MeanAbsoluteError: 0.1013538390398026 | Loss: 0.0161965953108544 | Returned to Spot: Validation loss: 0.016196595310854416

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.3840970624671163, 'lr_mult': 4.593111165984917, 'batch_size': 8, 'epochs': 256, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.8945915831939406}
Epoch: 1 | MeanAbsoluteError: 0.1626576930284500 | Loss: 0.0413343399321955 | Epoch: 2 | MeanAbsoluteError: 0.1537394374608994 | Loss: 0.0366750925681309 | Epoch: 3 | MeanAbsoluteError: 0.1365799307823181 | Loss: 0.0277057699368973 | Epoch: 4 | 
MeanAbsoluteError: 0.1161195263266563 | Loss: 0.0229927768109758 | Epoch: 5 | MeanAbsoluteError: 0.1120758429169655 | Loss: 0.0204163207611265 | Epoch: 6 | MeanAbsoluteError: 0.1116492450237274 | Loss: 0.0206605342713087 | Epoch: 7 | MeanAbsoluteError: 0.1021666601300240 | Loss: 0.0172079041918838 | Epoch: 8 | 
MeanAbsoluteError: 0.1030112579464912 | Loss: 0.0167795607826280 | Epoch: 9 | MeanAbsoluteError: 0.0965852290391922 | Loss: 0.0156609430958174 | Epoch: 10 | MeanAbsoluteError: 0.0915888473391533 | Loss: 0.0134127231216744 | Epoch: 11 | MeanAbsoluteError: 0.0932688489556313 | Loss: 0.0137812266199801 | Epoch: 12 | 
MeanAbsoluteError: 0.0863059088587761 | Loss: 0.0120438621073079 | Epoch: 13 | MeanAbsoluteError: 0.0865834653377533 | Loss: 0.0125441572959780 | Epoch: 14 | MeanAbsoluteError: 0.0948938950896263 | Loss: 0.0134223330900759 | Epoch: 15 | MeanAbsoluteError: 0.0933763310313225 | Loss: 0.0142932973164869 | Epoch: 16 | 
MeanAbsoluteError: 0.0665869489312172 | Loss: 0.0071251463898654 | Epoch: 17 | MeanAbsoluteError: 0.0713213384151459 | Loss: 0.0086198542879796 | Epoch: 18 | MeanAbsoluteError: 0.0657032728195190 | Loss: 0.0076233792474101 | Epoch: 19 | MeanAbsoluteError: 0.0689876377582550 | Loss: 0.0076212895004765 | Epoch: 20 | 
MeanAbsoluteError: 0.0895778536796570 | Loss: 0.0119494757443470 | Epoch: 21 | MeanAbsoluteError: 0.0670873224735260 | Loss: 0.0076784088803259 | Epoch: 22 | MeanAbsoluteError: 0.0679591745138168 | Loss: 0.0075432503546931 | Epoch: 23 | MeanAbsoluteError: 0.0583708174526691 | Loss: 0.0062508728235690 | Epoch: 24 | 
MeanAbsoluteError: 0.0644310116767883 | Loss: 0.0070306993898396 | Epoch: 25 | MeanAbsoluteError: 0.0629554837942123 | Loss: 0.0072357600453726 | Epoch: 26 | MeanAbsoluteError: 0.0569255501031876 | Loss: 0.0057495669584329 | Epoch: 27 | MeanAbsoluteError: 0.0568421855568886 | Loss: 0.0065536473013804 | Epoch: 28 | 
MeanAbsoluteError: 0.0598314143717289 | Loss: 0.0066645722039730 | Epoch: 29 | MeanAbsoluteError: 0.0564514808356762 | Loss: 0.0055192979634739 | Epoch: 30 | MeanAbsoluteError: 0.0619444400072098 | Loss: 0.0072641215856971 | Epoch: 31 | MeanAbsoluteError: 0.0587596148252487 | Loss: 0.0065632542000936 | Epoch: 32 | 
MeanAbsoluteError: 0.0543663464486599 | Loss: 0.0053742075443121 | Epoch: 33 | MeanAbsoluteError: 0.0568663328886032 | Loss: 0.0057703523749584 | Epoch: 34 | MeanAbsoluteError: 0.0535132922232151 | Loss: 0.0055064444681384 | Epoch: 35 | MeanAbsoluteError: 0.0526774674654007 | Loss: 0.0050219573497184 | Epoch: 36 | 
MeanAbsoluteError: 0.0571622215211391 | Loss: 0.0064462518111165 | Epoch: 37 | MeanAbsoluteError: 0.0696950629353523 | Loss: 0.0077464828132897 | Epoch: 38 | MeanAbsoluteError: 0.0493961721658707 | Loss: 0.0049501459442055 | Epoch: 39 | MeanAbsoluteError: 0.0620064921677113 | Loss: 0.0065720183621651 | Epoch: 40 | 
MeanAbsoluteError: 0.0537368021905422 | Loss: 0.0052471039035529 | Epoch: 41 | MeanAbsoluteError: 0.0505347140133381 | Loss: 0.0048286769398194 | Epoch: 42 | MeanAbsoluteError: 0.0545800775289536 | Loss: 0.0056211128279469 | Epoch: 43 | MeanAbsoluteError: 0.0519079603254795 | Loss: 0.0054655959308883 | Epoch: 44 | 
MeanAbsoluteError: 0.0565166287124157 | Loss: 0.0056362423822161 | Epoch: 45 | MeanAbsoluteError: 0.0515047647058964 | Loss: 0.0050457607522778 | Epoch: 46 | MeanAbsoluteError: 0.0515970587730408 | Loss: 0.0052022965269555 | Epoch: 47 | MeanAbsoluteError: 0.0519188679754734 | Loss: 0.0055511957892266 | Epoch: 48 | 
MeanAbsoluteError: 0.0525708273053169 | Loss: 0.0054101470297227 | Epoch: 49 | MeanAbsoluteError: 0.0572436191141605 | Loss: 0.0062339764982952 | Epoch: 50 | MeanAbsoluteError: 0.0546015240252018 | Loss: 0.0059300869593005 | Epoch: 51 | MeanAbsoluteError: 0.0507240742444992 | Loss: 0.0049242280656472 | Epoch: 52 | 
MeanAbsoluteError: 0.0591840930283070 | Loss: 0.0059958707118456 | Epoch: 53 | MeanAbsoluteError: 0.0619864538311958 | Loss: 0.0066938467651581 | Epoch: 54 | MeanAbsoluteError: 0.0494473315775394 | Loss: 0.0054034422600556 | Epoch: 55 | MeanAbsoluteError: 0.0551491975784302 | Loss: 0.0056716466389940 | Epoch: 56 | 
MeanAbsoluteError: 0.0738624036312103 | Loss: 0.0087352389604539 | Epoch: 57 | MeanAbsoluteError: 0.0575299598276615 | Loss: 0.0059685161732456 | Epoch: 58 | MeanAbsoluteError: 0.0552396513521671 | Loss: 0.0061524976397203 | Epoch: 59 | MeanAbsoluteError: 0.0581949986517429 | Loss: 0.0072683119460156 | Epoch: 60 | 
MeanAbsoluteError: 0.0520954206585884 | Loss: 0.0044637787214015 | Epoch: 61 | MeanAbsoluteError: 0.0508360192179680 | Loss: 0.0057808192489718 | Epoch: 62 | MeanAbsoluteError: 0.0519524887204170 | Loss: 0.0052587952829383 | Epoch: 63 | MeanAbsoluteError: 0.0630856603384018 | Loss: 0.0066377179464325 | Epoch: 64 | 
MeanAbsoluteError: 0.0550147891044617 | Loss: 0.0063826961712422 | Epoch: 65 | MeanAbsoluteError: 0.0494233332574368 | Loss: 0.0047548134798968 | Epoch: 66 | MeanAbsoluteError: 0.0550118573009968 | Loss: 0.0060631001420246 | Epoch: 67 | MeanAbsoluteError: 0.0555475354194641 | Loss: 0.0061263475478259 | Epoch: 68 | 
MeanAbsoluteError: 0.0500766783952713 | Loss: 0.0053911277094525 | Epoch: 69 | MeanAbsoluteError: 0.0493550635874271 | Loss: 0.0049810078175812 | Epoch: 70 | MeanAbsoluteError: 0.0498366914689541 | Loss: 0.0051566599056394 | Epoch: 71 | MeanAbsoluteError: 0.0591872930526733 | Loss: 0.0059196064585673 | Epoch: 72 | 
MeanAbsoluteError: 0.0613668188452721 | Loss: 0.0071180686507815 | Epoch: 73 | MeanAbsoluteError: 0.0576037168502808 | Loss: 0.0068467988166958 | Epoch: 74 | MeanAbsoluteError: 0.0477524213492870 | Loss: 0.0046002967482261 | Epoch: 75 | MeanAbsoluteError: 0.0536939054727554 | Loss: 0.0059728021411789 | Epoch: 76 | 
MeanAbsoluteError: 0.0583653524518013 | Loss: 0.0064095350006889 | Epoch: 77 | MeanAbsoluteError: 0.0520939677953720 | Loss: 0.0050349207227363 | Epoch: 78 | MeanAbsoluteError: 0.0607239603996277 | Loss: 0.0065976455164338 | Epoch: 79 | MeanAbsoluteError: 0.0641899630427361 | Loss: 0.0077005118211290 | Epoch: 80 | 
MeanAbsoluteError: 0.0596516430377960 | Loss: 0.0073486232217156 | Epoch: 81 | MeanAbsoluteError: 0.0516849830746651 | Loss: 0.0047221142020518 | Epoch: 82 | MeanAbsoluteError: 0.0512438528239727 | Loss: 0.0052871966112626 | Epoch: 83 | MeanAbsoluteError: 0.0478094704449177 | Loss: 0.0045627442664945 | Epoch: 84 | 
MeanAbsoluteError: 0.0508753396570683 | Loss: 0.0047871772533797 | Epoch: 85 | MeanAbsoluteError: 0.0600877068936825 | Loss: 0.0061330010066740 | Epoch: 86 | MeanAbsoluteError: 0.0532678142189980 | Loss: 0.0059493582061565 | Epoch: 87 | MeanAbsoluteError: 0.0441336482763290 | Loss: 0.0044096979537770 | Epoch: 88 | 
MeanAbsoluteError: 0.0550864599645138 | Loss: 0.0056976009049992 | Epoch: 89 | MeanAbsoluteError: 0.0540781542658806 | Loss: 0.0056116802420308 | Epoch: 90 | MeanAbsoluteError: 0.0623120442032814 | Loss: 0.0071764549785784 | Epoch: 91 | MeanAbsoluteError: 0.0531963147222996 | Loss: 0.0056378628911549 | Epoch: 92 | 
MeanAbsoluteError: 0.0500107370316982 | Loss: 0.0049179475555368 | Epoch: 93 | MeanAbsoluteError: 0.0519585907459259 | Loss: 0.0048321871895735 | Epoch: 94 | MeanAbsoluteError: 0.0562688559293747 | Loss: 0.0065124650565466 | Epoch: 95 | MeanAbsoluteError: 0.0575997047126293 | Loss: 0.0066455133155135 | Epoch: 96 | 
MeanAbsoluteError: 0.0552041940391064 | Loss: 0.0056959307525846 | Epoch: 97 | MeanAbsoluteError: 0.0458198785781860 | Loss: 0.0039411248044895 | Epoch: 98 | MeanAbsoluteError: 0.0484993606805801 | Loss: 0.0047044951811825 | Epoch: 99 | MeanAbsoluteError: 0.0501653477549553 | Loss: 0.0053635052892404 | Epoch: 100 | 
MeanAbsoluteError: 0.0523182712495327 | Loss: 0.0052293583438242 | Epoch: 101 | MeanAbsoluteError: 0.0494123138487339 | Loss: 0.0047505266710160 | Epoch: 102 | MeanAbsoluteError: 0.0542582459747791 | Loss: 0.0058572823472787 | Epoch: 103 | MeanAbsoluteError: 0.0611453317105770 | Loss: 0.0069310934356365 | Epoch: 104 | 
MeanAbsoluteError: 0.0494379438459873 | Loss: 0.0048170089200874 | Epoch: 105 | MeanAbsoluteError: 0.0476049259305000 | Loss: 0.0042035949545128 | Epoch: 106 | MeanAbsoluteError: 0.0549797564744949 | Loss: 0.0054155508221715 | Epoch: 107 | MeanAbsoluteError: 0.0537908375263214 | Loss: 0.0060102132602448 | Epoch: 108 | 
MeanAbsoluteError: 0.0545927286148071 | Loss: 0.0057061528511296 | Epoch: 109 | MeanAbsoluteError: 0.0507012866437435 | Loss: 0.0055254424101134 | Epoch: 110 | MeanAbsoluteError: 0.0496096909046173 | Loss: 0.0047983706524400 | Epoch: 111 | MeanAbsoluteError: 0.0559792406857014 | Loss: 0.0055359107576997 | Epoch: 112 | 
MeanAbsoluteError: 0.0493679419159889 | Loss: 0.0043806780288976 | Epoch: 113 | MeanAbsoluteError: 0.0532419532537460 | Loss: 0.0053525975488714 | Epoch: 114 | MeanAbsoluteError: 0.0503252707421780 | Loss: 0.0050524903498100 | Epoch: 115 | MeanAbsoluteError: 0.0546430796384811 | Loss: 0.0050659800701971 | Epoch: 116 | 
MeanAbsoluteError: 0.0468460731208324 | Loss: 0.0040309375250026 | Epoch: 117 | MeanAbsoluteError: 0.0541516244411469 | Loss: 0.0056323735564212 | Epoch: 118 | MeanAbsoluteError: 0.0573698617517948 | Loss: 0.0062795656267554 | Epoch: 119 | MeanAbsoluteError: 0.0557148680090904 | Loss: 0.0056823902751172 | Epoch: 120 | 
MeanAbsoluteError: 0.0522578321397305 | Loss: 0.0055570269637668 | Epoch: 121 | MeanAbsoluteError: 0.0580411776900291 | Loss: 0.0064528663979696 | Epoch: 122 | MeanAbsoluteError: 0.0618687756359577 | Loss: 0.0077903263338253 | Epoch: 123 | MeanAbsoluteError: 0.0502107776701450 | Loss: 0.0047873221337795 | Epoch: 124 | 
MeanAbsoluteError: 0.0548376925289631 | Loss: 0.0056014357863827 | Epoch: 125 | MeanAbsoluteError: 0.0503295026719570 | Loss: 0.0048289871131266 | Epoch: 126 | MeanAbsoluteError: 0.0528815612196922 | Loss: 0.0054034313713936 | Epoch: 127 | MeanAbsoluteError: 0.0596853457391262 | Loss: 0.0064964930551421 | Epoch: 128 | 
MeanAbsoluteError: 0.0522864200174809 | Loss: 0.0056025770479066 | Epoch: 129 | MeanAbsoluteError: 0.0542617663741112 | Loss: 0.0055674885270970 | Epoch: 130 | MeanAbsoluteError: 0.0520368888974190 | Loss: 0.0058686850028799 | Epoch: 131 | MeanAbsoluteError: 0.0520289428532124 | Loss: 0.0052298797803049 | Epoch: 132 | 
MeanAbsoluteError: 0.0490668378770351 | Loss: 0.0053369368114019 | Epoch: 133 | MeanAbsoluteError: 0.0516531206667423 | Loss: 0.0052992479069967 | Epoch: 134 | MeanAbsoluteError: 0.0566428117454052 | Loss: 0.0055602299643828 | Epoch: 135 | MeanAbsoluteError: 0.0574399381875992 | Loss: 0.0065735095995478 | Epoch: 136 | 
MeanAbsoluteError: 0.0488358102738857 | Loss: 0.0043989780043423 | Epoch: 137 | MeanAbsoluteError: 0.0528677552938461 | Loss: 0.0053588080106573 | Epoch: 138 | MeanAbsoluteError: 0.0539270713925362 | Loss: 0.0054578413944814 | Epoch: 139 | MeanAbsoluteError: 0.0655283629894257 | Loss: 0.0080582260546324 | Epoch: 140 | 
MeanAbsoluteError: 0.0553373582661152 | Loss: 0.0066498752107452 | Epoch: 141 | MeanAbsoluteError: 0.0622127801179886 | Loss: 0.0071402426861153 | Epoch: 142 | MeanAbsoluteError: 0.0554172396659851 | Loss: 0.0061624450088283 | Epoch: 143 | MeanAbsoluteError: 0.0623613409698009 | Loss: 0.0075119851665620 | Epoch: 144 | 
MeanAbsoluteError: 0.0494643561542034 | Loss: 0.0043325493982258 | Epoch: 145 | MeanAbsoluteError: 0.0497703924775124 | Loss: 0.0051071796287464 | Epoch: 146 | MeanAbsoluteError: 0.0568656846880913 | Loss: 0.0065511772531624 | Epoch: 147 | MeanAbsoluteError: 0.0503701195120811 | Loss: 0.0049316984843340 | Epoch: 148 | 
MeanAbsoluteError: 0.0523736067116261 | Loss: 0.0063204017887505 | Epoch: 149 | MeanAbsoluteError: 0.0543906353414059 | Loss: 0.0056644473960133 | Epoch: 150 | MeanAbsoluteError: 0.0556323640048504 | Loss: 0.0061598028344298 | Epoch: 151 | MeanAbsoluteError: 0.0461018010973930 | Loss: 0.0040895179263316 | Epoch: 152 | 
MeanAbsoluteError: 0.0485561713576317 | Loss: 0.0045722600196697 | Epoch: 153 | MeanAbsoluteError: 0.0560141168534756 | Loss: 0.0063591152460216 | Epoch: 154 | MeanAbsoluteError: 0.0626327022910118 | Loss: 0.0079410097555650 | Epoch: 155 | MeanAbsoluteError: 0.0513693802058697 | Loss: 0.0058101493525196 | Epoch: 156 | 
MeanAbsoluteError: 0.0495325960218906 | Loss: 0.0049131366173051 | Epoch: 157 | MeanAbsoluteError: 0.0649836808443069 | Loss: 0.0068259897433515 | Epoch: 158 | MeanAbsoluteError: 0.0541844889521599 | Loss: 0.0052261899262177 | Epoch: 159 | MeanAbsoluteError: 0.0518353730440140 | Loss: 0.0057736479226916 | Epoch: 160 | 
MeanAbsoluteError: 0.0553698912262917 | Loss: 0.0060843926024207 | Epoch: 161 | MeanAbsoluteError: 0.0483135432004929 | Loss: 0.0049607554560919 | Early stopping at epoch 160
Returned to Spot: Validation loss: 0.004960755456091934

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.2570159891363366, 'lr_mult': 6.162706742092988, 'batch_size': 16, 'epochs': 1024, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.12853296907341383}
Epoch: 1 | MeanAbsoluteError: 0.3423440158367157 | Loss: 0.1437908979622941 | Epoch: 2 | MeanAbsoluteError: 0.1729822009801865 | Loss: 0.0447112348322806 | Epoch: 3 | MeanAbsoluteError: 0.2257872968912125 | Loss: 0.0710060449415132 | Epoch: 4 | MeanAbsoluteError: 0.1799511015415192 | Loss: 0.0475212613022641 | Epoch: 5 | MeanAbsoluteError: 0.2033299803733826 | Loss: 0.0582103113594808 | Epoch: 6 | MeanAbsoluteError: 0.2281363457441330 | Loss: 0.0712397245592193 | Epoch: 7 | 
MeanAbsoluteError: 0.2041242420673370 | Loss: 0.0576041187894972 | Epoch: 8 | MeanAbsoluteError: 0.1528605818748474 | Loss: 0.0342372890169683 | Epoch: 9 | MeanAbsoluteError: 0.1994613558053970 | Loss: 0.0548458507186488 | Epoch: 10 | MeanAbsoluteError: 0.1095547974109650 | Loss: 0.0190495706506466 | Epoch: 11 | MeanAbsoluteError: 0.1068698614835739 | Loss: 0.0186127331107855 | Epoch: 12 | MeanAbsoluteError: 0.1599126160144806 | Loss: 0.0370459471290049 | Epoch: 13 | MeanAbsoluteError: 0.1212146505713463 | Loss: 0.0208737085034188 | Epoch: 14 | 
MeanAbsoluteError: 0.1298228651285172 | Loss: 0.0240677195160012 | Epoch: 15 | MeanAbsoluteError: 0.0836421176791191 | Loss: 0.0107364191575662 | Epoch: 16 | MeanAbsoluteError: 0.1273536831140518 | Loss: 0.0230931367136930 | Epoch: 17 | MeanAbsoluteError: 0.0766559764742851 | Loss: 0.0098223268225985 | Epoch: 18 | MeanAbsoluteError: 0.1038939505815506 | Loss: 0.0161122628732731 | Epoch: 19 | MeanAbsoluteError: 0.1233117282390594 | Loss: 0.0215209063730742 | Epoch: 20 | MeanAbsoluteError: 0.0743732228875160 | Loss: 0.0089336907932241 | Epoch: 21 | 
MeanAbsoluteError: 0.0873041972517967 | Loss: 0.0125091873158358 | Epoch: 22 | MeanAbsoluteError: 0.1484719514846802 | Loss: 0.0288214277181970 | Epoch: 23 | MeanAbsoluteError: 0.0720680877566338 | Loss: 0.0092540455393885 | Epoch: 24 | MeanAbsoluteError: 0.0708367601037025 | Loss: 0.0079730321457119 | Epoch: 25 | MeanAbsoluteError: 0.0889565721154213 | Loss: 0.0113509332418050 | Epoch: 26 | MeanAbsoluteError: 0.0617389678955078 | Loss: 0.0061907215338004 | Epoch: 27 | MeanAbsoluteError: 0.1054337769746780 | Loss: 0.0154105860641912 | Epoch: 28 | 
MeanAbsoluteError: 0.0727515071630478 | Loss: 0.0088184152876860 | Epoch: 29 | MeanAbsoluteError: 0.0861858278512955 | Loss: 0.0112928010180200 | Epoch: 30 | MeanAbsoluteError: 0.1228733062744141 | Loss: 0.0197133857658819 | Epoch: 31 | MeanAbsoluteError: 0.0638014525175095 | Loss: 0.0068249667161389 | Epoch: 32 | MeanAbsoluteError: 0.1081183254718781 | Loss: 0.0162850312986656 | Epoch: 33 | MeanAbsoluteError: 0.1647999435663223 | Loss: 0.0323032680898905 | Epoch: 34 | MeanAbsoluteError: 0.0576383136212826 | Loss: 0.0053536545754851 | Epoch: 35 | 
MeanAbsoluteError: 0.1067969873547554 | Loss: 0.0157729884315478 | Epoch: 36 | MeanAbsoluteError: 0.0580458305776119 | Loss: 0.0062006904106391 | Epoch: 37 | MeanAbsoluteError: 0.0903462618589401 | Loss: 0.0122054628782759 | Epoch: 38 | MeanAbsoluteError: 0.0727648735046387 | Loss: 0.0080979502955942 | Epoch: 39 | MeanAbsoluteError: 0.0510425642132759 | Loss: 0.0045917903587810 | Epoch: 40 | MeanAbsoluteError: 0.0938505157828331 | Loss: 0.0121378300613479 | Epoch: 41 | MeanAbsoluteError: 0.0791885852813721 | Loss: 0.0092246305981749 | Epoch: 42 | 
MeanAbsoluteError: 0.0530719459056854 | Loss: 0.0047994942379821 | Epoch: 43 | MeanAbsoluteError: 0.1168851628899574 | Loss: 0.0178712103025694 | Epoch: 44 | MeanAbsoluteError: 0.0630470588803291 | Loss: 0.0062137686059271 | Epoch: 45 | MeanAbsoluteError: 0.1283007711172104 | Loss: 0.0199300442871295 | Epoch: 46 | MeanAbsoluteError: 0.0765519812703133 | Loss: 0.0083993833119932 | Epoch: 47 | MeanAbsoluteError: 0.0548956803977489 | Loss: 0.0053270776621311 | Epoch: 48 | MeanAbsoluteError: 0.0637701302766800 | Loss: 0.0065470883794325 | Epoch: 49 | 
MeanAbsoluteError: 0.0470315851271152 | Loss: 0.0037644248284203 | Epoch: 50 | MeanAbsoluteError: 0.0520977415144444 | Loss: 0.0050207443939718 | Epoch: 51 | MeanAbsoluteError: 0.1512401252985001 | Loss: 0.0264807663073665 | Epoch: 52 | MeanAbsoluteError: 0.0490257218480110 | Loss: 0.0046885100769271 | Epoch: 53 | MeanAbsoluteError: 0.1133133471012115 | Loss: 0.0161198040372447 | Epoch: 54 | MeanAbsoluteError: 0.0676490813493729 | Loss: 0.0078625837218409 | Epoch: 55 | MeanAbsoluteError: 0.0762003064155579 | Loss: 0.0080595187793829 | Epoch: 56 | 
MeanAbsoluteError: 0.1029866710305214 | Loss: 0.0134951557081781 | Epoch: 57 | MeanAbsoluteError: 0.0801100507378578 | Loss: 0.0090739255722024 | Epoch: 58 | MeanAbsoluteError: 0.0855760499835014 | Loss: 0.0107470915995930 | Epoch: 59 | MeanAbsoluteError: 0.0542796589434147 | Loss: 0.0051013741299118 | Epoch: 60 | MeanAbsoluteError: 0.0651183426380157 | Loss: 0.0072130749222675 | Epoch: 61 | MeanAbsoluteError: 0.0763374716043472 | Loss: 0.0087482365779579 | Epoch: 62 | MeanAbsoluteError: 0.0477542914450169 | Loss: 0.0040827394236418 | Epoch: 63 | 
MeanAbsoluteError: 0.0450784452259541 | Loss: 0.0038554653598878 | Epoch: 64 | MeanAbsoluteError: 0.0398227237164974 | Loss: 0.0028246651268809 | Epoch: 65 | MeanAbsoluteError: 0.0779407098889351 | Loss: 0.0088071843952333 | Epoch: 66 | MeanAbsoluteError: 0.0805606991052628 | Loss: 0.0091593268964636 | Epoch: 67 | MeanAbsoluteError: 0.0975914672017097 | Loss: 0.0122058492791104 | Epoch: 68 | MeanAbsoluteError: 0.0527165345847607 | Loss: 0.0053914263721948 | Epoch: 69 | MeanAbsoluteError: 0.1138182058930397 | Loss: 0.0157854715852361 | Epoch: 70 | 
MeanAbsoluteError: 0.0428841635584831 | Loss: 0.0037421189971562 | Epoch: 71 | MeanAbsoluteError: 0.0516423620283604 | Loss: 0.0048520243787942 | Epoch: 72 | MeanAbsoluteError: 0.0420255735516548 | Loss: 0.0035605940134510 | Epoch: 73 | MeanAbsoluteError: 0.0521859154105186 | Loss: 0.0049911654725867 | Epoch: 74 | MeanAbsoluteError: 0.0486435666680336 | Loss: 0.0044860523806787 | Epoch: 75 | MeanAbsoluteError: 0.0805722847580910 | Loss: 0.0091605205333939 | Epoch: 76 | MeanAbsoluteError: 0.0466424375772476 | Loss: 0.0039884851032280 | Epoch: 77 | 
MeanAbsoluteError: 0.0722592771053314 | Loss: 0.0076032666930635 | Epoch: 78 | MeanAbsoluteError: 0.0683041512966156 | Loss: 0.0072623347177317 | Epoch: 79 | MeanAbsoluteError: 0.0412859804928303 | Loss: 0.0030700229077698 | Epoch: 80 | MeanAbsoluteError: 0.0609451495110989 | Loss: 0.0058219831093754 | Epoch: 81 | MeanAbsoluteError: 0.0409572757780552 | Loss: 0.0029413407901302 | Epoch: 82 | MeanAbsoluteError: 0.0436525866389275 | Loss: 0.0039864069671909 | Epoch: 83 | MeanAbsoluteError: 0.0717284232378006 | Loss: 0.0078941746369789 | Epoch: 84 | 
MeanAbsoluteError: 0.0782864838838577 | Loss: 0.0086543309183693 | Epoch: 85 | MeanAbsoluteError: 0.0460302494466305 | Loss: 0.0036830229464134 | Epoch: 86 | MeanAbsoluteError: 0.0659904107451439 | Loss: 0.0064082944790195 | Epoch: 87 | MeanAbsoluteError: 0.0686687752604485 | Loss: 0.0073794202241851 | Epoch: 88 | MeanAbsoluteError: 0.0670675560832024 | Loss: 0.0066813337984250 | Epoch: 89 | MeanAbsoluteError: 0.0565076433122158 | Loss: 0.0049964674429870 | Epoch: 90 | MeanAbsoluteError: 0.0573157444596291 | Loss: 0.0059539593425334 | Epoch: 91 | 
MeanAbsoluteError: 0.1343620866537094 | Loss: 0.0212959553066053 | Epoch: 92 | MeanAbsoluteError: 0.0555307008326054 | Loss: 0.0054213659421198 | Epoch: 93 | MeanAbsoluteError: 0.0553924702107906 | Loss: 0.0048595409178616 | Epoch: 94 | MeanAbsoluteError: 0.0402259603142738 | Loss: 0.0030049026551607 | Epoch: 95 | MeanAbsoluteError: 0.0559682659804821 | Loss: 0.0058410302000610 | Epoch: 96 | MeanAbsoluteError: 0.0470009483397007 | Loss: 0.0041267481865361 | Early stopping at epoch 95
Returned to Spot: Validation loss: 0.004126748186536133
spotPython tuning: 0.0031685928421977317 [#---------] 6.15% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.016321969877482245, 'lr_mult': 9.255211113703332, 'batch_size': 16, 'epochs': 16384, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.011654298200852786}
Epoch: 1 | MeanAbsoluteError: 0.1381368190050125 | Loss: 0.0298610174244172 | Epoch: 2 | MeanAbsoluteError: 0.1415905505418777 | Loss: 0.0308142860272997 | Epoch: 3 | MeanAbsoluteError: 0.1300413757562637 | Loss: 0.0252986422396804 | Epoch: 4 | MeanAbsoluteError: 0.2359963208436966 | Loss: 0.0665579397035272 | Epoch: 5 | MeanAbsoluteError: 0.1421177983283997 | Loss: 0.0290346409341222 | Epoch: 6 | MeanAbsoluteError: 0.1252553313970566 | Loss: 0.0228163301454563 | Epoch: 7 | 
MeanAbsoluteError: 0.1209583431482315 | Loss: 0.0217053342708632 | Epoch: 8 | MeanAbsoluteError: 0.1046008393168449 | Loss: 0.0168037523368472 | Epoch: 9 | MeanAbsoluteError: 0.1143934279680252 | Loss: 0.0185354011329381 | Epoch: 10 | MeanAbsoluteError: 0.1028552725911140 | Loss: 0.0156799259252454 | Epoch: 11 | MeanAbsoluteError: 0.1598346680402756 | Loss: 0.0317355913943366 | Epoch: 12 | MeanAbsoluteError: 0.0997794419527054 | Loss: 0.0146708206616734 | Epoch: 13 | MeanAbsoluteError: 0.1445914059877396 | Loss: 0.0256868289097359 | Epoch: 14 | 
MeanAbsoluteError: 0.0744509622454643 | Loss: 0.0090770717024019 | Epoch: 15 | MeanAbsoluteError: 0.0869106575846672 | Loss: 0.0116266571475487 | Epoch: 16 | MeanAbsoluteError: 0.0790090262889862 | Loss: 0.0097968297226256 | Epoch: 17 | MeanAbsoluteError: 0.0922712609171867 | Loss: 0.0119085109449531 | Epoch: 18 | MeanAbsoluteError: 0.0867066383361816 | Loss: 0.0103842701615864 | Epoch: 19 | MeanAbsoluteError: 0.0587806366384029 | Loss: 0.0060068408492953 | Epoch: 20 | MeanAbsoluteError: 0.0927818045020103 | Loss: 0.0108138172838249 | Epoch: 21 | 
MeanAbsoluteError: 0.0746223926544189 | Loss: 0.0085193426103184 | Epoch: 22 | MeanAbsoluteError: 0.0728446170687675 | Loss: 0.0082433081084960 | Epoch: 23 | MeanAbsoluteError: 0.0858697295188904 | Loss: 0.0107542360691648 | Epoch: 24 | MeanAbsoluteError: 0.0439411848783493 | Loss: 0.0030571062448680 | Epoch: 25 | MeanAbsoluteError: 0.0738186985254288 | Loss: 0.0085100202429059 | Epoch: 26 | MeanAbsoluteError: 0.0765020176768303 | Loss: 0.0075667922041918 | Epoch: 27 | MeanAbsoluteError: 0.0507209226489067 | Loss: 0.0043163058642102 | Epoch: 28 | 
MeanAbsoluteError: 0.0404557660222054 | Loss: 0.0025731556877298 | Epoch: 29 | MeanAbsoluteError: 0.0393217019736767 | Loss: 0.0023927316498502 | Epoch: 30 | MeanAbsoluteError: 0.0531868748366833 | Loss: 0.0039956503008541 | Epoch: 31 | MeanAbsoluteError: 0.0671810880303383 | Loss: 0.0060611091995318 | Epoch: 32 | MeanAbsoluteError: 0.0520166382193565 | Loss: 0.0036054905626531 | Epoch: 33 | MeanAbsoluteError: 0.0532259084284306 | Loss: 0.0037164768865822 | Epoch: 34 | MeanAbsoluteError: 0.0308107566088438 | Loss: 0.0017142235577155 | Epoch: 35 | 
MeanAbsoluteError: 0.0439684651792049 | Loss: 0.0028109679758353 | Epoch: 36 | MeanAbsoluteError: 0.0484050996601582 | Loss: 0.0035730493500044 | Epoch: 37 | MeanAbsoluteError: 0.0730066001415253 | Loss: 0.0065430712788121 | Epoch: 38 | MeanAbsoluteError: 0.0496380887925625 | Loss: 0.0037361947746065 | Epoch: 39 | MeanAbsoluteError: 0.0453871600329876 | Loss: 0.0030125371597119 | Epoch: 40 | MeanAbsoluteError: 0.0309584327042103 | Loss: 0.0014791755881896 | Epoch: 41 | MeanAbsoluteError: 0.0773968249559402 | Loss: 0.0083333109015305 | Epoch: 42 | 
MeanAbsoluteError: 0.0598095841705799 | Loss: 0.0052282116008236 | Epoch: 43 | MeanAbsoluteError: 0.0576358214020729 | Loss: 0.0051708783905365 | Epoch: 44 | MeanAbsoluteError: 0.0616572573781013 | Loss: 0.0044046429010402 | Epoch: 45 | MeanAbsoluteError: 0.0311869084835052 | Loss: 0.0014954867932063 | Epoch: 46 | MeanAbsoluteError: 0.0375396646559238 | Loss: 0.0018767114992155 | Epoch: 47 | MeanAbsoluteError: 0.0315078273415565 | Loss: 0.0018717211879496 | Epoch: 48 | MeanAbsoluteError: 0.0808342099189758 | Loss: 0.0083587749027892 | Epoch: 49 | 
MeanAbsoluteError: 0.0662915706634521 | Loss: 0.0066272778387525 | Epoch: 50 | MeanAbsoluteError: 0.0441165529191494 | Loss: 0.0029176935908924 | Epoch: 51 | MeanAbsoluteError: 0.0423346646130085 | Loss: 0.0026227227399910 | Epoch: 52 | MeanAbsoluteError: 0.0695956870913506 | Loss: 0.0055701839860137 | Epoch: 53 | MeanAbsoluteError: 0.0303622968494892 | Loss: 0.0015336165900073 | Epoch: 54 | MeanAbsoluteError: 0.0373507812619209 | Loss: 0.0026106717628672 | Epoch: 55 | MeanAbsoluteError: 0.0612906254827976 | Loss: 0.0046425003215278 | Epoch: 56 | 
MeanAbsoluteError: 0.0322644747793674 | Loss: 0.0015487311695898 | Epoch: 57 | MeanAbsoluteError: 0.0424712896347046 | Loss: 0.0025092012824883 | Epoch: 58 | MeanAbsoluteError: 0.0858132541179657 | Loss: 0.0082362883136069 | Epoch: 59 | MeanAbsoluteError: 0.0224078651517630 | Loss: 0.0009108500947293 | Epoch: 60 | MeanAbsoluteError: 0.0314952954649925 | Loss: 0.0014676340659590 | Epoch: 61 | MeanAbsoluteError: 0.0574369765818119 | Loss: 0.0050783273886497 | Epoch: 62 | MeanAbsoluteError: 0.0344153977930546 | Loss: 0.0016355023835786 | Epoch: 63 | 
MeanAbsoluteError: 0.0555437020957470 | Loss: 0.0037894991201986 | Epoch: 64 | MeanAbsoluteError: 0.0278289634734392 | Loss: 0.0012781914709577 | Epoch: 65 | MeanAbsoluteError: 0.0382910296320915 | Loss: 0.0022100461156745 | Epoch: 66 | MeanAbsoluteError: 0.0291559956967831 | Loss: 0.0013130995058945 | Epoch: 67 | MeanAbsoluteError: 0.0315743051469326 | Loss: 0.0016218060688851 | Epoch: 68 | MeanAbsoluteError: 0.0465439707040787 | Loss: 0.0030829599433530 | Epoch: 69 | MeanAbsoluteError: 0.0567638538777828 | Loss: 0.0043334346999855 | Epoch: 70 | 
MeanAbsoluteError: 0.0491299964487553 | Loss: 0.0036056465346758 | Epoch: 71 | MeanAbsoluteError: 0.0461131036281586 | Loss: 0.0027722279283855 | Epoch: 72 | MeanAbsoluteError: 0.0368171446025372 | Loss: 0.0019706007411802 | Epoch: 73 | MeanAbsoluteError: 0.0436827912926674 | Loss: 0.0023445539654380 | Epoch: 74 | MeanAbsoluteError: 0.0296948272734880 | Loss: 0.0015686207211969 | Epoch: 75 | MeanAbsoluteError: 0.0243366137146950 | Loss: 0.0015787675587681 | Epoch: 76 | MeanAbsoluteError: 0.0380370020866394 | Loss: 0.0019230413998134 | Epoch: 77 | 
MeanAbsoluteError: 0.0652532428503036 | Loss: 0.0047740079707613 | Epoch: 78 | MeanAbsoluteError: 0.0242299456149340 | Loss: 0.0010981655244617 | Epoch: 79 | MeanAbsoluteError: 0.0350292287766933 | Loss: 0.0019455707117327 | Epoch: 80 | MeanAbsoluteError: 0.0182205922901630 | Loss: 0.0011152691034735 | Epoch: 81 | MeanAbsoluteError: 0.0197941176593304 | Loss: 0.0005973510629510 | Epoch: 82 | MeanAbsoluteError: 0.0297637786716223 | Loss: 0.0011873579381867 | Epoch: 83 | MeanAbsoluteError: 0.0356158465147018 | Loss: 0.0022244152894832 | Epoch: 84 | 
MeanAbsoluteError: 0.0369792208075523 | Loss: 0.0016947991772261 | Epoch: 85 | MeanAbsoluteError: 0.0651576966047287 | Loss: 0.0053538917931483 | Epoch: 86 | MeanAbsoluteError: 0.0291766077280045 | Loss: 0.0013017201900335 | Epoch: 87 | MeanAbsoluteError: 0.0318669825792313 | Loss: 0.0015719560508028 | Epoch: 88 | MeanAbsoluteError: 0.0362674854695797 | Loss: 0.0019024912709076 | Epoch: 89 | MeanAbsoluteError: 0.0208188742399216 | Loss: 0.0013029905745306 | Epoch: 90 | MeanAbsoluteError: 0.0272756442427635 | Loss: 0.0010911528309072 | Epoch: 91 | 
MeanAbsoluteError: 0.0594064705073833 | Loss: 0.0043182448165393 | Epoch: 92 | MeanAbsoluteError: 0.0268176272511482 | Loss: 0.0014712697624131 | Epoch: 93 | MeanAbsoluteError: 0.0261698272079229 | Loss: 0.0011524976917395 | Epoch: 94 | MeanAbsoluteError: 0.0321131423115730 | Loss: 0.0020343811790410 | Epoch: 95 | MeanAbsoluteError: 0.0282749645411968 | Loss: 0.0014596337262590 | Epoch: 96 | MeanAbsoluteError: 0.0204340796917677 | Loss: 0.0007772821439798 | Epoch: 97 | MeanAbsoluteError: 0.0461020320653915 | Loss: 0.0029457104269807 | Epoch: 98 | 
MeanAbsoluteError: 0.0363401547074318 | Loss: 0.0018726373397696 | Epoch: 99 | MeanAbsoluteError: 0.0254409462213516 | Loss: 0.0016866453546467 | Epoch: 100 | MeanAbsoluteError: 0.0230563953518867 | Loss: 0.0010243701874156 | Epoch: 101 | MeanAbsoluteError: 0.0359856374561787 | Loss: 0.0016816396290730 | Epoch: 102 | MeanAbsoluteError: 0.0450000725686550 | Loss: 0.0029862209676618 | Epoch: 103 | MeanAbsoluteError: 0.0478232428431511 | Loss: 0.0029143065667564 | Epoch: 104 | MeanAbsoluteError: 0.0557227320969105 | Loss: 0.0037254629791469 | Epoch: 105 | 
MeanAbsoluteError: 0.0325228460133076 | Loss: 0.0022230141361146 | Epoch: 106 | MeanAbsoluteError: 0.0154053149744868 | Loss: 0.0003975184854904 | Epoch: 107 | MeanAbsoluteError: 0.0186169669032097 | Loss: 0.0007629465789681 | Epoch: 108 | MeanAbsoluteError: 0.0441891252994537 | Loss: 0.0033853977832845 | Epoch: 109 | MeanAbsoluteError: 0.0214766059070826 | Loss: 0.0008970867018338 | Epoch: 110 | MeanAbsoluteError: 0.0202220156788826 | Loss: 0.0014077243862343 | Epoch: 111 | MeanAbsoluteError: 0.0256850551813841 | Loss: 0.0008626302266126 | Epoch: 112 | 
MeanAbsoluteError: 0.0354072861373425 | Loss: 0.0021136221904798 | Epoch: 113 | MeanAbsoluteError: 0.0166921727359295 | Loss: 0.0004511885674315 | Epoch: 114 | MeanAbsoluteError: 0.0168519970029593 | Loss: 0.0008468953685798 | Epoch: 115 | MeanAbsoluteError: 0.0304526556283236 | Loss: 0.0013139677252375 | Epoch: 116 | MeanAbsoluteError: 0.0153384432196617 | Loss: 0.0004066414112458 | Epoch: 117 | MeanAbsoluteError: 0.0154580054804683 | Loss: 0.0007643435475122 | Epoch: 118 | MeanAbsoluteError: 0.0280616376549006 | Loss: 0.0011947853980880 | Epoch: 119 | 
MeanAbsoluteError: 0.0305198729038239 | Loss: 0.0019414733948284 | Epoch: 120 | MeanAbsoluteError: 0.0260669235140085 | Loss: 0.0012950847985370 | Epoch: 121 | MeanAbsoluteError: 0.0355392061173916 | Loss: 0.0019818834445782 | Epoch: 122 | MeanAbsoluteError: 0.0243434086441994 | Loss: 0.0010794677134407 | Epoch: 123 | MeanAbsoluteError: 0.0278790593147278 | Loss: 0.0012772567080040 | Epoch: 124 | MeanAbsoluteError: 0.0435035303235054 | Loss: 0.0022934059992335 | Epoch: 125 | MeanAbsoluteError: 0.0381110012531281 | Loss: 0.0021759507760994 | Epoch: 126 | 
MeanAbsoluteError: 0.0940529108047485 | Loss: 0.0097230683374954 | Epoch: 127 | MeanAbsoluteError: 0.0339625477790833 | Loss: 0.0016076068737005 | Epoch: 128 | MeanAbsoluteError: 0.0135953677818179 | Loss: 0.0005766331967990 | Epoch: 129 | MeanAbsoluteError: 0.0201165303587914 | Loss: 0.0006673265214838 | Epoch: 130 | MeanAbsoluteError: 0.0154351871460676 | Loss: 0.0010755103331145 | Epoch: 131 | MeanAbsoluteError: 0.0241164043545723 | Loss: 0.0014492956688628 | Epoch: 132 | MeanAbsoluteError: 0.0313422381877899 | Loss: 0.0014604886436198 | Epoch: 133 | 
MeanAbsoluteError: 0.0175289530307055 | Loss: 0.0005680438036124 | Epoch: 134 | MeanAbsoluteError: 0.0151288537308574 | Loss: 0.0008909344974918 | Epoch: 135 | MeanAbsoluteError: 0.0212321374565363 | Loss: 0.0012107437972813 | Epoch: 136 | MeanAbsoluteError: 0.0324423387646675 | Loss: 0.0016355534592692 | Epoch: 137 | MeanAbsoluteError: 0.0168224480003119 | Loss: 0.0015394975485642 | Epoch: 138 | MeanAbsoluteError: 0.0323544517159462 | Loss: 0.0019051794661209 | Early stopping at epoch 137
Returned to Spot: Validation loss: 0.0019051794661208987
spotPython tuning: 0.0019051794661208987 [##--------] 15.72% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.09097589898222352, 'lr_mult': 9.4039613079632, 'batch_size': 16, 'epochs': 32768, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.06712428244495727}
Epoch: 1 | MeanAbsoluteError: 0.1784824132919312 | Loss: 0.0452397178466383 | Epoch: 2 | MeanAbsoluteError: 0.2533632516860962 | Loss: 0.0865791734111936 | Epoch: 3 | MeanAbsoluteError: 0.1775324791669846 | Loss: 0.0466641626859966 | Epoch: 4 | MeanAbsoluteError: 0.1196490004658699 | Loss: 0.0229167353950049 | Epoch: 5 | MeanAbsoluteError: 0.1839439868927002 | Loss: 0.0489420447694628 | Epoch: 6 | MeanAbsoluteError: 0.2106037586927414 | Loss: 0.0608888111616436 | Epoch: 7 | 
MeanAbsoluteError: 0.1548880189657211 | Loss: 0.0335480032586738 | Epoch: 8 | MeanAbsoluteError: 0.0949869751930237 | Loss: 0.0145942760435374 | Epoch: 9 | MeanAbsoluteError: 0.0927527919411659 | Loss: 0.0136276499221199 | Epoch: 10 | MeanAbsoluteError: 0.1335321515798569 | Loss: 0.0265018463036732 | Epoch: 11 | MeanAbsoluteError: 0.1016118079423904 | Loss: 0.0159603821505841 | Epoch: 12 | MeanAbsoluteError: 0.1636033058166504 | Loss: 0.0369429907908565 | Epoch: 13 | MeanAbsoluteError: 0.1013799384236336 | Loss: 0.0163399362936616 | Epoch: 14 | 
MeanAbsoluteError: 0.1081427857279778 | Loss: 0.0170068492328650 | Epoch: 15 | MeanAbsoluteError: 0.0974375903606415 | Loss: 0.0152526224571231 | Epoch: 16 | MeanAbsoluteError: 0.0970744863152504 | Loss: 0.0133509756997228 | Epoch: 17 | MeanAbsoluteError: 0.0861842557787895 | Loss: 0.0102878554822191 | Epoch: 18 | MeanAbsoluteError: 0.0862173810601234 | Loss: 0.0101155646537480 | Epoch: 19 | MeanAbsoluteError: 0.0854967832565308 | Loss: 0.0102086440709076 | Epoch: 20 | MeanAbsoluteError: 0.1145093291997910 | Loss: 0.0189587998841154 | Epoch: 21 | 
MeanAbsoluteError: 0.0764901563525200 | Loss: 0.0077951210060794 | Epoch: 22 | MeanAbsoluteError: 0.0580882504582405 | Loss: 0.0048763699167849 | Epoch: 23 | MeanAbsoluteError: 0.0487855151295662 | Loss: 0.0039176557115034 | Epoch: 24 | MeanAbsoluteError: 0.0858769342303276 | Loss: 0.0096647486482796 | Epoch: 25 | MeanAbsoluteError: 0.0752381533384323 | Loss: 0.0086312571810068 | Epoch: 26 | MeanAbsoluteError: 0.0893095582723618 | Loss: 0.0101484504136208 | Epoch: 27 | MeanAbsoluteError: 0.0649394169449806 | Loss: 0.0057052507089745 | Epoch: 28 | 
MeanAbsoluteError: 0.0488644577562809 | Loss: 0.0038298659063386 | Epoch: 29 | MeanAbsoluteError: 0.0440627112984657 | Loss: 0.0028270009482328 | Epoch: 30 | MeanAbsoluteError: 0.0432453788816929 | Loss: 0.0031874317424617 | Epoch: 31 | MeanAbsoluteError: 0.0646319314837456 | Loss: 0.0067738515790552 | Epoch: 32 | MeanAbsoluteError: 0.0652915015816689 | Loss: 0.0056926504537267 | Epoch: 33 | MeanAbsoluteError: 0.1299323737621307 | Loss: 0.0220736752901422 | Epoch: 34 | MeanAbsoluteError: 0.1033668145537376 | Loss: 0.0137771335675528 | Epoch: 35 | 
MeanAbsoluteError: 0.0908927842974663 | Loss: 0.0099339931222953 | Epoch: 36 | MeanAbsoluteError: 0.0796788185834885 | Loss: 0.0077995289558251 | Epoch: 37 | MeanAbsoluteError: 0.0893777906894684 | Loss: 0.0117296121132217 | Epoch: 38 | MeanAbsoluteError: 0.0682826042175293 | Loss: 0.0070069669133150 | Epoch: 39 | MeanAbsoluteError: 0.1613409072160721 | Loss: 0.0296238573562158 | Epoch: 40 | MeanAbsoluteError: 0.0847837701439857 | Loss: 0.0106842303893676 | Epoch: 41 | MeanAbsoluteError: 0.0668001398444176 | Loss: 0.0057094280583490 | Epoch: 42 | 
MeanAbsoluteError: 0.0661463811993599 | Loss: 0.0070647899992764 | Epoch: 43 | MeanAbsoluteError: 0.0652018114924431 | Loss: 0.0055618321302494 | Epoch: 44 | MeanAbsoluteError: 0.1220611184835434 | Loss: 0.0197609056669630 | Epoch: 45 | MeanAbsoluteError: 0.0494024083018303 | Loss: 0.0044793963897973 | Epoch: 46 | MeanAbsoluteError: 0.1253624558448792 | Loss: 0.0192902386678677 | Epoch: 47 | MeanAbsoluteError: 0.0677861571311951 | Loss: 0.0057401189482526 | Epoch: 48 | MeanAbsoluteError: 0.0541455969214439 | Loss: 0.0041200808053346 | Epoch: 49 | 
MeanAbsoluteError: 0.0709698125720024 | Loss: 0.0071820100573333 | Epoch: 50 | MeanAbsoluteError: 0.0673588514328003 | Loss: 0.0070597848144213 | Epoch: 51 | MeanAbsoluteError: 0.0474024377763271 | Loss: 0.0039920240983759 | Epoch: 52 | MeanAbsoluteError: 0.0985866710543633 | Loss: 0.0121101342925900 | Epoch: 53 | MeanAbsoluteError: 0.0429323650896549 | Loss: 0.0027850716693425 | Epoch: 54 | MeanAbsoluteError: 0.0895950421690941 | Loss: 0.0097226799759818 | Epoch: 55 | MeanAbsoluteError: 0.0569730512797832 | Loss: 0.0047964335443746 | Epoch: 56 | 
MeanAbsoluteError: 0.1155830919742584 | Loss: 0.0173812096350287 | Epoch: 57 | MeanAbsoluteError: 0.0756404101848602 | Loss: 0.0083856938995029 | Epoch: 58 | MeanAbsoluteError: 0.0932580605149269 | Loss: 0.0098976068884919 | Epoch: 59 | MeanAbsoluteError: 0.0567304678261280 | Loss: 0.0044593373926258 | Epoch: 60 | MeanAbsoluteError: 0.0292531140148640 | Loss: 0.0019605046101405 | Epoch: 61 | MeanAbsoluteError: 0.0556276701390743 | Loss: 0.0041686260435534 | Epoch: 62 | MeanAbsoluteError: 0.0387441255152225 | Loss: 0.0030091797602118 | Epoch: 63 | 
MeanAbsoluteError: 0.0837800651788712 | Loss: 0.0100800251882327 | Epoch: 64 | MeanAbsoluteError: 0.0832710936665535 | Loss: 0.0098406036237353 | Epoch: 65 | MeanAbsoluteError: 0.1046761423349380 | Loss: 0.0155571447930446 | Epoch: 66 | MeanAbsoluteError: 0.0674861893057823 | Loss: 0.0059024157909382 | Epoch: 67 | MeanAbsoluteError: 0.0705355703830719 | Loss: 0.0060452532243768 | Epoch: 68 | MeanAbsoluteError: 0.1105062738060951 | Loss: 0.0135182676542746 | Epoch: 69 | MeanAbsoluteError: 0.0938713625073433 | Loss: 0.0101035125553608 | Epoch: 70 | 
MeanAbsoluteError: 0.0671540945768356 | Loss: 0.0056398013655684 | Epoch: 71 | MeanAbsoluteError: 0.1615707278251648 | Loss: 0.0305986882824647 | Epoch: 72 | MeanAbsoluteError: 0.0488885194063187 | Loss: 0.0042613364486514 | Epoch: 73 | MeanAbsoluteError: 0.0291787497699261 | Loss: 0.0013152026712257 | Epoch: 74 | MeanAbsoluteError: 0.0323801860213280 | Loss: 0.0022268393812211 | Epoch: 75 | MeanAbsoluteError: 0.0675570815801620 | Loss: 0.0055492805978773 | Epoch: 76 | MeanAbsoluteError: 0.0565079115331173 | Loss: 0.0047096390350673 | Epoch: 77 | 
MeanAbsoluteError: 0.0526355728507042 | Loss: 0.0040778339178743 | Epoch: 78 | MeanAbsoluteError: 0.0460250638425350 | Loss: 0.0037365946397921 | Epoch: 79 | MeanAbsoluteError: 0.0375380814075470 | Loss: 0.0030651859062920 | Epoch: 80 | MeanAbsoluteError: 0.0358107946813107 | Loss: 0.0022162747918628 | Epoch: 81 | MeanAbsoluteError: 0.0531915426254272 | Loss: 0.0052911370600525 | Epoch: 82 | MeanAbsoluteError: 0.0650850608944893 | Loss: 0.0055359528571563 | Epoch: 83 | MeanAbsoluteError: 0.0839092656970024 | Loss: 0.0111552520508045 | Epoch: 84 | 
MeanAbsoluteError: 0.0377178527414799 | Loss: 0.0022821862765245 | Epoch: 85 | MeanAbsoluteError: 0.1025565117597580 | Loss: 0.0120606750347897 | Epoch: 86 | MeanAbsoluteError: 0.0522064752876759 | Loss: 0.0044170985929668 | Epoch: 87 | MeanAbsoluteError: 0.0779603868722916 | Loss: 0.0086359310846188 | Epoch: 88 | MeanAbsoluteError: 0.0618426017463207 | Loss: 0.0047196103505006 | Epoch: 89 | MeanAbsoluteError: 0.0672179833054543 | Loss: 0.0058298031554410 | Epoch: 90 | MeanAbsoluteError: 0.0843745246529579 | Loss: 0.0112658230416281 | Epoch: 91 | 
MeanAbsoluteError: 0.0544510334730148 | Loss: 0.0044819897923030 | Epoch: 92 | MeanAbsoluteError: 0.0503093339502811 | Loss: 0.0042352852852721 | Epoch: 93 | MeanAbsoluteError: 0.0678396001458168 | Loss: 0.0059236567712536 | Epoch: 94 | MeanAbsoluteError: 0.0846584290266037 | Loss: 0.0094927854492868 | Epoch: 95 | MeanAbsoluteError: 0.0595000535249710 | Loss: 0.0049361410477248 | Epoch: 96 | MeanAbsoluteError: 0.0318655408918858 | Loss: 0.0024664348150652 | Epoch: 97 | MeanAbsoluteError: 0.0461340025067329 | Loss: 0.0031239723504864 | Epoch: 98 | 
MeanAbsoluteError: 0.0748609155416489 | Loss: 0.0073027712243952 | Epoch: 99 | MeanAbsoluteError: 0.0750875324010849 | Loss: 0.0071485744985311 | Epoch: 100 | MeanAbsoluteError: 0.0302072204649448 | Loss: 0.0016642030631805 | Epoch: 101 | MeanAbsoluteError: 0.0737751275300980 | Loss: 0.0071606146857927 | Epoch: 102 | MeanAbsoluteError: 0.0809723734855652 | Loss: 0.0080933551255025 | Epoch: 103 | MeanAbsoluteError: 0.0372357591986656 | Loss: 0.0025855764428056 | Epoch: 104 | MeanAbsoluteError: 0.0487052239477634 | Loss: 0.0040263548297317 | Epoch: 105 | 
MeanAbsoluteError: 0.0423036701977253 | Loss: 0.0034744316454683 | Early stopping at epoch 104
Returned to Spot: Validation loss: 0.0034744316454682696
spotPython tuning: 0.0019051794661208987 [##--------] 23.60% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.33506089616266266, 'lr_mult': 1.0269858663402802, 'batch_size': 16, 'epochs': 4, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 5.733712764577348e-07}
Epoch: 1 | MeanAbsoluteError: 0.2073198705911636 | Loss: 0.0682545770940028 | Epoch: 2 | MeanAbsoluteError: 0.2159038037061691 | Loss: 0.0708216118969415 | Epoch: 3 | MeanAbsoluteError: 0.1998750865459442 | Loss: 0.0620201318279693 | Epoch: 4 | MeanAbsoluteError: 0.1743946820497513 | Loss: 0.0490728373590269 | Returned to Spot: Validation loss: 0.04907283735902686
spotPython tuning: 0.0019051794661208987 [###-------] 27.69% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 8, 'dropout_prob': 0.10814332884409439, 'lr_mult': 7.69572039516958, 'batch_size': 4, 'epochs': 4096, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adam', 'sgd_momentum': 0.9238232120938407}
Epoch: 1 | MeanAbsoluteError: 0.1315124630928040 | Loss: 0.0274141672129432 | Epoch: 2 | 
MeanAbsoluteError: 0.1301127970218658 | Loss: 0.0241437444401284 | Epoch: 3 | MeanAbsoluteError: 0.1243746951222420 | Loss: 0.0209642338939011 | Epoch: 4 | 
MeanAbsoluteError: 0.0856374353170395 | Loss: 0.0111063849716447 | Epoch: 5 | MeanAbsoluteError: 0.0764760002493858 | Loss: 0.0105803327301207 | Epoch: 6 | 
MeanAbsoluteError: 0.0605865232646465 | Loss: 0.0080787586440177 | Epoch: 7 | MeanAbsoluteError: 0.0696778595447540 | Loss: 0.0072772263914036 | Epoch: 8 | 
MeanAbsoluteError: 0.0644004791975021 | Loss: 0.0074623821062657 | Epoch: 9 | MeanAbsoluteError: 0.0630195960402489 | Loss: 0.0059288527692358 | Epoch: 10 | 
MeanAbsoluteError: 0.0317668877542019 | Loss: 0.0036293003783309 | Epoch: 11 | MeanAbsoluteError: 0.0433216504752636 | Loss: 0.0040234678234750 | Epoch: 12 | 
MeanAbsoluteError: 0.0518763139843941 | Loss: 0.0055692073120736 | Epoch: 13 | MeanAbsoluteError: 0.0478316172957420 | Loss: 0.0074617862061132 | Epoch: 14 | 
MeanAbsoluteError: 0.0338070280849934 | Loss: 0.0040966459052288 | Epoch: 15 | MeanAbsoluteError: 0.0484548173844814 | Loss: 0.0045007333660033 | Epoch: 16 | 
MeanAbsoluteError: 0.0422444939613342 | Loss: 0.0049432762978055 | Epoch: 17 | MeanAbsoluteError: 0.0303707979619503 | Loss: 0.0038059055257569 | Epoch: 18 | 
MeanAbsoluteError: 0.0372832529246807 | Loss: 0.0044193371199193 | Epoch: 19 | MeanAbsoluteError: 0.0541264899075031 | Loss: 0.0067176959966309 | Epoch: 20 | 
MeanAbsoluteError: 0.0406181626021862 | Loss: 0.0075075163221239 | Epoch: 21 | MeanAbsoluteError: 0.0324270464479923 | Loss: 0.0034636555684377 | Epoch: 22 | 
MeanAbsoluteError: 0.0327820405364037 | Loss: 0.0029441956049413 | Epoch: 23 | MeanAbsoluteError: 0.0373801775276661 | Loss: 0.0041681696154653 | Epoch: 24 | 
MeanAbsoluteError: 0.0464061163365841 | Loss: 0.0046226517169271 | Epoch: 25 | MeanAbsoluteError: 0.0374764166772366 | Loss: 0.0058530991866913 | Epoch: 26 | 
MeanAbsoluteError: 0.0452474467456341 | Loss: 0.0040557490886810 | Epoch: 27 | MeanAbsoluteError: 0.0341211780905724 | Loss: 0.0044248004964174 | Epoch: 28 | 
MeanAbsoluteError: 0.0271581690758467 | Loss: 0.0038916601719833 | Epoch: 29 | MeanAbsoluteError: 0.0429781004786491 | Loss: 0.0053269283368718 | Epoch: 30 | 
MeanAbsoluteError: 0.0399633646011353 | Loss: 0.0048981138069454 | Epoch: 31 | MeanAbsoluteError: 0.0537777319550514 | Loss: 0.0064381757917969 | Epoch: 32 | 
MeanAbsoluteError: 0.0304265152662992 | Loss: 0.0042509571174620 | Epoch: 33 | MeanAbsoluteError: 0.0307949502021074 | Loss: 0.0044873468356673 | Epoch: 34 | 
MeanAbsoluteError: 0.0320835337042809 | Loss: 0.0033985512814252 | Epoch: 35 | MeanAbsoluteError: 0.0501879826188087 | Loss: 0.0048701833219578 | Epoch: 36 | 
MeanAbsoluteError: 0.0677760541439056 | Loss: 0.0057519068165372 | Epoch: 37 | MeanAbsoluteError: 0.0448419004678726 | Loss: 0.0054642967429633 | Epoch: 38 | 
MeanAbsoluteError: 0.0442640967667103 | Loss: 0.0058072601023984 | Epoch: 39 | MeanAbsoluteError: 0.0376864224672318 | Loss: 0.0056203750468073 | Epoch: 40 | 
MeanAbsoluteError: 0.0558172613382339 | Loss: 0.0065806473277432 | Epoch: 41 | MeanAbsoluteError: 0.0510261356830597 | Loss: 0.0055956776591484 | Epoch: 42 | 
MeanAbsoluteError: 0.0309999883174896 | Loss: 0.0045109647833184 | Epoch: 43 | MeanAbsoluteError: 0.0417353473603725 | Loss: 0.0042259033297887 | Epoch: 44 | 
MeanAbsoluteError: 0.0339863486588001 | Loss: 0.0042101076596979 | Epoch: 45 | MeanAbsoluteError: 0.0348559878766537 | Loss: 0.0048557018968859 | Epoch: 46 | 
MeanAbsoluteError: 0.0483681745827198 | Loss: 0.0041364013310522 | Epoch: 47 | MeanAbsoluteError: 0.0400032065808773 | Loss: 0.0052465864516368 | Epoch: 48 | 
MeanAbsoluteError: 0.0331407412886620 | Loss: 0.0030351299144483 | Epoch: 49 | MeanAbsoluteError: 0.0505889505147934 | Loss: 0.0065338074761288 | Epoch: 50 | 
MeanAbsoluteError: 0.0328158549964428 | Loss: 0.0035366140966895 | Epoch: 51 | MeanAbsoluteError: 0.0496988184750080 | Loss: 0.0053680223117893 | Epoch: 52 | 
MeanAbsoluteError: 0.0398613847792149 | Loss: 0.0047735277338264 | Epoch: 53 | MeanAbsoluteError: 0.0447148084640503 | Loss: 0.0049698225827888 | Epoch: 54 | 
MeanAbsoluteError: 0.0358754470944405 | Loss: 0.0045421979071883 | Epoch: 55 | MeanAbsoluteError: 0.0557750016450882 | Loss: 0.0058906319822806 | Epoch: 56 | 
MeanAbsoluteError: 0.0338069126009941 | Loss: 0.0039018339597775 | Epoch: 57 | MeanAbsoluteError: 0.0373328849673271 | Loss: 0.0040345437099071 | Epoch: 58 | 
MeanAbsoluteError: 0.0471822246909142 | Loss: 0.0056516249190706 | Epoch: 59 | MeanAbsoluteError: 0.0418174564838409 | Loss: 0.0047306026933560 | Epoch: 60 | 
MeanAbsoluteError: 0.0336641259491444 | Loss: 0.0038762135247331 | Epoch: 61 | MeanAbsoluteError: 0.0488719195127487 | Loss: 0.0052794803997191 | Epoch: 62 | 
MeanAbsoluteError: 0.0309484712779522 | Loss: 0.0034029272840902 | Epoch: 63 | MeanAbsoluteError: 0.0291268732398748 | Loss: 0.0036652883891293 | Epoch: 64 | 
MeanAbsoluteError: 0.0427459701895714 | Loss: 0.0060593348110948 | Epoch: 65 | MeanAbsoluteError: 0.0458709374070168 | Loss: 0.0054518955200911 | Epoch: 66 | 
MeanAbsoluteError: 0.0307291802018881 | Loss: 0.0048502065036882 | Epoch: 67 | MeanAbsoluteError: 0.0573271736502647 | Loss: 0.0067187778682758 | Epoch: 68 | 
MeanAbsoluteError: 0.0587132908403873 | Loss: 0.0082612429066406 | Epoch: 69 | MeanAbsoluteError: 0.0369960516691208 | Loss: 0.0031288059269233 | Epoch: 70 | 
MeanAbsoluteError: 0.0520658344030380 | Loss: 0.0057515928700256 | Epoch: 71 | MeanAbsoluteError: 0.0410935766994953 | Loss: 0.0051767858147893 | Epoch: 72 | 
MeanAbsoluteError: 0.0364359468221664 | Loss: 0.0035496347810840 | Epoch: 73 | MeanAbsoluteError: 0.0284937676042318 | Loss: 0.0035523513648392 | Epoch: 74 | 
MeanAbsoluteError: 0.0318142026662827 | Loss: 0.0037543684149083 | Epoch: 75 | MeanAbsoluteError: 0.0217653326690197 | Loss: 0.0022893784784295 | Epoch: 76 | 
MeanAbsoluteError: 0.0341836251318455 | Loss: 0.0033737822067148 | Epoch: 77 | MeanAbsoluteError: 0.0397861227393150 | Loss: 0.0061747769596210 | Epoch: 78 | 
MeanAbsoluteError: 0.0508753694593906 | Loss: 0.0071497165881253 | Epoch: 79 | MeanAbsoluteError: 0.0322434343397617 | Loss: 0.0036983763605773 | Epoch: 80 | 
MeanAbsoluteError: 0.0495898835361004 | Loss: 0.0055231636196064 | Epoch: 81 | MeanAbsoluteError: 0.0299569834023714 | Loss: 0.0031809739875583 | Epoch: 82 | 
MeanAbsoluteError: 0.0419573448598385 | Loss: 0.0048473454668419 | Epoch: 83 | MeanAbsoluteError: 0.0396195873618126 | Loss: 0.0040634027251508 | Epoch: 84 | 
MeanAbsoluteError: 0.0308871492743492 | Loss: 0.0039123011214542 | Epoch: 85 | MeanAbsoluteError: 0.0559827163815498 | Loss: 0.0071423875004984 | Epoch: 86 | 
MeanAbsoluteError: 0.0347671061754227 | Loss: 0.0043151928106090 | Epoch: 87 | MeanAbsoluteError: 0.0378125384449959 | Loss: 0.0045473580816906 | Epoch: 88 | 
MeanAbsoluteError: 0.0316873341798782 | Loss: 0.0040579833880353 | Epoch: 89 | MeanAbsoluteError: 0.0310365837067366 | Loss: 0.0045850314452643 | Epoch: 90 | 
MeanAbsoluteError: 0.0373508483171463 | Loss: 0.0044756095305153 | Epoch: 91 | MeanAbsoluteError: 0.0385824479162693 | Loss: 0.0040394673713793 | Epoch: 92 | 
MeanAbsoluteError: 0.0483681708574295 | Loss: 0.0040160561601321 | Epoch: 93 | MeanAbsoluteError: 0.0382293909788132 | Loss: 0.0041043926059501 | Epoch: 94 | 
MeanAbsoluteError: 0.0424490347504616 | Loss: 0.0036701034323778 | Epoch: 95 | MeanAbsoluteError: 0.0416914299130440 | Loss: 0.0057638043341770 | Epoch: 96 | 
MeanAbsoluteError: 0.0399882458150387 | Loss: 0.0045528850888756 | Epoch: 97 | MeanAbsoluteError: 0.0307296495884657 | Loss: 0.0041396756044317 | Epoch: 98 | 
MeanAbsoluteError: 0.0246354918926954 | Loss: 0.0028611337757684 | Epoch: 99 | MeanAbsoluteError: 0.0716181322932243 | Loss: 0.0066925272780160 | Epoch: 100 | 
MeanAbsoluteError: 0.0334171243011951 | Loss: 0.0055387910780943 | Epoch: 101 | MeanAbsoluteError: 0.0474209003150463 | Loss: 0.0049185111614255 | Epoch: 102 | 
MeanAbsoluteError: 0.0300523191690445 | Loss: 0.0041911157321617 | Epoch: 103 | MeanAbsoluteError: 0.0503477528691292 | Loss: 0.0050843223289121 | Epoch: 104 | 
MeanAbsoluteError: 0.0308506209403276 | Loss: 0.0040850206183677 | Epoch: 105 | MeanAbsoluteError: 0.0416354611515999 | Loss: 0.0056580387290524 | Epoch: 106 | 
MeanAbsoluteError: 0.0340189598500729 | Loss: 0.0046742718903867 | Epoch: 107 | MeanAbsoluteError: 0.0328017063438892 | Loss: 0.0041005200270350 | Epoch: 108 | 
MeanAbsoluteError: 0.0505441203713417 | Loss: 0.0054235068227475 | Epoch: 109 | MeanAbsoluteError: 0.0264100804924965 | Loss: 0.0032076957863652 | Epoch: 110 | 
MeanAbsoluteError: 0.0321137346327305 | Loss: 0.0058231434822422 | Epoch: 111 | MeanAbsoluteError: 0.0307540297508240 | Loss: 0.0054923545333440 | Epoch: 112 | 
MeanAbsoluteError: 0.0546434968709946 | Loss: 0.0055375585681759 | Epoch: 113 | MeanAbsoluteError: 0.0533248260617256 | Loss: 0.0050829151140836 | Epoch: 114 | 
MeanAbsoluteError: 0.0569054298102856 | Loss: 0.0061227352280791 | Epoch: 115 | MeanAbsoluteError: 0.0424289740622044 | Loss: 0.0041518829759055 | Epoch: 116 | 
MeanAbsoluteError: 0.0608100779354572 | Loss: 0.0061303600172202 | Epoch: 117 | MeanAbsoluteError: 0.0333525091409683 | Loss: 0.0057689430784800 | Epoch: 118 | 
MeanAbsoluteError: 0.0345158204436302 | Loss: 0.0036513072209588 | Epoch: 119 | MeanAbsoluteError: 0.0319460630416870 | Loss: 0.0041927120769833 | Epoch: 120 | 
MeanAbsoluteError: 0.0812739431858063 | Loss: 0.0089948370928566 | Epoch: 121 | MeanAbsoluteError: 0.0357641875743866 | Loss: 0.0035482838453026 | Epoch: 122 | 
MeanAbsoluteError: 0.0335149057209492 | Loss: 0.0045432503612634 | Epoch: 123 | MeanAbsoluteError: 0.0359080992639065 | Loss: 0.0040776767899903 | Epoch: 124 | 
MeanAbsoluteError: 0.0530582144856453 | Loss: 0.0048706619425987 | Epoch: 125 | MeanAbsoluteError: 0.0314061306416988 | Loss: 0.0047426881868644 | Epoch: 126 | 
MeanAbsoluteError: 0.0334049910306931 | Loss: 0.0034848559478996 | Epoch: 127 | MeanAbsoluteError: 0.0347059853374958 | Loss: 0.0058186996622438 | Epoch: 128 | 
MeanAbsoluteError: 0.0502660311758518 | Loss: 0.0050284810077089 | Epoch: 129 | MeanAbsoluteError: 0.0442327708005905 | Loss: 0.0047969770734198 | Epoch: 130 | 
MeanAbsoluteError: 0.0302211344242096 | Loss: 0.0030701139920105 | Epoch: 131 | MeanAbsoluteError: 0.0264714416116476 | Loss: 0.0029792715524915 | Epoch: 132 | 
MeanAbsoluteError: 0.0300140790641308 | Loss: 0.0032106826059195 | Epoch: 133 | MeanAbsoluteError: 0.0283342674374580 | Loss: 0.0028333565688081 | Epoch: 134 | 
MeanAbsoluteError: 0.0591255240142345 | Loss: 0.0051506198414912 | Epoch: 135 | MeanAbsoluteError: 0.0612846687436104 | Loss: 0.0066762569546700 | Epoch: 136 | 
MeanAbsoluteError: 0.0590779744088650 | Loss: 0.0053317655886834 | Epoch: 137 | MeanAbsoluteError: 0.0366613380610943 | Loss: 0.0049579818947920 | Epoch: 138 | 
MeanAbsoluteError: 0.0298636984080076 | Loss: 0.0042407470290103 | Epoch: 139 | MeanAbsoluteError: 0.0407038591802120 | Loss: 0.0053551945505509 | Epoch: 140 | 
MeanAbsoluteError: 0.0538124702870846 | Loss: 0.0057181050108435 | Epoch: 141 | MeanAbsoluteError: 0.0370990075170994 | Loss: 0.0052813065376055 | Epoch: 142 | 
MeanAbsoluteError: 0.0484183169901371 | Loss: 0.0042441359465010 | Epoch: 143 | MeanAbsoluteError: 0.0478232018649578 | Loss: 0.0061682563405096 | Epoch: 144 | 
MeanAbsoluteError: 0.0245170015841722 | Loss: 0.0032757529662316 | Epoch: 145 | MeanAbsoluteError: 0.0375631563365459 | Loss: 0.0027285307944597 | Epoch: 146 | 
MeanAbsoluteError: 0.0342917442321777 | Loss: 0.0043051412952142 | Epoch: 147 | MeanAbsoluteError: 0.0306239537894726 | Loss: 0.0031596030614067 | Epoch: 148 | 
MeanAbsoluteError: 0.0283758156001568 | Loss: 0.0032665505459348 | Epoch: 149 | MeanAbsoluteError: 0.0457849092781544 | Loss: 0.0055982794082956 | Epoch: 150 | 
MeanAbsoluteError: 0.0299779642373323 | Loss: 0.0035547804283184 | Epoch: 151 | MeanAbsoluteError: 0.0323712974786758 | Loss: 0.0044062282261317 | Epoch: 152 | 
MeanAbsoluteError: 0.0305292196571827 | Loss: 0.0037644078654436 | Epoch: 153 | MeanAbsoluteError: 0.0551299527287483 | Loss: 0.0051352905295789 | Epoch: 154 | 
MeanAbsoluteError: 0.0306458305567503 | Loss: 0.0040322914729707 | Epoch: 155 | MeanAbsoluteError: 0.0487155206501484 | Loss: 0.0045623410772532 | Epoch: 156 | 
MeanAbsoluteError: 0.0291802305728197 | Loss: 0.0035209463467133 | Epoch: 157 | MeanAbsoluteError: 0.0331834778189659 | Loss: 0.0037625371309211 | Epoch: 158 | 
MeanAbsoluteError: 0.0410046726465225 | Loss: 0.0034013228434681 | Epoch: 159 | MeanAbsoluteError: 0.0346155986189842 | Loss: 0.0050621231538632 | Epoch: 160 | 
MeanAbsoluteError: 0.0440394319593906 | Loss: 0.0044200955602961 | Epoch: 161 | MeanAbsoluteError: 0.0355514660477638 | Loss: 0.0043668471050478 | Epoch: 162 | 
MeanAbsoluteError: 0.0373017787933350 | Loss: 0.0078415869331260 | Epoch: 163 | MeanAbsoluteError: 0.0440087802708149 | Loss: 0.0056140907077740 | Epoch: 164 | 
MeanAbsoluteError: 0.0292590260505676 | Loss: 0.0027476389368045 | Epoch: 165 | MeanAbsoluteError: 0.0294920280575752 | Loss: 0.0029517234395219 | Epoch: 166 | 
MeanAbsoluteError: 0.0501076243817806 | Loss: 0.0051685145792241 | Epoch: 167 | MeanAbsoluteError: 0.0570460110902786 | Loss: 0.0070893335334646 | Epoch: 168 | 
MeanAbsoluteError: 0.0282490570098162 | Loss: 0.0030458498377751 | Epoch: 169 | MeanAbsoluteError: 0.0460715182125568 | Loss: 0.0050836471732085 | Epoch: 170 | 
MeanAbsoluteError: 0.0362937040627003 | Loss: 0.0042579600863974 | Epoch: 171 | MeanAbsoluteError: 0.0289535261690617 | Loss: 0.0049419024121319 | Epoch: 172 | 
MeanAbsoluteError: 0.0269506294280291 | Loss: 0.0043931257432208 | Epoch: 173 | MeanAbsoluteError: 0.0360520891845226 | Loss: 0.0039792399995107 | Epoch: 174 | 
MeanAbsoluteError: 0.0656060948967934 | Loss: 0.0059798129120221 | Epoch: 175 | MeanAbsoluteError: 0.0376128591597080 | Loss: 0.0037861723406240 | Epoch: 176 | 
MeanAbsoluteError: 0.0522074513137341 | Loss: 0.0047873750049621 | Epoch: 177 | 
MeanAbsoluteError: 0.0289363637566566 | Loss: 0.0040926771386512 | Epoch: 178 | MeanAbsoluteError: 0.0322785377502441 | Loss: 0.0037903485253567 | Epoch: 179 | 
MeanAbsoluteError: 0.0415387824177742 | Loss: 0.0034970552536349 | Epoch: 180 | MeanAbsoluteError: 0.0429686158895493 | Loss: 0.0047961601677040 | Epoch: 181 | 
MeanAbsoluteError: 0.0410930849611759 | Loss: 0.0033611126857189 | Epoch: 182 | MeanAbsoluteError: 0.0508336052298546 | Loss: 0.0059588949824683 | Epoch: 183 | 
MeanAbsoluteError: 0.0282004959881306 | Loss: 0.0042715547672803 | Epoch: 184 | MeanAbsoluteError: 0.0258009359240532 | Loss: 0.0032755535597244 | Epoch: 185 | 
MeanAbsoluteError: 0.0269891768693924 | Loss: 0.0026630410829239 | Epoch: 186 | MeanAbsoluteError: 0.0422684177756310 | Loss: 0.0037691505590919 | Epoch: 187 | 
MeanAbsoluteError: 0.0305949077010155 | Loss: 0.0037216577733731 | Epoch: 188 | MeanAbsoluteError: 0.0437331311404705 | Loss: 0.0034222454344854 | Epoch: 189 | 
MeanAbsoluteError: 0.0376232489943504 | Loss: 0.0041441735532135 | Epoch: 190 | MeanAbsoluteError: 0.0750022605061531 | Loss: 0.0073590953089297 | Epoch: 191 | 
MeanAbsoluteError: 0.0303845889866352 | Loss: 0.0030195351951018 | Epoch: 192 | MeanAbsoluteError: 0.0429762825369835 | Loss: 0.0054133873430934 | Epoch: 193 | 
MeanAbsoluteError: 0.0421945117413998 | Loss: 0.0044137665008505 | Epoch: 194 | MeanAbsoluteError: 0.0298555269837379 | Loss: 0.0035940875693511 | Epoch: 195 | 
MeanAbsoluteError: 0.0361031517386436 | Loss: 0.0031183475174475 | Epoch: 196 | MeanAbsoluteError: 0.0310878343880177 | Loss: 0.0039851018363455 | Epoch: 197 | 
MeanAbsoluteError: 0.0274989120662212 | Loss: 0.0035401239671046 | Epoch: 198 | MeanAbsoluteError: 0.0542082153260708 | Loss: 0.0066104537139957 | Epoch: 199 | 
MeanAbsoluteError: 0.0400690510869026 | Loss: 0.0042269836845420 | Epoch: 200 | MeanAbsoluteError: 0.0348945632576942 | Loss: 0.0045763677579331 | Epoch: 201 | 
MeanAbsoluteError: 0.0458779558539391 | Loss: 0.0042532920332936 | Epoch: 202 | MeanAbsoluteError: 0.0270840320736170 | Loss: 0.0029998617390326 | Epoch: 203 | 
MeanAbsoluteError: 0.0366220362484455 | Loss: 0.0045865005648617 | Early stopping at epoch 202
Returned to Spot: Validation loss: 0.004586500564861732
spotPython tuning: 0.0019051794661208987 [#######---] 66.58% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.37295456740707145, 'lr_mult': 8.052119735539524, 'batch_size': 16, 'epochs': 4096, 'k_folds': 1, 'patience': 128, 'optimizer': 'Adadelta', 'sgd_momentum': 0.7268778306225528}
Epoch: 1 | MeanAbsoluteError: 0.2447001188993454 | Loss: 0.0855097898135060 | Epoch: 2 | MeanAbsoluteError: 0.1580020934343338 | Loss: 0.0396394822746515 | Epoch: 3 | MeanAbsoluteError: 0.2309902757406235 | Loss: 0.0745504572987556 | Epoch: 4 | MeanAbsoluteError: 0.2075043618679047 | Loss: 0.0638963561505079 | Epoch: 5 | MeanAbsoluteError: 0.1297899037599564 | Loss: 0.0265217359716955 | Epoch: 6 | MeanAbsoluteError: 0.2709507942199707 | Loss: 0.0965300967034541 | Epoch: 7 | 
MeanAbsoluteError: 0.2206484526395798 | Loss: 0.0660201644426898 | Epoch: 8 | MeanAbsoluteError: 0.2098174989223480 | Loss: 0.0598776003247813 | Epoch: 9 | MeanAbsoluteError: 0.2696607112884521 | Loss: 0.0917368311631052 | Epoch: 10 | MeanAbsoluteError: 0.2177387773990631 | Loss: 0.0621080775009958 | Epoch: 11 | MeanAbsoluteError: 0.2510089576244354 | Loss: 0.0825520491129474 | Epoch: 12 | MeanAbsoluteError: 0.1331928223371506 | Loss: 0.0272956270920603 | Epoch: 13 | MeanAbsoluteError: 0.1745722144842148 | Loss: 0.0409186095195381 | Epoch: 14 | 
MeanAbsoluteError: 0.3186619579792023 | Loss: 0.1230389534642822 | Epoch: 15 | MeanAbsoluteError: 0.1258539557456970 | Loss: 0.0240965406655481 | Epoch: 16 | MeanAbsoluteError: 0.1507243216037750 | Loss: 0.0303019874386097 | Epoch: 17 | MeanAbsoluteError: 0.1662148833274841 | Loss: 0.0384318517815126 | Epoch: 18 | MeanAbsoluteError: 0.2478298991918564 | Loss: 0.0802299250897608 | Epoch: 19 | MeanAbsoluteError: 0.1899395287036896 | Loss: 0.0475054759728281 | Epoch: 20 | MeanAbsoluteError: 0.0840018615126610 | Loss: 0.0124709567447242 | Epoch: 21 | 
MeanAbsoluteError: 0.1647410690784454 | Loss: 0.0368504882054894 | Epoch: 22 | MeanAbsoluteError: 0.1322818100452423 | Loss: 0.0241542640877397 | Epoch: 23 | MeanAbsoluteError: 0.2800635695457458 | Loss: 0.0986453322203536 | Epoch: 24 | MeanAbsoluteError: 0.1964591145515442 | Loss: 0.0483156984769984 | Epoch: 25 | MeanAbsoluteError: 0.1034839153289795 | Loss: 0.0176489182355765 | Epoch: 26 | MeanAbsoluteError: 0.1360865086317062 | Loss: 0.0257633225992322 | Epoch: 27 | MeanAbsoluteError: 0.1527444422245026 | Loss: 0.0314595564023445 | Epoch: 28 | 
MeanAbsoluteError: 0.1796315461397171 | Loss: 0.0420685830084901 | Epoch: 29 | MeanAbsoluteError: 0.0768462419509888 | Loss: 0.0093461621650740 | Epoch: 30 | MeanAbsoluteError: 0.1132896170020103 | Loss: 0.0197883887510551 | Epoch: 31 | MeanAbsoluteError: 0.1696530729532242 | Loss: 0.0360168930339186 | Epoch: 32 | MeanAbsoluteError: 0.1606636494398117 | Loss: 0.0328978204021328 | Epoch: 33 | MeanAbsoluteError: 0.0880002751946449 | Loss: 0.0131370253664883 | Epoch: 34 | MeanAbsoluteError: 0.1499195098876953 | Loss: 0.0298106886054340 | Epoch: 35 | 
MeanAbsoluteError: 0.1348686665296555 | Loss: 0.0248544794066172 | Epoch: 36 | MeanAbsoluteError: 0.0985082462430000 | Loss: 0.0155198200066623 | Epoch: 37 | MeanAbsoluteError: 0.1998571902513504 | Loss: 0.0521628341000331 | Epoch: 38 | MeanAbsoluteError: 0.1013329029083252 | Loss: 0.0159437929427153 | Epoch: 39 | MeanAbsoluteError: 0.0738273113965988 | Loss: 0.0092891985427980 | Epoch: 40 | MeanAbsoluteError: 0.1674318164587021 | Loss: 0.0349522588872596 | Epoch: 41 | MeanAbsoluteError: 0.1275167167186737 | Loss: 0.0210473715376697 | Epoch: 42 | 
MeanAbsoluteError: 0.1411611139774323 | Loss: 0.0271960639051701 | Epoch: 43 | MeanAbsoluteError: 0.0714160501956940 | Loss: 0.0096633623991358 | Epoch: 44 | MeanAbsoluteError: 0.0864876061677933 | Loss: 0.0115388306347947 | Epoch: 45 | MeanAbsoluteError: 0.1619458496570587 | Loss: 0.0330489627330711 | Epoch: 46 | MeanAbsoluteError: 0.1159750968217850 | Loss: 0.0190904546823157 | Epoch: 47 | MeanAbsoluteError: 0.1470805555582047 | Loss: 0.0278928057829800 | Epoch: 48 | MeanAbsoluteError: 0.1511153876781464 | Loss: 0.0292483608385450 | Epoch: 49 | 
MeanAbsoluteError: 0.1093328595161438 | Loss: 0.0163401996128653 | Epoch: 50 | MeanAbsoluteError: 0.2037901729345322 | Loss: 0.0475490316748619 | Epoch: 51 | MeanAbsoluteError: 0.0938889086246490 | Loss: 0.0133329716658122 | Epoch: 52 | MeanAbsoluteError: 0.0813632085919380 | Loss: 0.0104606454505732 | Epoch: 53 | MeanAbsoluteError: 0.0738695114850998 | Loss: 0.0100817983651436 | Epoch: 54 | MeanAbsoluteError: 0.1636683493852615 | Loss: 0.0344360181571622 | Epoch: 55 | MeanAbsoluteError: 0.0710796341300011 | Loss: 0.0091952923930397 | Epoch: 56 | 
MeanAbsoluteError: 0.1910803467035294 | Loss: 0.0456635442219282 | Epoch: 57 | MeanAbsoluteError: 0.1033508628606796 | Loss: 0.0140300424965589 | Epoch: 58 | MeanAbsoluteError: 0.0889611095190048 | Loss: 0.0107328815287665 | Epoch: 59 | MeanAbsoluteError: 0.0841425433754921 | Loss: 0.0130304643443148 | Epoch: 60 | MeanAbsoluteError: 0.0791903585195541 | Loss: 0.0098597710020840 | Epoch: 61 | MeanAbsoluteError: 0.1642506271600723 | Loss: 0.0314657674416115 | Epoch: 62 | MeanAbsoluteError: 0.1043332368135452 | Loss: 0.0142901360400413 | Epoch: 63 | 
MeanAbsoluteError: 0.1017965152859688 | Loss: 0.0140063922950312 | Epoch: 64 | MeanAbsoluteError: 0.0973787680268288 | Loss: 0.0143673922866583 | Epoch: 65 | MeanAbsoluteError: 0.1379560679197311 | Loss: 0.0235067429511171 | Epoch: 66 | MeanAbsoluteError: 0.0981749743223190 | Loss: 0.0135280620551815 | Epoch: 67 | MeanAbsoluteError: 0.0904821455478668 | Loss: 0.0137444020763628 | Epoch: 68 | MeanAbsoluteError: 0.0959734320640564 | Loss: 0.0147141058880248 | Epoch: 69 | MeanAbsoluteError: 0.1689277142286301 | Loss: 0.0345918827347065 | Epoch: 70 | 
MeanAbsoluteError: 0.1012625023722649 | Loss: 0.0143574995576943 | Epoch: 71 | MeanAbsoluteError: 0.1681680530309677 | Loss: 0.0358784859509845 | Epoch: 72 | MeanAbsoluteError: 0.0746937990188599 | Loss: 0.0093927654241653 | Epoch: 73 | MeanAbsoluteError: 0.1125854849815369 | Loss: 0.0183977984186066 | Epoch: 74 | MeanAbsoluteError: 0.1177399158477783 | Loss: 0.0186993292483844 | Epoch: 75 | MeanAbsoluteError: 0.0625247955322266 | Loss: 0.0064390514683174 | Epoch: 76 | MeanAbsoluteError: 0.0797554925084114 | Loss: 0.0094127234953799 | Epoch: 77 | 
MeanAbsoluteError: 0.1175967529416084 | Loss: 0.0178729963831996 | Epoch: 78 | MeanAbsoluteError: 0.0812770873308182 | Loss: 0.0095973570438984 | Epoch: 79 | MeanAbsoluteError: 0.0562059283256531 | Loss: 0.0063348143287983 | Epoch: 80 | MeanAbsoluteError: 0.1060760021209717 | Loss: 0.0159570546330590 | Epoch: 81 | MeanAbsoluteError: 0.0794241428375244 | Loss: 0.0095451139526344 | Epoch: 82 | MeanAbsoluteError: 0.0832724496722221 | Loss: 0.0105652679738246 | Epoch: 83 | MeanAbsoluteError: 0.0736607909202576 | Loss: 0.0083275347286345 | Epoch: 84 | 
MeanAbsoluteError: 0.1254241466522217 | Loss: 0.0229584735965258 | Epoch: 85 | MeanAbsoluteError: 0.0612995959818363 | Loss: 0.0067398775810082 | Epoch: 86 | MeanAbsoluteError: 0.1380100697278976 | Loss: 0.0249583928992874 | Epoch: 87 | MeanAbsoluteError: 0.1011698842048645 | Loss: 0.0132057306503779 | Epoch: 88 | MeanAbsoluteError: 0.0979978814721107 | Loss: 0.0140497115636735 | Epoch: 89 | MeanAbsoluteError: 0.1508186906576157 | Loss: 0.0281760888664346 | Epoch: 90 | MeanAbsoluteError: 0.1484555751085281 | Loss: 0.0264455155518494 | Epoch: 91 | 
MeanAbsoluteError: 0.1085724011063576 | Loss: 0.0165455286930266 | Epoch: 92 | MeanAbsoluteError: 0.1390037536621094 | Loss: 0.0285958419308851 | Epoch: 93 | MeanAbsoluteError: 0.0682134926319122 | Loss: 0.0070925108647268 | Epoch: 94 | MeanAbsoluteError: 0.0865677818655968 | Loss: 0.0109067204114246 | Epoch: 95 | MeanAbsoluteError: 0.0916916653513908 | Loss: 0.0124773131438384 | Epoch: 96 | MeanAbsoluteError: 0.0962722003459930 | Loss: 0.0130882558265799 | Epoch: 97 | MeanAbsoluteError: 0.0622784160077572 | Loss: 0.0070744024614166 | Epoch: 98 | 
MeanAbsoluteError: 0.1259673237800598 | Loss: 0.0200339205759136 | Epoch: 99 | MeanAbsoluteError: 0.0631988495588303 | Loss: 0.0062209959141910 | Epoch: 100 | MeanAbsoluteError: 0.1384975314140320 | Loss: 0.0240916968568375 | Epoch: 101 | MeanAbsoluteError: 0.1126506924629211 | Loss: 0.0181471174827924 | Epoch: 102 | MeanAbsoluteError: 0.1256616115570068 | Loss: 0.0223907211207246 | Epoch: 103 | MeanAbsoluteError: 0.1407861709594727 | Loss: 0.0240103401439755 | Epoch: 104 | MeanAbsoluteError: 0.1535448431968689 | Loss: 0.0277186524319021 | Epoch: 105 | 
MeanAbsoluteError: 0.0884410813450813 | Loss: 0.0113332649006655 | Epoch: 106 | MeanAbsoluteError: 0.0990367680788040 | Loss: 0.0131283090694955 | Epoch: 107 | MeanAbsoluteError: 0.0721407011151314 | Loss: 0.0087017266717004 | Epoch: 108 | MeanAbsoluteError: 0.1101248785853386 | Loss: 0.0167359557787054 | Epoch: 109 | MeanAbsoluteError: 0.0847753360867500 | Loss: 0.0114182231849746 | Epoch: 110 | MeanAbsoluteError: 0.1068745404481888 | Loss: 0.0183329419232905 | Epoch: 111 | MeanAbsoluteError: 0.0720966979861259 | Loss: 0.0086385031279765 | Epoch: 112 | 
MeanAbsoluteError: 0.0671968534588814 | Loss: 0.0077523747581596 | Epoch: 113 | MeanAbsoluteError: 0.0622012466192245 | Loss: 0.0076761219625998 | Epoch: 114 | MeanAbsoluteError: 0.0559682026505470 | Loss: 0.0054941350643180 | Epoch: 115 | MeanAbsoluteError: 0.1343731880187988 | Loss: 0.0233532857934111 | Epoch: 116 | MeanAbsoluteError: 0.1237890124320984 | Loss: 0.0221729664328067 | Epoch: 117 | MeanAbsoluteError: 0.0586146414279938 | Loss: 0.0064251101269436 | Epoch: 118 | MeanAbsoluteError: 0.0693998932838440 | Loss: 0.0087266478712033 | Epoch: 119 | 
MeanAbsoluteError: 0.1278504431247711 | Loss: 0.0207617553931318 | Epoch: 120 | MeanAbsoluteError: 0.0888359099626541 | Loss: 0.0117721463014421 | Epoch: 121 | MeanAbsoluteError: 0.0650345161557198 | Loss: 0.0087111913476531 | Epoch: 122 | MeanAbsoluteError: 0.1191420257091522 | Loss: 0.0201977723229088 | Epoch: 123 | MeanAbsoluteError: 0.0535241700708866 | Loss: 0.0057879760616312 | Epoch: 124 | MeanAbsoluteError: 0.1021244972944260 | Loss: 0.0142826392854515 | Epoch: 125 | MeanAbsoluteError: 0.0940655246376991 | Loss: 0.0125544384170912 | Epoch: 126 | 
MeanAbsoluteError: 0.0775369778275490 | Loss: 0.0098799197248330 | Epoch: 127 | MeanAbsoluteError: 0.0519650653004646 | Loss: 0.0049745226278901 | Epoch: 128 | MeanAbsoluteError: 0.1587994247674942 | Loss: 0.0321820337129267 | Epoch: 129 | MeanAbsoluteError: 0.0955057740211487 | Loss: 0.0137253675462776 | Epoch: 130 | MeanAbsoluteError: 0.0740934908390045 | Loss: 0.0081886019018528 | Epoch: 131 | MeanAbsoluteError: 0.0533605888485909 | Loss: 0.0054388267453760 | Epoch: 132 | MeanAbsoluteError: 0.1525044292211533 | Loss: 0.0272629424733551 | Epoch: 133 | 
MeanAbsoluteError: 0.0763928964734077 | Loss: 0.0085627328677985 | Epoch: 134 | MeanAbsoluteError: 0.1105835586786270 | Loss: 0.0172793817167219 | Epoch: 135 | MeanAbsoluteError: 0.0918404012918472 | Loss: 0.0117150510808355 | Epoch: 136 | MeanAbsoluteError: 0.0740693658590317 | Loss: 0.0081618354704819 | Epoch: 137 | MeanAbsoluteError: 0.1039353162050247 | Loss: 0.0141779218653315 | Epoch: 138 | MeanAbsoluteError: 0.0756265819072723 | Loss: 0.0083343223913720 | Epoch: 139 | MeanAbsoluteError: 0.0887664109468460 | Loss: 0.0127237628116027 | Epoch: 140 | 
MeanAbsoluteError: 0.0847578719258308 | Loss: 0.0113944038503656 | Epoch: 141 | MeanAbsoluteError: 0.0490307286381721 | Loss: 0.0046689158648645 | Epoch: 142 | MeanAbsoluteError: 0.1354899406433105 | Loss: 0.0248635874472951 | Epoch: 143 | MeanAbsoluteError: 0.1333345174789429 | Loss: 0.0235807562344953 | Epoch: 144 | MeanAbsoluteError: 0.0665749013423920 | Loss: 0.0079835188869191 | Epoch: 145 | MeanAbsoluteError: 0.1162428781390190 | Loss: 0.0198595350069043 | Epoch: 146 | MeanAbsoluteError: 0.0669198483228683 | Loss: 0.0069582311215958 | Epoch: 147 | 
MeanAbsoluteError: 0.0563974753022194 | Loss: 0.0058180993104256 | Epoch: 148 | MeanAbsoluteError: 0.0681925863027573 | Loss: 0.0083114144416820 | Epoch: 149 | MeanAbsoluteError: 0.0732608139514923 | Loss: 0.0090417446397049 | Epoch: 150 | MeanAbsoluteError: 0.0632192194461823 | Loss: 0.0074918614210267 | Epoch: 151 | MeanAbsoluteError: 0.0818670094013214 | Loss: 0.0121128338781234 | Epoch: 152 | MeanAbsoluteError: 0.0683749243617058 | Loss: 0.0071537019439826 | Epoch: 153 | MeanAbsoluteError: 0.0586371496319771 | Loss: 0.0065204092472988 | Epoch: 154 | 
MeanAbsoluteError: 0.1223448961973190 | Loss: 0.0216586120720757 | Epoch: 155 | MeanAbsoluteError: 0.0558478534221649 | Loss: 0.0055494656124593 | Epoch: 156 | MeanAbsoluteError: 0.1147128939628601 | Loss: 0.0176597947597896 | Epoch: 157 | MeanAbsoluteError: 0.1310752630233765 | Loss: 0.0224258431086415 | Epoch: 158 | MeanAbsoluteError: 0.1146662905812263 | Loss: 0.0165902227163315 | Epoch: 159 | MeanAbsoluteError: 0.0474279932677746 | Loss: 0.0048133358114252 | Epoch: 160 | MeanAbsoluteError: 0.0867375358939171 | Loss: 0.0118472345516478 | Epoch: 161 | 
MeanAbsoluteError: 0.0785840451717377 | Loss: 0.0100041605336101 | Epoch: 162 | MeanAbsoluteError: 0.0841324850916862 | Loss: 0.0107220630896719 | Epoch: 163 | MeanAbsoluteError: 0.1525932103395462 | Loss: 0.0270050025888179 | Epoch: 164 | MeanAbsoluteError: 0.0522489883005619 | Loss: 0.0050711162804969 | Epoch: 165 | MeanAbsoluteError: 0.0695595964789391 | Loss: 0.0074024963388710 | Epoch: 166 | MeanAbsoluteError: 0.1244753748178482 | Loss: 0.0179116721019933 | Epoch: 167 | MeanAbsoluteError: 0.0968054458498955 | Loss: 0.0146950731838220 | Epoch: 168 | 
MeanAbsoluteError: 0.1136688888072968 | Loss: 0.0168685035191868 | Epoch: 169 | MeanAbsoluteError: 0.0554621554911137 | Loss: 0.0051055842838985 | Epoch: 170 | MeanAbsoluteError: 0.0719570070505142 | Loss: 0.0085775479490526 | Epoch: 171 | MeanAbsoluteError: 0.1554182320833206 | Loss: 0.0277685794587198 | Epoch: 172 | MeanAbsoluteError: 0.0746342092752457 | Loss: 0.0084003813711828 | Epoch: 173 | MeanAbsoluteError: 0.0609415359795094 | Loss: 0.0073291383021952 | Epoch: 174 | MeanAbsoluteError: 0.1221163570880890 | Loss: 0.0189705100890837 | Epoch: 175 | 
MeanAbsoluteError: 0.1373913139104843 | Loss: 0.0270361505252750 | Epoch: 176 | MeanAbsoluteError: 0.0677372962236404 | Loss: 0.0073383560306148 | Epoch: 177 | MeanAbsoluteError: 0.1013956293463707 | Loss: 0.0134072843448896 | Epoch: 178 | MeanAbsoluteError: 0.0729240700602531 | Loss: 0.0084308743182766 | Epoch: 179 | MeanAbsoluteError: 0.0806202515959740 | Loss: 0.0122144872959899 | Epoch: 180 | MeanAbsoluteError: 0.0951137095689774 | Loss: 0.0148316225968301 | Epoch: 181 | MeanAbsoluteError: 0.0960243642330170 | Loss: 0.0123010216476886 | Epoch: 182 | 
MeanAbsoluteError: 0.0783033967018127 | Loss: 0.0096626366537653 | Epoch: 183 | MeanAbsoluteError: 0.0679651871323586 | Loss: 0.0073398284761137 | Epoch: 184 | MeanAbsoluteError: 0.0691692605614662 | Loss: 0.0079222069072880 | Epoch: 185 | MeanAbsoluteError: 0.0844503566622734 | Loss: 0.0126851046653955 | Epoch: 186 | MeanAbsoluteError: 0.0791855230927467 | Loss: 0.0099326067996260 | Epoch: 187 | MeanAbsoluteError: 0.0607512928545475 | Loss: 0.0056878988949680 | Epoch: 188 | MeanAbsoluteError: 0.0609961077570915 | Loss: 0.0072128173748129 | Epoch: 189 | 
MeanAbsoluteError: 0.0781227573752403 | Loss: 0.0099874292377775 | Epoch: 190 | MeanAbsoluteError: 0.0915561392903328 | Loss: 0.0117463599890471 | Epoch: 191 | MeanAbsoluteError: 0.0689331442117691 | Loss: 0.0084562878443026 | Epoch: 192 | MeanAbsoluteError: 0.0793147981166840 | Loss: 0.0090814752896365 | Epoch: 193 | MeanAbsoluteError: 0.0627450868487358 | Loss: 0.0073934600467941 | Epoch: 194 | MeanAbsoluteError: 0.1125935092568398 | Loss: 0.0166534901057419 | Epoch: 195 | MeanAbsoluteError: 0.0773493275046349 | Loss: 0.0091300153565642 | Epoch: 196 | 
MeanAbsoluteError: 0.0673442482948303 | Loss: 0.0075917264667193 | Epoch: 197 | MeanAbsoluteError: 0.0900190770626068 | Loss: 0.0137332113165604 | Epoch: 198 | MeanAbsoluteError: 0.1159798204898834 | Loss: 0.0166195855524979 | Epoch: 199 | MeanAbsoluteError: 0.0809410512447357 | Loss: 0.0100829765004547 | Epoch: 200 | MeanAbsoluteError: 0.0448737479746342 | Loss: 0.0034751534296543 | Epoch: 201 | MeanAbsoluteError: 0.0791918709874153 | Loss: 0.0111996479038345 | Epoch: 202 | 
MeanAbsoluteError: 0.1598356813192368 | Loss: 0.0351670507929827 | Epoch: 203 | MeanAbsoluteError: 0.0444257557392120 | Loss: 0.0036616488972581 | Epoch: 204 | MeanAbsoluteError: 0.0726116970181465 | Loss: 0.0089672073280733 | Epoch: 205 | MeanAbsoluteError: 0.1267763078212738 | Loss: 0.0203453094061268 | Epoch: 206 | MeanAbsoluteError: 0.0580264478921890 | Loss: 0.0061880298154919 | Epoch: 207 | MeanAbsoluteError: 0.1490679085254669 | Loss: 0.0280556132722842 | Epoch: 208 | 
MeanAbsoluteError: 0.0950463265180588 | Loss: 0.0121512326755022 | Epoch: 209 | MeanAbsoluteError: 0.0820402428507805 | Loss: 0.0097848481964320 | Epoch: 210 | MeanAbsoluteError: 0.0659906566143036 | Loss: 0.0072785777186877 | Epoch: 211 | MeanAbsoluteError: 0.0700170695781708 | Loss: 0.0072350782881442 | Epoch: 212 | MeanAbsoluteError: 0.1037385910749435 | Loss: 0.0163056126697675 | Epoch: 213 | MeanAbsoluteError: 0.0887548476457596 | Loss: 0.0109845771160173 | Epoch: 214 | MeanAbsoluteError: 0.0574871078133583 | Loss: 0.0054916914331874 | Epoch: 215 | 
MeanAbsoluteError: 0.0906533002853394 | Loss: 0.0131006567297797 | Epoch: 216 | MeanAbsoluteError: 0.0540482066571712 | Loss: 0.0052423573123585 | Epoch: 217 | MeanAbsoluteError: 0.1477705091238022 | Loss: 0.0255973212617008 | Epoch: 218 | MeanAbsoluteError: 0.0658211112022400 | Loss: 0.0085414868142260 | Epoch: 219 | MeanAbsoluteError: 0.0856865718960762 | Loss: 0.0100902552030196 | Epoch: 220 | MeanAbsoluteError: 0.0973692163825035 | Loss: 0.0129868492827212 | Epoch: 221 | MeanAbsoluteError: 0.0644562244415283 | Loss: 0.0075791036636618 | Epoch: 222 | 
MeanAbsoluteError: 0.1348229497671127 | Loss: 0.0247115518799738 | Epoch: 223 | MeanAbsoluteError: 0.0985309183597565 | Loss: 0.0124414864143259 | Epoch: 224 | MeanAbsoluteError: 0.1390668302774429 | Loss: 0.0275598176215824 | Epoch: 225 | MeanAbsoluteError: 0.0526663996279240 | Loss: 0.0044252158902389 | Epoch: 226 | MeanAbsoluteError: 0.0840587392449379 | Loss: 0.0102564654999266 | Epoch: 227 | MeanAbsoluteError: 0.0632937848567963 | Loss: 0.0066094641500202 | Epoch: 228 | MeanAbsoluteError: 0.0671389922499657 | Loss: 0.0078354010505504 | Epoch: 229 | 
MeanAbsoluteError: 0.0836645662784576 | Loss: 0.0098813778083575 | Epoch: 230 | MeanAbsoluteError: 0.0481733456254005 | Loss: 0.0039462109684552 | Epoch: 231 | MeanAbsoluteError: 0.0804310590028763 | Loss: 0.0100185493570998 | Epoch: 232 | MeanAbsoluteError: 0.0803806558251381 | Loss: 0.0119821812320305 | Epoch: 233 | MeanAbsoluteError: 0.0690108314156532 | Loss: 0.0076982008023678 | Epoch: 234 | MeanAbsoluteError: 0.0750814974308014 | Loss: 0.0092731249935337 | Epoch: 235 | MeanAbsoluteError: 0.1106955111026764 | Loss: 0.0162190019496177 | Epoch: 236 | 
MeanAbsoluteError: 0.1126798391342163 | Loss: 0.0164694327517952 | Epoch: 237 | MeanAbsoluteError: 0.0776378065347672 | Loss: 0.0089555618990409 | Epoch: 238 | MeanAbsoluteError: 0.0822804719209671 | Loss: 0.0106189366626112 | Epoch: 239 | MeanAbsoluteError: 0.1266122460365295 | Loss: 0.0199280937545394 | Epoch: 240 | MeanAbsoluteError: 0.0848600640892982 | Loss: 0.0112331209606246 | Epoch: 241 | MeanAbsoluteError: 0.0823120847344398 | Loss: 0.0095310402838023 | Epoch: 242 | MeanAbsoluteError: 0.0765826925635338 | Loss: 0.0102423024853986 | Epoch: 243 | 
MeanAbsoluteError: 0.0683756768703461 | Loss: 0.0083380426329217 | Epoch: 244 | MeanAbsoluteError: 0.0876366645097733 | Loss: 0.0105649727935854 | Epoch: 245 | MeanAbsoluteError: 0.0975115075707436 | Loss: 0.0175518042554981 | Epoch: 246 | MeanAbsoluteError: 0.0945315062999725 | Loss: 0.0124611935921405 | Epoch: 247 | MeanAbsoluteError: 0.0793878808617592 | Loss: 0.0096594514570346 | Epoch: 248 | MeanAbsoluteError: 0.1109115853905678 | Loss: 0.0162084073220429 | Epoch: 249 | MeanAbsoluteError: 0.0720490068197250 | Loss: 0.0084369638934731 | Epoch: 250 | 
MeanAbsoluteError: 0.0606708265841007 | Loss: 0.0065813420806080 | Epoch: 251 | MeanAbsoluteError: 0.0695800408720970 | Loss: 0.0076791686863687 | Epoch: 252 | MeanAbsoluteError: 0.0718046501278877 | Loss: 0.0098116414768523 | Epoch: 253 | MeanAbsoluteError: 0.0673714876174927 | Loss: 0.0078621098011928 | Epoch: 254 | MeanAbsoluteError: 0.0653887838125229 | Loss: 0.0069031579861123 | Epoch: 255 | MeanAbsoluteError: 0.0637596994638443 | Loss: 0.0066761589290476 | Epoch: 256 | 
MeanAbsoluteError: 0.0823551416397095 | Loss: 0.0107396268285811 | Epoch: 257 | MeanAbsoluteError: 0.0857747495174408 | Loss: 0.0116973783771851 | Epoch: 258 | MeanAbsoluteError: 0.0877402275800705 | Loss: 0.0120977349579334 | Epoch: 259 | MeanAbsoluteError: 0.1036799773573875 | Loss: 0.0148738148671232 | Epoch: 260 | MeanAbsoluteError: 0.0571867190301418 | Loss: 0.0061157222249006 | Epoch: 261 | MeanAbsoluteError: 0.1369741410017014 | Loss: 0.0238327165869506 | Epoch: 262 | 
MeanAbsoluteError: 0.0477108992636204 | Loss: 0.0055608479061017 | Epoch: 263 | MeanAbsoluteError: 0.0602814666926861 | Loss: 0.0057324801424616 | Epoch: 264 | MeanAbsoluteError: 0.0908160880208015 | Loss: 0.0117845379649416 | Epoch: 265 | MeanAbsoluteError: 0.0711855217814445 | Loss: 0.0082770959768248 | Epoch: 266 | MeanAbsoluteError: 0.1374103724956512 | Loss: 0.0230335052076139 | Epoch: 267 | MeanAbsoluteError: 0.0605613440275192 | Loss: 0.0063800602097456 | Epoch: 268 | 
MeanAbsoluteError: 0.1010168790817261 | Loss: 0.0146073882320994 | Epoch: 269 | MeanAbsoluteError: 0.0992863774299622 | Loss: 0.0160150942637732 | Epoch: 270 | MeanAbsoluteError: 0.0645449087023735 | Loss: 0.0078444380288650 | Epoch: 271 | MeanAbsoluteError: 0.0595164187252522 | Loss: 0.0073634782119801 | Epoch: 272 | MeanAbsoluteError: 0.0859667584300041 | Loss: 0.0111019978740890 | Epoch: 273 | MeanAbsoluteError: 0.0708274319767952 | Loss: 0.0093057134776915 | Epoch: 274 | 
MeanAbsoluteError: 0.0737517178058624 | Loss: 0.0093562066260921 | Epoch: 275 | MeanAbsoluteError: 0.0801170319318771 | Loss: 0.0109158912060880 | Epoch: 276 | MeanAbsoluteError: 0.0510831885039806 | Loss: 0.0049052500276287 | Epoch: 277 | MeanAbsoluteError: 0.0554112195968628 | Loss: 0.0055595030640497 | Epoch: 278 | MeanAbsoluteError: 0.0626112893223763 | Loss: 0.0066454112652297 | Epoch: 279 | MeanAbsoluteError: 0.0565003529191017 | Loss: 0.0059297232533266 | Epoch: 280 | MeanAbsoluteError: 0.0955222919583321 | Loss: 0.0121061349973867 | Epoch: 281 | 
MeanAbsoluteError: 0.0680279061198235 | Loss: 0.0087319207622817 | Epoch: 282 | MeanAbsoluteError: 0.1107517853379250 | Loss: 0.0198835300183610 | Epoch: 283 | MeanAbsoluteError: 0.1275737285614014 | Loss: 0.0234656772135120 | Epoch: 284 | MeanAbsoluteError: 0.0470788776874542 | Loss: 0.0037291350124992 | Epoch: 285 | MeanAbsoluteError: 0.0475363396108150 | Loss: 0.0043408151311604 | Epoch: 286 | MeanAbsoluteError: 0.0939714908599854 | Loss: 0.0144327540979966 | Epoch: 287 | MeanAbsoluteError: 0.0529847443103790 | Loss: 0.0050816140015070 | Epoch: 288 | 
MeanAbsoluteError: 0.0562283135950565 | Loss: 0.0055566024353826 | Epoch: 289 | MeanAbsoluteError: 0.1024286001920700 | Loss: 0.0144528075807581 | Epoch: 290 | MeanAbsoluteError: 0.0570575520396233 | Loss: 0.0059144576815398 | Epoch: 291 | MeanAbsoluteError: 0.0840838104486465 | Loss: 0.0121900327258596 | Epoch: 292 | MeanAbsoluteError: 0.1171253323554993 | Loss: 0.0190340457974296 | Epoch: 293 | MeanAbsoluteError: 0.0722798481583595 | Loss: 0.0087267181492950 | Epoch: 294 | MeanAbsoluteError: 0.0876427516341209 | Loss: 0.0110047300542264 | Epoch: 295 | 
MeanAbsoluteError: 0.0620434321463108 | Loss: 0.0067325934253045 | Epoch: 296 | MeanAbsoluteError: 0.0643863826990128 | Loss: 0.0077448869736767 | Epoch: 297 | MeanAbsoluteError: 0.0895547047257423 | Loss: 0.0121951608330404 | Epoch: 298 | MeanAbsoluteError: 0.0910545885562897 | Loss: 0.0115143668249642 | Epoch: 299 | MeanAbsoluteError: 0.1027223169803619 | Loss: 0.0135154267773032 | Epoch: 300 | MeanAbsoluteError: 0.1138875186443329 | Loss: 0.0186224908715016 | Epoch: 301 | MeanAbsoluteError: 0.1169660687446594 | Loss: 0.0199162835059197 | Epoch: 302 | 
MeanAbsoluteError: 0.0792295783758163 | Loss: 0.0098335913652064 | Epoch: 303 | MeanAbsoluteError: 0.0568308494985104 | Loss: 0.0062469965288121 | Epoch: 304 | MeanAbsoluteError: 0.1020381972193718 | Loss: 0.0134630105948370 | Epoch: 305 | MeanAbsoluteError: 0.0720581337809563 | Loss: 0.0087242962939567 | Epoch: 306 | MeanAbsoluteError: 0.1104147359728813 | Loss: 0.0169855423124605 | Epoch: 307 | MeanAbsoluteError: 0.0888919532299042 | Loss: 0.0134771113332949 | Epoch: 308 | MeanAbsoluteError: 0.0883885100483894 | Loss: 0.0112606787956075 | Epoch: 309 | 
MeanAbsoluteError: 0.0793932750821114 | Loss: 0.0091313102870787 | Epoch: 310 | MeanAbsoluteError: 0.0675512626767159 | Loss: 0.0075036550283824 | Epoch: 311 | MeanAbsoluteError: 0.1107983887195587 | Loss: 0.0212515288669812 | Epoch: 312 | MeanAbsoluteError: 0.0952027365565300 | Loss: 0.0126856768160666 | Epoch: 313 | MeanAbsoluteError: 0.0626232773065567 | Loss: 0.0065561177723698 | Epoch: 314 | MeanAbsoluteError: 0.1131185144186020 | Loss: 0.0168677839009385 | Epoch: 315 | MeanAbsoluteError: 0.0579562634229660 | Loss: 0.0052874643649710 | Epoch: 316 | 
MeanAbsoluteError: 0.1033085659146309 | Loss: 0.0144052176099075 | Epoch: 317 | MeanAbsoluteError: 0.0692384168505669 | Loss: 0.0085241601949460 | Epoch: 318 | MeanAbsoluteError: 0.0530399009585381 | Loss: 0.0054795613732973 | Epoch: 319 | MeanAbsoluteError: 0.1015958711504936 | Loss: 0.0129027787203851 | Epoch: 320 | MeanAbsoluteError: 0.0724492296576500 | Loss: 0.0075352854879671 | Epoch: 321 | MeanAbsoluteError: 0.0583184100687504 | Loss: 0.0051359408167436 | Epoch: 322 | MeanAbsoluteError: 0.1205359771847725 | Loss: 0.0187268199301080 | Epoch: 323 | 
MeanAbsoluteError: 0.0674538984894753 | Loss: 0.0079233841357851 | Epoch: 324 | MeanAbsoluteError: 0.0584105625748634 | Loss: 0.0061445888376942 | Epoch: 325 | MeanAbsoluteError: 0.1080750524997711 | Loss: 0.0171692155693707 | Epoch: 326 | MeanAbsoluteError: 0.0764690712094307 | Loss: 0.0095567270427158 | Epoch: 327 | MeanAbsoluteError: 0.1216562017798424 | Loss: 0.0185169380550322 | Epoch: 328 | MeanAbsoluteError: 0.0567809231579304 | Loss: 0.0050826327090985 | Early stopping at epoch 327
Returned to Spot: Validation loss: 0.005082632709098489
spotPython tuning: 0.0019051794661208987 [#########-] 86.74% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.0, 'lr_mult': 8.538604972185516, 'batch_size': 16, 'epochs': 4096, 'k_folds': 1, 'patience': 16, 'optimizer': 'Adadelta', 'sgd_momentum': 0.02620721362909147}
Epoch: 1 | MeanAbsoluteError: 0.3478057682514191 | Loss: 0.1409961738084492 | Epoch: 2 | MeanAbsoluteError: 0.2604742348194122 | Loss: 0.0834734459456645 | Epoch: 3 | MeanAbsoluteError: 0.2547070682048798 | Loss: 0.0798962000561388 | Epoch: 4 | MeanAbsoluteError: 0.2507070302963257 | Loss: 0.0772159725035492 | Epoch: 5 | MeanAbsoluteError: 0.2495401501655579 | Loss: 0.0758573961885352 | Epoch: 6 | MeanAbsoluteError: 0.2399732023477554 | Loss: 0.0702857037908153 | Epoch: 7 | MeanAbsoluteError: 0.2250762879848480 | Loss: 0.0619862901144906 | Epoch: 8 | 
MeanAbsoluteError: 0.2266416400671005 | Loss: 0.0620954128864564 | Epoch: 9 | MeanAbsoluteError: 0.2148341387510300 | Loss: 0.0558909093470950 | Epoch: 10 | MeanAbsoluteError: 0.2046515494585037 | Loss: 0.0504755669910657 | Epoch: 11 | MeanAbsoluteError: 0.1928720921278000 | Loss: 0.0452703263022398 | Epoch: 12 | MeanAbsoluteError: 0.1761854737997055 | Loss: 0.0382545817839472 | Epoch: 13 | MeanAbsoluteError: 0.1811217814683914 | Loss: 0.0395094444485087 | Epoch: 14 | MeanAbsoluteError: 0.1494247615337372 | Loss: 0.0281376146564358 | Epoch: 15 | MeanAbsoluteError: 0.1446647346019745 | Loss: 0.0261912073351835 | Epoch: 16 | 
MeanAbsoluteError: 0.1284342557191849 | Loss: 0.0213872147233863 | Epoch: 17 | MeanAbsoluteError: 0.1193197667598724 | Loss: 0.0184752679871101 | Epoch: 18 | MeanAbsoluteError: 0.0863939896225929 | Loss: 0.0108656022256534 | Epoch: 19 | MeanAbsoluteError: 0.0873574241995811 | Loss: 0.0110135362238476 | Epoch: 20 | MeanAbsoluteError: 0.0889521688222885 | Loss: 0.0112271430951200 | Epoch: 21 | MeanAbsoluteError: 0.0744331553578377 | Loss: 0.0083119789579589 | Epoch: 22 | MeanAbsoluteError: 0.0961988493800163 | Loss: 0.0125223509477157 | Epoch: 23 | MeanAbsoluteError: 0.0694777518510818 | Loss: 0.0072868109411119 | Epoch: 24 | 
MeanAbsoluteError: 0.0899282470345497 | Loss: 0.0109758405014873 | Epoch: 25 | MeanAbsoluteError: 0.0796547904610634 | Loss: 0.0091532667804705 | Epoch: 26 | MeanAbsoluteError: 0.0768571346998215 | Loss: 0.0084761229196661 | Epoch: 27 | MeanAbsoluteError: 0.0718124806880951 | Loss: 0.0075513395284744 | Epoch: 28 | MeanAbsoluteError: 0.0681758150458336 | Loss: 0.0068932761879344 | Epoch: 29 | MeanAbsoluteError: 0.0668904259800911 | Loss: 0.0064515667281261 | Epoch: 30 | MeanAbsoluteError: 0.1393246203660965 | Loss: 0.0230521890089700 | Epoch: 31 | MeanAbsoluteError: 0.1241583526134491 | Loss: 0.0188489818063221 | Epoch: 32 | 
MeanAbsoluteError: 0.0596553422510624 | Loss: 0.0052078633789757 | Epoch: 33 | MeanAbsoluteError: 0.0577211827039719 | Loss: 0.0048815987048377 | Epoch: 34 | MeanAbsoluteError: 0.1277504414319992 | Loss: 0.0198997789993882 | Epoch: 35 | MeanAbsoluteError: 0.0608055368065834 | Loss: 0.0053971382593246 | Epoch: 36 | MeanAbsoluteError: 0.0536244586110115 | Loss: 0.0042388953856732 | Epoch: 37 | MeanAbsoluteError: 0.1449077129364014 | Loss: 0.0245098232438690 | Epoch: 38 | MeanAbsoluteError: 0.1328559666872025 | Loss: 0.0205741606064533 | Epoch: 39 | MeanAbsoluteError: 0.0371535792946815 | Loss: 0.0021946318018691 | Epoch: 40 | 
MeanAbsoluteError: 0.0518228374421597 | Loss: 0.0038503125113876 | Epoch: 41 | MeanAbsoluteError: 0.0464062876999378 | Loss: 0.0031541687877555 | Epoch: 42 | MeanAbsoluteError: 0.1264354288578033 | Loss: 0.0192804888479019 | Epoch: 43 | MeanAbsoluteError: 0.0307827983051538 | Loss: 0.0014697259665761 | Epoch: 44 | MeanAbsoluteError: 0.0281416922807693 | Loss: 0.0012363824919846 | Epoch: 45 | MeanAbsoluteError: 0.0344726331532001 | Loss: 0.0017762138986176 | Epoch: 46 | MeanAbsoluteError: 0.0268106199800968 | Loss: 0.0010795831698679 | Epoch: 47 | MeanAbsoluteError: 0.0250129662454128 | Loss: 0.0009534878405056 | 
Epoch: 48 | MeanAbsoluteError: 0.0289446320384741 | Loss: 0.0013124340299615 | Epoch: 49 | MeanAbsoluteError: 0.0388839989900589 | Loss: 0.0020822667467751 | Epoch: 50 | MeanAbsoluteError: 0.0339432694017887 | Loss: 0.0016576602662864 | Epoch: 51 | MeanAbsoluteError: 0.0327541418373585 | Loss: 0.0015892709274531 | Epoch: 52 | MeanAbsoluteError: 0.0775794684886932 | Loss: 0.0079647410219829 | Epoch: 53 | MeanAbsoluteError: 0.0914976149797440 | Loss: 0.0099890098269833 | Epoch: 54 | MeanAbsoluteError: 0.0841250717639923 | Loss: 0.0078797758262801 | Epoch: 55 | 
MeanAbsoluteError: 0.0702098831534386 | Loss: 0.0056387923755928 | Epoch: 56 | MeanAbsoluteError: 0.0574073046445847 | Loss: 0.0040185242940329 | Epoch: 57 | MeanAbsoluteError: 0.0412621125578880 | Loss: 0.0022675571963191 | Epoch: 58 | MeanAbsoluteError: 0.0235760491341352 | Loss: 0.0008485944953894 | Epoch: 59 | MeanAbsoluteError: 0.0226237084716558 | Loss: 0.0008107186969076 | Epoch: 60 | MeanAbsoluteError: 0.0327766984701157 | Loss: 0.0015902980629012 | Epoch: 61 | MeanAbsoluteError: 0.0231883823871613 | Loss: 0.0008396586590128 | Epoch: 62 | MeanAbsoluteError: 0.0252707228064537 | Loss: 0.0009947445360012 | Epoch: 63 | 
MeanAbsoluteError: 0.0247924420982599 | Loss: 0.0009656314015094 | Epoch: 64 | MeanAbsoluteError: 0.0242846105247736 | Loss: 0.0009200724736346 | Epoch: 65 | MeanAbsoluteError: 0.0233271047472954 | Loss: 0.0008661409665365 | Epoch: 66 | MeanAbsoluteError: 0.0431097000837326 | Loss: 0.0026500043336694 | Epoch: 67 | MeanAbsoluteError: 0.0522982403635979 | Loss: 0.0041642016731203 | Epoch: 68 | MeanAbsoluteError: 0.0536980368196964 | Loss: 0.0041490995178097 | Epoch: 69 | MeanAbsoluteError: 0.0245490316301584 | Loss: 0.0009618795991532 | Epoch: 70 | MeanAbsoluteError: 0.0241480916738510 | Loss: 0.0009295822589928 | Epoch: 71 | 
MeanAbsoluteError: 0.0176693070679903 | Loss: 0.0004967025934571 | Epoch: 72 | MeanAbsoluteError: 0.0339990705251694 | Loss: 0.0017141321257345 | Epoch: 73 | MeanAbsoluteError: 0.0315714031457901 | Loss: 0.0018004867903839 | Epoch: 74 | MeanAbsoluteError: 0.0179105363786221 | Loss: 0.0005143147657356 | Epoch: 75 | MeanAbsoluteError: 0.0275868345052004 | Loss: 0.0012686748155638 | Epoch: 76 | MeanAbsoluteError: 0.0211334414780140 | Loss: 0.0006984534204668 | Epoch: 77 | MeanAbsoluteError: 0.0182868856936693 | Loss: 0.0005476918871098 | Epoch: 78 | MeanAbsoluteError: 0.0207383465021849 | Loss: 0.0006842962466180 | Epoch: 79 | 
MeanAbsoluteError: 0.0478533096611500 | Loss: 0.0030803257648490 | Epoch: 80 | MeanAbsoluteError: 0.0320784784853458 | Loss: 0.0017769199943072 | Epoch: 81 | MeanAbsoluteError: 0.0363453440368176 | Loss: 0.0018587479380106 | Epoch: 82 | MeanAbsoluteError: 0.0244548264890909 | Loss: 0.0010893437720370 | Epoch: 83 | MeanAbsoluteError: 0.0259400010108948 | Loss: 0.0010890552136851 | Epoch: 84 | MeanAbsoluteError: 0.0381535589694977 | Loss: 0.0022181132838963 | Epoch: 85 | MeanAbsoluteError: 0.0406065732240677 | Loss: 0.0022110533594203 | Epoch: 86 | MeanAbsoluteError: 0.0446808449923992 | Loss: 0.0033921352832725 | Epoch: 87 | 
MeanAbsoluteError: 0.0433256067335606 | Loss: 0.0029973972858371 | Early stopping at epoch 86
Returned to Spot: Validation loss: 0.002997397285837092
spotPython tuning: 0.0019051794661208987 [##########] 95.54% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.40258745701192317, 'lr_mult': 1.1542120760836718, 'batch_size': 8, 'epochs': 8192, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adadelta', 'sgd_momentum': 0.0}
Epoch: 1 | MeanAbsoluteError: 0.1457615345716476 | Loss: 0.0316851790136609 | Epoch: 2 | MeanAbsoluteError: 0.1253353059291840 | Loss: 0.0247000646409824 | Epoch: 3 | MeanAbsoluteError: 0.1264829933643341 | Loss: 0.0253417301481884 | Epoch: 4 | 
MeanAbsoluteError: 0.1180199459195137 | Loss: 0.0217652010277992 | Epoch: 5 | MeanAbsoluteError: 0.1131462827324867 | Loss: 0.0206524082214424 | Epoch: 6 | MeanAbsoluteError: 0.1051789447665215 | Loss: 0.0187030956455457 | Epoch: 7 | MeanAbsoluteError: 0.1070660278201103 | Loss: 0.0189872326966571 | Epoch: 8 | 
MeanAbsoluteError: 0.0975124090909958 | Loss: 0.0150975822471082 | Epoch: 9 | MeanAbsoluteError: 0.0982413068413734 | Loss: 0.0153563828942807 | Epoch: 10 | MeanAbsoluteError: 0.1041371002793312 | Loss: 0.0165622010459437 | Epoch: 11 | MeanAbsoluteError: 0.1173929572105408 | Loss: 0.0198969566753428 | Epoch: 12 | 
MeanAbsoluteError: 0.1082867905497551 | Loss: 0.0183496474116845 | Epoch: 13 | MeanAbsoluteError: 0.0918010175228119 | Loss: 0.0130870818454576 | Epoch: 14 | MeanAbsoluteError: 0.0886270925402641 | Loss: 0.0122207612485478 | Epoch: 15 | MeanAbsoluteError: 0.1031743362545967 | Loss: 0.0165246317383686 | Epoch: 16 | 
MeanAbsoluteError: 0.0882811248302460 | Loss: 0.0120599025701124 | Epoch: 17 | MeanAbsoluteError: 0.0791379734873772 | Loss: 0.0107064451225788 | Epoch: 18 | MeanAbsoluteError: 0.0785517469048500 | Loss: 0.0108767806791308 | Epoch: 19 | MeanAbsoluteError: 0.0761403143405914 | Loss: 0.0098606975853296 | Epoch: 20 | 
MeanAbsoluteError: 0.0759699270129204 | Loss: 0.0095302697889948 | Epoch: 21 | MeanAbsoluteError: 0.0685718357563019 | Loss: 0.0083120428577163 | Epoch: 22 | MeanAbsoluteError: 0.0751651078462601 | Loss: 0.0093404341819941 | Epoch: 23 | MeanAbsoluteError: 0.0661839097738266 | Loss: 0.0076719018673573 | Epoch: 24 | 
MeanAbsoluteError: 0.0734331607818604 | Loss: 0.0089991156955397 | Epoch: 25 | MeanAbsoluteError: 0.0734720751643181 | Loss: 0.0088850671370318 | Epoch: 26 | MeanAbsoluteError: 0.0656242221593857 | Loss: 0.0071446104986152 | Epoch: 27 | MeanAbsoluteError: 0.0666397511959076 | Loss: 0.0079618639122744 | Epoch: 28 | 
MeanAbsoluteError: 0.0837053582072258 | Loss: 0.0108081284408016 | Epoch: 29 | MeanAbsoluteError: 0.0629019811749458 | Loss: 0.0070750680047480 | Epoch: 30 | MeanAbsoluteError: 0.0640324801206589 | Loss: 0.0067242983710266 | Epoch: 31 | MeanAbsoluteError: 0.0543489977717400 | Loss: 0.0057837287389894 | Epoch: 32 | 
MeanAbsoluteError: 0.0629967153072357 | Loss: 0.0065510760851842 | Epoch: 33 | MeanAbsoluteError: 0.0669367462396622 | Loss: 0.0069754033128878 | Epoch: 34 | MeanAbsoluteError: 0.0593128204345703 | Loss: 0.0056019758615692 | Epoch: 35 | MeanAbsoluteError: 0.0775573253631592 | Loss: 0.0088029446901361 | Epoch: 36 | 
MeanAbsoluteError: 0.0550632365047932 | Loss: 0.0050710470685245 | Epoch: 37 | MeanAbsoluteError: 0.0607802569866180 | Loss: 0.0066096674632526 | Epoch: 38 | MeanAbsoluteError: 0.0794601291418076 | Loss: 0.0091491223459965 | Epoch: 39 | MeanAbsoluteError: 0.0601389817893505 | Loss: 0.0059264827960808 | Epoch: 40 | 
MeanAbsoluteError: 0.0778352916240692 | Loss: 0.0095161951245054 | Epoch: 41 | MeanAbsoluteError: 0.0840401798486710 | Loss: 0.0106891830218956 | Epoch: 42 | MeanAbsoluteError: 0.0517758615314960 | Loss: 0.0044770039293278 | Epoch: 43 | MeanAbsoluteError: 0.0558196268975735 | Loss: 0.0055641511540958 | Epoch: 44 | 
MeanAbsoluteError: 0.0872868523001671 | Loss: 0.0109967203247116 | Epoch: 45 | MeanAbsoluteError: 0.0525735840201378 | Loss: 0.0043725856016145 | Epoch: 46 | MeanAbsoluteError: 0.0497734211385250 | Loss: 0.0043967736848189 | Epoch: 47 | MeanAbsoluteError: 0.0799828916788101 | Loss: 0.0086026039942609 | Epoch: 48 | 
MeanAbsoluteError: 0.0502716675400734 | Loss: 0.0042379662167820 | Epoch: 49 | MeanAbsoluteError: 0.0601295679807663 | Loss: 0.0055411738698910 | Epoch: 50 | MeanAbsoluteError: 0.0504750274121761 | Loss: 0.0043578770679520 | Epoch: 51 | MeanAbsoluteError: 0.0469220131635666 | Loss: 0.0044913201050612 | Epoch: 52 | 
MeanAbsoluteError: 0.0529604740440845 | Loss: 0.0046749152457587 | Epoch: 53 | MeanAbsoluteError: 0.0659995824098587 | Loss: 0.0068388767172828 | Epoch: 54 | MeanAbsoluteError: 0.0563468113541603 | Loss: 0.0055395954864492 | Epoch: 55 | MeanAbsoluteError: 0.0507864505052567 | Loss: 0.0041459505201170 | Epoch: 56 | 
MeanAbsoluteError: 0.0534272454679012 | Loss: 0.0052680392859896 | Epoch: 57 | MeanAbsoluteError: 0.0710095688700676 | Loss: 0.0071826088487318 | Epoch: 58 | MeanAbsoluteError: 0.0711101591587067 | Loss: 0.0077186298654660 | Epoch: 59 | MeanAbsoluteError: 0.0487131364643574 | Loss: 0.0040206358504580 | Epoch: 60 | 
MeanAbsoluteError: 0.0674524530768394 | Loss: 0.0063664982214840 | Epoch: 61 | MeanAbsoluteError: 0.0441754385828972 | Loss: 0.0036133152331642 | Epoch: 62 | MeanAbsoluteError: 0.0541563145816326 | Loss: 0.0051879870435713 | Epoch: 63 | MeanAbsoluteError: 0.0537017807364464 | Loss: 0.0044973482818980 | Epoch: 64 | 
MeanAbsoluteError: 0.0513370446860790 | Loss: 0.0039990437263010 | Epoch: 65 | MeanAbsoluteError: 0.0434232465922832 | Loss: 0.0031948269254491 | Epoch: 66 | MeanAbsoluteError: 0.0490526147186756 | Loss: 0.0041666041085448 | Epoch: 67 | MeanAbsoluteError: 0.0621708929538727 | Loss: 0.0058813973507648 | Epoch: 68 | 
MeanAbsoluteError: 0.0380812026560307 | Loss: 0.0036356954017384 | Epoch: 69 | MeanAbsoluteError: 0.0441140271723270 | Loss: 0.0034794991783871 | Epoch: 70 | MeanAbsoluteError: 0.0521772578358650 | Loss: 0.0049411355851733 | Epoch: 71 | MeanAbsoluteError: 0.0439712107181549 | Loss: 0.0032883784718395 | Epoch: 72 | 
MeanAbsoluteError: 0.0497409813106060 | Loss: 0.0048177462686956 | Epoch: 73 | MeanAbsoluteError: 0.0541338995099068 | Loss: 0.0049116047877377 | Epoch: 74 | MeanAbsoluteError: 0.0586596950888634 | Loss: 0.0055151313181819 | Epoch: 75 | MeanAbsoluteError: 0.0630569458007812 | Loss: 0.0058538521284630 | Epoch: 76 | 
MeanAbsoluteError: 0.0516748987138271 | Loss: 0.0041778693527081 | Epoch: 77 | MeanAbsoluteError: 0.0412996076047421 | Loss: 0.0032147365257659 | Epoch: 78 | MeanAbsoluteError: 0.0534880273044109 | Loss: 0.0045620342318312 | Epoch: 79 | MeanAbsoluteError: 0.0483443960547447 | Loss: 0.0041747514716055 | Epoch: 80 | 
MeanAbsoluteError: 0.0489515587687492 | Loss: 0.0041652214292155 | Epoch: 81 | MeanAbsoluteError: 0.0640793442726135 | Loss: 0.0061230446751180 | Epoch: 82 | MeanAbsoluteError: 0.0651302188634872 | Loss: 0.0061005269066970 | Epoch: 83 | MeanAbsoluteError: 0.0503777265548706 | Loss: 0.0044412669713462 | Epoch: 84 | 
MeanAbsoluteError: 0.0439477451145649 | Loss: 0.0034310674232792 | Epoch: 85 | MeanAbsoluteError: 0.0519327372312546 | Loss: 0.0047843732900219 | Epoch: 86 | MeanAbsoluteError: 0.0463242679834366 | Loss: 0.0035026184908163 | Epoch: 87 | MeanAbsoluteError: 0.0416743829846382 | Loss: 0.0028900156581872 | Epoch: 88 | 
MeanAbsoluteError: 0.0472563840448856 | Loss: 0.0043921598668308 | Epoch: 89 | MeanAbsoluteError: 0.0497908927500248 | Loss: 0.0043609434996094 | Epoch: 90 | MeanAbsoluteError: 0.0416219793260098 | Loss: 0.0030666432790703 | Epoch: 91 | MeanAbsoluteError: 0.0473648309707642 | Loss: 0.0038652954022645 | Epoch: 92 | 
MeanAbsoluteError: 0.0363839976489544 | Loss: 0.0024379455043297 | Epoch: 93 | MeanAbsoluteError: 0.0618337392807007 | Loss: 0.0057804030948319 | Epoch: 94 | MeanAbsoluteError: 0.0558093450963497 | Loss: 0.0047082584933378 | Epoch: 95 | MeanAbsoluteError: 0.0546224527060986 | Loss: 0.0045980919155562 | Epoch: 96 | 
MeanAbsoluteError: 0.0600742325186729 | Loss: 0.0057227910361498 | Epoch: 97 | MeanAbsoluteError: 0.0434171184897423 | Loss: 0.0036944174973637 | Epoch: 98 | MeanAbsoluteError: 0.0488132908940315 | Loss: 0.0043900264610880 | Epoch: 99 | MeanAbsoluteError: 0.0544731467962265 | Loss: 0.0049075702523911 | Epoch: 100 | 
MeanAbsoluteError: 0.0397574491798878 | Loss: 0.0029862880420344 | Epoch: 101 | MeanAbsoluteError: 0.0431756973266602 | Loss: 0.0031373765408429 | Epoch: 102 | MeanAbsoluteError: 0.0472720861434937 | Loss: 0.0043054712418540 | Epoch: 103 | MeanAbsoluteError: 0.0651825815439224 | Loss: 0.0063685755472091 | Epoch: 104 | 
MeanAbsoluteError: 0.0456732176244259 | Loss: 0.0033194041124692 | Epoch: 105 | MeanAbsoluteError: 0.0538361407816410 | Loss: 0.0041723460798446 | Epoch: 106 | MeanAbsoluteError: 0.0483741872012615 | Loss: 0.0043423762575625 | Epoch: 107 | MeanAbsoluteError: 0.0375005826354027 | Loss: 0.0025535945988897 | Epoch: 108 | 
MeanAbsoluteError: 0.0485747568309307 | Loss: 0.0037914685396429 | Epoch: 109 | MeanAbsoluteError: 0.0470775105059147 | Loss: 0.0041954210150595 | Epoch: 110 | MeanAbsoluteError: 0.0429639928042889 | Loss: 0.0034747882148766 | Epoch: 111 | MeanAbsoluteError: 0.0535848885774612 | Loss: 0.0045762524425395 | Epoch: 112 | 
MeanAbsoluteError: 0.0445241034030914 | Loss: 0.0035832815981274 | Epoch: 113 | MeanAbsoluteError: 0.0508418902754784 | Loss: 0.0045140545744768 | Epoch: 114 | MeanAbsoluteError: 0.0366192236542702 | Loss: 0.0027799400712339 | Epoch: 115 | MeanAbsoluteError: 0.0460703410208225 | Loss: 0.0035017808419836 | Epoch: 116 | 
MeanAbsoluteError: 0.0444956980645657 | Loss: 0.0037264035008296 | Epoch: 117 | MeanAbsoluteError: 0.0564117245376110 | Loss: 0.0050990405893811 | Epoch: 118 | MeanAbsoluteError: 0.0424948260188103 | Loss: 0.0033508955200791 | Epoch: 119 | MeanAbsoluteError: 0.0383610390126705 | Loss: 0.0026728743449846 | Epoch: 120 | 
MeanAbsoluteError: 0.0455981194972992 | Loss: 0.0038161021182436 | Epoch: 121 | MeanAbsoluteError: 0.0396690070629120 | Loss: 0.0033606389264797 | Epoch: 122 | MeanAbsoluteError: 0.0426466166973114 | Loss: 0.0034429296762315 | Epoch: 123 | MeanAbsoluteError: 0.0396508611738682 | Loss: 0.0033671011540144 | Epoch: 124 | 
MeanAbsoluteError: 0.0463694706559181 | Loss: 0.0035818290872205 | Epoch: 125 | MeanAbsoluteError: 0.0413978397846222 | Loss: 0.0028858518497528 | Epoch: 126 | MeanAbsoluteError: 0.0499507896602154 | Loss: 0.0044545636046678 | Epoch: 127 | MeanAbsoluteError: 0.0748868808150291 | Loss: 0.0076304938227526 | Epoch: 128 | 
MeanAbsoluteError: 0.0541429705917835 | Loss: 0.0052041930244549 | Epoch: 129 | MeanAbsoluteError: 0.0427209846675396 | Loss: 0.0032979556088226 | Epoch: 130 | MeanAbsoluteError: 0.0616357177495956 | Loss: 0.0058142877778185 | Epoch: 131 | MeanAbsoluteError: 0.0405024886131287 | Loss: 0.0030941555573679 | Epoch: 132 | 
MeanAbsoluteError: 0.0432367809116840 | Loss: 0.0036374265174872 | Epoch: 133 | MeanAbsoluteError: 0.0530366301536560 | Loss: 0.0040308269151290 | Epoch: 134 | MeanAbsoluteError: 0.0373763665556908 | Loss: 0.0028013924510512 | Epoch: 135 | MeanAbsoluteError: 0.0441406704485416 | Loss: 0.0039799081415894 | Epoch: 136 | 
MeanAbsoluteError: 0.0444756969809532 | Loss: 0.0036094232054893 | Epoch: 137 | MeanAbsoluteError: 0.0382555648684502 | Loss: 0.0027987290312395 | Epoch: 138 | MeanAbsoluteError: 0.0439352132380009 | Loss: 0.0032567294669877 | Epoch: 139 | MeanAbsoluteError: 0.0365946143865585 | Loss: 0.0026617730426982 | Epoch: 140 | 
MeanAbsoluteError: 0.0478513948619366 | Loss: 0.0036854212046723 | Epoch: 141 | MeanAbsoluteError: 0.0382731296122074 | Loss: 0.0027192238531394 | Epoch: 142 | MeanAbsoluteError: 0.0522352457046509 | Loss: 0.0050017955624131 | Epoch: 143 | MeanAbsoluteError: 0.0655769109725952 | Loss: 0.0068353336353443 | Epoch: 144 | 
MeanAbsoluteError: 0.0507311746478081 | Loss: 0.0042139694713497 | Epoch: 145 | MeanAbsoluteError: 0.0381352156400681 | Loss: 0.0027629153812182 | Epoch: 146 | MeanAbsoluteError: 0.0341974087059498 | Loss: 0.0023014957887905 | Epoch: 147 | MeanAbsoluteError: 0.0381050668656826 | Loss: 0.0030981251942361 | Epoch: 148 | 
MeanAbsoluteError: 0.0429463237524033 | Loss: 0.0032693948749894 | Epoch: 149 | MeanAbsoluteError: 0.0408112518489361 | Loss: 0.0033254966501294 | Epoch: 150 | MeanAbsoluteError: 0.0605819262564182 | Loss: 0.0053254407034010 | Epoch: 151 | MeanAbsoluteError: 0.0510649606585503 | Loss: 0.0045276107189956 | Epoch: 152 | 
MeanAbsoluteError: 0.0475301109254360 | Loss: 0.0041117749757464 | Epoch: 153 | MeanAbsoluteError: 0.0405471846461296 | Loss: 0.0029220775422322 | Epoch: 154 | MeanAbsoluteError: 0.0441485419869423 | Loss: 0.0030394009001228 | Epoch: 155 | MeanAbsoluteError: 0.0387841239571571 | Loss: 0.0028878541396759 | Epoch: 156 | 
MeanAbsoluteError: 0.0511848330497742 | Loss: 0.0046688189368548 | Epoch: 157 | MeanAbsoluteError: 0.0407604426145554 | Loss: 0.0027548873407987 | Epoch: 158 | MeanAbsoluteError: 0.0474117211997509 | Loss: 0.0041283060211419 | Epoch: 159 | MeanAbsoluteError: 0.0355576090514660 | Loss: 0.0026055788720872 | Epoch: 160 | 
MeanAbsoluteError: 0.0401887297630310 | Loss: 0.0033621476996862 | Epoch: 161 | MeanAbsoluteError: 0.0410211235284805 | Loss: 0.0029663128049211 | Epoch: 162 | MeanAbsoluteError: 0.0492808483541012 | Loss: 0.0043833853545182 | Epoch: 163 | MeanAbsoluteError: 0.0539791025221348 | Loss: 0.0054307285088151 | Epoch: 164 | 
MeanAbsoluteError: 0.0484345965087414 | Loss: 0.0035202251808522 | Epoch: 165 | MeanAbsoluteError: 0.0488404221832752 | Loss: 0.0037508315581363 | Epoch: 166 | MeanAbsoluteError: 0.0529283806681633 | Loss: 0.0046533746445723 | Epoch: 167 | MeanAbsoluteError: 0.0488353371620178 | Loss: 0.0041556369274315 | Epoch: 168 | 
MeanAbsoluteError: 0.0372331477701664 | Loss: 0.0026259780424880 | Epoch: 169 | MeanAbsoluteError: 0.0392632596194744 | Loss: 0.0026221392388260 | Epoch: 170 | MeanAbsoluteError: 0.0375594012439251 | Loss: 0.0025706640850618 | Epoch: 171 | MeanAbsoluteError: 0.0425305366516113 | Loss: 0.0030150260227904 | Epoch: 172 | 
MeanAbsoluteError: 0.0457133837044239 | Loss: 0.0041084609983955 | Epoch: 173 | MeanAbsoluteError: 0.0402535833418369 | Loss: 0.0032751290606316 | Epoch: 174 | MeanAbsoluteError: 0.0362287275493145 | Loss: 0.0026689092046581 | Epoch: 175 | MeanAbsoluteError: 0.0359207615256310 | Loss: 0.0025499502754476 | Epoch: 176 | 
MeanAbsoluteError: 0.0462026223540306 | Loss: 0.0037535484206226 | Epoch: 177 | MeanAbsoluteError: 0.0427092872560024 | Loss: 0.0036856348926545 | Epoch: 178 | MeanAbsoluteError: 0.0556990802288055 | Loss: 0.0047264510159087 | Epoch: 179 | MeanAbsoluteError: 0.0429524593055248 | Loss: 0.0032780058957685 | Epoch: 180 | 
MeanAbsoluteError: 0.0390552766621113 | Loss: 0.0027441334195349 | Epoch: 181 | MeanAbsoluteError: 0.0462540984153748 | Loss: 0.0039791295099636 | Epoch: 182 | MeanAbsoluteError: 0.0369781814515591 | Loss: 0.0026039753574878 | Epoch: 183 | MeanAbsoluteError: 0.0407433807849884 | Loss: 0.0029534012619957 | Epoch: 184 | 
MeanAbsoluteError: 0.0448577255010605 | Loss: 0.0035675410365098 | Epoch: 185 | MeanAbsoluteError: 0.0597855709493160 | Loss: 0.0053587039001286 | Epoch: 186 | MeanAbsoluteError: 0.0545175299048424 | Loss: 0.0047856750867428 | Epoch: 187 | MeanAbsoluteError: 0.0503588803112507 | Loss: 0.0039507346472850 | Epoch: 188 | 
MeanAbsoluteError: 0.0367363728582859 | Loss: 0.0025690276708797 | Epoch: 189 | MeanAbsoluteError: 0.0394543707370758 | Loss: 0.0031475453740170 | Epoch: 190 | MeanAbsoluteError: 0.0610848478972912 | Loss: 0.0054124081966859 | Epoch: 191 | MeanAbsoluteError: 0.0558290742337704 | Loss: 0.0046515046943616 | Epoch: 192 | 
MeanAbsoluteError: 0.0383168160915375 | Loss: 0.0029696583714165 | Epoch: 193 | MeanAbsoluteError: 0.0488446429371834 | Loss: 0.0038413188472317 | Epoch: 194 | MeanAbsoluteError: 0.0419653765857220 | Loss: 0.0031928842011104 | Epoch: 195 | MeanAbsoluteError: 0.0442921817302704 | Loss: 0.0035540611945754 | Epoch: 196 | 
MeanAbsoluteError: 0.0411214604973793 | Loss: 0.0032130320078546 | Epoch: 197 | MeanAbsoluteError: 0.0385981127619743 | Loss: 0.0028408446604245 | Epoch: 198 | MeanAbsoluteError: 0.0502631627023220 | Loss: 0.0039490576508749 | Epoch: 199 | MeanAbsoluteError: 0.0394138880074024 | Loss: 0.0031445134690761 | Epoch: 200 | 
MeanAbsoluteError: 0.0340324342250824 | Loss: 0.0023425644727755 | Epoch: 201 | MeanAbsoluteError: 0.0427715592086315 | Loss: 0.0029385180149754 | Epoch: 202 | MeanAbsoluteError: 0.0368716903030872 | Loss: 0.0027468722140551 | Epoch: 203 | MeanAbsoluteError: 0.0443419814109802 | Loss: 0.0033567734123943 | Epoch: 204 | 
MeanAbsoluteError: 0.0501890331506729 | Loss: 0.0039297287723074 | Epoch: 205 | MeanAbsoluteError: 0.0361526347696781 | Loss: 0.0032136958116577 | Epoch: 206 | MeanAbsoluteError: 0.0478320419788361 | Loss: 0.0033763273386285 | Epoch: 207 | MeanAbsoluteError: 0.0470534823834896 | Loss: 0.0036191223464955 | Epoch: 208 | 
MeanAbsoluteError: 0.0409456863999367 | Loss: 0.0031340437670128 | Epoch: 209 | MeanAbsoluteError: 0.0473450943827629 | Loss: 0.0036185815146095 | Epoch: 210 | MeanAbsoluteError: 0.0589663051068783 | Loss: 0.0051192725506170 | Early stopping at epoch 209
Returned to Spot: Validation loss: 0.005119272550617002
spotPython tuning: 0.0019051794661208987 [##########] 100.00% Done...
<spotPython.spot.spot.Spot at 0x165213d30>

19.9 Step 9: Tensorboard

The textual output shown in the console (or code cell) can be visualized with Tensorboard as described in Section 14.9, see also the description in the documentation: Tensorboard.

19.10 Step 10: Results

After the hyperparameter tuning run is finished, the results can be analyzed as described in Section 14.10.

spot_tuner.plot_progress(log_y=False,
    filename="./figures/" + experiment_name+"_progress.png")

Progress plot. Black dots denote results from the initial design. Red dots illustrate the improvement found by the surrogate model based optimization.
print(gen_design_table(fun_control=fun_control, spot=spot_tuner))
| name         | type   | default   |   lower |   upper |                tuned | transform             |   importance | stars   |
|--------------|--------|-----------|---------|---------|----------------------|-----------------------|--------------|---------|
| _L_in        | int    | 10        |    10.0 |    10.0 |                 10.0 | None                  |         0.00 |         |
| _L_out       | int    | 1         |     1.0 |     1.0 |                  1.0 | None                  |         0.00 |         |
| l1           | int    | 3         |     3.0 |     8.0 |                  5.0 | transform_power_2_int |         0.00 |         |
| dropout_prob | float  | 0.01      |     0.0 |     0.9 | 0.016321969877482245 | None                  |         0.05 |         |
| lr_mult      | float  | 1.0       |     0.1 |    10.0 |    9.255211113703332 | None                  |         0.00 |         |
| batch_size   | int    | 4         |     1.0 |     4.0 |                  4.0 | transform_power_2_int |         0.00 |         |
| epochs       | int    | 4         |     2.0 |    16.0 |                 14.0 | transform_power_2_int |         4.09 | *       |
| k_folds      | int    | 1         |     1.0 |     1.0 |                  1.0 | None                  |         0.00 |         |
| patience     | int    | 2         |     3.0 |     7.0 |                  5.0 | transform_power_2_int |         0.00 |         |
| optimizer    | factor | SGD       |     0.0 |     6.0 |                  0.0 | None                  |       100.00 | ***     |
| sgd_momentum | float  | 0.0       |     0.0 |     1.0 | 0.011654298200852786 | None                  |         0.00 |         |
spot_tuner.plot_importance(threshold=0.025,
    filename="./figures/" + experiment_name+"_importance.png")

Variable importance plot, threshold 0.025.

19.10.1 Get the Tuned Architecture (SPOT Results)

from spotPython.hyperparameters.values import get_one_core_model_from_X
X = spot_tuner.to_all_dim(spot_tuner.min_X.reshape(1,-1))
model_spot = get_one_core_model_from_X(X, fun_control)
model_spot
Net_lin_reg(
  (fc1): Linear(in_features=10, out_features=32, bias=True)
  (fc2): Linear(in_features=32, out_features=16, bias=True)
  (fc3): Linear(in_features=16, out_features=1, bias=True)
  (relu): ReLU()
  (softmax): Softmax(dim=1)
  (dropout1): Dropout(p=0.016321969877482245, inplace=False)
  (dropout2): Dropout(p=0.008160984938741123, inplace=False)
)

19.10.2 Evaluation of the Tuned Architecture

from spotPython.torch.traintest import (
    train_tuned,
    test_tuned,
    )
train_tuned(net=model_spot, train_dataset=train,
        loss_function=fun_control["loss_function"],
        metric=fun_control["metric_torch"],
        shuffle=True,
        device = fun_control["device"],
        path=None,
        task=fun_control["task"],)
Epoch: 1 | MeanAbsoluteError: 0.1228210031986237 | Loss: 0.0249800669323457 | Epoch: 2 | MeanAbsoluteError: 0.2048833668231964 | Loss: 0.0579266599134395 | Epoch: 3 | MeanAbsoluteError: 0.1540751159191132 | Loss: 0.0348089474596475 | Epoch: 4 | MeanAbsoluteError: 0.1494647264480591 | Loss: 0.0336229610992105 | Epoch: 5 | MeanAbsoluteError: 0.1471123844385147 | Loss: 0.0314887439537989 | Epoch: 6 | MeanAbsoluteError: 0.2679280638694763 | Loss: 0.0836654346632330 | Epoch: 7 | MeanAbsoluteError: 0.2223915159702301 | Loss: 0.0630003794243461 | Epoch: 8 | 
MeanAbsoluteError: 0.1675338298082352 | Loss: 0.0371561008260438 | Epoch: 9 | MeanAbsoluteError: 0.0923310294747353 | Loss: 0.0138416172887542 | Epoch: 10 | MeanAbsoluteError: 0.1432806998491287 | Loss: 0.0289106791054732 | Epoch: 11 | MeanAbsoluteError: 0.1746126264333725 | Loss: 0.0372636041751033 | Epoch: 12 | MeanAbsoluteError: 0.1794256120920181 | Loss: 0.0368467467395883 | Epoch: 13 | MeanAbsoluteError: 0.0677431151270866 | Loss: 0.0079014038078879 | Epoch: 14 | MeanAbsoluteError: 0.1662124395370483 | Loss: 0.0320383625987329 | Epoch: 15 | 
MeanAbsoluteError: 0.0536298416554928 | Loss: 0.0062325877921754 | Epoch: 16 | MeanAbsoluteError: 0.1160425543785095 | Loss: 0.0175660818717197 | Epoch: 17 | MeanAbsoluteError: 0.1010939925909042 | Loss: 0.0141792114039785 | Epoch: 18 | MeanAbsoluteError: 0.0796459838747978 | Loss: 0.0096734277904034 | Epoch: 19 | MeanAbsoluteError: 0.0874833539128304 | Loss: 0.0106019134584226 | Epoch: 20 | MeanAbsoluteError: 0.1035742685198784 | Loss: 0.0143239790279614 | Epoch: 21 | MeanAbsoluteError: 0.1010925844311714 | Loss: 0.0142230112840863 | Epoch: 22 | MeanAbsoluteError: 0.2165593951940536 | Loss: 0.0499531436515482 | Epoch: 23 | 
MeanAbsoluteError: 0.1474176943302155 | Loss: 0.0236275305873469 | Epoch: 24 | MeanAbsoluteError: 0.1325393468141556 | Loss: 0.0215577751300053 | Epoch: 25 | MeanAbsoluteError: 0.1588282287120819 | Loss: 0.0266094022479497 | Epoch: 26 | MeanAbsoluteError: 0.1357726007699966 | Loss: 0.0237428757215017 | Epoch: 27 | MeanAbsoluteError: 0.0436173230409622 | Loss: 0.0027346874397297 | Epoch: 28 | MeanAbsoluteError: 0.0558080226182938 | Loss: 0.0059208871527134 | Epoch: 29 | MeanAbsoluteError: 0.0591724403202534 | Loss: 0.0053334404150710 | Epoch: 30 | MeanAbsoluteError: 0.0402873978018761 | Loss: 0.0025083953759780 | Epoch: 31 | 
MeanAbsoluteError: 0.0469940267503262 | Loss: 0.0034776305056814 | Epoch: 32 | MeanAbsoluteError: 0.0377871319651604 | Loss: 0.0024770030041078 | Epoch: 33 | MeanAbsoluteError: 0.0691657289862633 | Loss: 0.0080504717342065 | Epoch: 34 | MeanAbsoluteError: 0.0874920338392258 | Loss: 0.0104222605985246 | Epoch: 35 | MeanAbsoluteError: 0.1100754439830780 | Loss: 0.0140273704340583 | Epoch: 36 | MeanAbsoluteError: 0.0972262173891068 | Loss: 0.0123841371877413 | Epoch: 37 | MeanAbsoluteError: 0.1131228655576706 | Loss: 0.0155937258938425 | Epoch: 38 | MeanAbsoluteError: 0.1354155838489532 | Loss: 0.0226774443137018 | Epoch: 39 | 
MeanAbsoluteError: 0.1547552794218063 | Loss: 0.0254233894183447 | Epoch: 40 | MeanAbsoluteError: 0.0606942288577557 | Loss: 0.0064222687046583 | Epoch: 41 | MeanAbsoluteError: 0.0817094370722771 | Loss: 0.0098827015363464 | Epoch: 42 | MeanAbsoluteError: 0.1202026754617691 | Loss: 0.0185174924370490 | Epoch: 43 | MeanAbsoluteError: 0.1130082607269287 | Loss: 0.0157019775850992 | Epoch: 44 | MeanAbsoluteError: 0.0644983872771263 | Loss: 0.0053391523389636 | Epoch: 45 | MeanAbsoluteError: 0.0305481869727373 | Loss: 0.0018043331556806 | Epoch: 46 | 
MeanAbsoluteError: 0.1140363290905952 | Loss: 0.0137683425686861 | Epoch: 47 | MeanAbsoluteError: 0.0533673278987408 | Loss: 0.0045091890190777 | Epoch: 48 | MeanAbsoluteError: 0.0329921245574951 | Loss: 0.0024041491667863 | Epoch: 49 | MeanAbsoluteError: 0.1664683520793915 | Loss: 0.0288264993578196 | Epoch: 50 | MeanAbsoluteError: 0.0506798662245274 | Loss: 0.0034269519383088 | Epoch: 51 | MeanAbsoluteError: 0.0522550344467163 | Loss: 0.0042115314067096 | Epoch: 52 | MeanAbsoluteError: 0.0996059477329254 | Loss: 0.0110274465068390 | Epoch: 53 | 
MeanAbsoluteError: 0.0361773036420345 | Loss: 0.0020569795742631 | Epoch: 54 | MeanAbsoluteError: 0.0204748753458261 | Loss: 0.0008917921567397 | Epoch: 55 | MeanAbsoluteError: 0.0673630088567734 | Loss: 0.0055738329201152 | Epoch: 56 | MeanAbsoluteError: 0.0990840345621109 | Loss: 0.0113220579530063 | Epoch: 57 | MeanAbsoluteError: 0.0975744798779488 | Loss: 0.0101872939910544 | Epoch: 58 | MeanAbsoluteError: 0.0540472045540810 | Loss: 0.0042437232025948 | Epoch: 59 | MeanAbsoluteError: 0.1495234519243240 | Loss: 0.0230513986592230 | Epoch: 60 | MeanAbsoluteError: 0.2088542133569717 | Loss: 0.0451038750378709 | Epoch: 61 | 
MeanAbsoluteError: 0.0235077179968357 | Loss: 0.0009144715303065 | Epoch: 62 | MeanAbsoluteError: 0.0803198516368866 | Loss: 0.0089929893024658 | Epoch: 63 | MeanAbsoluteError: 0.0854578763246536 | Loss: 0.0081957462243736 | Epoch: 64 | MeanAbsoluteError: 0.0525367222726345 | Loss: 0.0031203637512303 | Epoch: 65 | MeanAbsoluteError: 0.0282249804586172 | Loss: 0.0013511754069967 | Epoch: 66 | MeanAbsoluteError: 0.0605622418224812 | Loss: 0.0050018208444511 | Epoch: 67 | MeanAbsoluteError: 0.0824246332049370 | Loss: 0.0091842133306751 | Epoch: 68 | MeanAbsoluteError: 0.0584852546453476 | Loss: 0.0062446676035363 | Epoch: 69 | 
MeanAbsoluteError: 0.0613987147808075 | Loss: 0.0057366846227332 | Epoch: 70 | MeanAbsoluteError: 0.0752706006169319 | Loss: 0.0087214171837427 | Epoch: 71 | MeanAbsoluteError: 0.1094988882541656 | Loss: 0.0128697534827025 | Epoch: 72 | MeanAbsoluteError: 0.1361784785985947 | Loss: 0.0209620561156618 | Epoch: 73 | MeanAbsoluteError: 0.0654002800583839 | Loss: 0.0048367563071416 | Epoch: 74 | MeanAbsoluteError: 0.0422039255499840 | Loss: 0.0027860053324778 | Epoch: 75 | MeanAbsoluteError: 0.0245385877788067 | Loss: 0.0010519044008106 | Epoch: 76 | MeanAbsoluteError: 0.0650502443313599 | Loss: 0.0048093413198857 | Epoch: 77 | 
MeanAbsoluteError: 0.0456248745322227 | Loss: 0.0031965215763959 | Epoch: 78 | MeanAbsoluteError: 0.0888774842023849 | Loss: 0.0093825620255972 | Epoch: 79 | MeanAbsoluteError: 0.0232277140021324 | Loss: 0.0011864620089335 | Epoch: 80 | MeanAbsoluteError: 0.0670452490448952 | Loss: 0.0072632379535782 | Epoch: 81 | MeanAbsoluteError: 0.0258350428193808 | Loss: 0.0013792156486919 | Epoch: 82 | MeanAbsoluteError: 0.0267658866941929 | Loss: 0.0019803264815556 | Epoch: 83 | MeanAbsoluteError: 0.0461977459490299 | Loss: 0.0026185487911693 | Epoch: 84 | 
MeanAbsoluteError: 0.0474072284996510 | Loss: 0.0036778828729630 | Epoch: 85 | MeanAbsoluteError: 0.0163026954978704 | Loss: 0.0008908310027389 | Epoch: 86 | MeanAbsoluteError: 0.0865502431988716 | Loss: 0.0088483204476927 | Epoch: 87 | MeanAbsoluteError: 0.1548325270414352 | Loss: 0.0293912957177350 | Epoch: 88 | MeanAbsoluteError: 0.0420265942811966 | Loss: 0.0027086467077760 | Epoch: 89 | MeanAbsoluteError: 0.0754835829138756 | Loss: 0.0062399111492069 | Epoch: 90 | MeanAbsoluteError: 0.0600319877266884 | Loss: 0.0042323558958934 | Epoch: 91 | 
MeanAbsoluteError: 0.0499612614512444 | Loss: 0.0034402919700369 | Epoch: 92 | MeanAbsoluteError: 0.0304281748831272 | Loss: 0.0013439952193661 | Epoch: 93 | MeanAbsoluteError: 0.0274479705840349 | Loss: 0.0014060674783602 | Epoch: 94 | MeanAbsoluteError: 0.0665187090635300 | Loss: 0.0059245328394402 | Epoch: 95 | MeanAbsoluteError: 0.0226875394582748 | Loss: 0.0009058048293044 | Epoch: 96 | MeanAbsoluteError: 0.1047990992665291 | Loss: 0.0146164132380172 | Epoch: 97 | MeanAbsoluteError: 0.0734800919890404 | Loss: 0.0082364177429362 | Epoch: 98 | 
MeanAbsoluteError: 0.0796138495206833 | Loss: 0.0078486716374755 | Epoch: 99 | MeanAbsoluteError: 0.0289009343832731 | Loss: 0.0016815824676183 | Epoch: 100 | MeanAbsoluteError: 0.0200148448348045 | Loss: 0.0008902959433678 | Epoch: 101 | MeanAbsoluteError: 0.0871943160891533 | Loss: 0.0080805878449035 | Epoch: 102 | MeanAbsoluteError: 0.0669211521744728 | Loss: 0.0053518831141685 | Epoch: 103 | MeanAbsoluteError: 0.0408508665859699 | Loss: 0.0022408883822592 | Epoch: 104 | MeanAbsoluteError: 0.0513534657657146 | Loss: 0.0044091329787319 | Epoch: 105 | 
MeanAbsoluteError: 0.0752272382378578 | Loss: 0.0062571619392226 | Epoch: 106 | MeanAbsoluteError: 0.0377577207982540 | Loss: 0.0022244579893978 | Epoch: 107 | MeanAbsoluteError: 0.0249043162912130 | Loss: 0.0014026280320985 | Epoch: 108 | MeanAbsoluteError: 0.1482050865888596 | Loss: 0.0239591660272134 | Epoch: 109 | MeanAbsoluteError: 0.0378493852913380 | Loss: 0.0023473650554048 | Epoch: 110 | MeanAbsoluteError: 0.0496266484260559 | Loss: 0.0033126344757253 | Epoch: 111 | MeanAbsoluteError: 0.0711233392357826 | Loss: 0.0082444214678713 | Epoch: 112 | MeanAbsoluteError: 0.0231266114860773 | Loss: 0.0014916522073020 | Epoch: 113 | 
MeanAbsoluteError: 0.0206630602478981 | Loss: 0.0008781200051185 | Epoch: 114 | MeanAbsoluteError: 0.0584564730525017 | Loss: 0.0042506725968499 | Epoch: 115 | MeanAbsoluteError: 0.0365404523909092 | Loss: 0.0019092024610329 | Epoch: 116 | MeanAbsoluteError: 0.0836406648159027 | Loss: 0.0077462881117275 | Epoch: 117 | MeanAbsoluteError: 0.0172175914049149 | Loss: 0.0006533822130510 | Epoch: 118 | MeanAbsoluteError: 0.0500961057841778 | Loss: 0.0030881525813847 | Epoch: 119 | MeanAbsoluteError: 0.0979868099093437 | Loss: 0.0102534495098026 | Epoch: 120 | 
MeanAbsoluteError: 0.0236991923302412 | Loss: 0.0014725122462934 | Epoch: 121 | MeanAbsoluteError: 0.0398876257240772 | Loss: 0.0026061033254097 | Epoch: 122 | MeanAbsoluteError: 0.0320366621017456 | Loss: 0.0017750293451459 | Epoch: 123 | MeanAbsoluteError: 0.0166336316615343 | Loss: 0.0006932136771196 | Epoch: 124 | MeanAbsoluteError: 0.0854913964867592 | Loss: 0.0076035809654154 | Epoch: 125 | MeanAbsoluteError: 0.0220942404121161 | Loss: 0.0007857640999933 | Epoch: 126 | MeanAbsoluteError: 0.0832551643252373 | Loss: 0.0077254017079739 | Epoch: 127 | 
MeanAbsoluteError: 0.0388975217938423 | Loss: 0.0017754441421283 | Epoch: 128 | MeanAbsoluteError: 0.0115353139117360 | Loss: 0.0003291275155023 | Epoch: 129 | MeanAbsoluteError: 0.0195532534271479 | Loss: 0.0008946099551395 | Epoch: 130 | MeanAbsoluteError: 0.1114673987030983 | Loss: 0.0130549786416324 | Epoch: 131 | MeanAbsoluteError: 0.0763561949133873 | Loss: 0.0064787778905348 | Epoch: 132 | MeanAbsoluteError: 0.1575443148612976 | Loss: 0.0254815435527187 | Epoch: 133 | MeanAbsoluteError: 0.0366000719368458 | Loss: 0.0019862616655270 | Epoch: 134 | MeanAbsoluteError: 0.0231486242264509 | Loss: 0.0010220811558324 | Epoch: 135 | 
MeanAbsoluteError: 0.0394649505615234 | Loss: 0.0025637700393992 | Epoch: 136 | MeanAbsoluteError: 0.1041802689433098 | Loss: 0.0123427566631060 | Epoch: 137 | MeanAbsoluteError: 0.0514943525195122 | Loss: 0.0037323270287169 | Epoch: 138 | MeanAbsoluteError: 0.0159714929759502 | Loss: 0.0005745019880123 | Epoch: 139 | MeanAbsoluteError: 0.1022333800792694 | Loss: 0.0106826174612108 | Epoch: 140 | MeanAbsoluteError: 0.0343810096383095 | Loss: 0.0015911694560935 | Epoch: 141 | MeanAbsoluteError: 0.0179342664778233 | Loss: 0.0009313961965841 | Epoch: 142 | MeanAbsoluteError: 0.0654406324028969 | Loss: 0.0066776898763094 | Epoch: 143 | 
MeanAbsoluteError: 0.0585271269083023 | Loss: 0.0040942783540997 | Epoch: 144 | MeanAbsoluteError: 0.0457018576562405 | Loss: 0.0031798895521972 | Epoch: 145 | MeanAbsoluteError: 0.1777454614639282 | Loss: 0.0326477687217687 | Epoch: 146 | MeanAbsoluteError: 0.0296531934291124 | Loss: 0.0017652351127349 | Epoch: 147 | MeanAbsoluteError: 0.0817768573760986 | Loss: 0.0073138115878560 | Epoch: 148 | MeanAbsoluteError: 0.0461126789450645 | Loss: 0.0024565531455569 | Epoch: 149 | MeanAbsoluteError: 0.0288111455738544 | Loss: 0.0019960218633059 | Epoch: 150 | 
MeanAbsoluteError: 0.0806537270545959 | Loss: 0.0069310175451009 | Epoch: 151 | MeanAbsoluteError: 0.1057984977960587 | Loss: 0.0151034479862765 | Epoch: 152 | MeanAbsoluteError: 0.0519763007760048 | Loss: 0.0033751922463508 | Epoch: 153 | MeanAbsoluteError: 0.0504338480532169 | Loss: 0.0030493225755268 | Epoch: 154 | MeanAbsoluteError: 0.1045179143548012 | Loss: 0.0130372699350119 | Epoch: 155 | MeanAbsoluteError: 0.0311901532113552 | Loss: 0.0012275995441565 | Epoch: 156 | MeanAbsoluteError: 0.0738343745470047 | Loss: 0.0064001857107015 | Epoch: 157 | 
MeanAbsoluteError: 0.0249321646988392 | Loss: 0.0008796308431652 | Epoch: 158 | MeanAbsoluteError: 0.0622901283204556 | Loss: 0.0049236082888551 | Epoch: 159 | MeanAbsoluteError: 0.0431338697671890 | Loss: 0.0036183339053471 | Epoch: 160 | MeanAbsoluteError: 0.0233542136847973 | Loss: 0.0009125908928629 | Early stopping at epoch 159
Returned to Spot: Validation loss: 0.0009125908928629207

If path is set to a filename, e.g., path = "model_spot_trained.pt", the weights of the trained model will be loaded from this file.

test_tuned(net=model_spot, test_dataset=test,
            shuffle=False,
            loss_function=fun_control["loss_function"],
            metric=fun_control["metric_torch"],
            device = fun_control["device"],
            task=fun_control["task"],)
MeanAbsoluteError: 0.0238810442388058 | Loss: 0.0011113633627247 | Final evaluation: Validation loss: 0.00111136336272466
Final evaluation: Validation metric: 0.02388104423880577
----------------------------------------------
(0.00111136336272466, nan, tensor(0.0239))

19.10.3 Cross-validated Evaluations

  • This is the evaluation that will be used in the comparison (evaluatecv has to be updated before, to get metric vlaues!):
from spotPython.torch.traintest import evaluate_cv
# modify k-kolds:
setattr(model_spot, "k_folds",  10)
df_eval, df_preds, df_metrics = evaluate_cv(net=model_spot,
            dataset=fun_control["data"],
            loss_function=fun_control["loss_function"],
            metric=fun_control["metric_torch"],
            task=fun_control["task"],
            writer=fun_control["writer"],
            writerId="model_spot_cv",
            device = fun_control["device"])
Fold: 1
Epoch: 1 | MeanAbsoluteError: 0.1639380455017090 | Loss: 0.0383810627141169 | Epoch: 2 | 
MeanAbsoluteError: 0.1896855980157852 | Loss: 0.0460876857063600 | Epoch: 3 | MeanAbsoluteError: 0.0959102138876915 | Loss: 0.0134818430191704 | Epoch: 4 | 
MeanAbsoluteError: 0.1328311860561371 | Loss: 0.0321080205695970 | Epoch: 5 | MeanAbsoluteError: 0.0765577107667923 | Loss: 0.0102910015599004 | Epoch: 6 | MeanAbsoluteError: 0.1558836102485657 | Loss: 0.0323308462144009 | Epoch: 7 | 
MeanAbsoluteError: 0.0745026320219040 | Loss: 0.0075681930008743 | Epoch: 8 | MeanAbsoluteError: 0.1273531615734100 | Loss: 0.0199969812695469 | Epoch: 9 | 
MeanAbsoluteError: 0.2215844690799713 | Loss: 0.0534633046814374 | Epoch: 10 | MeanAbsoluteError: 0.1262143254280090 | Loss: 0.0184372091399772 | Epoch: 11 | MeanAbsoluteError: 0.1456737071275711 | Loss: 0.0240369976631233 | Epoch: 12 | 
MeanAbsoluteError: 0.0559144876897335 | Loss: 0.0043070348578372 | Epoch: 13 | MeanAbsoluteError: 0.0624247267842293 | Loss: 0.0053239346619063 | 
Epoch: 14 | MeanAbsoluteError: 0.0888672992587090 | Loss: 0.0107860650335039 | Epoch: 15 | MeanAbsoluteError: 0.1394520103931427 | Loss: 0.0234407324876104 | Epoch: 16 | MeanAbsoluteError: 0.0898064821958542 | Loss: 0.0100551056010383 | Epoch: 17 | 
MeanAbsoluteError: 0.0982708707451820 | Loss: 0.0118285387621394 | Epoch: 18 | 
MeanAbsoluteError: 0.0471362210810184 | Loss: 0.0039620104466199 | Epoch: 19 | MeanAbsoluteError: 0.0757007673382759 | Loss: 0.0075099409358310 | Epoch: 20 | MeanAbsoluteError: 0.0778095349669456 | Loss: 0.0076206130906940 | Epoch: 21 | MeanAbsoluteError: 0.0448933392763138 | Loss: 0.0035525774001144 | 
Epoch: 22 | 
MeanAbsoluteError: 0.0766964405775070 | Loss: 0.0106060472982270 | Epoch: 23 | MeanAbsoluteError: 0.0905143246054649 | Loss: 0.0093351819419435 | Epoch: 24 | MeanAbsoluteError: 0.1271442025899887 | Loss: 0.0165522532271487 | Epoch: 25 | 
MeanAbsoluteError: 0.1066830083727837 | Loss: 0.0121827760179128 | Epoch: 26 | MeanAbsoluteError: 0.0685176551342010 | Loss: 0.0068983591294714 | 
Epoch: 27 | MeanAbsoluteError: 0.0459498055279255 | Loss: 0.0029678343396102 | Epoch: 28 | MeanAbsoluteError: 0.0583950169384480 | Loss: 0.0041835690416130 | Epoch: 29 | MeanAbsoluteError: 0.0573542155325413 | Loss: 0.0052452652182962 | Epoch: 30 | 
MeanAbsoluteError: 0.0732017979025841 | Loss: 0.0058417521151049 | Epoch: 31 | MeanAbsoluteError: 0.0910307243466377 | Loss: 0.0134362149983644 | Epoch: 32 | MeanAbsoluteError: 0.0647429153323174 | Loss: 0.0064194343119328 | Epoch: 33 | MeanAbsoluteError: 0.0822119414806366 | Loss: 0.0073036999840822 | Epoch: 34 | MeanAbsoluteError: 0.0734994933009148 | Loss: 0.0066123896810625 | 
Epoch: 35 | MeanAbsoluteError: 0.0230256132781506 | Loss: 0.0011945289859016 | Epoch: 36 | MeanAbsoluteError: 0.0642928853631020 | Loss: 0.0062549782783857 | Epoch: 37 | MeanAbsoluteError: 0.0449990145862103 | Loss: 0.0040326854546687 | Epoch: 38 | MeanAbsoluteError: 0.0409352220594883 | Loss: 0.0026249386303659 | Epoch: 39 | 
MeanAbsoluteError: 0.0553821511566639 | Loss: 0.0040315819704639 | Epoch: 40 | MeanAbsoluteError: 0.1345637738704681 | Loss: 0.0184051830853735 | Epoch: 41 | MeanAbsoluteError: 0.1189324185252190 | Loss: 0.0153094688430429 | Epoch: 42 | MeanAbsoluteError: 0.0336098149418831 | Loss: 0.0021560080266292 | Epoch: 43 | 
MeanAbsoluteError: 0.0626665130257607 | Loss: 0.0039937658168908 | Epoch: 44 | MeanAbsoluteError: 0.0624879226088524 | Loss: 0.0044428840545671 | Epoch: 45 | MeanAbsoluteError: 0.0784915462136269 | Loss: 0.0068709945439228 | Epoch: 46 | MeanAbsoluteError: 0.0830538570880890 | Loss: 0.0079131131060421 | Epoch: 47 | 
MeanAbsoluteError: 0.0380831509828568 | Loss: 0.0027840612622510 | Epoch: 48 | MeanAbsoluteError: 0.0780995562672615 | Loss: 0.0067690113625888 | Epoch: 49 | MeanAbsoluteError: 0.1022113859653473 | Loss: 0.0107995308935642 | Epoch: 50 | MeanAbsoluteError: 0.0437547639012337 | Loss: 0.0022831648654704 | Epoch: 51 | MeanAbsoluteError: 0.0738013833761215 | Loss: 0.0067974515924496 | 
Epoch: 52 | MeanAbsoluteError: 0.0276934616267681 | Loss: 0.0011583183243472 | Epoch: 53 | MeanAbsoluteError: 0.0919276773929596 | Loss: 0.0087205820849964 | Epoch: 54 | MeanAbsoluteError: 0.1133049204945564 | Loss: 0.0134667569239225 | Epoch: 55 | MeanAbsoluteError: 0.0672328397631645 | Loss: 0.0057490262801626 | 
Epoch: 56 | MeanAbsoluteError: 0.0393415503203869 | Loss: 0.0018396241856473 | Epoch: 57 | MeanAbsoluteError: 0.0604932866990566 | Loss: 0.0048223730575825 | Epoch: 58 | MeanAbsoluteError: 0.0558274351060390 | Loss: 0.0045833878019559 | Epoch: 59 | MeanAbsoluteError: 0.0504993535578251 | Loss: 0.0041262624519212 | Epoch: 60 | 
MeanAbsoluteError: 0.0560078769922256 | Loss: 0.0036488131154329 | Epoch: 61 | MeanAbsoluteError: 0.0319458208978176 | Loss: 0.0015597354254818 | Epoch: 62 | MeanAbsoluteError: 0.0415436998009682 | Loss: 0.0024162998223411 | Epoch: 63 | MeanAbsoluteError: 0.0428018048405647 | Loss: 0.0028744858490037 | Epoch: 64 | 
MeanAbsoluteError: 0.1037869527935982 | Loss: 0.0116341751334923 | Epoch: 65 | MeanAbsoluteError: 0.0499168597161770 | Loss: 0.0037261404629265 | Epoch: 66 | MeanAbsoluteError: 0.0478531643748283 | Loss: 0.0027480394845562 | Epoch: 67 | MeanAbsoluteError: 0.0529257506132126 | Loss: 0.0028528287075460 | Epoch: 68 | 
MeanAbsoluteError: 0.0643732398748398 | Loss: 0.0078734804077872 | Epoch: 69 | MeanAbsoluteError: 0.0298072639852762 | Loss: 0.0015739006589034 | Epoch: 70 | MeanAbsoluteError: 0.0362419076263905 | Loss: 0.0015592341909983 | Epoch: 71 | MeanAbsoluteError: 0.0390390977263451 | Loss: 0.0016517633339390 | Epoch: 72 | MeanAbsoluteError: 0.0537669844925404 | Loss: 0.0038281985824662 | 
Epoch: 73 | MeanAbsoluteError: 0.0722669214010239 | Loss: 0.0063117763825825 | Epoch: 74 | MeanAbsoluteError: 0.0899439081549644 | Loss: 0.0091159757492798 | Epoch: 75 | MeanAbsoluteError: 0.0206840708851814 | Loss: 0.0035494724704352 | Epoch: 76 | MeanAbsoluteError: 0.0140842162072659 | Loss: 0.0002817231860328 | Epoch: 77 | 
MeanAbsoluteError: 0.0639370456337929 | Loss: 0.0051639546374125 | Epoch: 78 | MeanAbsoluteError: 0.0367769189178944 | Loss: 0.0021675693237090 | Epoch: 79 | MeanAbsoluteError: 0.0559168681502342 | Loss: 0.0045204488560557 | Epoch: 80 | MeanAbsoluteError: 0.0927157029509544 | Loss: 0.0089377481490374 | Epoch: 81 | MeanAbsoluteError: 0.0574546754360199 | Loss: 0.0041762000016336 | 
Epoch: 82 | MeanAbsoluteError: 0.0414165407419205 | Loss: 0.0028828477121091 | Epoch: 83 | MeanAbsoluteError: 0.0107702519744635 | Loss: 0.0001595701526510 | Epoch: 84 | MeanAbsoluteError: 0.0481805317103863 | Loss: 0.0030284054643874 | Epoch: 85 | MeanAbsoluteError: 0.0766060203313828 | Loss: 0.0072592713737062 | 
Epoch: 86 | MeanAbsoluteError: 0.0534164533019066 | Loss: 0.0029491969118161 | Epoch: 87 | MeanAbsoluteError: 0.0650746002793312 | Loss: 0.0056604128996176 | Epoch: 88 | MeanAbsoluteError: 0.0720181465148926 | Loss: 0.0063307556722845 | Epoch: 89 | MeanAbsoluteError: 0.0230834707617760 | Loss: 0.0007373461350133 | 
Epoch: 90 | MeanAbsoluteError: 0.0824597626924515 | Loss: 0.0074388661554882 | Epoch: 91 | MeanAbsoluteError: 0.0625715255737305 | Loss: 0.0041088277607092 | Epoch: 92 | MeanAbsoluteError: 0.0179887507110834 | Loss: 0.0004655809981549 | Epoch: 93 | 
MeanAbsoluteError: 0.0321525558829308 | Loss: 0.0013675787652444 | Epoch: 94 | MeanAbsoluteError: 0.0683361515402794 | Loss: 0.0062017398221152 | Epoch: 95 | MeanAbsoluteError: 0.0410179346799850 | Loss: 0.0019674421221550 | Epoch: 96 | MeanAbsoluteError: 0.0665729790925980 | Loss: 0.0057961171759026 | Epoch: 97 | MeanAbsoluteError: 0.0202053282409906 | Loss: 0.0005636273251314 | 
Epoch: 98 | MeanAbsoluteError: 0.0819959715008736 | Loss: 0.0080946698518736 | Epoch: 99 | MeanAbsoluteError: 0.0668658241629601 | Loss: 0.0054065897129476 | Epoch: 100 | MeanAbsoluteError: 0.0577596127986908 | Loss: 0.0041050414687821 | Epoch: 101 | MeanAbsoluteError: 0.0193766281008720 | Loss: 0.0006092035161730 | Epoch: 102 | 
MeanAbsoluteError: 0.0747607871890068 | Loss: 0.0070754682778248 | Epoch: 103 | MeanAbsoluteError: 0.0768495872616768 | Loss: 0.0067220762638109 | Epoch: 104 | MeanAbsoluteError: 0.0474442876875401 | Loss: 0.0031934790978474 | Epoch: 105 | MeanAbsoluteError: 0.0703099891543388 | Loss: 0.0049120530685676 | Epoch: 106 | MeanAbsoluteError: 0.0540623478591442 | Loss: 0.0047613477134811 | Epoch: 107 | 
MeanAbsoluteError: 0.0161317698657513 | Loss: 0.0004526209335641 | Epoch: 108 | MeanAbsoluteError: 0.0687582343816757 | Loss: 0.0074143227455871 | Epoch: 109 | MeanAbsoluteError: 0.1116893216967583 | Loss: 0.0145286925669227 | Epoch: 110 | MeanAbsoluteError: 0.0493796542286873 | Loss: 0.0030160575240318 | Epoch: 111 | MeanAbsoluteError: 0.0092026898637414 | Loss: 0.0001942746114634 | Epoch: 112 | 
MeanAbsoluteError: 0.0563875325024128 | Loss: 0.0038792790978083 | Epoch: 113 | MeanAbsoluteError: 0.1129472032189369 | Loss: 0.0137012100645474 | Epoch: 114 | MeanAbsoluteError: 0.0808491334319115 | Loss: 0.0071658518032304 | Epoch: 115 | MeanAbsoluteError: 0.0623000897467136 | Loss: 0.0060336872536157 | Early stopping at epoch 114
Fold: 2
Epoch: 1 | MeanAbsoluteError: 0.1875731348991394 | Loss: 0.0548083739621299 | Epoch: 2 | 
MeanAbsoluteError: 0.1287401467561722 | Loss: 0.0240245810044663 | Epoch: 3 | MeanAbsoluteError: 0.1544365733861923 | Loss: 0.0346090764339481 | Epoch: 4 | MeanAbsoluteError: 0.1203802525997162 | Loss: 0.0257119672106845 | Epoch: 5 | MeanAbsoluteError: 0.1413151323795319 | Loss: 0.0269174027655806 | Epoch: 6 | MeanAbsoluteError: 0.0784184187650681 | Loss: 0.0099285747190671 | Epoch: 7 | 
MeanAbsoluteError: 0.0588682182133198 | Loss: 0.0051246911752969 | Epoch: 8 | MeanAbsoluteError: 0.2878260314464569 | Loss: 0.0863373524376324 | Epoch: 9 | MeanAbsoluteError: 0.0660466626286507 | Loss: 0.0082740757747420 | Epoch: 10 | MeanAbsoluteError: 0.0650015622377396 | Loss: 0.0067279759927520 | Epoch: 11 | 
MeanAbsoluteError: 0.1026022359728813 | Loss: 0.0128475643162216 | Epoch: 12 | MeanAbsoluteError: 0.0883723273873329 | Loss: 0.0099400739584650 | Epoch: 13 | MeanAbsoluteError: 0.0706924051046371 | Loss: 0.0067209577786603 | Epoch: 14 | MeanAbsoluteError: 0.0425970107316971 | Loss: 0.0033286912034133 | Epoch: 15 | 
MeanAbsoluteError: 0.0716144070029259 | Loss: 0.0067095564611788 | Epoch: 16 | MeanAbsoluteError: 0.0896000862121582 | Loss: 0.0132836004985230 | Epoch: 17 | MeanAbsoluteError: 0.0416910648345947 | Loss: 0.0024390914893177 | Epoch: 18 | MeanAbsoluteError: 0.0420268140733242 | Loss: 0.0028250329362761 | Epoch: 19 | MeanAbsoluteError: 0.0918758884072304 | Loss: 0.0101971002295613 | 
Epoch: 20 | MeanAbsoluteError: 0.0302333384752274 | Loss: 0.0013842238445899 | Epoch: 21 | MeanAbsoluteError: 0.0285319630056620 | Loss: 0.0029224843851158 | Epoch: 22 | MeanAbsoluteError: 0.0871686190366745 | Loss: 0.0119244291314057 | Epoch: 23 | MeanAbsoluteError: 0.0267611593008041 | Loss: 0.0013061863470024 | Epoch: 24 | 
MeanAbsoluteError: 0.1163795739412308 | Loss: 0.0149729866534472 | Epoch: 25 | MeanAbsoluteError: 0.0332480482757092 | Loss: 0.0017631608726723 | Epoch: 26 | MeanAbsoluteError: 0.1074485480785370 | Loss: 0.0128370588645339 | Epoch: 27 | MeanAbsoluteError: 0.0803233534097672 | Loss: 0.0088896883119430 | Epoch: 28 | 
MeanAbsoluteError: 0.0620340593159199 | Loss: 0.0053377162798175 | Epoch: 29 | MeanAbsoluteError: 0.0689964368939400 | Loss: 0.0054152254680438 | Epoch: 30 | MeanAbsoluteError: 0.0877003073692322 | Loss: 0.0104756498975413 | Epoch: 31 | MeanAbsoluteError: 0.0891375914216042 | Loss: 0.0087121973213341 | Epoch: 32 | MeanAbsoluteError: 0.0344536863267422 | Loss: 0.0018030928165120 | Epoch: 33 | 
MeanAbsoluteError: 0.0716036185622215 | Loss: 0.0057329023922128 | Epoch: 34 | MeanAbsoluteError: 0.0857782140374184 | Loss: 0.0080192916627441 | Epoch: 35 | MeanAbsoluteError: 0.1165428459644318 | Loss: 0.0146399499582393 | Epoch: 36 | MeanAbsoluteError: 0.0976095497608185 | Loss: 0.0101046224257776 | Epoch: 37 | MeanAbsoluteError: 0.0472901761531830 | Loss: 0.0025675237744248 | Epoch: 38 | 
MeanAbsoluteError: 0.0897562950849533 | Loss: 0.0087317238295717 | Epoch: 39 | MeanAbsoluteError: 0.0288115292787552 | Loss: 0.0014822244411334 | Epoch: 40 | MeanAbsoluteError: 0.0623716637492180 | Loss: 0.0043152678491814 | Epoch: 41 | MeanAbsoluteError: 0.1032026708126068 | Loss: 0.0115678207948804 | Epoch: 42 | MeanAbsoluteError: 0.0586179792881012 | Loss: 0.0048973530397883 | 
Epoch: 43 | MeanAbsoluteError: 0.0581212230026722 | Loss: 0.0047524008633835 | Epoch: 44 | MeanAbsoluteError: 0.0597954504191875 | Loss: 0.0057862993396286 | Epoch: 45 | MeanAbsoluteError: 0.0441270731389523 | Loss: 0.0026642362354323 | Epoch: 46 | 
MeanAbsoluteError: 0.0190635267645121 | Loss: 0.0005651630386378 | Epoch: 47 | MeanAbsoluteError: 0.0793508291244507 | Loss: 0.0076982842625252 | Epoch: 48 | MeanAbsoluteError: 0.1212385967373848 | Loss: 0.0156202757997172 | Epoch: 49 | MeanAbsoluteError: 0.0607620142400265 | Loss: 0.0049085167702287 | Epoch: 50 | 
MeanAbsoluteError: 0.0618618912994862 | Loss: 0.0052775254007429 | Epoch: 51 | MeanAbsoluteError: 0.1099285632371902 | Loss: 0.0126384599134326 | Epoch: 52 | MeanAbsoluteError: 0.0167869478464127 | Loss: 0.0007163952769978 | Epoch: 53 | MeanAbsoluteError: 0.0677095949649811 | Loss: 0.0051636380542602 | Epoch: 54 | 
MeanAbsoluteError: 0.0701957717537880 | Loss: 0.0064558998814651 | Epoch: 55 | MeanAbsoluteError: 0.0643985345959663 | Loss: 0.0049517291731068 | Epoch: 56 | MeanAbsoluteError: 0.0704644173383713 | Loss: 0.0051534288961973 | Epoch: 57 | MeanAbsoluteError: 0.0974155589938164 | Loss: 0.0099663808276611 | Epoch: 58 | MeanAbsoluteError: 0.0134482793509960 | Loss: 0.0002756816206134 | 
Epoch: 59 | MeanAbsoluteError: 0.0376173630356789 | Loss: 0.0019179865817672 | Epoch: 60 | MeanAbsoluteError: 0.0187660176306963 | Loss: 0.0004536964531456 | Epoch: 61 | MeanAbsoluteError: 0.1002608016133308 | Loss: 0.0114391878513353 | Epoch: 62 | MeanAbsoluteError: 0.0491006895899773 | Loss: 0.0039284608127283 | Epoch: 63 | 
MeanAbsoluteError: 0.0227681938558817 | Loss: 0.0007454549195245 | Epoch: 64 | MeanAbsoluteError: 0.1057873740792274 | Loss: 0.0139727390238217 | Epoch: 65 | MeanAbsoluteError: 0.0965043008327484 | Loss: 0.0123305863567761 | Epoch: 66 | MeanAbsoluteError: 0.0103847058489919 | Loss: 0.0002277354610019 | Epoch: 67 | MeanAbsoluteError: 0.0303328521549702 | Loss: 0.0013706488784270 | Epoch: 68 | 
MeanAbsoluteError: 0.0761545971035957 | Loss: 0.0060974658866014 | Epoch: 69 | MeanAbsoluteError: 0.0561526529490948 | Loss: 0.0038042343554220 | Epoch: 70 | MeanAbsoluteError: 0.0400217659771442 | Loss: 0.0021192144070353 | Epoch: 71 | MeanAbsoluteError: 0.0550573617219925 | Loss: 0.0039477530600769 | Epoch: 72 | 
MeanAbsoluteError: 0.0708765834569931 | Loss: 0.0070162199969803 | Epoch: 73 | MeanAbsoluteError: 0.0623649917542934 | Loss: 0.0048169208956616 | Epoch: 74 | MeanAbsoluteError: 0.0897804722189903 | Loss: 0.0098424137436918 | Epoch: 75 | MeanAbsoluteError: 0.0438877567648888 | Loss: 0.0027568288413542 | Epoch: 76 | 
MeanAbsoluteError: 0.0273945406079292 | Loss: 0.0011345381083499 | Epoch: 77 | MeanAbsoluteError: 0.0284788496792316 | Loss: 0.0009752612843710 | Epoch: 78 | MeanAbsoluteError: 0.0139699988067150 | Loss: 0.0010249710092986 | Epoch: 79 | MeanAbsoluteError: 0.0467720516026020 | Loss: 0.0024765774474612 | Epoch: 80 | 
MeanAbsoluteError: 0.0556169189512730 | Loss: 0.0033516435817416 | Epoch: 81 | MeanAbsoluteError: 0.0864635929465294 | Loss: 0.0076274174664702 | Epoch: 82 | MeanAbsoluteError: 0.0323512665927410 | Loss: 0.0020571981772913 | Epoch: 83 | MeanAbsoluteError: 0.0844052881002426 | Loss: 0.0073739403991827 | Epoch: 84 | 
MeanAbsoluteError: 0.0915672853589058 | Loss: 0.0091697219759226 | Epoch: 85 | MeanAbsoluteError: 0.0747087225317955 | Loss: 0.0059319648758641 | Epoch: 86 | MeanAbsoluteError: 0.0305943544954062 | Loss: 0.0012076241130541 | Epoch: 87 | MeanAbsoluteError: 0.0967967063188553 | Loss: 0.0150768631137908 | Epoch: 88 | 
MeanAbsoluteError: 0.0495527312159538 | Loss: 0.0025016972462514 | Epoch: 89 | MeanAbsoluteError: 0.0596473217010498 | Loss: 0.0046621261114654 | Epoch: 90 | MeanAbsoluteError: 0.0806061103940010 | Loss: 0.0070420715824834 | Epoch: 91 | MeanAbsoluteError: 0.0290493797510862 | Loss: 0.0013302820152603 | Epoch: 92 | MeanAbsoluteError: 0.0585905499756336 | Loss: 0.0043209496819015 | 
Epoch: 93 | MeanAbsoluteError: 0.0661211460828781 | Loss: 0.0085665676742792 | Epoch: 94 | MeanAbsoluteError: 0.0480170994997025 | Loss: 0.0043541099044627 | Epoch: 95 | MeanAbsoluteError: 0.1108162626624107 | Loss: 0.0133065280637571 | Epoch: 96 | MeanAbsoluteError: 0.0177693404257298 | Loss: 0.0004248945582991 | 
Epoch: 97 | MeanAbsoluteError: 0.0338397324085236 | Loss: 0.0017234743905387 | Epoch: 98 | MeanAbsoluteError: 0.0171042010188103 | Loss: 0.0006002622103551 | Early stopping at epoch 97
Fold: 3
Epoch: 1 | MeanAbsoluteError: 0.1974520236253738 | Loss: 0.0500000215002469 | Epoch: 2 | 
MeanAbsoluteError: 0.2812427282333374 | Loss: 0.0862968425665583 | Epoch: 3 | MeanAbsoluteError: 0.0796064957976341 | Loss: 0.0094771249485867 | Epoch: 4 | MeanAbsoluteError: 0.1857855916023254 | Loss: 0.0459510715944426 | Epoch: 5 | MeanAbsoluteError: 0.0715257227420807 | Loss: 0.0094494695908257 | Epoch: 6 | MeanAbsoluteError: 0.0822183340787888 | Loss: 0.0103644749282726 | Epoch: 7 | 
MeanAbsoluteError: 0.0886420458555222 | Loss: 0.0105875252213861 | Epoch: 8 | MeanAbsoluteError: 0.0726716518402100 | Loss: 0.0075014914785113 | Epoch: 9 | MeanAbsoluteError: 0.1922459602355957 | Loss: 0.0437696139727320 | Epoch: 10 | MeanAbsoluteError: 0.0503762587904930 | Loss: 0.0040690975064146 | Epoch: 11 | MeanAbsoluteError: 0.0790933594107628 | Loss: 0.0107497544293957 | Epoch: 12 | 
MeanAbsoluteError: 0.1628204137086868 | Loss: 0.0289082442011152 | Epoch: 13 | MeanAbsoluteError: 0.1183900833129883 | Loss: 0.0169772103961025 | Epoch: 14 | MeanAbsoluteError: 0.1079489588737488 | Loss: 0.0150271317522441 | Epoch: 15 | MeanAbsoluteError: 0.0837290212512016 | Loss: 0.0089988528218653 | Epoch: 16 | MeanAbsoluteError: 0.1401028931140900 | Loss: 0.0206947308033705 | Epoch: 17 | 
MeanAbsoluteError: 0.1042164489626884 | Loss: 0.0119862744052495 | Epoch: 18 | MeanAbsoluteError: 0.1259006261825562 | Loss: 0.0173246410808393 | Epoch: 19 | MeanAbsoluteError: 0.1211792454123497 | Loss: 0.0176388903387955 | Epoch: 20 | MeanAbsoluteError: 0.0252868104726076 | Loss: 0.0011300532413380 | Epoch: 21 | MeanAbsoluteError: 0.0693217813968658 | Loss: 0.0061674304306507 | 
Epoch: 22 | MeanAbsoluteError: 0.1025445237755775 | Loss: 0.0116856844563569 | Epoch: 23 | MeanAbsoluteError: 0.0805107578635216 | Loss: 0.0072595669355776 | Epoch: 24 | MeanAbsoluteError: 0.1077637076377869 | Loss: 0.0130314587482384 | Epoch: 25 | MeanAbsoluteError: 0.0564589649438858 | Loss: 0.0038282123527357 | 
Epoch: 26 | MeanAbsoluteError: 0.1014566421508789 | Loss: 0.0116676171975476 | Epoch: 27 | MeanAbsoluteError: 0.0438762418925762 | Loss: 0.0023828187591529 | Epoch: 28 | MeanAbsoluteError: 0.0398796312510967 | Loss: 0.0030174938396418 | Epoch: 29 | 
MeanAbsoluteError: 0.0988130792975426 | Loss: 0.0156135700110878 | Epoch: 30 | MeanAbsoluteError: 0.1033807769417763 | Loss: 0.0118704524689487 | Epoch: 31 | MeanAbsoluteError: 0.0746643617749214 | Loss: 0.0058858975368951 | Epoch: 32 | MeanAbsoluteError: 0.0845243632793427 | Loss: 0.0083112696052662 | Epoch: 33 | MeanAbsoluteError: 0.1271128654479980 | Loss: 0.0164236323907971 | 
Epoch: 34 | MeanAbsoluteError: 0.0449629463255405 | Loss: 0.0031224976992235 | Epoch: 35 | MeanAbsoluteError: 0.1522975713014603 | Loss: 0.0239356266600745 | Epoch: 36 | MeanAbsoluteError: 0.0500417314469814 | Loss: 0.0034606961666473 | Epoch: 37 | MeanAbsoluteError: 0.0517760887742043 | Loss: 0.0033350036413010 | Epoch: 38 | 
MeanAbsoluteError: 0.0993414968252182 | Loss: 0.0138621049533997 | Epoch: 39 | MeanAbsoluteError: 0.0236128624528646 | Loss: 0.0022492161619344 | Epoch: 40 | MeanAbsoluteError: 0.1175350844860077 | Loss: 0.0142913414165378 | Epoch: 41 | MeanAbsoluteError: 0.0675806179642677 | Loss: 0.0059381481260061 | Epoch: 42 | 
MeanAbsoluteError: 0.0885746553540230 | Loss: 0.0097780735897166 | Epoch: 43 | MeanAbsoluteError: 0.0621849633753300 | Loss: 0.0062800918572715 | Epoch: 44 | MeanAbsoluteError: 0.1102041602134705 | Loss: 0.0128572225304587 | Epoch: 45 | MeanAbsoluteError: 0.0452315509319305 | Loss: 0.0022372419979157 | Epoch: 46 | 
MeanAbsoluteError: 0.0215491037815809 | Loss: 0.0009334189900463 | Epoch: 47 | MeanAbsoluteError: 0.0257438831031322 | Loss: 0.0011524159095383 | Epoch: 48 | MeanAbsoluteError: 0.0959469377994537 | Loss: 0.0098507557330387 | Epoch: 49 | MeanAbsoluteError: 0.0819488018751144 | Loss: 0.0072356846316585 | Epoch: 50 | 
MeanAbsoluteError: 0.0203432552516460 | Loss: 0.0008134298966200 | Epoch: 51 | MeanAbsoluteError: 0.0237145926803350 | Loss: 0.0009667084918224 | Epoch: 52 | MeanAbsoluteError: 0.1001599133014679 | Loss: 0.0120026580989361 | Epoch: 53 | MeanAbsoluteError: 0.0822058171033859 | Loss: 0.0081481930932828 | Epoch: 54 | 
MeanAbsoluteError: 0.1013797596096992 | Loss: 0.0119559937821967 | Epoch: 55 | MeanAbsoluteError: 0.0254250355064869 | Loss: 0.0008531351923011 | Epoch: 56 | MeanAbsoluteError: 0.0335517562925816 | Loss: 0.0020995324677122 | Epoch: 57 | MeanAbsoluteError: 0.0829300880432129 | Loss: 0.0082818156640444 | Epoch: 58 | 
MeanAbsoluteError: 0.0498059317469597 | Loss: 0.0035438186023384 | Epoch: 59 | MeanAbsoluteError: 0.0753484740853310 | Loss: 0.0063071211001703 | Epoch: 60 | MeanAbsoluteError: 0.1186455786228180 | Loss: 0.0151536690869502 | Epoch: 61 | MeanAbsoluteError: 0.0990508645772934 | Loss: 0.0098638937675527 | Epoch: 62 | 
MeanAbsoluteError: 0.0564767979085445 | Loss: 0.0051411090950881 | Epoch: 63 | MeanAbsoluteError: 0.1113079935312271 | Loss: 0.0127513461879322 | Epoch: 64 | MeanAbsoluteError: 0.0253819208592176 | Loss: 0.0009497529993366 | Epoch: 65 | MeanAbsoluteError: 0.0460511595010757 | Loss: 0.0028889290655830 | Epoch: 66 | 
MeanAbsoluteError: 0.0240607913583517 | Loss: 0.0008130724849512 | Epoch: 67 | MeanAbsoluteError: 0.0353405661880970 | Loss: 0.0019447756349109 | Epoch: 68 | MeanAbsoluteError: 0.0551312416791916 | Loss: 0.0047130605006324 | Epoch: 69 | MeanAbsoluteError: 0.1028596088290215 | Loss: 0.0118107610781278 | Epoch: 70 | 
MeanAbsoluteError: 0.0757268443703651 | Loss: 0.0063967887711312 | Epoch: 71 | MeanAbsoluteError: 0.0659172311425209 | Loss: 0.0070155282903995 | Epoch: 72 | MeanAbsoluteError: 0.1065379157662392 | Loss: 0.0116848070174456 | Epoch: 73 | MeanAbsoluteError: 0.0872842893004417 | Loss: 0.0087500038290662 | Epoch: 74 | 
MeanAbsoluteError: 0.0459997840225697 | Loss: 0.0033225031636123 | Epoch: 75 | MeanAbsoluteError: 0.0762868821620941 | Loss: 0.0062048685337816 | Epoch: 76 | MeanAbsoluteError: 0.0329459123313427 | Loss: 0.0018109914464211 | Epoch: 77 | MeanAbsoluteError: 0.0461119972169399 | Loss: 0.0034655692454960 | Epoch: 78 | 
MeanAbsoluteError: 0.0554335154592991 | Loss: 0.0033909673469939 | Epoch: 79 | MeanAbsoluteError: 0.0661979541182518 | Loss: 0.0051717991009355 | Epoch: 80 | MeanAbsoluteError: 0.0678558126091957 | Loss: 0.0059379931938435 | Epoch: 81 | MeanAbsoluteError: 0.0152753479778767 | Loss: 0.0003412426085561 | Epoch: 82 | 
MeanAbsoluteError: 0.1056084930896759 | Loss: 0.0116230024557028 | Epoch: 83 | MeanAbsoluteError: 0.1249688044190407 | Loss: 0.0192135379516653 | Epoch: 84 | MeanAbsoluteError: 0.0910619273781776 | Loss: 0.0087023634197456 | Epoch: 85 | MeanAbsoluteError: 0.0953879281878471 | Loss: 0.0093587663556848 | Epoch: 86 | 
MeanAbsoluteError: 0.1037181094288826 | Loss: 0.0114082215087754 | Epoch: 87 | MeanAbsoluteError: 0.0819294229149818 | Loss: 0.0071827845115747 | Epoch: 88 | MeanAbsoluteError: 0.0672457963228226 | Loss: 0.0064309238722282 | Epoch: 89 | MeanAbsoluteError: 0.0414618775248528 | Loss: 0.0018143383619775 | Epoch: 90 | 
MeanAbsoluteError: 0.0612335912883282 | Loss: 0.0047884980615761 | Epoch: 91 | MeanAbsoluteError: 0.0632229894399643 | Loss: 0.0042254023719579 | Epoch: 92 | MeanAbsoluteError: 0.0239886790513992 | Loss: 0.0007331612536551 | Epoch: 93 | MeanAbsoluteError: 0.0243940036743879 | Loss: 0.0011215766675637 | Epoch: 94 | 
MeanAbsoluteError: 0.0570557937026024 | Loss: 0.0034473616563316 | Epoch: 95 | MeanAbsoluteError: 0.0859296545386314 | Loss: 0.0092295564578048 | Epoch: 96 | MeanAbsoluteError: 0.0495473258197308 | Loss: 0.0028791602235287 | Epoch: 97 | MeanAbsoluteError: 0.0777652710676193 | Loss: 0.0066963987691062 | Epoch: 98 | 
MeanAbsoluteError: 0.0719422250986099 | Loss: 0.0056056652351149 | Epoch: 99 | MeanAbsoluteError: 0.0730885192751884 | Loss: 0.0064227823833270 | Epoch: 100 | MeanAbsoluteError: 0.0491753295063972 | Loss: 0.0029216281670545 | Epoch: 101 | MeanAbsoluteError: 0.0505636222660542 | Loss: 0.0029494633033339 | Epoch: 102 | 
MeanAbsoluteError: 0.1265380680561066 | Loss: 0.0165522487035819 | Epoch: 103 | MeanAbsoluteError: 0.0185465496033430 | Loss: 0.0005270473245348 | Epoch: 104 | MeanAbsoluteError: 0.0224044900387526 | Loss: 0.0011609674714107 | Epoch: 105 | MeanAbsoluteError: 0.0105945346876979 | Loss: 0.0002201429139989 | Epoch: 106 | 
MeanAbsoluteError: 0.0620035231113434 | Loss: 0.0045190660416016 | Epoch: 107 | MeanAbsoluteError: 0.0829047858715057 | Loss: 0.0079848537487643 | Epoch: 108 | MeanAbsoluteError: 0.0317102819681168 | Loss: 0.0015836421267263 | Epoch: 109 | MeanAbsoluteError: 0.0200640894472599 | Loss: 0.0006452601644144 | Epoch: 110 | MeanAbsoluteError: 0.0350622572004795 | Loss: 0.0023425744314279 | 
Epoch: 111 | MeanAbsoluteError: 0.0632903650403023 | Loss: 0.0045885357207486 | Epoch: 112 | MeanAbsoluteError: 0.0354497954249382 | Loss: 0.0018285447731614 | Epoch: 113 | MeanAbsoluteError: 0.0603243745863438 | Loss: 0.0047176385165325 | Epoch: 114 | MeanAbsoluteError: 0.0284903906285763 | Loss: 0.0015994098752604 | Epoch: 115 | 
MeanAbsoluteError: 0.0122172236442566 | Loss: 0.0002896865179147 | Epoch: 116 | MeanAbsoluteError: 0.0662835538387299 | Loss: 0.0053604190636958 | Epoch: 117 | MeanAbsoluteError: 0.0607853755354881 | Loss: 0.0038470270976956 | Epoch: 118 | MeanAbsoluteError: 0.0757391154766083 | Loss: 0.0060685129304017 | Epoch: 119 | 
MeanAbsoluteError: 0.0975213423371315 | Loss: 0.0100698485704405 | Epoch: 120 | MeanAbsoluteError: 0.0551159717142582 | Loss: 0.0047718649397471 | Epoch: 121 | MeanAbsoluteError: 0.0585180036723614 | Loss: 0.0040463050494769 | Epoch: 122 | MeanAbsoluteError: 0.0245392099022865 | Loss: 0.0007799813507258 | Epoch: 123 | 
MeanAbsoluteError: 0.0550521835684776 | Loss: 0.0034960597154817 | Epoch: 124 | MeanAbsoluteError: 0.0233218055218458 | Loss: 0.0006595217481455 | Epoch: 125 | MeanAbsoluteError: 0.0631386414170265 | Loss: 0.0042092147549348 | Epoch: 126 | MeanAbsoluteError: 0.0266040246933699 | Loss: 0.0008564025213543 | Epoch: 127 | 
MeanAbsoluteError: 0.0945507362484932 | Loss: 0.0132945946284703 | Epoch: 128 | MeanAbsoluteError: 0.1173982545733452 | Loss: 0.0162328094510095 | Epoch: 129 | MeanAbsoluteError: 0.0297178402543068 | Loss: 0.0014925183828122 | Epoch: 130 | MeanAbsoluteError: 0.0414521545171738 | Loss: 0.0027630910543459 | Epoch: 131 | 
MeanAbsoluteError: 0.0507855117321014 | Loss: 0.0031056741718203 | Epoch: 132 | MeanAbsoluteError: 0.0223997924476862 | Loss: 0.0008807795072374 | Epoch: 133 | MeanAbsoluteError: 0.0633427724242210 | Loss: 0.0091638174905841 | Epoch: 134 | MeanAbsoluteError: 0.0437549725174904 | Loss: 0.0029109931617443 | Epoch: 135 | MeanAbsoluteError: 0.0279094930738211 | Loss: 0.0017538514553702 | 
Epoch: 136 | MeanAbsoluteError: 0.0237847641110420 | Loss: 0.0007952793883825 | Epoch: 137 | MeanAbsoluteError: 0.0414493568241596 | Loss: 0.0022754041710868 | Early stopping at epoch 136
Fold: 4
Epoch: 1 | MeanAbsoluteError: 0.1168994829058647 | Loss: 0.0197419064518596 | Epoch: 2 | MeanAbsoluteError: 0.1761628985404968 | Loss: 0.0437724537083081 | 
Epoch: 3 | MeanAbsoluteError: 0.1300867199897766 | Loss: 0.0255963222256729 | Epoch: 4 | MeanAbsoluteError: 0.1221307739615440 | Loss: 0.0220792775175401 | Epoch: 5 | MeanAbsoluteError: 0.1215391233563423 | Loss: 0.0238350683024951 | Epoch: 6 | 
MeanAbsoluteError: 0.0783812403678894 | Loss: 0.0097215362558407 | Epoch: 7 | MeanAbsoluteError: 0.0880567133426666 | Loss: 0.0123155102399843 | Epoch: 8 | MeanAbsoluteError: 0.0594241619110107 | Loss: 0.0061427052465401 | Epoch: 9 | MeanAbsoluteError: 0.1362758278846741 | Loss: 0.0220730099827051 | Epoch: 10 | 
MeanAbsoluteError: 0.0957184582948685 | Loss: 0.0120600480586290 | Epoch: 11 | MeanAbsoluteError: 0.0482290796935558 | Loss: 0.0052585900162480 | Epoch: 12 | MeanAbsoluteError: 0.0713712126016617 | Loss: 0.0071099812963179 | Epoch: 13 | MeanAbsoluteError: 0.0648003816604614 | Loss: 0.0053702565242669 | Epoch: 14 | 
MeanAbsoluteError: 0.0357886590063572 | Loss: 0.0020060554712213 | Epoch: 15 | MeanAbsoluteError: 0.0912640392780304 | Loss: 0.0111097468595420 | Epoch: 16 | MeanAbsoluteError: 0.1384110450744629 | Loss: 0.0224888223622526 | Epoch: 17 | MeanAbsoluteError: 0.1307099312543869 | Loss: 0.0185567137918302 | Epoch: 18 | 
MeanAbsoluteError: 0.0701051875948906 | Loss: 0.0068082293229444 | Epoch: 19 | MeanAbsoluteError: 0.0523579679429531 | Loss: 0.0044788854595806 | Epoch: 20 | MeanAbsoluteError: 0.0217170547693968 | Loss: 0.0014978565575023 | Epoch: 21 | MeanAbsoluteError: 0.1582082808017731 | Loss: 0.0277365784027747 | Epoch: 22 | MeanAbsoluteError: 0.0575745068490505 | Loss: 0.0046430073146309 | 
Epoch: 23 | MeanAbsoluteError: 0.0953040421009064 | Loss: 0.0100480392575264 | Epoch: 24 | MeanAbsoluteError: 0.0571191012859344 | Loss: 0.0055013356198158 | Epoch: 25 | MeanAbsoluteError: 0.1216273382306099 | Loss: 0.0148176486337824 | Epoch: 26 | MeanAbsoluteError: 0.0801959484815598 | Loss: 0.0073763833913420 | Epoch: 27 | 
MeanAbsoluteError: 0.0780432894825935 | Loss: 0.0077755157835782 | Epoch: 28 | MeanAbsoluteError: 0.0528097972273827 | Loss: 0.0033323748835496 | Epoch: 29 | MeanAbsoluteError: 0.1261558681726456 | Loss: 0.0173830437873091 | Epoch: 30 | MeanAbsoluteError: 0.1170466914772987 | Loss: 0.0141360227550779 | Epoch: 31 | 
MeanAbsoluteError: 0.0588773451745510 | Loss: 0.0065475840986307 | Epoch: 32 | MeanAbsoluteError: 0.0694455876946449 | Loss: 0.0060324573756329 | Epoch: 33 | MeanAbsoluteError: 0.0390768423676491 | Loss: 0.0026007826173944 | Epoch: 34 | MeanAbsoluteError: 0.0318981967866421 | Loss: 0.0016227218854640 | Epoch: 35 | MeanAbsoluteError: 0.0844193845987320 | Loss: 0.0085463003654565 | 
Epoch: 36 | MeanAbsoluteError: 0.1019284501671791 | Loss: 0.0112834232194083 | Epoch: 37 | MeanAbsoluteError: 0.0322395935654640 | Loss: 0.0012937914580107 | Epoch: 38 | MeanAbsoluteError: 0.0327868536114693 | Loss: 0.0019352038673657 | Epoch: 39 | 
MeanAbsoluteError: 0.0874809324741364 | Loss: 0.0091304699225085 | Epoch: 40 | MeanAbsoluteError: 0.0991555899381638 | Loss: 0.0145150399101632 | Epoch: 41 | MeanAbsoluteError: 0.0901669859886169 | Loss: 0.0111484794345285 | Epoch: 42 | MeanAbsoluteError: 0.0399033315479755 | Loss: 0.0019921056227759 | Epoch: 43 | MeanAbsoluteError: 0.0706376135349274 | Loss: 0.0062465249627296 | 
Epoch: 44 | MeanAbsoluteError: 0.0364402830600739 | Loss: 0.0024396270081135 | Epoch: 45 | MeanAbsoluteError: 0.0348718278110027 | Loss: 0.0014660351693497 | Epoch: 46 | MeanAbsoluteError: 0.0141871189698577 | Loss: 0.0004712884496517 | Epoch: 47 | 
MeanAbsoluteError: 0.0819195583462715 | Loss: 0.0080386217284415 | Epoch: 48 | MeanAbsoluteError: 0.0423697344958782 | Loss: 0.0029521858336271 | Epoch: 49 | MeanAbsoluteError: 0.0335203111171722 | Loss: 0.0013921053448160 | Epoch: 50 | MeanAbsoluteError: 0.0649213045835495 | Loss: 0.0057488913381738 | Epoch: 51 | 
MeanAbsoluteError: 0.0828215479850769 | Loss: 0.0110760668425688 | Epoch: 52 | MeanAbsoluteError: 0.0274940915405750 | Loss: 0.0012205596930081 | Epoch: 53 | MeanAbsoluteError: 0.0781171768903732 | Loss: 0.0070726401172578 | Epoch: 54 | MeanAbsoluteError: 0.0922668278217316 | Loss: 0.0090061193332076 | Epoch: 55 | MeanAbsoluteError: 0.0216677244752645 | Loss: 0.0008883901547441 | 
Epoch: 56 | MeanAbsoluteError: 0.0226446967571974 | Loss: 0.0010318794977918 | Epoch: 57 | MeanAbsoluteError: 0.1065752133727074 | Loss: 0.0121555780725820 | Epoch: 58 | MeanAbsoluteError: 0.0684896409511566 | Loss: 0.0068844126071781 | Epoch: 59 | MeanAbsoluteError: 0.0610512979328632 | Loss: 0.0045246579684317 | Epoch: 60 | 
MeanAbsoluteError: 0.0914650261402130 | Loss: 0.0096308744645544 | Epoch: 61 | MeanAbsoluteError: 0.0265057329088449 | Loss: 0.0021729322158665 | Epoch: 62 | MeanAbsoluteError: 0.0466126836836338 | Loss: 0.0029293315518381 | Epoch: 63 | MeanAbsoluteError: 0.0755191966891289 | Loss: 0.0069965008380158 | Epoch: 64 | MeanAbsoluteError: 0.0624389536678791 | Loss: 0.0047868294641376 | 
Epoch: 65 | MeanAbsoluteError: 0.0648020952939987 | Loss: 0.0068865676876158 | Epoch: 66 | MeanAbsoluteError: 0.0489098541438580 | Loss: 0.0027935499591487 | Epoch: 67 | MeanAbsoluteError: 0.0499535650014877 | Loss: 0.0034844480521445 | Epoch: 68 | 
MeanAbsoluteError: 0.0975267589092255 | Loss: 0.0105023603620274 | Epoch: 69 | MeanAbsoluteError: 0.0256837941706181 | Loss: 0.0012179142213427 | Epoch: 70 | MeanAbsoluteError: 0.0502827689051628 | Loss: 0.0044435866376651 | Epoch: 71 | MeanAbsoluteError: 0.0548109263181686 | Loss: 0.0036894749583943 | Epoch: 72 | MeanAbsoluteError: 0.0602851249277592 | Loss: 0.0038581686094403 | 
Epoch: 73 | MeanAbsoluteError: 0.0422905907034874 | Loss: 0.0025582919562502 | Epoch: 74 | MeanAbsoluteError: 0.0883297249674797 | Loss: 0.0085728080677135 | Epoch: 75 | MeanAbsoluteError: 0.0606841742992401 | Loss: 0.0052432314758854 | Epoch: 76 | 
MeanAbsoluteError: 0.0891181081533432 | Loss: 0.0082933253475598 | Epoch: 77 | MeanAbsoluteError: 0.0246125943958759 | Loss: 0.0014195250488618 | Epoch: 78 | MeanAbsoluteError: 0.0661009997129440 | Loss: 0.0048816269263625 | Early stopping at epoch 77
Fold: 5
Epoch: 1 | MeanAbsoluteError: 0.1525989919900894 | Loss: 0.0380334619964872 | Epoch: 2 | 
MeanAbsoluteError: 0.1280819177627563 | Loss: 0.0262985780302967 | Epoch: 3 | MeanAbsoluteError: 0.0999870672821999 | Loss: 0.0144915506243706 | Epoch: 4 | MeanAbsoluteError: 0.1363716274499893 | Loss: 0.0251079002129180 | Epoch: 5 | MeanAbsoluteError: 0.0835693627595901 | Loss: 0.0097634314692446 | Epoch: 6 | MeanAbsoluteError: 0.0991615802049637 | Loss: 0.0134478782835816 | Epoch: 7 | 
MeanAbsoluteError: 0.0609229765832424 | Loss: 0.0064333968995405 | Epoch: 8 | MeanAbsoluteError: 0.0614234320819378 | Loss: 0.0057342557036983 | Epoch: 9 | MeanAbsoluteError: 0.0435533747076988 | Loss: 0.0030009016793753 | Epoch: 10 | MeanAbsoluteError: 0.0799175351858139 | Loss: 0.0095429953320750 | Epoch: 11 | MeanAbsoluteError: 0.1866586506366730 | Loss: 0.0369386856577226 | Epoch: 12 | 
MeanAbsoluteError: 0.0587062798440456 | Loss: 0.0050488409386682 | Epoch: 13 | MeanAbsoluteError: 0.1071305200457573 | Loss: 0.0148504993745259 | Epoch: 14 | MeanAbsoluteError: 0.0959459394216537 | Loss: 0.0105426279561860 | Epoch: 15 | MeanAbsoluteError: 0.0486491732299328 | Loss: 0.0032118979309286 | Epoch: 16 | MeanAbsoluteError: 0.0563794486224651 | Loss: 0.0038173197702106 | Epoch: 17 | 
MeanAbsoluteError: 0.0523767918348312 | Loss: 0.0041893034441663 | Epoch: 18 | MeanAbsoluteError: 0.0930769741535187 | Loss: 0.0108381723985076 | Epoch: 19 | MeanAbsoluteError: 0.0305692553520203 | Loss: 0.0013791281630152 | Epoch: 20 | MeanAbsoluteError: 0.0444236546754837 | Loss: 0.0027265805983916 | Epoch: 21 | MeanAbsoluteError: 0.1332302689552307 | Loss: 0.0186788349279336 | 
Epoch: 22 | MeanAbsoluteError: 0.0794709622859955 | Loss: 0.0086225435536887 | Epoch: 23 | MeanAbsoluteError: 0.0460859648883343 | Loss: 0.0030010835367388 | Epoch: 24 | MeanAbsoluteError: 0.0229217857122421 | Loss: 0.0009294807761242 | Epoch: 25 | MeanAbsoluteError: 0.0272379834204912 | Loss: 0.0011565652717504 | 
Epoch: 26 | MeanAbsoluteError: 0.0774392858147621 | Loss: 0.0067235852724739 | Epoch: 27 | MeanAbsoluteError: 0.1030650213360786 | Loss: 0.0146418732724019 | Epoch: 28 | MeanAbsoluteError: 0.0401638634502888 | Loss: 0.0021013708485823 | Epoch: 29 | MeanAbsoluteError: 0.0927371084690094 | Loss: 0.0093431817367673 | 
Epoch: 30 | MeanAbsoluteError: 0.0767808407545090 | Loss: 0.0089002183106329 | Epoch: 31 | MeanAbsoluteError: 0.0459957271814346 | Loss: 0.0032574853726796 | Epoch: 32 | MeanAbsoluteError: 0.1052183434367180 | Loss: 0.0112770612218550 | Epoch: 33 | MeanAbsoluteError: 0.0498006865382195 | Loss: 0.0035967704440866 | Epoch: 34 | 
MeanAbsoluteError: 0.0457068905234337 | Loss: 0.0025286195866231 | Epoch: 35 | MeanAbsoluteError: 0.0427412167191505 | Loss: 0.0023752792788270 | Epoch: 36 | MeanAbsoluteError: 0.1020043566823006 | Loss: 0.0109424693509936 | Epoch: 37 | MeanAbsoluteError: 0.0691630616784096 | Loss: 0.0062321147083172 | Epoch: 38 | MeanAbsoluteError: 0.0450674258172512 | Loss: 0.0041353733478380 | Epoch: 39 | 
MeanAbsoluteError: 0.0399085395038128 | Loss: 0.0022634193467508 | Epoch: 40 | MeanAbsoluteError: 0.0606083422899246 | Loss: 0.0045094817344631 | Epoch: 41 | MeanAbsoluteError: 0.0410170108079910 | Loss: 0.0026618756985824 | Epoch: 42 | MeanAbsoluteError: 0.0626837834715843 | Loss: 0.0054846749241863 | Epoch: 43 | 
MeanAbsoluteError: 0.0655003488063812 | Loss: 0.0051237460824528 | Epoch: 44 | MeanAbsoluteError: 0.0857545360922813 | Loss: 0.0076951754412481 | Epoch: 45 | MeanAbsoluteError: 0.0158770028501749 | Loss: 0.0004432980848443 | Epoch: 46 | MeanAbsoluteError: 0.0421926230192184 | Loss: 0.0032103807399315 | Epoch: 47 | MeanAbsoluteError: 0.0682839453220367 | Loss: 0.0072186534692134 | Epoch: 48 | 
MeanAbsoluteError: 0.0416868925094604 | Loss: 0.0021701663000775 | Epoch: 49 | MeanAbsoluteError: 0.0551340691745281 | Loss: 0.0040980281441339 | Epoch: 50 | MeanAbsoluteError: 0.0656242817640305 | Loss: 0.0061734185687133 | Epoch: 51 | MeanAbsoluteError: 0.0252983309328556 | Loss: 0.0009097750132371 | Epoch: 52 | MeanAbsoluteError: 0.1400276720523834 | Loss: 0.0203134853925024 | Epoch: 53 | 
MeanAbsoluteError: 0.0485753901302814 | Loss: 0.0049689483296658 | Epoch: 54 | MeanAbsoluteError: 0.0270598791539669 | Loss: 0.0009007821208797 | Epoch: 55 | MeanAbsoluteError: 0.1393326818943024 | Loss: 0.0215190630406141 | Epoch: 56 | MeanAbsoluteError: 0.0575551614165306 | Loss: 0.0041333145927638 | Epoch: 57 | MeanAbsoluteError: 0.0254738777875900 | Loss: 0.0009504943986290 | Epoch: 58 | 
MeanAbsoluteError: 0.0467134937644005 | Loss: 0.0033658479140805 | Epoch: 59 | MeanAbsoluteError: 0.1041112393140793 | Loss: 0.0119191006358181 | Epoch: 60 | MeanAbsoluteError: 0.0806674733757973 | Loss: 0.0067503101059369 | Epoch: 61 | MeanAbsoluteError: 0.0198716353625059 | Loss: 0.0028459204768296 | Epoch: 62 | MeanAbsoluteError: 0.0393435657024384 | Loss: 0.0018518928471687 | Epoch: 63 | 
MeanAbsoluteError: 0.0332358293235302 | Loss: 0.0017462494184396 | Epoch: 64 | MeanAbsoluteError: 0.0937105566263199 | Loss: 0.0093128876760602 | Epoch: 65 | MeanAbsoluteError: 0.0213021654635668 | Loss: 0.0007743993316711 | Epoch: 66 | MeanAbsoluteError: 0.0403633862733841 | Loss: 0.0021753766341135 | Epoch: 67 | MeanAbsoluteError: 0.0826693922281265 | Loss: 0.0096435955077011 | 
Epoch: 68 | MeanAbsoluteError: 0.0473427399992943 | Loss: 0.0026884970055627 | Epoch: 69 | MeanAbsoluteError: 0.0210866574198008 | Loss: 0.0007806782024480 | Epoch: 70 | MeanAbsoluteError: 0.0416165627539158 | Loss: 0.0022890715460692 | Epoch: 71 | MeanAbsoluteError: 0.0881102308630943 | Loss: 0.0083206075110606 | Epoch: 72 | 
MeanAbsoluteError: 0.0448546744883060 | Loss: 0.0026344599900767 | Epoch: 73 | MeanAbsoluteError: 0.0464189238846302 | Loss: 0.0025637633433299 | Epoch: 74 | MeanAbsoluteError: 0.0875259563326836 | Loss: 0.0097498211211392 | Epoch: 75 | MeanAbsoluteError: 0.0928220003843307 | Loss: 0.0098743948952428 | Epoch: 76 | MeanAbsoluteError: 0.0284844450652599 | Loss: 0.0011831763716015 | 
Epoch: 77 | MeanAbsoluteError: 0.0163068752735853 | Loss: 0.0003776757761703 | Epoch: 78 | MeanAbsoluteError: 0.0636973977088928 | Loss: 0.0054372407362929 | Epoch: 79 | MeanAbsoluteError: 0.0831598117947578 | Loss: 0.0078974886398230 | Epoch: 80 | MeanAbsoluteError: 0.0261406898498535 | Loss: 0.0011869874932537 | Epoch: 81 | 
MeanAbsoluteError: 0.0205963738262653 | Loss: 0.0006624557302400 | Epoch: 82 | MeanAbsoluteError: 0.0511679761111736 | Loss: 0.0032213641929307 | Epoch: 83 | MeanAbsoluteError: 0.0574358925223351 | Loss: 0.0053974874650261 | Epoch: 84 | MeanAbsoluteError: 0.0609631836414337 | Loss: 0.0049462564721970 | Epoch: 85 | MeanAbsoluteError: 0.0116222938522696 | Loss: 0.0002038694739375 | Epoch: 86 | 
MeanAbsoluteError: 0.0134173873811960 | Loss: 0.0002329777988572 | Epoch: 87 | MeanAbsoluteError: 0.0266865715384483 | Loss: 0.0024065822446054 | Epoch: 88 | MeanAbsoluteError: 0.0713756158947945 | Loss: 0.0061095899104008 | Epoch: 89 | MeanAbsoluteError: 0.0148691227659583 | Loss: 0.0022091276316912 | Epoch: 90 | MeanAbsoluteError: 0.0461485758423805 | Loss: 0.0038267946802080 | Epoch: 91 | 
MeanAbsoluteError: 0.0181999150663614 | Loss: 0.0005280607646065 | Epoch: 92 | MeanAbsoluteError: 0.0561368577182293 | Loss: 0.0054448834686939 | Epoch: 93 | MeanAbsoluteError: 0.0790244787931442 | Loss: 0.0088576884008944 | Epoch: 94 | MeanAbsoluteError: 0.0616889894008636 | Loss: 0.0049430828741086 | Epoch: 95 | MeanAbsoluteError: 0.0570034533739090 | Loss: 0.0036205423862806 | 
Epoch: 96 | MeanAbsoluteError: 0.0277503449469805 | Loss: 0.0010500211667802 | Epoch: 97 | MeanAbsoluteError: 0.0836593359708786 | Loss: 0.0071502055839768 | Epoch: 98 | MeanAbsoluteError: 0.0190600007772446 | Loss: 0.0006134564131831 | Epoch: 99 | MeanAbsoluteError: 0.0398324429988861 | Loss: 0.0028359419998846 | Epoch: 100 | 
MeanAbsoluteError: 0.0320896282792091 | Loss: 0.0013752138474956 | Epoch: 101 | MeanAbsoluteError: 0.0709237530827522 | Loss: 0.0078849549006139 | Epoch: 102 | MeanAbsoluteError: 0.0595054775476456 | Loss: 0.0056432893366686 | Epoch: 103 | MeanAbsoluteError: 0.0483052618801594 | Loss: 0.0029740535121943 | Epoch: 104 | MeanAbsoluteError: 0.0657604485750198 | Loss: 0.0055877383399223 | Epoch: 105 | 
MeanAbsoluteError: 0.0186141617596149 | Loss: 0.0006186245591380 | Epoch: 106 | MeanAbsoluteError: 0.0513558574020863 | Loss: 0.0039145412655281 | Epoch: 107 | MeanAbsoluteError: 0.0465803891420364 | Loss: 0.0028827497735620 | Epoch: 108 | MeanAbsoluteError: 0.0313127487897873 | Loss: 0.0013714958747317 | Epoch: 109 | MeanAbsoluteError: 0.0316991806030273 | Loss: 0.0011416923121682 | 
Epoch: 110 | MeanAbsoluteError: 0.0536461845040321 | Loss: 0.0032956087961793 | Epoch: 111 | MeanAbsoluteError: 0.0455507189035416 | Loss: 0.0034713388553688 | Epoch: 112 | MeanAbsoluteError: 0.0591510348021984 | Loss: 0.0039885844370084 | Epoch: 113 | MeanAbsoluteError: 0.0826397910714149 | Loss: 0.0081651895972235 | Epoch: 114 | 
MeanAbsoluteError: 0.0296522993594408 | Loss: 0.0010884052774470 | Epoch: 115 | MeanAbsoluteError: 0.0210917852818966 | Loss: 0.0011272301344434 | Epoch: 116 | MeanAbsoluteError: 0.0167038496583700 | Loss: 0.0004629150306365 | Epoch: 117 | MeanAbsoluteError: 0.0575824864208698 | Loss: 0.0050008650869131 | Early stopping at epoch 116
Fold: 6
Epoch: 1 | MeanAbsoluteError: 0.1950235962867737 | Loss: 0.0506039376237563 | 
Epoch: 2 | MeanAbsoluteError: 0.1536903977394104 | Loss: 0.0325084541525160 | Epoch: 3 | MeanAbsoluteError: 0.1029528602957726 | Loss: 0.0157123526026096 | Epoch: 4 | MeanAbsoluteError: 0.1172966286540031 | Loss: 0.0203536339769406 | Epoch: 5 | MeanAbsoluteError: 0.0980603620409966 | Loss: 0.0156119330120938 | Epoch: 6 | 
MeanAbsoluteError: 0.1642319858074188 | Loss: 0.0370862204581499 | Epoch: 7 | MeanAbsoluteError: 0.0676772519946098 | Loss: 0.0071453911119274 | Epoch: 8 | MeanAbsoluteError: 0.0998761579394341 | Loss: 0.0134687711750822 | Epoch: 9 | MeanAbsoluteError: 0.0618037469685078 | Loss: 0.0063992864868071 | Epoch: 10 | MeanAbsoluteError: 0.0770561993122101 | Loss: 0.0081592464287366 | 
Epoch: 11 | MeanAbsoluteError: 0.1595982313156128 | Loss: 0.0294886960514954 | Epoch: 12 | MeanAbsoluteError: 0.0570953525602818 | Loss: 0.0049000015881445 | Epoch: 13 | MeanAbsoluteError: 0.1617123037576675 | Loss: 0.0276999082416296 | Epoch: 14 | MeanAbsoluteError: 0.0305472500622272 | Loss: 0.0015524459221134 | Epoch: 15 | 
MeanAbsoluteError: 0.0888141915202141 | Loss: 0.0116886243756328 | Epoch: 16 | MeanAbsoluteError: 0.0308904629200697 | Loss: 0.0021709593877728 | Epoch: 17 | MeanAbsoluteError: 0.0732812508940697 | Loss: 0.0085696748324803 | Epoch: 18 | MeanAbsoluteError: 0.0401262603700161 | Loss: 0.0038563269024183 | Epoch: 19 | MeanAbsoluteError: 0.1856592893600464 | Loss: 0.0354930471096720 | 
Epoch: 20 | MeanAbsoluteError: 0.0494714751839638 | Loss: 0.0034365441783198 | Epoch: 21 | MeanAbsoluteError: 0.0480886325240135 | Loss: 0.0033304992664073 | Epoch: 22 | MeanAbsoluteError: 0.1427503526210785 | Loss: 0.0211297241704805 | Epoch: 23 | 
MeanAbsoluteError: 0.0446303747594357 | Loss: 0.0025419015769980 | Epoch: 24 | MeanAbsoluteError: 0.0278590563684702 | Loss: 0.0017780804690639 | Epoch: 25 | MeanAbsoluteError: 0.0883297547698021 | Loss: 0.0095258485525846 | Epoch: 26 | MeanAbsoluteError: 0.0305791236460209 | Loss: 0.0011066741842244 | Epoch: 27 | MeanAbsoluteError: 0.0194856412708759 | Loss: 0.0007851233739140 | 
Epoch: 28 | MeanAbsoluteError: 0.0968534648418427 | Loss: 0.0104748339924429 | Epoch: 29 | MeanAbsoluteError: 0.0353865996003151 | Loss: 0.0019277813345460 | Epoch: 30 | MeanAbsoluteError: 0.0933705717325211 | Loss: 0.0091927248452391 | Epoch: 31 | 
MeanAbsoluteError: 0.1033700257539749 | Loss: 0.0153430416913969 | Epoch: 32 | MeanAbsoluteError: 0.0525323636829853 | Loss: 0.0036446413557444 | Epoch: 33 | MeanAbsoluteError: 0.0191033165901899 | Loss: 0.0013917096480977 | Epoch: 34 | MeanAbsoluteError: 0.0498255714774132 | Loss: 0.0045558371514614 | Epoch: 35 | MeanAbsoluteError: 0.0439303293824196 | Loss: 0.0023275546596519 | Epoch: 36 | 
MeanAbsoluteError: 0.0970114693045616 | Loss: 0.0114608735644392 | Epoch: 37 | MeanAbsoluteError: 0.0299968905746937 | Loss: 0.0046941229333502 | Epoch: 38 | MeanAbsoluteError: 0.0313629545271397 | Loss: 0.0013902109764915 | Epoch: 39 | MeanAbsoluteError: 0.0969822034239769 | Loss: 0.0119494822408472 | Epoch: 40 | MeanAbsoluteError: 0.1057933494448662 | Loss: 0.0122614872774908 | Epoch: 41 | 
MeanAbsoluteError: 0.0313361920416355 | Loss: 0.0012400916561351 | Epoch: 42 | MeanAbsoluteError: 0.0505751334130764 | Loss: 0.0051384563557804 | Epoch: 43 | MeanAbsoluteError: 0.0193615872412920 | Loss: 0.0006143296860890 | Epoch: 44 | MeanAbsoluteError: 0.0501393973827362 | Loss: 0.0032193907869181 | Epoch: 45 | MeanAbsoluteError: 0.1126857772469521 | Loss: 0.0130009108356067 | 
Epoch: 46 | MeanAbsoluteError: 0.0468416959047318 | Loss: 0.0039319535384753 | Epoch: 47 | MeanAbsoluteError: 0.0562790669500828 | Loss: 0.0042469796525048 | Epoch: 48 | MeanAbsoluteError: 0.1001624092459679 | Loss: 0.0103201299373593 | Epoch: 49 | MeanAbsoluteError: 0.0508447326719761 | Loss: 0.0038164074399642 | 
Epoch: 50 | MeanAbsoluteError: 0.0631677210330963 | Loss: 0.0078057095275394 | Epoch: 51 | MeanAbsoluteError: 0.0590364038944244 | Loss: 0.0036106587587191 | Epoch: 52 | MeanAbsoluteError: 0.0441858321428299 | Loss: 0.0021281370593767 | Epoch: 53 | 
MeanAbsoluteError: 0.1068550944328308 | Loss: 0.0121606163946646 | Epoch: 54 | MeanAbsoluteError: 0.1060797870159149 | Loss: 0.0116145918145776 | Epoch: 55 | MeanAbsoluteError: 0.1011842787265778 | Loss: 0.0106715304510934 | Epoch: 56 | MeanAbsoluteError: 0.0720862820744514 | Loss: 0.0067501296289265 | Epoch: 57 | 
MeanAbsoluteError: 0.0316695831716061 | Loss: 0.0018961605133622 | Epoch: 58 | MeanAbsoluteError: 0.0492111295461655 | Loss: 0.0048096385518355 | Epoch: 59 | MeanAbsoluteError: 0.0812727138400078 | Loss: 0.0086356830517096 | Epoch: 60 | MeanAbsoluteError: 0.0351922474801540 | Loss: 0.0021351314914812 | Epoch: 61 | 
MeanAbsoluteError: 0.0518552102148533 | Loss: 0.0032455667886617 | Epoch: 62 | MeanAbsoluteError: 0.0168409198522568 | Loss: 0.0005291145207593 | Epoch: 63 | MeanAbsoluteError: 0.0931853801012039 | Loss: 0.0101716302202216 | Epoch: 64 | MeanAbsoluteError: 0.0679589509963989 | Loss: 0.0055178673272686 | Epoch: 65 | 
MeanAbsoluteError: 0.0569388158619404 | Loss: 0.0038845456271831 | Epoch: 66 | MeanAbsoluteError: 0.0460489280521870 | Loss: 0.0029748969578317 | Epoch: 67 | MeanAbsoluteError: 0.0684212371706963 | Loss: 0.0062270088653479 | Epoch: 68 | MeanAbsoluteError: 0.0306626018136740 | Loss: 0.0016242845033828 | Epoch: 69 | 
MeanAbsoluteError: 0.0280663948506117 | Loss: 0.0013040836950365 | Epoch: 70 | MeanAbsoluteError: 0.0548372082412243 | Loss: 0.0033448191825300 | Epoch: 71 | MeanAbsoluteError: 0.1083421111106873 | Loss: 0.0131800732176219 | Epoch: 72 | MeanAbsoluteError: 0.0106636695563793 | Loss: 0.0002627765331584 | Epoch: 73 | MeanAbsoluteError: 0.0527908280491829 | Loss: 0.0032601135317236 | 
Epoch: 74 | MeanAbsoluteError: 0.0251993760466576 | Loss: 0.0010822441212700 | Epoch: 75 | MeanAbsoluteError: 0.0725027397274971 | Loss: 0.0063264329385545 | Epoch: 76 | MeanAbsoluteError: 0.0254174154251814 | Loss: 0.0007815659046173 | Epoch: 77 | 
MeanAbsoluteError: 0.0183263197541237 | Loss: 0.0005609530583440 | Epoch: 78 | MeanAbsoluteError: 0.0212521813809872 | Loss: 0.0005783580542941 | Epoch: 79 | MeanAbsoluteError: 0.0788594260811806 | Loss: 0.0068803047761321 | Epoch: 80 | MeanAbsoluteError: 0.0208207592368126 | Loss: 0.0006499763944053 | Epoch: 81 | 
MeanAbsoluteError: 0.0267464779317379 | Loss: 0.0010592431062832 | Epoch: 82 | MeanAbsoluteError: 0.0217894688248634 | Loss: 0.0006926012990464 | Epoch: 83 | MeanAbsoluteError: 0.0395281799137592 | Loss: 0.0017716510587239 | Epoch: 84 | MeanAbsoluteError: 0.0550790727138519 | Loss: 0.0040674123114773 | Epoch: 85 | 
MeanAbsoluteError: 0.1256550252437592 | Loss: 0.0176703009222235 | Epoch: 86 | MeanAbsoluteError: 0.0843215733766556 | Loss: 0.0081206715798804 | Epoch: 87 | MeanAbsoluteError: 0.0526957660913467 | Loss: 0.0048649920084115 | Epoch: 88 | MeanAbsoluteError: 0.0492047443985939 | Loss: 0.0044565567513928 | Epoch: 89 | MeanAbsoluteError: 0.0916253104805946 | Loss: 0.0084088811916964 | 
Epoch: 90 | MeanAbsoluteError: 0.0638537183403969 | Loss: 0.0072575292017843 | Epoch: 91 | MeanAbsoluteError: 0.0547722205519676 | Loss: 0.0054255325480231 | Epoch: 92 | MeanAbsoluteError: 0.0296619944274426 | Loss: 0.0017841372339587 | Epoch: 93 | MeanAbsoluteError: 0.0300752632319927 | Loss: 0.0011084786050820 | Epoch: 94 | 
MeanAbsoluteError: 0.0797337889671326 | Loss: 0.0066563898830542 | Epoch: 95 | MeanAbsoluteError: 0.0645461976528168 | Loss: 0.0063053149996059 | Epoch: 96 | MeanAbsoluteError: 0.0406567007303238 | Loss: 0.0017949526996485 | Epoch: 97 | MeanAbsoluteError: 0.0259984061121941 | Loss: 0.0008716480390701 | Epoch: 98 | 
MeanAbsoluteError: 0.1087990552186966 | Loss: 0.0121991429477930 | Epoch: 99 | MeanAbsoluteError: 0.0252857059240341 | Loss: 0.0008155295093145 | Epoch: 100 | MeanAbsoluteError: 0.0749030336737633 | Loss: 0.0059570152578609 | Epoch: 101 | MeanAbsoluteError: 0.0114435115829110 | Loss: 0.0003578543816859 | Epoch: 102 | MeanAbsoluteError: 0.0443598739802837 | Loss: 0.0036545253824443 | 
Epoch: 103 | MeanAbsoluteError: 0.0242254883050919 | Loss: 0.0009136091393884 | Epoch: 104 | MeanAbsoluteError: 0.0505714453756809 | Loss: 0.0046345353060003 | Early stopping at epoch 103
Fold: 7
Epoch: 1 | MeanAbsoluteError: 0.1609563380479813 | Loss: 0.0336329851831709 | Epoch: 2 | MeanAbsoluteError: 0.1898842453956604 | Loss: 0.0467206101332392 | 
Epoch: 3 | MeanAbsoluteError: 0.1150288954377174 | Loss: 0.0201554346297468 | Epoch: 4 | MeanAbsoluteError: 0.1073938459157944 | Loss: 0.0178263661052500 | Epoch: 5 | MeanAbsoluteError: 0.0978396534919739 | Loss: 0.0147814655543438 | Epoch: 6 | 
MeanAbsoluteError: 0.1058414280414581 | Loss: 0.0172596782712000 | Epoch: 7 | MeanAbsoluteError: 0.0903423950076103 | Loss: 0.0109711779015405 | Epoch: 8 | MeanAbsoluteError: 0.1057201102375984 | Loss: 0.0204456177140985 | Epoch: 9 | MeanAbsoluteError: 0.0842994973063469 | Loss: 0.0085443502425083 | Epoch: 10 | 
MeanAbsoluteError: 0.0736942887306213 | Loss: 0.0075704877131752 | Epoch: 11 | MeanAbsoluteError: 0.1454999595880508 | Loss: 0.0237582134349006 | Epoch: 12 | MeanAbsoluteError: 0.1451305598020554 | Loss: 0.0240590170558010 | Epoch: 13 | MeanAbsoluteError: 0.1440607905387878 | Loss: 0.0240360128560237 | Epoch: 14 | 
MeanAbsoluteError: 0.0859181284904480 | Loss: 0.0094089563935995 | Epoch: 15 | MeanAbsoluteError: 0.1155444830656052 | Loss: 0.0160393909152065 | Epoch: 16 | MeanAbsoluteError: 0.0295851919800043 | Loss: 0.0017934917788287 | Epoch: 17 | MeanAbsoluteError: 0.1530549526214600 | Loss: 0.0248576128589255 | Epoch: 18 | 
MeanAbsoluteError: 0.0676637813448906 | Loss: 0.0081525588674205 | Epoch: 19 | MeanAbsoluteError: 0.0778286755084991 | Loss: 0.0072740820635642 | Epoch: 20 | MeanAbsoluteError: 0.1203886121511459 | Loss: 0.0156473884625094 | Epoch: 21 | MeanAbsoluteError: 0.0532175488770008 | Loss: 0.0038757624237665 | Epoch: 22 | 
MeanAbsoluteError: 0.1221880167722702 | Loss: 0.0159677003643342 | Epoch: 23 | MeanAbsoluteError: 0.0789653137326241 | Loss: 0.0066730349457690 | Epoch: 24 | MeanAbsoluteError: 0.1488992869853973 | Loss: 0.0232065886791263 | Epoch: 25 | MeanAbsoluteError: 0.1096496284008026 | Loss: 0.0127510327313628 | Epoch: 26 | 
MeanAbsoluteError: 0.0658180415630341 | Loss: 0.0048504641745239 | Epoch: 27 | MeanAbsoluteError: 0.0746377035975456 | Loss: 0.0062117611191102 | Epoch: 28 | MeanAbsoluteError: 0.0795656815171242 | Loss: 0.0109179812217397 | Epoch: 29 | MeanAbsoluteError: 0.1007967665791512 | Loss: 0.0110887509903737 | Epoch: 30 | 
MeanAbsoluteError: 0.0583497807383537 | Loss: 0.0041387841837215 | Epoch: 31 | MeanAbsoluteError: 0.0698600336909294 | Loss: 0.0053221087769738 | Epoch: 32 | MeanAbsoluteError: 0.1249903514981270 | Loss: 0.0160946457513741 | Epoch: 33 | MeanAbsoluteError: 0.0690218135714531 | Loss: 0.0054343420280410 | Epoch: 34 | 
MeanAbsoluteError: 0.0742945298552513 | Loss: 0.0060888101080699 | Epoch: 35 | MeanAbsoluteError: 0.0501404255628586 | Loss: 0.0027723964303732 | Epoch: 36 | MeanAbsoluteError: 0.0599724911153316 | Loss: 0.0040359465471868 | Epoch: 37 | MeanAbsoluteError: 0.0274025630205870 | Loss: 0.0014635247893498 | Epoch: 38 | 
MeanAbsoluteError: 0.0146734025329351 | Loss: 0.0003341957989116 | Epoch: 39 | MeanAbsoluteError: 0.0487922951579094 | Loss: 0.0039846016360181 | Epoch: 40 | MeanAbsoluteError: 0.0659610927104950 | Loss: 0.0058212717995048 | Epoch: 41 | MeanAbsoluteError: 0.0166627746075392 | Loss: 0.0006542168765528 | Epoch: 42 | 
MeanAbsoluteError: 0.0269919577986002 | Loss: 0.0010777790282321 | Epoch: 43 | MeanAbsoluteError: 0.0270567182451487 | Loss: 0.0009578065863544 | Epoch: 44 | MeanAbsoluteError: 0.0432259216904640 | Loss: 0.0027064810606784 | Epoch: 45 | MeanAbsoluteError: 0.0555249676108360 | Loss: 0.0046664749471737 | Epoch: 46 | 
MeanAbsoluteError: 0.0255558770149946 | Loss: 0.0012700135620045 | Epoch: 47 | MeanAbsoluteError: 0.0351677313446999 | Loss: 0.0017946681473404 | Epoch: 48 | MeanAbsoluteError: 0.0395101346075535 | Loss: 0.0025727536994964 | Epoch: 49 | MeanAbsoluteError: 0.0809170752763748 | Loss: 0.0076482233458332 | Epoch: 50 | 
MeanAbsoluteError: 0.0162768401205540 | Loss: 0.0004249474191706 | Epoch: 51 | MeanAbsoluteError: 0.0662170797586441 | Loss: 0.0062983971687832 | Epoch: 52 | MeanAbsoluteError: 0.0673084631562233 | Loss: 0.0050215403815465 | Epoch: 53 | MeanAbsoluteError: 0.0395420603454113 | Loss: 0.0018045644974336 | Epoch: 54 | 
MeanAbsoluteError: 0.0734096542000771 | Loss: 0.0058375823843692 | Epoch: 55 | MeanAbsoluteError: 0.0232145618647337 | Loss: 0.0009000557516369 | Epoch: 56 | MeanAbsoluteError: 0.0453947149217129 | Loss: 0.0022316485909479 | Epoch: 57 | MeanAbsoluteError: 0.0114982249215245 | Loss: 0.0002518459150451 | Epoch: 58 | 
MeanAbsoluteError: 0.0690433308482170 | Loss: 0.0058872109012944 | Epoch: 59 | MeanAbsoluteError: 0.0503594055771828 | Loss: 0.0027466824810420 | Epoch: 60 | MeanAbsoluteError: 0.0605665892362595 | Loss: 0.0053305272678179 | Epoch: 61 | MeanAbsoluteError: 0.0395152680575848 | Loss: 0.0022091818141884 | Epoch: 62 | 
MeanAbsoluteError: 0.0448567233979702 | Loss: 0.0029084903154788 | Epoch: 63 | MeanAbsoluteError: 0.0343662798404694 | Loss: 0.0013926181210471 | Epoch: 64 | MeanAbsoluteError: 0.1032196730375290 | Loss: 0.0116541128871696 | Epoch: 65 | MeanAbsoluteError: 0.0243404880166054 | Loss: 0.0011566414406324 | Epoch: 66 | 
MeanAbsoluteError: 0.0529902353882790 | Loss: 0.0035422066492694 | Epoch: 67 | MeanAbsoluteError: 0.0271496828645468 | Loss: 0.0014711277659184 | Epoch: 68 | MeanAbsoluteError: 0.0312769711017609 | Loss: 0.0014573481333043 | Epoch: 69 | MeanAbsoluteError: 0.0364798866212368 | Loss: 0.0037709441801001 | Epoch: 70 | 
MeanAbsoluteError: 0.0452557913959026 | Loss: 0.0033908123150468 | Epoch: 71 | MeanAbsoluteError: 0.0550894849002361 | Loss: 0.0041558111552149 | Epoch: 72 | MeanAbsoluteError: 0.1087918728590012 | Loss: 0.0124691224523953 | Epoch: 73 | MeanAbsoluteError: 0.0460104607045650 | Loss: 0.0022206008600603 | Epoch: 74 | 
MeanAbsoluteError: 0.0835668444633484 | Loss: 0.0085380097318973 | Epoch: 75 | MeanAbsoluteError: 0.0248660519719124 | Loss: 0.0009760265134641 | Epoch: 76 | MeanAbsoluteError: 0.0387217849493027 | Loss: 0.0022105438900845 | Epoch: 77 | MeanAbsoluteError: 0.0775893703103065 | Loss: 0.0082896986444082 | Epoch: 78 | 
MeanAbsoluteError: 0.0516755394637585 | Loss: 0.0040824396003570 | Epoch: 79 | MeanAbsoluteError: 0.1009475812315941 | Loss: 0.0107682407168405 | Epoch: 80 | MeanAbsoluteError: 0.0527359433472157 | Loss: 0.0032450521830469 | Epoch: 81 | MeanAbsoluteError: 0.0614903792738914 | Loss: 0.0046841563390834 | Epoch: 82 | 
MeanAbsoluteError: 0.0918752476572990 | Loss: 0.0096823378865208 | Epoch: 83 | MeanAbsoluteError: 0.0945500358939171 | Loss: 0.0091788626409003 | Epoch: 84 | MeanAbsoluteError: 0.0878500863909721 | Loss: 0.0080534366092512 | Epoch: 85 | MeanAbsoluteError: 0.0603362545371056 | Loss: 0.0040016999202115 | Epoch: 86 | MeanAbsoluteError: 0.0632812008261681 | Loss: 0.0046639419160783 | 
Epoch: 87 | MeanAbsoluteError: 0.0281848981976509 | Loss: 0.0010487623180130 | Epoch: 88 | MeanAbsoluteError: 0.0399275049567223 | Loss: 0.0018174923025072 | Epoch: 89 | MeanAbsoluteError: 0.0442158840596676 | Loss: 0.0030755110617195 | Early stopping at epoch 88
Fold: 8
Epoch: 1 | 
MeanAbsoluteError: 0.1535099744796753 | Loss: 0.0348269388611828 | Epoch: 2 | MeanAbsoluteError: 0.1193537041544914 | Loss: 0.0199146890746696 | Epoch: 3 | MeanAbsoluteError: 0.1918441206216812 | Loss: 0.0487929987055915 | Epoch: 4 | MeanAbsoluteError: 0.2200849503278732 | Loss: 0.0536121454622064 | Epoch: 5 | 
MeanAbsoluteError: 0.0896589830517769 | Loss: 0.0109885242501540 | Epoch: 6 | MeanAbsoluteError: 0.1479929089546204 | Loss: 0.0271658381181104 | Epoch: 7 | MeanAbsoluteError: 0.0521375052630901 | Loss: 0.0043062098390822 | Epoch: 8 | MeanAbsoluteError: 0.0803080350160599 | Loss: 0.0086960622242519 | Epoch: 9 | 
MeanAbsoluteError: 0.0737851038575172 | Loss: 0.0072492320489671 | Epoch: 10 | MeanAbsoluteError: 0.0689747631549835 | Loss: 0.0066197301327650 | Epoch: 11 | MeanAbsoluteError: 0.0839711129665375 | Loss: 0.0085343155743820 | Epoch: 12 | MeanAbsoluteError: 0.0384578593075275 | Loss: 0.0022732926798718 | Epoch: 13 | 
MeanAbsoluteError: 0.0949116349220276 | Loss: 0.0127112220174500 | Epoch: 14 | MeanAbsoluteError: 0.0489758625626564 | Loss: 0.0034496556368790 | Epoch: 15 | MeanAbsoluteError: 0.0848037973046303 | Loss: 0.0087530183871942 | Epoch: 16 | MeanAbsoluteError: 0.0637854188680649 | Loss: 0.0048563892154821 | Epoch: 17 | 
MeanAbsoluteError: 0.0481798350811005 | Loss: 0.0032464009709656 | Epoch: 18 | MeanAbsoluteError: 0.0631908401846886 | Loss: 0.0054866449707853 | Epoch: 19 | MeanAbsoluteError: 0.2169472873210907 | Loss: 0.0481726314340319 | Epoch: 20 | MeanAbsoluteError: 0.0852161496877670 | Loss: 0.0079300367672529 | Epoch: 21 | 
MeanAbsoluteError: 0.0894903019070625 | Loss: 0.0087802550489349 | Epoch: 22 | MeanAbsoluteError: 0.0835938081145287 | Loss: 0.0083404353021511 | Epoch: 23 | MeanAbsoluteError: 0.1387533098459244 | Loss: 0.0201875751039812 | Epoch: 24 | MeanAbsoluteError: 0.1079445183277130 | Loss: 0.0131106658705643 | Epoch: 25 | 
MeanAbsoluteError: 0.1221547499299049 | Loss: 0.0177409849794848 | Epoch: 26 | MeanAbsoluteError: 0.0731521323323250 | Loss: 0.0062249638805432 | Epoch: 27 | MeanAbsoluteError: 0.0473313033580780 | Loss: 0.0030303212947079 | Epoch: 28 | 
MeanAbsoluteError: 0.0859970599412918 | Loss: 0.0085699984670750 | Epoch: 29 | MeanAbsoluteError: 0.0482830442488194 | Loss: 0.0042505358744945 | Epoch: 30 | MeanAbsoluteError: 0.0677324458956718 | Loss: 0.0064308777052377 | Epoch: 31 | MeanAbsoluteError: 0.0634723380208015 | Loss: 0.0058426947798580 | Epoch: 32 | 
MeanAbsoluteError: 0.1321652382612228 | Loss: 0.0178116102303777 | Epoch: 33 | MeanAbsoluteError: 0.0547842159867287 | Loss: 0.0037937742391867 | Epoch: 34 | MeanAbsoluteError: 0.0490750186145306 | Loss: 0.0034646601416171 | Epoch: 35 | MeanAbsoluteError: 0.0184496287256479 | Loss: 0.0004898685661569 | Epoch: 36 | 
MeanAbsoluteError: 0.0645987764000893 | Loss: 0.0064078797253647 | Epoch: 37 | MeanAbsoluteError: 0.0863616168498993 | Loss: 0.0078705936404211 | Epoch: 38 | MeanAbsoluteError: 0.1341207176446915 | Loss: 0.0187270023993083 | Epoch: 39 | MeanAbsoluteError: 0.0781791508197784 | Loss: 0.0075192100235394 | Epoch: 40 | 
MeanAbsoluteError: 0.0717539340257645 | Loss: 0.0059953776321241 | Epoch: 41 | MeanAbsoluteError: 0.0658156424760818 | Loss: 0.0048450673930347 | Epoch: 42 | MeanAbsoluteError: 0.0777226537466049 | Loss: 0.0063079387348677 | Epoch: 43 | MeanAbsoluteError: 0.0816709920763969 | Loss: 0.0101541103129940 | Epoch: 44 | 
MeanAbsoluteError: 0.1025453060865402 | Loss: 0.0133713217718261 | Epoch: 45 | MeanAbsoluteError: 0.0393124036490917 | Loss: 0.0021953214808101 | Epoch: 46 | MeanAbsoluteError: 0.0495055578649044 | Loss: 0.0028108382664089 | Epoch: 47 | MeanAbsoluteError: 0.0476361364126205 | Loss: 0.0033070488965937 | Epoch: 48 | 
MeanAbsoluteError: 0.0279767625033855 | Loss: 0.0010750328406825 | Epoch: 49 | MeanAbsoluteError: 0.0825482755899429 | Loss: 0.0074630164142166 | Epoch: 50 | MeanAbsoluteError: 0.1077794805169106 | Loss: 0.0120206088093775 | Epoch: 51 | MeanAbsoluteError: 0.0295483898371458 | Loss: 0.0027917307202837 | Epoch: 52 | 
MeanAbsoluteError: 0.0620115809142590 | Loss: 0.0061142587967749 | Epoch: 53 | MeanAbsoluteError: 0.0354796648025513 | Loss: 0.0023733254721654 | Epoch: 54 | MeanAbsoluteError: 0.0714817941188812 | Loss: 0.0068184825192605 | Epoch: 55 | MeanAbsoluteError: 0.0697838962078094 | Loss: 0.0052558961324394 | Epoch: 56 | 
MeanAbsoluteError: 0.1002169623970985 | Loss: 0.0112586749850639 | Epoch: 57 | MeanAbsoluteError: 0.0300662275403738 | Loss: 0.0011503396921658 | Epoch: 58 | MeanAbsoluteError: 0.0715685412287712 | Loss: 0.0072708944790065 | Epoch: 59 | MeanAbsoluteError: 0.0333186276257038 | Loss: 0.0015220040056322 | Epoch: 60 | 
MeanAbsoluteError: 0.1233097612857819 | Loss: 0.0151980504659670 | Epoch: 61 | MeanAbsoluteError: 0.1031742691993713 | Loss: 0.0106755431209292 | Epoch: 62 | MeanAbsoluteError: 0.0670470073819160 | Loss: 0.0078764088518385 | Epoch: 63 | MeanAbsoluteError: 0.0854857414960861 | Loss: 0.0081384380880211 | Epoch: 64 | 
MeanAbsoluteError: 0.0184523891657591 | Loss: 0.0005006327410229 | Epoch: 65 | MeanAbsoluteError: 0.0777706131339073 | Loss: 0.0067601668914514 | Epoch: 66 | MeanAbsoluteError: 0.0391710773110390 | Loss: 0.0026871954157416 | Epoch: 67 | MeanAbsoluteError: 0.0561163388192654 | Loss: 0.0036388941641365 | Early stopping at epoch 66
Fold: 9
Epoch: 1 | 
MeanAbsoluteError: 0.1657859683036804 | Loss: 0.0370088948735169 | Epoch: 2 | MeanAbsoluteError: 0.1109316721558571 | Loss: 0.0222987402230501 | Epoch: 3 | MeanAbsoluteError: 0.1582045406103134 | Loss: 0.0320890206577522 | Epoch: 4 | MeanAbsoluteError: 0.1409308016300201 | Loss: 0.0254776872960585 | Epoch: 5 | 
MeanAbsoluteError: 0.0711264312267303 | Loss: 0.0100792681665293 | Epoch: 6 | MeanAbsoluteError: 0.0975055918097496 | Loss: 0.0144998444510358 | Epoch: 7 | MeanAbsoluteError: 0.1598387360572815 | Loss: 0.0323676695781095 | Epoch: 8 | MeanAbsoluteError: 0.1475517302751541 | Loss: 0.0275754779577255 | Epoch: 9 | 
MeanAbsoluteError: 0.0765296369791031 | Loss: 0.0128159355039575 | Epoch: 10 | MeanAbsoluteError: 0.0861884951591492 | Loss: 0.0098496898343521 | Epoch: 11 | MeanAbsoluteError: 0.0941406711935997 | Loss: 0.0126262235322169 | Epoch: 12 | MeanAbsoluteError: 0.0695992261171341 | Loss: 0.0069900167706822 | Epoch: 13 | 
MeanAbsoluteError: 0.1906548738479614 | Loss: 0.0375907953296389 | Epoch: 14 | MeanAbsoluteError: 0.0372782982885838 | Loss: 0.0024574476327481 | Epoch: 15 | MeanAbsoluteError: 0.0348807610571384 | Loss: 0.0019784137839451 | Epoch: 16 | MeanAbsoluteError: 0.1163853183388710 | Loss: 0.0164944584082280 | Epoch: 17 | 
MeanAbsoluteError: 0.0310148615390062 | Loss: 0.0015150973756265 | Epoch: 18 | MeanAbsoluteError: 0.1720049083232880 | Loss: 0.0313720647245646 | Epoch: 19 | MeanAbsoluteError: 0.1179847419261932 | Loss: 0.0151916388422251 | Epoch: 20 | MeanAbsoluteError: 0.0305314417928457 | Loss: 0.0019952311579670 | Epoch: 21 | 
MeanAbsoluteError: 0.0772490203380585 | Loss: 0.0098006964794227 | Epoch: 22 | MeanAbsoluteError: 0.0530386529862881 | Loss: 0.0044778481658016 | Epoch: 23 | MeanAbsoluteError: 0.1228047683835030 | Loss: 0.0153232947258013 | Epoch: 24 | MeanAbsoluteError: 0.0403862372040749 | Loss: 0.0023547381694828 | Epoch: 25 | 
MeanAbsoluteError: 0.0908226892352104 | Loss: 0.0091217321210674 | Epoch: 26 | MeanAbsoluteError: 0.0570431239902973 | Loss: 0.0051792163534888 | Epoch: 27 | MeanAbsoluteError: 0.0525885596871376 | Loss: 0.0050567228879247 | Epoch: 28 | MeanAbsoluteError: 0.0692638233304024 | Loss: 0.0051313068584672 | Epoch: 29 | 
MeanAbsoluteError: 0.0386270284652710 | Loss: 0.0023895060377462 | Epoch: 30 | MeanAbsoluteError: 0.0409907065331936 | Loss: 0.0026866373539503 | Epoch: 31 | MeanAbsoluteError: 0.0563966408371925 | Loss: 0.0049975831394217 | Epoch: 32 | MeanAbsoluteError: 0.0241193156689405 | Loss: 0.0008985136519186 | Epoch: 33 | 
MeanAbsoluteError: 0.0402029529213905 | Loss: 0.0024399065046704 | Epoch: 34 | MeanAbsoluteError: 0.1636538654565811 | Loss: 0.0283316589359726 | Epoch: 35 | MeanAbsoluteError: 0.0695990324020386 | Loss: 0.0059974284709564 | Epoch: 36 | MeanAbsoluteError: 0.1042935177683830 | Loss: 0.0122230449425323 | Epoch: 37 | 
MeanAbsoluteError: 0.0697705820202827 | Loss: 0.0078828743925052 | Epoch: 38 | MeanAbsoluteError: 0.0411719270050526 | Loss: 0.0022942570171186 | Epoch: 39 | MeanAbsoluteError: 0.1036009117960930 | Loss: 0.0115249971193927 | Epoch: 40 | MeanAbsoluteError: 0.0517226159572601 | Loss: 0.0042004658108843 | Epoch: 41 | 
MeanAbsoluteError: 0.1316391825675964 | Loss: 0.0181044477171132 | Epoch: 42 | MeanAbsoluteError: 0.0369045585393906 | Loss: 0.0016882128381569 | Epoch: 43 | MeanAbsoluteError: 0.0551717132329941 | Loss: 0.0048024881564613 | Epoch: 44 | MeanAbsoluteError: 0.0680872425436974 | Loss: 0.0051054351164826 | Epoch: 45 | 
MeanAbsoluteError: 0.0202519372105598 | Loss: 0.0007572719769087 | Epoch: 46 | MeanAbsoluteError: 0.0864084064960480 | Loss: 0.0081732247157821 | Epoch: 47 | MeanAbsoluteError: 0.0497635900974274 | Loss: 0.0030713438921209 | Epoch: 48 | MeanAbsoluteError: 0.0732984840869904 | Loss: 0.0059431545170290 | Epoch: 49 | 
MeanAbsoluteError: 0.0294838640838861 | Loss: 0.0016295082251807 | Epoch: 50 | MeanAbsoluteError: 0.0357769168913364 | Loss: 0.0022138597643269 | Epoch: 51 | MeanAbsoluteError: 0.1016312986612320 | Loss: 0.0117300418870790 | Epoch: 52 | MeanAbsoluteError: 0.0186113081872463 | Loss: 0.0006397351223443 | Epoch: 53 | 
MeanAbsoluteError: 0.1027460172772408 | Loss: 0.0119764746299812 | Epoch: 54 | MeanAbsoluteError: 0.1037460342049599 | Loss: 0.0125851369063769 | Epoch: 55 | MeanAbsoluteError: 0.1137867271900177 | Loss: 0.0137143953304206 | Epoch: 56 | MeanAbsoluteError: 0.0141011737287045 | Loss: 0.0004103158509159 | Epoch: 57 | 
MeanAbsoluteError: 0.0960814654827118 | Loss: 0.0106372249179653 | Epoch: 58 | MeanAbsoluteError: 0.0551665835082531 | Loss: 0.0040286454438631 | Epoch: 59 | MeanAbsoluteError: 0.0588097870349884 | Loss: 0.0038260152962591 | Epoch: 60 | MeanAbsoluteError: 0.0596865601837635 | Loss: 0.0041786407985325 | Epoch: 61 | 
MeanAbsoluteError: 0.0262339618057013 | Loss: 0.0012343139969744 | Epoch: 62 | MeanAbsoluteError: 0.0767289996147156 | Loss: 0.0079784342753036 | Epoch: 63 | MeanAbsoluteError: 0.1107620596885681 | Loss: 0.0125832247680851 | Epoch: 64 | MeanAbsoluteError: 0.0246118195354939 | Loss: 0.0007974856042503 | Epoch: 65 | 
MeanAbsoluteError: 0.0244842357933521 | Loss: 0.0010616707233047 | Epoch: 66 | MeanAbsoluteError: 0.0537229590117931 | Loss: 0.0030497974782650 | Epoch: 67 | MeanAbsoluteError: 0.0385421551764011 | Loss: 0.0018345433220799 | Epoch: 68 | MeanAbsoluteError: 0.1148666217923164 | Loss: 0.0140432648892914 | Epoch: 69 | 
MeanAbsoluteError: 0.0723702013492584 | Loss: 0.0054107730143837 | Epoch: 70 | MeanAbsoluteError: 0.0847403556108475 | Loss: 0.0080032918735274 | Epoch: 71 | MeanAbsoluteError: 0.0516732893884182 | Loss: 0.0033014489537371 | Epoch: 72 | MeanAbsoluteError: 0.0320510640740395 | Loss: 0.0017742082875754 | Epoch: 73 | 
MeanAbsoluteError: 0.0202731378376484 | Loss: 0.0006363732931537 | Epoch: 74 | MeanAbsoluteError: 0.1401814073324203 | Loss: 0.0222588335829122 | Epoch: 75 | MeanAbsoluteError: 0.0425272881984711 | Loss: 0.0032316629076377 | Epoch: 76 | MeanAbsoluteError: 0.0435927584767342 | Loss: 0.0031539492608447 | Epoch: 77 | 
MeanAbsoluteError: 0.0612737126648426 | Loss: 0.0047692608620439 | Epoch: 78 | MeanAbsoluteError: 0.0871190130710602 | Loss: 0.0084079947721745 | Epoch: 79 | MeanAbsoluteError: 0.0485136471688747 | Loss: 0.0025341921219868 | Epoch: 80 | MeanAbsoluteError: 0.1312666684389114 | Loss: 0.0178526887404067 | Epoch: 81 | 
MeanAbsoluteError: 0.0812474191188812 | Loss: 0.0068365107955677 | Epoch: 82 | MeanAbsoluteError: 0.0527415797114372 | Loss: 0.0035400144822363 | Epoch: 83 | MeanAbsoluteError: 0.0529899597167969 | Loss: 0.0032654062711767 | Epoch: 84 | MeanAbsoluteError: 0.0613225139677525 | Loss: 0.0047604240077947 | Epoch: 85 | 
MeanAbsoluteError: 0.0456783063709736 | Loss: 0.0027542549651116 | Epoch: 86 | MeanAbsoluteError: 0.0217922832816839 | Loss: 0.0007582755393482 | Epoch: 87 | MeanAbsoluteError: 0.0267714411020279 | Loss: 0.0016522442705796 | Epoch: 88 | MeanAbsoluteError: 0.0406162440776825 | Loss: 0.0017464877039726 | Early stopping at epoch 87
Fold: 10
Epoch: 1 | 
MeanAbsoluteError: 0.2343432009220123 | Loss: 0.0709228728498731 | Epoch: 2 | MeanAbsoluteError: 0.1644575446844101 | Loss: 0.0380339428250279 | Epoch: 3 | MeanAbsoluteError: 0.2263622879981995 | Loss: 0.0698629324989659 | Epoch: 4 | MeanAbsoluteError: 0.0956499949097633 | Loss: 0.0137734566149967 | Epoch: 5 | 
MeanAbsoluteError: 0.1928589642047882 | Loss: 0.0482095056878669 | Epoch: 6 | MeanAbsoluteError: 0.0955111086368561 | Loss: 0.0133230678204979 | Epoch: 7 | MeanAbsoluteError: 0.1166024506092072 | Loss: 0.0184588474886758 | Epoch: 8 | MeanAbsoluteError: 0.1531362980604172 | Loss: 0.0310430007853678 | Epoch: 9 | 
MeanAbsoluteError: 0.0788467451930046 | Loss: 0.0094549208214240 | Epoch: 10 | MeanAbsoluteError: 0.0665338188409805 | Loss: 0.0069108530213790 | Epoch: 11 | MeanAbsoluteError: 0.0769880786538124 | Loss: 0.0081713129101055 | Epoch: 12 | MeanAbsoluteError: 0.0427684411406517 | Loss: 0.0034998472879774 | Epoch: 13 | 
MeanAbsoluteError: 0.0584968999028206 | Loss: 0.0050060705481363 | Epoch: 14 | MeanAbsoluteError: 0.1025567501783371 | Loss: 0.0119393028851066 | Epoch: 15 | MeanAbsoluteError: 0.0710638612508774 | Loss: 0.0080316685406225 | Epoch: 16 | MeanAbsoluteError: 0.0679923593997955 | Loss: 0.0076873916800001 | Epoch: 17 | 
MeanAbsoluteError: 0.0421126596629620 | Loss: 0.0027742388525179 | Epoch: 18 | MeanAbsoluteError: 0.0771562531590462 | Loss: 0.0079211772951697 | Epoch: 19 | MeanAbsoluteError: 0.1182941049337387 | Loss: 0.0148296863106745 | Epoch: 20 | MeanAbsoluteError: 0.0569669194519520 | Loss: 0.0047816242357450 | Epoch: 21 | 
MeanAbsoluteError: 0.0600297972559929 | Loss: 0.0050598634739539 | Epoch: 22 | MeanAbsoluteError: 0.0629867017269135 | Loss: 0.0053465885908476 | Epoch: 23 | MeanAbsoluteError: 0.0708451867103577 | Loss: 0.0070569477310138 | Epoch: 24 | MeanAbsoluteError: 0.0536024458706379 | Loss: 0.0038560928244676 | Epoch: 25 | 
MeanAbsoluteError: 0.0842436775565147 | Loss: 0.0100378895045391 | Epoch: 26 | MeanAbsoluteError: 0.1660428941249847 | Loss: 0.0286586111677544 | Epoch: 27 | MeanAbsoluteError: 0.0353963449597359 | Loss: 0.0018182150836635 | Epoch: 28 | MeanAbsoluteError: 0.0974751487374306 | Loss: 0.0109361493960023 | Epoch: 29 | 
MeanAbsoluteError: 0.0403727106750011 | Loss: 0.0026873988764627 | Epoch: 30 | MeanAbsoluteError: 0.0183166861534119 | Loss: 0.0010792560206028 | Epoch: 31 | MeanAbsoluteError: 0.0575433745980263 | Loss: 0.0048383474516283 | Epoch: 32 | MeanAbsoluteError: 0.0620324611663818 | Loss: 0.0056304567094360 | Epoch: 33 | 
MeanAbsoluteError: 0.1082444861531258 | Loss: 0.0184876061975956 | Epoch: 34 | MeanAbsoluteError: 0.0975958332419395 | Loss: 0.0102864835145218 | Epoch: 35 | MeanAbsoluteError: 0.0510397106409073 | Loss: 0.0039525427522936 | Epoch: 36 | MeanAbsoluteError: 0.1475276798009872 | Loss: 0.0226658675819635 | Epoch: 37 | 
MeanAbsoluteError: 0.0297300871461630 | Loss: 0.0016961816748205 | Epoch: 38 | MeanAbsoluteError: 0.0763444676995277 | Loss: 0.0066458379982838 | Epoch: 39 | MeanAbsoluteError: 0.0530667155981064 | Loss: 0.0043655457474025 | Epoch: 40 | MeanAbsoluteError: 0.0425240248441696 | Loss: 0.0020300890984280 | Epoch: 41 | 
MeanAbsoluteError: 0.0738881602883339 | Loss: 0.0074349360407463 | Epoch: 42 | MeanAbsoluteError: 0.0539563931524754 | Loss: 0.0041177730807768 | Epoch: 43 | MeanAbsoluteError: 0.0363076627254486 | Loss: 0.0018497838671984 | Epoch: 44 | MeanAbsoluteError: 0.0193550717085600 | Loss: 0.0010964560039741 | Epoch: 45 | 
MeanAbsoluteError: 0.0664691179990768 | Loss: 0.0057693113173757 | Epoch: 46 | MeanAbsoluteError: 0.0219720080494881 | Loss: 0.0006523796972553 | Epoch: 47 | MeanAbsoluteError: 0.0489956587553024 | Loss: 0.0035508309956640 | Epoch: 48 | MeanAbsoluteError: 0.0389172062277794 | Loss: 0.0024498624427776 | Epoch: 49 | 
MeanAbsoluteError: 0.0531529337167740 | Loss: 0.0039272547832557 | Epoch: 50 | MeanAbsoluteError: 0.0483401864767075 | Loss: 0.0043478042352945 | Epoch: 51 | MeanAbsoluteError: 0.0764253363013268 | Loss: 0.0093915622814425 | Epoch: 52 | MeanAbsoluteError: 0.0153923677280545 | Loss: 0.0003721770439630 | Epoch: 53 | 
MeanAbsoluteError: 0.0462868511676788 | Loss: 0.0026404983696661 | Epoch: 54 | MeanAbsoluteError: 0.0406834743916988 | Loss: 0.0020410374272615 | Epoch: 55 | MeanAbsoluteError: 0.0304846223443747 | Loss: 0.0014504756545648 | Epoch: 56 | MeanAbsoluteError: 0.0455599203705788 | Loss: 0.0026015982896622 | Epoch: 57 | 
MeanAbsoluteError: 0.0329301618039608 | Loss: 0.0016984847648668 | Epoch: 58 | MeanAbsoluteError: 0.1474128663539886 | Loss: 0.0224038793572358 | Epoch: 59 | MeanAbsoluteError: 0.0864783674478531 | Loss: 0.0093394709817533 | Epoch: 60 | MeanAbsoluteError: 0.1268717050552368 | Loss: 0.0173161055094429 | Epoch: 61 | 
MeanAbsoluteError: 0.1033531576395035 | Loss: 0.0127373586541840 | Epoch: 62 | MeanAbsoluteError: 0.1785792112350464 | Loss: 0.0341427775898150 | Epoch: 63 | MeanAbsoluteError: 0.0597653426229954 | Loss: 0.0055691043713263 | Epoch: 64 | MeanAbsoluteError: 0.0554763525724411 | Loss: 0.0044810532791806 | Epoch: 65 | 
MeanAbsoluteError: 0.0817086771130562 | Loss: 0.0125091855547258 | Epoch: 66 | MeanAbsoluteError: 0.0512781813740730 | Loss: 0.0043755695889039 | Epoch: 67 | MeanAbsoluteError: 0.1268511861562729 | Loss: 0.0171003916433879 | Epoch: 68 | MeanAbsoluteError: 0.0771383941173553 | Loss: 0.0071190723351070 | Epoch: 69 | 
MeanAbsoluteError: 0.0422805026173592 | Loss: 0.0026342420772250 | Epoch: 70 | MeanAbsoluteError: 0.0229457393288612 | Loss: 0.0008949015672053 | Epoch: 71 | MeanAbsoluteError: 0.0773255676031113 | Loss: 0.0117609708436898 | Epoch: 72 | MeanAbsoluteError: 0.0572469122707844 | Loss: 0.0041025327185967 | Epoch: 73 | 
MeanAbsoluteError: 0.1353479921817780 | Loss: 0.0189878538783107 | Epoch: 74 | MeanAbsoluteError: 0.0468414463102818 | Loss: 0.0044630006887019 | Epoch: 75 | MeanAbsoluteError: 0.0553701817989349 | Loss: 0.0034854622624282 | Epoch: 76 | MeanAbsoluteError: 0.0642457231879234 | Loss: 0.0055463018694094 | Epoch: 77 | 
MeanAbsoluteError: 0.1063345894217491 | Loss: 0.0119140729574221 | Epoch: 78 | MeanAbsoluteError: 0.0766781494021416 | Loss: 0.0061360586966787 | Epoch: 79 | MeanAbsoluteError: 0.0454042591154575 | Loss: 0.0027561731403694 | Epoch: 80 | MeanAbsoluteError: 0.0142686963081360 | Loss: 0.0003044454881872 | Epoch: 81 | 
MeanAbsoluteError: 0.0503102540969849 | Loss: 0.0030180586036295 | Epoch: 82 | MeanAbsoluteError: 0.0443661436438560 | Loss: 0.0027023269794881 | Epoch: 83 | MeanAbsoluteError: 0.0411083176732063 | Loss: 0.0030422666376191 | Epoch: 84 | MeanAbsoluteError: 0.0474401526153088 | Loss: 0.0033020448338773 | Epoch: 85 | 
MeanAbsoluteError: 0.0512406937777996 | Loss: 0.0045797419734299 | Epoch: 86 | MeanAbsoluteError: 0.0316602513194084 | Loss: 0.0013953738546531 | Epoch: 87 | MeanAbsoluteError: 0.0314037166535854 | Loss: 0.0015222162307639 | Epoch: 88 | MeanAbsoluteError: 0.0656640231609344 | Loss: 0.0047207328690482 | Epoch: 89 | 
MeanAbsoluteError: 0.0626998245716095 | Loss: 0.0040171004366130 | Epoch: 90 | MeanAbsoluteError: 0.0969201028347015 | Loss: 0.0100248758015888 | Epoch: 91 | MeanAbsoluteError: 0.0378238372504711 | Loss: 0.0016466198139824 | Epoch: 92 | MeanAbsoluteError: 0.0460575148463249 | Loss: 0.0037081823351660 | Epoch: 93 | 
MeanAbsoluteError: 0.0262591503560543 | Loss: 0.0011458664957900 | Epoch: 94 | MeanAbsoluteError: 0.0410335175693035 | Loss: 0.0021593178223286 | Epoch: 95 | MeanAbsoluteError: 0.0241684168577194 | Loss: 0.0010160671580317 | Epoch: 96 | MeanAbsoluteError: 0.0142872473224998 | Loss: 0.0010880371618051 | Epoch: 97 | 
MeanAbsoluteError: 0.0236727595329285 | Loss: 0.0008310807170346 | Epoch: 98 | MeanAbsoluteError: 0.0532738827168941 | Loss: 0.0035636391756790 | Epoch: 99 | MeanAbsoluteError: 0.0244365334510803 | Loss: 0.0007453639991581 | Epoch: 100 | MeanAbsoluteError: 0.0697693079710007 | Loss: 0.0056854193764074 | Epoch: 101 | 
MeanAbsoluteError: 0.0312278438359499 | Loss: 0.0022544312606832 | Epoch: 102 | MeanAbsoluteError: 0.0506853312253952 | Loss: 0.0041164392938039 | Epoch: 103 | MeanAbsoluteError: 0.0558484420180321 | Loss: 0.0042829349237893 | Epoch: 104 | MeanAbsoluteError: 0.0387760847806931 | Loss: 0.0020085299121482 | Epoch: 105 | 
MeanAbsoluteError: 0.0365944020450115 | Loss: 0.0014808801102585 | Epoch: 106 | MeanAbsoluteError: 0.0340264327824116 | Loss: 0.0020874915395065 | Epoch: 107 | MeanAbsoluteError: 0.0592649690806866 | Loss: 0.0040079921683563 | Epoch: 108 | MeanAbsoluteError: 0.0501893386244774 | Loss: 0.0029924408466156 | Epoch: 109 | 
MeanAbsoluteError: 0.1090741232037544 | Loss: 0.0123656002272453 | Epoch: 110 | MeanAbsoluteError: 0.0167075973004103 | Loss: 0.0003612322907429 | Epoch: 111 | MeanAbsoluteError: 0.0817133039236069 | Loss: 0.0071818635665945 | Epoch: 112 | MeanAbsoluteError: 0.0975102782249451 | Loss: 0.0126802383788994 | Early stopping at epoch 111
metric_name = type(fun_control["metric_torch"]).__name__
print(f"loss: {df_eval}, Cross-validated {metric_name}: {df_metrics}")
loss: 0.004456751226306161, Cross-validated MeanAbsoluteError: 0.053356729447841644

19.10.4 Detailed Hyperparameter Plots

filename = "./figures/" + experiment_name
spot_tuner.plot_important_hyperparameter_contour(filename=filename)
dropout_prob:  0.046573691171311486
epochs:  4.090759839144558
optimizer:  100.0

Contour plots.

19.10.5 Parallel Coordinates Plot

spot_tuner.parallel_plot()

Parallel coordinates plots

19.11 Summary and Outlook

This tutorial presents the hyperparameter tuning open source software spotPython for PyTorch. Some of the advantages of spotPython are:

  • Numerical and categorical hyperparameters.
  • Powerful surrogate models.
  • Flexible approach and easy to use.
  • Simple JSON files for the specification of the hyperparameters.
  • Extension of default and user specified network classes.
  • Noise handling techniques.
  • Online visualization of the hyperparameter tuning process with tensorboard.

Currently, only rudimentary parallel and distributed neural network training is possible, but these capabilities will be extended in the future. The next version of spotPython will also include a more detailed documentation and more examples.

Important

Important: This tutorial does not present a complete benchmarking study (Bartz-Beielstein et al. 2020). The results are only preliminary and highly dependent on the local configuration (hard- and software). Our goal is to provide a first impression of the performance of the hyperparameter tuning package spotPython. The results should be interpreted with care.