19  HPT PyTorch: Regression

In this tutorial, we will show how spotPython can be integrated into the PyTorch training workflow for regreession tasks.

This document refers to the following software versions:

pip list | grep  "spot[RiverPython]"
spotPython                 0.2.37
spotRiver                  0.0.93
Note: you may need to restart the kernel to use updated packages.

spotPython can be installed via pip. Alternatively, the source code can be downloaded from gitHub: https://github.com/sequential-parameter-optimization/spotPython.

!pip install spotPython
# import sys
# !{sys.executable} -m pip install --upgrade build
# !{sys.executable} -m pip install --upgrade --force-reinstall spotPython

19.1 Step 1: Setup

Before we consider the detailed experimental setup, we select the parameters that affect run time, initial design size and the device that is used.

Caution: Run time and initial design size should be increased for real experiments
  • MAX_TIME is set to one minute for demonstration purposes. For real experiments, this should be increased to at least 1 hour.
  • INIT_SIZE is set to 5 for demonstration purposes. For real experiments, this should be increased to at least 10.
Note: Device selection
  • The device can be selected by setting the variable DEVICE.
  • Since we are using a simple neural net, the setting "cpu" is preferred (on Mac).
  • If you have a GPU, you can use "cuda:0" instead.
  • If DEVICE is set to None, spotPython will automatically select the device.
    • This might result in "mps" on Macs, which is not the best choice for simple neural nets.
MAX_TIME = 1
INIT_SIZE = 5
DEVICE = "cpu" # "cuda:0"
from spotPython.utils.device import getDevice
DEVICE = getDevice(DEVICE)
print(DEVICE)
cpu
import os
import copy
import socket
from datetime import datetime
from dateutil.tz import tzlocal
start_time = datetime.now(tzlocal())
HOSTNAME = socket.gethostname().split(".")[0]
experiment_name = '24-torch' + "_" + HOSTNAME + "_" + str(MAX_TIME) + "min_" + str(INIT_SIZE) + "init_" + str(start_time).split(".", 1)[0].replace(' ', '_')
experiment_name = experiment_name.replace(':', '-')
print(experiment_name)
if not os.path.exists('./figures'):
    os.makedirs('./figures')
24-torch_bartz09_1min_5init_2023-06-18_20-11-17

19.2 Step 2: Initialization of the fun_control Dictionary

spotPython uses a Python dictionary for storing the information required for the hyperparameter tuning process, which was described in Section 14.2.

from spotPython.utils.init import fun_control_init
fun_control = fun_control_init(task="regression",
 tensorboard_path="runs/24_spot_torch_regression",
 device=DEVICE)

19.3 Step 3: PyTorch Data Loading

# Create dataset
import pandas as pd
import numpy as np
from sklearn import datasets as sklearn_datasets
from sklearn.preprocessing import MinMaxScaler
from sklearn.model_selection import train_test_split
X, y = sklearn_datasets.make_regression(
    n_samples=1000, n_features=10, noise=1, random_state=123)
y = y.reshape(-1, 1)

# Normalize the data
X_scaler = MinMaxScaler()
X_scaled = X_scaler.fit_transform(X)
y_scaler = MinMaxScaler()
y_scaled = y_scaler.fit_transform(y)

# combine the features and target into a single dataframe named train_df
train_df = pd.DataFrame(np.hstack((X_scaled, y_scaled)))

target_column = "y"
n_samples = train_df.shape[0]
n_features = train_df.shape[1] - 1
train_df.columns = [f"x{i}" for i in range(1, n_features+1)] + [target_column]
X_train, X_test, y_train, y_test = train_test_split(train_df.drop(target_column,
    axis=1), 
    train_df[target_column],
    random_state=42,
    test_size=0.25)
trainset = pd.DataFrame(np.hstack((X_train, np.array(y_train).reshape(-1, 1))))
testset = pd.DataFrame(np.hstack((X_test, np.array(y_test).reshape(-1, 1))))
trainset.columns = [f"x{i}" for i in range(1, n_features+1)] + [target_column]
testset.columns = [f"x{i}" for i in range(1, n_features+1)] + [target_column]
print(train_df.shape)
print(trainset.shape)
print(testset.shape)
(1000, 11)
(750, 11)
(250, 11)
import torch
from spotPython.torch.dataframedataset import DataFrameDataset
dtype_x = torch.float32
dtype_y = torch.float32
train_df = DataFrameDataset(train_df, target_column=target_column,
    dtype_x=dtype_x, dtype_y=dtype_y)
train = DataFrameDataset(trainset, target_column=target_column,
    dtype_x=dtype_x, dtype_y=dtype_y)
test = DataFrameDataset(testset, target_column=target_column,
    dtype_x=dtype_x, dtype_y=dtype_y)
n_samples = len(train)
  • Now we can test the data loading:
from spotPython.torch.traintest import create_train_val_data_loaders
trainloader, testloader = create_train_val_data_loaders(train, 2, True, 0)
for i, data in enumerate(trainloader, 0):
    inputs, labels = data
    print(inputs.shape)
    print(labels.shape)
    print(inputs)
    print(labels)
    break
torch.Size([2, 10])
torch.Size([2])
tensor([[0.6977, 0.6869, 0.6143, 0.5192, 0.1798, 0.6152, 0.3938, 0.5218, 0.5561,
         0.4747],
        [0.6543, 0.6076, 0.2833, 0.5309, 0.5252, 0.4334, 0.5616, 0.6457, 0.2494,
         0.3567]])
tensor([0.5490, 0.5883])
  • Since this works fine, we can add the data loading to the fun_control dictionary:
# add the dataset to the fun_control
fun_control.update({"data": train_df, # full dataset,
               "train": train,
               "test": test,
               "n_samples": n_samples,
               "target_column": target_column,})

19.4 Step 4: Specification of the Preprocessing Model

After the training and test data are specified and added to the fun_control dictionary, spotPython allows the specification of a data preprocessing pipeline, e.g., for the scaling of the data or for the one-hot encoding of categorical variables, see Section 14.4. This feature is not used here, so we do not change the default value (which is None).

19.5 Step 5: Select Model (algorithm) and core_model_hyper_dict

19.5.1 Implementing a Configurable Neural Network With spotPython

spotPython includes the Net_lin_reg class which is implemented in the file netregression.py.

This class inherits from the class Net_Core which is implemented in the file netcore.py, see Section 14.5.1.

from torch import nn
import spotPython.torch.netcore as netcore


class Net_lin_reg(netcore.Net_Core):
    def __init__(
        self, _L_in, _L_out, l1, dropout_prob, lr_mult,
        batch_size, epochs, k_folds, patience, optimizer,
        sgd_momentum
    ):
        super(Net_lin_reg, self).__init__(
            lr_mult=lr_mult,
            batch_size=batch_size,
            epochs=epochs,
            k_folds=k_folds,
            patience=patience,
            optimizer=optimizer,
            sgd_momentum=sgd_momentum,
        )
        l2 = max(l1 // 2, 4)
        self.fc1 = nn.Linear(_L_in, l1)
        self.fc2 = nn.Linear(l1, l2)
        self.fc3 = nn.Linear(l2, _L_out)
        self.relu = nn.ReLU()
        self.softmax = nn.Softmax(dim=1)
        self.dropout1 = nn.Dropout(p=dropout_prob)
        self.dropout2 = nn.Dropout(p=dropout_prob / 2)

    def forward(self, x):
        x = self.fc1(x)
        x = self.relu(x)
        x = self.dropout1(x)
        x = self.fc2(x)
        x = self.relu(x)
        x = self.dropout2(x)
        x = self.fc3(x)
        return x

19.5.1.1 The Net_Core class

Net_lin_reg inherits from the class Net_Core which is implemented in the file netcore.py. This class was described in Section 14.5.1.

from spotPython.torch.netregression import Net_lin_reg
from spotPython.data.torch_hyper_dict import TorchHyperDict
from spotPython.hyperparameters.values import add_core_model_to_fun_control
fun_control = add_core_model_to_fun_control(core_model=Net_lin_reg,
                              fun_control=fun_control,
                              hyper_dict=TorchHyperDict,
                              filename=None)

19.5.2 The Search Space

19.5.3 Configuring the Search Space With spotPython

19.5.3.1 The hyper_dict Hyperparameters for the Selected Algorithm

spotPython uses JSON files for the specification of the hyperparameters, which were described in Section 14.5.5.

The corresponding entries for the Net_lin_reg class are shown below.

    "Net_lin_reg":
    {
        "_L_in": {
            "type": "int",
            "default": 10,
            "transform": "None",
            "lower": 10,
            "upper": 10},
        "_L_out": {
            "type": "int",
            "default": 1,
            "transform": "None",
            "lower": 1,
            "upper": 1},
        "l1": {
            "type": "int",
            "default": 3,
            "transform": "transform_power_2_int",
            "lower": 3,
            "upper": 8},
        "dropout_prob": {
            "type": "float",
            "default": 0.01,
            "transform": "None",
            "lower": 0.0,
            "upper": 0.9},
        "lr_mult": {
            "type": "float",
            "default": 1.0,
            "transform": "None",
            "lower": 0.1,
            "upper": 10.0},
        "batch_size": {
            "type": "int",
            "default": 4,
            "transform": "transform_power_2_int",
            "lower": 1,
            "upper": 4},
        "epochs": {
            "type": "int",
            "default": 4,
            "transform": "transform_power_2_int",
            "lower": 4,
            "upper": 9},
        "k_folds": {
            "type": "int",
            "default": 1,
            "transform": "None",
            "lower": 1,
            "upper": 1},
        "patience": {
            "type": "int",
            "default": 2,
            "transform": "transform_power_2_int",
            "lower": 1,
            "upper": 5
        },
        "optimizer": {
            "levels": ["Adadelta",
                       "Adagrad",
                       "Adam",
                       "AdamW",
                       "SparseAdam",
                       "Adamax",
                       "ASGD",
                       "NAdam",
                       "RAdam",
                       "RMSprop",
                       "Rprop",
                       "SGD"],
            "type": "factor",
            "default": "SGD",
            "transform": "None",
            "class_name": "torch.optim",
            "core_model_parameter_type": "str",
            "lower": 0,
            "upper": 12},
        "sgd_momentum": {
            "type": "float",
            "default": 0.0,
            "transform": "None",
            "lower": 0.0,
            "upper": 1.0}
    },

19.6 Step 6: Modify hyper_dict Hyperparameters for the Selected Algorithm aka core_model

spotPython provides functions for modifying the hyperparameters, their bounds and factors as well as for activating and de-activating hyperparameters without re-compilation of the Python source code. These functions were described in Section 14.6.

19.6.1 Modify hyper_dict Hyperparameters for the Selected Algorithm aka core_model

19.6.1.1 Modify Hyperparameters of Type numeric and integer (boolean)

from spotPython.hyperparameters.values import modify_hyper_parameter_bounds

fun_control = modify_hyper_parameter_bounds(fun_control, "epochs", bounds=[2, 16])
fun_control = modify_hyper_parameter_bounds(fun_control, "patience", bounds=[3, 7])

19.6.1.2 Modify Hyperparameter of Type factor

from spotPython.hyperparameters.values import modify_hyper_parameter_levels
fun_control = modify_hyper_parameter_levels(fun_control, "optimizer",
    ["Adadelta", "Adagrad", "Adam", "AdamW", "Adamax", "ASGD", "NAdam"])


fun_control.update({
               "_L_in": n_features,
               "_L_out": 1,})

19.6.2 Optimizers

Optimizers are described in Section 14.6.1.

19.7 Step 7: Selection of the Objective (Loss) Function

19.7.1 Evaluation

The evaluation procedure requires the specification of two elements:

  1. the way how the data is split into a train and a test set (see Section 14.7.1)
  2. the loss function (and a metric).

19.7.2 Loss Functions and Metrics

The key "loss_function" specifies the loss function which is used during the optimization, see Section 14.7.5.

We will use MSE loss for the regression task.

from torch.nn import MSELoss
loss_torch = MSELoss()
fun_control.update({"loss_function": loss_torch})

19.7.3 Metric

from torchmetrics import MeanAbsoluteError
metric_torch = MeanAbsoluteError().to(fun_control["device"])
fun_control.update({"metric_torch": metric_torch})

19.8 Step 8: Calling the SPOT Function

19.8.1 Preparing the SPOT Call

The following code passes the information about the parameter ranges and bounds to spot.

# extract the variable types, names, and bounds
from spotPython.hyperparameters.values import (get_bound_values,
    get_var_name,
    get_var_type,)
var_type = get_var_type(fun_control)
var_name = get_var_name(fun_control)
fun_control.update({"var_type": var_type,
                    "var_name": var_name})
lower = get_bound_values(fun_control, "lower")
upper = get_bound_values(fun_control, "upper")
from spotPython.utils.eda import gen_design_table
print(gen_design_table(fun_control))
| name         | type   | default   |   lower |   upper | transform             |
|--------------|--------|-----------|---------|---------|-----------------------|
| _L_in        | int    | 10        |    10   |    10   | None                  |
| _L_out       | int    | 1         |     1   |     1   | None                  |
| l1           | int    | 3         |     3   |     8   | transform_power_2_int |
| dropout_prob | float  | 0.01      |     0   |     0.9 | None                  |
| lr_mult      | float  | 1.0       |     0.1 |    10   | None                  |
| batch_size   | int    | 4         |     1   |     4   | transform_power_2_int |
| epochs       | int    | 4         |     2   |    16   | transform_power_2_int |
| k_folds      | int    | 1         |     1   |     1   | None                  |
| patience     | int    | 2         |     3   |     7   | transform_power_2_int |
| optimizer    | factor | SGD       |     0   |     6   | None                  |
| sgd_momentum | float  | 0.0       |     0   |     1   | None                  |

19.8.2 The Objective Function fun_torch

The objective function fun_torch is selected next. It implements an interface from PyTorch’s training, validation, and testing methods to spotPython.

from spotPython.fun.hypertorch import HyperTorch
fun = HyperTorch().fun_torch
from spotPython.hyperparameters.values import get_default_hyperparameters_as_array
hyper_dict=TorchHyperDict().load()
X_start = get_default_hyperparameters_as_array(fun_control, hyper_dict)

19.8.3 Starting the Hyperparameter Tuning

The spotPython hyperparameter tuning is started by calling the Spot function as described in Section 14.8.4.

from spotPython.spot import spot
from math import inf
spot_tuner = spot.Spot(fun=fun,
                   lower = lower,
                   upper = upper,
                   fun_evals = inf,
                   fun_repeats = 1,
                   max_time = MAX_TIME,
                   noise = False,
                   tolerance_x = np.sqrt(np.spacing(1)),
                   var_type = var_type,
                   var_name = var_name,
                   infill_criterion = "y",
                   n_points = 1,
                   seed=123,
                   log_level = 50,
                   show_models= False,
                   show_progress= True,
                   fun_control = fun_control,
                   design_control={"init_size": INIT_SIZE,
                                   "repeats": 1},
                   surrogate_control={"noise": True,
                                      "cod_type": "norm",
                                      "min_theta": -4,
                                      "max_theta": 3,
                                      "n_theta": len(var_name),
                                      "model_fun_evals": 10_000,
                                      "log_level": 50
                                      })
spot_tuner.run(X_start=X_start)

config: {'_L_in': 10, '_L_out': 1, 'l1': 64, 'dropout_prob': 0.7103122166156, 'lr_mult': 3.62368745191023, 'batch_size': 8, 'epochs': 128, 'k_folds': 1, 'patience': 16, 'optimizer': 'Adam', 'sgd_momentum': 0.5446851204405787}
Epoch: 1 | 
MeanAbsoluteError: 0.1662108153104782 | Loss: 0.0414130068139026 | Epoch: 2 | MeanAbsoluteError: 0.1360705941915512 | Loss: 0.0303551420986064 | Epoch: 3 | MeanAbsoluteError: 0.1355727463960648 | Loss: 0.0285579371020982 | Epoch: 4 | MeanAbsoluteError: 0.1296506822109222 | Loss: 0.0266583719486861 | Epoch: 5 | MeanAbsoluteError: 0.1348747014999390 | Loss: 0.0277176208696083 | Epoch: 6 | MeanAbsoluteError: 0.1236122101545334 | Loss: 0.0251152438209637 | Epoch: 7 | MeanAbsoluteError: 0.1147443652153015 | Loss: 0.0210826456804123 | Epoch: 8 | MeanAbsoluteError: 0.1233383044600487 | Loss: 0.0243585200882272 | Epoch: 9 | 
MeanAbsoluteError: 0.1137320473790169 | Loss: 0.0210433804895729 | Epoch: 10 | MeanAbsoluteError: 0.1139937937259674 | Loss: 0.0209818360224170 | Epoch: 11 | 
MeanAbsoluteError: 0.1142696365714073 | Loss: 0.0209720283164643 | Epoch: 12 | MeanAbsoluteError: 0.1112662032246590 | Loss: 0.0206644533716730 | Epoch: 13 | MeanAbsoluteError: 0.1054701134562492 | Loss: 0.0181756069221975 | Epoch: 14 | MeanAbsoluteError: 0.1124192774295807 | Loss: 0.0209150272360268 | Epoch: 15 | MeanAbsoluteError: 0.1077588498592377 | Loss: 0.0187461663123318 | Epoch: 16 | MeanAbsoluteError: 0.1055222675204277 | Loss: 0.0182788124442787 | Epoch: 17 | MeanAbsoluteError: 0.1021425575017929 | Loss: 0.0166354916352583 | Epoch: 18 | MeanAbsoluteError: 0.0967871695756912 | Loss: 0.0158161786568694 | Epoch: 19 | 
MeanAbsoluteError: 0.0911346971988678 | Loss: 0.0142561667108614 | Epoch: 20 | MeanAbsoluteError: 0.0892629101872444 | Loss: 0.0137691372993255 | Epoch: 21 | 
MeanAbsoluteError: 0.0937148332595825 | Loss: 0.0154858364319233 | Epoch: 22 | MeanAbsoluteError: 0.0916476994752884 | Loss: 0.0141096757479796 | Epoch: 23 | MeanAbsoluteError: 0.0995107367634773 | Loss: 0.0155078423773184 | Epoch: 24 | MeanAbsoluteError: 0.0946360304951668 | Loss: 0.0146166531638683 | Epoch: 25 | MeanAbsoluteError: 0.0917932540178299 | Loss: 0.0139894757517859 | Epoch: 26 | MeanAbsoluteError: 0.0928711965680122 | Loss: 0.0138545410560542 | Epoch: 27 | MeanAbsoluteError: 0.0757282227277756 | Loss: 0.0103934385605451 | Epoch: 28 | MeanAbsoluteError: 0.0898409336805344 | Loss: 0.0138931367852676 | Epoch: 29 | 
MeanAbsoluteError: 0.1002304926514626 | Loss: 0.0167801937235421 | Epoch: 30 | MeanAbsoluteError: 0.0860455706715584 | Loss: 0.0128354909952338 | Epoch: 31 | 
MeanAbsoluteError: 0.0760384723544121 | Loss: 0.0097276779032606 | Epoch: 32 | MeanAbsoluteError: 0.0863725543022156 | Loss: 0.0124413567092760 | Epoch: 33 | MeanAbsoluteError: 0.0835919603705406 | Loss: 0.0126422719882899 | Epoch: 34 | MeanAbsoluteError: 0.0754104107618332 | Loss: 0.0105363699840382 | Epoch: 35 | MeanAbsoluteError: 0.0792507529258728 | Loss: 0.0103279131795525 | Epoch: 36 | MeanAbsoluteError: 0.0735116377472878 | Loss: 0.0096862262695427 | Epoch: 37 | MeanAbsoluteError: 0.0810480341315269 | Loss: 0.0123276910116577 | Epoch: 38 | MeanAbsoluteError: 0.0788906887173653 | Loss: 0.0115400174583652 | Epoch: 39 | 
MeanAbsoluteError: 0.0802209675312042 | Loss: 0.0113314824074654 | Epoch: 40 | MeanAbsoluteError: 0.0762533918023109 | Loss: 0.0103049725952779 | Epoch: 41 | 
MeanAbsoluteError: 0.0850879848003387 | Loss: 0.0115093890773623 | Epoch: 42 | MeanAbsoluteError: 0.0729322284460068 | Loss: 0.0102354635876652 | Epoch: 43 | MeanAbsoluteError: 0.0693292319774628 | Loss: 0.0096794686274064 | Epoch: 44 | MeanAbsoluteError: 0.0654551461338997 | Loss: 0.0088931735862341 | Epoch: 45 | MeanAbsoluteError: 0.0862749442458153 | Loss: 0.0128129422174473 | Epoch: 46 | MeanAbsoluteError: 0.0681459382176399 | Loss: 0.0089398009494241 | Epoch: 47 | MeanAbsoluteError: 0.0739313066005707 | Loss: 0.0102146780179617 | Epoch: 48 | MeanAbsoluteError: 0.0824249014258385 | Loss: 0.0122177042097687 | Epoch: 49 | 
MeanAbsoluteError: 0.0680282637476921 | Loss: 0.0090126667821192 | Epoch: 50 | MeanAbsoluteError: 0.0733134970068932 | Loss: 0.0092079958535339 | Epoch: 51 | 
MeanAbsoluteError: 0.0753031447529793 | Loss: 0.0091654329015383 | Epoch: 52 | MeanAbsoluteError: 0.0808464735746384 | Loss: 0.0115444671644486 | Epoch: 53 | MeanAbsoluteError: 0.0793885067105293 | Loss: 0.0106897239977690 | Epoch: 54 | MeanAbsoluteError: 0.0819716677069664 | Loss: 0.0118494848720729 | Epoch: 55 | MeanAbsoluteError: 0.0755024105310440 | Loss: 0.0101831025829980 | Epoch: 56 | MeanAbsoluteError: 0.0756959691643715 | Loss: 0.0098142815925377 | Epoch: 57 | MeanAbsoluteError: 0.0664037466049194 | Loss: 0.0089121830839615 | Epoch: 58 | MeanAbsoluteError: 0.0725655779242516 | Loss: 0.0092989409244374 | Epoch: 59 | MeanAbsoluteError: 0.0699397027492523 | Loss: 0.0089538212755303 | 
Epoch: 60 | MeanAbsoluteError: 0.0744479894638062 | Loss: 0.0122519856974434 | Early stopping at epoch 59
Returned to Spot: Validation loss: 0.012251985697443351

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.19981931523998656, 'lr_mult': 7.004318498645526, 'batch_size': 16, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.07401195908206384}
Epoch: 1 | MeanAbsoluteError: 0.2617393732070923 | Loss: 0.0911276307153074 | Epoch: 2 | 
MeanAbsoluteError: 0.1625749170780182 | Loss: 0.0406129321965732 | Epoch: 3 | MeanAbsoluteError: 0.1785652190446854 | Loss: 0.0472873994394353 | Epoch: 4 | MeanAbsoluteError: 0.1704477369785309 | Loss: 0.0414181949668809 | Epoch: 5 | MeanAbsoluteError: 0.2066054344177246 | Loss: 0.0570430165450824 | Epoch: 6 | MeanAbsoluteError: 0.1039190217852592 | Loss: 0.0170784156867548 | Epoch: 7 | MeanAbsoluteError: 0.1332449167966843 | Loss: 0.0267219437090190 | Epoch: 8 | MeanAbsoluteError: 0.0963595658540726 | Loss: 0.0140742779170212 | Epoch: 9 | MeanAbsoluteError: 0.0990349203348160 | Loss: 0.0153382789637697 | Epoch: 10 | MeanAbsoluteError: 0.1308006197214127 | Loss: 0.0238938799225970 | Epoch: 11 | MeanAbsoluteError: 0.0957584008574486 | Loss: 0.0152535405696223 | Epoch: 12 | MeanAbsoluteError: 0.0950491800904274 | Loss: 0.0143503597447355 | Epoch: 13 | MeanAbsoluteError: 0.1095120608806610 | Loss: 0.0169656001227467 | Epoch: 14 | MeanAbsoluteError: 0.1250670403242111 | Loss: 0.0221022405710660 | Epoch: 15 | MeanAbsoluteError: 0.0936354026198387 | Loss: 0.0135124560298496 | Epoch: 16 | MeanAbsoluteError: 0.1242202520370483 | Loss: 0.0208319420681188 | Epoch: 17 | 
MeanAbsoluteError: 0.1492279767990112 | Loss: 0.0311349797013559 | Epoch: 18 | MeanAbsoluteError: 0.0892288237810135 | Loss: 0.0113139294676091 | Epoch: 19 | MeanAbsoluteError: 0.0622569732367992 | Loss: 0.0070749023610628 | Epoch: 20 | MeanAbsoluteError: 0.0694091469049454 | Loss: 0.0078115935290330 | Epoch: 21 | 
MeanAbsoluteError: 0.0662443712353706 | Loss: 0.0074573172942588 | Epoch: 22 | MeanAbsoluteError: 0.1297012120485306 | Loss: 0.0206843272439743 | Epoch: 23 | MeanAbsoluteError: 0.1218687072396278 | Loss: 0.0192443112303552 | Epoch: 24 | MeanAbsoluteError: 0.0655169263482094 | Loss: 0.0073590458150169 | Epoch: 25 | MeanAbsoluteError: 0.0813442766666412 | Loss: 0.0097781064135856 | Epoch: 26 | MeanAbsoluteError: 0.1043963506817818 | Loss: 0.0156657572737650 | Epoch: 27 | MeanAbsoluteError: 0.1495737433433533 | Loss: 0.0289548828609680 | Epoch: 28 | MeanAbsoluteError: 0.0531131885945797 | Loss: 0.0051696494001111 | Epoch: 29 | MeanAbsoluteError: 0.1130540743470192 | Loss: 0.0163031666980762 | Epoch: 30 | MeanAbsoluteError: 0.0842536166310310 | Loss: 0.0107960100775879 | Epoch: 31 | MeanAbsoluteError: 0.0922524929046631 | Loss: 0.0120846719824170 | Epoch: 32 | MeanAbsoluteError: 0.0983051136136055 | Loss: 0.0137676459394003 | Epoch: 33 | MeanAbsoluteError: 0.0631745681166649 | Loss: 0.0061394447142160 | Epoch: 34 | MeanAbsoluteError: 0.1300567090511322 | Loss: 0.0211263724945878 | Epoch: 35 | MeanAbsoluteError: 0.0509396791458130 | Loss: 0.0047286541666836 | Epoch: 36 | 
MeanAbsoluteError: 0.0963956639170647 | Loss: 0.0118038019312448 | Epoch: 37 | MeanAbsoluteError: 0.0453077852725983 | Loss: 0.0042670570424219 | Epoch: 38 | MeanAbsoluteError: 0.0947094112634659 | Loss: 0.0119850283096495 | Epoch: 39 | MeanAbsoluteError: 0.0514362007379532 | Loss: 0.0042482388671488 | Epoch: 40 | 
MeanAbsoluteError: 0.1001503691077232 | Loss: 0.0132635868595619 | Epoch: 41 | MeanAbsoluteError: 0.0502238646149635 | Loss: 0.0049810952102569 | Epoch: 42 | MeanAbsoluteError: 0.0947366207838058 | Loss: 0.0120074133829851 | Epoch: 43 | MeanAbsoluteError: 0.0602954551577568 | Loss: 0.0057426418520902 | Epoch: 44 | MeanAbsoluteError: 0.1192206218838692 | Loss: 0.0183526486354439 | Epoch: 45 | MeanAbsoluteError: 0.1017824336886406 | Loss: 0.0128743639705997 | Epoch: 46 | MeanAbsoluteError: 0.0592088624835014 | Loss: 0.0061617936620391 | Epoch: 47 | MeanAbsoluteError: 0.1045421212911606 | Loss: 0.0139463900735504 | Epoch: 48 | MeanAbsoluteError: 0.1003229171037674 | Loss: 0.0131158449589030 | Epoch: 49 | MeanAbsoluteError: 0.1163545846939087 | Loss: 0.0178707135645183 | Epoch: 50 | MeanAbsoluteError: 0.1596858054399490 | Loss: 0.0294874420291499 | Epoch: 51 | MeanAbsoluteError: 0.0409947596490383 | Loss: 0.0029646808060964 | Epoch: 52 | MeanAbsoluteError: 0.1030901372432709 | Loss: 0.0146643821836302 | Epoch: 53 | MeanAbsoluteError: 0.0870107337832451 | Loss: 0.0124812357519802 | Epoch: 54 | MeanAbsoluteError: 0.0356090366840363 | Loss: 0.0024876807614132 | Epoch: 55 | 
MeanAbsoluteError: 0.0630044937133789 | Loss: 0.0062092433830625 | Epoch: 56 | MeanAbsoluteError: 0.0516429431736469 | Loss: 0.0043942420498321 | Epoch: 57 | MeanAbsoluteError: 0.0833432003855705 | Loss: 0.0094934182094508 | Epoch: 58 | MeanAbsoluteError: 0.0447139404714108 | Loss: 0.0035265732225717 | Epoch: 59 | 
MeanAbsoluteError: 0.0591517202556133 | Loss: 0.0064351476826950 | Epoch: 60 | MeanAbsoluteError: 0.0832905396819115 | Loss: 0.0093197960308508 | Epoch: 61 | MeanAbsoluteError: 0.0697178170084953 | Loss: 0.0068160532483537 | Epoch: 62 | MeanAbsoluteError: 0.0411843061447144 | Loss: 0.0032872612539091 | Epoch: 63 | MeanAbsoluteError: 0.0470216609537601 | Loss: 0.0036658147398971 | Epoch: 64 | MeanAbsoluteError: 0.1567997336387634 | Loss: 0.0299976426911981 | Epoch: 65 | MeanAbsoluteError: 0.0425210259854794 | Loss: 0.0031855153103702 | Epoch: 66 | MeanAbsoluteError: 0.0655173435807228 | Loss: 0.0064941501906632 | Epoch: 67 | MeanAbsoluteError: 0.0919855907559395 | Loss: 0.0108168010452860 | Epoch: 68 | MeanAbsoluteError: 0.0849889889359474 | Loss: 0.0093803132982238 | Epoch: 69 | MeanAbsoluteError: 0.1145936846733093 | Loss: 0.0155504595390276 | Epoch: 70 | MeanAbsoluteError: 0.0383654683828354 | Loss: 0.0027761564461367 | Epoch: 71 | MeanAbsoluteError: 0.0820434391498566 | Loss: 0.0093159714566642 | Epoch: 72 | MeanAbsoluteError: 0.0551934987306595 | Loss: 0.0059582531317382 | Epoch: 73 | MeanAbsoluteError: 0.1266217529773712 | Loss: 0.0200172218641168 | Epoch: 74 | 
MeanAbsoluteError: 0.0480641722679138 | Loss: 0.0038638502040780 | Epoch: 75 | MeanAbsoluteError: 0.0601010583341122 | Loss: 0.0054833895134691 | Epoch: 76 | MeanAbsoluteError: 0.0647122859954834 | Loss: 0.0081660760272490 | Epoch: 77 | MeanAbsoluteError: 0.0853702127933502 | Loss: 0.0115183142111882 | Epoch: 78 | 
MeanAbsoluteError: 0.0719594731926918 | Loss: 0.0066907302672534 | Epoch: 79 | MeanAbsoluteError: 0.0592313818633556 | Loss: 0.0063185264895621 | Epoch: 80 | MeanAbsoluteError: 0.0653950795531273 | Loss: 0.0061146402486453 | Epoch: 81 | MeanAbsoluteError: 0.0405097678303719 | Loss: 0.0028735605240064 | Epoch: 82 | MeanAbsoluteError: 0.0708017051219940 | Loss: 0.0086123098276163 | Epoch: 83 | MeanAbsoluteError: 0.0861884579062462 | Loss: 0.0103376807988082 | Epoch: 84 | MeanAbsoluteError: 0.0829845517873764 | Loss: 0.0105123474801842 | Epoch: 85 | MeanAbsoluteError: 0.0949225202202797 | Loss: 0.0110604768667958 | Epoch: 86 | MeanAbsoluteError: 0.0442406162619591 | Loss: 0.0034164733277928 | Early stopping at epoch 85
Returned to Spot: Validation loss: 0.0034164733277927887

config: {'_L_in': 10, '_L_out': 1, 'l1': 128, 'dropout_prob': 0.8582565260508446, 'lr_mult': 0.4977322453322358, 'batch_size': 2, 'epochs': 32768, 'k_folds': 1, 'patience': 128, 'optimizer': 'ASGD', 'sgd_momentum': 0.6834550718769361}
Epoch: 1 | 
MeanAbsoluteError: 0.2102157920598984 | Loss: 0.0665509853271457 | Epoch: 2 | 
MeanAbsoluteError: 0.1791418343782425 | Loss: 0.0514642968562354 | Epoch: 3 | MeanAbsoluteError: 0.1646759361028671 | Loss: 0.0416730181280824 | Epoch: 4 | 
MeanAbsoluteError: 0.1552460193634033 | Loss: 0.0390001587003159 | Epoch: 5 | 
MeanAbsoluteError: 0.1565588414669037 | Loss: 0.0391083471224799 | Epoch: 6 | MeanAbsoluteError: 0.1564691662788391 | Loss: 0.0373846962527993 | Epoch: 7 | 
MeanAbsoluteError: 0.1433590054512024 | Loss: 0.0325400658173021 | Epoch: 8 | 
MeanAbsoluteError: 0.1373151391744614 | Loss: 0.0302275480066116 | Epoch: 9 | MeanAbsoluteError: 0.1353391408920288 | Loss: 0.0298610496627710 | Epoch: 10 | 
MeanAbsoluteError: 0.1314878910779953 | Loss: 0.0293896116931379 | Epoch: 11 | 
MeanAbsoluteError: 0.1437053084373474 | Loss: 0.0325698297285271 | Epoch: 12 | MeanAbsoluteError: 0.1345003545284271 | Loss: 0.0296480408672263 | Epoch: 13 | 
MeanAbsoluteError: 0.1331509500741959 | Loss: 0.0290867671955478 | Epoch: 14 | 
MeanAbsoluteError: 0.1383592784404755 | Loss: 0.0303594978703162 | Epoch: 15 | MeanAbsoluteError: 0.1409113705158234 | Loss: 0.0306548527628183 | Epoch: 16 | 
MeanAbsoluteError: 0.1337313652038574 | Loss: 0.0285606742281622 | Epoch: 17 | 
MeanAbsoluteError: 0.1339588165283203 | Loss: 0.0287238180755715 | Epoch: 18 | MeanAbsoluteError: 0.1320623457431793 | Loss: 0.0280341896309983 | Epoch: 19 | 
MeanAbsoluteError: 0.1312285363674164 | Loss: 0.0276951678255379 | Epoch: 20 | 
MeanAbsoluteError: 0.1323003619909286 | Loss: 0.0283333077044032 | Epoch: 21 | MeanAbsoluteError: 0.1309539675712585 | Loss: 0.0273300248066274 | Epoch: 22 | 
MeanAbsoluteError: 0.1328950822353363 | Loss: 0.0289819976819369 | Epoch: 23 | 
MeanAbsoluteError: 0.1269196271896362 | Loss: 0.0267477497855399 | Epoch: 24 | MeanAbsoluteError: 0.1281350553035736 | Loss: 0.0261243307567202 | Epoch: 25 | 
MeanAbsoluteError: 0.1324069648981094 | Loss: 0.0278549588979998 | Epoch: 26 | 
MeanAbsoluteError: 0.1301785409450531 | Loss: 0.0281666334187321 | Epoch: 27 | MeanAbsoluteError: 0.1295827329158783 | Loss: 0.0274198624980393 | Epoch: 28 | 
MeanAbsoluteError: 0.1273842453956604 | Loss: 0.0261939689890035 | Epoch: 29 | 
MeanAbsoluteError: 0.1294062733650208 | Loss: 0.0277862003777409 | Epoch: 30 | MeanAbsoluteError: 0.1316287815570831 | Loss: 0.0275045535696942 | Epoch: 31 | 
MeanAbsoluteError: 0.1308544278144836 | Loss: 0.0269882484627184 | Epoch: 32 | 
MeanAbsoluteError: 0.1330181509256363 | Loss: 0.0284149027016368 | Epoch: 33 | MeanAbsoluteError: 0.1323383003473282 | Loss: 0.0274167901117471 | Epoch: 34 | 
MeanAbsoluteError: 0.1306152045726776 | Loss: 0.0270658305465865 | Epoch: 35 | 
MeanAbsoluteError: 0.1351267397403717 | Loss: 0.0295521621857188 | Epoch: 36 | MeanAbsoluteError: 0.1297154873609543 | Loss: 0.0273715227258314 | Epoch: 37 | 
MeanAbsoluteError: 0.1324552446603775 | Loss: 0.0287067646984118 | Epoch: 38 | 
MeanAbsoluteError: 0.1301193833351135 | Loss: 0.0271218066126820 | Epoch: 39 | MeanAbsoluteError: 0.1307657063007355 | Loss: 0.0277240701116777 | Epoch: 40 | 
MeanAbsoluteError: 0.1311408281326294 | Loss: 0.0287272857382777 | Epoch: 41 | 
MeanAbsoluteError: 0.1317073553800583 | Loss: 0.0279814985767007 | Epoch: 42 | MeanAbsoluteError: 0.1294104307889938 | Loss: 0.0274552128285965 | Epoch: 43 | 
MeanAbsoluteError: 0.1294929534196854 | Loss: 0.0271658662416060 | Epoch: 44 | 
MeanAbsoluteError: 0.1277399957180023 | Loss: 0.0266493456709698 | Epoch: 45 | MeanAbsoluteError: 0.1310832202434540 | Loss: 0.0277428684096473 | Epoch: 46 | 
MeanAbsoluteError: 0.1308962851762772 | Loss: 0.0278984262857314 | Epoch: 47 | 
MeanAbsoluteError: 0.1290927082300186 | Loss: 0.0265723158085408 | Epoch: 48 | MeanAbsoluteError: 0.1299927383661270 | Loss: 0.0273451234900737 | Epoch: 49 | 
MeanAbsoluteError: 0.1270874589681625 | Loss: 0.0258068862045184 | Epoch: 50 | 
MeanAbsoluteError: 0.1325191110372543 | Loss: 0.0272713710898339 | Epoch: 51 | MeanAbsoluteError: 0.1306291669607162 | Loss: 0.0272572589248496 | Epoch: 52 | 
MeanAbsoluteError: 0.1295180767774582 | Loss: 0.0272477318694776 | Epoch: 53 | 
MeanAbsoluteError: 0.1240790560841560 | Loss: 0.0257985427562380 | Epoch: 54 | MeanAbsoluteError: 0.1286749988794327 | Loss: 0.0263048455524646 | Epoch: 55 | 
MeanAbsoluteError: 0.1246573403477669 | Loss: 0.0256491075310259 | Epoch: 56 | 
MeanAbsoluteError: 0.1255495101213455 | Loss: 0.0263114615893088 | Epoch: 57 | MeanAbsoluteError: 0.1241434216499329 | Loss: 0.0262852428055582 | Epoch: 58 | 
MeanAbsoluteError: 0.1284091472625732 | Loss: 0.0268498247775036 | Epoch: 59 | 
MeanAbsoluteError: 0.1286313384771347 | Loss: 0.0264026489741324 | Epoch: 60 | MeanAbsoluteError: 0.1290634274482727 | Loss: 0.0266372710229431 | Epoch: 61 | 
MeanAbsoluteError: 0.1317204833030701 | Loss: 0.0278843635474762 | Epoch: 62 | 
MeanAbsoluteError: 0.1268922239542007 | Loss: 0.0263441636703646 | Epoch: 63 | MeanAbsoluteError: 0.1288563460111618 | Loss: 0.0274764697138259 | Epoch: 64 | 
MeanAbsoluteError: 0.1306124031543732 | Loss: 0.0264964445580214 | Epoch: 65 | 
MeanAbsoluteError: 0.1326338350772858 | Loss: 0.0281501388992183 | Epoch: 66 | MeanAbsoluteError: 0.1329332292079926 | Loss: 0.0283920423315916 | Epoch: 67 | 
MeanAbsoluteError: 0.1294229775667191 | Loss: 0.0273425751369602 | Epoch: 68 | 
MeanAbsoluteError: 0.1282555460929871 | Loss: 0.0269424480750361 | Epoch: 69 | MeanAbsoluteError: 0.1278754770755768 | Loss: 0.0260667533231632 | Epoch: 70 | 
MeanAbsoluteError: 0.1278028786182404 | Loss: 0.0269823084981181 | Epoch: 71 | 
MeanAbsoluteError: 0.1306986808776855 | Loss: 0.0268667063689403 | Epoch: 72 | MeanAbsoluteError: 0.1263697743415833 | Loss: 0.0261413525351478 | Epoch: 73 | 
MeanAbsoluteError: 0.1232607662677765 | Loss: 0.0243933924518448 | Epoch: 74 | 
MeanAbsoluteError: 0.1272476166486740 | Loss: 0.0262815809008801 | Epoch: 75 | MeanAbsoluteError: 0.1281934231519699 | Loss: 0.0272914708481449 | Epoch: 76 | 
MeanAbsoluteError: 0.1230077594518661 | Loss: 0.0246506826259429 | Epoch: 77 | 
MeanAbsoluteError: 0.1296063810586929 | Loss: 0.0266628393907255 | Epoch: 78 | MeanAbsoluteError: 0.1296603083610535 | Loss: 0.0271187999280422 | Epoch: 79 | 
MeanAbsoluteError: 0.1258707791566849 | Loss: 0.0246629581948946 | Epoch: 80 | 
MeanAbsoluteError: 0.1344768851995468 | Loss: 0.0282694783445913 | Epoch: 81 | MeanAbsoluteError: 0.1294379383325577 | Loss: 0.0268022918671098 | Epoch: 82 | 
MeanAbsoluteError: 0.1256334632635117 | Loss: 0.0251619620795433 | Epoch: 83 | 
MeanAbsoluteError: 0.1267390549182892 | Loss: 0.0259477935093067 | Epoch: 84 | MeanAbsoluteError: 0.1227691024541855 | Loss: 0.0248491936886179 | Epoch: 85 | 
MeanAbsoluteError: 0.1252847313880920 | Loss: 0.0247165721447285 | Epoch: 86 | 
MeanAbsoluteError: 0.1300581842660904 | Loss: 0.0266487833638287 | Epoch: 87 | MeanAbsoluteError: 0.1338419318199158 | Loss: 0.0284174115934487 | Epoch: 88 | 
MeanAbsoluteError: 0.1267838180065155 | Loss: 0.0260074619368728 | Epoch: 89 | 
MeanAbsoluteError: 0.1253502517938614 | Loss: 0.0257665255295190 | Epoch: 90 | MeanAbsoluteError: 0.1269852519035339 | Loss: 0.0254256452786891 | Epoch: 91 | 
MeanAbsoluteError: 0.1275876164436340 | Loss: 0.0261710758466506 | Epoch: 92 | 
MeanAbsoluteError: 0.1305522471666336 | Loss: 0.0271382087557383 | Epoch: 93 | MeanAbsoluteError: 0.1333543956279755 | Loss: 0.0280724292502661 | Epoch: 94 | 
MeanAbsoluteError: 0.1279048472642899 | Loss: 0.0266800144441853 | Epoch: 95 | 
MeanAbsoluteError: 0.1316096037626266 | Loss: 0.0269531364434321 | Epoch: 96 | MeanAbsoluteError: 0.1269774287939072 | Loss: 0.0261731802256933 | Epoch: 97 | 
MeanAbsoluteError: 0.1265817582607269 | Loss: 0.0259398512851233 | Epoch: 98 | 
MeanAbsoluteError: 0.1302405744791031 | Loss: 0.0273198330471253 | Epoch: 99 | MeanAbsoluteError: 0.1215663030743599 | Loss: 0.0237398605492005 | Epoch: 100 | 
MeanAbsoluteError: 0.1265951842069626 | Loss: 0.0261927174382678 | Epoch: 101 | 
MeanAbsoluteError: 0.1274755746126175 | Loss: 0.0261462494029547 | Epoch: 102 | MeanAbsoluteError: 0.1300031095743179 | Loss: 0.0273470994061790 | Epoch: 103 | 
MeanAbsoluteError: 0.1252849251031876 | Loss: 0.0248441091396671 | Epoch: 104 | 
MeanAbsoluteError: 0.1248131468892097 | Loss: 0.0251717831485439 | Epoch: 105 | MeanAbsoluteError: 0.1198159754276276 | Loss: 0.0232199447232415 | Epoch: 106 | 
MeanAbsoluteError: 0.1212125048041344 | Loss: 0.0238739198782908 | Epoch: 107 | 
MeanAbsoluteError: 0.1265274584293365 | Loss: 0.0268793218381082 | Epoch: 108 | MeanAbsoluteError: 0.1260225623846054 | Loss: 0.0257897023383218 | Epoch: 109 | 
MeanAbsoluteError: 0.1289996653795242 | Loss: 0.0266460445559157 | Epoch: 110 | 
MeanAbsoluteError: 0.1255685240030289 | Loss: 0.0248337387239250 | Epoch: 111 | MeanAbsoluteError: 0.1293907612562180 | Loss: 0.0272638532627995 | Epoch: 112 | 
MeanAbsoluteError: 0.1176716610789299 | Loss: 0.0226351454691030 | Epoch: 113 | 
MeanAbsoluteError: 0.1274376511573792 | Loss: 0.0254039728714270 | Epoch: 114 | MeanAbsoluteError: 0.1268608719110489 | Loss: 0.0251802930251385 | Epoch: 115 | 
MeanAbsoluteError: 0.1223524883389473 | Loss: 0.0241381361865206 | Epoch: 116 | 
MeanAbsoluteError: 0.1239159926772118 | Loss: 0.0250231726029112 | Epoch: 117 | MeanAbsoluteError: 0.1263691633939743 | Loss: 0.0253282277732311 | Epoch: 118 | 
MeanAbsoluteError: 0.1285864412784576 | Loss: 0.0263887474311438 | Epoch: 119 | 
MeanAbsoluteError: 0.1215927004814148 | Loss: 0.0236628530680173 | Epoch: 120 | MeanAbsoluteError: 0.1274651139974594 | Loss: 0.0255666840861280 | Epoch: 121 | 
MeanAbsoluteError: 0.1235426440834999 | Loss: 0.0244086579122571 | Epoch: 122 | 
MeanAbsoluteError: 0.1290850043296814 | Loss: 0.0253977768728995 | Epoch: 123 | MeanAbsoluteError: 0.1276722252368927 | Loss: 0.0252955104734671 | Epoch: 124 | 
MeanAbsoluteError: 0.1269372105598450 | Loss: 0.0261592098980327 | Epoch: 125 | 
MeanAbsoluteError: 0.1194866299629211 | Loss: 0.0239005121813777 | Epoch: 126 | MeanAbsoluteError: 0.1288756281137466 | Loss: 0.0257306113028123 | Epoch: 127 | 
MeanAbsoluteError: 0.1283125877380371 | Loss: 0.0266165129337363 | Epoch: 128 | 
MeanAbsoluteError: 0.1257169097661972 | Loss: 0.0257395806490482 | Epoch: 129 | MeanAbsoluteError: 0.1216021627187729 | Loss: 0.0242324082467409 | Epoch: 130 | 
MeanAbsoluteError: 0.1245446130633354 | Loss: 0.0253846809425037 | Epoch: 131 | 
MeanAbsoluteError: 0.1208044216036797 | Loss: 0.0240102828233967 | Epoch: 132 | MeanAbsoluteError: 0.1236972957849503 | Loss: 0.0247346029403464 | Epoch: 133 | 
MeanAbsoluteError: 0.1255433410406113 | Loss: 0.0252084223071142 | Epoch: 134 | 
MeanAbsoluteError: 0.1265958547592163 | Loss: 0.0238017121335724 | Epoch: 135 | MeanAbsoluteError: 0.1229776516556740 | Loss: 0.0243014536169115 | Epoch: 136 | 
MeanAbsoluteError: 0.1326731592416763 | Loss: 0.0269295116210318 | Epoch: 137 | 
MeanAbsoluteError: 0.1284371912479401 | Loss: 0.0268021870311350 | Epoch: 138 | MeanAbsoluteError: 0.1238947436213493 | Loss: 0.0244600809356780 | Epoch: 139 | 
MeanAbsoluteError: 0.1293323189020157 | Loss: 0.0265190965363096 | Epoch: 140 | 
MeanAbsoluteError: 0.1203877478837967 | Loss: 0.0242159448628081 | Epoch: 141 | MeanAbsoluteError: 0.1243271008133888 | Loss: 0.0256816558275993 | Epoch: 142 | 
MeanAbsoluteError: 0.1250777095556259 | Loss: 0.0249787031877592 | Epoch: 143 | 
MeanAbsoluteError: 0.1302986145019531 | Loss: 0.0262836561146347 | Epoch: 144 | MeanAbsoluteError: 0.1257786601781845 | Loss: 0.0252046272616523 | Epoch: 145 | 
MeanAbsoluteError: 0.1294629573822021 | Loss: 0.0263406169167138 | Epoch: 146 | 
MeanAbsoluteError: 0.1231233999133110 | Loss: 0.0243558348415051 | Epoch: 147 | MeanAbsoluteError: 0.1246404126286507 | Loss: 0.0253699602954900 | Epoch: 148 | 
MeanAbsoluteError: 0.1239404156804085 | Loss: 0.0247743580871611 | Epoch: 149 | 
MeanAbsoluteError: 0.1262796521186829 | Loss: 0.0241869716352085 | Epoch: 150 | MeanAbsoluteError: 0.1233366802334785 | Loss: 0.0244420860748990 | Epoch: 151 | 
MeanAbsoluteError: 0.1248720809817314 | Loss: 0.0253030999803741 | Epoch: 152 | 
MeanAbsoluteError: 0.1183039620518684 | Loss: 0.0220976164393748 | Epoch: 153 | MeanAbsoluteError: 0.1258634328842163 | Loss: 0.0261330285312943 | Epoch: 154 | 
MeanAbsoluteError: 0.1258328855037689 | Loss: 0.0254795402086893 | Epoch: 155 | 
MeanAbsoluteError: 0.1261493265628815 | Loss: 0.0242246383997068 | Epoch: 156 | MeanAbsoluteError: 0.1238932684063911 | Loss: 0.0244056163741819 | Epoch: 157 | 
MeanAbsoluteError: 0.1222455501556396 | Loss: 0.0241419230076523 | Epoch: 158 | 
MeanAbsoluteError: 0.1222455352544785 | Loss: 0.0238218493476840 | Epoch: 159 | MeanAbsoluteError: 0.1245422735810280 | Loss: 0.0249811718962155 | Epoch: 160 | 
MeanAbsoluteError: 0.1236570253968239 | Loss: 0.0243279189249733 | Epoch: 161 | 
MeanAbsoluteError: 0.1214886084198952 | Loss: 0.0238095132699042 | Epoch: 162 | MeanAbsoluteError: 0.1249737292528152 | Loss: 0.0253672441430778 | Epoch: 163 | 
MeanAbsoluteError: 0.1272814869880676 | Loss: 0.0253479926909010 | Epoch: 164 | 
MeanAbsoluteError: 0.1333645880222321 | Loss: 0.0279801784618758 | Epoch: 165 | MeanAbsoluteError: 0.1262485831975937 | Loss: 0.0258340676723795 | Epoch: 166 | 
MeanAbsoluteError: 0.1267826706171036 | Loss: 0.0247424248155827 | Epoch: 167 | 
MeanAbsoluteError: 0.1259748488664627 | Loss: 0.0251483035222191 | Epoch: 168 | MeanAbsoluteError: 0.1231370940804482 | Loss: 0.0235354478308000 | Epoch: 169 | 
MeanAbsoluteError: 0.1233678162097931 | Loss: 0.0240064087735179 | Epoch: 170 | 
MeanAbsoluteError: 0.1217409893870354 | Loss: 0.0233430486169527 | Epoch: 171 | MeanAbsoluteError: 0.1214836016297340 | Loss: 0.0231814633863784 | Epoch: 172 | 
MeanAbsoluteError: 0.1199882104992867 | Loss: 0.0233362886130150 | Epoch: 173 | 
MeanAbsoluteError: 0.1272649616003036 | Loss: 0.0255465925467433 | Epoch: 174 | MeanAbsoluteError: 0.1256207823753357 | Loss: 0.0255436673266619 | Epoch: 175 | 
MeanAbsoluteError: 0.1213891878724098 | Loss: 0.0228192307641924 | Epoch: 176 | 
MeanAbsoluteError: 0.1228522583842278 | Loss: 0.0239838092585395 | Epoch: 177 | MeanAbsoluteError: 0.1218982860445976 | Loss: 0.0231730767374393 | Epoch: 178 | 
MeanAbsoluteError: 0.1230417117476463 | Loss: 0.0234387933244094 | Epoch: 179 | 
MeanAbsoluteError: 0.1197614669799805 | Loss: 0.0229810547141824 | Epoch: 180 | MeanAbsoluteError: 0.1319567412137985 | Loss: 0.0268096842291925 | Epoch: 181 | 
MeanAbsoluteError: 0.1164606362581253 | Loss: 0.0226855791026416 | Epoch: 182 | 
MeanAbsoluteError: 0.1246052831411362 | Loss: 0.0248458027375940 | Epoch: 183 | MeanAbsoluteError: 0.1220383197069168 | Loss: 0.0239765042747846 | Epoch: 184 | 
MeanAbsoluteError: 0.1215223595499992 | Loss: 0.0232478923028248 | Epoch: 185 | 
MeanAbsoluteError: 0.1229933425784111 | Loss: 0.0234860074250416 | Epoch: 186 | MeanAbsoluteError: 0.1225182712078094 | Loss: 0.0245974068950939 | Epoch: 187 | 
MeanAbsoluteError: 0.1204395070672035 | Loss: 0.0231821879465133 | Epoch: 188 | 
MeanAbsoluteError: 0.1266300380229950 | Loss: 0.0250140564145598 | Epoch: 189 | MeanAbsoluteError: 0.1202166527509689 | Loss: 0.0234881731271222 | Epoch: 190 | 
MeanAbsoluteError: 0.1190423220396042 | Loss: 0.0226181379904544 | Epoch: 191 | 
MeanAbsoluteError: 0.1196661666035652 | Loss: 0.0235217380585770 | Epoch: 192 | MeanAbsoluteError: 0.1194999441504478 | Loss: 0.0232721826787747 | Epoch: 193 | 
MeanAbsoluteError: 0.1245827227830887 | Loss: 0.0245430455229750 | Epoch: 194 | 
MeanAbsoluteError: 0.1266150921583176 | Loss: 0.0244737919012550 | Epoch: 195 | MeanAbsoluteError: 0.1219901368021965 | Loss: 0.0235738942818716 | Epoch: 196 | 
MeanAbsoluteError: 0.1234380975365639 | Loss: 0.0245113174583336 | Epoch: 197 | 
MeanAbsoluteError: 0.1232323423027992 | Loss: 0.0249685200341628 | Epoch: 198 | MeanAbsoluteError: 0.1228264495730400 | Loss: 0.0240200985097423 | Epoch: 199 | 
MeanAbsoluteError: 0.1177096590399742 | Loss: 0.0223083299869298 | Epoch: 200 | 
MeanAbsoluteError: 0.1230057775974274 | Loss: 0.0239097236832216 | Epoch: 201 | MeanAbsoluteError: 0.1252094954252243 | Loss: 0.0244555256414848 | Epoch: 202 | 
MeanAbsoluteError: 0.1220335140824318 | Loss: 0.0232952304036977 | Epoch: 203 | 
MeanAbsoluteError: 0.1253298372030258 | Loss: 0.0247361508320319 | Epoch: 204 | MeanAbsoluteError: 0.1219793930649757 | Loss: 0.0236685012997865 | Epoch: 205 | 
MeanAbsoluteError: 0.1254278272390366 | Loss: 0.0240236972777833 | Epoch: 206 | 
MeanAbsoluteError: 0.1205756142735481 | Loss: 0.0232762720557124 | Epoch: 207 | MeanAbsoluteError: 0.1160673648118973 | Loss: 0.0222787634562701 | Epoch: 208 | 
MeanAbsoluteError: 0.1157898083329201 | Loss: 0.0221206869708840 | Epoch: 209 | 
MeanAbsoluteError: 0.1176840737462044 | Loss: 0.0223699557208844 | Epoch: 210 | MeanAbsoluteError: 0.1207094565033913 | Loss: 0.0228657115641909 | Epoch: 211 | 
MeanAbsoluteError: 0.1239864379167557 | Loss: 0.0242125370679423 | Epoch: 212 | 
MeanAbsoluteError: 0.1173232868313789 | Loss: 0.0223567307319415 | Epoch: 213 | MeanAbsoluteError: 0.1230286508798599 | Loss: 0.0234625770031319 | Epoch: 214 | 
MeanAbsoluteError: 0.1193790212273598 | Loss: 0.0220516300270295 | Epoch: 215 | 
MeanAbsoluteError: 0.1198453903198242 | Loss: 0.0230685822940723 | Epoch: 216 | MeanAbsoluteError: 0.1225361227989197 | Loss: 0.0234309539226342 | Epoch: 217 | 
MeanAbsoluteError: 0.1197224184870720 | Loss: 0.0229902814369416 | Epoch: 218 | 
MeanAbsoluteError: 0.1215275600552559 | Loss: 0.0233032984434006 | Epoch: 219 | MeanAbsoluteError: 0.1197552233934402 | Loss: 0.0231429299448306 | Epoch: 220 | 
MeanAbsoluteError: 0.1151008754968643 | Loss: 0.0216275214293213 | Epoch: 221 | 
MeanAbsoluteError: 0.1177813708782196 | Loss: 0.0223788560242489 | Epoch: 222 | MeanAbsoluteError: 0.1205273419618607 | Loss: 0.0223215974252525 | Epoch: 223 | 
MeanAbsoluteError: 0.1154473721981049 | Loss: 0.0212313888626765 | Epoch: 224 | 
MeanAbsoluteError: 0.1228204742074013 | Loss: 0.0239585870857748 | Epoch: 225 | MeanAbsoluteError: 0.1152007803320885 | Loss: 0.0225305807287562 | Epoch: 226 | 
MeanAbsoluteError: 0.1235764473676682 | Loss: 0.0243401586159113 | Epoch: 227 | 
MeanAbsoluteError: 0.1209341585636139 | Loss: 0.0233812679903349 | Epoch: 228 | MeanAbsoluteError: 0.1180767938494682 | Loss: 0.0227865537335553 | Epoch: 229 | 
MeanAbsoluteError: 0.1211885437369347 | Loss: 0.0229222726418326 | Epoch: 230 | 
MeanAbsoluteError: 0.1142123416066170 | Loss: 0.0210667004157343 | Epoch: 231 | MeanAbsoluteError: 0.1171048507094383 | Loss: 0.0219162282532635 | Epoch: 232 | 
MeanAbsoluteError: 0.1233923882246017 | Loss: 0.0243246061112344 | Epoch: 233 | 
MeanAbsoluteError: 0.1206913739442825 | Loss: 0.0224944824845685 | Epoch: 234 | MeanAbsoluteError: 0.1164302676916122 | Loss: 0.0219715766860948 | Epoch: 235 | 
MeanAbsoluteError: 0.1166623085737228 | Loss: 0.0222330795683471 | Epoch: 236 | 
MeanAbsoluteError: 0.1192160695791245 | Loss: 0.0219706429682750 | Epoch: 237 | MeanAbsoluteError: 0.1168800070881844 | Loss: 0.0217194253904745 | Epoch: 238 | 
MeanAbsoluteError: 0.1215790584683418 | Loss: 0.0232176420387502 | Epoch: 239 | 
MeanAbsoluteError: 0.1177576184272766 | Loss: 0.0214934058213839 | Epoch: 240 | MeanAbsoluteError: 0.1204075142741203 | Loss: 0.0226601775398012 | Epoch: 241 | 
MeanAbsoluteError: 0.1206947714090347 | Loss: 0.0234696458560938 | Epoch: 242 | 
MeanAbsoluteError: 0.1165590435266495 | Loss: 0.0225764500505594 | Epoch: 243 | MeanAbsoluteError: 0.1182412728667259 | Loss: 0.0224317816453792 | Epoch: 244 | 
MeanAbsoluteError: 0.1191309243440628 | Loss: 0.0223116150773179 | Epoch: 245 | 
MeanAbsoluteError: 0.1226589307188988 | Loss: 0.0238461798604112 | Epoch: 246 | MeanAbsoluteError: 0.1208608373999596 | Loss: 0.0231906459795967 | Epoch: 247 | 
MeanAbsoluteError: 0.1237911581993103 | Loss: 0.0236853133749294 | Epoch: 248 | 
MeanAbsoluteError: 0.1212196350097656 | Loss: 0.0239682304093609 | Epoch: 249 | MeanAbsoluteError: 0.1132403686642647 | Loss: 0.0207848831108519 | Epoch: 250 | 
MeanAbsoluteError: 0.1213263347744942 | Loss: 0.0220725718674172 | Epoch: 251 | 
MeanAbsoluteError: 0.1126734167337418 | Loss: 0.0201114097049382 | Epoch: 252 | MeanAbsoluteError: 0.1167616173624992 | Loss: 0.0221753067494137 | Epoch: 253 | 
MeanAbsoluteError: 0.1210124939680099 | Loss: 0.0232879705403078 | Epoch: 254 | 
MeanAbsoluteError: 0.1135738492012024 | Loss: 0.0214798969574622 | Epoch: 255 | MeanAbsoluteError: 0.1193159222602844 | Loss: 0.0220624571450753 | Epoch: 256 | 
MeanAbsoluteError: 0.1176946386694908 | Loss: 0.0223667316449185 | Epoch: 257 | 
MeanAbsoluteError: 0.1194745898246765 | Loss: 0.0223441709974819 | Epoch: 258 | MeanAbsoluteError: 0.1188266873359680 | Loss: 0.0217152421777913 | Epoch: 259 | 
MeanAbsoluteError: 0.1135515049099922 | Loss: 0.0205960815305298 | Epoch: 260 | 
MeanAbsoluteError: 0.1156262680888176 | Loss: 0.0222345304705474 | Epoch: 261 | MeanAbsoluteError: 0.1084112152457237 | Loss: 0.0181569367223710 | Epoch: 262 | 
MeanAbsoluteError: 0.1179286986589432 | Loss: 0.0217346067930339 | Epoch: 263 | 
MeanAbsoluteError: 0.1165856420993805 | Loss: 0.0211070975150991 | Epoch: 264 | MeanAbsoluteError: 0.1111558675765991 | Loss: 0.0200070150212074 | Epoch: 265 | 
MeanAbsoluteError: 0.1205206960439682 | Loss: 0.0237851255686837 | Epoch: 266 | 
MeanAbsoluteError: 0.1154857650399208 | Loss: 0.0209134246450655 | Epoch: 267 | MeanAbsoluteError: 0.1112009286880493 | Loss: 0.0201940219794051 | Epoch: 268 | 
MeanAbsoluteError: 0.1168886572122574 | Loss: 0.0221733395674770 | Epoch: 269 | 
MeanAbsoluteError: 0.1143194809556007 | Loss: 0.0216841699685513 | Epoch: 270 | MeanAbsoluteError: 0.1173895373940468 | Loss: 0.0216626432045208 | Epoch: 271 | 
MeanAbsoluteError: 0.1156941875815392 | Loss: 0.0205949188647234 | Epoch: 272 | 
MeanAbsoluteError: 0.1155193075537682 | Loss: 0.0218060831879848 | Epoch: 273 | MeanAbsoluteError: 0.1127584427595139 | Loss: 0.0206264369771816 | Epoch: 274 | 
MeanAbsoluteError: 0.1093937084078789 | Loss: 0.0200421112200517 | Epoch: 275 | 
MeanAbsoluteError: 0.1157788187265396 | Loss: 0.0220105506390488 | Epoch: 276 | MeanAbsoluteError: 0.1089722663164139 | Loss: 0.0192585398579831 | Epoch: 277 | 
MeanAbsoluteError: 0.1132773682475090 | Loss: 0.0208842915812662 | Epoch: 278 | 
MeanAbsoluteError: 0.1169268190860748 | Loss: 0.0212298277414326 | Epoch: 279 | MeanAbsoluteError: 0.1185274645686150 | Loss: 0.0218489614313391 | Epoch: 280 | 
MeanAbsoluteError: 0.1168230175971985 | Loss: 0.0214688196271891 | Epoch: 281 | 
MeanAbsoluteError: 0.1174726858735085 | Loss: 0.0226259776952914 | Epoch: 282 | MeanAbsoluteError: 0.1081054285168648 | Loss: 0.0188513065767135 | Epoch: 283 | 
MeanAbsoluteError: 0.1168603897094727 | Loss: 0.0214431815817564 | Epoch: 284 | 
MeanAbsoluteError: 0.1205486282706261 | Loss: 0.0231580356994527 | Epoch: 285 | MeanAbsoluteError: 0.1186555102467537 | Loss: 0.0225512235453546 | Epoch: 286 | 
MeanAbsoluteError: 0.1086334362626076 | Loss: 0.0195800189800987 | Epoch: 287 | 
MeanAbsoluteError: 0.1184109970927238 | Loss: 0.0224613561872684 | Epoch: 288 | MeanAbsoluteError: 0.1165304183959961 | Loss: 0.0221518724062480 | Epoch: 289 | 
MeanAbsoluteError: 0.1086463257670403 | Loss: 0.0192406770800396 | Epoch: 290 | 
MeanAbsoluteError: 0.1121391654014587 | Loss: 0.0199390364073527 | Epoch: 291 | MeanAbsoluteError: 0.1202616617083549 | Loss: 0.0220361656911943 | Epoch: 292 | 
MeanAbsoluteError: 0.1116259992122650 | Loss: 0.0201859243629345 | Epoch: 293 | 
MeanAbsoluteError: 0.1140590906143188 | Loss: 0.0220233605670122 | Epoch: 294 | MeanAbsoluteError: 0.1110184490680695 | Loss: 0.0205085370659557 | Epoch: 295 | 
MeanAbsoluteError: 0.1072168871760368 | Loss: 0.0188329004176436 | Epoch: 296 | 
MeanAbsoluteError: 0.1205711141228676 | Loss: 0.0216438353486592 | Epoch: 297 | MeanAbsoluteError: 0.1123102605342865 | Loss: 0.0205135514524227 | Epoch: 298 | 
MeanAbsoluteError: 0.1165306121110916 | Loss: 0.0211944969694984 | Epoch: 299 | 
MeanAbsoluteError: 0.1090162172913551 | Loss: 0.0198241240831946 | Epoch: 300 | MeanAbsoluteError: 0.1183172613382339 | Loss: 0.0220181445885585 | Epoch: 301 | 
MeanAbsoluteError: 0.1090446710586548 | Loss: 0.0185193690493907 | Epoch: 302 | 
MeanAbsoluteError: 0.1179836764931679 | Loss: 0.0218038399323511 | Epoch: 303 | MeanAbsoluteError: 0.1114653795957565 | Loss: 0.0190018008378684 | Epoch: 304 | 
MeanAbsoluteError: 0.1055841669440269 | Loss: 0.0181006412366211 | Epoch: 305 | 
MeanAbsoluteError: 0.1159246563911438 | Loss: 0.0213321180325390 | Epoch: 306 | MeanAbsoluteError: 0.1186988428235054 | Loss: 0.0219460765371332 | Epoch: 307 | 
MeanAbsoluteError: 0.1152101010084152 | Loss: 0.0209899215291565 | Epoch: 308 | 
MeanAbsoluteError: 0.1180606335401535 | Loss: 0.0217984009023348 | Epoch: 309 | MeanAbsoluteError: 0.1140686571598053 | Loss: 0.0209899884108866 | Epoch: 310 | 
MeanAbsoluteError: 0.1152365878224373 | Loss: 0.0206621223094407 | Epoch: 311 | 
MeanAbsoluteError: 0.1145634353160858 | Loss: 0.0213564790059657 | Epoch: 312 | MeanAbsoluteError: 0.1122301965951920 | Loss: 0.0204730655328603 | Epoch: 313 | 
MeanAbsoluteError: 0.1127177774906158 | Loss: 0.0202710962648356 | Epoch: 314 | 
MeanAbsoluteError: 0.1129336059093475 | Loss: 0.0209185434821605 | Epoch: 315 | MeanAbsoluteError: 0.1092793121933937 | Loss: 0.0196065655291022 | Epoch: 316 | 
MeanAbsoluteError: 0.1157676801085472 | Loss: 0.0213240796509975 | Epoch: 317 | 
MeanAbsoluteError: 0.1125921979546547 | Loss: 0.0199622325356662 | Epoch: 318 | MeanAbsoluteError: 0.1182480901479721 | Loss: 0.0215154771495145 | Epoch: 319 | 
MeanAbsoluteError: 0.1063499376177788 | Loss: 0.0190253152817725 | Epoch: 320 | 
MeanAbsoluteError: 0.1088212952017784 | Loss: 0.0192225204590553 | Epoch: 321 | MeanAbsoluteError: 0.1101126745343208 | Loss: 0.0195096284137132 | Epoch: 322 | 
MeanAbsoluteError: 0.1134005486965179 | Loss: 0.0201440311006445 | Epoch: 323 | 
MeanAbsoluteError: 0.1109940111637115 | Loss: 0.0202674128181388 | Epoch: 324 | MeanAbsoluteError: 0.1163765937089920 | Loss: 0.0202687383079804 | Epoch: 325 | 
MeanAbsoluteError: 0.1121208071708679 | Loss: 0.0203167487850442 | Epoch: 326 | 
MeanAbsoluteError: 0.1108437478542328 | Loss: 0.0199853075181212 | Epoch: 327 | MeanAbsoluteError: 0.1169383525848389 | Loss: 0.0225225898564046 | Epoch: 328 | 
MeanAbsoluteError: 0.1116462871432304 | Loss: 0.0205436125735650 | Epoch: 329 | 
MeanAbsoluteError: 0.1061721444129944 | Loss: 0.0181712799860543 | Epoch: 330 | MeanAbsoluteError: 0.1098493859171867 | Loss: 0.0200516174963862 | Epoch: 331 | 
MeanAbsoluteError: 0.1131199896335602 | Loss: 0.0203543525899052 | Epoch: 332 | 
MeanAbsoluteError: 0.1103830114006996 | Loss: 0.0191875367463702 | Epoch: 333 | MeanAbsoluteError: 0.1113051101565361 | Loss: 0.0201653284045945 | Epoch: 334 | 
MeanAbsoluteError: 0.1087969318032265 | Loss: 0.0192863316357671 | Epoch: 335 | 
MeanAbsoluteError: 0.1146965771913528 | Loss: 0.0212363864915096 | Epoch: 336 | MeanAbsoluteError: 0.1105970889329910 | Loss: 0.0193950900256944 | Epoch: 337 | 
MeanAbsoluteError: 0.1152297481894493 | Loss: 0.0211108808735541 | Epoch: 338 | 
MeanAbsoluteError: 0.1141336187720299 | Loss: 0.0224495797836789 | Epoch: 339 | MeanAbsoluteError: 0.1076506823301315 | Loss: 0.0182367557999896 | Epoch: 340 | 
MeanAbsoluteError: 0.1107348129153252 | Loss: 0.0196694096591091 | Epoch: 341 | 
MeanAbsoluteError: 0.1086159124970436 | Loss: 0.0194470483707846 | Epoch: 342 | MeanAbsoluteError: 0.1152724176645279 | Loss: 0.0204110894728122 | Epoch: 343 | 
MeanAbsoluteError: 0.1096512004733086 | Loss: 0.0191614553368224 | Epoch: 344 | 
MeanAbsoluteError: 0.1101050823926926 | Loss: 0.0202383183974113 | Epoch: 345 | MeanAbsoluteError: 0.1033957898616791 | Loss: 0.0185081244603437 | Epoch: 346 | 
MeanAbsoluteError: 0.1105138361454010 | Loss: 0.0198917816878141 | Epoch: 347 | 
MeanAbsoluteError: 0.1165033578872681 | Loss: 0.0206480608376053 | Epoch: 348 | MeanAbsoluteError: 0.1078980416059494 | Loss: 0.0182325256118202 | Epoch: 349 | 
MeanAbsoluteError: 0.1084743663668633 | Loss: 0.0184720508697501 | Epoch: 350 | 
MeanAbsoluteError: 0.1094183102250099 | Loss: 0.0191570745040372 | Epoch: 351 | MeanAbsoluteError: 0.1080355718731880 | Loss: 0.0190371945332178 | Epoch: 352 | 
MeanAbsoluteError: 0.1109865605831146 | Loss: 0.0196262182156594 | Epoch: 353 | 
MeanAbsoluteError: 0.1075021773576736 | Loss: 0.0185438153737535 | Epoch: 354 | MeanAbsoluteError: 0.1072203814983368 | Loss: 0.0177141370354366 | Epoch: 355 | 
MeanAbsoluteError: 0.1124577447772026 | Loss: 0.0207633088430157 | Epoch: 356 | 
MeanAbsoluteError: 0.1097092926502228 | Loss: 0.0192660555820233 | Epoch: 357 | MeanAbsoluteError: 0.1097099408507347 | Loss: 0.0201752220921723 | Epoch: 358 | 
MeanAbsoluteError: 0.1091546788811684 | Loss: 0.0198308033615467 | Epoch: 359 | 
MeanAbsoluteError: 0.1025966852903366 | Loss: 0.0163147032737713 | Epoch: 360 | MeanAbsoluteError: 0.1100029274821281 | Loss: 0.0198254019541006 | Epoch: 361 | 
MeanAbsoluteError: 0.1082188561558723 | Loss: 0.0190798145301233 | Epoch: 362 | 
MeanAbsoluteError: 0.1119103655219078 | Loss: 0.0204364164546132 | Epoch: 363 | MeanAbsoluteError: 0.1160656735301018 | Loss: 0.0213884026266654 | Epoch: 364 | 
MeanAbsoluteError: 0.1094341501593590 | Loss: 0.0190138894717287 | Epoch: 365 | 
MeanAbsoluteError: 0.1112790331244469 | Loss: 0.0190585758399296 | Epoch: 366 | MeanAbsoluteError: 0.1072444543242455 | Loss: 0.0180069600047318 | Epoch: 367 | 
MeanAbsoluteError: 0.1117027401924133 | Loss: 0.0202270709358466 | Epoch: 368 | 
MeanAbsoluteError: 0.1105680689215660 | Loss: 0.0197340531112665 | Epoch: 369 | MeanAbsoluteError: 0.1063970327377319 | Loss: 0.0176848766052475 | Epoch: 370 | 
MeanAbsoluteError: 0.1057348847389221 | Loss: 0.0178422940217812 | Epoch: 371 | 
MeanAbsoluteError: 0.1030068695545197 | Loss: 0.0175803290550054 | Epoch: 372 | MeanAbsoluteError: 0.1043044924736023 | Loss: 0.0176082975766622 | Epoch: 373 | 
MeanAbsoluteError: 0.1067223250865936 | Loss: 0.0191273592222296 | Epoch: 374 | 
MeanAbsoluteError: 0.1084671765565872 | Loss: 0.0188998452154919 | Epoch: 375 | MeanAbsoluteError: 0.1039475798606873 | Loss: 0.0179255117248492 | Epoch: 376 | 
MeanAbsoluteError: 0.1043663471937180 | Loss: 0.0175069234526018 | Epoch: 377 | 
MeanAbsoluteError: 0.1104820370674133 | Loss: 0.0193572233036199 | Epoch: 378 | MeanAbsoluteError: 0.1120848581194878 | Loss: 0.0207132147678446 | Epoch: 379 | 
MeanAbsoluteError: 0.1071886718273163 | Loss: 0.0184528706973651 | Epoch: 380 | 
MeanAbsoluteError: 0.1125749722123146 | Loss: 0.0207470957224723 | Epoch: 381 | MeanAbsoluteError: 0.1113730221986771 | Loss: 0.0192966731153138 | Epoch: 382 | 
MeanAbsoluteError: 0.1154846325516701 | Loss: 0.0207538157159524 | Epoch: 383 | 
MeanAbsoluteError: 0.1017976030707359 | Loss: 0.0165430686124212 | Epoch: 384 | MeanAbsoluteError: 0.1028461679816246 | Loss: 0.0174596653852495 | Epoch: 385 | 
MeanAbsoluteError: 0.1114310994744301 | Loss: 0.0188679352061202 | Epoch: 386 | 
MeanAbsoluteError: 0.1081351190805435 | Loss: 0.0182885484055926 | Epoch: 387 | MeanAbsoluteError: 0.1113780215382576 | Loss: 0.0204502600146770 | Epoch: 388 | 
MeanAbsoluteError: 0.1113116294145584 | Loss: 0.0198405561581603 | Epoch: 389 | 
MeanAbsoluteError: 0.1079913228750229 | Loss: 0.0184428491317279 | Epoch: 390 | MeanAbsoluteError: 0.1124254390597343 | Loss: 0.0204556516854185 | Epoch: 391 | 
MeanAbsoluteError: 0.1075731143355370 | Loss: 0.0183798355752272 | Epoch: 392 | 
MeanAbsoluteError: 0.1096105203032494 | Loss: 0.0190529448645733 | Epoch: 393 | MeanAbsoluteError: 0.1063162386417389 | Loss: 0.0176883803413026 | Epoch: 394 | 
MeanAbsoluteError: 0.1078129559755325 | Loss: 0.0184918257904549 | Epoch: 395 | 
MeanAbsoluteError: 0.1054526194930077 | Loss: 0.0175816116891413 | Epoch: 396 | MeanAbsoluteError: 0.1066676601767540 | Loss: 0.0185103510526581 | Epoch: 397 | 
MeanAbsoluteError: 0.1024161428213120 | Loss: 0.0167687340507359 | Epoch: 398 | 
MeanAbsoluteError: 0.1091590523719788 | Loss: 0.0190118371249021 | Epoch: 399 | MeanAbsoluteError: 0.1049298122525215 | Loss: 0.0184039590088529 | Epoch: 400 | 
MeanAbsoluteError: 0.1043420061469078 | Loss: 0.0182430477013501 | Epoch: 401 | 
MeanAbsoluteError: 0.1150648146867752 | Loss: 0.0213681924671012 | Epoch: 402 | MeanAbsoluteError: 0.1063252016901970 | Loss: 0.0179485750344126 | Epoch: 403 | 
MeanAbsoluteError: 0.1052596569061279 | Loss: 0.0176247744592062 | Epoch: 404 | 
MeanAbsoluteError: 0.1145032495260239 | Loss: 0.0203894155400728 | Epoch: 405 | MeanAbsoluteError: 0.1072629019618034 | Loss: 0.0189004657623445 | Epoch: 406 | 
MeanAbsoluteError: 0.1014098674058914 | Loss: 0.0161731773459663 | Epoch: 407 | 
MeanAbsoluteError: 0.1126547008752823 | Loss: 0.0198788925237568 | Epoch: 408 | MeanAbsoluteError: 0.1082161739468575 | Loss: 0.0191191537274790 | Epoch: 409 | 
MeanAbsoluteError: 0.1042592525482178 | Loss: 0.0171239899006226 | Epoch: 410 | 
MeanAbsoluteError: 0.1053512468934059 | Loss: 0.0180779251784164 | Epoch: 411 | MeanAbsoluteError: 0.1081084981560707 | Loss: 0.0191424791586663 | Epoch: 412 | 
MeanAbsoluteError: 0.1096677556633949 | Loss: 0.0186143018325674 | Epoch: 413 | 
MeanAbsoluteError: 0.1087886169552803 | Loss: 0.0184241442791426 | Epoch: 414 | MeanAbsoluteError: 0.1074578836560249 | Loss: 0.0180553921802008 | Epoch: 415 | 
MeanAbsoluteError: 0.1070557013154030 | Loss: 0.0185823286101610 | Epoch: 416 | 
MeanAbsoluteError: 0.1065438389778137 | Loss: 0.0180178463129171 | Epoch: 417 | MeanAbsoluteError: 0.1060394421219826 | Loss: 0.0186620085678927 | Epoch: 418 | 
MeanAbsoluteError: 0.1100803539156914 | Loss: 0.0195770324626938 | Epoch: 419 | 
MeanAbsoluteError: 0.1082278937101364 | Loss: 0.0175446277026397 | Epoch: 420 | MeanAbsoluteError: 0.1041729897260666 | Loss: 0.0182336976924319 | Epoch: 421 | 
MeanAbsoluteError: 0.1072939932346344 | Loss: 0.0180786414642595 | Epoch: 422 | 
MeanAbsoluteError: 0.1092916652560234 | Loss: 0.0186533606966107 | Epoch: 423 | MeanAbsoluteError: 0.1093950644135475 | Loss: 0.0192238962198947 | Epoch: 424 | 
MeanAbsoluteError: 0.1011427044868469 | Loss: 0.0162566089982768 | Epoch: 425 | 
MeanAbsoluteError: 0.1044467166066170 | Loss: 0.0185675207353537 | Epoch: 426 | MeanAbsoluteError: 0.1028816401958466 | Loss: 0.0173465039612105 | Epoch: 427 | 
MeanAbsoluteError: 0.1082451120018959 | Loss: 0.0186663130545154 | Epoch: 428 | 
MeanAbsoluteError: 0.1031233519315720 | Loss: 0.0166740811367830 | Epoch: 429 | MeanAbsoluteError: 0.1083937063813210 | Loss: 0.0193147467853366 | Epoch: 430 | 
MeanAbsoluteError: 0.1068577468395233 | Loss: 0.0182576708293830 | Epoch: 431 | 
MeanAbsoluteError: 0.1045836731791496 | Loss: 0.0175487578418688 | Epoch: 432 | MeanAbsoluteError: 0.1069847866892815 | Loss: 0.0186660199316248 | Epoch: 433 | 
MeanAbsoluteError: 0.1065055876970291 | Loss: 0.0177473866909713 | Epoch: 434 | 
MeanAbsoluteError: 0.1144158914685249 | Loss: 0.0203162314738923 | Epoch: 435 | MeanAbsoluteError: 0.1006121188402176 | Loss: 0.0170661732241570 | Epoch: 436 | 
MeanAbsoluteError: 0.1107954010367393 | Loss: 0.0191861334918940 | Epoch: 437 | 
MeanAbsoluteError: 0.1052205041050911 | Loss: 0.0183041865231159 | Epoch: 438 | MeanAbsoluteError: 0.1129106506705284 | Loss: 0.0206724296230823 | Epoch: 439 | 
MeanAbsoluteError: 0.1039220616221428 | Loss: 0.0172184852500019 | Epoch: 440 | 
MeanAbsoluteError: 0.0999606475234032 | Loss: 0.0167866634663854 | Epoch: 441 | MeanAbsoluteError: 0.1055586934089661 | Loss: 0.0165622426136542 | Epoch: 442 | 
MeanAbsoluteError: 0.1033260822296143 | Loss: 0.0171586543317244 | Epoch: 443 | 
MeanAbsoluteError: 0.1048279181122780 | Loss: 0.0183809479228997 | Epoch: 444 | MeanAbsoluteError: 0.1060077473521233 | Loss: 0.0183397357806098 | Epoch: 445 | 
MeanAbsoluteError: 0.1053078249096870 | Loss: 0.0176206933531406 | Epoch: 446 | 
MeanAbsoluteError: 0.1036654040217400 | Loss: 0.0173099355490801 | Epoch: 447 | MeanAbsoluteError: 0.1074150204658508 | Loss: 0.0183197877042827 | Epoch: 448 | 
MeanAbsoluteError: 0.1137079373002052 | Loss: 0.0204963920585578 | Epoch: 449 | 
MeanAbsoluteError: 0.1100808084011078 | Loss: 0.0193953740178586 | Epoch: 450 | MeanAbsoluteError: 0.1021889522671700 | Loss: 0.0173031527824545 | Epoch: 451 | 
MeanAbsoluteError: 0.1046103313565254 | Loss: 0.0176176397350112 | Epoch: 452 | 
MeanAbsoluteError: 0.1042651236057281 | Loss: 0.0175998711584058 | Epoch: 453 | MeanAbsoluteError: 0.1045303940773010 | Loss: 0.0169040079370704 | Epoch: 454 | 
MeanAbsoluteError: 0.1003384515643120 | Loss: 0.0172174314416770 | Epoch: 455 | 
MeanAbsoluteError: 0.1050094068050385 | Loss: 0.0179638464525245 | Epoch: 456 | MeanAbsoluteError: 0.1072094365954399 | Loss: 0.0185594966085531 | Epoch: 457 | 
MeanAbsoluteError: 0.1045665964484215 | Loss: 0.0183242650131191 | Epoch: 458 | 
MeanAbsoluteError: 0.1072380691766739 | Loss: 0.0192557434527165 | Epoch: 459 | MeanAbsoluteError: 0.1041370183229446 | Loss: 0.0177115750290007 | Epoch: 460 | 
MeanAbsoluteError: 0.1047966778278351 | Loss: 0.0180399565363768 | Epoch: 461 | 
MeanAbsoluteError: 0.1009185537695885 | Loss: 0.0171972870247936 | Epoch: 462 | MeanAbsoluteError: 0.0993184968829155 | Loss: 0.0164250484692214 | Epoch: 463 | 
MeanAbsoluteError: 0.1029707491397858 | Loss: 0.0176820080494266 | Epoch: 464 | 
MeanAbsoluteError: 0.0966066941618919 | Loss: 0.0148589386558342 | Epoch: 465 | MeanAbsoluteError: 0.1024949848651886 | Loss: 0.0167868319358846 | Epoch: 466 | 
MeanAbsoluteError: 0.1001669466495514 | Loss: 0.0161904547672748 | Epoch: 467 | 
MeanAbsoluteError: 0.1060042008757591 | Loss: 0.0182499325122141 | Epoch: 468 | MeanAbsoluteError: 0.1028437986969948 | Loss: 0.0178258866808513 | Epoch: 469 | 
MeanAbsoluteError: 0.1112335324287415 | Loss: 0.0188757112872433 | Epoch: 470 | 
MeanAbsoluteError: 0.1062401086091995 | Loss: 0.0187174591840206 | Epoch: 471 | MeanAbsoluteError: 0.1032548025250435 | Loss: 0.0178422909954679 | Epoch: 472 | 
MeanAbsoluteError: 0.1047516614198685 | Loss: 0.0175978131254669 | Epoch: 473 | 
MeanAbsoluteError: 0.1054480671882629 | Loss: 0.0176322033465840 | Epoch: 474 | MeanAbsoluteError: 0.1012194007635117 | Loss: 0.0165426881892684 | Epoch: 475 | 
MeanAbsoluteError: 0.1012341752648354 | Loss: 0.0164298569004313 | Epoch: 476 | 
MeanAbsoluteError: 0.1009021848440170 | Loss: 0.0169116127133990 | Epoch: 477 | MeanAbsoluteError: 0.0973635539412498 | Loss: 0.0154647219281954 | Epoch: 478 | 
MeanAbsoluteError: 0.1027617827057838 | Loss: 0.0173406164604239 | Epoch: 479 | 
MeanAbsoluteError: 0.1007346063852310 | Loss: 0.0164064660761748 | Epoch: 480 | MeanAbsoluteError: 0.1041623875498772 | Loss: 0.0167149260699322 | Epoch: 481 | 
MeanAbsoluteError: 0.1085548922419548 | Loss: 0.0183981310486949 | Epoch: 482 | 
MeanAbsoluteError: 0.1068247631192207 | Loss: 0.0180614853999092 | Epoch: 483 | MeanAbsoluteError: 0.1045707166194916 | Loss: 0.0182765668600041 | Epoch: 484 | 
MeanAbsoluteError: 0.1039972305297852 | Loss: 0.0174150339287007 | Epoch: 485 | 
MeanAbsoluteError: 0.1060587465763092 | Loss: 0.0168162923193692 | Epoch: 486 | MeanAbsoluteError: 0.0999387055635452 | Loss: 0.0168158394357306 | Epoch: 487 | 
MeanAbsoluteError: 0.1014354303479195 | Loss: 0.0165111582050546 | Epoch: 488 | 
MeanAbsoluteError: 0.1079690530896187 | Loss: 0.0183212316341815 | Epoch: 489 | MeanAbsoluteError: 0.1008966490626335 | Loss: 0.0165655469491321 | Epoch: 490 | 
MeanAbsoluteError: 0.1005443111062050 | Loss: 0.0165112581021579 | Epoch: 491 | 
MeanAbsoluteError: 0.1047336235642433 | Loss: 0.0178763289199560 | Epoch: 492 | MeanAbsoluteError: 0.1067328676581383 | Loss: 0.0179001564556772 | Epoch: 493 | 
MeanAbsoluteError: 0.1051359996199608 | Loss: 0.0180254137951609 | Epoch: 494 | 
MeanAbsoluteError: 0.0991199016571045 | Loss: 0.0161893933624924 | Epoch: 495 | MeanAbsoluteError: 0.1068935394287109 | Loss: 0.0180374488197655 | Epoch: 496 | 
MeanAbsoluteError: 0.1037350818514824 | Loss: 0.0179032857414374 | Epoch: 497 | 
MeanAbsoluteError: 0.1057118549942970 | Loss: 0.0177847684076308 | Epoch: 498 | MeanAbsoluteError: 0.1041492298245430 | Loss: 0.0181768371420427 | Epoch: 499 | 
MeanAbsoluteError: 0.0985211208462715 | Loss: 0.0155858256134282 | Epoch: 500 | 
MeanAbsoluteError: 0.0989159718155861 | Loss: 0.0156894411639466 | Epoch: 501 | MeanAbsoluteError: 0.1001823842525482 | Loss: 0.0163652040540789 | Epoch: 502 | 
MeanAbsoluteError: 0.0976790860295296 | Loss: 0.0157863925957766 | Epoch: 503 | 
MeanAbsoluteError: 0.1006353348493576 | Loss: 0.0179522603088117 | Epoch: 504 | MeanAbsoluteError: 0.0982748717069626 | Loss: 0.0161262988593080 | Epoch: 505 | 
MeanAbsoluteError: 0.1032885760068893 | Loss: 0.0168514340132970 | Epoch: 506 | 
MeanAbsoluteError: 0.1001498624682426 | Loss: 0.0160374553133685 | Epoch: 507 | MeanAbsoluteError: 0.0995835065841675 | Loss: 0.0157188278851633 | Epoch: 508 | 
MeanAbsoluteError: 0.1012902259826660 | Loss: 0.0168098621539442 | Epoch: 509 | 
MeanAbsoluteError: 0.1008647605776787 | Loss: 0.0168884770000780 | Epoch: 510 | MeanAbsoluteError: 0.0977271571755409 | Loss: 0.0160959235325087 | Epoch: 511 | 
MeanAbsoluteError: 0.0996190160512924 | Loss: 0.0156707570986085 | Epoch: 512 | 
MeanAbsoluteError: 0.1008191406726837 | Loss: 0.0165760521415723 | Epoch: 513 | MeanAbsoluteError: 0.1014097929000854 | Loss: 0.0160324042702268 | Epoch: 514 | 
MeanAbsoluteError: 0.0998727008700371 | Loss: 0.0151420694690629 | Epoch: 515 | 
MeanAbsoluteError: 0.1043237447738647 | Loss: 0.0171853440241587 | Epoch: 516 | MeanAbsoluteError: 0.0994371101260185 | Loss: 0.0155570909175003 | Epoch: 517 | 
MeanAbsoluteError: 0.1023254469037056 | Loss: 0.0167399925319963 | Epoch: 518 | 
MeanAbsoluteError: 0.0924345627427101 | Loss: 0.0141809274586800 | Epoch: 519 | MeanAbsoluteError: 0.1064071431756020 | Loss: 0.0179946945171105 | Epoch: 520 | 
MeanAbsoluteError: 0.0998687446117401 | Loss: 0.0160354396080493 | Epoch: 521 | 
MeanAbsoluteError: 0.0970214530825615 | Loss: 0.0158852230631070 | Epoch: 522 | MeanAbsoluteError: 0.0968722999095917 | Loss: 0.0158241720473355 | Epoch: 523 | 
MeanAbsoluteError: 0.1000847741961479 | Loss: 0.0163712291883712 | Epoch: 524 | 
MeanAbsoluteError: 0.1014071330428123 | Loss: 0.0168228853387215 | Epoch: 525 | MeanAbsoluteError: 0.0984298065304756 | Loss: 0.0165312173152536 | Epoch: 526 | 
MeanAbsoluteError: 0.0995489433407784 | Loss: 0.0159685214744726 | Epoch: 527 | 
MeanAbsoluteError: 0.0942135527729988 | Loss: 0.0150418284624660 | Epoch: 528 | MeanAbsoluteError: 0.1024943366646767 | Loss: 0.0173183097975076 | Epoch: 529 | 
MeanAbsoluteError: 0.1030221730470657 | Loss: 0.0166909512865944 | Epoch: 530 | 
MeanAbsoluteError: 0.0973265692591667 | Loss: 0.0149118823424215 | Epoch: 531 | MeanAbsoluteError: 0.1030654758214951 | Loss: 0.0168415761678868 | Epoch: 532 | 
MeanAbsoluteError: 0.1037859395146370 | Loss: 0.0172603441042884 | Epoch: 533 | 
MeanAbsoluteError: 0.0922453030943871 | Loss: 0.0142612750012389 | Epoch: 534 | MeanAbsoluteError: 0.0982851758599281 | Loss: 0.0172376303661440 | Epoch: 535 | 
MeanAbsoluteError: 0.1024951413273811 | Loss: 0.0163341560008742 | Epoch: 536 | 
MeanAbsoluteError: 0.1055429503321648 | Loss: 0.0183996936536884 | Epoch: 537 | MeanAbsoluteError: 0.1006422266364098 | Loss: 0.0161244955455671 | Epoch: 538 | 
MeanAbsoluteError: 0.1061522960662842 | Loss: 0.0187010063658818 | Epoch: 539 | 
MeanAbsoluteError: 0.0950859487056732 | Loss: 0.0147054497102120 | Epoch: 540 | MeanAbsoluteError: 0.1014645546674728 | Loss: 0.0161824309343744 | Epoch: 541 | 
MeanAbsoluteError: 0.0928631201386452 | Loss: 0.0142058215267995 | Epoch: 542 | 
MeanAbsoluteError: 0.1069013848900795 | Loss: 0.0175758433291533 | Epoch: 543 | MeanAbsoluteError: 0.0980310663580894 | Loss: 0.0152356411511937 | Epoch: 544 | 
MeanAbsoluteError: 0.0991547554731369 | Loss: 0.0158571233354451 | Epoch: 545 | 
MeanAbsoluteError: 0.0986626818776131 | Loss: 0.0167468842861854 | Epoch: 546 | MeanAbsoluteError: 0.1020622178912163 | Loss: 0.0165864147242488 | Epoch: 547 | 
MeanAbsoluteError: 0.0956170484423637 | Loss: 0.0155406659159053 | Epoch: 548 | 
MeanAbsoluteError: 0.0954895764589310 | Loss: 0.0153291747449354 | Epoch: 549 | MeanAbsoluteError: 0.0988571569323540 | Loss: 0.0153093789821408 | Epoch: 550 | 
MeanAbsoluteError: 0.1020356267690659 | Loss: 0.0161018056924513 | Epoch: 551 | 
MeanAbsoluteError: 0.1016675978899002 | Loss: 0.0162260958650343 | Epoch: 552 | MeanAbsoluteError: 0.0976085513830185 | Loss: 0.0153389801572970 | Epoch: 553 | 
MeanAbsoluteError: 0.0964926704764366 | Loss: 0.0157941145702595 | Epoch: 554 | 
MeanAbsoluteError: 0.0926388874650002 | Loss: 0.0141466170325778 | Epoch: 555 | MeanAbsoluteError: 0.1049748510122299 | Loss: 0.0180488369361653 | Epoch: 556 | 
MeanAbsoluteError: 0.0961445942521095 | Loss: 0.0152641426779640 | Epoch: 557 | 
MeanAbsoluteError: 0.1045381575822830 | Loss: 0.0180379693722837 | Epoch: 558 | MeanAbsoluteError: 0.0954236835241318 | Loss: 0.0153754390466687 | Epoch: 559 | 
MeanAbsoluteError: 0.1015503481030464 | Loss: 0.0174591987367603 | Epoch: 560 | 
MeanAbsoluteError: 0.1009065434336662 | Loss: 0.0162467927722779 | Epoch: 561 | MeanAbsoluteError: 0.0949442908167839 | Loss: 0.0154361507603608 | Epoch: 562 | 
MeanAbsoluteError: 0.1032740622758865 | Loss: 0.0172292851180525 | Epoch: 563 | 
MeanAbsoluteError: 0.0989602133631706 | Loss: 0.0163127763333857 | Epoch: 564 | MeanAbsoluteError: 0.0999174639582634 | Loss: 0.0166829997450016 | Epoch: 565 | 
MeanAbsoluteError: 0.1022123172879219 | Loss: 0.0174814080446716 | Epoch: 566 | 
MeanAbsoluteError: 0.0912406817078590 | Loss: 0.0136464071385793 | Epoch: 567 | MeanAbsoluteError: 0.0990792587399483 | Loss: 0.0159886008283744 | Epoch: 568 | 
MeanAbsoluteError: 0.0900502800941467 | Loss: 0.0136648329420617 | Epoch: 569 | 
MeanAbsoluteError: 0.1009969487786293 | Loss: 0.0169171844433004 | Epoch: 570 | MeanAbsoluteError: 0.1015595570206642 | Loss: 0.0158110765631621 | Epoch: 571 | 
MeanAbsoluteError: 0.0953214913606644 | Loss: 0.0151884248638332 | Epoch: 572 | 
MeanAbsoluteError: 0.1028058230876923 | Loss: 0.0167987331752859 | Epoch: 573 | MeanAbsoluteError: 0.0997686088085175 | Loss: 0.0163564150030531 | Epoch: 574 | 
MeanAbsoluteError: 0.0995037853717804 | Loss: 0.0157854779638971 | Epoch: 575 | 
MeanAbsoluteError: 0.0941324830055237 | Loss: 0.0152940669575279 | Epoch: 576 | MeanAbsoluteError: 0.0983931943774223 | Loss: 0.0157761265308864 | Epoch: 577 | 
MeanAbsoluteError: 0.0947352051734924 | Loss: 0.0142380776832579 | Epoch: 578 | 
MeanAbsoluteError: 0.1009699404239655 | Loss: 0.0159912269477112 | Epoch: 579 | MeanAbsoluteError: 0.0896512046456337 | Loss: 0.0135649126220233 | Epoch: 580 | 
MeanAbsoluteError: 0.0983654111623764 | Loss: 0.0160450066431319 | Epoch: 581 | 
MeanAbsoluteError: 0.1000287979841232 | Loss: 0.0163381744563715 | Epoch: 582 | MeanAbsoluteError: 0.0947435721755028 | Loss: 0.0143924853105030 | Epoch: 583 | 
MeanAbsoluteError: 0.0937034636735916 | Loss: 0.0145481960336838 | Epoch: 584 | 
MeanAbsoluteError: 0.1002358794212341 | Loss: 0.0166138055873550 | Epoch: 585 | MeanAbsoluteError: 0.0990642383694649 | Loss: 0.0155329776070721 | Epoch: 586 | 
MeanAbsoluteError: 0.1070388928055763 | Loss: 0.0186054557852973 | Epoch: 587 | 
MeanAbsoluteError: 0.0984522998332977 | Loss: 0.0162724630410230 | Epoch: 588 | MeanAbsoluteError: 0.1001866757869720 | Loss: 0.0166207074177025 | Epoch: 589 | 
MeanAbsoluteError: 0.0957328826189041 | Loss: 0.0149736427890700 | Epoch: 590 | 
MeanAbsoluteError: 0.1027718037366867 | Loss: 0.0173072172927399 | Epoch: 591 | MeanAbsoluteError: 0.0887078791856766 | Loss: 0.0131997537741457 | Epoch: 592 | 
MeanAbsoluteError: 0.0990177318453789 | Loss: 0.0164299053895229 | Epoch: 593 | 
MeanAbsoluteError: 0.0952631011605263 | Loss: 0.0146911124796316 | Epoch: 594 | MeanAbsoluteError: 0.1075564548373222 | Loss: 0.0182568715140223 | Epoch: 595 | 
MeanAbsoluteError: 0.1005841568112373 | Loss: 0.0160360420207144 | Epoch: 596 | 
MeanAbsoluteError: 0.0977841690182686 | Loss: 0.0158000729659883 | Epoch: 597 | MeanAbsoluteError: 0.0989195331931114 | Loss: 0.0166239724967939 | Epoch: 598 | 
MeanAbsoluteError: 0.0997594296932220 | Loss: 0.0159320009093305 | Epoch: 599 | 
MeanAbsoluteError: 0.0982733517885208 | Loss: 0.0150385051447423 | Epoch: 600 | MeanAbsoluteError: 0.0907892957329750 | Loss: 0.0138606651643446 | Epoch: 601 | 
MeanAbsoluteError: 0.0993971005082130 | Loss: 0.0160604010978204 | Epoch: 602 | 
MeanAbsoluteError: 0.0934408083558083 | Loss: 0.0138052048050789 | Epoch: 603 | MeanAbsoluteError: 0.0982951596379280 | Loss: 0.0169914767883893 | Epoch: 604 | 
MeanAbsoluteError: 0.0943993031978607 | Loss: 0.0142420240820714 | Epoch: 605 | 
MeanAbsoluteError: 0.1003955304622650 | Loss: 0.0157523042288570 | Epoch: 606 | MeanAbsoluteError: 0.0950990021228790 | Loss: 0.0152508601814043 | Epoch: 607 | 
MeanAbsoluteError: 0.0954424366354942 | Loss: 0.0156266297213248 | Epoch: 608 | 
MeanAbsoluteError: 0.0945651829242706 | Loss: 0.0144213630148442 | Epoch: 609 | MeanAbsoluteError: 0.1052370071411133 | Loss: 0.0174543419670469 | Epoch: 610 | 
MeanAbsoluteError: 0.0924447476863861 | Loss: 0.0136910122368984 | Epoch: 611 | 
MeanAbsoluteError: 0.0976069942116737 | Loss: 0.0146968636652067 | Epoch: 612 | MeanAbsoluteError: 0.0899846702814102 | Loss: 0.0134521905866253 | Epoch: 613 | 
MeanAbsoluteError: 0.0940748825669289 | Loss: 0.0141298770531042 | Epoch: 614 | 
MeanAbsoluteError: 0.0970796421170235 | Loss: 0.0149834337664167 | Epoch: 615 | MeanAbsoluteError: 0.0968588292598724 | Loss: 0.0155799007029661 | Epoch: 616 | 
MeanAbsoluteError: 0.0992546901106834 | Loss: 0.0157871531593810 | Epoch: 617 | 
MeanAbsoluteError: 0.0925603061914444 | Loss: 0.0133367345717852 | Epoch: 618 | MeanAbsoluteError: 0.0883614197373390 | Loss: 0.0125461659070182 | Epoch: 619 | 
MeanAbsoluteError: 0.0938840955495834 | Loss: 0.0143809066557151 | Epoch: 620 | 
MeanAbsoluteError: 0.0943734943866730 | Loss: 0.0154072867821863 | Epoch: 621 | MeanAbsoluteError: 0.0943661853671074 | Loss: 0.0137641056411667 | Epoch: 622 | 
MeanAbsoluteError: 0.0984540879726410 | Loss: 0.0152119088698237 | Epoch: 623 | 
MeanAbsoluteError: 0.0924278944730759 | Loss: 0.0146441417771287 | Epoch: 624 | MeanAbsoluteError: 0.0959010049700737 | Loss: 0.0148444880057650 | Epoch: 625 | 
MeanAbsoluteError: 0.0926394462585449 | Loss: 0.0149338207176576 | Epoch: 626 | 
MeanAbsoluteError: 0.0980502441525459 | Loss: 0.0147791587900914 | Epoch: 627 | MeanAbsoluteError: 0.0964949131011963 | Loss: 0.0162986567715325 | Epoch: 628 | 
MeanAbsoluteError: 0.0925266742706299 | Loss: 0.0147066628635730 | Epoch: 629 | 
MeanAbsoluteError: 0.0877007469534874 | Loss: 0.0130659208392414 | Epoch: 630 | MeanAbsoluteError: 0.0921423360705376 | Loss: 0.0138718113140870 | Epoch: 631 | 
MeanAbsoluteError: 0.0919355303049088 | Loss: 0.0139295549731484 | Epoch: 632 | 
MeanAbsoluteError: 0.0917608439922333 | Loss: 0.0137319293915061 | Epoch: 633 | MeanAbsoluteError: 0.0974386632442474 | Loss: 0.0153161916752773 | Epoch: 634 | 
MeanAbsoluteError: 0.0966138318181038 | Loss: 0.0144394689858503 | Epoch: 635 | 
MeanAbsoluteError: 0.0965937674045563 | Loss: 0.0151875031699213 | Epoch: 636 | MeanAbsoluteError: 0.0937630683183670 | Loss: 0.0147585591320725 | Epoch: 637 | 
MeanAbsoluteError: 0.0894635170698166 | Loss: 0.0131074710716348 | Epoch: 638 | 
MeanAbsoluteError: 0.0987518578767776 | Loss: 0.0160078499177568 | Epoch: 639 | MeanAbsoluteError: 0.0908858254551888 | Loss: 0.0143671062453359 | Epoch: 640 | 
MeanAbsoluteError: 0.0933778882026672 | Loss: 0.0135919081183602 | Epoch: 641 | 
MeanAbsoluteError: 0.0953180044889450 | Loss: 0.0147383133514086 | Epoch: 642 | MeanAbsoluteError: 0.0877891480922699 | Loss: 0.0128323020754033 | Epoch: 643 | 
MeanAbsoluteError: 0.0955309644341469 | Loss: 0.0146992583250540 | Epoch: 644 | 
MeanAbsoluteError: 0.0959597304463387 | Loss: 0.0147033020803065 | Epoch: 645 | MeanAbsoluteError: 0.0906999260187149 | Loss: 0.0132015914787189 | Epoch: 646 | 
MeanAbsoluteError: 0.0955182537436485 | Loss: 0.0149364193005507 | Epoch: 647 | 
MeanAbsoluteError: 0.0850692912936211 | Loss: 0.0123227503134937 | Epoch: 648 | MeanAbsoluteError: 0.0878093466162682 | Loss: 0.0124548807414734 | Epoch: 649 | 
MeanAbsoluteError: 0.0881238281726837 | Loss: 0.0130311380276301 | Epoch: 650 | 
MeanAbsoluteError: 0.0916740968823433 | Loss: 0.0134879007985486 | Epoch: 651 | MeanAbsoluteError: 0.0921845659613609 | Loss: 0.0137896739171507 | Epoch: 652 | 
MeanAbsoluteError: 0.0942127257585526 | Loss: 0.0157869215761214 | Epoch: 653 | 
MeanAbsoluteError: 0.0941820219159126 | Loss: 0.0145341557525292 | Epoch: 654 | MeanAbsoluteError: 0.0938542410731316 | Loss: 0.0143017806670347 | Epoch: 655 | 
MeanAbsoluteError: 0.0967621281743050 | Loss: 0.0157966979895476 | Epoch: 656 | 
MeanAbsoluteError: 0.0956066921353340 | Loss: 0.0150192472714358 | Epoch: 657 | MeanAbsoluteError: 0.0967372879385948 | Loss: 0.0153667183372697 | Epoch: 658 | 
MeanAbsoluteError: 0.0919147282838821 | Loss: 0.0135529879280754 | Epoch: 659 | 
MeanAbsoluteError: 0.0896446108818054 | Loss: 0.0136351099622531 | Epoch: 660 | MeanAbsoluteError: 0.0992690771818161 | Loss: 0.0162654478897457 | Epoch: 661 | 
MeanAbsoluteError: 0.0940035879611969 | Loss: 0.0153378259977156 | Epoch: 662 | 
MeanAbsoluteError: 0.0920687094330788 | Loss: 0.0143205685635325 | Epoch: 663 | MeanAbsoluteError: 0.0881146043539047 | Loss: 0.0132575557272260 | Epoch: 664 | 
MeanAbsoluteError: 0.0916023254394531 | Loss: 0.0138549522764273 | Epoch: 665 | 
MeanAbsoluteError: 0.0939320176839828 | Loss: 0.0146088590217308 | Epoch: 666 | MeanAbsoluteError: 0.0920712798833847 | Loss: 0.0135037981863328 | Epoch: 667 | 
MeanAbsoluteError: 0.0889955163002014 | Loss: 0.0136962929689435 | Epoch: 668 | 
MeanAbsoluteError: 0.0920215472579002 | Loss: 0.0133897598418844 | Epoch: 669 | MeanAbsoluteError: 0.0879184901714325 | Loss: 0.0122417319589294 | Epoch: 670 | 
MeanAbsoluteError: 0.0973758026957512 | Loss: 0.0151104992120236 | Epoch: 671 | 
MeanAbsoluteError: 0.0944016799330711 | Loss: 0.0146039008274480 | Epoch: 672 | MeanAbsoluteError: 0.0974368602037430 | Loss: 0.0159773891677226 | Epoch: 673 | 
MeanAbsoluteError: 0.0895331576466560 | Loss: 0.0134400495300846 | Epoch: 674 | 
MeanAbsoluteError: 0.0880242884159088 | Loss: 0.0128289589636218 | Epoch: 675 | MeanAbsoluteError: 0.0926602035760880 | Loss: 0.0144956791222406 | Epoch: 676 | 
MeanAbsoluteError: 0.0956828594207764 | Loss: 0.0148600981018293 | Epoch: 677 | 
MeanAbsoluteError: 0.0967293009161949 | Loss: 0.0153127191109525 | Epoch: 678 | MeanAbsoluteError: 0.0887131020426750 | Loss: 0.0133767645117981 | Epoch: 679 | 
MeanAbsoluteError: 0.0915435105562210 | Loss: 0.0136566714321937 | Epoch: 680 | 
MeanAbsoluteError: 0.0888066515326500 | Loss: 0.0128416880650184 | Epoch: 681 | MeanAbsoluteError: 0.0955328792333603 | Loss: 0.0147792885383145 | Epoch: 682 | 
MeanAbsoluteError: 0.0924923121929169 | Loss: 0.0135112213046523 | Epoch: 683 | 
MeanAbsoluteError: 0.0881593674421310 | Loss: 0.0128630303144746 | Epoch: 684 | MeanAbsoluteError: 0.0875883549451828 | Loss: 0.0122713982760130 | Epoch: 685 | 
MeanAbsoluteError: 0.0896522849798203 | Loss: 0.0138129791641162 | Epoch: 686 | 
MeanAbsoluteError: 0.0934305042028427 | Loss: 0.0142006830752750 | Epoch: 687 | MeanAbsoluteError: 0.0908662825822830 | Loss: 0.0137923494540640 | Epoch: 688 | 
MeanAbsoluteError: 0.0912023782730103 | Loss: 0.0133243325197994 | Epoch: 689 | 
MeanAbsoluteError: 0.0882226377725601 | Loss: 0.0128940731275785 | Epoch: 690 | MeanAbsoluteError: 0.0867831185460091 | Loss: 0.0119514795638679 | Epoch: 691 | 
MeanAbsoluteError: 0.0954886972904205 | Loss: 0.0149311127273904 | Epoch: 692 | 
MeanAbsoluteError: 0.0905425250530243 | Loss: 0.0131326134538297 | Epoch: 693 | MeanAbsoluteError: 0.0944915264844894 | Loss: 0.0145834428869421 | Epoch: 694 | 
MeanAbsoluteError: 0.0917292758822441 | Loss: 0.0135205955875669 | Epoch: 695 | 
MeanAbsoluteError: 0.0931029245257378 | Loss: 0.0138981285340075 | Epoch: 696 | MeanAbsoluteError: 0.0977769568562508 | Loss: 0.0160550226880393 | Epoch: 697 | 
MeanAbsoluteError: 0.0881829187273979 | Loss: 0.0122405039649796 | Epoch: 698 | 
MeanAbsoluteError: 0.0963408350944519 | Loss: 0.0156592369992480 | Epoch: 699 | MeanAbsoluteError: 0.0909581854939461 | Loss: 0.0131106599043414 | Epoch: 700 | 
MeanAbsoluteError: 0.0890300646424294 | Loss: 0.0130091067938580 | Epoch: 701 | 
MeanAbsoluteError: 0.0886887982487679 | Loss: 0.0135109169761370 | Epoch: 702 | MeanAbsoluteError: 0.0878634527325630 | Loss: 0.0130662787415592 | Epoch: 703 | 
MeanAbsoluteError: 0.0830014199018478 | Loss: 0.0121105450505032 | Epoch: 704 | 
MeanAbsoluteError: 0.0929535776376724 | Loss: 0.0147707168462754 | Epoch: 705 | MeanAbsoluteError: 0.0866511240601540 | Loss: 0.0128505462641867 | Epoch: 706 | 
MeanAbsoluteError: 0.0951036587357521 | Loss: 0.0148202962951261 | Epoch: 707 | 
MeanAbsoluteError: 0.0906323865056038 | Loss: 0.0138288734046607 | Epoch: 708 | MeanAbsoluteError: 0.0862893536686897 | Loss: 0.0130456025340633 | Epoch: 709 | 
MeanAbsoluteError: 0.0884069725871086 | Loss: 0.0129074190752241 | Epoch: 710 | 
MeanAbsoluteError: 0.0863957405090332 | Loss: 0.0126563966961354 | Epoch: 711 | MeanAbsoluteError: 0.0916888713836670 | Loss: 0.0139690324069428 | Epoch: 712 | 
MeanAbsoluteError: 0.0882830470800400 | Loss: 0.0124708507626201 | Epoch: 713 | 
MeanAbsoluteError: 0.0881345793604851 | Loss: 0.0132134068345961 | Epoch: 714 | MeanAbsoluteError: 0.0927750617265701 | Loss: 0.0140779329066572 | Epoch: 715 | 
MeanAbsoluteError: 0.0909811928868294 | Loss: 0.0130362905862906 | Epoch: 716 | 
MeanAbsoluteError: 0.0896946489810944 | Loss: 0.0130723498439572 | Epoch: 717 | MeanAbsoluteError: 0.0898309424519539 | Loss: 0.0129998253132605 | Epoch: 718 | 
MeanAbsoluteError: 0.0954559147357941 | Loss: 0.0148155929099691 | Epoch: 719 | 
MeanAbsoluteError: 0.0929110571742058 | Loss: 0.0141901625903968 | Epoch: 720 | MeanAbsoluteError: 0.0924602970480919 | Loss: 0.0139699069243882 | Epoch: 721 | 
MeanAbsoluteError: 0.0853607058525085 | Loss: 0.0125879773029131 | Epoch: 722 | 
MeanAbsoluteError: 0.0882351770997047 | Loss: 0.0122150349896401 | Epoch: 723 | MeanAbsoluteError: 0.0942606329917908 | Loss: 0.0139566587019362 | Epoch: 724 | 
MeanAbsoluteError: 0.0925872698426247 | Loss: 0.0139991549672171 | Epoch: 725 | 
MeanAbsoluteError: 0.0928440168499947 | Loss: 0.0143787183015957 | Epoch: 726 | MeanAbsoluteError: 0.0914622694253922 | Loss: 0.0139049536810565 | Epoch: 727 | 
MeanAbsoluteError: 0.0857709720730782 | Loss: 0.0125925473713626 | Epoch: 728 | 
MeanAbsoluteError: 0.0898869484663010 | Loss: 0.0132946921225941 | Epoch: 729 | MeanAbsoluteError: 0.0910322070121765 | Loss: 0.0130977004234349 | Epoch: 730 | 
MeanAbsoluteError: 0.0817722156643867 | Loss: 0.0118544207660367 | Epoch: 731 | 
MeanAbsoluteError: 0.0810555070638657 | Loss: 0.0108738654296485 | Epoch: 732 | MeanAbsoluteError: 0.0894933417439461 | Loss: 0.0127227185860587 | Epoch: 733 | 
MeanAbsoluteError: 0.0882375836372375 | Loss: 0.0129974066277282 | Epoch: 734 | 
MeanAbsoluteError: 0.0862670168280602 | Loss: 0.0122295736578235 | Epoch: 735 | MeanAbsoluteError: 0.0912216007709503 | Loss: 0.0140933200203290 | Epoch: 736 | 
MeanAbsoluteError: 0.0932363942265511 | Loss: 0.0153800261983148 | Epoch: 737 | 
MeanAbsoluteError: 0.0846222564578056 | Loss: 0.0116643682059172 | Epoch: 738 | MeanAbsoluteError: 0.0868971273303032 | Loss: 0.0127378041627526 | Epoch: 739 | 
MeanAbsoluteError: 0.0912105664610863 | Loss: 0.0132779843274572 | Epoch: 740 | 
MeanAbsoluteError: 0.0892487689852715 | Loss: 0.0131702084391630 | Epoch: 741 | MeanAbsoluteError: 0.0942844226956367 | Loss: 0.0137845157657284 | Epoch: 742 | 
MeanAbsoluteError: 0.0913934111595154 | Loss: 0.0133019086395992 | Epoch: 743 | 
MeanAbsoluteError: 0.0875681042671204 | Loss: 0.0123854485368793 | Epoch: 744 | MeanAbsoluteError: 0.0853696390986443 | Loss: 0.0119251611363143 | Epoch: 745 | 
MeanAbsoluteError: 0.0876848176121712 | Loss: 0.0127049013822155 | Epoch: 746 | 
MeanAbsoluteError: 0.0908146351575851 | Loss: 0.0138761448941659 | Epoch: 747 | MeanAbsoluteError: 0.0880022123456001 | Loss: 0.0127012663409550 | Epoch: 748 | 
MeanAbsoluteError: 0.0886463075876236 | Loss: 0.0137587591787451 | Epoch: 749 | 
MeanAbsoluteError: 0.0879680588841438 | Loss: 0.0126730307204222 | Epoch: 750 | MeanAbsoluteError: 0.0902737304568291 | Loss: 0.0133400050833977 | Epoch: 751 | 
MeanAbsoluteError: 0.0893298611044884 | Loss: 0.0127201402865467 | Epoch: 752 | 
MeanAbsoluteError: 0.0927522405982018 | Loss: 0.0133169567787021 | Epoch: 753 | MeanAbsoluteError: 0.0882991403341293 | Loss: 0.0133467205362588 | Epoch: 754 | 
MeanAbsoluteError: 0.0865770578384399 | Loss: 0.0127563611993295 | Epoch: 755 | 
MeanAbsoluteError: 0.0914335995912552 | Loss: 0.0140254101955058 | Epoch: 756 | MeanAbsoluteError: 0.0904492810368538 | Loss: 0.0139049919023212 | Epoch: 757 | 
MeanAbsoluteError: 0.0904882028698921 | Loss: 0.0138003310284770 | Epoch: 758 | 
MeanAbsoluteError: 0.0907306000590324 | Loss: 0.0141383986686318 | Epoch: 759 | MeanAbsoluteError: 0.0917293056845665 | Loss: 0.0138464749990127 | Epoch: 760 | 
MeanAbsoluteError: 0.0902694314718246 | Loss: 0.0129091020840860 | Epoch: 761 | 
MeanAbsoluteError: 0.0880319625139236 | Loss: 0.0127718716131797 | Epoch: 762 | MeanAbsoluteError: 0.0863233730196953 | Loss: 0.0124815379487973 | Epoch: 763 | 
MeanAbsoluteError: 0.0923957601189613 | Loss: 0.0142655538520679 | Epoch: 764 | 
MeanAbsoluteError: 0.0907487198710442 | Loss: 0.0136294912380011 | Epoch: 765 | MeanAbsoluteError: 0.0900905504822731 | Loss: 0.0131017532835055 | Epoch: 766 | 
MeanAbsoluteError: 0.0861571282148361 | Loss: 0.0126082910317928 | Epoch: 767 | 
MeanAbsoluteError: 0.0884456411004066 | Loss: 0.0129412539726885 | Epoch: 768 | MeanAbsoluteError: 0.0859845057129860 | Loss: 0.0131967615764734 | Epoch: 769 | 
MeanAbsoluteError: 0.0898269340395927 | Loss: 0.0132529384948430 | Epoch: 770 | 
MeanAbsoluteError: 0.0863729864358902 | Loss: 0.0126810302012988 | Epoch: 771 | MeanAbsoluteError: 0.0854879543185234 | Loss: 0.0121853417230038 | Epoch: 772 | 
MeanAbsoluteError: 0.0900488272309303 | Loss: 0.0129705732933265 | Epoch: 773 | 
MeanAbsoluteError: 0.0854345560073853 | Loss: 0.0116807561976748 | Epoch: 774 | MeanAbsoluteError: 0.0863072723150253 | Loss: 0.0124837040873050 | Epoch: 775 | 
MeanAbsoluteError: 0.0889175385236740 | Loss: 0.0141521103987664 | Epoch: 776 | 
MeanAbsoluteError: 0.0842685028910637 | Loss: 0.0122836684110492 | Epoch: 777 | MeanAbsoluteError: 0.0862216576933861 | Loss: 0.0125923740753206 | Epoch: 778 | 
MeanAbsoluteError: 0.0873129367828369 | Loss: 0.0130452021788612 | Epoch: 779 | 
MeanAbsoluteError: 0.0908226668834686 | Loss: 0.0136501490063529 | Epoch: 780 | MeanAbsoluteError: 0.0880358442664146 | Loss: 0.0132670219899349 | Epoch: 781 | 
MeanAbsoluteError: 0.0876614600419998 | Loss: 0.0132093444812441 | Epoch: 782 | 
MeanAbsoluteError: 0.0852647051215172 | Loss: 0.0127097528006804 | Epoch: 783 | MeanAbsoluteError: 0.0826836153864861 | Loss: 0.0119062289502472 | Epoch: 784 | 
MeanAbsoluteError: 0.0895292162895203 | Loss: 0.0134629080618227 | Epoch: 785 | 
MeanAbsoluteError: 0.0926901996135712 | Loss: 0.0134423151729546 | Epoch: 786 | MeanAbsoluteError: 0.0901091992855072 | Loss: 0.0137006828578888 | Epoch: 787 | 
MeanAbsoluteError: 0.0928524136543274 | Loss: 0.0143529221736632 | Epoch: 788 | 
MeanAbsoluteError: 0.0898644030094147 | Loss: 0.0133021922358603 | Epoch: 789 | MeanAbsoluteError: 0.0864257216453552 | Loss: 0.0121765173092979 | Epoch: 790 | 
MeanAbsoluteError: 0.0854378193616867 | Loss: 0.0123268987046322 | Epoch: 791 | 
MeanAbsoluteError: 0.0850182622671127 | Loss: 0.0119157060962364 | Epoch: 792 | MeanAbsoluteError: 0.0901851654052734 | Loss: 0.0132935410866048 | Epoch: 793 | 
MeanAbsoluteError: 0.0847238004207611 | Loss: 0.0120365755796471 | Epoch: 794 | 
MeanAbsoluteError: 0.0859578326344490 | Loss: 0.0125267552506314 | Epoch: 795 | MeanAbsoluteError: 0.0851010456681252 | Loss: 0.0121925164099472 | Epoch: 796 | 
MeanAbsoluteError: 0.0869227722287178 | Loss: 0.0125499785254457 | Epoch: 797 | 
MeanAbsoluteError: 0.0852400511503220 | Loss: 0.0128140698390416 | Epoch: 798 | MeanAbsoluteError: 0.0839199721813202 | Loss: 0.0116450084481767 | Epoch: 799 | 
MeanAbsoluteError: 0.0855045691132545 | Loss: 0.0117951900712796 | Epoch: 800 | 
MeanAbsoluteError: 0.0880231261253357 | Loss: 0.0126531708388848 | Epoch: 801 | MeanAbsoluteError: 0.0896451175212860 | Loss: 0.0135053835451314 | Epoch: 802 | 
MeanAbsoluteError: 0.0919696316123009 | Loss: 0.0134769947291352 | Epoch: 803 | 
MeanAbsoluteError: 0.0886656194925308 | Loss: 0.0133796356661696 | Epoch: 804 | MeanAbsoluteError: 0.0858787298202515 | Loss: 0.0126749980919218 | Epoch: 805 | 
MeanAbsoluteError: 0.0864026919007301 | Loss: 0.0121178450690544 | Epoch: 806 | 
MeanAbsoluteError: 0.0876366794109344 | Loss: 0.0123262177964595 | Epoch: 807 | MeanAbsoluteError: 0.0844025388360023 | Loss: 0.0115509569383964 | Epoch: 808 | 
MeanAbsoluteError: 0.0905684381723404 | Loss: 0.0139003206320437 | Epoch: 809 | 
MeanAbsoluteError: 0.0889257714152336 | Loss: 0.0131178946532054 | Epoch: 810 | MeanAbsoluteError: 0.0849311873316765 | Loss: 0.0117375160862927 | Epoch: 811 | 
MeanAbsoluteError: 0.0873510912060738 | Loss: 0.0127323967765551 | Epoch: 812 | 
MeanAbsoluteError: 0.0857861340045929 | Loss: 0.0125060931998693 | Epoch: 813 | MeanAbsoluteError: 0.0890098884701729 | Loss: 0.0132862139778930 | Epoch: 814 | 
MeanAbsoluteError: 0.0837553441524506 | Loss: 0.0114491514022423 | Epoch: 815 | 
MeanAbsoluteError: 0.0898700430989265 | Loss: 0.0130232449750777 | Epoch: 816 | MeanAbsoluteError: 0.0843343585729599 | Loss: 0.0119342981591459 | Epoch: 817 | 
MeanAbsoluteError: 0.0830661728978157 | Loss: 0.0117747530929531 | Epoch: 818 | 
MeanAbsoluteError: 0.0839562043547630 | Loss: 0.0121495205059182 | Epoch: 819 | MeanAbsoluteError: 0.0912846773862839 | Loss: 0.0132434905112799 | Epoch: 820 | 
MeanAbsoluteError: 0.0891295671463013 | Loss: 0.0128964189029648 | Epoch: 821 | 
MeanAbsoluteError: 0.0820631682872772 | Loss: 0.0115679245347686 | Epoch: 822 | MeanAbsoluteError: 0.0899364948272705 | Loss: 0.0129258787219199 | Epoch: 823 | 
MeanAbsoluteError: 0.0847276970744133 | Loss: 0.0118603773180318 | Epoch: 824 | 
MeanAbsoluteError: 0.0804093852639198 | Loss: 0.0107896103329161 | Epoch: 825 | MeanAbsoluteError: 0.0846450626850128 | Loss: 0.0122038920242145 | Epoch: 826 | 
MeanAbsoluteError: 0.0844758823513985 | Loss: 0.0118698093683148 | Epoch: 827 | 
MeanAbsoluteError: 0.0846074000000954 | Loss: 0.0122950409188828 | Epoch: 828 | MeanAbsoluteError: 0.0931851565837860 | Loss: 0.0150185121943165 | Epoch: 829 | 
MeanAbsoluteError: 0.0913174599409103 | Loss: 0.0131129631810472 | Epoch: 830 | 
MeanAbsoluteError: 0.0900227800011635 | Loss: 0.0127244981217033 | Epoch: 831 | MeanAbsoluteError: 0.0856932103633881 | Loss: 0.0126495744993251 | Epoch: 832 | 
MeanAbsoluteError: 0.0808189362287521 | Loss: 0.0110276159657387 | Epoch: 833 | 
MeanAbsoluteError: 0.0842553898692131 | Loss: 0.0125167668156791 | Epoch: 834 | MeanAbsoluteError: 0.0867830887436867 | Loss: 0.0129232926267529 | Epoch: 835 | 
MeanAbsoluteError: 0.0828283727169037 | Loss: 0.0114380083837023 | Epoch: 836 | 
MeanAbsoluteError: 0.0803664699196815 | Loss: 0.0104214202231378 | Epoch: 837 | MeanAbsoluteError: 0.0832745134830475 | Loss: 0.0111907459425856 | Epoch: 838 | 
MeanAbsoluteError: 0.0849030613899231 | Loss: 0.0121533546292145 | Epoch: 839 | 
MeanAbsoluteError: 0.0889679342508316 | Loss: 0.0126430415795767 | Epoch: 840 | MeanAbsoluteError: 0.0889220461249352 | Loss: 0.0129551391796364 | Epoch: 841 | 
MeanAbsoluteError: 0.0854803174734116 | Loss: 0.0133938781746838 | Epoch: 842 | 
MeanAbsoluteError: 0.0831574425101280 | Loss: 0.0113371864108558 | Epoch: 843 | MeanAbsoluteError: 0.0898304656147957 | Loss: 0.0131160577022577 | Epoch: 844 | 
MeanAbsoluteError: 0.0852263048291206 | Loss: 0.0123755703633166 | Epoch: 845 | 
MeanAbsoluteError: 0.0822930112481117 | Loss: 0.0121629677025097 | Epoch: 846 | MeanAbsoluteError: 0.0853987336158752 | Loss: 0.0123873085970020 | Epoch: 847 | 
MeanAbsoluteError: 0.0827751904726028 | Loss: 0.0114104003017322 | Epoch: 848 | 
MeanAbsoluteError: 0.0864428952336311 | Loss: 0.0123256283481411 | Epoch: 849 | MeanAbsoluteError: 0.0868401303887367 | Loss: 0.0123464747521211 | Epoch: 850 | 
MeanAbsoluteError: 0.0840938985347748 | Loss: 0.0117232627727208 | Epoch: 851 | 
MeanAbsoluteError: 0.0858922526240349 | Loss: 0.0125612743135813 | Epoch: 852 | MeanAbsoluteError: 0.0814532935619354 | Loss: 0.0106962558162437 | Epoch: 853 | 
MeanAbsoluteError: 0.0842081382870674 | Loss: 0.0115703151050563 | Epoch: 854 | 
MeanAbsoluteError: 0.0882107764482498 | Loss: 0.0130562302557034 | Epoch: 855 | MeanAbsoluteError: 0.0872952342033386 | Loss: 0.0124118806892026 | Epoch: 856 | 
MeanAbsoluteError: 0.0863999426364899 | Loss: 0.0129254566654951 | Epoch: 857 | 
MeanAbsoluteError: 0.0823040232062340 | Loss: 0.0113910648410092 | Epoch: 858 | MeanAbsoluteError: 0.0821163132786751 | Loss: 0.0113980007911111 | Epoch: 859 | 
MeanAbsoluteError: 0.0772186815738678 | Loss: 0.0101424770135297 | Epoch: 860 | 
MeanAbsoluteError: 0.0886955708265305 | Loss: 0.0131906971256043 | Epoch: 861 | MeanAbsoluteError: 0.0822984129190445 | Loss: 0.0111803714016946 | Epoch: 862 | 
MeanAbsoluteError: 0.0877204686403275 | Loss: 0.0133902671425585 | Epoch: 863 | 
MeanAbsoluteError: 0.0795196890830994 | Loss: 0.0103198074590364 | Epoch: 864 | MeanAbsoluteError: 0.0830334424972534 | Loss: 0.0112252999649718 | Epoch: 865 | 
MeanAbsoluteError: 0.0851328521966934 | Loss: 0.0122097963400696 | Epoch: 866 | 
MeanAbsoluteError: 0.0798445641994476 | Loss: 0.0105141039300361 | Epoch: 867 | MeanAbsoluteError: 0.0895470529794693 | Loss: 0.0134692845002307 | Epoch: 868 | 
MeanAbsoluteError: 0.0837924927473068 | Loss: 0.0113667741829947 | Epoch: 869 | 
MeanAbsoluteError: 0.0843477398157120 | Loss: 0.0119819240949316 | Epoch: 870 | MeanAbsoluteError: 0.0872694551944733 | Loss: 0.0122564860086519 | Epoch: 871 | 
MeanAbsoluteError: 0.0810838118195534 | Loss: 0.0111499648765645 | Epoch: 872 | 
MeanAbsoluteError: 0.0867245346307755 | Loss: 0.0125898936911835 | Epoch: 873 | MeanAbsoluteError: 0.0897300392389297 | Loss: 0.0133413582966993 | Epoch: 874 | 
MeanAbsoluteError: 0.0832250937819481 | Loss: 0.0115453572640157 | Epoch: 875 | 
MeanAbsoluteError: 0.0840907022356987 | Loss: 0.0117681180148065 | Epoch: 876 | MeanAbsoluteError: 0.0756603255867958 | Loss: 0.0098256256018067 | Epoch: 877 | 
MeanAbsoluteError: 0.0894352123141289 | Loss: 0.0128425951317574 | Epoch: 878 | 
MeanAbsoluteError: 0.0791545584797859 | Loss: 0.0108026085142531 | Epoch: 879 | MeanAbsoluteError: 0.0869871377944946 | Loss: 0.0121675136547613 | Epoch: 880 | 
MeanAbsoluteError: 0.0801681354641914 | Loss: 0.0105625872105035 | Epoch: 881 | 
MeanAbsoluteError: 0.0878944173455238 | Loss: 0.0127329375204984 | Epoch: 882 | MeanAbsoluteError: 0.0814753025770187 | Loss: 0.0109948873020767 | Epoch: 883 | 
MeanAbsoluteError: 0.0847180709242821 | Loss: 0.0116997679445194 | Epoch: 884 | 
MeanAbsoluteError: 0.0833866223692894 | Loss: 0.0112467669383720 | Epoch: 885 | MeanAbsoluteError: 0.0844525620341301 | Loss: 0.0112455059727654 | Epoch: 886 | 
MeanAbsoluteError: 0.0824271813035011 | Loss: 0.0117207891419093 | Epoch: 887 | 
MeanAbsoluteError: 0.0867894366383553 | Loss: 0.0128361827932531 | Epoch: 888 | MeanAbsoluteError: 0.0830385163426399 | Loss: 0.0114022354173236 | Epoch: 889 | 
MeanAbsoluteError: 0.0783187672495842 | Loss: 0.0106034910110854 | Epoch: 890 | 
MeanAbsoluteError: 0.0893675684928894 | Loss: 0.0134198275281778 | Epoch: 891 | MeanAbsoluteError: 0.0812975093722343 | Loss: 0.0108334728283565 | Epoch: 892 | 
MeanAbsoluteError: 0.0862082391977310 | Loss: 0.0130616500083124 | Epoch: 893 | 
MeanAbsoluteError: 0.0776863619685173 | Loss: 0.0102151527052532 | Epoch: 894 | MeanAbsoluteError: 0.0871971547603607 | Loss: 0.0127531289025986 | Epoch: 895 | 
MeanAbsoluteError: 0.0846094042062759 | Loss: 0.0118463389920362 | Epoch: 896 | 
MeanAbsoluteError: 0.0807527974247932 | Loss: 0.0105892057297994 | Epoch: 897 | MeanAbsoluteError: 0.0802342891693115 | Loss: 0.0109129498951370 | Epoch: 898 | 
MeanAbsoluteError: 0.0810921862721443 | Loss: 0.0113669133998580 | Epoch: 899 | 
MeanAbsoluteError: 0.0817196294665337 | Loss: 0.0116312836031526 | Epoch: 900 | MeanAbsoluteError: 0.0820036977529526 | Loss: 0.0110537258400533 | Epoch: 901 | 
MeanAbsoluteError: 0.0787001103162766 | Loss: 0.0105406448623883 | Epoch: 902 | 
MeanAbsoluteError: 0.0794801488518715 | Loss: 0.0107056951776516 | Epoch: 903 | MeanAbsoluteError: 0.0888825431466103 | Loss: 0.0130465563898421 | Epoch: 904 | 
MeanAbsoluteError: 0.0848540738224983 | Loss: 0.0128208808829610 | Epoch: 905 | 
MeanAbsoluteError: 0.0874326154589653 | Loss: 0.0128565892649446 | Epoch: 906 | MeanAbsoluteError: 0.0805240869522095 | Loss: 0.0106693181915519 | Epoch: 907 | 
MeanAbsoluteError: 0.0786235779523849 | Loss: 0.0103270748444872 | Epoch: 908 | 
MeanAbsoluteError: 0.0811391100287437 | Loss: 0.0112503806708022 | Epoch: 909 | MeanAbsoluteError: 0.0813039615750313 | Loss: 0.0110512909884680 | Epoch: 910 | 
MeanAbsoluteError: 0.0834695473313332 | Loss: 0.0111961761735923 | Epoch: 911 | 
MeanAbsoluteError: 0.0809558704495430 | Loss: 0.0114780064089427 | Epoch: 912 | MeanAbsoluteError: 0.0826668217778206 | Loss: 0.0116861188803523 | Epoch: 913 | 
MeanAbsoluteError: 0.0810652002692223 | Loss: 0.0114854567542837 | Epoch: 914 | 
MeanAbsoluteError: 0.0793175399303436 | Loss: 0.0104817998182261 | Epoch: 915 | MeanAbsoluteError: 0.0779872462153435 | Loss: 0.0107204250166251 | Epoch: 916 | 
MeanAbsoluteError: 0.0847158059477806 | Loss: 0.0119053192558446 | Epoch: 917 | 
MeanAbsoluteError: 0.0852611884474754 | Loss: 0.0122231619879797 | Epoch: 918 | MeanAbsoluteError: 0.0873420238494873 | Loss: 0.0126699964755471 | Epoch: 919 | 
MeanAbsoluteError: 0.0900907590985298 | Loss: 0.0123916140848693 | Epoch: 920 | 
MeanAbsoluteError: 0.0814876779913902 | Loss: 0.0109120962512679 | Epoch: 921 | MeanAbsoluteError: 0.0853115469217300 | Loss: 0.0115987883396459 | Epoch: 922 | 
MeanAbsoluteError: 0.0861827060580254 | Loss: 0.0123737035060746 | Epoch: 923 | 
MeanAbsoluteError: 0.0805467516183853 | Loss: 0.0110146025149637 | Epoch: 924 | MeanAbsoluteError: 0.0766517519950867 | Loss: 0.0101950914222228 | Epoch: 925 | 
MeanAbsoluteError: 0.0847849398851395 | Loss: 0.0121975087705990 | Epoch: 926 | 
MeanAbsoluteError: 0.0815167650580406 | Loss: 0.0111207033859440 | Epoch: 927 | MeanAbsoluteError: 0.0844301655888557 | Loss: 0.0112665699429635 | Epoch: 928 | 
MeanAbsoluteError: 0.0817159712314606 | Loss: 0.0105791589748333 | Epoch: 929 | 
MeanAbsoluteError: 0.0853240042924881 | Loss: 0.0113984121147466 | Epoch: 930 | MeanAbsoluteError: 0.0815212354063988 | Loss: 0.0109735336221274 | Epoch: 931 | 
MeanAbsoluteError: 0.0875440835952759 | Loss: 0.0135979839054410 | Epoch: 932 | 
MeanAbsoluteError: 0.0800951644778252 | Loss: 0.0117643046061858 | Epoch: 933 | MeanAbsoluteError: 0.0846487581729889 | Loss: 0.0115278361023714 | Epoch: 934 | 
MeanAbsoluteError: 0.0810759142041206 | Loss: 0.0113790923589355 | Epoch: 935 | 
MeanAbsoluteError: 0.0813119858503342 | Loss: 0.0105889934234559 | Epoch: 936 | MeanAbsoluteError: 0.0808901339769363 | Loss: 0.0109295938709632 | Epoch: 937 | 
MeanAbsoluteError: 0.0861655995249748 | Loss: 0.0123473476298386 | Epoch: 938 | 
MeanAbsoluteError: 0.0807514414191246 | Loss: 0.0119141494099707 | Epoch: 939 | MeanAbsoluteError: 0.0782798007130623 | Loss: 0.0105396684495918 | Epoch: 940 | 
MeanAbsoluteError: 0.0799887776374817 | Loss: 0.0109580869618488 | Epoch: 941 | 
MeanAbsoluteError: 0.0794720426201820 | Loss: 0.0109352247965095 | Epoch: 942 | MeanAbsoluteError: 0.0753696560859680 | Loss: 0.0101018833872710 | Epoch: 943 | 
MeanAbsoluteError: 0.0852912738919258 | Loss: 0.0118055384506685 | Epoch: 944 | 
MeanAbsoluteError: 0.0834563225507736 | Loss: 0.0112408168223434 | Epoch: 945 | MeanAbsoluteError: 0.0800192430615425 | Loss: 0.0109238399642830 | Epoch: 946 | 
MeanAbsoluteError: 0.0789183601737022 | Loss: 0.0109296069577006 | Epoch: 947 | 
MeanAbsoluteError: 0.0820596292614937 | Loss: 0.0115864925294591 | Epoch: 948 | MeanAbsoluteError: 0.0774351507425308 | Loss: 0.0102799841509174 | Epoch: 949 | 
MeanAbsoluteError: 0.0828437879681587 | Loss: 0.0119973972692818 | Epoch: 950 | 
MeanAbsoluteError: 0.0767286270856857 | Loss: 0.0099505839348467 | Epoch: 951 | MeanAbsoluteError: 0.0792687088251114 | Loss: 0.0106685195425962 | Epoch: 952 | 
MeanAbsoluteError: 0.0804613381624222 | Loss: 0.0110057819390446 | Epoch: 953 | 
MeanAbsoluteError: 0.0778492167592049 | Loss: 0.0104970800298421 | Epoch: 954 | MeanAbsoluteError: 0.0767916813492775 | Loss: 0.0099882882764602 | Epoch: 955 | 
MeanAbsoluteError: 0.0775426998734474 | Loss: 0.0102596230855609 | Epoch: 956 | 
MeanAbsoluteError: 0.0807943418622017 | Loss: 0.0109845612035618 | Epoch: 957 | MeanAbsoluteError: 0.0851599872112274 | Loss: 0.0120625909351899 | Epoch: 958 | 
MeanAbsoluteError: 0.0827905982732773 | Loss: 0.0116668981161395 | Epoch: 959 | 
MeanAbsoluteError: 0.0816919356584549 | Loss: 0.0116942316061492 | Epoch: 960 | MeanAbsoluteError: 0.0803053602576256 | Loss: 0.0111851020848493 | Epoch: 961 | 
MeanAbsoluteError: 0.0814963877201080 | Loss: 0.0111400906953107 | Epoch: 962 | 
MeanAbsoluteError: 0.0797574520111084 | Loss: 0.0121825958039972 | Epoch: 963 | MeanAbsoluteError: 0.0811826437711716 | Loss: 0.0113614202145315 | Epoch: 964 | 
MeanAbsoluteError: 0.0793322324752808 | Loss: 0.0110543987408164 | Epoch: 965 | 
MeanAbsoluteError: 0.0778100267052650 | Loss: 0.0103036645338034 | Epoch: 966 | MeanAbsoluteError: 0.0813805758953094 | Loss: 0.0109037470217542 | Epoch: 967 | 
MeanAbsoluteError: 0.0798039287328720 | Loss: 0.0107907714694799 | Epoch: 968 | 
MeanAbsoluteError: 0.0811770856380463 | Loss: 0.0110361660058455 | Epoch: 969 | MeanAbsoluteError: 0.0784460902214050 | Loss: 0.0106750054383034 | Epoch: 970 | 
MeanAbsoluteError: 0.0836869925260544 | Loss: 0.0123411736837928 | Epoch: 971 | 
MeanAbsoluteError: 0.0802863091230392 | Loss: 0.0111266350393028 | Epoch: 972 | MeanAbsoluteError: 0.0817136317491531 | Loss: 0.0109330557020682 | Epoch: 973 | 
MeanAbsoluteError: 0.0779331550002098 | Loss: 0.0099665610061250 | Epoch: 974 | 
MeanAbsoluteError: 0.0767477825284004 | Loss: 0.0109278881620655 | Epoch: 975 | MeanAbsoluteError: 0.0799491479992867 | Loss: 0.0106451970298076 | Epoch: 976 | 
MeanAbsoluteError: 0.0835985094308853 | Loss: 0.0117250489849296 | Epoch: 977 | 
MeanAbsoluteError: 0.0799057260155678 | Loss: 0.0111022491120578 | Epoch: 978 | MeanAbsoluteError: 0.0797233656048775 | Loss: 0.0104528623646183 | Epoch: 979 | 
MeanAbsoluteError: 0.0790417864918709 | Loss: 0.0101769665649529 | Epoch: 980 | 
MeanAbsoluteError: 0.0798722952604294 | Loss: 0.0106485573768926 | Epoch: 981 | MeanAbsoluteError: 0.0787381455302238 | Loss: 0.0104691559091028 | Epoch: 982 | 
MeanAbsoluteError: 0.0796719118952751 | Loss: 0.0104514892221778 | Epoch: 983 | 
MeanAbsoluteError: 0.0817427337169647 | Loss: 0.0110643387879888 | Epoch: 984 | MeanAbsoluteError: 0.0835069864988327 | Loss: 0.0111985758890690 | Epoch: 985 | 
MeanAbsoluteError: 0.0784978643059731 | Loss: 0.0107149144612777 | Epoch: 986 | 
MeanAbsoluteError: 0.0825326293706894 | Loss: 0.0111450733974804 | Epoch: 987 | MeanAbsoluteError: 0.0805847197771072 | Loss: 0.0108955381274670 | Epoch: 988 | 
MeanAbsoluteError: 0.0773717239499092 | Loss: 0.0099667243599742 | Epoch: 989 | 
MeanAbsoluteError: 0.0792021676898003 | Loss: 0.0102502034262701 | Epoch: 990 | MeanAbsoluteError: 0.0803946033120155 | Loss: 0.0109710032832421 | Epoch: 991 | 
MeanAbsoluteError: 0.0827815085649490 | Loss: 0.0117825886060336 | Epoch: 992 | 
MeanAbsoluteError: 0.0766885727643967 | Loss: 0.0100570682231531 | Epoch: 993 | MeanAbsoluteError: 0.0790843293070793 | Loss: 0.0109440010787027 | Epoch: 994 | 
MeanAbsoluteError: 0.0770236924290657 | Loss: 0.0099913223910456 | Epoch: 995 | 
MeanAbsoluteError: 0.0792539119720459 | Loss: 0.0099654194641820 | Epoch: 996 | MeanAbsoluteError: 0.0821989923715591 | Loss: 0.0108155634860304 | Epoch: 997 | 
MeanAbsoluteError: 0.0781106799840927 | Loss: 0.0104807833368250 | Epoch: 998 | 
MeanAbsoluteError: 0.0822207555174828 | Loss: 0.0117088231569020 | Epoch: 999 | MeanAbsoluteError: 0.0819309651851654 | Loss: 0.0110204845750498 | Epoch: 1000 | 
MeanAbsoluteError: 0.0742249935865402 | Loss: 0.0089560724432037 | Epoch: 1001 | 
MeanAbsoluteError: 0.0765185952186584 | Loss: 0.0102979455963214 | Epoch: 1002 | MeanAbsoluteError: 0.0814492180943489 | Loss: 0.0109778017867120 | Epoch: 1003 | 
MeanAbsoluteError: 0.0785412266850471 | Loss: 0.0104134390683854 | Epoch: 1004 | 
MeanAbsoluteError: 0.0806770995259285 | Loss: 0.0105677329884687 | Epoch: 1005 | MeanAbsoluteError: 0.0860157832503319 | Loss: 0.0118252036485743 | Epoch: 1006 | 
MeanAbsoluteError: 0.0763087049126625 | Loss: 0.0104153512701547 | Epoch: 1007 | 
MeanAbsoluteError: 0.0753281340003014 | Loss: 0.0096652695182032 | Epoch: 1008 | MeanAbsoluteError: 0.0803877860307693 | Loss: 0.0114739247147069 | Epoch: 1009 | 
MeanAbsoluteError: 0.0839739367365837 | Loss: 0.0122035783480245 | Epoch: 1010 | 
MeanAbsoluteError: 0.0834366381168365 | Loss: 0.0116131426976062 | Epoch: 1011 | MeanAbsoluteError: 0.0771669521927834 | Loss: 0.0098695189364419 | Epoch: 1012 | 
MeanAbsoluteError: 0.0858783945441246 | Loss: 0.0116101382824612 | Epoch: 1013 | 
MeanAbsoluteError: 0.0712968409061432 | Loss: 0.0088712135874933 | Epoch: 1014 | MeanAbsoluteError: 0.0767467021942139 | Loss: 0.0101315278329760 | Epoch: 1015 | 
MeanAbsoluteError: 0.0743427053093910 | Loss: 0.0093896187869056 | Epoch: 1016 | 
MeanAbsoluteError: 0.0808187797665596 | Loss: 0.0110782822189261 | Epoch: 1017 | MeanAbsoluteError: 0.0834538787603378 | Loss: 0.0120893543896091 | Epoch: 1018 | 
MeanAbsoluteError: 0.0755506232380867 | Loss: 0.0091724674676758 | Epoch: 1019 | 
MeanAbsoluteError: 0.0843406096100807 | Loss: 0.0121468277798946 | Epoch: 1020 | MeanAbsoluteError: 0.0777495801448822 | Loss: 0.0100996113238701 | Epoch: 1021 | 
MeanAbsoluteError: 0.0781078413128853 | Loss: 0.0101873029284373 | Epoch: 1022 | 
MeanAbsoluteError: 0.0784441158175468 | Loss: 0.0105265056059579 | Epoch: 1023 | MeanAbsoluteError: 0.0775833427906036 | Loss: 0.0097500032376168 | Epoch: 1024 | 
MeanAbsoluteError: 0.0763250738382339 | Loss: 0.0096011892892420 | Epoch: 1025 | 
MeanAbsoluteError: 0.0849190577864647 | Loss: 0.0110521442351577 | Epoch: 1026 | MeanAbsoluteError: 0.0789560601115227 | Loss: 0.0106642135676763 | Epoch: 1027 | 
MeanAbsoluteError: 0.0771628394722939 | Loss: 0.0101572793190159 | Epoch: 1028 | 
MeanAbsoluteError: 0.0780831500887871 | Loss: 0.0101833644398024 | Epoch: 1029 | MeanAbsoluteError: 0.0851734653115273 | Loss: 0.0116694634162316 | Epoch: 1030 | 
MeanAbsoluteError: 0.0802776291966438 | Loss: 0.0122319972995346 | Epoch: 1031 | 
MeanAbsoluteError: 0.0826498717069626 | Loss: 0.0112384752586756 | Epoch: 1032 | MeanAbsoluteError: 0.0738894641399384 | Loss: 0.0093475292252515 | Epoch: 1033 | 
MeanAbsoluteError: 0.0787489414215088 | Loss: 0.0109282928987523 | Epoch: 1034 | 
MeanAbsoluteError: 0.0797242820262909 | Loss: 0.0111809726622838 | Epoch: 1035 | MeanAbsoluteError: 0.0770508199930191 | Loss: 0.0102551479645141 | Epoch: 1036 | 
MeanAbsoluteError: 0.0809864699840546 | Loss: 0.0111380292452911 | Epoch: 1037 | 
MeanAbsoluteError: 0.0780249312520027 | Loss: 0.0102453863299646 | Epoch: 1038 | MeanAbsoluteError: 0.0764536708593369 | Loss: 0.0102224042036444 | Epoch: 1039 | 
MeanAbsoluteError: 0.0711638182401657 | Loss: 0.0086436457873788 | Epoch: 1040 | 
MeanAbsoluteError: 0.0736639052629471 | Loss: 0.0093027273623738 | Epoch: 1041 | MeanAbsoluteError: 0.0789984166622162 | Loss: 0.0097864238555970 | Epoch: 1042 | 
MeanAbsoluteError: 0.0838350579142570 | Loss: 0.0122917329745057 | Epoch: 1043 | 
MeanAbsoluteError: 0.0798211768269539 | Loss: 0.0110959167483331 | Epoch: 1044 | MeanAbsoluteError: 0.0818912014365196 | Loss: 0.0109141668878662 | Epoch: 1045 | 
MeanAbsoluteError: 0.0765458717942238 | Loss: 0.0098385355088006 | Epoch: 1046 | 
MeanAbsoluteError: 0.0791237950325012 | Loss: 0.0103247728328764 | Epoch: 1047 | MeanAbsoluteError: 0.0768154412508011 | Loss: 0.0102105903291764 | Epoch: 1048 | 
MeanAbsoluteError: 0.0842389389872551 | Loss: 0.0117193851121313 | Epoch: 1049 | 
MeanAbsoluteError: 0.0739859342575073 | Loss: 0.0093762344306985 | Epoch: 1050 | MeanAbsoluteError: 0.0789607241749763 | Loss: 0.0104742602940435 | Epoch: 1051 | 
MeanAbsoluteError: 0.0830809995532036 | Loss: 0.0117433610883018 | Epoch: 1052 | 
MeanAbsoluteError: 0.0797499641776085 | Loss: 0.0101497483906132 | Epoch: 1053 | MeanAbsoluteError: 0.0827616155147552 | Loss: 0.0121954634603026 | Epoch: 1054 | 
MeanAbsoluteError: 0.0773455128073692 | Loss: 0.0106737778095824 | Epoch: 1055 | 
MeanAbsoluteError: 0.0791585370898247 | Loss: 0.0107113805897825 | Epoch: 1056 | MeanAbsoluteError: 0.0808061435818672 | Loss: 0.0107919615778277 | Epoch: 1057 | 
MeanAbsoluteError: 0.0748482197523117 | Loss: 0.0094142291248530 | Epoch: 1058 | 
MeanAbsoluteError: 0.0814159139990807 | Loss: 0.0114032692971038 | Epoch: 1059 | MeanAbsoluteError: 0.0750073119997978 | Loss: 0.0092384969931542 | Epoch: 1060 | 
MeanAbsoluteError: 0.0762596055865288 | Loss: 0.0099605135793930 | Epoch: 1061 | 
MeanAbsoluteError: 0.0740376189351082 | Loss: 0.0091504795190728 | Epoch: 1062 | MeanAbsoluteError: 0.0786333158612251 | Loss: 0.0110417670190822 | Epoch: 1063 | 
MeanAbsoluteError: 0.0828019157052040 | Loss: 0.0111327564246797 | Epoch: 1064 | 
MeanAbsoluteError: 0.0786697119474411 | Loss: 0.0105151593774463 | Epoch: 1065 | MeanAbsoluteError: 0.0812012255191803 | Loss: 0.0115967932223551 | Epoch: 1066 | 
MeanAbsoluteError: 0.0733213797211647 | Loss: 0.0090578024931407 | Epoch: 1067 | 
MeanAbsoluteError: 0.0722844302654266 | Loss: 0.0094596829361884 | Epoch: 1068 | MeanAbsoluteError: 0.0758704990148544 | Loss: 0.0098202056699544 | Epoch: 1069 | 
MeanAbsoluteError: 0.0754862055182457 | Loss: 0.0098195204585500 | Epoch: 1070 | 
MeanAbsoluteError: 0.0719922333955765 | Loss: 0.0090988842939078 | Epoch: 1071 | MeanAbsoluteError: 0.0770527049899101 | Loss: 0.0101087290155677 | Epoch: 1072 | 
MeanAbsoluteError: 0.0808756798505783 | Loss: 0.0110966594159254 | Epoch: 1073 | 
MeanAbsoluteError: 0.0734191536903381 | Loss: 0.0091604537900882 | Epoch: 1074 | MeanAbsoluteError: 0.0754526406526566 | Loss: 0.0092636788791909 | Epoch: 1075 | 
MeanAbsoluteError: 0.0801360532641411 | Loss: 0.0111116758813781 | Epoch: 1076 | 
MeanAbsoluteError: 0.0790905058383942 | Loss: 0.0107065720077662 | Epoch: 1077 | MeanAbsoluteError: 0.0792380571365356 | Loss: 0.0109261547988475 | Epoch: 1078 | 
MeanAbsoluteError: 0.0799518600106239 | Loss: 0.0102769006884508 | Epoch: 1079 | 
MeanAbsoluteError: 0.0813763216137886 | Loss: 0.0112526121907285 | Epoch: 1080 | MeanAbsoluteError: 0.0760635957121849 | Loss: 0.0100414728937176 | Epoch: 1081 | 
MeanAbsoluteError: 0.0819802954792976 | Loss: 0.0114132468400931 | Epoch: 1082 | 
MeanAbsoluteError: 0.0732652693986893 | Loss: 0.0093677770822372 | Epoch: 1083 | MeanAbsoluteError: 0.0718203783035278 | Loss: 0.0091996732829985 | Epoch: 1084 | 
MeanAbsoluteError: 0.0768508017063141 | Loss: 0.0103693242547160 | Epoch: 1085 | 
MeanAbsoluteError: 0.0791066810488701 | Loss: 0.0107175551955394 | Epoch: 1086 | MeanAbsoluteError: 0.0772410929203033 | Loss: 0.0100612953921276 | Epoch: 1087 | 
MeanAbsoluteError: 0.0826539620757103 | Loss: 0.0113252641689420 | Epoch: 1088 | 
MeanAbsoluteError: 0.0719712227582932 | Loss: 0.0092483175165156 | Epoch: 1089 | MeanAbsoluteError: 0.0755955651402473 | Loss: 0.0096856384992376 | Epoch: 1090 | 
MeanAbsoluteError: 0.0763257369399071 | Loss: 0.0098936961256368 | Epoch: 1091 | 
MeanAbsoluteError: 0.0792898386716843 | Loss: 0.0106859345851990 | Epoch: 1092 | MeanAbsoluteError: 0.0755667909979820 | Loss: 0.0097809931560672 | Epoch: 1093 | 
MeanAbsoluteError: 0.0748354196548462 | Loss: 0.0101279254044711 | Epoch: 1094 | 
MeanAbsoluteError: 0.0741146802902222 | Loss: 0.0091696833564007 | Epoch: 1095 | MeanAbsoluteError: 0.0807479918003082 | Loss: 0.0113813712754927 | Epoch: 1096 | 
MeanAbsoluteError: 0.0711684599518776 | Loss: 0.0081948269579577 | Epoch: 1097 | 
MeanAbsoluteError: 0.0766433030366898 | Loss: 0.0102434495136064 | Epoch: 1098 | MeanAbsoluteError: 0.0762272179126740 | Loss: 0.0102356361727774 | Epoch: 1099 | 
MeanAbsoluteError: 0.0782568082213402 | Loss: 0.0110953668269091 | Epoch: 1100 | 
MeanAbsoluteError: 0.0753133818507195 | Loss: 0.0097613304924198 | Epoch: 1101 | MeanAbsoluteError: 0.0782390758395195 | Loss: 0.0105954158943738 | Epoch: 1102 | 
MeanAbsoluteError: 0.0753251388669014 | Loss: 0.0098096484786947 | Epoch: 1103 | 
MeanAbsoluteError: 0.0790805146098137 | Loss: 0.0108908841850522 | Epoch: 1104 | MeanAbsoluteError: 0.0774146318435669 | Loss: 0.0100907252420438 | Epoch: 1105 | 
MeanAbsoluteError: 0.0774610862135887 | Loss: 0.0098928650617988 | Epoch: 1106 | 
MeanAbsoluteError: 0.0735087916254997 | Loss: 0.0093527602239919 | Epoch: 1107 | MeanAbsoluteError: 0.0758463442325592 | Loss: 0.0103473262115555 | Epoch: 1108 | 
MeanAbsoluteError: 0.0790556147694588 | Loss: 0.0109796156605201 | Epoch: 1109 | 
MeanAbsoluteError: 0.0796167179942131 | Loss: 0.0109561101418512 | Epoch: 1110 | MeanAbsoluteError: 0.0715682432055473 | Loss: 0.0093572091378580 | Epoch: 1111 | 
MeanAbsoluteError: 0.0723885670304298 | Loss: 0.0089810855339359 | Epoch: 1112 | 
MeanAbsoluteError: 0.0774054676294327 | Loss: 0.0100532385708675 | Epoch: 1113 | MeanAbsoluteError: 0.0761859342455864 | Loss: 0.0100815837434250 | Epoch: 1114 | 
MeanAbsoluteError: 0.0728448405861855 | Loss: 0.0091642631843327 | Epoch: 1115 | 
MeanAbsoluteError: 0.0706325992941856 | Loss: 0.0085524178621805 | Epoch: 1116 | MeanAbsoluteError: 0.0761121287941933 | Loss: 0.0096255014764514 | Epoch: 1117 | 
MeanAbsoluteError: 0.0804161205887794 | Loss: 0.0109809654255272 | Epoch: 1118 | 
MeanAbsoluteError: 0.0731162354350090 | Loss: 0.0090884931735369 | Epoch: 1119 | MeanAbsoluteError: 0.0729935392737389 | Loss: 0.0095069675255945 | Epoch: 1120 | 
MeanAbsoluteError: 0.0742910131812096 | Loss: 0.0100838190375847 | Epoch: 1121 | 
MeanAbsoluteError: 0.0780294314026833 | Loss: 0.0110276344724040 | Epoch: 1122 | MeanAbsoluteError: 0.0768042579293251 | Loss: 0.0102896406215950 | Epoch: 1123 | 
MeanAbsoluteError: 0.0778308585286140 | Loss: 0.0106247359614887 | Epoch: 1124 | 
MeanAbsoluteError: 0.0761818289756775 | Loss: 0.0095280339884509 | Epoch: 1125 | MeanAbsoluteError: 0.0752395242452621 | Loss: 0.0101159590803703 | Epoch: 1126 | 
MeanAbsoluteError: 0.0777955353260040 | Loss: 0.0099182066527040 | Epoch: 1127 | 
MeanAbsoluteError: 0.0753741487860680 | Loss: 0.0093829782667065 | Epoch: 1128 | MeanAbsoluteError: 0.0720049589872360 | Loss: 0.0090915962744718 | Epoch: 1129 | 
MeanAbsoluteError: 0.0710797756910324 | Loss: 0.0090073285002533 | Epoch: 1130 | 
MeanAbsoluteError: 0.0739299431443214 | Loss: 0.0090871711910828 | Epoch: 1131 | MeanAbsoluteError: 0.0774425640702248 | Loss: 0.0101988705133166 | Epoch: 1132 | 
MeanAbsoluteError: 0.0771576762199402 | Loss: 0.0103115899101249 | Epoch: 1133 | 
MeanAbsoluteError: 0.0751268565654755 | Loss: 0.0095889023146689 | Epoch: 1134 | MeanAbsoluteError: 0.0762356221675873 | Loss: 0.0094794061444797 | Epoch: 1135 | 
MeanAbsoluteError: 0.0763162747025490 | Loss: 0.0098945926916592 | Epoch: 1136 | 
MeanAbsoluteError: 0.0721278712153435 | Loss: 0.0095161811572325 | Epoch: 1137 | MeanAbsoluteError: 0.0796170905232430 | Loss: 0.0109027532875674 | Epoch: 1138 | 
MeanAbsoluteError: 0.0788417682051659 | Loss: 0.0104463429992635 | Epoch: 1139 | 
MeanAbsoluteError: 0.0736665949225426 | Loss: 0.0093314258327913 | Epoch: 1140 | MeanAbsoluteError: 0.0771023631095886 | Loss: 0.0103506943272275 | Epoch: 1141 | 
MeanAbsoluteError: 0.0746853277087212 | Loss: 0.0093746413490347 | Epoch: 1142 | 
MeanAbsoluteError: 0.0744357109069824 | Loss: 0.0102286266127339 | Epoch: 1143 | MeanAbsoluteError: 0.0721102878451347 | Loss: 0.0094143224936367 | Epoch: 1144 | 
MeanAbsoluteError: 0.0753890275955200 | Loss: 0.0102678460885848 | Epoch: 1145 | 
MeanAbsoluteError: 0.0785412490367889 | Loss: 0.0111589255550158 | Epoch: 1146 | MeanAbsoluteError: 0.0711220204830170 | Loss: 0.0087199749163604 | Epoch: 1147 | 
MeanAbsoluteError: 0.0717831477522850 | Loss: 0.0086872578399683 | Epoch: 1148 | 
MeanAbsoluteError: 0.0714653804898262 | Loss: 0.0083702374933152 | Epoch: 1149 | MeanAbsoluteError: 0.0734660699963570 | Loss: 0.0091674384714618 | Epoch: 1150 | 
MeanAbsoluteError: 0.0750407353043556 | Loss: 0.0098616032845530 | Epoch: 1151 | 
MeanAbsoluteError: 0.0728831142187119 | Loss: 0.0089887576312079 | Epoch: 1152 | MeanAbsoluteError: 0.0717433765530586 | Loss: 0.0089564603529834 | Epoch: 1153 | 
MeanAbsoluteError: 0.0697365775704384 | Loss: 0.0082730542524951 | Epoch: 1154 | 
MeanAbsoluteError: 0.0770397558808327 | Loss: 0.0097560962254208 | Epoch: 1155 | MeanAbsoluteError: 0.0734242871403694 | Loss: 0.0094161905271903 | Epoch: 1156 | 
MeanAbsoluteError: 0.0748293623328209 | Loss: 0.0101921623121598 | Epoch: 1157 | 
MeanAbsoluteError: 0.0710012763738632 | Loss: 0.0083151159421929 | Epoch: 1158 | MeanAbsoluteError: 0.0778808519244194 | Loss: 0.0096039163575915 | Epoch: 1159 | 
MeanAbsoluteError: 0.0745119601488113 | Loss: 0.0092697770763213 | Epoch: 1160 | 
MeanAbsoluteError: 0.0768109634518623 | Loss: 0.0100630211924848 | Epoch: 1161 | MeanAbsoluteError: 0.0799050480127335 | Loss: 0.0110931521609018 | Epoch: 1162 | 
MeanAbsoluteError: 0.0740251317620277 | Loss: 0.0094664047186476 | Epoch: 1163 | 
MeanAbsoluteError: 0.0757060870528221 | Loss: 0.0098211725423850 | Epoch: 1164 | MeanAbsoluteError: 0.0770554915070534 | Loss: 0.0099205628124764 | Epoch: 1165 | 
MeanAbsoluteError: 0.0715246349573135 | Loss: 0.0089008971913669 | Epoch: 1166 | 
MeanAbsoluteError: 0.0757642686367035 | Loss: 0.0096641077135670 | Epoch: 1167 | MeanAbsoluteError: 0.0705088600516319 | Loss: 0.0087975634884732 | Epoch: 1168 | 
MeanAbsoluteError: 0.0753110423684120 | Loss: 0.0101649951477399 | Epoch: 1169 | 
MeanAbsoluteError: 0.0693522170186043 | Loss: 0.0082086631072404 | Epoch: 1170 | MeanAbsoluteError: 0.0730027630925179 | Loss: 0.0089591340036683 | Epoch: 1171 | 
MeanAbsoluteError: 0.0729404613375664 | Loss: 0.0089655621746109 | Epoch: 1172 | 
MeanAbsoluteError: 0.0729978606104851 | Loss: 0.0092923569381431 | Epoch: 1173 | MeanAbsoluteError: 0.0751508325338364 | Loss: 0.0093727224309502 | Epoch: 1174 | 
MeanAbsoluteError: 0.0764370784163475 | Loss: 0.0096040136937881 | Epoch: 1175 | 
MeanAbsoluteError: 0.0763458460569382 | Loss: 0.0096792195313416 | Epoch: 1176 | MeanAbsoluteError: 0.0783675014972687 | Loss: 0.0108466480083977 | Epoch: 1177 | 
MeanAbsoluteError: 0.0714866966009140 | Loss: 0.0086943162176370 | Epoch: 1178 | 
MeanAbsoluteError: 0.0747063532471657 | Loss: 0.0098131392798678 | Epoch: 1179 | MeanAbsoluteError: 0.0727716013789177 | Loss: 0.0091420818245691 | Epoch: 1180 | 
MeanAbsoluteError: 0.0744332000613213 | Loss: 0.0094013054016371 | Epoch: 1181 | 
MeanAbsoluteError: 0.0705423876643181 | Loss: 0.0086722544932491 | Epoch: 1182 | MeanAbsoluteError: 0.0775942653417587 | Loss: 0.0101437826145169 | Epoch: 1183 | 
MeanAbsoluteError: 0.0702958926558495 | Loss: 0.0090118990328877 | Epoch: 1184 | 
MeanAbsoluteError: 0.0781895667314529 | Loss: 0.0101654315494792 | Epoch: 1185 | MeanAbsoluteError: 0.0705584734678268 | Loss: 0.0086825195030542 | Epoch: 1186 | 
MeanAbsoluteError: 0.0718369930982590 | Loss: 0.0089196939587176 | Epoch: 1187 | 
MeanAbsoluteError: 0.0729104205965996 | Loss: 0.0094714367083482 | Epoch: 1188 | MeanAbsoluteError: 0.0715822800993919 | Loss: 0.0087371695258480 | Epoch: 1189 | 
MeanAbsoluteError: 0.0744573995471001 | Loss: 0.0093635351045911 | Epoch: 1190 | 
MeanAbsoluteError: 0.0765640214085579 | Loss: 0.0100390275301197 | Epoch: 1191 | MeanAbsoluteError: 0.0710071623325348 | Loss: 0.0091899916582679 | Epoch: 1192 | 
MeanAbsoluteError: 0.0712167173624039 | Loss: 0.0092770067056699 | Epoch: 1193 | 
MeanAbsoluteError: 0.0732539296150208 | Loss: 0.0091604213320655 | Epoch: 1194 | MeanAbsoluteError: 0.0724341794848442 | Loss: 0.0090846943149518 | Epoch: 1195 | 
MeanAbsoluteError: 0.0720392465591431 | Loss: 0.0093398551149706 | Epoch: 1196 | 
MeanAbsoluteError: 0.0758213326334953 | Loss: 0.0098821933589837 | Epoch: 1197 | MeanAbsoluteError: 0.0818063765764236 | Loss: 0.0114398268246441 | Epoch: 1198 | 
MeanAbsoluteError: 0.0726697593927383 | Loss: 0.0094839891439551 | Epoch: 1199 | 
MeanAbsoluteError: 0.0761432796716690 | Loss: 0.0095367067152135 | Epoch: 1200 | MeanAbsoluteError: 0.0729445889592171 | Loss: 0.0097233608183888 | Epoch: 1201 | 
MeanAbsoluteError: 0.0790116935968399 | Loss: 0.0102932546254548 | Epoch: 1202 | 
MeanAbsoluteError: 0.0812764391303062 | Loss: 0.0124177305907142 | Epoch: 1203 | MeanAbsoluteError: 0.0717479139566422 | Loss: 0.0090304287522789 | Epoch: 1204 | 
MeanAbsoluteError: 0.0762517899274826 | Loss: 0.0106181993645729 | Epoch: 1205 | 
MeanAbsoluteError: 0.0810980647802353 | Loss: 0.0112188509103726 | Epoch: 1206 | MeanAbsoluteError: 0.0708948001265526 | Loss: 0.0089636501190883 | Epoch: 1207 | 
MeanAbsoluteError: 0.0711241289973259 | Loss: 0.0088344263134756 | Epoch: 1208 | 
MeanAbsoluteError: 0.0707039833068848 | Loss: 0.0087672802931532 | Epoch: 1209 | MeanAbsoluteError: 0.0714915841817856 | Loss: 0.0091346497223761 | Epoch: 1210 | 
MeanAbsoluteError: 0.0770235136151314 | Loss: 0.0102689785846693 | Epoch: 1211 | 
MeanAbsoluteError: 0.0731478855013847 | Loss: 0.0090482235212827 | Epoch: 1212 | MeanAbsoluteError: 0.0708224475383759 | Loss: 0.0089778698750160 | Epoch: 1213 | 
MeanAbsoluteError: 0.0773651748895645 | Loss: 0.0101364258961257 | Epoch: 1214 | 
MeanAbsoluteError: 0.0787117853760719 | Loss: 0.0101732820400624 | Epoch: 1215 | MeanAbsoluteError: 0.0712366625666618 | Loss: 0.0089510927983065 | Epoch: 1216 | 
MeanAbsoluteError: 0.0717374086380005 | Loss: 0.0091585356321593 | Epoch: 1217 | 
MeanAbsoluteError: 0.0738085582852364 | Loss: 0.0098769022602058 | Epoch: 1218 | MeanAbsoluteError: 0.0723524838685989 | Loss: 0.0087931159668369 | Epoch: 1219 | 
MeanAbsoluteError: 0.0690352022647858 | Loss: 0.0084941416224077 | Epoch: 1220 | 
MeanAbsoluteError: 0.0719821304082870 | Loss: 0.0084262569399531 | Epoch: 1221 | MeanAbsoluteError: 0.0738014280796051 | Loss: 0.0098091907693076 | Epoch: 1222 | 
MeanAbsoluteError: 0.0731337517499924 | Loss: 0.0086348389252695 | Epoch: 1223 | 
MeanAbsoluteError: 0.0719165578484535 | Loss: 0.0088658601249335 | Epoch: 1224 | MeanAbsoluteError: 0.0726284757256508 | Loss: 0.0086095952552084 | Early stopping at epoch 1223
Returned to Spot: Validation loss: 0.008609595255208357

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.1773189149831582, 'lr_mult': 9.06715620679689, 'batch_size': 4, 'epochs': 4, 'k_folds': 1, 'patience': 8, 'optimizer': 'Adamax', 'sgd_momentum': 0.22706194978124503}
Epoch: 1 | MeanAbsoluteError: 0.1273143887519836 | Loss: 0.0256845303283383 | Epoch: 2 | 
MeanAbsoluteError: 0.1234637945890427 | Loss: 0.0237106628188243 | Epoch: 3 | MeanAbsoluteError: 0.1138372421264648 | Loss: 0.0206073829795544 | Epoch: 4 | 
MeanAbsoluteError: 0.0972898751497269 | Loss: 0.0153659190873926 | Returned to Spot: Validation loss: 0.015365919087392588

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.3840970624671163, 'lr_mult': 4.593111165984917, 'batch_size': 8, 'epochs': 256, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.8945915831939406}
Epoch: 1 | MeanAbsoluteError: 0.1623708009719849 | Loss: 0.0406233821015217 | Epoch: 2 | MeanAbsoluteError: 0.1400841027498245 | Loss: 0.0309523704253431 | Epoch: 3 | MeanAbsoluteError: 0.1271484941244125 | Loss: 0.0262105070348633 | Epoch: 4 | MeanAbsoluteError: 0.1319982409477234 | Loss: 0.0274074596450909 | Epoch: 5 | MeanAbsoluteError: 0.1058175787329674 | Loss: 0.0182074947576774 | Epoch: 6 | MeanAbsoluteError: 0.1104197800159454 | Loss: 0.0192253507649232 | Epoch: 7 | 
MeanAbsoluteError: 0.1040905341506004 | Loss: 0.0174235612104990 | Epoch: 8 | MeanAbsoluteError: 0.1035401523113251 | Loss: 0.0174380383625823 | Epoch: 9 | MeanAbsoluteError: 0.0938217267394066 | Loss: 0.0139481426694577 | Epoch: 10 | MeanAbsoluteError: 0.0914507582783699 | Loss: 0.0137419729910203 | Epoch: 11 | 
MeanAbsoluteError: 0.0825715288519859 | Loss: 0.0118880775806151 | Epoch: 12 | MeanAbsoluteError: 0.0843093842267990 | Loss: 0.0126748379062567 | Epoch: 13 | MeanAbsoluteError: 0.0788758769631386 | Loss: 0.0117728114587647 | Epoch: 14 | MeanAbsoluteError: 0.0778097733855247 | Loss: 0.0099937925544126 | Epoch: 15 | MeanAbsoluteError: 0.0792128965258598 | Loss: 0.0110351751423686 | Epoch: 16 | MeanAbsoluteError: 0.0706287324428558 | Loss: 0.0088109693897422 | Epoch: 17 | MeanAbsoluteError: 0.0675539746880531 | Loss: 0.0086899276678818 | Epoch: 18 | 
MeanAbsoluteError: 0.0747077316045761 | Loss: 0.0103498119768981 | Epoch: 19 | MeanAbsoluteError: 0.0654421523213387 | Loss: 0.0076033706825815 | Epoch: 20 | MeanAbsoluteError: 0.0650960728526115 | Loss: 0.0085457853488869 | Epoch: 21 | MeanAbsoluteError: 0.0667726546525955 | Loss: 0.0090801386946910 | Epoch: 22 | 
MeanAbsoluteError: 0.0657069236040115 | Loss: 0.0083339340359855 | Epoch: 23 | MeanAbsoluteError: 0.0598203353583813 | Loss: 0.0065459738896032 | Epoch: 24 | MeanAbsoluteError: 0.0627705305814743 | Loss: 0.0081742755091431 | Epoch: 25 | MeanAbsoluteError: 0.0654822215437889 | Loss: 0.0069324536720830 | Epoch: 26 | MeanAbsoluteError: 0.0606752783060074 | Loss: 0.0067751734290811 | Epoch: 27 | MeanAbsoluteError: 0.0587655380368233 | Loss: 0.0069376400328780 | Epoch: 28 | MeanAbsoluteError: 0.0687547400593758 | Loss: 0.0081911213653113 | Epoch: 29 | 
MeanAbsoluteError: 0.0549499206244946 | Loss: 0.0056060901628562 | Epoch: 30 | MeanAbsoluteError: 0.0647452324628830 | Loss: 0.0077502248704580 | Epoch: 31 | MeanAbsoluteError: 0.0650596544146538 | Loss: 0.0068808090153126 | Epoch: 32 | MeanAbsoluteError: 0.0575524792075157 | Loss: 0.0059828315922794 | Epoch: 33 | 
MeanAbsoluteError: 0.0478478148579597 | Loss: 0.0046138316438852 | Epoch: 34 | MeanAbsoluteError: 0.0580140165984631 | Loss: 0.0062071446353864 | Epoch: 35 | MeanAbsoluteError: 0.0602895729243755 | Loss: 0.0060470033142912 | Epoch: 36 | MeanAbsoluteError: 0.0707148388028145 | Loss: 0.0080962337639281 | Epoch: 37 | MeanAbsoluteError: 0.0564267858862877 | Loss: 0.0054368438309451 | Epoch: 38 | MeanAbsoluteError: 0.0538025163114071 | Loss: 0.0053991874722813 | Epoch: 39 | MeanAbsoluteError: 0.0653034672141075 | Loss: 0.0077548549835276 | Epoch: 40 | 
MeanAbsoluteError: 0.0580477826297283 | Loss: 0.0067466214960931 | Epoch: 41 | MeanAbsoluteError: 0.0545035824179649 | Loss: 0.0056438143847596 | Epoch: 42 | MeanAbsoluteError: 0.0532882474362850 | Loss: 0.0053365088809331 | Epoch: 43 | MeanAbsoluteError: 0.0518933124840260 | Loss: 0.0050505789404269 | Epoch: 44 | 
MeanAbsoluteError: 0.0649017170071602 | Loss: 0.0070015616181895 | Epoch: 45 | MeanAbsoluteError: 0.0605409629642963 | Loss: 0.0067815208917876 | Epoch: 46 | MeanAbsoluteError: 0.0526941567659378 | Loss: 0.0048198858842768 | Epoch: 47 | MeanAbsoluteError: 0.0496314465999603 | Loss: 0.0052715360759880 | Epoch: 48 | MeanAbsoluteError: 0.0533580966293812 | Loss: 0.0053006814866278 | Epoch: 49 | MeanAbsoluteError: 0.0513687282800674 | Loss: 0.0052530209466472 | Epoch: 50 | MeanAbsoluteError: 0.0516549088060856 | Loss: 0.0046377177825075 | Epoch: 51 | 
MeanAbsoluteError: 0.0522674694657326 | Loss: 0.0048909859370293 | Epoch: 52 | MeanAbsoluteError: 0.0540342852473259 | Loss: 0.0052068716889296 | Epoch: 53 | MeanAbsoluteError: 0.0541450865566730 | Loss: 0.0061107364599593 | Epoch: 54 | MeanAbsoluteError: 0.0537174418568611 | Loss: 0.0047923664441393 | Epoch: 55 | 
MeanAbsoluteError: 0.0517357811331749 | Loss: 0.0053018471103554 | Epoch: 56 | MeanAbsoluteError: 0.0530774705111980 | Loss: 0.0054320943109863 | Epoch: 57 | MeanAbsoluteError: 0.0548373609781265 | Loss: 0.0059708082607310 | Epoch: 58 | MeanAbsoluteError: 0.0696393474936485 | Loss: 0.0076546843200432 | Epoch: 59 | MeanAbsoluteError: 0.0543245300650597 | Loss: 0.0055577672411394 | Epoch: 60 | MeanAbsoluteError: 0.0530802421271801 | Loss: 0.0055056329675656 | Epoch: 61 | MeanAbsoluteError: 0.0513826385140419 | Loss: 0.0049456614345361 | Epoch: 62 | 
MeanAbsoluteError: 0.0491917096078396 | Loss: 0.0048342164097305 | Epoch: 63 | MeanAbsoluteError: 0.0504812598228455 | Loss: 0.0048239605078523 | Epoch: 64 | MeanAbsoluteError: 0.0701302215456963 | Loss: 0.0080583249126855 | Epoch: 65 | MeanAbsoluteError: 0.0544833168387413 | Loss: 0.0054246279116916 | Epoch: 66 | 
MeanAbsoluteError: 0.0617512315511703 | Loss: 0.0067223066304761 | Epoch: 67 | MeanAbsoluteError: 0.0560186840593815 | Loss: 0.0055778875095329 | Epoch: 68 | MeanAbsoluteError: 0.0574280731379986 | Loss: 0.0061345006351506 | Epoch: 69 | MeanAbsoluteError: 0.0534925647079945 | Loss: 0.0051589513681584 | Epoch: 70 | MeanAbsoluteError: 0.0554681569337845 | Loss: 0.0055809164493296 | Epoch: 71 | MeanAbsoluteError: 0.0480491779744625 | Loss: 0.0052445159894169 | Epoch: 72 | MeanAbsoluteError: 0.0591404475271702 | Loss: 0.0063324326030469 | Epoch: 73 | 
MeanAbsoluteError: 0.0551490224897861 | Loss: 0.0060053033858391 | Epoch: 74 | MeanAbsoluteError: 0.0536806173622608 | Loss: 0.0056669389810658 | Epoch: 75 | MeanAbsoluteError: 0.0612141042947769 | Loss: 0.0067010002752987 | Epoch: 76 | MeanAbsoluteError: 0.0490252748131752 | Loss: 0.0048237113423008 | Epoch: 77 | 
MeanAbsoluteError: 0.0476369187235832 | Loss: 0.0049010735712823 | Epoch: 78 | MeanAbsoluteError: 0.0540821254253387 | Loss: 0.0059155660871367 | Epoch: 79 | MeanAbsoluteError: 0.0460529476404190 | Loss: 0.0044427752857844 | Epoch: 80 | MeanAbsoluteError: 0.0501189157366753 | Loss: 0.0048574311566833 | Epoch: 81 | MeanAbsoluteError: 0.0519359521567822 | Loss: 0.0062583037338060 | Epoch: 82 | MeanAbsoluteError: 0.0517777651548386 | Loss: 0.0048910327436476 | Epoch: 83 | MeanAbsoluteError: 0.0527585521340370 | Loss: 0.0056073930272281 | Epoch: 84 | 
MeanAbsoluteError: 0.0502856895327568 | Loss: 0.0049820335300051 | Epoch: 85 | MeanAbsoluteError: 0.0484406128525734 | Loss: 0.0049082869518315 | Epoch: 86 | MeanAbsoluteError: 0.0506847873330116 | Loss: 0.0053613518462761 | Epoch: 87 | MeanAbsoluteError: 0.0553923808038235 | Loss: 0.0059143203704336 | Epoch: 88 | 
MeanAbsoluteError: 0.0490318946540356 | Loss: 0.0046650155272800 | Epoch: 89 | MeanAbsoluteError: 0.0558336339890957 | Loss: 0.0061959174192069 | Epoch: 90 | MeanAbsoluteError: 0.0508249253034592 | Loss: 0.0062239893902044 | Epoch: 91 | MeanAbsoluteError: 0.0511913858354092 | Loss: 0.0051942568817666 | Epoch: 92 | MeanAbsoluteError: 0.0528994277119637 | Loss: 0.0058090027703560 | Epoch: 93 | MeanAbsoluteError: 0.0482963845133781 | Loss: 0.0048661773601596 | Epoch: 94 | MeanAbsoluteError: 0.0533009320497513 | Loss: 0.0049048979448057 | Epoch: 95 | 
MeanAbsoluteError: 0.0536236129701138 | Loss: 0.0054402862243526 | Epoch: 96 | MeanAbsoluteError: 0.0592939518392086 | Loss: 0.0062313529564754 | Epoch: 97 | MeanAbsoluteError: 0.0499239899218082 | Loss: 0.0041817871449319 | Epoch: 98 | MeanAbsoluteError: 0.0506448186933994 | Loss: 0.0049522992830086 | Epoch: 99 | 
MeanAbsoluteError: 0.0446750037372112 | Loss: 0.0033293176522037 | Epoch: 100 | MeanAbsoluteError: 0.0458734780550003 | Loss: 0.0042514839120773 | Epoch: 101 | MeanAbsoluteError: 0.0450072512030602 | Loss: 0.0044092952004193 | Epoch: 102 | MeanAbsoluteError: 0.0441622398793697 | Loss: 0.0037665743883209 | Epoch: 103 | MeanAbsoluteError: 0.0600054860115051 | Loss: 0.0064608878854319 | Epoch: 104 | MeanAbsoluteError: 0.0430788882076740 | Loss: 0.0035355144309027 | Epoch: 105 | MeanAbsoluteError: 0.0598864480853081 | Loss: 0.0061358844671447 | Epoch: 106 | 
MeanAbsoluteError: 0.0548825636506081 | Loss: 0.0060296179114008 | Epoch: 107 | MeanAbsoluteError: 0.0524246394634247 | Loss: 0.0056644307279432 | Epoch: 108 | MeanAbsoluteError: 0.0499289482831955 | Loss: 0.0046540068119372 | Epoch: 109 | MeanAbsoluteError: 0.0486816056072712 | Loss: 0.0037169454643797 | Epoch: 110 | 
MeanAbsoluteError: 0.0520404763519764 | Loss: 0.0051146857677898 | Epoch: 111 | MeanAbsoluteError: 0.0579268150031567 | Loss: 0.0066002285794208 | Epoch: 112 | MeanAbsoluteError: 0.0529880672693253 | Loss: 0.0060090134104126 | Epoch: 113 | MeanAbsoluteError: 0.0536507032811642 | Loss: 0.0049873983754017 | Epoch: 114 | MeanAbsoluteError: 0.0429656133055687 | Loss: 0.0039430169685817 | Epoch: 115 | MeanAbsoluteError: 0.0507809706032276 | Loss: 0.0052658876673760 | Epoch: 116 | MeanAbsoluteError: 0.0498244315385818 | Loss: 0.0042273921242572 | Epoch: 117 | 
MeanAbsoluteError: 0.0469658859074116 | Loss: 0.0040689199599192 | Epoch: 118 | MeanAbsoluteError: 0.0544400103390217 | Loss: 0.0059207571007152 | Epoch: 119 | MeanAbsoluteError: 0.0508665703237057 | Loss: 0.0051576849777791 | Epoch: 120 | MeanAbsoluteError: 0.0562406480312347 | Loss: 0.0070846104844302 | Epoch: 121 | 
MeanAbsoluteError: 0.0514979250729084 | Loss: 0.0045265892067140 | Epoch: 122 | MeanAbsoluteError: 0.0589899495244026 | Loss: 0.0070536459649080 | Epoch: 123 | MeanAbsoluteError: 0.0484884306788445 | Loss: 0.0048405598285363 | Epoch: 124 | MeanAbsoluteError: 0.0470880977809429 | Loss: 0.0042612608032007 | Epoch: 125 | MeanAbsoluteError: 0.0501802265644073 | Loss: 0.0047795014076033 | Epoch: 126 | MeanAbsoluteError: 0.0571232587099075 | Loss: 0.0055170075502247 | Epoch: 127 | MeanAbsoluteError: 0.0492623858153820 | Loss: 0.0046365553234385 | Epoch: 128 | 
MeanAbsoluteError: 0.0471030175685883 | Loss: 0.0044964626615279 | Epoch: 129 | MeanAbsoluteError: 0.0583554133772850 | Loss: 0.0064098972361535 | Epoch: 130 | MeanAbsoluteError: 0.0558050796389580 | Loss: 0.0049149633636453 | Epoch: 131 | MeanAbsoluteError: 0.0548096708953381 | Loss: 0.0054126833167270 | Epoch: 132 | 
MeanAbsoluteError: 0.0524290204048157 | Loss: 0.0056690000224319 | Epoch: 133 | MeanAbsoluteError: 0.0526521503925323 | Loss: 0.0048959007636816 | Epoch: 134 | MeanAbsoluteError: 0.0498731695115566 | Loss: 0.0043648734158763 | Epoch: 135 | MeanAbsoluteError: 0.0450481250882149 | Loss: 0.0037879267076373 | Epoch: 136 | MeanAbsoluteError: 0.0636688023805618 | Loss: 0.0074199106158248 | Epoch: 137 | MeanAbsoluteError: 0.0471385866403580 | Loss: 0.0040608021418417 | Epoch: 138 | MeanAbsoluteError: 0.0467486269772053 | Loss: 0.0044178538251129 | Epoch: 139 | 
MeanAbsoluteError: 0.0519829206168652 | Loss: 0.0048942063647126 | Epoch: 140 | MeanAbsoluteError: 0.0434172935783863 | Loss: 0.0037831949992228 | Epoch: 141 | MeanAbsoluteError: 0.0496224164962769 | Loss: 0.0047945167584418 | Epoch: 142 | MeanAbsoluteError: 0.0536433905363083 | Loss: 0.0056726909104710 | Epoch: 143 | 
MeanAbsoluteError: 0.0705322846770287 | Loss: 0.0080569616341228 | Epoch: 144 | MeanAbsoluteError: 0.0428756289184093 | Loss: 0.0038233233943557 | Epoch: 145 | MeanAbsoluteError: 0.0504007525742054 | Loss: 0.0044703130674622 | Epoch: 146 | MeanAbsoluteError: 0.0517579503357410 | Loss: 0.0047306706853162 | Epoch: 147 | MeanAbsoluteError: 0.0519875288009644 | Loss: 0.0054913777092129 | Epoch: 148 | MeanAbsoluteError: 0.0520254187285900 | Loss: 0.0051423125673625 | Epoch: 149 | MeanAbsoluteError: 0.0465091802179813 | Loss: 0.0044713971529793 | Epoch: 150 | 
MeanAbsoluteError: 0.0563918575644493 | Loss: 0.0059588181565663 | Epoch: 151 | MeanAbsoluteError: 0.0451574400067329 | Loss: 0.0041877986054475 | Epoch: 152 | MeanAbsoluteError: 0.0523117035627365 | Loss: 0.0051560335927398 | Epoch: 153 | MeanAbsoluteError: 0.0612157769501209 | Loss: 0.0064227275433950 | Epoch: 154 | 
MeanAbsoluteError: 0.0486434102058411 | Loss: 0.0046297882723401 | Epoch: 155 | MeanAbsoluteError: 0.0459852963685989 | Loss: 0.0039160966576004 | Epoch: 156 | MeanAbsoluteError: 0.0544111579656601 | Loss: 0.0060264546719784 | Epoch: 157 | MeanAbsoluteError: 0.0558949783444405 | Loss: 0.0060491811416700 | Epoch: 158 | MeanAbsoluteError: 0.0555992014706135 | Loss: 0.0055195814868631 | Epoch: 159 | MeanAbsoluteError: 0.0510876514017582 | Loss: 0.0044407772411911 | Epoch: 160 | MeanAbsoluteError: 0.0548095181584358 | Loss: 0.0056221281778754 | Epoch: 161 | 
MeanAbsoluteError: 0.0562781393527985 | Loss: 0.0052647276499652 | Epoch: 162 | MeanAbsoluteError: 0.0494938455522060 | Loss: 0.0047499344264476 | Epoch: 163 | MeanAbsoluteError: 0.0511399805545807 | Loss: 0.0054140348725732 | Early stopping at epoch 162
Returned to Spot: Validation loss: 0.005414034872573163

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.25720387344735907, 'lr_mult': 6.64364311004794, 'batch_size': 16, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.2311571854258434}
Epoch: 1 | MeanAbsoluteError: 0.1931009292602539 | Loss: 0.0543621821623099 | Epoch: 2 | MeanAbsoluteError: 0.1943719536066055 | Loss: 0.0538908047111411 | Epoch: 3 | MeanAbsoluteError: 0.1177785843610764 | Loss: 0.0217154369640507 | Epoch: 4 | MeanAbsoluteError: 0.1391853541135788 | Loss: 0.0295541360974312 | Epoch: 5 | MeanAbsoluteError: 0.1136453151702881 | Loss: 0.0206243941364320 | Epoch: 6 | MeanAbsoluteError: 0.1982957720756531 | Loss: 0.0557153438659091 | Epoch: 7 | MeanAbsoluteError: 0.1441925317049026 | Loss: 0.0281623501918818 | Epoch: 8 | MeanAbsoluteError: 0.1191397607326508 | Loss: 0.0225036601584993 | Epoch: 9 | MeanAbsoluteError: 0.1405492871999741 | Loss: 0.0294085859664177 | Epoch: 10 | MeanAbsoluteError: 0.2101283818483353 | Loss: 0.0584813634815969 | Epoch: 11 | MeanAbsoluteError: 0.1361592859029770 | Loss: 0.0270040815598086 | Epoch: 12 | MeanAbsoluteError: 0.1069744005799294 | Loss: 0.0179334082885792 | Epoch: 13 | MeanAbsoluteError: 0.1724698394536972 | Loss: 0.0403072086996154 | Epoch: 14 | MeanAbsoluteError: 0.1342748552560806 | Loss: 0.0256743660490764 | Epoch: 15 | MeanAbsoluteError: 0.1482224762439728 | Loss: 0.0326294122557891 | Epoch: 16 | MeanAbsoluteError: 0.2411551475524902 | Loss: 0.0681611917128688 | Epoch: 17 | MeanAbsoluteError: 0.1200496777892113 | Loss: 0.0200626288883780 | Epoch: 18 | MeanAbsoluteError: 0.0698433965444565 | Loss: 0.0086956013631272 | Epoch: 19 | 
MeanAbsoluteError: 0.0849197134375572 | Loss: 0.0115242343101847 | Epoch: 20 | MeanAbsoluteError: 0.0826778262853622 | Loss: 0.0112278994025761 | Epoch: 21 | MeanAbsoluteError: 0.1114109307527542 | Loss: 0.0196865281384242 | Epoch: 22 | MeanAbsoluteError: 0.0945895314216614 | Loss: 0.0133742870713927 | Epoch: 23 | MeanAbsoluteError: 0.0887643843889236 | Loss: 0.0128246185271756 | Epoch: 24 | MeanAbsoluteError: 0.0860880389809608 | Loss: 0.0119253931763141 | Epoch: 25 | MeanAbsoluteError: 0.1559847146272659 | Loss: 0.0295598243216151 | Epoch: 26 | MeanAbsoluteError: 0.0633682906627655 | Loss: 0.0070596259626511 | Epoch: 27 | MeanAbsoluteError: 0.0940798148512840 | Loss: 0.0117769767285178 | Epoch: 28 | MeanAbsoluteError: 0.0670882984995842 | Loss: 0.0075376919519744 | Epoch: 29 | MeanAbsoluteError: 0.0784322097897530 | Loss: 0.0102569205245297 | Epoch: 30 | MeanAbsoluteError: 0.1442881077528000 | Loss: 0.0270974428245896 | Epoch: 31 | MeanAbsoluteError: 0.0768838003277779 | Loss: 0.0096637543388887 | Epoch: 32 | MeanAbsoluteError: 0.0594173669815063 | Loss: 0.0064142156931523 | Epoch: 33 | MeanAbsoluteError: 0.1042024716734886 | Loss: 0.0150100374594331 | Epoch: 34 | MeanAbsoluteError: 0.0635708868503571 | Loss: 0.0068643322876213 | Epoch: 35 | MeanAbsoluteError: 0.0777871087193489 | Loss: 0.0094404277685834 | Epoch: 36 | MeanAbsoluteError: 0.0922087058424950 | Loss: 0.0112343345964818 | Epoch: 37 | MeanAbsoluteError: 0.0646578818559647 | Loss: 0.0067754688207060 | Epoch: 38 | 
MeanAbsoluteError: 0.0736524313688278 | Loss: 0.0086612039809360 | Epoch: 39 | MeanAbsoluteError: 0.0617485381662846 | Loss: 0.0064719801425542 | Epoch: 40 | MeanAbsoluteError: 0.0699118077754974 | Loss: 0.0070581714573659 | Epoch: 41 | MeanAbsoluteError: 0.1144779473543167 | Loss: 0.0160450654006318 | Epoch: 42 | MeanAbsoluteError: 0.0630614981055260 | Loss: 0.0063189958148685 | Epoch: 43 | MeanAbsoluteError: 0.1288088262081146 | Loss: 0.0219211082317327 | Epoch: 44 | MeanAbsoluteError: 0.0500600449740887 | Loss: 0.0046805879713869 | Epoch: 45 | MeanAbsoluteError: 0.0717226713895798 | Loss: 0.0079338826900838 | Epoch: 46 | MeanAbsoluteError: 0.1141232028603554 | Loss: 0.0175563164153381 | Epoch: 47 | MeanAbsoluteError: 0.0795645266771317 | Loss: 0.0084284124405761 | Epoch: 48 | MeanAbsoluteError: 0.1048285067081451 | Loss: 0.0152611186433780 | Epoch: 49 | MeanAbsoluteError: 0.1062637344002724 | Loss: 0.0141310583505976 | Epoch: 50 | MeanAbsoluteError: 0.1083770766854286 | Loss: 0.0166141013859918 | Epoch: 51 | MeanAbsoluteError: 0.0959727317094803 | Loss: 0.0121891839478753 | Epoch: 52 | MeanAbsoluteError: 0.0737433210015297 | Loss: 0.0078105062589441 | Epoch: 53 | MeanAbsoluteError: 0.0992109924554825 | Loss: 0.0128410345335540 | Epoch: 54 | MeanAbsoluteError: 0.1358755677938461 | Loss: 0.0227868555995979 | Epoch: 55 | MeanAbsoluteError: 0.0550244897603989 | Loss: 0.0053020078982962 | Epoch: 56 | MeanAbsoluteError: 0.0701755806803703 | Loss: 0.0083644113895532 | Epoch: 57 | 
MeanAbsoluteError: 0.0964456573128700 | Loss: 0.0116093424393942 | Epoch: 58 | MeanAbsoluteError: 0.0480468422174454 | Loss: 0.0038181198148155 | Epoch: 59 | MeanAbsoluteError: 0.0668087750673294 | Loss: 0.0071859530565378 | Epoch: 60 | MeanAbsoluteError: 0.0835436061024666 | Loss: 0.0106697172710770 | Epoch: 61 | MeanAbsoluteError: 0.1186840534210205 | Loss: 0.0187169622727915 | Epoch: 62 | MeanAbsoluteError: 0.0841273739933968 | Loss: 0.0095992177283685 | Epoch: 63 | MeanAbsoluteError: 0.0557111240923405 | Loss: 0.0053435582912674 | Epoch: 64 | MeanAbsoluteError: 0.0581847950816154 | Loss: 0.0053578350251835 | Epoch: 65 | MeanAbsoluteError: 0.0434498228132725 | Loss: 0.0038066453876366 | Epoch: 66 | MeanAbsoluteError: 0.0592362321913242 | Loss: 0.0059312882612606 | Epoch: 67 | MeanAbsoluteError: 0.0475554056465626 | Loss: 0.0040112486979189 | Epoch: 68 | MeanAbsoluteError: 0.0549491196870804 | Loss: 0.0049626870865100 | Epoch: 69 | MeanAbsoluteError: 0.0624069906771183 | Loss: 0.0064490971302516 | Epoch: 70 | MeanAbsoluteError: 0.0654543936252594 | Loss: 0.0070307957817261 | Epoch: 71 | MeanAbsoluteError: 0.0841888189315796 | Loss: 0.0099857678931010 | Epoch: 72 | MeanAbsoluteError: 0.0766839161515236 | Loss: 0.0078824735001514 | Epoch: 73 | MeanAbsoluteError: 0.0408749170601368 | Loss: 0.0031196298322787 | Epoch: 74 | MeanAbsoluteError: 0.1536621153354645 | Loss: 0.0281109871636880 | Epoch: 75 | MeanAbsoluteError: 0.0448874831199646 | Loss: 0.0034870667762956 | Epoch: 76 | 
MeanAbsoluteError: 0.1214192956686020 | Loss: 0.0194598604483824 | Epoch: 77 | MeanAbsoluteError: 0.0770390033721924 | Loss: 0.0098611828135817 | Epoch: 78 | MeanAbsoluteError: 0.0655292421579361 | Loss: 0.0070968524087220 | Epoch: 79 | MeanAbsoluteError: 0.0756077542901039 | Loss: 0.0079349000006914 | Epoch: 80 | MeanAbsoluteError: 0.0415216386318207 | Loss: 0.0036013023376367 | Epoch: 81 | MeanAbsoluteError: 0.0433793067932129 | Loss: 0.0030853404896334 | Epoch: 82 | MeanAbsoluteError: 0.0580634549260139 | Loss: 0.0054336845825769 | Epoch: 83 | MeanAbsoluteError: 0.0408902168273926 | Loss: 0.0035867990043602 | Epoch: 84 | MeanAbsoluteError: 0.0773444697260857 | Loss: 0.0077587201161996 | Epoch: 85 | MeanAbsoluteError: 0.0366274490952492 | Loss: 0.0025282101092958 | Epoch: 86 | MeanAbsoluteError: 0.0486696884036064 | Loss: 0.0038892257113108 | Epoch: 87 | MeanAbsoluteError: 0.0776556432247162 | Loss: 0.0081487329382645 | Epoch: 88 | MeanAbsoluteError: 0.1071514636278152 | Loss: 0.0150442207232118 | Epoch: 89 | MeanAbsoluteError: 0.0614426545798779 | Loss: 0.0054891978660108 | Epoch: 90 | MeanAbsoluteError: 0.0958704724907875 | Loss: 0.0114969077373022 | Epoch: 91 | MeanAbsoluteError: 0.0525704026222229 | Loss: 0.0048054831506880 | Epoch: 92 | MeanAbsoluteError: 0.0526353642344475 | Loss: 0.0052739049209968 | Epoch: 93 | MeanAbsoluteError: 0.0735762044787407 | Loss: 0.0080506139140772 | Epoch: 94 | MeanAbsoluteError: 0.0649461522698402 | Loss: 0.0062555000431051 | Epoch: 95 | 
MeanAbsoluteError: 0.0547547265887260 | Loss: 0.0060637741545705 | Epoch: 96 | MeanAbsoluteError: 0.0495599843561649 | Loss: 0.0043005423963462 | Epoch: 97 | MeanAbsoluteError: 0.1001492366194725 | Loss: 0.0130343995008029 | Epoch: 98 | MeanAbsoluteError: 0.0389581285417080 | Loss: 0.0031628963341446 | Epoch: 99 | MeanAbsoluteError: 0.0775342658162117 | Loss: 0.0078757694726320 | Epoch: 100 | MeanAbsoluteError: 0.1370126605033875 | Loss: 0.0211684288162934 | Epoch: 101 | MeanAbsoluteError: 0.0787058472633362 | Loss: 0.0080632047335568 | Epoch: 102 | MeanAbsoluteError: 0.0375889278948307 | Loss: 0.0026373792635767 | Epoch: 103 | MeanAbsoluteError: 0.0386525169014931 | Loss: 0.0026471663303183 | Epoch: 104 | MeanAbsoluteError: 0.0889057889580727 | Loss: 0.0110981739616316 | Epoch: 105 | MeanAbsoluteError: 0.0679711401462555 | Loss: 0.0066632607486099 | Epoch: 106 | MeanAbsoluteError: 0.0429219193756580 | Loss: 0.0032834253200379 | Epoch: 107 | MeanAbsoluteError: 0.0399616807699203 | Loss: 0.0030825592908322 | Epoch: 108 | MeanAbsoluteError: 0.0411434322595596 | Loss: 0.0031409862230679 | Epoch: 109 | MeanAbsoluteError: 0.0345973409712315 | Loss: 0.0024886004700276 | Epoch: 110 | MeanAbsoluteError: 0.0356200784444809 | Loss: 0.0033361114941439 | Epoch: 111 | MeanAbsoluteError: 0.0435455366969109 | Loss: 0.0036671812903430 | Epoch: 112 | MeanAbsoluteError: 0.0827836170792580 | Loss: 0.0091653914730016 | Epoch: 113 | MeanAbsoluteError: 0.0600406825542450 | Loss: 0.0054627322518316 | Epoch: 114 | 
MeanAbsoluteError: 0.0379344448447227 | Loss: 0.0024224833070644 | Epoch: 115 | MeanAbsoluteError: 0.0464811772108078 | Loss: 0.0032495645205735 | Epoch: 116 | MeanAbsoluteError: 0.1492297053337097 | Loss: 0.0258100237697363 | Epoch: 117 | MeanAbsoluteError: 0.0462909638881683 | Loss: 0.0039472583325972 | Epoch: 118 | MeanAbsoluteError: 0.0593616031110287 | Loss: 0.0054907137650604 | Epoch: 119 | MeanAbsoluteError: 0.0611927732825279 | Loss: 0.0052228855385788 | Epoch: 120 | MeanAbsoluteError: 0.0466319099068642 | Loss: 0.0040440762685122 | Epoch: 121 | MeanAbsoluteError: 0.0538025721907616 | Loss: 0.0046607357768440 | Epoch: 122 | MeanAbsoluteError: 0.0651224479079247 | Loss: 0.0079214318998550 | Epoch: 123 | MeanAbsoluteError: 0.0692432820796967 | Loss: 0.0074533063697776 | Epoch: 124 | MeanAbsoluteError: 0.0342543423175812 | Loss: 0.0028139158629959 | Epoch: 125 | MeanAbsoluteError: 0.0547838285565376 | Loss: 0.0047451935733031 | Epoch: 126 | MeanAbsoluteError: 0.0916428640484810 | Loss: 0.0104635946305567 | Epoch: 127 | MeanAbsoluteError: 0.0489927940070629 | Loss: 0.0036717201031646 | Epoch: 128 | MeanAbsoluteError: 0.0427102185785770 | Loss: 0.0034122966462746 | Epoch: 129 | MeanAbsoluteError: 0.0566479377448559 | Loss: 0.0049140211194754 | Epoch: 130 | MeanAbsoluteError: 0.0806854143738747 | Loss: 0.0082309502422025 | Epoch: 131 | MeanAbsoluteError: 0.0395285002887249 | Loss: 0.0031449005442770 | Epoch: 132 | MeanAbsoluteError: 0.1159842312335968 | Loss: 0.0164884126402046 | Epoch: 133 | 
MeanAbsoluteError: 0.0581236444413662 | Loss: 0.0051469206932540 | Epoch: 134 | MeanAbsoluteError: 0.0506997667253017 | Loss: 0.0038033735840336 | Epoch: 135 | MeanAbsoluteError: 0.0923685580492020 | Loss: 0.0110598180295998 | Epoch: 136 | MeanAbsoluteError: 0.0751065984368324 | Loss: 0.0079229342702188 | Epoch: 137 | MeanAbsoluteError: 0.0517393164336681 | Loss: 0.0043026967660377 | Epoch: 138 | MeanAbsoluteError: 0.0430673994123936 | Loss: 0.0031894303882789 | Epoch: 139 | MeanAbsoluteError: 0.0448055453598499 | Loss: 0.0040606760579210 | Epoch: 140 | MeanAbsoluteError: 0.0605678744614124 | Loss: 0.0057340503278139 | Epoch: 141 | MeanAbsoluteError: 0.0453690178692341 | Loss: 0.0038969229637204 | Epoch: 142 | MeanAbsoluteError: 0.1313636153936386 | Loss: 0.0203960923183905 | Epoch: 143 | MeanAbsoluteError: 0.0529601797461510 | Loss: 0.0050734013968490 | Epoch: 144 | MeanAbsoluteError: 0.0608514919877052 | Loss: 0.0061312688661641 | Epoch: 145 | MeanAbsoluteError: 0.0454288087785244 | Loss: 0.0034923521973389 | Epoch: 146 | MeanAbsoluteError: 0.0662707388401031 | Loss: 0.0069333128631115 | Early stopping at epoch 145
Returned to Spot: Validation loss: 0.006933312863111496
spotPython tuning: 0.0034164733277927887 [----------] 3.04% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.2531887747103636, 'lr_mult': 6.962589232333425, 'batch_size': 16, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.14320268359313437}

Epoch: 1 | MeanAbsoluteError: 0.1391334980726242 | Loss: 0.0296333604737332 | Epoch: 2 | MeanAbsoluteError: 0.1274575740098953 | Loss: 0.0251744011613099 | Epoch: 3 | MeanAbsoluteError: 0.1121383532881737 | Loss: 0.0202856746649272 | Epoch: 4 | MeanAbsoluteError: 0.1105916351079941 | Loss: 0.0188625324517488 | Epoch: 5 | MeanAbsoluteError: 0.1343192309141159 | Loss: 0.0269126887678316 | Epoch: 6 | MeanAbsoluteError: 0.1390496939420700 | Loss: 0.0278464810628640 | Epoch: 7 | MeanAbsoluteError: 0.1257724761962891 | Loss: 0.0241952971800377 | Epoch: 8 | MeanAbsoluteError: 0.1106164827942848 | Loss: 0.0190452912479247 | Epoch: 9 | MeanAbsoluteError: 0.1045458316802979 | Loss: 0.0173976162546559 | Epoch: 10 | MeanAbsoluteError: 0.0915747135877609 | Loss: 0.0136267659009287 | Epoch: 11 | MeanAbsoluteError: 0.1914142668247223 | Loss: 0.0467093436929740 | Epoch: 12 | MeanAbsoluteError: 0.0806389376521111 | Loss: 0.0104445281168936 | Epoch: 13 | MeanAbsoluteError: 0.1079781726002693 | Loss: 0.0161467895009800 | Epoch: 14 | MeanAbsoluteError: 0.0925234183669090 | Loss: 0.0134217694254690 | Epoch: 15 | MeanAbsoluteError: 0.1565232425928116 | Loss: 0.0324583407491446 | Epoch: 16 | MeanAbsoluteError: 0.1259127706289291 | Loss: 0.0206508855090330 | Epoch: 17 | MeanAbsoluteError: 0.0977258086204529 | Loss: 0.0132005894066472 | Epoch: 18 | MeanAbsoluteError: 0.1415141075849533 | Loss: 0.0249651794959056 | Epoch: 19 | 
MeanAbsoluteError: 0.1235619336366653 | Loss: 0.0191280111964596 | Epoch: 20 | MeanAbsoluteError: 0.0548617877066135 | Loss: 0.0051935157174931 | Epoch: 21 | MeanAbsoluteError: 0.1232595443725586 | Loss: 0.0210666753547756 | Epoch: 22 | MeanAbsoluteError: 0.0532153919339180 | Loss: 0.0048931522147828 | Epoch: 23 | MeanAbsoluteError: 0.1788431107997894 | Loss: 0.0367553345859051 | Epoch: 24 | MeanAbsoluteError: 0.0760362893342972 | Loss: 0.0091587252620804 | Epoch: 25 | MeanAbsoluteError: 0.0658567026257515 | Loss: 0.0063829095298915 | Epoch: 26 | MeanAbsoluteError: 0.1650717705488205 | Loss: 0.0313551924926670 | Epoch: 27 | MeanAbsoluteError: 0.1337165683507919 | Loss: 0.0218894532636592 | Epoch: 28 | MeanAbsoluteError: 0.0640091747045517 | Loss: 0.0068319902853354 | Epoch: 29 | MeanAbsoluteError: 0.0522392019629478 | Loss: 0.0049285419456857 | Epoch: 30 | MeanAbsoluteError: 0.0986679643392563 | Loss: 0.0153602226392219 | Epoch: 31 | MeanAbsoluteError: 0.0575586073100567 | Loss: 0.0060883681167309 | Epoch: 32 | MeanAbsoluteError: 0.0845373943448067 | Loss: 0.0089611178018937 | Epoch: 33 | MeanAbsoluteError: 0.0897918790578842 | Loss: 0.0114465356608363 | Epoch: 34 | MeanAbsoluteError: 0.0563053637742996 | Loss: 0.0052489041424307 | Epoch: 35 | MeanAbsoluteError: 0.0461170822381973 | Loss: 0.0035367509852605 | Epoch: 36 | MeanAbsoluteError: 0.1860184669494629 | Loss: 0.0399225379683469 | Epoch: 37 | MeanAbsoluteError: 0.0654532611370087 | Loss: 0.0063605495532484 | Epoch: 38 | 
MeanAbsoluteError: 0.0795864388346672 | Loss: 0.0087240720903011 | Epoch: 39 | MeanAbsoluteError: 0.1662562936544418 | Loss: 0.0319251791623078 | Epoch: 40 | MeanAbsoluteError: 0.1142207309603691 | Loss: 0.0162644956358954 | Epoch: 41 | MeanAbsoluteError: 0.0773128047585487 | Loss: 0.0083954802371169 | Epoch: 42 | MeanAbsoluteError: 0.0742489844560623 | Loss: 0.0081704140052591 | Epoch: 43 | MeanAbsoluteError: 0.0505507551133633 | Loss: 0.0044161496058989 | Epoch: 44 | MeanAbsoluteError: 0.0787674412131310 | Loss: 0.0092063776805605 | Epoch: 45 | MeanAbsoluteError: 0.0678746476769447 | Loss: 0.0074994506583990 | Epoch: 46 | MeanAbsoluteError: 0.1399971991777420 | Loss: 0.0234457442634984 | Epoch: 47 | MeanAbsoluteError: 0.0482800118625164 | Loss: 0.0038617280385408 | Epoch: 48 | MeanAbsoluteError: 0.0453852750360966 | Loss: 0.0038884897765360 | Epoch: 49 | MeanAbsoluteError: 0.0541916154325008 | Loss: 0.0043876944354882 | Epoch: 50 | MeanAbsoluteError: 0.1203496307134628 | Loss: 0.0178597484666266 | Epoch: 51 | MeanAbsoluteError: 0.0436299480497837 | Loss: 0.0035558808962569 | Epoch: 52 | MeanAbsoluteError: 0.0845181643962860 | Loss: 0.0093543170951307 | Epoch: 53 | MeanAbsoluteError: 0.0390516705811024 | Loss: 0.0030688613310064 | Epoch: 54 | MeanAbsoluteError: 0.0725411027669907 | Loss: 0.0080550136289706 | Epoch: 55 | MeanAbsoluteError: 0.0516392514109612 | Loss: 0.0049055052038870 | Epoch: 56 | MeanAbsoluteError: 0.0561637766659260 | Loss: 0.0049893579837915 | Epoch: 57 | 
MeanAbsoluteError: 0.0669238790869713 | Loss: 0.0067276725619051 | Epoch: 58 | MeanAbsoluteError: 0.0498436279594898 | Loss: 0.0039135038264488 | Epoch: 59 | MeanAbsoluteError: 0.0434470102190971 | Loss: 0.0033214670532432 | Epoch: 60 | MeanAbsoluteError: 0.0535210147500038 | Loss: 0.0046853552523412 | Epoch: 61 | MeanAbsoluteError: 0.0967421233654022 | Loss: 0.0128783878233088 | Epoch: 62 | MeanAbsoluteError: 0.0959044545888901 | Loss: 0.0126801562299462 | Epoch: 63 | MeanAbsoluteError: 0.0488598011434078 | Loss: 0.0037954392793931 | Epoch: 64 | MeanAbsoluteError: 0.0465746447443962 | Loss: 0.0032578131159473 | Epoch: 65 | MeanAbsoluteError: 0.0637439191341400 | Loss: 0.0057070947766892 | Epoch: 66 | MeanAbsoluteError: 0.1185294464230537 | Loss: 0.0165434329721488 | Epoch: 67 | MeanAbsoluteError: 0.0517249219119549 | Loss: 0.0048174692293335 | Epoch: 68 | MeanAbsoluteError: 0.0992250218987465 | Loss: 0.0123178705475048 | Epoch: 69 | MeanAbsoluteError: 0.0947728306055069 | Loss: 0.0108326666155144 | Epoch: 70 | MeanAbsoluteError: 0.1008453220129013 | Loss: 0.0146611940458809 | Epoch: 71 | MeanAbsoluteError: 0.1134563460946083 | Loss: 0.0155184501291890 | Epoch: 72 | MeanAbsoluteError: 0.0378904342651367 | Loss: 0.0028353945633985 | Epoch: 73 | MeanAbsoluteError: 0.0415401794016361 | Loss: 0.0032811773340463 | Epoch: 74 | MeanAbsoluteError: 0.0358376018702984 | Loss: 0.0025474017081586 | Epoch: 75 | MeanAbsoluteError: 0.1171335875988007 | Loss: 0.0174024737881202 | Epoch: 76 | 
MeanAbsoluteError: 0.0559115037322044 | Loss: 0.0048381219201378 | Epoch: 77 | MeanAbsoluteError: 0.0778397023677826 | Loss: 0.0098740486673226 | Epoch: 78 | MeanAbsoluteError: 0.0555096566677094 | Loss: 0.0046959523185107 | Epoch: 79 | MeanAbsoluteError: 0.0586736872792244 | Loss: 0.0057103602754834 | Epoch: 80 | MeanAbsoluteError: 0.0997687354683876 | Loss: 0.0124025932072025 | Epoch: 81 | MeanAbsoluteError: 0.0742066204547882 | Loss: 0.0069491902954484 | Epoch: 82 | MeanAbsoluteError: 0.0435835607349873 | Loss: 0.0037005807910311 | Epoch: 83 | MeanAbsoluteError: 0.0571439042687416 | Loss: 0.0048076338379791 | Epoch: 84 | MeanAbsoluteError: 0.0375167988240719 | Loss: 0.0023804890592337 | Epoch: 85 | MeanAbsoluteError: 0.0749946534633636 | Loss: 0.0072055003164630 | Epoch: 86 | MeanAbsoluteError: 0.0693852454423904 | Loss: 0.0064191794954240 | Epoch: 87 | MeanAbsoluteError: 0.0820542424917221 | Loss: 0.0100691691286078 | Epoch: 88 | MeanAbsoluteError: 0.0880842804908752 | Loss: 0.0101225782479895 | Epoch: 89 | MeanAbsoluteError: 0.0365717709064484 | Loss: 0.0025578318408837 | Epoch: 90 | MeanAbsoluteError: 0.0399183854460716 | Loss: 0.0026456907262879 | Epoch: 91 | MeanAbsoluteError: 0.0551774650812149 | Loss: 0.0047309553422230 | Epoch: 92 | MeanAbsoluteError: 0.0543159916996956 | Loss: 0.0043263396395272 | Epoch: 93 | MeanAbsoluteError: 0.0727672502398491 | Loss: 0.0079645015740473 | Epoch: 94 | MeanAbsoluteError: 0.0973675101995468 | Loss: 0.0116492003986710 | Epoch: 95 | 
MeanAbsoluteError: 0.0960338264703751 | Loss: 0.0117995376502605 | Epoch: 96 | MeanAbsoluteError: 0.1103913262486458 | Loss: 0.0142187796729176 | Epoch: 97 | MeanAbsoluteError: 0.0976741313934326 | Loss: 0.0117978132574966 | Epoch: 98 | MeanAbsoluteError: 0.0745194852352142 | Loss: 0.0074496820176903 | Epoch: 99 | MeanAbsoluteError: 0.0625941529870033 | Loss: 0.0058914467594341 | Epoch: 100 | MeanAbsoluteError: 0.0673898980021477 | Loss: 0.0057904768465577 | Epoch: 101 | MeanAbsoluteError: 0.0381320491433144 | Loss: 0.0027678388042228 | Epoch: 102 | MeanAbsoluteError: 0.1269130408763885 | Loss: 0.0200161490785448 | Epoch: 103 | MeanAbsoluteError: 0.0490759126842022 | Loss: 0.0040763180433331 | Epoch: 104 | MeanAbsoluteError: 0.0606099814176559 | Loss: 0.0051226022310163 | Epoch: 105 | MeanAbsoluteError: 0.0375387035310268 | Loss: 0.0025454271848215 | Epoch: 106 | MeanAbsoluteError: 0.0878970921039581 | Loss: 0.0097200347257680 | Epoch: 107 | MeanAbsoluteError: 0.0401246286928654 | Loss: 0.0031765061246819 | Epoch: 108 | MeanAbsoluteError: 0.0339195169508457 | Loss: 0.0021068652430059 | Epoch: 109 | MeanAbsoluteError: 0.0624162815511227 | Loss: 0.0053537919945819 | Epoch: 110 | MeanAbsoluteError: 0.0543188713490963 | Loss: 0.0047513879467978 | Epoch: 111 | MeanAbsoluteError: 0.0608414150774479 | Loss: 0.0059663221289061 | Epoch: 112 | MeanAbsoluteError: 0.0316233076155186 | Loss: 0.0019970156044062 | Epoch: 113 | MeanAbsoluteError: 0.1231174692511559 | Loss: 0.0184336909043946 | Epoch: 114 | 
MeanAbsoluteError: 0.0498438216745853 | Loss: 0.0038405193665408 | Epoch: 115 | MeanAbsoluteError: 0.0512661598622799 | Loss: 0.0042631453895745 | Epoch: 116 | MeanAbsoluteError: 0.0904723480343819 | Loss: 0.0099701934837197 | Epoch: 117 | MeanAbsoluteError: 0.0409925542771816 | Loss: 0.0028516374540662 | Epoch: 118 | MeanAbsoluteError: 0.0369148328900337 | Loss: 0.0022262935097770 | Epoch: 119 | MeanAbsoluteError: 0.0829040631651878 | Loss: 0.0094392752814058 | Epoch: 120 | MeanAbsoluteError: 0.0408052951097488 | Loss: 0.0032026610815113 | Epoch: 121 | MeanAbsoluteError: 0.0325195901095867 | Loss: 0.0019029511849543 | Epoch: 122 | MeanAbsoluteError: 0.0379860065877438 | Loss: 0.0023414133006315 | Epoch: 123 | MeanAbsoluteError: 0.0356730930507183 | Loss: 0.0021357047034575 | Epoch: 124 | MeanAbsoluteError: 0.0546065345406532 | Loss: 0.0043403749525743 | Epoch: 125 | MeanAbsoluteError: 0.0617876872420311 | Loss: 0.0052848684748537 | Epoch: 126 | MeanAbsoluteError: 0.0576840266585350 | Loss: 0.0049509213575603 | Epoch: 127 | MeanAbsoluteError: 0.0478023365139961 | Loss: 0.0038184864495538 | Epoch: 128 | MeanAbsoluteError: 0.0521348565816879 | Loss: 0.0050709683227500 | Epoch: 129 | MeanAbsoluteError: 0.0609993822872639 | Loss: 0.0048557421266052 | Epoch: 130 | MeanAbsoluteError: 0.0382921807467937 | Loss: 0.0024850972021293 | Epoch: 131 | MeanAbsoluteError: 0.0503752939403057 | Loss: 0.0038991612994945 | Epoch: 132 | MeanAbsoluteError: 0.0460587218403816 | Loss: 0.0033179569107137 | Epoch: 133 | 
MeanAbsoluteError: 0.0551920905709267 | Loss: 0.0046686525701692 | Epoch: 134 | MeanAbsoluteError: 0.0425338819622993 | Loss: 0.0036600833930271 | Epoch: 135 | MeanAbsoluteError: 0.0337785109877586 | Loss: 0.0021455463904299 | Epoch: 136 | MeanAbsoluteError: 0.0570876039564610 | Loss: 0.0056006681590684 | Epoch: 137 | MeanAbsoluteError: 0.0622717738151550 | Loss: 0.0057928127996427 | Epoch: 138 | MeanAbsoluteError: 0.0334199890494347 | Loss: 0.0021412055081639 | Epoch: 139 | MeanAbsoluteError: 0.0390509963035583 | Loss: 0.0028264695735599 | Epoch: 140 | MeanAbsoluteError: 0.0554943792521954 | Loss: 0.0044524101785531 | Epoch: 141 | MeanAbsoluteError: 0.1164600402116776 | Loss: 0.0181806020830807 | Epoch: 142 | MeanAbsoluteError: 0.0418856106698513 | Loss: 0.0036783694399913 | Epoch: 143 | MeanAbsoluteError: 0.0599193237721920 | Loss: 0.0059666497890200 | Epoch: 144 | MeanAbsoluteError: 0.0848188176751137 | Loss: 0.0088140294936142 | Epoch: 145 | MeanAbsoluteError: 0.0396732166409492 | Loss: 0.0026770939952449 | Epoch: 146 | MeanAbsoluteError: 0.0549743957817554 | Loss: 0.0043670412667684 | Epoch: 147 | MeanAbsoluteError: 0.1236782073974609 | Loss: 0.0186543450935891 | Epoch: 148 | MeanAbsoluteError: 0.0376981347799301 | Loss: 0.0030148885163822 | Epoch: 149 | MeanAbsoluteError: 0.0456475801765919 | Loss: 0.0036998846641693 | Epoch: 150 | MeanAbsoluteError: 0.0530539527535439 | Loss: 0.0048085262043107 | Epoch: 151 | MeanAbsoluteError: 0.0332804434001446 | Loss: 0.0020512752143029 | Epoch: 152 | 
MeanAbsoluteError: 0.0567427650094032 | Loss: 0.0055686604525698 | Epoch: 153 | MeanAbsoluteError: 0.0292326491326094 | Loss: 0.0017211528488827 | Epoch: 154 | MeanAbsoluteError: 0.0597246363759041 | Loss: 0.0054043882256864 | Epoch: 155 | MeanAbsoluteError: 0.0524163208901882 | Loss: 0.0064962523572735 | Epoch: 156 | MeanAbsoluteError: 0.0397980213165283 | Loss: 0.0027130197574335 | Epoch: 157 | MeanAbsoluteError: 0.0561083853244781 | Loss: 0.0045864583042107 | Epoch: 158 | MeanAbsoluteError: 0.0334235653281212 | Loss: 0.0025937741279210 | Epoch: 159 | MeanAbsoluteError: 0.0594947487115860 | Loss: 0.0052467535715550 | Epoch: 160 | MeanAbsoluteError: 0.0578557588160038 | Loss: 0.0053367779075511 | Epoch: 161 | MeanAbsoluteError: 0.0702856853604317 | Loss: 0.0076850004567716 | Epoch: 162 | MeanAbsoluteError: 0.0733630210161209 | Loss: 0.0072131292085702 | Epoch: 163 | MeanAbsoluteError: 0.0357454195618629 | Loss: 0.0023447970375664 | Epoch: 164 | MeanAbsoluteError: 0.0849552154541016 | Loss: 0.0088188557052299 | Epoch: 165 | MeanAbsoluteError: 0.0551446527242661 | Loss: 0.0045593592681383 | Epoch: 166 | MeanAbsoluteError: 0.0879076868295670 | Loss: 0.0097776827108311 | Epoch: 167 | MeanAbsoluteError: 0.0552980154752731 | Loss: 0.0043056448799019 | Epoch: 168 | MeanAbsoluteError: 0.0485858321189880 | Loss: 0.0041929964821688 | Epoch: 169 | MeanAbsoluteError: 0.0522498227655888 | Loss: 0.0043125534920316 | Epoch: 170 | MeanAbsoluteError: 0.0346432738006115 | Loss: 0.0023458197798678 | Epoch: 171 | 
MeanAbsoluteError: 0.0324419997632504 | Loss: 0.0022122709380806 | Epoch: 172 | MeanAbsoluteError: 0.0785063430666924 | Loss: 0.0091901560510068 | Epoch: 173 | MeanAbsoluteError: 0.0369299277663231 | Loss: 0.0023730514558816 | Epoch: 174 | MeanAbsoluteError: 0.0386619195342064 | Loss: 0.0025903198402375 | Epoch: 175 | MeanAbsoluteError: 0.0468814037740231 | Loss: 0.0031072765735811 | Epoch: 176 | MeanAbsoluteError: 0.0791656747460365 | Loss: 0.0084681557736507 | Epoch: 177 | MeanAbsoluteError: 0.0315167531371117 | Loss: 0.0023665595707778 | Epoch: 178 | MeanAbsoluteError: 0.0953931584954262 | Loss: 0.0114869907449343 | Epoch: 179 | MeanAbsoluteError: 0.0784628391265869 | Loss: 0.0088923212974087 | Epoch: 180 | MeanAbsoluteError: 0.0660447180271149 | Loss: 0.0062858013583249 | Epoch: 181 | MeanAbsoluteError: 0.0421870835125446 | Loss: 0.0028933628621560 | Epoch: 182 | MeanAbsoluteError: 0.0896819457411766 | Loss: 0.0097041044531292 | Epoch: 183 | MeanAbsoluteError: 0.0758897513151169 | Loss: 0.0070284544980448 | Epoch: 184 | MeanAbsoluteError: 0.0685416013002396 | Loss: 0.0066197172150408 | Epoch: 185 | MeanAbsoluteError: 0.0415989570319653 | Loss: 0.0027803774972103 | Early stopping at epoch 184
Returned to Spot: Validation loss: 0.0027803774972103143
spotPython tuning: 0.0027803774972103143 [#---------] 6.85% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.19252161407909985, 'lr_mult': 6.900132830198289, 'batch_size': 8, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.7824081882248493}
Epoch: 1 | MeanAbsoluteError: 0.1252362132072449 | Loss: 0.0257683556379848 | Epoch: 2 | MeanAbsoluteError: 0.1311414539813995 | Loss: 0.0264041994110142 | Epoch: 3 | MeanAbsoluteError: 0.1215800717473030 | Loss: 0.0222822892185497 | Epoch: 4 | MeanAbsoluteError: 0.0942129492759705 | Loss: 0.0147930680847678 | Epoch: 5 | MeanAbsoluteError: 0.1256962269544601 | Loss: 0.0226909497532209 | Epoch: 6 | MeanAbsoluteError: 0.0997139587998390 | Loss: 0.0158799214741999 | Epoch: 7 | MeanAbsoluteError: 0.0859117135405540 | Loss: 0.0120204957202077 | Epoch: 8 | MeanAbsoluteError: 0.0842403322458267 | Loss: 0.0113149954183762 | Epoch: 9 | MeanAbsoluteError: 0.1537954062223434 | Loss: 0.0294443875502207 | Epoch: 10 | MeanAbsoluteError: 0.0618632696568966 | Loss: 0.0065342749753893 | Epoch: 11 | 
MeanAbsoluteError: 0.0829161778092384 | Loss: 0.0107154192611281 | Epoch: 12 | MeanAbsoluteError: 0.1802139729261398 | Loss: 0.0407082134563672 | Epoch: 13 | MeanAbsoluteError: 0.1077672466635704 | Loss: 0.0173535000802459 | Epoch: 14 | MeanAbsoluteError: 0.0927738547325134 | Loss: 0.0122998890981666 | Epoch: 15 | MeanAbsoluteError: 0.0671817883849144 | Loss: 0.0071060921212560 | Epoch: 16 | MeanAbsoluteError: 0.0750523433089256 | Loss: 0.0085235066178843 | Epoch: 17 | MeanAbsoluteError: 0.1027007475495338 | Loss: 0.0159142021469674 | Epoch: 18 | MeanAbsoluteError: 0.0742226094007492 | Loss: 0.0087337392308798 | Epoch: 19 | MeanAbsoluteError: 0.0882656201720238 | Loss: 0.0117637014972340 | Epoch: 20 | MeanAbsoluteError: 0.0761914476752281 | Loss: 0.0092436747539690 | Epoch: 21 | MeanAbsoluteError: 0.0495065636932850 | Loss: 0.0044340145847711 | Epoch: 22 | 
MeanAbsoluteError: 0.0722033232450485 | Loss: 0.0092549149167577 | Epoch: 23 | MeanAbsoluteError: 0.0709216892719269 | Loss: 0.0079769967062595 | Epoch: 24 | MeanAbsoluteError: 0.1227476894855499 | Loss: 0.0173413604742994 | Epoch: 25 | MeanAbsoluteError: 0.0898978561162949 | Loss: 0.0112576435050486 | Epoch: 26 | MeanAbsoluteError: 0.1286485195159912 | Loss: 0.0187796061662467 | Epoch: 27 | MeanAbsoluteError: 0.0886171385645866 | Loss: 0.0101173424137462 | Epoch: 28 | MeanAbsoluteError: 0.0436669103801250 | Loss: 0.0036943124968706 | Epoch: 29 | MeanAbsoluteError: 0.0845272690057755 | Loss: 0.0100546318817099 | Epoch: 30 | MeanAbsoluteError: 0.0782097652554512 | Loss: 0.0094252495634321 | Epoch: 31 | MeanAbsoluteError: 0.0539182350039482 | Loss: 0.0045765465750408 | Epoch: 32 | MeanAbsoluteError: 0.0458899252116680 | Loss: 0.0038739677494098 | Epoch: 33 | 
MeanAbsoluteError: 0.0640013590455055 | Loss: 0.0055229550987286 | Epoch: 34 | MeanAbsoluteError: 0.0593590475618839 | Loss: 0.0076206257692416 | Epoch: 35 | MeanAbsoluteError: 0.0462500788271427 | Loss: 0.0040852318511737 | Epoch: 36 | MeanAbsoluteError: 0.0551264397799969 | Loss: 0.0050925920337537 | Epoch: 37 | MeanAbsoluteError: 0.0714388862252235 | Loss: 0.0085854978656004 | Epoch: 38 | MeanAbsoluteError: 0.0846157893538475 | Loss: 0.0100345109638415 | Epoch: 39 | MeanAbsoluteError: 0.0461929738521576 | Loss: 0.0042682315535402 | Epoch: 40 | MeanAbsoluteError: 0.0998257845640182 | Loss: 0.0128844659898038 | Epoch: 41 | MeanAbsoluteError: 0.0799952521920204 | Loss: 0.0085238685684377 | Epoch: 42 | MeanAbsoluteError: 0.0708113908767700 | Loss: 0.0073396672715286 | Epoch: 43 | MeanAbsoluteError: 0.0861292928457260 | Loss: 0.0090447440620904 | Epoch: 44 | 
MeanAbsoluteError: 0.0756579563021660 | Loss: 0.0075454146870853 | Epoch: 45 | MeanAbsoluteError: 0.0853466689586639 | Loss: 0.0109945911926364 | Epoch: 46 | MeanAbsoluteError: 0.0659419000148773 | Loss: 0.0070562694944735 | Epoch: 47 | MeanAbsoluteError: 0.1110501736402512 | Loss: 0.0150042798639716 | Epoch: 48 | MeanAbsoluteError: 0.0415618941187859 | Loss: 0.0027575703524666 | Epoch: 49 | MeanAbsoluteError: 0.0886094570159912 | Loss: 0.0113259971166324 | Epoch: 50 | MeanAbsoluteError: 0.0776339098811150 | Loss: 0.0077041676941965 | Epoch: 51 | MeanAbsoluteError: 0.0809543579816818 | Loss: 0.0092142132221182 | Epoch: 52 | MeanAbsoluteError: 0.0571504794061184 | Loss: 0.0054468759871701 | Epoch: 53 | MeanAbsoluteError: 0.0475473888218403 | Loss: 0.0042845260315134 | Epoch: 54 | MeanAbsoluteError: 0.0986951440572739 | Loss: 0.0117552876472473 | Epoch: 55 | 
MeanAbsoluteError: 0.0458579398691654 | Loss: 0.0036586858102390 | Epoch: 56 | MeanAbsoluteError: 0.0570737831294537 | Loss: 0.0047920722036475 | Epoch: 57 | MeanAbsoluteError: 0.0480967462062836 | Loss: 0.0042029324475535 | Epoch: 58 | MeanAbsoluteError: 0.0555819571018219 | Loss: 0.0049388845769787 | Epoch: 59 | MeanAbsoluteError: 0.0480007641017437 | Loss: 0.0037294515733313 | Epoch: 60 | MeanAbsoluteError: 0.0989639535546303 | Loss: 0.0120268981462639 | Epoch: 61 | MeanAbsoluteError: 0.0517031960189342 | Loss: 0.0042474844039565 | Epoch: 62 | MeanAbsoluteError: 0.0459947921335697 | Loss: 0.0037826234643274 | Epoch: 63 | MeanAbsoluteError: 0.0370293520390987 | Loss: 0.0030972951399714 | Epoch: 64 | MeanAbsoluteError: 0.0620019845664501 | Loss: 0.0064136265397170 | Epoch: 65 | MeanAbsoluteError: 0.0374571904540062 | Loss: 0.0027507140039233 | Epoch: 66 | 
MeanAbsoluteError: 0.0655027106404305 | Loss: 0.0055850410993260 | Epoch: 67 | MeanAbsoluteError: 0.0368831492960453 | Loss: 0.0029720855450968 | Epoch: 68 | MeanAbsoluteError: 0.0565893761813641 | Loss: 0.0048454649268502 | Epoch: 69 | MeanAbsoluteError: 0.0473910234868526 | Loss: 0.0036773033758723 | Epoch: 70 | MeanAbsoluteError: 0.0510105006396770 | Loss: 0.0047450551248499 | Epoch: 71 | MeanAbsoluteError: 0.0402920804917812 | Loss: 0.0028097308761636 | Epoch: 72 | MeanAbsoluteError: 0.0475596040487289 | Loss: 0.0036200252882401 | Epoch: 73 | MeanAbsoluteError: 0.1020177453756332 | Loss: 0.0120309763955639 | Epoch: 74 | MeanAbsoluteError: 0.0550942607223988 | Loss: 0.0051108141993418 | Epoch: 75 | MeanAbsoluteError: 0.0555067695677280 | Loss: 0.0040889265701959 | Epoch: 76 | MeanAbsoluteError: 0.0395360700786114 | Loss: 0.0030261684426621 | Epoch: 77 | 
MeanAbsoluteError: 0.0378043241798878 | Loss: 0.0022900106000873 | Epoch: 78 | MeanAbsoluteError: 0.0333363860845566 | Loss: 0.0021703458187403 | Epoch: 79 | MeanAbsoluteError: 0.0369822867214680 | Loss: 0.0022228230449592 | Epoch: 80 | MeanAbsoluteError: 0.0343585461378098 | Loss: 0.0033981491620867 | Epoch: 81 | MeanAbsoluteError: 0.0340819917619228 | Loss: 0.0026916440884203 | Epoch: 82 | MeanAbsoluteError: 0.0989473089575768 | Loss: 0.0117482368368655 | Epoch: 83 | MeanAbsoluteError: 0.0397992022335529 | Loss: 0.0025427994857493 | Epoch: 84 | MeanAbsoluteError: 0.0451517142355442 | Loss: 0.0031974539222000 | Epoch: 85 | MeanAbsoluteError: 0.0624049752950668 | Loss: 0.0053629382991379 | Epoch: 86 | MeanAbsoluteError: 0.0362343229353428 | Loss: 0.0020099734323785 | Epoch: 87 | MeanAbsoluteError: 0.0368412956595421 | Loss: 0.0025889716497132 | Epoch: 88 | 
MeanAbsoluteError: 0.0588162615895271 | Loss: 0.0053378740926028 | Epoch: 89 | MeanAbsoluteError: 0.0541478917002678 | Loss: 0.0044565241428484 | Epoch: 90 | MeanAbsoluteError: 0.0555230528116226 | Loss: 0.0041531851380377 | Epoch: 91 | MeanAbsoluteError: 0.0537891015410423 | Loss: 0.0038448726960556 | Epoch: 92 | MeanAbsoluteError: 0.0409336276352406 | Loss: 0.0031360403702006 | Epoch: 93 | MeanAbsoluteError: 0.0432261638343334 | Loss: 0.0030489766228895 | Epoch: 94 | MeanAbsoluteError: 0.0469322092831135 | Loss: 0.0042681932628559 | Epoch: 95 | MeanAbsoluteError: 0.0581782162189484 | Loss: 0.0053427438496759 | Epoch: 96 | MeanAbsoluteError: 0.0424027033150196 | Loss: 0.0027845477268688 | Epoch: 97 | MeanAbsoluteError: 0.0565806627273560 | Loss: 0.0048264228267056 | Epoch: 98 | MeanAbsoluteError: 0.0514558330178261 | Loss: 0.0042128674716591 | Epoch: 99 | 
MeanAbsoluteError: 0.0388750843703747 | Loss: 0.0029476218310025 | Epoch: 100 | MeanAbsoluteError: 0.0851459354162216 | Loss: 0.0089441553726302 | Epoch: 101 | MeanAbsoluteError: 0.0322649478912354 | Loss: 0.0020048727984479 | Epoch: 102 | MeanAbsoluteError: 0.0314880982041359 | Loss: 0.0020761244048021 | Epoch: 103 | MeanAbsoluteError: 0.0391213782131672 | Loss: 0.0027025071574730 | Epoch: 104 | MeanAbsoluteError: 0.0419422723352909 | Loss: 0.0034833597517143 | Epoch: 105 | MeanAbsoluteError: 0.0729304850101471 | Loss: 0.0067012205683185 | Epoch: 106 | MeanAbsoluteError: 0.0935977101325989 | Loss: 0.0115706791709128 | Epoch: 107 | MeanAbsoluteError: 0.0539500936865807 | Loss: 0.0045964367975677 | Epoch: 108 | MeanAbsoluteError: 0.0831520333886147 | Loss: 0.0081773259015264 | Epoch: 109 | MeanAbsoluteError: 0.0422595366835594 | Loss: 0.0028913460455921 | Epoch: 110 | 
MeanAbsoluteError: 0.0567801930010319 | Loss: 0.0043315036822797 | Epoch: 111 | MeanAbsoluteError: 0.0897048339247704 | Loss: 0.0100475169448672 | Epoch: 112 | MeanAbsoluteError: 0.0335636474192142 | Loss: 0.0019493300404927 | Epoch: 113 | MeanAbsoluteError: 0.0307611934840679 | Loss: 0.0020062172391734 | Epoch: 114 | MeanAbsoluteError: 0.0410225912928581 | Loss: 0.0029530349711422 | Epoch: 115 | MeanAbsoluteError: 0.0545160286128521 | Loss: 0.0050014908499035 | Epoch: 116 | MeanAbsoluteError: 0.0659000799059868 | Loss: 0.0064022122134798 | Epoch: 117 | MeanAbsoluteError: 0.0434620752930641 | Loss: 0.0034102218816866 | Epoch: 118 | MeanAbsoluteError: 0.0373487807810307 | Loss: 0.0026816639438039 | Epoch: 119 | MeanAbsoluteError: 0.0471990332007408 | Loss: 0.0038322266329104 | Epoch: 120 | MeanAbsoluteError: 0.0492083281278610 | Loss: 0.0038410394305461 | Epoch: 121 | 
MeanAbsoluteError: 0.0842974185943604 | Loss: 0.0089502438571990 | Epoch: 122 | MeanAbsoluteError: 0.0416778661310673 | Loss: 0.0029258135749076 | Epoch: 123 | MeanAbsoluteError: 0.0516832880675793 | Loss: 0.0040288367997977 | Epoch: 124 | MeanAbsoluteError: 0.0584416016936302 | Loss: 0.0048632609970426 | Epoch: 125 | MeanAbsoluteError: 0.0716505050659180 | Loss: 0.0075898155245293 | Epoch: 126 | MeanAbsoluteError: 0.0510531775653362 | Loss: 0.0050380847525575 | Epoch: 127 | MeanAbsoluteError: 0.0627448558807373 | Loss: 0.0050690754157442 | Epoch: 128 | MeanAbsoluteError: 0.0715789794921875 | Loss: 0.0066034764321031 | Epoch: 129 | MeanAbsoluteError: 0.0349017977714539 | Loss: 0.0021500286621679 | Epoch: 130 | MeanAbsoluteError: 0.0457443334162235 | Loss: 0.0037468630930801 | Epoch: 131 | MeanAbsoluteError: 0.0500236749649048 | Loss: 0.0036950420012305 | Epoch: 132 | 
MeanAbsoluteError: 0.0361831076443195 | Loss: 0.0024907548385703 | Epoch: 133 | MeanAbsoluteError: 0.0381030030548573 | Loss: 0.0025478281191011 | Epoch: 134 | MeanAbsoluteError: 0.0485121458768845 | Loss: 0.0036892189803582 | Epoch: 135 | MeanAbsoluteError: 0.0305006150156260 | Loss: 0.0022983876088371 | Epoch: 136 | MeanAbsoluteError: 0.0736540704965591 | Loss: 0.0080229231695596 | Epoch: 137 | MeanAbsoluteError: 0.0474169403314590 | Loss: 0.0037836742841663 | Epoch: 138 | MeanAbsoluteError: 0.0301682036370039 | Loss: 0.0017911881571452 | Epoch: 139 | MeanAbsoluteError: 0.0726350396871567 | Loss: 0.0067568338647681 | Epoch: 140 | MeanAbsoluteError: 0.0548581071197987 | Loss: 0.0041294175837385 | Epoch: 141 | MeanAbsoluteError: 0.0625423267483711 | Loss: 0.0050704501275169 | Epoch: 142 | MeanAbsoluteError: 0.0559906847774982 | Loss: 0.0042668568754667 | Epoch: 143 | 
MeanAbsoluteError: 0.0695746839046478 | Loss: 0.0068806037582506 | Epoch: 144 | MeanAbsoluteError: 0.0388698130846024 | Loss: 0.0030566715194206 | Epoch: 145 | MeanAbsoluteError: 0.0561318509280682 | Loss: 0.0045041699287188 | Epoch: 146 | MeanAbsoluteError: 0.0432456284761429 | Loss: 0.0031765756001206 | Epoch: 147 | MeanAbsoluteError: 0.0525000728666782 | Loss: 0.0045646088700251 | Epoch: 148 | MeanAbsoluteError: 0.0340506136417389 | Loss: 0.0023533580028207 | Epoch: 149 | MeanAbsoluteError: 0.0514568537473679 | Loss: 0.0037988436340943 | Epoch: 150 | MeanAbsoluteError: 0.0274332277476788 | Loss: 0.0018312964131933 | Epoch: 151 | MeanAbsoluteError: 0.0452364534139633 | Loss: 0.0029361240204277 | Epoch: 152 | MeanAbsoluteError: 0.0445401966571808 | Loss: 0.0033829524687271 | Epoch: 153 | MeanAbsoluteError: 0.0372360385954380 | Loss: 0.0024504337818239 | Epoch: 154 | 
MeanAbsoluteError: 0.0670197308063507 | Loss: 0.0057220150422501 | Epoch: 155 | MeanAbsoluteError: 0.0585596896708012 | Loss: 0.0048988440172061 | Epoch: 156 | MeanAbsoluteError: 0.0637474060058594 | Loss: 0.0057809955599767 | Epoch: 157 | MeanAbsoluteError: 0.0398226641118526 | Loss: 0.0029599201409024 | Epoch: 158 | MeanAbsoluteError: 0.0873046666383743 | Loss: 0.0101745166619749 | Epoch: 159 | MeanAbsoluteError: 0.0441516339778900 | Loss: 0.0029826616090232 | Epoch: 160 | MeanAbsoluteError: 0.0364482291042805 | Loss: 0.0028480480755924 | Epoch: 161 | MeanAbsoluteError: 0.0322977602481842 | Loss: 0.0024568136095216 | Epoch: 162 | MeanAbsoluteError: 0.0324559584259987 | Loss: 0.0019782746500201 | Epoch: 163 | MeanAbsoluteError: 0.0326359942555428 | Loss: 0.0025998702752220 | Epoch: 164 | MeanAbsoluteError: 0.0369891040027142 | Loss: 0.0029933279116736 | Epoch: 165 | 
MeanAbsoluteError: 0.0613240748643875 | Loss: 0.0059400733995349 | Epoch: 166 | MeanAbsoluteError: 0.0319739133119583 | Loss: 0.0021170712701094 | Epoch: 167 | MeanAbsoluteError: 0.0339622460305691 | Loss: 0.0027668099930069 | Epoch: 168 | MeanAbsoluteError: 0.0683422908186913 | Loss: 0.0061573064824762 | Epoch: 169 | MeanAbsoluteError: 0.0467341765761375 | Loss: 0.0033255578125950 | Epoch: 170 | MeanAbsoluteError: 0.0576527155935764 | Loss: 0.0050642099813558 | Early stopping at epoch 169
Returned to Spot: Validation loss: 0.005064209981355816
spotPython tuning: 0.0027803774972103143 [#---------] 12.81% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.39771031684416464, 'lr_mult': 7.04509024126456, 'batch_size': 16, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.0}
Epoch: 1 | MeanAbsoluteError: 0.2543983161449432 | Loss: 0.0913004398738083 | Epoch: 2 | MeanAbsoluteError: 0.2471912354230881 | Loss: 0.0848151057174331 | Epoch: 3 | MeanAbsoluteError: 0.2059574127197266 | Loss: 0.0611926183888787 | Epoch: 4 | MeanAbsoluteError: 0.1613949537277222 | Loss: 0.0404168342877375 | Epoch: 5 | MeanAbsoluteError: 0.1712362170219421 | Loss: 0.0431507704289336 | Epoch: 6 | MeanAbsoluteError: 0.1720687299966812 | Loss: 0.0438032494367738 | Epoch: 7 | MeanAbsoluteError: 0.1667802482843399 | Loss: 0.0410167975841384 | Epoch: 8 | MeanAbsoluteError: 0.1572707444429398 | Loss: 0.0369025030614514 | Epoch: 9 | MeanAbsoluteError: 0.1692318320274353 | Loss: 0.0433367210391321 | Epoch: 10 | MeanAbsoluteError: 0.1543078720569611 | Loss: 0.0360594599654800 | Epoch: 11 | MeanAbsoluteError: 0.1253196746110916 | Loss: 0.0247579608112574 | Epoch: 12 | MeanAbsoluteError: 0.1354203671216965 | Loss: 0.0281942780374696 | Epoch: 13 | MeanAbsoluteError: 0.1687933653593063 | Loss: 0.0416606636227746 | Epoch: 14 | MeanAbsoluteError: 0.1561819016933441 | Loss: 0.0362619098864104 | Epoch: 15 | MeanAbsoluteError: 0.1372428387403488 | Loss: 0.0282482009283022 | Epoch: 16 | MeanAbsoluteError: 0.1588287204504013 | Loss: 0.0368352619637000 | Epoch: 17 | MeanAbsoluteError: 0.1154667884111404 | Loss: 0.0205303479084059 | Epoch: 18 | MeanAbsoluteError: 0.1231055036187172 | Loss: 0.0233217523384251 | Epoch: 19 | 
MeanAbsoluteError: 0.1532057672739029 | Loss: 0.0339822764263341 | Epoch: 20 | MeanAbsoluteError: 0.1342072486877441 | Loss: 0.0271727398135944 | Epoch: 21 | MeanAbsoluteError: 0.1189441308379173 | Loss: 0.0219795744572031 | Epoch: 22 | MeanAbsoluteError: 0.1439491063356400 | Loss: 0.0299056396378498 | Epoch: 23 | MeanAbsoluteError: 0.1549630314111710 | Loss: 0.0341802165402394 | Epoch: 24 | MeanAbsoluteError: 0.1243725344538689 | Loss: 0.0234457395088516 | Epoch: 25 | MeanAbsoluteError: 0.1652579009532928 | Loss: 0.0380750716124710 | Epoch: 26 | MeanAbsoluteError: 0.1158493682742119 | Loss: 0.0198462121188641 | Epoch: 27 | MeanAbsoluteError: 0.1055632457137108 | Loss: 0.0166648022438350 | Epoch: 28 | MeanAbsoluteError: 0.1373340040445328 | Loss: 0.0273087873172603 | Epoch: 29 | MeanAbsoluteError: 0.1401849836111069 | Loss: 0.0280619319528341 | Epoch: 30 | MeanAbsoluteError: 0.1026846170425415 | Loss: 0.0164400165116316 | Epoch: 31 | MeanAbsoluteError: 0.0867193862795830 | Loss: 0.0123312330412629 | Epoch: 32 | MeanAbsoluteError: 0.1356033235788345 | Loss: 0.0252738109250602 | Epoch: 33 | MeanAbsoluteError: 0.1108344644308090 | Loss: 0.0187004409289282 | Epoch: 34 | MeanAbsoluteError: 0.0951570793986320 | Loss: 0.0139195223485953 | Epoch: 35 | MeanAbsoluteError: 0.1393079757690430 | Loss: 0.0286157805178511 | Epoch: 36 | MeanAbsoluteError: 0.1078894585371017 | Loss: 0.0173441685834213 | Epoch: 37 | MeanAbsoluteError: 0.0982444286346436 | Loss: 0.0154061675267784 | Epoch: 38 | 
MeanAbsoluteError: 0.1642353683710098 | Loss: 0.0357355758743851 | Epoch: 39 | MeanAbsoluteError: 0.1064278185367584 | Loss: 0.0168273935682679 | Epoch: 40 | MeanAbsoluteError: 0.1788747161626816 | Loss: 0.0415554017220673 | Epoch: 41 | MeanAbsoluteError: 0.1358545422554016 | Loss: 0.0255309885465785 | Epoch: 42 | MeanAbsoluteError: 0.1201207339763641 | Loss: 0.0197356188865869 | Epoch: 43 | MeanAbsoluteError: 0.1061778366565704 | Loss: 0.0162773927869765 | Epoch: 44 | MeanAbsoluteError: 0.1429216116666794 | Loss: 0.0266111051957858 | Epoch: 45 | MeanAbsoluteError: 0.0908187925815582 | Loss: 0.0125078112622233 | Epoch: 46 | MeanAbsoluteError: 0.1383493542671204 | Loss: 0.0242138831925235 | Epoch: 47 | MeanAbsoluteError: 0.0697177574038506 | Loss: 0.0084977730324394 | Epoch: 48 | MeanAbsoluteError: 0.1405729949474335 | Loss: 0.0249080206512621 | Epoch: 49 | MeanAbsoluteError: 0.0691194906830788 | Loss: 0.0087862177384331 | Epoch: 50 | MeanAbsoluteError: 0.1129437983036041 | Loss: 0.0189128035777494 | Epoch: 51 | MeanAbsoluteError: 0.0981867611408234 | Loss: 0.0148973613977432 | Epoch: 52 | MeanAbsoluteError: 0.0837436839938164 | Loss: 0.0115417079313805 | Epoch: 53 | MeanAbsoluteError: 0.0648616775870323 | Loss: 0.0070041480449666 | Epoch: 54 | MeanAbsoluteError: 0.1710279136896133 | Loss: 0.0366671654934946 | Epoch: 55 | MeanAbsoluteError: 0.1285041123628616 | Loss: 0.0209632937453295 | Epoch: 56 | MeanAbsoluteError: 0.0621614977717400 | Loss: 0.0080980996809606 | Epoch: 57 | 
MeanAbsoluteError: 0.1364984065294266 | Loss: 0.0238010046611491 | Epoch: 58 | MeanAbsoluteError: 0.0660748109221458 | Loss: 0.0082185440084064 | Epoch: 59 | MeanAbsoluteError: 0.0579964816570282 | Loss: 0.0063099866904514 | Epoch: 60 | MeanAbsoluteError: 0.1247534677386284 | Loss: 0.0215339162632039 | Epoch: 61 | MeanAbsoluteError: 0.0760682374238968 | Loss: 0.0090299626983898 | Epoch: 62 | MeanAbsoluteError: 0.1043938472867012 | Loss: 0.0151302364017618 | Epoch: 63 | MeanAbsoluteError: 0.0794092267751694 | Loss: 0.0110235558945293 | Epoch: 64 | MeanAbsoluteError: 0.0607804507017136 | Loss: 0.0068854064876704 | Epoch: 65 | MeanAbsoluteError: 0.0699247494339943 | Loss: 0.0078628309879844 | Epoch: 66 | MeanAbsoluteError: 0.0692233070731163 | Loss: 0.0083529654351112 | Epoch: 67 | MeanAbsoluteError: 0.0894894376397133 | Loss: 0.0136950417715860 | Epoch: 68 | MeanAbsoluteError: 0.0630930736660957 | Loss: 0.0069295547559465 | Epoch: 69 | MeanAbsoluteError: 0.0802200958132744 | Loss: 0.0097464749246444 | Epoch: 70 | MeanAbsoluteError: 0.0640942156314850 | Loss: 0.0069661542136026 | Epoch: 71 | MeanAbsoluteError: 0.0561666749417782 | Loss: 0.0061622080454407 | Epoch: 72 | MeanAbsoluteError: 0.0582254901528358 | Loss: 0.0052711472135821 | Epoch: 73 | MeanAbsoluteError: 0.1119331195950508 | Loss: 0.0170927035475248 | Epoch: 74 | MeanAbsoluteError: 0.0637694150209427 | Loss: 0.0068976190431338 | Epoch: 75 | MeanAbsoluteError: 0.0610853135585785 | Loss: 0.0061862886466674 | Epoch: 76 | 
MeanAbsoluteError: 0.0920107886195183 | Loss: 0.0121174834570602 | Epoch: 77 | MeanAbsoluteError: 0.2010395377874374 | Loss: 0.0484107019085633 | Epoch: 78 | MeanAbsoluteError: 0.0499165877699852 | Loss: 0.0050666257555253 | Epoch: 79 | MeanAbsoluteError: 0.0572282411158085 | Loss: 0.0057780033614683 | Epoch: 80 | MeanAbsoluteError: 0.0986733213067055 | Loss: 0.0134309550110055 | Epoch: 81 | MeanAbsoluteError: 0.0773694291710854 | Loss: 0.0090471728043141 | Epoch: 82 | MeanAbsoluteError: 0.1081673949956894 | Loss: 0.0161441088605084 | Epoch: 83 | MeanAbsoluteError: 0.0762100666761398 | Loss: 0.0094329166030021 | Epoch: 84 | MeanAbsoluteError: 0.0715212970972061 | Loss: 0.0087182720338828 | Epoch: 85 | MeanAbsoluteError: 0.0541167780756950 | Loss: 0.0053291739283228 | Epoch: 86 | MeanAbsoluteError: 0.0628202632069588 | Loss: 0.0067628618378780 | Epoch: 87 | MeanAbsoluteError: 0.0620918609201908 | Loss: 0.0066863500856255 | Epoch: 88 | MeanAbsoluteError: 0.1506672203540802 | Loss: 0.0281747657021410 | Epoch: 89 | MeanAbsoluteError: 0.0757741928100586 | Loss: 0.0094543628541655 | Epoch: 90 | MeanAbsoluteError: 0.1295413672924042 | Loss: 0.0205450814315363 | Epoch: 91 | MeanAbsoluteError: 0.1378149986267090 | Loss: 0.0233732967784530 | Epoch: 92 | MeanAbsoluteError: 0.0864528790116310 | Loss: 0.0110686357182107 | Epoch: 93 | MeanAbsoluteError: 0.0680500194430351 | Loss: 0.0075829587019000 | Epoch: 94 | 
MeanAbsoluteError: 0.1018155366182327 | Loss: 0.0147872168178621 | Epoch: 95 | MeanAbsoluteError: 0.0632536560297012 | Loss: 0.0071631467925679 | Epoch: 96 | MeanAbsoluteError: 0.0598153546452522 | Loss: 0.0062922769299659 | Epoch: 97 | MeanAbsoluteError: 0.0640873238444328 | Loss: 0.0064469022235196 | Epoch: 98 | MeanAbsoluteError: 0.0629718378186226 | Loss: 0.0069034543795217 | Epoch: 99 | MeanAbsoluteError: 0.0700382664799690 | Loss: 0.0078176991572898 | Epoch: 100 | MeanAbsoluteError: 0.0641560852527618 | Loss: 0.0069786301495409 | Epoch: 101 | MeanAbsoluteError: 0.0583542138338089 | Loss: 0.0053053952165340 | Epoch: 102 | MeanAbsoluteError: 0.0591504611074924 | Loss: 0.0061277190566455 | Epoch: 103 | MeanAbsoluteError: 0.1160808950662613 | Loss: 0.0193079889408852 | Epoch: 104 | MeanAbsoluteError: 0.0812640264630318 | Loss: 0.0094794385919445 | Epoch: 105 | MeanAbsoluteError: 0.1077820062637329 | Loss: 0.0168915392438832 | Epoch: 106 | MeanAbsoluteError: 0.0531023554503918 | Loss: 0.0052943711879810 | Epoch: 107 | MeanAbsoluteError: 0.0556357204914093 | Loss: 0.0053381719013774 | Epoch: 108 | MeanAbsoluteError: 0.0788398906588554 | Loss: 0.0095849207994577 | Epoch: 109 | MeanAbsoluteError: 0.0798280984163284 | Loss: 0.0105678083277062 | Epoch: 110 | MeanAbsoluteError: 0.0627325922250748 | Loss: 0.0067635910266912 | Early stopping at epoch 109
Returned to Spot: Validation loss: 0.006763591026691229
spotPython tuning: 0.0027803774972103143 [##--------] 15.71% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.25155279655166113, 'lr_mult': 7.1491907378875235, 'batch_size': 16, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.0}
Epoch: 1 | MeanAbsoluteError: 0.1672388315200806 | Loss: 0.0422140148125197 | Epoch: 2 | MeanAbsoluteError: 0.2076952308416367 | Loss: 0.0623254115252118 | Epoch: 3 | MeanAbsoluteError: 0.1560304760932922 | Loss: 0.0376047133223007 | Epoch: 4 | MeanAbsoluteError: 0.1892507076263428 | Loss: 0.0512795346347909 | Epoch: 5 | MeanAbsoluteError: 0.1298824250698090 | Loss: 0.0272793920808717 | Epoch: 6 | MeanAbsoluteError: 0.2099546492099762 | Loss: 0.0594013252932774 | Epoch: 7 | MeanAbsoluteError: 0.1372822523117065 | Loss: 0.0283307470871430 | Epoch: 8 | MeanAbsoluteError: 0.1559867113828659 | Loss: 0.0347539589397217 | Epoch: 9 | MeanAbsoluteError: 0.1373474746942520 | Loss: 0.0277481417318708 | Epoch: 10 | MeanAbsoluteError: 0.1799133121967316 | Loss: 0.0457985116855094 | Epoch: 11 | MeanAbsoluteError: 0.1015565395355225 | Loss: 0.0159528239777214 | Epoch: 12 | MeanAbsoluteError: 0.1348604857921600 | Loss: 0.0262822728898180 | Epoch: 13 | MeanAbsoluteError: 0.1778265684843063 | Loss: 0.0425974690404377 | Epoch: 14 | MeanAbsoluteError: 0.0964530259370804 | Loss: 0.0148438568913231 | Epoch: 15 | MeanAbsoluteError: 0.0801896005868912 | Loss: 0.0107643368997072 | Epoch: 16 | MeanAbsoluteError: 0.1486910432577133 | Loss: 0.0303612310243280 | Epoch: 17 | MeanAbsoluteError: 0.1635666340589523 | Loss: 0.0350849747069572 | Epoch: 18 | MeanAbsoluteError: 0.1614292412996292 | Loss: 0.0355112681067304 | Epoch: 19 | 
MeanAbsoluteError: 0.1701682358980179 | Loss: 0.0382156545590413 | Epoch: 20 | MeanAbsoluteError: 0.0706726461648941 | Loss: 0.0096421854717559 | Epoch: 21 | MeanAbsoluteError: 0.1101501733064651 | Loss: 0.0182114230762971 | Epoch: 22 | MeanAbsoluteError: 0.0979365855455399 | Loss: 0.0138179975757866 | Epoch: 23 | MeanAbsoluteError: 0.0739870592951775 | Loss: 0.0097100405806774 | Epoch: 24 | MeanAbsoluteError: 0.1092022359371185 | Loss: 0.0178273682923693 | Epoch: 25 | MeanAbsoluteError: 0.1295844465494156 | Loss: 0.0223247482147264 | Epoch: 26 | MeanAbsoluteError: 0.1179408282041550 | Loss: 0.0221757335392268 | Epoch: 27 | MeanAbsoluteError: 0.1110715866088867 | Loss: 0.0190784058680660 | Epoch: 28 | MeanAbsoluteError: 0.0785258710384369 | Loss: 0.0094521039312607 | Epoch: 29 | MeanAbsoluteError: 0.0914171189069748 | Loss: 0.0143512980032124 | Epoch: 30 | MeanAbsoluteError: 0.0902564749121666 | Loss: 0.0116728158961785 | Epoch: 31 | MeanAbsoluteError: 0.0968122482299805 | Loss: 0.0144863825438446 | Epoch: 32 | MeanAbsoluteError: 0.1574890613555908 | Loss: 0.0298819200772988 | Epoch: 33 | MeanAbsoluteError: 0.0770720466971397 | Loss: 0.0095788903877531 | Epoch: 34 | MeanAbsoluteError: 0.1720045804977417 | Loss: 0.0358958637439891 | Epoch: 35 | MeanAbsoluteError: 0.0882399976253510 | Loss: 0.0124738467121987 | Epoch: 36 | MeanAbsoluteError: 0.0841309800744057 | Loss: 0.0119872933351680 | Epoch: 37 | MeanAbsoluteError: 0.0770543515682220 | Loss: 0.0100339125890873 | Epoch: 38 | 
MeanAbsoluteError: 0.0909152701497078 | Loss: 0.0126285081680276 | Epoch: 39 | MeanAbsoluteError: 0.1058987453579903 | Loss: 0.0180317995775687 | Epoch: 40 | MeanAbsoluteError: 0.1162743493914604 | Loss: 0.0182544412581544 | Epoch: 41 | MeanAbsoluteError: 0.1955800950527191 | Loss: 0.0436482498128163 | Epoch: 42 | MeanAbsoluteError: 0.0650502741336823 | Loss: 0.0068063236356370 | Epoch: 43 | MeanAbsoluteError: 0.0500506348907948 | Loss: 0.0051211036349598 | Epoch: 44 | MeanAbsoluteError: 0.0915367081761360 | Loss: 0.0139324047210577 | Epoch: 45 | MeanAbsoluteError: 0.1099297180771828 | Loss: 0.0171427865953822 | Epoch: 46 | MeanAbsoluteError: 0.0526683256030083 | Loss: 0.0050167905865237 | Epoch: 47 | MeanAbsoluteError: 0.1610105782747269 | Loss: 0.0316080773543370 | Epoch: 48 | MeanAbsoluteError: 0.0636252015829086 | Loss: 0.0063215378720902 | Epoch: 49 | MeanAbsoluteError: 0.0936309918761253 | Loss: 0.0134274544635494 | Epoch: 50 | MeanAbsoluteError: 0.0695795714855194 | Loss: 0.0069328488438929 | Epoch: 51 | MeanAbsoluteError: 0.0918928682804108 | Loss: 0.0109071496530975 | Epoch: 52 | MeanAbsoluteError: 0.0938407108187675 | Loss: 0.0118807555960589 | Epoch: 53 | MeanAbsoluteError: 0.0902421921491623 | Loss: 0.0122487979794019 | Epoch: 54 | MeanAbsoluteError: 0.0883198007941246 | Loss: 0.0103675807875238 | Epoch: 55 | MeanAbsoluteError: 0.0793031454086304 | Loss: 0.0104175589145406 | Epoch: 56 | MeanAbsoluteError: 0.0786392614245415 | Loss: 0.0096214558733137 | Epoch: 57 | 
MeanAbsoluteError: 0.1078676357865334 | Loss: 0.0172521224441497 | Epoch: 58 | MeanAbsoluteError: 0.1044691205024719 | Loss: 0.0168570432272789 | Epoch: 59 | MeanAbsoluteError: 0.0672413483262062 | Loss: 0.0067688977394841 | Epoch: 60 | MeanAbsoluteError: 0.0453428886830807 | Loss: 0.0038642067474460 | Epoch: 61 | MeanAbsoluteError: 0.0484645925462246 | Loss: 0.0041200848737437 | Epoch: 62 | MeanAbsoluteError: 0.1099879443645477 | Loss: 0.0148537055050072 | Epoch: 63 | MeanAbsoluteError: 0.0825788527727127 | Loss: 0.0098724799524797 | Epoch: 64 | MeanAbsoluteError: 0.1030607372522354 | Loss: 0.0152406317525004 | Epoch: 65 | MeanAbsoluteError: 0.0624248683452606 | Loss: 0.0054365745776235 | Epoch: 66 | MeanAbsoluteError: 0.0573275238275528 | Loss: 0.0053288645699228 | Epoch: 67 | MeanAbsoluteError: 0.0637485310435295 | Loss: 0.0070092918620886 | Epoch: 68 | MeanAbsoluteError: 0.0413083992898464 | Loss: 0.0030586427126668 | Epoch: 69 | MeanAbsoluteError: 0.0549145303666592 | Loss: 0.0059136064527066 | Epoch: 70 | MeanAbsoluteError: 0.0727852508425713 | Loss: 0.0097429523930738 | Epoch: 71 | MeanAbsoluteError: 0.1056129708886147 | Loss: 0.0150890531704614 | Epoch: 72 | MeanAbsoluteError: 0.0661973729729652 | Loss: 0.0077815497857764 | Epoch: 73 | MeanAbsoluteError: 0.1101018115878105 | Loss: 0.0148940659863384 | Epoch: 74 | MeanAbsoluteError: 0.0722094848752022 | Loss: 0.0076590273774376 | Epoch: 75 | MeanAbsoluteError: 0.0685946419835091 | Loss: 0.0080403652605846 | Epoch: 76 | 
MeanAbsoluteError: 0.0793750733137131 | Loss: 0.0088684483994975 | Epoch: 77 | MeanAbsoluteError: 0.0628493949770927 | Loss: 0.0066918128807294 | Epoch: 78 | MeanAbsoluteError: 0.0787456780672073 | Loss: 0.0089055334560965 | Epoch: 79 | MeanAbsoluteError: 0.0635294094681740 | Loss: 0.0057298822549025 | Epoch: 80 | MeanAbsoluteError: 0.0618458874523640 | Loss: 0.0076375298422614 | Epoch: 81 | MeanAbsoluteError: 0.0689473673701286 | Loss: 0.0073010304844693 | Epoch: 82 | MeanAbsoluteError: 0.0587329864501953 | Loss: 0.0059514261635118 | Epoch: 83 | MeanAbsoluteError: 0.0551955476403236 | Loss: 0.0051053279925040 | Epoch: 84 | MeanAbsoluteError: 0.0450545512139797 | Loss: 0.0041889939640992 | Epoch: 85 | MeanAbsoluteError: 0.0502624735236168 | Loss: 0.0039988205106439 | Epoch: 86 | MeanAbsoluteError: 0.1457688361406326 | Loss: 0.0244590255774950 | Epoch: 87 | MeanAbsoluteError: 0.0519421622157097 | Loss: 0.0043037527081508 | Epoch: 88 | MeanAbsoluteError: 0.0625516995787621 | Loss: 0.0057480827366051 | Epoch: 89 | MeanAbsoluteError: 0.0794916003942490 | Loss: 0.0104432541778997 | Epoch: 90 | MeanAbsoluteError: 0.0862450823187828 | Loss: 0.0109357951257966 | Epoch: 91 | MeanAbsoluteError: 0.0692718476057053 | Loss: 0.0068180744756797 | Epoch: 92 | MeanAbsoluteError: 0.0847462564706802 | Loss: 0.0127675521040433 | Epoch: 93 | MeanAbsoluteError: 0.0452364720404148 | Loss: 0.0036351911503037 | Epoch: 94 | MeanAbsoluteError: 0.0694696828722954 | Loss: 0.0075487308204174 | Epoch: 95 | 
MeanAbsoluteError: 0.0420685783028603 | Loss: 0.0035918146604672 | Epoch: 96 | MeanAbsoluteError: 0.0590527392923832 | Loss: 0.0050132427683198 | Epoch: 97 | MeanAbsoluteError: 0.0963408499956131 | Loss: 0.0117830142476841 | Epoch: 98 | MeanAbsoluteError: 0.1053502336144447 | Loss: 0.0149631268884006 | Epoch: 99 | MeanAbsoluteError: 0.0427432879805565 | Loss: 0.0028764105977883 | Epoch: 100 | MeanAbsoluteError: 0.0853065177798271 | Loss: 0.0103250729459289 | Epoch: 101 | MeanAbsoluteError: 0.0830713436007500 | Loss: 0.0102789300542913 | Epoch: 102 | MeanAbsoluteError: 0.0786322802305222 | Loss: 0.0090828243594028 | Epoch: 103 | MeanAbsoluteError: 0.0560917966067791 | Loss: 0.0055555868342421 | Epoch: 104 | MeanAbsoluteError: 0.0444035902619362 | Loss: 0.0036608391674235 | Epoch: 105 | MeanAbsoluteError: 0.0968509614467621 | Loss: 0.0118165657316384 | Epoch: 106 | MeanAbsoluteError: 0.0599621906876564 | Loss: 0.0054742224808586 | Epoch: 107 | MeanAbsoluteError: 0.0773335918784142 | Loss: 0.0091229345600464 | Epoch: 108 | MeanAbsoluteError: 0.0598466880619526 | Loss: 0.0055238183979925 | Epoch: 109 | MeanAbsoluteError: 0.0992218255996704 | Loss: 0.0122132955217048 | Epoch: 110 | MeanAbsoluteError: 0.0824882090091705 | Loss: 0.0089487228297481 | Epoch: 111 | MeanAbsoluteError: 0.0739020928740501 | Loss: 0.0087215527156858 | Epoch: 112 | MeanAbsoluteError: 0.0891821980476379 | Loss: 0.0111015325069035 | Epoch: 113 | MeanAbsoluteError: 0.1145653948187828 | Loss: 0.0164539971830029 | Epoch: 114 | 
MeanAbsoluteError: 0.1010073497891426 | Loss: 0.0135107196279262 | Epoch: 115 | MeanAbsoluteError: 0.0356011949479580 | Loss: 0.0023250576892966 | Epoch: 116 | MeanAbsoluteError: 0.0430332422256470 | Loss: 0.0034963804615760 | Epoch: 117 | MeanAbsoluteError: 0.0511320754885674 | Loss: 0.0041626265921973 | Epoch: 118 | MeanAbsoluteError: 0.0453089512884617 | Loss: 0.0036793690615971 | Epoch: 119 | MeanAbsoluteError: 0.0762473121285439 | Loss: 0.0085689698493010 | Epoch: 120 | MeanAbsoluteError: 0.0606708861887455 | Loss: 0.0054712135981964 | Epoch: 121 | MeanAbsoluteError: 0.0729451924562454 | Loss: 0.0084444996533229 | Epoch: 122 | MeanAbsoluteError: 0.1169665381312370 | Loss: 0.0164077765259304 | Epoch: 123 | MeanAbsoluteError: 0.0617563501000404 | Loss: 0.0054955536033958 | Epoch: 124 | MeanAbsoluteError: 0.0508204400539398 | Loss: 0.0039314033806716 | Epoch: 125 | MeanAbsoluteError: 0.0403455533087254 | Loss: 0.0031389807822722 | Epoch: 126 | MeanAbsoluteError: 0.0870140045881271 | Loss: 0.0108215822102992 | Epoch: 127 | MeanAbsoluteError: 0.0520471446216106 | Loss: 0.0040700329516671 | Epoch: 128 | MeanAbsoluteError: 0.1222828924655914 | Loss: 0.0190259353502801 | Epoch: 129 | MeanAbsoluteError: 0.0500175580382347 | Loss: 0.0039168702757084 | Epoch: 130 | MeanAbsoluteError: 0.0358269736170769 | Loss: 0.0021322182575731 | Epoch: 131 | MeanAbsoluteError: 0.0983366295695305 | Loss: 0.0119839465049537 | Epoch: 132 | MeanAbsoluteError: 0.0771257504820824 | Loss: 0.0078146554970820 | Epoch: 133 | 
MeanAbsoluteError: 0.0520547814667225 | Loss: 0.0046118580442118 | Epoch: 134 | MeanAbsoluteError: 0.0844564586877823 | Loss: 0.0109846335468128 | Epoch: 135 | MeanAbsoluteError: 0.0517361275851727 | Loss: 0.0046539937918025 | Epoch: 136 | MeanAbsoluteError: 0.0744351223111153 | Loss: 0.0088741634237139 | Epoch: 137 | MeanAbsoluteError: 0.0357350111007690 | Loss: 0.0025365638675315 | Epoch: 138 | MeanAbsoluteError: 0.0903328135609627 | Loss: 0.0103127275054392 | Epoch: 139 | MeanAbsoluteError: 0.1090185046195984 | Loss: 0.0137527184560895 | Epoch: 140 | MeanAbsoluteError: 0.0936419665813446 | Loss: 0.0111314904091782 | Epoch: 141 | MeanAbsoluteError: 0.0500037148594856 | Loss: 0.0045482443498546 | Epoch: 142 | MeanAbsoluteError: 0.0577743798494339 | Loss: 0.0053003717115835 | Epoch: 143 | MeanAbsoluteError: 0.0434254296123981 | Loss: 0.0032526199509831 | Epoch: 144 | MeanAbsoluteError: 0.0713473632931709 | Loss: 0.0074069928622952 | Epoch: 145 | MeanAbsoluteError: 0.0718638971447945 | Loss: 0.0080421066990024 | Epoch: 146 | MeanAbsoluteError: 0.0799963027238846 | Loss: 0.0085221668950429 | Epoch: 147 | MeanAbsoluteError: 0.0790042728185654 | Loss: 0.0084489511178904 | Epoch: 148 | MeanAbsoluteError: 0.1007812619209290 | Loss: 0.0124896817693585 | Epoch: 149 | MeanAbsoluteError: 0.0628253892064095 | Loss: 0.0070503399903445 | Epoch: 150 | MeanAbsoluteError: 0.0694654211401939 | Loss: 0.0067171415216044 | Epoch: 151 | MeanAbsoluteError: 0.1242596954107285 | Loss: 0.0203066461866623 | Epoch: 152 | 
MeanAbsoluteError: 0.0598394200205803 | Loss: 0.0053683328197191 | Epoch: 153 | MeanAbsoluteError: 0.0634596794843674 | Loss: 0.0056953428337645 | Epoch: 154 | MeanAbsoluteError: 0.0482254773378372 | Loss: 0.0042115976776634 | Epoch: 155 | MeanAbsoluteError: 0.0725540742278099 | Loss: 0.0069084808009824 | Epoch: 156 | MeanAbsoluteError: 0.0678521692752838 | Loss: 0.0073656496273256 | Epoch: 157 | MeanAbsoluteError: 0.0752699151635170 | Loss: 0.0079042548558822 | Epoch: 158 | MeanAbsoluteError: 0.0652173981070518 | Loss: 0.0066732282039562 | Epoch: 159 | MeanAbsoluteError: 0.0754758715629578 | Loss: 0.0074607264985772 | Epoch: 160 | MeanAbsoluteError: 0.0806521698832512 | Loss: 0.0094689632471847 | Epoch: 161 | MeanAbsoluteError: 0.0587525032460690 | Loss: 0.0058212267529023 | Epoch: 162 | MeanAbsoluteError: 0.0571280717849731 | Loss: 0.0051712611334791 | Early stopping at epoch 161
Returned to Spot: Validation loss: 0.005171261133479052
spotPython tuning: 0.0027803774972103143 [##--------] 19.53% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.10088603237370973, 'lr_mult': 6.960053582101358, 'batch_size': 16, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.2545016461498963}
Epoch: 1 | MeanAbsoluteError: 0.2910962402820587 | Loss: 0.1042306623176524 | Epoch: 2 | MeanAbsoluteError: 0.2775455117225647 | Loss: 0.0983186397505434 | Epoch: 3 | MeanAbsoluteError: 0.2770738601684570 | Loss: 0.0951236084495720 | Epoch: 4 | MeanAbsoluteError: 0.2255162000656128 | Loss: 0.0655950907813875 | Epoch: 5 | MeanAbsoluteError: 0.2942900657653809 | Loss: 0.1019031113307727 | Epoch: 6 | MeanAbsoluteError: 0.3916591405868530 | Loss: 0.1711814791748398 | Epoch: 7 | MeanAbsoluteError: 0.3412545919418335 | Loss: 0.1329331045088015 | Epoch: 8 | MeanAbsoluteError: 0.3322477042675018 | Loss: 0.1258587068633029 | Epoch: 9 | MeanAbsoluteError: 0.2781085073947906 | Loss: 0.0908023169950435 | Epoch: 10 | MeanAbsoluteError: 0.3244224488735199 | Loss: 0.1168127095228747 | Epoch: 11 | MeanAbsoluteError: 0.2785333395004272 | Loss: 0.0868118726893475 | Epoch: 12 | MeanAbsoluteError: 0.2973031699657440 | Loss: 0.0974306001474983 | Epoch: 13 | MeanAbsoluteError: 0.2511703968048096 | Loss: 0.0723128299179830 | Epoch: 14 | MeanAbsoluteError: 0.2987591922283173 | Loss: 0.0982806470833327 | Epoch: 15 | MeanAbsoluteError: 0.2495615184307098 | Loss: 0.0702840479973115 | Epoch: 16 | MeanAbsoluteError: 0.2542445957660675 | Loss: 0.0719560071041710 | Epoch: 17 | MeanAbsoluteError: 0.2622060179710388 | Loss: 0.0750732719898224 | Epoch: 18 | MeanAbsoluteError: 0.1204057857394218 | Loss: 0.0178008801058719 | 
Epoch: 19 | MeanAbsoluteError: 0.2920796275138855 | Loss: 0.0924862003640125 | Epoch: 20 | MeanAbsoluteError: 0.2734753489494324 | Loss: 0.0800960158046923 | Epoch: 21 | MeanAbsoluteError: 0.1999766975641251 | Loss: 0.0449329747965461 | Epoch: 22 | MeanAbsoluteError: 0.1863209754228592 | Loss: 0.0391146154388001 | Epoch: 23 | MeanAbsoluteError: 0.2083046734333038 | Loss: 0.0471531695833332 | Epoch: 24 | MeanAbsoluteError: 0.2699044644832611 | Loss: 0.0779729807063153 | Epoch: 25 | MeanAbsoluteError: 0.2201494276523590 | Loss: 0.0535105798197420 | Epoch: 26 | MeanAbsoluteError: 0.1009714528918266 | Loss: 0.0122472450725342 | Epoch: 27 | MeanAbsoluteError: 0.0830034613609314 | Loss: 0.0088992438181058 | Epoch: 28 | MeanAbsoluteError: 0.1928188800811768 | Loss: 0.0439859647303820 | Epoch: 29 | MeanAbsoluteError: 0.1330696791410446 | Loss: 0.0206227469699163 | Epoch: 30 | MeanAbsoluteError: 0.2165024131536484 | Loss: 0.0501785233224693 | Epoch: 31 | MeanAbsoluteError: 0.2301595360040665 | Loss: 0.0577045792811795 | Epoch: 32 | MeanAbsoluteError: 0.1097430437803268 | Loss: 0.0146797569468617 | Epoch: 33 | MeanAbsoluteError: 0.2402754276990891 | Loss: 0.0626945593639424 | Epoch: 34 | MeanAbsoluteError: 0.2072703838348389 | Loss: 0.0463250322561515 | Epoch: 35 | MeanAbsoluteError: 0.1758059710264206 | Loss: 0.0345050595504673 | Epoch: 36 | MeanAbsoluteError: 0.2195360511541367 | Loss: 0.0524647853484279 | Epoch: 37 | 
MeanAbsoluteError: 0.1274362802505493 | Loss: 0.0187359475285599 | Epoch: 38 | MeanAbsoluteError: 0.1375720351934433 | Loss: 0.0211414270299046 | Epoch: 39 | MeanAbsoluteError: 0.1924101412296295 | Loss: 0.0409573046000380 | Epoch: 40 | MeanAbsoluteError: 0.2063948214054108 | Loss: 0.0464875623583794 | Epoch: 41 | MeanAbsoluteError: 0.0803222358226776 | Loss: 0.0104654665644232 | Epoch: 42 | MeanAbsoluteError: 0.1119791194796562 | Loss: 0.0158176262323794 | Epoch: 43 | MeanAbsoluteError: 0.2467733472585678 | Loss: 0.0645750466930239 | Epoch: 44 | MeanAbsoluteError: 0.0513559170067310 | Loss: 0.0043095835165954 | Epoch: 45 | MeanAbsoluteError: 0.1661489903926849 | Loss: 0.0298045476604449 | Epoch: 46 | MeanAbsoluteError: 0.1035134121775627 | Loss: 0.0124926653347517 | Epoch: 47 | MeanAbsoluteError: 0.0832288712263107 | Loss: 0.0086695519030878 | Epoch: 48 | MeanAbsoluteError: 0.0635773018002510 | Loss: 0.0055638130166029 | Epoch: 49 | MeanAbsoluteError: 0.0782835930585861 | Loss: 0.0085393744520843 | Epoch: 50 | MeanAbsoluteError: 0.1840583235025406 | Loss: 0.0369399558556707 | Epoch: 51 | MeanAbsoluteError: 0.1734528243541718 | Loss: 0.0339207305131774 | Epoch: 52 | MeanAbsoluteError: 0.0623109191656113 | Loss: 0.0057102354660042 | Epoch: 53 | MeanAbsoluteError: 0.1668742299079895 | Loss: 0.0321025421940967 | Epoch: 54 | MeanAbsoluteError: 0.0323977656662464 | Loss: 0.0017225477112286 | Epoch: 55 | MeanAbsoluteError: 0.1831610798835754 | Loss: 0.0356956435073363 | Epoch: 56 | 
MeanAbsoluteError: 0.0909242108464241 | Loss: 0.0104499595043691 | Epoch: 57 | MeanAbsoluteError: 0.1851081848144531 | Loss: 0.0370400493082247 | Epoch: 58 | MeanAbsoluteError: 0.1024085581302643 | Loss: 0.0120664815859575 | Epoch: 59 | MeanAbsoluteError: 0.1565930992364883 | Loss: 0.0294127226071922 | Epoch: 60 | MeanAbsoluteError: 0.1413357555866241 | Loss: 0.0230630072519967 | Epoch: 61 | MeanAbsoluteError: 0.0873458459973335 | Loss: 0.0085685507541424 | Epoch: 62 | MeanAbsoluteError: 0.1031707078218460 | Loss: 0.0121505266349567 | Epoch: 63 | MeanAbsoluteError: 0.1063481718301773 | Loss: 0.0137332410208489 | Epoch: 64 | MeanAbsoluteError: 0.2081720083951950 | Loss: 0.0481761711600580 | Epoch: 65 | MeanAbsoluteError: 0.1389300525188446 | Loss: 0.0227147806435823 | Epoch: 66 | MeanAbsoluteError: 0.1917621046304703 | Loss: 0.0393739177992469 | Epoch: 67 | MeanAbsoluteError: 0.0648884400725365 | Loss: 0.0061963035259396 | Epoch: 68 | MeanAbsoluteError: 0.1160153299570084 | Loss: 0.0169929954664488 | Epoch: 69 | MeanAbsoluteError: 0.1662764549255371 | Loss: 0.0303504784640513 | Epoch: 70 | MeanAbsoluteError: 0.1701101213693619 | Loss: 0.0316396169364452 | Epoch: 71 | MeanAbsoluteError: 0.0353529304265976 | Loss: 0.0023352225543931 | Epoch: 72 | MeanAbsoluteError: 0.0755028650164604 | Loss: 0.0090835748093301 | Epoch: 73 | MeanAbsoluteError: 0.1211277022957802 | Loss: 0.0187778220462956 | Epoch: 74 | MeanAbsoluteError: 0.1076416522264481 | Loss: 0.0156247382493396 | Epoch: 75 | 
MeanAbsoluteError: 0.0493791289627552 | Loss: 0.0040915941047531 | Epoch: 76 | MeanAbsoluteError: 0.1383124291896820 | Loss: 0.0221170394828445 | Epoch: 77 | MeanAbsoluteError: 0.0985716059803963 | Loss: 0.0133792612407553 | Epoch: 78 | MeanAbsoluteError: 0.2292233854532242 | Loss: 0.0570677801182396 | Epoch: 79 | MeanAbsoluteError: 0.0987784042954445 | Loss: 0.0129950329857437 | Epoch: 80 | MeanAbsoluteError: 0.0471880361437798 | Loss: 0.0032402524467264 | Epoch: 81 | MeanAbsoluteError: 0.0972426086664200 | Loss: 0.0119757022904722 | Epoch: 82 | MeanAbsoluteError: 0.0788379311561584 | Loss: 0.0081748364395217 | Epoch: 83 | MeanAbsoluteError: 0.0847170874476433 | Loss: 0.0105497179994066 | Epoch: 84 | MeanAbsoluteError: 0.1041115894913673 | Loss: 0.0149870262187170 | Epoch: 85 | MeanAbsoluteError: 0.0909545123577118 | Loss: 0.0125308405902041 | Epoch: 86 | MeanAbsoluteError: 0.0988859757781029 | Loss: 0.0133184427150378 | Early stopping at epoch 85
Returned to Spot: Validation loss: 0.01331844271503781
spotPython tuning: 0.0027803774972103143 [##--------] 21.73% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.23159984980328024, 'lr_mult': 6.973660731599605, 'batch_size': 16, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.0}
Epoch: 1 | MeanAbsoluteError: 0.3868705928325653 | Loss: 0.1946377487559068 | Epoch: 2 | MeanAbsoluteError: 0.1659881025552750 | Loss: 0.0411704866901824 | Epoch: 3 | MeanAbsoluteError: 0.1557595282793045 | Loss: 0.0352255626532592 | Epoch: 4 | MeanAbsoluteError: 0.1171957179903984 | Loss: 0.0210211985793553 | Epoch: 5 | MeanAbsoluteError: 0.1143862307071686 | Loss: 0.0205929088161180 | Epoch: 6 | MeanAbsoluteError: 0.1271432340145111 | Loss: 0.0240812583483363 | Epoch: 7 | MeanAbsoluteError: 0.1283313482999802 | Loss: 0.0244008550224336 | Epoch: 8 | MeanAbsoluteError: 0.0984221622347832 | Loss: 0.0147535783042641 | Epoch: 9 | MeanAbsoluteError: 0.0957727432250977 | Loss: 0.0146143797687010 | Epoch: 10 | MeanAbsoluteError: 0.0831302702426910 | Loss: 0.0112331412413991 | Epoch: 11 | MeanAbsoluteError: 0.0875712260603905 | Loss: 0.0127421833672806 | Epoch: 12 | MeanAbsoluteError: 0.0790195688605309 | Loss: 0.0107647621219880 | Epoch: 13 | MeanAbsoluteError: 0.1079024523496628 | Loss: 0.0164758259626596 | Epoch: 14 | MeanAbsoluteError: 0.1075215786695480 | Loss: 0.0174453164156722 | Epoch: 15 | MeanAbsoluteError: 0.0844598934054375 | Loss: 0.0118160796302714 | Epoch: 16 | MeanAbsoluteError: 0.1625580638647079 | Loss: 0.0360575581557657 | Epoch: 17 | MeanAbsoluteError: 0.1696456670761108 | Loss: 0.0362331246663081 | Epoch: 18 | MeanAbsoluteError: 0.1123851165175438 | Loss: 0.0175859551680715 | Epoch: 19 | 
MeanAbsoluteError: 0.1151136532425880 | Loss: 0.0186919012155972 | Epoch: 20 | MeanAbsoluteError: 0.0908927321434021 | Loss: 0.0125787034875860 | Epoch: 21 | MeanAbsoluteError: 0.0683801174163818 | Loss: 0.0086259088527999 | Epoch: 22 | MeanAbsoluteError: 0.0839834585785866 | Loss: 0.0114457665354406 | Epoch: 23 | MeanAbsoluteError: 0.0707907527685165 | Loss: 0.0086604171481572 | Epoch: 24 | MeanAbsoluteError: 0.0619030743837357 | Loss: 0.0072424407729781 | Epoch: 25 | MeanAbsoluteError: 0.0994154214859009 | Loss: 0.0146297013730203 | Epoch: 26 | MeanAbsoluteError: 0.1177031323313713 | Loss: 0.0203929131997651 | Epoch: 27 | MeanAbsoluteError: 0.0777343586087227 | Loss: 0.0098400072831857 | Epoch: 28 | MeanAbsoluteError: 0.0650613233447075 | Loss: 0.0074693885521571 | Epoch: 29 | MeanAbsoluteError: 0.0775512456893921 | Loss: 0.0099610250051084 | Epoch: 30 | MeanAbsoluteError: 0.1176314800977707 | Loss: 0.0187324371777083 | Epoch: 31 | MeanAbsoluteError: 0.0889178812503815 | Loss: 0.0120821799347667 | Epoch: 32 | MeanAbsoluteError: 0.0990726947784424 | Loss: 0.0131395968461507 | Epoch: 33 | MeanAbsoluteError: 0.0896524041891098 | Loss: 0.0128008782569515 | Epoch: 34 | MeanAbsoluteError: 0.0541300214827061 | Loss: 0.0059578009133570 | Epoch: 35 | MeanAbsoluteError: 0.0707278624176979 | Loss: 0.0093722115270793 | Epoch: 36 | MeanAbsoluteError: 0.0695960670709610 | Loss: 0.0078390411370875 | Epoch: 37 | MeanAbsoluteError: 0.0808347165584564 | Loss: 0.0105094619610004 | Epoch: 38 | 
MeanAbsoluteError: 0.0809566974639893 | Loss: 0.0100912432382373 | Epoch: 39 | MeanAbsoluteError: 0.0739220455288887 | Loss: 0.0094938032378099 | Epoch: 40 | MeanAbsoluteError: 0.1169069185853004 | Loss: 0.0195611161424925 | Epoch: 41 | MeanAbsoluteError: 0.0977644100785255 | Loss: 0.0128000780057750 | Epoch: 42 | MeanAbsoluteError: 0.0857792198657990 | Loss: 0.0105567816154737 | Epoch: 43 | MeanAbsoluteError: 0.1026436686515808 | Loss: 0.0141323043376599 | Epoch: 44 | MeanAbsoluteError: 0.1009714528918266 | Loss: 0.0141196672461535 | Epoch: 45 | MeanAbsoluteError: 0.0804255157709122 | Loss: 0.0097948406871996 | Epoch: 46 | MeanAbsoluteError: 0.0536635257303715 | Loss: 0.0057164733880199 | Epoch: 47 | MeanAbsoluteError: 0.0871158018708229 | Loss: 0.0104809623995894 | Epoch: 48 | MeanAbsoluteError: 0.0524183362722397 | Loss: 0.0049099458357025 | Epoch: 49 | MeanAbsoluteError: 0.0844147205352783 | Loss: 0.0102980536359705 | Epoch: 50 | MeanAbsoluteError: 0.0731202438473701 | Loss: 0.0081970203961981 | Epoch: 51 | MeanAbsoluteError: 0.1269181817770004 | Loss: 0.0198277667360870 | Epoch: 52 | MeanAbsoluteError: 0.0921289473772049 | Loss: 0.0122330306146882 | Epoch: 53 | MeanAbsoluteError: 0.1655553430318832 | Loss: 0.0333873972688851 | Epoch: 54 | MeanAbsoluteError: 0.1182519793510437 | Loss: 0.0181119727264894 | Epoch: 55 | MeanAbsoluteError: 0.0795105248689651 | Loss: 0.0097059815827953 | Epoch: 56 | MeanAbsoluteError: 0.0889619588851929 | Loss: 0.0114184060183011 | Epoch: 57 | 
MeanAbsoluteError: 0.0596942976117134 | Loss: 0.0068907883802527 | Epoch: 58 | MeanAbsoluteError: 0.0760712921619415 | Loss: 0.0086397088475918 | Epoch: 59 | MeanAbsoluteError: 0.0631694570183754 | Loss: 0.0061092725342238 | Epoch: 60 | MeanAbsoluteError: 0.1347343176603317 | Loss: 0.0226310716059647 | Epoch: 61 | MeanAbsoluteError: 0.1182711943984032 | Loss: 0.0210911676189617 | Epoch: 62 | MeanAbsoluteError: 0.1124777570366859 | Loss: 0.0186422210872958 | Epoch: 63 | MeanAbsoluteError: 0.0574897453188896 | Loss: 0.0055872882275205 | Epoch: 64 | MeanAbsoluteError: 0.0758774355053902 | Loss: 0.0083398356004373 | Epoch: 65 | MeanAbsoluteError: 0.0602756813168526 | Loss: 0.0060934757348150 | Epoch: 66 | MeanAbsoluteError: 0.0824487507343292 | Loss: 0.0097929982615537 | Epoch: 67 | MeanAbsoluteError: 0.0559815280139446 | Loss: 0.0054256058861747 | Epoch: 68 | MeanAbsoluteError: 0.0496898069977760 | Loss: 0.0047702568362614 | Epoch: 69 | MeanAbsoluteError: 0.0866053998470306 | Loss: 0.0126180882859779 | Epoch: 70 | MeanAbsoluteError: 0.0734004452824593 | Loss: 0.0077970386482775 | Epoch: 71 | MeanAbsoluteError: 0.0509099438786507 | Loss: 0.0050698219014234 | Epoch: 72 | MeanAbsoluteError: 0.0515252277255058 | Loss: 0.0053205605608558 | Epoch: 73 | MeanAbsoluteError: 0.0881260111927986 | Loss: 0.0107426494605055 | Epoch: 74 | MeanAbsoluteError: 0.1140714809298515 | Loss: 0.0172015319235231 | Epoch: 75 | MeanAbsoluteError: 0.0446097105741501 | Loss: 0.0041201924782638 | Epoch: 76 | 
MeanAbsoluteError: 0.1047303229570389 | Loss: 0.0138832561818785 | Epoch: 77 | MeanAbsoluteError: 0.0487063452601433 | Loss: 0.0050221218139325 | Epoch: 78 | MeanAbsoluteError: 0.0501807928085327 | Loss: 0.0050838396480111 | Epoch: 79 | MeanAbsoluteError: 0.0573408119380474 | Loss: 0.0056064255829704 | Epoch: 80 | MeanAbsoluteError: 0.0965674594044685 | Loss: 0.0128138494236689 | Epoch: 81 | MeanAbsoluteError: 0.0965150073170662 | Loss: 0.0125467496630000 | Epoch: 82 | MeanAbsoluteError: 0.1113169863820076 | Loss: 0.0169599768460581 | Epoch: 83 | MeanAbsoluteError: 0.0937435552477837 | Loss: 0.0125288716517389 | Epoch: 84 | MeanAbsoluteError: 0.1151427701115608 | Loss: 0.0178919287496491 | Epoch: 85 | MeanAbsoluteError: 0.0629192218184471 | Loss: 0.0063121094196839 | Epoch: 86 | MeanAbsoluteError: 0.0689280182123184 | Loss: 0.0071774001331314 | Epoch: 87 | MeanAbsoluteError: 0.0513954907655716 | Loss: 0.0047427756270688 | Epoch: 88 | MeanAbsoluteError: 0.0989659652113914 | Loss: 0.0143774453501560 | Epoch: 89 | MeanAbsoluteError: 0.0582801885902882 | Loss: 0.0056053140249692 | Epoch: 90 | MeanAbsoluteError: 0.1026923730969429 | Loss: 0.0150167354823727 | Epoch: 91 | MeanAbsoluteError: 0.1396352499723434 | Loss: 0.0262967282906175 | Epoch: 92 | MeanAbsoluteError: 0.0516951605677605 | Loss: 0.0055238060212057 | Epoch: 93 | MeanAbsoluteError: 0.0477292798459530 | Loss: 0.0048144475838758 | Epoch: 94 | MeanAbsoluteError: 0.0626765042543411 | Loss: 0.0064265615380320 | Epoch: 95 | 
MeanAbsoluteError: 0.0714503452181816 | Loss: 0.0073761841723401 | Epoch: 96 | MeanAbsoluteError: 0.1030198335647583 | Loss: 0.0141362460624231 | Epoch: 97 | MeanAbsoluteError: 0.0891690850257874 | Loss: 0.0110064125374744 | Epoch: 98 | MeanAbsoluteError: 0.0947365313768387 | Loss: 0.0137590090744197 | Epoch: 99 | MeanAbsoluteError: 0.1179528310894966 | Loss: 0.0185897114049447 | Epoch: 100 | MeanAbsoluteError: 0.0885697379708290 | Loss: 0.0104093101659888 | Epoch: 101 | MeanAbsoluteError: 0.0432412289083004 | Loss: 0.0038841194963377 | Epoch: 102 | MeanAbsoluteError: 0.0964608341455460 | Loss: 0.0140631721649123 | Epoch: 103 | MeanAbsoluteError: 0.0792242288589478 | Loss: 0.0097269227385129 | Epoch: 104 | MeanAbsoluteError: 0.1355681270360947 | Loss: 0.0228582855412050 | Epoch: 105 | MeanAbsoluteError: 0.0779837593436241 | Loss: 0.0084333050701963 | Epoch: 106 | MeanAbsoluteError: 0.0698710605502129 | Loss: 0.0074578974714601 | Epoch: 107 | MeanAbsoluteError: 0.1565555781126022 | Loss: 0.0311464417823835 | Epoch: 108 | MeanAbsoluteError: 0.0767930448055267 | Loss: 0.0087940130186708 | Epoch: 109 | MeanAbsoluteError: 0.0563487038016319 | Loss: 0.0058499770116453 | Epoch: 110 | MeanAbsoluteError: 0.0834165364503860 | Loss: 0.0106229196596695 | Epoch: 111 | MeanAbsoluteError: 0.0773963183164597 | Loss: 0.0089840468166298 | Epoch: 112 | MeanAbsoluteError: 0.0504502132534981 | Loss: 0.0048332139482035 | Epoch: 113 | MeanAbsoluteError: 0.1058350279927254 | Loss: 0.0146371150683416 | Epoch: 114 | 
MeanAbsoluteError: 0.0574693046510220 | Loss: 0.0061093935816500 | Epoch: 115 | MeanAbsoluteError: 0.0887190550565720 | Loss: 0.0116640517095986 | Epoch: 116 | MeanAbsoluteError: 0.1335638612508774 | Loss: 0.0212312956389628 | Epoch: 117 | MeanAbsoluteError: 0.0691011622548103 | Loss: 0.0071569664869457 | Epoch: 118 | MeanAbsoluteError: 0.0426119528710842 | Loss: 0.0038150761791162 | Epoch: 119 | MeanAbsoluteError: 0.0583452917635441 | Loss: 0.0062716824958395 | Epoch: 120 | MeanAbsoluteError: 0.0723422765731812 | Loss: 0.0082733983321017 | Epoch: 121 | MeanAbsoluteError: 0.1047351062297821 | Loss: 0.0135125794055823 | Epoch: 122 | MeanAbsoluteError: 0.0782415419816971 | Loss: 0.0098070223252044 | Epoch: 123 | MeanAbsoluteError: 0.1124968603253365 | Loss: 0.0185504821129143 | Epoch: 124 | MeanAbsoluteError: 0.1298045814037323 | Loss: 0.0225839408016519 | Epoch: 125 | MeanAbsoluteError: 0.0923781841993332 | Loss: 0.0114187054630173 | Epoch: 126 | MeanAbsoluteError: 0.0737027749419212 | Loss: 0.0092212408535967 | Epoch: 127 | MeanAbsoluteError: 0.0607974231243134 | Loss: 0.0057669270808171 | Epoch: 128 | MeanAbsoluteError: 0.0763664022088051 | Loss: 0.0084725656228042 | Epoch: 129 | MeanAbsoluteError: 0.0468227639794350 | Loss: 0.0042172504074283 | Epoch: 130 | MeanAbsoluteError: 0.0657964870333672 | Loss: 0.0068349324313826 | Epoch: 131 | MeanAbsoluteError: 0.0821887701749802 | Loss: 0.0092247539739075 | Epoch: 132 | MeanAbsoluteError: 0.0964276269078255 | Loss: 0.0134281996196430 | Epoch: 133 | 
MeanAbsoluteError: 0.0786191746592522 | Loss: 0.0102241080572927 | Epoch: 134 | MeanAbsoluteError: 0.1106538772583008 | Loss: 0.0153262394137288 | Epoch: 135 | MeanAbsoluteError: 0.0443779565393925 | Loss: 0.0040090722215705 | Epoch: 136 | MeanAbsoluteError: 0.0733276084065437 | Loss: 0.0080169285402486 | Epoch: 137 | MeanAbsoluteError: 0.0750026106834412 | Loss: 0.0083888622221390 | Epoch: 138 | MeanAbsoluteError: 0.0488856621086597 | Loss: 0.0040874026446162 | Epoch: 139 | MeanAbsoluteError: 0.0796880871057510 | Loss: 0.0098809174409038 | Epoch: 140 | MeanAbsoluteError: 0.0564183369278908 | Loss: 0.0055959751878522 | Epoch: 141 | MeanAbsoluteError: 0.0459271892905235 | Loss: 0.0042548755392138 | Epoch: 142 | MeanAbsoluteError: 0.0473105236887932 | Loss: 0.0039101848562591 | Epoch: 143 | MeanAbsoluteError: 0.0603822208940983 | Loss: 0.0056120420340449 | Epoch: 144 | MeanAbsoluteError: 0.1272820085287094 | Loss: 0.0215015212858194 | Epoch: 145 | MeanAbsoluteError: 0.0525672994554043 | Loss: 0.0049756201915443 | Epoch: 146 | MeanAbsoluteError: 0.0623181723058224 | Loss: 0.0062389338854700 | Epoch: 147 | MeanAbsoluteError: 0.0729039460420609 | Loss: 0.0079071257557524 | Epoch: 148 | MeanAbsoluteError: 0.0431043654680252 | Loss: 0.0038639929170083 | Epoch: 149 | MeanAbsoluteError: 0.0466031022369862 | Loss: 0.0044382524823672 | Epoch: 150 | MeanAbsoluteError: 0.0479060634970665 | Loss: 0.0041139331695281 | Early stopping at epoch 149
Returned to Spot: Validation loss: 0.0041139331695280576
spotPython tuning: 0.0027803774972103143 [###-------] 25.58% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.23315131857080248, 'lr_mult': 6.972542543037714, 'batch_size': 16, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.3135588414486277}
Epoch: 1 | MeanAbsoluteError: 0.1560869961977005 | Loss: 0.0380777723499035 | Epoch: 2 | MeanAbsoluteError: 0.2222785651683807 | Loss: 0.0692837536334991 | Epoch: 3 | MeanAbsoluteError: 0.1626877039670944 | Loss: 0.0407216811650678 | Epoch: 4 | MeanAbsoluteError: 0.1224681362509727 | Loss: 0.0242820136052997 | Epoch: 5 | MeanAbsoluteError: 0.2208685874938965 | Loss: 0.0672808773815632 | Epoch: 6 | MeanAbsoluteError: 0.1079633980989456 | Loss: 0.0185845090860599 | Epoch: 7 | MeanAbsoluteError: 0.1696196943521500 | Loss: 0.0421220461200727 | Epoch: 8 | MeanAbsoluteError: 0.1737772822380066 | Loss: 0.0439928717126972 | Epoch: 9 | MeanAbsoluteError: 0.2076095342636108 | Loss: 0.0591248130719913 | Epoch: 10 | MeanAbsoluteError: 0.1510245352983475 | Loss: 0.0331550306199413 | Epoch: 11 | MeanAbsoluteError: 0.1061160638928413 | Loss: 0.0181223080542527 | Epoch: 12 | MeanAbsoluteError: 0.1085586547851562 | Loss: 0.0186965682200695 | Epoch: 13 | MeanAbsoluteError: 0.1896485984325409 | Loss: 0.0507585760205984 | Epoch: 14 | MeanAbsoluteError: 0.0860791951417923 | Loss: 0.0124426354458065 | Epoch: 15 | MeanAbsoluteError: 0.1495292037725449 | Loss: 0.0315796122150986 | Epoch: 16 | MeanAbsoluteError: 0.0787794664502144 | Loss: 0.0106007871953280 | Epoch: 17 | MeanAbsoluteError: 0.0758549943566322 | Loss: 0.0097779265457862 | Epoch: 18 | MeanAbsoluteError: 0.0726881250739098 | Loss: 0.0094923499824577 | Epoch: 19 | 
MeanAbsoluteError: 0.1951953023672104 | Loss: 0.0476237818794815 | Epoch: 20 | MeanAbsoluteError: 0.1404995322227478 | Loss: 0.0255963625876527 | Epoch: 21 | MeanAbsoluteError: 0.0803651139140129 | Loss: 0.0099719199351966 | Epoch: 22 | MeanAbsoluteError: 0.1721673607826233 | Loss: 0.0381579128535170 | Epoch: 23 | MeanAbsoluteError: 0.0567033886909485 | Loss: 0.0054033469457768 | Epoch: 24 | MeanAbsoluteError: 0.0633946284651756 | Loss: 0.0068097028293108 | Epoch: 25 | MeanAbsoluteError: 0.0592333488166332 | Loss: 0.0059713359897662 | Epoch: 26 | MeanAbsoluteError: 0.0668035820126534 | Loss: 0.0074380919655883 | Epoch: 27 | MeanAbsoluteError: 0.0599147863686085 | Loss: 0.0064648923856255 | Epoch: 28 | MeanAbsoluteError: 0.0957759693264961 | Loss: 0.0141685064146785 | Epoch: 29 | MeanAbsoluteError: 0.1095126718282700 | Loss: 0.0193106329656745 | Epoch: 30 | MeanAbsoluteError: 0.0566540956497192 | Loss: 0.0062243391048947 | Epoch: 31 | MeanAbsoluteError: 0.1037193015217781 | Loss: 0.0154999053644899 | Epoch: 32 | MeanAbsoluteError: 0.0988508686423302 | Loss: 0.0128032129355951 | Epoch: 33 | MeanAbsoluteError: 0.0793311595916748 | Loss: 0.0088726556859910 | Epoch: 34 | MeanAbsoluteError: 0.1593784540891647 | Loss: 0.0304962645627950 | Epoch: 35 | MeanAbsoluteError: 0.0485741123557091 | Loss: 0.0045048304906997 | Epoch: 36 | MeanAbsoluteError: 0.0480006970465183 | Loss: 0.0038528733421117 | Epoch: 37 | MeanAbsoluteError: 0.0693195387721062 | Loss: 0.0080641053224865 | Epoch: 38 | 
MeanAbsoluteError: 0.0591119378805161 | Loss: 0.0060505412004300 | Epoch: 39 | MeanAbsoluteError: 0.0560420602560043 | Loss: 0.0051190269204151 | Epoch: 40 | MeanAbsoluteError: 0.0535375922918320 | Loss: 0.0051654387620817 | Epoch: 41 | MeanAbsoluteError: 0.0497963204979897 | Loss: 0.0040418437473770 | Epoch: 42 | MeanAbsoluteError: 0.0492137670516968 | Loss: 0.0042238266967041 | Epoch: 43 | MeanAbsoluteError: 0.0857104659080505 | Loss: 0.0111688496790042 | Epoch: 44 | MeanAbsoluteError: 0.0670306906104088 | Loss: 0.0079448754825678 | Epoch: 45 | MeanAbsoluteError: 0.0599792785942554 | Loss: 0.0062064719263856 | Epoch: 46 | MeanAbsoluteError: 0.0673087090253830 | Loss: 0.0068869808149573 | Epoch: 47 | MeanAbsoluteError: 0.0951054766774178 | Loss: 0.0144273102479546 | Epoch: 48 | MeanAbsoluteError: 0.0569616518914700 | Loss: 0.0054088518464644 | Epoch: 49 | MeanAbsoluteError: 0.0807572677731514 | Loss: 0.0108809237074303 | Epoch: 50 | MeanAbsoluteError: 0.0886038318276405 | Loss: 0.0110608450088062 | Epoch: 51 | MeanAbsoluteError: 0.0924524962902069 | Loss: 0.0112093474568897 | Epoch: 52 | MeanAbsoluteError: 0.1232690960168839 | Loss: 0.0192652920653161 | Epoch: 53 | MeanAbsoluteError: 0.0473826639354229 | Loss: 0.0038378579836143 | Epoch: 54 | MeanAbsoluteError: 0.1087955459952354 | Loss: 0.0154608990751991 | Epoch: 55 | MeanAbsoluteError: 0.0513369329273701 | Loss: 0.0043630649666547 | Epoch: 56 | MeanAbsoluteError: 0.0538960769772530 | Loss: 0.0049129310921815 | Epoch: 57 | 
MeanAbsoluteError: 0.1343468427658081 | Loss: 0.0224595099295440 | Epoch: 58 | MeanAbsoluteError: 0.0624910593032837 | Loss: 0.0061801570026498 | Epoch: 59 | MeanAbsoluteError: 0.1352952122688293 | Loss: 0.0220602843420286 | Epoch: 60 | MeanAbsoluteError: 0.0922022983431816 | Loss: 0.0117123544853377 | Epoch: 61 | MeanAbsoluteError: 0.0645882263779640 | Loss: 0.0063737755592324 | Epoch: 62 | MeanAbsoluteError: 0.0767036005854607 | Loss: 0.0083118280591933 | Epoch: 63 | MeanAbsoluteError: 0.0812368616461754 | Loss: 0.0094456877069254 | Epoch: 64 | MeanAbsoluteError: 0.1332289278507233 | Loss: 0.0212285089257516 | Epoch: 65 | MeanAbsoluteError: 0.0461983792483807 | Loss: 0.0042246758668242 | Epoch: 66 | MeanAbsoluteError: 0.0464496947824955 | Loss: 0.0041907566881395 | Epoch: 67 | MeanAbsoluteError: 0.0958737507462502 | Loss: 0.0122579389839972 | Epoch: 68 | MeanAbsoluteError: 0.0574656613171101 | Loss: 0.0056588104313337 | Epoch: 69 | MeanAbsoluteError: 0.0577683262526989 | Loss: 0.0059446387581135 | Epoch: 70 | MeanAbsoluteError: 0.0690196901559830 | Loss: 0.0066716019921985 | Epoch: 71 | MeanAbsoluteError: 0.0432155877351761 | Loss: 0.0039034891187360 | Epoch: 72 | MeanAbsoluteError: 0.0855104476213455 | Loss: 0.0094026517809222 | Epoch: 73 | MeanAbsoluteError: 0.0477826409041882 | Loss: 0.0040665370424425 | Epoch: 74 | MeanAbsoluteError: 0.0635255500674248 | Loss: 0.0055855321942976 | Epoch: 75 | MeanAbsoluteError: 0.0650324150919914 | Loss: 0.0067510167872043 | Epoch: 76 | 
MeanAbsoluteError: 0.0663134232163429 | Loss: 0.0065828364734587 | Epoch: 77 | MeanAbsoluteError: 0.0663770437240601 | Loss: 0.0068478009075319 | Epoch: 78 | MeanAbsoluteError: 0.0773047953844070 | Loss: 0.0077208522952309 | Epoch: 79 | MeanAbsoluteError: 0.0661243498325348 | Loss: 0.0063284544004618 | Epoch: 80 | MeanAbsoluteError: 0.0618967115879059 | Loss: 0.0065459160403790 | Epoch: 81 | MeanAbsoluteError: 0.0513688474893570 | Loss: 0.0045939928876530 | Epoch: 82 | MeanAbsoluteError: 0.0438958555459976 | Loss: 0.0038425403671633 | Epoch: 83 | MeanAbsoluteError: 0.0458674989640713 | Loss: 0.0037850008444174 | Epoch: 84 | MeanAbsoluteError: 0.0467391125857830 | Loss: 0.0040364212319745 | Epoch: 85 | MeanAbsoluteError: 0.1166560128331184 | Loss: 0.0169237363397291 | Epoch: 86 | MeanAbsoluteError: 0.0426205843687057 | Loss: 0.0035250686219354 | Epoch: 87 | MeanAbsoluteError: 0.0551074407994747 | Loss: 0.0046810908120518 | Epoch: 88 | MeanAbsoluteError: 0.1033150330185890 | Loss: 0.0142287589903725 | Epoch: 89 | MeanAbsoluteError: 0.0464876666665077 | Loss: 0.0040824781907232 | Epoch: 90 | MeanAbsoluteError: 0.0517881065607071 | Loss: 0.0041451897092262 | Epoch: 91 | MeanAbsoluteError: 0.0484059713780880 | Loss: 0.0047973800315767 | Epoch: 92 | MeanAbsoluteError: 0.0597227215766907 | Loss: 0.0062458919312217 | Epoch: 93 | MeanAbsoluteError: 0.0429231002926826 | Loss: 0.0029976344054663 | Epoch: 94 | MeanAbsoluteError: 0.1015043407678604 | Loss: 0.0130837517545411 | Epoch: 95 | 
MeanAbsoluteError: 0.0477393157780170 | Loss: 0.0042088168035997 | Epoch: 96 | MeanAbsoluteError: 0.0522218421101570 | Loss: 0.0045516821004352 | Epoch: 97 | MeanAbsoluteError: 0.0458667017519474 | Loss: 0.0038926502334346 | Epoch: 98 | MeanAbsoluteError: 0.0446404702961445 | Loss: 0.0036588173825294 | Epoch: 99 | MeanAbsoluteError: 0.0795361325144768 | Loss: 0.0090155402002366 | Epoch: 100 | MeanAbsoluteError: 0.0524040684103966 | Loss: 0.0046575945177066 | Epoch: 101 | MeanAbsoluteError: 0.0401677340269089 | Loss: 0.0030775500253137 | Epoch: 102 | MeanAbsoluteError: 0.0866469219326973 | Loss: 0.0098747781134750 | Epoch: 103 | MeanAbsoluteError: 0.0902165547013283 | Loss: 0.0107258552636363 | Epoch: 104 | MeanAbsoluteError: 0.0438329502940178 | Loss: 0.0035991305485368 | Epoch: 105 | MeanAbsoluteError: 0.0604909658432007 | Loss: 0.0050789969360554 | Epoch: 106 | MeanAbsoluteError: 0.0675847977399826 | Loss: 0.0067930511493040 | Epoch: 107 | MeanAbsoluteError: 0.0430223420262337 | Loss: 0.0035616700770333 | Epoch: 108 | MeanAbsoluteError: 0.0608309544622898 | Loss: 0.0053566053975374 | Epoch: 109 | MeanAbsoluteError: 0.0417532473802567 | Loss: 0.0033604289699150 | Epoch: 110 | MeanAbsoluteError: 0.0466740913689137 | Loss: 0.0040185751185115 | Epoch: 111 | MeanAbsoluteError: 0.1108829751610756 | Loss: 0.0148226783953999 | Epoch: 112 | MeanAbsoluteError: 0.0529548861086369 | Loss: 0.0044796441583649 | Epoch: 113 | MeanAbsoluteError: 0.0640338659286499 | Loss: 0.0065968414695051 | Epoch: 114 | 
MeanAbsoluteError: 0.0447477661073208 | Loss: 0.0039217934980498 | Epoch: 115 | MeanAbsoluteError: 0.1092279925942421 | Loss: 0.0149924760243218 | Epoch: 116 | MeanAbsoluteError: 0.0651657059788704 | Loss: 0.0064843752617507 | Epoch: 117 | MeanAbsoluteError: 0.0558967068791389 | Loss: 0.0051072743402696 | Epoch: 118 | MeanAbsoluteError: 0.0541713573038578 | Loss: 0.0048812068141017 | Epoch: 119 | MeanAbsoluteError: 0.0478247702121735 | Loss: 0.0039559633066682 | Epoch: 120 | MeanAbsoluteError: 0.0559069253504276 | Loss: 0.0053294146752083 | Epoch: 121 | MeanAbsoluteError: 0.0407739058136940 | Loss: 0.0031051159603521 | Epoch: 122 | MeanAbsoluteError: 0.0473834499716759 | Loss: 0.0039940849130385 | Epoch: 123 | MeanAbsoluteError: 0.0672213956713676 | Loss: 0.0069225942838545 | Epoch: 124 | MeanAbsoluteError: 0.0397128053009510 | Loss: 0.0026926816821000 | Epoch: 125 | MeanAbsoluteError: 0.0421262457966805 | Loss: 0.0031038612911576 | Epoch: 126 | MeanAbsoluteError: 0.0489991120994091 | Loss: 0.0042363517231455 | Epoch: 127 | MeanAbsoluteError: 0.0649992972612381 | Loss: 0.0076609395419885 | Epoch: 128 | MeanAbsoluteError: 0.0545013882219791 | Loss: 0.0046866333455239 | Epoch: 129 | MeanAbsoluteError: 0.0658838748931885 | Loss: 0.0062721344691358 | Epoch: 130 | MeanAbsoluteError: 0.1161362454295158 | Loss: 0.0160632486896295 | Epoch: 131 | MeanAbsoluteError: 0.0429888851940632 | Loss: 0.0030397424829732 | Epoch: 132 | MeanAbsoluteError: 0.0717600211501122 | Loss: 0.0082112882825497 | Epoch: 133 | 
MeanAbsoluteError: 0.0477596297860146 | Loss: 0.0035568047069797 | Epoch: 134 | MeanAbsoluteError: 0.0966025888919830 | Loss: 0.0124366108671223 | Epoch: 135 | MeanAbsoluteError: 0.0366761945188046 | Loss: 0.0025400603695552 | Epoch: 136 | MeanAbsoluteError: 0.0331093333661556 | Loss: 0.0020121220762743 | Epoch: 137 | MeanAbsoluteError: 0.1020667105913162 | Loss: 0.0131472810906799 | Epoch: 138 | MeanAbsoluteError: 0.0379768908023834 | Loss: 0.0029952744616343 | Epoch: 139 | MeanAbsoluteError: 0.0431386791169643 | Loss: 0.0032601889075809 | Epoch: 140 | MeanAbsoluteError: 0.0567821003496647 | Loss: 0.0057409824680929 | Epoch: 141 | MeanAbsoluteError: 0.1191650107502937 | Loss: 0.0171728875782145 | Epoch: 142 | MeanAbsoluteError: 0.0774800479412079 | Loss: 0.0089175952475910 | Epoch: 143 | MeanAbsoluteError: 0.0598020628094673 | Loss: 0.0052045308249561 | Epoch: 144 | MeanAbsoluteError: 0.0384450368583202 | Loss: 0.0032622714857816 | Epoch: 145 | MeanAbsoluteError: 0.0705766901373863 | Loss: 0.0074735600623841 | Epoch: 146 | MeanAbsoluteError: 0.0377651043236256 | Loss: 0.0030269396528111 | Epoch: 147 | MeanAbsoluteError: 0.0384414307773113 | Loss: 0.0027842157226252 | Epoch: 148 | MeanAbsoluteError: 0.0748001411557198 | Loss: 0.0076437197307027 | Epoch: 149 | MeanAbsoluteError: 0.0589033141732216 | Loss: 0.0047855738329848 | Epoch: 150 | MeanAbsoluteError: 0.1219063326716423 | Loss: 0.0184260227864510 | Epoch: 151 | MeanAbsoluteError: 0.0442172549664974 | Loss: 0.0033400688430687 | Epoch: 152 | 
MeanAbsoluteError: 0.0407820343971252 | Loss: 0.0032297902048173 | Epoch: 153 | MeanAbsoluteError: 0.1101165637373924 | Loss: 0.0146920037406840 | Epoch: 154 | MeanAbsoluteError: 0.1010206118226051 | Loss: 0.0123814425284141 | Epoch: 155 | MeanAbsoluteError: 0.0507367253303528 | Loss: 0.0039507432865273 | Epoch: 156 | MeanAbsoluteError: 0.0974727421998978 | Loss: 0.0117081262808489 | Epoch: 157 | MeanAbsoluteError: 0.0589631721377373 | Loss: 0.0052411511393362 | Epoch: 158 | MeanAbsoluteError: 0.1452387720346451 | Loss: 0.0260599462413474 | Epoch: 159 | MeanAbsoluteError: 0.0664048641920090 | Loss: 0.0066059611639694 | Epoch: 160 | MeanAbsoluteError: 0.0547566302120686 | Loss: 0.0040787049618207 | Epoch: 161 | MeanAbsoluteError: 0.0603580400347710 | Loss: 0.0050262080775084 | Epoch: 162 | MeanAbsoluteError: 0.0456633009016514 | Loss: 0.0043960037812787 | Epoch: 163 | MeanAbsoluteError: 0.0365024134516716 | Loss: 0.0027348812467321 | Epoch: 164 | MeanAbsoluteError: 0.0661197900772095 | Loss: 0.0060730725159182 | Epoch: 165 | MeanAbsoluteError: 0.0351155139505863 | Loss: 0.0022520645962734 | Epoch: 166 | MeanAbsoluteError: 0.0470073819160461 | Loss: 0.0033982459357695 | Epoch: 167 | MeanAbsoluteError: 0.0500909574329853 | Loss: 0.0049097103397607 | Epoch: 168 | MeanAbsoluteError: 0.0415736697614193 | Loss: 0.0028977984881127 | Early stopping at epoch 167
Returned to Spot: Validation loss: 0.0028977984881126567
spotPython tuning: 0.0027803774972103143 [###-------] 29.57% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 64, 'dropout_prob': 0.2351929042048888, 'lr_mult': 6.968008887729215, 'batch_size': 8, 'epochs': 4096, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.782150193965759}
Epoch: 1 | MeanAbsoluteError: 0.1280488669872284 | Loss: 0.0253004161395917 | Epoch: 2 | MeanAbsoluteError: 0.1334737837314606 | Loss: 0.0279789430971601 | Epoch: 3 | MeanAbsoluteError: 0.0995069220662117 | Loss: 0.0164126129146959 | Epoch: 4 | MeanAbsoluteError: 0.1678895503282547 | Loss: 0.0405600624845216 | Epoch: 5 | MeanAbsoluteError: 0.0976141691207886 | Loss: 0.0150564208222357 | Epoch: 6 | MeanAbsoluteError: 0.1122318878769875 | Loss: 0.0183332646143084 | Epoch: 7 | MeanAbsoluteError: 0.0850501284003258 | Loss: 0.0112947229798393 | Epoch: 8 | MeanAbsoluteError: 0.0801512598991394 | Loss: 0.0102710924907833 | Epoch: 9 | MeanAbsoluteError: 0.0923251286149025 | Loss: 0.0124001003507721 | Epoch: 10 | MeanAbsoluteError: 0.0615028440952301 | Loss: 0.0060984822584463 | Epoch: 11 | 
MeanAbsoluteError: 0.0702878534793854 | Loss: 0.0076501164462809 | Epoch: 12 | MeanAbsoluteError: 0.0993769392371178 | Loss: 0.0141216895886158 | Epoch: 13 | MeanAbsoluteError: 0.0761966481804848 | Loss: 0.0092239981076043 | Epoch: 14 | MeanAbsoluteError: 0.0622380562126637 | Loss: 0.0062763270352183 | Epoch: 15 | MeanAbsoluteError: 0.0892819687724113 | Loss: 0.0127611997978468 | Epoch: 16 | MeanAbsoluteError: 0.0521567538380623 | Loss: 0.0045882948524147 | Epoch: 17 | MeanAbsoluteError: 0.0655554234981537 | Loss: 0.0067323382949996 | Epoch: 18 | MeanAbsoluteError: 0.0616429634392262 | Loss: 0.0059644641740689 | Epoch: 19 | MeanAbsoluteError: 0.0735914558172226 | Loss: 0.0085180972298411 | Epoch: 20 | MeanAbsoluteError: 0.0477383472025394 | Loss: 0.0040803931586101 | Epoch: 21 | MeanAbsoluteError: 0.0810343399643898 | Loss: 0.0090629656394748 | Epoch: 22 | 
MeanAbsoluteError: 0.0576002895832062 | Loss: 0.0051321575669327 | Epoch: 23 | MeanAbsoluteError: 0.0688341110944748 | Loss: 0.0076224570082942 | Epoch: 24 | MeanAbsoluteError: 0.1160046383738518 | Loss: 0.0161787077760030 | Epoch: 25 | MeanAbsoluteError: 0.0685739293694496 | Loss: 0.0075645515615562 | Epoch: 26 | MeanAbsoluteError: 0.0775035694241524 | Loss: 0.0107642682207944 | Epoch: 27 | MeanAbsoluteError: 0.0692961066961288 | Loss: 0.0078890667523650 | Epoch: 28 | MeanAbsoluteError: 0.0839676260948181 | Loss: 0.0096342958644719 | Epoch: 29 | MeanAbsoluteError: 0.0434610359370708 | Loss: 0.0030867701394814 | Epoch: 30 | MeanAbsoluteError: 0.0452954433858395 | Loss: 0.0038307600189000 | Epoch: 31 | MeanAbsoluteError: 0.0962066203355789 | Loss: 0.0132652499933580 | Epoch: 32 | MeanAbsoluteError: 0.0449757725000381 | Loss: 0.0036110016532659 | Epoch: 33 | 
MeanAbsoluteError: 0.1129442825913429 | Loss: 0.0165742086491695 | Epoch: 34 | MeanAbsoluteError: 0.0428076907992363 | Loss: 0.0035545669758760 | Epoch: 35 | MeanAbsoluteError: 0.0629773810505867 | Loss: 0.0073735231264053 | Epoch: 36 | MeanAbsoluteError: 0.1096665561199188 | Loss: 0.0150889123569390 | Epoch: 37 | MeanAbsoluteError: 0.0495533160865307 | Loss: 0.0038452459572765 | Epoch: 38 | MeanAbsoluteError: 0.0611972436308861 | Loss: 0.0055310433963314 | Epoch: 39 | MeanAbsoluteError: 0.0506042689085007 | Loss: 0.0049443627971126 | Epoch: 40 | MeanAbsoluteError: 0.0541235469281673 | Loss: 0.0046050169253967 | Epoch: 41 | MeanAbsoluteError: 0.0599872507154942 | Loss: 0.0065392801832212 | Epoch: 42 | MeanAbsoluteError: 0.0398138090968132 | Loss: 0.0031244482088368 | Epoch: 43 | MeanAbsoluteError: 0.1089417487382889 | Loss: 0.0154455816863399 | Epoch: 44 | 
MeanAbsoluteError: 0.0838776379823685 | Loss: 0.0104133610515610 | Epoch: 45 | MeanAbsoluteError: 0.0499248094856739 | Loss: 0.0041213047087168 | Epoch: 46 | MeanAbsoluteError: 0.0805223882198334 | Loss: 0.0088605253687619 | Epoch: 47 | MeanAbsoluteError: 0.0695538297295570 | Loss: 0.0068560986301715 | Epoch: 48 | MeanAbsoluteError: 0.0825582668185234 | Loss: 0.0083757974942656 | Epoch: 49 | MeanAbsoluteError: 0.0436743050813675 | Loss: 0.0036049466258479 | Epoch: 50 | MeanAbsoluteError: 0.0667657107114792 | Loss: 0.0062417021254078 | Epoch: 51 | MeanAbsoluteError: 0.0430079251527786 | Loss: 0.0030391261894501 | Epoch: 52 | MeanAbsoluteError: 0.0597374401986599 | Loss: 0.0058428700431250 | Epoch: 53 | MeanAbsoluteError: 0.0389463230967522 | Loss: 0.0028946975316534 | Epoch: 54 | MeanAbsoluteError: 0.0908858254551888 | Loss: 0.0110315184574574 | Epoch: 55 | 
MeanAbsoluteError: 0.0588439628481865 | Loss: 0.0056184330085096 | Epoch: 56 | MeanAbsoluteError: 0.0719805508852005 | Loss: 0.0066245953723984 | Epoch: 57 | MeanAbsoluteError: 0.0445792116224766 | Loss: 0.0032939092274510 | Epoch: 58 | MeanAbsoluteError: 0.0810113549232483 | Loss: 0.0094645172663915 | Epoch: 59 | MeanAbsoluteError: 0.0440575778484344 | Loss: 0.0034288220221673 | Epoch: 60 | MeanAbsoluteError: 0.0770894587039948 | Loss: 0.0088410916566653 | Epoch: 61 | MeanAbsoluteError: 0.0957575589418411 | Loss: 0.0118277445925694 | Epoch: 62 | MeanAbsoluteError: 0.0537270978093147 | Loss: 0.0038200731689454 | Epoch: 63 | MeanAbsoluteError: 0.0627573877573013 | Loss: 0.0065737374610954 | Epoch: 64 | MeanAbsoluteError: 0.0405190512537956 | Loss: 0.0023112296950881 | Epoch: 65 | MeanAbsoluteError: 0.0447292849421501 | Loss: 0.0034365914685431 | Epoch: 66 | 
MeanAbsoluteError: 0.0370902493596077 | Loss: 0.0025103289486938 | Epoch: 67 | MeanAbsoluteError: 0.0467300936579704 | Loss: 0.0037235669013554 | Epoch: 68 | MeanAbsoluteError: 0.0622771382331848 | Loss: 0.0060786495971689 | Epoch: 69 | MeanAbsoluteError: 0.0511438809335232 | Loss: 0.0048975037122881 | Epoch: 70 | MeanAbsoluteError: 0.0457096174359322 | Loss: 0.0036254391307011 | Epoch: 71 | MeanAbsoluteError: 0.0371825136244297 | Loss: 0.0024233760938698 | Epoch: 72 | MeanAbsoluteError: 0.0325520411133766 | Loss: 0.0022308883694917 | Epoch: 73 | MeanAbsoluteError: 0.0354342833161354 | Loss: 0.0023311982988257 | Epoch: 74 | MeanAbsoluteError: 0.0755175128579140 | Loss: 0.0071544392757412 | Epoch: 75 | MeanAbsoluteError: 0.0688321739435196 | Loss: 0.0065080833155662 | Epoch: 76 | MeanAbsoluteError: 0.0441884920001030 | Loss: 0.0035806352925168 | Epoch: 77 | 
MeanAbsoluteError: 0.0608682259917259 | Loss: 0.0064460895557300 | Epoch: 78 | MeanAbsoluteError: 0.1056588217616081 | Loss: 0.0141662695861765 | Epoch: 79 | MeanAbsoluteError: 0.0544046014547348 | Loss: 0.0045656546319247 | Epoch: 80 | MeanAbsoluteError: 0.0615233182907104 | Loss: 0.0068658176981109 | Epoch: 81 | MeanAbsoluteError: 0.0413691177964211 | Loss: 0.0027475183290478 | Epoch: 82 | MeanAbsoluteError: 0.0872901380062103 | Loss: 0.0093165433499962 | Epoch: 83 | MeanAbsoluteError: 0.0505118407309055 | Loss: 0.0041662386042605 | Epoch: 84 | MeanAbsoluteError: 0.0569009669125080 | Loss: 0.0043925262074672 | Epoch: 85 | MeanAbsoluteError: 0.0401829034090042 | Loss: 0.0031519215714836 | Epoch: 86 | MeanAbsoluteError: 0.0353415161371231 | Loss: 0.0023559721058088 | Epoch: 87 | MeanAbsoluteError: 0.0761258900165558 | Loss: 0.0072071147151291 | Epoch: 88 | 
MeanAbsoluteError: 0.0510046966373920 | Loss: 0.0047883932757510 | Epoch: 89 | MeanAbsoluteError: 0.1294278502464294 | Loss: 0.0202384955666371 | Epoch: 90 | MeanAbsoluteError: 0.0553274787962437 | Loss: 0.0042496157448592 | Epoch: 91 | MeanAbsoluteError: 0.0403682515025139 | Loss: 0.0031723359080436 | Epoch: 92 | MeanAbsoluteError: 0.0636694952845573 | Loss: 0.0050504348473623 | Epoch: 93 | MeanAbsoluteError: 0.0646803155541420 | Loss: 0.0060243869359654 | Epoch: 94 | MeanAbsoluteError: 0.0554468035697937 | Loss: 0.0045580588998028 | Epoch: 95 | MeanAbsoluteError: 0.0963396802544594 | Loss: 0.0112993662172046 | Epoch: 96 | MeanAbsoluteError: 0.0451106913387775 | Loss: 0.0039018462718415 | Epoch: 97 | MeanAbsoluteError: 0.0446762479841709 | Loss: 0.0032322102633771 | Epoch: 98 | MeanAbsoluteError: 0.0720705389976501 | Loss: 0.0066680397139862 | Epoch: 99 | 
MeanAbsoluteError: 0.0421319045126438 | Loss: 0.0026804336368131 | Epoch: 100 | MeanAbsoluteError: 0.0331162996590137 | Loss: 0.0019700214324985 | Epoch: 101 | MeanAbsoluteError: 0.0338616706430912 | Loss: 0.0020186901682265 | Epoch: 102 | MeanAbsoluteError: 0.0489301793277264 | Loss: 0.0038331412514182 | Epoch: 103 | MeanAbsoluteError: 0.0523779653012753 | Loss: 0.0035395022867689 | Epoch: 104 | MeanAbsoluteError: 0.0355413518846035 | Loss: 0.0023978156471123 | Epoch: 105 | MeanAbsoluteError: 0.0702407807111740 | Loss: 0.0059826449295016 | Epoch: 106 | MeanAbsoluteError: 0.0411857478320599 | Loss: 0.0029900637294448 | Epoch: 107 | MeanAbsoluteError: 0.0296129919588566 | Loss: 0.0014706385845784 | Epoch: 108 | MeanAbsoluteError: 0.0782948657870293 | Loss: 0.0083497132750620 | Epoch: 109 | MeanAbsoluteError: 0.0470937825739384 | Loss: 0.0040273399760113 | Epoch: 110 | 
MeanAbsoluteError: 0.0337763130664825 | Loss: 0.0021031257795250 | Epoch: 111 | MeanAbsoluteError: 0.0396328940987587 | Loss: 0.0025670563459004 | Epoch: 112 | MeanAbsoluteError: 0.0743226259946823 | Loss: 0.0086976130137612 | Epoch: 113 | MeanAbsoluteError: 0.0778123438358307 | Loss: 0.0088615450199301 | Epoch: 114 | MeanAbsoluteError: 0.0555018410086632 | Loss: 0.0039154198449595 | Epoch: 115 | MeanAbsoluteError: 0.0488681420683861 | Loss: 0.0043505307832292 | Epoch: 116 | MeanAbsoluteError: 0.0371855981647968 | Loss: 0.0024145178735795 | Epoch: 117 | MeanAbsoluteError: 0.0552457235753536 | Loss: 0.0042421438571948 | Epoch: 118 | MeanAbsoluteError: 0.0792679935693741 | Loss: 0.0088399904657547 | Epoch: 119 | MeanAbsoluteError: 0.0444954298436642 | Loss: 0.0030921813572365 | Epoch: 120 | MeanAbsoluteError: 0.0847556218504906 | Loss: 0.0093182415248042 | Epoch: 121 | 
MeanAbsoluteError: 0.0438450276851654 | Loss: 0.0034107182567057 | Epoch: 122 | MeanAbsoluteError: 0.0827162563800812 | Loss: 0.0088543212470157 | Epoch: 123 | MeanAbsoluteError: 0.0586955696344376 | Loss: 0.0050868457550869 | Epoch: 124 | MeanAbsoluteError: 0.0503682270646095 | Loss: 0.0038681681862248 | Epoch: 125 | MeanAbsoluteError: 0.0391917861998081 | Loss: 0.0029117173475434 | Epoch: 126 | MeanAbsoluteError: 0.0408752001821995 | Loss: 0.0030337318833182 | Epoch: 127 | MeanAbsoluteError: 0.0426731333136559 | Loss: 0.0036698993192802 | Epoch: 128 | MeanAbsoluteError: 0.0424721464514732 | Loss: 0.0029581928392872 | Epoch: 129 | MeanAbsoluteError: 0.0396302454173565 | Loss: 0.0030695593113227 | Epoch: 130 | MeanAbsoluteError: 0.0540635436773300 | Loss: 0.0048872098218693 | Epoch: 131 | MeanAbsoluteError: 0.0452549606561661 | Loss: 0.0034576826897376 | Epoch: 132 | 
MeanAbsoluteError: 0.0472671985626221 | Loss: 0.0031750638338149 | Epoch: 133 | MeanAbsoluteError: 0.0461972095072269 | Loss: 0.0038974648647893 | Epoch: 134 | MeanAbsoluteError: 0.0531916730105877 | Loss: 0.0041500444854855 | Epoch: 135 | MeanAbsoluteError: 0.0623468384146690 | Loss: 0.0059308982423605 | Epoch: 136 | MeanAbsoluteError: 0.0598323568701744 | Loss: 0.0048306317705857 | Epoch: 137 | MeanAbsoluteError: 0.0755465179681778 | Loss: 0.0081434754078816 | Epoch: 138 | MeanAbsoluteError: 0.0388055667281151 | Loss: 0.0027088070606911 | Epoch: 139 | MeanAbsoluteError: 0.0278248786926270 | Loss: 0.0015749900673032 | Early stopping at epoch 138
Returned to Spot: Validation loss: 0.0015749900673032052
spotPython tuning: 0.0015749900673032052 [####------] 35.05% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 64, 'dropout_prob': 0.23942418265853882, 'lr_mult': 6.976137270628877, 'batch_size': 8, 'epochs': 2048, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 1.0}
Epoch: 1 | MeanAbsoluteError: 0.1373207122087479 | Loss: 0.0290901469507892 | Epoch: 2 | MeanAbsoluteError: 0.1151301190257072 | Loss: 0.0208530271254284 | Epoch: 3 | MeanAbsoluteError: 0.1021575778722763 | Loss: 0.0169799693884622 | Epoch: 4 | MeanAbsoluteError: 0.1281262189149857 | Loss: 0.0251262686460426 | Epoch: 5 | MeanAbsoluteError: 0.1380035281181335 | Loss: 0.0277223240731186 | Epoch: 6 | MeanAbsoluteError: 0.1738124787807465 | Loss: 0.0402132439868231 | Epoch: 7 | MeanAbsoluteError: 0.0786591991782188 | Loss: 0.0099527676234414 | Epoch: 8 | MeanAbsoluteError: 0.1348630338907242 | Loss: 0.0249167605254211 | Epoch: 9 | MeanAbsoluteError: 0.0786281377077103 | Loss: 0.0101906359073167 | Epoch: 10 | MeanAbsoluteError: 0.0720704048871994 | Loss: 0.0087043899724162 | Epoch: 11 | 
MeanAbsoluteError: 0.0821970105171204 | Loss: 0.0117538912332078 | Epoch: 12 | MeanAbsoluteError: 0.0720719620585442 | Loss: 0.0081498909337250 | Epoch: 13 | MeanAbsoluteError: 0.0914427712559700 | Loss: 0.0134021651342903 | Epoch: 14 | MeanAbsoluteError: 0.0604836158454418 | Loss: 0.0064660727542727 | Epoch: 15 | MeanAbsoluteError: 0.1227761730551720 | Loss: 0.0189443572644929 | Epoch: 16 | MeanAbsoluteError: 0.0776167437434196 | Loss: 0.0095353524298652 | Epoch: 17 | MeanAbsoluteError: 0.1327582448720932 | Loss: 0.0210672246145183 | Epoch: 18 | MeanAbsoluteError: 0.0567357204854488 | Loss: 0.0051606175777698 | Epoch: 19 | MeanAbsoluteError: 0.1511732637882233 | Loss: 0.0266132996858735 | Epoch: 20 | MeanAbsoluteError: 0.0915163531899452 | Loss: 0.0115650985144863 | Epoch: 21 | MeanAbsoluteError: 0.1944212019443512 | Loss: 0.0431715327952253 | Epoch: 22 | 
MeanAbsoluteError: 0.0776900351047516 | Loss: 0.0092637478312674 | Epoch: 23 | MeanAbsoluteError: 0.1017314046621323 | Loss: 0.0130802957022465 | Epoch: 24 | MeanAbsoluteError: 0.0702431946992874 | Loss: 0.0079766552601206 | Epoch: 25 | MeanAbsoluteError: 0.0759479999542236 | Loss: 0.0089402077597027 | Epoch: 26 | MeanAbsoluteError: 0.1010381728410721 | Loss: 0.0135479892824629 | Epoch: 27 | MeanAbsoluteError: 0.0629414469003677 | Loss: 0.0075543029417627 | Epoch: 28 | MeanAbsoluteError: 0.0660389810800552 | Loss: 0.0074350764595070 | Epoch: 29 | MeanAbsoluteError: 0.0734662190079689 | Loss: 0.0079136232196010 | Epoch: 30 | MeanAbsoluteError: 0.1198182776570320 | Loss: 0.0175215078419761 | Epoch: 31 | MeanAbsoluteError: 0.0507611557841301 | Loss: 0.0050693701824026 | Epoch: 32 | MeanAbsoluteError: 0.0783642455935478 | Loss: 0.0097361844596698 | Epoch: 33 | 
MeanAbsoluteError: 0.0479898415505886 | Loss: 0.0049552081894179 | Epoch: 34 | MeanAbsoluteError: 0.0539882034063339 | Loss: 0.0054689060290050 | Epoch: 35 | MeanAbsoluteError: 0.0807905793190002 | Loss: 0.0089357816920567 | Epoch: 36 | MeanAbsoluteError: 0.0684272199869156 | Loss: 0.0069342701830656 | Epoch: 37 | MeanAbsoluteError: 0.0732860788702965 | Loss: 0.0082748149962802 | Epoch: 38 | MeanAbsoluteError: 0.0571042932569981 | Loss: 0.0059066842866167 | Epoch: 39 | MeanAbsoluteError: 0.0512213855981827 | Loss: 0.0048561193321611 | Epoch: 40 | MeanAbsoluteError: 0.0837457105517387 | Loss: 0.0094700321359070 | Epoch: 41 | MeanAbsoluteError: 0.0575413070619106 | Loss: 0.0048777110396737 | Epoch: 42 | MeanAbsoluteError: 0.0526864416897297 | Loss: 0.0048246331617089 | Epoch: 43 | MeanAbsoluteError: 0.0614626072347164 | Loss: 0.0069990557416244 | Epoch: 44 | 
MeanAbsoluteError: 0.0594785176217556 | Loss: 0.0050924091943000 | Epoch: 45 | MeanAbsoluteError: 0.0704752355813980 | Loss: 0.0082597155307763 | Epoch: 46 | MeanAbsoluteError: 0.0517466664314270 | Loss: 0.0047415125820982 | Epoch: 47 | MeanAbsoluteError: 0.0765812993049622 | Loss: 0.0090814702899048 | Epoch: 48 | MeanAbsoluteError: 0.1360420137643814 | Loss: 0.0211058067353932 | Epoch: 49 | MeanAbsoluteError: 0.0875368267297745 | Loss: 0.0099530248277772 | Epoch: 50 | MeanAbsoluteError: 0.0419326536357403 | Loss: 0.0031251310796697 | Epoch: 51 | MeanAbsoluteError: 0.0729193463921547 | Loss: 0.0090823841900075 | Epoch: 52 | MeanAbsoluteError: 0.0560189187526703 | Loss: 0.0052663175585239 | Epoch: 53 | MeanAbsoluteError: 0.0532870218157768 | Loss: 0.0046469875317263 | Epoch: 54 | MeanAbsoluteError: 0.0679176598787308 | Loss: 0.0066944928410904 | Epoch: 55 | 
MeanAbsoluteError: 0.0700984075665474 | Loss: 0.0086410737988588 | Epoch: 56 | MeanAbsoluteError: 0.0994731262326241 | Loss: 0.0118115032459364 | Epoch: 57 | MeanAbsoluteError: 0.0381972566246986 | Loss: 0.0024382840025570 | Epoch: 58 | MeanAbsoluteError: 0.0496081449091434 | Loss: 0.0044191905916178 | Epoch: 59 | MeanAbsoluteError: 0.0580578297376633 | Loss: 0.0056172196453094 | Epoch: 60 | MeanAbsoluteError: 0.0579426325857639 | Loss: 0.0049367234858341 | Epoch: 61 | MeanAbsoluteError: 0.0579236336052418 | Loss: 0.0048625994822942 | Epoch: 62 | MeanAbsoluteError: 0.0698076784610748 | Loss: 0.0070559635856434 | Epoch: 63 | MeanAbsoluteError: 0.0458428598940372 | Loss: 0.0031739930518119 | Epoch: 64 | MeanAbsoluteError: 0.0711144357919693 | Loss: 0.0084120692427907 | Epoch: 65 | MeanAbsoluteError: 0.0739658996462822 | Loss: 0.0075800590903351 | Epoch: 66 | 
MeanAbsoluteError: 0.0515555888414383 | Loss: 0.0038519353256561 | Epoch: 67 | MeanAbsoluteError: 0.0562985911965370 | Loss: 0.0051043309305035 | Epoch: 68 | MeanAbsoluteError: 0.0759759917855263 | Loss: 0.0080789221132076 | Epoch: 69 | MeanAbsoluteError: 0.0587508007884026 | Loss: 0.0051190678587821 | Epoch: 70 | MeanAbsoluteError: 0.0798396468162537 | Loss: 0.0077635863869402 | Epoch: 71 | MeanAbsoluteError: 0.0747508555650711 | Loss: 0.0068849111956201 | Epoch: 72 | MeanAbsoluteError: 0.0652717873454094 | Loss: 0.0064287782573190 | Epoch: 73 | MeanAbsoluteError: 0.0595342554152012 | Loss: 0.0053930468796017 | Epoch: 74 | MeanAbsoluteError: 0.0728066936135292 | Loss: 0.0068330884310662 | Epoch: 75 | MeanAbsoluteError: 0.0495741628110409 | Loss: 0.0035115348138405 | Epoch: 76 | MeanAbsoluteError: 0.0948354378342628 | Loss: 0.0118422090492554 | Epoch: 77 | 
MeanAbsoluteError: 0.0946420505642891 | Loss: 0.0128060770833767 | Epoch: 78 | MeanAbsoluteError: 0.0822100862860680 | Loss: 0.0092633555545227 | Epoch: 79 | MeanAbsoluteError: 0.0817655175924301 | Loss: 0.0088054397339491 | Epoch: 80 | MeanAbsoluteError: 0.0636623874306679 | Loss: 0.0065843918556838 | Epoch: 81 | MeanAbsoluteError: 0.0317629687488079 | Loss: 0.0020000289568040 | Epoch: 82 | MeanAbsoluteError: 0.0780631974339485 | Loss: 0.0095268059613820 | Epoch: 83 | MeanAbsoluteError: 0.0641248673200607 | Loss: 0.0060612846741845 | Epoch: 84 | MeanAbsoluteError: 0.0501060970127583 | Loss: 0.0040116720935514 | Epoch: 85 | MeanAbsoluteError: 0.0908658429980278 | Loss: 0.0101530132447614 | Epoch: 86 | MeanAbsoluteError: 0.0416676327586174 | Loss: 0.0028101257921662 | Epoch: 87 | MeanAbsoluteError: 0.0708657428622246 | Loss: 0.0072277950637631 | Epoch: 88 | 
MeanAbsoluteError: 0.0594784542918205 | Loss: 0.0049593767770076 | Epoch: 89 | MeanAbsoluteError: 0.0595595166087151 | Loss: 0.0054605067217428 | Epoch: 90 | MeanAbsoluteError: 0.0435383878648281 | Loss: 0.0031040151830223 | Epoch: 91 | MeanAbsoluteError: 0.0604440830647945 | Loss: 0.0052502709563429 | Epoch: 92 | MeanAbsoluteError: 0.0693944394588470 | Loss: 0.0066442245519475 | Epoch: 93 | MeanAbsoluteError: 0.0542870387434959 | Loss: 0.0046750089876648 | Epoch: 94 | MeanAbsoluteError: 0.0424138493835926 | Loss: 0.0034132792283536 | Epoch: 95 | MeanAbsoluteError: 0.0652002319693565 | Loss: 0.0061544071925853 | Epoch: 96 | MeanAbsoluteError: 0.0640346333384514 | Loss: 0.0056955341072018 | Epoch: 97 | MeanAbsoluteError: 0.0407236665487289 | Loss: 0.0030216270652569 | Epoch: 98 | MeanAbsoluteError: 0.0468005985021591 | Loss: 0.0037034830556398 | Epoch: 99 | 
MeanAbsoluteError: 0.0502535887062550 | Loss: 0.0037051919406574 | Epoch: 100 | MeanAbsoluteError: 0.0528099611401558 | Loss: 0.0042390418024489 | Epoch: 101 | MeanAbsoluteError: 0.0541548095643520 | Loss: 0.0047637117738639 | Epoch: 102 | MeanAbsoluteError: 0.0543938502669334 | Loss: 0.0042454216041063 | Epoch: 103 | MeanAbsoluteError: 0.0362024642527103 | Loss: 0.0024784746913754 | Epoch: 104 | MeanAbsoluteError: 0.0273931063711643 | Loss: 0.0015478679589777 | Epoch: 105 | MeanAbsoluteError: 0.0557534918189049 | Loss: 0.0054427933462552 | Epoch: 106 | MeanAbsoluteError: 0.0591906346380711 | Loss: 0.0054815774783492 | Epoch: 107 | MeanAbsoluteError: 0.0545259676873684 | Loss: 0.0047548132501297 | Epoch: 108 | MeanAbsoluteError: 0.0539598017930984 | Loss: 0.0047215436995765 | Epoch: 109 | MeanAbsoluteError: 0.0426751114428043 | Loss: 0.0027875385743468 | Epoch: 110 | 
MeanAbsoluteError: 0.0717659667134285 | Loss: 0.0067478199795771 | Epoch: 111 | MeanAbsoluteError: 0.0702719911932945 | Loss: 0.0077095385885944 | Epoch: 112 | MeanAbsoluteError: 0.0749437734484673 | Loss: 0.0069400588307824 | Epoch: 113 | MeanAbsoluteError: 0.0455460622906685 | Loss: 0.0028794429994090 | Epoch: 114 | MeanAbsoluteError: 0.0578785389661789 | Loss: 0.0056057413519164 | Epoch: 115 | MeanAbsoluteError: 0.0499950610101223 | Loss: 0.0044586520066093 | Epoch: 116 | MeanAbsoluteError: 0.0714515373110771 | Loss: 0.0068380793397266 | Epoch: 117 | MeanAbsoluteError: 0.0750313028693199 | Loss: 0.0085284785845464 | Epoch: 118 | MeanAbsoluteError: 0.0530318617820740 | Loss: 0.0045124245011003 | Epoch: 119 | MeanAbsoluteError: 0.0648170113563538 | Loss: 0.0053768776063072 | Epoch: 120 | MeanAbsoluteError: 0.0452833287417889 | Loss: 0.0036083054652217 | Epoch: 121 | 
MeanAbsoluteError: 0.0310891922563314 | Loss: 0.0018111873742830 | Epoch: 122 | MeanAbsoluteError: 0.0398172326385975 | Loss: 0.0025284939168303 | Epoch: 123 | MeanAbsoluteError: 0.0467073284089565 | Loss: 0.0035251385615036 | Epoch: 124 | MeanAbsoluteError: 0.0539847500622272 | Loss: 0.0040104426321034 | Epoch: 125 | MeanAbsoluteError: 0.0328388474881649 | Loss: 0.0021302809542057 | Epoch: 126 | MeanAbsoluteError: 0.0662022531032562 | Loss: 0.0055217537477514 | Epoch: 127 | MeanAbsoluteError: 0.0807016268372536 | Loss: 0.0078679452233605 | Epoch: 128 | MeanAbsoluteError: 0.0532350949943066 | Loss: 0.0047227324654446 | Epoch: 129 | MeanAbsoluteError: 0.0597150214016438 | Loss: 0.0047032300223547 | Epoch: 130 | MeanAbsoluteError: 0.0824807509779930 | Loss: 0.0096908805855109 | Epoch: 131 | MeanAbsoluteError: 0.0340831987559795 | Loss: 0.0020544060083155 | Epoch: 132 | 
MeanAbsoluteError: 0.0502762682735920 | Loss: 0.0035112096260204 | Epoch: 133 | MeanAbsoluteError: 0.0496982857584953 | Loss: 0.0033150974226086 | Epoch: 134 | MeanAbsoluteError: 0.0469608977437019 | Loss: 0.0032235137860928 | Epoch: 135 | MeanAbsoluteError: 0.0285246539860964 | Loss: 0.0016780797565221 | Epoch: 136 | MeanAbsoluteError: 0.0452772825956345 | Loss: 0.0028352634583012 | Early stopping at epoch 135
Returned to Spot: Validation loss: 0.0028352634583011663
spotPython tuning: 0.0015749900673032052 [####------] 40.68% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 128, 'dropout_prob': 0.23729096390990712, 'lr_mult': 6.964592743168394, 'batch_size': 8, 'epochs': 8192, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.8876367905221806}
Epoch: 1 | MeanAbsoluteError: 0.1846168488264084 | Loss: 0.0475236728395286 | Epoch: 2 | MeanAbsoluteError: 0.1135727837681770 | Loss: 0.0202281342108587 | Epoch: 3 | MeanAbsoluteError: 0.1037082448601723 | Loss: 0.0167080664786657 | Epoch: 4 | MeanAbsoluteError: 0.0970366671681404 | Loss: 0.0151310238901428 | Epoch: 5 | MeanAbsoluteError: 0.1765984445810318 | Loss: 0.0397344205136362 | Epoch: 6 | MeanAbsoluteError: 0.1362823545932770 | Loss: 0.0251055429199416 | Epoch: 7 | MeanAbsoluteError: 0.0783399045467377 | Loss: 0.0093899888268329 | Epoch: 8 | MeanAbsoluteError: 0.1085221990942955 | Loss: 0.0180377173360045 | Epoch: 9 | 
MeanAbsoluteError: 0.0913195833563805 | Loss: 0.0125395146927698 | Epoch: 10 | MeanAbsoluteError: 0.0921043083071709 | Loss: 0.0130244047797628 | Epoch: 11 | MeanAbsoluteError: 0.1049204319715500 | Loss: 0.0156720058110199 | Epoch: 12 | MeanAbsoluteError: 0.0725723356008530 | Loss: 0.0077846035863714 | Epoch: 13 | MeanAbsoluteError: 0.0847227647900581 | Loss: 0.0097446370698316 | Epoch: 14 | MeanAbsoluteError: 0.0656421482563019 | Loss: 0.0071553416354092 | Epoch: 15 | MeanAbsoluteError: 0.0648363009095192 | Loss: 0.0065593038085162 | Epoch: 16 | MeanAbsoluteError: 0.0519374981522560 | Loss: 0.0050086703114702 | Epoch: 17 | MeanAbsoluteError: 0.1071487590670586 | Loss: 0.0151281531311964 | Epoch: 18 | 
MeanAbsoluteError: 0.0743255093693733 | Loss: 0.0086562071197764 | Epoch: 19 | MeanAbsoluteError: 0.0662081763148308 | Loss: 0.0067797677812019 | Epoch: 20 | MeanAbsoluteError: 0.0715675652027130 | Loss: 0.0077863692269219 | Epoch: 21 | MeanAbsoluteError: 0.0704767405986786 | Loss: 0.0080083957475022 | Epoch: 22 | MeanAbsoluteError: 0.0870988368988037 | Loss: 0.0114696123943615 | Epoch: 23 | MeanAbsoluteError: 0.0868550091981888 | Loss: 0.0114598629971672 | Epoch: 24 | MeanAbsoluteError: 0.1685353070497513 | Loss: 0.0327016166166255 | Epoch: 25 | MeanAbsoluteError: 0.0522195920348167 | Loss: 0.0049510571437790 | Epoch: 26 | MeanAbsoluteError: 0.0620957575738430 | Loss: 0.0064768839786810 | Epoch: 27 | 
MeanAbsoluteError: 0.0600542947649956 | Loss: 0.0056287456628572 | Epoch: 28 | MeanAbsoluteError: 0.0471992939710617 | Loss: 0.0038627123515318 | Epoch: 29 | MeanAbsoluteError: 0.0509871654212475 | Loss: 0.0045068260208753 | Epoch: 30 | MeanAbsoluteError: 0.0424724668264389 | Loss: 0.0032064807218328 | Epoch: 31 | MeanAbsoluteError: 0.0424161180853844 | Loss: 0.0033172286333100 | Epoch: 32 | MeanAbsoluteError: 0.0495606586337090 | Loss: 0.0043401943280754 | Epoch: 33 | MeanAbsoluteError: 0.1491915136575699 | Loss: 0.0253031320722872 | Epoch: 34 | MeanAbsoluteError: 0.0565737262368202 | Loss: 0.0048266016528942 | Epoch: 35 | MeanAbsoluteError: 0.0634795278310776 | Loss: 0.0066573060436272 | Epoch: 36 | 
MeanAbsoluteError: 0.0576304197311401 | Loss: 0.0059476012791397 | Epoch: 37 | MeanAbsoluteError: 0.0625688582658768 | Loss: 0.0069332529153479 | Epoch: 38 | MeanAbsoluteError: 0.0664928704500198 | Loss: 0.0060668741628577 | Epoch: 39 | MeanAbsoluteError: 0.0525523610413074 | Loss: 0.0044337288066010 | Epoch: 40 | MeanAbsoluteError: 0.0677904710173607 | Loss: 0.0069099642201572 | Epoch: 41 | MeanAbsoluteError: 0.0387668646872044 | Loss: 0.0028004525447614 | Epoch: 42 | MeanAbsoluteError: 0.0640056207776070 | Loss: 0.0055866747647279 | Epoch: 43 | MeanAbsoluteError: 0.0664677396416664 | Loss: 0.0070150207397283 | Epoch: 44 | MeanAbsoluteError: 0.0569753311574459 | Loss: 0.0058350905984346 | Epoch: 45 | 
MeanAbsoluteError: 0.0372076220810413 | Loss: 0.0027598531696161 | Epoch: 46 | MeanAbsoluteError: 0.0503042638301849 | Loss: 0.0046355291070588 | Epoch: 47 | MeanAbsoluteError: 0.0472685396671295 | Loss: 0.0038075611978696 | Epoch: 48 | MeanAbsoluteError: 0.0715990737080574 | Loss: 0.0080382619604566 | Epoch: 49 | MeanAbsoluteError: 0.0619497187435627 | Loss: 0.0061720572718370 | Epoch: 50 | MeanAbsoluteError: 0.0433632731437683 | Loss: 0.0036184285004550 | Epoch: 51 | MeanAbsoluteError: 0.0611442811787128 | Loss: 0.0059249510768017 | Epoch: 52 | MeanAbsoluteError: 0.0832961946725845 | Loss: 0.0088143989345745 | Epoch: 53 | MeanAbsoluteError: 0.0573604591190815 | Loss: 0.0059560677925076 | Epoch: 54 | 
MeanAbsoluteError: 0.0484810285270214 | Loss: 0.0041846716883715 | Epoch: 55 | MeanAbsoluteError: 0.0583311840891838 | Loss: 0.0057785612941524 | Epoch: 56 | MeanAbsoluteError: 0.0460194572806358 | Loss: 0.0033883700410737 | Epoch: 57 | MeanAbsoluteError: 0.0405646488070488 | Loss: 0.0026744311816353 | Epoch: 58 | MeanAbsoluteError: 0.0345368012785912 | Loss: 0.0021086073676614 | Epoch: 59 | MeanAbsoluteError: 0.0405582189559937 | Loss: 0.0029996804866977 | Epoch: 60 | MeanAbsoluteError: 0.0389610975980759 | Loss: 0.0023318826937803 | Epoch: 61 | MeanAbsoluteError: 0.0683389604091644 | Loss: 0.0073084490508527 | Epoch: 62 | MeanAbsoluteError: 0.0418119095265865 | Loss: 0.0030845483507667 | Epoch: 63 | 
MeanAbsoluteError: 0.0525353252887726 | Loss: 0.0044632666303139 | Epoch: 64 | MeanAbsoluteError: 0.0355718694627285 | Loss: 0.0021846643419275 | Epoch: 65 | MeanAbsoluteError: 0.0659905374050140 | Loss: 0.0067877583358878 | Epoch: 66 | MeanAbsoluteError: 0.0404588617384434 | Loss: 0.0027845688348048 | Epoch: 67 | MeanAbsoluteError: 0.0601534210145473 | Loss: 0.0053463946188506 | Epoch: 68 | MeanAbsoluteError: 0.0633920058608055 | Loss: 0.0057347475759391 | Epoch: 69 | MeanAbsoluteError: 0.0542432069778442 | Loss: 0.0050068851192727 | Epoch: 70 | MeanAbsoluteError: 0.0689267441630363 | Loss: 0.0063654955317217 | Epoch: 71 | MeanAbsoluteError: 0.0455852895975113 | Loss: 0.0035874704052204 | Epoch: 72 | 
MeanAbsoluteError: 0.0508402325212955 | Loss: 0.0044982072584772 | Epoch: 73 | MeanAbsoluteError: 0.0344296880066395 | Loss: 0.0021882282974395 | Epoch: 74 | MeanAbsoluteError: 0.0486868172883987 | Loss: 0.0045665358943791 | Epoch: 75 | MeanAbsoluteError: 0.0559430047869682 | Loss: 0.0051399107599680 | Epoch: 76 | MeanAbsoluteError: 0.0473542846739292 | Loss: 0.0039546054735853 | Epoch: 77 | MeanAbsoluteError: 0.0374723821878433 | Loss: 0.0024289596292778 | Epoch: 78 | MeanAbsoluteError: 0.0781984776258469 | Loss: 0.0078324609999790 | Epoch: 79 | MeanAbsoluteError: 0.0481427200138569 | Loss: 0.0043497297967980 | Epoch: 80 | MeanAbsoluteError: 0.0432345941662788 | Loss: 0.0030157357794355 | Epoch: 81 | 
MeanAbsoluteError: 0.0494408309459686 | Loss: 0.0033924148822399 | Epoch: 82 | MeanAbsoluteError: 0.0491342842578888 | Loss: 0.0035853206584426 | Epoch: 83 | MeanAbsoluteError: 0.0502467826008797 | Loss: 0.0044395880816553 | Epoch: 84 | MeanAbsoluteError: 0.0388470813632011 | Loss: 0.0030126442441925 | Epoch: 85 | MeanAbsoluteError: 0.0339125245809555 | Loss: 0.0022073491617400 | Epoch: 86 | MeanAbsoluteError: 0.0428074188530445 | Loss: 0.0033020204274707 | Epoch: 87 | MeanAbsoluteError: 0.0413237325847149 | Loss: 0.0030672995237278 | Epoch: 88 | MeanAbsoluteError: 0.0561369135975838 | Loss: 0.0042504556844697 | Epoch: 89 | MeanAbsoluteError: 0.0642394497990608 | Loss: 0.0061922086415028 | Epoch: 90 | 
MeanAbsoluteError: 0.0375278778374195 | Loss: 0.0024280499844616 | Early stopping at epoch 89
Returned to Spot: Validation loss: 0.002428049984461579
spotPython tuning: 0.0015749900673032052 [#####-----] 45.41% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 16, 'dropout_prob': 0.3840991438077573, 'lr_mult': 4.5930878663522385, 'batch_size': 4, 'epochs': 128, 'k_folds': 1, 'patience': 64, 'optimizer': 'Adam', 'sgd_momentum': 0.838117477367509}
Epoch: 1 | MeanAbsoluteError: 0.1899684816598892 | Loss: 0.0559097968414426 | Epoch: 2 | MeanAbsoluteError: 0.1403177380561829 | Loss: 0.0319577923479180 | Epoch: 3 | MeanAbsoluteError: 0.1384312212467194 | Loss: 0.0289512749575078 | Epoch: 4 | MeanAbsoluteError: 0.1277535855770111 | Loss: 0.0269370270272096 | Epoch: 5 | MeanAbsoluteError: 0.1260300129652023 | Loss: 0.0257252861233428 | Epoch: 6 | 
MeanAbsoluteError: 0.1083279401063919 | Loss: 0.0189164832886308 | Epoch: 7 | MeanAbsoluteError: 0.1032298952341080 | Loss: 0.0161577335201825 | Epoch: 8 | MeanAbsoluteError: 0.0934520140290260 | Loss: 0.0141346140642418 | Epoch: 9 | MeanAbsoluteError: 0.0880697518587112 | Loss: 0.0134339158042955 | Epoch: 10 | MeanAbsoluteError: 0.0860692486166954 | Loss: 0.0119047026196495 | Epoch: 11 | MeanAbsoluteError: 0.0802751928567886 | Loss: 0.0103254485549405 | Epoch: 12 | 
MeanAbsoluteError: 0.0760179534554482 | Loss: 0.0099354736728128 | Epoch: 13 | MeanAbsoluteError: 0.0904750153422356 | Loss: 0.0125070607801899 | Epoch: 14 | MeanAbsoluteError: 0.0713906958699226 | Loss: 0.0087866275136669 | Epoch: 15 | MeanAbsoluteError: 0.0719276592135429 | Loss: 0.0095193057681900 | Epoch: 16 | MeanAbsoluteError: 0.0718683972954750 | Loss: 0.0095656993667944 | Epoch: 17 | MeanAbsoluteError: 0.0713618919253349 | Loss: 0.0093692339506621 | Epoch: 18 | 
MeanAbsoluteError: 0.0773814097046852 | Loss: 0.0116333763541964 | Epoch: 19 | MeanAbsoluteError: 0.0669969767332077 | Loss: 0.0083297829252357 | Epoch: 20 | MeanAbsoluteError: 0.0579551011323929 | Loss: 0.0063471133642209 | Epoch: 21 | MeanAbsoluteError: 0.0679945126175880 | Loss: 0.0089524395142992 | Epoch: 22 | MeanAbsoluteError: 0.0600271150469780 | Loss: 0.0061123519802156 | Epoch: 23 | MeanAbsoluteError: 0.0721631422638893 | Loss: 0.0090857191709802 | Epoch: 24 | 
MeanAbsoluteError: 0.0573097690939903 | Loss: 0.0066750883097605 | Epoch: 25 | MeanAbsoluteError: 0.0628582909703255 | Loss: 0.0081231112297003 | Epoch: 26 | MeanAbsoluteError: 0.0657276287674904 | Loss: 0.0073633665327604 | Epoch: 27 | MeanAbsoluteError: 0.0636222362518311 | Loss: 0.0070358323096298 | Epoch: 28 | MeanAbsoluteError: 0.0765877217054367 | Loss: 0.0100259256161128 | Epoch: 29 | MeanAbsoluteError: 0.0640668198466301 | Loss: 0.0079013479046989 | Epoch: 30 | 
MeanAbsoluteError: 0.0707083418965340 | Loss: 0.0096638894216934 | Epoch: 31 | MeanAbsoluteError: 0.0699794441461563 | Loss: 0.0083211477845907 | Epoch: 32 | MeanAbsoluteError: 0.0671578273177147 | Loss: 0.0081746624837009 | Epoch: 33 | MeanAbsoluteError: 0.0697479620575905 | Loss: 0.0081924932807063 | Epoch: 34 | MeanAbsoluteError: 0.0684905648231506 | Loss: 0.0075011083809659 | Epoch: 35 | MeanAbsoluteError: 0.0761415511369705 | Loss: 0.0095907151706827 | Epoch: 36 | 
MeanAbsoluteError: 0.0677382498979568 | Loss: 0.0083322983630933 | Epoch: 37 | MeanAbsoluteError: 0.0636971741914749 | Loss: 0.0071179067632571 | Epoch: 38 | MeanAbsoluteError: 0.0647276416420937 | Loss: 0.0074187481527527 | Epoch: 39 | MeanAbsoluteError: 0.0600925944745541 | Loss: 0.0067775476410558 | Epoch: 40 | MeanAbsoluteError: 0.0720128417015076 | Loss: 0.0091323857870884 | Epoch: 41 | MeanAbsoluteError: 0.0602180026471615 | Loss: 0.0065041887236293 | Epoch: 42 | 
MeanAbsoluteError: 0.0605176798999310 | Loss: 0.0069441355349651 | Epoch: 43 | MeanAbsoluteError: 0.0591382086277008 | Loss: 0.0065464526290695 | Epoch: 44 | MeanAbsoluteError: 0.0666972696781158 | Loss: 0.0081704062762825 | Epoch: 45 | MeanAbsoluteError: 0.0586327686905861 | Loss: 0.0065355776327973 | Epoch: 46 | MeanAbsoluteError: 0.0690472647547722 | Loss: 0.0071699058497325 | Epoch: 47 | MeanAbsoluteError: 0.0603463239967823 | Loss: 0.0071596284971262 | Epoch: 48 | 
MeanAbsoluteError: 0.1084248498082161 | Loss: 0.0165511891525239 | Epoch: 49 | MeanAbsoluteError: 0.0670942068099976 | Loss: 0.0072437127601976 | Epoch: 50 | MeanAbsoluteError: 0.0803942382335663 | Loss: 0.0110252701397985 | Epoch: 51 | MeanAbsoluteError: 0.0637620314955711 | Loss: 0.0079801501504456 | Epoch: 52 | MeanAbsoluteError: 0.0813964679837227 | Loss: 0.0098299199187507 | Epoch: 53 | MeanAbsoluteError: 0.0636290088295937 | Loss: 0.0074036945340534 | Epoch: 54 | 
MeanAbsoluteError: 0.0549818277359009 | Loss: 0.0053674941548767 | Epoch: 55 | MeanAbsoluteError: 0.0646695941686630 | Loss: 0.0083419733063783 | Epoch: 56 | MeanAbsoluteError: 0.0653730630874634 | Loss: 0.0069985386368353 | Epoch: 57 | MeanAbsoluteError: 0.0775337442755699 | Loss: 0.0105830891158742 | Epoch: 58 | MeanAbsoluteError: 0.0712076872587204 | Loss: 0.0080071107243809 | Epoch: 59 | MeanAbsoluteError: 0.0606241337954998 | Loss: 0.0072150027127160 | Epoch: 60 | 
MeanAbsoluteError: 0.0616226941347122 | Loss: 0.0071851524570957 | Epoch: 61 | MeanAbsoluteError: 0.0615576058626175 | Loss: 0.0061136544418211 | Epoch: 62 | MeanAbsoluteError: 0.0622325129806995 | Loss: 0.0069410026306286 | Epoch: 63 | MeanAbsoluteError: 0.0634460151195526 | Loss: 0.0074191724404227 | Epoch: 64 | MeanAbsoluteError: 0.0557804815471172 | Loss: 0.0063451630109921 | Epoch: 65 | MeanAbsoluteError: 0.0768705084919930 | Loss: 0.0091326656658202 | Epoch: 66 | 
MeanAbsoluteError: 0.0621598996222019 | Loss: 0.0068853095577409 | Epoch: 67 | MeanAbsoluteError: 0.0621695592999458 | Loss: 0.0070795461884700 | Epoch: 68 | MeanAbsoluteError: 0.0572721809148788 | Loss: 0.0062497573233365 | Epoch: 69 | MeanAbsoluteError: 0.0682721808552742 | Loss: 0.0076178240607260 | Epoch: 70 | MeanAbsoluteError: 0.0621080398559570 | Loss: 0.0069961740689663 | Epoch: 71 | MeanAbsoluteError: 0.0761938616633415 | Loss: 0.0100466573797166 | Epoch: 72 | 
MeanAbsoluteError: 0.0615078359842300 | Loss: 0.0061763784747260 | Epoch: 73 | MeanAbsoluteError: 0.0666948333382607 | Loss: 0.0079256285645533 | Epoch: 74 | MeanAbsoluteError: 0.0559957139194012 | Loss: 0.0063017844752176 | Epoch: 75 | MeanAbsoluteError: 0.0617873184382915 | Loss: 0.0068546325519371 | Epoch: 76 | MeanAbsoluteError: 0.0828760117292404 | Loss: 0.0104881833602364 | Epoch: 77 | MeanAbsoluteError: 0.0629561543464661 | Loss: 0.0075741360763398 | Epoch: 78 | 
MeanAbsoluteError: 0.0672372654080391 | Loss: 0.0083793758476774 | Epoch: 79 | MeanAbsoluteError: 0.0618865899741650 | Loss: 0.0077794252840492 | Epoch: 80 | MeanAbsoluteError: 0.0714161843061447 | Loss: 0.0083439239801373 | Epoch: 81 | MeanAbsoluteError: 0.0679718926548958 | Loss: 0.0089466923746901 | Epoch: 82 | MeanAbsoluteError: 0.0715537443757057 | Loss: 0.0084381225029938 | Epoch: 83 | MeanAbsoluteError: 0.0642870813608170 | Loss: 0.0076986999841756 | Epoch: 84 | 
MeanAbsoluteError: 0.0651755258440971 | Loss: 0.0077889669477008 | Epoch: 85 | MeanAbsoluteError: 0.0569059699773788 | Loss: 0.0066734508552084 | Epoch: 86 | MeanAbsoluteError: 0.0687931403517723 | Loss: 0.0085637449783583 | Epoch: 87 | MeanAbsoluteError: 0.0643384084105492 | Loss: 0.0074377097444570 | Epoch: 88 | MeanAbsoluteError: 0.0634617581963539 | Loss: 0.0065598031346841 | Epoch: 89 | MeanAbsoluteError: 0.0634468942880630 | Loss: 0.0073639813313882 | Epoch: 90 | 
MeanAbsoluteError: 0.0636256709694862 | Loss: 0.0077315308951074 | Epoch: 91 | MeanAbsoluteError: 0.0622144453227520 | Loss: 0.0068515315616969 | Epoch: 92 | MeanAbsoluteError: 0.0612292662262917 | Loss: 0.0062100966371751 | Epoch: 93 | MeanAbsoluteError: 0.0572219416499138 | Loss: 0.0079728684027214 | Epoch: 94 | MeanAbsoluteError: 0.0582324974238873 | Loss: 0.0063891752319372 | Epoch: 95 | MeanAbsoluteError: 0.0709527060389519 | Loss: 0.0080440613891309 | Epoch: 96 | 
MeanAbsoluteError: 0.0641806721687317 | Loss: 0.0073221125438189 | Epoch: 97 | MeanAbsoluteError: 0.0595539584755898 | Loss: 0.0076708535708409 | Epoch: 98 | MeanAbsoluteError: 0.0667128711938858 | Loss: 0.0070615358456659 | Epoch: 99 | MeanAbsoluteError: 0.0897024869918823 | Loss: 0.0122210201341659 | Epoch: 100 | MeanAbsoluteError: 0.0757330358028412 | Loss: 0.0089264028717298 | Epoch: 101 | MeanAbsoluteError: 0.0655679926276207 | Loss: 0.0079004276311025 | Epoch: 102 | 
MeanAbsoluteError: 0.0618032850325108 | Loss: 0.0072526415980731 | Epoch: 103 | MeanAbsoluteError: 0.0670469254255295 | Loss: 0.0077469938628686 | Epoch: 104 | MeanAbsoluteError: 0.0603768602013588 | Loss: 0.0062433659910069 | Epoch: 105 | MeanAbsoluteError: 0.0664521306753159 | Loss: 0.0082033080630936 | Epoch: 106 | MeanAbsoluteError: 0.0654451549053192 | Loss: 0.0078865121211857 | Epoch: 107 | MeanAbsoluteError: 0.0726227015256882 | Loss: 0.0092662853763128 | Epoch: 108 | 
MeanAbsoluteError: 0.0596442930400372 | Loss: 0.0070839049589510 | Epoch: 109 | MeanAbsoluteError: 0.0660989433526993 | Loss: 0.0080559615127277 | Epoch: 110 | MeanAbsoluteError: 0.0603764094412327 | Loss: 0.0070787967999543 | Epoch: 111 | MeanAbsoluteError: 0.0548771545290947 | Loss: 0.0056898456365646 | Epoch: 112 | MeanAbsoluteError: 0.0715158954262733 | Loss: 0.0077146153074379 | Epoch: 113 | MeanAbsoluteError: 0.0549929924309254 | Loss: 0.0064254635475421 | Epoch: 114 | 
MeanAbsoluteError: 0.0626425445079803 | Loss: 0.0067922412122910 | Epoch: 115 | MeanAbsoluteError: 0.0589302815496922 | Loss: 0.0060798195640867 | Epoch: 116 | MeanAbsoluteError: 0.0601787678897381 | Loss: 0.0073240341940740 | Epoch: 117 | MeanAbsoluteError: 0.0615410543978214 | Loss: 0.0073394248535624 | Epoch: 118 | MeanAbsoluteError: 0.0694168880581856 | Loss: 0.0081309656119750 | Early stopping at epoch 117
Returned to Spot: Validation loss: 0.00813096561197502
spotPython tuning: 0.0015749900673032052 [#####-----] 53.15% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.23959968929875958, 'lr_mult': 6.9692364725298575, 'batch_size': 8, 'epochs': 16384, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.527120762268488}
Epoch: 1 | MeanAbsoluteError: 0.1354541033506393 | Loss: 0.0283433862741252 | Epoch: 2 | MeanAbsoluteError: 0.1253892332315445 | Loss: 0.0251732022611816 | Epoch: 3 | MeanAbsoluteError: 0.1136626303195953 | Loss: 0.0195876432729787 | Epoch: 4 | MeanAbsoluteError: 0.1051208078861237 | Loss: 0.0177423687786550 | Epoch: 5 | MeanAbsoluteError: 0.1132828146219254 | Loss: 0.0196976817494846 | Epoch: 6 | MeanAbsoluteError: 0.0862480849027634 | Loss: 0.0121941029945830 | Epoch: 7 | MeanAbsoluteError: 0.0858472138643265 | Loss: 0.0118427183325893 | Epoch: 8 | MeanAbsoluteError: 0.0837061405181885 | Loss: 0.0115085324811700 | Epoch: 9 | MeanAbsoluteError: 0.0867878273129463 | Loss: 0.0114737626557287 | Epoch: 10 | MeanAbsoluteError: 0.0876126885414124 | Loss: 0.0124598832090238 | Epoch: 11 | 
MeanAbsoluteError: 0.0984195470809937 | Loss: 0.0138832330091023 | Epoch: 12 | MeanAbsoluteError: 0.0745552629232407 | Loss: 0.0085532329854016 | Epoch: 13 | MeanAbsoluteError: 0.0591983348131180 | Loss: 0.0067688067547830 | Epoch: 14 | MeanAbsoluteError: 0.0605726130306721 | Loss: 0.0065064543741755 | Epoch: 15 | MeanAbsoluteError: 0.0520592555403709 | Loss: 0.0049477854688456 | Epoch: 16 | MeanAbsoluteError: 0.0757664889097214 | Loss: 0.0090201965159442 | Epoch: 17 | MeanAbsoluteError: 0.0557324104011059 | Loss: 0.0057704966334553 | Epoch: 18 | MeanAbsoluteError: 0.0878016501665115 | Loss: 0.0110762171251209 | Epoch: 19 | MeanAbsoluteError: 0.0713005438446999 | Loss: 0.0088202065518616 | Epoch: 20 | MeanAbsoluteError: 0.0704699084162712 | Loss: 0.0083602744056598 | Epoch: 21 | MeanAbsoluteError: 0.0805202201008797 | Loss: 0.0100958134341789 | Epoch: 22 | 
MeanAbsoluteError: 0.0667894557118416 | Loss: 0.0068072797056582 | Epoch: 23 | MeanAbsoluteError: 0.0964301526546478 | Loss: 0.0127062322633145 | Epoch: 24 | MeanAbsoluteError: 0.0562020428478718 | Loss: 0.0065273782238364 | Epoch: 25 | MeanAbsoluteError: 0.0551646612584591 | Loss: 0.0059348395596699 | Epoch: 26 | MeanAbsoluteError: 0.0961534529924393 | Loss: 0.0138861053059564 | Epoch: 27 | MeanAbsoluteError: 0.0996297821402550 | Loss: 0.0131984709664003 | Epoch: 28 | MeanAbsoluteError: 0.1017300859093666 | Loss: 0.0140896228534219 | Epoch: 29 | MeanAbsoluteError: 0.0941050425171852 | Loss: 0.0135667916191252 | Epoch: 30 | MeanAbsoluteError: 0.0523110628128052 | Loss: 0.0055714715547909 | Epoch: 31 | MeanAbsoluteError: 0.0656183585524559 | Loss: 0.0068478966254349 | Epoch: 32 | MeanAbsoluteError: 0.0550342239439487 | Loss: 0.0055281749457783 | Epoch: 33 | 
MeanAbsoluteError: 0.0802814066410065 | Loss: 0.0098519890912269 | Epoch: 34 | MeanAbsoluteError: 0.1068615466356277 | Loss: 0.0156081064702257 | Epoch: 35 | MeanAbsoluteError: 0.0689014866948128 | Loss: 0.0084359232262757 | Epoch: 36 | MeanAbsoluteError: 0.0667700096964836 | Loss: 0.0067040837786504 | Epoch: 37 | MeanAbsoluteError: 0.0824612081050873 | Loss: 0.0092915049999168 | Epoch: 38 | MeanAbsoluteError: 0.0388248898088932 | Loss: 0.0033026176204562 | Epoch: 39 | MeanAbsoluteError: 0.0657479315996170 | Loss: 0.0065572869835274 | Epoch: 40 | MeanAbsoluteError: 0.0434342883527279 | Loss: 0.0039475106490212 | Epoch: 41 | MeanAbsoluteError: 0.1253913044929504 | Loss: 0.0194288712043903 | Epoch: 42 | MeanAbsoluteError: 0.0539667122066021 | Loss: 0.0051714819733446 | Epoch: 43 | MeanAbsoluteError: 0.0549158677458763 | Loss: 0.0061367516816398 | Epoch: 44 | 
MeanAbsoluteError: 0.0676751211285591 | Loss: 0.0082179030072630 | Epoch: 45 | MeanAbsoluteError: 0.0814117342233658 | Loss: 0.0108538877316996 | Epoch: 46 | MeanAbsoluteError: 0.0610695220530033 | Loss: 0.0057498495168004 | Epoch: 47 | MeanAbsoluteError: 0.0758924484252930 | Loss: 0.0091003295046424 | Epoch: 48 | MeanAbsoluteError: 0.0937995240092278 | Loss: 0.0126624451092395 | Epoch: 49 | MeanAbsoluteError: 0.0619604699313641 | Loss: 0.0067443091538735 | Epoch: 50 | MeanAbsoluteError: 0.0562880262732506 | Loss: 0.0049693997716531 | Epoch: 51 | MeanAbsoluteError: 0.0881449952721596 | Loss: 0.0106887128939362 | Epoch: 52 | MeanAbsoluteError: 0.0558096505701542 | Loss: 0.0057364262971341 | Epoch: 53 | MeanAbsoluteError: 0.0457093939185143 | Loss: 0.0043131731615990 | Epoch: 54 | MeanAbsoluteError: 0.0571871884167194 | Loss: 0.0060775454805576 | Epoch: 55 | 
MeanAbsoluteError: 0.0721698999404907 | Loss: 0.0080591719352493 | Epoch: 56 | MeanAbsoluteError: 0.0819378495216370 | Loss: 0.0102494694047460 | Epoch: 57 | MeanAbsoluteError: 0.0629542842507362 | Loss: 0.0062695641934529 | Epoch: 58 | MeanAbsoluteError: 0.0464757718145847 | Loss: 0.0043890009998761 | Epoch: 59 | MeanAbsoluteError: 0.0702527612447739 | Loss: 0.0071854191084735 | Epoch: 60 | MeanAbsoluteError: 0.0690911561250687 | Loss: 0.0081085354383839 | Epoch: 61 | MeanAbsoluteError: 0.0429706685245037 | Loss: 0.0037592374888175 | Epoch: 62 | MeanAbsoluteError: 0.0515722706913948 | Loss: 0.0053434232740026 | Epoch: 63 | MeanAbsoluteError: 0.0424874462187290 | Loss: 0.0039587720553084 | Epoch: 64 | MeanAbsoluteError: 0.0570631474256516 | Loss: 0.0054634593390419 | Epoch: 65 | MeanAbsoluteError: 0.0703116953372955 | Loss: 0.0079549758597032 | Epoch: 66 | 
MeanAbsoluteError: 0.1076275631785393 | Loss: 0.0147458465377751 | Epoch: 67 | MeanAbsoluteError: 0.0438563935458660 | Loss: 0.0038763155806871 | Epoch: 68 | MeanAbsoluteError: 0.0592186041176319 | Loss: 0.0054712380775814 | Epoch: 69 | MeanAbsoluteError: 0.0962544903159142 | Loss: 0.0142439561222043 | Epoch: 70 | MeanAbsoluteError: 0.1037811711430550 | Loss: 0.0140646331159300 | Early stopping at epoch 69
Returned to Spot: Validation loss: 0.014064633115929993
spotPython tuning: 0.0015749900673032052 [######----] 57.22% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 128, 'dropout_prob': 0.23614177456789387, 'lr_mult': 6.964820290664194, 'batch_size': 16, 'epochs': 4096, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.6183357155912083}
Epoch: 1 | MeanAbsoluteError: 0.1451512426137924 | Loss: 0.0317458619216555 | Epoch: 2 | MeanAbsoluteError: 0.2317722886800766 | Loss: 0.0732946976235038 | Epoch: 3 | MeanAbsoluteError: 0.1832721680402756 | Loss: 0.0476901184179281 | Epoch: 4 | MeanAbsoluteError: 0.1454408764839172 | Loss: 0.0321414756931757 | Epoch: 5 | MeanAbsoluteError: 0.1464353650808334 | Loss: 0.0321273622838290 | Epoch: 6 | MeanAbsoluteError: 0.1284597367048264 | Loss: 0.0252772783370394 | Epoch: 7 | MeanAbsoluteError: 0.1551052033901215 | Loss: 0.0347520776681210 | Epoch: 8 | MeanAbsoluteError: 0.1454615890979767 | Loss: 0.0312354089202065 | Epoch: 9 | MeanAbsoluteError: 0.1343436241149902 | Loss: 0.0269399864697143 | Epoch: 10 | MeanAbsoluteError: 0.1393031328916550 | Loss: 0.0276836223998352 | Epoch: 11 | MeanAbsoluteError: 0.1050047352910042 | Loss: 0.0170423258831234 | Epoch: 12 | MeanAbsoluteError: 0.1220800653100014 | Loss: 0.0214823536868942 | Epoch: 13 | MeanAbsoluteError: 0.1244908049702644 | Loss: 0.0226847473041792 | Epoch: 14 | MeanAbsoluteError: 0.1595679819583893 | Loss: 0.0312615174211954 | Epoch: 15 | MeanAbsoluteError: 0.1236842349171638 | Loss: 0.0224436242623549 | Epoch: 16 | 
MeanAbsoluteError: 0.0828737169504166 | Loss: 0.0107159925085541 | Epoch: 17 | MeanAbsoluteError: 0.1367921233177185 | Loss: 0.0249777124018261 | Epoch: 18 | MeanAbsoluteError: 0.0957060828804970 | Loss: 0.0140470879299468 | Epoch: 19 | MeanAbsoluteError: 0.0883363187313080 | Loss: 0.0123717691259165 | Epoch: 20 | MeanAbsoluteError: 0.1042960658669472 | Loss: 0.0166237688574352 | Epoch: 21 | MeanAbsoluteError: 0.1094528436660767 | Loss: 0.0165757186661818 | Epoch: 22 | MeanAbsoluteError: 0.0832956060767174 | Loss: 0.0105529120927186 | Epoch: 23 | MeanAbsoluteError: 0.1404622495174408 | Loss: 0.0267241964312760 | Epoch: 24 | MeanAbsoluteError: 0.0710027664899826 | Loss: 0.0074410962651631 | Epoch: 25 | MeanAbsoluteError: 0.0783559828996658 | Loss: 0.0094183312581950 | Epoch: 26 | MeanAbsoluteError: 0.0506663657724857 | Loss: 0.0044103143736720 | Epoch: 27 | MeanAbsoluteError: 0.0984227657318115 | Loss: 0.0124395635763281 | Epoch: 28 | MeanAbsoluteError: 0.0622920617461205 | Loss: 0.0065001873544564 | Epoch: 29 | MeanAbsoluteError: 0.0905896648764610 | Loss: 0.0110482531109531 | Epoch: 30 | MeanAbsoluteError: 0.0752569735050201 | Loss: 0.0086171348873330 | Epoch: 31 | MeanAbsoluteError: 0.1278919428586960 | Loss: 0.0205229651673060 | Epoch: 32 | MeanAbsoluteError: 0.0583507418632507 | Loss: 0.0050294660031796 | Epoch: 33 | 
MeanAbsoluteError: 0.0682941600680351 | Loss: 0.0072900609137784 | Epoch: 34 | MeanAbsoluteError: 0.0509929805994034 | Loss: 0.0049808811653700 | Epoch: 35 | MeanAbsoluteError: 0.0685079544782639 | Loss: 0.0074663244089798 | Epoch: 36 | MeanAbsoluteError: 0.1156544238328934 | Loss: 0.0168888888959038 | Epoch: 37 | MeanAbsoluteError: 0.0655048340559006 | Loss: 0.0069726652980439 | Epoch: 38 | MeanAbsoluteError: 0.0646443441510201 | Loss: 0.0069201543412514 | Epoch: 39 | MeanAbsoluteError: 0.0508684962987900 | Loss: 0.0050633096467017 | Epoch: 40 | MeanAbsoluteError: 0.0701361149549484 | Loss: 0.0085243763108003 | Epoch: 41 | MeanAbsoluteError: 0.0677956417202950 | Loss: 0.0079998928857477 | Epoch: 42 | MeanAbsoluteError: 0.0985965728759766 | Loss: 0.0122429854236543 | Epoch: 43 | MeanAbsoluteError: 0.0514719039201736 | Loss: 0.0047748155193403 | Epoch: 44 | MeanAbsoluteError: 0.0563385374844074 | Loss: 0.0057988972403109 | Epoch: 45 | MeanAbsoluteError: 0.0781236365437508 | Loss: 0.0090127154988678 | Epoch: 46 | MeanAbsoluteError: 0.0900555774569511 | Loss: 0.0102297115433765 | Epoch: 47 | MeanAbsoluteError: 0.0810247287154198 | Loss: 0.0112947277283590 | Epoch: 48 | MeanAbsoluteError: 0.0625136643648148 | Loss: 0.0071868713160879 | Epoch: 49 | MeanAbsoluteError: 0.0949536487460136 | Loss: 0.0132846823207250 | Epoch: 50 | 
MeanAbsoluteError: 0.0562279000878334 | Loss: 0.0056794113602097 | Epoch: 51 | MeanAbsoluteError: 0.0678383186459541 | Loss: 0.0074739799173059 | Epoch: 52 | MeanAbsoluteError: 0.0780587121844292 | Loss: 0.0097878879230273 | Epoch: 53 | MeanAbsoluteError: 0.0920737981796265 | Loss: 0.0110121554155883 | Epoch: 54 | MeanAbsoluteError: 0.1198095604777336 | Loss: 0.0185781052630199 | Epoch: 55 | MeanAbsoluteError: 0.0956914648413658 | Loss: 0.0120000853448322 | Epoch: 56 | MeanAbsoluteError: 0.0614760667085648 | Loss: 0.0065376559811595 | Epoch: 57 | MeanAbsoluteError: 0.0903052911162376 | Loss: 0.0101486051112021 | Epoch: 58 | MeanAbsoluteError: 0.0672167241573334 | Loss: 0.0064075354756297 | Early stopping at epoch 57
Returned to Spot: Validation loss: 0.006407535475629725
spotPython tuning: 0.0015749900673032052 [######----] 61.79% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.23661590203974972, 'lr_mult': 6.965919003778449, 'batch_size': 8, 'epochs': 512, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adamax', 'sgd_momentum': 0.22426835332476622}
Epoch: 1 | MeanAbsoluteError: 0.1288775354623795 | Loss: 0.0267630353337154 | Epoch: 2 | MeanAbsoluteError: 0.1101436987519264 | Loss: 0.0202857563547839 | Epoch: 3 | MeanAbsoluteError: 0.1016937792301178 | Loss: 0.0168524691957588 | Epoch: 4 | MeanAbsoluteError: 0.1022370010614395 | Loss: 0.0164240252925083 | Epoch: 5 | MeanAbsoluteError: 0.0937793999910355 | Loss: 0.0142476336638394 | Epoch: 6 | 
MeanAbsoluteError: 0.0805307999253273 | Loss: 0.0106277698467142 | Epoch: 7 | MeanAbsoluteError: 0.0800877362489700 | Loss: 0.0104280874794839 | Epoch: 8 | MeanAbsoluteError: 0.0848388969898224 | Loss: 0.0117992079007979 | Epoch: 9 | MeanAbsoluteError: 0.0796059444546700 | Loss: 0.0103621433096889 | Epoch: 10 | MeanAbsoluteError: 0.0732070282101631 | Loss: 0.0090284682963485 | Epoch: 11 | 
MeanAbsoluteError: 0.0682593062520027 | Loss: 0.0075692702038826 | Epoch: 12 | MeanAbsoluteError: 0.0711552202701569 | Loss: 0.0086151410827082 | Epoch: 13 | MeanAbsoluteError: 0.0746921747922897 | Loss: 0.0098112145696129 | Epoch: 14 | MeanAbsoluteError: 0.0683959349989891 | Loss: 0.0077308352123701 | Epoch: 15 | MeanAbsoluteError: 0.0696017369627953 | Loss: 0.0079826719022668 | Epoch: 16 | MeanAbsoluteError: 0.0676216855645180 | Loss: 0.0074198499450607 | Epoch: 17 | 
MeanAbsoluteError: 0.0671896412968636 | Loss: 0.0073103139875457 | Epoch: 18 | MeanAbsoluteError: 0.0627606436610222 | Loss: 0.0064580549859736 | Epoch: 19 | MeanAbsoluteError: 0.0577894672751427 | Loss: 0.0059413375565782 | Epoch: 20 | MeanAbsoluteError: 0.0593812689185143 | Loss: 0.0063788646366447 | Epoch: 21 | MeanAbsoluteError: 0.0611749440431595 | Loss: 0.0058432019156355 | Epoch: 22 | 
MeanAbsoluteError: 0.0602394863963127 | Loss: 0.0058545400265996 | Epoch: 23 | MeanAbsoluteError: 0.0538647063076496 | Loss: 0.0050153660949467 | Epoch: 24 | MeanAbsoluteError: 0.0551308318972588 | Loss: 0.0050531803878441 | Epoch: 25 | MeanAbsoluteError: 0.0607073642313480 | Loss: 0.0056160537274799 | Epoch: 26 | MeanAbsoluteError: 0.0561188943684101 | Loss: 0.0059048162350480 | Epoch: 27 | MeanAbsoluteError: 0.0522770322859287 | Loss: 0.0054081984317714 | Epoch: 28 | 
MeanAbsoluteError: 0.0492677874863148 | Loss: 0.0040987636005555 | Epoch: 29 | MeanAbsoluteError: 0.0515398494899273 | Loss: 0.0048706341691095 | Epoch: 30 | MeanAbsoluteError: 0.0645691901445389 | Loss: 0.0061467992123461 | Epoch: 31 | MeanAbsoluteError: 0.0551459826529026 | Loss: 0.0047895331364615 | Epoch: 32 | MeanAbsoluteError: 0.0509240254759789 | Loss: 0.0041739654904967 | Epoch: 33 | 
MeanAbsoluteError: 0.0494338087737560 | Loss: 0.0040329567594821 | Epoch: 34 | MeanAbsoluteError: 0.0521326176822186 | Loss: 0.0053128445900879 | Epoch: 35 | MeanAbsoluteError: 0.0521035753190517 | Loss: 0.0043648959713449 | Epoch: 36 | MeanAbsoluteError: 0.0533601567149162 | Loss: 0.0052719624777398 | Epoch: 37 | MeanAbsoluteError: 0.0436098873615265 | Loss: 0.0034179267278983 | Epoch: 38 | MeanAbsoluteError: 0.0478936508297920 | Loss: 0.0041143647088718 | Epoch: 39 | 
MeanAbsoluteError: 0.0424028374254704 | Loss: 0.0032659713902639 | Epoch: 40 | MeanAbsoluteError: 0.0478006787598133 | Loss: 0.0043707156812735 | Epoch: 41 | MeanAbsoluteError: 0.0473803617060184 | Loss: 0.0039747964949225 | Epoch: 42 | MeanAbsoluteError: 0.0429375469684601 | Loss: 0.0034401745605895 | Epoch: 43 | MeanAbsoluteError: 0.0446214936673641 | Loss: 0.0039851680293826 | Epoch: 44 | 
MeanAbsoluteError: 0.0479806587100029 | Loss: 0.0038453630603678 | Epoch: 45 | MeanAbsoluteError: 0.0476274378597736 | Loss: 0.0043129615782834 | Epoch: 46 | MeanAbsoluteError: 0.0402086116373539 | Loss: 0.0028853258623521 | Epoch: 47 | MeanAbsoluteError: 0.0465039238333702 | Loss: 0.0038516855152250 | Epoch: 48 | MeanAbsoluteError: 0.0417363308370113 | Loss: 0.0032300618806499 | Epoch: 49 | MeanAbsoluteError: 0.0456352420151234 | Loss: 0.0039330687677169 | Epoch: 50 | 
MeanAbsoluteError: 0.0422786623239517 | Loss: 0.0030743304163671 | Epoch: 51 | MeanAbsoluteError: 0.0444168671965599 | Loss: 0.0036456515586714 | Epoch: 52 | MeanAbsoluteError: 0.0470615215599537 | Loss: 0.0034040918383796 | Epoch: 53 | MeanAbsoluteError: 0.0421747192740440 | Loss: 0.0038972422220180 | Epoch: 54 | MeanAbsoluteError: 0.0432820804417133 | Loss: 0.0038143117853906 | Epoch: 55 | 
MeanAbsoluteError: 0.0415568724274635 | Loss: 0.0037767631453646 | Epoch: 56 | MeanAbsoluteError: 0.0421903170645237 | Loss: 0.0035864136681132 | Epoch: 57 | MeanAbsoluteError: 0.0410952158272266 | Loss: 0.0033650245149099 | Epoch: 58 | MeanAbsoluteError: 0.0462279990315437 | Loss: 0.0036244763667989 | Epoch: 59 | MeanAbsoluteError: 0.0407688729465008 | Loss: 0.0025750750118229 | Epoch: 60 | MeanAbsoluteError: 0.0509108118712902 | Loss: 0.0041099501265164 | Epoch: 61 | 
MeanAbsoluteError: 0.0428812503814697 | Loss: 0.0034568524478297 | Epoch: 62 | MeanAbsoluteError: 0.0422656126320362 | Loss: 0.0031737493945433 | Epoch: 63 | MeanAbsoluteError: 0.0422894060611725 | Loss: 0.0034334454658643 | Epoch: 64 | MeanAbsoluteError: 0.0416121594607830 | Loss: 0.0035481867380440 | Epoch: 65 | MeanAbsoluteError: 0.0401942394673824 | Loss: 0.0032669923445945 | Epoch: 66 | 
MeanAbsoluteError: 0.0435773096978664 | Loss: 0.0035066027500618 | Epoch: 67 | MeanAbsoluteError: 0.0394811369478703 | Loss: 0.0030537526579696 | Epoch: 68 | MeanAbsoluteError: 0.0491577871143818 | Loss: 0.0044483561819346 | Epoch: 69 | MeanAbsoluteError: 0.0484959743916988 | Loss: 0.0047466758804053 | Epoch: 70 | MeanAbsoluteError: 0.0422966703772545 | Loss: 0.0032893673663861 | Epoch: 71 | MeanAbsoluteError: 0.0370469689369202 | Loss: 0.0024711368283821 | Epoch: 72 | 
MeanAbsoluteError: 0.0415196716785431 | Loss: 0.0031157100663557 | Epoch: 73 | MeanAbsoluteError: 0.0391064025461674 | Loss: 0.0033644674555322 | Epoch: 74 | MeanAbsoluteError: 0.0476641766726971 | Loss: 0.0035167070454918 | Epoch: 75 | MeanAbsoluteError: 0.0390329025685787 | Loss: 0.0031655833690341 | Epoch: 76 | MeanAbsoluteError: 0.0413492172956467 | Loss: 0.0029844899254385 | Epoch: 77 | 
MeanAbsoluteError: 0.0446039587259293 | Loss: 0.0033777814464166 | Epoch: 78 | MeanAbsoluteError: 0.0441848635673523 | Loss: 0.0037530641512651 | Epoch: 79 | MeanAbsoluteError: 0.0407017953693867 | Loss: 0.0033004976254520 | Epoch: 80 | MeanAbsoluteError: 0.0392067097127438 | Loss: 0.0031496634535295 | Epoch: 81 | MeanAbsoluteError: 0.0383860319852829 | Loss: 0.0027491072928809 | Epoch: 82 | MeanAbsoluteError: 0.0496034473180771 | Loss: 0.0038670313170817 | Epoch: 83 | 
MeanAbsoluteError: 0.0375318974256516 | Loss: 0.0027006123610159 | Epoch: 84 | MeanAbsoluteError: 0.0395994298160076 | Loss: 0.0029590266571368 | Epoch: 85 | MeanAbsoluteError: 0.0419181808829308 | Loss: 0.0034517471963466 | Epoch: 86 | MeanAbsoluteError: 0.0345180146396160 | Loss: 0.0025483644230438 | Epoch: 87 | MeanAbsoluteError: 0.0382866300642490 | Loss: 0.0029251196331308 | Epoch: 88 | 
MeanAbsoluteError: 0.0378892756998539 | Loss: 0.0027605689116937 | Epoch: 89 | MeanAbsoluteError: 0.0467211902141571 | Loss: 0.0037400518684942 | Epoch: 90 | MeanAbsoluteError: 0.0395164005458355 | Loss: 0.0031781916090710 | Epoch: 91 | MeanAbsoluteError: 0.0443350262939930 | Loss: 0.0033585222784160 | Epoch: 92 | MeanAbsoluteError: 0.0456381551921368 | Loss: 0.0038116519725391 | Epoch: 93 | MeanAbsoluteError: 0.0473809428513050 | Loss: 0.0039212535775732 | Epoch: 94 | 
MeanAbsoluteError: 0.0370600782334805 | Loss: 0.0025594871610673 | Epoch: 95 | MeanAbsoluteError: 0.0404642447829247 | Loss: 0.0030024028398513 | Epoch: 96 | MeanAbsoluteError: 0.0432344861328602 | Loss: 0.0040984386179939 | Epoch: 97 | MeanAbsoluteError: 0.0424984544515610 | Loss: 0.0038143769948204 | Epoch: 98 | MeanAbsoluteError: 0.0390667542815208 | Loss: 0.0028443037207532 | Epoch: 99 | 
MeanAbsoluteError: 0.0440567210316658 | Loss: 0.0037335214146879 | Epoch: 100 | MeanAbsoluteError: 0.0391400344669819 | Loss: 0.0025902917504458 | Epoch: 101 | MeanAbsoluteError: 0.0473693981766701 | Loss: 0.0034315938552793 | Epoch: 102 | MeanAbsoluteError: 0.0434797592461109 | Loss: 0.0031045293971578 | Epoch: 103 | MeanAbsoluteError: 0.0391034223139286 | Loss: 0.0027005083148221 | Early stopping at epoch 102
Returned to Spot: Validation loss: 0.002700508314822065
spotPython tuning: 0.0015749900673032052 [#######---] 66.12% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.2341370496058523, 'lr_mult': 7.251373361317278, 'batch_size': 8, 'epochs': 512, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adamax', 'sgd_momentum': 0.21659375865809677}
Epoch: 1 | MeanAbsoluteError: 0.1474356651306152 | Loss: 0.0352408312212088 | Epoch: 2 | MeanAbsoluteError: 0.1404805332422256 | Loss: 0.0325026880018413 | Epoch: 3 | MeanAbsoluteError: 0.1274990588426590 | Loss: 0.0252850533855197 | Epoch: 4 | MeanAbsoluteError: 0.1209076046943665 | Loss: 0.0228619082634778 | Epoch: 5 | MeanAbsoluteError: 0.1262989342212677 | Loss: 0.0249753332525296 | Epoch: 6 | MeanAbsoluteError: 0.1205452084541321 | Loss: 0.0234042892759470 | Epoch: 7 | MeanAbsoluteError: 0.1033160313963890 | Loss: 0.0176520585266285 | Epoch: 8 | MeanAbsoluteError: 0.1035893335938454 | Loss: 0.0167364831768761 | Epoch: 9 | MeanAbsoluteError: 0.0941874012351036 | Loss: 0.0151652453320199 | Epoch: 10 | MeanAbsoluteError: 0.0892684161663055 | Loss: 0.0133198081687289 | Epoch: 11 | 
MeanAbsoluteError: 0.0839783102273941 | Loss: 0.0113164614273333 | Epoch: 12 | MeanAbsoluteError: 0.0800041481852531 | Loss: 0.0104958649822756 | Epoch: 13 | MeanAbsoluteError: 0.0790740326046944 | Loss: 0.0107701263868397 | Epoch: 14 | MeanAbsoluteError: 0.0714234933257103 | Loss: 0.0085821710036773 | Epoch: 15 | MeanAbsoluteError: 0.0744797959923744 | Loss: 0.0087153104035870 | Epoch: 16 | MeanAbsoluteError: 0.0691602379083633 | Loss: 0.0078119132882229 | Epoch: 17 | MeanAbsoluteError: 0.0639832615852356 | Loss: 0.0071572785504701 | Epoch: 18 | MeanAbsoluteError: 0.0680588707327843 | Loss: 0.0078611938515678 | Epoch: 19 | MeanAbsoluteError: 0.0688043236732483 | Loss: 0.0077132691849807 | Epoch: 20 | MeanAbsoluteError: 0.0663871765136719 | Loss: 0.0072707606350856 | Epoch: 21 | MeanAbsoluteError: 0.0586463548243046 | Loss: 0.0054405712473549 | Epoch: 22 | 
MeanAbsoluteError: 0.0610277242958546 | Loss: 0.0061803866778255 | Epoch: 23 | MeanAbsoluteError: 0.0530935637652874 | Loss: 0.0045607388479096 | Epoch: 24 | MeanAbsoluteError: 0.0528215467929840 | Loss: 0.0046326743353060 | Epoch: 25 | MeanAbsoluteError: 0.0547838546335697 | Loss: 0.0050809691188318 | Epoch: 26 | MeanAbsoluteError: 0.0558706745505333 | Loss: 0.0049689368675708 | Epoch: 27 | MeanAbsoluteError: 0.0505219511687756 | Loss: 0.0043133724799478 | Epoch: 28 | MeanAbsoluteError: 0.0505168475210667 | Loss: 0.0041189692320155 | Epoch: 29 | MeanAbsoluteError: 0.0489094108343124 | Loss: 0.0038475041548832 | Epoch: 30 | MeanAbsoluteError: 0.0531033910810947 | Loss: 0.0044300284108000 | Epoch: 31 | MeanAbsoluteError: 0.0511307120323181 | Loss: 0.0046003489574344 | Epoch: 32 | MeanAbsoluteError: 0.0480536893010139 | Loss: 0.0037224202985128 | Epoch: 33 | 
MeanAbsoluteError: 0.0475524142384529 | Loss: 0.0033956468212541 | Epoch: 34 | MeanAbsoluteError: 0.0476173125207424 | Loss: 0.0036319259946284 | Epoch: 35 | MeanAbsoluteError: 0.0440216474235058 | Loss: 0.0036970276851207 | Epoch: 36 | MeanAbsoluteError: 0.0454287528991699 | Loss: 0.0033985624782202 | Epoch: 37 | MeanAbsoluteError: 0.0442569144070148 | Loss: 0.0035216630571277 | Epoch: 38 | MeanAbsoluteError: 0.0410348512232304 | Loss: 0.0032674458450760 | Epoch: 39 | MeanAbsoluteError: 0.0409110262989998 | Loss: 0.0029208086090971 | Epoch: 40 | MeanAbsoluteError: 0.0422509275376797 | Loss: 0.0029401726496872 | Epoch: 41 | MeanAbsoluteError: 0.0390282198786736 | Loss: 0.0026692179656637 | Epoch: 42 | MeanAbsoluteError: 0.0384373590350151 | Loss: 0.0028468036126517 | Epoch: 43 | MeanAbsoluteError: 0.0423254631459713 | Loss: 0.0030541985700103 | Epoch: 44 | 
MeanAbsoluteError: 0.0418752878904343 | Loss: 0.0029090890081869 | Epoch: 45 | MeanAbsoluteError: 0.0476841330528259 | Loss: 0.0034308642390993 | Epoch: 46 | MeanAbsoluteError: 0.0455053858458996 | Loss: 0.0037121136096845 | Epoch: 47 | MeanAbsoluteError: 0.0461778305470943 | Loss: 0.0034822470073490 | Epoch: 48 | MeanAbsoluteError: 0.0407961979508400 | Loss: 0.0034821137792039 | Epoch: 49 | MeanAbsoluteError: 0.0418938547372818 | Loss: 0.0030371993121470 | Epoch: 50 | MeanAbsoluteError: 0.0475438162684441 | Loss: 0.0041276053234469 | Epoch: 51 | MeanAbsoluteError: 0.0411561392247677 | Loss: 0.0029505792397111 | Epoch: 52 | MeanAbsoluteError: 0.0431498624384403 | Loss: 0.0030793646062528 | Epoch: 53 | MeanAbsoluteError: 0.0398860946297646 | Loss: 0.0030491646029986 | Epoch: 54 | MeanAbsoluteError: 0.0399539805948734 | Loss: 0.0029651637290188 | Epoch: 55 | 
MeanAbsoluteError: 0.0415788181126118 | Loss: 0.0029616134814109 | Epoch: 56 | MeanAbsoluteError: 0.0395717620849609 | Loss: 0.0029417629871444 | Epoch: 57 | MeanAbsoluteError: 0.0336467474699020 | Loss: 0.0021392551999796 | Epoch: 58 | MeanAbsoluteError: 0.0500486493110657 | Loss: 0.0035913766370964 | Epoch: 59 | MeanAbsoluteError: 0.0348328165709972 | Loss: 0.0023355759821195 | Epoch: 60 | MeanAbsoluteError: 0.0390467718243599 | Loss: 0.0025882306294271 | Epoch: 61 | MeanAbsoluteError: 0.0340112000703812 | Loss: 0.0020307550730649 | Epoch: 62 | MeanAbsoluteError: 0.0378326475620270 | Loss: 0.0027543485783482 | Epoch: 63 | MeanAbsoluteError: 0.0348743461072445 | Loss: 0.0020209489448462 | Epoch: 64 | MeanAbsoluteError: 0.0392619073390961 | Loss: 0.0030091600638116 | Epoch: 65 | MeanAbsoluteError: 0.0356929488480091 | Loss: 0.0022594823439201 | Epoch: 66 | 
MeanAbsoluteError: 0.0451353006064892 | Loss: 0.0030906201328004 | Epoch: 67 | MeanAbsoluteError: 0.0350367464125156 | Loss: 0.0022551487054443 | Epoch: 68 | MeanAbsoluteError: 0.0321592278778553 | Loss: 0.0019024071263725 | Epoch: 69 | MeanAbsoluteError: 0.0337182544171810 | Loss: 0.0022173248825742 | Epoch: 70 | MeanAbsoluteError: 0.0322844833135605 | Loss: 0.0019622549286731 | Epoch: 71 | MeanAbsoluteError: 0.0382903218269348 | Loss: 0.0024318529689672 | Epoch: 72 | MeanAbsoluteError: 0.0396313332021236 | Loss: 0.0029658896030589 | Epoch: 73 | MeanAbsoluteError: 0.0444966331124306 | Loss: 0.0030750187120008 | Epoch: 74 | MeanAbsoluteError: 0.0326494649052620 | Loss: 0.0019069313053287 | Epoch: 75 | MeanAbsoluteError: 0.0340104512870312 | Loss: 0.0018357979164361 | Epoch: 76 | MeanAbsoluteError: 0.0398020520806313 | Loss: 0.0033577870084340 | Epoch: 77 | 
MeanAbsoluteError: 0.0327529869973660 | Loss: 0.0020283329787689 | Epoch: 78 | MeanAbsoluteError: 0.0330798141658306 | Loss: 0.0023539510607646 | Epoch: 79 | MeanAbsoluteError: 0.0341492407023907 | Loss: 0.0025409231847765 | Epoch: 80 | MeanAbsoluteError: 0.0321894809603691 | Loss: 0.0020469433794987 | Epoch: 81 | MeanAbsoluteError: 0.0339797548949718 | Loss: 0.0021314483034841 | Epoch: 82 | MeanAbsoluteError: 0.0324975885450840 | Loss: 0.0020195657473921 | Epoch: 83 | MeanAbsoluteError: 0.0329146124422550 | Loss: 0.0018379763243597 | Epoch: 84 | MeanAbsoluteError: 0.0416433066129684 | Loss: 0.0028743950288596 | Epoch: 85 | MeanAbsoluteError: 0.0347562804818153 | Loss: 0.0024743775812615 | Epoch: 86 | MeanAbsoluteError: 0.0349881127476692 | Loss: 0.0020733124455498 | Epoch: 87 | MeanAbsoluteError: 0.0538280978798866 | Loss: 0.0039779973878084 | Epoch: 88 | 
MeanAbsoluteError: 0.0320808142423630 | Loss: 0.0021198520691159 | Epoch: 89 | MeanAbsoluteError: 0.0301994699984789 | Loss: 0.0018936566668440 | Epoch: 90 | MeanAbsoluteError: 0.0419032685458660 | Loss: 0.0027052548861033 | Epoch: 91 | MeanAbsoluteError: 0.0391669161617756 | Loss: 0.0029295349024898 | Epoch: 92 | MeanAbsoluteError: 0.0381404869258404 | Loss: 0.0030566014825844 | Epoch: 93 | MeanAbsoluteError: 0.0372475683689117 | Loss: 0.0029154067198856 | Epoch: 94 | MeanAbsoluteError: 0.0439150296151638 | Loss: 0.0029577320061722 | Epoch: 95 | MeanAbsoluteError: 0.0376706570386887 | Loss: 0.0026276594006432 | Epoch: 96 | MeanAbsoluteError: 0.0409365557134151 | Loss: 0.0030488641993878 | Epoch: 97 | MeanAbsoluteError: 0.0370162464678288 | Loss: 0.0023176514966364 | Epoch: 98 | MeanAbsoluteError: 0.0360884368419647 | Loss: 0.0024039724728362 | Epoch: 99 | 
MeanAbsoluteError: 0.0327412821352482 | Loss: 0.0021194184090219 | Epoch: 100 | MeanAbsoluteError: 0.0415783487260342 | Loss: 0.0034713391046113 | Epoch: 101 | MeanAbsoluteError: 0.0380656383931637 | Loss: 0.0027625374128356 | Epoch: 102 | MeanAbsoluteError: 0.0334663502871990 | Loss: 0.0021140012824234 | Epoch: 103 | MeanAbsoluteError: 0.0335723571479321 | Loss: 0.0022540546212296 | Epoch: 104 | MeanAbsoluteError: 0.0343287363648415 | Loss: 0.0025902741671368 | Epoch: 105 | MeanAbsoluteError: 0.0437183268368244 | Loss: 0.0035252590092377 | Epoch: 106 | MeanAbsoluteError: 0.0331417396664619 | Loss: 0.0019496627018701 | Epoch: 107 | MeanAbsoluteError: 0.0371582619845867 | Loss: 0.0028326321380997 | Early stopping at epoch 106
Returned to Spot: Validation loss: 0.0028326321380997173
spotPython tuning: 0.0015749900673032052 [#######---] 72.14% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 64, 'dropout_prob': 0.22905133272463013, 'lr_mult': 7.262833061288867, 'batch_size': 8, 'epochs': 4096, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adadelta', 'sgd_momentum': 0.7945368827078965}
Epoch: 1 | MeanAbsoluteError: 0.1378129869699478 | Loss: 0.0300807676180021 | Epoch: 2 | MeanAbsoluteError: 0.1676592081785202 | Loss: 0.0414051040516872 | Epoch: 3 | MeanAbsoluteError: 0.1522629559040070 | Loss: 0.0349389494543797 | Epoch: 4 | MeanAbsoluteError: 0.1243919134140015 | Loss: 0.0236021589953452 | Epoch: 5 | MeanAbsoluteError: 0.1561204940080643 | Loss: 0.0347875360840637 | Epoch: 6 | MeanAbsoluteError: 0.1159306988120079 | Loss: 0.0202658145541423 | Epoch: 7 | MeanAbsoluteError: 0.1141022965312004 | Loss: 0.0194924707083326 | Epoch: 8 | MeanAbsoluteError: 0.1017169430851936 | Loss: 0.0163413388164420 | Epoch: 9 | MeanAbsoluteError: 0.1145527511835098 | Loss: 0.0184864608423882 | Epoch: 10 | MeanAbsoluteError: 0.0860565230250359 | Loss: 0.0121176309614001 | Epoch: 11 | 
MeanAbsoluteError: 0.0771513879299164 | Loss: 0.0103785554406625 | Epoch: 12 | MeanAbsoluteError: 0.0901204049587250 | Loss: 0.0125835936050862 | Epoch: 13 | MeanAbsoluteError: 0.0858690664172173 | Loss: 0.0108973675493249 | Epoch: 14 | MeanAbsoluteError: 0.0995560437440872 | Loss: 0.0153587408437345 | Epoch: 15 | MeanAbsoluteError: 0.0590012930333614 | Loss: 0.0060235163086633 | Epoch: 16 | MeanAbsoluteError: 0.0714228376746178 | Loss: 0.0082313728788377 | Epoch: 17 | MeanAbsoluteError: 0.0712554827332497 | Loss: 0.0085532437691367 | Epoch: 18 | MeanAbsoluteError: 0.0661920383572578 | Loss: 0.0070015181585117 | Epoch: 19 | MeanAbsoluteError: 0.0721942856907845 | Loss: 0.0083224844175244 | Epoch: 20 | MeanAbsoluteError: 0.0912252590060234 | Loss: 0.0110846827125275 | Epoch: 21 | MeanAbsoluteError: 0.0874827429652214 | Loss: 0.0099274394666090 | Epoch: 22 | 
MeanAbsoluteError: 0.1100511923432350 | Loss: 0.0164899692601083 | Epoch: 23 | MeanAbsoluteError: 0.0851866826415062 | Loss: 0.0112329013645649 | Epoch: 24 | MeanAbsoluteError: 0.0689928084611893 | Loss: 0.0071516763602727 | Epoch: 25 | MeanAbsoluteError: 0.0562079697847366 | Loss: 0.0052807102574183 | Epoch: 26 | MeanAbsoluteError: 0.0767030194401741 | Loss: 0.0078454844800657 | Epoch: 27 | MeanAbsoluteError: 0.0726120993494987 | Loss: 0.0082325289810174 | Epoch: 28 | MeanAbsoluteError: 0.0859095379710197 | Loss: 0.0095039440478247 | Epoch: 29 | MeanAbsoluteError: 0.1125765964388847 | Loss: 0.0163729510294568 | Epoch: 30 | MeanAbsoluteError: 0.0611453317105770 | Loss: 0.0056626669278270 | Epoch: 31 | MeanAbsoluteError: 0.0627504661679268 | Loss: 0.0066396265143627 | Epoch: 32 | MeanAbsoluteError: 0.0935003906488419 | Loss: 0.0117195354419221 | Epoch: 33 | 
MeanAbsoluteError: 0.0865811184048653 | Loss: 0.0105488447129334 | Epoch: 34 | MeanAbsoluteError: 0.0710941851139069 | Loss: 0.0076290440353516 | Epoch: 35 | MeanAbsoluteError: 0.1530986428260803 | Loss: 0.0282772382917373 | Epoch: 36 | MeanAbsoluteError: 0.0588685162365437 | Loss: 0.0046758680775958 | Epoch: 37 | MeanAbsoluteError: 0.0503796637058258 | Loss: 0.0044898507614179 | Epoch: 38 | MeanAbsoluteError: 0.0502572581171989 | Loss: 0.0041857939029701 | Epoch: 39 | MeanAbsoluteError: 0.0429409779608250 | Loss: 0.0031509474287496 | Epoch: 40 | MeanAbsoluteError: 0.0705426931381226 | Loss: 0.0071901744476667 | Epoch: 41 | MeanAbsoluteError: 0.0425887666642666 | Loss: 0.0031430213451753 | Epoch: 42 | MeanAbsoluteError: 0.0624663867056370 | Loss: 0.0053371995148298 | Epoch: 43 | MeanAbsoluteError: 0.0483836270868778 | Loss: 0.0040953166838000 | Epoch: 44 | 
MeanAbsoluteError: 0.0584215931594372 | Loss: 0.0064221413708047 | Epoch: 45 | MeanAbsoluteError: 0.0790954753756523 | Loss: 0.0097797428147475 | Epoch: 46 | MeanAbsoluteError: 0.0905225574970245 | Loss: 0.0114586683431346 | Epoch: 47 | MeanAbsoluteError: 0.0658549591898918 | Loss: 0.0069678130032691 | Epoch: 48 | MeanAbsoluteError: 0.0463536754250526 | Loss: 0.0034535940182028 | Epoch: 49 | MeanAbsoluteError: 0.1048360615968704 | Loss: 0.0137494194664453 | Epoch: 50 | MeanAbsoluteError: 0.0556624531745911 | Loss: 0.0043021990537741 | Epoch: 51 | MeanAbsoluteError: 0.0722869783639908 | Loss: 0.0097116528777406 | Epoch: 52 | MeanAbsoluteError: 0.0644847229123116 | Loss: 0.0061400076619496 | Epoch: 53 | MeanAbsoluteError: 0.0920932516455650 | Loss: 0.0126665383944974 | Epoch: 54 | MeanAbsoluteError: 0.0682103186845779 | Loss: 0.0082576403572028 | Epoch: 55 | 
MeanAbsoluteError: 0.0378246493637562 | Loss: 0.0024023350392542 | Epoch: 56 | MeanAbsoluteError: 0.0521546304225922 | Loss: 0.0043456189037227 | Epoch: 57 | MeanAbsoluteError: 0.0582675673067570 | Loss: 0.0051765970052465 | Epoch: 58 | MeanAbsoluteError: 0.0718746259808540 | Loss: 0.0065928520879855 | Epoch: 59 | MeanAbsoluteError: 0.0516660101711750 | Loss: 0.0050847872266068 | Epoch: 60 | MeanAbsoluteError: 0.0736993253231049 | Loss: 0.0066911159083247 | Epoch: 61 | MeanAbsoluteError: 0.0482069030404091 | Loss: 0.0032472751719117 | Epoch: 62 | MeanAbsoluteError: 0.0488415770232677 | Loss: 0.0037872283229310 | Epoch: 63 | MeanAbsoluteError: 0.0743236839771271 | Loss: 0.0080992851381827 | Epoch: 64 | MeanAbsoluteError: 0.0483801215887070 | Loss: 0.0037753586381625 | Epoch: 65 | MeanAbsoluteError: 0.0396941229701042 | Loss: 0.0030094753111419 | Epoch: 66 | 
MeanAbsoluteError: 0.0378321558237076 | Loss: 0.0023484890131696 | Epoch: 67 | MeanAbsoluteError: 0.0404547713696957 | Loss: 0.0028864700258342 | Epoch: 68 | MeanAbsoluteError: 0.0536894276738167 | Loss: 0.0042008003097420 | Epoch: 69 | MeanAbsoluteError: 0.0466026477515697 | Loss: 0.0037811329836442 | Epoch: 70 | MeanAbsoluteError: 0.0519905872642994 | Loss: 0.0040392987950901 | Epoch: 71 | MeanAbsoluteError: 0.0434255711734295 | Loss: 0.0034779545599840 | Epoch: 72 | MeanAbsoluteError: 0.0673918053507805 | Loss: 0.0058227694213488 | Epoch: 73 | MeanAbsoluteError: 0.0676839649677277 | Loss: 0.0057523189492426 | Epoch: 74 | MeanAbsoluteError: 0.0353229902684689 | Loss: 0.0023586862876791 | Epoch: 75 | MeanAbsoluteError: 0.0567175559699535 | Loss: 0.0051866294816136 | Epoch: 76 | MeanAbsoluteError: 0.0730882585048676 | Loss: 0.0073285998905225 | Epoch: 77 | 
MeanAbsoluteError: 0.0632316768169403 | Loss: 0.0054644028760346 | Epoch: 78 | MeanAbsoluteError: 0.0545928589999676 | Loss: 0.0041652859317286 | Epoch: 79 | MeanAbsoluteError: 0.0378904230892658 | Loss: 0.0027935160829465 | Epoch: 80 | MeanAbsoluteError: 0.0333735235035419 | Loss: 0.0024622491351022 | Epoch: 81 | MeanAbsoluteError: 0.0468736961483955 | Loss: 0.0040481776599527 | Epoch: 82 | MeanAbsoluteError: 0.0662287548184395 | Loss: 0.0064529202461831 | Epoch: 83 | MeanAbsoluteError: 0.0428983829915524 | Loss: 0.0031302004767655 | Epoch: 84 | MeanAbsoluteError: 0.0408065877854824 | Loss: 0.0032564261223582 | Epoch: 85 | MeanAbsoluteError: 0.0320414789021015 | Loss: 0.0019886069938749 | Epoch: 86 | MeanAbsoluteError: 0.0640798732638359 | Loss: 0.0063266503060923 | Epoch: 87 | MeanAbsoluteError: 0.0477071441709995 | Loss: 0.0040797027315038 | Epoch: 88 | 
MeanAbsoluteError: 0.0469779856503010 | Loss: 0.0039357772023466 | Epoch: 89 | MeanAbsoluteError: 0.0646031647920609 | Loss: 0.0069825079439110 | Epoch: 90 | MeanAbsoluteError: 0.0615973286330700 | Loss: 0.0050067245335269 | Epoch: 91 | MeanAbsoluteError: 0.0343921296298504 | Loss: 0.0022690253145380 | Epoch: 92 | MeanAbsoluteError: 0.0519913658499718 | Loss: 0.0042656906941710 | Epoch: 93 | MeanAbsoluteError: 0.0342851541936398 | Loss: 0.0024937668617655 | Epoch: 94 | MeanAbsoluteError: 0.0351181589066982 | Loss: 0.0021455743101940 | Epoch: 95 | MeanAbsoluteError: 0.0462987944483757 | Loss: 0.0034177352821356 | Epoch: 96 | MeanAbsoluteError: 0.0578870251774788 | Loss: 0.0045994996816214 | Epoch: 97 | MeanAbsoluteError: 0.0401850827038288 | Loss: 0.0027773280866983 | Epoch: 98 | MeanAbsoluteError: 0.0464251749217510 | Loss: 0.0041473863070439 | Epoch: 99 | 
MeanAbsoluteError: 0.0613627694547176 | Loss: 0.0054498877756200 | Epoch: 100 | MeanAbsoluteError: 0.0493861176073551 | Loss: 0.0037329984479584 | Epoch: 101 | MeanAbsoluteError: 0.0524586103856564 | Loss: 0.0040389670359314 | Epoch: 102 | MeanAbsoluteError: 0.0288395341485739 | Loss: 0.0019472374295123 | Epoch: 103 | MeanAbsoluteError: 0.0421820878982544 | Loss: 0.0032026849956693 | Epoch: 104 | MeanAbsoluteError: 0.0482375733554363 | Loss: 0.0038797105693160 | Epoch: 105 | MeanAbsoluteError: 0.0457050539553165 | Loss: 0.0028322668819639 | Epoch: 106 | MeanAbsoluteError: 0.0690150633454323 | Loss: 0.0072816487242419 | Epoch: 107 | MeanAbsoluteError: 0.0496943481266499 | Loss: 0.0045259281239276 | Epoch: 108 | MeanAbsoluteError: 0.0625996366143227 | Loss: 0.0052014747266903 | Epoch: 109 | MeanAbsoluteError: 0.0792446285486221 | Loss: 0.0080903047959222 | Epoch: 110 | 
MeanAbsoluteError: 0.0466908216476440 | Loss: 0.0032206995896750 | Epoch: 111 | MeanAbsoluteError: 0.0382550098001957 | Loss: 0.0029699095405369 | Epoch: 112 | MeanAbsoluteError: 0.0584789924323559 | Loss: 0.0059909655706418 | Epoch: 113 | MeanAbsoluteError: 0.0575902350246906 | Loss: 0.0053091925005183 | Epoch: 114 | MeanAbsoluteError: 0.0361091159284115 | Loss: 0.0023569782987531 | Epoch: 115 | MeanAbsoluteError: 0.0460491366684437 | Loss: 0.0031029375401742 | Epoch: 116 | MeanAbsoluteError: 0.0571641549468040 | Loss: 0.0048305547695092 | Epoch: 117 | MeanAbsoluteError: 0.0501135848462582 | Loss: 0.0039365520696217 | Epoch: 118 | MeanAbsoluteError: 0.0629853904247284 | Loss: 0.0057436460629106 | Epoch: 119 | MeanAbsoluteError: 0.0461761392652988 | Loss: 0.0034120449640077 | Epoch: 120 | MeanAbsoluteError: 0.0334367156028748 | Loss: 0.0025300171270685 | Epoch: 121 | 
MeanAbsoluteError: 0.0385857447981834 | Loss: 0.0022413637397174 | Epoch: 122 | MeanAbsoluteError: 0.0425891727209091 | Loss: 0.0030458352504004 | Epoch: 123 | MeanAbsoluteError: 0.0489994622766972 | Loss: 0.0036539092237179 | Epoch: 124 | MeanAbsoluteError: 0.0635714083909988 | Loss: 0.0065508022579659 | Epoch: 125 | MeanAbsoluteError: 0.0716934874653816 | Loss: 0.0068648390802800 | Epoch: 126 | MeanAbsoluteError: 0.0388007201254368 | Loss: 0.0028361352980076 | Epoch: 127 | MeanAbsoluteError: 0.0550346709787846 | Loss: 0.0050430580526345 | Epoch: 128 | MeanAbsoluteError: 0.0578943453729153 | Loss: 0.0050292886658817 | Epoch: 129 | MeanAbsoluteError: 0.0267501864582300 | Loss: 0.0016283403659288 | Epoch: 130 | MeanAbsoluteError: 0.0525211244821548 | Loss: 0.0040932972210852 | Epoch: 131 | MeanAbsoluteError: 0.0307914726436138 | Loss: 0.0017079621688218 | Epoch: 132 | 
MeanAbsoluteError: 0.0381686836481094 | Loss: 0.0026270603189723 | Epoch: 133 | MeanAbsoluteError: 0.0531179979443550 | Loss: 0.0041179162401118 | Epoch: 134 | MeanAbsoluteError: 0.0592023730278015 | Loss: 0.0055891009121153 | Epoch: 135 | MeanAbsoluteError: 0.0494322851300240 | Loss: 0.0038314233656581 | Epoch: 136 | MeanAbsoluteError: 0.0257747601717710 | Loss: 0.0013807939486517 | Epoch: 137 | MeanAbsoluteError: 0.0515109412372112 | Loss: 0.0049149579595235 | Epoch: 138 | MeanAbsoluteError: 0.0308775082230568 | Loss: 0.0020339699545538 | Epoch: 139 | MeanAbsoluteError: 0.0346953608095646 | Loss: 0.0025351091462653 | Epoch: 140 | MeanAbsoluteError: 0.0342066735029221 | Loss: 0.0025202384720998 | Epoch: 141 | MeanAbsoluteError: 0.0637626275420189 | Loss: 0.0063634779500334 | Epoch: 142 | MeanAbsoluteError: 0.0679114684462547 | Loss: 0.0056722577734801 | Epoch: 143 | 
MeanAbsoluteError: 0.0649145320057869 | Loss: 0.0065594456636494 | Epoch: 144 | MeanAbsoluteError: 0.0328146629035473 | Loss: 0.0021728079039971 | Epoch: 145 | MeanAbsoluteError: 0.0607507079839706 | Loss: 0.0049107044224480 | Epoch: 146 | MeanAbsoluteError: 0.0329978242516518 | Loss: 0.0020689147533726 | Epoch: 147 | MeanAbsoluteError: 0.0497611723840237 | Loss: 0.0033732995354129 | Epoch: 148 | MeanAbsoluteError: 0.0540797114372253 | Loss: 0.0044674741281932 | Epoch: 149 | MeanAbsoluteError: 0.0341470353305340 | Loss: 0.0020023577089887 | Epoch: 150 | MeanAbsoluteError: 0.0337383933365345 | Loss: 0.0016750657492881 | Epoch: 151 | MeanAbsoluteError: 0.0370855033397675 | Loss: 0.0025966649654468 | Epoch: 152 | MeanAbsoluteError: 0.0511837340891361 | Loss: 0.0038437301103075 | Epoch: 153 | MeanAbsoluteError: 0.0581845864653587 | Loss: 0.0050569452363753 | Epoch: 154 | 
MeanAbsoluteError: 0.0309177692979574 | Loss: 0.0018458574126462 | Epoch: 155 | MeanAbsoluteError: 0.0628540068864822 | Loss: 0.0062360596555089 | Epoch: 156 | MeanAbsoluteError: 0.0503107421100140 | Loss: 0.0042993113594620 | Epoch: 157 | MeanAbsoluteError: 0.0968391299247742 | Loss: 0.0110722305620775 | Epoch: 158 | MeanAbsoluteError: 0.0473672784864902 | Loss: 0.0031748307734042 | Epoch: 159 | MeanAbsoluteError: 0.0463147275149822 | Loss: 0.0037412699671940 | Epoch: 160 | MeanAbsoluteError: 0.0294780358672142 | Loss: 0.0017897682251044 | Epoch: 161 | MeanAbsoluteError: 0.0352023430168629 | Loss: 0.0026631530299231 | Epoch: 162 | MeanAbsoluteError: 0.0312476977705956 | Loss: 0.0019495962202966 | Epoch: 163 | MeanAbsoluteError: 0.0313153006136417 | Loss: 0.0019520271973880 | Epoch: 164 | MeanAbsoluteError: 0.0279815010726452 | Loss: 0.0015450183066270 | Epoch: 165 | 
MeanAbsoluteError: 0.0629592239856720 | Loss: 0.0058474509370219 | Epoch: 166 | MeanAbsoluteError: 0.0568133555352688 | Loss: 0.0050318004398019 | Epoch: 167 | MeanAbsoluteError: 0.0258110202848911 | Loss: 0.0012844319533446 | Epoch: 168 | MeanAbsoluteError: 0.0490126535296440 | Loss: 0.0032734946703146 | Epoch: 169 | MeanAbsoluteError: 0.0531408861279488 | Loss: 0.0042270152526295 | Epoch: 170 | MeanAbsoluteError: 0.0462623797357082 | Loss: 0.0034416084358542 | Epoch: 171 | MeanAbsoluteError: 0.0446479432284832 | Loss: 0.0032369747488318 | Epoch: 172 | MeanAbsoluteError: 0.0417260564863682 | Loss: 0.0034267317050284 | Epoch: 173 | MeanAbsoluteError: 0.0325404517352581 | Loss: 0.0018668095860783 | Epoch: 174 | MeanAbsoluteError: 0.0640951395034790 | Loss: 0.0070572318172229 | Epoch: 175 | MeanAbsoluteError: 0.0382575877010822 | Loss: 0.0025144470824958 | Epoch: 176 | 
MeanAbsoluteError: 0.0485397577285767 | Loss: 0.0039688717194000 | Epoch: 177 | MeanAbsoluteError: 0.0346860662102699 | Loss: 0.0020978049509914 | Epoch: 178 | MeanAbsoluteError: 0.0456258989870548 | Loss: 0.0030167874478809 | Epoch: 179 | MeanAbsoluteError: 0.0366846807301044 | Loss: 0.0024455606073484 | Epoch: 180 | MeanAbsoluteError: 0.0302431806921959 | Loss: 0.0017017022404807 | Epoch: 181 | MeanAbsoluteError: 0.0420019514858723 | Loss: 0.0024789758087871 | Epoch: 182 | MeanAbsoluteError: 0.0539141073822975 | Loss: 0.0037160999827871 | Epoch: 183 | MeanAbsoluteError: 0.0746003836393356 | Loss: 0.0067434443565282 | Epoch: 184 | MeanAbsoluteError: 0.0250127147883177 | Loss: 0.0011616316497614 | Epoch: 185 | MeanAbsoluteError: 0.0571040362119675 | Loss: 0.0042669350698002 | Epoch: 186 | MeanAbsoluteError: 0.0306629966944456 | Loss: 0.0016184670576446 | Epoch: 187 | 
MeanAbsoluteError: 0.0520697608590126 | Loss: 0.0041198049255304 | Epoch: 188 | MeanAbsoluteError: 0.0331550054252148 | Loss: 0.0020706453368276 | Epoch: 189 | MeanAbsoluteError: 0.0506393015384674 | Loss: 0.0037678529165293 | Epoch: 190 | MeanAbsoluteError: 0.0304870475083590 | Loss: 0.0017618440362735 | Epoch: 191 | MeanAbsoluteError: 0.0384334139525890 | Loss: 0.0026679135204942 | Epoch: 192 | MeanAbsoluteError: 0.0570423118770123 | Loss: 0.0051787437819018 | Epoch: 193 | MeanAbsoluteError: 0.0369030721485615 | Loss: 0.0019571355047734 | Epoch: 194 | MeanAbsoluteError: 0.0301548633724451 | Loss: 0.0016542346175380 | Epoch: 195 | MeanAbsoluteError: 0.0328011289238930 | Loss: 0.0022862333104345 | Epoch: 196 | MeanAbsoluteError: 0.0464389882981777 | Loss: 0.0037289487801517 | Epoch: 197 | MeanAbsoluteError: 0.0555381029844284 | Loss: 0.0039987963023841 | Epoch: 198 | 
MeanAbsoluteError: 0.0396247245371342 | Loss: 0.0027724283235760 | Epoch: 199 | MeanAbsoluteError: 0.0411643609404564 | Loss: 0.0024655381406008 | Epoch: 200 | MeanAbsoluteError: 0.0359187722206116 | Loss: 0.0024081790003325 | Epoch: 201 | MeanAbsoluteError: 0.0647639483213425 | Loss: 0.0059612475666463 | Epoch: 202 | MeanAbsoluteError: 0.0361182019114494 | Loss: 0.0022689228276967 | Epoch: 203 | MeanAbsoluteError: 0.0308734029531479 | Loss: 0.0020682340691565 | Epoch: 204 | MeanAbsoluteError: 0.0494871921837330 | Loss: 0.0035533636722616 | Epoch: 205 | MeanAbsoluteError: 0.0471053458750248 | Loss: 0.0037312801210455 | Epoch: 206 | MeanAbsoluteError: 0.0366561599075794 | Loss: 0.0022404833496119 | Epoch: 207 | MeanAbsoluteError: 0.0573679618537426 | Loss: 0.0042714490616498 | Epoch: 208 | MeanAbsoluteError: 0.0540199168026447 | Loss: 0.0039262586138456 | Epoch: 209 | 
MeanAbsoluteError: 0.0373909063637257 | Loss: 0.0021658836462608 | Epoch: 210 | MeanAbsoluteError: 0.0637630671262741 | Loss: 0.0057524653507004 | Epoch: 211 | MeanAbsoluteError: 0.0404165051877499 | Loss: 0.0026848876089054 | Epoch: 212 | MeanAbsoluteError: 0.0448033884167671 | Loss: 0.0037976147018765 | Epoch: 213 | MeanAbsoluteError: 0.0349764414131641 | Loss: 0.0019861608973435 | Epoch: 214 | MeanAbsoluteError: 0.0746559649705887 | Loss: 0.0091564233635405 | Epoch: 215 | MeanAbsoluteError: 0.0518055707216263 | Loss: 0.0044600208485989 | Epoch: 216 | MeanAbsoluteError: 0.0665348544716835 | Loss: 0.0060927172951204 | Early stopping at epoch 215
Returned to Spot: Validation loss: 0.006092717295120421
spotPython tuning: 0.0015749900673032052 [########--] 82.01% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.23266589934986817, 'lr_mult': 7.339222181628309, 'batch_size': 8, 'epochs': 512, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adamax', 'sgd_momentum': 0.2766963149947748}
Epoch: 1 | MeanAbsoluteError: 0.1541225761175156 | Loss: 0.0373115666504753 | Epoch: 2 | MeanAbsoluteError: 0.1396461427211761 | Loss: 0.0308091607385952 | Epoch: 3 | MeanAbsoluteError: 0.1277101486921310 | Loss: 0.0256018827203661 | Epoch: 4 | MeanAbsoluteError: 0.1238697841763496 | Loss: 0.0245116205126243 | Epoch: 5 | MeanAbsoluteError: 0.1102050393819809 | Loss: 0.0211116333835219 | Epoch: 6 | MeanAbsoluteError: 0.1040666550397873 | Loss: 0.0176158992230500 | Epoch: 7 | MeanAbsoluteError: 0.1007635071873665 | Loss: 0.0170008265045717 | Epoch: 8 | MeanAbsoluteError: 0.0932649448513985 | Loss: 0.0149439892143403 | Epoch: 9 | MeanAbsoluteError: 0.0947813987731934 | Loss: 0.0141803327531211 | Epoch: 10 | MeanAbsoluteError: 0.1042147502303123 | Loss: 0.0178914433957911 | Epoch: 11 | 
MeanAbsoluteError: 0.0913608074188232 | Loss: 0.0133648410954170 | Epoch: 12 | MeanAbsoluteError: 0.0823563858866692 | Loss: 0.0105060817563514 | Epoch: 13 | MeanAbsoluteError: 0.0821790099143982 | Loss: 0.0105849379354990 | Epoch: 14 | MeanAbsoluteError: 0.0753440186381340 | Loss: 0.0091888568376338 | Epoch: 15 | MeanAbsoluteError: 0.0738252773880959 | Loss: 0.0093698940748398 | Epoch: 16 | MeanAbsoluteError: 0.0707823783159256 | Loss: 0.0091267520880425 | Epoch: 17 | MeanAbsoluteError: 0.0650810971856117 | Loss: 0.0076486787231835 | Epoch: 18 | MeanAbsoluteError: 0.0676700994372368 | Loss: 0.0080517362864492 | Epoch: 19 | MeanAbsoluteError: 0.0595799498260021 | Loss: 0.0061971314563906 | Epoch: 20 | MeanAbsoluteError: 0.0640069618821144 | Loss: 0.0071323022895836 | Epoch: 21 | MeanAbsoluteError: 0.0607879199087620 | Loss: 0.0066882015426496 | Epoch: 22 | 
MeanAbsoluteError: 0.0742009133100510 | Loss: 0.0086216281143654 | Epoch: 23 | MeanAbsoluteError: 0.0605876147747040 | Loss: 0.0072424075578486 | Epoch: 24 | MeanAbsoluteError: 0.0604981631040573 | Loss: 0.0068467827069598 | Epoch: 25 | MeanAbsoluteError: 0.0596596784889698 | Loss: 0.0062259607733914 | Epoch: 26 | MeanAbsoluteError: 0.0779320895671844 | Loss: 0.0087387671718668 | Epoch: 27 | MeanAbsoluteError: 0.0571656972169876 | Loss: 0.0056998240455103 | Epoch: 28 | MeanAbsoluteError: 0.0650111511349678 | Loss: 0.0067332298525511 | Epoch: 29 | MeanAbsoluteError: 0.0605197511613369 | Loss: 0.0057549424650221 | Epoch: 30 | MeanAbsoluteError: 0.0499731376767159 | Loss: 0.0043001083954311 | Epoch: 31 | MeanAbsoluteError: 0.0528511740267277 | Loss: 0.0051150383752477 | Epoch: 32 | MeanAbsoluteError: 0.0554554052650928 | Loss: 0.0050326154221119 | Epoch: 33 | 
MeanAbsoluteError: 0.0530665330588818 | Loss: 0.0048406644368936 | Epoch: 34 | MeanAbsoluteError: 0.0463807992637157 | Loss: 0.0041781982351830 | Epoch: 35 | MeanAbsoluteError: 0.0476812571287155 | Loss: 0.0043672575143558 | Epoch: 36 | MeanAbsoluteError: 0.0454143732786179 | Loss: 0.0033083746108643 | Epoch: 37 | MeanAbsoluteError: 0.0469229221343994 | Loss: 0.0038269206323955 | Epoch: 38 | MeanAbsoluteError: 0.0448490157723427 | Loss: 0.0034371538732605 | Epoch: 39 | MeanAbsoluteError: 0.0540996305644512 | Loss: 0.0044587673864474 | Epoch: 40 | MeanAbsoluteError: 0.0476976856589317 | Loss: 0.0045885617161586 | Epoch: 41 | MeanAbsoluteError: 0.0434103831648827 | Loss: 0.0036151345457735 | Epoch: 42 | MeanAbsoluteError: 0.0410936400294304 | Loss: 0.0031090637448391 | Epoch: 43 | MeanAbsoluteError: 0.0632179155945778 | Loss: 0.0057606621412560 | Epoch: 44 | 
MeanAbsoluteError: 0.0492202304303646 | Loss: 0.0045358330198245 | Epoch: 45 | MeanAbsoluteError: 0.0448098704218864 | Loss: 0.0038835649764606 | Epoch: 46 | MeanAbsoluteError: 0.0467744059860706 | Loss: 0.0040821657136181 | Epoch: 47 | MeanAbsoluteError: 0.0423034653067589 | Loss: 0.0032889690452353 | Epoch: 48 | MeanAbsoluteError: 0.0399227961897850 | Loss: 0.0029263455102122 | Epoch: 49 | MeanAbsoluteError: 0.0422550439834595 | Loss: 0.0033523041944902 | Epoch: 50 | MeanAbsoluteError: 0.0418115817010403 | Loss: 0.0031714793057242 | Epoch: 51 | MeanAbsoluteError: 0.0412688180804253 | Loss: 0.0032758580943521 | Epoch: 52 | MeanAbsoluteError: 0.0502165593206882 | Loss: 0.0041793671690883 | Epoch: 53 | MeanAbsoluteError: 0.0620093271136284 | Loss: 0.0055992358063936 | Epoch: 54 | MeanAbsoluteError: 0.0427211858332157 | Loss: 0.0034984338042130 | Epoch: 55 | 
MeanAbsoluteError: 0.0455107539892197 | Loss: 0.0036420862751057 | Epoch: 56 | MeanAbsoluteError: 0.0451881960034370 | Loss: 0.0040322882873864 | Epoch: 57 | MeanAbsoluteError: 0.0372392460703850 | Loss: 0.0024982463617466 | Epoch: 58 | MeanAbsoluteError: 0.0438872091472149 | Loss: 0.0034253418485413 | Epoch: 59 | MeanAbsoluteError: 0.0348838493227959 | Loss: 0.0022615551738693 | Epoch: 60 | MeanAbsoluteError: 0.0455232635140419 | Loss: 0.0036497812512894 | Epoch: 61 | MeanAbsoluteError: 0.0440866909921169 | Loss: 0.0034243537505206 | Epoch: 62 | MeanAbsoluteError: 0.0382284447550774 | Loss: 0.0027767621711399 | Epoch: 63 | MeanAbsoluteError: 0.0531309768557549 | Loss: 0.0043818273131221 | Epoch: 64 | MeanAbsoluteError: 0.0408103838562965 | Loss: 0.0031646488258909 | Epoch: 65 | MeanAbsoluteError: 0.0347949191927910 | Loss: 0.0022891942322818 | Epoch: 66 | 
MeanAbsoluteError: 0.0407383218407631 | Loss: 0.0027293451589924 | Epoch: 67 | MeanAbsoluteError: 0.0401151850819588 | Loss: 0.0027738574036017 | Epoch: 68 | MeanAbsoluteError: 0.0421418696641922 | Loss: 0.0030345279021850 | Epoch: 69 | MeanAbsoluteError: 0.0415555909276009 | Loss: 0.0027903942142362 | Epoch: 70 | MeanAbsoluteError: 0.0418571457266808 | Loss: 0.0032973193416470 | Epoch: 71 | MeanAbsoluteError: 0.0472235120832920 | Loss: 0.0036071137261675 | Epoch: 72 | MeanAbsoluteError: 0.0423176586627960 | Loss: 0.0031431390272797 | Epoch: 73 | MeanAbsoluteError: 0.0413760319352150 | Loss: 0.0029678325012547 | Epoch: 74 | MeanAbsoluteError: 0.0447703264653683 | Loss: 0.0031887498120532 | Epoch: 75 | MeanAbsoluteError: 0.0429480746388435 | Loss: 0.0029436061465132 | Epoch: 76 | MeanAbsoluteError: 0.0387268178164959 | Loss: 0.0028826156340074 | Epoch: 77 | 
MeanAbsoluteError: 0.0419839546084404 | Loss: 0.0033673656825589 | Epoch: 78 | MeanAbsoluteError: 0.0377058126032352 | Loss: 0.0027528959755345 | Epoch: 79 | MeanAbsoluteError: 0.0368290692567825 | Loss: 0.0026131009523708 | Epoch: 80 | MeanAbsoluteError: 0.0387162156403065 | Loss: 0.0030164303408176 | Epoch: 81 | MeanAbsoluteError: 0.0407833009958267 | Loss: 0.0031781132198184 | Epoch: 82 | MeanAbsoluteError: 0.0362634398043156 | Loss: 0.0025455016860322 | Epoch: 83 | MeanAbsoluteError: 0.0416466444730759 | Loss: 0.0034000888086953 | Epoch: 84 | MeanAbsoluteError: 0.0357958935201168 | Loss: 0.0022735149870737 | Epoch: 85 | MeanAbsoluteError: 0.0421808920800686 | Loss: 0.0032694676069935 | Epoch: 86 | MeanAbsoluteError: 0.0375171676278114 | Loss: 0.0025644032920306 | Epoch: 87 | MeanAbsoluteError: 0.0526866279542446 | Loss: 0.0041265326496949 | Epoch: 88 | 
MeanAbsoluteError: 0.0394500419497490 | Loss: 0.0029054609660402 | Epoch: 89 | MeanAbsoluteError: 0.0416964292526245 | Loss: 0.0033108618977406 | Epoch: 90 | MeanAbsoluteError: 0.0443307198584080 | Loss: 0.0040662843124377 | Epoch: 91 | MeanAbsoluteError: 0.0362977981567383 | Loss: 0.0022997143138414 | Early stopping at epoch 90
Returned to Spot: Validation loss: 0.0022997143138414494
spotPython tuning: 0.0015749900673032052 [#########-] 87.26% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.23369521993740142, 'lr_mult': 7.288349869991199, 'batch_size': 8, 'epochs': 512, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adamax', 'sgd_momentum': 0.3058242825482079}
Epoch: 1 | MeanAbsoluteError: 0.1554764360189438 | Loss: 0.0386122204118261 | Epoch: 2 | MeanAbsoluteError: 0.1381536424160004 | Loss: 0.0293309809640050 | Epoch: 3 | MeanAbsoluteError: 0.1369004249572754 | Loss: 0.0293667364228321 | Epoch: 4 | MeanAbsoluteError: 0.1157693490386009 | Loss: 0.0216017357612911 | Epoch: 5 | MeanAbsoluteError: 0.1080318167805672 | Loss: 0.0189402840516873 | Epoch: 6 | MeanAbsoluteError: 0.1079679504036903 | Loss: 0.0184731639394733 | Epoch: 7 | MeanAbsoluteError: 0.1031567603349686 | Loss: 0.0168928383347137 | Epoch: 8 | MeanAbsoluteError: 0.0890646576881409 | Loss: 0.0130485354150694 | Epoch: 9 | MeanAbsoluteError: 0.1027812734246254 | Loss: 0.0165221362717842 | Epoch: 10 | MeanAbsoluteError: 0.0851870030164719 | Loss: 0.0114593746103837 | Epoch: 11 | 
MeanAbsoluteError: 0.0799309313297272 | Loss: 0.0105034147242182 | Epoch: 12 | MeanAbsoluteError: 0.0784811750054359 | Loss: 0.0096915225547395 | Epoch: 13 | MeanAbsoluteError: 0.0724771618843079 | Loss: 0.0087435556281554 | Epoch: 14 | MeanAbsoluteError: 0.0683196485042572 | Loss: 0.0082953301148097 | Epoch: 15 | MeanAbsoluteError: 0.0721565261483192 | Loss: 0.0093768168559396 | Epoch: 16 | MeanAbsoluteError: 0.0702508240938187 | Loss: 0.0080230727693752 | Epoch: 17 | MeanAbsoluteError: 0.0626303032040596 | Loss: 0.0073571350704266 | Epoch: 18 | MeanAbsoluteError: 0.0555829890072346 | Loss: 0.0054792210208497 | Epoch: 19 | MeanAbsoluteError: 0.0674048513174057 | Loss: 0.0079299204088257 | Epoch: 20 | MeanAbsoluteError: 0.0551095642149448 | Loss: 0.0050949223697994 | Epoch: 21 | MeanAbsoluteError: 0.0660537257790565 | Loss: 0.0069795381798605 | Epoch: 22 | 
MeanAbsoluteError: 0.0502624996006489 | Loss: 0.0047855757477105 | Epoch: 23 | MeanAbsoluteError: 0.0532280839979649 | Loss: 0.0048031303388263 | Epoch: 24 | MeanAbsoluteError: 0.0490928031504154 | Loss: 0.0044612070043130 | Epoch: 25 | MeanAbsoluteError: 0.0530782043933868 | Loss: 0.0055332771827173 | Epoch: 26 | MeanAbsoluteError: 0.0453713461756706 | Loss: 0.0037074438954924 | Epoch: 27 | MeanAbsoluteError: 0.0795057490468025 | Loss: 0.0085633617066043 | Epoch: 28 | MeanAbsoluteError: 0.0522076226770878 | Loss: 0.0048971677437964 | Epoch: 29 | MeanAbsoluteError: 0.0486100763082504 | Loss: 0.0041171384969187 | Epoch: 30 | MeanAbsoluteError: 0.0428077839314938 | Loss: 0.0032265321887711 | Epoch: 31 | MeanAbsoluteError: 0.0444543473422527 | Loss: 0.0037360325054339 | Epoch: 32 | MeanAbsoluteError: 0.0528617613017559 | Loss: 0.0049874401455255 | Epoch: 33 | 
MeanAbsoluteError: 0.0563183836638927 | Loss: 0.0058388304115445 | Epoch: 34 | MeanAbsoluteError: 0.0450028888881207 | Loss: 0.0040153569586293 | Epoch: 35 | MeanAbsoluteError: 0.0470291189849377 | Loss: 0.0041252795337258 | Epoch: 36 | MeanAbsoluteError: 0.0535046197474003 | Loss: 0.0049393909851604 | Epoch: 37 | MeanAbsoluteError: 0.0427599102258682 | Loss: 0.0036273180326373 | Epoch: 38 | MeanAbsoluteError: 0.0394764095544815 | Loss: 0.0031154577966510 | Epoch: 39 | MeanAbsoluteError: 0.0419631972908974 | Loss: 0.0033151317207069 | Epoch: 40 | MeanAbsoluteError: 0.0428036339581013 | Loss: 0.0032512934795752 | Epoch: 41 | MeanAbsoluteError: 0.0427267923951149 | Loss: 0.0034371162443054 | Epoch: 42 | MeanAbsoluteError: 0.0499174296855927 | Loss: 0.0043525804495929 | Epoch: 43 | MeanAbsoluteError: 0.0447069667279720 | Loss: 0.0033091655426879 | Epoch: 44 | 
MeanAbsoluteError: 0.0430172011256218 | Loss: 0.0034317394510206 | Epoch: 45 | MeanAbsoluteError: 0.0409944355487823 | Loss: 0.0031683202618488 | Epoch: 46 | MeanAbsoluteError: 0.0374671667814255 | Loss: 0.0023511540585835 | Epoch: 47 | MeanAbsoluteError: 0.0369810275733471 | Loss: 0.0026250048586486 | Epoch: 48 | MeanAbsoluteError: 0.0393127948045731 | Loss: 0.0027858151374140 | Epoch: 49 | MeanAbsoluteError: 0.0394553765654564 | Loss: 0.0028100451898737 | Epoch: 50 | MeanAbsoluteError: 0.0387657880783081 | Loss: 0.0028790877779676 | Epoch: 51 | MeanAbsoluteError: 0.0352580361068249 | Loss: 0.0022079414361781 | Epoch: 52 | MeanAbsoluteError: 0.0452683977782726 | Loss: 0.0037981351947804 | Epoch: 53 | MeanAbsoluteError: 0.0363142415881157 | Loss: 0.0023734599143561 | Epoch: 54 | MeanAbsoluteError: 0.0608035773038864 | Loss: 0.0056216503174877 | Epoch: 55 | 
MeanAbsoluteError: 0.0337390713393688 | Loss: 0.0020309910423269 | Epoch: 56 | MeanAbsoluteError: 0.0358567610383034 | Loss: 0.0022131167244975 | Epoch: 57 | MeanAbsoluteError: 0.0372098088264465 | Loss: 0.0026402580567121 | Epoch: 58 | MeanAbsoluteError: 0.0436034835875034 | Loss: 0.0039560626793996 | Epoch: 59 | MeanAbsoluteError: 0.0361792929470539 | Loss: 0.0026564715800831 | Epoch: 60 | MeanAbsoluteError: 0.0351365394890308 | Loss: 0.0023598765669464 | Epoch: 61 | MeanAbsoluteError: 0.0408150330185890 | Loss: 0.0028925538951482 | Epoch: 62 | MeanAbsoluteError: 0.0451416932046413 | Loss: 0.0036965732410624 | Epoch: 63 | MeanAbsoluteError: 0.0361412763595581 | Loss: 0.0023170199496426 | Epoch: 64 | MeanAbsoluteError: 0.0371962599456310 | Loss: 0.0028584841914524 | Epoch: 65 | MeanAbsoluteError: 0.0388014949858189 | Loss: 0.0026035240704292 | Epoch: 66 | 
MeanAbsoluteError: 0.0339961089193821 | Loss: 0.0022413687792754 | Epoch: 67 | MeanAbsoluteError: 0.0415946990251541 | Loss: 0.0032955529811596 | Epoch: 68 | MeanAbsoluteError: 0.0389153435826302 | Loss: 0.0027325258139938 | Epoch: 69 | MeanAbsoluteError: 0.0348053947091103 | Loss: 0.0023588234747111 | Epoch: 70 | MeanAbsoluteError: 0.0343778990209103 | Loss: 0.0022468815242112 | Epoch: 71 | MeanAbsoluteError: 0.0371932834386826 | Loss: 0.0028551700884954 | Epoch: 72 | MeanAbsoluteError: 0.0444335192441940 | Loss: 0.0031934208006868 | Epoch: 73 | MeanAbsoluteError: 0.0396551154553890 | Loss: 0.0031368936799577 | Epoch: 74 | MeanAbsoluteError: 0.0325941480696201 | Loss: 0.0020066082345836 | Epoch: 75 | MeanAbsoluteError: 0.0371698625385761 | Loss: 0.0024878604323787 | Epoch: 76 | MeanAbsoluteError: 0.0371561199426651 | Loss: 0.0023335585658635 | Epoch: 77 | 
MeanAbsoluteError: 0.0394566357135773 | Loss: 0.0025678792567066 | Epoch: 78 | MeanAbsoluteError: 0.0489462651312351 | Loss: 0.0038895743598818 | Epoch: 79 | MeanAbsoluteError: 0.0344182401895523 | Loss: 0.0025019869782754 | Epoch: 80 | MeanAbsoluteError: 0.0389415398240089 | Loss: 0.0026296977302991 | Epoch: 81 | MeanAbsoluteError: 0.0361609198153019 | Loss: 0.0024894748448308 | Epoch: 82 | MeanAbsoluteError: 0.0374165996909142 | Loss: 0.0024772003571821 | Epoch: 83 | MeanAbsoluteError: 0.0419627912342548 | Loss: 0.0034665484931075 | Epoch: 84 | MeanAbsoluteError: 0.0403334125876427 | Loss: 0.0024822419294842 | Epoch: 85 | MeanAbsoluteError: 0.0466831102967262 | Loss: 0.0040446960943212 | Epoch: 86 | MeanAbsoluteError: 0.0360485985875130 | Loss: 0.0029504469842466 | Epoch: 87 | MeanAbsoluteError: 0.0363794937729836 | Loss: 0.0026074987491531 | Epoch: 88 | 
MeanAbsoluteError: 0.0385427623987198 | Loss: 0.0027009861415105 | Epoch: 89 | MeanAbsoluteError: 0.0362989977002144 | Loss: 0.0025683576409631 | Epoch: 90 | MeanAbsoluteError: 0.0516403280198574 | Loss: 0.0045312534723627 | Epoch: 91 | MeanAbsoluteError: 0.0317623093724251 | Loss: 0.0019887444945389 | Epoch: 92 | MeanAbsoluteError: 0.0369366705417633 | Loss: 0.0024923164088058 | Epoch: 93 | MeanAbsoluteError: 0.0339396111667156 | Loss: 0.0024631855125527 | Epoch: 94 | MeanAbsoluteError: 0.0328474268317223 | Loss: 0.0024973353547945 | Epoch: 95 | MeanAbsoluteError: 0.0363773666322231 | Loss: 0.0023991860813878 | Epoch: 96 | MeanAbsoluteError: 0.0345585159957409 | Loss: 0.0022259906668057 | Epoch: 97 | MeanAbsoluteError: 0.0361124463379383 | Loss: 0.0023555540951508 | Epoch: 98 | MeanAbsoluteError: 0.0386100038886070 | Loss: 0.0027825190106676 | Epoch: 99 | 
MeanAbsoluteError: 0.0341466218233109 | Loss: 0.0022546702660436 | Epoch: 100 | MeanAbsoluteError: 0.0350700393319130 | Loss: 0.0023425950570718 | Epoch: 101 | MeanAbsoluteError: 0.0379661619663239 | Loss: 0.0027668126337965 | Epoch: 102 | MeanAbsoluteError: 0.0327008850872517 | Loss: 0.0021379492720467 | Epoch: 103 | MeanAbsoluteError: 0.0410242713987827 | Loss: 0.0032690328555059 | Epoch: 104 | MeanAbsoluteError: 0.0345291346311569 | Loss: 0.0023329491764583 | Epoch: 105 | MeanAbsoluteError: 0.0384873785078526 | Loss: 0.0025692039527808 | Epoch: 106 | MeanAbsoluteError: 0.0330820158123970 | Loss: 0.0022621435041640 | Epoch: 107 | MeanAbsoluteError: 0.0399347059428692 | Loss: 0.0031863564769370 | Epoch: 108 | MeanAbsoluteError: 0.0330177843570709 | Loss: 0.0020221041279575 | Epoch: 109 | MeanAbsoluteError: 0.0349830389022827 | Loss: 0.0025858602641261 | Epoch: 110 | 
MeanAbsoluteError: 0.0410876944661140 | Loss: 0.0028684421788631 | Epoch: 111 | MeanAbsoluteError: 0.0312727056443691 | Loss: 0.0021081585831493 | Epoch: 112 | MeanAbsoluteError: 0.0415178798139095 | Loss: 0.0032996391038116 | Epoch: 113 | MeanAbsoluteError: 0.0329581797122955 | Loss: 0.0018984099695349 | Epoch: 114 | MeanAbsoluteError: 0.0324372611939907 | Loss: 0.0020249953920843 | Epoch: 115 | MeanAbsoluteError: 0.0358343645930290 | Loss: 0.0025449729184498 | Epoch: 116 | MeanAbsoluteError: 0.0324864946305752 | Loss: 0.0021884300053659 | Epoch: 117 | MeanAbsoluteError: 0.0436873398721218 | Loss: 0.0033972726860635 | Epoch: 118 | MeanAbsoluteError: 0.0359686426818371 | Loss: 0.0027313227160209 | Epoch: 119 | MeanAbsoluteError: 0.0309051517397165 | Loss: 0.0019023001368623 | Epoch: 120 | MeanAbsoluteError: 0.0351545549929142 | Loss: 0.0021927016764254 | Epoch: 121 | 
MeanAbsoluteError: 0.0366384088993073 | Loss: 0.0023410923275055 | Epoch: 122 | MeanAbsoluteError: 0.0280789211392403 | Loss: 0.0016106522889459 | Epoch: 123 | MeanAbsoluteError: 0.0385907888412476 | Loss: 0.0032472040498090 | Epoch: 124 | MeanAbsoluteError: 0.0308629255741835 | Loss: 0.0019613419533830 | Epoch: 125 | MeanAbsoluteError: 0.0335121527314186 | Loss: 0.0019438061158565 | Epoch: 126 | MeanAbsoluteError: 0.0327470637857914 | Loss: 0.0020981819122282 | Epoch: 127 | MeanAbsoluteError: 0.0321358852088451 | Loss: 0.0017958299584662 | Epoch: 128 | MeanAbsoluteError: 0.0373118221759796 | Loss: 0.0027312189669924 | Epoch: 129 | MeanAbsoluteError: 0.0404179058969021 | Loss: 0.0027272797589448 | Epoch: 130 | MeanAbsoluteError: 0.0376400388777256 | Loss: 0.0026158883288429 | Epoch: 131 | MeanAbsoluteError: 0.0382482707500458 | Loss: 0.0029500340935652 | Epoch: 132 | 
MeanAbsoluteError: 0.0325923748314381 | Loss: 0.0020800307488810 | Epoch: 133 | MeanAbsoluteError: 0.0330325588583946 | Loss: 0.0022929601117013 | Epoch: 134 | MeanAbsoluteError: 0.0387290790677071 | Loss: 0.0029884046433788 | Epoch: 135 | MeanAbsoluteError: 0.0331574864685535 | Loss: 0.0024649790330410 | Epoch: 136 | MeanAbsoluteError: 0.0382527559995651 | Loss: 0.0025948694781523 | Epoch: 137 | MeanAbsoluteError: 0.0338138155639172 | Loss: 0.0024972933912834 | Epoch: 138 | MeanAbsoluteError: 0.0393060669302940 | Loss: 0.0028680380951540 | Epoch: 139 | MeanAbsoluteError: 0.0330544076859951 | Loss: 0.0021690702392095 | Epoch: 140 | MeanAbsoluteError: 0.0364464633166790 | Loss: 0.0021254912280710 | Epoch: 141 | MeanAbsoluteError: 0.0306935049593449 | Loss: 0.0017266030872155 | Epoch: 142 | MeanAbsoluteError: 0.0350914187729359 | Loss: 0.0030179038838373 | Epoch: 143 | 
MeanAbsoluteError: 0.0352209582924843 | Loss: 0.0024171820297948 | Epoch: 144 | MeanAbsoluteError: 0.0333389118313789 | Loss: 0.0023426730346584 | Epoch: 145 | MeanAbsoluteError: 0.0342363566160202 | Loss: 0.0021238793491839 | Epoch: 146 | MeanAbsoluteError: 0.0320138931274414 | Loss: 0.0019730806640215 | Epoch: 147 | MeanAbsoluteError: 0.0356280915439129 | Loss: 0.0022984241965643 | Epoch: 148 | MeanAbsoluteError: 0.0366051606833935 | Loss: 0.0025398062862223 | Epoch: 149 | MeanAbsoluteError: 0.0317383371293545 | Loss: 0.0023830434097602 | Epoch: 150 | MeanAbsoluteError: 0.0313437543809414 | Loss: 0.0020041991849307 | Epoch: 151 | MeanAbsoluteError: 0.0338635779917240 | Loss: 0.0020806150469549 | Epoch: 152 | MeanAbsoluteError: 0.0381601527333260 | Loss: 0.0024740310450158 | Epoch: 153 | MeanAbsoluteError: 0.0337538942694664 | Loss: 0.0024716505194144 | Epoch: 154 | 
MeanAbsoluteError: 0.0363807901740074 | Loss: 0.0025205009212521 | Early stopping at epoch 153
Returned to Spot: Validation loss: 0.0025205009212521346
spotPython tuning: 0.0015749900673032052 [##########] 95.23% 

config: {'_L_in': 10, '_L_out': 1, 'l1': 32, 'dropout_prob': 0.23207208374587823, 'lr_mult': 7.171682920429353, 'batch_size': 4, 'epochs': 512, 'k_folds': 1, 'patience': 32, 'optimizer': 'Adamax', 'sgd_momentum': 0.41577827649701554}
Epoch: 1 | MeanAbsoluteError: 0.1467274278402328 | Loss: 0.0342639771693697 | Epoch: 2 | MeanAbsoluteError: 0.1279194355010986 | Loss: 0.0257599685682605 | Epoch: 3 | MeanAbsoluteError: 0.1151985898613930 | Loss: 0.0215667312017952 | Epoch: 4 | MeanAbsoluteError: 0.1093183904886246 | Loss: 0.0190519907969671 | Epoch: 5 | MeanAbsoluteError: 0.0991281867027283 | Loss: 0.0153917010330285 | Epoch: 6 | 
MeanAbsoluteError: 0.0894886478781700 | Loss: 0.0125176954447913 | Epoch: 7 | MeanAbsoluteError: 0.0884322896599770 | Loss: 0.0120650409146522 | Epoch: 8 | MeanAbsoluteError: 0.0796170905232430 | Loss: 0.0094481912969301 | Epoch: 9 | MeanAbsoluteError: 0.0759462714195251 | Loss: 0.0099865880724974 | Epoch: 10 | MeanAbsoluteError: 0.0635321885347366 | Loss: 0.0065522091913347 | Epoch: 11 | MeanAbsoluteError: 0.0628774166107178 | Loss: 0.0062544344000829 | Epoch: 12 | 
MeanAbsoluteError: 0.0677002444863319 | Loss: 0.0070711916510481 | Epoch: 13 | MeanAbsoluteError: 0.0539378561079502 | Loss: 0.0049603641774350 | Epoch: 14 | MeanAbsoluteError: 0.0597524531185627 | Loss: 0.0059690378094092 | Epoch: 15 | MeanAbsoluteError: 0.0580984689295292 | Loss: 0.0054242610787818 | Epoch: 16 | MeanAbsoluteError: 0.0508987344801426 | Loss: 0.0048915863382475 | Epoch: 17 | MeanAbsoluteError: 0.0488185696303844 | Loss: 0.0039717744469332 | Epoch: 18 | 
MeanAbsoluteError: 0.0447673276066780 | Loss: 0.0035850006807595 | Epoch: 19 | MeanAbsoluteError: 0.0667019635438919 | Loss: 0.0064404565460670 | Epoch: 20 | MeanAbsoluteError: 0.0446480289101601 | Loss: 0.0031917276984314 | Epoch: 21 | MeanAbsoluteError: 0.0496772713959217 | Loss: 0.0040579030492033 | Epoch: 22 | MeanAbsoluteError: 0.0448724515736103 | Loss: 0.0035676464904464 | Epoch: 23 | MeanAbsoluteError: 0.0443522557616234 | Loss: 0.0031705459409083 | Epoch: 24 | 
MeanAbsoluteError: 0.0566308982670307 | Loss: 0.0052504234477722 | Epoch: 25 | MeanAbsoluteError: 0.0476927049458027 | Loss: 0.0041389793452496 | Epoch: 26 | MeanAbsoluteError: 0.0471478551626205 | Loss: 0.0036715430393815 | Epoch: 27 | MeanAbsoluteError: 0.0438426099717617 | Loss: 0.0034626782037473 | Epoch: 28 | MeanAbsoluteError: 0.0651919618248940 | Loss: 0.0060080223561575 | Epoch: 29 | MeanAbsoluteError: 0.0381015241146088 | Loss: 0.0026448419798786 | Epoch: 30 | 
MeanAbsoluteError: 0.0389935933053493 | Loss: 0.0024727446529626 | Epoch: 31 | MeanAbsoluteError: 0.0434076562523842 | Loss: 0.0031946696357530 | Epoch: 32 | MeanAbsoluteError: 0.0467709302902222 | Loss: 0.0035077174718026 | Epoch: 33 | MeanAbsoluteError: 0.0478978492319584 | Loss: 0.0034538060426712 | Epoch: 34 | MeanAbsoluteError: 0.0452988781034946 | Loss: 0.0031138555942258 | Epoch: 35 | MeanAbsoluteError: 0.0376895368099213 | Loss: 0.0029568151421457 | Epoch: 36 | 
MeanAbsoluteError: 0.0429976917803288 | Loss: 0.0028499781883632 | Epoch: 37 | MeanAbsoluteError: 0.0386928319931030 | Loss: 0.0026958666122907 | Epoch: 38 | MeanAbsoluteError: 0.0358047783374786 | Loss: 0.0023453970556147 | Epoch: 39 | MeanAbsoluteError: 0.0401695631444454 | Loss: 0.0031214155480848 | Epoch: 40 | MeanAbsoluteError: 0.0412451438605785 | Loss: 0.0035133661333627 | Epoch: 41 | MeanAbsoluteError: 0.0449937209486961 | Loss: 0.0031945975920341 | Epoch: 42 | 
MeanAbsoluteError: 0.0401767790317535 | Loss: 0.0026414122659480 | Epoch: 43 | MeanAbsoluteError: 0.0394029058516026 | Loss: 0.0026818252989324 | Epoch: 44 | MeanAbsoluteError: 0.0540089942514896 | Loss: 0.0041395668863940 | Epoch: 45 | MeanAbsoluteError: 0.0541880466043949 | Loss: 0.0041962965628287 | Epoch: 46 | MeanAbsoluteError: 0.0355691649019718 | Loss: 0.0027342852940395 | Epoch: 47 | MeanAbsoluteError: 0.0396922007203102 | Loss: 0.0030446070015508 | Epoch: 48 | 
MeanAbsoluteError: 0.0369933433830738 | Loss: 0.0028170816214212 | Epoch: 49 | MeanAbsoluteError: 0.0358200818300247 | Loss: 0.0022885431637405 | Epoch: 50 | MeanAbsoluteError: 0.0375387705862522 | Loss: 0.0025438910105731 | Epoch: 51 | MeanAbsoluteError: 0.0348372347652912 | Loss: 0.0021653142322126 | Epoch: 52 | MeanAbsoluteError: 0.0377980470657349 | Loss: 0.0023609681361510 | Epoch: 53 | MeanAbsoluteError: 0.0374945402145386 | Loss: 0.0026540968481762 | Epoch: 54 | 
MeanAbsoluteError: 0.0395556949079037 | Loss: 0.0027023159437037 | Epoch: 55 | MeanAbsoluteError: 0.0380013249814510 | Loss: 0.0028426578054981 | Epoch: 56 | MeanAbsoluteError: 0.0415107905864716 | Loss: 0.0026650328061078 | Epoch: 57 | MeanAbsoluteError: 0.0365413203835487 | Loss: 0.0026317312986551 | Epoch: 58 | MeanAbsoluteError: 0.0354156941175461 | Loss: 0.0020849019269614 | Epoch: 59 | MeanAbsoluteError: 0.0317407846450806 | Loss: 0.0019162803491054 | Epoch: 60 | 
MeanAbsoluteError: 0.0332613438367844 | Loss: 0.0023404952627122 | Epoch: 61 | MeanAbsoluteError: 0.0374982468783855 | Loss: 0.0024724218749907 | Epoch: 62 | MeanAbsoluteError: 0.0330330990254879 | Loss: 0.0018542762335467 | Epoch: 63 | MeanAbsoluteError: 0.0412922129034996 | Loss: 0.0029030758482016 | Epoch: 64 | MeanAbsoluteError: 0.0405399128794670 | Loss: 0.0026614807990457 | Epoch: 65 | MeanAbsoluteError: 0.0342043340206146 | Loss: 0.0021958092770850 | Epoch: 66 | 
MeanAbsoluteError: 0.0425611771643162 | Loss: 0.0028767427293739 | Epoch: 67 | MeanAbsoluteError: 0.0360937230288982 | Loss: 0.0026911285590419 | Epoch: 68 | MeanAbsoluteError: 0.0310265254229307 | Loss: 0.0020160770759685 | Epoch: 69 | MeanAbsoluteError: 0.0400923043489456 | Loss: 0.0029304492104954 | Epoch: 70 | MeanAbsoluteError: 0.0374164395034313 | Loss: 0.0023941619145141 | Epoch: 71 | MeanAbsoluteError: 0.0506167821586132 | Loss: 0.0039891845926953 | Epoch: 72 | 
MeanAbsoluteError: 0.0419925898313522 | Loss: 0.0028858055776800 | Epoch: 73 | MeanAbsoluteError: 0.0435884520411491 | Loss: 0.0032136267351840 | Epoch: 74 | MeanAbsoluteError: 0.0345782935619354 | Loss: 0.0023005319195848 | Epoch: 75 | MeanAbsoluteError: 0.0318384021520615 | Loss: 0.0019212393846828 | Epoch: 76 | MeanAbsoluteError: 0.0416642874479294 | Loss: 0.0030753423933250 | Epoch: 77 | MeanAbsoluteError: 0.0303832944482565 | Loss: 0.0016114753694274 | Epoch: 78 | 
MeanAbsoluteError: 0.0332897007465363 | Loss: 0.0017585964838509 | Epoch: 79 | MeanAbsoluteError: 0.0385771170258522 | Loss: 0.0022886274000242 | Epoch: 80 | MeanAbsoluteError: 0.0342486463487148 | Loss: 0.0024413212396515 | Epoch: 81 | MeanAbsoluteError: 0.0319216735661030 | Loss: 0.0020796398847112 | Epoch: 82 | MeanAbsoluteError: 0.0442915409803391 | Loss: 0.0031167641489689 | Epoch: 83 | MeanAbsoluteError: 0.0320579856634140 | Loss: 0.0019652217175462 | Epoch: 84 | 
MeanAbsoluteError: 0.0322107076644897 | Loss: 0.0019708833502955 | Epoch: 85 | MeanAbsoluteError: 0.0390330329537392 | Loss: 0.0026858585250253 | Epoch: 86 | MeanAbsoluteError: 0.0392145141959190 | Loss: 0.0023488021870920 | Epoch: 87 | MeanAbsoluteError: 0.0317002497613430 | Loss: 0.0019931599751969 | Epoch: 88 | MeanAbsoluteError: 0.0374857001006603 | Loss: 0.0024542346360007 | Epoch: 89 | MeanAbsoluteError: 0.0329678803682327 | Loss: 0.0018608247191878 | Epoch: 90 | 
MeanAbsoluteError: 0.0340527407824993 | Loss: 0.0024032472094405 | Epoch: 91 | MeanAbsoluteError: 0.0365735851228237 | Loss: 0.0022307216715611 | Epoch: 92 | MeanAbsoluteError: 0.0357925705611706 | Loss: 0.0024037940338409 | Epoch: 93 | MeanAbsoluteError: 0.0333674326539040 | Loss: 0.0023456101269888 | Epoch: 94 | MeanAbsoluteError: 0.0282090567052364 | Loss: 0.0017375654105369 | Epoch: 95 | MeanAbsoluteError: 0.0290706697851419 | Loss: 0.0014783064703806 | Epoch: 96 | 
MeanAbsoluteError: 0.0321782603859901 | Loss: 0.0017903581283948 | Epoch: 97 | MeanAbsoluteError: 0.0496624298393726 | Loss: 0.0038271901958312 | Epoch: 98 | MeanAbsoluteError: 0.0332420431077480 | Loss: 0.0021523293708742 | Epoch: 99 | MeanAbsoluteError: 0.0405935607850552 | Loss: 0.0026273569162004 | Epoch: 100 | MeanAbsoluteError: 0.0321754664182663 | Loss: 0.0017257910074356 | Epoch: 101 | MeanAbsoluteError: 0.0426290109753609 | Loss: 0.0032054584444268 | Epoch: 102 | 
MeanAbsoluteError: 0.0365186184644699 | Loss: 0.0022010728493721 | Epoch: 103 | MeanAbsoluteError: 0.0378952845931053 | Loss: 0.0024470931023825 | Epoch: 104 | MeanAbsoluteError: 0.0303844772279263 | Loss: 0.0016016485408181 | Epoch: 105 | MeanAbsoluteError: 0.0317410230636597 | Loss: 0.0017326273845780 | Epoch: 106 | MeanAbsoluteError: 0.0341768376529217 | Loss: 0.0020902705305101 | Epoch: 107 | MeanAbsoluteError: 0.0346680432558060 | Loss: 0.0020381109870505 | Epoch: 108 | 
MeanAbsoluteError: 0.0302570238709450 | Loss: 0.0018071834909885 | Epoch: 109 | MeanAbsoluteError: 0.0435991436243057 | Loss: 0.0032845674330990 | Epoch: 110 | MeanAbsoluteError: 0.0344886779785156 | Loss: 0.0020054857002106 | Epoch: 111 | MeanAbsoluteError: 0.0353386998176575 | Loss: 0.0024198657102534 | Epoch: 112 | MeanAbsoluteError: 0.0332357138395309 | Loss: 0.0023967987202923 | Epoch: 113 | MeanAbsoluteError: 0.0296184029430151 | Loss: 0.0019570032038609 | Epoch: 114 | 
MeanAbsoluteError: 0.0340445898473263 | Loss: 0.0019907734828303 | Epoch: 115 | MeanAbsoluteError: 0.0316646620631218 | Loss: 0.0017030261052423 | Epoch: 116 | MeanAbsoluteError: 0.0390845127403736 | Loss: 0.0026583353699728 | Epoch: 117 | MeanAbsoluteError: 0.0317254401743412 | Loss: 0.0023012494559710 | Epoch: 118 | MeanAbsoluteError: 0.0322062633931637 | Loss: 0.0019163792837935 | Epoch: 119 | MeanAbsoluteError: 0.0283815730363131 | Loss: 0.0014103095445898 | Epoch: 120 | 
MeanAbsoluteError: 0.0405085757374763 | Loss: 0.0024323359690607 | Epoch: 121 | MeanAbsoluteError: 0.0283977501094341 | Loss: 0.0015262959575436 | Epoch: 122 | MeanAbsoluteError: 0.0282334703952074 | Loss: 0.0015685829811264 | Epoch: 123 | MeanAbsoluteError: 0.0327820405364037 | Loss: 0.0018427225239187 | Epoch: 124 | MeanAbsoluteError: 0.0272926688194275 | Loss: 0.0015024509494348 | Epoch: 125 | MeanAbsoluteError: 0.0305783841758966 | Loss: 0.0021986829878491 | Epoch: 126 | 
MeanAbsoluteError: 0.0307519119232893 | Loss: 0.0017378482489827 | Epoch: 127 | MeanAbsoluteError: 0.0315463282167912 | Loss: 0.0021257724385941 | Epoch: 128 | MeanAbsoluteError: 0.0332776606082916 | Loss: 0.0021705679405325 | Epoch: 129 | MeanAbsoluteError: 0.0292933974415064 | Loss: 0.0014368111638275 | Epoch: 130 | MeanAbsoluteError: 0.0320044606924057 | Loss: 0.0016173854334435 | Epoch: 131 | MeanAbsoluteError: 0.0266231335699558 | Loss: 0.0012993852953271 | Epoch: 132 | 
MeanAbsoluteError: 0.0293146539479494 | Loss: 0.0015596165835935 | Epoch: 133 | MeanAbsoluteError: 0.0239500179886818 | Loss: 0.0010878521788982 | Epoch: 134 | MeanAbsoluteError: 0.0417068302631378 | Loss: 0.0026756589453726 | Epoch: 135 | MeanAbsoluteError: 0.0412213578820229 | Loss: 0.0029165761002029 | Epoch: 136 | MeanAbsoluteError: 0.0366368629038334 | Loss: 0.0022394234844251 | Epoch: 137 | MeanAbsoluteError: 0.0322229564189911 | Loss: 0.0021008254153761 | Epoch: 138 | 
MeanAbsoluteError: 0.0282800365239382 | Loss: 0.0013968453645551 | Epoch: 139 | MeanAbsoluteError: 0.0316473580896854 | Loss: 0.0018035906904455 | Epoch: 140 | MeanAbsoluteError: 0.0264845173805952 | Loss: 0.0013324112978686 | Epoch: 141 | MeanAbsoluteError: 0.0336364805698395 | Loss: 0.0019657743966673 | Epoch: 142 | MeanAbsoluteError: 0.0324042104184628 | Loss: 0.0019784303286967 | Epoch: 143 | MeanAbsoluteError: 0.0330296605825424 | Loss: 0.0020025688023694 | Epoch: 144 | 
MeanAbsoluteError: 0.0433458909392357 | Loss: 0.0030387942163118 | Epoch: 145 | MeanAbsoluteError: 0.0337122865021229 | Loss: 0.0020690588320819 | Epoch: 146 | MeanAbsoluteError: 0.0328972339630127 | Loss: 0.0024323625923231 | Epoch: 147 | MeanAbsoluteError: 0.0534378252923489 | Loss: 0.0045030631093929 | Epoch: 148 | MeanAbsoluteError: 0.0370488055050373 | Loss: 0.0025496424901454 | Epoch: 149 | MeanAbsoluteError: 0.0420572459697723 | Loss: 0.0032681788284875 | Epoch: 150 | 
MeanAbsoluteError: 0.0415934100747108 | Loss: 0.0030100848085325 | Epoch: 151 | MeanAbsoluteError: 0.0331489704549313 | Loss: 0.0024148078076541 | Epoch: 152 | MeanAbsoluteError: 0.0298735331743956 | Loss: 0.0017702883793390 | Epoch: 153 | MeanAbsoluteError: 0.0312916934490204 | Loss: 0.0019012561932323 | Epoch: 154 | MeanAbsoluteError: 0.0309804882854223 | Loss: 0.0018046070439353 | Epoch: 155 | MeanAbsoluteError: 0.0347637422382832 | Loss: 0.0021735026185828 | Epoch: 156 | 
MeanAbsoluteError: 0.0366489142179489 | Loss: 0.0020995611053271 | Epoch: 157 | MeanAbsoluteError: 0.0364068076014519 | Loss: 0.0027161014929394 | Epoch: 158 | MeanAbsoluteError: 0.0336003378033638 | Loss: 0.0018823983595939 | Epoch: 159 | MeanAbsoluteError: 0.0356222279369831 | Loss: 0.0020731893090609 | Epoch: 160 | MeanAbsoluteError: 0.0337330065667629 | Loss: 0.0018417193084800 | Epoch: 161 | MeanAbsoluteError: 0.0317757427692413 | Loss: 0.0018102932814751 | Epoch: 162 | 
MeanAbsoluteError: 0.0386520251631737 | Loss: 0.0027062978240428 | Epoch: 163 | MeanAbsoluteError: 0.0304391793906689 | Loss: 0.0016824931267668 | Epoch: 164 | MeanAbsoluteError: 0.0504992641508579 | Loss: 0.0036358934827149 | Epoch: 165 | MeanAbsoluteError: 0.0333048216998577 | Loss: 0.0019406464715818 | Early stopping at epoch 164
Returned to Spot: Validation loss: 0.00194064647158181
spotPython tuning: 0.0015749900673032052 [##########] 100.00% Done...
<spotPython.spot.spot.Spot at 0x2b9fd7190>

19.9 Step 9: Tensorboard

The textual output shown in the console (or code cell) can be visualized with Tensorboard as described in Section 14.9, see also the description in the documentation: Tensorboard.

19.10 Step 10: Results

After the hyperparameter tuning run is finished, the results can be analyzed as described in Section 14.10.

spot_tuner.plot_progress(log_y=False,
    filename="./figures/" + experiment_name+"_progress.png")

Progress plot. Black dots denote results from the initial design. Red dots illustrate the improvement found by the surrogate model based optimization.
print(gen_design_table(fun_control=fun_control, spot=spot_tuner))
| name         | type   | default   |   lower |   upper |              tuned | transform             |   importance | stars   |
|--------------|--------|-----------|---------|---------|--------------------|-----------------------|--------------|---------|
| _L_in        | int    | 10        |    10.0 |    10.0 |               10.0 | None                  |         0.00 |         |
| _L_out       | int    | 1         |     1.0 |     1.0 |                1.0 | None                  |         0.00 |         |
| l1           | int    | 3         |     3.0 |     8.0 |                6.0 | transform_power_2_int |         1.96 | *       |
| dropout_prob | float  | 0.01      |     0.0 |     0.9 | 0.2351929042048888 | None                  |        18.30 | *       |
| lr_mult      | float  | 1.0       |     0.1 |    10.0 |  6.968008887729215 | None                  |       100.00 | ***     |
| batch_size   | int    | 4         |     1.0 |     4.0 |                3.0 | transform_power_2_int |         0.00 |         |
| epochs       | int    | 4         |     2.0 |    16.0 |               12.0 | transform_power_2_int |        19.31 | *       |
| k_folds      | int    | 1         |     1.0 |     1.0 |                1.0 | None                  |         0.00 |         |
| patience     | int    | 2         |     3.0 |     7.0 |                5.0 | transform_power_2_int |         0.47 | .       |
| optimizer    | factor | SGD       |     0.0 |     6.0 |                0.0 | None                  |        46.55 | *       |
| sgd_momentum | float  | 0.0       |     0.0 |     1.0 |  0.782150193965759 | None                  |         0.00 |         |
spot_tuner.plot_importance(threshold=0.025,
    filename="./figures/" + experiment_name+"_importance.png")

Variable importance plot, threshold 0.025.

19.10.1 Get the Tuned Architecture (SPOT Results)

from spotPython.hyperparameters.values import get_one_core_model_from_X
X = spot_tuner.to_all_dim(spot_tuner.min_X.reshape(1,-1))
model_spot = get_one_core_model_from_X(X, fun_control)
model_spot
Net_lin_reg(
  (fc1): Linear(in_features=10, out_features=64, bias=True)
  (fc2): Linear(in_features=64, out_features=32, bias=True)
  (fc3): Linear(in_features=32, out_features=1, bias=True)
  (relu): ReLU()
  (softmax): Softmax(dim=1)
  (dropout1): Dropout(p=0.2351929042048888, inplace=False)
  (dropout2): Dropout(p=0.1175964521024444, inplace=False)
)

19.10.2 Evaluation of the Tuned Architecture

from spotPython.torch.traintest import (
    train_tuned,
    test_tuned,
    )
train_tuned(net=model_spot, train_dataset=train,
        loss_function=fun_control["loss_function"],
        metric=fun_control["metric_torch"],
        shuffle=True,
        device = fun_control["device"],
        path=None,
        task=fun_control["task"],)
Epoch: 1 | MeanAbsoluteError: 0.1650581210851669 | Loss: 0.0394061903077129 | Epoch: 2 | MeanAbsoluteError: 0.1246103420853615 | Loss: 0.0234934884662691 | Epoch: 3 | MeanAbsoluteError: 0.3123507797718048 | Loss: 0.1125329291742099 | Epoch: 4 | MeanAbsoluteError: 0.3352417051792145 | Loss: 0.1290363767429402 | Epoch: 5 | MeanAbsoluteError: 0.1307443529367447 | Loss: 0.0253504656475822 | Epoch: 6 | MeanAbsoluteError: 0.1094256937503815 | Loss: 0.0172118619819613 | Epoch: 7 | MeanAbsoluteError: 0.0929616913199425 | Loss: 0.0143275475497112 | Epoch: 8 | MeanAbsoluteError: 0.1257256269454956 | Loss: 0.0209784391091058 | Epoch: 9 | MeanAbsoluteError: 0.0753368809819221 | Loss: 0.0085730770492534 | Epoch: 10 | MeanAbsoluteError: 0.0753952115774155 | Loss: 0.0099673009581717 | Epoch: 11 | 
MeanAbsoluteError: 0.1208384707570076 | Loss: 0.0190504924639275 | Epoch: 12 | MeanAbsoluteError: 0.1136713922023773 | Loss: 0.0174790630117059 | Epoch: 13 | MeanAbsoluteError: 0.0823391899466515 | Loss: 0.0110233774788580 | Epoch: 14 | MeanAbsoluteError: 0.1280873417854309 | Loss: 0.0207527905065370 | Epoch: 15 | MeanAbsoluteError: 0.0733741372823715 | Loss: 0.0085843535948937 | Epoch: 16 | MeanAbsoluteError: 0.0731063559651375 | Loss: 0.0082484109443612 | Epoch: 17 | MeanAbsoluteError: 0.1328975558280945 | Loss: 0.0233019132069067 | Epoch: 18 | MeanAbsoluteError: 0.0636803284287453 | Loss: 0.0067597427451370 | Epoch: 19 | MeanAbsoluteError: 0.0521852970123291 | Loss: 0.0040799268294665 | Epoch: 20 | MeanAbsoluteError: 0.1180770471692085 | Loss: 0.0165950956656352 | Epoch: 21 | MeanAbsoluteError: 0.0683115795254707 | Loss: 0.0074897403277359 | Epoch: 22 | 
MeanAbsoluteError: 0.1304858475923538 | Loss: 0.0206972476658656 | Epoch: 23 | MeanAbsoluteError: 0.0736429616808891 | Loss: 0.0085006167952854 | Epoch: 24 | MeanAbsoluteError: 0.0933236256241798 | Loss: 0.0118802615968314 | Epoch: 25 | MeanAbsoluteError: 0.0390118956565857 | Loss: 0.0028009021418831 | Epoch: 26 | MeanAbsoluteError: 0.0622562803328037 | Loss: 0.0069610603784799 | Epoch: 27 | MeanAbsoluteError: 0.0815006569027901 | Loss: 0.0102319637754638 | Epoch: 28 | MeanAbsoluteError: 0.1121134683489799 | Loss: 0.0153489555109684 | Epoch: 29 | MeanAbsoluteError: 0.0792539715766907 | Loss: 0.0102590502938256 | Epoch: 30 | MeanAbsoluteError: 0.0620294511318207 | Loss: 0.0058353814774340 | Epoch: 31 | MeanAbsoluteError: 0.0466223284602165 | Loss: 0.0040925753771597 | Epoch: 32 | MeanAbsoluteError: 0.0968276485800743 | Loss: 0.0120625244453549 | Epoch: 33 | 
MeanAbsoluteError: 0.0654591098427773 | Loss: 0.0061547289890433 | Epoch: 34 | MeanAbsoluteError: 0.0857981517910957 | Loss: 0.0104921693656299 | Epoch: 35 | MeanAbsoluteError: 0.0840799435973167 | Loss: 0.0093797878913679 | Epoch: 36 | MeanAbsoluteError: 0.0936994776129723 | Loss: 0.0107294769933153 | Epoch: 37 | MeanAbsoluteError: 0.0727187842130661 | Loss: 0.0081605568013497 | Epoch: 38 | MeanAbsoluteError: 0.1143024191260338 | Loss: 0.0172152395458206 | Epoch: 39 | MeanAbsoluteError: 0.0659631341695786 | Loss: 0.0060537897087143 | Epoch: 40 | MeanAbsoluteError: 0.1126304864883423 | Loss: 0.0169388904285274 | Epoch: 41 | MeanAbsoluteError: 0.0756546556949615 | Loss: 0.0080695090950222 | Epoch: 42 | MeanAbsoluteError: 0.1168607100844383 | Loss: 0.0164538328352041 | Epoch: 43 | MeanAbsoluteError: 0.0988017171621323 | Loss: 0.0118096037767828 | Epoch: 44 | 
MeanAbsoluteError: 0.0499737262725830 | Loss: 0.0042693529501680 | Epoch: 45 | MeanAbsoluteError: 0.0861722752451897 | Loss: 0.0100474226116938 | Epoch: 46 | MeanAbsoluteError: 0.0711000636219978 | Loss: 0.0082658969208990 | Epoch: 47 | MeanAbsoluteError: 0.0452042296528816 | Loss: 0.0040199348218984 | Epoch: 48 | MeanAbsoluteError: 0.0881458818912506 | Loss: 0.0098096253227835 | Epoch: 49 | MeanAbsoluteError: 0.1110117956995964 | Loss: 0.0175987719558179 | Epoch: 50 | MeanAbsoluteError: 0.0906753838062286 | Loss: 0.0118928151817894 | Epoch: 51 | MeanAbsoluteError: 0.0952761024236679 | Loss: 0.0114077436247546 | Epoch: 52 | MeanAbsoluteError: 0.0909674614667892 | Loss: 0.0105627369454229 | Epoch: 53 | MeanAbsoluteError: 0.0446550808846951 | Loss: 0.0034914010060387 | Epoch: 54 | MeanAbsoluteError: 0.0598095245659351 | Loss: 0.0054586947141950 | Epoch: 55 | 
MeanAbsoluteError: 0.0586848966777325 | Loss: 0.0053180242049214 | Epoch: 56 | MeanAbsoluteError: 0.0741182416677475 | Loss: 0.0096583124005089 | Epoch: 57 | MeanAbsoluteError: 0.0552331544458866 | Loss: 0.0049371939155543 | Early stopping at epoch 56
Returned to Spot: Validation loss: 0.004937193915554273

If path is set to a filename, e.g., path = "model_spot_trained.pt", the weights of the trained model will be loaded from this file.

test_tuned(net=model_spot, test_dataset=test,
            shuffle=False,
            loss_function=fun_control["loss_function"],
            metric=fun_control["metric_torch"],
            device = fun_control["device"],
            task=fun_control["task"],)
MeanAbsoluteError: 0.0516573488712311 | Loss: 0.0041228815498471 | Final evaluation: Validation loss: 0.0041228815498470794
Final evaluation: Validation metric: 0.05165734887123108
----------------------------------------------
(0.0041228815498470794, nan, tensor(0.0517))

19.10.3 Cross-validated Evaluations

  • This is the evaluation that will be used in the comparison (evaluatecv has to be updated before, to get metric vlaues!):
from spotPython.torch.traintest import evaluate_cv
# modify k-kolds:
setattr(model_spot, "k_folds",  10)
df_eval, df_preds, df_metrics = evaluate_cv(net=model_spot,
            dataset=fun_control["data"],
            loss_function=fun_control["loss_function"],
            metric=fun_control["metric_torch"],
            task=fun_control["task"],
            writer=fun_control["writer"],
            writerId="model_spot_cv",
            device = fun_control["device"])
Fold: 1
Epoch: 1 | MeanAbsoluteError: 0.1270460188388824 | Loss: 0.0238463072679364 | Epoch: 2 | MeanAbsoluteError: 0.1749499440193176 | Loss: 0.0416610053238960 | Epoch: 3 | MeanAbsoluteError: 0.1281647980213165 | Loss: 0.0252674015668722 | Epoch: 4 | MeanAbsoluteError: 0.0875769332051277 | Loss: 0.0116372055624827 | Epoch: 5 | 
MeanAbsoluteError: 0.0979614928364754 | Loss: 0.0144333589750414 | Epoch: 6 | 
MeanAbsoluteError: 0.0770765990018845 | Loss: 0.0100851232105365 | Epoch: 7 | MeanAbsoluteError: 0.1019514873623848 | Loss: 0.0136438001735279 | Epoch: 8 | MeanAbsoluteError: 0.0864775478839874 | Loss: 0.0123099992320371 | Epoch: 9 | MeanAbsoluteError: 0.1058864668011665 | Loss: 0.0171550425987404 | Epoch: 10 | MeanAbsoluteError: 0.1364749372005463 | Loss: 0.0232295515732123 | Epoch: 11 | MeanAbsoluteError: 0.1153961271047592 | Loss: 0.0182958670820181 | Epoch: 12 | 
MeanAbsoluteError: 0.0450381413102150 | Loss: 0.0031505675556568 | Epoch: 13 | 
MeanAbsoluteError: 0.0762923061847687 | Loss: 0.0075857434421778 | Epoch: 14 | MeanAbsoluteError: 0.0804207399487495 | Loss: 0.0086709217240031 | Epoch: 15 | MeanAbsoluteError: 0.1356700360774994 | Loss: 0.0225784519973856 | Epoch: 16 | MeanAbsoluteError: 0.0911061987280846 | Loss: 0.0105023976558676 | Epoch: 17 | MeanAbsoluteError: 0.0592626854777336 | Loss: 0.0058804219946838 | Epoch: 18 | MeanAbsoluteError: 0.0435630604624748 | Loss: 0.0034356732816937 | Epoch: 19 | 
MeanAbsoluteError: 0.0582772716879845 | Loss: 0.0054664843751547 | Epoch: 20 | 
MeanAbsoluteError: 0.0540629513561726 | Loss: 0.0043616097312994 | Epoch: 21 | MeanAbsoluteError: 0.0633755102753639 | Loss: 0.0052548396365287 | Epoch: 22 | MeanAbsoluteError: 0.0479066595435143 | Loss: 0.0034239231877459 | Epoch: 23 | MeanAbsoluteError: 0.0600698329508305 | Loss: 0.0058660189030119 | Epoch: 24 | MeanAbsoluteError: 0.1158349588513374 | Loss: 0.0184164986444207 | Epoch: 25 | MeanAbsoluteError: 0.0622257702052593 | Loss: 0.0053023925731675 | Epoch: 26 | 
MeanAbsoluteError: 0.0770299807190895 | Loss: 0.0077008089193931 | Epoch: 27 | 
MeanAbsoluteError: 0.0366315878927708 | Loss: 0.0023451383548001 | Epoch: 28 | MeanAbsoluteError: 0.0488185919821262 | Loss: 0.0035732285021088 | Epoch: 29 | MeanAbsoluteError: 0.0441770330071449 | Loss: 0.0046463737246366 | Epoch: 30 | MeanAbsoluteError: 0.0900834873318672 | Loss: 0.0121672391676559 | Epoch: 31 | MeanAbsoluteError: 0.0756051316857338 | Loss: 0.0076245945663406 | Epoch: 32 | MeanAbsoluteError: 0.0637139379978180 | Loss: 0.0055866666281453 | Epoch: 33 | 
MeanAbsoluteError: 0.1118892878293991 | Loss: 0.0156977807816405 | Epoch: 34 | 
MeanAbsoluteError: 0.0386546850204468 | Loss: 0.0024941188345950 | Epoch: 35 | MeanAbsoluteError: 0.0438023358583450 | Loss: 0.0031403821463195 | Epoch: 36 | MeanAbsoluteError: 0.0613978207111359 | Loss: 0.0057341107883706 | Epoch: 37 | MeanAbsoluteError: 0.0521349236369133 | Loss: 0.0044182315200137 | Epoch: 38 | MeanAbsoluteError: 0.0409958995878696 | Loss: 0.0026736856312849 | Epoch: 39 | MeanAbsoluteError: 0.0727818980813026 | Loss: 0.0074567056458014 | Epoch: 40 | 
MeanAbsoluteError: 0.0895361006259918
 | Loss: 0.0097582146811944 | Epoch: 41 | MeanAbsoluteError: 0.1396567076444626 | Loss: 0.0230635858785648 | Epoch: 42 | MeanAbsoluteError: 0.0468857996165752 | Loss: 0.0041493440154367 | Epoch: 43 | MeanAbsoluteError: 0.0350015573203564 | Loss: 0.0019615544677855 | Epoch: 44 | MeanAbsoluteError: 0.1062439456582069 | Loss: 0.0151524949962130 | Epoch: 45 | MeanAbsoluteError: 0.0754746049642563 | Loss: 0.0076045748204566 | Epoch: 46 | MeanAbsoluteError: 0.0340585000813007 | Loss: 0.0027569346891071 | 
Epoch: 47 | MeanAbsoluteError: 0.0499974489212036 | Loss: 0.0036145629755293 | Epoch: 48 | MeanAbsoluteError: 0.0891140848398209 | Loss: 0.0095041269937960 | Epoch: 49 | MeanAbsoluteError: 0.1055869162082672 | Loss: 0.0129545363239371 | Epoch: 50 | MeanAbsoluteError: 0.0702945441007614 | Loss: 0.0071600904204668 | Epoch: 51 | MeanAbsoluteError: 0.0529486797749996 | Loss: 0.0043273431589254 | Epoch: 52 | MeanAbsoluteError: 0.0525381788611412 | Loss: 0.0043311682081996 | Epoch: 53 | 
MeanAbsoluteError: 0.0436397120356560 | Loss: 0.0032420361307091 | Epoch: 54 | MeanAbsoluteError: 0.0553815998136997 | Loss: 0.0047330236456429 | Epoch: 55 | MeanAbsoluteError: 0.0819080173969269 | Loss: 0.0092553556538545 | Epoch: 56 | MeanAbsoluteError: 0.0356888584792614 | Loss: 0.0024450457242962 | Epoch: 57 | MeanAbsoluteError: 0.0571393780410290 | Loss: 0.0042764225150817 | Epoch: 58 | MeanAbsoluteError: 0.0751289799809456 | Loss: 0.0075973572496038 | Epoch: 59 | MeanAbsoluteError: 0.0518726967275143 | Loss: 0.0048263632746127 | Epoch: 60 | 
MeanAbsoluteError: 0.0734219327569008 | Loss: 0.0077901609743444 | Epoch: 61 | MeanAbsoluteError: 0.0865056887269020 | Loss: 0.0094511292588252 | Epoch: 62 | MeanAbsoluteError: 0.0485210195183754 | Loss: 0.0030887743296961 | Epoch: 63 | MeanAbsoluteError: 0.0522453226149082 | Loss: 0.0049918279401027 | Epoch: 64 | MeanAbsoluteError: 0.0405377373099327 | Loss: 0.0027351813836364 | Epoch: 65 | MeanAbsoluteError: 0.0405152477324009 | Loss: 0.0022864872231506 | Epoch: 66 | MeanAbsoluteError: 0.0328501015901566 | Loss: 0.0019413299473504 | Epoch: 67 | 
MeanAbsoluteError: 0.0600634254515171 | Loss: 0.0054389557872827 | Epoch: 68 | MeanAbsoluteError: 0.0414358414709568 | Loss: 0.0028028122346418 | Epoch: 69 | MeanAbsoluteError: 0.0535140223801136 | Loss: 0.0044752631981212 | Epoch: 70 | MeanAbsoluteError: 0.0507709681987762 | Loss: 0.0044503097440331 | Epoch: 71 | MeanAbsoluteError: 0.0320247001945972 | Loss: 0.0016039561977288 | Epoch: 72 | MeanAbsoluteError: 0.0415541045367718 | Loss: 0.0028653350219919 | Epoch: 73 | MeanAbsoluteError: 0.0367858782410622 | Loss: 0.0022142087646688 | Epoch: 74 | 
MeanAbsoluteError: 0.0277187917381525 | Loss: 0.0016787260336479 | Epoch: 75 | MeanAbsoluteError: 0.0350018776953220 | Loss: 0.0020618064087242 | Epoch: 76 | MeanAbsoluteError: 0.0847633108496666 | Loss: 0.0101173982525674 | Epoch: 77 | MeanAbsoluteError: 0.0407622829079628 | Loss: 0.0026690602848808 | Epoch: 78 | MeanAbsoluteError: 0.0584591738879681 | Loss: 0.0050431729760021 | Epoch: 79 | MeanAbsoluteError: 0.0720139816403389 | Loss: 0.0066015618638350 | Epoch: 80 | MeanAbsoluteError: 0.0591519623994827 | Loss: 0.0052599241383947 | Epoch: 81 | 
MeanAbsoluteError: 0.0520311482250690 | Loss: 0.0047878118213983 | Epoch: 82 | MeanAbsoluteError: 0.0337831452488899 | Loss: 0.0020317279721404 | Epoch: 83 | MeanAbsoluteError: 0.0279079731553793 | Loss: 0.0019900018017394 | Epoch: 84 | MeanAbsoluteError: 0.0319114103913307 | Loss: 0.0021743192158353 | Epoch: 85 | MeanAbsoluteError: 0.0418223105370998 | Loss: 0.0030581793353821 | Epoch: 86 | MeanAbsoluteError: 0.0477811209857464 | Loss: 0.0029844010893542 | Epoch: 87 | MeanAbsoluteError: 0.0282665230333805 | Loss: 0.0014078158419579 | Epoch: 88 | 
MeanAbsoluteError: 0.0488404929637909 | Loss: 0.0042561109070308 | Epoch: 89 | MeanAbsoluteError: 0.0445776134729385 | Loss: 0.0029859619591242 | Epoch: 90 | MeanAbsoluteError: 0.0486374236643314 | Loss: 0.0033167981220266 | Epoch: 91 | MeanAbsoluteError: 0.0358055755496025 | Loss: 0.0021140188596641 | Epoch: 92 | MeanAbsoluteError: 0.0653892606496811 | Loss: 0.0067405835188066 | Epoch: 93 | MeanAbsoluteError: 0.0323013029992580 | Loss: 0.0023305665191191 | Epoch: 94 | MeanAbsoluteError: 0.0318741686642170 | Loss: 0.0015433567728346 | Epoch: 95 | 
MeanAbsoluteError: 0.0388007834553719 | Loss: 0.0025446865183767 | Epoch: 96 | MeanAbsoluteError: 0.0318180285394192 | Loss: 0.0017155351457544 | Epoch: 97 | MeanAbsoluteError: 0.0274691302329302 | Loss: 0.0016707909212878 | Epoch: 98 | MeanAbsoluteError: 0.0286306571215391 | Loss: 0.0022643427901830 | Epoch: 99 | MeanAbsoluteError: 0.0439555197954178 | Loss: 0.0031437144453566 | Epoch: 100 | MeanAbsoluteError: 0.0317636020481586 | Loss: 0.0024036538491670 | Epoch: 101 | MeanAbsoluteError: 0.0377281792461872 | Loss: 0.0027481429502726 | Epoch: 102 | 
MeanAbsoluteError: 0.0454332791268826 | Loss: 0.0036776291448265 | Epoch: 103 | MeanAbsoluteError: 0.0531644150614738 | Loss: 0.0038505846168846 | Epoch: 104 | MeanAbsoluteError: 0.0396669283509254 | Loss: 0.0031887265817764 | Epoch: 105 | MeanAbsoluteError: 0.0759715065360069 | Loss: 0.0079646413214505 | Epoch: 106 | MeanAbsoluteError: 0.0310679432004690 | Loss: 0.0018509289276643 | Epoch: 107 | MeanAbsoluteError: 0.0414218157529831 | Loss: 0.0023683087559990 | Epoch: 108 | MeanAbsoluteError: 0.0402011685073376 | Loss: 0.0029197242648269 | Epoch: 109 | 
MeanAbsoluteError: 0.0338102839887142 | Loss: 0.0018690447849132 | Epoch: 110 | MeanAbsoluteError: 0.0728711411356926 | Loss: 0.0070751343423930 | Epoch: 111 | MeanAbsoluteError: 0.0832871645689011 | Loss: 0.0089411260918356 | Epoch: 112 | MeanAbsoluteError: 0.0407419577240944 | Loss: 0.0029660379514098 | Epoch: 113 | MeanAbsoluteError: 0.0830108150839806 | Loss: 0.0125320563809230 | Epoch: 114 | MeanAbsoluteError: 0.0737706273794174 | Loss: 0.0076964389031323 | Epoch: 115 | MeanAbsoluteError: 0.0293204542249441 | Loss: 0.0015307075899238 | Epoch: 116 | 
MeanAbsoluteError: 0.0298710446804762 | Loss: 0.0017992434021345 | Epoch: 117 | MeanAbsoluteError: 0.0399999469518661 | Loss: 0.0034740068278132 | Epoch: 118 | MeanAbsoluteError: 0.0574121959507465 | Loss: 0.0042149069575736 | Epoch: 119 | MeanAbsoluteError: 0.0496614016592503 | Loss: 0.0036277150233778 | Early stopping at epoch 118
Fold: 2
Epoch: 1 | MeanAbsoluteError: 0.1114313676953316 | Loss: 0.0219248943030834 | Epoch: 2 | MeanAbsoluteError: 0.1150257587432861 | Loss: 0.0211229431801117 | Epoch: 3 | MeanAbsoluteError: 0.0838880911469460 | Loss: 0.0118109319860545 | Epoch: 4 | 
MeanAbsoluteError: 0.0782292261719704 | Loss: 0.0089780466201214 | Epoch: 5 | MeanAbsoluteError: 0.0974089205265045 | Loss: 0.0134221335801368 | Epoch: 6 | MeanAbsoluteError: 0.0708864629268646 | Loss: 0.0091388551607871 | Epoch: 7 | MeanAbsoluteError: 0.0685193687677383 | Loss: 0.0085439932120677 | Epoch: 8 | MeanAbsoluteError: 0.0413018316030502 | Loss: 0.0027473883237690 | Epoch: 9 | MeanAbsoluteError: 0.0861537829041481 | Loss: 0.0097774246779199 | Epoch: 10 | MeanAbsoluteError: 0.1745942682027817 | Loss: 0.0380646738295372 | Epoch: 11 | 
MeanAbsoluteError: 0.0627444386482239 | Loss: 0.0065981031467135 | Epoch: 12 | MeanAbsoluteError: 0.0424602925777435 | Loss: 0.0036039416758845 | Epoch: 13 | MeanAbsoluteError: 0.0412910133600235 | Loss: 0.0029809857593276 | Epoch: 14 | MeanAbsoluteError: 0.0742610767483711 | Loss: 0.0078578433021903 | Epoch: 15 | MeanAbsoluteError: 0.0633179172873497 | Loss: 0.0060392090011961 | Epoch: 16 | MeanAbsoluteError: 0.1712940037250519 | Loss: 0.0328176278047837 | Epoch: 17 | MeanAbsoluteError: 0.0884454250335693 | Loss: 0.0107159597727542 | Epoch: 18 | 
MeanAbsoluteError: 0.0396771728992462 | Loss: 0.0028837987338193 | Epoch: 19 | MeanAbsoluteError: 0.0484076216816902 | Loss: 0.0032562966315219 | Epoch: 20 | MeanAbsoluteError: 0.0596975572407246 | Loss: 0.0057694992731110 | Epoch: 21 | MeanAbsoluteError: 0.0516476109623909 | Loss: 0.0043670648368649 | Epoch: 22 | MeanAbsoluteError: 0.0337622128427029 | Loss: 0.0019191954186401 | Epoch: 23 | MeanAbsoluteError: 0.0546166263520718 | Loss: 0.0056600981177046 | Epoch: 24 | MeanAbsoluteError: 0.0697960481047630 | Loss: 0.0066086879143348 | Epoch: 25 | 
MeanAbsoluteError: 0.0357735790312290 | Loss: 0.0022369286654374 | Epoch: 26 | MeanAbsoluteError: 0.0528253354132175 | Loss: 0.0041655764216557 | Epoch: 27 | MeanAbsoluteError: 0.0974816232919693 | Loss: 0.0139346346975519 | Epoch: 28 | MeanAbsoluteError: 0.0364463776350021 | Loss: 0.0023343932698481 | Epoch: 29 | MeanAbsoluteError: 0.0932121276855469 | Loss: 0.0099147375529775 | Epoch: 30 | MeanAbsoluteError: 0.0674483552575111 | Loss: 0.0075951424033309 | Epoch: 31 | MeanAbsoluteError: 0.0457044616341591 | Loss: 0.0035512879258022 | Epoch: 32 | 
MeanAbsoluteError: 0.0445340834558010 | Loss: 0.0037670396716119 | Epoch: 33 | MeanAbsoluteError: 0.0548504106700420 | Loss: 0.0054514104178032 | Epoch: 34 | MeanAbsoluteError: 0.0459129475057125 | Loss: 0.0040122856690477 | Epoch: 35 | MeanAbsoluteError: 0.0670038536190987 | Loss: 0.0057095874172564 | Epoch: 36 | MeanAbsoluteError: 0.0370068326592445 | Loss: 0.0026763711715690 | Epoch: 37 | MeanAbsoluteError: 0.0304030273109674 | Loss: 0.0014882795535064 | Epoch: 38 | MeanAbsoluteError: 0.0658661052584648 | Loss: 0.0074230196455923 | Epoch: 39 | 
MeanAbsoluteError: 0.0790649801492691 | Loss: 0.0087981011288670 | Epoch: 40 | MeanAbsoluteError: 0.0735425055027008 | Loss: 0.0064356976117079 | Epoch: 41 | MeanAbsoluteError: 0.0606803707778454 | Loss: 0.0051293787188255 | Epoch: 42 | MeanAbsoluteError: 0.0402081646025181 | Loss: 0.0027459918951186 | Epoch: 43 | MeanAbsoluteError: 0.0588217303156853 | Loss: 0.0056221443407524 | Epoch: 44 | MeanAbsoluteError: 0.1804045140743256 | Loss: 0.0378066090723643 | Epoch: 45 | MeanAbsoluteError: 0.0273209568113089 | Loss: 0.0015250430045014 | Epoch: 46 | 
MeanAbsoluteError: 0.0405084006488323 | Loss: 0.0032197867896265 | Epoch: 47 | MeanAbsoluteError: 0.0759690105915070 | Loss: 0.0067576951204011 | Epoch: 48 | MeanAbsoluteError: 0.0497300997376442 | Loss: 0.0032615699411298 | Epoch: 49 | MeanAbsoluteError: 0.0279660057276487 | Loss: 0.0017819736161842 | Epoch: 50 | MeanAbsoluteError: 0.0646590963006020 | Loss: 0.0051925232311567 | Epoch: 51 | MeanAbsoluteError: 0.0725939497351646 | Loss: 0.0067751728571378 | Epoch: 52 | MeanAbsoluteError: 0.0931645333766937 | Loss: 0.0104093414444763 | Epoch: 53 | 
MeanAbsoluteError: 0.0373433530330658 | Loss: 0.0029133812148267 | Epoch: 54 | MeanAbsoluteError: 0.0513786114752293 | Loss: 0.0043208950575298 | Epoch: 55 | MeanAbsoluteError: 0.0413206294178963 | Loss: 0.0026132807654973 | Epoch: 56 | MeanAbsoluteError: 0.0477096475660801 | Loss: 0.0039816171271153 | Epoch: 57 | MeanAbsoluteError: 0.0564130581915379 | Loss: 0.0044314105135317 | Epoch: 58 | MeanAbsoluteError: 0.0711441487073898 | Loss: 0.0079600204391262 | Epoch: 59 | MeanAbsoluteError: 0.0456993356347084 | Loss: 0.0031308056159805 | Epoch: 60 | 
MeanAbsoluteError: 0.0847727954387665 | Loss: 0.0084755536741935 | Epoch: 61 | MeanAbsoluteError: 0.0592677257955074 | Loss: 0.0055980993560157 | Epoch: 62 | MeanAbsoluteError: 0.0584927648305893 | Loss: 0.0052451411208424 | Epoch: 63 | MeanAbsoluteError: 0.0483307093381882 | Loss: 0.0040049245894457 | Epoch: 64 | MeanAbsoluteError: 0.0374358668923378 | Loss: 0.0041923613305419 | Epoch: 65 | MeanAbsoluteError: 0.0739842727780342 | Loss: 0.0102421568097690 | Epoch: 66 | MeanAbsoluteError: 0.0731588751077652 | Loss: 0.0075134746730328 | Epoch: 67 | 
MeanAbsoluteError: 0.0474496446549892 | Loss: 0.0031134262412357 | Epoch: 68 | MeanAbsoluteError: 0.0242197401821613 | Loss: 0.0010393630498304 | Epoch: 69 | MeanAbsoluteError: 0.0267269536852837 | Loss: 0.0014772246403691 | Epoch: 70 | MeanAbsoluteError: 0.0980926677584648 | Loss: 0.0123926804472621 | Epoch: 71 | MeanAbsoluteError: 0.0615896470844746 | Loss: 0.0051605816608152 | Epoch: 72 | MeanAbsoluteError: 0.0813105776906013 | Loss: 0.0084661323792086 | Epoch: 73 | MeanAbsoluteError: 0.0481697283685207 | Loss: 0.0044389444027239 | Epoch: 74 | 
MeanAbsoluteError: 0.0642467588186264 | Loss: 0.0064489187207073 | Epoch: 75 | MeanAbsoluteError: 0.0533203929662704 | Loss: 0.0046292708183710 | Epoch: 76 | MeanAbsoluteError: 0.0480934754014015 | Loss: 0.0037008072786893 | Epoch: 77 | MeanAbsoluteError: 0.0290521010756493 | Loss: 0.0019123475246418 | Epoch: 78 | MeanAbsoluteError: 0.0791369900107384 | Loss: 0.0075667765833294 | Epoch: 79 | MeanAbsoluteError: 0.0318538621068001 | Loss: 0.0017992377845356 | Epoch: 80 | MeanAbsoluteError: 0.0582368671894073 | Loss: 0.0042049301107629 | Epoch: 81 | 
MeanAbsoluteError: 0.0547761395573616 | Loss: 0.0039326963194001 | Epoch: 82 | MeanAbsoluteError: 0.0398587770760059 | Loss: 0.0025327981073553 | Epoch: 83 | MeanAbsoluteError: 0.0292945615947247 | Loss: 0.0027084859712676 | Epoch: 84 | MeanAbsoluteError: 0.0673190504312515 | Loss: 0.0055845227952187 | Epoch: 85 | MeanAbsoluteError: 0.0301169008016586 | Loss: 0.0019250285896795 | Epoch: 86 | MeanAbsoluteError: 0.0760040357708931 | Loss: 0.0088308990503160 | Epoch: 87 | MeanAbsoluteError: 0.0686279460787773 | Loss: 0.0067154741308724 | Epoch: 88 | 
MeanAbsoluteError: 0.0719590485095978 | Loss: 0.0066855332742517 | Epoch: 89 | MeanAbsoluteError: 0.0456940270960331 | Loss: 0.0029169549681963 | Epoch: 90 | MeanAbsoluteError: 0.0438304655253887 | Loss: 0.0027304674955443 | Epoch: 91 | MeanAbsoluteError: 0.0308602787554264 | Loss: 0.0018617668986106 | Epoch: 92 | MeanAbsoluteError: 0.0245893970131874 | Loss: 0.0010609284688074 | Epoch: 93 | MeanAbsoluteError: 0.1006924510002136 | Loss: 0.0119742566289810 | Epoch: 94 | MeanAbsoluteError: 0.0712020844221115 | Loss: 0.0067623254413215 | Epoch: 95 | 
MeanAbsoluteError: 0.0640233010053635 | Loss: 0.0063722092980662 | Epoch: 96 | MeanAbsoluteError: 0.0558310598134995 | Loss: 0.0054353844428148 | Epoch: 97 | MeanAbsoluteError: 0.1095955818891525 | Loss: 0.0157789205415891 | Epoch: 98 | MeanAbsoluteError: 0.0662527531385422 | Loss: 0.0061039945039038 | Epoch: 99 | MeanAbsoluteError: 0.0676337778568268 | Loss: 0.0057189942409213 | Epoch: 100 | MeanAbsoluteError: 0.0894103273749352 | Loss: 0.0104289547755168 | Early stopping at epoch 99
Fold: 3
Epoch: 1 | MeanAbsoluteError: 0.1129890382289886 | Loss: 0.0187206315234877 | Epoch: 2 | 
MeanAbsoluteError: 0.0949626713991165 | Loss: 0.0150324883870780 | Epoch: 3 | MeanAbsoluteError: 0.1483396887779236 | Loss: 0.0299065364524722 | Epoch: 4 | MeanAbsoluteError: 0.0931377336382866 | Loss: 0.0121079378474790 | Epoch: 5 | MeanAbsoluteError: 0.0650222375988960 | Loss: 0.0074792118169940 | Epoch: 6 | MeanAbsoluteError: 0.1025640070438385 | Loss: 0.0142476771456691 | Epoch: 7 | MeanAbsoluteError: 0.0532764866948128 | Loss: 0.0045490327980728 | Epoch: 8 | MeanAbsoluteError: 0.0788799598813057 | Loss: 0.0109689945462518 | Epoch: 9 | 
MeanAbsoluteError: 0.0875709652900696 | Loss: 0.0116646397285737 | Epoch: 10 | MeanAbsoluteError: 0.1146238297224045 | Loss: 0.0166031537362589 | Epoch: 11 | MeanAbsoluteError: 0.0771472081542015 | Loss: 0.0085316013473158 | Epoch: 12 | MeanAbsoluteError: 0.0446753464639187 | Loss: 0.0032004771503405 | Epoch: 13 | MeanAbsoluteError: 0.0441499389708042 | Loss: 0.0029848598373624 | Epoch: 14 | MeanAbsoluteError: 0.0619133897125721 | Loss: 0.0059434785328519 | Epoch: 15 | MeanAbsoluteError: 0.0570649988949299 | Loss: 0.0047948579572571 | Epoch: 16 | 
MeanAbsoluteError: 0.0548367127776146 | Loss: 0.0041408358285060 | Epoch: 17 | MeanAbsoluteError: 0.0451518781483173 | Loss: 0.0033951714151324 | Epoch: 18 | MeanAbsoluteError: 0.0570790469646454 | Loss: 0.0043440804315301 | Epoch: 19 | MeanAbsoluteError: 0.1374395787715912 | Loss: 0.0220493668547043 | Epoch: 20 | MeanAbsoluteError: 0.0355083979666233 | Loss: 0.0020486795871805 | Epoch: 21 | MeanAbsoluteError: 0.1051290482282639 | Loss: 0.0138061680257894 | Epoch: 22 | MeanAbsoluteError: 0.0446546226739883 | Loss: 0.0029195026010991 | Epoch: 23 | 
MeanAbsoluteError: 0.0472285710275173 | Loss: 0.0034829897429937 | Epoch: 24 | MeanAbsoluteError: 0.0748780146241188 | Loss: 0.0086088101021372 | Epoch: 25 | MeanAbsoluteError: 0.0661497712135315 | Loss: 0.0064694597744025 | Epoch: 26 | MeanAbsoluteError: 0.0575590990483761 | Loss: 0.0052465167469703 | Epoch: 27 | MeanAbsoluteError: 0.0351512283086777 | Loss: 0.0020823733424410 | Epoch: 28 | MeanAbsoluteError: 0.0317352376878262 | Loss: 0.0015308257469979 | Epoch: 29 | MeanAbsoluteError: 0.0538023598492146 | Loss: 0.0045564500973202 | Epoch: 30 | 
MeanAbsoluteError: 0.0451621897518635 | Loss: 0.0037986720518137 | Epoch: 31 | MeanAbsoluteError: 0.0426535122096539 | Loss: 0.0027558492460790 | Epoch: 32 | MeanAbsoluteError: 0.0588687695562840 | Loss: 0.0047432119026780 | Epoch: 33 | MeanAbsoluteError: 0.1165244132280350 | Loss: 0.0172888175226175 | Epoch: 34 | MeanAbsoluteError: 0.0495641119778156 | Loss: 0.0035367869109345 | Epoch: 35 | MeanAbsoluteError: 0.0384258665144444 | Loss: 0.0026331834781628 | Epoch: 36 | MeanAbsoluteError: 0.0610992759466171 | Loss: 0.0051261280000640 | Epoch: 37 | 
MeanAbsoluteError: 0.0851062089204788 | Loss: 0.0111320790333244 | Epoch: 38 | MeanAbsoluteError: 0.0410849489271641 | Loss: 0.0030589256919204 | Epoch: 39 | MeanAbsoluteError: 0.0975091159343719 | Loss: 0.0109644702707346 | Epoch: 40 | MeanAbsoluteError: 0.0542846918106079 | Loss: 0.0044775940030097 | Epoch: 41 | MeanAbsoluteError: 0.0511560216546059 | Loss: 0.0042322952873432 | Epoch: 42 | MeanAbsoluteError: 0.0967604666948318 | Loss: 0.0130571570390692 | Epoch: 43 | MeanAbsoluteError: 0.0407520085573196 | Loss: 0.0022106598704480 | Epoch: 44 | 
MeanAbsoluteError: 0.0881309807300568 | Loss: 0.0120821295377727 | Epoch: 45 | MeanAbsoluteError: 0.0689808949828148 | Loss: 0.0069067995780363 | Epoch: 46 | MeanAbsoluteError: 0.0635980144143105 | Loss: 0.0068187823590751 | Epoch: 47 | MeanAbsoluteError: 0.0369189903140068 | Loss: 0.0026616444184373 | Epoch: 48 | MeanAbsoluteError: 0.0565615743398666 | Loss: 0.0048127794602456 | Epoch: 49 | MeanAbsoluteError: 0.0288387630134821 | Loss: 0.0015000364958094 | Epoch: 50 | MeanAbsoluteError: 0.0884396061301231 | Loss: 0.0107109184161975 | Epoch: 51 | 
MeanAbsoluteError: 0.0313462838530540 | Loss: 0.0016903720142391 | Epoch: 52 | MeanAbsoluteError: 0.0710671022534370 | Loss: 0.0064434055238962 | Epoch: 53 | MeanAbsoluteError: 0.1037059798836708 | Loss: 0.0127073383818452 | Epoch: 54 | MeanAbsoluteError: 0.0552556812763214 | Loss: 0.0049253270621053 | Epoch: 55 | MeanAbsoluteError: 0.0693231970071793 | Loss: 0.0065829428271032 | Epoch: 56 | MeanAbsoluteError: 0.0403056517243385 | Loss: 0.0025669038922598 | Epoch: 57 | MeanAbsoluteError: 0.0385151915252209 | Loss: 0.0021874395718511 | Epoch: 58 | 
MeanAbsoluteError: 0.0487393848598003 | Loss: 0.0040863615621884 | Epoch: 59 | MeanAbsoluteError: 0.0497765727341175 | Loss: 0.0036046048447203 | Epoch: 60 | MeanAbsoluteError: 0.0357239693403244 | Loss: 0.0022849408470882 | Epoch: 61 | MeanAbsoluteError: 0.0781700089573860 | Loss: 0.0084273519281011 | Epoch: 62 | MeanAbsoluteError: 0.0742963775992393 | Loss: 0.0075197187252343 | Epoch: 63 | MeanAbsoluteError: 0.0663655623793602 | Loss: 0.0054944697767496 | Epoch: 64 | MeanAbsoluteError: 0.0487090051174164 | Loss: 0.0030928150070115 | Epoch: 65 | 
MeanAbsoluteError: 0.0521165877580643 | Loss: 0.0033563739584329 | Epoch: 66 | MeanAbsoluteError: 0.0732009485363960 | Loss: 0.0067852969782857 | Epoch: 67 | MeanAbsoluteError: 0.0397054329514503 | Loss: 0.0024001201561007 | Epoch: 68 | MeanAbsoluteError: 0.0316488705575466 | Loss: 0.0017366230693789 | Epoch: 69 | MeanAbsoluteError: 0.0432630442082882 | Loss: 0.0025958813091095 | Epoch: 70 | MeanAbsoluteError: 0.0317458286881447 | Loss: 0.0019985589315183 | Epoch: 71 | MeanAbsoluteError: 0.0423242561519146 | Loss: 0.0029384440634973 | Epoch: 72 | 
MeanAbsoluteError: 0.0464515872299671 | Loss: 0.0031218961051379 | Epoch: 73 | MeanAbsoluteError: 0.0472801215946674 | Loss: 0.0034190343979460 | Epoch: 74 | MeanAbsoluteError: 0.0650100409984589 | Loss: 0.0050980002941707 | Epoch: 75 | MeanAbsoluteError: 0.0513266324996948 | Loss: 0.0043195646274118 | Epoch: 76 | MeanAbsoluteError: 0.0326182991266251 | Loss: 0.0015537156924928 | Epoch: 77 | MeanAbsoluteError: 0.0384014733135700 | Loss: 0.0026129796841325 | Epoch: 78 | MeanAbsoluteError: 0.0725365728139877 | Loss: 0.0077739793878908 | Epoch: 79 | 
MeanAbsoluteError: 0.0555565394461155 | Loss: 0.0059065698251988 | Epoch: 80 | MeanAbsoluteError: 0.0506878234446049 | Loss: 0.0049767492589756 | Epoch: 81 | MeanAbsoluteError: 0.0372632853686810 | Loss: 0.0025406994312876 | Early stopping at epoch 80
Fold: 4
Epoch: 1 | MeanAbsoluteError: 0.1233746334910393 | Loss: 0.0244687525555491 | Epoch: 2 | MeanAbsoluteError: 0.1103623136878014 | Loss: 0.0198488577555578 | Epoch: 3 | MeanAbsoluteError: 0.1237980946898460 | Loss: 0.0234378177242783 | Epoch: 4 | MeanAbsoluteError: 0.1985216289758682 | Loss: 0.0488502979278564 | Epoch: 5 | 
MeanAbsoluteError: 0.1099233403801918 | Loss: 0.0176566358512411 | Epoch: 6 | MeanAbsoluteError: 0.0973531901836395 | Loss: 0.0147114397169879 | Epoch: 7 | MeanAbsoluteError: 0.1324206739664078 | Loss: 0.0218207984446333 | Epoch: 8 | MeanAbsoluteError: 0.0684382393956184 | Loss: 0.0078775019277460 | Epoch: 9 | MeanAbsoluteError: 0.0927502885460854 | Loss: 0.0111386076762126 | Epoch: 10 | MeanAbsoluteError: 0.0599652305245399 | Loss: 0.0064650812508682 | Epoch: 11 | MeanAbsoluteError: 0.0954389348626137 | Loss: 0.0121969844286258 | Epoch: 12 | 
MeanAbsoluteError: 0.0538219511508942 | Loss: 0.0056195150514563 | Epoch: 13 | MeanAbsoluteError: 0.0694729164242744 | Loss: 0.0076748806839952 | Epoch: 14 | MeanAbsoluteError: 0.0778371095657349 | Loss: 0.0091789034553445 | Epoch: 15 | MeanAbsoluteError: 0.1130148246884346 | Loss: 0.0160179092333867 | Epoch: 16 | MeanAbsoluteError: 0.0556445494294167 | Loss: 0.0056861512040576 | Epoch: 17 | MeanAbsoluteError: 0.0588991306722164 | Loss: 0.0052825346266708 | Epoch: 18 | MeanAbsoluteError: 0.0587762892246246 | Loss: 0.0056565098124198 | Epoch: 19 | 
MeanAbsoluteError: 0.0430668108165264 | Loss: 0.0034252992258049 | Epoch: 20 | MeanAbsoluteError: 0.0573774427175522 | Loss: 0.0055156356672971 | Epoch: 21 | MeanAbsoluteError: 0.0432535894215107 | Loss: 0.0029546270335021 | Epoch: 22 | MeanAbsoluteError: 0.0767913386225700 | Loss: 0.0099143347559640 | Epoch: 23 | MeanAbsoluteError: 0.0528836809098721 | Loss: 0.0045974814834503 | Epoch: 24 | MeanAbsoluteError: 0.0362174957990646 | Loss: 0.0027306941192364 | Epoch: 25 | MeanAbsoluteError: 0.1022880151867867 | Loss: 0.0136310276933588 | Epoch: 26 | 
MeanAbsoluteError: 0.0785193815827370 | Loss: 0.0083302596154121 | Epoch: 27 | MeanAbsoluteError: 0.1438079625368118 | Loss: 0.0247867446965896 | Epoch: 28 | MeanAbsoluteError: 0.0386994257569313 | Loss: 0.0024635617871984 | Epoch: 29 | MeanAbsoluteError: 0.0693017244338989 | Loss: 0.0069146560540853 | Epoch: 30 | MeanAbsoluteError: 0.0801600515842438 | Loss: 0.0081820766656445 | Epoch: 31 | MeanAbsoluteError: 0.0842568799853325 | Loss: 0.0087253718386189 | Epoch: 32 | MeanAbsoluteError: 0.0445926710963249 | Loss: 0.0031762942492675 | Epoch: 33 | 
MeanAbsoluteError: 0.1175881102681160 | Loss: 0.0167457986479768 | Epoch: 34 | MeanAbsoluteError: 0.0471864938735962 | Loss: 0.0041662201983854 | Epoch: 35 | MeanAbsoluteError: 0.0631622150540352 | Loss: 0.0053376504399169 | Epoch: 36 | MeanAbsoluteError: 0.0363465361297131 | Loss: 0.0024553787616941 | Epoch: 37 | MeanAbsoluteError: 0.0418148897588253 | Loss: 0.0026290929661347 | Epoch: 38 | MeanAbsoluteError: 0.1111608892679214 | Loss: 0.0152445292243591 | Epoch: 39 | MeanAbsoluteError: 0.0582928285002708 | Loss: 0.0051154214709711 | Epoch: 40 | 
MeanAbsoluteError: 0.0538898147642612 | Loss: 0.0044671981774557 | Epoch: 41 | MeanAbsoluteError: 0.0350674688816071 | Loss: 0.0023151678615250 | Epoch: 42 | MeanAbsoluteError: 0.0784987807273865 | Loss: 0.0086808789413995 | Epoch: 43 | MeanAbsoluteError: 0.0373467206954956 | Loss: 0.0020344189386098 | Epoch: 44 | MeanAbsoluteError: 0.0394114665687084 | Loss: 0.0029380844252256 | Epoch: 45 | MeanAbsoluteError: 0.0711489766836166 | Loss: 0.0065988904008499 | Epoch: 46 | MeanAbsoluteError: 0.0548579990863800 | Loss: 0.0046447405251316 | Epoch: 47 | 
MeanAbsoluteError: 0.0736190974712372 | Loss: 0.0096106299808106 | Epoch: 48 | MeanAbsoluteError: 0.0357540398836136 | Loss: 0.0019245932254797 | Epoch: 49 | MeanAbsoluteError: 0.0784877166152000 | Loss: 0.0084286181506916 | Epoch: 50 | MeanAbsoluteError: 0.0981437563896179 | Loss: 0.0114543000952556 | Epoch: 51 | MeanAbsoluteError: 0.0373787507414818 | Loss: 0.0022975021767287 | Epoch: 52 | MeanAbsoluteError: 0.0643653944134712 | Loss: 0.0051933009034166 | Epoch: 53 | MeanAbsoluteError: 0.0518679916858673 | Loss: 0.0045009322930127 | Epoch: 54 | 
MeanAbsoluteError: 0.0539828203618526 | Loss: 0.0053868147616203 | Epoch: 55 | MeanAbsoluteError: 0.0443424545228481 | Loss: 0.0036734699656685 | Epoch: 56 | MeanAbsoluteError: 0.0527070909738541 | Loss: 0.0050916608911043 | Epoch: 57 | MeanAbsoluteError: 0.0507569499313831 | Loss: 0.0044793120513742 | Epoch: 58 | MeanAbsoluteError: 0.0274871494621038 | Loss: 0.0015700953361095 | Epoch: 59 | MeanAbsoluteError: 0.0564161539077759 | Loss: 0.0051175812080216 | Epoch: 60 | MeanAbsoluteError: 0.0725901573896408 | Loss: 0.0089580928727698 | Epoch: 61 | 
MeanAbsoluteError: 0.0319460630416870 | Loss: 0.0022458400613127 | Epoch: 62 | MeanAbsoluteError: 0.0674574002623558 | Loss: 0.0070335305331705 | Epoch: 63 | MeanAbsoluteError: 0.0366112776100636 | Loss: 0.0031985883251764 | Epoch: 64 | MeanAbsoluteError: 0.0744747817516327 | Loss: 0.0080443722052643 | Epoch: 65 | MeanAbsoluteError: 0.0304089412093163 | Loss: 0.0015036967547181 | Epoch: 66 | MeanAbsoluteError: 0.0430528372526169 | Loss: 0.0032035161812718 | Epoch: 67 | MeanAbsoluteError: 0.0415652766823769 | Loss: 0.0027565170670501 | Epoch: 68 | 
MeanAbsoluteError: 0.0627041682600975 | Loss: 0.0067480221265354 | Epoch: 69 | MeanAbsoluteError: 0.0439759865403175 | Loss: 0.0036583579897594 | Epoch: 70 | MeanAbsoluteError: 0.0734118372201920 | Loss: 0.0079952793625685 | Epoch: 71 | MeanAbsoluteError: 0.0654841884970665 | Loss: 0.0064813617545252 | Epoch: 72 | MeanAbsoluteError: 0.0344896018505096 | Loss: 0.0024326396232937 | Epoch: 73 | MeanAbsoluteError: 0.0679732486605644 | Loss: 0.0062574727926403 | Epoch: 74 | MeanAbsoluteError: 0.0604915097355843 | Loss: 0.0047884626278224 | Epoch: 75 | 
MeanAbsoluteError: 0.0384915322065353 | Loss: 0.0023744683175419 | Epoch: 76 | MeanAbsoluteError: 0.1010293662548065 | Loss: 0.0135817206106507 | Epoch: 77 | MeanAbsoluteError: 0.0599873773753643 | Loss: 0.0047483257770252 | Epoch: 78 | MeanAbsoluteError: 0.0714829340577126 | Loss: 0.0079050469570435 | Epoch: 79 | MeanAbsoluteError: 0.0388959608972073 | Loss: 0.0023126261881911 | Epoch: 80 | MeanAbsoluteError: 0.0336180962622166 | Loss: 0.0018499961230331 | Epoch: 81 | MeanAbsoluteError: 0.0554074496030807 | Loss: 0.0052372162463143 | Epoch: 82 | 
MeanAbsoluteError: 0.0608640573918819 | Loss: 0.0052466627317839 | Epoch: 83 | MeanAbsoluteError: 0.0845050215721130 | Loss: 0.0127068841471695 | Epoch: 84 | MeanAbsoluteError: 0.1205457150936127 | Loss: 0.0171830245795158 | Epoch: 85 | MeanAbsoluteError: 0.0640523061156273 | Loss: 0.0059075712656172 | Epoch: 86 | MeanAbsoluteError: 0.0654024854302406 | Loss: 0.0061310734420728 | Epoch: 87 | MeanAbsoluteError: 0.0691285133361816 | Loss: 0.0083850524388254 | Epoch: 88 | MeanAbsoluteError: 0.0368131697177887 | Loss: 0.0023990679630795 | Epoch: 89 | 
MeanAbsoluteError: 0.0335528552532196 | Loss: 0.0017178769921884 | Epoch: 90 | MeanAbsoluteError: 0.0502398647367954 | Loss: 0.0040361175421052 | Epoch: 91 | MeanAbsoluteError: 0.0372959859669209 | Loss: 0.0021572678054396 | Epoch: 92 | MeanAbsoluteError: 0.0601962618529797 | Loss: 0.0047358297026501 | Epoch: 93 | MeanAbsoluteError: 0.0251520890742540 | Loss: 0.0012954820502693 | Epoch: 94 | MeanAbsoluteError: 0.0366254486143589 | Loss: 0.0025780905405274 | Epoch: 95 | MeanAbsoluteError: 0.0823583900928497 | Loss: 0.0088427114085509 | Epoch: 96 | 
MeanAbsoluteError: 0.0452422387897968 | Loss: 0.0035956899116102 | Epoch: 97 | MeanAbsoluteError: 0.0845732912421227 | Loss: 0.0081455736922530 | Epoch: 98 | MeanAbsoluteError: 0.0439910665154457 | Loss: 0.0030938663806480 | Epoch: 99 | MeanAbsoluteError: 0.0402199849486351 | Loss: 0.0026628421238946 | Epoch: 100 | MeanAbsoluteError: 0.0381279289722443 | Loss: 0.0027632858254947 | Epoch: 101 | MeanAbsoluteError: 0.0592835098505020 | Loss: 0.0051936176068221 | Epoch: 102 | MeanAbsoluteError: 0.0365620255470276 | Loss: 0.0024315762342527 | Epoch: 103 | 
MeanAbsoluteError: 0.0631670132279396 | Loss: 0.0058773598597886 | Epoch: 104 | MeanAbsoluteError: 0.0680142715573311 | Loss: 0.0063813612438165 | Epoch: 105 | MeanAbsoluteError: 0.0399124287068844 | Loss: 0.0025118109904445 | Epoch: 106 | MeanAbsoluteError: 0.0555732920765877 | Loss: 0.0039977840452383 | Epoch: 107 | MeanAbsoluteError: 0.0566760972142220 | Loss: 0.0043212409901361 | Epoch: 108 | MeanAbsoluteError: 0.0334192067384720 | Loss: 0.0018404322461440 | Epoch: 109 | MeanAbsoluteError: 0.0483900308609009 | Loss: 0.0046801043432564 | Epoch: 110 | 
MeanAbsoluteError: 0.1038654521107674 | Loss: 0.0138292828431496 | Epoch: 111 | MeanAbsoluteError: 0.0809292569756508 | Loss: 0.0096529991580890 | Epoch: 112 | MeanAbsoluteError: 0.0402229167521000 | Loss: 0.0032344506314705 | Epoch: 113 | MeanAbsoluteError: 0.0740041583776474 | Loss: 0.0071163019523598 | Epoch: 114 | MeanAbsoluteError: 0.0726020559668541 | Loss: 0.0065649018372194 | Epoch: 115 | MeanAbsoluteError: 0.0469914563000202 | Loss: 0.0032333199543735 | Epoch: 116 | MeanAbsoluteError: 0.0545236319303513 | Loss: 0.0044766348571731 | Epoch: 117 | 
MeanAbsoluteError: 0.0537455193698406 | Loss: 0.0038015457908981 | Epoch: 118 | MeanAbsoluteError: 0.0677849203348160 | Loss: 0.0068440499643867 | Epoch: 119 | MeanAbsoluteError: 0.0389212258160114 | Loss: 0.0022576624267878 | Epoch: 120 | MeanAbsoluteError: 0.0631925612688065 | Loss: 0.0062985664520126 | Epoch: 121 | MeanAbsoluteError: 0.0574379451572895 | Loss: 0.0055629357767220 | Epoch: 122 | MeanAbsoluteError: 0.0296723227947950 | Loss: 0.0022637317575013 | Epoch: 123 | MeanAbsoluteError: 0.0740757435560226 | Loss: 0.0075482264465581 | Epoch: 124 | 
MeanAbsoluteError: 0.0253833848983049 | Loss: 0.0014233328178167 | Epoch: 125 | MeanAbsoluteError: 0.0583047233521938 | Loss: 0.0048740113225694 | Early stopping at epoch 124
Fold: 5
Epoch: 1 | MeanAbsoluteError: 0.1271550208330154 | Loss: 0.0238162899533143 | Epoch: 2 | MeanAbsoluteError: 0.1196485832333565 | Loss: 0.0223028489316885 | Epoch: 3 | MeanAbsoluteError: 0.0994279831647873 | Loss: 0.0148807528715294 | Epoch: 4 | MeanAbsoluteError: 0.0945752412080765 | Loss: 0.0129960933700204 | Epoch: 5 | MeanAbsoluteError: 0.0764456391334534 | Loss: 0.0084686279296875 | Epoch: 6 | 
MeanAbsoluteError: 0.0828749462962151 | Loss: 0.0102188395551191 | Epoch: 7 | MeanAbsoluteError: 0.1798360794782639 | Loss: 0.0399495284431256 | Epoch: 8 | MeanAbsoluteError: 0.1257198005914688 | Loss: 0.0191889315700302 | Epoch: 9 | MeanAbsoluteError: 0.0828293859958649 | Loss: 0.0102081698043129 | Epoch: 10 | MeanAbsoluteError: 0.0831756964325905 | Loss: 0.0115234743839560 | Epoch: 11 | MeanAbsoluteError: 0.0531280264258385 | Loss: 0.0043847864816109 | Epoch: 12 | MeanAbsoluteError: 0.0690076574683189 | Loss: 0.0074302092230377 | Epoch: 13 | 
MeanAbsoluteError: 0.0588678829371929 | Loss: 0.0054406645851066 | Epoch: 14 | MeanAbsoluteError: 0.0398863330483437 | Loss: 0.0024833965491360 | Epoch: 15 | MeanAbsoluteError: 0.0642529129981995 | Loss: 0.0062149857224610 | Epoch: 16 | MeanAbsoluteError: 0.0824399888515472 | Loss: 0.0097145297600386 | Epoch: 17 | MeanAbsoluteError: 0.0837635323405266 | Loss: 0.0097336266727115 | Epoch: 18 | MeanAbsoluteError: 0.0826497077941895 | Loss: 0.0101310443133116 | Epoch: 19 | MeanAbsoluteError: 0.1005631610751152 | Loss: 0.0154684840414960 | Epoch: 20 | 
MeanAbsoluteError: 0.0780870839953423 | Loss: 0.0083623274874229 | Epoch: 21 | MeanAbsoluteError: 0.0726410374045372 | Loss: 0.0068345844494895 | Epoch: 22 | MeanAbsoluteError: 0.0479729659855366 | Loss: 0.0044302133028395 | Epoch: 23 | MeanAbsoluteError: 0.0549715310335159 | Loss: 0.0048525412208759 | Epoch: 24 | MeanAbsoluteError: 0.0690042003989220 | Loss: 0.0073952356245942 | Epoch: 25 | MeanAbsoluteError: 0.0598784722387791 | Loss: 0.0058536013910690 | Epoch: 26 | MeanAbsoluteError: 0.0591274127364159 | Loss: 0.0052889805788604 | Epoch: 27 | 
MeanAbsoluteError: 0.0667087584733963 | Loss: 0.0071054716469147 | Epoch: 28 | MeanAbsoluteError: 0.0393105782568455 | Loss: 0.0024596950209413 | Epoch: 29 | MeanAbsoluteError: 0.0545483641326427 | Loss: 0.0044245661981852 | Epoch: 30 | MeanAbsoluteError: 0.0648661404848099 | Loss: 0.0070228145027963 | Epoch: 31 | MeanAbsoluteError: 0.0441960208117962 | Loss: 0.0040249633871449 | Epoch: 32 | MeanAbsoluteError: 0.0973994508385658 | Loss: 0.0119806259798889 | Epoch: 33 | MeanAbsoluteError: 0.0491028055548668 | Loss: 0.0031491383516158 | Epoch: 34 | 
MeanAbsoluteError: 0.0436286181211472 | Loss: 0.0035089413420512 | Epoch: 35 | MeanAbsoluteError: 0.0332710184156895 | Loss: 0.0024575514611430 | Epoch: 36 | MeanAbsoluteError: 0.0399673171341419 | Loss: 0.0026194034703971 | Epoch: 37 | MeanAbsoluteError: 0.0730304345488548 | Loss: 0.0072525181234456 | Epoch: 38 | MeanAbsoluteError: 0.0742544829845428 | Loss: 0.0081210578254496 | Epoch: 39 | MeanAbsoluteError: 0.0528773888945580 | Loss: 0.0043193158120490 | Epoch: 40 | MeanAbsoluteError: 0.0465324223041534 | Loss: 0.0028283398759623 | Epoch: 41 | 
MeanAbsoluteError: 0.0333640351891518 | Loss: 0.0016770128254743 | Epoch: 42 | MeanAbsoluteError: 0.0490793660283089 | Loss: 0.0035814001278665 | Epoch: 43 | MeanAbsoluteError: 0.0486144460737705 | Loss: 0.0043215942658627 | Epoch: 44 | MeanAbsoluteError: 0.0518703758716583 | Loss: 0.0050525429139200 | Epoch: 45 | MeanAbsoluteError: 0.0717853754758835 | Loss: 0.0075435098618842 | Epoch: 46 | MeanAbsoluteError: 0.0439211241900921 | Loss: 0.0030203825444914 | Epoch: 47 | MeanAbsoluteError: 0.0486594997346401 | Loss: 0.0039098465797276 | Epoch: 48 | 
MeanAbsoluteError: 0.0694038197398186 | Loss: 0.0065966859065856 | Epoch: 49 | MeanAbsoluteError: 0.0446446314454079 | Loss: 0.0032606134907557 | Epoch: 50 | MeanAbsoluteError: 0.0371309742331505 | Loss: 0.0023526017634700 | Epoch: 51 | MeanAbsoluteError: 0.0463461130857468 | Loss: 0.0037547838560735 | Epoch: 52 | MeanAbsoluteError: 0.0452915057539940 | Loss: 0.0033183493651450 | Epoch: 53 | MeanAbsoluteError: 0.0392431393265724 | Loss: 0.0028798865834967 | Epoch: 54 | MeanAbsoluteError: 0.0351312793791294 | Loss: 0.0026099290474891 | Epoch: 55 | 
MeanAbsoluteError: 0.0439997576177120 | Loss: 0.0026355845553693 | Epoch: 56 | MeanAbsoluteError: 0.0364743582904339 | Loss: 0.0023417080542108 | Epoch: 57 | MeanAbsoluteError: 0.0381896309554577 | Loss: 0.0025504615869767 | Epoch: 58 | MeanAbsoluteError: 0.0411985442042351 | Loss: 0.0025852018062813 | Epoch: 59 | MeanAbsoluteError: 0.0839017853140831 | Loss: 0.0105904572141858 | Epoch: 60 | MeanAbsoluteError: 0.0312048122286797 | Loss: 0.0018496809509368 | Epoch: 61 | MeanAbsoluteError: 0.0938129350543022 | Loss: 0.0117034034158748 | Epoch: 62 | 
MeanAbsoluteError: 0.0493652150034904 | Loss: 0.0039982639360600 | Epoch: 63 | MeanAbsoluteError: 0.0836844742298126 | Loss: 0.0085125357593195 | Epoch: 64 | MeanAbsoluteError: 0.0352883450686932 | Loss: 0.0023750586730715 | Epoch: 65 | MeanAbsoluteError: 0.0455437526106834 | Loss: 0.0036858824762301 | Epoch: 66 | MeanAbsoluteError: 0.0560179762542248 | Loss: 0.0049604189116508 | Epoch: 67 | MeanAbsoluteError: 0.0667514577507973 | Loss: 0.0070930475798937 | Epoch: 68 | MeanAbsoluteError: 0.0681800246238708 | Loss: 0.0071383347161687 | Epoch: 69 | 
MeanAbsoluteError: 0.0288205388933420 | Loss: 0.0014895772507701 | Epoch: 70 | MeanAbsoluteError: 0.0473631843924522 | Loss: 0.0033504480110983 | Epoch: 71 | MeanAbsoluteError: 0.0885448902845383 | Loss: 0.0099933290710816 | Epoch: 72 | MeanAbsoluteError: 0.0402311049401760 | Loss: 0.0025126565507470 | Epoch: 73 | MeanAbsoluteError: 0.0424978919327259 | Loss: 0.0032281227624760 | Epoch: 74 | MeanAbsoluteError: 0.0426528081297874 | Loss: 0.0032094882066863 | Epoch: 75 | MeanAbsoluteError: 0.0663787573575974 | Loss: 0.0058287518600432 | Epoch: 76 | 
MeanAbsoluteError: 0.0330821275711060 | Loss: 0.0019540703371884 | Epoch: 77 | MeanAbsoluteError: 0.0410845726728439 | Loss: 0.0030323564827156 | Epoch: 78 | MeanAbsoluteError: 0.0439009554684162 | Loss: 0.0036569039400022 | Epoch: 79 | MeanAbsoluteError: 0.0355196110904217 | Loss: 0.0023311149472227 | Epoch: 80 | MeanAbsoluteError: 0.0609558522701263 | Loss: 0.0058420678923050 | Epoch: 81 | MeanAbsoluteError: 0.0644289478659630 | Loss: 0.0060121858886515 | Epoch: 82 | MeanAbsoluteError: 0.0385326892137527 | Loss: 0.0026055484374340 | Epoch: 83 | 
MeanAbsoluteError: 0.0258180573582649 | Loss: 0.0013435186186913 | Epoch: 84 | MeanAbsoluteError: 0.0372185073792934 | Loss: 0.0022710813075089 | Epoch: 85 | MeanAbsoluteError: 0.0381509959697723 | Loss: 0.0024425666376304 | Epoch: 86 | MeanAbsoluteError: 0.0605999939143658 | Loss: 0.0061894936952740 | Epoch: 87 | MeanAbsoluteError: 0.0409558117389679 | Loss: 0.0034824623905409 | Epoch: 88 | MeanAbsoluteError: 0.0637481436133385 | Loss: 0.0057785686893532 | Epoch: 89 | MeanAbsoluteError: 0.0365827493369579 | Loss: 0.0025150433223014 | Epoch: 90 | 
MeanAbsoluteError: 0.0376690104603767 | Loss: 0.0021208099788055 | Epoch: 91 | MeanAbsoluteError: 0.0811367630958557 | Loss: 0.0083126438459238 | Epoch: 92 | MeanAbsoluteError: 0.0422824732959270 | Loss: 0.0028187675365748 | Epoch: 93 | MeanAbsoluteError: 0.0337787456810474 | Loss: 0.0021313887510377 | Epoch: 94 | MeanAbsoluteError: 0.0476343519985676 | Loss: 0.0032384989183181 | Epoch: 95 | MeanAbsoluteError: 0.0329952575266361 | Loss: 0.0017596615317206 | Epoch: 96 | MeanAbsoluteError: 0.0355844274163246 | Loss: 0.0018685001190394 | Epoch: 97 | 
MeanAbsoluteError: 0.0441637188196182 | Loss: 0.0030679773727360 | Epoch: 98 | MeanAbsoluteError: 0.0515309721231461 | Loss: 0.0042670598038687 | Epoch: 99 | MeanAbsoluteError: 0.0629545152187347 | Loss: 0.0052564107777121 | Epoch: 100 | MeanAbsoluteError: 0.0565435253083706 | Loss: 0.0055927003715904 | Epoch: 101 | MeanAbsoluteError: 0.0487512201070786 | Loss: 0.0035308370626388 | Epoch: 102 | MeanAbsoluteError: 0.0349263995885849 | Loss: 0.0022270497462999 | Epoch: 103 | MeanAbsoluteError: 0.0766559317708015 | Loss: 0.0079288032765572 | Epoch: 104 | 
MeanAbsoluteError: 0.0571240410208702 | Loss: 0.0042444447485300 | Epoch: 105 | MeanAbsoluteError: 0.0533826649188995 | Loss: 0.0042762842136793 | Epoch: 106 | MeanAbsoluteError: 0.0317233204841614 | Loss: 0.0019494325925524 | Epoch: 107 | MeanAbsoluteError: 0.0310290474444628 | Loss: 0.0016656014710092 | Epoch: 108 | MeanAbsoluteError: 0.0388268046081066 | Loss: 0.0020951151382178 | Epoch: 109 | MeanAbsoluteError: 0.0286086294800043 | Loss: 0.0014825417893007 | Epoch: 110 | MeanAbsoluteError: 0.0861317142844200 | Loss: 0.0090815763777265 | Epoch: 111 | 
MeanAbsoluteError: 0.0393838770687580 | Loss: 0.0030154789900944 | Epoch: 112 | MeanAbsoluteError: 0.0337165333330631 | Loss: 0.0019460812551328 | Epoch: 113 | MeanAbsoluteError: 0.0425293818116188 | Loss: 0.0031304886260142 | Epoch: 114 | MeanAbsoluteError: 0.0691060945391655 | Loss: 0.0069074446084694 | Epoch: 115 | MeanAbsoluteError: 0.0457921884953976 | Loss: 0.0031854215194471 | Early stopping at epoch 114
Fold: 6
Epoch: 1 | MeanAbsoluteError: 0.1360104680061340 | Loss: 0.0278348241431209 | Epoch: 2 | MeanAbsoluteError: 0.2220766842365265 | Loss: 0.0596712655746020 | Epoch: 3 | 
MeanAbsoluteError: 0.1071937009692192 | Loss: 0.0166786750778556 | Epoch: 4 | MeanAbsoluteError: 0.1124041974544525 | Loss: 0.0183894826600758 | Epoch: 5 | MeanAbsoluteError: 0.0977243483066559 | Loss: 0.0126777016557753 | Epoch: 6 | MeanAbsoluteError: 0.0653524398803711 | Loss: 0.0077306658853419 | Epoch: 7 | MeanAbsoluteError: 0.0958029329776764 | Loss: 0.0162477500629253 | Epoch: 8 | MeanAbsoluteError: 0.1022107228636742 | Loss: 0.0140792533325461 | Epoch: 9 | MeanAbsoluteError: 0.0692594498395920 | Loss: 0.0093517085143293 | Epoch: 10 | 
MeanAbsoluteError: 0.0862192064523697 | Loss: 0.0134418924482396 | Epoch: 11 | MeanAbsoluteError: 0.0585366003215313 | Loss: 0.0058150944756702 | Epoch: 12 | MeanAbsoluteError: 0.0936028957366943 | Loss: 0.0103831721039919 | Epoch: 13 | MeanAbsoluteError: 0.0676486790180206 | Loss: 0.0066811140053547 | Epoch: 14 | MeanAbsoluteError: 0.0696256384253502 | Loss: 0.0067811896845412 | Epoch: 15 | MeanAbsoluteError: 0.1373465508222580 | Loss: 0.0212424681163751 | Epoch: 16 | MeanAbsoluteError: 0.0783552974462509 | Loss: 0.0090038130471769 | Epoch: 17 | 
MeanAbsoluteError: 0.0507234446704388 | Loss: 0.0047169801814911 | Epoch: 18 | MeanAbsoluteError: 0.0562240779399872 | Loss: 0.0055947929728203 | Epoch: 19 | MeanAbsoluteError: 0.0424920953810215 | Loss: 0.0040359369640310 | Epoch: 20 | MeanAbsoluteError: 0.0993418470025063 | Loss: 0.0124419684020373 | Epoch: 21 | MeanAbsoluteError: 0.0535469055175781 | Loss: 0.0046956602197427 | Epoch: 22 | MeanAbsoluteError: 0.0507973767817020 | Loss: 0.0049208147460237 | Epoch: 23 | MeanAbsoluteError: 0.0422424226999283 | Loss: 0.0038029308018919 | Epoch: 24 | 
MeanAbsoluteError: 0.0686404630541801 | Loss: 0.0068156978724381 | Epoch: 25 | MeanAbsoluteError: 0.0486456863582134 | Loss: 0.0044103349523189 | Epoch: 26 | MeanAbsoluteError: 0.0462197102606297 | Loss: 0.0035759802692785 | Epoch: 27 | MeanAbsoluteError: 0.1141994893550873 | Loss: 0.0152477522452290 | Epoch: 28 | MeanAbsoluteError: 0.1072804331779480 | Loss: 0.0150110988806073 | Epoch: 29 | MeanAbsoluteError: 0.0693604201078415 | Loss: 0.0078065531471601 | Epoch: 30 | MeanAbsoluteError: 0.0596413463354111 | Loss: 0.0050928921868595 | Epoch: 31 | 
MeanAbsoluteError: 0.0691386759281158 | Loss: 0.0076219124647860 | Epoch: 32 | MeanAbsoluteError: 0.0437154881656170 | Loss: 0.0034199113948629 | Epoch: 33 | MeanAbsoluteError: 0.1066208183765411 | Loss: 0.0152316589911397 | Epoch: 34 | MeanAbsoluteError: 0.0575329884886742 | Loss: 0.0051421328232839 | Epoch: 35 | MeanAbsoluteError: 0.0896117612719536 | Loss: 0.0110212640048793 | Epoch: 36 | MeanAbsoluteError: 0.0421354398131371 | Loss: 0.0036157026815300 | Epoch: 37 | MeanAbsoluteError: 0.0744731575250626 | Loss: 0.0072312442800747 | Epoch: 38 | 
MeanAbsoluteError: 0.1159466207027435 | Loss: 0.0167013063596991 | Epoch: 39 | MeanAbsoluteError: 0.0679119229316711 | Loss: 0.0067313082086352 | Epoch: 40 | MeanAbsoluteError: 0.0590855255723000 | Loss: 0.0050964003357177 | Epoch: 41 | MeanAbsoluteError: 0.0615686997771263 | Loss: 0.0063681005356977 | Epoch: 42 | MeanAbsoluteError: 0.0415149703621864 | Loss: 0.0042921205951223 | Epoch: 43 | MeanAbsoluteError: 0.0747618898749352 | Loss: 0.0081631289436840 | Epoch: 44 | MeanAbsoluteError: 0.0414830669760704 | Loss: 0.0027859185670073 | Epoch: 45 | 
MeanAbsoluteError: 0.0538271777331829 | Loss: 0.0058497322785955 | Epoch: 46 | MeanAbsoluteError: 0.0886843875050545 | Loss: 0.0130353388376534 | Epoch: 47 | MeanAbsoluteError: 0.0686599761247635 | Loss: 0.0073624332972731 | Epoch: 48 | MeanAbsoluteError: 0.0615544542670250 | Loss: 0.0057594865076960 | Epoch: 49 | MeanAbsoluteError: 0.0631950199604034 | Loss: 0.0056537530886439 | Epoch: 50 | MeanAbsoluteError: 0.0423251874744892 | Loss: 0.0025764969625295 | Epoch: 51 | MeanAbsoluteError: 0.0244529228657484 | Loss: 0.0011647982442250 | Epoch: 52 | 
MeanAbsoluteError: 0.0521158799529076 | Loss: 0.0047838993083972 | Epoch: 53 | MeanAbsoluteError: 0.0489531122148037 | Loss: 0.0038880627029217 | Epoch: 54 | MeanAbsoluteError: 0.0361713021993637 | Loss: 0.0030141890053458 | Epoch: 55 | MeanAbsoluteError: 0.0299501791596413 | Loss: 0.0017723287500513 | Epoch: 56 | MeanAbsoluteError: 0.0646219477057457 | Loss: 0.0064225225763109 | Epoch: 57 | MeanAbsoluteError: 0.0551073662936687 | Loss: 0.0053542499573758 | Epoch: 58 | MeanAbsoluteError: 0.0362845659255981 | Loss: 0.0029337423889396 | Epoch: 59 | 
MeanAbsoluteError: 0.0541127286851406 | Loss: 0.0042721213540062 | Epoch: 60 | MeanAbsoluteError: 0.0506929531693459 | Loss: 0.0034508529172924 | Epoch: 61 | MeanAbsoluteError: 0.0697371140122414 | Loss: 0.0067271257822330 | Epoch: 62 | MeanAbsoluteError: 0.0512262359261513 | Loss: 0.0048119616694748 | Epoch: 63 | MeanAbsoluteError: 0.0462451316416264 | Loss: 0.0036780047767724 | Epoch: 64 | MeanAbsoluteError: 0.0632572472095490 | Loss: 0.0060286617730386 | Epoch: 65 | MeanAbsoluteError: 0.0541695170104504 | Loss: 0.0042583108073674 | Epoch: 66 | 
MeanAbsoluteError: 0.0334703549742699 | Loss: 0.0018137071232419 | Epoch: 67 | MeanAbsoluteError: 0.0433593094348907 | Loss: 0.0034973454401972 | Epoch: 68 | MeanAbsoluteError: 0.0346672311425209 | Loss: 0.0021430406531391 | Epoch: 69 | MeanAbsoluteError: 0.0388019010424614 | Loss: 0.0024073538504756 | Epoch: 70 | MeanAbsoluteError: 0.0540176331996918 | Loss: 0.0042952744540973 | Epoch: 71 | MeanAbsoluteError: 0.0315856561064720 | Loss: 0.0016803244451204 | Epoch: 72 | MeanAbsoluteError: 0.0560786686837673 | Loss: 0.0045471907270929 | Epoch: 73 | 
MeanAbsoluteError: 0.0308813694864511 | Loss: 0.0018166750467991 | Epoch: 74 | MeanAbsoluteError: 0.0953757762908936 | Loss: 0.0113997613796248 | Epoch: 75 | MeanAbsoluteError: 0.0241710059344769 | Loss: 0.0010915216228638 | Epoch: 76 | MeanAbsoluteError: 0.1326000541448593 | Loss: 0.0219468011592443 | Epoch: 77 | MeanAbsoluteError: 0.0299257859587669 | Loss: 0.0014987847579715 | Epoch: 78 | MeanAbsoluteError: 0.0365549102425575 | Loss: 0.0022428905403313 | Epoch: 79 | MeanAbsoluteError: 0.0787581726908684 | Loss: 0.0092225136378637 | Epoch: 80 | 
MeanAbsoluteError: 0.0748918801546097 | Loss: 0.0089910837033620 | Epoch: 81 | MeanAbsoluteError: 0.0483046993613243 | Loss: 0.0034369537696386 | Epoch: 82 | MeanAbsoluteError: 0.0291776470839977 | Loss: 0.0026278117293259 | Epoch: 83 | MeanAbsoluteError: 0.0273768305778503 | Loss: 0.0014029545978142 | Epoch: 84 | MeanAbsoluteError: 0.0486875213682652 | Loss: 0.0037588416867388 | Epoch: 85 | MeanAbsoluteError: 0.0418346486985683 | Loss: 0.0027756700471330 | Epoch: 86 | MeanAbsoluteError: 0.0351545251905918 | Loss: 0.0022611275377970 | Epoch: 87 | 
MeanAbsoluteError: 0.0675715357065201 | Loss: 0.0054293054585847 | Epoch: 88 | MeanAbsoluteError: 0.0419243946671486 | Loss: 0.0032585640975203 | Epoch: 89 | MeanAbsoluteError: 0.0292361620813608 | Loss: 0.0021439086301073 | Epoch: 90 | MeanAbsoluteError: 0.0673386603593826 | Loss: 0.0063366040479965 | Epoch: 91 | MeanAbsoluteError: 0.0446361154317856 | Loss: 0.0031269186248000 | Epoch: 92 | MeanAbsoluteError: 0.0646992325782776 | Loss: 0.0056258059429148 | Epoch: 93 | MeanAbsoluteError: 0.0313660204410553 | Loss: 0.0020047677042805 | Epoch: 94 | 
MeanAbsoluteError: 0.0556756593286991 | Loss: 0.0041589433094487 | Epoch: 95 | MeanAbsoluteError: 0.0274773836135864 | Loss: 0.0013859455894607 | Epoch: 96 | MeanAbsoluteError: 0.0481901019811630 | Loss: 0.0036108094948129 | Epoch: 97 | MeanAbsoluteError: 0.0437489412724972 | Loss: 0.0036832464796204 | Epoch: 98 | MeanAbsoluteError: 0.0560235977172852 | Loss: 0.0047814050563969 | Epoch: 99 | MeanAbsoluteError: 0.0616047196090221 | Loss: 0.0047313472291885 | Epoch: 100 | MeanAbsoluteError: 0.0579657033085823 | Loss: 0.0046836931365900 | Epoch: 101 | 
MeanAbsoluteError: 0.0745191276073456 | Loss: 0.0071158257957834 | Epoch: 102 | MeanAbsoluteError: 0.0306074246764183 | Loss: 0.0020342320338106 | Epoch: 103 | MeanAbsoluteError: 0.0611320100724697 | Loss: 0.0058374254283710 | Epoch: 104 | MeanAbsoluteError: 0.0440551862120628 | Loss: 0.0027726454427466 | Epoch: 105 | MeanAbsoluteError: 0.0614264495670795 | Loss: 0.0080810496135830 | Epoch: 106 | MeanAbsoluteError: 0.1184859573841095 | Loss: 0.0197562415582629 | Epoch: 107 | MeanAbsoluteError: 0.0676948577165604 | Loss: 0.0070795712705988 | Early stopping at epoch 106
Fold: 7
Epoch: 1 | 
MeanAbsoluteError: 0.1481914818286896 | Loss: 0.0343694865273742 | Epoch: 2 | MeanAbsoluteError: 0.2590743899345398 | Loss: 0.0788370502682833 | Epoch: 3 | MeanAbsoluteError: 0.0710063204169273 | Loss: 0.0084059981521792 | Epoch: 4 | MeanAbsoluteError: 0.0673247501254082 | Loss: 0.0074474013571699 | Epoch: 5 | MeanAbsoluteError: 0.1078560575842857 | Loss: 0.0168605575051445 | Epoch: 6 | MeanAbsoluteError: 0.0748860910534859 | Loss: 0.0096073775964144 | Epoch: 7 | MeanAbsoluteError: 0.0623845681548119 | Loss: 0.0060173460783867 | Epoch: 8 | 
MeanAbsoluteError: 0.0696241185069084 | Loss: 0.0066580359215060 | Epoch: 9 | MeanAbsoluteError: 0.1000215411186218 | Loss: 0.0144430694098656 | Epoch: 10 | MeanAbsoluteError: 0.0718656778335571 | Loss: 0.0074535838256662 | Epoch: 11 | MeanAbsoluteError: 0.0562163256108761 | Loss: 0.0048695980177189 | Epoch: 12 | MeanAbsoluteError: 0.0458306632936001 | Loss: 0.0035986781675512 | Epoch: 13 | MeanAbsoluteError: 0.0561563223600388 | Loss: 0.0053292007024328 | Epoch: 14 | MeanAbsoluteError: 0.0771110504865646 | Loss: 0.0080512715503573 | Epoch: 15 | 
MeanAbsoluteError: 0.0445845611393452 | Loss: 0.0040248359571426 | Epoch: 16 | MeanAbsoluteError: 0.0784944519400597 | Loss: 0.0088030716332679 | Epoch: 17 | MeanAbsoluteError: 0.0481153950095177 | Loss: 0.0043643566582782 | Epoch: 18 | MeanAbsoluteError: 0.0500206425786018 | Loss: 0.0043015953482469 | Epoch: 19 | MeanAbsoluteError: 0.0699427276849747 | Loss: 0.0070114169950382 | Epoch: 20 | MeanAbsoluteError: 0.1113970279693604 | Loss: 0.0154099628114356 | Epoch: 21 | MeanAbsoluteError: 0.0420466512441635 | Loss: 0.0036642047881077 | Epoch: 22 | 
MeanAbsoluteError: 0.0415108203887939 | Loss: 0.0025859762054796 | Epoch: 23 | MeanAbsoluteError: 0.0418124832212925 | Loss: 0.0033026102688522 | Epoch: 24 | MeanAbsoluteError: 0.0296928286552429 | Loss: 0.0016129009499519 | Epoch: 25 | MeanAbsoluteError: 0.1514513045549393 | Loss: 0.0260727260834896 | Epoch: 26 | MeanAbsoluteError: 0.0333099402487278 | Loss: 0.0021061570643304 | Epoch: 27 | MeanAbsoluteError: 0.0717411190271378 | Loss: 0.0068621855014219 | Epoch: 28 | MeanAbsoluteError: 0.0400495305657387 | Loss: 0.0024608703097329 | Epoch: 29 | 
MeanAbsoluteError: 0.0453322641551495 | Loss: 0.0033310242086792 | Epoch: 30 | MeanAbsoluteError: 0.0595685727894306 | Loss: 0.0046552114833433 | Epoch: 31 | MeanAbsoluteError: 0.0772311165928841 | Loss: 0.0076553266710387 | Epoch: 32 | MeanAbsoluteError: 0.0931225493550301 | Loss: 0.0102142917099767 | Epoch: 33 | MeanAbsoluteError: 0.0551522336900234 | Loss: 0.0039392076970006 | Epoch: 34 | MeanAbsoluteError: 0.0573367960751057 | Loss: 0.0045446554521242 | Epoch: 35 | MeanAbsoluteError: 0.0690783783793449 | Loss: 0.0064417986611191 | Epoch: 36 | 
MeanAbsoluteError: 0.0584684424102306 | Loss: 0.0052318127216915 | Epoch: 37 | MeanAbsoluteError: 0.0598084554076195 | Loss: 0.0050383289434159 | Epoch: 38 | MeanAbsoluteError: 0.0773476287722588 | Loss: 0.0083063975370561 | Epoch: 39 | MeanAbsoluteError: 0.0372569672763348 | Loss: 0.0024797951516051 | Epoch: 40 | MeanAbsoluteError: 0.0350975170731544 | Loss: 0.0022464039950417 | Epoch: 41 | MeanAbsoluteError: 0.0334105975925922 | Loss: 0.0020636337173458 | Epoch: 42 | MeanAbsoluteError: 0.0944334864616394 | Loss: 0.0108448144478294 | Epoch: 43 | 
MeanAbsoluteError: 0.0260165389627218 | Loss: 0.0012499192805710 | Epoch: 44 | MeanAbsoluteError: 0.0403511412441730 | Loss: 0.0027975141330479 | Epoch: 45 | MeanAbsoluteError: 0.0724602639675140 | Loss: 0.0078624534205748 | Epoch: 46 | MeanAbsoluteError: 0.0733173862099648 | Loss: 0.0073078729642125 | Epoch: 47 | MeanAbsoluteError: 0.0425883382558823 | Loss: 0.0028196005240226 | Epoch: 48 | MeanAbsoluteError: 0.0337453372776508 | Loss: 0.0022075903297474 | Epoch: 49 | MeanAbsoluteError: 0.0391620546579361 | Loss: 0.0027646088811497 | Epoch: 50 | 
MeanAbsoluteError: 0.0351868830621243 | Loss: 0.0021633700022134 | Epoch: 51 | MeanAbsoluteError: 0.0839673504233360 | Loss: 0.0092447295498389 | Epoch: 52 | MeanAbsoluteError: 0.0652567446231842 | Loss: 0.0064234383708726 | Epoch: 53 | MeanAbsoluteError: 0.0353384390473366 | Loss: 0.0022921445645177 | Epoch: 54 | MeanAbsoluteError: 0.0951710194349289 | Loss: 0.0110801168215963 | Epoch: 55 | MeanAbsoluteError: 0.0411252230405807 | Loss: 0.0026603422190349 | Epoch: 56 | MeanAbsoluteError: 0.0504706799983978 | Loss: 0.0041466369741381 | Epoch: 57 | 
MeanAbsoluteError: 0.0876582115888596 | Loss: 0.0092274973957011 | Epoch: 58 | MeanAbsoluteError: 0.0459568016231060 | Loss: 0.0036788536862542 | Epoch: 59 | MeanAbsoluteError: 0.0559574812650681 | Loss: 0.0061216770241467 | Epoch: 60 | MeanAbsoluteError: 0.0322446674108505 | Loss: 0.0023290986562363 | Epoch: 61 | MeanAbsoluteError: 0.0413896888494492 | Loss: 0.0027203841555792 | Epoch: 62 | MeanAbsoluteError: 0.1106870621442795 | Loss: 0.0138757044019607 | Epoch: 63 | MeanAbsoluteError: 0.0824708640575409 | Loss: 0.0096543237495308 | Epoch: 64 | 
MeanAbsoluteError: 0.0285964440554380 | Loss: 0.0017463316146929 | Epoch: 65 | MeanAbsoluteError: 0.0331472791731358 | Loss: 0.0018958434184942 | Epoch: 66 | MeanAbsoluteError: 0.0631162449717522 | Loss: 0.0052289695550616 | Epoch: 67 | MeanAbsoluteError: 0.0392517298460007 | Loss: 0.0024142923961895 | Epoch: 68 | MeanAbsoluteError: 0.0549550577998161 | Loss: 0.0045410698064818 | Epoch: 69 | MeanAbsoluteError: 0.0359478443861008 | Loss: 0.0020742452201935 | Epoch: 70 | MeanAbsoluteError: 0.0592147745192051 | Loss: 0.0048737083561718 | Epoch: 71 | 
MeanAbsoluteError: 0.0918926820158958 | Loss: 0.0122628493341975 | Epoch: 72 | MeanAbsoluteError: 0.0200275443494320 | Loss: 0.0006509416494877 | Epoch: 73 | MeanAbsoluteError: 0.0310848038643599 | Loss: 0.0017016167895725 | Epoch: 74 | MeanAbsoluteError: 0.0388812981545925 | Loss: 0.0025849665533035 | Epoch: 75 | MeanAbsoluteError: 0.0442915298044682 | Loss: 0.0028863524247964 | Epoch: 76 | MeanAbsoluteError: 0.0649951845407486 | Loss: 0.0054648532711256 | Epoch: 77 | MeanAbsoluteError: 0.1165458709001541 | Loss: 0.0146413616692791 | Epoch: 78 | 
MeanAbsoluteError: 0.0395773835480213 | Loss: 0.0024407537779413 | Epoch: 79 | MeanAbsoluteError: 0.0254725441336632 | Loss: 0.0009738221683969 | Epoch: 80 | MeanAbsoluteError: 0.0633817836642265 | Loss: 0.0051705043118161 | Epoch: 81 | MeanAbsoluteError: 0.0890552327036858 | Loss: 0.0108726914578046 | Epoch: 82 | MeanAbsoluteError: 0.0366479381918907 | Loss: 0.0021928437591459 | Epoch: 83 | MeanAbsoluteError: 0.0544604212045670 | Loss: 0.0038836645768382 | Epoch: 84 | MeanAbsoluteError: 0.0905896723270416 | Loss: 0.0103487923311499 | Epoch: 85 | 
MeanAbsoluteError: 0.0512833558022976 | Loss: 0.0038758512729636 | Epoch: 86 | MeanAbsoluteError: 0.0337646305561066 | Loss: 0.0020909239493239 | Epoch: 87 | MeanAbsoluteError: 0.0372574217617512 | Loss: 0.0024257511697495 | Epoch: 88 | MeanAbsoluteError: 0.0575227439403534 | Loss: 0.0047566347325651 | Epoch: 89 | MeanAbsoluteError: 0.0386124327778816 | Loss: 0.0022304304606783 | Epoch: 90 | MeanAbsoluteError: 0.0637443289160728 | Loss: 0.0058680513264755 | Epoch: 91 | MeanAbsoluteError: 0.0287668686360121 | Loss: 0.0016058573729914 | Epoch: 92 | 
MeanAbsoluteError: 0.0267513729631901 | Loss: 0.0014177375795463 | Epoch: 93 | MeanAbsoluteError: 0.0403658524155617 | Loss: 0.0026987291594896 | Epoch: 94 | MeanAbsoluteError: 0.0701793879270554 | Loss: 0.0060653050716680 | Epoch: 95 | MeanAbsoluteError: 0.0297492593526840 | Loss: 0.0014306454373022 | Epoch: 96 | MeanAbsoluteError: 0.0552990250289440 | Loss: 0.0047281395661860 | Epoch: 97 | MeanAbsoluteError: 0.0679321363568306 | Loss: 0.0069279128219932 | Epoch: 98 | MeanAbsoluteError: 0.0392989814281464 | Loss: 0.0025936991665871 | Epoch: 99 | 
MeanAbsoluteError: 0.0279756598174572 | Loss: 0.0014675576027142 | Epoch: 100 | MeanAbsoluteError: 0.0372042879462242 | Loss: 0.0022336457444068 | Epoch: 101 | MeanAbsoluteError: 0.0387463495135307 | Loss: 0.0021141960616940 | Epoch: 102 | MeanAbsoluteError: 0.0305238105356693 | Loss: 0.0017127752384672 | Epoch: 103 | MeanAbsoluteError: 0.0348869189620018 | Loss: 0.0021888530754950 | Epoch: 104 | MeanAbsoluteError: 0.0416419021785259 | Loss: 0.0025566797658729 | Early stopping at epoch 103
Fold: 8
Epoch: 1 | MeanAbsoluteError: 0.1861671507358551 | Loss: 0.0519103959489327 | Epoch: 2 | 
MeanAbsoluteError: 0.1664825081825256 | Loss: 0.0388413756512679 | Epoch: 3 | MeanAbsoluteError: 0.1163345426321030 | Loss: 0.0192564393107135 | Epoch: 4 | MeanAbsoluteError: 0.0749647542834282 | Loss: 0.0086867220234126 | Epoch: 5 | MeanAbsoluteError: 0.1171664446592331 | Loss: 0.0202481200058873 | Epoch: 6 | MeanAbsoluteError: 0.1360088437795639 | Loss: 0.0245636262429448 | Epoch: 7 | MeanAbsoluteError: 0.1067002117633820 | Loss: 0.0157199552497612 | Epoch: 8 | MeanAbsoluteError: 0.0513823032379150 | Loss: 0.0049547525660063 | Epoch: 9 | 
MeanAbsoluteError: 0.0567321926355362 | Loss: 0.0063330034205977 | Epoch: 10 | MeanAbsoluteError: 0.0819140449166298 | Loss: 0.0096310021606489 | Epoch: 11 | MeanAbsoluteError: 0.0895248204469681 | Loss: 0.0106191623669404 | Epoch: 12 | MeanAbsoluteError: 0.0648430064320564 | Loss: 0.0061835375292083 | Epoch: 13 | MeanAbsoluteError: 0.0674160197377205 | Loss: 0.0075957297096745 | Epoch: 14 | MeanAbsoluteError: 0.0656726360321045 | Loss: 0.0062452593030265 | Epoch: 15 | MeanAbsoluteError: 0.0480137877166271 | Loss: 0.0037495617468197 | Epoch: 16 | 
MeanAbsoluteError: 0.0557621009647846 | Loss: 0.0043711692023163 | Epoch: 17 | MeanAbsoluteError: 0.0790864676237106 | Loss: 0.0079927518247412 | Epoch: 18 | MeanAbsoluteError: 0.0403685346245766 | Loss: 0.0027897496474907 | Epoch: 19 | MeanAbsoluteError: 0.0869552195072174 | Loss: 0.0098537671594666 | Epoch: 20 | MeanAbsoluteError: 0.0440062470734119 | Loss: 0.0034891138157736 | Epoch: 21 | MeanAbsoluteError: 0.0964422672986984 | Loss: 0.0116662712266239 | Epoch: 22 | MeanAbsoluteError: 0.0479723401367664 | Loss: 0.0043110399498031 | Epoch: 23 | 
MeanAbsoluteError: 0.0428856126964092 | Loss: 0.0034509487315797 | Epoch: 24 | MeanAbsoluteError: 0.0389922894537449 | Loss: 0.0028643343852869 | Epoch: 25 | MeanAbsoluteError: 0.0475423187017441 | Loss: 0.0035187215812934 | Epoch: 26 | MeanAbsoluteError: 0.1147362887859344 | Loss: 0.0164447110146284 | Epoch: 27 | MeanAbsoluteError: 0.0511622093617916 | Loss: 0.0040414717782719 | Epoch: 28 | MeanAbsoluteError: 0.0417586527764797 | Loss: 0.0030895825162028 | Epoch: 29 | MeanAbsoluteError: 0.0475418455898762 | Loss: 0.0040420980031530 | Epoch: 30 | 
MeanAbsoluteError: 0.0855991169810295 | Loss: 0.0089962584539675 | Epoch: 31 | MeanAbsoluteError: 0.0843953415751457 | Loss: 0.0100088871728915 | Epoch: 32 | MeanAbsoluteError: 0.0437725260853767 | Loss: 0.0031369640760554 | Epoch: 33 | MeanAbsoluteError: 0.0370704680681229 | Loss: 0.0021956918599944 | Epoch: 34 | MeanAbsoluteError: 0.0964409187436104 | Loss: 0.0114045571177625 | Epoch: 35 | MeanAbsoluteError: 0.0502698719501495 | Loss: 0.0042611860150758 | Epoch: 36 | MeanAbsoluteError: 0.0803511887788773 | Loss: 0.0087174542176609 | Epoch: 37 | 
MeanAbsoluteError: 0.0321062318980694 | Loss: 0.0015390158469717 | Epoch: 38 | MeanAbsoluteError: 0.0801994502544403 | Loss: 0.0079304187898882 | Epoch: 39 | MeanAbsoluteError: 0.0722487270832062 | Loss: 0.0068260403349996 | Epoch: 40 | MeanAbsoluteError: 0.0518044754862785 | Loss: 0.0039764164696233 | Epoch: 41 | MeanAbsoluteError: 0.0393064841628075 | Loss: 0.0024738488987518 | Epoch: 42 | MeanAbsoluteError: 0.0580911189317703 | Loss: 0.0051763883720224 | Epoch: 43 | MeanAbsoluteError: 0.0449617467820644 | Loss: 0.0029155910821058 | Epoch: 44 | 
MeanAbsoluteError: 0.0911086350679398 | Loss: 0.0107076272654992 | Epoch: 45 | MeanAbsoluteError: 0.0999177396297455 | Loss: 0.0123189360333177 | Epoch: 46 | MeanAbsoluteError: 0.0296116098761559 | Loss: 0.0014102326419491 | Epoch: 47 | MeanAbsoluteError: 0.0348054431378841 | Loss: 0.0018013847830634 | Epoch: 48 | MeanAbsoluteError: 0.0885576307773590 | Loss: 0.0099699998704287 | Epoch: 49 | MeanAbsoluteError: 0.0660384371876717 | Loss: 0.0056817181444225 | Epoch: 50 | MeanAbsoluteError: 0.0752702131867409 | Loss: 0.0074768544425471 | Epoch: 51 | 
MeanAbsoluteError: 0.0968824699521065 | Loss: 0.0120838196375049 | Epoch: 52 | MeanAbsoluteError: 0.0373071916401386 | Loss: 0.0023468761489942 | Epoch: 53 | MeanAbsoluteError: 0.0571294352412224 | Loss: 0.0050720123511453 | Epoch: 54 | MeanAbsoluteError: 0.0630985945463181 | Loss: 0.0062379696889995 | Epoch: 55 | MeanAbsoluteError: 0.0429347194731236 | Loss: 0.0025449660875333 | Epoch: 56 | MeanAbsoluteError: 0.0357052385807037 | Loss: 0.0021692423884255 | Epoch: 57 | MeanAbsoluteError: 0.0583352558314800 | Loss: 0.0045906704707214 | Epoch: 58 | 
MeanAbsoluteError: 0.0681079626083374 | Loss: 0.0068736502972360 | Epoch: 59 | MeanAbsoluteError: 0.0354722104966640 | Loss: 0.0021135852484104 | Epoch: 60 | MeanAbsoluteError: 0.0549491643905640 | Loss: 0.0044714293012825 | Epoch: 61 | MeanAbsoluteError: 0.0395159833133221 | Loss: 0.0029965141729917 | Epoch: 62 | MeanAbsoluteError: 0.0407041124999523 | Loss: 0.0031763750146358 | Epoch: 63 | MeanAbsoluteError: 0.0445616431534290 | Loss: 0.0032701941404062 | Epoch: 64 | MeanAbsoluteError: 0.0509964078664780 | Loss: 0.0045086170743721 | Epoch: 65 | 
MeanAbsoluteError: 0.0478223338723183 | Loss: 0.0034477523205659 | Epoch: 66 | MeanAbsoluteError: 0.0490616075694561 | Loss: 0.0035501567987152 | Epoch: 67 | MeanAbsoluteError: 0.0279074162244797 | Loss: 0.0014005982688664 | Epoch: 68 | MeanAbsoluteError: 0.0835607126355171 | Loss: 0.0088646836543026 | Epoch: 69 | MeanAbsoluteError: 0.0834848657250404 | Loss: 0.0087083270773292 | Epoch: 70 | MeanAbsoluteError: 0.0302438084036112 | Loss: 0.0015432992099354 | Epoch: 71 | MeanAbsoluteError: 0.0251835659146309 | Loss: 0.0014753785866420 | Epoch: 72 | 
MeanAbsoluteError: 0.0370502322912216 | Loss: 0.0022390329664072 | Epoch: 73 | MeanAbsoluteError: 0.0295870732516050 | Loss: 0.0018435607691152 | Epoch: 74 | MeanAbsoluteError: 0.0631109923124313 | Loss: 0.0050717673909206 | Epoch: 75 | MeanAbsoluteError: 0.0341487377882004 | Loss: 0.0018286068449155 | Epoch: 76 | MeanAbsoluteError: 0.0293669756501913 | Loss: 0.0017687096461976 | Epoch: 77 | MeanAbsoluteError: 0.0744449868798256 | Loss: 0.0069519931880327 | Epoch: 78 | MeanAbsoluteError: 0.0574376806616783 | Loss: 0.0044771543202492 | Epoch: 79 | 
MeanAbsoluteError: 0.0346750542521477 | Loss: 0.0018088462037178 | Epoch: 80 | MeanAbsoluteError: 0.0558674670755863 | Loss: 0.0047337353910105 | Epoch: 81 | MeanAbsoluteError: 0.0598470717668533 | Loss: 0.0057677675862438 | Epoch: 82 | MeanAbsoluteError: 0.0505005568265915 | Loss: 0.0044952911378529 | Epoch: 83 | MeanAbsoluteError: 0.0791244208812714 | Loss: 0.0088420880671877 | Epoch: 84 | MeanAbsoluteError: 0.0715940892696381 | Loss: 0.0070248895969528 | Epoch: 85 | MeanAbsoluteError: 0.0489390268921852 | Loss: 0.0033347630121100 | Epoch: 86 | 
MeanAbsoluteError: 0.0269037634134293 | Loss: 0.0012181209178659 | Epoch: 87 | MeanAbsoluteError: 0.0528705008327961 | Loss: 0.0039133692178159 | Epoch: 88 | MeanAbsoluteError: 0.0318964570760727 | Loss: 0.0017936249563578 | Epoch: 89 | MeanAbsoluteError: 0.0623123683035374 | Loss: 0.0069696762366220 | Epoch: 90 | MeanAbsoluteError: 0.0565380491316319 | Loss: 0.0044484590538419 | Epoch: 91 | MeanAbsoluteError: 0.1077339202165604 | Loss: 0.0151104768738151 | Epoch: 92 | MeanAbsoluteError: 0.0473801791667938 | Loss: 0.0035310600203677 | Epoch: 93 | 
MeanAbsoluteError: 0.0875534340739250 | Loss: 0.0093824090436101 | Epoch: 94 | MeanAbsoluteError: 0.0510640703141689 | Loss: 0.0042444952190495 | Epoch: 95 | MeanAbsoluteError: 0.0288489107042551 | Loss: 0.0015460056064722 | Epoch: 96 | MeanAbsoluteError: 0.0455102622509003 | Loss: 0.0029377467267645 | Epoch: 97 | MeanAbsoluteError: 0.0577077120542526 | Loss: 0.0047478346924226 | Epoch: 98 | MeanAbsoluteError: 0.0525175482034683 | Loss: 0.0036398514908237 | Epoch: 99 | MeanAbsoluteError: 0.0337783135473728 | Loss: 0.0019143755377557 | Epoch: 100 | 
MeanAbsoluteError: 0.0532571263611317 | Loss: 0.0044869667348953 | Epoch: 101 | MeanAbsoluteError: 0.0406806953251362 | Loss: 0.0026839254244875 | Epoch: 102 | MeanAbsoluteError: 0.0480214208364487 | Loss: 0.0038642105467331 | Epoch: 103 | MeanAbsoluteError: 0.0478824824094772 | Loss: 0.0028402014778784 | Epoch: 104 | MeanAbsoluteError: 0.0601385198533535 | Loss: 0.0056208887388213 | Epoch: 105 | MeanAbsoluteError: 0.0263363607227802 | Loss: 0.0013153342252526 | Epoch: 106 | MeanAbsoluteError: 0.0482825338840485 | Loss: 0.0034060894260899 | Epoch: 107 | 
MeanAbsoluteError: 0.0591554678976536 | Loss: 0.0059131271241663 | Epoch: 108 | MeanAbsoluteError: 0.0460236221551895 | Loss: 0.0033934673500391 | Epoch: 109 | MeanAbsoluteError: 0.0573018454015255 | Loss: 0.0045563994835203 | Epoch: 110 | MeanAbsoluteError: 0.0734614580869675 | Loss: 0.0093973538695047 | Epoch: 111 | MeanAbsoluteError: 0.0398122780025005 | Loss: 0.0026005951848884 | Epoch: 112 | MeanAbsoluteError: 0.0701176896691322 | Loss: 0.0067485187811634 | Epoch: 113 | MeanAbsoluteError: 0.0420567356050014 | Loss: 0.0024435271311981 | Epoch: 114 | 
MeanAbsoluteError: 0.0492447502911091 | Loss: 0.0040432484820485 | Epoch: 115 | MeanAbsoluteError: 0.0591563321650028 | Loss: 0.0055032797211495 | Epoch: 116 | MeanAbsoluteError: 0.0340740643441677 | Loss: 0.0021815180684476 | Epoch: 117 | MeanAbsoluteError: 0.0423083342611790 | Loss: 0.0027571785926389 | Epoch: 118 | MeanAbsoluteError: 0.0341044031083584 | Loss: 0.0022386096982070 | Early stopping at epoch 117
Fold: 9
Epoch: 1 | MeanAbsoluteError: 0.1119308546185493 | Loss: 0.0242152734158131 | Epoch: 2 | MeanAbsoluteError: 0.1146131902933121 | Loss: 0.0210809320784532 | Epoch: 3 | 
MeanAbsoluteError: 0.0816055759787560 | Loss: 0.0114502974320203 | Epoch: 4 | MeanAbsoluteError: 0.0961654260754585 | Loss: 0.0179773754296968 | Epoch: 5 | MeanAbsoluteError: 0.0880988687276840 | Loss: 0.0108312441645047 | Epoch: 6 | MeanAbsoluteError: 0.1053510829806328 | Loss: 0.0140687258054431 | Epoch: 7 | MeanAbsoluteError: 0.0640776380896568 | Loss: 0.0071655146670170 | Epoch: 8 | MeanAbsoluteError: 0.0842599943280220 | Loss: 0.0124811441637576 | Epoch: 9 | MeanAbsoluteError: 0.1484175920486450 | Loss: 0.0263402511437352 | Epoch: 10 | 
MeanAbsoluteError: 0.1746247112751007 | Loss: 0.0356914476992992 | Epoch: 11 | MeanAbsoluteError: 0.1634880602359772 | Loss: 0.0297147049926795 | Epoch: 12 | MeanAbsoluteError: 0.0521644055843353 | Loss: 0.0049856476342449 | Epoch: 13 | MeanAbsoluteError: 0.1189405173063278 | Loss: 0.0183229384084161 | Epoch: 14 | MeanAbsoluteError: 0.0547323971986771 | Loss: 0.0047300221899954 | Epoch: 15 | MeanAbsoluteError: 0.1447095721960068 | Loss: 0.0240782995063525 | Epoch: 16 | MeanAbsoluteError: 0.0907324105501175 | Loss: 0.0137387099496734 | Epoch: 17 | 
MeanAbsoluteError: 0.0724234506487846 | Loss: 0.0085701617197349 | Epoch: 18 | MeanAbsoluteError: 0.0747703015804291 | Loss: 0.0077803805112266 | Epoch: 19 | MeanAbsoluteError: 0.0797107145190239 | Loss: 0.0100932847708464 | Epoch: 20 | MeanAbsoluteError: 0.0599866881966591 | Loss: 0.0054901420819358 | Epoch: 21 | MeanAbsoluteError: 0.0503198578953743 | Loss: 0.0045252629967693 | Epoch: 22 | MeanAbsoluteError: 0.1253996044397354 | Loss: 0.0195110383658455 | Epoch: 23 | MeanAbsoluteError: 0.1200777217745781 | Loss: 0.0169440620363905 | Epoch: 24 | 
MeanAbsoluteError: 0.0721687152981758 | Loss: 0.0073941977909551 | Epoch: 25 | MeanAbsoluteError: 0.0872525051236153 | Loss: 0.0094111589714885 | Epoch: 26 | MeanAbsoluteError: 0.0428870357573032 | Loss: 0.0037403615334859 | Epoch: 27 | MeanAbsoluteError: 0.0612809509038925 | Loss: 0.0054054093869546 | Epoch: 28 | MeanAbsoluteError: 0.0504402369260788 | Loss: 0.0038371819761009 | Epoch: 29 | MeanAbsoluteError: 0.0356781966984272 | Loss: 0.0019795923077394 | Epoch: 30 | MeanAbsoluteError: 0.1008141040802002 | Loss: 0.0123765224304337 | Epoch: 31 | 
MeanAbsoluteError: 0.1417662799358368 | Loss: 0.0232496791734145 | Epoch: 32 | MeanAbsoluteError: 0.0408938564360142 | Loss: 0.0030862531320264 | Epoch: 33 | MeanAbsoluteError: 0.0315383821725845 | Loss: 0.0017137706700641 | Epoch: 34 | MeanAbsoluteError: 0.0783235132694244 | Loss: 0.0093789773348432 | Epoch: 35 | MeanAbsoluteError: 0.0505264662206173 | Loss: 0.0057638942514761 | Epoch: 36 | MeanAbsoluteError: 0.0681148469448090 | Loss: 0.0069229071512102 | Epoch: 37 | MeanAbsoluteError: 0.0478477478027344 | Loss: 0.0036841708127982 | Epoch: 38 | 
MeanAbsoluteError: 0.0477188266813755 | Loss: 0.0033914328445322 | Epoch: 39 | MeanAbsoluteError: 0.1021449640393257 | Loss: 0.0128055957790751 | Epoch: 40 | MeanAbsoluteError: 0.0658222660422325 | Loss: 0.0064091772163430 | Epoch: 41 | MeanAbsoluteError: 0.0570884123444557 | Loss: 0.0048299274505832 | Epoch: 42 | MeanAbsoluteError: 0.0533422529697418 | Loss: 0.0054309261344875 | Epoch: 43 | MeanAbsoluteError: 0.0643961131572723 | Loss: 0.0053749074084828 | Epoch: 44 | MeanAbsoluteError: 0.0402340553700924 | Loss: 0.0033101803542545 | Epoch: 45 | 
MeanAbsoluteError: 0.0549132265150547 | Loss: 0.0051050804591236 | Epoch: 46 | MeanAbsoluteError: 0.0626840889453888 | Loss: 0.0062440253140476 | Epoch: 47 | MeanAbsoluteError: 0.0626541823148727 | Loss: 0.0058396258391440 | Epoch: 48 | MeanAbsoluteError: 0.1106534898281097 | Loss: 0.0141684697367824 | Epoch: 49 | MeanAbsoluteError: 0.0392517596483231 | Loss: 0.0028695527267141 | Epoch: 50 | MeanAbsoluteError: 0.0783291682600975 | Loss: 0.0082192194397346 | Epoch: 51 | MeanAbsoluteError: 0.0438046455383301 | Loss: 0.0028989803171358 | Epoch: 52 | 
MeanAbsoluteError: 0.0330046936869621 | Loss: 0.0023489715912057 | Epoch: 53 | MeanAbsoluteError: 0.0394266471266747 | Loss: 0.0026255342572068 | Epoch: 54 | MeanAbsoluteError: 0.0778232589364052 | Loss: 0.0082654445790328 | Epoch: 55 | MeanAbsoluteError: 0.1264271736145020 | Loss: 0.0188592233910010 | Epoch: 56 | MeanAbsoluteError: 0.0562583319842815 | Loss: 0.0047368442174047 | Epoch: 57 | MeanAbsoluteError: 0.0600550211966038 | Loss: 0.0054617341106328 | Epoch: 58 | MeanAbsoluteError: 0.0311625190079212 | Loss: 0.0014127252305535 | Epoch: 59 | 
MeanAbsoluteError: 0.0781940147280693 | Loss: 0.0088958270991078 | Epoch: 60 | MeanAbsoluteError: 0.0284409094601870 | Loss: 0.0016870814153942 | Epoch: 61 | MeanAbsoluteError: 0.0590154305100441 | Loss: 0.0055624056034363 | Epoch: 62 | MeanAbsoluteError: 0.0547774136066437 | Loss: 0.0049274841753336 | Epoch: 63 | MeanAbsoluteError: 0.0442264191806316 | Loss: 0.0034260676833443 | Epoch: 64 | MeanAbsoluteError: 0.0676316693425179 | Loss: 0.0063392193450664 | Epoch: 65 | MeanAbsoluteError: 0.0765657648444176 | Loss: 0.0087935784115241 | Epoch: 66 | 
MeanAbsoluteError: 0.0482657663524151 | Loss: 0.0033171148881173 | Epoch: 67 | MeanAbsoluteError: 0.0653405338525772 | Loss: 0.0055135668685230 | Epoch: 68 | MeanAbsoluteError: 0.0725527033209801 | Loss: 0.0078756652879887 | Epoch: 69 | MeanAbsoluteError: 0.0444331802427769 | Loss: 0.0027395889360028 | Epoch: 70 | MeanAbsoluteError: 0.0564345121383667 | Loss: 0.0057733726705639 | Epoch: 71 | MeanAbsoluteError: 0.0614207871258259 | Loss: 0.0055365032659700 | Epoch: 72 | MeanAbsoluteError: 0.0326578393578529 | Loss: 0.0022467296221294 | Epoch: 73 | 
MeanAbsoluteError: 0.0490861833095551 | Loss: 0.0035975875261311 | Epoch: 74 | MeanAbsoluteError: 0.0425860248506069 | Loss: 0.0026845589521914 | Epoch: 75 | MeanAbsoluteError: 0.0442980751395226 | Loss: 0.0034675726828237 | Epoch: 76 | MeanAbsoluteError: 0.0414831936359406 | Loss: 0.0024806613398071 | Epoch: 77 | MeanAbsoluteError: 0.0215571783483028 | Loss: 0.0008473544646852 | Epoch: 78 | MeanAbsoluteError: 0.0838011056184769 | Loss: 0.0087159289262043 | Epoch: 79 | MeanAbsoluteError: 0.0604068934917450 | Loss: 0.0055451557004394 | Epoch: 80 | 
MeanAbsoluteError: 0.0335111506283283 | Loss: 0.0020162788479446 | Epoch: 81 | MeanAbsoluteError: 0.0448416434228420 | Loss: 0.0038129233737261 | Epoch: 82 | MeanAbsoluteError: 0.0262446030974388 | Loss: 0.0013888531897324 | Epoch: 83 | MeanAbsoluteError: 0.0615904442965984 | Loss: 0.0062000341713428 | Epoch: 84 | MeanAbsoluteError: 0.1229223087430000 | Loss: 0.0188391867022102 | Epoch: 85 | 
MeanAbsoluteError: 0.0486791469156742 | Loss: 0.0032196517120330 | Epoch: 86 | MeanAbsoluteError: 0.0467173494398594 | Loss: 0.0039439486124768 | Epoch: 87 | MeanAbsoluteError: 0.0556094013154507 | Loss: 0.0041049185316437 | Epoch: 88 | MeanAbsoluteError: 0.0351609699428082 | Loss: 0.0031856424802055 | Epoch: 89 | MeanAbsoluteError: 0.0314623303711414 | Loss: 0.0016582784010097 | Epoch: 90 | MeanAbsoluteError: 0.0608287602663040 | Loss: 0.0060381433084750 | Epoch: 91 | MeanAbsoluteError: 0.0508691444993019 | Loss: 0.0041465075337328 | Epoch: 92 | 
MeanAbsoluteError: 0.0468417927622795 | Loss: 0.0034976752134613 | Epoch: 93 | MeanAbsoluteError: 0.0349633283913136 | Loss: 0.0020341847647125 | Epoch: 94 | MeanAbsoluteError: 0.0281434003263712 | Loss: 0.0015140221982550 | Epoch: 95 | MeanAbsoluteError: 0.0360061265528202 | Loss: 0.0024969900561980 | Epoch: 96 | MeanAbsoluteError: 0.0563825517892838 | Loss: 0.0049647036492108 | Epoch: 97 | MeanAbsoluteError: 0.0604257360100746 | Loss: 0.0055305500729726 | Epoch: 98 | MeanAbsoluteError: 0.0381195992231369 | Loss: 0.0022370776322742 | Epoch: 99 | 
MeanAbsoluteError: 0.0324037745594978 | Loss: 0.0017797371569591 | Epoch: 100 | MeanAbsoluteError: 0.0524153336882591 | Loss: 0.0048717602353113 | Epoch: 101 | MeanAbsoluteError: 0.0282710343599319 | Loss: 0.0016223453276325 | Epoch: 102 | MeanAbsoluteError: 0.0496654510498047 | Loss: 0.0036249975673854 | Epoch: 103 | MeanAbsoluteError: 0.0235165115445852 | Loss: 0.0012281080819845 | Epoch: 104 | MeanAbsoluteError: 0.0363549962639809 | Loss: 0.0029759713394854 | Epoch: 105 | MeanAbsoluteError: 0.0381968319416046 | Loss: 0.0024040650415163 | Epoch: 106 | 
MeanAbsoluteError: 0.0499870553612709 | Loss: 0.0043353704252065 | Epoch: 107 | MeanAbsoluteError: 0.0530704073607922 | Loss: 0.0043598309410020 | Epoch: 108 | MeanAbsoluteError: 0.0936763286590576 | Loss: 0.0121793919601119 | Epoch: 109 | MeanAbsoluteError: 0.0561753176152706 | Loss: 0.0043953241099818 | Early stopping at epoch 108
Fold: 10
Epoch: 1 | MeanAbsoluteError: 0.1330154687166214 | Loss: 0.0277384754556876 | Epoch: 2 | MeanAbsoluteError: 0.1210014820098877 | Loss: 0.0229843098025482 | Epoch: 3 | MeanAbsoluteError: 0.1457633972167969 | Loss: 0.0296038535710138 | Epoch: 4 | 
MeanAbsoluteError: 0.0994027405977249 | Loss: 0.0151191350932305 | Epoch: 5 | MeanAbsoluteError: 0.1046080663800240 | Loss: 0.0167013529795580 | Epoch: 6 | MeanAbsoluteError: 0.1973824650049210 | Loss: 0.0432703176943155 | Epoch: 7 | MeanAbsoluteError: 0.0851512402296066 | Loss: 0.0105282212428462 | Epoch: 8 | MeanAbsoluteError: 0.1182767078280449 | Loss: 0.0183684962729995 | Epoch: 9 | MeanAbsoluteError: 0.0660992041230202 | Loss: 0.0073262972470659 | Epoch: 10 | MeanAbsoluteError: 0.0726405829191208 | Loss: 0.0083107345450956 | Epoch: 11 | 
MeanAbsoluteError: 0.1268167793750763 | Loss: 0.0194077210214276 | Epoch: 12 | MeanAbsoluteError: 0.0937352553009987 | Loss: 0.0118783518958550 | Epoch: 13 | MeanAbsoluteError: 0.0475714169442654 | Loss: 0.0049169303652329 | Epoch: 14 | MeanAbsoluteError: 0.0531766973435879 | Loss: 0.0047881084834584 | Epoch: 15 | MeanAbsoluteError: 0.0895252153277397 | Loss: 0.0118048923233381 | Epoch: 16 | MeanAbsoluteError: 0.0520330034196377 | Loss: 0.0045656928738866 | Epoch: 17 | MeanAbsoluteError: 0.0882584303617477 | Loss: 0.0094627330366236 | Epoch: 18 | 
MeanAbsoluteError: 0.0592141821980476 | Loss: 0.0068371693890255 | Epoch: 19 | MeanAbsoluteError: 0.0428397655487061 | Loss: 0.0029989201754618 | Epoch: 20 | MeanAbsoluteError: 0.0572957657277584 | Loss: 0.0058065427538867 | Epoch: 21 | MeanAbsoluteError: 0.0456118807196617 | Loss: 0.0047996616787994 | Epoch: 22 | MeanAbsoluteError: 0.0929881855845451 | Loss: 0.0109900483646645 | Epoch: 23 | MeanAbsoluteError: 0.0480714701116085 | Loss: 0.0043671186207435 | Epoch: 24 | MeanAbsoluteError: 0.0660299658775330 | Loss: 0.0058438947173552 | Epoch: 25 | 
MeanAbsoluteError: 0.0461247861385345 | Loss: 0.0041869632953491 | Epoch: 26 | MeanAbsoluteError: 0.0416426509618759 | Loss: 0.0030227091449958 | Epoch: 27 | MeanAbsoluteError: 0.0402235314249992 | Loss: 0.0025439516488964 | Epoch: 28 | MeanAbsoluteError: 0.0654409602284431 | Loss: 0.0065909677292578 | Epoch: 29 | MeanAbsoluteError: 0.1140401661396027 | Loss: 0.0182828967316219 | Epoch: 30 | MeanAbsoluteError: 0.0984854102134705 | Loss: 0.0122044655637672 | Epoch: 31 | MeanAbsoluteError: 0.0456661097705364 | Loss: 0.0035174814357351 | Epoch: 32 | 
MeanAbsoluteError: 0.0456781350076199 | Loss: 0.0032565890936754 | Epoch: 33 | MeanAbsoluteError: 0.0410617217421532 | Loss: 0.0037964741215826 | Epoch: 34 | MeanAbsoluteError: 0.0709045901894569 | Loss: 0.0065369453782646 | Epoch: 35 | MeanAbsoluteError: 0.0481971055269241 | Loss: 0.0034973238899301 | Epoch: 36 | MeanAbsoluteError: 0.0422836318612099 | Loss: 0.0032058093078936 | Epoch: 37 | MeanAbsoluteError: 0.0323637090623379 | Loss: 0.0022505010218503 | Epoch: 38 | MeanAbsoluteError: 0.0617923513054848 | Loss: 0.0066292319500532 | Epoch: 39 | 
MeanAbsoluteError: 0.0512133873999119 | Loss: 0.0041883614881394 | Epoch: 40 | MeanAbsoluteError: 0.0800053328275681 | Loss: 0.0083043834624382 | Epoch: 41 | MeanAbsoluteError: 0.1318707615137100 | Loss: 0.0197591975044746 | Epoch: 42 | MeanAbsoluteError: 0.1025399267673492 | Loss: 0.0142121238347430 | Epoch: 43 | MeanAbsoluteError: 0.0894898921251297 | Loss: 0.0113365403734721 | Epoch: 44 | MeanAbsoluteError: 0.0795177444815636 | Loss: 0.0078282228205353 | Epoch: 45 | MeanAbsoluteError: 0.0511692613363266 | Loss: 0.0044711743696378 | Epoch: 46 | 
MeanAbsoluteError: 0.0939172431826591 | Loss: 0.0106136690323743 | Epoch: 47 | MeanAbsoluteError: 0.0480749830603600 | Loss: 0.0038044521173176 | Epoch: 48 | MeanAbsoluteError: 0.0467383973300457 | Loss: 0.0033809186962362 | Epoch: 49 | MeanAbsoluteError: 0.0356994308531284 | Loss: 0.0027220089720616 | Epoch: 50 | MeanAbsoluteError: 0.0825988203287125 | Loss: 0.0098765169700178 | Epoch: 51 | MeanAbsoluteError: 0.0468007177114487 | Loss: 0.0039535484482678 | Epoch: 52 | MeanAbsoluteError: 0.0357312448322773 | Loss: 0.0021002918947488 | Epoch: 53 | 
MeanAbsoluteError: 0.0680613145232201 | Loss: 0.0056895202992914 | Epoch: 54 | MeanAbsoluteError: 0.0491696894168854 | Loss: 0.0036241891077505 | Epoch: 55 | MeanAbsoluteError: 0.0558385960757732 | Loss: 0.0045177131855431 | Epoch: 56 | MeanAbsoluteError: 0.0615228228271008 | Loss: 0.0061112605751707 | Epoch: 57 | MeanAbsoluteError: 0.0440432913601398 | Loss: 0.0029847526367610 | Epoch: 58 | MeanAbsoluteError: 0.0342135503888130 | Loss: 0.0019627346146780 | Epoch: 59 | MeanAbsoluteError: 0.0373110994696617 | Loss: 0.0024203596403822 | Epoch: 60 | 
MeanAbsoluteError: 0.0530986264348030 | Loss: 0.0039014423516794 | Epoch: 61 | MeanAbsoluteError: 0.0446447096765041 | Loss: 0.0038982757676142 | Epoch: 62 | MeanAbsoluteError: 0.0528983585536480 | Loss: 0.0042222111593359 | Epoch: 63 | MeanAbsoluteError: 0.1327503621578217 | Loss: 0.0198091412536227 | Epoch: 64 | MeanAbsoluteError: 0.0522558018565178 | Loss: 0.0036042202308846 | Epoch: 65 | MeanAbsoluteError: 0.0984805598855019 | Loss: 0.0174186141230166 | Epoch: 66 | MeanAbsoluteError: 0.0606794245541096 | Loss: 0.0056430668964122 | Epoch: 67 | 
MeanAbsoluteError: 0.0328152403235435 | Loss: 0.0022014245108809 | Epoch: 68 | MeanAbsoluteError: 0.0776986628770828 | Loss: 0.0078078503362261 | Epoch: 69 | MeanAbsoluteError: 0.1149819344282150 | Loss: 0.0146050638017746 | Epoch: 70 | MeanAbsoluteError: 0.0516501218080521 | Loss: 0.0037258737093697 | Epoch: 71 | MeanAbsoluteError: 0.0363251529633999 | Loss: 0.0025411386562225 | Epoch: 72 | MeanAbsoluteError: 0.0294227600097656 | Loss: 0.0014335062072720 | Epoch: 73 | MeanAbsoluteError: 0.0345425605773926 | Loss: 0.0020395618227597 | Epoch: 74 | 
MeanAbsoluteError: 0.0458697937428951 | Loss: 0.0034130381491895 | Epoch: 75 | MeanAbsoluteError: 0.0754340812563896 | Loss: 0.0078438499834962 | Epoch: 76 | MeanAbsoluteError: 0.0581650845706463 | Loss: 0.0074460847312226 | Epoch: 77 | MeanAbsoluteError: 0.0414166152477264 | Loss: 0.0028397941070860 | Epoch: 78 | MeanAbsoluteError: 0.0273252744227648 | Loss: 0.0012625147982572 | Epoch: 79 | MeanAbsoluteError: 0.0694182217121124 | Loss: 0.0063760071330202 | Epoch: 80 | MeanAbsoluteError: 0.0716835707426071 | Loss: 0.0070579476976910 | Epoch: 81 | 
MeanAbsoluteError: 0.0392753146588802 | Loss: 0.0032453901904563 | Epoch: 82 | MeanAbsoluteError: 0.0471986532211304 | Loss: 0.0036775420538526 | Epoch: 83 | MeanAbsoluteError: 0.0931367874145508 | Loss: 0.0116313910469986 | Epoch: 84 | MeanAbsoluteError: 0.0327370651066303 | Loss: 0.0021743080399644 | Epoch: 85 | MeanAbsoluteError: 0.0363047420978546 | Loss: 0.0022032826393395 | Epoch: 86 | MeanAbsoluteError: 0.0401505790650845 | Loss: 0.0030226249588080 | Epoch: 87 | MeanAbsoluteError: 0.0503876954317093 | Loss: 0.0039205040263299 | Epoch: 88 | 
MeanAbsoluteError: 0.0306565109640360 | Loss: 0.0018386916132071 | Epoch: 89 | MeanAbsoluteError: 0.0456584170460701 | Loss: 0.0037333348748059 | Epoch: 90 | MeanAbsoluteError: 0.0401938632130623 | Loss: 0.0029786317609251 | Epoch: 91 | MeanAbsoluteError: 0.0599405467510223 | Loss: 0.0054604032685837 | Epoch: 92 | MeanAbsoluteError: 0.1074244901537895 | Loss: 0.0180577304787361 | Epoch: 93 | MeanAbsoluteError: 0.0514662452042103 | Loss: 0.0040755966015590 | Epoch: 94 | MeanAbsoluteError: 0.0695994794368744 | Loss: 0.0072469654528854 | Epoch: 95 | 
MeanAbsoluteError: 0.0620524846017361 | Loss: 0.0067559777257534 | Epoch: 96 | MeanAbsoluteError: 0.0464168936014175 | Loss: 0.0029141261385610 | Epoch: 97 | MeanAbsoluteError: 0.0311757102608681 | Loss: 0.0020662491039660 | Epoch: 98 | MeanAbsoluteError: 0.0431643910706043 | Loss: 0.0030869929603516 | Epoch: 99 | MeanAbsoluteError: 0.0330915935337543 | Loss: 0.0021826436187929 | Epoch: 100 | MeanAbsoluteError: 0.0534563250839710 | Loss: 0.0043837360572070 | Epoch: 101 | MeanAbsoluteError: 0.0863939747214317 | Loss: 0.0098313336403897 | Epoch: 102 | 
MeanAbsoluteError: 0.0367822423577309 | Loss: 0.0026293069733163 | Epoch: 103 | MeanAbsoluteError: 0.0497808158397675 | Loss: 0.0035396686289459 | Epoch: 104 | MeanAbsoluteError: 0.0475022122263908 | Loss: 0.0036288069632764 | Epoch: 105 | MeanAbsoluteError: 0.0517992414534092 | Loss: 0.0035280935251369 | Epoch: 106 | MeanAbsoluteError: 0.0411145687103271 | Loss: 0.0024386468934468 | Epoch: 107 | MeanAbsoluteError: 0.0370441675186157 | Loss: 0.0030287181927214 | Epoch: 108 | MeanAbsoluteError: 0.0533891618251801 | Loss: 0.0043097678571939 | Epoch: 109 | 
MeanAbsoluteError: 0.0537219382822514 | Loss: 0.0037879354338377 | Epoch: 110 | MeanAbsoluteError: 0.0482608079910278 | Loss: 0.0038966137642721 | Early stopping at epoch 109
metric_name = type(fun_control["metric_torch"]).__name__
print(f"loss: {df_eval}, Cross-validated {metric_name}: {df_metrics}")
loss: 0.004482360068113149, Cross-validated MeanAbsoluteError: 0.05283092334866524

19.10.4 Detailed Hyperparameter Plots

filename = "./figures/" + experiment_name
spot_tuner.plot_important_hyperparameter_contour(filename=filename)
l1:  1.9598804142045072
dropout_prob:  18.295338146878894
lr_mult:  100.0
epochs:  19.311691219714838
patience:  0.4683162391697677
optimizer:  46.54783189471269

Contour plots.

19.10.5 Parallel Coordinates Plot

spot_tuner.parallel_plot()

Parallel coordinates plots

19.11 Summary and Outlook

This tutorial presents the hyperparameter tuning open source software spotPython for PyTorch. Some of the advantages of spotPython are:

  • Numerical and categorical hyperparameters.
  • Powerful surrogate models.
  • Flexible approach and easy to use.
  • Simple JSON files for the specification of the hyperparameters.
  • Extension of default and user specified network classes.
  • Noise handling techniques.
  • Online visualization of the hyperparameter tuning process with tensorboard.

Currently, only rudimentary parallel and distributed neural network training is possible, but these capabilities will be extended in the future. The next version of spotPython will also include a more detailed documentation and more examples.

Important

Important: This tutorial does not present a complete benchmarking study (Bartz-Beielstein et al. 2020). The results are only preliminary and highly dependent on the local configuration (hard- and software). Our goal is to provide a first impression of the performance of the hyperparameter tuning package spotPython. The results should be interpreted with care.