Chris Ferrie
This is an open peer review of arxiv:1703.10743, Generating 3 qubit quantum circuits with neural networks by Michael Swaddle et al.
TO JOURNAL EDITORS: You are free to use the contents of the repository as you see fit.
DISCLAIMER: A referee necessarily spends far less time than the authors on the paper. As such, this report surely contains errors. I would love for you to point them out so I can correct them. Otherwise, this report is provided without warranty of any kind, including its suitability as a resource for making decisions affecting the career of the authors of the paper.
Highly recommended read for its accessibility and reproducibility, but lacks the analysis to live up to its claims. #workinprogress
The authors seem to define quantum compilation the same way I would define quantum control. Namely, given a set of control Hamiltonians, design the interaction strength to generate a target unitary. The standard approach—as far as I understand—is a numerical gradient-based optimization using classical simulation to evaluate the objective function. The authors propose the following two-step alternative:
The authors achieve this to some extend by training a neural network with simulated trajectories. Though, as I outline below, much more analysis is required to warrant suggesting this as a viable alternative to traditional methods. Though they did not emphasize it, I see the provided code and data as the most valuable research output.
Given I was able to reproduce the results, I have no doubt the results obtained are correct. I do have some concerns, though, in the relevance of the result to quantum control:
The paper is quite short, but not necessarily dense. I am neither an expert in geometric quantum nor the architecture of neural networks—yet, I was able to quickly grasp the main idea of the paper. That being said, there were a few points which I got hung up on.
Relative to other research in quantum information theory, this work gets top marks for reproducibility. However... given the author's eagerness to go above and beyond what is expected in a physics paper, I'm going to make some further suggestions for improvement in the hopes that the reproducibility aspect is more transparent.
The code is not well organized or documented. Since it is quite minimal and I had some basic knowledge in the software used, I was able to figure out how it works. But, I doubt most of the target audience of this paper could make use of it. Indeed, I immediately ran into errors when attempting to run the code, making the saved trained model useless to me. To be fair, I did not attempt to contact the authors about this since—as the authors themselves point out—the model can be trained quite quickly on a reasonable GPU (as you will see below).
The data was generated with separate software—Mathematica. I do not have a Mathematica license so did not attempt to reproduce the data. Given the authors were already using numpy, it would have been straightforward to generate the data in python as well.
I think here is where the paper falls short. The analysis of the results of the network training are not subjected to any anaylsis beyond plotting the results. Crucially(!):
The authors provided the code to generate the data, the data themselves, the code to train the network, and the trained network! Indeed, if I was so inclined, I could immediately build on their work without any uncertainty and this is far more than I can say for anything else I've read recently on quant-ph. This is an immensely impressive effort in a field which neither rewards or encourages it. The standard approach to publishing is to obscure your result to the point of either not being about to reproduce it, or give yourself plausible deniability should it be wrong. I applaud the authors for their bravery in exposing their work for detailed criticism.
I see this as a (very useful!) set of lab notes rather than a complete scientific result because of the lack of comparisons to existing methods and variations in the proposed method. More analysis and discussion of the results is required.
The code here is derived from the source provided by the authors at https://github.com/Swaddle/nnQcompiler.
I have also used the data provided by the authors at https://github.com/Swaddle/nnQcompiler.
I had a bit of trouble with various versions and their respective compatability under Python 3:
Python 3.5.2 |Anaconda custom (64-bit)| (default, Jul 2 2016, 17:53:06)
[GCC 4.4.7 20120313 (Red Hat 4.4.7-1)] on linux
With the Anaconda distribution above, I download Keras version 1.2.2 and ran:
pip install tensorflow
pip install Keras-1.2.2.tar.gz
I hacked up some minimal changes and moved most of the code into this single notebook for convenience.
%matplotlib inline
import matplotlib.pyplot as plt
plt.style.use('ggplot')
from data_utils import load_data_lstm, load_data_ss
from keras.models import Sequential
from keras.metrics import mean_squared_error
from keras.layers import Dense, Dropout, Flatten
from keras.layers.recurrent import GRU
from keras.layers.convolutional import Conv1D
from keras.layers.convolutional import ZeroPadding1D
from keras.callbacks import CSVLogger
from tensorflow.python.ops import control_flow_ops
from keras.callbacks import ModelCheckpoint, EarlyStopping
import tensorflow as tf
Using TensorFlow backend.
The authors use the squared error as an objective. While standard in many network training problems, it is unclear what it's operational meaning is here.
def custom_objective(y_true, y_pred):
tensor = y_true - y_pred
squares = tf.square(tensor)
norm = tf.reduce_sum(squares)
return norm
The authors already nicely split the training and validation data, so we just load that up.
training_data_path = 'data/lstm_data_training.csv'
valid_data_path = 'data/lstm_data_valid.csv'
train_input, train_output = load_data_lstm(training_data_path)
valid_input, valid_output = load_data_lstm(valid_data_path)
This seems like black magic to me and is worth playing with, but it defines the architecture of the network.
model = Sequential()
model.add(GRU(80, return_sequences=True, input_shape=(8,8)))
model.add(Dropout(0.2))
model.add(GRU(80, return_sequences=True))
model.add(Dropout(0.2))
model.add(GRU(80, return_sequences=True))
model.add(Dropout(0.2))
model.add(GRU(80, return_sequences=True))
model.add(Dropout(0.2))
model.add(GRU(80, return_sequences=True))
model.add(Dropout(0.2))
model.add(GRU(80, return_sequences=True))
model.add(Dropout(0.2))
model.add(Flatten())
model.add(Dense(input_dim=640,output_dim=640))
#model.summary()
Now we train that sucker!
%%time
model.compile(optimizer='Nadam',loss=custom_objective)
history = model.fit(train_input, train_output, validation_data=(valid_input,valid_output), nb_epoch=1000, batch_size=64)
Train on 1000 samples, validate on 100 samples Epoch 1/1000 1000/1000 [==============================] - 1s - loss: 1655.0847 - val_loss: 34.2073 Epoch 2/1000 1000/1000 [==============================] - 0s - loss: 316.0393 - val_loss: 18.3714 Epoch 3/1000 1000/1000 [==============================] - 0s - loss: 169.6186 - val_loss: 16.4331 Epoch 4/1000 1000/1000 [==============================] - 0s - loss: 93.3592 - val_loss: 10.5343 Epoch 5/1000 1000/1000 [==============================] - 0s - loss: 108.5998 - val_loss: 11.2147 Epoch 6/1000 1000/1000 [==============================] - 0s - loss: 62.0827 - val_loss: 10.4611 Epoch 7/1000 1000/1000 [==============================] - 0s - loss: 52.4477 - val_loss: 9.0723 Epoch 8/1000 1000/1000 [==============================] - 0s - loss: 77.2306 - val_loss: 12.8944 Epoch 9/1000 1000/1000 [==============================] - 0s - loss: 42.5482 - val_loss: 8.8110 Epoch 10/1000 1000/1000 [==============================] - 0s - loss: 45.2898 - val_loss: 9.0821 Epoch 11/1000 1000/1000 [==============================] - 0s - loss: 35.5967 - val_loss: 8.2457 Epoch 12/1000 1000/1000 [==============================] - 0s - loss: 46.2576 - val_loss: 8.5135 Epoch 13/1000 1000/1000 [==============================] - 0s - loss: 31.4348 - val_loss: 8.2321 Epoch 14/1000 1000/1000 [==============================] - 0s - loss: 28.9892 - val_loss: 8.0690 Epoch 15/1000 1000/1000 [==============================] - 0s - loss: 29.3194 - val_loss: 8.7529 Epoch 16/1000 1000/1000 [==============================] - 0s - loss: 26.0391 - val_loss: 7.7710 Epoch 17/1000 1000/1000 [==============================] - 0s - loss: 25.8025 - val_loss: 8.8804 Epoch 18/1000 1000/1000 [==============================] - 0s - loss: 51.3100 - val_loss: 7.3290 Epoch 19/1000 1000/1000 [==============================] - 0s - loss: 23.0907 - val_loss: 7.4554 Epoch 20/1000 1000/1000 [==============================] - 0s - loss: 21.8436 - val_loss: 6.9894 Epoch 21/1000 1000/1000 [==============================] - 0s - loss: 23.8127 - val_loss: 7.3371 Epoch 22/1000 1000/1000 [==============================] - 0s - loss: 20.6293 - val_loss: 7.0844 Epoch 23/1000 1000/1000 [==============================] - 0s - loss: 21.2581 - val_loss: 7.1833 Epoch 24/1000 1000/1000 [==============================] - 0s - loss: 21.8342 - val_loss: 7.2273 Epoch 25/1000 1000/1000 [==============================] - 0s - loss: 23.4267 - val_loss: 7.1940 Epoch 26/1000 1000/1000 [==============================] - 0s - loss: 24.7397 - val_loss: 6.7745 Epoch 27/1000 1000/1000 [==============================] - 0s - loss: 17.8136 - val_loss: 6.6896 Epoch 28/1000 1000/1000 [==============================] - 0s - loss: 19.7745 - val_loss: 6.5086 Epoch 29/1000 1000/1000 [==============================] - 0s - loss: 17.7195 - val_loss: 6.2366 Epoch 30/1000 1000/1000 [==============================] - 0s - loss: 18.8222 - val_loss: 6.3709 Epoch 31/1000 1000/1000 [==============================] - 0s - loss: 16.8897 - val_loss: 6.5695 Epoch 32/1000 1000/1000 [==============================] - 0s - loss: 18.6408 - val_loss: 6.4200 Epoch 33/1000 1000/1000 [==============================] - 0s - loss: 16.2138 - val_loss: 6.0732 Epoch 34/1000 1000/1000 [==============================] - 0s - loss: 15.6626 - val_loss: 5.9461 Epoch 35/1000 1000/1000 [==============================] - 0s - loss: 16.1931 - val_loss: 6.1901 Epoch 36/1000 1000/1000 [==============================] - 0s - loss: 19.7903 - val_loss: 6.0741 Epoch 37/1000 1000/1000 [==============================] - 0s - loss: 19.6402 - val_loss: 5.9941 Epoch 38/1000 1000/1000 [==============================] - 0s - loss: 14.7746 - val_loss: 5.8172 Epoch 39/1000 1000/1000 [==============================] - 0s - loss: 14.3934 - val_loss: 5.7385 Epoch 40/1000 1000/1000 [==============================] - 0s - loss: 20.1974 - val_loss: 6.0071 Epoch 41/1000 1000/1000 [==============================] - 0s - loss: 14.9444 - val_loss: 6.2999 Epoch 42/1000 1000/1000 [==============================] - 0s - loss: 13.6593 - val_loss: 5.6227 Epoch 43/1000 1000/1000 [==============================] - 0s - loss: 14.2644 - val_loss: 5.7975 Epoch 44/1000 1000/1000 [==============================] - 0s - loss: 15.8589 - val_loss: 6.4562 Epoch 45/1000 1000/1000 [==============================] - 0s - loss: 13.7538 - val_loss: 5.5583 Epoch 46/1000 1000/1000 [==============================] - 0s - loss: 16.9502 - val_loss: 6.1578 Epoch 47/1000 1000/1000 [==============================] - 0s - loss: 13.3041 - val_loss: 5.3534 Epoch 48/1000 1000/1000 [==============================] - 0s - loss: 15.2560 - val_loss: 5.6836 Epoch 49/1000 1000/1000 [==============================] - 0s - loss: 13.5695 - val_loss: 5.2710 Epoch 50/1000 1000/1000 [==============================] - 0s - loss: 13.0860 - val_loss: 5.2635 Epoch 51/1000 1000/1000 [==============================] - 0s - loss: 15.1462 - val_loss: 5.2328 Epoch 52/1000 1000/1000 [==============================] - 0s - loss: 13.6565 - val_loss: 5.3323 Epoch 53/1000 1000/1000 [==============================] - 0s - loss: 14.1215 - val_loss: 5.1675 Epoch 54/1000 1000/1000 [==============================] - 0s - loss: 12.0265 - val_loss: 4.9756 Epoch 55/1000 1000/1000 [==============================] - 0s - loss: 12.4859 - val_loss: 5.0503 Epoch 56/1000 1000/1000 [==============================] - 0s - loss: 11.9864 - val_loss: 4.9412 Epoch 57/1000 1000/1000 [==============================] - 0s - loss: 11.7923 - val_loss: 4.9105 Epoch 58/1000 1000/1000 [==============================] - 0s - loss: 12.6661 - val_loss: 4.8659 Epoch 59/1000 1000/1000 [==============================] - 0s - loss: 11.8572 - val_loss: 4.9905 Epoch 60/1000 1000/1000 [==============================] - 0s - loss: 13.1981 - val_loss: 5.1625 Epoch 61/1000 1000/1000 [==============================] - 0s - loss: 14.4236 - val_loss: 4.9859 Epoch 62/1000 1000/1000 [==============================] - 0s - loss: 11.4187 - val_loss: 5.0602 Epoch 63/1000 1000/1000 [==============================] - 0s - loss: 13.2030 - val_loss: 4.8664 Epoch 64/1000 1000/1000 [==============================] - 0s - loss: 12.3580 - val_loss: 4.7044 Epoch 65/1000 1000/1000 [==============================] - 0s - loss: 11.7380 - val_loss: 4.5651 Epoch 66/1000 1000/1000 [==============================] - 0s - loss: 13.3998 - val_loss: 4.8031 Epoch 67/1000 1000/1000 [==============================] - 0s - loss: 12.8522 - val_loss: 4.5214 Epoch 68/1000 1000/1000 [==============================] - 0s - loss: 10.7382 - val_loss: 4.5601 Epoch 69/1000 1000/1000 [==============================] - 0s - loss: 12.3455 - val_loss: 4.5410 Epoch 70/1000 1000/1000 [==============================] - 0s - loss: 11.8252 - val_loss: 4.5446 Epoch 71/1000 1000/1000 [==============================] - 0s - loss: 11.1937 - val_loss: 4.5946 Epoch 72/1000 1000/1000 [==============================] - 0s - loss: 10.6099 - val_loss: 4.5330 Epoch 73/1000 1000/1000 [==============================] - 0s - loss: 10.8846 - val_loss: 4.4979 Epoch 74/1000 1000/1000 [==============================] - 0s - loss: 10.4041 - val_loss: 4.4830 Epoch 75/1000 1000/1000 [==============================] - 0s - loss: 11.5117 - val_loss: 4.5468 Epoch 76/1000 1000/1000 [==============================] - 0s - loss: 11.3887 - val_loss: 4.8771 Epoch 77/1000 1000/1000 [==============================] - 0s - loss: 10.8172 - val_loss: 5.7137 Epoch 78/1000 1000/1000 [==============================] - 0s - loss: 10.7837 - val_loss: 4.1909 Epoch 79/1000 1000/1000 [==============================] - 0s - loss: 12.2569 - val_loss: 5.9973 Epoch 80/1000 1000/1000 [==============================] - 0s - loss: 12.9323 - val_loss: 4.3936 Epoch 81/1000 1000/1000 [==============================] - 0s - loss: 11.2098 - val_loss: 4.1748 Epoch 82/1000 1000/1000 [==============================] - 0s - loss: 10.3625 - val_loss: 4.2554 Epoch 83/1000 1000/1000 [==============================] - 0s - loss: 11.0963 - val_loss: 4.2596 Epoch 84/1000 1000/1000 [==============================] - 0s - loss: 10.0053 - val_loss: 4.1061 Epoch 85/1000 1000/1000 [==============================] - 0s - loss: 11.0152 - val_loss: 4.5238 Epoch 86/1000 1000/1000 [==============================] - 0s - loss: 11.0763 - val_loss: 3.9531 Epoch 87/1000 1000/1000 [==============================] - 0s - loss: 9.9096 - val_loss: 4.1221 Epoch 88/1000 1000/1000 [==============================] - 0s - loss: 10.2488 - val_loss: 3.9117 Epoch 89/1000 1000/1000 [==============================] - 0s - loss: 10.5618 - val_loss: 3.9093 Epoch 90/1000 1000/1000 [==============================] - 0s - loss: 10.1431 - val_loss: 4.1418 Epoch 91/1000 1000/1000 [==============================] - 0s - loss: 10.0329 - val_loss: 3.8906 Epoch 92/1000 1000/1000 [==============================] - 0s - loss: 9.6519 - val_loss: 4.2325 Epoch 93/1000 1000/1000 [==============================] - 0s - loss: 9.8501 - val_loss: 3.8506 Epoch 94/1000 1000/1000 [==============================] - 0s - loss: 10.5886 - val_loss: 4.0437 Epoch 95/1000 1000/1000 [==============================] - 0s - loss: 10.4563 - val_loss: 3.9303 Epoch 96/1000 1000/1000 [==============================] - 0s - loss: 10.4780 - val_loss: 3.7307 Epoch 97/1000 1000/1000 [==============================] - 0s - loss: 10.3165 - val_loss: 3.7491 Epoch 98/1000 1000/1000 [==============================] - 0s - loss: 10.4377 - val_loss: 3.7697 Epoch 99/1000 1000/1000 [==============================] - 0s - loss: 9.6351 - val_loss: 3.8461 Epoch 100/1000 1000/1000 [==============================] - 0s - loss: 8.9137 - val_loss: 3.6934 Epoch 101/1000 1000/1000 [==============================] - 0s - loss: 9.4236 - val_loss: 3.9148 Epoch 102/1000 1000/1000 [==============================] - 0s - loss: 9.3758 - val_loss: 3.5260 Epoch 103/1000 1000/1000 [==============================] - 0s - loss: 9.9851 - val_loss: 3.6144 Epoch 104/1000 1000/1000 [==============================] - 0s - loss: 9.8013 - val_loss: 3.7855 Epoch 105/1000 1000/1000 [==============================] - 0s - loss: 10.5989 - val_loss: 3.5723 Epoch 106/1000 1000/1000 [==============================] - 0s - loss: 8.4604 - val_loss: 3.4867 Epoch 107/1000 1000/1000 [==============================] - 0s - loss: 9.1778 - val_loss: 3.5283 Epoch 108/1000 1000/1000 [==============================] - 0s - loss: 8.8627 - val_loss: 3.5240 Epoch 109/1000 1000/1000 [==============================] - 0s - loss: 8.8417 - val_loss: 3.4189 Epoch 110/1000 1000/1000 [==============================] - 0s - loss: 9.6607 - val_loss: 3.5599 Epoch 111/1000 1000/1000 [==============================] - 0s - loss: 9.0176 - val_loss: 3.2983 Epoch 112/1000 1000/1000 [==============================] - 0s - loss: 11.3471 - val_loss: 3.2506 Epoch 113/1000 1000/1000 [==============================] - 0s - loss: 8.5091 - val_loss: 3.6389 Epoch 114/1000 1000/1000 [==============================] - 0s - loss: 9.9849 - val_loss: 3.2931 Epoch 115/1000 1000/1000 [==============================] - 0s - loss: 8.2165 - val_loss: 3.2461 Epoch 116/1000 1000/1000 [==============================] - 0s - loss: 8.1490 - val_loss: 3.2328 Epoch 117/1000 1000/1000 [==============================] - 0s - loss: 8.7013 - val_loss: 3.2242 Epoch 118/1000 1000/1000 [==============================] - 0s - loss: 8.1500 - val_loss: 3.2025 Epoch 119/1000 1000/1000 [==============================] - 0s - loss: 8.6589 - val_loss: 3.1866 Epoch 120/1000 1000/1000 [==============================] - 0s - loss: 8.0517 - val_loss: 3.2678 Epoch 121/1000 1000/1000 [==============================] - 0s - loss: 9.9382 - val_loss: 3.0484 Epoch 122/1000 1000/1000 [==============================] - 0s - loss: 8.1925 - val_loss: 3.6015 Epoch 123/1000 1000/1000 [==============================] - 0s - loss: 7.8880 - val_loss: 3.0268 Epoch 124/1000 1000/1000 [==============================] - 0s - loss: 7.7847 - val_loss: 2.9976 Epoch 125/1000 1000/1000 [==============================] - 0s - loss: 8.0426 - val_loss: 3.0957 Epoch 126/1000 1000/1000 [==============================] - 0s - loss: 9.6018 - val_loss: 3.3405 Epoch 127/1000 1000/1000 [==============================] - 0s - loss: 10.0551 - val_loss: 2.9933 Epoch 128/1000 1000/1000 [==============================] - 0s - loss: 8.9692 - val_loss: 3.0649 Epoch 129/1000 1000/1000 [==============================] - 0s - loss: 7.8450 - val_loss: 3.2537 Epoch 130/1000 1000/1000 [==============================] - 0s - loss: 7.8751 - val_loss: 3.0356 Epoch 131/1000 1000/1000 [==============================] - 0s - loss: 7.7737 - val_loss: 2.8974 Epoch 132/1000 1000/1000 [==============================] - 0s - loss: 7.4117 - val_loss: 3.0712 Epoch 133/1000 1000/1000 [==============================] - 0s - loss: 7.4516 - val_loss: 2.8255 Epoch 134/1000 1000/1000 [==============================] - 0s - loss: 7.3018 - val_loss: 2.7697 Epoch 135/1000 1000/1000 [==============================] - 0s - loss: 8.1295 - val_loss: 2.8746 Epoch 136/1000 1000/1000 [==============================] - 0s - loss: 7.3559 - val_loss: 3.1144 Epoch 137/1000 1000/1000 [==============================] - 0s - loss: 10.0260 - val_loss: 2.7372 Epoch 138/1000 1000/1000 [==============================] - 0s - loss: 7.3145 - val_loss: 2.7843 Epoch 139/1000 1000/1000 [==============================] - 0s - loss: 7.2526 - val_loss: 2.7655 Epoch 140/1000 1000/1000 [==============================] - 0s - loss: 8.5104 - val_loss: 3.1060 Epoch 141/1000 1000/1000 [==============================] - 0s - loss: 9.8544 - val_loss: 2.8281 Epoch 142/1000 1000/1000 [==============================] - 0s - loss: 8.0390 - val_loss: 3.1103 Epoch 143/1000 1000/1000 [==============================] - 0s - loss: 7.3997 - val_loss: 2.7757 Epoch 144/1000 1000/1000 [==============================] - 0s - loss: 9.0054 - val_loss: 2.6026 Epoch 145/1000 1000/1000 [==============================] - 0s - loss: 7.8805 - val_loss: 2.6176 Epoch 146/1000 1000/1000 [==============================] - 0s - loss: 7.4475 - val_loss: 2.6153 Epoch 147/1000 1000/1000 [==============================] - 0s - loss: 7.5694 - val_loss: 2.6343 Epoch 148/1000 1000/1000 [==============================] - 0s - loss: 7.4845 - val_loss: 2.9744 Epoch 149/1000 1000/1000 [==============================] - 0s - loss: 7.7331 - val_loss: 3.3107 Epoch 150/1000 1000/1000 [==============================] - 0s - loss: 7.8300 - val_loss: 2.5236 Epoch 151/1000 1000/1000 [==============================] - 0s - loss: 6.9689 - val_loss: 2.7710 Epoch 152/1000 1000/1000 [==============================] - 0s - loss: 7.3094 - val_loss: 2.5098 Epoch 153/1000 1000/1000 [==============================] - 0s - loss: 7.0811 - val_loss: 2.4889 Epoch 154/1000 1000/1000 [==============================] - 0s - loss: 7.2483 - val_loss: 2.9621 Epoch 155/1000 1000/1000 [==============================] - 0s - loss: 7.5195 - val_loss: 2.6031 Epoch 156/1000 1000/1000 [==============================] - 0s - loss: 7.8160 - val_loss: 2.6751 Epoch 157/1000 1000/1000 [==============================] - 0s - loss: 7.1482 - val_loss: 2.4909 Epoch 158/1000 1000/1000 [==============================] - 0s - loss: 6.8342 - val_loss: 2.4545 Epoch 159/1000 1000/1000 [==============================] - 0s - loss: 6.6638 - val_loss: 2.7457 Epoch 160/1000 1000/1000 [==============================] - 0s - loss: 6.6214 - val_loss: 2.4069 Epoch 161/1000 1000/1000 [==============================] - 0s - loss: 6.9068 - val_loss: 2.4132 Epoch 162/1000 1000/1000 [==============================] - 0s - loss: 7.1494 - val_loss: 2.5891 Epoch 163/1000 1000/1000 [==============================] - 0s - loss: 7.0298 - val_loss: 2.4025 Epoch 164/1000 1000/1000 [==============================] - 0s - loss: 6.5123 - val_loss: 2.4034 Epoch 165/1000 1000/1000 [==============================] - 0s - loss: 7.0316 - val_loss: 2.4386 Epoch 166/1000 1000/1000 [==============================] - 0s - loss: 6.7394 - val_loss: 2.4985 Epoch 167/1000 1000/1000 [==============================] - 0s - loss: 7.5645 - val_loss: 2.6433 Epoch 168/1000 1000/1000 [==============================] - 0s - loss: 6.3952 - val_loss: 2.3639 Epoch 169/1000 1000/1000 [==============================] - 0s - loss: 8.1023 - val_loss: 2.3782 Epoch 170/1000 1000/1000 [==============================] - 0s - loss: 7.2586 - val_loss: 2.3079 Epoch 171/1000 1000/1000 [==============================] - 0s - loss: 6.2499 - val_loss: 2.3738 Epoch 172/1000 1000/1000 [==============================] - 0s - loss: 6.4738 - val_loss: 2.3307 Epoch 173/1000 1000/1000 [==============================] - 0s - loss: 7.8482 - val_loss: 2.2793 Epoch 174/1000 1000/1000 [==============================] - 0s - loss: 6.6046 - val_loss: 2.3429 Epoch 175/1000 1000/1000 [==============================] - 0s - loss: 6.7245 - val_loss: 2.5309 Epoch 176/1000 1000/1000 [==============================] - 0s - loss: 6.8677 - val_loss: 2.5061 Epoch 177/1000 1000/1000 [==============================] - 0s - loss: 6.6059 - val_loss: 2.4307 Epoch 178/1000 1000/1000 [==============================] - 0s - loss: 7.4489 - val_loss: 2.3128 Epoch 179/1000 1000/1000 [==============================] - 0s - loss: 6.5029 - val_loss: 2.2662 Epoch 180/1000 1000/1000 [==============================] - 0s - loss: 6.8496 - val_loss: 2.2336 Epoch 181/1000 1000/1000 [==============================] - 0s - loss: 7.1255 - val_loss: 2.4665 Epoch 182/1000 1000/1000 [==============================] - 0s - loss: 7.3895 - val_loss: 2.3385 Epoch 183/1000 1000/1000 [==============================] - 0s - loss: 6.3442 - val_loss: 2.1800 Epoch 184/1000 1000/1000 [==============================] - 0s - loss: 8.0593 - val_loss: 2.3639 Epoch 185/1000 1000/1000 [==============================] - 0s - loss: 6.3882 - val_loss: 2.4444 Epoch 186/1000 1000/1000 [==============================] - 0s - loss: 6.0669 - val_loss: 2.1786 Epoch 187/1000 1000/1000 [==============================] - 0s - loss: 7.0835 - val_loss: 2.2344 Epoch 188/1000 1000/1000 [==============================] - 0s - loss: 6.2458 - val_loss: 2.2061 Epoch 189/1000 1000/1000 [==============================] - 0s - loss: 6.3769 - val_loss: 2.1706 Epoch 190/1000 1000/1000 [==============================] - 0s - loss: 6.2216 - val_loss: 2.3522 Epoch 191/1000 1000/1000 [==============================] - 0s - loss: 8.3435 - val_loss: 2.1435 Epoch 192/1000 1000/1000 [==============================] - 0s - loss: 6.4731 - val_loss: 2.1934 Epoch 193/1000 1000/1000 [==============================] - 0s - loss: 6.5095 - val_loss: 2.1055 Epoch 194/1000 1000/1000 [==============================] - 0s - loss: 6.1363 - val_loss: 2.1520 Epoch 195/1000 1000/1000 [==============================] - 0s - loss: 6.5666 - val_loss: 2.0857 Epoch 196/1000 1000/1000 [==============================] - 0s - loss: 6.3837 - val_loss: 2.1154 Epoch 197/1000 1000/1000 [==============================] - 0s - loss: 6.2844 - val_loss: 2.1702 Epoch 198/1000 1000/1000 [==============================] - 0s - loss: 6.1259 - val_loss: 2.1339 Epoch 199/1000 1000/1000 [==============================] - 0s - loss: 6.1919 - val_loss: 2.4377 Epoch 200/1000 1000/1000 [==============================] - 0s - loss: 5.9413 - val_loss: 2.1181 Epoch 201/1000 1000/1000 [==============================] - 0s - loss: 6.0681 - val_loss: 2.0634 Epoch 202/1000 1000/1000 [==============================] - 0s - loss: 6.6244 - val_loss: 2.1205 Epoch 203/1000 1000/1000 [==============================] - 0s - loss: 6.9179 - val_loss: 2.0735 Epoch 204/1000 1000/1000 [==============================] - 0s - loss: 5.6048 - val_loss: 2.0652 Epoch 205/1000 1000/1000 [==============================] - 0s - loss: 5.7305 - val_loss: 2.2187 Epoch 206/1000 1000/1000 [==============================] - 0s - loss: 5.6804 - val_loss: 2.2179 Epoch 207/1000 1000/1000 [==============================] - 0s - loss: 7.6614 - val_loss: 1.9880 Epoch 208/1000 1000/1000 [==============================] - 0s - loss: 5.8762 - val_loss: 2.0525 Epoch 209/1000 1000/1000 [==============================] - 0s - loss: 6.6974 - val_loss: 2.3841 Epoch 210/1000 1000/1000 [==============================] - 0s - loss: 5.9831 - val_loss: 2.0043 Epoch 211/1000 1000/1000 [==============================] - 0s - loss: 5.6536 - val_loss: 2.0169 Epoch 212/1000 1000/1000 [==============================] - 0s - loss: 5.6771 - val_loss: 2.0057 Epoch 213/1000 1000/1000 [==============================] - 0s - loss: 5.6785 - val_loss: 2.0814 Epoch 214/1000 1000/1000 [==============================] - 0s - loss: 5.7123 - val_loss: 2.0297 Epoch 215/1000 1000/1000 [==============================] - 0s - loss: 5.6266 - val_loss: 1.9371 Epoch 216/1000 1000/1000 [==============================] - 0s - loss: 6.7549 - val_loss: 2.1114 Epoch 217/1000 1000/1000 [==============================] - 0s - loss: 6.2603 - val_loss: 2.1500 Epoch 218/1000 1000/1000 [==============================] - 0s - loss: 5.2277 - val_loss: 2.1217 Epoch 219/1000 1000/1000 [==============================] - 0s - loss: 6.1739 - val_loss: 2.0610 Epoch 220/1000 1000/1000 [==============================] - 0s - loss: 5.7409 - val_loss: 1.9607 Epoch 221/1000 1000/1000 [==============================] - 0s - loss: 5.9125 - val_loss: 2.0878 Epoch 222/1000 1000/1000 [==============================] - 0s - loss: 5.8615 - val_loss: 1.8960 Epoch 223/1000 1000/1000 [==============================] - 0s - loss: 5.6380 - val_loss: 1.9474 Epoch 224/1000 1000/1000 [==============================] - 0s - loss: 5.3909 - val_loss: 2.0236 Epoch 225/1000 1000/1000 [==============================] - 0s - loss: 6.2307 - val_loss: 2.0363 Epoch 226/1000 1000/1000 [==============================] - 0s - loss: 5.5323 - val_loss: 1.9243 Epoch 227/1000 1000/1000 [==============================] - 0s - loss: 5.2446 - val_loss: 2.0454 Epoch 228/1000 1000/1000 [==============================] - 0s - loss: 5.2465 - val_loss: 1.9682 Epoch 229/1000 1000/1000 [==============================] - 0s - loss: 5.6833 - val_loss: 1.9508 Epoch 230/1000 1000/1000 [==============================] - 0s - loss: 5.6755 - val_loss: 1.9418 Epoch 231/1000 1000/1000 [==============================] - 0s - loss: 5.2985 - val_loss: 1.8312 Epoch 232/1000 1000/1000 [==============================] - 0s - loss: 6.3471 - val_loss: 2.1082 Epoch 233/1000 1000/1000 [==============================] - 0s - loss: 5.5699 - val_loss: 2.1104 Epoch 234/1000 1000/1000 [==============================] - 0s - loss: 5.5562 - val_loss: 1.9223 Epoch 235/1000 1000/1000 [==============================] - 0s - loss: 5.9781 - val_loss: 1.9168 Epoch 236/1000 1000/1000 [==============================] - 0s - loss: 5.6107 - val_loss: 1.9031 Epoch 237/1000 1000/1000 [==============================] - 0s - loss: 5.3896 - val_loss: 1.9107 Epoch 238/1000 1000/1000 [==============================] - 0s - loss: 5.6402 - val_loss: 1.8551 Epoch 239/1000 1000/1000 [==============================] - 0s - loss: 5.1569 - val_loss: 1.7963 Epoch 240/1000 1000/1000 [==============================] - 0s - loss: 5.7049 - val_loss: 2.1162 Epoch 241/1000 1000/1000 [==============================] - 0s - loss: 5.1619 - val_loss: 1.9521 Epoch 242/1000 1000/1000 [==============================] - 0s - loss: 5.2456 - val_loss: 2.0414 Epoch 243/1000 1000/1000 [==============================] - 0s - loss: 5.9072 - val_loss: 2.0580 Epoch 244/1000 1000/1000 [==============================] - 0s - loss: 5.1494 - val_loss: 2.0610 Epoch 245/1000 1000/1000 [==============================] - 0s - loss: 5.0562 - val_loss: 1.8547 Epoch 246/1000 1000/1000 [==============================] - 0s - loss: 5.8364 - val_loss: 1.8358 Epoch 247/1000 1000/1000 [==============================] - 0s - loss: 4.9335 - val_loss: 1.8223 Epoch 248/1000 1000/1000 [==============================] - 0s - loss: 7.4502 - val_loss: 1.9656 Epoch 249/1000 1000/1000 [==============================] - 0s - loss: 4.8748 - val_loss: 1.7496 Epoch 250/1000 1000/1000 [==============================] - 0s - loss: 4.8132 - val_loss: 1.8237 Epoch 251/1000 1000/1000 [==============================] - 0s - loss: 4.9389 - val_loss: 1.7756 Epoch 252/1000 1000/1000 [==============================] - 0s - loss: 5.1955 - val_loss: 1.8212 Epoch 253/1000 1000/1000 [==============================] - 0s - loss: 5.0690 - val_loss: 1.8822 Epoch 254/1000 1000/1000 [==============================] - 0s - loss: 4.8552 - val_loss: 1.7645 Epoch 255/1000 1000/1000 [==============================] - 0s - loss: 5.2078 - val_loss: 1.7511 Epoch 256/1000 1000/1000 [==============================] - 0s - loss: 4.8711 - val_loss: 1.8794 Epoch 257/1000 1000/1000 [==============================] - 0s - loss: 5.6251 - val_loss: 1.9501 Epoch 258/1000 1000/1000 [==============================] - 0s - loss: 4.8966 - val_loss: 1.8802 Epoch 259/1000 1000/1000 [==============================] - 0s - loss: 5.1593 - val_loss: 1.8005 Epoch 260/1000 1000/1000 [==============================] - 0s - loss: 4.7745 - val_loss: 1.8009 Epoch 261/1000 1000/1000 [==============================] - 0s - loss: 5.0862 - val_loss: 1.7933 Epoch 262/1000 1000/1000 [==============================] - 0s - loss: 5.0474 - val_loss: 1.8494 Epoch 263/1000 1000/1000 [==============================] - 0s - loss: 4.7612 - val_loss: 1.6773 Epoch 264/1000 1000/1000 [==============================] - 0s - loss: 4.7505 - val_loss: 1.7475 Epoch 265/1000 1000/1000 [==============================] - 0s - loss: 5.3794 - val_loss: 1.6749 Epoch 266/1000 1000/1000 [==============================] - 0s - loss: 5.0416 - val_loss: 1.7070 Epoch 267/1000 1000/1000 [==============================] - 0s - loss: 5.4166 - val_loss: 1.6760 Epoch 268/1000 1000/1000 [==============================] - 0s - loss: 4.9895 - val_loss: 1.7043 Epoch 269/1000 1000/1000 [==============================] - 0s - loss: 5.0753 - val_loss: 1.6818 Epoch 270/1000 1000/1000 [==============================] - 0s - loss: 4.9247 - val_loss: 1.6460 Epoch 271/1000 1000/1000 [==============================] - 0s - loss: 4.4932 - val_loss: 1.6879 Epoch 272/1000 1000/1000 [==============================] - 0s - loss: 4.9594 - val_loss: 1.7169 Epoch 273/1000 1000/1000 [==============================] - 0s - loss: 5.1647 - val_loss: 1.7414 Epoch 274/1000 1000/1000 [==============================] - 0s - loss: 4.7437 - val_loss: 1.7012 Epoch 275/1000 1000/1000 [==============================] - 0s - loss: 4.6980 - val_loss: 1.7774 Epoch 276/1000 1000/1000 [==============================] - 0s - loss: 4.7067 - val_loss: 1.6650 Epoch 277/1000 1000/1000 [==============================] - 0s - loss: 5.5052 - val_loss: 1.6868 Epoch 278/1000 1000/1000 [==============================] - 0s - loss: 5.3209 - val_loss: 1.7320 Epoch 279/1000 1000/1000 [==============================] - 0s - loss: 4.7842 - val_loss: 1.8526 Epoch 280/1000 1000/1000 [==============================] - 0s - loss: 5.1266 - val_loss: 1.6980 Epoch 281/1000 1000/1000 [==============================] - 0s - loss: 4.8226 - val_loss: 1.7242 Epoch 282/1000 1000/1000 [==============================] - 0s - loss: 4.7843 - val_loss: 2.1063 Epoch 283/1000 1000/1000 [==============================] - 0s - loss: 4.7163 - val_loss: 1.6538 Epoch 284/1000 1000/1000 [==============================] - 0s - loss: 4.6420 - val_loss: 1.6615 Epoch 285/1000 1000/1000 [==============================] - 0s - loss: 4.3938 - val_loss: 1.6032 Epoch 286/1000 1000/1000 [==============================] - 0s - loss: 4.3345 - val_loss: 1.7813 Epoch 287/1000 1000/1000 [==============================] - 0s - loss: 5.2474 - val_loss: 1.5851 Epoch 288/1000 1000/1000 [==============================] - 0s - loss: 4.3427 - val_loss: 1.5918 Epoch 289/1000 1000/1000 [==============================] - 0s - loss: 4.6263 - val_loss: 1.6451 Epoch 290/1000 1000/1000 [==============================] - 0s - loss: 4.4756 - val_loss: 1.6702 Epoch 291/1000 1000/1000 [==============================] - 0s - loss: 4.5055 - val_loss: 1.6083 Epoch 292/1000 1000/1000 [==============================] - 0s - loss: 4.2342 - val_loss: 1.5477 Epoch 293/1000 1000/1000 [==============================] - 0s - loss: 4.5968 - val_loss: 1.6296 Epoch 294/1000 1000/1000 [==============================] - 0s - loss: 4.2356 - val_loss: 1.5457 Epoch 295/1000 1000/1000 [==============================] - 0s - loss: 4.3566 - val_loss: 1.6291 Epoch 296/1000 1000/1000 [==============================] - 0s - loss: 5.4404 - val_loss: 1.5963 Epoch 297/1000 1000/1000 [==============================] - 0s - loss: 4.8631 - val_loss: 1.5646 Epoch 298/1000 1000/1000 [==============================] - 0s - loss: 4.2691 - val_loss: 1.5692 Epoch 299/1000 1000/1000 [==============================] - 0s - loss: 4.3184 - val_loss: 1.5635 Epoch 300/1000 1000/1000 [==============================] - 0s - loss: 4.4139 - val_loss: 1.5934 Epoch 301/1000 1000/1000 [==============================] - 0s - loss: 5.1752 - val_loss: 1.7112 Epoch 302/1000 1000/1000 [==============================] - 0s - loss: 4.4361 - val_loss: 1.5276 Epoch 303/1000 1000/1000 [==============================] - 0s - loss: 4.4239 - val_loss: 1.6038 Epoch 304/1000 1000/1000 [==============================] - 0s - loss: 4.4984 - val_loss: 1.6551 Epoch 305/1000 1000/1000 [==============================] - 0s - loss: 4.5287 - val_loss: 1.5866 Epoch 306/1000 1000/1000 [==============================] - 0s - loss: 4.3814 - val_loss: 1.5505 Epoch 307/1000 1000/1000 [==============================] - 0s - loss: 4.4361 - val_loss: 1.5174 Epoch 308/1000 1000/1000 [==============================] - 0s - loss: 4.2072 - val_loss: 1.6701 Epoch 309/1000 1000/1000 [==============================] - 0s - loss: 4.5587 - val_loss: 1.8835 Epoch 310/1000 1000/1000 [==============================] - 0s - loss: 4.2399 - val_loss: 1.5188 Epoch 311/1000 1000/1000 [==============================] - 0s - loss: 4.2844 - val_loss: 1.5002 Epoch 312/1000 1000/1000 [==============================] - 0s - loss: 4.1416 - val_loss: 1.4664 Epoch 313/1000 1000/1000 [==============================] - 0s - loss: 4.0652 - val_loss: 1.4843 Epoch 314/1000 1000/1000 [==============================] - 0s - loss: 4.0993 - val_loss: 1.4815 Epoch 315/1000 1000/1000 [==============================] - 0s - loss: 4.6183 - val_loss: 1.5138 Epoch 316/1000 1000/1000 [==============================] - 0s - loss: 4.2764 - val_loss: 1.5214 Epoch 317/1000 1000/1000 [==============================] - 0s - loss: 4.1352 - val_loss: 1.5135 Epoch 318/1000 1000/1000 [==============================] - 0s - loss: 4.3088 - val_loss: 1.4791 Epoch 319/1000 1000/1000 [==============================] - 0s - loss: 4.3150 - val_loss: 1.4450 Epoch 320/1000 1000/1000 [==============================] - 0s - loss: 4.3982 - val_loss: 1.4721 Epoch 321/1000 1000/1000 [==============================] - 0s - loss: 4.4248 - val_loss: 1.4721 Epoch 322/1000 1000/1000 [==============================] - 0s - loss: 4.0368 - val_loss: 1.5449 Epoch 323/1000 1000/1000 [==============================] - 0s - loss: 4.5626 - val_loss: 1.4728 Epoch 324/1000 1000/1000 [==============================] - 0s - loss: 4.4107 - val_loss: 1.5371 Epoch 325/1000 1000/1000 [==============================] - 0s - loss: 3.9914 - val_loss: 1.6037 Epoch 326/1000 1000/1000 [==============================] - 0s - loss: 4.2241 - val_loss: 1.4403 Epoch 327/1000 1000/1000 [==============================] - 0s - loss: 3.9380 - val_loss: 1.4779 Epoch 328/1000 1000/1000 [==============================] - 0s - loss: 3.9654 - val_loss: 1.5436 Epoch 329/1000 1000/1000 [==============================] - 0s - loss: 4.0526 - val_loss: 1.4452 Epoch 330/1000 1000/1000 [==============================] - 0s - loss: 4.5945 - val_loss: 1.4740 Epoch 331/1000 1000/1000 [==============================] - 0s - loss: 4.0486 - val_loss: 1.4581 Epoch 332/1000 1000/1000 [==============================] - 0s - loss: 4.0772 - val_loss: 1.4331 Epoch 333/1000 1000/1000 [==============================] - 0s - loss: 4.1690 - val_loss: 1.4559 Epoch 334/1000 1000/1000 [==============================] - 0s - loss: 3.9304 - val_loss: 1.5141 Epoch 335/1000 1000/1000 [==============================] - 0s - loss: 3.9179 - val_loss: 1.4685 Epoch 336/1000 1000/1000 [==============================] - 0s - loss: 3.9820 - val_loss: 1.4568 Epoch 337/1000 1000/1000 [==============================] - 0s - loss: 3.9058 - val_loss: 1.4708 Epoch 338/1000 1000/1000 [==============================] - 0s - loss: 3.9854 - val_loss: 1.5246 Epoch 339/1000 1000/1000 [==============================] - 0s - loss: 3.9531 - val_loss: 1.4273 Epoch 340/1000 1000/1000 [==============================] - 0s - loss: 4.1978 - val_loss: 1.4683 Epoch 341/1000 1000/1000 [==============================] - 0s - loss: 3.7256 - val_loss: 1.4025 Epoch 342/1000 1000/1000 [==============================] - 0s - loss: 3.7908 - val_loss: 1.6222 Epoch 343/1000 1000/1000 [==============================] - 0s - loss: 3.8527 - val_loss: 1.3715 Epoch 344/1000 1000/1000 [==============================] - 0s - loss: 3.8249 - val_loss: 1.4248 Epoch 345/1000 1000/1000 [==============================] - 0s - loss: 4.0525 - val_loss: 1.5124 Epoch 346/1000 1000/1000 [==============================] - 0s - loss: 4.0610 - val_loss: 1.4030 Epoch 347/1000 1000/1000 [==============================] - 0s - loss: 3.8029 - val_loss: 1.3972 Epoch 348/1000 1000/1000 [==============================] - 0s - loss: 3.8701 - val_loss: 1.3936 Epoch 349/1000 1000/1000 [==============================] - 0s - loss: 3.8329 - val_loss: 1.4767 Epoch 350/1000 1000/1000 [==============================] - 0s - loss: 3.6555 - val_loss: 1.4410 Epoch 351/1000 1000/1000 [==============================] - 0s - loss: 3.7998 - val_loss: 1.4086 Epoch 352/1000 1000/1000 [==============================] - 0s - loss: 3.7985 - val_loss: 1.5960 Epoch 353/1000 1000/1000 [==============================] - 0s - loss: 3.8635 - val_loss: 1.4156 Epoch 354/1000 1000/1000 [==============================] - 0s - loss: 3.6989 - val_loss: 1.5499 Epoch 355/1000 1000/1000 [==============================] - 0s - loss: 3.7531 - val_loss: 1.4220 Epoch 356/1000 1000/1000 [==============================] - 0s - loss: 3.7418 - val_loss: 1.4860 Epoch 357/1000 1000/1000 [==============================] - 0s - loss: 4.0641 - val_loss: 1.3936 Epoch 358/1000 1000/1000 [==============================] - 0s - loss: 3.8017 - val_loss: 1.4165 Epoch 359/1000 1000/1000 [==============================] - 0s - loss: 3.9504 - val_loss: 1.4143 Epoch 360/1000 1000/1000 [==============================] - 0s - loss: 3.9387 - val_loss: 1.4019 Epoch 361/1000 1000/1000 [==============================] - 0s - loss: 3.7198 - val_loss: 1.3621 Epoch 362/1000 1000/1000 [==============================] - 0s - loss: 3.5907 - val_loss: 1.4138 Epoch 363/1000 1000/1000 [==============================] - 0s - loss: 3.8930 - val_loss: 1.3453 Epoch 364/1000 1000/1000 [==============================] - 0s - loss: 4.1985 - val_loss: 1.3463 Epoch 365/1000 1000/1000 [==============================] - 0s - loss: 3.6845 - val_loss: 1.4281 Epoch 366/1000 1000/1000 [==============================] - 0s - loss: 3.5891 - val_loss: 1.3461 Epoch 367/1000 1000/1000 [==============================] - 0s - loss: 3.7422 - val_loss: 1.3962 Epoch 368/1000 1000/1000 [==============================] - 0s - loss: 3.8173 - val_loss: 1.3250 Epoch 369/1000 1000/1000 [==============================] - 0s - loss: 3.7576 - val_loss: 1.4080 Epoch 370/1000 1000/1000 [==============================] - 0s - loss: 3.6743 - val_loss: 1.3031 Epoch 371/1000 1000/1000 [==============================] - 0s - loss: 3.5999 - val_loss: 1.3520 Epoch 372/1000 1000/1000 [==============================] - 0s - loss: 3.7122 - val_loss: 1.3753 Epoch 373/1000 1000/1000 [==============================] - 0s - loss: 3.5977 - val_loss: 1.3434 Epoch 374/1000 1000/1000 [==============================] - 0s - loss: 3.3632 - val_loss: 1.3463 Epoch 375/1000 1000/1000 [==============================] - 0s - loss: 3.6891 - val_loss: 1.3544 Epoch 376/1000 1000/1000 [==============================] - 0s - loss: 3.8055 - val_loss: 1.4010 Epoch 377/1000 1000/1000 [==============================] - 0s - loss: 3.5171 - val_loss: 1.3423 Epoch 378/1000 1000/1000 [==============================] - 0s - loss: 3.5057 - val_loss: 1.3340 Epoch 379/1000 1000/1000 [==============================] - 0s - loss: 3.5141 - val_loss: 1.3199 Epoch 380/1000 1000/1000 [==============================] - 0s - loss: 3.3356 - val_loss: 1.2895 Epoch 381/1000 1000/1000 [==============================] - 0s - loss: 3.4462 - val_loss: 1.3746 Epoch 382/1000 1000/1000 [==============================] - 0s - loss: 3.7217 - val_loss: 1.3450 Epoch 383/1000 1000/1000 [==============================] - 0s - loss: 3.3330 - val_loss: 1.2722 Epoch 384/1000 1000/1000 [==============================] - 0s - loss: 3.4329 - val_loss: 1.3198 Epoch 385/1000 1000/1000 [==============================] - 0s - loss: 3.4734 - val_loss: 1.4865 Epoch 386/1000 1000/1000 [==============================] - 0s - loss: 3.3372 - val_loss: 1.3577 Epoch 387/1000 1000/1000 [==============================] - 0s - loss: 3.3525 - val_loss: 1.2888 Epoch 388/1000 1000/1000 [==============================] - 0s - loss: 3.6556 - val_loss: 1.3492 Epoch 389/1000 1000/1000 [==============================] - 0s - loss: 3.5405 - val_loss: 1.4373 Epoch 390/1000 1000/1000 [==============================] - 0s - loss: 3.4748 - val_loss: 1.2724 Epoch 391/1000 1000/1000 [==============================] - 0s - loss: 3.4686 - val_loss: 1.3646 Epoch 392/1000 1000/1000 [==============================] - 0s - loss: 3.3313 - val_loss: 1.3004 Epoch 393/1000 1000/1000 [==============================] - 0s - loss: 3.4369 - val_loss: 1.2942 Epoch 394/1000 1000/1000 [==============================] - 0s - loss: 3.4265 - val_loss: 1.3331 Epoch 395/1000 1000/1000 [==============================] - 0s - loss: 3.7890 - val_loss: 1.3160 Epoch 396/1000 1000/1000 [==============================] - 0s - loss: 3.3242 - val_loss: 1.3032 Epoch 397/1000 1000/1000 [==============================] - 0s - loss: 3.3978 - val_loss: 1.2830 Epoch 398/1000 1000/1000 [==============================] - 0s - loss: 3.2636 - val_loss: 1.3109 Epoch 399/1000 1000/1000 [==============================] - 0s - loss: 3.4246 - val_loss: 1.3103 Epoch 400/1000 1000/1000 [==============================] - 0s - loss: 3.4630 - val_loss: 1.2256 Epoch 401/1000 1000/1000 [==============================] - 0s - loss: 3.1528 - val_loss: 1.5458 Epoch 402/1000 1000/1000 [==============================] - 0s - loss: 3.5376 - val_loss: 1.3038 Epoch 403/1000 1000/1000 [==============================] - 0s - loss: 3.1854 - val_loss: 1.3035 Epoch 404/1000 1000/1000 [==============================] - 0s - loss: 3.4468 - val_loss: 1.3616 Epoch 405/1000 1000/1000 [==============================] - 0s - loss: 3.1716 - val_loss: 1.2360 Epoch 406/1000 1000/1000 [==============================] - 0s - loss: 3.1606 - val_loss: 1.2405 Epoch 407/1000 1000/1000 [==============================] - 0s - loss: 3.2123 - val_loss: 1.3198 Epoch 408/1000 1000/1000 [==============================] - 0s - loss: 3.5628 - val_loss: 1.2907 Epoch 409/1000 1000/1000 [==============================] - 0s - loss: 3.1516 - val_loss: 1.2468 Epoch 410/1000 1000/1000 [==============================] - 0s - loss: 3.2502 - val_loss: 1.2643 Epoch 411/1000 1000/1000 [==============================] - 0s - loss: 3.4081 - val_loss: 1.3621 Epoch 412/1000 1000/1000 [==============================] - 0s - loss: 3.1152 - val_loss: 1.2514 Epoch 413/1000 1000/1000 [==============================] - 0s - loss: 3.1616 - val_loss: 1.2453 Epoch 414/1000 1000/1000 [==============================] - 0s - loss: 3.1605 - val_loss: 1.3045 Epoch 415/1000 1000/1000 [==============================] - 0s - loss: 3.3035 - val_loss: 1.2320 Epoch 416/1000 1000/1000 [==============================] - 0s - loss: 3.1016 - val_loss: 1.2576 Epoch 417/1000 1000/1000 [==============================] - 0s - loss: 3.3995 - val_loss: 1.2330 Epoch 418/1000 1000/1000 [==============================] - 0s - loss: 3.1856 - val_loss: 1.2254 Epoch 419/1000 1000/1000 [==============================] - 0s - loss: 3.1210 - val_loss: 1.2400 Epoch 420/1000 1000/1000 [==============================] - 0s - loss: 3.0865 - val_loss: 1.2711 Epoch 421/1000 1000/1000 [==============================] - 0s - loss: 3.0854 - val_loss: 1.2306 Epoch 422/1000 1000/1000 [==============================] - 0s - loss: 3.0749 - val_loss: 1.2509 Epoch 423/1000 1000/1000 [==============================] - 0s - loss: 2.9816 - val_loss: 1.2313 Epoch 424/1000 1000/1000 [==============================] - 0s - loss: 3.1901 - val_loss: 1.2360 Epoch 425/1000 1000/1000 [==============================] - 0s - loss: 3.0176 - val_loss: 1.2494 Epoch 426/1000 1000/1000 [==============================] - 0s - loss: 3.1368 - val_loss: 1.3387 Epoch 427/1000 1000/1000 [==============================] - 0s - loss: 3.4224 - val_loss: 1.2553 Epoch 428/1000 1000/1000 [==============================] - 0s - loss: 3.1288 - val_loss: 1.3322 Epoch 429/1000 1000/1000 [==============================] - 0s - loss: 3.0693 - val_loss: 1.2097 Epoch 430/1000 1000/1000 [==============================] - 0s - loss: 3.0662 - val_loss: 1.2320 Epoch 431/1000 1000/1000 [==============================] - 0s - loss: 3.0169 - val_loss: 1.2011 Epoch 432/1000 1000/1000 [==============================] - 0s - loss: 2.9856 - val_loss: 1.2156 Epoch 433/1000 1000/1000 [==============================] - 0s - loss: 3.0965 - val_loss: 1.2015 Epoch 434/1000 1000/1000 [==============================] - 0s - loss: 3.1524 - val_loss: 1.1974 Epoch 435/1000 1000/1000 [==============================] - 0s - loss: 2.8962 - val_loss: 1.3365 Epoch 436/1000 1000/1000 [==============================] - 0s - loss: 3.0729 - val_loss: 1.2129 Epoch 437/1000 1000/1000 [==============================] - 0s - loss: 3.0742 - val_loss: 1.1555 Epoch 438/1000 1000/1000 [==============================] - 0s - loss: 3.1804 - val_loss: 1.1451 Epoch 439/1000 1000/1000 [==============================] - 0s - loss: 3.0216 - val_loss: 1.1788 Epoch 440/1000 1000/1000 [==============================] - 0s - loss: 3.1646 - val_loss: 1.1765 Epoch 441/1000 1000/1000 [==============================] - 0s - loss: 2.9585 - val_loss: 1.1860 Epoch 442/1000 1000/1000 [==============================] - 0s - loss: 2.9413 - val_loss: 1.1641 Epoch 443/1000 1000/1000 [==============================] - 0s - loss: 3.0217 - val_loss: 1.2214 Epoch 444/1000 1000/1000 [==============================] - 0s - loss: 2.9857 - val_loss: 1.1852 Epoch 445/1000 1000/1000 [==============================] - 0s - loss: 2.9178 - val_loss: 1.1918 Epoch 446/1000 1000/1000 [==============================] - 0s - loss: 2.8830 - val_loss: 1.1650 Epoch 447/1000 1000/1000 [==============================] - 0s - loss: 2.9957 - val_loss: 1.2156 Epoch 448/1000 1000/1000 [==============================] - 0s - loss: 2.9591 - val_loss: 1.2448 Epoch 449/1000 1000/1000 [==============================] - 0s - loss: 2.8875 - val_loss: 1.2241 Epoch 450/1000 1000/1000 [==============================] - 0s - loss: 3.1132 - val_loss: 1.1950 Epoch 451/1000 1000/1000 [==============================] - 0s - loss: 2.9023 - val_loss: 1.2047 Epoch 452/1000 1000/1000 [==============================] - 0s - loss: 3.0850 - val_loss: 1.1992 Epoch 453/1000 1000/1000 [==============================] - 0s - loss: 2.8020 - val_loss: 1.1576 Epoch 454/1000 1000/1000 [==============================] - 0s - loss: 2.9174 - val_loss: 1.1966 Epoch 455/1000 1000/1000 [==============================] - 0s - loss: 2.8493 - val_loss: 1.2833 Epoch 456/1000 1000/1000 [==============================] - 0s - loss: 2.9748 - val_loss: 1.1772 Epoch 457/1000 1000/1000 [==============================] - 0s - loss: 2.8099 - val_loss: 1.1516 Epoch 458/1000 1000/1000 [==============================] - 0s - loss: 2.8399 - val_loss: 1.1386 Epoch 459/1000 1000/1000 [==============================] - 0s - loss: 2.7897 - val_loss: 1.1393 Epoch 460/1000 1000/1000 [==============================] - 0s - loss: 2.7688 - val_loss: 1.2351 Epoch 461/1000 1000/1000 [==============================] - 0s - loss: 2.8065 - val_loss: 1.2175 Epoch 462/1000 1000/1000 [==============================] - 0s - loss: 2.7956 - val_loss: 1.2051 Epoch 463/1000 1000/1000 [==============================] - 0s - loss: 2.8266 - val_loss: 1.1439 Epoch 464/1000 1000/1000 [==============================] - 0s - loss: 2.7337 - val_loss: 1.1556 Epoch 465/1000 1000/1000 [==============================] - 0s - loss: 2.7019 - val_loss: 1.1301 Epoch 466/1000 1000/1000 [==============================] - 0s - loss: 2.8598 - val_loss: 1.1581 Epoch 467/1000 1000/1000 [==============================] - 0s - loss: 2.9306 - val_loss: 1.1465 Epoch 468/1000 1000/1000 [==============================] - 0s - loss: 2.7184 - val_loss: 1.1159 Epoch 469/1000 1000/1000 [==============================] - 0s - loss: 2.8028 - val_loss: 1.1306 Epoch 470/1000 1000/1000 [==============================] - 0s - loss: 2.8081 - val_loss: 1.1470 Epoch 471/1000 1000/1000 [==============================] - 0s - loss: 2.7909 - val_loss: 1.1723 Epoch 472/1000 1000/1000 [==============================] - 0s - loss: 2.7085 - val_loss: 1.1230 Epoch 473/1000 1000/1000 [==============================] - 0s - loss: 2.7357 - val_loss: 1.2527 Epoch 474/1000 1000/1000 [==============================] - 0s - loss: 2.6820 - val_loss: 1.1513 Epoch 475/1000 1000/1000 [==============================] - 0s - loss: 2.7039 - val_loss: 1.2557 Epoch 476/1000 1000/1000 [==============================] - 0s - loss: 2.6805 - val_loss: 1.1363 Epoch 477/1000 1000/1000 [==============================] - 0s - loss: 2.6377 - val_loss: 1.1292 Epoch 478/1000 1000/1000 [==============================] - 0s - loss: 2.6816 - val_loss: 1.1742 Epoch 479/1000 1000/1000 [==============================] - 0s - loss: 2.6793 - val_loss: 1.1378 Epoch 480/1000 1000/1000 [==============================] - 0s - loss: 2.5900 - val_loss: 1.1523 Epoch 481/1000 1000/1000 [==============================] - 0s - loss: 2.6551 - val_loss: 1.2817 Epoch 482/1000 1000/1000 [==============================] - 0s - loss: 3.0076 - val_loss: 1.1451 Epoch 483/1000 1000/1000 [==============================] - 0s - loss: 2.5452 - val_loss: 1.1119 Epoch 484/1000 1000/1000 [==============================] - 0s - loss: 2.5741 - val_loss: 1.1191 Epoch 485/1000 1000/1000 [==============================] - 0s - loss: 2.5944 - val_loss: 1.1668 Epoch 486/1000 1000/1000 [==============================] - 0s - loss: 2.6158 - val_loss: 1.1653 Epoch 487/1000 1000/1000 [==============================] - 0s - loss: 2.5927 - val_loss: 1.1492 Epoch 488/1000 1000/1000 [==============================] - 0s - loss: 2.5905 - val_loss: 1.1450 Epoch 489/1000 1000/1000 [==============================] - 0s - loss: 2.7158 - val_loss: 1.1482 Epoch 490/1000 1000/1000 [==============================] - 0s - loss: 2.5416 - val_loss: 1.1397 Epoch 491/1000 1000/1000 [==============================] - 0s - loss: 2.6483 - val_loss: 1.1114 Epoch 492/1000 1000/1000 [==============================] - 0s - loss: 2.5876 - val_loss: 1.1885 Epoch 493/1000 1000/1000 [==============================] - 0s - loss: 2.4975 - val_loss: 1.1736 Epoch 494/1000 1000/1000 [==============================] - 0s - loss: 2.7264 - val_loss: 1.1034 Epoch 495/1000 1000/1000 [==============================] - 0s - loss: 2.6085 - val_loss: 1.1054 Epoch 496/1000 1000/1000 [==============================] - 0s - loss: 2.5812 - val_loss: 1.0697 Epoch 497/1000 1000/1000 [==============================] - 0s - loss: 2.5497 - val_loss: 1.0949 Epoch 498/1000 1000/1000 [==============================] - 0s - loss: 2.5118 - val_loss: 1.1316 Epoch 499/1000 1000/1000 [==============================] - 0s - loss: 2.5126 - val_loss: 1.1171 Epoch 500/1000 1000/1000 [==============================] - 0s - loss: 2.5302 - val_loss: 1.1454 Epoch 501/1000 1000/1000 [==============================] - 0s - loss: 2.6670 - val_loss: 1.1368 Epoch 502/1000 1000/1000 [==============================] - 0s - loss: 2.5230 - val_loss: 1.0802 Epoch 503/1000 1000/1000 [==============================] - 0s - loss: 2.5407 - val_loss: 1.1406 Epoch 504/1000 1000/1000 [==============================] - 0s - loss: 2.5033 - val_loss: 1.1063 Epoch 505/1000 1000/1000 [==============================] - 0s - loss: 2.4372 - val_loss: 1.0746 Epoch 506/1000 1000/1000 [==============================] - 0s - loss: 2.8048 - val_loss: 1.1215 Epoch 507/1000 1000/1000 [==============================] - 0s - loss: 2.5310 - val_loss: 1.1476 Epoch 508/1000 1000/1000 [==============================] - 0s - loss: 2.6959 - val_loss: 1.1008 Epoch 509/1000 1000/1000 [==============================] - 0s - loss: 2.4694 - val_loss: 1.1173 Epoch 510/1000 1000/1000 [==============================] - 0s - loss: 2.4363 - val_loss: 1.1139 Epoch 511/1000 1000/1000 [==============================] - 0s - loss: 2.4304 - val_loss: 1.0867 Epoch 512/1000 1000/1000 [==============================] - 0s - loss: 2.5050 - val_loss: 1.0961 Epoch 513/1000 1000/1000 [==============================] - 0s - loss: 2.6045 - val_loss: 1.0606 Epoch 514/1000 1000/1000 [==============================] - 0s - loss: 2.4590 - val_loss: 1.1199 Epoch 515/1000 1000/1000 [==============================] - 0s - loss: 2.4577 - val_loss: 1.0537 Epoch 516/1000 1000/1000 [==============================] - 0s - loss: 2.4802 - val_loss: 1.0955 Epoch 517/1000 1000/1000 [==============================] - 0s - loss: 2.3618 - val_loss: 1.0565 Epoch 518/1000 1000/1000 [==============================] - 0s - loss: 2.3547 - val_loss: 1.0874 Epoch 519/1000 1000/1000 [==============================] - 0s - loss: 2.3889 - val_loss: 1.0919 Epoch 520/1000 1000/1000 [==============================] - 0s - loss: 2.3782 - val_loss: 1.0548 Epoch 521/1000 1000/1000 [==============================] - 0s - loss: 2.3856 - val_loss: 1.0751 Epoch 522/1000 1000/1000 [==============================] - 0s - loss: 2.3699 - val_loss: 1.0703 Epoch 523/1000 1000/1000 [==============================] - 0s - loss: 2.3018 - val_loss: 1.0697 Epoch 524/1000 1000/1000 [==============================] - 0s - loss: 2.3426 - val_loss: 1.0832 Epoch 525/1000 1000/1000 [==============================] - 0s - loss: 2.3445 - val_loss: 1.1067 Epoch 526/1000 1000/1000 [==============================] - 0s - loss: 2.4015 - val_loss: 1.0699 Epoch 527/1000 1000/1000 [==============================] - 0s - loss: 2.3245 - val_loss: 1.0796 Epoch 528/1000 1000/1000 [==============================] - 0s - loss: 2.3811 - val_loss: 1.0650 Epoch 529/1000 1000/1000 [==============================] - 0s - loss: 2.3500 - val_loss: 1.0867 Epoch 530/1000 1000/1000 [==============================] - 0s - loss: 2.2619 - val_loss: 1.0673 Epoch 531/1000 1000/1000 [==============================] - 0s - loss: 2.3369 - val_loss: 1.0956 Epoch 532/1000 1000/1000 [==============================] - 0s - loss: 2.2610 - val_loss: 1.0784 Epoch 533/1000 1000/1000 [==============================] - 0s - loss: 2.3140 - val_loss: 1.0765 Epoch 534/1000 1000/1000 [==============================] - 0s - loss: 2.3029 - val_loss: 1.0812 Epoch 535/1000 1000/1000 [==============================] - 0s - loss: 2.3277 - val_loss: 1.0800 Epoch 536/1000 1000/1000 [==============================] - 0s - loss: 2.3304 - val_loss: 1.0620 Epoch 537/1000 1000/1000 [==============================] - 0s - loss: 2.3067 - val_loss: 1.0624 Epoch 538/1000 1000/1000 [==============================] - 0s - loss: 2.3246 - val_loss: 1.1249 Epoch 539/1000 1000/1000 [==============================] - 0s - loss: 2.2427 - val_loss: 1.0140 Epoch 540/1000 1000/1000 [==============================] - 0s - loss: 2.2458 - val_loss: 1.0500 Epoch 541/1000 1000/1000 [==============================] - 0s - loss: 2.2777 - val_loss: 1.1070 Epoch 542/1000 1000/1000 [==============================] - 0s - loss: 2.2328 - val_loss: 1.0822 Epoch 543/1000 1000/1000 [==============================] - 0s - loss: 2.2284 - val_loss: 1.0575 Epoch 544/1000 1000/1000 [==============================] - 0s - loss: 2.3304 - val_loss: 1.1047 Epoch 545/1000 1000/1000 [==============================] - 0s - loss: 2.2135 - val_loss: 1.0404 Epoch 546/1000 1000/1000 [==============================] - 0s - loss: 2.2131 - val_loss: 1.1252 Epoch 547/1000 1000/1000 [==============================] - 0s - loss: 2.2372 - val_loss: 1.0617 Epoch 548/1000 1000/1000 [==============================] - 0s - loss: 2.2139 - val_loss: 1.0418 Epoch 549/1000 1000/1000 [==============================] - 0s - loss: 2.2034 - val_loss: 1.0868 Epoch 550/1000 1000/1000 [==============================] - 0s - loss: 2.2416 - val_loss: 1.0971 Epoch 551/1000 1000/1000 [==============================] - 0s - loss: 2.1991 - val_loss: 1.0807 Epoch 552/1000 1000/1000 [==============================] - 0s - loss: 2.2303 - val_loss: 1.0338 Epoch 553/1000 1000/1000 [==============================] - 0s - loss: 2.1963 - val_loss: 1.0546 Epoch 554/1000 1000/1000 [==============================] - 0s - loss: 2.1680 - val_loss: 1.0571 Epoch 555/1000 1000/1000 [==============================] - 0s - loss: 2.1757 - val_loss: 1.0145 Epoch 556/1000 1000/1000 [==============================] - 0s - loss: 2.1041 - val_loss: 1.0709 Epoch 557/1000 1000/1000 [==============================] - 0s - loss: 2.1484 - val_loss: 1.0529 Epoch 558/1000 1000/1000 [==============================] - 0s - loss: 2.1420 - val_loss: 1.0439 Epoch 559/1000 1000/1000 [==============================] - 0s - loss: 2.1781 - val_loss: 1.0379 Epoch 560/1000 1000/1000 [==============================] - 0s - loss: 2.1409 - val_loss: 1.0377 Epoch 561/1000 1000/1000 [==============================] - 0s - loss: 2.1260 - val_loss: 1.0656 Epoch 562/1000 1000/1000 [==============================] - 0s - loss: 2.1483 - val_loss: 1.0372 Epoch 563/1000 1000/1000 [==============================] - 0s - loss: 2.1488 - val_loss: 1.1455 Epoch 564/1000 1000/1000 [==============================] - 0s - loss: 2.1697 - val_loss: 1.0341 Epoch 565/1000 1000/1000 [==============================] - 0s - loss: 2.1633 - val_loss: 1.0140 Epoch 566/1000 1000/1000 [==============================] - 0s - loss: 2.0734 - val_loss: 1.0411 Epoch 567/1000 1000/1000 [==============================] - 0s - loss: 2.1073 - val_loss: 1.0327 Epoch 568/1000 1000/1000 [==============================] - 0s - loss: 2.1147 - val_loss: 1.0674 Epoch 569/1000 1000/1000 [==============================] - 0s - loss: 2.1226 - val_loss: 1.0694 Epoch 570/1000 1000/1000 [==============================] - 0s - loss: 2.1035 - val_loss: 1.0311 Epoch 571/1000 1000/1000 [==============================] - 0s - loss: 2.0905 - val_loss: 1.0627 Epoch 572/1000 1000/1000 [==============================] - 0s - loss: 2.1011 - val_loss: 1.0454 Epoch 573/1000 1000/1000 [==============================] - 0s - loss: 2.1024 - val_loss: 1.0497 Epoch 574/1000 1000/1000 [==============================] - 0s - loss: 2.0798 - val_loss: 1.0207 Epoch 575/1000 1000/1000 [==============================] - 0s - loss: 2.0158 - val_loss: 1.0562 Epoch 576/1000 1000/1000 [==============================] - 0s - loss: 2.0750 - val_loss: 1.0354 Epoch 577/1000 1000/1000 [==============================] - 0s - loss: 2.0301 - val_loss: 1.0176 Epoch 578/1000 1000/1000 [==============================] - 0s - loss: 2.0393 - val_loss: 1.0354 Epoch 579/1000 1000/1000 [==============================] - 0s - loss: 2.0453 - val_loss: 1.0520 Epoch 580/1000 1000/1000 [==============================] - 0s - loss: 2.0574 - val_loss: 1.0388 Epoch 581/1000 1000/1000 [==============================] - 0s - loss: 1.9956 - val_loss: 1.0173 Epoch 582/1000 1000/1000 [==============================] - 0s - loss: 1.9903 - val_loss: 1.0204 Epoch 583/1000 1000/1000 [==============================] - 0s - loss: 1.9995 - val_loss: 1.0449 Epoch 584/1000 1000/1000 [==============================] - 0s - loss: 1.9998 - val_loss: 1.0081 Epoch 585/1000 1000/1000 [==============================] - 0s - loss: 2.0703 - val_loss: 1.0106 Epoch 586/1000 1000/1000 [==============================] - 0s - loss: 2.0180 - val_loss: 1.0404 Epoch 587/1000 1000/1000 [==============================] - 0s - loss: 2.0087 - val_loss: 1.0387 Epoch 588/1000 1000/1000 [==============================] - 0s - loss: 1.9972 - val_loss: 1.0420 Epoch 589/1000 1000/1000 [==============================] - 0s - loss: 2.0276 - val_loss: 1.0096 Epoch 590/1000 1000/1000 [==============================] - 0s - loss: 1.9768 - val_loss: 1.0235 Epoch 591/1000 1000/1000 [==============================] - 0s - loss: 1.9792 - val_loss: 0.9913 Epoch 592/1000 1000/1000 [==============================] - 0s - loss: 1.9667 - val_loss: 1.0316 Epoch 593/1000 1000/1000 [==============================] - 0s - loss: 1.9429 - val_loss: 0.9999 Epoch 594/1000 1000/1000 [==============================] - 0s - loss: 1.9983 - val_loss: 1.0042 Epoch 595/1000 1000/1000 [==============================] - 0s - loss: 1.9688 - val_loss: 1.0139 Epoch 596/1000 1000/1000 [==============================] - 0s - loss: 1.9244 - val_loss: 1.0140 Epoch 597/1000 1000/1000 [==============================] - 0s - loss: 1.9763 - val_loss: 0.9972 Epoch 598/1000 1000/1000 [==============================] - 0s - loss: 2.0020 - val_loss: 0.9985 Epoch 599/1000 1000/1000 [==============================] - 0s - loss: 1.9658 - val_loss: 1.0136 Epoch 600/1000 1000/1000 [==============================] - 0s - loss: 1.9730 - val_loss: 1.0554 Epoch 601/1000 1000/1000 [==============================] - 0s - loss: 1.9558 - val_loss: 1.0230 Epoch 602/1000 1000/1000 [==============================] - 0s - loss: 1.9409 - val_loss: 1.0121 Epoch 603/1000 1000/1000 [==============================] - 0s - loss: 1.9591 - val_loss: 1.0160 Epoch 604/1000 1000/1000 [==============================] - 0s - loss: 1.9264 - val_loss: 0.9973 Epoch 605/1000 1000/1000 [==============================] - 0s - loss: 1.8868 - val_loss: 1.0220 Epoch 606/1000 1000/1000 [==============================] - 0s - loss: 1.8714 - val_loss: 1.0012 Epoch 607/1000 1000/1000 [==============================] - 0s - loss: 1.9089 - val_loss: 1.0358 Epoch 608/1000 1000/1000 [==============================] - 0s - loss: 1.9080 - val_loss: 1.0182 Epoch 609/1000 1000/1000 [==============================] - 0s - loss: 1.8659 - val_loss: 1.0170 Epoch 610/1000 1000/1000 [==============================] - 0s - loss: 1.8979 - val_loss: 1.0024 Epoch 611/1000 1000/1000 [==============================] - 0s - loss: 1.8584 - val_loss: 1.0346 Epoch 612/1000 1000/1000 [==============================] - 0s - loss: 1.9113 - val_loss: 0.9852 Epoch 613/1000 1000/1000 [==============================] - 0s - loss: 1.8779 - val_loss: 0.9722 Epoch 614/1000 1000/1000 [==============================] - 0s - loss: 1.8638 - val_loss: 1.0219 Epoch 615/1000 1000/1000 [==============================] - 0s - loss: 1.8655 - val_loss: 1.0039 Epoch 616/1000 1000/1000 [==============================] - 0s - loss: 1.8953 - val_loss: 1.0224 Epoch 617/1000 1000/1000 [==============================] - 0s - loss: 1.8269 - val_loss: 0.9912 Epoch 618/1000 1000/1000 [==============================] - 0s - loss: 1.8578 - val_loss: 1.0184 Epoch 619/1000 1000/1000 [==============================] - 0s - loss: 1.8590 - val_loss: 0.9922 Epoch 620/1000 1000/1000 [==============================] - 0s - loss: 1.8310 - val_loss: 1.0156 Epoch 621/1000 1000/1000 [==============================] - 0s - loss: 1.8498 - val_loss: 0.9779 Epoch 622/1000 1000/1000 [==============================] - 0s - loss: 1.8453 - val_loss: 0.9875 Epoch 623/1000 1000/1000 [==============================] - 0s - loss: 1.8414 - val_loss: 0.9779 Epoch 624/1000 1000/1000 [==============================] - 0s - loss: 1.8414 - val_loss: 1.0015 Epoch 625/1000 1000/1000 [==============================] - 0s - loss: 1.8278 - val_loss: 1.0190 Epoch 626/1000 1000/1000 [==============================] - 0s - loss: 1.8070 - val_loss: 0.9867 Epoch 627/1000 1000/1000 [==============================] - 0s - loss: 1.8107 - val_loss: 0.9868 Epoch 628/1000 1000/1000 [==============================] - 0s - loss: 1.8100 - val_loss: 0.9647 Epoch 629/1000 1000/1000 [==============================] - 0s - loss: 1.7913 - val_loss: 0.9887 Epoch 630/1000 1000/1000 [==============================] - 0s - loss: 1.8140 - val_loss: 1.0041 Epoch 631/1000 1000/1000 [==============================] - 0s - loss: 1.7628 - val_loss: 0.9987 Epoch 632/1000 1000/1000 [==============================] - 0s - loss: 1.8529 - val_loss: 0.9623 Epoch 633/1000 1000/1000 [==============================] - 0s - loss: 1.7716 - val_loss: 0.9811 Epoch 634/1000 1000/1000 [==============================] - 0s - loss: 1.7625 - val_loss: 0.9896 Epoch 635/1000 1000/1000 [==============================] - 0s - loss: 1.7857 - val_loss: 0.9788 Epoch 636/1000 1000/1000 [==============================] - 0s - loss: 1.7422 - val_loss: 0.9909 Epoch 637/1000 1000/1000 [==============================] - 0s - loss: 1.7459 - val_loss: 0.9865 Epoch 638/1000 1000/1000 [==============================] - 0s - loss: 1.7683 - val_loss: 0.9919 Epoch 639/1000 1000/1000 [==============================] - 0s - loss: 1.7794 - val_loss: 0.9671 Epoch 640/1000 1000/1000 [==============================] - 0s - loss: 1.7514 - val_loss: 1.0198 Epoch 641/1000 1000/1000 [==============================] - 0s - loss: 1.7370 - val_loss: 0.9751 Epoch 642/1000 1000/1000 [==============================] - 0s - loss: 1.7237 - val_loss: 1.0063 Epoch 643/1000 1000/1000 [==============================] - 0s - loss: 1.7309 - val_loss: 1.0039 Epoch 644/1000 1000/1000 [==============================] - 0s - loss: 1.7135 - val_loss: 1.0007 Epoch 645/1000 1000/1000 [==============================] - 0s - loss: 1.7335 - val_loss: 0.9707 Epoch 646/1000 1000/1000 [==============================] - 0s - loss: 1.7401 - val_loss: 1.0034 Epoch 647/1000 1000/1000 [==============================] - 0s - loss: 1.7044 - val_loss: 0.9977 Epoch 648/1000 1000/1000 [==============================] - 0s - loss: 1.7322 - val_loss: 1.0234 Epoch 649/1000 1000/1000 [==============================] - 0s - loss: 1.7104 - val_loss: 0.9989 Epoch 650/1000 1000/1000 [==============================] - 0s - loss: 1.7333 - val_loss: 0.9960 Epoch 651/1000 1000/1000 [==============================] - 0s - loss: 1.7204 - val_loss: 0.9672 Epoch 652/1000 1000/1000 [==============================] - 0s - loss: 1.7204 - val_loss: 0.9729 Epoch 653/1000 1000/1000 [==============================] - 0s - loss: 1.7149 - val_loss: 0.9828 Epoch 654/1000 1000/1000 [==============================] - 0s - loss: 1.6889 - val_loss: 0.9728 Epoch 655/1000 1000/1000 [==============================] - 0s - loss: 1.6887 - val_loss: 0.9522 Epoch 656/1000 1000/1000 [==============================] - 0s - loss: 1.6883 - val_loss: 0.9790 Epoch 657/1000 1000/1000 [==============================] - 0s - loss: 1.6747 - val_loss: 1.0013 Epoch 658/1000 1000/1000 [==============================] - 0s - loss: 1.6666 - val_loss: 0.9945 Epoch 659/1000 1000/1000 [==============================] - 0s - loss: 1.6913 - val_loss: 1.0010 Epoch 660/1000 1000/1000 [==============================] - 0s - loss: 1.6768 - val_loss: 0.9871 Epoch 661/1000 1000/1000 [==============================] - 0s - loss: 1.6638 - val_loss: 0.9700 Epoch 662/1000 1000/1000 [==============================] - 0s - loss: 1.6747 - val_loss: 0.9677 Epoch 663/1000 1000/1000 [==============================] - 0s - loss: 1.6466 - val_loss: 0.9523 Epoch 664/1000 1000/1000 [==============================] - 0s - loss: 1.6839 - val_loss: 0.9745 Epoch 665/1000 1000/1000 [==============================] - 0s - loss: 1.6386 - val_loss: 1.0013 Epoch 666/1000 1000/1000 [==============================] - 0s - loss: 1.6618 - val_loss: 0.9561 Epoch 667/1000 1000/1000 [==============================] - 0s - loss: 1.6378 - val_loss: 0.9678 Epoch 668/1000 1000/1000 [==============================] - 0s - loss: 1.6251 - val_loss: 0.9817 Epoch 669/1000 1000/1000 [==============================] - 0s - loss: 1.6573 - val_loss: 0.9811 Epoch 670/1000 1000/1000 [==============================] - 0s - loss: 1.6330 - val_loss: 1.0016 Epoch 671/1000 1000/1000 [==============================] - 0s - loss: 1.6594 - val_loss: 0.9494 Epoch 672/1000 1000/1000 [==============================] - 0s - loss: 1.5964 - val_loss: 0.9608 Epoch 673/1000 1000/1000 [==============================] - 0s - loss: 1.6279 - val_loss: 0.9732 Epoch 674/1000 1000/1000 [==============================] - 0s - loss: 1.6385 - val_loss: 0.9121 Epoch 675/1000 1000/1000 [==============================] - 0s - loss: 1.6088 - val_loss: 0.9732 Epoch 676/1000 1000/1000 [==============================] - 0s - loss: 1.5953 - val_loss: 0.9693 Epoch 677/1000 1000/1000 [==============================] - 0s - loss: 1.5956 - val_loss: 0.9729 Epoch 678/1000 1000/1000 [==============================] - 0s - loss: 1.6139 - val_loss: 0.9883 Epoch 679/1000 1000/1000 [==============================] - 0s - loss: 1.5953 - val_loss: 0.9570 Epoch 680/1000 1000/1000 [==============================] - 0s - loss: 1.6172 - val_loss: 0.9936 Epoch 681/1000 1000/1000 [==============================] - 0s - loss: 1.6145 - val_loss: 0.9695 Epoch 682/1000 1000/1000 [==============================] - 0s - loss: 1.5989 - val_loss: 0.9675 Epoch 683/1000 1000/1000 [==============================] - 0s - loss: 1.5980 - val_loss: 0.9522 Epoch 684/1000 1000/1000 [==============================] - 0s - loss: 1.5935 - val_loss: 0.9448 Epoch 685/1000 1000/1000 [==============================] - 0s - loss: 1.5834 - val_loss: 0.9738 Epoch 686/1000 1000/1000 [==============================] - 0s - loss: 1.5949 - val_loss: 0.9813 Epoch 687/1000 1000/1000 [==============================] - 0s - loss: 1.5625 - val_loss: 0.9761 Epoch 688/1000 1000/1000 [==============================] - 0s - loss: 1.5909 - val_loss: 0.9546 Epoch 689/1000 1000/1000 [==============================] - 0s - loss: 1.5741 - val_loss: 0.9712 Epoch 690/1000 1000/1000 [==============================] - 0s - loss: 1.5515 - val_loss: 0.9655 Epoch 691/1000 1000/1000 [==============================] - 0s - loss: 1.5700 - val_loss: 0.9581 Epoch 692/1000 1000/1000 [==============================] - 0s - loss: 1.5775 - val_loss: 0.9728 Epoch 693/1000 1000/1000 [==============================] - 0s - loss: 1.5517 - val_loss: 0.9923 Epoch 694/1000 1000/1000 [==============================] - 0s - loss: 1.5772 - val_loss: 0.9755 Epoch 695/1000 1000/1000 [==============================] - 0s - loss: 1.5371 - val_loss: 0.9441 Epoch 696/1000 1000/1000 [==============================] - 0s - loss: 1.5574 - val_loss: 0.9604 Epoch 697/1000 1000/1000 [==============================] - 0s - loss: 1.5552 - val_loss: 0.9474 Epoch 698/1000 1000/1000 [==============================] - 0s - loss: 1.5636 - val_loss: 0.9910 Epoch 699/1000 1000/1000 [==============================] - 0s - loss: 1.5357 - val_loss: 0.9849 Epoch 700/1000 1000/1000 [==============================] - 0s - loss: 1.5412 - val_loss: 0.9549 Epoch 701/1000 1000/1000 [==============================] - 0s - loss: 1.5316 - val_loss: 0.9680 Epoch 702/1000 1000/1000 [==============================] - 0s - loss: 1.5424 - val_loss: 0.9904 Epoch 703/1000 1000/1000 [==============================] - 0s - loss: 1.5219 - val_loss: 0.9570 Epoch 704/1000 1000/1000 [==============================] - 0s - loss: 1.5114 - val_loss: 0.9453 Epoch 705/1000 1000/1000 [==============================] - 0s - loss: 1.5206 - val_loss: 0.9490 Epoch 706/1000 1000/1000 [==============================] - 0s - loss: 1.5325 - val_loss: 0.9617 Epoch 707/1000 1000/1000 [==============================] - 0s - loss: 1.5324 - val_loss: 0.9737 Epoch 708/1000 1000/1000 [==============================] - 0s - loss: 1.5176 - val_loss: 0.9383 Epoch 709/1000 1000/1000 [==============================] - 0s - loss: 1.5298 - val_loss: 0.9487 Epoch 710/1000 1000/1000 [==============================] - 0s - loss: 1.5068 - val_loss: 0.9379 Epoch 711/1000 1000/1000 [==============================] - 0s - loss: 1.5169 - val_loss: 0.9691 Epoch 712/1000 1000/1000 [==============================] - 0s - loss: 1.5185 - val_loss: 0.9618 Epoch 713/1000 1000/1000 [==============================] - 0s - loss: 1.5073 - val_loss: 0.9630 Epoch 714/1000 1000/1000 [==============================] - 0s - loss: 1.5108 - val_loss: 0.9291 Epoch 715/1000 1000/1000 [==============================] - 0s - loss: 1.5210 - val_loss: 0.9812 Epoch 716/1000 1000/1000 [==============================] - 0s - loss: 1.5182 - val_loss: 0.9459 Epoch 717/1000 1000/1000 [==============================] - 0s - loss: 1.5216 - val_loss: 0.9493 Epoch 718/1000 1000/1000 [==============================] - 0s - loss: 1.5155 - val_loss: 0.9693 Epoch 719/1000 1000/1000 [==============================] - 0s - loss: 1.4846 - val_loss: 0.9523 Epoch 720/1000 1000/1000 [==============================] - 0s - loss: 1.4783 - val_loss: 0.9827 Epoch 721/1000 1000/1000 [==============================] - 0s - loss: 1.4876 - val_loss: 0.9554 Epoch 722/1000 1000/1000 [==============================] - 0s - loss: 1.4972 - val_loss: 0.9545 Epoch 723/1000 1000/1000 [==============================] - 0s - loss: 1.4830 - val_loss: 0.9816 Epoch 724/1000 1000/1000 [==============================] - 0s - loss: 1.4942 - val_loss: 0.9471 Epoch 725/1000 1000/1000 [==============================] - 0s - loss: 1.4775 - val_loss: 0.9413 Epoch 726/1000 1000/1000 [==============================] - 0s - loss: 1.4624 - val_loss: 0.9542 Epoch 727/1000 1000/1000 [==============================] - 0s - loss: 1.4730 - val_loss: 0.9640 Epoch 728/1000 1000/1000 [==============================] - 0s - loss: 1.4833 - val_loss: 0.9788 Epoch 729/1000 1000/1000 [==============================] - 0s - loss: 1.4506 - val_loss: 0.9429 Epoch 730/1000 1000/1000 [==============================] - 0s - loss: 1.4458 - val_loss: 0.9435 Epoch 731/1000 1000/1000 [==============================] - 0s - loss: 1.4539 - val_loss: 0.9713 Epoch 732/1000 1000/1000 [==============================] - 0s - loss: 1.4712 - val_loss: 0.9612 Epoch 733/1000 1000/1000 [==============================] - 0s - loss: 1.4311 - val_loss: 0.9410 Epoch 734/1000 1000/1000 [==============================] - 0s - loss: 1.4381 - val_loss: 0.9885 Epoch 735/1000 1000/1000 [==============================] - 0s - loss: 1.4679 - val_loss: 0.9641 Epoch 736/1000 1000/1000 [==============================] - 0s - loss: 1.4495 - val_loss: 0.9617 Epoch 737/1000 1000/1000 [==============================] - 0s - loss: 1.4629 - val_loss: 0.9306 Epoch 738/1000 1000/1000 [==============================] - 0s - loss: 1.4739 - val_loss: 0.9895 Epoch 739/1000 1000/1000 [==============================] - 0s - loss: 1.4836 - val_loss: 0.9594 Epoch 740/1000 1000/1000 [==============================] - 0s - loss: 1.4549 - val_loss: 0.9531 Epoch 741/1000 1000/1000 [==============================] - 0s - loss: 1.4531 - val_loss: 0.9359 Epoch 742/1000 1000/1000 [==============================] - 0s - loss: 1.4539 - val_loss: 0.9618 Epoch 743/1000 1000/1000 [==============================] - 0s - loss: 1.4553 - val_loss: 0.9521 Epoch 744/1000 1000/1000 [==============================] - 0s - loss: 1.4298 - val_loss: 0.9887 Epoch 745/1000 1000/1000 [==============================] - 0s - loss: 1.4420 - val_loss: 0.9660 Epoch 746/1000 1000/1000 [==============================] - 0s - loss: 1.4485 - val_loss: 0.9537 Epoch 747/1000 1000/1000 [==============================] - 0s - loss: 1.4499 - val_loss: 0.9795 Epoch 748/1000 1000/1000 [==============================] - 0s - loss: 1.4200 - val_loss: 0.9649 Epoch 749/1000 1000/1000 [==============================] - 0s - loss: 1.4411 - val_loss: 0.9784 Epoch 750/1000 1000/1000 [==============================] - 0s - loss: 1.4192 - val_loss: 0.9829 Epoch 751/1000 1000/1000 [==============================] - 0s - loss: 1.4382 - val_loss: 0.9574 Epoch 752/1000 1000/1000 [==============================] - 0s - loss: 1.4221 - val_loss: 0.9807 Epoch 753/1000 1000/1000 [==============================] - 0s - loss: 1.4175 - val_loss: 0.9441 Epoch 754/1000 1000/1000 [==============================] - 0s - loss: 1.4355 - val_loss: 0.9460 Epoch 755/1000 1000/1000 [==============================] - 0s - loss: 1.4324 - val_loss: 0.9713 Epoch 756/1000 1000/1000 [==============================] - 0s - loss: 1.4377 - val_loss: 0.9322 Epoch 757/1000 1000/1000 [==============================] - 0s - loss: 1.3978 - val_loss: 0.9591 Epoch 758/1000 1000/1000 [==============================] - 0s - loss: 1.3998 - val_loss: 0.9542 Epoch 759/1000 1000/1000 [==============================] - 0s - loss: 1.4101 - val_loss: 0.9495 Epoch 760/1000 1000/1000 [==============================] - 0s - loss: 1.3990 - val_loss: 0.9512 Epoch 761/1000 1000/1000 [==============================] - 0s - loss: 1.4126 - val_loss: 0.9483 Epoch 762/1000 1000/1000 [==============================] - 0s - loss: 1.4103 - val_loss: 0.9598 Epoch 763/1000 1000/1000 [==============================] - 0s - loss: 1.4000 - val_loss: 0.9705 Epoch 764/1000 1000/1000 [==============================] - 0s - loss: 1.4129 - val_loss: 0.9633 Epoch 765/1000 1000/1000 [==============================] - 0s - loss: 1.4307 - val_loss: 0.9930 Epoch 766/1000 1000/1000 [==============================] - 0s - loss: 1.4202 - val_loss: 0.9403 Epoch 767/1000 1000/1000 [==============================] - 0s - loss: 1.4161 - val_loss: 0.9454 Epoch 768/1000 1000/1000 [==============================] - 0s - loss: 1.3996 - val_loss: 0.9266 Epoch 769/1000 1000/1000 [==============================] - 0s - loss: 1.4259 - val_loss: 0.9398 Epoch 770/1000 1000/1000 [==============================] - 0s - loss: 1.4021 - val_loss: 0.9346 Epoch 771/1000 1000/1000 [==============================] - 0s - loss: 1.4384 - val_loss: 0.9384 Epoch 772/1000 1000/1000 [==============================] - 0s - loss: 1.4179 - val_loss: 0.9336 Epoch 773/1000 1000/1000 [==============================] - 0s - loss: 1.4100 - val_loss: 0.9760 Epoch 774/1000 1000/1000 [==============================] - 0s - loss: 1.4006 - val_loss: 0.9285 Epoch 775/1000 1000/1000 [==============================] - 0s - loss: 1.3949 - val_loss: 0.9250 Epoch 776/1000 1000/1000 [==============================] - 0s - loss: 1.4114 - val_loss: 0.9666 Epoch 777/1000 1000/1000 [==============================] - 0s - loss: 1.3779 - val_loss: 0.9401 Epoch 778/1000 1000/1000 [==============================] - 0s - loss: 1.4199 - val_loss: 0.9594 Epoch 779/1000 1000/1000 [==============================] - 0s - loss: 1.3919 - val_loss: 0.9546 Epoch 780/1000 1000/1000 [==============================] - 0s - loss: 1.3914 - val_loss: 0.9478 Epoch 781/1000 1000/1000 [==============================] - 0s - loss: 1.3828 - val_loss: 0.9521 Epoch 782/1000 1000/1000 [==============================] - 0s - loss: 1.3812 - val_loss: 0.9664 Epoch 783/1000 1000/1000 [==============================] - 0s - loss: 1.3817 - val_loss: 0.9362 Epoch 784/1000 1000/1000 [==============================] - 0s - loss: 1.3861 - val_loss: 0.9791 Epoch 785/1000 1000/1000 [==============================] - 0s - loss: 1.3904 - val_loss: 0.9428 Epoch 786/1000 1000/1000 [==============================] - 0s - loss: 1.3838 - val_loss: 0.9288 Epoch 787/1000 1000/1000 [==============================] - 0s - loss: 1.3714 - val_loss: 0.9693 Epoch 788/1000 1000/1000 [==============================] - 0s - loss: 1.3986 - val_loss: 0.9659 Epoch 789/1000 1000/1000 [==============================] - 0s - loss: 1.3995 - val_loss: 0.9588 Epoch 790/1000 1000/1000 [==============================] - 0s - loss: 1.3907 - val_loss: 0.9664 Epoch 791/1000 1000/1000 [==============================] - 0s - loss: 1.3990 - val_loss: 0.9530 Epoch 792/1000 1000/1000 [==============================] - 0s - loss: 1.3952 - val_loss: 0.9640 Epoch 793/1000 1000/1000 [==============================] - 0s - loss: 1.3764 - val_loss: 0.9559 Epoch 794/1000 1000/1000 [==============================] - 0s - loss: 1.3807 - val_loss: 0.9708 Epoch 795/1000 1000/1000 [==============================] - 0s - loss: 1.3811 - val_loss: 0.9729 Epoch 796/1000 1000/1000 [==============================] - 0s - loss: 1.3805 - val_loss: 0.9389 Epoch 797/1000 1000/1000 [==============================] - 0s - loss: 1.3973 - val_loss: 0.9786 Epoch 798/1000 1000/1000 [==============================] - 0s - loss: 1.3710 - val_loss: 0.9686 Epoch 799/1000 1000/1000 [==============================] - 0s - loss: 1.3790 - val_loss: 0.9736 Epoch 800/1000 1000/1000 [==============================] - 0s - loss: 1.3912 - val_loss: 0.9444 Epoch 801/1000 1000/1000 [==============================] - 0s - loss: 1.3738 - val_loss: 0.9480 Epoch 802/1000 1000/1000 [==============================] - 0s - loss: 1.3556 - val_loss: 0.9651 Epoch 803/1000 1000/1000 [==============================] - 0s - loss: 1.3595 - val_loss: 0.9730 Epoch 804/1000 1000/1000 [==============================] - 0s - loss: 1.3653 - val_loss: 0.9921 Epoch 805/1000 1000/1000 [==============================] - 0s - loss: 1.3753 - val_loss: 0.9846 Epoch 806/1000 1000/1000 [==============================] - 0s - loss: 1.3647 - val_loss: 0.9669 Epoch 807/1000 1000/1000 [==============================] - 0s - loss: 1.3570 - val_loss: 0.9483 Epoch 808/1000 1000/1000 [==============================] - 0s - loss: 1.3389 - val_loss: 0.9665 Epoch 809/1000 1000/1000 [==============================] - 0s - loss: 1.3679 - val_loss: 0.9564 Epoch 810/1000 1000/1000 [==============================] - 0s - loss: 1.3651 - val_loss: 1.0131 Epoch 811/1000 1000/1000 [==============================] - 0s - loss: 1.3815 - val_loss: 0.9533 Epoch 812/1000 1000/1000 [==============================] - 0s - loss: 1.3607 - val_loss: 0.9526 Epoch 813/1000 1000/1000 [==============================] - 0s - loss: 1.3606 - val_loss: 0.9335 Epoch 814/1000 1000/1000 [==============================] - 0s - loss: 1.3394 - val_loss: 0.9460 Epoch 815/1000 1000/1000 [==============================] - 0s - loss: 1.3468 - val_loss: 0.9643 Epoch 816/1000 1000/1000 [==============================] - 0s - loss: 1.3538 - val_loss: 0.9843 Epoch 817/1000 1000/1000 [==============================] - 0s - loss: 1.3588 - val_loss: 0.9640 Epoch 818/1000 1000/1000 [==============================] - 0s - loss: 1.3606 - val_loss: 0.9551 Epoch 819/1000 1000/1000 [==============================] - 0s - loss: 1.3660 - val_loss: 0.9995 Epoch 820/1000 1000/1000 [==============================] - 0s - loss: 1.3604 - val_loss: 0.9736 Epoch 821/1000 1000/1000 [==============================] - 0s - loss: 1.3637 - val_loss: 0.9900 Epoch 822/1000 1000/1000 [==============================] - 0s - loss: 1.3495 - val_loss: 0.9932 Epoch 823/1000 1000/1000 [==============================] - 0s - loss: 1.3337 - val_loss: 0.9697 Epoch 824/1000 1000/1000 [==============================] - 0s - loss: 1.3519 - val_loss: 0.9933 Epoch 825/1000 1000/1000 [==============================] - 0s - loss: 1.3436 - val_loss: 0.9548 Epoch 826/1000 1000/1000 [==============================] - 0s - loss: 1.3781 - val_loss: 0.9396 Epoch 827/1000 1000/1000 [==============================] - 0s - loss: 1.3481 - val_loss: 0.9607 Epoch 828/1000 1000/1000 [==============================] - 0s - loss: 1.3622 - val_loss: 0.9675 Epoch 829/1000 1000/1000 [==============================] - 0s - loss: 1.3738 - val_loss: 0.9697 Epoch 830/1000 1000/1000 [==============================] - 0s - loss: 1.3647 - val_loss: 0.9848 Epoch 831/1000 1000/1000 [==============================] - 0s - loss: 1.3327 - val_loss: 0.9585 Epoch 832/1000 1000/1000 [==============================] - 0s - loss: 1.3465 - val_loss: 0.9429 Epoch 833/1000 1000/1000 [==============================] - 0s - loss: 1.3376 - val_loss: 0.9766 Epoch 834/1000 1000/1000 [==============================] - 0s - loss: 1.3392 - val_loss: 0.9698 Epoch 835/1000 1000/1000 [==============================] - 0s - loss: 1.3694 - val_loss: 0.9582 Epoch 836/1000 1000/1000 [==============================] - 0s - loss: 1.3354 - val_loss: 0.9779 Epoch 837/1000 1000/1000 [==============================] - 0s - loss: 1.3406 - val_loss: 0.9596 Epoch 838/1000 1000/1000 [==============================] - 0s - loss: 1.3467 - val_loss: 0.9818 Epoch 839/1000 1000/1000 [==============================] - 0s - loss: 1.3727 - val_loss: 0.9659 Epoch 840/1000 1000/1000 [==============================] - 0s - loss: 1.3415 - val_loss: 0.9822 Epoch 841/1000 1000/1000 [==============================] - 0s - loss: 1.3571 - val_loss: 0.9603 Epoch 842/1000 1000/1000 [==============================] - 0s - loss: 1.3333 - val_loss: 0.9520 Epoch 843/1000 1000/1000 [==============================] - 0s - loss: 1.3604 - val_loss: 0.9892 Epoch 844/1000 1000/1000 [==============================] - 0s - loss: 1.3420 - val_loss: 0.9886 Epoch 845/1000 1000/1000 [==============================] - 0s - loss: 1.3482 - val_loss: 0.9831 Epoch 846/1000 1000/1000 [==============================] - 0s - loss: 1.3488 - val_loss: 0.9534 Epoch 847/1000 1000/1000 [==============================] - 0s - loss: 1.3406 - val_loss: 0.9392 Epoch 848/1000 1000/1000 [==============================] - 0s - loss: 1.3379 - val_loss: 0.9990 Epoch 849/1000 1000/1000 [==============================] - 0s - loss: 1.3350 - val_loss: 0.9542 Epoch 850/1000 1000/1000 [==============================] - 0s - loss: 1.3345 - val_loss: 0.9894 Epoch 851/1000 1000/1000 [==============================] - 0s - loss: 1.3391 - val_loss: 0.9751 Epoch 852/1000 1000/1000 [==============================] - 0s - loss: 1.3316 - val_loss: 0.9530 Epoch 853/1000 1000/1000 [==============================] - 0s - loss: 1.3072 - val_loss: 0.9862 Epoch 854/1000 1000/1000 [==============================] - 0s - loss: 1.3382 - val_loss: 1.0235 Epoch 855/1000 1000/1000 [==============================] - 0s - loss: 1.3290 - val_loss: 0.9586 Epoch 856/1000 1000/1000 [==============================] - 0s - loss: 1.3347 - val_loss: 0.9868 Epoch 857/1000 1000/1000 [==============================] - 0s - loss: 1.3321 - val_loss: 0.9741 Epoch 858/1000 1000/1000 [==============================] - 0s - loss: 1.3275 - val_loss: 0.9865 Epoch 859/1000 1000/1000 [==============================] - 0s - loss: 1.3382 - val_loss: 0.9672 Epoch 860/1000 1000/1000 [==============================] - 0s - loss: 1.3257 - val_loss: 0.9587 Epoch 861/1000 1000/1000 [==============================] - 0s - loss: 1.3131 - val_loss: 0.9759 Epoch 862/1000 1000/1000 [==============================] - 0s - loss: 1.3215 - val_loss: 0.9754 Epoch 863/1000 1000/1000 [==============================] - 0s - loss: 1.3321 - val_loss: 0.9992 Epoch 864/1000 1000/1000 [==============================] - 0s - loss: 1.3150 - val_loss: 0.9658 Epoch 865/1000 1000/1000 [==============================] - 0s - loss: 1.3235 - val_loss: 1.0093 Epoch 866/1000 1000/1000 [==============================] - 0s - loss: 1.2998 - val_loss: 0.9764 Epoch 867/1000 1000/1000 [==============================] - 0s - loss: 1.2976 - val_loss: 0.9940 Epoch 868/1000 1000/1000 [==============================] - 0s - loss: 1.3249 - val_loss: 0.9870 Epoch 869/1000 1000/1000 [==============================] - 0s - loss: 1.3055 - val_loss: 0.9739 Epoch 870/1000 1000/1000 [==============================] - 0s - loss: 1.3057 - val_loss: 0.9887 Epoch 871/1000 1000/1000 [==============================] - 0s - loss: 1.2919 - val_loss: 0.9749 Epoch 872/1000 1000/1000 [==============================] - 0s - loss: 1.3195 - val_loss: 0.9944 Epoch 873/1000 1000/1000 [==============================] - 0s - loss: 1.3113 - val_loss: 0.9896 Epoch 874/1000 1000/1000 [==============================] - 0s - loss: 1.3278 - val_loss: 0.9958 Epoch 875/1000 1000/1000 [==============================] - 0s - loss: 1.3151 - val_loss: 1.0322 Epoch 876/1000 1000/1000 [==============================] - 0s - loss: 1.3009 - val_loss: 0.9924 Epoch 877/1000 1000/1000 [==============================] - 0s - loss: 1.3268 - val_loss: 0.9887 Epoch 878/1000 1000/1000 [==============================] - 0s - loss: 1.3270 - val_loss: 0.9959 Epoch 879/1000 1000/1000 [==============================] - 0s - loss: 1.3043 - val_loss: 0.9732 Epoch 880/1000 1000/1000 [==============================] - 0s - loss: 1.3116 - val_loss: 0.9783 Epoch 881/1000 1000/1000 [==============================] - 0s - loss: 1.3113 - val_loss: 0.9670 Epoch 882/1000 1000/1000 [==============================] - 0s - loss: 1.3097 - val_loss: 0.9810 Epoch 883/1000 1000/1000 [==============================] - 0s - loss: 1.3240 - val_loss: 0.9643 Epoch 884/1000 1000/1000 [==============================] - 0s - loss: 1.3169 - val_loss: 0.9653 Epoch 885/1000 1000/1000 [==============================] - 0s - loss: 1.2994 - val_loss: 0.9707 Epoch 886/1000 1000/1000 [==============================] - 0s - loss: 1.3073 - val_loss: 0.9862 Epoch 887/1000 1000/1000 [==============================] - 0s - loss: 1.3118 - val_loss: 0.9961 Epoch 888/1000 1000/1000 [==============================] - 0s - loss: 1.2957 - val_loss: 0.9950 Epoch 889/1000 1000/1000 [==============================] - 0s - loss: 1.3078 - val_loss: 0.9896 Epoch 890/1000 1000/1000 [==============================] - 0s - loss: 1.3138 - val_loss: 0.9969 Epoch 891/1000 1000/1000 [==============================] - 0s - loss: 1.2893 - val_loss: 0.9612 Epoch 892/1000 1000/1000 [==============================] - 0s - loss: 1.3018 - val_loss: 0.9832 Epoch 893/1000 1000/1000 [==============================] - 0s - loss: 1.2957 - val_loss: 0.9726 Epoch 894/1000 1000/1000 [==============================] - 0s - loss: 1.2849 - val_loss: 0.9745 Epoch 895/1000 1000/1000 [==============================] - 0s - loss: 1.3144 - val_loss: 1.0036 Epoch 896/1000 1000/1000 [==============================] - 0s - loss: 1.2877 - val_loss: 1.0262 Epoch 897/1000 1000/1000 [==============================] - 0s - loss: 1.3065 - val_loss: 0.9948 Epoch 898/1000 1000/1000 [==============================] - 0s - loss: 1.3124 - val_loss: 0.9948 Epoch 899/1000 1000/1000 [==============================] - 0s - loss: 1.2744 - val_loss: 1.0092 Epoch 900/1000 1000/1000 [==============================] - 0s - loss: 1.2655 - val_loss: 0.9860 Epoch 901/1000 1000/1000 [==============================] - 0s - loss: 1.2857 - val_loss: 1.0018 Epoch 902/1000 1000/1000 [==============================] - 0s - loss: 1.3014 - val_loss: 0.9861 Epoch 903/1000 1000/1000 [==============================] - 0s - loss: 1.2985 - val_loss: 0.9980 Epoch 904/1000 1000/1000 [==============================] - 0s - loss: 1.2789 - val_loss: 1.0026 Epoch 905/1000 1000/1000 [==============================] - 0s - loss: 1.2925 - val_loss: 0.9882 Epoch 906/1000 1000/1000 [==============================] - 0s - loss: 1.2803 - val_loss: 1.0041 Epoch 907/1000 1000/1000 [==============================] - 0s - loss: 1.2835 - val_loss: 0.9718 Epoch 908/1000 1000/1000 [==============================] - 0s - loss: 1.2808 - val_loss: 0.9985 Epoch 909/1000 1000/1000 [==============================] - 0s - loss: 1.3004 - val_loss: 1.0101 Epoch 910/1000 1000/1000 [==============================] - 0s - loss: 1.2970 - val_loss: 1.0243 Epoch 911/1000 1000/1000 [==============================] - 0s - loss: 1.2844 - val_loss: 0.9928 Epoch 912/1000 1000/1000 [==============================] - 0s - loss: 1.2857 - val_loss: 0.9811 Epoch 913/1000 1000/1000 [==============================] - 0s - loss: 1.2795 - val_loss: 0.9890 Epoch 914/1000 1000/1000 [==============================] - 0s - loss: 1.3080 - val_loss: 1.0026 Epoch 915/1000 1000/1000 [==============================] - 0s - loss: 1.2976 - val_loss: 0.9926 Epoch 916/1000 1000/1000 [==============================] - 0s - loss: 1.2908 - val_loss: 0.9886 Epoch 917/1000 1000/1000 [==============================] - 0s - loss: 1.2912 - val_loss: 0.9874 Epoch 918/1000 1000/1000 [==============================] - 0s - loss: 1.2883 - val_loss: 0.9878 Epoch 919/1000 1000/1000 [==============================] - 0s - loss: 1.2798 - val_loss: 0.9909 Epoch 920/1000 1000/1000 [==============================] - 0s - loss: 1.2533 - val_loss: 0.9914 Epoch 921/1000 1000/1000 [==============================] - 0s - loss: 1.2883 - val_loss: 1.0011 Epoch 922/1000 1000/1000 [==============================] - 0s - loss: 1.2959 - val_loss: 1.0093 Epoch 923/1000 1000/1000 [==============================] - 0s - loss: 1.2890 - val_loss: 0.9862 Epoch 924/1000 1000/1000 [==============================] - 0s - loss: 1.2855 - val_loss: 0.9988 Epoch 925/1000 1000/1000 [==============================] - 0s - loss: 1.2899 - val_loss: 1.0216 Epoch 926/1000 1000/1000 [==============================] - 0s - loss: 1.2698 - val_loss: 1.0031 Epoch 927/1000 1000/1000 [==============================] - 0s - loss: 1.2637 - val_loss: 0.9964 Epoch 928/1000 1000/1000 [==============================] - 0s - loss: 1.2799 - val_loss: 1.0018 Epoch 929/1000 1000/1000 [==============================] - 0s - loss: 1.2778 - val_loss: 0.9887 Epoch 930/1000 1000/1000 [==============================] - 0s - loss: 1.2810 - val_loss: 0.9871 Epoch 931/1000 1000/1000 [==============================] - 0s - loss: 1.2656 - val_loss: 0.9877 Epoch 932/1000 1000/1000 [==============================] - 0s - loss: 1.2630 - val_loss: 0.9925 Epoch 933/1000 1000/1000 [==============================] - 0s - loss: 1.2710 - val_loss: 0.9920 Epoch 934/1000 1000/1000 [==============================] - 0s - loss: 1.2682 - val_loss: 1.0518 Epoch 935/1000 1000/1000 [==============================] - 0s - loss: 1.2796 - val_loss: 1.0078 Epoch 936/1000 1000/1000 [==============================] - 0s - loss: 1.2655 - val_loss: 1.0137 Epoch 937/1000 1000/1000 [==============================] - 0s - loss: 1.2527 - val_loss: 0.9952 Epoch 938/1000 1000/1000 [==============================] - 0s - loss: 1.2719 - val_loss: 1.0135 Epoch 939/1000 1000/1000 [==============================] - 0s - loss: 1.2664 - val_loss: 1.0124 Epoch 940/1000 1000/1000 [==============================] - 0s - loss: 1.2626 - val_loss: 1.0120 Epoch 941/1000 1000/1000 [==============================] - 0s - loss: 1.2727 - val_loss: 1.0004 Epoch 942/1000 1000/1000 [==============================] - 0s - loss: 1.2598 - val_loss: 0.9993 Epoch 943/1000 1000/1000 [==============================] - 0s - loss: 1.2649 - val_loss: 0.9913 Epoch 944/1000 1000/1000 [==============================] - 0s - loss: 1.2658 - val_loss: 0.9968 Epoch 945/1000 1000/1000 [==============================] - 0s - loss: 1.2721 - val_loss: 1.0100 Epoch 946/1000 1000/1000 [==============================] - 0s - loss: 1.2871 - val_loss: 0.9731 Epoch 947/1000 1000/1000 [==============================] - 0s - loss: 1.2455 - val_loss: 0.9892 Epoch 948/1000 1000/1000 [==============================] - 0s - loss: 1.2634 - val_loss: 1.0105 Epoch 949/1000 1000/1000 [==============================] - 0s - loss: 1.2764 - val_loss: 1.0050 Epoch 950/1000 1000/1000 [==============================] - 0s - loss: 1.2702 - val_loss: 0.9827 Epoch 951/1000 1000/1000 [==============================] - 0s - loss: 1.2683 - val_loss: 1.0109 Epoch 952/1000 1000/1000 [==============================] - 0s - loss: 1.2576 - val_loss: 0.9847 Epoch 953/1000 1000/1000 [==============================] - 0s - loss: 1.2583 - val_loss: 1.0223 Epoch 954/1000 1000/1000 [==============================] - 0s - loss: 1.2678 - val_loss: 0.9782 Epoch 955/1000 1000/1000 [==============================] - 0s - loss: 1.2432 - val_loss: 1.0090 Epoch 956/1000 1000/1000 [==============================] - 0s - loss: 1.2533 - val_loss: 0.9923 Epoch 957/1000 1000/1000 [==============================] - 0s - loss: 1.2404 - val_loss: 0.9838 Epoch 958/1000 1000/1000 [==============================] - 0s - loss: 1.2634 - val_loss: 1.0103 Epoch 959/1000 1000/1000 [==============================] - 0s - loss: 1.2618 - val_loss: 1.0084 Epoch 960/1000 1000/1000 [==============================] - 0s - loss: 1.2572 - val_loss: 0.9778 Epoch 961/1000 1000/1000 [==============================] - 0s - loss: 1.2520 - val_loss: 0.9904 Epoch 962/1000 1000/1000 [==============================] - 0s - loss: 1.2844 - val_loss: 0.9946 Epoch 963/1000 1000/1000 [==============================] - 0s - loss: 1.2590 - val_loss: 1.0358 Epoch 964/1000 1000/1000 [==============================] - 0s - loss: 1.2660 - val_loss: 1.0090 Epoch 965/1000 1000/1000 [==============================] - 0s - loss: 1.2655 - val_loss: 0.9980 Epoch 966/1000 1000/1000 [==============================] - 0s - loss: 1.2283 - val_loss: 0.9996 Epoch 967/1000 1000/1000 [==============================] - 0s - loss: 1.2376 - val_loss: 1.0249 Epoch 968/1000 1000/1000 [==============================] - 0s - loss: 1.2449 - val_loss: 0.9915 Epoch 969/1000 1000/1000 [==============================] - 0s - loss: 1.2430 - val_loss: 1.0158 Epoch 970/1000 1000/1000 [==============================] - 0s - loss: 1.2666 - val_loss: 0.9815 Epoch 971/1000 1000/1000 [==============================] - 0s - loss: 1.2496 - val_loss: 1.0140 Epoch 972/1000 1000/1000 [==============================] - 0s - loss: 1.2391 - val_loss: 1.0208 Epoch 973/1000 1000/1000 [==============================] - 0s - loss: 1.2297 - val_loss: 0.9948 Epoch 974/1000 1000/1000 [==============================] - 0s - loss: 1.2554 - val_loss: 1.0094 Epoch 975/1000 1000/1000 [==============================] - 0s - loss: 1.2425 - val_loss: 1.0068 Epoch 976/1000 1000/1000 [==============================] - 0s - loss: 1.2420 - val_loss: 0.9999 Epoch 977/1000 1000/1000 [==============================] - 0s - loss: 1.2388 - val_loss: 0.9971 Epoch 978/1000 1000/1000 [==============================] - 0s - loss: 1.2405 - val_loss: 1.0143 Epoch 979/1000 1000/1000 [==============================] - 0s - loss: 1.2557 - val_loss: 1.0249 Epoch 980/1000 1000/1000 [==============================] - 0s - loss: 1.2579 - val_loss: 0.9988 Epoch 981/1000 1000/1000 [==============================] - 0s - loss: 1.2512 - val_loss: 0.9910 Epoch 982/1000 1000/1000 [==============================] - 0s - loss: 1.2434 - val_loss: 0.9941 Epoch 983/1000 1000/1000 [==============================] - 0s - loss: 1.2354 - val_loss: 1.0024 Epoch 984/1000 1000/1000 [==============================] - 0s - loss: 1.2498 - val_loss: 1.0029 Epoch 985/1000 1000/1000 [==============================] - 0s - loss: 1.2345 - val_loss: 0.9968 Epoch 986/1000 1000/1000 [==============================] - 0s - loss: 1.2368 - val_loss: 0.9903 Epoch 987/1000 1000/1000 [==============================] - 0s - loss: 1.2342 - val_loss: 1.0094 Epoch 988/1000 1000/1000 [==============================] - 0s - loss: 1.2460 - val_loss: 1.0223 Epoch 989/1000 1000/1000 [==============================] - 0s - loss: 1.2346 - val_loss: 1.0397 Epoch 990/1000 1000/1000 [==============================] - 0s - loss: 1.2447 - val_loss: 1.0458 Epoch 991/1000 1000/1000 [==============================] - 0s - loss: 1.2323 - val_loss: 1.0271 Epoch 992/1000 1000/1000 [==============================] - 0s - loss: 1.2474 - val_loss: 1.0172 Epoch 993/1000 1000/1000 [==============================] - 0s - loss: 1.2362 - val_loss: 1.0163 Epoch 994/1000 1000/1000 [==============================] - 0s - loss: 1.2293 - val_loss: 1.0224 Epoch 995/1000 1000/1000 [==============================] - 0s - loss: 1.2309 - val_loss: 1.0242 Epoch 996/1000 1000/1000 [==============================] - 0s - loss: 1.2322 - val_loss: 0.9872 Epoch 997/1000 1000/1000 [==============================] - 0s - loss: 1.2435 - val_loss: 1.0042 Epoch 998/1000 1000/1000 [==============================] - 0s - loss: 1.2268 - val_loss: 1.0263 Epoch 999/1000 1000/1000 [==============================] - 0s - loss: 1.2341 - val_loss: 0.9958 Epoch 1000/1000 1000/1000 [==============================] - 0s - loss: 1.2533 - val_loss: 1.0211 CPU times: user 58min 9s, sys: 7min 6s, total: 1h 5min 16s Wall time: 11min 12s
plt.plot(history.history['val_loss'], label = 'Validation loss')
plt.plot(history.history['loss'], label = 'Training loss')
plt.ylabel("Squared error")
plt.xlabel("Epoch")
plt.ylim([0,7])
plt.legend();
<matplotlib.legend.Legend at 0x7f7d384e0438>
That looks nearly identical to Fig. 1 of the paper. Next, the "local decomposition."
training_data_path = 'data/ss_data_training.csv'
valid_data_path = 'data/ss_data_valid.csv'
train_input, train_output = load_data_ss(training_data_path)
valid_input, valid_output = load_data_ss(valid_data_path)
model = Sequential()
model.add(Dense(output_dim=2000,input_dim=64))
model.add(Dense(4000,activation='relu'))
model.add(Dropout(0.2))
model.add(Dense(4000,activation='relu'))
model.add(Dropout(0.2))
model.add(Dense(input_dim=4000,output_dim=36))
#model.summary()
%%time
model.compile(optimizer='adam',loss=custom_objective)
history = model.fit(train_input, train_output, validation_data=(valid_input,valid_output), nb_epoch=500, batch_size=64)
Train on 500 samples, validate on 500 samples Epoch 1/500 500/500 [==============================] - 2s - loss: 1928.0432 - val_loss: 58.7284 Epoch 2/500 500/500 [==============================] - 1s - loss: 83.0015 - val_loss: 56.8443 Epoch 3/500 500/500 [==============================] - 1s - loss: 57.4910 - val_loss: 48.1649 Epoch 4/500 500/500 [==============================] - 1s - loss: 51.7076 - val_loss: 47.2014 Epoch 5/500 500/500 [==============================] - 1s - loss: 49.7511 - val_loss: 47.0593 Epoch 6/500 500/500 [==============================] - 1s - loss: 49.4571 - val_loss: 46.9361 Epoch 7/500 500/500 [==============================] - 1s - loss: 48.8565 - val_loss: 46.5122 Epoch 8/500 500/500 [==============================] - 1s - loss: 48.1984 - val_loss: 46.0242 Epoch 9/500 500/500 [==============================] - 1s - loss: 47.9599 - val_loss: 45.4773 Epoch 10/500 500/500 [==============================] - 1s - loss: 47.1162 - val_loss: 45.5617 Epoch 11/500 500/500 [==============================] - 1s - loss: 47.5879 - val_loss: 44.9578 Epoch 12/500 500/500 [==============================] - 1s - loss: 46.9787 - val_loss: 45.3351 Epoch 13/500 500/500 [==============================] - 1s - loss: 46.7124 - val_loss: 44.6159 Epoch 14/500 500/500 [==============================] - 1s - loss: 45.8505 - val_loss: 43.7878 Epoch 15/500 500/500 [==============================] - 1s - loss: 45.1820 - val_loss: 43.5011 Epoch 16/500 500/500 [==============================] - 1s - loss: 44.6850 - val_loss: 43.1022 Epoch 17/500 500/500 [==============================] - 1s - loss: 44.2769 - val_loss: 43.3106 Epoch 18/500 500/500 [==============================] - 1s - loss: 45.6469 - val_loss: 46.3445 Epoch 19/500 500/500 [==============================] - 1s - loss: 45.9416 - val_loss: 43.2778 Epoch 20/500 500/500 [==============================] - 1s - loss: 43.7875 - val_loss: 41.2507 Epoch 21/500 500/500 [==============================] - 1s - loss: 42.4273 - val_loss: 40.4794 Epoch 22/500 500/500 [==============================] - 1s - loss: 41.5514 - val_loss: 39.6212 Epoch 23/500 500/500 [==============================] - 1s - loss: 41.3061 - val_loss: 39.5961 Epoch 24/500 500/500 [==============================] - 1s - loss: 41.2355 - val_loss: 39.4855 Epoch 25/500 500/500 [==============================] - 1s - loss: 39.9226 - val_loss: 38.0519 Epoch 26/500 500/500 [==============================] - 1s - loss: 38.5709 - val_loss: 36.1625 Epoch 27/500 500/500 [==============================] - 1s - loss: 38.5727 - val_loss: 37.6131 Epoch 28/500 500/500 [==============================] - 1s - loss: 37.8976 - val_loss: 34.6365 Epoch 29/500 500/500 [==============================] - 1s - loss: 37.1208 - val_loss: 35.1463 Epoch 30/500 500/500 [==============================] - 1s - loss: 36.6890 - val_loss: 33.6481 Epoch 31/500 500/500 [==============================] - 1s - loss: 35.6755 - val_loss: 33.2816 Epoch 32/500 500/500 [==============================] - 1s - loss: 34.9731 - val_loss: 32.5114 Epoch 33/500 500/500 [==============================] - 1s - loss: 34.5225 - val_loss: 32.0806 Epoch 34/500 500/500 [==============================] - 1s - loss: 34.0801 - val_loss: 31.1134 Epoch 35/500 500/500 [==============================] - 1s - loss: 33.5336 - val_loss: 30.7787 Epoch 36/500 500/500 [==============================] - 1s - loss: 33.0177 - val_loss: 30.5774 Epoch 37/500 500/500 [==============================] - 1s - loss: 33.0489 - val_loss: 30.3603 Epoch 38/500 500/500 [==============================] - 1s - loss: 32.5370 - val_loss: 29.1842 Epoch 39/500 500/500 [==============================] - 1s - loss: 31.9061 - val_loss: 29.2739 Epoch 40/500 500/500 [==============================] - 1s - loss: 32.3620 - val_loss: 29.7957 Epoch 41/500 500/500 [==============================] - 1s - loss: 31.4147 - val_loss: 28.6334 Epoch 42/500 500/500 [==============================] - 1s - loss: 31.0300 - val_loss: 29.8735 Epoch 43/500 500/500 [==============================] - 1s - loss: 31.8526 - val_loss: 28.9440 Epoch 44/500 500/500 [==============================] - 1s - loss: 31.0116 - val_loss: 29.2483 Epoch 45/500 500/500 [==============================] - 1s - loss: 30.5171 - val_loss: 27.3801 Epoch 46/500 500/500 [==============================] - 1s - loss: 30.2832 - val_loss: 28.1007 Epoch 47/500 500/500 [==============================] - 1s - loss: 30.3353 - val_loss: 27.4352 Epoch 48/500 500/500 [==============================] - 1s - loss: 29.8938 - val_loss: 27.6298 Epoch 49/500 500/500 [==============================] - 1s - loss: 29.8872 - val_loss: 27.3145 Epoch 50/500 500/500 [==============================] - 1s - loss: 29.7929 - val_loss: 28.0647 Epoch 51/500 500/500 [==============================] - 1s - loss: 29.6782 - val_loss: 26.7747 Epoch 52/500 500/500 [==============================] - 1s - loss: 29.4139 - val_loss: 26.7458 Epoch 53/500 500/500 [==============================] - 1s - loss: 28.5147 - val_loss: 26.0697 Epoch 54/500 500/500 [==============================] - 1s - loss: 28.7702 - val_loss: 26.3329 Epoch 55/500 500/500 [==============================] - 1s - loss: 28.7239 - val_loss: 25.6868 Epoch 56/500 500/500 [==============================] - 1s - loss: 28.5961 - val_loss: 26.4685 Epoch 57/500 500/500 [==============================] - 1s - loss: 29.7481 - val_loss: 26.0791 Epoch 58/500 500/500 [==============================] - 1s - loss: 28.8565 - val_loss: 27.3456 Epoch 59/500 500/500 [==============================] - 1s - loss: 28.8071 - val_loss: 25.8198 Epoch 60/500 500/500 [==============================] - 1s - loss: 28.3281 - val_loss: 25.7100 Epoch 61/500 500/500 [==============================] - 1s - loss: 27.8777 - val_loss: 26.0692 Epoch 62/500 500/500 [==============================] - 1s - loss: 27.8926 - val_loss: 25.4982 Epoch 63/500 500/500 [==============================] - 1s - loss: 27.6902 - val_loss: 25.2152 Epoch 64/500 500/500 [==============================] - 1s - loss: 27.1233 - val_loss: 24.7323 Epoch 65/500 500/500 [==============================] - 1s - loss: 26.8366 - val_loss: 24.5293 Epoch 66/500 500/500 [==============================] - 1s - loss: 27.0532 - val_loss: 24.8751 Epoch 67/500 500/500 [==============================] - 1s - loss: 27.3120 - val_loss: 24.3714 Epoch 68/500 500/500 [==============================] - 1s - loss: 26.7316 - val_loss: 24.9043 Epoch 69/500 500/500 [==============================] - 1s - loss: 26.9798 - val_loss: 23.8858 Epoch 70/500 500/500 [==============================] - 1s - loss: 26.3727 - val_loss: 23.8449 Epoch 71/500 500/500 [==============================] - 1s - loss: 26.0630 - val_loss: 23.6661 Epoch 72/500 500/500 [==============================] - 1s - loss: 26.0013 - val_loss: 23.5329 Epoch 73/500 500/500 [==============================] - 1s - loss: 26.1116 - val_loss: 23.7442 Epoch 74/500 500/500 [==============================] - 1s - loss: 25.8768 - val_loss: 23.4318 Epoch 75/500 500/500 [==============================] - 1s - loss: 26.1874 - val_loss: 23.4129 Epoch 76/500 500/500 [==============================] - 1s - loss: 27.0570 - val_loss: 23.4328 Epoch 77/500 500/500 [==============================] - 1s - loss: 25.6738 - val_loss: 22.9433 Epoch 78/500 500/500 [==============================] - 1s - loss: 25.2788 - val_loss: 22.4110 Epoch 79/500 500/500 [==============================] - 1s - loss: 24.9501 - val_loss: 21.9928 Epoch 80/500 500/500 [==============================] - 1s - loss: 24.7120 - val_loss: 22.5425 Epoch 81/500 500/500 [==============================] - 1s - loss: 24.7361 - val_loss: 22.6039 Epoch 82/500 500/500 [==============================] - 1s - loss: 24.9983 - val_loss: 22.7363 Epoch 83/500 500/500 [==============================] - 1s - loss: 25.2060 - val_loss: 22.4622 Epoch 84/500 500/500 [==============================] - 1s - loss: 24.8344 - val_loss: 21.8732 Epoch 85/500 500/500 [==============================] - 1s - loss: 23.9391 - val_loss: 21.3500 Epoch 86/500 500/500 [==============================] - 1s - loss: 23.5522 - val_loss: 21.1678 Epoch 87/500 500/500 [==============================] - 1s - loss: 23.5628 - val_loss: 21.5371 Epoch 88/500 500/500 [==============================] - 1s - loss: 23.7517 - val_loss: 21.7780 Epoch 89/500 500/500 [==============================] - 1s - loss: 23.5532 - val_loss: 22.1706 Epoch 90/500 500/500 [==============================] - 1s - loss: 23.8794 - val_loss: 20.1531 Epoch 91/500 500/500 [==============================] - 1s - loss: 22.6723 - val_loss: 20.2714 Epoch 92/500 500/500 [==============================] - 1s - loss: 22.3922 - val_loss: 19.2760 Epoch 93/500 500/500 [==============================] - 1s - loss: 21.8145 - val_loss: 18.5101 Epoch 94/500 500/500 [==============================] - 1s - loss: 22.4426 - val_loss: 19.3888 Epoch 95/500 500/500 [==============================] - 1s - loss: 22.0816 - val_loss: 18.8926 Epoch 96/500 500/500 [==============================] - 1s - loss: 21.7314 - val_loss: 18.1874 Epoch 97/500 500/500 [==============================] - 1s - loss: 21.8398 - val_loss: 18.5346 Epoch 98/500 500/500 [==============================] - 1s - loss: 21.7493 - val_loss: 20.6972 Epoch 99/500 500/500 [==============================] - 1s - loss: 21.9077 - val_loss: 19.2547 Epoch 100/500 500/500 [==============================] - 1s - loss: 21.1385 - val_loss: 17.6240 Epoch 101/500 500/500 [==============================] - 1s - loss: 20.9727 - val_loss: 17.6485 Epoch 102/500 500/500 [==============================] - 1s - loss: 20.7763 - val_loss: 17.6589 Epoch 103/500 500/500 [==============================] - 1s - loss: 20.2651 - val_loss: 16.5054 Epoch 104/500 500/500 [==============================] - 1s - loss: 19.4422 - val_loss: 16.0809 Epoch 105/500 500/500 [==============================] - 1s - loss: 19.2042 - val_loss: 16.9620 Epoch 106/500 500/500 [==============================] - 1s - loss: 19.6524 - val_loss: 16.7391 Epoch 107/500 500/500 [==============================] - 1s - loss: 19.5323 - val_loss: 16.2183 Epoch 108/500 500/500 [==============================] - 1s - loss: 19.1176 - val_loss: 16.6020 Epoch 109/500 500/500 [==============================] - 1s - loss: 18.7388 - val_loss: 15.8039 Epoch 110/500 500/500 [==============================] - 1s - loss: 19.0691 - val_loss: 15.7187 Epoch 111/500 500/500 [==============================] - 1s - loss: 18.3063 - val_loss: 14.5503 Epoch 112/500 500/500 [==============================] - 1s - loss: 18.3555 - val_loss: 15.1999 Epoch 113/500 500/500 [==============================] - 1s - loss: 18.1069 - val_loss: 14.9871 Epoch 114/500 500/500 [==============================] - 1s - loss: 17.8411 - val_loss: 14.8636 Epoch 115/500 500/500 [==============================] - 1s - loss: 18.3923 - val_loss: 14.1869 Epoch 116/500 500/500 [==============================] - 1s - loss: 17.8015 - val_loss: 15.2624 Epoch 117/500 500/500 [==============================] - 1s - loss: 18.0717 - val_loss: 13.9149 Epoch 118/500 500/500 [==============================] - 1s - loss: 17.1005 - val_loss: 14.2740 Epoch 119/500 500/500 [==============================] - 1s - loss: 17.2014 - val_loss: 14.4739 Epoch 120/500 500/500 [==============================] - 1s - loss: 17.4387 - val_loss: 14.2247 Epoch 121/500 500/500 [==============================] - 1s - loss: 17.1951 - val_loss: 13.7455 Epoch 122/500 500/500 [==============================] - 1s - loss: 16.8486 - val_loss: 13.1874 Epoch 123/500 500/500 [==============================] - 1s - loss: 16.7053 - val_loss: 13.2789 Epoch 124/500 500/500 [==============================] - 1s - loss: 16.3125 - val_loss: 13.0253 Epoch 125/500 500/500 [==============================] - 1s - loss: 16.3424 - val_loss: 12.7554 Epoch 126/500 500/500 [==============================] - 1s - loss: 16.3314 - val_loss: 14.0382 Epoch 127/500 500/500 [==============================] - 1s - loss: 16.7385 - val_loss: 13.5239 Epoch 128/500 500/500 [==============================] - 1s - loss: 16.2890 - val_loss: 12.5187 Epoch 129/500 500/500 [==============================] - 1s - loss: 15.4437 - val_loss: 11.7787 Epoch 130/500 500/500 [==============================] - 1s - loss: 15.5926 - val_loss: 11.9115 Epoch 131/500 500/500 [==============================] - 1s - loss: 15.0373 - val_loss: 11.4172 Epoch 132/500 500/500 [==============================] - 1s - loss: 15.1642 - val_loss: 11.9214 Epoch 133/500 500/500 [==============================] - 1s - loss: 15.4446 - val_loss: 11.6906 Epoch 134/500 500/500 [==============================] - 1s - loss: 16.5509 - val_loss: 15.0385 Epoch 135/500 500/500 [==============================] - 1s - loss: 16.2195 - val_loss: 12.3908 Epoch 136/500 500/500 [==============================] - 1s - loss: 15.7185 - val_loss: 13.9386 Epoch 137/500 500/500 [==============================] - 1s - loss: 15.6152 - val_loss: 11.8112 Epoch 138/500 500/500 [==============================] - 1s - loss: 15.1574 - val_loss: 11.8416 Epoch 139/500 500/500 [==============================] - 1s - loss: 15.0489 - val_loss: 11.2803 Epoch 140/500 500/500 [==============================] - 1s - loss: 14.4673 - val_loss: 11.4361 Epoch 141/500 500/500 [==============================] - 1s - loss: 16.7280 - val_loss: 13.6167 Epoch 142/500 500/500 [==============================] - 1s - loss: 15.7860 - val_loss: 11.2677 Epoch 143/500 500/500 [==============================] - 1s - loss: 14.1296 - val_loss: 10.6362 Epoch 144/500 500/500 [==============================] - 1s - loss: 14.4168 - val_loss: 11.7518 Epoch 145/500 500/500 [==============================] - 1s - loss: 15.6741 - val_loss: 11.5584 Epoch 146/500 500/500 [==============================] - 1s - loss: 14.8495 - val_loss: 11.8084 Epoch 147/500 500/500 [==============================] - 1s - loss: 13.8308 - val_loss: 10.3624 Epoch 148/500 500/500 [==============================] - 1s - loss: 13.2304 - val_loss: 9.8691 Epoch 149/500 500/500 [==============================] - 1s - loss: 13.3060 - val_loss: 9.5735 Epoch 150/500 500/500 [==============================] - 1s - loss: 13.4854 - val_loss: 9.7293 Epoch 151/500 500/500 [==============================] - 1s - loss: 12.7915 - val_loss: 9.6296 Epoch 152/500 500/500 [==============================] - 1s - loss: 12.4320 - val_loss: 8.8409 Epoch 153/500 500/500 [==============================] - 1s - loss: 12.1876 - val_loss: 9.7054 Epoch 154/500 500/500 [==============================] - 1s - loss: 12.3956 - val_loss: 8.5183 Epoch 155/500 500/500 [==============================] - 1s - loss: 11.9358 - val_loss: 9.3293 Epoch 156/500 500/500 [==============================] - 1s - loss: 12.2306 - val_loss: 8.0850 Epoch 157/500 500/500 [==============================] - 1s - loss: 11.4125 - val_loss: 7.5101 Epoch 158/500 500/500 [==============================] - 1s - loss: 11.0173 - val_loss: 7.7434 Epoch 159/500 500/500 [==============================] - 1s - loss: 11.2014 - val_loss: 7.0060 Epoch 160/500 500/500 [==============================] - 1s - loss: 11.0875 - val_loss: 7.6966 Epoch 161/500 500/500 [==============================] - 1s - loss: 11.6276 - val_loss: 7.1349 Epoch 162/500 500/500 [==============================] - 1s - loss: 10.5399 - val_loss: 6.3728 Epoch 163/500 500/500 [==============================] - 1s - loss: 10.8268 - val_loss: 7.9008 Epoch 164/500 500/500 [==============================] - 1s - loss: 10.9474 - val_loss: 7.5107 Epoch 165/500 500/500 [==============================] - 1s - loss: 11.7909 - val_loss: 8.8236 Epoch 166/500 500/500 [==============================] - 1s - loss: 11.4318 - val_loss: 6.8427 Epoch 167/500 500/500 [==============================] - 1s - loss: 10.7585 - val_loss: 7.4368 Epoch 168/500 500/500 [==============================] - 1s - loss: 10.4682 - val_loss: 6.3239 Epoch 169/500 500/500 [==============================] - 1s - loss: 10.2039 - val_loss: 6.7206 Epoch 170/500 500/500 [==============================] - 1s - loss: 10.5190 - val_loss: 6.8035 Epoch 171/500 500/500 [==============================] - 1s - loss: 9.3056 - val_loss: 6.4316 Epoch 172/500 500/500 [==============================] - 1s - loss: 9.0501 - val_loss: 5.1253 Epoch 173/500 500/500 [==============================] - 1s - loss: 8.3399 - val_loss: 5.7806 Epoch 174/500 500/500 [==============================] - 1s - loss: 8.6715 - val_loss: 4.9853 Epoch 175/500 500/500 [==============================] - 1s - loss: 8.8605 - val_loss: 5.6089 Epoch 176/500 500/500 [==============================] - 1s - loss: 8.2402 - val_loss: 4.5588 Epoch 177/500 500/500 [==============================] - 1s - loss: 8.1634 - val_loss: 5.0486 Epoch 178/500 500/500 [==============================] - 1s - loss: 8.2378 - val_loss: 4.8302 Epoch 179/500 500/500 [==============================] - 1s - loss: 8.2387 - val_loss: 5.2692 Epoch 180/500 500/500 [==============================] - 1s - loss: 8.3342 - val_loss: 5.1009 Epoch 181/500 500/500 [==============================] - 1s - loss: 8.1874 - val_loss: 4.4188 Epoch 182/500 500/500 [==============================] - 1s - loss: 8.5127 - val_loss: 5.8360 Epoch 183/500 500/500 [==============================] - 1s - loss: 9.3278 - val_loss: 7.7671 Epoch 184/500 500/500 [==============================] - 1s - loss: 9.9096 - val_loss: 5.9508 Epoch 185/500 500/500 [==============================] - 1s - loss: 8.7522 - val_loss: 5.0897 Epoch 186/500 500/500 [==============================] - 1s - loss: 8.1514 - val_loss: 5.5797 Epoch 187/500 500/500 [==============================] - 1s - loss: 8.0158 - val_loss: 4.6018 Epoch 188/500 500/500 [==============================] - 1s - loss: 7.2932 - val_loss: 3.6828 Epoch 189/500 500/500 [==============================] - 1s - loss: 6.7976 - val_loss: 3.5923 Epoch 190/500 500/500 [==============================] - 1s - loss: 6.6601 - val_loss: 3.4250 Epoch 191/500 500/500 [==============================] - 1s - loss: 6.5509 - val_loss: 3.8488 Epoch 192/500 500/500 [==============================] - 1s - loss: 6.6878 - val_loss: 3.3129 Epoch 193/500 500/500 [==============================] - 1s - loss: 6.1467 - val_loss: 3.7122 Epoch 194/500 500/500 [==============================] - 1s - loss: 6.6668 - val_loss: 3.8315 Epoch 195/500 500/500 [==============================] - 1s - loss: 7.0483 - val_loss: 5.8750 Epoch 196/500 500/500 [==============================] - 1s - loss: 7.1647 - val_loss: 4.6958 Epoch 197/500 500/500 [==============================] - 1s - loss: 6.7713 - val_loss: 3.3452 Epoch 198/500 500/500 [==============================] - 1s - loss: 6.5446 - val_loss: 3.3485 Epoch 199/500 500/500 [==============================] - 1s - loss: 6.3982 - val_loss: 3.9603 Epoch 200/500 500/500 [==============================] - 1s - loss: 6.5716 - val_loss: 3.6029 Epoch 201/500 500/500 [==============================] - 1s - loss: 6.6997 - val_loss: 3.1458 Epoch 202/500 500/500 [==============================] - 1s - loss: 6.2691 - val_loss: 3.2734 Epoch 203/500 500/500 [==============================] - 1s - loss: 6.4622 - val_loss: 3.3147 Epoch 204/500 500/500 [==============================] - 1s - loss: 5.9702 - val_loss: 2.4278 Epoch 205/500 500/500 [==============================] - 1s - loss: 5.6693 - val_loss: 2.9080 Epoch 206/500 500/500 [==============================] - 1s - loss: 6.0875 - val_loss: 2.8858 Epoch 207/500 500/500 [==============================] - 1s - loss: 5.5837 - val_loss: 3.1185 Epoch 208/500 500/500 [==============================] - 1s - loss: 5.6562 - val_loss: 2.7291 Epoch 209/500 500/500 [==============================] - 1s - loss: 5.4512 - val_loss: 2.5840 Epoch 210/500 500/500 [==============================] - 1s - loss: 5.4928 - val_loss: 3.1645 Epoch 211/500 500/500 [==============================] - 1s - loss: 5.6749 - val_loss: 3.1559 Epoch 212/500 500/500 [==============================] - 1s - loss: 6.1027 - val_loss: 2.9530 Epoch 213/500 500/500 [==============================] - 1s - loss: 5.7644 - val_loss: 2.8974 Epoch 214/500 500/500 [==============================] - 1s - loss: 5.4408 - val_loss: 3.0485 Epoch 215/500 500/500 [==============================] - 1s - loss: 5.4080 - val_loss: 2.2956 Epoch 216/500 500/500 [==============================] - 1s - loss: 4.9712 - val_loss: 2.1414 Epoch 217/500 500/500 [==============================] - 1s - loss: 4.7840 - val_loss: 1.8948 Epoch 218/500 500/500 [==============================] - 1s - loss: 5.1520 - val_loss: 2.5227 Epoch 219/500 500/500 [==============================] - 1s - loss: 5.3126 - val_loss: 1.8040 Epoch 220/500 500/500 [==============================] - 1s - loss: 4.8045 - val_loss: 2.0338 Epoch 221/500 500/500 [==============================] - 1s - loss: 4.6550 - val_loss: 1.9782 Epoch 222/500 500/500 [==============================] - 1s - loss: 4.6351 - val_loss: 1.8332 Epoch 223/500 500/500 [==============================] - 1s - loss: 4.6952 - val_loss: 2.2893 Epoch 224/500 500/500 [==============================] - 1s - loss: 4.6099 - val_loss: 2.3695 Epoch 225/500 500/500 [==============================] - 1s - loss: 4.5715 - val_loss: 1.8765 Epoch 226/500 500/500 [==============================] - 1s - loss: 4.3441 - val_loss: 1.7817 Epoch 227/500 500/500 [==============================] - 1s - loss: 4.2001 - val_loss: 1.7008 Epoch 228/500 500/500 [==============================] - 1s - loss: 4.5778 - val_loss: 1.9930 Epoch 229/500 500/500 [==============================] - 1s - loss: 4.5752 - val_loss: 1.9139 Epoch 230/500 500/500 [==============================] - 1s - loss: 4.5134 - val_loss: 1.6818 Epoch 231/500 500/500 [==============================] - 1s - loss: 4.4104 - val_loss: 1.4291 Epoch 232/500 500/500 [==============================] - 1s - loss: 4.3837 - val_loss: 2.0426 Epoch 233/500 500/500 [==============================] - 1s - loss: 4.5516 - val_loss: 1.8445 Epoch 234/500 500/500 [==============================] - 1s - loss: 4.4904 - val_loss: 1.8949 Epoch 235/500 500/500 [==============================] - 1s - loss: 4.4605 - val_loss: 1.5963 Epoch 236/500 500/500 [==============================] - 1s - loss: 4.3438 - val_loss: 1.8792 Epoch 237/500 500/500 [==============================] - 1s - loss: 4.3992 - val_loss: 1.6114 Epoch 238/500 500/500 [==============================] - 1s - loss: 4.1809 - val_loss: 2.0185 Epoch 239/500 500/500 [==============================] - 1s - loss: 4.2456 - val_loss: 1.5622 Epoch 240/500 500/500 [==============================] - 1s - loss: 4.3564 - val_loss: 1.6728 Epoch 241/500 500/500 [==============================] - 1s - loss: 4.1857 - val_loss: 2.0035 Epoch 242/500 500/500 [==============================] - 1s - loss: 4.4218 - val_loss: 2.1638 Epoch 243/500 500/500 [==============================] - 1s - loss: 4.3590 - val_loss: 1.9175 Epoch 244/500 500/500 [==============================] - 1s - loss: 4.4782 - val_loss: 2.3463 Epoch 245/500 500/500 [==============================] - 1s - loss: 4.5182 - val_loss: 1.9176 Epoch 246/500 500/500 [==============================] - 1s - loss: 4.2608 - val_loss: 1.5383 Epoch 247/500 500/500 [==============================] - 1s - loss: 4.4674 - val_loss: 2.0951 Epoch 248/500 500/500 [==============================] - 1s - loss: 3.9751 - val_loss: 1.3204 Epoch 249/500 500/500 [==============================] - 1s - loss: 4.0403 - val_loss: 1.7277 Epoch 250/500 500/500 [==============================] - 1s - loss: 4.0162 - val_loss: 1.5315 Epoch 251/500 500/500 [==============================] - 1s - loss: 3.8845 - val_loss: 1.3248 Epoch 252/500 500/500 [==============================] - 1s - loss: 3.7396 - val_loss: 1.1626 Epoch 253/500 500/500 [==============================] - 1s - loss: 3.7342 - val_loss: 1.4158 Epoch 254/500 500/500 [==============================] - 1s - loss: 3.8723 - val_loss: 1.4234 Epoch 255/500 500/500 [==============================] - 1s - loss: 3.6967 - val_loss: 0.9893 Epoch 256/500 500/500 [==============================] - 1s - loss: 3.6360 - val_loss: 1.7676 Epoch 257/500 500/500 [==============================] - 1s - loss: 4.0274 - val_loss: 1.4162 Epoch 258/500 500/500 [==============================] - 1s - loss: 3.8734 - val_loss: 1.3667 Epoch 259/500 500/500 [==============================] - 1s - loss: 3.7334 - val_loss: 1.3034 Epoch 260/500 500/500 [==============================] - 1s - loss: 3.6527 - val_loss: 1.2300 Epoch 261/500 500/500 [==============================] - 1s - loss: 3.8820 - val_loss: 1.7735 Epoch 262/500 500/500 [==============================] - 1s - loss: 3.9917 - val_loss: 1.3752 Epoch 263/500 500/500 [==============================] - 1s - loss: 3.6973 - val_loss: 1.4040 Epoch 264/500 500/500 [==============================] - 1s - loss: 3.7384 - val_loss: 1.3597 Epoch 265/500 500/500 [==============================] - 1s - loss: 3.8233 - val_loss: 1.5710 Epoch 266/500 500/500 [==============================] - 1s - loss: 3.9037 - val_loss: 1.5031 Epoch 267/500 500/500 [==============================] - 1s - loss: 3.7198 - val_loss: 1.0980 Epoch 268/500 500/500 [==============================] - 1s - loss: 3.6646 - val_loss: 1.6870 Epoch 269/500 500/500 [==============================] - 1s - loss: 3.7391 - val_loss: 1.4695 Epoch 270/500 500/500 [==============================] - 1s - loss: 3.8487 - val_loss: 1.5701 Epoch 271/500 500/500 [==============================] - 1s - loss: 3.6862 - val_loss: 1.0557 Epoch 272/500 500/500 [==============================] - 1s - loss: 3.5585 - val_loss: 1.5156 Epoch 273/500 500/500 [==============================] - 1s - loss: 3.8232 - val_loss: 1.3221 Epoch 274/500 500/500 [==============================] - 1s - loss: 3.8222 - val_loss: 1.3993 Epoch 275/500 500/500 [==============================] - 1s - loss: 3.6637 - val_loss: 1.2120 Epoch 276/500 500/500 [==============================] - 1s - loss: 3.5550 - val_loss: 1.5198 Epoch 277/500 500/500 [==============================] - 1s - loss: 3.5031 - val_loss: 1.3929 Epoch 278/500 500/500 [==============================] - 1s - loss: 3.9795 - val_loss: 1.4485 Epoch 279/500 500/500 [==============================] - 1s - loss: 3.8654 - val_loss: 1.4748 Epoch 280/500 500/500 [==============================] - 1s - loss: 3.4574 - val_loss: 1.2789 Epoch 281/500 500/500 [==============================] - 1s - loss: 3.5138 - val_loss: 1.2360 Epoch 282/500 500/500 [==============================] - 1s - loss: 3.7030 - val_loss: 1.3026 Epoch 283/500 500/500 [==============================] - 1s - loss: 3.8741 - val_loss: 1.4417 Epoch 284/500 500/500 [==============================] - 1s - loss: 3.7972 - val_loss: 1.1690 Epoch 285/500 500/500 [==============================] - 1s - loss: 3.3484 - val_loss: 1.2018 Epoch 286/500 500/500 [==============================] - 1s - loss: 3.3349 - val_loss: 0.9829 Epoch 287/500 500/500 [==============================] - 1s - loss: 3.4195 - val_loss: 1.1481 Epoch 288/500 500/500 [==============================] - 1s - loss: 3.4528 - val_loss: 1.3549 Epoch 289/500 500/500 [==============================] - 1s - loss: 3.5590 - val_loss: 1.9513 Epoch 290/500 500/500 [==============================] - 1s - loss: 4.0321 - val_loss: 1.5812 Epoch 291/500 500/500 [==============================] - 1s - loss: 3.6949 - val_loss: 1.6886 Epoch 292/500 500/500 [==============================] - 1s - loss: 3.7315 - val_loss: 1.2912 Epoch 293/500 500/500 [==============================] - 1s - loss: 3.5747 - val_loss: 1.3013 Epoch 294/500 500/500 [==============================] - 1s - loss: 3.3887 - val_loss: 1.0416 Epoch 295/500 500/500 [==============================] - 1s - loss: 3.3819 - val_loss: 1.0654 Epoch 296/500 500/500 [==============================] - 1s - loss: 3.4369 - val_loss: 1.2010 Epoch 297/500 500/500 [==============================] - 1s - loss: 3.4015 - val_loss: 1.1858 Epoch 298/500 500/500 [==============================] - 1s - loss: 3.3568 - val_loss: 1.0868 Epoch 299/500 500/500 [==============================] - 1s - loss: 3.3142 - val_loss: 1.4660 Epoch 300/500 500/500 [==============================] - 1s - loss: 3.7237 - val_loss: 1.2372 Epoch 301/500 500/500 [==============================] - 1s - loss: 3.4159 - val_loss: 1.6738 Epoch 302/500 500/500 [==============================] - 1s - loss: 3.5486 - val_loss: 1.2870 Epoch 303/500 500/500 [==============================] - 1s - loss: 3.4404 - val_loss: 1.6207 Epoch 304/500 500/500 [==============================] - 1s - loss: 3.2716 - val_loss: 1.2255 Epoch 305/500 500/500 [==============================] - 1s - loss: 3.1875 - val_loss: 1.3057 Epoch 306/500 500/500 [==============================] - 1s - loss: 3.4978 - val_loss: 1.2490 Epoch 307/500 500/500 [==============================] - 1s - loss: 3.5266 - val_loss: 1.3423 Epoch 308/500 500/500 [==============================] - 1s - loss: 3.4850 - val_loss: 1.3093 Epoch 309/500 500/500 [==============================] - 1s - loss: 3.4766 - val_loss: 1.4630 Epoch 310/500 500/500 [==============================] - 1s - loss: 3.3026 - val_loss: 1.0277 Epoch 311/500 500/500 [==============================] - 1s - loss: 3.1343 - val_loss: 0.9550 Epoch 312/500 500/500 [==============================] - 1s - loss: 3.2058 - val_loss: 0.9907 Epoch 313/500 500/500 [==============================] - 1s - loss: 3.3018 - val_loss: 1.4125 Epoch 314/500 500/500 [==============================] - 1s - loss: 3.3261 - val_loss: 0.9826 Epoch 315/500 500/500 [==============================] - 1s - loss: 3.1498 - val_loss: 1.0712 Epoch 316/500 500/500 [==============================] - 1s - loss: 3.2153 - val_loss: 1.0992 Epoch 317/500 500/500 [==============================] - 1s - loss: 3.2806 - val_loss: 1.3962 Epoch 318/500 500/500 [==============================] - 1s - loss: 3.3730 - val_loss: 1.4300 Epoch 319/500 500/500 [==============================] - 1s - loss: 3.4524 - val_loss: 1.1916 Epoch 320/500 500/500 [==============================] - 1s - loss: 3.3216 - val_loss: 1.0728 Epoch 321/500 500/500 [==============================] - 1s - loss: 3.1925 - val_loss: 0.9582 Epoch 322/500 500/500 [==============================] - 1s - loss: 3.1302 - val_loss: 1.0066 Epoch 323/500 500/500 [==============================] - 1s - loss: 3.0876 - val_loss: 1.3794 Epoch 324/500 500/500 [==============================] - 1s - loss: 3.0836 - val_loss: 1.1581 Epoch 325/500 500/500 [==============================] - 1s - loss: 3.2366 - val_loss: 1.3415 Epoch 326/500 500/500 [==============================] - 1s - loss: 3.1781 - val_loss: 1.0848 Epoch 327/500 500/500 [==============================] - 1s - loss: 3.1847 - val_loss: 1.3082 Epoch 328/500 500/500 [==============================] - 1s - loss: 3.1997 - val_loss: 1.3481 Epoch 329/500 500/500 [==============================] - 1s - loss: 3.1705 - val_loss: 1.2140 Epoch 330/500 500/500 [==============================] - 1s - loss: 3.2323 - val_loss: 0.9882 Epoch 331/500 500/500 [==============================] - 1s - loss: 3.2079 - val_loss: 1.4395 Epoch 332/500 500/500 [==============================] - 1s - loss: 3.3927 - val_loss: 1.2815 Epoch 333/500 500/500 [==============================] - 1s - loss: 3.2788 - val_loss: 1.3950 Epoch 334/500 500/500 [==============================] - 1s - loss: 3.2899 - val_loss: 1.3792 Epoch 335/500 500/500 [==============================] - 1s - loss: 3.2420 - val_loss: 1.1922 Epoch 336/500 500/500 [==============================] - 1s - loss: 3.2977 - val_loss: 1.1514 Epoch 337/500 500/500 [==============================] - 1s - loss: 3.0439 - val_loss: 0.9693 Epoch 338/500 500/500 [==============================] - 1s - loss: 3.0493 - val_loss: 1.3604 Epoch 339/500 500/500 [==============================] - 1s - loss: 3.3884 - val_loss: 1.5604 Epoch 340/500 500/500 [==============================] - 1s - loss: 3.6037 - val_loss: 1.6549 Epoch 341/500 500/500 [==============================] - 1s - loss: 3.5605 - val_loss: 1.3416 Epoch 342/500 500/500 [==============================] - 1s - loss: 3.4757 - val_loss: 2.0039 Epoch 343/500 500/500 [==============================] - 1s - loss: 3.5074 - val_loss: 1.1451 Epoch 344/500 500/500 [==============================] - 1s - loss: 3.2544 - val_loss: 1.1766 Epoch 345/500 500/500 [==============================] - 1s - loss: 3.0757 - val_loss: 1.5257 Epoch 346/500 500/500 [==============================] - 1s - loss: 3.2114 - val_loss: 1.3101 Epoch 347/500 500/500 [==============================] - 1s - loss: 3.2737 - val_loss: 1.5882 Epoch 348/500 500/500 [==============================] - 1s - loss: 3.3171 - val_loss: 1.1697 Epoch 349/500 500/500 [==============================] - 1s - loss: 3.0213 - val_loss: 1.2819 Epoch 350/500 500/500 [==============================] - 1s - loss: 3.0606 - val_loss: 0.9880 Epoch 351/500 500/500 [==============================] - 1s - loss: 3.0650 - val_loss: 1.3208 Epoch 352/500 500/500 [==============================] - 1s - loss: 3.1045 - val_loss: 1.3940 Epoch 353/500 500/500 [==============================] - 1s - loss: 3.2777 - val_loss: 1.4500 Epoch 354/500 500/500 [==============================] - 1s - loss: 3.2692 - val_loss: 1.1134 Epoch 355/500 500/500 [==============================] - 1s - loss: 3.1557 - val_loss: 1.3617 Epoch 356/500 500/500 [==============================] - 1s - loss: 3.1645 - val_loss: 1.5315 Epoch 357/500 500/500 [==============================] - 1s - loss: 3.2510 - val_loss: 1.1977 Epoch 358/500 500/500 [==============================] - 1s - loss: 3.2341 - val_loss: 1.3880 Epoch 359/500 500/500 [==============================] - 1s - loss: 3.2242 - val_loss: 1.0072 Epoch 360/500 500/500 [==============================] - 1s - loss: 3.0256 - val_loss: 1.0613 Epoch 361/500 500/500 [==============================] - 1s - loss: 3.0052 - val_loss: 1.1863 Epoch 362/500 500/500 [==============================] - 1s - loss: 2.9494 - val_loss: 1.5005 Epoch 363/500 500/500 [==============================] - 1s - loss: 3.1848 - val_loss: 0.9270 Epoch 364/500 500/500 [==============================] - 1s - loss: 3.0877 - val_loss: 1.1687 Epoch 365/500 500/500 [==============================] - 1s - loss: 3.0506 - val_loss: 0.9988 Epoch 366/500 500/500 [==============================] - 1s - loss: 2.9690 - val_loss: 1.1543 Epoch 367/500 500/500 [==============================] - 1s - loss: 3.0979 - val_loss: 1.2624 Epoch 368/500 500/500 [==============================] - 1s - loss: 3.0079 - val_loss: 1.1323 Epoch 369/500 500/500 [==============================] - 1s - loss: 3.0521 - val_loss: 1.2321 Epoch 370/500 500/500 [==============================] - 1s - loss: 3.0867 - val_loss: 1.1142 Epoch 371/500 500/500 [==============================] - 1s - loss: 2.9492 - val_loss: 0.9846 Epoch 372/500 500/500 [==============================] - 1s - loss: 2.9953 - val_loss: 0.9794 Epoch 373/500 500/500 [==============================] - 1s - loss: 3.1030 - val_loss: 1.2909 Epoch 374/500 500/500 [==============================] - 1s - loss: 3.1844 - val_loss: 1.0073 Epoch 375/500 500/500 [==============================] - 1s - loss: 3.0648 - val_loss: 1.2751 Epoch 376/500 500/500 [==============================] - 1s - loss: 3.0570 - val_loss: 1.0687 Epoch 377/500 500/500 [==============================] - 1s - loss: 2.9099 - val_loss: 0.9214 Epoch 378/500 500/500 [==============================] - 1s - loss: 2.8927 - val_loss: 0.9752 Epoch 379/500 500/500 [==============================] - 1s - loss: 2.7753 - val_loss: 0.8077 Epoch 380/500 500/500 [==============================] - 1s - loss: 2.7440 - val_loss: 0.8956 Epoch 381/500 500/500 [==============================] - 1s - loss: 2.7609 - val_loss: 1.0479 Epoch 382/500 500/500 [==============================] - 1s - loss: 2.7874 - val_loss: 0.8562 Epoch 383/500 500/500 [==============================] - 1s - loss: 2.7265 - val_loss: 0.6732 Epoch 384/500 500/500 [==============================] - 1s - loss: 2.7713 - val_loss: 1.0092 Epoch 385/500 500/500 [==============================] - 1s - loss: 2.8485 - val_loss: 1.0239 Epoch 386/500 500/500 [==============================] - 1s - loss: 2.8394 - val_loss: 1.0833 Epoch 387/500 500/500 [==============================] - 1s - loss: 2.8544 - val_loss: 1.2758 Epoch 388/500 500/500 [==============================] - 1s - loss: 2.9453 - val_loss: 0.9304 Epoch 389/500 500/500 [==============================] - 1s - loss: 2.8345 - val_loss: 0.9291 Epoch 390/500 500/500 [==============================] - 1s - loss: 2.8187 - val_loss: 1.1854 Epoch 391/500 500/500 [==============================] - 1s - loss: 2.7440 - val_loss: 0.8075 Epoch 392/500 500/500 [==============================] - 1s - loss: 2.6701 - val_loss: 0.8387 Epoch 393/500 500/500 [==============================] - 1s - loss: 2.8044 - val_loss: 0.8178 Epoch 394/500 500/500 [==============================] - 1s - loss: 2.8569 - val_loss: 1.1718 Epoch 395/500 500/500 [==============================] - 1s - loss: 2.9057 - val_loss: 1.0679 Epoch 396/500 500/500 [==============================] - 1s - loss: 2.9336 - val_loss: 1.3327 Epoch 397/500 500/500 [==============================] - 1s - loss: 2.9622 - val_loss: 1.0381 Epoch 398/500 500/500 [==============================] - 1s - loss: 2.8567 - val_loss: 1.0641 Epoch 399/500 500/500 [==============================] - 1s - loss: 3.0400 - val_loss: 1.2560 Epoch 400/500 500/500 [==============================] - 1s - loss: 2.8940 - val_loss: 1.0361 Epoch 401/500 500/500 [==============================] - 1s - loss: 2.7723 - val_loss: 1.0377 Epoch 402/500 500/500 [==============================] - 1s - loss: 2.7850 - val_loss: 1.0826 Epoch 403/500 500/500 [==============================] - 1s - loss: 2.8017 - val_loss: 0.8878 Epoch 404/500 500/500 [==============================] - 1s - loss: 2.7510 - val_loss: 0.8614 Epoch 405/500 500/500 [==============================] - 1s - loss: 2.8098 - val_loss: 0.9802 Epoch 406/500 500/500 [==============================] - 1s - loss: 2.9680 - val_loss: 1.1796 Epoch 407/500 500/500 [==============================] - 1s - loss: 2.7935 - val_loss: 0.9946 Epoch 408/500 500/500 [==============================] - 1s - loss: 2.9327 - val_loss: 1.4287 Epoch 409/500 500/500 [==============================] - 1s - loss: 2.9698 - val_loss: 1.0838 Epoch 410/500 500/500 [==============================] - 1s - loss: 2.8139 - val_loss: 0.7942 Epoch 411/500 500/500 [==============================] - 1s - loss: 2.6702 - val_loss: 0.9439 Epoch 412/500 500/500 [==============================] - 1s - loss: 2.6510 - val_loss: 0.7810 Epoch 413/500 500/500 [==============================] - 1s - loss: 2.6641 - val_loss: 0.8238 Epoch 414/500 500/500 [==============================] - 1s - loss: 2.7782 - val_loss: 1.1202 Epoch 415/500 500/500 [==============================] - 1s - loss: 2.9678 - val_loss: 1.1215 Epoch 416/500 500/500 [==============================] - 1s - loss: 2.7939 - val_loss: 0.9038 Epoch 417/500 500/500 [==============================] - 1s - loss: 2.8002 - val_loss: 1.2477 Epoch 418/500 500/500 [==============================] - 1s - loss: 2.9498 - val_loss: 1.2322 Epoch 419/500 500/500 [==============================] - 1s - loss: 2.8769 - val_loss: 1.0341 Epoch 420/500 500/500 [==============================] - 1s - loss: 2.8150 - val_loss: 1.0834 Epoch 421/500 500/500 [==============================] - 1s - loss: 2.7527 - val_loss: 1.0528 Epoch 422/500 500/500 [==============================] - 1s - loss: 2.8166 - val_loss: 1.1400 Epoch 423/500 500/500 [==============================] - 1s - loss: 2.9064 - val_loss: 1.0067 Epoch 424/500 500/500 [==============================] - 1s - loss: 2.6595 - val_loss: 1.0117 Epoch 425/500 500/500 [==============================] - 1s - loss: 2.8324 - val_loss: 1.1863 Epoch 426/500 500/500 [==============================] - 1s - loss: 2.8581 - val_loss: 1.1083 Epoch 427/500 500/500 [==============================] - 1s - loss: 2.8051 - val_loss: 0.8193 Epoch 428/500 500/500 [==============================] - 1s - loss: 2.5928 - val_loss: 1.0478 Epoch 429/500 500/500 [==============================] - 1s - loss: 2.7161 - val_loss: 0.8672 Epoch 430/500 500/500 [==============================] - 1s - loss: 2.7581 - val_loss: 1.2649 Epoch 431/500 500/500 [==============================] - 1s - loss: 2.8570 - val_loss: 1.2107 Epoch 432/500 500/500 [==============================] - 1s - loss: 2.9855 - val_loss: 1.2049 Epoch 433/500 500/500 [==============================] - 1s - loss: 2.8624 - val_loss: 1.0689 Epoch 434/500 500/500 [==============================] - 1s - loss: 2.7993 - val_loss: 1.5174 Epoch 435/500 500/500 [==============================] - 1s - loss: 2.9518 - val_loss: 1.0728 Epoch 436/500 500/500 [==============================] - 1s - loss: 3.0064 - val_loss: 1.2256 Epoch 437/500 500/500 [==============================] - 1s - loss: 2.9413 - val_loss: 0.8973 Epoch 438/500 500/500 [==============================] - 1s - loss: 2.8198 - val_loss: 1.1681 Epoch 439/500 500/500 [==============================] - 1s - loss: 2.6616 - val_loss: 0.8427 Epoch 440/500 500/500 [==============================] - 1s - loss: 2.6762 - val_loss: 1.1082 Epoch 441/500 500/500 [==============================] - 1s - loss: 2.7853 - val_loss: 0.9196 Epoch 442/500 500/500 [==============================] - 1s - loss: 2.7146 - val_loss: 1.1087 Epoch 443/500 500/500 [==============================] - 1s - loss: 2.7808 - val_loss: 1.0361 Epoch 444/500 500/500 [==============================] - 1s - loss: 2.7023 - val_loss: 0.9198 Epoch 445/500 500/500 [==============================] - 1s - loss: 2.7801 - val_loss: 1.1487 Epoch 446/500 500/500 [==============================] - 1s - loss: 2.9748 - val_loss: 0.9606 Epoch 447/500 500/500 [==============================] - 1s - loss: 2.8379 - val_loss: 1.0124 Epoch 448/500 500/500 [==============================] - 1s - loss: 2.7821 - val_loss: 0.9282 Epoch 449/500 500/500 [==============================] - 1s - loss: 2.6463 - val_loss: 1.1668 Epoch 450/500 500/500 [==============================] - 1s - loss: 2.7363 - val_loss: 0.8944 Epoch 451/500 500/500 [==============================] - 1s - loss: 2.7149 - val_loss: 1.1372 Epoch 452/500 500/500 [==============================] - 1s - loss: 2.7972 - val_loss: 1.0422 Epoch 453/500 500/500 [==============================] - 1s - loss: 2.9121 - val_loss: 0.9869 Epoch 454/500 500/500 [==============================] - 1s - loss: 2.8324 - val_loss: 0.9611 Epoch 455/500 500/500 [==============================] - 1s - loss: 2.6154 - val_loss: 0.9452 Epoch 456/500 500/500 [==============================] - 1s - loss: 2.7626 - val_loss: 0.9421 Epoch 457/500 500/500 [==============================] - 1s - loss: 2.6960 - val_loss: 1.2721 Epoch 458/500 500/500 [==============================] - 1s - loss: 2.9348 - val_loss: 1.1670 Epoch 459/500 500/500 [==============================] - 1s - loss: 2.7938 - val_loss: 0.9307 Epoch 460/500 500/500 [==============================] - 1s - loss: 2.7965 - val_loss: 0.9277 Epoch 461/500 500/500 [==============================] - 1s - loss: 2.5116 - val_loss: 1.1485 Epoch 462/500 500/500 [==============================] - 1s - loss: 2.7482 - val_loss: 1.1774 Epoch 463/500 500/500 [==============================] - 1s - loss: 2.8449 - val_loss: 0.8904 Epoch 464/500 500/500 [==============================] - 1s - loss: 2.8624 - val_loss: 1.2008 Epoch 465/500 500/500 [==============================] - 1s - loss: 2.8798 - val_loss: 1.0452 Epoch 466/500 500/500 [==============================] - 1s - loss: 2.6510 - val_loss: 0.9477 Epoch 467/500 500/500 [==============================] - 1s - loss: 2.7047 - val_loss: 1.3045 Epoch 468/500 500/500 [==============================] - 1s - loss: 2.9081 - val_loss: 1.2746 Epoch 469/500 500/500 [==============================] - 1s - loss: 2.8157 - val_loss: 1.2106 Epoch 470/500 500/500 [==============================] - 1s - loss: 2.7818 - val_loss: 1.6937 Epoch 471/500 500/500 [==============================] - 1s - loss: 2.8250 - val_loss: 1.1361 Epoch 472/500 500/500 [==============================] - 1s - loss: 2.6816 - val_loss: 1.1325 Epoch 473/500 500/500 [==============================] - 1s - loss: 2.8659 - val_loss: 1.1268 Epoch 474/500 500/500 [==============================] - 1s - loss: 2.7532 - val_loss: 1.0626 Epoch 475/500 500/500 [==============================] - 1s - loss: 2.7380 - val_loss: 1.6342 Epoch 476/500 500/500 [==============================] - 1s - loss: 2.9656 - val_loss: 1.1002 Epoch 477/500 500/500 [==============================] - 1s - loss: 2.6675 - val_loss: 0.9056 Epoch 478/500 500/500 [==============================] - 1s - loss: 2.6789 - val_loss: 0.9996 Epoch 479/500 500/500 [==============================] - 1s - loss: 2.6139 - val_loss: 0.8488 Epoch 480/500 500/500 [==============================] - 1s - loss: 2.6518 - val_loss: 1.1997 Epoch 481/500 500/500 [==============================] - 1s - loss: 2.5539 - val_loss: 1.0100 Epoch 482/500 500/500 [==============================] - 1s - loss: 2.5982 - val_loss: 0.8822 Epoch 483/500 500/500 [==============================] - 1s - loss: 2.7610 - val_loss: 0.9569 Epoch 484/500 500/500 [==============================] - 1s - loss: 2.6718 - val_loss: 0.8928 Epoch 485/500 500/500 [==============================] - 1s - loss: 2.5639 - val_loss: 1.0198 Epoch 486/500 500/500 [==============================] - 1s - loss: 2.7998 - val_loss: 1.2749 Epoch 487/500 500/500 [==============================] - 1s - loss: 2.7768 - val_loss: 1.2442 Epoch 488/500 500/500 [==============================] - 1s - loss: 2.9754 - val_loss: 1.1099 Epoch 489/500 500/500 [==============================] - 1s - loss: 2.7664 - val_loss: 1.2537 Epoch 490/500 500/500 [==============================] - 1s - loss: 2.7629 - val_loss: 1.0294 Epoch 491/500 500/500 [==============================] - 1s - loss: 2.6245 - val_loss: 1.1686 Epoch 492/500 500/500 [==============================] - 1s - loss: 2.5552 - val_loss: 0.9612 Epoch 493/500 500/500 [==============================] - 1s - loss: 2.5345 - val_loss: 1.1487 Epoch 494/500 500/500 [==============================] - 1s - loss: 2.5948 - val_loss: 1.2097 Epoch 495/500 500/500 [==============================] - 1s - loss: 2.5864 - val_loss: 0.9257 Epoch 496/500 500/500 [==============================] - 1s - loss: 2.7105 - val_loss: 0.7400 Epoch 497/500 500/500 [==============================] - 1s - loss: 2.5360 - val_loss: 0.9044 Epoch 498/500 500/500 [==============================] - 1s - loss: 2.6540 - val_loss: 1.1479 Epoch 499/500 500/500 [==============================] - 1s - loss: 2.6447 - val_loss: 0.8514 Epoch 500/500 500/500 [==============================] - 1s - loss: 2.5779 - val_loss: 1.1611 CPU times: user 2h 11min 39s, sys: 19min 54s, total: 2h 31min 34s Wall time: 14min 37s
plt.plot(history.history['val_loss'], label = 'Validation loss')
plt.plot(history.history['loss'], label = 'Training loss')
plt.ylabel("Squared error")
plt.xlabel("Epoch")
plt.ylim([0,50])
plt.legend();
Great! I say, at the level of trusting their data, these results are reproducible!