Kaggle的First Steps With Julia比賽是一個圖像的分類問題。這些字符圖像來自Chars74k數據集的一個子集。這個比賽通常作為如何使用Julia語言的教程,但這我們將透過Keras來建構一個卷積神經網絡(CNN)並使用圖像增強的手法來強化模型的辨識能力。
首先,你必須先從Kaggle下載Julia(Chars74K)相關數據並在解壓縮到本機的特定檔案目錄。
# 資料預處理 (Data Preprocessing)
import os
import glob
import pandas as pd
import math
import numpy as np
from scipy.misc import imread, imsave, imresize
from natsort import natsorted
訓練和測試資料集中幾乎所有圖像都是彩色圖像。預處理的第一步是將所有圖像轉換為灰階。它簡化了輸入到網絡的數據,也讓模型更能夠一般化(generalize),因為一個藍色的字母與一個紅色字母在這個圖像的分類問題上都是相同的。因此把圖像顏色的通道(channel)進行縮減的這個預處理應該對最終的準確性沒有負面影響,因為大多數文本與背景具有高度對比。
由於圖像具有不同的形狀和大小,因此我們必須對圖像進行歸一化(normalize)處理以便可以決定模型的輸入。這個處理會有兩個主要的問題需要解決:我們選擇哪種圖像大小(size)?我們是否該保持圖像寬高比(aspect ratio)?
起初,我也認為保持圖像的高寬比會更好,因為它不會任意扭曲圖像。這也可能導致O和O(大寫o和零)之間的混淆。不過,經過一番測試,似乎沒有保持寬高比的模型效果更好。
關於圖像尺寸,16×16的圖像允許非常快速的訓練,但不能給出最好的結果。這些小圖像是快速測試想法的完美選擇。使用32×32的圖像使訓練相當快,並提供良好的準確性。最後,與32×32圖像相比,使用64×64圖像使得訓練相當緩慢並略微提高了結果。我選擇使用32×32的圖像,因為它是速度和準確性之間的最佳折衷。
# 圖像資料的檔案路徑
path = "data"
# 圖像轉換後的目標大小 (32像素 x 32像素)
img_height, img_width = 32, 32
# 轉換圖像後的儲存目錄
suffix = "Preproc"
trainDataPath = path + "/train" + suffix
testDataPath = path + "/test" + suffix
# 產生目錄
if not os.path.exists(trainDataPath):
os.makedirs(trainDataPath)
if not os.path.exists(testDataPath):
os.makedirs(testDataPath)
### 圖像大小與圖像的色彩的預處理 ###
for datasetType in ["train","test"]:
# 透過natsorted可以讓回傳的檔案名稱的排序
imgFiles = natsorted(glob.glob(path + "/" + datasetType + "/*"))
# 初始一個ndarray物件來暫存讀進來的圖像資料
imgData = np.zeros((len(imgFiles), img_height, img_width))
# 使用迴圈來處理每一筆圖像檔
for i, imgFilePath in enumerate(imgFiles):
# 圖像的色彩 (Image Color)處理
img = imread(imgFilePath, True) # True: 代表讀取圖像時順便將多階圖像, 打平成灰階(單一通道:one channel)
# 圖像大小的修改 (Image Resizing)
imgResized = imresize(img, (img_height, img_width))
# 把圖像資料儲放在暫存記憶體中
imgData[i] = imgResized
# 將修改的圖像儲存到檔案系統 (方便視覺化了解)
filename = os.path.basename(imgFilePath)
filenameDotSplit = filename.split(".")
newFilename = str(int(filenameDotSplit[0])).zfill(5) + "." + filenameDotSplit[-1].lower()
newFilepath = path + "/" + datasetType + suffix + "/" + newFilename
imsave(newFilepath, imgResized)
# 新增加"Channel"的維度
print("Before: ", imgData.shape)
imgData = imgData[:,:,:,np.newaxis] # 改變前: []
print("After: ", imgData.shape)
# 進行資料(pixel值)標準化
imgData = imgData.astype('float32')/255
# 以numpy物件將圖像轉換後的ndarray物件保存在檔案系統中
np.save(path + "/" + datasetType + suffix + ".npy", imgData)
我們也必須將字符的標籤進行one-hot編碼的轉換。將標籤信息提供給CNN神經網絡是必要的。這個過程包括了兩個步驟。 首先,我們將字符轉換為連續整數。由於要預測的字符是[0~9],[a~z]及[A~Z]共有62個字符, 所以我們將把每個字符 對應到[0~61]的整數。
再來,我們將每個對應到某個字符的整數值去進行one-hot的編碼轉換成為一個向量。
# 標籤轉換 (Label Conversion)
import keras
def label2int(ch):
asciiVal = ord(ch)
if(asciiVal<=57): #0-9
asciiVal-=48
elif(asciiVal<=90): #A-Z
asciiVal-=55
else: #a-z
asciiVal-=61
return asciiVal
def int2label(i):
if(i<=9): #0-9
i+=48
elif(i<=35): #A-Z
i+=55
else: #a-z
i+=61
return chr(i)
# 圖像資料的檔案路徑
path = "data"
# 載入標籤資料
y_train = pd.read_csv(path + "/trainLabels.csv").values[:,1] #只保留"標籤資料"欄
# 對標籤(Label)進行one-hot編碼
Y_train = np.zeros((y_train.shape[0], 62)) # A-Z, a-z, 0-9共有62個類別
for i in range(y_train.shape[0]):
Y_train[i][label2int(y_train[i])] = 1 # One-hot
# 把轉換過的標籤(Label)資料保存在檔案系統便於後續的快速載入與處理
np.save(path + "/" + "labelsPreproc.npy", Y_train)
Using TensorFlow backend.
這次我們要對於訓練數據的使用手法上有一些不同,主要的是想要應用一些圖像增強的技術來人為地增加“新”圖像到訓練資料集中。增量是對於原始的圖像進行一些隨機變換以產生新的圖像。這些轉換可以是縮放,旋轉,位移..等或所有這些的組合。
方便的是,Keras中有一個圖像增強類別:ImageDataGenerator 可以讓我們很輕鬆地就達成任務
ImageDataGenerator構建函數需要幾個參數來定義我們想要使用的增強效果。我只會通過對我們的案例有用的參數進行設定,如果您需要對您的圖像進行其他修改,請參閱Keras文檔。
featurewise_center
,featurewise_std_normalization
和zca_whitening
不使用,因為在本案例裡它們不會增加網絡的性能。如果你想測試這些選項,一定要合適地計算相關的數量,並將這些修改應用到你的測試集中進行標準化。rotation_range
20左右的值效果最好。width_shift_range
0.15左右的值效果最好。height_shift_range
0.15左右的值效果最好。shear_range 0.4
左右的值效果最好。zoom_range 0.3
左右的值效果最好。channel_shift_range
0.1左右的值效果最好。當然,我沒有測試所有的組合,所以可能還有其他值的組合可以用來提高最終的準確度。但要小心,太多的增量(高參數值)會使學習變得緩慢甚至跑不出來。
這個模型與Florian Muellerklein非常相似。我在卷積層設定了zero-padding,並增加了密集層的大小。Dropout設定為0.5。
這個模型給出了最好的結果,但是學習起來很慢很花時間。通過將所有濾波器數量和密集的圖層大小除以2或4,您也可以得到很好的結果。 較小的網絡對於測試不同的超參數非常有用。值得注意的是,增加網絡的規模確實提高了驗證的準確性,但也成倍地增加了模型學習的時間。
我也嘗試添加一些圖層,但產生的網絡難以收斂,並沒有給出好的結果。
對於模型的訓練,我使用了分類交叉熵(cross-entropy)作為損失函數(loss function),最後一層使用softmax的激勵函數。
在這個模型裡我選擇使用AdaMax
和AdaDelta
來作為優化器(optimizer),而不是使用經典的隨機梯度下降(SGD)算法。
同時我發現AdaMax
比AdaDelta
在這個問題上會給出更好的結果。
但是,對於具有眾多濾波器和大型完全連接層的複雜網絡,AdaMax在訓練循環不太收斂,甚至無法完全收斂。因此在這次的網絡訓練過程我拆成二個階段。
第一個階段,我先使用AdaDelta
進行了20個循環的前期訓練為的是要比較快速的幫忙卷積網絡的模型收斂。第二個階段,則利用AdaMax
來進行更多訓練循環與更細微的修正來得到更好的模型。
如果將網絡的大小除以2,則不需要使用該策略。
在保持訓練循環次數不變的同時,我試圖改變每次訓練循環的批量大小(batch size)。大的批量(batch)會使算法運行速度更快,但結果效能不佳。 這可能是因為在相同數量的數據量下,更大的批量意味著更少的模型權重的更新。無論如何,在這個範例中最好的結果是在批量(batch size) 設成 128的情況下達到的。
如果網絡未正確初始化,則優化算法可能無法找到最佳值。我發現使用he_normal
來進行初始化會使模型的學習變得更容易。在Keras中,你只需要為每一層使用kernel_initializer='he_normal'
參數。
在訓練期間逐漸降低學習率(learning rate)通常是一個好主意。它允許算法微調參數,並接近局部最小值。
但是,我發現使用AdaMax
的optimizer,在沒有設定學習速率衰減的情況下結果更好,所以我們現在不必擔心。
使用128的批量大小,沒有學習速度衰減,我測試了200到500個訓練循環。即使運行到第500個訓練循環,整個網絡模型似乎也沒出現過擬合(overfitting)的情形。 我想這肯定要歸功於Dropout的設定發揮了功效。我發現500個訓練循環的結果比300個訓練循環略好。最後的模型我用了500個訓練循環,但是如果你在CPU上運行,300個訓練循環應該就足夠了。
為了評估不同模型的質量和超參數的影響,我使用了蒙特卡洛交叉驗證:我隨機分配了初始數據1/4進行驗證,並將3/4進行學習。 我還使用分裂技術,確保在我們的例子中,每個類別約有1/4圖像出現在測試集中。這導致更穩定的驗證分數。
import numpy as np
import os
from keras.preprocessing.image import ImageDataGenerator
from keras.models import Sequential
from keras.layers.core import Dense, Dropout, Activation, Flatten
from keras.layers.convolutional import Convolution2D, MaxPooling2D
from keras.callbacks import ModelCheckpoint
from sklearn.model_selection import train_test_split
batch_size = 128 # 訓練批次量 (Batch Size)
nb_classes = 62 # A-Z, a-z, 0-9共有62個類別
nb_epoch = 500 # 進行500個訓練循環
# Input image dimensions
# 要輸入到第一層網絡的圖像大小 (32像素 x 32像素)
img_height, img_width = 32, 32
# 相關資料的路徑
path = "data/"
# 載入預處理好的訓練資料與標籤
X_train_all = np.load(path+"/trainPreproc.npy")
Y_train_all = np.load(path+"/labelsPreproc.npy")
# 將資料區分為訓練資料集與驗證資料集
X_train, X_val, Y_train, Y_val = train_test_split(X_train_all, Y_train_all, test_size=0.25, stratify=np.argmax(Y_train_all, axis=1))
# 設定圖像增強(data augmentation)的設定
datagen = ImageDataGenerator(
rotation_range = 20,
width_shift_range = 0.15,
height_shift_range = 0.15,
shear_range = 0.4,
zoom_range = 0.3,
channel_shift_range = 0.1)
### 卷積網絡模型架構 ###
model = Sequential()
model.add(Convolution2D(128,(3, 3), padding='same', kernel_initializer='he_normal', activation='relu',
input_shape=(img_height, img_width, 1)))
model.add(Convolution2D(128,(3, 3), padding='same', kernel_initializer='he_normal', activation='relu'))
model.add(MaxPooling2D(pool_size=(2, 2)))
model.add(Convolution2D(256,(3, 3), padding='same', kernel_initializer='he_normal', activation='relu'))
model.add(Convolution2D(256,(3, 3), padding='same', kernel_initializer='he_normal', activation='relu'))
model.add(MaxPooling2D(pool_size=(2, 2)))
model.add(Convolution2D(512,(3, 3), padding='same', kernel_initializer='he_normal', activation='relu'))
model.add(Convolution2D(512,(3, 3), padding='same', kernel_initializer='he_normal', activation='relu'))
model.add(Convolution2D(512,(3, 3), padding='same', kernel_initializer='he_normal', activation='relu'))
model.add(MaxPooling2D(pool_size=(2, 2)))
model.add(Flatten())
model.add(Dense(4096, kernel_initializer='he_normal', activation='relu'))
model.add(Dropout(0.5))
model.add(Dense(4096, kernel_initializer='he_normal', activation='relu'))
model.add(Dropout(0.5))
model.add(Dense(nb_classes, kernel_initializer='he_normal', activation='softmax'))
# 展現整個模型架構
model.summary()
_________________________________________________________________ Layer (type) Output Shape Param # ================================================================= conv2d_1 (Conv2D) (None, 32, 32, 128) 1280 _________________________________________________________________ conv2d_2 (Conv2D) (None, 32, 32, 128) 147584 _________________________________________________________________ max_pooling2d_1 (MaxPooling2 (None, 16, 16, 128) 0 _________________________________________________________________ conv2d_3 (Conv2D) (None, 16, 16, 256) 295168 _________________________________________________________________ conv2d_4 (Conv2D) (None, 16, 16, 256) 590080 _________________________________________________________________ max_pooling2d_2 (MaxPooling2 (None, 8, 8, 256) 0 _________________________________________________________________ conv2d_5 (Conv2D) (None, 8, 8, 512) 1180160 _________________________________________________________________ conv2d_6 (Conv2D) (None, 8, 8, 512) 2359808 _________________________________________________________________ conv2d_7 (Conv2D) (None, 8, 8, 512) 2359808 _________________________________________________________________ max_pooling2d_3 (MaxPooling2 (None, 4, 4, 512) 0 _________________________________________________________________ flatten_1 (Flatten) (None, 8192) 0 _________________________________________________________________ dense_1 (Dense) (None, 4096) 33558528 _________________________________________________________________ dropout_1 (Dropout) (None, 4096) 0 _________________________________________________________________ dense_2 (Dense) (None, 4096) 16781312 _________________________________________________________________ dropout_2 (Dropout) (None, 4096) 0 _________________________________________________________________ dense_3 (Dense) (None, 62) 254014 ================================================================= Total params: 57,527,742 Trainable params: 57,527,742 Non-trainable params: 0 _________________________________________________________________
### 模型訓練學習 ###
# 首先使用AdaDelta來做第一階段的訓練, 因為AdaMax會無卡住
model.compile(loss='categorical_crossentropy',
optimizer='adadelta',
metrics=["accuracy"])
# 進行20循環就足夠了
model.fit(X_train, Y_train, batch_size=batch_size,
epochs=20,
validation_data=(X_val, Y_val),
verbose=1)
# 接著改用AdaMax
model.compile(loss='categorical_crossentropy',
optimizer='adamax',
metrics=["accuracy"])
# 我們想要保存在訓練過程中驗證結果比較好的模型
saveBestModel = ModelCheckpoint("best.kerasModelWeights", monitor='val_acc', verbose=1, save_best_only=True, save_weights_only=True)
# 在訓練的過程透過ImageDataGenerator來持續產生圖像資料
history = model.fit_generator(datagen.flow(X_train, Y_train, batch_size=batch_size),
steps_per_epoch=len(X_train)/batch_size,
epochs=nb_epoch,
validation_data=(X_val, Y_val),
callbacks=[saveBestModel],
verbose=1)
### 進行預測 ###
# 載入訓練過程中驗證結果最好的模型
model.load_weights("best.kerasModelWeights")
# 載入Kaggle測試資料集
X_test = np.load(path+"/testPreproc.npy")
# 預測字符的類別
Y_test_pred = model.predict_classes(X_test)
# 從類別的數字轉換為字符
vInt2label = np.vectorize(int2label)
Y_test_pred = vInt2label(Y_test_pred)
# 保存預測結果到檔案系統
np.savetxt(path+"/jular_pred" + ".csv", np.c_[range(6284,len(Y_test_pred)+6284),Y_test_pred], delimiter=',', header = 'ID,Class', comments = '', fmt='%s')
Train on 4712 samples, validate on 1571 samples Epoch 1/20 4712/4712 [==============================] - 7s 2ms/step - loss: 3.9692 - acc: 0.0548 - val_loss: 3.8141 - val_acc: 0.0535 Epoch 2/20 4712/4712 [==============================] - 4s 919us/step - loss: 3.8019 - acc: 0.0745 - val_loss: 3.6092 - val_acc: 0.1031 Epoch 3/20 4712/4712 [==============================] - 4s 925us/step - loss: 3.7895 - acc: 0.1089 - val_loss: 3.6961 - val_acc: 0.1254 Epoch 4/20 4712/4712 [==============================] - 4s 922us/step - loss: 3.0957 - acc: 0.2674 - val_loss: 2.3153 - val_acc: 0.3730 Epoch 5/20 4712/4712 [==============================] - 4s 926us/step - loss: 2.2733 - acc: 0.4185 - val_loss: 1.5714 - val_acc: 0.5659 Epoch 6/20 4712/4712 [==============================] - 4s 927us/step - loss: 1.6286 - acc: 0.5575 - val_loss: 1.7043 - val_acc: 0.5341 Epoch 7/20 4712/4712 [==============================] - 4s 925us/step - loss: 1.3224 - acc: 0.6382 - val_loss: 1.1770 - val_acc: 0.6677 Epoch 8/20 4712/4712 [==============================] - 4s 922us/step - loss: 1.0587 - acc: 0.7086 - val_loss: 1.0827 - val_acc: 0.6926 Epoch 9/20 4712/4712 [==============================] - 4s 923us/step - loss: 0.9026 - acc: 0.7421 - val_loss: 1.0253 - val_acc: 0.7053 Epoch 10/20 4712/4712 [==============================] - 4s 925us/step - loss: 0.7683 - acc: 0.7742 - val_loss: 0.9706 - val_acc: 0.7148 Epoch 11/20 4712/4712 [==============================] - 4s 925us/step - loss: 0.6277 - acc: 0.8079 - val_loss: 0.8502 - val_acc: 0.7575 Epoch 12/20 4712/4712 [==============================] - 4s 922us/step - loss: 0.5210 - acc: 0.8427 - val_loss: 0.9288 - val_acc: 0.7505 Epoch 13/20 4712/4712 [==============================] - 4s 929us/step - loss: 0.4484 - acc: 0.8553 - val_loss: 0.8608 - val_acc: 0.7836 Epoch 14/20 4712/4712 [==============================] - 4s 929us/step - loss: 0.3457 - acc: 0.8907 - val_loss: 0.8800 - val_acc: 0.7486 Epoch 15/20 4712/4712 [==============================] - 4s 925us/step - loss: 0.2642 - acc: 0.9174 - val_loss: 0.9797 - val_acc: 0.7721 Epoch 16/20 4712/4712 [==============================] - 4s 925us/step - loss: 0.2397 - acc: 0.9228 - val_loss: 1.0379 - val_acc: 0.7632 Epoch 17/20 4712/4712 [==============================] - 4s 926us/step - loss: 0.2042 - acc: 0.9310 - val_loss: 1.1407 - val_acc: 0.7467 Epoch 18/20 4712/4712 [==============================] - 4s 923us/step - loss: 0.1660 - acc: 0.9442 - val_loss: 1.1450 - val_acc: 0.7632 Epoch 19/20 4712/4712 [==============================] - 4s 922us/step - loss: 0.1479 - acc: 0.9531 - val_loss: 1.0959 - val_acc: 0.7721 Epoch 20/20 4712/4712 [==============================] - 4s 925us/step - loss: 0.1259 - acc: 0.9584 - val_loss: 1.1597 - val_acc: 0.7785 Epoch 1/500 36/36 [============================>.] - ETA: 0s - loss: 2.6030 - acc: 0.3466- ETA: 1s - loss: 2.8169 Epoch 00001: val_acc improved from -inf to 0.69637, saving model to best.kerasModelWeights 37/36 [==============================] - 8s 206ms/step - loss: 2.5830 - acc: 0.3501 - val_loss: 1.0911 - val_acc: 0.6964 Epoch 2/500 36/36 [============================>.] - ETA: 0s - loss: 1.8551 - acc: 0.497 - ETA: 0s - loss: 1.8574 - acc: 0.4967Epoch 00002: val_acc improved from 0.69637 to 0.75939, saving model to best.kerasModelWeights 37/36 [==============================] - 5s 133ms/step - loss: 1.8493 - acc: 0.4991 - val_loss: 0.9028 - val_acc: 0.7594 Epoch 3/500 36/36 [============================>.] - ETA: 0s - loss: 1.5711 - acc: 0.5669Epoch 00003: val_acc improved from 0.75939 to 0.77912, saving model to best.kerasModelWeights 37/36 [==============================] - 5s 133ms/step - loss: 1.5680 - acc: 0.5668 - val_loss: 0.7923 - val_acc: 0.7791 Epoch 4/500 36/36 [============================>.] - ETA: 0s - loss: 1.4082 - acc: 0.6021Epoch 00004: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 1.4037 - acc: 0.6033 - val_loss: 0.7607 - val_acc: 0.7721 Epoch 5/500 36/36 [============================>.] - ETA: 0s - loss: 1.3048 - acc: 0.6357Epoch 00005: val_acc improved from 0.77912 to 0.78358, saving model to best.kerasModelWeights 37/36 [==============================] - 5s 130ms/step - loss: 1.3034 - acc: 0.6354 - val_loss: 0.7554 - val_acc: 0.7836 Epoch 6/500 36/36 [============================>.] - ETA: 0s - loss: 1.2425 - acc: 0.6462- ETA: 1s - loss: 1.2638 - Epoch 00006: val_acc improved from 0.78358 to 0.80522, saving model to best.kerasModelWeights 37/36 [==============================] - 5s 131ms/step - loss: 1.2402 - acc: 0.6486 - val_loss: 0.7101 - val_acc: 0.8052 Epoch 7/500 36/36 [============================>.] - ETA: 0s - loss: 1.1642 - acc: 0.6638Epoch 00007: val_acc did not improve 37/36 [==============================] - 4s 106ms/step - loss: 1.1617 - acc: 0.6628 - val_loss: 0.7095 - val_acc: 0.7963 Epoch 8/500 36/36 [============================>.] - ETA: 0s - loss: 1.1017 - acc: 0.6788- ETA: Epoch 00008: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 1.1050 - acc: 0.6788 - val_loss: 0.7013 - val_acc: 0.7791 Epoch 9/500 36/36 [============================>.] - ETA: 0s - loss: 1.0698 - acc: 0.6914Epoch 00009: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 1.0717 - acc: 0.6918 - val_loss: 0.6647 - val_acc: 0.8052 Epoch 10/500 36/36 [============================>.] - ETA: 0s - loss: 0.9987 - acc: 0.7007Epoch 00010: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.9960 - acc: 0.7014 - val_loss: 0.6507 - val_acc: 0.7995 Epoch 11/500 36/36 [============================>.] - ETA: 0s - loss: 0.9989 - acc: 0.7063Epoch 00011: val_acc improved from 0.80522 to 0.81604, saving model to best.kerasModelWeights 37/36 [==============================] - 5s 131ms/step - loss: 0.9948 - acc: 0.7072 - val_loss: 0.6371 - val_acc: 0.8160 Epoch 12/500 36/36 [============================>.] - ETA: 0s - loss: 0.9585 - acc: 0.7235Epoch 00012: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.9563 - acc: 0.7238 - val_loss: 0.6774 - val_acc: 0.8097 Epoch 13/500 36/36 [============================>.] - ETA: 0s - loss: 0.9254 - acc: 0.7285Epoch 00013: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.9284 - acc: 0.7281 - val_loss: 0.6377 - val_acc: 0.8103 Epoch 14/500 36/36 [============================>.] - ETA: 0s - loss: 0.8643 - acc: 0.7444Epoch 00014: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.8717 - acc: 0.7435 - val_loss: 0.6371 - val_acc: 0.8084 Epoch 15/500 36/36 [============================>.] - ETA: 0s - loss: 0.8827 - acc: 0.7294Epoch 00015: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.8873 - acc: 0.7289 - val_loss: 0.6237 - val_acc: 0.8148 Epoch 16/500 36/36 [============================>.] - ETA: 0s - loss: 0.7999 - acc: 0.7495Epoch 00016: val_acc improved from 0.81604 to 0.82113, saving model to best.kerasModelWeights 37/36 [==============================] - 5s 134ms/step - loss: 0.8029 - acc: 0.7487 - val_loss: 0.6319 - val_acc: 0.8211 Epoch 17/500 36/36 [============================>.] - ETA: 0s - loss: 0.7998 - acc: 0.7536Epoch 00017: val_acc improved from 0.82113 to 0.82877, saving model to best.kerasModelWeights 37/36 [==============================] - 5s 133ms/step - loss: 0.7961 - acc: 0.7552 - val_loss: 0.6242 - val_acc: 0.8288 Epoch 18/500 36/36 [============================>.] - ETA: 0s - loss: 0.7705 - acc: 0.7561Epoch 00018: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.7742 - acc: 0.7555 - val_loss: 0.6713 - val_acc: 0.8052 Epoch 19/500 36/36 [============================>.] - ETA: 0s - loss: 0.7837 - acc: 0.7601Epoch 00019: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.7902 - acc: 0.7581 - val_loss: 0.6155 - val_acc: 0.8084 Epoch 20/500 36/36 [============================>.] - ETA: 0s - loss: 0.7709 - acc: 0.7578Epoch 00020: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.7647 - acc: 0.7597 - val_loss: 0.6137 - val_acc: 0.8148 Epoch 21/500 36/36 [============================>.] - ETA: 0s - loss: 0.7343 - acc: 0.7675Epoch 00021: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.7385 - acc: 0.7658 - val_loss: 0.6170 - val_acc: 0.8180 Epoch 22/500 36/36 [============================>.] - ETA: 0s - loss: 0.7017 - acc: 0.7788Epoch 00022: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.6998 - acc: 0.7791 - val_loss: 0.6357 - val_acc: 0.8129 Epoch 23/500 36/36 [============================>.] - ETA: 0s - loss: 0.7411 - acc: 0.7650Epoch 00023: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.7375 - acc: 0.7655 - val_loss: 0.6160 - val_acc: 0.8205 Epoch 24/500 36/36 [============================>.] - ETA: 0s - loss: 0.6815 - acc: 0.7855Epoch 00024: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.6805 - acc: 0.7856 - val_loss: 0.5630 - val_acc: 0.8230 Epoch 25/500 36/36 [============================>.] - ETA: 0s - loss: 0.6661 - acc: 0.7909- ETA: 1s - loss: 0.Epoch 00025: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.6637 - acc: 0.7909 - val_loss: 0.6000 - val_acc: 0.8281 Epoch 26/500 36/36 [============================>.] - ETA: 0s - loss: 0.6592 - acc: 0.7864Epoch 00026: val_acc improved from 0.82877 to 0.82941, saving model to best.kerasModelWeights 37/36 [==============================] - 5s 131ms/step - loss: 0.6618 - acc: 0.7863 - val_loss: 0.6078 - val_acc: 0.8294 Epoch 27/500 36/36 [============================>.] - ETA: 0s - loss: 0.6180 - acc: 0.7993Epoch 00027: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.6197 - acc: 0.7999 - val_loss: 0.6164 - val_acc: 0.8256 Epoch 28/500 36/36 [============================>.] - ETA: 0s - loss: 0.6200 - acc: 0.8053Epoch 00028: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.6244 - acc: 0.8038 - val_loss: 0.5762 - val_acc: 0.8288 Epoch 29/500 36/36 [============================>.] - ETA: 0s - loss: 0.6200 - acc: 0.8020Epoch 00029: val_acc improved from 0.82941 to 0.83450, saving model to best.kerasModelWeights 37/36 [==============================] - 5s 136ms/step - loss: 0.6226 - acc: 0.8021 - val_loss: 0.6069 - val_acc: 0.8345 Epoch 30/500 36/36 [============================>.] - ETA: 0s - loss: 0.6107 - acc: 0.8046Epoch 00030: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.6147 - acc: 0.8027 - val_loss: 0.6189 - val_acc: 0.8186 Epoch 31/500 36/36 [============================>.] - ETA: 0s - loss: 0.6057 - acc: 0.8039Epoch 00031: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.6005 - acc: 0.8056 - val_loss: 0.6189 - val_acc: 0.8199 Epoch 32/500 36/36 [============================>.] - ETA: 0s - loss: 0.5824 - acc: 0.8104Epoch 00032: val_acc improved from 0.83450 to 0.83641, saving model to best.kerasModelWeights 37/36 [==============================] - 5s 132ms/step - loss: 0.5820 - acc: 0.8108 - val_loss: 0.5929 - val_acc: 0.8364 Epoch 33/500 36/36 [============================>.] - ETA: 0s - loss: 0.5598 - acc: 0.8156Epoch 00033: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.5602 - acc: 0.8147 - val_loss: 0.6052 - val_acc: 0.8269 Epoch 34/500 36/36 [============================>.] - ETA: 0s - loss: 0.5470 - acc: 0.8197Epoch 00034: val_acc improved from 0.83641 to 0.84278, saving model to best.kerasModelWeights 37/36 [==============================] - 5s 136ms/step - loss: 0.5435 - acc: 0.8203 - val_loss: 0.5952 - val_acc: 0.8428 Epoch 35/500 36/36 [============================>.] - ETA: 0s - loss: 0.5618 - acc: 0.8136Epoch 00035: val_acc improved from 0.84278 to 0.84596, saving model to best.kerasModelWeights 37/36 [==============================] - 5s 132ms/step - loss: 0.5593 - acc: 0.8142 - val_loss: 0.5882 - val_acc: 0.8460 Epoch 36/500 36/36 [============================>.] - ETA: 0s - loss: 0.5228 - acc: 0.8258Epoch 00036: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.5215 - acc: 0.8255 - val_loss: 0.5652 - val_acc: 0.8370 Epoch 37/500 36/36 [============================>.] - ETA: 0s - loss: 0.5121 - acc: 0.8272Epoch 00037: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.5148 - acc: 0.8266 - val_loss: 0.5932 - val_acc: 0.8288 Epoch 38/500 36/36 [============================>.] - ETA: 0s - loss: 0.5238 - acc: 0.8277Epoch 00038: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.5244 - acc: 0.8273 - val_loss: 0.6155 - val_acc: 0.8421 Epoch 39/500 36/36 [============================>.] - ETA: 0s - loss: 0.5167 - acc: 0.8246Epoch 00039: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.5187 - acc: 0.8251 - val_loss: 0.5526 - val_acc: 0.8370 Epoch 40/500 36/36 [============================>.] - ETA: 0s - loss: 0.5076 - acc: 0.8307Epoch 00040: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.5086 - acc: 0.8294 - val_loss: 0.6106 - val_acc: 0.8326 Epoch 41/500 36/36 [============================>.] - ETA: 0s - loss: 0.4844 - acc: 0.8363Epoch 00041: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.4857 - acc: 0.8361 - val_loss: 0.5678 - val_acc: 0.8428 Epoch 42/500 36/36 [============================>.] - ETA: 0s - loss: 0.4839 - acc: 0.8400Epoch 00042: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.4856 - acc: 0.8393 - val_loss: 0.6495 - val_acc: 0.8192 Epoch 43/500 36/36 [============================>.] - ETA: 0s - loss: 0.4695 - acc: 0.8470Epoch 00043: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.4728 - acc: 0.8467 - val_loss: 0.5671 - val_acc: 0.8415 Epoch 44/500 36/36 [============================>.] - ETA: 0s - loss: 0.4726 - acc: 0.8438Epoch 00044: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.4741 - acc: 0.8429 - val_loss: 0.6026 - val_acc: 0.8358 Epoch 45/500 36/36 [============================>.] - ETA: 0s - loss: 0.4665 - acc: 0.8483Epoch 00045: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.4629 - acc: 0.8482 - val_loss: 0.5849 - val_acc: 0.8447 Epoch 46/500 36/36 [============================>.] - ETA: 0s - loss: 0.4731 - acc: 0.8429Epoch 00046: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.4768 - acc: 0.8423 - val_loss: 0.5976 - val_acc: 0.8345 Epoch 47/500 36/36 [============================>.] - ETA: 0s - loss: 0.4472 - acc: 0.8516Epoch 00047: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.4505 - acc: 0.8503 - val_loss: 0.6614 - val_acc: 0.8326 Epoch 48/500 36/36 [============================>.] - ETA: 0s - loss: 0.4258 - acc: 0.8563Epoch 00048: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.4277 - acc: 0.8556 - val_loss: 0.5981 - val_acc: 0.8415 Epoch 49/500 36/36 [============================>.] - ETA: 0s - loss: 0.4521 - acc: 0.8507Epoch 00049: val_acc improved from 0.84596 to 0.85551, saving model to best.kerasModelWeights 37/36 [==============================] - 5s 134ms/step - loss: 0.4540 - acc: 0.8505 - val_loss: 0.5959 - val_acc: 0.8555 Epoch 50/500 36/36 [============================>.] - ETA: 0s - loss: 0.4382 - acc: 0.8553Epoch 00050: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.4390 - acc: 0.8547 - val_loss: 0.5942 - val_acc: 0.8396 Epoch 51/500 36/36 [============================>.] - ETA: 0s - loss: 0.4236 - acc: 0.8584Epoch 00051: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.4224 - acc: 0.8592 - val_loss: 0.5962 - val_acc: 0.8269 Epoch 52/500 36/36 [============================>.] - ETA: 0s - loss: 0.4045 - acc: 0.8634Epoch 00052: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.4038 - acc: 0.8640 - val_loss: 0.6647 - val_acc: 0.8173 Epoch 53/500 36/36 [============================>.] - ETA: 0s - loss: 0.4034 - acc: 0.8602Epoch 00053: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.4040 - acc: 0.8600 - val_loss: 0.6517 - val_acc: 0.8300 Epoch 54/500 36/36 [============================>.] - ETA: 0s - loss: 0.4147 - acc: 0.8646- ETA: 2Epoch 00054: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.4152 - acc: 0.8644 - val_loss: 0.5769 - val_acc: 0.8345 Epoch 55/500 36/36 [============================>.] - ETA: 0s - loss: 0.4069 - acc: 0.8630Epoch 00055: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.4047 - acc: 0.8637 - val_loss: 0.5980 - val_acc: 0.8364 Epoch 56/500 36/36 [============================>.] - ETA: 0s - loss: 0.4194 - acc: 0.8605Epoch 00056: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.4205 - acc: 0.8598 - val_loss: 0.6209 - val_acc: 0.8358 Epoch 57/500 36/36 [============================>.] - ETA: 0s - loss: 0.4000 - acc: 0.8669Epoch 00057: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.4039 - acc: 0.8661 - val_loss: 0.6333 - val_acc: 0.8364 Epoch 58/500 36/36 [============================>.] - ETA: 0s - loss: 0.3950 - acc: 0.8596Epoch 00058: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.3916 - acc: 0.8615 - val_loss: 0.5998 - val_acc: 0.8332 Epoch 59/500 36/36 [============================>.] - ETA: 0s - loss: 0.3566 - acc: 0.8763Epoch 00059: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.3578 - acc: 0.8757 - val_loss: 0.5975 - val_acc: 0.8364 Epoch 60/500 36/36 [============================>.] - ETA: 0s - loss: 0.3827 - acc: 0.8743Epoch 00060: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.3805 - acc: 0.8747 - val_loss: 0.6034 - val_acc: 0.8428 Epoch 61/500 36/36 [============================>.] - ETA: 0s - loss: 0.3578 - acc: 0.8779Epoch 00061: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.3569 - acc: 0.8784 - val_loss: 0.6016 - val_acc: 0.8345 Epoch 62/500 36/36 [============================>.] - ETA: 0s - loss: 0.3528 - acc: 0.8749Epoch 00062: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.3520 - acc: 0.8751 - val_loss: 0.6642 - val_acc: 0.8358 Epoch 63/500 36/36 [============================>.] - ETA: 0s - loss: 0.3559 - acc: 0.8838Epoch 00063: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.3543 - acc: 0.8849 - val_loss: 0.6594 - val_acc: 0.8307 Epoch 64/500 36/36 [============================>.] - ETA: 0s - loss: 0.3746 - acc: 0.8724Epoch 00064: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.3744 - acc: 0.8729 - val_loss: 0.6113 - val_acc: 0.8460 Epoch 65/500 36/36 [============================>.] - ETA: 0s - loss: 0.3479 - acc: 0.8793Epoch 00065: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.3493 - acc: 0.8792 - val_loss: 0.6690 - val_acc: 0.8300 Epoch 66/500 36/36 [============================>.] - ETA: 0s - loss: 0.3414 - acc: 0.8800Epoch 00066: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.3418 - acc: 0.8795 - val_loss: 0.6082 - val_acc: 0.8415 Epoch 67/500 36/36 [============================>.] - ETA: 0s - loss: 0.3346 - acc: 0.8839Epoch 00067: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.3352 - acc: 0.8841 - val_loss: 0.5873 - val_acc: 0.8409 Epoch 68/500 36/36 [============================>.] - ETA: 0s - loss: 0.3649 - acc: 0.8779Epoch 00068: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.3633 - acc: 0.8781 - val_loss: 0.6274 - val_acc: 0.8339 Epoch 69/500 36/36 [============================>.] - ETA: 0s - loss: 0.3513 - acc: 0.8823Epoch 00069: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.3529 - acc: 0.8817 - val_loss: 0.6459 - val_acc: 0.8396 Epoch 70/500 36/36 [============================>.] - ETA: 0s - loss: 0.3364 - acc: 0.8819Epoch 00070: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.3337 - acc: 0.8832 - val_loss: 0.6746 - val_acc: 0.8377 Epoch 71/500 36/36 [============================>.] - ETA: 0s - loss: 0.3509 - acc: 0.8820Epoch 00071: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.3488 - acc: 0.8826 - val_loss: 0.6338 - val_acc: 0.8320 Epoch 72/500 36/36 [============================>.] - ETA: 0s - loss: 0.3196 - acc: 0.8923Epoch 00072: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.3228 - acc: 0.8916 - val_loss: 0.6401 - val_acc: 0.8339 Epoch 73/500 36/36 [============================>.] - ETA: 0s - loss: 0.3173 - acc: 0.8954Epoch 00073: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.3184 - acc: 0.8946 - val_loss: 0.6636 - val_acc: 0.8256 Epoch 74/500 36/36 [============================>.] - ETA: 0s - loss: 0.3132 - acc: 0.8882Epoch 00074: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.3150 - acc: 0.8876 - val_loss: 0.6343 - val_acc: 0.8402 Epoch 75/500 36/36 [============================>.] - ETA: 0s - loss: 0.2999 - acc: 0.8949Epoch 00075: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2974 - acc: 0.8959 - val_loss: 0.6262 - val_acc: 0.8472 Epoch 76/500 36/36 [============================>.] - ETA: 0s - loss: 0.3154 - acc: 0.8920Epoch 00076: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.3170 - acc: 0.8911 - val_loss: 0.6305 - val_acc: 0.8491 Epoch 77/500 36/36 [============================>.] - ETA: 0s - loss: 0.3252 - acc: 0.8847Epoch 00077: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.3240 - acc: 0.8845 - val_loss: 0.6638 - val_acc: 0.8409 Epoch 78/500 36/36 [============================>.] - ETA: 0s - loss: 0.3171 - acc: 0.8906Epoch 00078: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.3155 - acc: 0.8904 - val_loss: 0.6571 - val_acc: 0.8415 Epoch 79/500 36/36 [============================>.] - ETA: 0s - loss: 0.3110 - acc: 0.8961Epoch 00079: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.3118 - acc: 0.8968 - val_loss: 0.6333 - val_acc: 0.8358 Epoch 80/500 36/36 [============================>.] - ETA: 0s - loss: 0.3042 - acc: 0.8978Epoch 00080: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.3030 - acc: 0.8979 - val_loss: 0.6800 - val_acc: 0.8313 Epoch 81/500 36/36 [============================>.] - ETA: 0s - loss: 0.2977 - acc: 0.8976Epoch 00081: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2964 - acc: 0.8980 - val_loss: 0.6209 - val_acc: 0.8447 Epoch 82/500 36/36 [============================>.] - ETA: 0s - loss: 0.2819 - acc: 0.9005Epoch 00082: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.2880 - acc: 0.8977 - val_loss: 0.6263 - val_acc: 0.8358 Epoch 83/500 36/36 [============================>.] - ETA: 0s - loss: 0.3043 - acc: 0.8988Epoch 00083: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.3006 - acc: 0.9003 - val_loss: 0.6402 - val_acc: 0.8300 Epoch 84/500 36/36 [============================>.] - ETA: 0s - loss: 0.3073 - acc: 0.8977Epoch 00084: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.3102 - acc: 0.8958 - val_loss: 0.6481 - val_acc: 0.8402 Epoch 85/500 36/36 [============================>.] - ETA: 0s - loss: 0.2837 - acc: 0.9021Epoch 00085: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2843 - acc: 0.9028 - val_loss: 0.7099 - val_acc: 0.8326 Epoch 86/500 36/36 [============================>.] - ETA: 0s - loss: 0.2852 - acc: 0.8934Epoch 00086: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2827 - acc: 0.8946 - val_loss: 0.6542 - val_acc: 0.8313 Epoch 87/500 36/36 [============================>.] - ETA: 0s - loss: 0.2605 - acc: 0.9100Epoch 00087: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2603 - acc: 0.9099 - val_loss: 0.7248 - val_acc: 0.8339 Epoch 88/500 36/36 [============================>.] - ETA: 0s - loss: 0.2540 - acc: 0.9124Epoch 00088: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2527 - acc: 0.9126 - val_loss: 0.6729 - val_acc: 0.8281 Epoch 89/500 36/36 [============================>.] - ETA: 0s - loss: 0.2785 - acc: 0.9067Epoch 00089: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2762 - acc: 0.9071 - val_loss: 0.6409 - val_acc: 0.8434 Epoch 90/500 36/36 [============================>.] - ETA: 0s - loss: 0.2811 - acc: 0.9057Epoch 00090: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.2826 - acc: 0.9057 - val_loss: 0.6965 - val_acc: 0.8326 Epoch 91/500 36/36 [============================>.] - ETA: 0s - loss: 0.2762 - acc: 0.9053Epoch 00091: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2760 - acc: 0.9047 - val_loss: 0.6528 - val_acc: 0.8409 Epoch 92/500 36/36 [============================>.] - ETA: 0s - loss: 0.2481 - acc: 0.9175Epoch 00092: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2490 - acc: 0.9172 - val_loss: 0.7456 - val_acc: 0.8364 Epoch 93/500 36/36 [============================>.] - ETA: 0s - loss: 0.2682 - acc: 0.9093Epoch 00093: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.2645 - acc: 0.9103 - val_loss: 0.6381 - val_acc: 0.8300 Epoch 94/500 36/36 [============================>.] - ETA: 0s - loss: 0.2412 - acc: 0.9162Epoch 00094: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2456 - acc: 0.9149 - val_loss: 0.6466 - val_acc: 0.8307 Epoch 95/500 36/36 [============================>.] - ETA: 0s - loss: 0.2577 - acc: 0.9133Epoch 00095: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2563 - acc: 0.9135 - val_loss: 0.6787 - val_acc: 0.8396 Epoch 96/500 36/36 [============================>.] - ETA: 0s - loss: 0.2504 - acc: 0.9117Epoch 00096: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2493 - acc: 0.9118 - val_loss: 0.6961 - val_acc: 0.8294 Epoch 97/500 36/36 [============================>.] - ETA: 0s - loss: 0.2703 - acc: 0.9101Epoch 00097: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2702 - acc: 0.9102 - val_loss: 0.6318 - val_acc: 0.8313 Epoch 98/500 36/36 [============================>.] - ETA: 0s - loss: 0.2509 - acc: 0.9138Epoch 00098: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2536 - acc: 0.9138 - val_loss: 0.6765 - val_acc: 0.8358 Epoch 99/500 36/36 [============================>.] - ETA: 0s - loss: 0.2465 - acc: 0.9165Epoch 00099: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2473 - acc: 0.9164 - val_loss: 0.7415 - val_acc: 0.8453 Epoch 100/500 36/36 [============================>.] - ETA: 0s - loss: 0.2589 - acc: 0.9164Epoch 00100: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2592 - acc: 0.9157 - val_loss: 0.6162 - val_acc: 0.8434 Epoch 101/500 36/36 [============================>.] - ETA: 0s - loss: 0.2313 - acc: 0.9192Epoch 00101: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2343 - acc: 0.9187 - val_loss: 0.7442 - val_acc: 0.8211 Epoch 102/500 36/36 [============================>.] - ETA: 0s - loss: 0.2659 - acc: 0.9131Epoch 00102: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2676 - acc: 0.9121 - val_loss: 0.7387 - val_acc: 0.8358 Epoch 103/500 36/36 [============================>.] - ETA: 0s - loss: 0.2458 - acc: 0.9161Epoch 00103: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.2468 - acc: 0.9159 - val_loss: 0.7013 - val_acc: 0.8307 Epoch 104/500 36/36 [============================>.] - ETA: 0s - loss: 0.2610 - acc: 0.9126Epoch 00104: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2591 - acc: 0.9128 - val_loss: 0.6660 - val_acc: 0.8358 Epoch 105/500 36/36 [============================>.] - ETA: 0s - loss: 0.2456 - acc: 0.9177Epoch 00105: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2472 - acc: 0.9169 - val_loss: 0.6947 - val_acc: 0.8320 Epoch 106/500 36/36 [============================>.] - ETA: 0s - loss: 0.2656 - acc: 0.9108Epoch 00106: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2640 - acc: 0.9111 - val_loss: 0.6628 - val_acc: 0.8256 Epoch 107/500 36/36 [============================>.] - ETA: 0s - loss: 0.2191 - acc: 0.9208Epoch 00107: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2178 - acc: 0.9214 - val_loss: 0.6584 - val_acc: 0.8275 Epoch 108/500 36/36 [============================>.] - ETA: 0s - loss: 0.2345 - acc: 0.9252Epoch 00108: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2340 - acc: 0.9251 - val_loss: 0.7057 - val_acc: 0.8351 Epoch 109/500 36/36 [============================>.] - ETA: 0s - loss: 0.2327 - acc: 0.9211Epoch 00109: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2335 - acc: 0.9216 - val_loss: 0.6683 - val_acc: 0.8396 Epoch 110/500 36/36 [============================>.] - ETA: 0s - loss: 0.2373 - acc: 0.9168Epoch 00110: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2360 - acc: 0.9171 - val_loss: 0.7181 - val_acc: 0.8447 Epoch 111/500 36/36 [============================>.] - ETA: 0s - loss: 0.2314 - acc: 0.9206Epoch 00111: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2326 - acc: 0.9197 - val_loss: 0.6703 - val_acc: 0.8415 Epoch 112/500 36/36 [============================>.] - ETA: 0s - loss: 0.2168 - acc: 0.9296Epoch 00112: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2162 - acc: 0.9292 - val_loss: 0.6879 - val_acc: 0.8230 Epoch 113/500 36/36 [============================>.] - ETA: 0s - loss: 0.2379 - acc: 0.9163Epoch 00113: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2352 - acc: 0.9173 - val_loss: 0.7063 - val_acc: 0.8313 Epoch 114/500 36/36 [============================>.] - ETA: 0s - loss: 0.2372 - acc: 0.9215Epoch 00114: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2345 - acc: 0.9223 - val_loss: 0.6880 - val_acc: 0.8370 Epoch 115/500 36/36 [============================>.] - ETA: 0s - loss: 0.2342 - acc: 0.9182Epoch 00115: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2340 - acc: 0.9183 - val_loss: 0.7267 - val_acc: 0.8358 Epoch 116/500 36/36 [============================>.] - ETA: 0s - loss: 0.2214 - acc: 0.9253Epoch 00116: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2192 - acc: 0.9261 - val_loss: 0.7044 - val_acc: 0.8453 Epoch 117/500 36/36 [============================>.] - ETA: 0s - loss: 0.2125 - acc: 0.9272Epoch 00117: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2096 - acc: 0.9283 - val_loss: 0.7022 - val_acc: 0.8294 Epoch 118/500 36/36 [============================>.] - ETA: 0s - loss: 0.2182 - acc: 0.9238Epoch 00118: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2215 - acc: 0.9233 - val_loss: 0.6884 - val_acc: 0.8358 Epoch 119/500 36/36 [============================>.] - ETA: 0s - loss: 0.2364 - acc: 0.9208- ETA: 2s - loEpoch 00119: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.2335 - acc: 0.9223 - val_loss: 0.6419 - val_acc: 0.8383 Epoch 120/500 36/36 [============================>.] - ETA: 0s - loss: 0.2147 - acc: 0.9201Epoch 00120: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2187 - acc: 0.9197 - val_loss: 0.6482 - val_acc: 0.8511 Epoch 121/500 36/36 [============================>.] - ETA: 0s - loss: 0.2189 - acc: 0.9249Epoch 00121: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.2180 - acc: 0.9250 - val_loss: 0.7027 - val_acc: 0.8402 Epoch 122/500 36/36 [============================>.] - ETA: 0s - loss: 0.2260 - acc: 0.9179- ETA: 0s - loss: 0.2296 - acc: Epoch 00122: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2254 - acc: 0.9182 - val_loss: 0.7382 - val_acc: 0.8345 Epoch 123/500 36/36 [============================>.] - ETA: 0s - loss: 0.2152 - acc: 0.9280Epoch 00123: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2168 - acc: 0.9272 - val_loss: 0.7344 - val_acc: 0.8313 Epoch 124/500 36/36 [============================>.] - ETA: 0s - loss: 0.2175 - acc: 0.9285Epoch 00124: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2173 - acc: 0.9287 - val_loss: 0.6971 - val_acc: 0.8307 Epoch 125/500 36/36 [============================>.] - ETA: 0s - loss: 0.1990 - acc: 0.9331Epoch 00125: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1976 - acc: 0.9335 - val_loss: 0.7635 - val_acc: 0.8313 Epoch 126/500 36/36 [============================>.] - ETA: 0s - loss: 0.2196 - acc: 0.9243Epoch 00126: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2176 - acc: 0.9251 - val_loss: 0.7031 - val_acc: 0.8300 Epoch 127/500 36/36 [============================>.] - ETA: 0s - loss: 0.2033 - acc: 0.9295Epoch 00127: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2035 - acc: 0.9293 - val_loss: 0.6898 - val_acc: 0.8466 Epoch 128/500 36/36 [============================>.] - ETA: 0s - loss: 0.2109 - acc: 0.9255Epoch 00128: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2117 - acc: 0.9246 - val_loss: 0.7136 - val_acc: 0.8370 Epoch 129/500 36/36 [============================>.] - ETA: 0s - loss: 0.2249 - acc: 0.9224Epoch 00129: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2263 - acc: 0.9226 - val_loss: 0.6668 - val_acc: 0.8549 Epoch 130/500 36/36 [============================>.] - ETA: 0s - loss: 0.1981 - acc: 0.9323Epoch 00130: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1980 - acc: 0.9324 - val_loss: 0.7529 - val_acc: 0.8415 Epoch 131/500 36/36 [============================>.] - ETA: 0s - loss: 0.1848 - acc: 0.9378- ETA: 2s - lossEpoch 00131: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1881 - acc: 0.9365 - val_loss: 0.7328 - val_acc: 0.8428 Epoch 132/500 36/36 [============================>.] - ETA: 0s - loss: 0.2058 - acc: 0.9340Epoch 00132: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.2055 - acc: 0.9339 - val_loss: 0.7227 - val_acc: 0.8491 Epoch 133/500 36/36 [============================>.] - ETA: 0s - loss: 0.1941 - acc: 0.9318Epoch 00133: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1931 - acc: 0.9317 - val_loss: 0.7607 - val_acc: 0.8364 Epoch 134/500 36/36 [============================>.] - ETA: 0s - loss: 0.1900 - acc: 0.9344Epoch 00134: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1897 - acc: 0.9343 - val_loss: 0.7203 - val_acc: 0.8402 Epoch 135/500 36/36 [============================>.] - ETA: 0s - loss: 0.1883 - acc: 0.9318Epoch 00135: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1906 - acc: 0.9309 - val_loss: 0.7415 - val_acc: 0.8460 Epoch 136/500 36/36 [============================>.] - ETA: 0s - loss: 0.1877 - acc: 0.9328Epoch 00136: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1913 - acc: 0.9319 - val_loss: 0.7929 - val_acc: 0.8434 Epoch 137/500 36/36 [============================>.] - ETA: 0s - loss: 0.1997 - acc: 0.9280Epoch 00137: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1991 - acc: 0.9278 - val_loss: 0.7579 - val_acc: 0.8428 Epoch 138/500 36/36 [============================>.] - ETA: 0s - loss: 0.1918 - acc: 0.9334Epoch 00138: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1907 - acc: 0.9337 - val_loss: 0.7352 - val_acc: 0.8339 Epoch 139/500 36/36 [============================>.] - ETA: 0s - loss: 0.1884 - acc: 0.9331Epoch 00139: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1907 - acc: 0.9322 - val_loss: 0.7431 - val_acc: 0.8434 Epoch 140/500 36/36 [============================>.] - ETA: 0s - loss: 0.1881 - acc: 0.9339- ETA: 0s - loss: 0.1855 - accEpoch 00140: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1884 - acc: 0.9338 - val_loss: 0.7056 - val_acc: 0.8358 Epoch 141/500 36/36 [============================>.] - ETA: 0s - loss: 0.1832 - acc: 0.9375Epoch 00141: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1850 - acc: 0.9375 - val_loss: 0.7142 - val_acc: 0.8351 Epoch 142/500 36/36 [============================>.] - ETA: 0s - loss: 0.1873 - acc: 0.9376Epoch 00142: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1867 - acc: 0.9383 - val_loss: 0.7610 - val_acc: 0.8288 Epoch 143/500 36/36 [============================>.] - ETA: 0s - loss: 0.1791 - acc: 0.9381Epoch 00143: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1794 - acc: 0.9381 - val_loss: 0.7605 - val_acc: 0.8313 Epoch 144/500 36/36 [============================>.] - ETA: 0s - loss: 0.1867 - acc: 0.9356- ETA: 0s - loss: 0.1870 - acc: 0.935Epoch 00144: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1848 - acc: 0.9361 - val_loss: 0.7256 - val_acc: 0.8485 Epoch 145/500 36/36 [============================>.] - ETA: 0s - loss: 0.1859 - acc: 0.9372Epoch 00145: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1863 - acc: 0.9366 - val_loss: 0.7343 - val_acc: 0.8370 Epoch 146/500 36/36 [============================>.] - ETA: 0s - loss: 0.1837 - acc: 0.9375Epoch 00146: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1853 - acc: 0.9382 - val_loss: 0.7667 - val_acc: 0.8351 Epoch 147/500 36/36 [============================>.] - ETA: 0s - loss: 0.1895 - acc: 0.9357Epoch 00147: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1910 - acc: 0.9351 - val_loss: 0.7825 - val_acc: 0.8402 Epoch 148/500 36/36 [============================>.] - ETA: 0s - loss: 0.1888 - acc: 0.9374Epoch 00148: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1894 - acc: 0.9372 - val_loss: 0.7609 - val_acc: 0.8345 Epoch 149/500 36/36 [============================>.] - ETA: 0s - loss: 0.1802 - acc: 0.9395Epoch 00149: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1784 - acc: 0.9396 - val_loss: 0.7651 - val_acc: 0.8288 Epoch 150/500 36/36 [============================>.] - ETA: 0s - loss: 0.1922 - acc: 0.9367Epoch 00150: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1928 - acc: 0.9363 - val_loss: 0.7432 - val_acc: 0.8256 Epoch 151/500 36/36 [============================>.] - ETA: 0s - loss: 0.1691 - acc: 0.9429Epoch 00151: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1704 - acc: 0.9423 - val_loss: 0.7938 - val_acc: 0.8421 Epoch 152/500 36/36 [============================>.] - ETA: 0s - loss: 0.1963 - acc: 0.9369Epoch 00152: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.1966 - acc: 0.9367 - val_loss: 0.6949 - val_acc: 0.8523 Epoch 153/500 36/36 [============================>.] - ETA: 0s - loss: 0.1867 - acc: 0.9341Epoch 00153: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1838 - acc: 0.9350 - val_loss: 0.7462 - val_acc: 0.8447 Epoch 154/500 36/36 [============================>.] - ETA: 0s - loss: 0.1798 - acc: 0.9371- ETA: 2s - lEpoch 00154: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1779 - acc: 0.9378 - val_loss: 0.7737 - val_acc: 0.8447 Epoch 155/500 36/36 [============================>.] - ETA: 0s - loss: 0.1666 - acc: 0.9420Epoch 00155: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1656 - acc: 0.9421 - val_loss: 0.8352 - val_acc: 0.8351 Epoch 156/500 36/36 [============================>.] - ETA: 0s - loss: 0.1699 - acc: 0.9368Epoch 00156: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1688 - acc: 0.9371 - val_loss: 0.7778 - val_acc: 0.8320 Epoch 157/500 36/36 [============================>.] - ETA: 0s - loss: 0.1670 - acc: 0.9420Epoch 00157: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1662 - acc: 0.9421 - val_loss: 0.7956 - val_acc: 0.8364 Epoch 158/500 36/36 [============================>.] - ETA: 0s - loss: 0.1816 - acc: 0.9392Epoch 00158: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1835 - acc: 0.9387 - val_loss: 0.7609 - val_acc: 0.8281 Epoch 159/500 36/36 [============================>.] - ETA: 0s - loss: 0.1667 - acc: 0.9459Epoch 00159: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1661 - acc: 0.9459 - val_loss: 0.7770 - val_acc: 0.8402 Epoch 160/500 36/36 [============================>.] - ETA: 0s - loss: 0.1661 - acc: 0.9453Epoch 00160: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1647 - acc: 0.9459 - val_loss: 0.8009 - val_acc: 0.8390 Epoch 161/500 36/36 [============================>.] - ETA: 0s - loss: 0.1838 - acc: 0.9371Epoch 00161: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1838 - acc: 0.9372 - val_loss: 0.7777 - val_acc: 0.8332 Epoch 162/500 36/36 [============================>.] - ETA: 0s - loss: 0.1687 - acc: 0.9459- ETA: 0s - loss: 0.1686 - accEpoch 00162: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1672 - acc: 0.9465 - val_loss: 0.7428 - val_acc: 0.8332 Epoch 163/500 36/36 [============================>.] - ETA: 0s - loss: 0.1613 - acc: 0.9414- ETA: 0s - loss: 0.1616 - acc: 0.Epoch 00163: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1614 - acc: 0.9413 - val_loss: 0.7533 - val_acc: 0.8428 Epoch 164/500 36/36 [============================>.] - ETA: 0s - loss: 0.1591 - acc: 0.9472Epoch 00164: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1599 - acc: 0.9465 - val_loss: 0.7655 - val_acc: 0.8345 Epoch 165/500 36/36 [============================>.] - ETA: 0s - loss: 0.1641 - acc: 0.9431Epoch 00165: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1624 - acc: 0.9436 - val_loss: 0.7981 - val_acc: 0.8313 Epoch 166/500 36/36 [============================>.] - ETA: 0s - loss: 0.1674 - acc: 0.9458Epoch 00166: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1663 - acc: 0.9458 - val_loss: 0.7350 - val_acc: 0.8421 Epoch 167/500 36/36 [============================>.] - ETA: 0s - loss: 0.1652 - acc: 0.9427Epoch 00167: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1690 - acc: 0.9415 - val_loss: 0.7683 - val_acc: 0.8326 Epoch 168/500 36/36 [============================>.] - ETA: 0s - loss: 0.1323 - acc: 0.9518Epoch 00168: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1330 - acc: 0.9514 - val_loss: 0.8201 - val_acc: 0.8370 Epoch 169/500 36/36 [============================>.] - ETA: 0s - loss: 0.1656 - acc: 0.9437Epoch 00169: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1657 - acc: 0.9435 - val_loss: 0.7566 - val_acc: 0.8409 Epoch 170/500 36/36 [============================>.] - ETA: 0s - loss: 0.1620 - acc: 0.9485- ETA: 2s - lossEpoch 00170: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1610 - acc: 0.9487 - val_loss: 0.7926 - val_acc: 0.8313 Epoch 171/500 36/36 [============================>.] - ETA: 0s - loss: 0.1669 - acc: 0.9436Epoch 00171: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1675 - acc: 0.9435 - val_loss: 0.7226 - val_acc: 0.8402 Epoch 172/500 36/36 [============================>.] - ETA: 0s - loss: 0.1542 - acc: 0.9481Epoch 00172: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1562 - acc: 0.9474 - val_loss: 0.7653 - val_acc: 0.8377 Epoch 173/500 36/36 [============================>.] - ETA: 0s - loss: 0.1555 - acc: 0.9431Epoch 00173: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1545 - acc: 0.9435 - val_loss: 0.8355 - val_acc: 0.8288 Epoch 174/500 36/36 [============================>.] - ETA: 0s - loss: 0.1600 - acc: 0.9489Epoch 00174: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.1581 - acc: 0.9498 - val_loss: 0.7620 - val_acc: 0.8364 Epoch 175/500 36/36 [============================>.] - ETA: 0s - loss: 0.1315 - acc: 0.9517Epoch 00175: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1343 - acc: 0.9514 - val_loss: 0.7376 - val_acc: 0.8358 Epoch 176/500 36/36 [============================>.] - ETA: 0s - loss: 0.1520 - acc: 0.9505Epoch 00176: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1540 - acc: 0.9495 - val_loss: 0.7659 - val_acc: 0.8307 Epoch 177/500 36/36 [============================>.] - ETA: 0s - loss: 0.1534 - acc: 0.9509Epoch 00177: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1542 - acc: 0.9507 - val_loss: 0.7919 - val_acc: 0.8326 Epoch 178/500 36/36 [============================>.] - ETA: 0s - loss: 0.1575 - acc: 0.9492Epoch 00178: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1562 - acc: 0.9498 - val_loss: 0.8016 - val_acc: 0.8294 Epoch 179/500 36/36 [============================>.] - ETA: 0s - loss: 0.1566 - acc: 0.9461Epoch 00179: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1536 - acc: 0.9476 - val_loss: 0.7470 - val_acc: 0.8339 Epoch 180/500 36/36 [============================>.] - ETA: 0s - loss: 0.1376 - acc: 0.9518- ETA: 1s - loss: 0.1350 - aEpoch 00180: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1371 - acc: 0.9516 - val_loss: 0.7911 - val_acc: 0.8364 Epoch 181/500 36/36 [============================>.] - ETA: 0s - loss: 0.1287 - acc: 0.9556Epoch 00181: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1282 - acc: 0.9553 - val_loss: 0.7832 - val_acc: 0.8307 Epoch 182/500 36/36 [============================>.] - ETA: 0s - loss: 0.1497 - acc: 0.9500Epoch 00182: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1525 - acc: 0.9494 - val_loss: 0.8551 - val_acc: 0.8230 Epoch 183/500 36/36 [============================>.] - ETA: 0s - loss: 0.1591 - acc: 0.9507Epoch 00183: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1593 - acc: 0.9510 - val_loss: 0.7805 - val_acc: 0.8332 Epoch 184/500 36/36 [============================>.] - ETA: 0s - loss: 0.1356 - acc: 0.9531Epoch 00184: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1370 - acc: 0.9519 - val_loss: 0.7919 - val_acc: 0.8370 Epoch 185/500 36/36 [============================>.] - ETA: 0s - loss: 0.1352 - acc: 0.9521Epoch 00185: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1388 - acc: 0.9517 - val_loss: 0.8131 - val_acc: 0.8339 Epoch 186/500 36/36 [============================>.] - ETA: 0s - loss: 0.1512 - acc: 0.9466Epoch 00186: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.1549 - acc: 0.9464 - val_loss: 0.7539 - val_acc: 0.8498 Epoch 187/500 36/36 [============================>.] - ETA: 0s - loss: 0.1510 - acc: 0.9508Epoch 00187: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1507 - acc: 0.9505 - val_loss: 0.8096 - val_acc: 0.8396 Epoch 188/500 36/36 [============================>.] - ETA: 0s - loss: 0.1540 - acc: 0.9474Epoch 00188: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1544 - acc: 0.9471 - val_loss: 0.8447 - val_acc: 0.8402 Epoch 189/500 36/36 [============================>.] - ETA: 0s - loss: 0.1331 - acc: 0.9541Epoch 00189: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1328 - acc: 0.9545 - val_loss: 0.8441 - val_acc: 0.8390 Epoch 190/500 36/36 [============================>.] - ETA: 0s - loss: 0.1489 - acc: 0.9539Epoch 00190: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1484 - acc: 0.9533 - val_loss: 0.7995 - val_acc: 0.8440 Epoch 191/500 36/36 [============================>.] - ETA: 0s - loss: 0.1501 - acc: 0.9524Epoch 00191: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1491 - acc: 0.9526 - val_loss: 0.7635 - val_acc: 0.8409 Epoch 192/500 36/36 [============================>.] - ETA: 0s - loss: 0.1259 - acc: 0.9565Epoch 00192: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.1256 - acc: 0.9566 - val_loss: 0.8084 - val_acc: 0.8523 Epoch 193/500 36/36 [============================>.] - ETA: 0s - loss: 0.1510 - acc: 0.9523Epoch 00193: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.1511 - acc: 0.9527 - val_loss: 0.8103 - val_acc: 0.8351 Epoch 194/500 36/36 [============================>.] - ETA: 0s - loss: 0.1472 - acc: 0.9447Epoch 00194: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1474 - acc: 0.9443 - val_loss: 0.8283 - val_acc: 0.8415 Epoch 195/500 36/36 [============================>.] - ETA: 0s - loss: 0.1469 - acc: 0.9516Epoch 00195: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1455 - acc: 0.9519 - val_loss: 0.8054 - val_acc: 0.8332 Epoch 196/500 36/36 [============================>.] - ETA: 0s - loss: 0.1538 - acc: 0.9437Epoch 00196: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1541 - acc: 0.9439 - val_loss: 0.7705 - val_acc: 0.8428 Epoch 197/500 36/36 [============================>.] - ETA: 0s - loss: 0.1502 - acc: 0.9480Epoch 00197: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1492 - acc: 0.9479 - val_loss: 0.7990 - val_acc: 0.8523 Epoch 198/500 36/36 [============================>.] - ETA: 0s - loss: 0.1414 - acc: 0.9533- ETA: 2Epoch 00198: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1398 - acc: 0.9537 - val_loss: 0.7710 - val_acc: 0.8421 Epoch 199/500 36/36 [============================>.] - ETA: 0s - loss: 0.1423 - acc: 0.9501Epoch 00199: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1403 - acc: 0.9507 - val_loss: 0.8304 - val_acc: 0.8358 Epoch 200/500 36/36 [============================>.] - ETA: 0s - loss: 0.1361 - acc: 0.9558Epoch 00200: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1347 - acc: 0.9561 - val_loss: 0.8123 - val_acc: 0.8434 Epoch 201/500 36/36 [============================>.] - ETA: 0s - loss: 0.1493 - acc: 0.9525Epoch 00201: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1488 - acc: 0.9527 - val_loss: 0.8227 - val_acc: 0.8364 Epoch 202/500 36/36 [============================>.] - ETA: 0s - loss: 0.1299 - acc: 0.9535Epoch 00202: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1298 - acc: 0.9539 - val_loss: 0.8841 - val_acc: 0.8211 Epoch 203/500 36/36 [============================>.] - ETA: 0s - loss: 0.1242 - acc: 0.9584Epoch 00203: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1250 - acc: 0.9576 - val_loss: 0.8624 - val_acc: 0.8370 Epoch 204/500 36/36 [============================>.] - ETA: 0s - loss: 0.1338 - acc: 0.9536- ETA: 0s - loss: 0.1353 - acEpoch 00204: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1345 - acc: 0.9536 - val_loss: 0.8160 - val_acc: 0.8351 Epoch 205/500 36/36 [============================>.] - ETA: 0s - loss: 0.1328 - acc: 0.9532Epoch 00205: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1331 - acc: 0.9530 - val_loss: 0.8733 - val_acc: 0.8390 Epoch 206/500 36/36 [============================>.] - ETA: 0s - loss: 0.1309 - acc: 0.9543Epoch 00206: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1330 - acc: 0.9536 - val_loss: 0.8822 - val_acc: 0.8332 Epoch 207/500 36/36 [============================>.] - ETA: 0s - loss: 0.1411 - acc: 0.9499Epoch 00207: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1402 - acc: 0.9502 - val_loss: 0.8166 - val_acc: 0.8326 Epoch 208/500 36/36 [============================>.] - ETA: 0s - loss: 0.1333 - acc: 0.9585Epoch 00208: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1321 - acc: 0.9587 - val_loss: 0.8256 - val_acc: 0.8300 Epoch 209/500 36/36 [============================>.] - ETA: 0s - loss: 0.1402 - acc: 0.9520Epoch 00209: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.1396 - acc: 0.9522 - val_loss: 0.8877 - val_acc: 0.8269 Epoch 210/500 36/36 [============================>.] - ETA: 0s - loss: 0.1457 - acc: 0.9544Epoch 00210: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1479 - acc: 0.9538 - val_loss: 0.8132 - val_acc: 0.8370 Epoch 211/500 36/36 [============================>.] - ETA: 0s - loss: 0.1376 - acc: 0.9527Epoch 00211: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1393 - acc: 0.9523 - val_loss: 0.8469 - val_acc: 0.8370 Epoch 212/500 36/36 [============================>.] - ETA: 0s - loss: 0.1285 - acc: 0.9561Epoch 00212: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1269 - acc: 0.9564 - val_loss: 0.8404 - val_acc: 0.8370 Epoch 213/500 36/36 [============================>.] - ETA: 0s - loss: 0.1182 - acc: 0.9595Epoch 00213: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1157 - acc: 0.9606 - val_loss: 0.8808 - val_acc: 0.8479 Epoch 214/500 36/36 [============================>.] - ETA: 0s - loss: 0.1357 - acc: 0.9526Epoch 00214: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1347 - acc: 0.9530 - val_loss: 0.8195 - val_acc: 0.8498 Epoch 215/500 36/36 [============================>.] - ETA: 0s - loss: 0.1451 - acc: 0.9508Epoch 00215: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1437 - acc: 0.9513 - val_loss: 0.7975 - val_acc: 0.8479 Epoch 216/500 36/36 [============================>.] - ETA: 0s - loss: 0.1279 - acc: 0.9569Epoch 00216: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1283 - acc: 0.9568 - val_loss: 0.8050 - val_acc: 0.8504 Epoch 217/500 36/36 [============================>.] - ETA: 0s - loss: 0.1358 - acc: 0.9534Epoch 00217: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1334 - acc: 0.9546 - val_loss: 0.8024 - val_acc: 0.8409 Epoch 218/500 36/36 [============================>.] - ETA: 0s - loss: 0.1249 - acc: 0.9594Epoch 00218: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.1240 - acc: 0.9595 - val_loss: 0.8464 - val_acc: 0.8440 Epoch 219/500 36/36 [============================>.] - ETA: 0s - loss: 0.1181 - acc: 0.9607Epoch 00219: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1192 - acc: 0.9603 - val_loss: 0.8091 - val_acc: 0.8453 Epoch 220/500 36/36 [============================>.] - ETA: 0s - loss: 0.1306 - acc: 0.9551Epoch 00220: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1289 - acc: 0.9557 - val_loss: 0.8498 - val_acc: 0.8409 Epoch 221/500 36/36 [============================>.] - ETA: 0s - loss: 0.1223 - acc: 0.9577Epoch 00221: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1224 - acc: 0.9578 - val_loss: 0.8433 - val_acc: 0.8485 Epoch 222/500 36/36 [============================>.] - ETA: 0s - loss: 0.1338 - acc: 0.9606Epoch 00222: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1356 - acc: 0.9597 - val_loss: 0.7811 - val_acc: 0.8377 Epoch 223/500 36/36 [============================>.] - ETA: 0s - loss: 0.1192 - acc: 0.9609Epoch 00223: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1207 - acc: 0.9603 - val_loss: 0.8315 - val_acc: 0.8358 Epoch 224/500 36/36 [============================>.] - ETA: 0s - loss: 0.1242 - acc: 0.9570Epoch 00224: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1240 - acc: 0.9571 - val_loss: 0.7593 - val_acc: 0.8428 Epoch 225/500 36/36 [============================>.] - ETA: 0s - loss: 0.1095 - acc: 0.9625Epoch 00225: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1097 - acc: 0.9622 - val_loss: 0.8327 - val_acc: 0.8409 Epoch 226/500 36/36 [============================>.] - ETA: 0s - loss: 0.1282 - acc: 0.9588Epoch 00226: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1295 - acc: 0.9578 - val_loss: 0.8427 - val_acc: 0.8326 Epoch 227/500 36/36 [============================>.] - ETA: 0s - loss: 0.1234 - acc: 0.9596Epoch 00227: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1225 - acc: 0.9596 - val_loss: 0.7906 - val_acc: 0.8421 Epoch 228/500 36/36 [============================>.] - ETA: 0s - loss: 0.1211 - acc: 0.9618Epoch 00228: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1237 - acc: 0.9614 - val_loss: 0.8327 - val_acc: 0.8288 Epoch 229/500 36/36 [============================>.] - ETA: 0s - loss: 0.1139 - acc: 0.9609Epoch 00229: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1140 - acc: 0.9605 - val_loss: 0.8111 - val_acc: 0.8402 Epoch 230/500 36/36 [============================>.] - ETA: 0s - loss: 0.1225 - acc: 0.9551Epoch 00230: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1221 - acc: 0.9555 - val_loss: 0.8342 - val_acc: 0.8358 Epoch 231/500 36/36 [============================>.] - ETA: 0s - loss: 0.1159 - acc: 0.9619- ETA: 2s - loEpoch 00231: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1170 - acc: 0.9616 - val_loss: 0.7884 - val_acc: 0.8472 Epoch 232/500 36/36 [============================>.] - ETA: 0s - loss: 0.1200 - acc: 0.9612Epoch 00232: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1190 - acc: 0.9616 - val_loss: 0.8188 - val_acc: 0.8434 Epoch 233/500 36/36 [============================>.] - ETA: 0s - loss: 0.1235 - acc: 0.9564Epoch 00233: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1217 - acc: 0.9572 - val_loss: 0.8487 - val_acc: 0.8326 Epoch 234/500 36/36 [============================>.] - ETA: 0s - loss: 0.1117 - acc: 0.9620Epoch 00234: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1095 - acc: 0.9626 - val_loss: 0.8511 - val_acc: 0.8383 Epoch 235/500 36/36 [============================>.] - ETA: 0s - loss: 0.1246 - acc: 0.9578Epoch 00235: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1238 - acc: 0.9579 - val_loss: 0.8630 - val_acc: 0.8415 Epoch 236/500 36/36 [============================>.] - ETA: 0s - loss: 0.1203 - acc: 0.9571Epoch 00236: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1218 - acc: 0.9561 - val_loss: 0.8420 - val_acc: 0.8300 Epoch 237/500 36/36 [============================>.] - ETA: 0s - loss: 0.1100 - acc: 0.9637Epoch 00237: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1093 - acc: 0.9636 - val_loss: 0.8694 - val_acc: 0.8383 Epoch 238/500 36/36 [============================>.] - ETA: 0s - loss: 0.1165 - acc: 0.9558Epoch 00238: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1191 - acc: 0.9549 - val_loss: 0.9292 - val_acc: 0.8377 Epoch 239/500 36/36 [============================>.] - ETA: 0s - loss: 0.1184 - acc: 0.9587Epoch 00239: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1175 - acc: 0.9590 - val_loss: 0.8920 - val_acc: 0.8383 Epoch 240/500 36/36 [============================>.] - ETA: 0s - loss: 0.1192 - acc: 0.9591Epoch 00240: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1207 - acc: 0.9591 - val_loss: 0.8899 - val_acc: 0.8466 Epoch 241/500 36/36 [============================>.] - ETA: 0s - loss: 0.1277 - acc: 0.9575- ETA: 1s - loss: 0.1236 - aEpoch 00241: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.1267 - acc: 0.9574 - val_loss: 0.8474 - val_acc: 0.8326 Epoch 242/500 36/36 [============================>.] - ETA: 0s - loss: 0.1243 - acc: 0.9604Epoch 00242: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1259 - acc: 0.9604 - val_loss: 0.8295 - val_acc: 0.8421 Epoch 243/500 36/36 [============================>.] - ETA: 0s - loss: 0.1198 - acc: 0.9618Epoch 00243: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1191 - acc: 0.9620 - val_loss: 0.8456 - val_acc: 0.8409 Epoch 244/500 36/36 [============================>.] - ETA: 0s - loss: 0.1133 - acc: 0.9609Epoch 00244: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1127 - acc: 0.9611 - val_loss: 0.8914 - val_acc: 0.8434 Epoch 245/500 36/36 [============================>.] - ETA: 0s - loss: 0.1031 - acc: 0.9657Epoch 00245: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1052 - acc: 0.9652 - val_loss: 0.8967 - val_acc: 0.8390 Epoch 246/500 36/36 [============================>.] - ETA: 0s - loss: 0.1237 - acc: 0.9609Epoch 00246: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1236 - acc: 0.9607 - val_loss: 0.7850 - val_acc: 0.8491 Epoch 247/500 36/36 [============================>.] - ETA: 0s - loss: 0.1190 - acc: 0.9618Epoch 00247: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1195 - acc: 0.9618 - val_loss: 0.8843 - val_acc: 0.8421 Epoch 248/500 36/36 [============================>.] - ETA: 0s - loss: 0.1040 - acc: 0.9658- ETA: 2s - Epoch 00248: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1073 - acc: 0.9655 - val_loss: 0.9663 - val_acc: 0.8364 Epoch 249/500 36/36 [============================>.] - ETA: 0s - loss: 0.1001 - acc: 0.9671Epoch 00249: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0998 - acc: 0.9673 - val_loss: 0.8615 - val_acc: 0.8479 Epoch 250/500 36/36 [============================>.] - ETA: 0s - loss: 0.1058 - acc: 0.9631Epoch 00250: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1048 - acc: 0.9638 - val_loss: 0.8409 - val_acc: 0.8479 Epoch 251/500 36/36 [============================>.] - ETA: 0s - loss: 0.1051 - acc: 0.9657Epoch 00251: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1063 - acc: 0.9647 - val_loss: 0.8615 - val_acc: 0.8479 Epoch 252/500 36/36 [============================>.] - ETA: 0s - loss: 0.1125 - acc: 0.9626Epoch 00252: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1112 - acc: 0.9634 - val_loss: 0.9004 - val_acc: 0.8358 Epoch 253/500 36/36 [============================>.] - ETA: 0s - loss: 0.1268 - acc: 0.9601Epoch 00253: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1269 - acc: 0.9601 - val_loss: 0.8422 - val_acc: 0.8364 Epoch 254/500 36/36 [============================>.] - ETA: 0s - loss: 0.1173 - acc: 0.9607Epoch 00254: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1168 - acc: 0.9610 - val_loss: 0.8942 - val_acc: 0.8364 Epoch 255/500 36/36 [============================>.] - ETA: 0s - loss: 0.1175 - acc: 0.9616Epoch 00255: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1160 - acc: 0.9618 - val_loss: 0.9011 - val_acc: 0.8396 Epoch 256/500 36/36 [============================>.] - ETA: 0s - loss: 0.1230 - acc: 0.9581Epoch 00256: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1217 - acc: 0.9588 - val_loss: 0.8138 - val_acc: 0.8504 Epoch 257/500 36/36 [============================>.] - ETA: 0s - loss: 0.1044 - acc: 0.9636Epoch 00257: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1051 - acc: 0.9633 - val_loss: 0.9437 - val_acc: 0.8358 Epoch 258/500 36/36 [============================>.] - ETA: 0s - loss: 0.1051 - acc: 0.9620Epoch 00258: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.1052 - acc: 0.9624 - val_loss: 0.9118 - val_acc: 0.8390 Epoch 259/500 36/36 [============================>.] - ETA: 0s - loss: 0.1019 - acc: 0.9631Epoch 00259: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1005 - acc: 0.9637 - val_loss: 0.8504 - val_acc: 0.8421 Epoch 260/500 36/36 [============================>.] - ETA: 0s - loss: 0.1225 - acc: 0.9564Epoch 00260: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.1199 - acc: 0.9574 - val_loss: 0.8339 - val_acc: 0.8530 Epoch 261/500 36/36 [============================>.] - ETA: 0s - loss: 0.1168 - acc: 0.9644Epoch 00261: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1160 - acc: 0.9648 - val_loss: 0.8456 - val_acc: 0.8453 Epoch 262/500 36/36 [============================>.] - ETA: 0s - loss: 0.1030 - acc: 0.9647Epoch 00262: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1021 - acc: 0.9648 - val_loss: 0.8807 - val_acc: 0.8434 Epoch 263/500 36/36 [============================>.] - ETA: 0s - loss: 0.1168 - acc: 0.9608Epoch 00263: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1175 - acc: 0.9612 - val_loss: 0.8921 - val_acc: 0.8383 Epoch 264/500 36/36 [============================>.] - ETA: 0s - loss: 0.1062 - acc: 0.9669Epoch 00264: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.1068 - acc: 0.9670 - val_loss: 0.9141 - val_acc: 0.8345 Epoch 265/500 36/36 [============================>.] - ETA: 0s - loss: 0.1192 - acc: 0.9587Epoch 00265: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1174 - acc: 0.9594 - val_loss: 0.8800 - val_acc: 0.8377 Epoch 266/500 36/36 [============================>.] - ETA: 0s - loss: 0.1049 - acc: 0.9655Epoch 00266: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1046 - acc: 0.9656 - val_loss: 0.8957 - val_acc: 0.8498 Epoch 267/500 36/36 [============================>.] - ETA: 0s - loss: 0.1043 - acc: 0.9653Epoch 00267: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1032 - acc: 0.9656 - val_loss: 0.9140 - val_acc: 0.8320 Epoch 268/500 36/36 [============================>.] - ETA: 0s - loss: 0.1046 - acc: 0.9650Epoch 00268: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1054 - acc: 0.9651 - val_loss: 0.9021 - val_acc: 0.8428 Epoch 269/500 36/36 [============================>.] - ETA: 0s - loss: 0.0888 - acc: 0.9701Epoch 00269: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0891 - acc: 0.9699 - val_loss: 0.9539 - val_acc: 0.8332 Epoch 270/500 36/36 [============================>.] - ETA: 0s - loss: 0.0908 - acc: 0.9676Epoch 00270: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0906 - acc: 0.9679 - val_loss: 0.9218 - val_acc: 0.8358 Epoch 271/500 36/36 [============================>.] - ETA: 0s - loss: 0.1024 - acc: 0.9664Epoch 00271: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1030 - acc: 0.9664 - val_loss: 0.9487 - val_acc: 0.8364 Epoch 272/500 36/36 [============================>.] - ETA: 0s - loss: 0.1217 - acc: 0.9623Epoch 00272: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1205 - acc: 0.9624 - val_loss: 0.8738 - val_acc: 0.8339 Epoch 273/500 36/36 [============================>.] - ETA: 0s - loss: 0.1086 - acc: 0.9637Epoch 00273: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1080 - acc: 0.9638 - val_loss: 0.9387 - val_acc: 0.8370 Epoch 274/500 36/36 [============================>.] - ETA: 0s - loss: 0.1126 - acc: 0.9620Epoch 00274: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.1122 - acc: 0.9618 - val_loss: 0.9816 - val_acc: 0.8192 Epoch 275/500 36/36 [============================>.] - ETA: 0s - loss: 0.1181 - acc: 0.9615Epoch 00275: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1168 - acc: 0.9617 - val_loss: 0.8479 - val_acc: 0.8269 Epoch 276/500 36/36 [============================>.] - ETA: 0s - loss: 0.1032 - acc: 0.9652Epoch 00276: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1026 - acc: 0.9655 - val_loss: 0.8702 - val_acc: 0.8281 Epoch 277/500 36/36 [============================>.] - ETA: 0s - loss: 0.1065 - acc: 0.9673Epoch 00277: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1043 - acc: 0.9678 - val_loss: 0.8493 - val_acc: 0.8370 Epoch 278/500 36/36 [============================>.] - ETA: 0s - loss: 0.0981 - acc: 0.9654Epoch 00278: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0975 - acc: 0.9660 - val_loss: 0.8671 - val_acc: 0.8377 Epoch 279/500 36/36 [============================>.] - ETA: 0s - loss: 0.0916 - acc: 0.9696Epoch 00279: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0908 - acc: 0.9700 - val_loss: 0.8617 - val_acc: 0.8402 Epoch 280/500 36/36 [============================>.] - ETA: 0s - loss: 0.1162 - acc: 0.9645Epoch 00280: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1157 - acc: 0.9646 - val_loss: 0.8822 - val_acc: 0.8396 Epoch 281/500 36/36 [============================>.] - ETA: 0s - loss: 0.0878 - acc: 0.9696Epoch 00281: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0874 - acc: 0.9696 - val_loss: 0.8706 - val_acc: 0.8396 Epoch 282/500 36/36 [============================>.] - ETA: 0s - loss: 0.0903 - acc: 0.9716Epoch 00282: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0888 - acc: 0.9721 - val_loss: 0.9473 - val_acc: 0.8364 Epoch 283/500 36/36 [============================>.] - ETA: 0s - loss: 0.0996 - acc: 0.9667Epoch 00283: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0985 - acc: 0.9672 - val_loss: 0.9164 - val_acc: 0.8453 Epoch 284/500 36/36 [============================>.] - ETA: 0s - loss: 0.0990 - acc: 0.9708Epoch 00284: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0997 - acc: 0.9705 - val_loss: 0.9444 - val_acc: 0.8390 Epoch 285/500 36/36 [============================>.] - ETA: 0s - loss: 0.0948 - acc: 0.9686Epoch 00285: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0932 - acc: 0.9690 - val_loss: 0.8981 - val_acc: 0.8491 Epoch 286/500 36/36 [============================>.] - ETA: 0s - loss: 0.0924 - acc: 0.9703Epoch 00286: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0932 - acc: 0.9700 - val_loss: 0.8950 - val_acc: 0.8428 Epoch 287/500 36/36 [============================>.] - ETA: 0s - loss: 0.0911 - acc: 0.9669Epoch 00287: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0901 - acc: 0.9672 - val_loss: 0.9313 - val_acc: 0.8383 Epoch 288/500 36/36 [============================>.] - ETA: 0s - loss: 0.0883 - acc: 0.9709Epoch 00288: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0886 - acc: 0.9713 - val_loss: 0.9419 - val_acc: 0.8326 Epoch 289/500 36/36 [============================>.] - ETA: 0s - loss: 0.1013 - acc: 0.9689Epoch 00289: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0996 - acc: 0.9694 - val_loss: 0.9295 - val_acc: 0.8294 Epoch 290/500 36/36 [============================>.] - ETA: 0s - loss: 0.1083 - acc: 0.9654Epoch 00290: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1086 - acc: 0.9657 - val_loss: 0.8693 - val_acc: 0.8390 Epoch 291/500 36/36 [============================>.] - ETA: 0s - loss: 0.1022 - acc: 0.9662Epoch 00291: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1014 - acc: 0.9662 - val_loss: 0.8900 - val_acc: 0.8415 Epoch 292/500 36/36 [============================>.] - ETA: 0s - loss: 0.0853 - acc: 0.9739- ETA: 0s - loss: 0.0847 - acEpoch 00292: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.0866 - acc: 0.9739 - val_loss: 0.9220 - val_acc: 0.8434 Epoch 293/500 36/36 [============================>.] - ETA: 0s - loss: 0.0890 - acc: 0.9705Epoch 00293: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0899 - acc: 0.9705 - val_loss: 0.9326 - val_acc: 0.8377 Epoch 294/500 36/36 [============================>.] - ETA: 0s - loss: 0.1047 - acc: 0.9663Epoch 00294: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.1067 - acc: 0.9659 - val_loss: 0.9249 - val_acc: 0.8383 Epoch 295/500 36/36 [============================>.] - ETA: 0s - loss: 0.1135 - acc: 0.9612Epoch 00295: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1151 - acc: 0.9612 - val_loss: 0.9587 - val_acc: 0.8396 Epoch 296/500 36/36 [============================>.] - ETA: 0s - loss: 0.1041 - acc: 0.9665Epoch 00296: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.1065 - acc: 0.9661 - val_loss: 0.8999 - val_acc: 0.8377 Epoch 297/500 36/36 [============================>.] - ETA: 0s - loss: 0.0937 - acc: 0.9673Epoch 00297: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0939 - acc: 0.9674 - val_loss: 0.9012 - val_acc: 0.8434 Epoch 298/500 36/36 [============================>.] - ETA: 0s - loss: 0.0957 - acc: 0.9680Epoch 00298: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0941 - acc: 0.9687 - val_loss: 0.8999 - val_acc: 0.8364 Epoch 299/500 36/36 [============================>.] - ETA: 0s - loss: 0.0816 - acc: 0.9722Epoch 00299: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0813 - acc: 0.9719 - val_loss: 0.9812 - val_acc: 0.8377 Epoch 300/500 36/36 [============================>.] - ETA: 0s - loss: 0.0940 - acc: 0.9675Epoch 00300: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0935 - acc: 0.9677 - val_loss: 0.9308 - val_acc: 0.8472 Epoch 301/500 36/36 [============================>.] - ETA: 0s - loss: 0.0916 - acc: 0.9692Epoch 00301: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0922 - acc: 0.9689 - val_loss: 0.9597 - val_acc: 0.8351 Epoch 302/500 36/36 [============================>.] - ETA: 0s - loss: 0.1075 - acc: 0.9668Epoch 00302: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1088 - acc: 0.9668 - val_loss: 0.8956 - val_acc: 0.8370 Epoch 303/500 36/36 [============================>.] - ETA: 0s - loss: 0.1012 - acc: 0.9657Epoch 00303: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1034 - acc: 0.9653 - val_loss: 0.8450 - val_acc: 0.8415 Epoch 304/500 36/36 [============================>.] - ETA: 0s - loss: 0.0999 - acc: 0.9688Epoch 00304: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0998 - acc: 0.9685 - val_loss: 0.8663 - val_acc: 0.8479 Epoch 305/500 36/36 [============================>.] - ETA: 0s - loss: 0.1054 - acc: 0.9652Epoch 00305: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.1047 - acc: 0.9658 - val_loss: 0.9065 - val_acc: 0.8383 Epoch 306/500 36/36 [============================>.] - ETA: 0s - loss: 0.0985 - acc: 0.9672Epoch 00306: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0981 - acc: 0.9675 - val_loss: 0.8601 - val_acc: 0.8517 Epoch 307/500 36/36 [============================>.] - ETA: 0s - loss: 0.0861 - acc: 0.9711Epoch 00307: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0868 - acc: 0.9710 - val_loss: 0.9492 - val_acc: 0.8440 Epoch 308/500 36/36 [============================>.] - ETA: 0s - loss: 0.0740 - acc: 0.9742Epoch 00308: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0749 - acc: 0.9741 - val_loss: 0.8616 - val_acc: 0.8460 Epoch 309/500 36/36 [============================>.] - ETA: 0s - loss: 0.0851 - acc: 0.9715Epoch 00309: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0887 - acc: 0.9708 - val_loss: 0.8976 - val_acc: 0.8453 Epoch 310/500 36/36 [============================>.] - ETA: 0s - loss: 0.0895 - acc: 0.9723Epoch 00310: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0890 - acc: 0.9720 - val_loss: 0.9182 - val_acc: 0.8472 Epoch 311/500 36/36 [============================>.] - ETA: 0s - loss: 0.1003 - acc: 0.9649Epoch 00311: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0984 - acc: 0.9652 - val_loss: 0.9337 - val_acc: 0.8479 Epoch 312/500 36/36 [============================>.] - ETA: 0s - loss: 0.0871 - acc: 0.9708Epoch 00312: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0899 - acc: 0.9703 - val_loss: 0.9141 - val_acc: 0.8466 Epoch 313/500 36/36 [============================>.] - ETA: 0s - loss: 0.0970 - acc: 0.9709Epoch 00313: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0957 - acc: 0.9713 - val_loss: 0.8519 - val_acc: 0.8421 Epoch 314/500 36/36 [============================>.] - ETA: 0s - loss: 0.0875 - acc: 0.9711Epoch 00314: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0857 - acc: 0.9717 - val_loss: 0.9057 - val_acc: 0.8472 Epoch 315/500 36/36 [============================>.] - ETA: 0s - loss: 0.0914 - acc: 0.9691Epoch 00315: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0915 - acc: 0.9689 - val_loss: 0.8846 - val_acc: 0.8472 Epoch 316/500 36/36 [============================>.] - ETA: 0s - loss: 0.0897 - acc: 0.9709Epoch 00316: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0912 - acc: 0.9700 - val_loss: 0.9142 - val_acc: 0.8383 Epoch 317/500 36/36 [============================>.] - ETA: 0s - loss: 0.0966 - acc: 0.9716Epoch 00317: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0953 - acc: 0.9719 - val_loss: 0.8820 - val_acc: 0.8440 Epoch 318/500 36/36 [============================>.] - ETA: 0s - loss: 0.0978 - acc: 0.9690Epoch 00318: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0961 - acc: 0.9697 - val_loss: 0.8954 - val_acc: 0.8396 Epoch 319/500 36/36 [============================>.] - ETA: 0s - loss: 0.0867 - acc: 0.9720Epoch 00319: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0861 - acc: 0.9723 - val_loss: 0.9056 - val_acc: 0.8517 Epoch 320/500 36/36 [============================>.] - ETA: 0s - loss: 0.0841 - acc: 0.9721Epoch 00320: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0834 - acc: 0.9722 - val_loss: 0.9595 - val_acc: 0.8460 Epoch 321/500 36/36 [============================>.] - ETA: 0s - loss: 0.0980 - acc: 0.9684Epoch 00321: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0964 - acc: 0.9690 - val_loss: 0.9432 - val_acc: 0.8383 Epoch 322/500 36/36 [============================>.] - ETA: 0s - loss: 0.0766 - acc: 0.9726- ETA: 2s Epoch 00322: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0787 - acc: 0.9729 - val_loss: 0.9331 - val_acc: 0.8466 Epoch 323/500 36/36 [============================>.] - ETA: 0s - loss: 0.0859 - acc: 0.9712Epoch 00323: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0864 - acc: 0.9711 - val_loss: 0.8698 - val_acc: 0.8460 Epoch 324/500 36/36 [============================>.] - ETA: 0s - loss: 0.0787 - acc: 0.9743Epoch 00324: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0772 - acc: 0.9748 - val_loss: 0.9687 - val_acc: 0.8440 Epoch 325/500 36/36 [============================>.] - ETA: 0s - loss: 0.0764 - acc: 0.9739Epoch 00325: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0763 - acc: 0.9744 - val_loss: 0.9621 - val_acc: 0.8523 Epoch 326/500 36/36 [============================>.] - ETA: 0s - loss: 0.0876 - acc: 0.9699Epoch 00326: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0870 - acc: 0.9702 - val_loss: 0.9773 - val_acc: 0.8428 Epoch 327/500 36/36 [============================>.] - ETA: 0s - loss: 0.0845 - acc: 0.9722Epoch 00327: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0844 - acc: 0.9723 - val_loss: 0.8746 - val_acc: 0.8517 Epoch 328/500 36/36 [============================>.] - ETA: 0s - loss: 0.0917 - acc: 0.9736Epoch 00328: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0903 - acc: 0.9739 - val_loss: 0.8660 - val_acc: 0.8523 Epoch 329/500 36/36 [============================>.] - ETA: 0s - loss: 0.0957 - acc: 0.9712Epoch 00329: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0967 - acc: 0.9709 - val_loss: 0.8659 - val_acc: 0.8428 Epoch 330/500 36/36 [============================>.] - ETA: 0s - loss: 0.0771 - acc: 0.9752Epoch 00330: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0792 - acc: 0.9748 - val_loss: 1.0340 - val_acc: 0.8390 Epoch 331/500 36/36 [============================>.] - ETA: 0s - loss: 0.0915 - acc: 0.9692Epoch 00331: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0927 - acc: 0.9691 - val_loss: 0.9530 - val_acc: 0.8460 Epoch 332/500 36/36 [============================>.] - ETA: 0s - loss: 0.0901 - acc: 0.9688Epoch 00332: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0886 - acc: 0.9694 - val_loss: 0.9421 - val_acc: 0.8472 Epoch 333/500 36/36 [============================>.] - ETA: 0s - loss: 0.0854 - acc: 0.9719Epoch 00333: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0858 - acc: 0.9720 - val_loss: 0.9137 - val_acc: 0.8530 Epoch 334/500 36/36 [============================>.] - ETA: 0s - loss: 0.0838 - acc: 0.9717Epoch 00334: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0823 - acc: 0.9725 - val_loss: 0.8785 - val_acc: 0.8440 Epoch 335/500 36/36 [============================>.] - ETA: 0s - loss: 0.0833 - acc: 0.9730Epoch 00335: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0834 - acc: 0.9727 - val_loss: 0.8523 - val_acc: 0.8421 Epoch 336/500 36/36 [============================>.] - ETA: 0s - loss: 0.0865 - acc: 0.9723Epoch 00336: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0846 - acc: 0.9730 - val_loss: 0.9212 - val_acc: 0.8390 Epoch 337/500 36/36 [============================>.] - ETA: 0s - loss: 0.0857 - acc: 0.9723Epoch 00337: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0854 - acc: 0.9720 - val_loss: 0.8496 - val_acc: 0.8511 Epoch 338/500 36/36 [============================>.] - ETA: 0s - loss: 0.0757 - acc: 0.9751- ETA: 1s - loss: 0.0854Epoch 00338: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0756 - acc: 0.9752 - val_loss: 0.9761 - val_acc: 0.8498 Epoch 339/500 36/36 [============================>.] - ETA: 0s - loss: 0.0818 - acc: 0.9773Epoch 00339: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0801 - acc: 0.9775 - val_loss: 0.9354 - val_acc: 0.8370 Epoch 340/500 36/36 [============================>.] - ETA: 0s - loss: 0.0779 - acc: 0.9755Epoch 00340: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0777 - acc: 0.9758 - val_loss: 0.9492 - val_acc: 0.8390 Epoch 341/500 36/36 [============================>.] - ETA: 0s - loss: 0.0871 - acc: 0.9719Epoch 00341: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0860 - acc: 0.9721 - val_loss: 0.9905 - val_acc: 0.8479 Epoch 342/500 36/36 [============================>.] - ETA: 0s - loss: 0.0870 - acc: 0.9736Epoch 00342: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0878 - acc: 0.9731 - val_loss: 0.9397 - val_acc: 0.8415 Epoch 343/500 36/36 [============================>.] - ETA: 0s - loss: 0.0847 - acc: 0.9709Epoch 00343: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0861 - acc: 0.9706 - val_loss: 0.9330 - val_acc: 0.8434 Epoch 344/500 36/36 [============================>.] - ETA: 0s - loss: 0.0772 - acc: 0.9706- ETA: 2Epoch 00344: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0758 - acc: 0.9712 - val_loss: 0.9827 - val_acc: 0.8453 Epoch 345/500 36/36 [============================>.] - ETA: 0s - loss: 0.0853 - acc: 0.9706Epoch 00345: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0846 - acc: 0.9709 - val_loss: 0.9131 - val_acc: 0.8415 Epoch 346/500 36/36 [============================>.] - ETA: 0s - loss: 0.0874 - acc: 0.9714Epoch 00346: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0874 - acc: 0.9713 - val_loss: 0.9346 - val_acc: 0.8409 Epoch 347/500 36/36 [============================>.] - ETA: 0s - loss: 0.0778 - acc: 0.9747- ETA: 0s - loss: 0.0778 - acc: 0.97Epoch 00347: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0774 - acc: 0.9747 - val_loss: 0.9450 - val_acc: 0.8485 Epoch 348/500 36/36 [============================>.] - ETA: 0s - loss: 0.0879 - acc: 0.9716Epoch 00348: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0877 - acc: 0.9716 - val_loss: 1.0111 - val_acc: 0.8421 Epoch 349/500 36/36 [============================>.] - ETA: 0s - loss: 0.0684 - acc: 0.9759Epoch 00349: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0684 - acc: 0.9755 - val_loss: 0.9461 - val_acc: 0.8402 Epoch 350/500 36/36 [============================>.] - ETA: 0s - loss: 0.0861 - acc: 0.9696Epoch 00350: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0858 - acc: 0.9698 - val_loss: 0.9102 - val_acc: 0.8409 Epoch 351/500 36/36 [============================>.] - ETA: 0s - loss: 0.0862 - acc: 0.9722Epoch 00351: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0861 - acc: 0.9719 - val_loss: 0.9229 - val_acc: 0.8460 Epoch 352/500 36/36 [============================>.] - ETA: 0s - loss: 0.0868 - acc: 0.9719Epoch 00352: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.0858 - acc: 0.9720 - val_loss: 0.9204 - val_acc: 0.8460 Epoch 353/500 36/36 [============================>.] - ETA: 0s - loss: 0.0818 - acc: 0.9736Epoch 00353: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0831 - acc: 0.9731 - val_loss: 0.9234 - val_acc: 0.8466 Epoch 354/500 36/36 [============================>.] - ETA: 0s - loss: 0.0808 - acc: 0.9703Epoch 00354: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0818 - acc: 0.9701 - val_loss: 0.9223 - val_acc: 0.8434 Epoch 355/500 36/36 [============================>.] - ETA: 0s - loss: 0.0780 - acc: 0.9760Epoch 00355: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0777 - acc: 0.9758 - val_loss: 0.9232 - val_acc: 0.8479 Epoch 356/500 36/36 [============================>.] - ETA: 0s - loss: 0.0743 - acc: 0.9739Epoch 00356: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0731 - acc: 0.9741 - val_loss: 0.9899 - val_acc: 0.8390 Epoch 357/500 36/36 [============================>.] - ETA: 0s - loss: 0.0900 - acc: 0.9711Epoch 00357: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0896 - acc: 0.9710 - val_loss: 0.9653 - val_acc: 0.8498 Epoch 358/500 36/36 [============================>.] - ETA: 0s - loss: 0.0788 - acc: 0.9739Epoch 00358: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0775 - acc: 0.9742 - val_loss: 0.9697 - val_acc: 0.8447 Epoch 359/500 36/36 [============================>.] - ETA: 0s - loss: 0.0732 - acc: 0.9757Epoch 00359: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0735 - acc: 0.9757 - val_loss: 0.9687 - val_acc: 0.8415 Epoch 360/500 36/36 [============================>.] - ETA: 0s - loss: 0.0761 - acc: 0.9754Epoch 00360: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0769 - acc: 0.9752 - val_loss: 0.9207 - val_acc: 0.8479 Epoch 361/500 36/36 [============================>.] - ETA: 0s - loss: 0.0666 - acc: 0.9791Epoch 00361: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0668 - acc: 0.9791 - val_loss: 0.9837 - val_acc: 0.8498 Epoch 362/500 36/36 [============================>.] - ETA: 0s - loss: 0.0743 - acc: 0.9772Epoch 00362: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0745 - acc: 0.9770 - val_loss: 0.9656 - val_acc: 0.8402 Epoch 363/500 36/36 [============================>.] - ETA: 0s - loss: 0.0763 - acc: 0.9752Epoch 00363: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0776 - acc: 0.9751 - val_loss: 0.9935 - val_acc: 0.8377 Epoch 364/500 36/36 [============================>.] - ETA: 0s - loss: 0.0774 - acc: 0.9782Epoch 00364: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0774 - acc: 0.9779 - val_loss: 0.9557 - val_acc: 0.8504 Epoch 365/500 36/36 [============================>.] - ETA: 0s - loss: 0.0812 - acc: 0.9741Epoch 00365: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0810 - acc: 0.9740 - val_loss: 0.9771 - val_acc: 0.8415 Epoch 366/500 36/36 [============================>.] - ETA: 0s - loss: 0.0862 - acc: 0.9741Epoch 00366: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0861 - acc: 0.9740 - val_loss: 0.9246 - val_acc: 0.8472 Epoch 367/500 36/36 [============================>.] - ETA: 0s - loss: 0.0678 - acc: 0.9791Epoch 00367: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0681 - acc: 0.9792 - val_loss: 1.0050 - val_acc: 0.8542 Epoch 368/500 36/36 [============================>.] - ETA: 0s - loss: 0.0908 - acc: 0.9698Epoch 00368: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0894 - acc: 0.9704 - val_loss: 1.0069 - val_acc: 0.8415 Epoch 369/500 36/36 [============================>.] - ETA: 0s - loss: 0.0842 - acc: 0.9737Epoch 00369: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0837 - acc: 0.9740 - val_loss: 1.0165 - val_acc: 0.8396 Epoch 370/500 36/36 [============================>.] - ETA: 0s - loss: 0.0740 - acc: 0.9761Epoch 00370: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0727 - acc: 0.9763 - val_loss: 1.0084 - val_acc: 0.8466 Epoch 371/500 36/36 [============================>.] - ETA: 0s - loss: 0.0723 - acc: 0.9776Epoch 00371: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0715 - acc: 0.9780 - val_loss: 1.0005 - val_acc: 0.8498 Epoch 372/500 36/36 [============================>.] - ETA: 0s - loss: 0.0590 - acc: 0.9793Epoch 00372: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0625 - acc: 0.9793 - val_loss: 1.0397 - val_acc: 0.8434 Epoch 373/500 36/36 [============================>.] - ETA: 0s - loss: 0.0789 - acc: 0.9718Epoch 00373: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0796 - acc: 0.9715 - val_loss: 0.9805 - val_acc: 0.8390 Epoch 374/500 36/36 [============================>.] - ETA: 0s - loss: 0.0643 - acc: 0.9806Epoch 00374: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0637 - acc: 0.9807 - val_loss: 0.9575 - val_acc: 0.8409 Epoch 375/500 36/36 [============================>.] - ETA: 0s - loss: 0.0710 - acc: 0.9760Epoch 00375: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0717 - acc: 0.9758 - val_loss: 1.0599 - val_acc: 0.8364 Epoch 376/500 36/36 [============================>.] - ETA: 0s - loss: 0.0875 - acc: 0.9716Epoch 00376: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0859 - acc: 0.9721 - val_loss: 0.9575 - val_acc: 0.8364 Epoch 377/500 36/36 [============================>.] - ETA: 0s - loss: 0.0756 - acc: 0.9769Epoch 00377: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0753 - acc: 0.9769 - val_loss: 0.9710 - val_acc: 0.8440 Epoch 378/500 36/36 [============================>.] - ETA: 0s - loss: 0.0694 - acc: 0.9755Epoch 00378: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0688 - acc: 0.9756 - val_loss: 1.0158 - val_acc: 0.8421 Epoch 379/500 36/36 [============================>.] - ETA: 0s - loss: 0.0813 - acc: 0.9734Epoch 00379: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0813 - acc: 0.9730 - val_loss: 0.9460 - val_acc: 0.8472 Epoch 380/500 36/36 [============================>.] - ETA: 0s - loss: 0.0676 - acc: 0.9778Epoch 00380: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0674 - acc: 0.9776 - val_loss: 0.9326 - val_acc: 0.8530 Epoch 381/500 36/36 [============================>.] - ETA: 0s - loss: 0.0794 - acc: 0.9755Epoch 00381: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0792 - acc: 0.9758 - val_loss: 0.8946 - val_acc: 0.8421 Epoch 382/500 36/36 [============================>.] - ETA: 0s - loss: 0.0805 - acc: 0.9752Epoch 00382: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0801 - acc: 0.9755 - val_loss: 1.0161 - val_acc: 0.8415 Epoch 383/500 36/36 [============================>.] - ETA: 0s - loss: 0.0729 - acc: 0.9759Epoch 00383: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0733 - acc: 0.9757 - val_loss: 0.9812 - val_acc: 0.8453 Epoch 384/500 36/36 [============================>.] - ETA: 0s - loss: 0.0623 - acc: 0.9783Epoch 00384: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0644 - acc: 0.9778 - val_loss: 0.9901 - val_acc: 0.8491 Epoch 385/500 36/36 [============================>.] - ETA: 0s - loss: 0.0699 - acc: 0.9772Epoch 00385: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0714 - acc: 0.9765 - val_loss: 0.9768 - val_acc: 0.8409 Epoch 386/500 36/36 [============================>.] - ETA: 0s - loss: 0.0744 - acc: 0.9763- ETA: 0s - loss: 0.0722 - acc: Epoch 00386: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0767 - acc: 0.9759 - val_loss: 1.0505 - val_acc: 0.8504 Epoch 387/500 36/36 [============================>.] - ETA: 0s - loss: 0.0676 - acc: 0.9771Epoch 00387: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0668 - acc: 0.9773 - val_loss: 1.0276 - val_acc: 0.8440 Epoch 388/500 36/36 [============================>.] - ETA: 0s - loss: 0.0712 - acc: 0.9752Epoch 00388: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0705 - acc: 0.9755 - val_loss: 0.9827 - val_acc: 0.8396 Epoch 389/500 36/36 [============================>.] - ETA: 0s - loss: 0.0678 - acc: 0.9761Epoch 00389: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0666 - acc: 0.9764 - val_loss: 0.9807 - val_acc: 0.8415 Epoch 390/500 36/36 [============================>.] - ETA: 0s - loss: 0.0824 - acc: 0.9733Epoch 00390: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0852 - acc: 0.9730 - val_loss: 0.9078 - val_acc: 0.8370 Epoch 391/500 36/36 [============================>.] - ETA: 0s - loss: 0.0831 - acc: 0.9755Epoch 00391: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0830 - acc: 0.9751 - val_loss: 0.9293 - val_acc: 0.8421 Epoch 392/500 36/36 [============================>.] - ETA: 0s - loss: 0.0721 - acc: 0.9775Epoch 00392: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0707 - acc: 0.9779 - val_loss: 0.9756 - val_acc: 0.8415 Epoch 393/500 36/36 [============================>.] - ETA: 0s - loss: 0.0638 - acc: 0.9807Epoch 00393: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0643 - acc: 0.9806 - val_loss: 0.9921 - val_acc: 0.8485 Epoch 394/500 36/36 [============================>.] - ETA: 0s - loss: 0.0724 - acc: 0.9765Epoch 00394: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.0710 - acc: 0.9769 - val_loss: 0.9908 - val_acc: 0.8409 Epoch 395/500 36/36 [============================>.] - ETA: 0s - loss: 0.0843 - acc: 0.9733Epoch 00395: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0836 - acc: 0.9735 - val_loss: 0.9478 - val_acc: 0.8370 Epoch 396/500 36/36 [============================>.] - ETA: 0s - loss: 0.0708 - acc: 0.9775Epoch 00396: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0713 - acc: 0.9771 - val_loss: 0.9531 - val_acc: 0.8447 Epoch 397/500 36/36 [============================>.] - ETA: 0s - loss: 0.0698 - acc: 0.9759Epoch 00397: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0731 - acc: 0.9746 - val_loss: 0.9580 - val_acc: 0.8428 Epoch 398/500 36/36 [============================>.] - ETA: 0s - loss: 0.0770 - acc: 0.9769Epoch 00398: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0782 - acc: 0.9771 - val_loss: 1.0042 - val_acc: 0.8479 Epoch 399/500 36/36 [============================>.] - ETA: 0s - loss: 0.0679 - acc: 0.9788Epoch 00399: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0671 - acc: 0.9792 - val_loss: 1.0230 - val_acc: 0.8396 Epoch 400/500 36/36 [============================>.] - ETA: 0s - loss: 0.0686 - acc: 0.9772Epoch 00400: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0676 - acc: 0.9776 - val_loss: 0.9858 - val_acc: 0.8523 Epoch 401/500 36/36 [============================>.] - ETA: 0s - loss: 0.0722 - acc: 0.9767Epoch 00401: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0715 - acc: 0.9771 - val_loss: 1.0203 - val_acc: 0.8428 Epoch 402/500 36/36 [============================>.] - ETA: 0s - loss: 0.0718 - acc: 0.9764Epoch 00402: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0720 - acc: 0.9762 - val_loss: 0.9515 - val_acc: 0.8511 Epoch 403/500 36/36 [============================>.] - ETA: 0s - loss: 0.0718 - acc: 0.9771Epoch 00403: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0757 - acc: 0.9768 - val_loss: 0.9485 - val_acc: 0.8447 Epoch 404/500 36/36 [============================>.] - ETA: 0s - loss: 0.0659 - acc: 0.9735Epoch 00404: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0663 - acc: 0.9738 - val_loss: 0.9992 - val_acc: 0.8421 Epoch 405/500 36/36 [============================>.] - ETA: 0s - loss: 0.0722 - acc: 0.9758Epoch 00405: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0712 - acc: 0.9759 - val_loss: 0.9426 - val_acc: 0.8447 Epoch 406/500 36/36 [============================>.] - ETA: 0s - loss: 0.0545 - acc: 0.9810Epoch 00406: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0542 - acc: 0.9811 - val_loss: 1.0351 - val_acc: 0.8453 Epoch 407/500 36/36 [============================>.] - ETA: 0s - loss: 0.0615 - acc: 0.9793- ETA: 1s - loss: 0.0719 Epoch 00407: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0612 - acc: 0.9792 - val_loss: 0.9705 - val_acc: 0.8479 Epoch 408/500 36/36 [============================>.] - ETA: 0s - loss: 0.0684 - acc: 0.9767Epoch 00408: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0698 - acc: 0.9767 - val_loss: 0.9326 - val_acc: 0.8421 Epoch 409/500 36/36 [============================>.] - ETA: 0s - loss: 0.0724 - acc: 0.9752Epoch 00409: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0715 - acc: 0.9757 - val_loss: 0.9615 - val_acc: 0.8466 Epoch 410/500 36/36 [============================>.] - ETA: 0s - loss: 0.0690 - acc: 0.9785Epoch 00410: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0696 - acc: 0.9780 - val_loss: 0.9742 - val_acc: 0.8498 Epoch 411/500 36/36 [============================>.] - ETA: 0s - loss: 0.0782 - acc: 0.9748Epoch 00411: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0778 - acc: 0.9748 - val_loss: 0.9607 - val_acc: 0.8402 Epoch 412/500 36/36 [============================>.] - ETA: 0s - loss: 0.0722 - acc: 0.9779Epoch 00412: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0725 - acc: 0.9781 - val_loss: 0.9446 - val_acc: 0.8434 Epoch 413/500 36/36 [============================>.] - ETA: 0s - loss: 0.0673 - acc: 0.9800Epoch 00413: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0668 - acc: 0.9801 - val_loss: 0.9991 - val_acc: 0.8428 Epoch 414/500 36/36 [============================>.] - ETA: 0s - loss: 0.0646 - acc: 0.9782Epoch 00414: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0698 - acc: 0.9773 - val_loss: 0.9744 - val_acc: 0.8491 Epoch 415/500 36/36 [============================>.] - ETA: 0s - loss: 0.0681 - acc: 0.9779Epoch 00415: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0693 - acc: 0.9776 - val_loss: 1.1077 - val_acc: 0.8370 Epoch 416/500 36/36 [============================>.] - ETA: 0s - loss: 0.0714 - acc: 0.9753Epoch 00416: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0734 - acc: 0.9747 - val_loss: 0.9972 - val_acc: 0.8460 Epoch 417/500 36/36 [============================>.] - ETA: 0s - loss: 0.0701 - acc: 0.9764Epoch 00417: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0687 - acc: 0.9770 - val_loss: 1.0265 - val_acc: 0.8402 Epoch 418/500 36/36 [============================>.] - ETA: 0s - loss: 0.0710 - acc: 0.9780- ETA: 0s - loss: 0.0724 - acc: 0Epoch 00418: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0712 - acc: 0.9779 - val_loss: 1.0058 - val_acc: 0.8364 Epoch 419/500 36/36 [============================>.] - ETA: 0s - loss: 0.0684 - acc: 0.9766Epoch 00419: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0686 - acc: 0.9764 - val_loss: 1.0285 - val_acc: 0.8491 Epoch 420/500 36/36 [============================>.] - ETA: 0s - loss: 0.0534 - acc: 0.9818Epoch 00420: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0543 - acc: 0.9817 - val_loss: 1.0873 - val_acc: 0.8434 Epoch 421/500 36/36 [============================>.] - ETA: 0s - loss: 0.0722 - acc: 0.9754Epoch 00421: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0718 - acc: 0.9754 - val_loss: 1.0576 - val_acc: 0.8383 Epoch 422/500 36/36 [============================>.] - ETA: 0s - loss: 0.0828 - acc: 0.9727Epoch 00422: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0813 - acc: 0.9732 - val_loss: 1.0474 - val_acc: 0.8453 Epoch 423/500 36/36 [============================>.] - ETA: 0s - loss: 0.0664 - acc: 0.9793Epoch 00423: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0651 - acc: 0.9797 - val_loss: 0.9831 - val_acc: 0.8542 Epoch 424/500 36/36 [============================>.] - ETA: 0s - loss: 0.0691 - acc: 0.9778Epoch 00424: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0689 - acc: 0.9776 - val_loss: 0.9553 - val_acc: 0.8383 Epoch 425/500 36/36 [============================>.] - ETA: 0s - loss: 0.0611 - acc: 0.9802Epoch 00425: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0656 - acc: 0.9798 - val_loss: 0.9904 - val_acc: 0.8523 Epoch 426/500 36/36 [============================>.] - ETA: 0s - loss: 0.0625 - acc: 0.9800Epoch 00426: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0637 - acc: 0.9797 - val_loss: 1.0087 - val_acc: 0.8434 Epoch 427/500 36/36 [============================>.] - ETA: 0s - loss: 0.0660 - acc: 0.9789Epoch 00427: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0655 - acc: 0.9788 - val_loss: 0.9859 - val_acc: 0.8440 Epoch 428/500 36/36 [============================>.] - ETA: 0s - loss: 0.0599 - acc: 0.9804Epoch 00428: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0617 - acc: 0.9798 - val_loss: 1.0235 - val_acc: 0.8447 Epoch 429/500 36/36 [============================>.] - ETA: 0s - loss: 0.0739 - acc: 0.9768Epoch 00429: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0743 - acc: 0.9771 - val_loss: 0.9108 - val_acc: 0.8472 Epoch 430/500 36/36 [============================>.] - ETA: 0s - loss: 0.0582 - acc: 0.9808Epoch 00430: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0571 - acc: 0.9813 - val_loss: 1.0341 - val_acc: 0.8460 Epoch 431/500 36/36 [============================>.] - ETA: 0s - loss: 0.0615 - acc: 0.9781Epoch 00431: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0614 - acc: 0.9779 - val_loss: 1.0049 - val_acc: 0.8491 Epoch 432/500 36/36 [============================>.] - ETA: 0s - loss: 0.0525 - acc: 0.9821Epoch 00432: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0538 - acc: 0.9813 - val_loss: 1.0447 - val_acc: 0.8402 Epoch 433/500 36/36 [============================>.] - ETA: 0s - loss: 0.0683 - acc: 0.9761Epoch 00433: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0713 - acc: 0.9757 - val_loss: 0.9919 - val_acc: 0.8491 Epoch 434/500 36/36 [============================>.] - ETA: 0s - loss: 0.0705 - acc: 0.9767Epoch 00434: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0702 - acc: 0.9769 - val_loss: 0.9805 - val_acc: 0.8479 Epoch 435/500 36/36 [============================>.] - ETA: 0s - loss: 0.0770 - acc: 0.9778Epoch 00435: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0776 - acc: 0.9777 - val_loss: 1.0278 - val_acc: 0.8491 Epoch 436/500 36/36 [============================>.] - ETA: 0s - loss: 0.0769 - acc: 0.9767Epoch 00436: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0782 - acc: 0.9765 - val_loss: 0.9352 - val_acc: 0.8523 Epoch 437/500 36/36 [============================>.] - ETA: 0s - loss: 0.0724 - acc: 0.9754Epoch 00437: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0735 - acc: 0.9752 - val_loss: 1.0333 - val_acc: 0.8472 Epoch 438/500 36/36 [============================>.] - ETA: 0s - loss: 0.0748 - acc: 0.9749Epoch 00438: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0776 - acc: 0.9746 - val_loss: 0.9741 - val_acc: 0.8542 Epoch 439/500 36/36 [============================>.] - ETA: 0s - loss: 0.0571 - acc: 0.9823Epoch 00439: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0559 - acc: 0.9828 - val_loss: 1.0823 - val_acc: 0.8466 Epoch 440/500 36/36 [============================>.] - ETA: 0s - loss: 0.0579 - acc: 0.9825Epoch 00440: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0588 - acc: 0.9822 - val_loss: 1.0314 - val_acc: 0.8479 Epoch 441/500 36/36 [============================>.] - ETA: 0s - loss: 0.0706 - acc: 0.9780Epoch 00441: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0734 - acc: 0.9773 - val_loss: 1.0435 - val_acc: 0.8517 Epoch 442/500 36/36 [============================>.] - ETA: 0s - loss: 0.0722 - acc: 0.9753Epoch 00442: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0727 - acc: 0.9754 - val_loss: 1.0735 - val_acc: 0.8491 Epoch 443/500 36/36 [============================>.] - ETA: 0s - loss: 0.0867 - acc: 0.9731Epoch 00443: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0854 - acc: 0.9736 - val_loss: 0.9624 - val_acc: 0.8530 Epoch 444/500 36/36 [============================>.] - ETA: 0s - loss: 0.0768 - acc: 0.9770Epoch 00444: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0765 - acc: 0.9770 - val_loss: 1.0042 - val_acc: 0.8504 Epoch 445/500 36/36 [============================>.] - ETA: 0s - loss: 0.0648 - acc: 0.9769Epoch 00445: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0635 - acc: 0.9775 - val_loss: 0.9644 - val_acc: 0.8491 Epoch 446/500 36/36 [============================>.] - ETA: 0s - loss: 0.0497 - acc: 0.9843Epoch 00446: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0492 - acc: 0.9843 - val_loss: 0.9729 - val_acc: 0.8479 Epoch 447/500 36/36 [============================>.] - ETA: 0s - loss: 0.0606 - acc: 0.9831Epoch 00447: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0601 - acc: 0.9827 - val_loss: 1.0150 - val_acc: 0.8504 Epoch 448/500 36/36 [============================>.] - ETA: 0s - loss: 0.0494 - acc: 0.9826Epoch 00448: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0494 - acc: 0.9829 - val_loss: 0.9487 - val_acc: 0.8536 Epoch 449/500 36/36 [============================>.] - ETA: 0s - loss: 0.0616 - acc: 0.9784Epoch 00449: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0606 - acc: 0.9787 - val_loss: 0.9821 - val_acc: 0.8498 Epoch 450/500 36/36 [============================>.] - ETA: 0s - loss: 0.0657 - acc: 0.9796- ETA: 1s - loss: 0.0Epoch 00450: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0651 - acc: 0.9795 - val_loss: 1.0614 - val_acc: 0.8428 Epoch 451/500 36/36 [============================>.] - ETA: 0s - loss: 0.0667 - acc: 0.9782Epoch 00451: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0663 - acc: 0.9782 - val_loss: 0.9880 - val_acc: 0.8402 Epoch 452/500 36/36 [============================>.] - ETA: 0s - loss: 0.0607 - acc: 0.9779Epoch 00452: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0610 - acc: 0.9779 - val_loss: 1.0228 - val_acc: 0.8460 Epoch 453/500 36/36 [============================>.] - ETA: 0s - loss: 0.0674 - acc: 0.9781Epoch 00453: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0661 - acc: 0.9787 - val_loss: 1.0576 - val_acc: 0.8300 Epoch 454/500 36/36 [============================>.] - ETA: 0s - loss: 0.0610 - acc: 0.9802Epoch 00454: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0603 - acc: 0.9805 - val_loss: 1.0625 - val_acc: 0.8370 Epoch 455/500 36/36 [============================>.] - ETA: 0s - loss: 0.0600 - acc: 0.9825Epoch 00455: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0598 - acc: 0.9826 - val_loss: 1.0247 - val_acc: 0.8511 Epoch 456/500 36/36 [============================>.] - ETA: 0s - loss: 0.0661 - acc: 0.9802Epoch 00456: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0646 - acc: 0.9807 - val_loss: 1.0286 - val_acc: 0.8377 Epoch 457/500 36/36 [============================>.] - ETA: 0s - loss: 0.0675 - acc: 0.9782- ETA: 2s - loss: - ETA: 1s - loss: 0.0626 - aEpoch 00457: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0681 - acc: 0.9777 - val_loss: 1.0013 - val_acc: 0.8332 Epoch 458/500 36/36 [============================>.] - ETA: 0s - loss: 0.0542 - acc: 0.9823Epoch 00458: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0542 - acc: 0.9822 - val_loss: 1.0214 - val_acc: 0.8428 Epoch 459/500 36/36 [============================>.] - ETA: 0s - loss: 0.0643 - acc: 0.9804- ETA: 0s - loss: 0.0656 - acc: 0.980Epoch 00459: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0633 - acc: 0.9807 - val_loss: 1.0546 - val_acc: 0.8491 Epoch 460/500 36/36 [============================>.] - ETA: 0s - loss: 0.0658 - acc: 0.9797Epoch 00460: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0677 - acc: 0.9788 - val_loss: 1.0936 - val_acc: 0.8415 Epoch 461/500 36/36 [============================>.] - ETA: 0s - loss: 0.0654 - acc: 0.9800Epoch 00461: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0663 - acc: 0.9797 - val_loss: 0.9827 - val_acc: 0.8383 Epoch 462/500 36/36 [============================>.] - ETA: 0s - loss: 0.0476 - acc: 0.9850Epoch 00462: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0478 - acc: 0.9850 - val_loss: 1.0276 - val_acc: 0.8472 Epoch 463/500 36/36 [============================>.] - ETA: 0s - loss: 0.0673 - acc: 0.9791Epoch 00463: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0673 - acc: 0.9792 - val_loss: 1.0005 - val_acc: 0.8377 Epoch 464/500 36/36 [============================>.] - ETA: 0s - loss: 0.0573 - acc: 0.9811Epoch 00464: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0574 - acc: 0.9809 - val_loss: 1.0012 - val_acc: 0.8460 Epoch 465/500 36/36 [============================>.] - ETA: 0s - loss: 0.0559 - acc: 0.9809Epoch 00465: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0559 - acc: 0.9807 - val_loss: 0.9813 - val_acc: 0.8415 Epoch 466/500 36/36 [============================>.] - ETA: 0s - loss: 0.0616 - acc: 0.9835Epoch 00466: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0613 - acc: 0.9833 - val_loss: 1.0303 - val_acc: 0.8332 Epoch 467/500 36/36 [============================>.] - ETA: 0s - loss: 0.0686 - acc: 0.9784Epoch 00467: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0689 - acc: 0.9784 - val_loss: 1.0318 - val_acc: 0.8415 Epoch 468/500 36/36 [============================>.] - ETA: 0s - loss: 0.0648 - acc: 0.9789Epoch 00468: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0642 - acc: 0.9790 - val_loss: 1.0230 - val_acc: 0.8460 Epoch 469/500 36/36 [============================>.] - ETA: 0s - loss: 0.0768 - acc: 0.9769Epoch 00469: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0792 - acc: 0.9765 - val_loss: 0.9590 - val_acc: 0.8498 Epoch 470/500 36/36 [============================>.] - ETA: 0s - loss: 0.0645 - acc: 0.9807Epoch 00470: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0673 - acc: 0.9804 - val_loss: 1.0704 - val_acc: 0.8345 Epoch 471/500 36/36 [============================>.] - ETA: 0s - loss: 0.0651 - acc: 0.9799Epoch 00471: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0639 - acc: 0.9802 - val_loss: 0.9353 - val_acc: 0.8434 Epoch 472/500 36/36 [============================>.] - ETA: 0s - loss: 0.0711 - acc: 0.9789Epoch 00472: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0706 - acc: 0.9790 - val_loss: 0.9695 - val_acc: 0.8434 Epoch 473/500 36/36 [============================>.] - ETA: 0s - loss: 0.0475 - acc: 0.9828Epoch 00473: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0476 - acc: 0.9826 - val_loss: 0.9992 - val_acc: 0.8440 Epoch 474/500 36/36 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 0.9802Epoch 00474: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0624 - acc: 0.9805 - val_loss: 0.9376 - val_acc: 0.8370 Epoch 475/500 36/36 [============================>.] - ETA: 0s - loss: 0.0716 - acc: 0.9745Epoch 00475: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0707 - acc: 0.9748 - val_loss: 0.9366 - val_acc: 0.8377 Epoch 476/500 36/36 [============================>.] - ETA: 0s - loss: 0.0605 - acc: 0.9782Epoch 00476: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0619 - acc: 0.9780 - val_loss: 1.0020 - val_acc: 0.8504 Epoch 477/500 36/36 [============================>.] - ETA: 0s - loss: 0.0507 - acc: 0.9833Epoch 00477: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0503 - acc: 0.9833 - val_loss: 0.9810 - val_acc: 0.8434 Epoch 478/500 36/36 [============================>.] - ETA: 0s - loss: 0.0555 - acc: 0.9829Epoch 00478: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0552 - acc: 0.9827 - val_loss: 1.0260 - val_acc: 0.8498 Epoch 479/500 36/36 [============================>.] - ETA: 0s - loss: 0.0622 - acc: 0.9793Epoch 00479: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0628 - acc: 0.9790 - val_loss: 1.0310 - val_acc: 0.8364 Epoch 480/500 36/36 [============================>.] - ETA: 0s - loss: 0.0631 - acc: 0.9799Epoch 00480: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0627 - acc: 0.9801 - val_loss: 1.0427 - val_acc: 0.8390 Epoch 481/500 36/36 [============================>.] - ETA: 0s - loss: 0.0709 - acc: 0.9776Epoch 00481: val_acc did not improve 37/36 [==============================] - 4s 103ms/step - loss: 0.0705 - acc: 0.9777 - val_loss: 1.0181 - val_acc: 0.8447 Epoch 482/500 36/36 [============================>.] - ETA: 0s - loss: 0.0604 - acc: 0.9808Epoch 00482: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0606 - acc: 0.9806 - val_loss: 1.0099 - val_acc: 0.8428 Epoch 483/500 36/36 [============================>.] - ETA: 0s - loss: 0.0542 - acc: 0.9819Epoch 00483: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0556 - acc: 0.9815 - val_loss: 1.0727 - val_acc: 0.8409 Epoch 484/500 36/36 [============================>.] - ETA: 0s - loss: 0.0585 - acc: 0.9815Epoch 00484: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0581 - acc: 0.9813 - val_loss: 0.9782 - val_acc: 0.8511 Epoch 485/500 36/36 [============================>.] - ETA: 0s - loss: 0.0609 - acc: 0.9802Epoch 00485: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0619 - acc: 0.9803 - val_loss: 0.9964 - val_acc: 0.8453 Epoch 486/500 36/36 [============================>.] - ETA: 0s - loss: 0.0685 - acc: 0.9775Epoch 00486: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0674 - acc: 0.9779 - val_loss: 1.0003 - val_acc: 0.8453 Epoch 487/500 36/36 [============================>.] - ETA: 0s - loss: 0.0648 - acc: 0.9835Epoch 00487: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0644 - acc: 0.9837 - val_loss: 0.9929 - val_acc: 0.8434 Epoch 488/500 36/36 [============================>.] - ETA: 0s - loss: 0.0527 - acc: 0.9828- ETA: 1s - loss: 0.045Epoch 00488: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0532 - acc: 0.9826 - val_loss: 1.0625 - val_acc: 0.8440 Epoch 489/500 36/36 [============================>.] - ETA: 0s - loss: 0.0584 - acc: 0.9817Epoch 00489: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0572 - acc: 0.9822 - val_loss: 1.0303 - val_acc: 0.8530 Epoch 490/500 36/36 [============================>.] - ETA: 0s - loss: 0.0666 - acc: 0.9799Epoch 00490: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0659 - acc: 0.9798 - val_loss: 0.9709 - val_acc: 0.8460 Epoch 491/500 36/36 [============================>.] - ETA: 0s - loss: 0.0573 - acc: 0.9830Epoch 00491: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0572 - acc: 0.9833 - val_loss: 1.0299 - val_acc: 0.8504 Epoch 492/500 36/36 [============================>.] - ETA: 0s - loss: 0.0744 - acc: 0.9773Epoch 00492: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0730 - acc: 0.9779 - val_loss: 0.9579 - val_acc: 0.8390 Epoch 493/500 36/36 [============================>.] - ETA: 0s - loss: 0.0544 - acc: 0.9825Epoch 00493: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0549 - acc: 0.9822 - val_loss: 1.0702 - val_acc: 0.8517 Epoch 494/500 36/36 [============================>.] - ETA: 0s - loss: 0.0654 - acc: 0.9785- ETA: 0s - loss: 0.0691 - acc: 0Epoch 00494: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0680 - acc: 0.9782 - val_loss: 0.9963 - val_acc: 0.8447 Epoch 495/500 36/36 [============================>.] - ETA: 0s - loss: 0.0564 - acc: 0.9810Epoch 00495: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0571 - acc: 0.9811 - val_loss: 1.0619 - val_acc: 0.8396 Epoch 496/500 36/36 [============================>.] - ETA: 0s - loss: 0.0602 - acc: 0.9804Epoch 00496: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0592 - acc: 0.9807 - val_loss: 1.0286 - val_acc: 0.8428 Epoch 497/500 36/36 [============================>.] - ETA: 0s - loss: 0.0531 - acc: 0.9819Epoch 00497: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0529 - acc: 0.9820 - val_loss: 1.0863 - val_acc: 0.8440 Epoch 498/500 36/36 [============================>.] - ETA: 0s - loss: 0.0614 - acc: 0.9806Epoch 00498: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0606 - acc: 0.9805 - val_loss: 1.0873 - val_acc: 0.8402 Epoch 499/500 36/36 [============================>.] - ETA: 0s - loss: 0.0629 - acc: 0.9793Epoch 00499: val_acc did not improve 37/36 [==============================] - 4s 105ms/step - loss: 0.0647 - acc: 0.9788 - val_loss: 1.0634 - val_acc: 0.8409 Epoch 500/500 36/36 [============================>.] - ETA: 0s - loss: 0.0559 - acc: 0.9817Epoch 00500: val_acc did not improve 37/36 [==============================] - 4s 104ms/step - loss: 0.0548 - acc: 0.9820 - val_loss: 0.9885 - val_acc: 0.8364 6220/6220 [==============================] - 2s 279us/step
# 透過趨勢圖來觀察訓練與驗證的走向 (特別去觀察是否有"過擬合(overfitting)"的現象)
import matplotlib.pyplot as plt
# 把每個訓練循環(epochs)的相關重要的監控指標取出來
acc = history.history['acc']
val_acc = history.history['val_acc']
loss = history.history['loss']
val_loss = history.history['val_loss']
# 取得整個訓練循環(epochs)的總次數
epochs = range(len(acc))
# 把"訓練準確率(Training acc)"與"驗證準確率(Validation acc)"的趨勢線形表現在圖表上
plt.plot(epochs, acc, 'bo', label='Training acc')
plt.plot(epochs, val_acc, 'b', label='Validation acc')
plt.title('Training and validation accuracy')
plt.legend()
plt.figure()
# 把"訓練損失(Training loss)"與"驗證損失(Validation loss)"的趨勢線形表現在圖表上
plt.plot(epochs, loss, 'bo', label='Training loss')
plt.plot(epochs, val_loss, 'b', label='Validation loss')
plt.title('Training and validation loss')
plt.legend()
plt.show()
從"Training與validation accuracy"的線型圖來看, 訓練到50~60循環(epochs)之後驗證的準確率就提不上去了, 但是訓練的準確率確可以一直提高。 雖然說83%的預測準確率在Kaggle的competition裡己經是前10名左右了, 但如果想要繼續提升效果的話可的的方向:
在這篇文章中有一些個人學習到的一些有趣的重點: