This method uses white-box access to the layers of a pre-trained complex neural network model, a training dataset and a training algorithm for a simple model (presumably with much smaller number of parameters compared to the complex model like Decision Tree, Neural Nets with very few layers) and produces a new model in the simple model hypothesis class.
The aim is to make sure that this new simple model (trained with the help of a complex model) has a higher accuracy on the training dataset than the output of the simple model training algorithm working only with the training dataset.
The reasons why one would prefer a simple model is because of resource constraints or because of better interpretability offered by the simple model.
The main idea is the following: For every sample (x,y) in the training dataset, we would like to produce a sample weight w(x,y) which indicates how easy/hard the example is to learn. w(x,y) is higher if the example is easier to learn for the complex model. Prof-Weight obtains these weights as follows:
a) Take the complex model layer L (flattened layer output). Create dataset consisting L(x),y.
b) Train a logistic classifier (we call it the probe classifier) that uses the representation L(x) and predicts y using a linear model. Let the probabilistic confidences of the probe classifier model trained only on Layer L representation be p(x,y,L).
c) Repeat steps a and b for the top K layers in the complex model.
d) Now take every point (x,y) in the training dataset available for the simple model to train. Let w(x,y)= (\sum_{L} p(x,y,L))/ num of layers used. These are the new sample weights.
e) Use the simple model training algorithm with w(x,y) as the sample weights.
Intuition: Measure of hardness or easiness of the sample may not be indicated by the final layer confidences in a highly confident complex deep neural network model in a manner that is useful for training a much simpler model. So we track how easy is a sample to predict from lower level layers's representation. So the average of the probe classifier's predictions for top K layers being high means that that sample's prediction is confident from a much lower layer indicating easiness of the sample. For a hard example, only last few layer confidences will be higher. Earlier layer representations won't have enough distinguishability.
We demonstrate this method where the complex model (an 18 layer Resnet) is trained on 30000 samples of the CIFAR-10 training dataset. The simple model is a Resnet with only one Resblock. The training dataset available is the rest of the 20000 samples in the standard CIFAR-10 dataset. The test dataset is the 10000 samples as in standard CIFAR-10 dataset.
Demonstrations: a) We demonstrate how to attach probes to a specific layer on a complex model stored as a tensorflow checkpoint. b) How to evaulate the flattened layer output and then use it to train a logistic probe classifier to predict y. c) Use pre-stored probe classifiers' confidences for the top K layers (we dont show probe training on all the top K layers in the notebook. However, we do demonstrate probe classifier training on one of the layers) and form sample weights d) Train the simple model using these new sample weights using the Prof-Weight Explainer Class.
Complex Model is trained on train1 (30000 samples), Simple Model is alwasy trained on train2 (20000) samples. Probe Classifiers are trained on layer representations of the complex model on train1 samples. However, probe confidences are evaluated on train2 (on which the simple model is also trained) to provide sample weights.
References for this method:
import sys
sys.path.append("../../")
from aix360.algorithms.profwt import train_probes
from aix360.algorithms.profwt import attach_probe_checkpoint
from aix360.datasets.cifar_dataset import CIFARDataset
import json
import numpy as np
import tensorflow as tf
import os
#Obtain parent directory for acccessing various data files.
parent_dir = '../../aix360/models/profwt'
This complex Resnet model has been trained using the model definitions obtained from: https://github.com/tensorflow/models/tree/master/research/resnet
checkpoint_path = os.path.join(parent_dir, "checkpoints/train_resnetmodel_new1_799.ckpt")
dataset_obj=CIFARDataset("../../aix360/data/cifar_data")
x_train1 =dataset_obj.load_file('cifar-10-train1-image.json')
y_train1=dataset_obj.load_file('cifar-10-train1-label.json')
run=1
os.mkdir(parent_dir+'/data')
to_save_filename=parent_dir+'/data/probe_run'+str(run)+'.npy'
print(to_save_filename)
../../aix360/models/profwt/data/probe_run1.npy
attach_probe_checkpoint.print_layer_labels(checkpoint_path)
tf.reset_default_graph()
[<tf.Operation 'Placeholder' type=Placeholder>, <tf.Operation 'Placeholder_1' type=Placeholder>, <tf.Operation 'init/init_conv/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'init/init_conv/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'init/init_conv/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'init/init_conv/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'init/init_conv/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'init/init_conv/DW/Initializer/random_normal' type=Add>, <tf.Operation 'init/init_conv/DW' type=VariableV2>, <tf.Operation 'init/init_conv/DW/Assign' type=Assign>, <tf.Operation 'init/init_conv/DW/read' type=Identity>, <tf.Operation 'init/init_conv/Conv2D' type=Conv2D>, <tf.Operation 'init/Reshape/shape' type=Const>, <tf.Operation 'init/Reshape' type=Reshape>, <tf.Operation 'unit_1_0/shared_activation/init_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/beta' type=VariableV2>, <tf.Operation 'unit_1_0/shared_activation/init_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_1_0/shared_activation/init_bn/beta/read' type=Identity>, <tf.Operation 'unit_1_0/shared_activation/init_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/gamma' type=VariableV2>, <tf.Operation 'unit_1_0/shared_activation/init_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_1_0/shared_activation/init_bn/gamma/read' type=Identity>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moments/mean' type=Mean>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moments/variance' type=Mean>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_1_0/shared_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/unit_1_0/shared_activation/init_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/unit_1_0/shared_activation/init_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/unit_1_0/shared_activation/init_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/unit_1_0/shared_activation/init_bn/moving_mean/unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/unit_1_0/shared_activation/init_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/unit_1_0/shared_activation/init_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/unit_1_0/shared_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/unit_1_0/shared_activation/init_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/unit_1_0/shared_activation/init_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/unit_1_0/shared_activation/init_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/unit_1_0/shared_activation/init_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/unit_1_0/shared_activation/init_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/unit_1_0/shared_activation/init_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/unit_1_0/shared_activation/init_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg/unit_1_0/shared_activation/init_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/unit_1_0/shared_activation/init_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/unit_1_0/shared_activation/init_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/unit_1_0/shared_activation/init_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/unit_1_0/shared_activation/init_bn/moving_variance/unit_1_0/shared_activation/init_bn/unit_1_0/shared_activation/init_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/unit_1_0/shared_activation/init_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/unit_1_0/shared_activation/init_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/unit_1_0/shared_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/unit_1_0/shared_activation/init_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/unit_1_0/shared_activation/init_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/unit_1_0/shared_activation/init_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/unit_1_0/shared_activation/init_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/unit_1_0/shared_activation/init_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/unit_1_0/shared_activation/init_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/unit_1_0/shared_activation/init_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1/unit_1_0/shared_activation/init_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_1_0/shared_activation/init_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_1_0/shared_activation/init_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_1_0/shared_activation/init_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_1_0/shared_activation/init_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_1_0/shared_activation/init_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_1_0/shared_activation/init_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_1_0/shared_activation/init_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_1_0/shared_activation/init_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_1_0/shared_activation/init_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_1_0/shared_activation/Less/y' type=Const>, <tf.Operation 'unit_1_0/shared_activation/Less' type=Less>, <tf.Operation 'unit_1_0/shared_activation/mul/x' type=Const>, <tf.Operation 'unit_1_0/shared_activation/mul' type=Mul>, <tf.Operation 'unit_1_0/shared_activation/leaky_relu' type=Select>, <tf.Operation 'unit_1_0/sub1/conv1/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_1_0/sub1/conv1/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_1_0/sub1/conv1/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_1_0/sub1/conv1/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_1_0/sub1/conv1/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_1_0/sub1/conv1/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_1_0/sub1/conv1/DW' type=VariableV2>, <tf.Operation 'unit_1_0/sub1/conv1/DW/Assign' type=Assign>, <tf.Operation 'unit_1_0/sub1/conv1/DW/read' type=Identity>, <tf.Operation 'unit_1_0/sub1/conv1/Conv2D' type=Conv2D>, <tf.Operation 'unit_1_0/sub2/bn2/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/beta' type=VariableV2>, <tf.Operation 'unit_1_0/sub2/bn2/beta/Assign' type=Assign>, <tf.Operation 'unit_1_0/sub2/bn2/beta/read' type=Identity>, <tf.Operation 'unit_1_0/sub2/bn2/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/gamma' type=VariableV2>, <tf.Operation 'unit_1_0/sub2/bn2/gamma/Assign' type=Assign>, <tf.Operation 'unit_1_0/sub2/bn2/gamma/read' type=Identity>, <tf.Operation 'unit_1_0/sub2/bn2/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/moments/mean' type=Mean>, <tf.Operation 'unit_1_0/sub2/bn2/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_1_0/sub2/bn2/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_1_0/sub2/bn2/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/moments/variance' type=Mean>, <tf.Operation 'unit_1_0/sub2/bn2/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_1_0/sub2/bn2/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_1_0/sub2/bn2/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/moving_mean' type=VariableV2>, <tf.Operation 'unit_1_0/sub2/bn2/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_1_0/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_0/sub2/bn2/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/moving_variance' type=VariableV2>, <tf.Operation 'unit_1_0/sub2/bn2/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_1_0/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/unit_1_0/sub2/bn2/moving_mean/zeros' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/unit_1_0/sub2/bn2/moving_mean/sub' type=Sub>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/unit_1_0/sub2/bn2/moving_mean/mul' type=Mul>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/unit_1_0/sub2/bn2/moving_mean/unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_mean' type=AssignSub>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/unit_1_0/sub2/bn2/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/unit_1_0/sub2/bn2/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/unit_1_0/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/unit_1_0/sub2/bn2/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/unit_1_0/sub2/bn2/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/unit_1_0/sub2/bn2/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/unit_1_0/sub2/bn2/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/unit_1_0/sub2/bn2/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/unit_1_0/sub2/bn2/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/unit_1_0/sub2/bn2/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg/unit_1_0/sub2/bn2/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/unit_1_0/sub2/bn2/moving_variance/zeros' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/unit_1_0/sub2/bn2/moving_variance/sub' type=Sub>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/unit_1_0/sub2/bn2/moving_variance/mul' type=Mul>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/unit_1_0/sub2/bn2/moving_variance/unit_1_0/sub2/bn2/unit_1_0/sub2/bn2/moving_variance' type=AssignSub>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/unit_1_0/sub2/bn2/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/unit_1_0/sub2/bn2/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/unit_1_0/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/unit_1_0/sub2/bn2/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/unit_1_0/sub2/bn2/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/unit_1_0/sub2/bn2/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/unit_1_0/sub2/bn2/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/unit_1_0/sub2/bn2/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/unit_1_0/sub2/bn2/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/unit_1_0/sub2/bn2/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1/unit_1_0/sub2/bn2/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_1_0/sub2/bn2/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_1_0/sub2/bn2/batchnorm/add/y' type=Const>, <tf.Operation 'unit_1_0/sub2/bn2/batchnorm/add' type=Add>, <tf.Operation 'unit_1_0/sub2/bn2/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_1_0/sub2/bn2/batchnorm/mul' type=Mul>, <tf.Operation 'unit_1_0/sub2/bn2/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_1_0/sub2/bn2/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_1_0/sub2/bn2/batchnorm/sub' type=Sub>, <tf.Operation 'unit_1_0/sub2/bn2/batchnorm/add_1' type=Add>, <tf.Operation 'unit_1_0/sub2/Less/y' type=Const>, <tf.Operation 'unit_1_0/sub2/Less' type=Less>, <tf.Operation 'unit_1_0/sub2/mul/x' type=Const>, <tf.Operation 'unit_1_0/sub2/mul' type=Mul>, <tf.Operation 'unit_1_0/sub2/leaky_relu' type=Select>, <tf.Operation 'unit_1_0/sub2/conv2/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_1_0/sub2/conv2/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_1_0/sub2/conv2/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_1_0/sub2/conv2/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_1_0/sub2/conv2/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_1_0/sub2/conv2/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_1_0/sub2/conv2/DW' type=VariableV2>, <tf.Operation 'unit_1_0/sub2/conv2/DW/Assign' type=Assign>, <tf.Operation 'unit_1_0/sub2/conv2/DW/read' type=Identity>, <tf.Operation 'unit_1_0/sub2/conv2/Conv2D' type=Conv2D>, <tf.Operation 'unit_1_0/sub_add/add' type=Add>, <tf.Operation 'unit_1_0/Reshape/shape' type=Const>, <tf.Operation 'unit_1_0/Reshape' type=Reshape>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/beta' type=VariableV2>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/beta/read' type=Identity>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/gamma' type=VariableV2>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/gamma/read' type=Identity>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moments/mean' type=Mean>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moments/variance' type=Mean>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/unit_1_1/residual_only_activation/init_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/unit_1_1/residual_only_activation/init_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/unit_1_1/residual_only_activation/init_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/unit_1_1/residual_only_activation/init_bn/moving_mean/unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/unit_1_1/residual_only_activation/init_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/unit_1_1/residual_only_activation/init_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/unit_1_1/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/unit_1_1/residual_only_activation/init_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/unit_1_1/residual_only_activation/init_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/unit_1_1/residual_only_activation/init_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/unit_1_1/residual_only_activation/init_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/unit_1_1/residual_only_activation/init_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/unit_1_1/residual_only_activation/init_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/unit_1_1/residual_only_activation/init_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg/unit_1_1/residual_only_activation/init_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_1/residual_only_activation/init_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_1/residual_only_activation/init_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_1/residual_only_activation/init_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_1/residual_only_activation/init_bn/moving_variance/unit_1_1/residual_only_activation/init_bn/unit_1_1/residual_only_activation/init_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_1/residual_only_activation/init_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_1/residual_only_activation/init_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_1/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_1/residual_only_activation/init_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_1/residual_only_activation/init_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_1/residual_only_activation/init_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_1/residual_only_activation/init_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_1/residual_only_activation/init_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_1/residual_only_activation/init_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_1/residual_only_activation/init_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_1/residual_only_activation/init_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_1_1/residual_only_activation/init_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_1_1/residual_only_activation/Less/y' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/Less' type=Less>, <tf.Operation 'unit_1_1/residual_only_activation/mul/x' type=Const>, <tf.Operation 'unit_1_1/residual_only_activation/mul' type=Mul>, <tf.Operation 'unit_1_1/residual_only_activation/leaky_relu' type=Select>, <tf.Operation 'unit_1_1/sub1/conv1/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_1_1/sub1/conv1/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_1_1/sub1/conv1/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_1_1/sub1/conv1/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_1_1/sub1/conv1/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_1_1/sub1/conv1/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_1_1/sub1/conv1/DW' type=VariableV2>, <tf.Operation 'unit_1_1/sub1/conv1/DW/Assign' type=Assign>, <tf.Operation 'unit_1_1/sub1/conv1/DW/read' type=Identity>, <tf.Operation 'unit_1_1/sub1/conv1/Conv2D' type=Conv2D>, <tf.Operation 'unit_1_1/sub2/bn2/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/beta' type=VariableV2>, <tf.Operation 'unit_1_1/sub2/bn2/beta/Assign' type=Assign>, <tf.Operation 'unit_1_1/sub2/bn2/beta/read' type=Identity>, <tf.Operation 'unit_1_1/sub2/bn2/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/gamma' type=VariableV2>, <tf.Operation 'unit_1_1/sub2/bn2/gamma/Assign' type=Assign>, <tf.Operation 'unit_1_1/sub2/bn2/gamma/read' type=Identity>, <tf.Operation 'unit_1_1/sub2/bn2/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/moments/mean' type=Mean>, <tf.Operation 'unit_1_1/sub2/bn2/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_1_1/sub2/bn2/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_1_1/sub2/bn2/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/moments/variance' type=Mean>, <tf.Operation 'unit_1_1/sub2/bn2/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_1_1/sub2/bn2/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_1_1/sub2/bn2/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/moving_mean' type=VariableV2>, <tf.Operation 'unit_1_1/sub2/bn2/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_1_1/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_1/sub2/bn2/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/moving_variance' type=VariableV2>, <tf.Operation 'unit_1_1/sub2/bn2/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_1_1/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/unit_1_1/sub2/bn2/moving_mean/zeros' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/unit_1_1/sub2/bn2/moving_mean/sub' type=Sub>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/unit_1_1/sub2/bn2/moving_mean/mul' type=Mul>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/unit_1_1/sub2/bn2/moving_mean/unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_mean' type=AssignSub>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/unit_1_1/sub2/bn2/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/unit_1_1/sub2/bn2/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/unit_1_1/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/unit_1_1/sub2/bn2/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/unit_1_1/sub2/bn2/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/unit_1_1/sub2/bn2/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/unit_1_1/sub2/bn2/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/unit_1_1/sub2/bn2/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/unit_1_1/sub2/bn2/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/unit_1_1/sub2/bn2/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg/unit_1_1/sub2/bn2/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/unit_1_1/sub2/bn2/moving_variance/zeros' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/unit_1_1/sub2/bn2/moving_variance/sub' type=Sub>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/unit_1_1/sub2/bn2/moving_variance/mul' type=Mul>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/unit_1_1/sub2/bn2/moving_variance/unit_1_1/sub2/bn2/unit_1_1/sub2/bn2/moving_variance' type=AssignSub>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/unit_1_1/sub2/bn2/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/unit_1_1/sub2/bn2/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/unit_1_1/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/unit_1_1/sub2/bn2/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/unit_1_1/sub2/bn2/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/unit_1_1/sub2/bn2/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/unit_1_1/sub2/bn2/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/unit_1_1/sub2/bn2/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/unit_1_1/sub2/bn2/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/unit_1_1/sub2/bn2/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1/unit_1_1/sub2/bn2/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_1_1/sub2/bn2/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_1_1/sub2/bn2/batchnorm/add/y' type=Const>, <tf.Operation 'unit_1_1/sub2/bn2/batchnorm/add' type=Add>, <tf.Operation 'unit_1_1/sub2/bn2/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_1_1/sub2/bn2/batchnorm/mul' type=Mul>, <tf.Operation 'unit_1_1/sub2/bn2/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_1_1/sub2/bn2/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_1_1/sub2/bn2/batchnorm/sub' type=Sub>, <tf.Operation 'unit_1_1/sub2/bn2/batchnorm/add_1' type=Add>, <tf.Operation 'unit_1_1/sub2/Less/y' type=Const>, <tf.Operation 'unit_1_1/sub2/Less' type=Less>, <tf.Operation 'unit_1_1/sub2/mul/x' type=Const>, <tf.Operation 'unit_1_1/sub2/mul' type=Mul>, <tf.Operation 'unit_1_1/sub2/leaky_relu' type=Select>, <tf.Operation 'unit_1_1/sub2/conv2/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_1_1/sub2/conv2/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_1_1/sub2/conv2/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_1_1/sub2/conv2/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_1_1/sub2/conv2/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_1_1/sub2/conv2/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_1_1/sub2/conv2/DW' type=VariableV2>, <tf.Operation 'unit_1_1/sub2/conv2/DW/Assign' type=Assign>, <tf.Operation 'unit_1_1/sub2/conv2/DW/read' type=Identity>, <tf.Operation 'unit_1_1/sub2/conv2/Conv2D' type=Conv2D>, <tf.Operation 'unit_1_1/sub_add/add' type=Add>, <tf.Operation 'unit_1_1/Reshape/shape' type=Const>, <tf.Operation 'unit_1_1/Reshape' type=Reshape>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/beta' type=VariableV2>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/beta/read' type=Identity>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/gamma' type=VariableV2>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/gamma/read' type=Identity>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moments/mean' type=Mean>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moments/variance' type=Mean>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/unit_1_2/residual_only_activation/init_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/unit_1_2/residual_only_activation/init_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/unit_1_2/residual_only_activation/init_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/unit_1_2/residual_only_activation/init_bn/moving_mean/unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/unit_1_2/residual_only_activation/init_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/unit_1_2/residual_only_activation/init_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/unit_1_2/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/unit_1_2/residual_only_activation/init_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/unit_1_2/residual_only_activation/init_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/unit_1_2/residual_only_activation/init_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/unit_1_2/residual_only_activation/init_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/unit_1_2/residual_only_activation/init_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/unit_1_2/residual_only_activation/init_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/unit_1_2/residual_only_activation/init_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg/unit_1_2/residual_only_activation/init_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_2/residual_only_activation/init_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_2/residual_only_activation/init_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_2/residual_only_activation/init_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_2/residual_only_activation/init_bn/moving_variance/unit_1_2/residual_only_activation/init_bn/unit_1_2/residual_only_activation/init_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_2/residual_only_activation/init_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_2/residual_only_activation/init_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_2/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_2/residual_only_activation/init_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_2/residual_only_activation/init_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_2/residual_only_activation/init_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_2/residual_only_activation/init_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_2/residual_only_activation/init_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_2/residual_only_activation/init_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_2/residual_only_activation/init_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_2/residual_only_activation/init_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_1_2/residual_only_activation/init_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_1_2/residual_only_activation/Less/y' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/Less' type=Less>, <tf.Operation 'unit_1_2/residual_only_activation/mul/x' type=Const>, <tf.Operation 'unit_1_2/residual_only_activation/mul' type=Mul>, <tf.Operation 'unit_1_2/residual_only_activation/leaky_relu' type=Select>, <tf.Operation 'unit_1_2/sub1/conv1/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_1_2/sub1/conv1/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_1_2/sub1/conv1/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_1_2/sub1/conv1/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_1_2/sub1/conv1/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_1_2/sub1/conv1/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_1_2/sub1/conv1/DW' type=VariableV2>, <tf.Operation 'unit_1_2/sub1/conv1/DW/Assign' type=Assign>, <tf.Operation 'unit_1_2/sub1/conv1/DW/read' type=Identity>, <tf.Operation 'unit_1_2/sub1/conv1/Conv2D' type=Conv2D>, <tf.Operation 'unit_1_2/sub2/bn2/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/beta' type=VariableV2>, <tf.Operation 'unit_1_2/sub2/bn2/beta/Assign' type=Assign>, <tf.Operation 'unit_1_2/sub2/bn2/beta/read' type=Identity>, <tf.Operation 'unit_1_2/sub2/bn2/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/gamma' type=VariableV2>, <tf.Operation 'unit_1_2/sub2/bn2/gamma/Assign' type=Assign>, <tf.Operation 'unit_1_2/sub2/bn2/gamma/read' type=Identity>, <tf.Operation 'unit_1_2/sub2/bn2/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/moments/mean' type=Mean>, <tf.Operation 'unit_1_2/sub2/bn2/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_1_2/sub2/bn2/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_1_2/sub2/bn2/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/moments/variance' type=Mean>, <tf.Operation 'unit_1_2/sub2/bn2/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_1_2/sub2/bn2/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_1_2/sub2/bn2/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/moving_mean' type=VariableV2>, <tf.Operation 'unit_1_2/sub2/bn2/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_1_2/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_2/sub2/bn2/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/moving_variance' type=VariableV2>, <tf.Operation 'unit_1_2/sub2/bn2/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_1_2/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/unit_1_2/sub2/bn2/moving_mean/zeros' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/unit_1_2/sub2/bn2/moving_mean/sub' type=Sub>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/unit_1_2/sub2/bn2/moving_mean/mul' type=Mul>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/unit_1_2/sub2/bn2/moving_mean/unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_mean' type=AssignSub>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/unit_1_2/sub2/bn2/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/unit_1_2/sub2/bn2/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/unit_1_2/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/unit_1_2/sub2/bn2/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/unit_1_2/sub2/bn2/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/unit_1_2/sub2/bn2/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/unit_1_2/sub2/bn2/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/unit_1_2/sub2/bn2/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/unit_1_2/sub2/bn2/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/unit_1_2/sub2/bn2/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg/unit_1_2/sub2/bn2/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/unit_1_2/sub2/bn2/moving_variance/zeros' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/unit_1_2/sub2/bn2/moving_variance/sub' type=Sub>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/unit_1_2/sub2/bn2/moving_variance/mul' type=Mul>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/unit_1_2/sub2/bn2/moving_variance/unit_1_2/sub2/bn2/unit_1_2/sub2/bn2/moving_variance' type=AssignSub>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/unit_1_2/sub2/bn2/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/unit_1_2/sub2/bn2/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/unit_1_2/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/unit_1_2/sub2/bn2/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/unit_1_2/sub2/bn2/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/unit_1_2/sub2/bn2/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/unit_1_2/sub2/bn2/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/unit_1_2/sub2/bn2/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/unit_1_2/sub2/bn2/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/unit_1_2/sub2/bn2/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1/unit_1_2/sub2/bn2/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_1_2/sub2/bn2/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_1_2/sub2/bn2/batchnorm/add/y' type=Const>, <tf.Operation 'unit_1_2/sub2/bn2/batchnorm/add' type=Add>, <tf.Operation 'unit_1_2/sub2/bn2/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_1_2/sub2/bn2/batchnorm/mul' type=Mul>, <tf.Operation 'unit_1_2/sub2/bn2/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_1_2/sub2/bn2/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_1_2/sub2/bn2/batchnorm/sub' type=Sub>, <tf.Operation 'unit_1_2/sub2/bn2/batchnorm/add_1' type=Add>, <tf.Operation 'unit_1_2/sub2/Less/y' type=Const>, <tf.Operation 'unit_1_2/sub2/Less' type=Less>, <tf.Operation 'unit_1_2/sub2/mul/x' type=Const>, <tf.Operation 'unit_1_2/sub2/mul' type=Mul>, <tf.Operation 'unit_1_2/sub2/leaky_relu' type=Select>, <tf.Operation 'unit_1_2/sub2/conv2/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_1_2/sub2/conv2/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_1_2/sub2/conv2/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_1_2/sub2/conv2/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_1_2/sub2/conv2/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_1_2/sub2/conv2/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_1_2/sub2/conv2/DW' type=VariableV2>, <tf.Operation 'unit_1_2/sub2/conv2/DW/Assign' type=Assign>, <tf.Operation 'unit_1_2/sub2/conv2/DW/read' type=Identity>, <tf.Operation 'unit_1_2/sub2/conv2/Conv2D' type=Conv2D>, <tf.Operation 'unit_1_2/sub_add/add' type=Add>, <tf.Operation 'unit_1_2/Reshape/shape' type=Const>, <tf.Operation 'unit_1_2/Reshape' type=Reshape>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/beta' type=VariableV2>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/beta/read' type=Identity>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/gamma' type=VariableV2>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/gamma/read' type=Identity>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moments/mean' type=Mean>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moments/variance' type=Mean>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/unit_1_3/residual_only_activation/init_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/unit_1_3/residual_only_activation/init_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/unit_1_3/residual_only_activation/init_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/unit_1_3/residual_only_activation/init_bn/moving_mean/unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/unit_1_3/residual_only_activation/init_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/unit_1_3/residual_only_activation/init_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/unit_1_3/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/unit_1_3/residual_only_activation/init_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/unit_1_3/residual_only_activation/init_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/unit_1_3/residual_only_activation/init_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/unit_1_3/residual_only_activation/init_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/unit_1_3/residual_only_activation/init_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/unit_1_3/residual_only_activation/init_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/unit_1_3/residual_only_activation/init_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg/unit_1_3/residual_only_activation/init_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_3/residual_only_activation/init_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_3/residual_only_activation/init_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_3/residual_only_activation/init_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_3/residual_only_activation/init_bn/moving_variance/unit_1_3/residual_only_activation/init_bn/unit_1_3/residual_only_activation/init_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_3/residual_only_activation/init_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_3/residual_only_activation/init_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_3/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_3/residual_only_activation/init_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_3/residual_only_activation/init_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_3/residual_only_activation/init_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_3/residual_only_activation/init_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_3/residual_only_activation/init_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_3/residual_only_activation/init_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_3/residual_only_activation/init_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_3/residual_only_activation/init_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_1_3/residual_only_activation/init_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_1_3/residual_only_activation/Less/y' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/Less' type=Less>, <tf.Operation 'unit_1_3/residual_only_activation/mul/x' type=Const>, <tf.Operation 'unit_1_3/residual_only_activation/mul' type=Mul>, <tf.Operation 'unit_1_3/residual_only_activation/leaky_relu' type=Select>, <tf.Operation 'unit_1_3/sub1/conv1/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_1_3/sub1/conv1/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_1_3/sub1/conv1/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_1_3/sub1/conv1/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_1_3/sub1/conv1/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_1_3/sub1/conv1/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_1_3/sub1/conv1/DW' type=VariableV2>, <tf.Operation 'unit_1_3/sub1/conv1/DW/Assign' type=Assign>, <tf.Operation 'unit_1_3/sub1/conv1/DW/read' type=Identity>, <tf.Operation 'unit_1_3/sub1/conv1/Conv2D' type=Conv2D>, <tf.Operation 'unit_1_3/sub2/bn2/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/beta' type=VariableV2>, <tf.Operation 'unit_1_3/sub2/bn2/beta/Assign' type=Assign>, <tf.Operation 'unit_1_3/sub2/bn2/beta/read' type=Identity>, <tf.Operation 'unit_1_3/sub2/bn2/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/gamma' type=VariableV2>, <tf.Operation 'unit_1_3/sub2/bn2/gamma/Assign' type=Assign>, <tf.Operation 'unit_1_3/sub2/bn2/gamma/read' type=Identity>, <tf.Operation 'unit_1_3/sub2/bn2/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/moments/mean' type=Mean>, <tf.Operation 'unit_1_3/sub2/bn2/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_1_3/sub2/bn2/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_1_3/sub2/bn2/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/moments/variance' type=Mean>, <tf.Operation 'unit_1_3/sub2/bn2/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_1_3/sub2/bn2/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_1_3/sub2/bn2/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/moving_mean' type=VariableV2>, <tf.Operation 'unit_1_3/sub2/bn2/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_1_3/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_3/sub2/bn2/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/moving_variance' type=VariableV2>, <tf.Operation 'unit_1_3/sub2/bn2/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_1_3/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/unit_1_3/sub2/bn2/moving_mean/zeros' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/unit_1_3/sub2/bn2/moving_mean/sub' type=Sub>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/unit_1_3/sub2/bn2/moving_mean/mul' type=Mul>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/unit_1_3/sub2/bn2/moving_mean/unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_mean' type=AssignSub>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/unit_1_3/sub2/bn2/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/unit_1_3/sub2/bn2/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/unit_1_3/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/unit_1_3/sub2/bn2/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/unit_1_3/sub2/bn2/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/unit_1_3/sub2/bn2/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/unit_1_3/sub2/bn2/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/unit_1_3/sub2/bn2/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/unit_1_3/sub2/bn2/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/unit_1_3/sub2/bn2/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg/unit_1_3/sub2/bn2/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/unit_1_3/sub2/bn2/moving_variance/zeros' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/unit_1_3/sub2/bn2/moving_variance/sub' type=Sub>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/unit_1_3/sub2/bn2/moving_variance/mul' type=Mul>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/unit_1_3/sub2/bn2/moving_variance/unit_1_3/sub2/bn2/unit_1_3/sub2/bn2/moving_variance' type=AssignSub>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/unit_1_3/sub2/bn2/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/unit_1_3/sub2/bn2/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/unit_1_3/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/unit_1_3/sub2/bn2/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/unit_1_3/sub2/bn2/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/unit_1_3/sub2/bn2/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/unit_1_3/sub2/bn2/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/unit_1_3/sub2/bn2/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/unit_1_3/sub2/bn2/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/unit_1_3/sub2/bn2/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1/unit_1_3/sub2/bn2/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_1_3/sub2/bn2/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_1_3/sub2/bn2/batchnorm/add/y' type=Const>, <tf.Operation 'unit_1_3/sub2/bn2/batchnorm/add' type=Add>, <tf.Operation 'unit_1_3/sub2/bn2/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_1_3/sub2/bn2/batchnorm/mul' type=Mul>, <tf.Operation 'unit_1_3/sub2/bn2/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_1_3/sub2/bn2/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_1_3/sub2/bn2/batchnorm/sub' type=Sub>, <tf.Operation 'unit_1_3/sub2/bn2/batchnorm/add_1' type=Add>, <tf.Operation 'unit_1_3/sub2/Less/y' type=Const>, <tf.Operation 'unit_1_3/sub2/Less' type=Less>, <tf.Operation 'unit_1_3/sub2/mul/x' type=Const>, <tf.Operation 'unit_1_3/sub2/mul' type=Mul>, <tf.Operation 'unit_1_3/sub2/leaky_relu' type=Select>, <tf.Operation 'unit_1_3/sub2/conv2/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_1_3/sub2/conv2/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_1_3/sub2/conv2/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_1_3/sub2/conv2/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_1_3/sub2/conv2/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_1_3/sub2/conv2/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_1_3/sub2/conv2/DW' type=VariableV2>, <tf.Operation 'unit_1_3/sub2/conv2/DW/Assign' type=Assign>, <tf.Operation 'unit_1_3/sub2/conv2/DW/read' type=Identity>, <tf.Operation 'unit_1_3/sub2/conv2/Conv2D' type=Conv2D>, <tf.Operation 'unit_1_3/sub_add/add' type=Add>, <tf.Operation 'unit_1_3/Reshape/shape' type=Const>, <tf.Operation 'unit_1_3/Reshape' type=Reshape>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/beta' type=VariableV2>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/beta/read' type=Identity>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/gamma' type=VariableV2>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/gamma/read' type=Identity>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moments/mean' type=Mean>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moments/variance' type=Mean>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/unit_1_4/residual_only_activation/init_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/unit_1_4/residual_only_activation/init_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/unit_1_4/residual_only_activation/init_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/unit_1_4/residual_only_activation/init_bn/moving_mean/unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/unit_1_4/residual_only_activation/init_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/unit_1_4/residual_only_activation/init_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/unit_1_4/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/unit_1_4/residual_only_activation/init_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/unit_1_4/residual_only_activation/init_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/unit_1_4/residual_only_activation/init_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/unit_1_4/residual_only_activation/init_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/unit_1_4/residual_only_activation/init_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/unit_1_4/residual_only_activation/init_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/unit_1_4/residual_only_activation/init_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg/unit_1_4/residual_only_activation/init_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_4/residual_only_activation/init_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_4/residual_only_activation/init_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_4/residual_only_activation/init_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_4/residual_only_activation/init_bn/moving_variance/unit_1_4/residual_only_activation/init_bn/unit_1_4/residual_only_activation/init_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_4/residual_only_activation/init_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_4/residual_only_activation/init_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_4/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_4/residual_only_activation/init_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_4/residual_only_activation/init_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_4/residual_only_activation/init_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_4/residual_only_activation/init_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_4/residual_only_activation/init_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_4/residual_only_activation/init_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_4/residual_only_activation/init_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_1_4/residual_only_activation/init_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_1_4/residual_only_activation/init_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_1_4/residual_only_activation/Less/y' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/Less' type=Less>, <tf.Operation 'unit_1_4/residual_only_activation/mul/x' type=Const>, <tf.Operation 'unit_1_4/residual_only_activation/mul' type=Mul>, <tf.Operation 'unit_1_4/residual_only_activation/leaky_relu' type=Select>, <tf.Operation 'unit_1_4/sub1/conv1/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_1_4/sub1/conv1/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_1_4/sub1/conv1/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_1_4/sub1/conv1/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_1_4/sub1/conv1/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_1_4/sub1/conv1/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_1_4/sub1/conv1/DW' type=VariableV2>, <tf.Operation 'unit_1_4/sub1/conv1/DW/Assign' type=Assign>, <tf.Operation 'unit_1_4/sub1/conv1/DW/read' type=Identity>, <tf.Operation 'unit_1_4/sub1/conv1/Conv2D' type=Conv2D>, <tf.Operation 'unit_1_4/sub2/bn2/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/beta' type=VariableV2>, <tf.Operation 'unit_1_4/sub2/bn2/beta/Assign' type=Assign>, <tf.Operation 'unit_1_4/sub2/bn2/beta/read' type=Identity>, <tf.Operation 'unit_1_4/sub2/bn2/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/gamma' type=VariableV2>, <tf.Operation 'unit_1_4/sub2/bn2/gamma/Assign' type=Assign>, <tf.Operation 'unit_1_4/sub2/bn2/gamma/read' type=Identity>, <tf.Operation 'unit_1_4/sub2/bn2/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/moments/mean' type=Mean>, <tf.Operation 'unit_1_4/sub2/bn2/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_1_4/sub2/bn2/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_1_4/sub2/bn2/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/moments/variance' type=Mean>, <tf.Operation 'unit_1_4/sub2/bn2/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_1_4/sub2/bn2/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_1_4/sub2/bn2/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/moving_mean' type=VariableV2>, <tf.Operation 'unit_1_4/sub2/bn2/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_1_4/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_4/sub2/bn2/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/moving_variance' type=VariableV2>, <tf.Operation 'unit_1_4/sub2/bn2/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_1_4/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/unit_1_4/sub2/bn2/moving_mean/zeros' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/unit_1_4/sub2/bn2/moving_mean/sub' type=Sub>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/unit_1_4/sub2/bn2/moving_mean/mul' type=Mul>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/unit_1_4/sub2/bn2/moving_mean/unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_mean' type=AssignSub>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/unit_1_4/sub2/bn2/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/unit_1_4/sub2/bn2/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/unit_1_4/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/unit_1_4/sub2/bn2/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/unit_1_4/sub2/bn2/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/unit_1_4/sub2/bn2/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/unit_1_4/sub2/bn2/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/unit_1_4/sub2/bn2/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/unit_1_4/sub2/bn2/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/unit_1_4/sub2/bn2/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg/unit_1_4/sub2/bn2/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/unit_1_4/sub2/bn2/moving_variance/zeros' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/unit_1_4/sub2/bn2/moving_variance/sub' type=Sub>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/unit_1_4/sub2/bn2/moving_variance/mul' type=Mul>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/unit_1_4/sub2/bn2/moving_variance/unit_1_4/sub2/bn2/unit_1_4/sub2/bn2/moving_variance' type=AssignSub>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/unit_1_4/sub2/bn2/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/unit_1_4/sub2/bn2/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/unit_1_4/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/unit_1_4/sub2/bn2/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/unit_1_4/sub2/bn2/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/unit_1_4/sub2/bn2/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/unit_1_4/sub2/bn2/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/unit_1_4/sub2/bn2/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/unit_1_4/sub2/bn2/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/unit_1_4/sub2/bn2/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1/unit_1_4/sub2/bn2/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_1_4/sub2/bn2/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_1_4/sub2/bn2/batchnorm/add/y' type=Const>, <tf.Operation 'unit_1_4/sub2/bn2/batchnorm/add' type=Add>, <tf.Operation 'unit_1_4/sub2/bn2/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_1_4/sub2/bn2/batchnorm/mul' type=Mul>, <tf.Operation 'unit_1_4/sub2/bn2/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_1_4/sub2/bn2/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_1_4/sub2/bn2/batchnorm/sub' type=Sub>, <tf.Operation 'unit_1_4/sub2/bn2/batchnorm/add_1' type=Add>, <tf.Operation 'unit_1_4/sub2/Less/y' type=Const>, <tf.Operation 'unit_1_4/sub2/Less' type=Less>, <tf.Operation 'unit_1_4/sub2/mul/x' type=Const>, <tf.Operation 'unit_1_4/sub2/mul' type=Mul>, <tf.Operation 'unit_1_4/sub2/leaky_relu' type=Select>, <tf.Operation 'unit_1_4/sub2/conv2/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_1_4/sub2/conv2/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_1_4/sub2/conv2/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_1_4/sub2/conv2/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_1_4/sub2/conv2/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_1_4/sub2/conv2/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_1_4/sub2/conv2/DW' type=VariableV2>, <tf.Operation 'unit_1_4/sub2/conv2/DW/Assign' type=Assign>, <tf.Operation 'unit_1_4/sub2/conv2/DW/read' type=Identity>, <tf.Operation 'unit_1_4/sub2/conv2/Conv2D' type=Conv2D>, <tf.Operation 'unit_1_4/sub_add/add' type=Add>, <tf.Operation 'unit_1_4/Reshape/shape' type=Const>, <tf.Operation 'unit_1_4/Reshape' type=Reshape>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/beta' type=VariableV2>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/beta/read' type=Identity>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/gamma' type=VariableV2>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/gamma/read' type=Identity>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moments/mean' type=Mean>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moments/variance' type=Mean>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/unit_2_0/residual_only_activation/init_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/unit_2_0/residual_only_activation/init_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/unit_2_0/residual_only_activation/init_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/unit_2_0/residual_only_activation/init_bn/moving_mean/unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/unit_2_0/residual_only_activation/init_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/unit_2_0/residual_only_activation/init_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/unit_2_0/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/unit_2_0/residual_only_activation/init_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/unit_2_0/residual_only_activation/init_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/unit_2_0/residual_only_activation/init_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/unit_2_0/residual_only_activation/init_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/unit_2_0/residual_only_activation/init_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/unit_2_0/residual_only_activation/init_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/unit_2_0/residual_only_activation/init_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg/unit_2_0/residual_only_activation/init_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_0/residual_only_activation/init_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_0/residual_only_activation/init_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_0/residual_only_activation/init_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_0/residual_only_activation/init_bn/moving_variance/unit_2_0/residual_only_activation/init_bn/unit_2_0/residual_only_activation/init_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_0/residual_only_activation/init_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_0/residual_only_activation/init_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_0/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_0/residual_only_activation/init_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_0/residual_only_activation/init_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_0/residual_only_activation/init_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_0/residual_only_activation/init_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_0/residual_only_activation/init_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_0/residual_only_activation/init_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_0/residual_only_activation/init_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_0/residual_only_activation/init_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_2_0/residual_only_activation/init_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_2_0/residual_only_activation/Less/y' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/Less' type=Less>, <tf.Operation 'unit_2_0/residual_only_activation/mul/x' type=Const>, <tf.Operation 'unit_2_0/residual_only_activation/mul' type=Mul>, <tf.Operation 'unit_2_0/residual_only_activation/leaky_relu' type=Select>, <tf.Operation 'unit_2_0/sub1/conv1/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_2_0/sub1/conv1/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_2_0/sub1/conv1/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_2_0/sub1/conv1/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_2_0/sub1/conv1/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_2_0/sub1/conv1/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_2_0/sub1/conv1/DW' type=VariableV2>, <tf.Operation 'unit_2_0/sub1/conv1/DW/Assign' type=Assign>, <tf.Operation 'unit_2_0/sub1/conv1/DW/read' type=Identity>, <tf.Operation 'unit_2_0/sub1/conv1/Conv2D' type=Conv2D>, <tf.Operation 'unit_2_0/sub2/bn2/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/beta' type=VariableV2>, <tf.Operation 'unit_2_0/sub2/bn2/beta/Assign' type=Assign>, <tf.Operation 'unit_2_0/sub2/bn2/beta/read' type=Identity>, <tf.Operation 'unit_2_0/sub2/bn2/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/gamma' type=VariableV2>, <tf.Operation 'unit_2_0/sub2/bn2/gamma/Assign' type=Assign>, <tf.Operation 'unit_2_0/sub2/bn2/gamma/read' type=Identity>, <tf.Operation 'unit_2_0/sub2/bn2/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/moments/mean' type=Mean>, <tf.Operation 'unit_2_0/sub2/bn2/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_2_0/sub2/bn2/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_2_0/sub2/bn2/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/moments/variance' type=Mean>, <tf.Operation 'unit_2_0/sub2/bn2/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_2_0/sub2/bn2/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_2_0/sub2/bn2/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/moving_mean' type=VariableV2>, <tf.Operation 'unit_2_0/sub2/bn2/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_2_0/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_0/sub2/bn2/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/moving_variance' type=VariableV2>, <tf.Operation 'unit_2_0/sub2/bn2/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_2_0/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/unit_2_0/sub2/bn2/moving_mean/zeros' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/unit_2_0/sub2/bn2/moving_mean/sub' type=Sub>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/unit_2_0/sub2/bn2/moving_mean/mul' type=Mul>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/unit_2_0/sub2/bn2/moving_mean/unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_mean' type=AssignSub>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/unit_2_0/sub2/bn2/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/unit_2_0/sub2/bn2/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/unit_2_0/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/unit_2_0/sub2/bn2/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/unit_2_0/sub2/bn2/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/unit_2_0/sub2/bn2/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/unit_2_0/sub2/bn2/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/unit_2_0/sub2/bn2/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/unit_2_0/sub2/bn2/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/unit_2_0/sub2/bn2/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg/unit_2_0/sub2/bn2/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/unit_2_0/sub2/bn2/moving_variance/zeros' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/unit_2_0/sub2/bn2/moving_variance/sub' type=Sub>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/unit_2_0/sub2/bn2/moving_variance/mul' type=Mul>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/unit_2_0/sub2/bn2/moving_variance/unit_2_0/sub2/bn2/unit_2_0/sub2/bn2/moving_variance' type=AssignSub>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/unit_2_0/sub2/bn2/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/unit_2_0/sub2/bn2/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/unit_2_0/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/unit_2_0/sub2/bn2/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/unit_2_0/sub2/bn2/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/unit_2_0/sub2/bn2/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/unit_2_0/sub2/bn2/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/unit_2_0/sub2/bn2/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/unit_2_0/sub2/bn2/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/unit_2_0/sub2/bn2/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1/unit_2_0/sub2/bn2/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_2_0/sub2/bn2/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_2_0/sub2/bn2/batchnorm/add/y' type=Const>, <tf.Operation 'unit_2_0/sub2/bn2/batchnorm/add' type=Add>, <tf.Operation 'unit_2_0/sub2/bn2/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_2_0/sub2/bn2/batchnorm/mul' type=Mul>, <tf.Operation 'unit_2_0/sub2/bn2/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_2_0/sub2/bn2/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_2_0/sub2/bn2/batchnorm/sub' type=Sub>, <tf.Operation 'unit_2_0/sub2/bn2/batchnorm/add_1' type=Add>, <tf.Operation 'unit_2_0/sub2/Less/y' type=Const>, <tf.Operation 'unit_2_0/sub2/Less' type=Less>, <tf.Operation 'unit_2_0/sub2/mul/x' type=Const>, <tf.Operation 'unit_2_0/sub2/mul' type=Mul>, <tf.Operation 'unit_2_0/sub2/leaky_relu' type=Select>, <tf.Operation 'unit_2_0/sub2/conv2/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_2_0/sub2/conv2/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_2_0/sub2/conv2/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_2_0/sub2/conv2/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_2_0/sub2/conv2/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_2_0/sub2/conv2/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_2_0/sub2/conv2/DW' type=VariableV2>, <tf.Operation 'unit_2_0/sub2/conv2/DW/Assign' type=Assign>, <tf.Operation 'unit_2_0/sub2/conv2/DW/read' type=Identity>, <tf.Operation 'unit_2_0/sub2/conv2/Conv2D' type=Conv2D>, <tf.Operation 'unit_2_0/sub_add/AvgPool' type=AvgPool>, <tf.Operation 'unit_2_0/sub_add/Pad/paddings' type=Const>, <tf.Operation 'unit_2_0/sub_add/Pad' type=Pad>, <tf.Operation 'unit_2_0/sub_add/add' type=Add>, <tf.Operation 'unit_2_0/Reshape/shape' type=Const>, <tf.Operation 'unit_2_0/Reshape' type=Reshape>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/beta' type=VariableV2>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/beta/read' type=Identity>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/gamma' type=VariableV2>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/gamma/read' type=Identity>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moments/mean' type=Mean>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moments/variance' type=Mean>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/unit_2_1/residual_only_activation/init_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/unit_2_1/residual_only_activation/init_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/unit_2_1/residual_only_activation/init_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/unit_2_1/residual_only_activation/init_bn/moving_mean/unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/unit_2_1/residual_only_activation/init_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/unit_2_1/residual_only_activation/init_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/unit_2_1/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/unit_2_1/residual_only_activation/init_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/unit_2_1/residual_only_activation/init_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/unit_2_1/residual_only_activation/init_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/unit_2_1/residual_only_activation/init_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/unit_2_1/residual_only_activation/init_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/unit_2_1/residual_only_activation/init_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/unit_2_1/residual_only_activation/init_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg/unit_2_1/residual_only_activation/init_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_1/residual_only_activation/init_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_1/residual_only_activation/init_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_1/residual_only_activation/init_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_1/residual_only_activation/init_bn/moving_variance/unit_2_1/residual_only_activation/init_bn/unit_2_1/residual_only_activation/init_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_1/residual_only_activation/init_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_1/residual_only_activation/init_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_1/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_1/residual_only_activation/init_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_1/residual_only_activation/init_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_1/residual_only_activation/init_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_1/residual_only_activation/init_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_1/residual_only_activation/init_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_1/residual_only_activation/init_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_1/residual_only_activation/init_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_1/residual_only_activation/init_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_2_1/residual_only_activation/init_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_2_1/residual_only_activation/Less/y' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/Less' type=Less>, <tf.Operation 'unit_2_1/residual_only_activation/mul/x' type=Const>, <tf.Operation 'unit_2_1/residual_only_activation/mul' type=Mul>, <tf.Operation 'unit_2_1/residual_only_activation/leaky_relu' type=Select>, <tf.Operation 'unit_2_1/sub1/conv1/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_2_1/sub1/conv1/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_2_1/sub1/conv1/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_2_1/sub1/conv1/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_2_1/sub1/conv1/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_2_1/sub1/conv1/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_2_1/sub1/conv1/DW' type=VariableV2>, <tf.Operation 'unit_2_1/sub1/conv1/DW/Assign' type=Assign>, <tf.Operation 'unit_2_1/sub1/conv1/DW/read' type=Identity>, <tf.Operation 'unit_2_1/sub1/conv1/Conv2D' type=Conv2D>, <tf.Operation 'unit_2_1/sub2/bn2/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/beta' type=VariableV2>, <tf.Operation 'unit_2_1/sub2/bn2/beta/Assign' type=Assign>, <tf.Operation 'unit_2_1/sub2/bn2/beta/read' type=Identity>, <tf.Operation 'unit_2_1/sub2/bn2/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/gamma' type=VariableV2>, <tf.Operation 'unit_2_1/sub2/bn2/gamma/Assign' type=Assign>, <tf.Operation 'unit_2_1/sub2/bn2/gamma/read' type=Identity>, <tf.Operation 'unit_2_1/sub2/bn2/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/moments/mean' type=Mean>, <tf.Operation 'unit_2_1/sub2/bn2/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_2_1/sub2/bn2/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_2_1/sub2/bn2/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/moments/variance' type=Mean>, <tf.Operation 'unit_2_1/sub2/bn2/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_2_1/sub2/bn2/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_2_1/sub2/bn2/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/moving_mean' type=VariableV2>, <tf.Operation 'unit_2_1/sub2/bn2/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_2_1/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_1/sub2/bn2/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/moving_variance' type=VariableV2>, <tf.Operation 'unit_2_1/sub2/bn2/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_2_1/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/unit_2_1/sub2/bn2/moving_mean/zeros' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/unit_2_1/sub2/bn2/moving_mean/sub' type=Sub>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/unit_2_1/sub2/bn2/moving_mean/mul' type=Mul>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/unit_2_1/sub2/bn2/moving_mean/unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_mean' type=AssignSub>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/unit_2_1/sub2/bn2/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/unit_2_1/sub2/bn2/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/unit_2_1/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/unit_2_1/sub2/bn2/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/unit_2_1/sub2/bn2/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/unit_2_1/sub2/bn2/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/unit_2_1/sub2/bn2/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/unit_2_1/sub2/bn2/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/unit_2_1/sub2/bn2/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/unit_2_1/sub2/bn2/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg/unit_2_1/sub2/bn2/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/unit_2_1/sub2/bn2/moving_variance/zeros' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/unit_2_1/sub2/bn2/moving_variance/sub' type=Sub>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/unit_2_1/sub2/bn2/moving_variance/mul' type=Mul>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/unit_2_1/sub2/bn2/moving_variance/unit_2_1/sub2/bn2/unit_2_1/sub2/bn2/moving_variance' type=AssignSub>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/unit_2_1/sub2/bn2/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/unit_2_1/sub2/bn2/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/unit_2_1/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/unit_2_1/sub2/bn2/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/unit_2_1/sub2/bn2/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/unit_2_1/sub2/bn2/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/unit_2_1/sub2/bn2/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/unit_2_1/sub2/bn2/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/unit_2_1/sub2/bn2/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/unit_2_1/sub2/bn2/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1/unit_2_1/sub2/bn2/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_2_1/sub2/bn2/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_2_1/sub2/bn2/batchnorm/add/y' type=Const>, <tf.Operation 'unit_2_1/sub2/bn2/batchnorm/add' type=Add>, <tf.Operation 'unit_2_1/sub2/bn2/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_2_1/sub2/bn2/batchnorm/mul' type=Mul>, <tf.Operation 'unit_2_1/sub2/bn2/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_2_1/sub2/bn2/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_2_1/sub2/bn2/batchnorm/sub' type=Sub>, <tf.Operation 'unit_2_1/sub2/bn2/batchnorm/add_1' type=Add>, <tf.Operation 'unit_2_1/sub2/Less/y' type=Const>, <tf.Operation 'unit_2_1/sub2/Less' type=Less>, <tf.Operation 'unit_2_1/sub2/mul/x' type=Const>, <tf.Operation 'unit_2_1/sub2/mul' type=Mul>, <tf.Operation 'unit_2_1/sub2/leaky_relu' type=Select>, <tf.Operation 'unit_2_1/sub2/conv2/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_2_1/sub2/conv2/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_2_1/sub2/conv2/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_2_1/sub2/conv2/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_2_1/sub2/conv2/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_2_1/sub2/conv2/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_2_1/sub2/conv2/DW' type=VariableV2>, <tf.Operation 'unit_2_1/sub2/conv2/DW/Assign' type=Assign>, <tf.Operation 'unit_2_1/sub2/conv2/DW/read' type=Identity>, <tf.Operation 'unit_2_1/sub2/conv2/Conv2D' type=Conv2D>, <tf.Operation 'unit_2_1/sub_add/add' type=Add>, <tf.Operation 'unit_2_1/Reshape/shape' type=Const>, <tf.Operation 'unit_2_1/Reshape' type=Reshape>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/beta' type=VariableV2>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/beta/read' type=Identity>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/gamma' type=VariableV2>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/gamma/read' type=Identity>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moments/mean' type=Mean>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moments/variance' type=Mean>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/unit_2_2/residual_only_activation/init_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/unit_2_2/residual_only_activation/init_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/unit_2_2/residual_only_activation/init_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/unit_2_2/residual_only_activation/init_bn/moving_mean/unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/unit_2_2/residual_only_activation/init_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/unit_2_2/residual_only_activation/init_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/unit_2_2/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/unit_2_2/residual_only_activation/init_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/unit_2_2/residual_only_activation/init_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/unit_2_2/residual_only_activation/init_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/unit_2_2/residual_only_activation/init_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/unit_2_2/residual_only_activation/init_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/unit_2_2/residual_only_activation/init_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/unit_2_2/residual_only_activation/init_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg/unit_2_2/residual_only_activation/init_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_2/residual_only_activation/init_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_2/residual_only_activation/init_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_2/residual_only_activation/init_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_2/residual_only_activation/init_bn/moving_variance/unit_2_2/residual_only_activation/init_bn/unit_2_2/residual_only_activation/init_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_2/residual_only_activation/init_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_2/residual_only_activation/init_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_2/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_2/residual_only_activation/init_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_2/residual_only_activation/init_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_2/residual_only_activation/init_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_2/residual_only_activation/init_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_2/residual_only_activation/init_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_2/residual_only_activation/init_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_2/residual_only_activation/init_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_2/residual_only_activation/init_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_2_2/residual_only_activation/init_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_2_2/residual_only_activation/Less/y' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/Less' type=Less>, <tf.Operation 'unit_2_2/residual_only_activation/mul/x' type=Const>, <tf.Operation 'unit_2_2/residual_only_activation/mul' type=Mul>, <tf.Operation 'unit_2_2/residual_only_activation/leaky_relu' type=Select>, <tf.Operation 'unit_2_2/sub1/conv1/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_2_2/sub1/conv1/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_2_2/sub1/conv1/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_2_2/sub1/conv1/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_2_2/sub1/conv1/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_2_2/sub1/conv1/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_2_2/sub1/conv1/DW' type=VariableV2>, <tf.Operation 'unit_2_2/sub1/conv1/DW/Assign' type=Assign>, <tf.Operation 'unit_2_2/sub1/conv1/DW/read' type=Identity>, <tf.Operation 'unit_2_2/sub1/conv1/Conv2D' type=Conv2D>, <tf.Operation 'unit_2_2/sub2/bn2/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/beta' type=VariableV2>, <tf.Operation 'unit_2_2/sub2/bn2/beta/Assign' type=Assign>, <tf.Operation 'unit_2_2/sub2/bn2/beta/read' type=Identity>, <tf.Operation 'unit_2_2/sub2/bn2/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/gamma' type=VariableV2>, <tf.Operation 'unit_2_2/sub2/bn2/gamma/Assign' type=Assign>, <tf.Operation 'unit_2_2/sub2/bn2/gamma/read' type=Identity>, <tf.Operation 'unit_2_2/sub2/bn2/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/moments/mean' type=Mean>, <tf.Operation 'unit_2_2/sub2/bn2/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_2_2/sub2/bn2/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_2_2/sub2/bn2/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/moments/variance' type=Mean>, <tf.Operation 'unit_2_2/sub2/bn2/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_2_2/sub2/bn2/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_2_2/sub2/bn2/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/moving_mean' type=VariableV2>, <tf.Operation 'unit_2_2/sub2/bn2/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_2_2/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_2/sub2/bn2/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/moving_variance' type=VariableV2>, <tf.Operation 'unit_2_2/sub2/bn2/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_2_2/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/unit_2_2/sub2/bn2/moving_mean/zeros' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/unit_2_2/sub2/bn2/moving_mean/sub' type=Sub>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/unit_2_2/sub2/bn2/moving_mean/mul' type=Mul>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/unit_2_2/sub2/bn2/moving_mean/unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_mean' type=AssignSub>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/unit_2_2/sub2/bn2/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/unit_2_2/sub2/bn2/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/unit_2_2/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/unit_2_2/sub2/bn2/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/unit_2_2/sub2/bn2/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/unit_2_2/sub2/bn2/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/unit_2_2/sub2/bn2/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/unit_2_2/sub2/bn2/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/unit_2_2/sub2/bn2/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/unit_2_2/sub2/bn2/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg/unit_2_2/sub2/bn2/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/unit_2_2/sub2/bn2/moving_variance/zeros' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/unit_2_2/sub2/bn2/moving_variance/sub' type=Sub>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/unit_2_2/sub2/bn2/moving_variance/mul' type=Mul>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/unit_2_2/sub2/bn2/moving_variance/unit_2_2/sub2/bn2/unit_2_2/sub2/bn2/moving_variance' type=AssignSub>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/unit_2_2/sub2/bn2/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/unit_2_2/sub2/bn2/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/unit_2_2/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/unit_2_2/sub2/bn2/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/unit_2_2/sub2/bn2/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/unit_2_2/sub2/bn2/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/unit_2_2/sub2/bn2/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/unit_2_2/sub2/bn2/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/unit_2_2/sub2/bn2/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/unit_2_2/sub2/bn2/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1/unit_2_2/sub2/bn2/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_2_2/sub2/bn2/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_2_2/sub2/bn2/batchnorm/add/y' type=Const>, <tf.Operation 'unit_2_2/sub2/bn2/batchnorm/add' type=Add>, <tf.Operation 'unit_2_2/sub2/bn2/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_2_2/sub2/bn2/batchnorm/mul' type=Mul>, <tf.Operation 'unit_2_2/sub2/bn2/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_2_2/sub2/bn2/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_2_2/sub2/bn2/batchnorm/sub' type=Sub>, <tf.Operation 'unit_2_2/sub2/bn2/batchnorm/add_1' type=Add>, <tf.Operation 'unit_2_2/sub2/Less/y' type=Const>, <tf.Operation 'unit_2_2/sub2/Less' type=Less>, <tf.Operation 'unit_2_2/sub2/mul/x' type=Const>, <tf.Operation 'unit_2_2/sub2/mul' type=Mul>, <tf.Operation 'unit_2_2/sub2/leaky_relu' type=Select>, <tf.Operation 'unit_2_2/sub2/conv2/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_2_2/sub2/conv2/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_2_2/sub2/conv2/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_2_2/sub2/conv2/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_2_2/sub2/conv2/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_2_2/sub2/conv2/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_2_2/sub2/conv2/DW' type=VariableV2>, <tf.Operation 'unit_2_2/sub2/conv2/DW/Assign' type=Assign>, <tf.Operation 'unit_2_2/sub2/conv2/DW/read' type=Identity>, <tf.Operation 'unit_2_2/sub2/conv2/Conv2D' type=Conv2D>, <tf.Operation 'unit_2_2/sub_add/add' type=Add>, <tf.Operation 'unit_2_2/Reshape/shape' type=Const>, <tf.Operation 'unit_2_2/Reshape' type=Reshape>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/beta' type=VariableV2>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/beta/read' type=Identity>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/gamma' type=VariableV2>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/gamma/read' type=Identity>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moments/mean' type=Mean>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moments/variance' type=Mean>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/unit_2_3/residual_only_activation/init_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/unit_2_3/residual_only_activation/init_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/unit_2_3/residual_only_activation/init_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/unit_2_3/residual_only_activation/init_bn/moving_mean/unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/unit_2_3/residual_only_activation/init_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/unit_2_3/residual_only_activation/init_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/unit_2_3/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/unit_2_3/residual_only_activation/init_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/unit_2_3/residual_only_activation/init_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/unit_2_3/residual_only_activation/init_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/unit_2_3/residual_only_activation/init_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/unit_2_3/residual_only_activation/init_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/unit_2_3/residual_only_activation/init_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/unit_2_3/residual_only_activation/init_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg/unit_2_3/residual_only_activation/init_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_3/residual_only_activation/init_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_3/residual_only_activation/init_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_3/residual_only_activation/init_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_3/residual_only_activation/init_bn/moving_variance/unit_2_3/residual_only_activation/init_bn/unit_2_3/residual_only_activation/init_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_3/residual_only_activation/init_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_3/residual_only_activation/init_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_3/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_3/residual_only_activation/init_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_3/residual_only_activation/init_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_3/residual_only_activation/init_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_3/residual_only_activation/init_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_3/residual_only_activation/init_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_3/residual_only_activation/init_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_3/residual_only_activation/init_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_3/residual_only_activation/init_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_2_3/residual_only_activation/init_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_2_3/residual_only_activation/Less/y' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/Less' type=Less>, <tf.Operation 'unit_2_3/residual_only_activation/mul/x' type=Const>, <tf.Operation 'unit_2_3/residual_only_activation/mul' type=Mul>, <tf.Operation 'unit_2_3/residual_only_activation/leaky_relu' type=Select>, <tf.Operation 'unit_2_3/sub1/conv1/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_2_3/sub1/conv1/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_2_3/sub1/conv1/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_2_3/sub1/conv1/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_2_3/sub1/conv1/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_2_3/sub1/conv1/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_2_3/sub1/conv1/DW' type=VariableV2>, <tf.Operation 'unit_2_3/sub1/conv1/DW/Assign' type=Assign>, <tf.Operation 'unit_2_3/sub1/conv1/DW/read' type=Identity>, <tf.Operation 'unit_2_3/sub1/conv1/Conv2D' type=Conv2D>, <tf.Operation 'unit_2_3/sub2/bn2/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/beta' type=VariableV2>, <tf.Operation 'unit_2_3/sub2/bn2/beta/Assign' type=Assign>, <tf.Operation 'unit_2_3/sub2/bn2/beta/read' type=Identity>, <tf.Operation 'unit_2_3/sub2/bn2/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/gamma' type=VariableV2>, <tf.Operation 'unit_2_3/sub2/bn2/gamma/Assign' type=Assign>, <tf.Operation 'unit_2_3/sub2/bn2/gamma/read' type=Identity>, <tf.Operation 'unit_2_3/sub2/bn2/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/moments/mean' type=Mean>, <tf.Operation 'unit_2_3/sub2/bn2/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_2_3/sub2/bn2/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_2_3/sub2/bn2/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/moments/variance' type=Mean>, <tf.Operation 'unit_2_3/sub2/bn2/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_2_3/sub2/bn2/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_2_3/sub2/bn2/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/moving_mean' type=VariableV2>, <tf.Operation 'unit_2_3/sub2/bn2/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_2_3/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_3/sub2/bn2/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/moving_variance' type=VariableV2>, <tf.Operation 'unit_2_3/sub2/bn2/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_2_3/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/unit_2_3/sub2/bn2/moving_mean/zeros' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/unit_2_3/sub2/bn2/moving_mean/sub' type=Sub>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/unit_2_3/sub2/bn2/moving_mean/mul' type=Mul>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/unit_2_3/sub2/bn2/moving_mean/unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_mean' type=AssignSub>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/unit_2_3/sub2/bn2/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/unit_2_3/sub2/bn2/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/unit_2_3/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/unit_2_3/sub2/bn2/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/unit_2_3/sub2/bn2/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/unit_2_3/sub2/bn2/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/unit_2_3/sub2/bn2/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/unit_2_3/sub2/bn2/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/unit_2_3/sub2/bn2/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/unit_2_3/sub2/bn2/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg/unit_2_3/sub2/bn2/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/unit_2_3/sub2/bn2/moving_variance/zeros' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/unit_2_3/sub2/bn2/moving_variance/sub' type=Sub>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/unit_2_3/sub2/bn2/moving_variance/mul' type=Mul>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/unit_2_3/sub2/bn2/moving_variance/unit_2_3/sub2/bn2/unit_2_3/sub2/bn2/moving_variance' type=AssignSub>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/unit_2_3/sub2/bn2/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/unit_2_3/sub2/bn2/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/unit_2_3/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/unit_2_3/sub2/bn2/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/unit_2_3/sub2/bn2/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/unit_2_3/sub2/bn2/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/unit_2_3/sub2/bn2/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/unit_2_3/sub2/bn2/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/unit_2_3/sub2/bn2/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/unit_2_3/sub2/bn2/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1/unit_2_3/sub2/bn2/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_2_3/sub2/bn2/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_2_3/sub2/bn2/batchnorm/add/y' type=Const>, <tf.Operation 'unit_2_3/sub2/bn2/batchnorm/add' type=Add>, <tf.Operation 'unit_2_3/sub2/bn2/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_2_3/sub2/bn2/batchnorm/mul' type=Mul>, <tf.Operation 'unit_2_3/sub2/bn2/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_2_3/sub2/bn2/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_2_3/sub2/bn2/batchnorm/sub' type=Sub>, <tf.Operation 'unit_2_3/sub2/bn2/batchnorm/add_1' type=Add>, <tf.Operation 'unit_2_3/sub2/Less/y' type=Const>, <tf.Operation 'unit_2_3/sub2/Less' type=Less>, <tf.Operation 'unit_2_3/sub2/mul/x' type=Const>, <tf.Operation 'unit_2_3/sub2/mul' type=Mul>, <tf.Operation 'unit_2_3/sub2/leaky_relu' type=Select>, <tf.Operation 'unit_2_3/sub2/conv2/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_2_3/sub2/conv2/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_2_3/sub2/conv2/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_2_3/sub2/conv2/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_2_3/sub2/conv2/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_2_3/sub2/conv2/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_2_3/sub2/conv2/DW' type=VariableV2>, <tf.Operation 'unit_2_3/sub2/conv2/DW/Assign' type=Assign>, <tf.Operation 'unit_2_3/sub2/conv2/DW/read' type=Identity>, <tf.Operation 'unit_2_3/sub2/conv2/Conv2D' type=Conv2D>, <tf.Operation 'unit_2_3/sub_add/add' type=Add>, <tf.Operation 'unit_2_3/Reshape/shape' type=Const>, <tf.Operation 'unit_2_3/Reshape' type=Reshape>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/beta' type=VariableV2>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/beta/read' type=Identity>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/gamma' type=VariableV2>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/gamma/read' type=Identity>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moments/mean' type=Mean>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moments/variance' type=Mean>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/unit_2_4/residual_only_activation/init_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/unit_2_4/residual_only_activation/init_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/unit_2_4/residual_only_activation/init_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/unit_2_4/residual_only_activation/init_bn/moving_mean/unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/unit_2_4/residual_only_activation/init_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/unit_2_4/residual_only_activation/init_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/unit_2_4/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/unit_2_4/residual_only_activation/init_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/unit_2_4/residual_only_activation/init_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/unit_2_4/residual_only_activation/init_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/unit_2_4/residual_only_activation/init_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/unit_2_4/residual_only_activation/init_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/unit_2_4/residual_only_activation/init_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/unit_2_4/residual_only_activation/init_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg/unit_2_4/residual_only_activation/init_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_4/residual_only_activation/init_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_4/residual_only_activation/init_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_4/residual_only_activation/init_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_4/residual_only_activation/init_bn/moving_variance/unit_2_4/residual_only_activation/init_bn/unit_2_4/residual_only_activation/init_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_4/residual_only_activation/init_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_4/residual_only_activation/init_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_4/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_4/residual_only_activation/init_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_4/residual_only_activation/init_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_4/residual_only_activation/init_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_4/residual_only_activation/init_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_4/residual_only_activation/init_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_4/residual_only_activation/init_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_4/residual_only_activation/init_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_2_4/residual_only_activation/init_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_2_4/residual_only_activation/init_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_2_4/residual_only_activation/Less/y' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/Less' type=Less>, <tf.Operation 'unit_2_4/residual_only_activation/mul/x' type=Const>, <tf.Operation 'unit_2_4/residual_only_activation/mul' type=Mul>, <tf.Operation 'unit_2_4/residual_only_activation/leaky_relu' type=Select>, <tf.Operation 'unit_2_4/sub1/conv1/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_2_4/sub1/conv1/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_2_4/sub1/conv1/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_2_4/sub1/conv1/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_2_4/sub1/conv1/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_2_4/sub1/conv1/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_2_4/sub1/conv1/DW' type=VariableV2>, <tf.Operation 'unit_2_4/sub1/conv1/DW/Assign' type=Assign>, <tf.Operation 'unit_2_4/sub1/conv1/DW/read' type=Identity>, <tf.Operation 'unit_2_4/sub1/conv1/Conv2D' type=Conv2D>, <tf.Operation 'unit_2_4/sub2/bn2/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/beta' type=VariableV2>, <tf.Operation 'unit_2_4/sub2/bn2/beta/Assign' type=Assign>, <tf.Operation 'unit_2_4/sub2/bn2/beta/read' type=Identity>, <tf.Operation 'unit_2_4/sub2/bn2/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/gamma' type=VariableV2>, <tf.Operation 'unit_2_4/sub2/bn2/gamma/Assign' type=Assign>, <tf.Operation 'unit_2_4/sub2/bn2/gamma/read' type=Identity>, <tf.Operation 'unit_2_4/sub2/bn2/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/moments/mean' type=Mean>, <tf.Operation 'unit_2_4/sub2/bn2/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_2_4/sub2/bn2/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_2_4/sub2/bn2/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/moments/variance' type=Mean>, <tf.Operation 'unit_2_4/sub2/bn2/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_2_4/sub2/bn2/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_2_4/sub2/bn2/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/moving_mean' type=VariableV2>, <tf.Operation 'unit_2_4/sub2/bn2/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_2_4/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_4/sub2/bn2/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/moving_variance' type=VariableV2>, <tf.Operation 'unit_2_4/sub2/bn2/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_2_4/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/unit_2_4/sub2/bn2/moving_mean/zeros' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/unit_2_4/sub2/bn2/moving_mean/sub' type=Sub>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/unit_2_4/sub2/bn2/moving_mean/mul' type=Mul>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/unit_2_4/sub2/bn2/moving_mean/unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_mean' type=AssignSub>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/unit_2_4/sub2/bn2/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/unit_2_4/sub2/bn2/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/unit_2_4/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/unit_2_4/sub2/bn2/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/unit_2_4/sub2/bn2/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/unit_2_4/sub2/bn2/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/unit_2_4/sub2/bn2/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/unit_2_4/sub2/bn2/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/unit_2_4/sub2/bn2/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/unit_2_4/sub2/bn2/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg/unit_2_4/sub2/bn2/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/unit_2_4/sub2/bn2/moving_variance/zeros' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/unit_2_4/sub2/bn2/moving_variance/sub' type=Sub>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/unit_2_4/sub2/bn2/moving_variance/mul' type=Mul>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/unit_2_4/sub2/bn2/moving_variance/unit_2_4/sub2/bn2/unit_2_4/sub2/bn2/moving_variance' type=AssignSub>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/unit_2_4/sub2/bn2/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/unit_2_4/sub2/bn2/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/unit_2_4/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/unit_2_4/sub2/bn2/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/unit_2_4/sub2/bn2/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/unit_2_4/sub2/bn2/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/unit_2_4/sub2/bn2/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/unit_2_4/sub2/bn2/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/unit_2_4/sub2/bn2/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/unit_2_4/sub2/bn2/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1/unit_2_4/sub2/bn2/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_2_4/sub2/bn2/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_2_4/sub2/bn2/batchnorm/add/y' type=Const>, <tf.Operation 'unit_2_4/sub2/bn2/batchnorm/add' type=Add>, <tf.Operation 'unit_2_4/sub2/bn2/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_2_4/sub2/bn2/batchnorm/mul' type=Mul>, <tf.Operation 'unit_2_4/sub2/bn2/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_2_4/sub2/bn2/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_2_4/sub2/bn2/batchnorm/sub' type=Sub>, <tf.Operation 'unit_2_4/sub2/bn2/batchnorm/add_1' type=Add>, <tf.Operation 'unit_2_4/sub2/Less/y' type=Const>, <tf.Operation 'unit_2_4/sub2/Less' type=Less>, <tf.Operation 'unit_2_4/sub2/mul/x' type=Const>, <tf.Operation 'unit_2_4/sub2/mul' type=Mul>, <tf.Operation 'unit_2_4/sub2/leaky_relu' type=Select>, <tf.Operation 'unit_2_4/sub2/conv2/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_2_4/sub2/conv2/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_2_4/sub2/conv2/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_2_4/sub2/conv2/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_2_4/sub2/conv2/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_2_4/sub2/conv2/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_2_4/sub2/conv2/DW' type=VariableV2>, <tf.Operation 'unit_2_4/sub2/conv2/DW/Assign' type=Assign>, <tf.Operation 'unit_2_4/sub2/conv2/DW/read' type=Identity>, <tf.Operation 'unit_2_4/sub2/conv2/Conv2D' type=Conv2D>, <tf.Operation 'unit_2_4/sub_add/add' type=Add>, <tf.Operation 'unit_2_4/Reshape/shape' type=Const>, <tf.Operation 'unit_2_4/Reshape' type=Reshape>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/beta' type=VariableV2>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/beta/read' type=Identity>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/gamma' type=VariableV2>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/gamma/read' type=Identity>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moments/mean' type=Mean>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moments/variance' type=Mean>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/unit_3_0/residual_only_activation/init_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/unit_3_0/residual_only_activation/init_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/unit_3_0/residual_only_activation/init_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/unit_3_0/residual_only_activation/init_bn/moving_mean/unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/unit_3_0/residual_only_activation/init_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/unit_3_0/residual_only_activation/init_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/unit_3_0/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/unit_3_0/residual_only_activation/init_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/unit_3_0/residual_only_activation/init_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/unit_3_0/residual_only_activation/init_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/unit_3_0/residual_only_activation/init_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/unit_3_0/residual_only_activation/init_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/unit_3_0/residual_only_activation/init_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/unit_3_0/residual_only_activation/init_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg/unit_3_0/residual_only_activation/init_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_0/residual_only_activation/init_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_0/residual_only_activation/init_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_0/residual_only_activation/init_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_0/residual_only_activation/init_bn/moving_variance/unit_3_0/residual_only_activation/init_bn/unit_3_0/residual_only_activation/init_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_0/residual_only_activation/init_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_0/residual_only_activation/init_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_0/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_0/residual_only_activation/init_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_0/residual_only_activation/init_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_0/residual_only_activation/init_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_0/residual_only_activation/init_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_0/residual_only_activation/init_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_0/residual_only_activation/init_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_0/residual_only_activation/init_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_0/residual_only_activation/init_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_3_0/residual_only_activation/init_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_3_0/residual_only_activation/Less/y' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/Less' type=Less>, <tf.Operation 'unit_3_0/residual_only_activation/mul/x' type=Const>, <tf.Operation 'unit_3_0/residual_only_activation/mul' type=Mul>, <tf.Operation 'unit_3_0/residual_only_activation/leaky_relu' type=Select>, <tf.Operation 'unit_3_0/sub1/conv1/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_3_0/sub1/conv1/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_3_0/sub1/conv1/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_3_0/sub1/conv1/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_3_0/sub1/conv1/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_3_0/sub1/conv1/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_3_0/sub1/conv1/DW' type=VariableV2>, <tf.Operation 'unit_3_0/sub1/conv1/DW/Assign' type=Assign>, <tf.Operation 'unit_3_0/sub1/conv1/DW/read' type=Identity>, <tf.Operation 'unit_3_0/sub1/conv1/Conv2D' type=Conv2D>, <tf.Operation 'unit_3_0/sub2/bn2/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/beta' type=VariableV2>, <tf.Operation 'unit_3_0/sub2/bn2/beta/Assign' type=Assign>, <tf.Operation 'unit_3_0/sub2/bn2/beta/read' type=Identity>, <tf.Operation 'unit_3_0/sub2/bn2/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/gamma' type=VariableV2>, <tf.Operation 'unit_3_0/sub2/bn2/gamma/Assign' type=Assign>, <tf.Operation 'unit_3_0/sub2/bn2/gamma/read' type=Identity>, <tf.Operation 'unit_3_0/sub2/bn2/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/moments/mean' type=Mean>, <tf.Operation 'unit_3_0/sub2/bn2/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_3_0/sub2/bn2/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_3_0/sub2/bn2/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/moments/variance' type=Mean>, <tf.Operation 'unit_3_0/sub2/bn2/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_3_0/sub2/bn2/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_3_0/sub2/bn2/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/moving_mean' type=VariableV2>, <tf.Operation 'unit_3_0/sub2/bn2/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_3_0/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_0/sub2/bn2/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/moving_variance' type=VariableV2>, <tf.Operation 'unit_3_0/sub2/bn2/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_3_0/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/unit_3_0/sub2/bn2/moving_mean/zeros' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/unit_3_0/sub2/bn2/moving_mean/sub' type=Sub>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/unit_3_0/sub2/bn2/moving_mean/mul' type=Mul>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/unit_3_0/sub2/bn2/moving_mean/unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_mean' type=AssignSub>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/unit_3_0/sub2/bn2/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/unit_3_0/sub2/bn2/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/unit_3_0/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/unit_3_0/sub2/bn2/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/unit_3_0/sub2/bn2/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/unit_3_0/sub2/bn2/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/unit_3_0/sub2/bn2/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/unit_3_0/sub2/bn2/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/unit_3_0/sub2/bn2/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/unit_3_0/sub2/bn2/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg/unit_3_0/sub2/bn2/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/unit_3_0/sub2/bn2/moving_variance/zeros' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/unit_3_0/sub2/bn2/moving_variance/sub' type=Sub>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/unit_3_0/sub2/bn2/moving_variance/mul' type=Mul>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/unit_3_0/sub2/bn2/moving_variance/unit_3_0/sub2/bn2/unit_3_0/sub2/bn2/moving_variance' type=AssignSub>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/unit_3_0/sub2/bn2/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/unit_3_0/sub2/bn2/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/unit_3_0/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/unit_3_0/sub2/bn2/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/unit_3_0/sub2/bn2/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/unit_3_0/sub2/bn2/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/unit_3_0/sub2/bn2/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/unit_3_0/sub2/bn2/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/unit_3_0/sub2/bn2/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/unit_3_0/sub2/bn2/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1/unit_3_0/sub2/bn2/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_3_0/sub2/bn2/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_3_0/sub2/bn2/batchnorm/add/y' type=Const>, <tf.Operation 'unit_3_0/sub2/bn2/batchnorm/add' type=Add>, <tf.Operation 'unit_3_0/sub2/bn2/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_3_0/sub2/bn2/batchnorm/mul' type=Mul>, <tf.Operation 'unit_3_0/sub2/bn2/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_3_0/sub2/bn2/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_3_0/sub2/bn2/batchnorm/sub' type=Sub>, <tf.Operation 'unit_3_0/sub2/bn2/batchnorm/add_1' type=Add>, <tf.Operation 'unit_3_0/sub2/Less/y' type=Const>, <tf.Operation 'unit_3_0/sub2/Less' type=Less>, <tf.Operation 'unit_3_0/sub2/mul/x' type=Const>, <tf.Operation 'unit_3_0/sub2/mul' type=Mul>, <tf.Operation 'unit_3_0/sub2/leaky_relu' type=Select>, <tf.Operation 'unit_3_0/sub2/conv2/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_3_0/sub2/conv2/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_3_0/sub2/conv2/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_3_0/sub2/conv2/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_3_0/sub2/conv2/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_3_0/sub2/conv2/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_3_0/sub2/conv2/DW' type=VariableV2>, <tf.Operation 'unit_3_0/sub2/conv2/DW/Assign' type=Assign>, <tf.Operation 'unit_3_0/sub2/conv2/DW/read' type=Identity>, <tf.Operation 'unit_3_0/sub2/conv2/Conv2D' type=Conv2D>, <tf.Operation 'unit_3_0/sub_add/AvgPool' type=AvgPool>, <tf.Operation 'unit_3_0/sub_add/Pad/paddings' type=Const>, <tf.Operation 'unit_3_0/sub_add/Pad' type=Pad>, <tf.Operation 'unit_3_0/sub_add/add' type=Add>, <tf.Operation 'unit_3_0/Reshape/shape' type=Const>, <tf.Operation 'unit_3_0/Reshape' type=Reshape>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/beta' type=VariableV2>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/beta/read' type=Identity>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/gamma' type=VariableV2>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/gamma/read' type=Identity>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moments/mean' type=Mean>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moments/variance' type=Mean>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/unit_3_1/residual_only_activation/init_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/unit_3_1/residual_only_activation/init_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/unit_3_1/residual_only_activation/init_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/unit_3_1/residual_only_activation/init_bn/moving_mean/unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/unit_3_1/residual_only_activation/init_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/unit_3_1/residual_only_activation/init_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/unit_3_1/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/unit_3_1/residual_only_activation/init_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/unit_3_1/residual_only_activation/init_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/unit_3_1/residual_only_activation/init_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/unit_3_1/residual_only_activation/init_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/unit_3_1/residual_only_activation/init_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/unit_3_1/residual_only_activation/init_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/unit_3_1/residual_only_activation/init_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg/unit_3_1/residual_only_activation/init_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_1/residual_only_activation/init_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_1/residual_only_activation/init_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_1/residual_only_activation/init_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_1/residual_only_activation/init_bn/moving_variance/unit_3_1/residual_only_activation/init_bn/unit_3_1/residual_only_activation/init_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_1/residual_only_activation/init_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_1/residual_only_activation/init_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_1/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_1/residual_only_activation/init_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_1/residual_only_activation/init_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_1/residual_only_activation/init_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_1/residual_only_activation/init_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_1/residual_only_activation/init_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_1/residual_only_activation/init_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_1/residual_only_activation/init_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_1/residual_only_activation/init_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_3_1/residual_only_activation/init_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_3_1/residual_only_activation/Less/y' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/Less' type=Less>, <tf.Operation 'unit_3_1/residual_only_activation/mul/x' type=Const>, <tf.Operation 'unit_3_1/residual_only_activation/mul' type=Mul>, <tf.Operation 'unit_3_1/residual_only_activation/leaky_relu' type=Select>, <tf.Operation 'unit_3_1/sub1/conv1/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_3_1/sub1/conv1/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_3_1/sub1/conv1/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_3_1/sub1/conv1/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_3_1/sub1/conv1/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_3_1/sub1/conv1/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_3_1/sub1/conv1/DW' type=VariableV2>, <tf.Operation 'unit_3_1/sub1/conv1/DW/Assign' type=Assign>, <tf.Operation 'unit_3_1/sub1/conv1/DW/read' type=Identity>, <tf.Operation 'unit_3_1/sub1/conv1/Conv2D' type=Conv2D>, <tf.Operation 'unit_3_1/sub2/bn2/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/beta' type=VariableV2>, <tf.Operation 'unit_3_1/sub2/bn2/beta/Assign' type=Assign>, <tf.Operation 'unit_3_1/sub2/bn2/beta/read' type=Identity>, <tf.Operation 'unit_3_1/sub2/bn2/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/gamma' type=VariableV2>, <tf.Operation 'unit_3_1/sub2/bn2/gamma/Assign' type=Assign>, <tf.Operation 'unit_3_1/sub2/bn2/gamma/read' type=Identity>, <tf.Operation 'unit_3_1/sub2/bn2/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/moments/mean' type=Mean>, <tf.Operation 'unit_3_1/sub2/bn2/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_3_1/sub2/bn2/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_3_1/sub2/bn2/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/moments/variance' type=Mean>, <tf.Operation 'unit_3_1/sub2/bn2/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_3_1/sub2/bn2/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_3_1/sub2/bn2/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/moving_mean' type=VariableV2>, <tf.Operation 'unit_3_1/sub2/bn2/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_3_1/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_1/sub2/bn2/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/moving_variance' type=VariableV2>, <tf.Operation 'unit_3_1/sub2/bn2/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_3_1/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/unit_3_1/sub2/bn2/moving_mean/zeros' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/unit_3_1/sub2/bn2/moving_mean/sub' type=Sub>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/unit_3_1/sub2/bn2/moving_mean/mul' type=Mul>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/unit_3_1/sub2/bn2/moving_mean/unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_mean' type=AssignSub>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/unit_3_1/sub2/bn2/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/unit_3_1/sub2/bn2/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/unit_3_1/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/unit_3_1/sub2/bn2/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/unit_3_1/sub2/bn2/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/unit_3_1/sub2/bn2/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/unit_3_1/sub2/bn2/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/unit_3_1/sub2/bn2/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/unit_3_1/sub2/bn2/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/unit_3_1/sub2/bn2/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg/unit_3_1/sub2/bn2/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/unit_3_1/sub2/bn2/moving_variance/zeros' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/unit_3_1/sub2/bn2/moving_variance/sub' type=Sub>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/unit_3_1/sub2/bn2/moving_variance/mul' type=Mul>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/unit_3_1/sub2/bn2/moving_variance/unit_3_1/sub2/bn2/unit_3_1/sub2/bn2/moving_variance' type=AssignSub>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/unit_3_1/sub2/bn2/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/unit_3_1/sub2/bn2/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/unit_3_1/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/unit_3_1/sub2/bn2/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/unit_3_1/sub2/bn2/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/unit_3_1/sub2/bn2/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/unit_3_1/sub2/bn2/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/unit_3_1/sub2/bn2/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/unit_3_1/sub2/bn2/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/unit_3_1/sub2/bn2/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1/unit_3_1/sub2/bn2/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_3_1/sub2/bn2/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_3_1/sub2/bn2/batchnorm/add/y' type=Const>, <tf.Operation 'unit_3_1/sub2/bn2/batchnorm/add' type=Add>, <tf.Operation 'unit_3_1/sub2/bn2/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_3_1/sub2/bn2/batchnorm/mul' type=Mul>, <tf.Operation 'unit_3_1/sub2/bn2/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_3_1/sub2/bn2/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_3_1/sub2/bn2/batchnorm/sub' type=Sub>, <tf.Operation 'unit_3_1/sub2/bn2/batchnorm/add_1' type=Add>, <tf.Operation 'unit_3_1/sub2/Less/y' type=Const>, <tf.Operation 'unit_3_1/sub2/Less' type=Less>, <tf.Operation 'unit_3_1/sub2/mul/x' type=Const>, <tf.Operation 'unit_3_1/sub2/mul' type=Mul>, <tf.Operation 'unit_3_1/sub2/leaky_relu' type=Select>, <tf.Operation 'unit_3_1/sub2/conv2/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_3_1/sub2/conv2/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_3_1/sub2/conv2/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_3_1/sub2/conv2/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_3_1/sub2/conv2/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_3_1/sub2/conv2/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_3_1/sub2/conv2/DW' type=VariableV2>, <tf.Operation 'unit_3_1/sub2/conv2/DW/Assign' type=Assign>, <tf.Operation 'unit_3_1/sub2/conv2/DW/read' type=Identity>, <tf.Operation 'unit_3_1/sub2/conv2/Conv2D' type=Conv2D>, <tf.Operation 'unit_3_1/sub_add/add' type=Add>, <tf.Operation 'unit_3_1/Reshape/shape' type=Const>, <tf.Operation 'unit_3_1/Reshape' type=Reshape>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/beta' type=VariableV2>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/beta/read' type=Identity>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/gamma' type=VariableV2>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/gamma/read' type=Identity>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moments/mean' type=Mean>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moments/variance' type=Mean>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/unit_3_2/residual_only_activation/init_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/unit_3_2/residual_only_activation/init_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/unit_3_2/residual_only_activation/init_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/unit_3_2/residual_only_activation/init_bn/moving_mean/unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/unit_3_2/residual_only_activation/init_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/unit_3_2/residual_only_activation/init_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/unit_3_2/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/unit_3_2/residual_only_activation/init_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/unit_3_2/residual_only_activation/init_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/unit_3_2/residual_only_activation/init_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/unit_3_2/residual_only_activation/init_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/unit_3_2/residual_only_activation/init_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/unit_3_2/residual_only_activation/init_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/unit_3_2/residual_only_activation/init_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg/unit_3_2/residual_only_activation/init_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_2/residual_only_activation/init_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_2/residual_only_activation/init_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_2/residual_only_activation/init_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_2/residual_only_activation/init_bn/moving_variance/unit_3_2/residual_only_activation/init_bn/unit_3_2/residual_only_activation/init_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_2/residual_only_activation/init_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_2/residual_only_activation/init_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_2/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_2/residual_only_activation/init_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_2/residual_only_activation/init_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_2/residual_only_activation/init_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_2/residual_only_activation/init_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_2/residual_only_activation/init_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_2/residual_only_activation/init_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_2/residual_only_activation/init_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_2/residual_only_activation/init_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_3_2/residual_only_activation/init_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_3_2/residual_only_activation/Less/y' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/Less' type=Less>, <tf.Operation 'unit_3_2/residual_only_activation/mul/x' type=Const>, <tf.Operation 'unit_3_2/residual_only_activation/mul' type=Mul>, <tf.Operation 'unit_3_2/residual_only_activation/leaky_relu' type=Select>, <tf.Operation 'unit_3_2/sub1/conv1/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_3_2/sub1/conv1/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_3_2/sub1/conv1/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_3_2/sub1/conv1/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_3_2/sub1/conv1/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_3_2/sub1/conv1/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_3_2/sub1/conv1/DW' type=VariableV2>, <tf.Operation 'unit_3_2/sub1/conv1/DW/Assign' type=Assign>, <tf.Operation 'unit_3_2/sub1/conv1/DW/read' type=Identity>, <tf.Operation 'unit_3_2/sub1/conv1/Conv2D' type=Conv2D>, <tf.Operation 'unit_3_2/sub2/bn2/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/beta' type=VariableV2>, <tf.Operation 'unit_3_2/sub2/bn2/beta/Assign' type=Assign>, <tf.Operation 'unit_3_2/sub2/bn2/beta/read' type=Identity>, <tf.Operation 'unit_3_2/sub2/bn2/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/gamma' type=VariableV2>, <tf.Operation 'unit_3_2/sub2/bn2/gamma/Assign' type=Assign>, <tf.Operation 'unit_3_2/sub2/bn2/gamma/read' type=Identity>, <tf.Operation 'unit_3_2/sub2/bn2/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/moments/mean' type=Mean>, <tf.Operation 'unit_3_2/sub2/bn2/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_3_2/sub2/bn2/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_3_2/sub2/bn2/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/moments/variance' type=Mean>, <tf.Operation 'unit_3_2/sub2/bn2/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_3_2/sub2/bn2/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_3_2/sub2/bn2/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/moving_mean' type=VariableV2>, <tf.Operation 'unit_3_2/sub2/bn2/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_3_2/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_2/sub2/bn2/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/moving_variance' type=VariableV2>, <tf.Operation 'unit_3_2/sub2/bn2/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_3_2/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/unit_3_2/sub2/bn2/moving_mean/zeros' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/unit_3_2/sub2/bn2/moving_mean/sub' type=Sub>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/unit_3_2/sub2/bn2/moving_mean/mul' type=Mul>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/unit_3_2/sub2/bn2/moving_mean/unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_mean' type=AssignSub>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/unit_3_2/sub2/bn2/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/unit_3_2/sub2/bn2/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/unit_3_2/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/unit_3_2/sub2/bn2/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/unit_3_2/sub2/bn2/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/unit_3_2/sub2/bn2/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/unit_3_2/sub2/bn2/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/unit_3_2/sub2/bn2/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/unit_3_2/sub2/bn2/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/unit_3_2/sub2/bn2/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg/unit_3_2/sub2/bn2/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/unit_3_2/sub2/bn2/moving_variance/zeros' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/unit_3_2/sub2/bn2/moving_variance/sub' type=Sub>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/unit_3_2/sub2/bn2/moving_variance/mul' type=Mul>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/unit_3_2/sub2/bn2/moving_variance/unit_3_2/sub2/bn2/unit_3_2/sub2/bn2/moving_variance' type=AssignSub>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/unit_3_2/sub2/bn2/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/unit_3_2/sub2/bn2/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/unit_3_2/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/unit_3_2/sub2/bn2/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/unit_3_2/sub2/bn2/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/unit_3_2/sub2/bn2/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/unit_3_2/sub2/bn2/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/unit_3_2/sub2/bn2/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/unit_3_2/sub2/bn2/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/unit_3_2/sub2/bn2/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1/unit_3_2/sub2/bn2/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_3_2/sub2/bn2/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_3_2/sub2/bn2/batchnorm/add/y' type=Const>, <tf.Operation 'unit_3_2/sub2/bn2/batchnorm/add' type=Add>, <tf.Operation 'unit_3_2/sub2/bn2/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_3_2/sub2/bn2/batchnorm/mul' type=Mul>, <tf.Operation 'unit_3_2/sub2/bn2/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_3_2/sub2/bn2/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_3_2/sub2/bn2/batchnorm/sub' type=Sub>, <tf.Operation 'unit_3_2/sub2/bn2/batchnorm/add_1' type=Add>, <tf.Operation 'unit_3_2/sub2/Less/y' type=Const>, <tf.Operation 'unit_3_2/sub2/Less' type=Less>, <tf.Operation 'unit_3_2/sub2/mul/x' type=Const>, <tf.Operation 'unit_3_2/sub2/mul' type=Mul>, <tf.Operation 'unit_3_2/sub2/leaky_relu' type=Select>, <tf.Operation 'unit_3_2/sub2/conv2/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_3_2/sub2/conv2/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_3_2/sub2/conv2/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_3_2/sub2/conv2/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_3_2/sub2/conv2/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_3_2/sub2/conv2/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_3_2/sub2/conv2/DW' type=VariableV2>, <tf.Operation 'unit_3_2/sub2/conv2/DW/Assign' type=Assign>, <tf.Operation 'unit_3_2/sub2/conv2/DW/read' type=Identity>, <tf.Operation 'unit_3_2/sub2/conv2/Conv2D' type=Conv2D>, <tf.Operation 'unit_3_2/sub_add/add' type=Add>, <tf.Operation 'unit_3_2/Reshape/shape' type=Const>, <tf.Operation 'unit_3_2/Reshape' type=Reshape>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/beta' type=VariableV2>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/beta/read' type=Identity>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/gamma' type=VariableV2>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/gamma/read' type=Identity>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moments/mean' type=Mean>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moments/variance' type=Mean>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/unit_3_3/residual_only_activation/init_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/unit_3_3/residual_only_activation/init_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/unit_3_3/residual_only_activation/init_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/unit_3_3/residual_only_activation/init_bn/moving_mean/unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/unit_3_3/residual_only_activation/init_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/unit_3_3/residual_only_activation/init_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/unit_3_3/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/unit_3_3/residual_only_activation/init_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/unit_3_3/residual_only_activation/init_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/unit_3_3/residual_only_activation/init_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/unit_3_3/residual_only_activation/init_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/unit_3_3/residual_only_activation/init_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/unit_3_3/residual_only_activation/init_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/unit_3_3/residual_only_activation/init_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg/unit_3_3/residual_only_activation/init_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_3/residual_only_activation/init_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_3/residual_only_activation/init_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_3/residual_only_activation/init_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_3/residual_only_activation/init_bn/moving_variance/unit_3_3/residual_only_activation/init_bn/unit_3_3/residual_only_activation/init_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_3/residual_only_activation/init_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_3/residual_only_activation/init_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_3/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_3/residual_only_activation/init_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_3/residual_only_activation/init_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_3/residual_only_activation/init_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_3/residual_only_activation/init_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_3/residual_only_activation/init_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_3/residual_only_activation/init_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_3/residual_only_activation/init_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_3/residual_only_activation/init_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_3_3/residual_only_activation/init_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_3_3/residual_only_activation/Less/y' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/Less' type=Less>, <tf.Operation 'unit_3_3/residual_only_activation/mul/x' type=Const>, <tf.Operation 'unit_3_3/residual_only_activation/mul' type=Mul>, <tf.Operation 'unit_3_3/residual_only_activation/leaky_relu' type=Select>, <tf.Operation 'unit_3_3/sub1/conv1/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_3_3/sub1/conv1/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_3_3/sub1/conv1/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_3_3/sub1/conv1/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_3_3/sub1/conv1/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_3_3/sub1/conv1/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_3_3/sub1/conv1/DW' type=VariableV2>, <tf.Operation 'unit_3_3/sub1/conv1/DW/Assign' type=Assign>, <tf.Operation 'unit_3_3/sub1/conv1/DW/read' type=Identity>, <tf.Operation 'unit_3_3/sub1/conv1/Conv2D' type=Conv2D>, <tf.Operation 'unit_3_3/sub2/bn2/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/beta' type=VariableV2>, <tf.Operation 'unit_3_3/sub2/bn2/beta/Assign' type=Assign>, <tf.Operation 'unit_3_3/sub2/bn2/beta/read' type=Identity>, <tf.Operation 'unit_3_3/sub2/bn2/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/gamma' type=VariableV2>, <tf.Operation 'unit_3_3/sub2/bn2/gamma/Assign' type=Assign>, <tf.Operation 'unit_3_3/sub2/bn2/gamma/read' type=Identity>, <tf.Operation 'unit_3_3/sub2/bn2/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/moments/mean' type=Mean>, <tf.Operation 'unit_3_3/sub2/bn2/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_3_3/sub2/bn2/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_3_3/sub2/bn2/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/moments/variance' type=Mean>, <tf.Operation 'unit_3_3/sub2/bn2/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_3_3/sub2/bn2/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_3_3/sub2/bn2/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/moving_mean' type=VariableV2>, <tf.Operation 'unit_3_3/sub2/bn2/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_3_3/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_3/sub2/bn2/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/moving_variance' type=VariableV2>, <tf.Operation 'unit_3_3/sub2/bn2/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_3_3/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/unit_3_3/sub2/bn2/moving_mean/zeros' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/unit_3_3/sub2/bn2/moving_mean/sub' type=Sub>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/unit_3_3/sub2/bn2/moving_mean/mul' type=Mul>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/unit_3_3/sub2/bn2/moving_mean/unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_mean' type=AssignSub>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/unit_3_3/sub2/bn2/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/unit_3_3/sub2/bn2/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/unit_3_3/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/unit_3_3/sub2/bn2/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/unit_3_3/sub2/bn2/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/unit_3_3/sub2/bn2/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/unit_3_3/sub2/bn2/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/unit_3_3/sub2/bn2/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/unit_3_3/sub2/bn2/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/unit_3_3/sub2/bn2/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg/unit_3_3/sub2/bn2/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/unit_3_3/sub2/bn2/moving_variance/zeros' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/unit_3_3/sub2/bn2/moving_variance/sub' type=Sub>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/unit_3_3/sub2/bn2/moving_variance/mul' type=Mul>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/unit_3_3/sub2/bn2/moving_variance/unit_3_3/sub2/bn2/unit_3_3/sub2/bn2/moving_variance' type=AssignSub>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/unit_3_3/sub2/bn2/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/unit_3_3/sub2/bn2/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/unit_3_3/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/unit_3_3/sub2/bn2/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/unit_3_3/sub2/bn2/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/unit_3_3/sub2/bn2/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/unit_3_3/sub2/bn2/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/unit_3_3/sub2/bn2/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/unit_3_3/sub2/bn2/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/unit_3_3/sub2/bn2/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1/unit_3_3/sub2/bn2/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_3_3/sub2/bn2/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_3_3/sub2/bn2/batchnorm/add/y' type=Const>, <tf.Operation 'unit_3_3/sub2/bn2/batchnorm/add' type=Add>, <tf.Operation 'unit_3_3/sub2/bn2/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_3_3/sub2/bn2/batchnorm/mul' type=Mul>, <tf.Operation 'unit_3_3/sub2/bn2/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_3_3/sub2/bn2/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_3_3/sub2/bn2/batchnorm/sub' type=Sub>, <tf.Operation 'unit_3_3/sub2/bn2/batchnorm/add_1' type=Add>, <tf.Operation 'unit_3_3/sub2/Less/y' type=Const>, <tf.Operation 'unit_3_3/sub2/Less' type=Less>, <tf.Operation 'unit_3_3/sub2/mul/x' type=Const>, <tf.Operation 'unit_3_3/sub2/mul' type=Mul>, <tf.Operation 'unit_3_3/sub2/leaky_relu' type=Select>, <tf.Operation 'unit_3_3/sub2/conv2/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_3_3/sub2/conv2/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_3_3/sub2/conv2/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_3_3/sub2/conv2/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_3_3/sub2/conv2/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_3_3/sub2/conv2/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_3_3/sub2/conv2/DW' type=VariableV2>, <tf.Operation 'unit_3_3/sub2/conv2/DW/Assign' type=Assign>, <tf.Operation 'unit_3_3/sub2/conv2/DW/read' type=Identity>, <tf.Operation 'unit_3_3/sub2/conv2/Conv2D' type=Conv2D>, <tf.Operation 'unit_3_3/sub_add/add' type=Add>, <tf.Operation 'unit_3_3/Reshape/shape' type=Const>, <tf.Operation 'unit_3_3/Reshape' type=Reshape>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/beta' type=VariableV2>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/beta/read' type=Identity>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/gamma' type=VariableV2>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/gamma/read' type=Identity>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moments/mean' type=Mean>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moments/variance' type=Mean>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/unit_3_4/residual_only_activation/init_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/unit_3_4/residual_only_activation/init_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/unit_3_4/residual_only_activation/init_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/unit_3_4/residual_only_activation/init_bn/moving_mean/unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/unit_3_4/residual_only_activation/init_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/unit_3_4/residual_only_activation/init_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/unit_3_4/residual_only_activation/init_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/unit_3_4/residual_only_activation/init_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/unit_3_4/residual_only_activation/init_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/unit_3_4/residual_only_activation/init_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/unit_3_4/residual_only_activation/init_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/unit_3_4/residual_only_activation/init_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/unit_3_4/residual_only_activation/init_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/unit_3_4/residual_only_activation/init_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg/unit_3_4/residual_only_activation/init_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_4/residual_only_activation/init_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_4/residual_only_activation/init_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_4/residual_only_activation/init_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_4/residual_only_activation/init_bn/moving_variance/unit_3_4/residual_only_activation/init_bn/unit_3_4/residual_only_activation/init_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_4/residual_only_activation/init_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_4/residual_only_activation/init_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_4/residual_only_activation/init_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_4/residual_only_activation/init_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_4/residual_only_activation/init_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_4/residual_only_activation/init_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_4/residual_only_activation/init_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_4/residual_only_activation/init_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_4/residual_only_activation/init_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_4/residual_only_activation/init_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1/unit_3_4/residual_only_activation/init_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_3_4/residual_only_activation/init_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_3_4/residual_only_activation/Less/y' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/Less' type=Less>, <tf.Operation 'unit_3_4/residual_only_activation/mul/x' type=Const>, <tf.Operation 'unit_3_4/residual_only_activation/mul' type=Mul>, <tf.Operation 'unit_3_4/residual_only_activation/leaky_relu' type=Select>, <tf.Operation 'unit_3_4/sub1/conv1/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_3_4/sub1/conv1/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_3_4/sub1/conv1/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_3_4/sub1/conv1/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_3_4/sub1/conv1/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_3_4/sub1/conv1/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_3_4/sub1/conv1/DW' type=VariableV2>, <tf.Operation 'unit_3_4/sub1/conv1/DW/Assign' type=Assign>, <tf.Operation 'unit_3_4/sub1/conv1/DW/read' type=Identity>, <tf.Operation 'unit_3_4/sub1/conv1/Conv2D' type=Conv2D>, <tf.Operation 'unit_3_4/sub2/bn2/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/beta' type=VariableV2>, <tf.Operation 'unit_3_4/sub2/bn2/beta/Assign' type=Assign>, <tf.Operation 'unit_3_4/sub2/bn2/beta/read' type=Identity>, <tf.Operation 'unit_3_4/sub2/bn2/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/gamma' type=VariableV2>, <tf.Operation 'unit_3_4/sub2/bn2/gamma/Assign' type=Assign>, <tf.Operation 'unit_3_4/sub2/bn2/gamma/read' type=Identity>, <tf.Operation 'unit_3_4/sub2/bn2/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/moments/mean' type=Mean>, <tf.Operation 'unit_3_4/sub2/bn2/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_3_4/sub2/bn2/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_3_4/sub2/bn2/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/moments/variance' type=Mean>, <tf.Operation 'unit_3_4/sub2/bn2/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_3_4/sub2/bn2/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_3_4/sub2/bn2/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/moving_mean' type=VariableV2>, <tf.Operation 'unit_3_4/sub2/bn2/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_3_4/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_4/sub2/bn2/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/moving_variance' type=VariableV2>, <tf.Operation 'unit_3_4/sub2/bn2/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_3_4/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/unit_3_4/sub2/bn2/moving_mean/zeros' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/unit_3_4/sub2/bn2/moving_mean/sub' type=Sub>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/unit_3_4/sub2/bn2/moving_mean/mul' type=Mul>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/unit_3_4/sub2/bn2/moving_mean/unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_mean' type=AssignSub>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/unit_3_4/sub2/bn2/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/unit_3_4/sub2/bn2/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/unit_3_4/sub2/bn2/moving_mean/read' type=Identity>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/unit_3_4/sub2/bn2/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/unit_3_4/sub2/bn2/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/unit_3_4/sub2/bn2/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/unit_3_4/sub2/bn2/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/unit_3_4/sub2/bn2/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/unit_3_4/sub2/bn2/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/unit_3_4/sub2/bn2/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg/unit_3_4/sub2/bn2/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/unit_3_4/sub2/bn2/moving_variance/zeros' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/unit_3_4/sub2/bn2/moving_variance/sub' type=Sub>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/unit_3_4/sub2/bn2/moving_variance/mul' type=Mul>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/unit_3_4/sub2/bn2/moving_variance/unit_3_4/sub2/bn2/unit_3_4/sub2/bn2/moving_variance' type=AssignSub>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/unit_3_4/sub2/bn2/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/unit_3_4/sub2/bn2/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/unit_3_4/sub2/bn2/moving_variance/read' type=Identity>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/unit_3_4/sub2/bn2/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/unit_3_4/sub2/bn2/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/unit_3_4/sub2/bn2/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/unit_3_4/sub2/bn2/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/unit_3_4/sub2/bn2/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/unit_3_4/sub2/bn2/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/unit_3_4/sub2/bn2/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1/unit_3_4/sub2/bn2/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_3_4/sub2/bn2/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_3_4/sub2/bn2/batchnorm/add/y' type=Const>, <tf.Operation 'unit_3_4/sub2/bn2/batchnorm/add' type=Add>, <tf.Operation 'unit_3_4/sub2/bn2/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_3_4/sub2/bn2/batchnorm/mul' type=Mul>, <tf.Operation 'unit_3_4/sub2/bn2/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_3_4/sub2/bn2/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_3_4/sub2/bn2/batchnorm/sub' type=Sub>, <tf.Operation 'unit_3_4/sub2/bn2/batchnorm/add_1' type=Add>, <tf.Operation 'unit_3_4/sub2/Less/y' type=Const>, <tf.Operation 'unit_3_4/sub2/Less' type=Less>, <tf.Operation 'unit_3_4/sub2/mul/x' type=Const>, <tf.Operation 'unit_3_4/sub2/mul' type=Mul>, <tf.Operation 'unit_3_4/sub2/leaky_relu' type=Select>, <tf.Operation 'unit_3_4/sub2/conv2/DW/Initializer/random_normal/shape' type=Const>, <tf.Operation 'unit_3_4/sub2/conv2/DW/Initializer/random_normal/mean' type=Const>, <tf.Operation 'unit_3_4/sub2/conv2/DW/Initializer/random_normal/stddev' type=Const>, <tf.Operation 'unit_3_4/sub2/conv2/DW/Initializer/random_normal/RandomStandardNormal' type=RandomStandardNormal>, <tf.Operation 'unit_3_4/sub2/conv2/DW/Initializer/random_normal/mul' type=Mul>, <tf.Operation 'unit_3_4/sub2/conv2/DW/Initializer/random_normal' type=Add>, <tf.Operation 'unit_3_4/sub2/conv2/DW' type=VariableV2>, <tf.Operation 'unit_3_4/sub2/conv2/DW/Assign' type=Assign>, <tf.Operation 'unit_3_4/sub2/conv2/DW/read' type=Identity>, <tf.Operation 'unit_3_4/sub2/conv2/Conv2D' type=Conv2D>, <tf.Operation 'unit_3_4/sub_add/add' type=Add>, <tf.Operation 'unit_3_4/Reshape/shape' type=Const>, <tf.Operation 'unit_3_4/Reshape' type=Reshape>, <tf.Operation 'unit_last/final_bn/beta/Initializer/Const' type=Const>, <tf.Operation 'unit_last/final_bn/beta' type=VariableV2>, <tf.Operation 'unit_last/final_bn/beta/Assign' type=Assign>, <tf.Operation 'unit_last/final_bn/beta/read' type=Identity>, <tf.Operation 'unit_last/final_bn/gamma/Initializer/Const' type=Const>, <tf.Operation 'unit_last/final_bn/gamma' type=VariableV2>, <tf.Operation 'unit_last/final_bn/gamma/Assign' type=Assign>, <tf.Operation 'unit_last/final_bn/gamma/read' type=Identity>, <tf.Operation 'unit_last/final_bn/moments/mean/reduction_indices' type=Const>, <tf.Operation 'unit_last/final_bn/moments/mean' type=Mean>, <tf.Operation 'unit_last/final_bn/moments/StopGradient' type=StopGradient>, <tf.Operation 'unit_last/final_bn/moments/SquaredDifference' type=SquaredDifference>, <tf.Operation 'unit_last/final_bn/moments/variance/reduction_indices' type=Const>, <tf.Operation 'unit_last/final_bn/moments/variance' type=Mean>, <tf.Operation 'unit_last/final_bn/moments/Squeeze' type=Squeeze>, <tf.Operation 'unit_last/final_bn/moments/Squeeze_1' type=Squeeze>, <tf.Operation 'unit_last/final_bn/moving_mean/Initializer/Const' type=Const>, <tf.Operation 'unit_last/final_bn/moving_mean' type=VariableV2>, <tf.Operation 'unit_last/final_bn/moving_mean/Assign' type=Assign>, <tf.Operation 'unit_last/final_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_last/final_bn/moving_variance/Initializer/Const' type=Const>, <tf.Operation 'unit_last/final_bn/moving_variance' type=VariableV2>, <tf.Operation 'unit_last/final_bn/moving_variance/Assign' type=Assign>, <tf.Operation 'unit_last/final_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/decay' type=Const>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/unit_last/final_bn/moving_mean/zeros' type=Const>, <tf.Operation 'unit_last/final_bn/unit_last/final_bn/moving_mean/biased' type=VariableV2>, <tf.Operation 'unit_last/final_bn/unit_last/final_bn/moving_mean/biased/Assign' type=Assign>, <tf.Operation 'unit_last/final_bn/unit_last/final_bn/moving_mean/biased/read' type=Identity>, <tf.Operation 'unit_last/final_bn/unit_last/final_bn/moving_mean/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_last/final_bn/unit_last/final_bn/moving_mean/local_step' type=VariableV2>, <tf.Operation 'unit_last/final_bn/unit_last/final_bn/moving_mean/local_step/Assign' type=Assign>, <tf.Operation 'unit_last/final_bn/unit_last/final_bn/moving_mean/local_step/read' type=Identity>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/unit_last/final_bn/moving_mean/sub' type=Sub>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/unit_last/final_bn/moving_mean/mul' type=Mul>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/unit_last/final_bn/moving_mean/unit_last/final_bn/unit_last/final_bn/moving_mean' type=AssignSub>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/unit_last/final_bn/moving_mean/AssignAdd/value' type=Const>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/unit_last/final_bn/moving_mean/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/unit_last/final_bn/moving_mean/read' type=Identity>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/unit_last/final_bn/moving_mean/sub_1/x' type=Const>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/unit_last/final_bn/moving_mean/sub_1' type=Sub>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/unit_last/final_bn/moving_mean/read_1' type=Identity>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/unit_last/final_bn/moving_mean/Pow' type=Pow>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/unit_last/final_bn/moving_mean/sub_2/x' type=Const>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/unit_last/final_bn/moving_mean/sub_2' type=Sub>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/unit_last/final_bn/moving_mean/truediv' type=RealDiv>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg/unit_last/final_bn/moving_mean/sub_3' type=Sub>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg' type=AssignSub>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/decay' type=Const>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/unit_last/final_bn/moving_variance/zeros' type=Const>, <tf.Operation 'unit_last/final_bn/unit_last/final_bn/moving_variance/biased' type=VariableV2>, <tf.Operation 'unit_last/final_bn/unit_last/final_bn/moving_variance/biased/Assign' type=Assign>, <tf.Operation 'unit_last/final_bn/unit_last/final_bn/moving_variance/biased/read' type=Identity>, <tf.Operation 'unit_last/final_bn/unit_last/final_bn/moving_variance/local_step/Initializer/zeros' type=Const>, <tf.Operation 'unit_last/final_bn/unit_last/final_bn/moving_variance/local_step' type=VariableV2>, <tf.Operation 'unit_last/final_bn/unit_last/final_bn/moving_variance/local_step/Assign' type=Assign>, <tf.Operation 'unit_last/final_bn/unit_last/final_bn/moving_variance/local_step/read' type=Identity>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/unit_last/final_bn/moving_variance/sub' type=Sub>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/unit_last/final_bn/moving_variance/mul' type=Mul>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/unit_last/final_bn/moving_variance/unit_last/final_bn/unit_last/final_bn/moving_variance' type=AssignSub>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/unit_last/final_bn/moving_variance/AssignAdd/value' type=Const>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/unit_last/final_bn/moving_variance/AssignAdd' type=AssignAdd>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/unit_last/final_bn/moving_variance/read' type=Identity>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/unit_last/final_bn/moving_variance/sub_1/x' type=Const>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/unit_last/final_bn/moving_variance/sub_1' type=Sub>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/unit_last/final_bn/moving_variance/read_1' type=Identity>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/unit_last/final_bn/moving_variance/Pow' type=Pow>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/unit_last/final_bn/moving_variance/sub_2/x' type=Const>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/unit_last/final_bn/moving_variance/sub_2' type=Sub>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/unit_last/final_bn/moving_variance/truediv' type=RealDiv>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1/unit_last/final_bn/moving_variance/sub_3' type=Sub>, <tf.Operation 'unit_last/final_bn/AssignMovingAvg_1' type=AssignSub>, <tf.Operation 'unit_last/final_bn/batchnorm/add/y' type=Const>, <tf.Operation 'unit_last/final_bn/batchnorm/add' type=Add>, <tf.Operation 'unit_last/final_bn/batchnorm/Rsqrt' type=Rsqrt>, <tf.Operation 'unit_last/final_bn/batchnorm/mul' type=Mul>, <tf.Operation 'unit_last/final_bn/batchnorm/mul_1' type=Mul>, <tf.Operation 'unit_last/final_bn/batchnorm/mul_2' type=Mul>, <tf.Operation 'unit_last/final_bn/batchnorm/sub' type=Sub>, <tf.Operation 'unit_last/final_bn/batchnorm/add_1' type=Add>, <tf.Operation 'unit_last/Less/y' type=Const>, <tf.Operation 'unit_last/Less' type=Less>, <tf.Operation 'unit_last/mul/x' type=Const>, <tf.Operation 'unit_last/mul' type=Mul>, <tf.Operation 'unit_last/leaky_relu' type=Select>, <tf.Operation 'unit_last/Mean/reduction_indices' type=Const>, <tf.Operation 'unit_last/Mean' type=Mean>, <tf.Operation 'unit_last/Reshape/shape' type=Const>, <tf.Operation 'unit_last/Reshape' type=Reshape>, <tf.Operation 'logit/Reshape/shape' type=Const>, <tf.Operation 'logit/Reshape' type=Reshape>, <tf.Operation 'logit/DW/Initializer/random_uniform/shape' type=Const>, <tf.Operation 'logit/DW/Initializer/random_uniform/min' type=Const>, <tf.Operation 'logit/DW/Initializer/random_uniform/max' type=Const>, <tf.Operation 'logit/DW/Initializer/random_uniform/RandomUniform' type=RandomUniform>, <tf.Operation 'logit/DW/Initializer/random_uniform/sub' type=Sub>, <tf.Operation 'logit/DW/Initializer/random_uniform/mul' type=Mul>, <tf.Operation 'logit/DW/Initializer/random_uniform' type=Add>, <tf.Operation 'logit/DW' type=VariableV2>, <tf.Operation 'logit/DW/Assign' type=Assign>, <tf.Operation 'logit/DW/read' type=Identity>, <tf.Operation 'logit/biases/Initializer/Const' type=Const>, <tf.Operation 'logit/biases' type=VariableV2>, <tf.Operation 'logit/biases/Assign' type=Assign>, <tf.Operation 'logit/biases/read' type=Identity>, <tf.Operation 'logit/xw_plus_b/MatMul' type=MatMul>, <tf.Operation 'logit/xw_plus_b' type=BiasAdd>, <tf.Operation 'logit/Softmax' type=Softmax>, <tf.Operation 'costs/Rank' type=Const>, <tf.Operation 'costs/Shape' type=Shape>, <tf.Operation 'costs/Rank_1' type=Const>, <tf.Operation 'costs/Shape_1' type=Shape>, <tf.Operation 'costs/Sub/y' type=Const>, <tf.Operation 'costs/Sub' type=Sub>, <tf.Operation 'costs/Slice/begin' type=Pack>, <tf.Operation 'costs/Slice/size' type=Const>, <tf.Operation 'costs/Slice' type=Slice>, <tf.Operation 'costs/concat/values_0' type=Const>, <tf.Operation 'costs/concat/axis' type=Const>, <tf.Operation 'costs/concat' type=ConcatV2>, <tf.Operation 'costs/Reshape' type=Reshape>, <tf.Operation 'costs/Rank_2' type=Const>, <tf.Operation 'costs/Shape_2' type=Shape>, <tf.Operation 'costs/Sub_1/y' type=Const>, <tf.Operation 'costs/Sub_1' type=Sub>, <tf.Operation 'costs/Slice_1/begin' type=Pack>, <tf.Operation 'costs/Slice_1/size' type=Const>, <tf.Operation 'costs/Slice_1' type=Slice>, <tf.Operation 'costs/concat_1/values_0' type=Const>, <tf.Operation 'costs/concat_1/axis' type=Const>, <tf.Operation 'costs/concat_1' type=ConcatV2>, <tf.Operation 'costs/Reshape_1' type=Reshape>, <tf.Operation 'costs/SoftmaxCrossEntropyWithLogits' type=SoftmaxCrossEntropyWithLogits>, <tf.Operation 'costs/Sub_2/y' type=Const>, <tf.Operation 'costs/Sub_2' type=Sub>, <tf.Operation 'costs/Slice_2/begin' type=Const>, <tf.Operation 'costs/Slice_2/size' type=Pack>, <tf.Operation 'costs/Slice_2' type=Slice>, <tf.Operation 'costs/Reshape_2' type=Reshape>, <tf.Operation 'costs/Const' type=Const>, <tf.Operation 'costs/xent' type=Mean>, <tf.Operation 'costs/L2Loss' type=L2Loss>, <tf.Operation 'costs/L2Loss_1' type=L2Loss>, <tf.Operation 'costs/L2Loss_2' type=L2Loss>, <tf.Operation 'costs/L2Loss_3' type=L2Loss>, <tf.Operation 'costs/L2Loss_4' type=L2Loss>, <tf.Operation 'costs/L2Loss_5' type=L2Loss>, <tf.Operation 'costs/L2Loss_6' type=L2Loss>, <tf.Operation 'costs/L2Loss_7' type=L2Loss>, <tf.Operation 'costs/L2Loss_8' type=L2Loss>, <tf.Operation 'costs/L2Loss_9' type=L2Loss>, <tf.Operation 'costs/L2Loss_10' type=L2Loss>, <tf.Operation 'costs/L2Loss_11' type=L2Loss>, <tf.Operation 'costs/L2Loss_12' type=L2Loss>, <tf.Operation 'costs/L2Loss_13' type=L2Loss>, <tf.Operation 'costs/L2Loss_14' type=L2Loss>, <tf.Operation 'costs/L2Loss_15' type=L2Loss>, <tf.Operation 'costs/L2Loss_16' type=L2Loss>, <tf.Operation 'costs/L2Loss_17' type=L2Loss>, <tf.Operation 'costs/L2Loss_18' type=L2Loss>, <tf.Operation 'costs/L2Loss_19' type=L2Loss>, <tf.Operation 'costs/L2Loss_20' type=L2Loss>, <tf.Operation 'costs/L2Loss_21' type=L2Loss>, <tf.Operation 'costs/L2Loss_22' type=L2Loss>, <tf.Operation 'costs/L2Loss_23' type=L2Loss>, <tf.Operation 'costs/L2Loss_24' type=L2Loss>, <tf.Operation 'costs/L2Loss_25' type=L2Loss>, <tf.Operation 'costs/L2Loss_26' type=L2Loss>, <tf.Operation 'costs/L2Loss_27' type=L2Loss>, <tf.Operation 'costs/L2Loss_28' type=L2Loss>, <tf.Operation 'costs/L2Loss_29' type=L2Loss>, <tf.Operation 'costs/L2Loss_30' type=L2Loss>, <tf.Operation 'costs/L2Loss_31' type=L2Loss>, <tf.Operation 'costs/AddN' type=AddN>, <tf.Operation 'costs/Mul/x' type=Const>, <tf.Operation 'costs/Mul' type=Mul>, <tf.Operation 'costs/add' type=Add>, <tf.Operation 'costs/cost/tags' type=Const>, <tf.Operation 'costs/cost' type=ScalarSummary>, <tf.Operation 'Const' type=Const>, <tf.Operation 'learning_rate/tags' type=Const>, <tf.Operation 'learning_rate' type=ScalarSummary>, <tf.Operation 'gradients/Shape' type=Const>, <tf.Operation 'gradients/Const' type=Const>, <tf.Operation 'gradients/Fill' type=Fill>, <tf.Operation 'gradients/costs/add_grad/Shape' type=Const>, <tf.Operation 'gradients/costs/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/costs/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/costs/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/costs/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/costs/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/costs/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/costs/xent_grad/Reshape/shape' type=Const>, <tf.Operation 'gradients/costs/xent_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/costs/xent_grad/Shape' type=Shape>, <tf.Operation 'gradients/costs/xent_grad/Tile' type=Tile>, <tf.Operation 'gradients/costs/xent_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/costs/xent_grad/Shape_2' type=Const>, <tf.Operation 'gradients/costs/xent_grad/Const' type=Const>, <tf.Operation 'gradients/costs/xent_grad/Prod' type=Prod>, <tf.Operation 'gradients/costs/xent_grad/Const_1' type=Const>, <tf.Operation 'gradients/costs/xent_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/costs/xent_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/costs/xent_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/costs/xent_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/costs/xent_grad/Cast' type=Cast>, <tf.Operation 'gradients/costs/xent_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/costs/Mul_grad/Shape' type=Const>, <tf.Operation 'gradients/costs/Mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/costs/Mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/costs/Mul_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/Mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/costs/Mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/costs/Mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/costs/Mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/costs/Mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/costs/Reshape_2_grad/Shape' type=Shape>, <tf.Operation 'gradients/costs/Reshape_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/costs/SoftmaxCrossEntropyWithLogits_grad/ExpandDims/dim' type=Const>, <tf.Operation 'gradients/costs/SoftmaxCrossEntropyWithLogits_grad/ExpandDims' type=ExpandDims>, <tf.Operation 'gradients/costs/SoftmaxCrossEntropyWithLogits_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_1_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_2_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_3_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_4_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_5_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_6_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_7_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_8_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_9_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_10_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_11_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_12_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_13_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_14_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_15_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_16_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_17_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_18_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_19_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_20_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_21_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_22_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_23_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_24_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_25_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_26_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_27_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_28_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_29_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_30_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/L2Loss_31_grad/mul' type=Mul>, <tf.Operation 'gradients/costs/Reshape_grad/Shape' type=Shape>, <tf.Operation 'gradients/costs/Reshape_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/logit/xw_plus_b_grad/BiasAddGrad' type=BiasAddGrad>, <tf.Operation 'gradients/logit/xw_plus_b/MatMul_grad/MatMul' type=MatMul>, <tf.Operation 'gradients/logit/xw_plus_b/MatMul_grad/MatMul_1' type=MatMul>, <tf.Operation 'gradients/logit/Reshape_grad/Shape' type=Shape>, <tf.Operation 'gradients/logit/Reshape_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN' type=AddN>, <tf.Operation 'gradients/unit_last/Mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_last/Mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_last/Mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_last/Mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_last/Mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_last/Mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_last/Mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_last/Mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_last/Mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_last/Mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_last/Mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_last/Mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_last/Mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_last/Mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_last/Mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_last/Mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_last/Mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_last/Mean_grad/Shape_3' type=Shape>, <tf.Operation 'gradients/unit_last/Mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_last/Mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_last/Mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_last/Mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_last/Mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_last/Mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_last/Mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_last/Mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_last/Mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_last/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_last/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_last/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/unit_last/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_last/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_last/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_last/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_last/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_last/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_last/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_last/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_last/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_1' type=AddN>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_2' type=AddN>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_last/final_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_last/final_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_last/final_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_last/final_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_last/final_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_last/final_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_last/final_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_last/final_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_last/final_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_last/final_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_last/final_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_3' type=AddN>, <tf.Operation 'gradients/unit_3_4/sub_add/add_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_4/sub_add/add_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_3_4/sub_add/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/sub_add/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub_add/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub_add/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub_add/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/conv2/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_3_4/sub2/conv2/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_3_4/sub2/conv2/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_3_4/sub2/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_3_4/sub2/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_3_4/sub2/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_4' type=AddN>, <tf.Operation 'gradients/unit_3_4/sub2/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_3_4/sub2/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/sub2/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_4/sub2/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_4/sub2/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_5' type=AddN>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_6' type=AddN>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_4/sub2/bn2/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_7' type=AddN>, <tf.Operation 'gradients/unit_3_4/sub1/conv1/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_3_4/sub1/conv1/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_3_4/sub1/conv1/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_8' type=AddN>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_9' type=AddN>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_10' type=AddN>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_4/residual_only_activation/init_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_11' type=AddN>, <tf.Operation 'gradients/unit_3_3/sub_add/add_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_3/sub_add/add_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_3_3/sub_add/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/sub_add/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub_add/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub_add/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub_add/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/conv2/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_3_3/sub2/conv2/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_3_3/sub2/conv2/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_3_3/sub2/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_3_3/sub2/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_3_3/sub2/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_12' type=AddN>, <tf.Operation 'gradients/unit_3_3/sub2/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_3_3/sub2/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/sub2/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_3/sub2/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_3/sub2/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_13' type=AddN>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_14' type=AddN>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_3/sub2/bn2/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_15' type=AddN>, <tf.Operation 'gradients/unit_3_3/sub1/conv1/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_3_3/sub1/conv1/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_3_3/sub1/conv1/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_16' type=AddN>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_17' type=AddN>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_18' type=AddN>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_3/residual_only_activation/init_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_19' type=AddN>, <tf.Operation 'gradients/unit_3_2/sub_add/add_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_2/sub_add/add_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_3_2/sub_add/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/sub_add/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub_add/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub_add/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub_add/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/conv2/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_3_2/sub2/conv2/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_3_2/sub2/conv2/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_3_2/sub2/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_3_2/sub2/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_3_2/sub2/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_20' type=AddN>, <tf.Operation 'gradients/unit_3_2/sub2/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_3_2/sub2/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/sub2/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_2/sub2/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_2/sub2/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_21' type=AddN>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_22' type=AddN>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_2/sub2/bn2/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_23' type=AddN>, <tf.Operation 'gradients/unit_3_2/sub1/conv1/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_3_2/sub1/conv1/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_3_2/sub1/conv1/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_24' type=AddN>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_25' type=AddN>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_26' type=AddN>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_2/residual_only_activation/init_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_27' type=AddN>, <tf.Operation 'gradients/unit_3_1/sub_add/add_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_1/sub_add/add_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_3_1/sub_add/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/sub_add/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub_add/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub_add/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub_add/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/conv2/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_3_1/sub2/conv2/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_3_1/sub2/conv2/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_3_1/sub2/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_3_1/sub2/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_3_1/sub2/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_28' type=AddN>, <tf.Operation 'gradients/unit_3_1/sub2/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_3_1/sub2/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/sub2/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_1/sub2/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_1/sub2/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_29' type=AddN>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_30' type=AddN>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_1/sub2/bn2/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_31' type=AddN>, <tf.Operation 'gradients/unit_3_1/sub1/conv1/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_3_1/sub1/conv1/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_3_1/sub1/conv1/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_32' type=AddN>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_33' type=AddN>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_34' type=AddN>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_1/residual_only_activation/init_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_35' type=AddN>, <tf.Operation 'gradients/unit_3_0/sub_add/add_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_0/sub_add/add_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_3_0/sub_add/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/sub_add/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub_add/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub_add/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub_add/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/conv2/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_3_0/sub2/conv2/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_3_0/sub2/conv2/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_3_0/sub_add/Pad_grad/Rank' type=Const>, <tf.Operation 'gradients/unit_3_0/sub_add/Pad_grad/stack/1' type=Const>, <tf.Operation 'gradients/unit_3_0/sub_add/Pad_grad/stack' type=Pack>, <tf.Operation 'gradients/unit_3_0/sub_add/Pad_grad/Slice/begin' type=Const>, <tf.Operation 'gradients/unit_3_0/sub_add/Pad_grad/Slice' type=Slice>, <tf.Operation 'gradients/unit_3_0/sub_add/Pad_grad/Reshape/shape' type=Const>, <tf.Operation 'gradients/unit_3_0/sub_add/Pad_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub_add/Pad_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_0/sub_add/Pad_grad/Slice_1' type=Slice>, <tf.Operation 'gradients/unit_3_0/sub2/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_3_0/sub2/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_3_0/sub2/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_36' type=AddN>, <tf.Operation 'gradients/unit_3_0/sub_add/AvgPool_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_0/sub_add/AvgPool_grad/AvgPoolGrad' type=AvgPoolGrad>, <tf.Operation 'gradients/unit_3_0/sub2/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_3_0/sub2/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/sub2/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_0/sub2/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_0/sub2/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_37' type=AddN>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_38' type=AddN>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_0/sub2/bn2/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_39' type=AddN>, <tf.Operation 'gradients/unit_3_0/sub1/conv1/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_3_0/sub1/conv1/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_3_0/sub1/conv1/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_40' type=AddN>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_41' type=AddN>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_42' type=AddN>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_3_0/residual_only_activation/init_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_43' type=AddN>, <tf.Operation 'gradients/unit_2_4/sub_add/add_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_4/sub_add/add_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_2_4/sub_add/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/sub_add/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub_add/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub_add/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub_add/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/conv2/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_2_4/sub2/conv2/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_2_4/sub2/conv2/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_2_4/sub2/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_2_4/sub2/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_2_4/sub2/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_44' type=AddN>, <tf.Operation 'gradients/unit_2_4/sub2/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_2_4/sub2/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/sub2/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_4/sub2/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_4/sub2/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_45' type=AddN>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_46' type=AddN>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_4/sub2/bn2/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_47' type=AddN>, <tf.Operation 'gradients/unit_2_4/sub1/conv1/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_2_4/sub1/conv1/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_2_4/sub1/conv1/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_48' type=AddN>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_49' type=AddN>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_50' type=AddN>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_4/residual_only_activation/init_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_51' type=AddN>, <tf.Operation 'gradients/unit_2_3/sub_add/add_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_3/sub_add/add_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_2_3/sub_add/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/sub_add/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub_add/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub_add/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub_add/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/conv2/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_2_3/sub2/conv2/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_2_3/sub2/conv2/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_2_3/sub2/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_2_3/sub2/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_2_3/sub2/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_52' type=AddN>, <tf.Operation 'gradients/unit_2_3/sub2/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_2_3/sub2/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/sub2/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_3/sub2/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_3/sub2/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_53' type=AddN>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_54' type=AddN>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_3/sub2/bn2/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_55' type=AddN>, <tf.Operation 'gradients/unit_2_3/sub1/conv1/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_2_3/sub1/conv1/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_2_3/sub1/conv1/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_56' type=AddN>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_57' type=AddN>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_58' type=AddN>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_3/residual_only_activation/init_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_59' type=AddN>, <tf.Operation 'gradients/unit_2_2/sub_add/add_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_2/sub_add/add_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_2_2/sub_add/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/sub_add/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub_add/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub_add/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub_add/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/conv2/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_2_2/sub2/conv2/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_2_2/sub2/conv2/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_2_2/sub2/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_2_2/sub2/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_2_2/sub2/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_60' type=AddN>, <tf.Operation 'gradients/unit_2_2/sub2/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_2_2/sub2/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/sub2/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_2/sub2/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_2/sub2/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_61' type=AddN>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_62' type=AddN>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_2/sub2/bn2/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_63' type=AddN>, <tf.Operation 'gradients/unit_2_2/sub1/conv1/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_2_2/sub1/conv1/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_2_2/sub1/conv1/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_64' type=AddN>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_65' type=AddN>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_66' type=AddN>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_2/residual_only_activation/init_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_67' type=AddN>, <tf.Operation 'gradients/unit_2_1/sub_add/add_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_1/sub_add/add_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_2_1/sub_add/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/sub_add/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub_add/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub_add/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub_add/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/conv2/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_2_1/sub2/conv2/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_2_1/sub2/conv2/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_2_1/sub2/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_2_1/sub2/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_2_1/sub2/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_68' type=AddN>, <tf.Operation 'gradients/unit_2_1/sub2/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_2_1/sub2/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/sub2/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_1/sub2/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_1/sub2/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_69' type=AddN>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_70' type=AddN>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_1/sub2/bn2/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_71' type=AddN>, <tf.Operation 'gradients/unit_2_1/sub1/conv1/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_2_1/sub1/conv1/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_2_1/sub1/conv1/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_72' type=AddN>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_73' type=AddN>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_74' type=AddN>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_1/residual_only_activation/init_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_75' type=AddN>, <tf.Operation 'gradients/unit_2_0/sub_add/add_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_0/sub_add/add_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_2_0/sub_add/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/sub_add/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub_add/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub_add/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub_add/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/conv2/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_2_0/sub2/conv2/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_2_0/sub2/conv2/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_2_0/sub_add/Pad_grad/Rank' type=Const>, <tf.Operation 'gradients/unit_2_0/sub_add/Pad_grad/stack/1' type=Const>, <tf.Operation 'gradients/unit_2_0/sub_add/Pad_grad/stack' type=Pack>, <tf.Operation 'gradients/unit_2_0/sub_add/Pad_grad/Slice/begin' type=Const>, <tf.Operation 'gradients/unit_2_0/sub_add/Pad_grad/Slice' type=Slice>, <tf.Operation 'gradients/unit_2_0/sub_add/Pad_grad/Reshape/shape' type=Const>, <tf.Operation 'gradients/unit_2_0/sub_add/Pad_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub_add/Pad_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_0/sub_add/Pad_grad/Slice_1' type=Slice>, <tf.Operation 'gradients/unit_2_0/sub2/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_2_0/sub2/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_2_0/sub2/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_76' type=AddN>, <tf.Operation 'gradients/unit_2_0/sub_add/AvgPool_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_0/sub_add/AvgPool_grad/AvgPoolGrad' type=AvgPoolGrad>, <tf.Operation 'gradients/unit_2_0/sub2/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_2_0/sub2/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/sub2/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_0/sub2/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_0/sub2/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_77' type=AddN>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_78' type=AddN>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_0/sub2/bn2/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_79' type=AddN>, <tf.Operation 'gradients/unit_2_0/sub1/conv1/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_2_0/sub1/conv1/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_2_0/sub1/conv1/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_80' type=AddN>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_81' type=AddN>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_82' type=AddN>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_2_0/residual_only_activation/init_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_83' type=AddN>, <tf.Operation 'gradients/unit_1_4/sub_add/add_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_4/sub_add/add_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_1_4/sub_add/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/sub_add/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub_add/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub_add/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub_add/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/conv2/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_1_4/sub2/conv2/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_1_4/sub2/conv2/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_1_4/sub2/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_1_4/sub2/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_1_4/sub2/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_84' type=AddN>, <tf.Operation 'gradients/unit_1_4/sub2/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_1_4/sub2/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/sub2/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_4/sub2/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_4/sub2/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_85' type=AddN>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_86' type=AddN>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_4/sub2/bn2/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_87' type=AddN>, <tf.Operation 'gradients/unit_1_4/sub1/conv1/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_1_4/sub1/conv1/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_1_4/sub1/conv1/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_88' type=AddN>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_89' type=AddN>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_90' type=AddN>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_4/residual_only_activation/init_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_91' type=AddN>, <tf.Operation 'gradients/unit_1_3/sub_add/add_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_3/sub_add/add_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_1_3/sub_add/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/sub_add/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub_add/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub_add/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub_add/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/conv2/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_1_3/sub2/conv2/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_1_3/sub2/conv2/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_1_3/sub2/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_1_3/sub2/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_1_3/sub2/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_92' type=AddN>, <tf.Operation 'gradients/unit_1_3/sub2/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_1_3/sub2/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/sub2/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_3/sub2/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_3/sub2/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_93' type=AddN>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_94' type=AddN>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_3/sub2/bn2/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_95' type=AddN>, <tf.Operation 'gradients/unit_1_3/sub1/conv1/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_1_3/sub1/conv1/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_1_3/sub1/conv1/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_96' type=AddN>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_97' type=AddN>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_98' type=AddN>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_3/residual_only_activation/init_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_99' type=AddN>, <tf.Operation 'gradients/unit_1_2/sub_add/add_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_2/sub_add/add_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_1_2/sub_add/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/sub_add/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub_add/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub_add/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub_add/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/conv2/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_1_2/sub2/conv2/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_1_2/sub2/conv2/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_1_2/sub2/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_1_2/sub2/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_1_2/sub2/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_100' type=AddN>, <tf.Operation 'gradients/unit_1_2/sub2/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_1_2/sub2/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/sub2/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_2/sub2/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_2/sub2/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_101' type=AddN>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_102' type=AddN>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_2/sub2/bn2/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_103' type=AddN>, <tf.Operation 'gradients/unit_1_2/sub1/conv1/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_1_2/sub1/conv1/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_1_2/sub1/conv1/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_104' type=AddN>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_105' type=AddN>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_106' type=AddN>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_2/residual_only_activation/init_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_107' type=AddN>, <tf.Operation 'gradients/unit_1_1/sub_add/add_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_1/sub_add/add_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_1_1/sub_add/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/sub_add/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub_add/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub_add/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub_add/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/conv2/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_1_1/sub2/conv2/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_1_1/sub2/conv2/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_1_1/sub2/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_1_1/sub2/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_1_1/sub2/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_108' type=AddN>, <tf.Operation 'gradients/unit_1_1/sub2/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_1_1/sub2/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/sub2/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_1/sub2/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_1/sub2/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_109' type=AddN>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_110' type=AddN>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_1/sub2/bn2/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_111' type=AddN>, <tf.Operation 'gradients/unit_1_1/sub1/conv1/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_1_1/sub1/conv1/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_1_1/sub1/conv1/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_112' type=AddN>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_113' type=AddN>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_114' type=AddN>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_1/residual_only_activation/init_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_115' type=AddN>, <tf.Operation 'gradients/unit_1_0/sub_add/add_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_0/sub_add/add_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_1_0/sub_add/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/sub_add/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub_add/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub_add/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub_add/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/conv2/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_1_0/sub2/conv2/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_1_0/sub2/conv2/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/unit_1_0/sub2/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_1_0/sub2/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_1_0/sub2/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_116' type=AddN>, <tf.Operation 'gradients/unit_1_0/sub2/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_1_0/sub2/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/sub2/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_0/sub2/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_0/sub2/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_117' type=AddN>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_118' type=AddN>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_0/sub2/bn2/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_119' type=AddN>, <tf.Operation 'gradients/unit_1_0/sub1/conv1/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/unit_1_0/sub1/conv1/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/unit_1_0/sub1/conv1/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/AddN_120' type=AddN>, <tf.Operation 'gradients/unit_1_0/shared_activation/leaky_relu_grad/zeros_like' type=ZerosLike>, <tf.Operation 'gradients/unit_1_0/shared_activation/leaky_relu_grad/Select' type=Select>, <tf.Operation 'gradients/unit_1_0/shared_activation/leaky_relu_grad/Select_1' type=Select>, <tf.Operation 'gradients/AddN_121' type=AddN>, <tf.Operation 'gradients/unit_1_0/shared_activation/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/mul_grad/Shape_1' type=Shape>, <tf.Operation 'gradients/unit_1_0/shared_activation/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/shared_activation/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_0/shared_activation/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_0/shared_activation/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/AddN_122' type=AddN>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/add_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/add_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/add_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/add_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/add_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/add_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/add_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_1_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_1_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_1_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_1_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_1_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_1_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_1_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_1_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/sub_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/sub_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/sub_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/sub_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/sub_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/sub_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/sub_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/sub_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_2_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_2_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_2_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_2_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_2_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_2_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_2_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_2_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_2_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/Squeeze_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/Squeeze_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/AddN_123' type=AddN>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/mul_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/Rsqrt_grad/RsqrtGrad' type=RsqrtGrad>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/add_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/add_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/add_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/add_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/add_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/add_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/batchnorm/add_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/Squeeze_1_grad/Shape' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/Squeeze_1_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/variance_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/SquaredDifference_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/SquaredDifference_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/SquaredDifference_grad/BroadcastGradientArgs' type=BroadcastGradientArgs>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/SquaredDifference_grad/scalar' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/SquaredDifference_grad/mul' type=Mul>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/SquaredDifference_grad/sub' type=Sub>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/SquaredDifference_grad/mul_1' type=Mul>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/SquaredDifference_grad/Sum' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/SquaredDifference_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/SquaredDifference_grad/Sum_1' type=Sum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/SquaredDifference_grad/Reshape_1' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/SquaredDifference_grad/Neg' type=Neg>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Shape' type=Shape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Size' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/add' type=Add>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/mod' type=FloorMod>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Shape_1' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/range/start' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/range/delta' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/range' type=Range>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Fill/value' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Fill' type=Fill>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/DynamicStitch' type=DynamicStitch>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Maximum/y' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Maximum' type=Maximum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/floordiv' type=FloorDiv>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Reshape' type=Reshape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Tile' type=Tile>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Shape_2' type=Shape>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Shape_3' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Const' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Prod' type=Prod>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Const_1' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Prod_1' type=Prod>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Maximum_1/y' type=Const>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Maximum_1' type=Maximum>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/floordiv_1' type=FloorDiv>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/Cast' type=Cast>, <tf.Operation 'gradients/unit_1_0/shared_activation/init_bn/moments/mean_grad/truediv' type=RealDiv>, <tf.Operation 'gradients/AddN_124' type=AddN>, <tf.Operation 'gradients/init/init_conv/Conv2D_grad/ShapeN' type=ShapeN>, <tf.Operation 'gradients/init/init_conv/Conv2D_grad/Conv2DBackpropInput' type=Conv2DBackpropInput>, <tf.Operation 'gradients/init/init_conv/Conv2D_grad/Conv2DBackpropFilter' type=Conv2DBackpropFilter>, <tf.Operation 'gradients/AddN_125' type=AddN>, <tf.Operation 'train_step/update_init/init_conv/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_0/shared_activation/init_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_0/shared_activation/init_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_0/sub1/conv1/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_0/sub2/bn2/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_0/sub2/bn2/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_0/sub2/conv2/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_1/residual_only_activation/init_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_1/residual_only_activation/init_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_1/sub1/conv1/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_1/sub2/bn2/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_1/sub2/bn2/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_1/sub2/conv2/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_2/residual_only_activation/init_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_2/residual_only_activation/init_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_2/sub1/conv1/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_2/sub2/bn2/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_2/sub2/bn2/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_2/sub2/conv2/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_3/residual_only_activation/init_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_3/residual_only_activation/init_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_3/sub1/conv1/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_3/sub2/bn2/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_3/sub2/bn2/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_3/sub2/conv2/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_4/residual_only_activation/init_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_4/residual_only_activation/init_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_4/sub1/conv1/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_4/sub2/bn2/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_4/sub2/bn2/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_1_4/sub2/conv2/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_0/residual_only_activation/init_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_0/residual_only_activation/init_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_0/sub1/conv1/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_0/sub2/bn2/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_0/sub2/bn2/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_0/sub2/conv2/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_1/residual_only_activation/init_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_1/residual_only_activation/init_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_1/sub1/conv1/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_1/sub2/bn2/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_1/sub2/bn2/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_1/sub2/conv2/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_2/residual_only_activation/init_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_2/residual_only_activation/init_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_2/sub1/conv1/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_2/sub2/bn2/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_2/sub2/bn2/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_2/sub2/conv2/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_3/residual_only_activation/init_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_3/residual_only_activation/init_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_3/sub1/conv1/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_3/sub2/bn2/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_3/sub2/bn2/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_3/sub2/conv2/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_4/residual_only_activation/init_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_4/residual_only_activation/init_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_4/sub1/conv1/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_4/sub2/bn2/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_4/sub2/bn2/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_2_4/sub2/conv2/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_0/residual_only_activation/init_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_0/residual_only_activation/init_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_0/sub1/conv1/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_0/sub2/bn2/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_0/sub2/bn2/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_0/sub2/conv2/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_1/residual_only_activation/init_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_1/residual_only_activation/init_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_1/sub1/conv1/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_1/sub2/bn2/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_1/sub2/bn2/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_1/sub2/conv2/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_2/residual_only_activation/init_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_2/residual_only_activation/init_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_2/sub1/conv1/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_2/sub2/bn2/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_2/sub2/bn2/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_2/sub2/conv2/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_3/residual_only_activation/init_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_3/residual_only_activation/init_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_3/sub1/conv1/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_3/sub2/bn2/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_3/sub2/bn2/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_3/sub2/conv2/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_4/residual_only_activation/init_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_4/residual_only_activation/init_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_4/sub1/conv1/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_4/sub2/bn2/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_4/sub2/bn2/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_3_4/sub2/conv2/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_last/final_bn/beta/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_unit_last/final_bn/gamma/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_logit/DW/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step/update_logit/biases/ApplyGradientDescent' type=ApplyGradientDescent>, <tf.Operation 'train_step' type=NoOp>, <tf.Operation 'group_deps' type=NoOp>, <tf.Operation 'Merge/MergeSummary' type=MergeSummary>, <tf.Operation 'ArgMax/dimension' type=Const>, <tf.Operation 'ArgMax' type=ArgMax>, <tf.Operation 'ArgMax_1/dimension' type=Const>, <tf.Operation 'ArgMax_1' type=ArgMax>, <tf.Operation 'Equal' type=Equal>, <tf.Operation 'ToFloat' type=Cast>, <tf.Operation 'Const_1' type=Const>, <tf.Operation 'Mean' type=Mean>, <tf.Operation 'Precision/tags' type=Const>, <tf.Operation 'Precision' type=ScalarSummary>, <tf.Operation 'Merge_1/MergeSummary' type=MergeSummary>, <tf.Operation 'save/Const' type=Const>, <tf.Operation 'save/SaveV2/tensor_names' type=Const>, <tf.Operation 'save/SaveV2/shape_and_slices' type=Const>, <tf.Operation 'save/SaveV2' type=SaveV2>, <tf.Operation 'save/control_dependency' type=Identity>, <tf.Operation 'save/RestoreV2/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2' type=RestoreV2>, <tf.Operation 'save/Assign' type=Assign>, <tf.Operation 'save/RestoreV2_1/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_1/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_1' type=RestoreV2>, <tf.Operation 'save/Assign_1' type=Assign>, <tf.Operation 'save/RestoreV2_2/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_2/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_2' type=RestoreV2>, <tf.Operation 'save/Assign_2' type=Assign>, <tf.Operation 'save/RestoreV2_3/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_3/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_3' type=RestoreV2>, <tf.Operation 'save/Assign_3' type=Assign>, <tf.Operation 'save/RestoreV2_4/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_4/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_4' type=RestoreV2>, <tf.Operation 'save/Assign_4' type=Assign>, <tf.Operation 'save/RestoreV2_5/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_5/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_5' type=RestoreV2>, <tf.Operation 'save/Assign_5' type=Assign>, <tf.Operation 'save/RestoreV2_6/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_6/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_6' type=RestoreV2>, <tf.Operation 'save/Assign_6' type=Assign>, <tf.Operation 'save/RestoreV2_7/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_7/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_7' type=RestoreV2>, <tf.Operation 'save/Assign_7' type=Assign>, <tf.Operation 'save/RestoreV2_8/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_8/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_8' type=RestoreV2>, <tf.Operation 'save/Assign_8' type=Assign>, <tf.Operation 'save/RestoreV2_9/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_9/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_9' type=RestoreV2>, <tf.Operation 'save/Assign_9' type=Assign>, <tf.Operation 'save/RestoreV2_10/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_10/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_10' type=RestoreV2>, <tf.Operation 'save/Assign_10' type=Assign>, <tf.Operation 'save/RestoreV2_11/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_11/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_11' type=RestoreV2>, <tf.Operation 'save/Assign_11' type=Assign>, <tf.Operation 'save/RestoreV2_12/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_12/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_12' type=RestoreV2>, <tf.Operation 'save/Assign_12' type=Assign>, <tf.Operation 'save/RestoreV2_13/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_13/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_13' type=RestoreV2>, <tf.Operation 'save/Assign_13' type=Assign>, <tf.Operation 'save/RestoreV2_14/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_14/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_14' type=RestoreV2>, <tf.Operation 'save/Assign_14' type=Assign>, <tf.Operation 'save/RestoreV2_15/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_15/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_15' type=RestoreV2>, <tf.Operation 'save/Assign_15' type=Assign>, <tf.Operation 'save/RestoreV2_16/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_16/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_16' type=RestoreV2>, <tf.Operation 'save/Assign_16' type=Assign>, <tf.Operation 'save/RestoreV2_17/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_17/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_17' type=RestoreV2>, <tf.Operation 'save/Assign_17' type=Assign>, <tf.Operation 'save/RestoreV2_18/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_18/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_18' type=RestoreV2>, <tf.Operation 'save/Assign_18' type=Assign>, <tf.Operation 'save/RestoreV2_19/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_19/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_19' type=RestoreV2>, <tf.Operation 'save/Assign_19' type=Assign>, <tf.Operation 'save/RestoreV2_20/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_20/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_20' type=RestoreV2>, <tf.Operation 'save/Assign_20' type=Assign>, <tf.Operation 'save/RestoreV2_21/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_21/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_21' type=RestoreV2>, <tf.Operation 'save/Assign_21' type=Assign>, <tf.Operation 'save/RestoreV2_22/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_22/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_22' type=RestoreV2>, <tf.Operation 'save/Assign_22' type=Assign>, <tf.Operation 'save/RestoreV2_23/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_23/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_23' type=RestoreV2>, <tf.Operation 'save/Assign_23' type=Assign>, <tf.Operation 'save/RestoreV2_24/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_24/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_24' type=RestoreV2>, <tf.Operation 'save/Assign_24' type=Assign>, <tf.Operation 'save/RestoreV2_25/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_25/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_25' type=RestoreV2>, <tf.Operation 'save/Assign_25' type=Assign>, <tf.Operation 'save/RestoreV2_26/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_26/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_26' type=RestoreV2>, <tf.Operation 'save/Assign_26' type=Assign>, <tf.Operation 'save/RestoreV2_27/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_27/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_27' type=RestoreV2>, <tf.Operation 'save/Assign_27' type=Assign>, <tf.Operation 'save/RestoreV2_28/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_28/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_28' type=RestoreV2>, <tf.Operation 'save/Assign_28' type=Assign>, <tf.Operation 'save/RestoreV2_29/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_29/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_29' type=RestoreV2>, <tf.Operation 'save/Assign_29' type=Assign>, <tf.Operation 'save/RestoreV2_30/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_30/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_30' type=RestoreV2>, <tf.Operation 'save/Assign_30' type=Assign>, <tf.Operation 'save/RestoreV2_31/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_31/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_31' type=RestoreV2>, <tf.Operation 'save/Assign_31' type=Assign>, <tf.Operation 'save/RestoreV2_32/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_32/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_32' type=RestoreV2>, <tf.Operation 'save/Assign_32' type=Assign>, <tf.Operation 'save/RestoreV2_33/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_33/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_33' type=RestoreV2>, <tf.Operation 'save/Assign_33' type=Assign>, <tf.Operation 'save/RestoreV2_34/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_34/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_34' type=RestoreV2>, <tf.Operation 'save/Assign_34' type=Assign>, <tf.Operation 'save/RestoreV2_35/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_35/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_35' type=RestoreV2>, <tf.Operation 'save/Assign_35' type=Assign>, <tf.Operation 'save/RestoreV2_36/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_36/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_36' type=RestoreV2>, <tf.Operation 'save/Assign_36' type=Assign>, <tf.Operation 'save/RestoreV2_37/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_37/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_37' type=RestoreV2>, <tf.Operation 'save/Assign_37' type=Assign>, <tf.Operation 'save/RestoreV2_38/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_38/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_38' type=RestoreV2>, <tf.Operation 'save/Assign_38' type=Assign>, <tf.Operation 'save/RestoreV2_39/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_39/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_39' type=RestoreV2>, <tf.Operation 'save/Assign_39' type=Assign>, <tf.Operation 'save/RestoreV2_40/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_40/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_40' type=RestoreV2>, <tf.Operation 'save/Assign_40' type=Assign>, <tf.Operation 'save/RestoreV2_41/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_41/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_41' type=RestoreV2>, <tf.Operation 'save/Assign_41' type=Assign>, <tf.Operation 'save/RestoreV2_42/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_42/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_42' type=RestoreV2>, <tf.Operation 'save/Assign_42' type=Assign>, <tf.Operation 'save/RestoreV2_43/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_43/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_43' type=RestoreV2>, <tf.Operation 'save/Assign_43' type=Assign>, <tf.Operation 'save/RestoreV2_44/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_44/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_44' type=RestoreV2>, <tf.Operation 'save/Assign_44' type=Assign>, <tf.Operation 'save/RestoreV2_45/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_45/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_45' type=RestoreV2>, <tf.Operation 'save/Assign_45' type=Assign>, <tf.Operation 'save/RestoreV2_46/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_46/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_46' type=RestoreV2>, <tf.Operation 'save/Assign_46' type=Assign>, <tf.Operation 'save/RestoreV2_47/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_47/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_47' type=RestoreV2>, <tf.Operation 'save/Assign_47' type=Assign>, <tf.Operation 'save/RestoreV2_48/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_48/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_48' type=RestoreV2>, <tf.Operation 'save/Assign_48' type=Assign>, <tf.Operation 'save/RestoreV2_49/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_49/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_49' type=RestoreV2>, <tf.Operation 'save/Assign_49' type=Assign>, <tf.Operation 'save/RestoreV2_50/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_50/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_50' type=RestoreV2>, <tf.Operation 'save/Assign_50' type=Assign>, <tf.Operation 'save/RestoreV2_51/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_51/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_51' type=RestoreV2>, <tf.Operation 'save/Assign_51' type=Assign>, <tf.Operation 'save/RestoreV2_52/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_52/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_52' type=RestoreV2>, <tf.Operation 'save/Assign_52' type=Assign>, <tf.Operation 'save/RestoreV2_53/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_53/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_53' type=RestoreV2>, <tf.Operation 'save/Assign_53' type=Assign>, <tf.Operation 'save/RestoreV2_54/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_54/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_54' type=RestoreV2>, <tf.Operation 'save/Assign_54' type=Assign>, <tf.Operation 'save/RestoreV2_55/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_55/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_55' type=RestoreV2>, <tf.Operation 'save/Assign_55' type=Assign>, <tf.Operation 'save/RestoreV2_56/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_56/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_56' type=RestoreV2>, <tf.Operation 'save/Assign_56' type=Assign>, <tf.Operation 'save/RestoreV2_57/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_57/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_57' type=RestoreV2>, <tf.Operation 'save/Assign_57' type=Assign>, <tf.Operation 'save/RestoreV2_58/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_58/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_58' type=RestoreV2>, <tf.Operation 'save/Assign_58' type=Assign>, <tf.Operation 'save/RestoreV2_59/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_59/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_59' type=RestoreV2>, <tf.Operation 'save/Assign_59' type=Assign>, <tf.Operation 'save/RestoreV2_60/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_60/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_60' type=RestoreV2>, <tf.Operation 'save/Assign_60' type=Assign>, <tf.Operation 'save/RestoreV2_61/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_61/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_61' type=RestoreV2>, <tf.Operation 'save/Assign_61' type=Assign>, <tf.Operation 'save/RestoreV2_62/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_62/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_62' type=RestoreV2>, <tf.Operation 'save/Assign_62' type=Assign>, <tf.Operation 'save/RestoreV2_63/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_63/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_63' type=RestoreV2>, <tf.Operation 'save/Assign_63' type=Assign>, <tf.Operation 'save/RestoreV2_64/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_64/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_64' type=RestoreV2>, <tf.Operation 'save/Assign_64' type=Assign>, <tf.Operation 'save/RestoreV2_65/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_65/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_65' type=RestoreV2>, <tf.Operation 'save/Assign_65' type=Assign>, <tf.Operation 'save/RestoreV2_66/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_66/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_66' type=RestoreV2>, <tf.Operation 'save/Assign_66' type=Assign>, <tf.Operation 'save/RestoreV2_67/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_67/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_67' type=RestoreV2>, <tf.Operation 'save/Assign_67' type=Assign>, <tf.Operation 'save/RestoreV2_68/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_68/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_68' type=RestoreV2>, <tf.Operation 'save/Assign_68' type=Assign>, <tf.Operation 'save/RestoreV2_69/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_69/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_69' type=RestoreV2>, <tf.Operation 'save/Assign_69' type=Assign>, <tf.Operation 'save/RestoreV2_70/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_70/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_70' type=RestoreV2>, <tf.Operation 'save/Assign_70' type=Assign>, <tf.Operation 'save/RestoreV2_71/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_71/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_71' type=RestoreV2>, <tf.Operation 'save/Assign_71' type=Assign>, <tf.Operation 'save/RestoreV2_72/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_72/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_72' type=RestoreV2>, <tf.Operation 'save/Assign_72' type=Assign>, <tf.Operation 'save/RestoreV2_73/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_73/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_73' type=RestoreV2>, <tf.Operation 'save/Assign_73' type=Assign>, <tf.Operation 'save/RestoreV2_74/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_74/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_74' type=RestoreV2>, <tf.Operation 'save/Assign_74' type=Assign>, <tf.Operation 'save/RestoreV2_75/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_75/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_75' type=RestoreV2>, <tf.Operation 'save/Assign_75' type=Assign>, <tf.Operation 'save/RestoreV2_76/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_76/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_76' type=RestoreV2>, <tf.Operation 'save/Assign_76' type=Assign>, <tf.Operation 'save/RestoreV2_77/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_77/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_77' type=RestoreV2>, <tf.Operation 'save/Assign_77' type=Assign>, <tf.Operation 'save/RestoreV2_78/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_78/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_78' type=RestoreV2>, <tf.Operation 'save/Assign_78' type=Assign>, <tf.Operation 'save/RestoreV2_79/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_79/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_79' type=RestoreV2>, <tf.Operation 'save/Assign_79' type=Assign>, <tf.Operation 'save/RestoreV2_80/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_80/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_80' type=RestoreV2>, <tf.Operation 'save/Assign_80' type=Assign>, <tf.Operation 'save/RestoreV2_81/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_81/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_81' type=RestoreV2>, <tf.Operation 'save/Assign_81' type=Assign>, <tf.Operation 'save/RestoreV2_82/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_82/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_82' type=RestoreV2>, <tf.Operation 'save/Assign_82' type=Assign>, <tf.Operation 'save/RestoreV2_83/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_83/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_83' type=RestoreV2>, <tf.Operation 'save/Assign_83' type=Assign>, <tf.Operation 'save/RestoreV2_84/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_84/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_84' type=RestoreV2>, <tf.Operation 'save/Assign_84' type=Assign>, <tf.Operation 'save/RestoreV2_85/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_85/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_85' type=RestoreV2>, <tf.Operation 'save/Assign_85' type=Assign>, <tf.Operation 'save/RestoreV2_86/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_86/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_86' type=RestoreV2>, <tf.Operation 'save/Assign_86' type=Assign>, <tf.Operation 'save/RestoreV2_87/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_87/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_87' type=RestoreV2>, <tf.Operation 'save/Assign_87' type=Assign>, <tf.Operation 'save/RestoreV2_88/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_88/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_88' type=RestoreV2>, <tf.Operation 'save/Assign_88' type=Assign>, <tf.Operation 'save/RestoreV2_89/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_89/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_89' type=RestoreV2>, <tf.Operation 'save/Assign_89' type=Assign>, <tf.Operation 'save/RestoreV2_90/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_90/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_90' type=RestoreV2>, <tf.Operation 'save/Assign_90' type=Assign>, <tf.Operation 'save/RestoreV2_91/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_91/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_91' type=RestoreV2>, <tf.Operation 'save/Assign_91' type=Assign>, <tf.Operation 'save/RestoreV2_92/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_92/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_92' type=RestoreV2>, <tf.Operation 'save/Assign_92' type=Assign>, <tf.Operation 'save/RestoreV2_93/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_93/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_93' type=RestoreV2>, <tf.Operation 'save/Assign_93' type=Assign>, <tf.Operation 'save/RestoreV2_94/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_94/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_94' type=RestoreV2>, <tf.Operation 'save/Assign_94' type=Assign>, <tf.Operation 'save/RestoreV2_95/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_95/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_95' type=RestoreV2>, <tf.Operation 'save/Assign_95' type=Assign>, <tf.Operation 'save/RestoreV2_96/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_96/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_96' type=RestoreV2>, <tf.Operation 'save/Assign_96' type=Assign>, <tf.Operation 'save/RestoreV2_97/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_97/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_97' type=RestoreV2>, <tf.Operation 'save/Assign_97' type=Assign>, <tf.Operation 'save/RestoreV2_98/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_98/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_98' type=RestoreV2>, <tf.Operation 'save/Assign_98' type=Assign>, <tf.Operation 'save/RestoreV2_99/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_99/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_99' type=RestoreV2>, <tf.Operation 'save/Assign_99' type=Assign>, <tf.Operation 'save/RestoreV2_100/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_100/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_100' type=RestoreV2>, <tf.Operation 'save/Assign_100' type=Assign>, <tf.Operation 'save/RestoreV2_101/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_101/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_101' type=RestoreV2>, <tf.Operation 'save/Assign_101' type=Assign>, <tf.Operation 'save/RestoreV2_102/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_102/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_102' type=RestoreV2>, <tf.Operation 'save/Assign_102' type=Assign>, <tf.Operation 'save/RestoreV2_103/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_103/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_103' type=RestoreV2>, <tf.Operation 'save/Assign_103' type=Assign>, <tf.Operation 'save/RestoreV2_104/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_104/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_104' type=RestoreV2>, <tf.Operation 'save/Assign_104' type=Assign>, <tf.Operation 'save/RestoreV2_105/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_105/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_105' type=RestoreV2>, <tf.Operation 'save/Assign_105' type=Assign>, <tf.Operation 'save/RestoreV2_106/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_106/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_106' type=RestoreV2>, <tf.Operation 'save/Assign_106' type=Assign>, <tf.Operation 'save/RestoreV2_107/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_107/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_107' type=RestoreV2>, <tf.Operation 'save/Assign_107' type=Assign>, <tf.Operation 'save/RestoreV2_108/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_108/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_108' type=RestoreV2>, <tf.Operation 'save/Assign_108' type=Assign>, <tf.Operation 'save/RestoreV2_109/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_109/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_109' type=RestoreV2>, <tf.Operation 'save/Assign_109' type=Assign>, <tf.Operation 'save/RestoreV2_110/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_110/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_110' type=RestoreV2>, <tf.Operation 'save/Assign_110' type=Assign>, <tf.Operation 'save/RestoreV2_111/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_111/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_111' type=RestoreV2>, <tf.Operation 'save/Assign_111' type=Assign>, <tf.Operation 'save/RestoreV2_112/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_112/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_112' type=RestoreV2>, <tf.Operation 'save/Assign_112' type=Assign>, <tf.Operation 'save/RestoreV2_113/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_113/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_113' type=RestoreV2>, <tf.Operation 'save/Assign_113' type=Assign>, <tf.Operation 'save/RestoreV2_114/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_114/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_114' type=RestoreV2>, <tf.Operation 'save/Assign_114' type=Assign>, <tf.Operation 'save/RestoreV2_115/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_115/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_115' type=RestoreV2>, <tf.Operation 'save/Assign_115' type=Assign>, <tf.Operation 'save/RestoreV2_116/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_116/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_116' type=RestoreV2>, <tf.Operation 'save/Assign_116' type=Assign>, <tf.Operation 'save/RestoreV2_117/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_117/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_117' type=RestoreV2>, <tf.Operation 'save/Assign_117' type=Assign>, <tf.Operation 'save/RestoreV2_118/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_118/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_118' type=RestoreV2>, <tf.Operation 'save/Assign_118' type=Assign>, <tf.Operation 'save/RestoreV2_119/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_119/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_119' type=RestoreV2>, <tf.Operation 'save/Assign_119' type=Assign>, <tf.Operation 'save/RestoreV2_120/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_120/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_120' type=RestoreV2>, <tf.Operation 'save/Assign_120' type=Assign>, <tf.Operation 'save/RestoreV2_121/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_121/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_121' type=RestoreV2>, <tf.Operation 'save/Assign_121' type=Assign>, <tf.Operation 'save/RestoreV2_122/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_122/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_122' type=RestoreV2>, <tf.Operation 'save/Assign_122' type=Assign>, <tf.Operation 'save/RestoreV2_123/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_123/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_123' type=RestoreV2>, <tf.Operation 'save/Assign_123' type=Assign>, <tf.Operation 'save/RestoreV2_124/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_124/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_124' type=RestoreV2>, <tf.Operation 'save/Assign_124' type=Assign>, <tf.Operation 'save/RestoreV2_125/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_125/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_125' type=RestoreV2>, <tf.Operation 'save/Assign_125' type=Assign>, <tf.Operation 'save/RestoreV2_126/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_126/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_126' type=RestoreV2>, <tf.Operation 'save/Assign_126' type=Assign>, <tf.Operation 'save/RestoreV2_127/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_127/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_127' type=RestoreV2>, <tf.Operation 'save/Assign_127' type=Assign>, <tf.Operation 'save/RestoreV2_128/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_128/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_128' type=RestoreV2>, <tf.Operation 'save/Assign_128' type=Assign>, <tf.Operation 'save/RestoreV2_129/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_129/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_129' type=RestoreV2>, <tf.Operation 'save/Assign_129' type=Assign>, <tf.Operation 'save/RestoreV2_130/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_130/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_130' type=RestoreV2>, <tf.Operation 'save/Assign_130' type=Assign>, <tf.Operation 'save/RestoreV2_131/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_131/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_131' type=RestoreV2>, <tf.Operation 'save/Assign_131' type=Assign>, <tf.Operation 'save/RestoreV2_132/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_132/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_132' type=RestoreV2>, <tf.Operation 'save/Assign_132' type=Assign>, <tf.Operation 'save/RestoreV2_133/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_133/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_133' type=RestoreV2>, <tf.Operation 'save/Assign_133' type=Assign>, <tf.Operation 'save/RestoreV2_134/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_134/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_134' type=RestoreV2>, <tf.Operation 'save/Assign_134' type=Assign>, <tf.Operation 'save/RestoreV2_135/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_135/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_135' type=RestoreV2>, <tf.Operation 'save/Assign_135' type=Assign>, <tf.Operation 'save/RestoreV2_136/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_136/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_136' type=RestoreV2>, <tf.Operation 'save/Assign_136' type=Assign>, <tf.Operation 'save/RestoreV2_137/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_137/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_137' type=RestoreV2>, <tf.Operation 'save/Assign_137' type=Assign>, <tf.Operation 'save/RestoreV2_138/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_138/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_138' type=RestoreV2>, <tf.Operation 'save/Assign_138' type=Assign>, <tf.Operation 'save/RestoreV2_139/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_139/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_139' type=RestoreV2>, <tf.Operation 'save/Assign_139' type=Assign>, <tf.Operation 'save/RestoreV2_140/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_140/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_140' type=RestoreV2>, <tf.Operation 'save/Assign_140' type=Assign>, <tf.Operation 'save/RestoreV2_141/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_141/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_141' type=RestoreV2>, <tf.Operation 'save/Assign_141' type=Assign>, <tf.Operation 'save/RestoreV2_142/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_142/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_142' type=RestoreV2>, <tf.Operation 'save/Assign_142' type=Assign>, <tf.Operation 'save/RestoreV2_143/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_143/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_143' type=RestoreV2>, <tf.Operation 'save/Assign_143' type=Assign>, <tf.Operation 'save/RestoreV2_144/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_144/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_144' type=RestoreV2>, <tf.Operation 'save/Assign_144' type=Assign>, <tf.Operation 'save/RestoreV2_145/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_145/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_145' type=RestoreV2>, <tf.Operation 'save/Assign_145' type=Assign>, <tf.Operation 'save/RestoreV2_146/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_146/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_146' type=RestoreV2>, <tf.Operation 'save/Assign_146' type=Assign>, <tf.Operation 'save/RestoreV2_147/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_147/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_147' type=RestoreV2>, <tf.Operation 'save/Assign_147' type=Assign>, <tf.Operation 'save/RestoreV2_148/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_148/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_148' type=RestoreV2>, <tf.Operation 'save/Assign_148' type=Assign>, <tf.Operation 'save/RestoreV2_149/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_149/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_149' type=RestoreV2>, <tf.Operation 'save/Assign_149' type=Assign>, <tf.Operation 'save/RestoreV2_150/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_150/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_150' type=RestoreV2>, <tf.Operation 'save/Assign_150' type=Assign>, <tf.Operation 'save/RestoreV2_151/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_151/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_151' type=RestoreV2>, <tf.Operation 'save/Assign_151' type=Assign>, <tf.Operation 'save/RestoreV2_152/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_152/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_152' type=RestoreV2>, <tf.Operation 'save/Assign_152' type=Assign>, <tf.Operation 'save/RestoreV2_153/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_153/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_153' type=RestoreV2>, <tf.Operation 'save/Assign_153' type=Assign>, <tf.Operation 'save/RestoreV2_154/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_154/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_154' type=RestoreV2>, <tf.Operation 'save/Assign_154' type=Assign>, <tf.Operation 'save/RestoreV2_155/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_155/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_155' type=RestoreV2>, <tf.Operation 'save/Assign_155' type=Assign>, <tf.Operation 'save/RestoreV2_156/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_156/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_156' type=RestoreV2>, <tf.Operation 'save/Assign_156' type=Assign>, <tf.Operation 'save/RestoreV2_157/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_157/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_157' type=RestoreV2>, <tf.Operation 'save/Assign_157' type=Assign>, <tf.Operation 'save/RestoreV2_158/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_158/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_158' type=RestoreV2>, <tf.Operation 'save/Assign_158' type=Assign>, <tf.Operation 'save/RestoreV2_159/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_159/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_159' type=RestoreV2>, <tf.Operation 'save/Assign_159' type=Assign>, <tf.Operation 'save/RestoreV2_160/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_160/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_160' type=RestoreV2>, <tf.Operation 'save/Assign_160' type=Assign>, <tf.Operation 'save/RestoreV2_161/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_161/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_161' type=RestoreV2>, <tf.Operation 'save/Assign_161' type=Assign>, <tf.Operation 'save/RestoreV2_162/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_162/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_162' type=RestoreV2>, <tf.Operation 'save/Assign_162' type=Assign>, <tf.Operation 'save/RestoreV2_163/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_163/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_163' type=RestoreV2>, <tf.Operation 'save/Assign_163' type=Assign>, <tf.Operation 'save/RestoreV2_164/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_164/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_164' type=RestoreV2>, <tf.Operation 'save/Assign_164' type=Assign>, <tf.Operation 'save/RestoreV2_165/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_165/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_165' type=RestoreV2>, <tf.Operation 'save/Assign_165' type=Assign>, <tf.Operation 'save/RestoreV2_166/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_166/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_166' type=RestoreV2>, <tf.Operation 'save/Assign_166' type=Assign>, <tf.Operation 'save/RestoreV2_167/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_167/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_167' type=RestoreV2>, <tf.Operation 'save/Assign_167' type=Assign>, <tf.Operation 'save/RestoreV2_168/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_168/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_168' type=RestoreV2>, <tf.Operation 'save/Assign_168' type=Assign>, <tf.Operation 'save/RestoreV2_169/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_169/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_169' type=RestoreV2>, <tf.Operation 'save/Assign_169' type=Assign>, <tf.Operation 'save/RestoreV2_170/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_170/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_170' type=RestoreV2>, <tf.Operation 'save/Assign_170' type=Assign>, <tf.Operation 'save/RestoreV2_171/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_171/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_171' type=RestoreV2>, <tf.Operation 'save/Assign_171' type=Assign>, <tf.Operation 'save/RestoreV2_172/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_172/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_172' type=RestoreV2>, <tf.Operation 'save/Assign_172' type=Assign>, <tf.Operation 'save/RestoreV2_173/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_173/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_173' type=RestoreV2>, <tf.Operation 'save/Assign_173' type=Assign>, <tf.Operation 'save/RestoreV2_174/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_174/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_174' type=RestoreV2>, <tf.Operation 'save/Assign_174' type=Assign>, <tf.Operation 'save/RestoreV2_175/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_175/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_175' type=RestoreV2>, <tf.Operation 'save/Assign_175' type=Assign>, <tf.Operation 'save/RestoreV2_176/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_176/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_176' type=RestoreV2>, <tf.Operation 'save/Assign_176' type=Assign>, <tf.Operation 'save/RestoreV2_177/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_177/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_177' type=RestoreV2>, <tf.Operation 'save/Assign_177' type=Assign>, <tf.Operation 'save/RestoreV2_178/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_178/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_178' type=RestoreV2>, <tf.Operation 'save/Assign_178' type=Assign>, <tf.Operation 'save/RestoreV2_179/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_179/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_179' type=RestoreV2>, <tf.Operation 'save/Assign_179' type=Assign>, <tf.Operation 'save/RestoreV2_180/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_180/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_180' type=RestoreV2>, <tf.Operation 'save/Assign_180' type=Assign>, <tf.Operation 'save/RestoreV2_181/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_181/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_181' type=RestoreV2>, <tf.Operation 'save/Assign_181' type=Assign>, <tf.Operation 'save/RestoreV2_182/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_182/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_182' type=RestoreV2>, <tf.Operation 'save/Assign_182' type=Assign>, <tf.Operation 'save/RestoreV2_183/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_183/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_183' type=RestoreV2>, <tf.Operation 'save/Assign_183' type=Assign>, <tf.Operation 'save/RestoreV2_184/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_184/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_184' type=RestoreV2>, <tf.Operation 'save/Assign_184' type=Assign>, <tf.Operation 'save/RestoreV2_185/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_185/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_185' type=RestoreV2>, <tf.Operation 'save/Assign_185' type=Assign>, <tf.Operation 'save/RestoreV2_186/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_186/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_186' type=RestoreV2>, <tf.Operation 'save/Assign_186' type=Assign>, <tf.Operation 'save/RestoreV2_187/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_187/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_187' type=RestoreV2>, <tf.Operation 'save/Assign_187' type=Assign>, <tf.Operation 'save/RestoreV2_188/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_188/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_188' type=RestoreV2>, <tf.Operation 'save/Assign_188' type=Assign>, <tf.Operation 'save/RestoreV2_189/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_189/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_189' type=RestoreV2>, <tf.Operation 'save/Assign_189' type=Assign>, <tf.Operation 'save/RestoreV2_190/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_190/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_190' type=RestoreV2>, <tf.Operation 'save/Assign_190' type=Assign>, <tf.Operation 'save/RestoreV2_191/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_191/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_191' type=RestoreV2>, <tf.Operation 'save/Assign_191' type=Assign>, <tf.Operation 'save/RestoreV2_192/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_192/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_192' type=RestoreV2>, <tf.Operation 'save/Assign_192' type=Assign>, <tf.Operation 'save/RestoreV2_193/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_193/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_193' type=RestoreV2>, <tf.Operation 'save/Assign_193' type=Assign>, <tf.Operation 'save/RestoreV2_194/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_194/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_194' type=RestoreV2>, <tf.Operation 'save/Assign_194' type=Assign>, <tf.Operation 'save/RestoreV2_195/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_195/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_195' type=RestoreV2>, <tf.Operation 'save/Assign_195' type=Assign>, <tf.Operation 'save/RestoreV2_196/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_196/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_196' type=RestoreV2>, <tf.Operation 'save/Assign_196' type=Assign>, <tf.Operation 'save/RestoreV2_197/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_197/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_197' type=RestoreV2>, <tf.Operation 'save/Assign_197' type=Assign>, <tf.Operation 'save/RestoreV2_198/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_198/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_198' type=RestoreV2>, <tf.Operation 'save/Assign_198' type=Assign>, <tf.Operation 'save/RestoreV2_199/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_199/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_199' type=RestoreV2>, <tf.Operation 'save/Assign_199' type=Assign>, <tf.Operation 'save/RestoreV2_200/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_200/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_200' type=RestoreV2>, <tf.Operation 'save/Assign_200' type=Assign>, <tf.Operation 'save/RestoreV2_201/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_201/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_201' type=RestoreV2>, <tf.Operation 'save/Assign_201' type=Assign>, <tf.Operation 'save/RestoreV2_202/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_202/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_202' type=RestoreV2>, <tf.Operation 'save/Assign_202' type=Assign>, <tf.Operation 'save/RestoreV2_203/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_203/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_203' type=RestoreV2>, <tf.Operation 'save/Assign_203' type=Assign>, <tf.Operation 'save/RestoreV2_204/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_204/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_204' type=RestoreV2>, <tf.Operation 'save/Assign_204' type=Assign>, <tf.Operation 'save/RestoreV2_205/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_205/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_205' type=RestoreV2>, <tf.Operation 'save/Assign_205' type=Assign>, <tf.Operation 'save/RestoreV2_206/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_206/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_206' type=RestoreV2>, <tf.Operation 'save/Assign_206' type=Assign>, <tf.Operation 'save/RestoreV2_207/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_207/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_207' type=RestoreV2>, <tf.Operation 'save/Assign_207' type=Assign>, <tf.Operation 'save/RestoreV2_208/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_208/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_208' type=RestoreV2>, <tf.Operation 'save/Assign_208' type=Assign>, <tf.Operation 'save/RestoreV2_209/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_209/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_209' type=RestoreV2>, <tf.Operation 'save/Assign_209' type=Assign>, <tf.Operation 'save/RestoreV2_210/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_210/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_210' type=RestoreV2>, <tf.Operation 'save/Assign_210' type=Assign>, <tf.Operation 'save/RestoreV2_211/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_211/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_211' type=RestoreV2>, <tf.Operation 'save/Assign_211' type=Assign>, <tf.Operation 'save/RestoreV2_212/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_212/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_212' type=RestoreV2>, <tf.Operation 'save/Assign_212' type=Assign>, <tf.Operation 'save/RestoreV2_213/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_213/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_213' type=RestoreV2>, <tf.Operation 'save/Assign_213' type=Assign>, <tf.Operation 'save/RestoreV2_214/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_214/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_214' type=RestoreV2>, <tf.Operation 'save/Assign_214' type=Assign>, <tf.Operation 'save/RestoreV2_215/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_215/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_215' type=RestoreV2>, <tf.Operation 'save/Assign_215' type=Assign>, <tf.Operation 'save/RestoreV2_216/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_216/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_216' type=RestoreV2>, <tf.Operation 'save/Assign_216' type=Assign>, <tf.Operation 'save/RestoreV2_217/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_217/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_217' type=RestoreV2>, <tf.Operation 'save/Assign_217' type=Assign>, <tf.Operation 'save/RestoreV2_218/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_218/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_218' type=RestoreV2>, <tf.Operation 'save/Assign_218' type=Assign>, <tf.Operation 'save/RestoreV2_219/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_219/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_219' type=RestoreV2>, <tf.Operation 'save/Assign_219' type=Assign>, <tf.Operation 'save/RestoreV2_220/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_220/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_220' type=RestoreV2>, <tf.Operation 'save/Assign_220' type=Assign>, <tf.Operation 'save/RestoreV2_221/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_221/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_221' type=RestoreV2>, <tf.Operation 'save/Assign_221' type=Assign>, <tf.Operation 'save/RestoreV2_222/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_222/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_222' type=RestoreV2>, <tf.Operation 'save/Assign_222' type=Assign>, <tf.Operation 'save/RestoreV2_223/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_223/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_223' type=RestoreV2>, <tf.Operation 'save/Assign_223' type=Assign>, <tf.Operation 'save/RestoreV2_224/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_224/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_224' type=RestoreV2>, <tf.Operation 'save/Assign_224' type=Assign>, <tf.Operation 'save/RestoreV2_225/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_225/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_225' type=RestoreV2>, <tf.Operation 'save/Assign_225' type=Assign>, <tf.Operation 'save/RestoreV2_226/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_226/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_226' type=RestoreV2>, <tf.Operation 'save/Assign_226' type=Assign>, <tf.Operation 'save/RestoreV2_227/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_227/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_227' type=RestoreV2>, <tf.Operation 'save/Assign_227' type=Assign>, <tf.Operation 'save/RestoreV2_228/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_228/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_228' type=RestoreV2>, <tf.Operation 'save/Assign_228' type=Assign>, <tf.Operation 'save/RestoreV2_229/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_229/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_229' type=RestoreV2>, <tf.Operation 'save/Assign_229' type=Assign>, <tf.Operation 'save/RestoreV2_230/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_230/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_230' type=RestoreV2>, <tf.Operation 'save/Assign_230' type=Assign>, <tf.Operation 'save/RestoreV2_231/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_231/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_231' type=RestoreV2>, <tf.Operation 'save/Assign_231' type=Assign>, <tf.Operation 'save/RestoreV2_232/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_232/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_232' type=RestoreV2>, <tf.Operation 'save/Assign_232' type=Assign>, <tf.Operation 'save/RestoreV2_233/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_233/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_233' type=RestoreV2>, <tf.Operation 'save/Assign_233' type=Assign>, <tf.Operation 'save/RestoreV2_234/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_234/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_234' type=RestoreV2>, <tf.Operation 'save/Assign_234' type=Assign>, <tf.Operation 'save/RestoreV2_235/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_235/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_235' type=RestoreV2>, <tf.Operation 'save/Assign_235' type=Assign>, <tf.Operation 'save/RestoreV2_236/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_236/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_236' type=RestoreV2>, <tf.Operation 'save/Assign_236' type=Assign>, <tf.Operation 'save/RestoreV2_237/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_237/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_237' type=RestoreV2>, <tf.Operation 'save/Assign_237' type=Assign>, <tf.Operation 'save/RestoreV2_238/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_238/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_238' type=RestoreV2>, <tf.Operation 'save/Assign_238' type=Assign>, <tf.Operation 'save/RestoreV2_239/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_239/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_239' type=RestoreV2>, <tf.Operation 'save/Assign_239' type=Assign>, <tf.Operation 'save/RestoreV2_240/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_240/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_240' type=RestoreV2>, <tf.Operation 'save/Assign_240' type=Assign>, <tf.Operation 'save/RestoreV2_241/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_241/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_241' type=RestoreV2>, <tf.Operation 'save/Assign_241' type=Assign>, <tf.Operation 'save/RestoreV2_242/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_242/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_242' type=RestoreV2>, <tf.Operation 'save/Assign_242' type=Assign>, <tf.Operation 'save/RestoreV2_243/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_243/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_243' type=RestoreV2>, <tf.Operation 'save/Assign_243' type=Assign>, <tf.Operation 'save/RestoreV2_244/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_244/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_244' type=RestoreV2>, <tf.Operation 'save/Assign_244' type=Assign>, <tf.Operation 'save/RestoreV2_245/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_245/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_245' type=RestoreV2>, <tf.Operation 'save/Assign_245' type=Assign>, <tf.Operation 'save/RestoreV2_246/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_246/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_246' type=RestoreV2>, <tf.Operation 'save/Assign_246' type=Assign>, <tf.Operation 'save/RestoreV2_247/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_247/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_247' type=RestoreV2>, <tf.Operation 'save/Assign_247' type=Assign>, <tf.Operation 'save/RestoreV2_248/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_248/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_248' type=RestoreV2>, <tf.Operation 'save/Assign_248' type=Assign>, <tf.Operation 'save/RestoreV2_249/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_249/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_249' type=RestoreV2>, <tf.Operation 'save/Assign_249' type=Assign>, <tf.Operation 'save/RestoreV2_250/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_250/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_250' type=RestoreV2>, <tf.Operation 'save/Assign_250' type=Assign>, <tf.Operation 'save/RestoreV2_251/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_251/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_251' type=RestoreV2>, <tf.Operation 'save/Assign_251' type=Assign>, <tf.Operation 'save/RestoreV2_252/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_252/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_252' type=RestoreV2>, <tf.Operation 'save/Assign_252' type=Assign>, <tf.Operation 'save/RestoreV2_253/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_253/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_253' type=RestoreV2>, <tf.Operation 'save/Assign_253' type=Assign>, <tf.Operation 'save/RestoreV2_254/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_254/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_254' type=RestoreV2>, <tf.Operation 'save/Assign_254' type=Assign>, <tf.Operation 'save/RestoreV2_255/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_255/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_255' type=RestoreV2>, <tf.Operation 'save/Assign_255' type=Assign>, <tf.Operation 'save/RestoreV2_256/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_256/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_256' type=RestoreV2>, <tf.Operation 'save/Assign_256' type=Assign>, <tf.Operation 'save/RestoreV2_257/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_257/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_257' type=RestoreV2>, <tf.Operation 'save/Assign_257' type=Assign>, <tf.Operation 'save/RestoreV2_258/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_258/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_258' type=RestoreV2>, <tf.Operation 'save/Assign_258' type=Assign>, <tf.Operation 'save/RestoreV2_259/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_259/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_259' type=RestoreV2>, <tf.Operation 'save/Assign_259' type=Assign>, <tf.Operation 'save/RestoreV2_260/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_260/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_260' type=RestoreV2>, <tf.Operation 'save/Assign_260' type=Assign>, <tf.Operation 'save/RestoreV2_261/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_261/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_261' type=RestoreV2>, <tf.Operation 'save/Assign_261' type=Assign>, <tf.Operation 'save/RestoreV2_262/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_262/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_262' type=RestoreV2>, <tf.Operation 'save/Assign_262' type=Assign>, <tf.Operation 'save/RestoreV2_263/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_263/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_263' type=RestoreV2>, <tf.Operation 'save/Assign_263' type=Assign>, <tf.Operation 'save/RestoreV2_264/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_264/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_264' type=RestoreV2>, <tf.Operation 'save/Assign_264' type=Assign>, <tf.Operation 'save/RestoreV2_265/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_265/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_265' type=RestoreV2>, <tf.Operation 'save/Assign_265' type=Assign>, <tf.Operation 'save/RestoreV2_266/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_266/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_266' type=RestoreV2>, <tf.Operation 'save/Assign_266' type=Assign>, <tf.Operation 'save/RestoreV2_267/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_267/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_267' type=RestoreV2>, <tf.Operation 'save/Assign_267' type=Assign>, <tf.Operation 'save/RestoreV2_268/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_268/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_268' type=RestoreV2>, <tf.Operation 'save/Assign_268' type=Assign>, <tf.Operation 'save/RestoreV2_269/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_269/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_269' type=RestoreV2>, <tf.Operation 'save/Assign_269' type=Assign>, <tf.Operation 'save/RestoreV2_270/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_270/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_270' type=RestoreV2>, <tf.Operation 'save/Assign_270' type=Assign>, <tf.Operation 'save/RestoreV2_271/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_271/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_271' type=RestoreV2>, <tf.Operation 'save/Assign_271' type=Assign>, <tf.Operation 'save/RestoreV2_272/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_272/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_272' type=RestoreV2>, <tf.Operation 'save/Assign_272' type=Assign>, <tf.Operation 'save/RestoreV2_273/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_273/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_273' type=RestoreV2>, <tf.Operation 'save/Assign_273' type=Assign>, <tf.Operation 'save/RestoreV2_274/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_274/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_274' type=RestoreV2>, <tf.Operation 'save/Assign_274' type=Assign>, <tf.Operation 'save/RestoreV2_275/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_275/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_275' type=RestoreV2>, <tf.Operation 'save/Assign_275' type=Assign>, <tf.Operation 'save/RestoreV2_276/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_276/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_276' type=RestoreV2>, <tf.Operation 'save/Assign_276' type=Assign>, <tf.Operation 'save/RestoreV2_277/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_277/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_277' type=RestoreV2>, <tf.Operation 'save/Assign_277' type=Assign>, <tf.Operation 'save/RestoreV2_278/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_278/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_278' type=RestoreV2>, <tf.Operation 'save/Assign_278' type=Assign>, <tf.Operation 'save/RestoreV2_279/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_279/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_279' type=RestoreV2>, <tf.Operation 'save/Assign_279' type=Assign>, <tf.Operation 'save/RestoreV2_280/tensor_names' type=Const>, <tf.Operation 'save/RestoreV2_280/shape_and_slices' type=Const>, <tf.Operation 'save/RestoreV2_280' type=RestoreV2>, <tf.Operation 'save/Assign_280' type=Assign>, <tf.Operation 'save/restore_all' type=NoOp>, <tf.Operation 'init_1' type=NoOp>]
Identify tensor names corresponding to a) Layer whose output is of interest b) Input layer where the model takes in image/data sample c) Layer where model takes in the labels to fit.
#Fixing a specific operation_name to define the layer output
operation_name='unit_1_1/sub_add/add:0'
# In this case the probe is intended to be after the second Resnet Block in 18 layer Resnet for CIFAR-10
input_features_name='Placeholder:0'
label_name='Placeholder_1:0'
#These two correspond to Placeholder tensors for Feature input and label
attach_probe_eval() function loads a tensorflow checkpoint from a path, takes these inputs: a) Layer name whose output it needs to evaluate) Placeholder Tensor name corresponding to feature input x and c) Placeholder Tensor name corresponding to Label y d) Data samples to evaulate the layer outputs on.
pr=attach_probe_checkpoint.attach_probe_eval(input_features_name,label_name,operation_name,x_train1,y_train1,checkpoint_path)
np.save(to_save_filename,pr)
Tensor("unit_1_1/sub_add/add:0", shape=(?, 32, 32, 16), dtype=float32) Tensor("Reshape:0", shape=(?, 16384), dtype=float32) INFO:tensorflow:Restoring parameters from ../../aix360/models/profwt/checkpoints/train_resnetmodel_new1_799.ckpt 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 probe shape (30000, 16384)
# In this script, samples for probe training and probe confidence evaluations are done
# on the layer outputs obtained from the same dataset. Load the layer output values from the file.
#In general, it can be made different by supplying a new y_train2 and probe_eval_input
y_train2=y_train1
probe_train_input=np.load(parent_dir+'/data/probe_run1.npy')
probe_eval_input=probe_train_input
run=1
num_classes=10
to_save_pred_filename=parent_dir+"/data/probe_pred_run"+str(run)+'.npy'
to_save_probe_model_filename=parent_dir+"/data/probe_model_run"+str(run)
(log,pred)=train_probes.probe_train_eval(probe_train_input,y_train1,num_classes,probe_eval_input,y_train2,to_save_probe_model_filename)
np.save(to_save_pred_filename,pred)
WARNING:tensorflow:From ../../aix360/algorithms/profwt/train_probes.py:31: UniformUnitScaling.__init__ (from tensorflow.python.ops.init_ops) is deprecated and will be removed in a future version. Instructions for updating: Use tf.initializers.variance_scaling instead with distribution=uniform to get equivalent behavior. WARNING:tensorflow:From ../../aix360/algorithms/profwt/train_probes.py:70: softmax_cross_entropy_with_logits (from tensorflow.python.ops.nn_ops) is deprecated and will be removed in a future version. Instructions for updating: Future major versions of TensorFlow will allow gradients to flow into the labels input on backprop by default. See tf.nn.softmax_cross_entropy_with_logits_v2. Start Training Probe Model..... 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 Starting to Evaluate Probe Model Confidences and Saving in a File..... INFO:tensorflow:Restoring parameters from ../../aix360/models/profwt/data/probe_model_run1 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 (30000, 10) (30000, 10) Probe Confidences/Logits Saved...
import keras
from keras.layers import Dense, Conv2D, BatchNormalization, Activation
from keras.layers import AveragePooling2D, Input, Flatten
from keras.optimizers import Adam
from keras.callbacks import ModelCheckpoint, LearningRateScheduler
from keras.callbacks import ReduceLROnPlateau
from keras.preprocessing.image import ImageDataGenerator
from keras.regularizers import l2
from keras import backend as K
from keras.models import Model
import os
/Users/1j1060/tensorflow3/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`. from ._conv import register_converters as _register_converters Using TensorFlow backend.
Import the ProfWeight Explainer Class.
from aix360.algorithms.profwt.profwt import ProfweightExplainer
from aix360.algorithms.profwt.resnet_keras_model import resnet_v1,lr_schedule,HParams
Open the file constaining the training dataset for training the simple model. This file could be (In this example it is different) different from the dataset used for training the complex model.
x_train2=dataset_obj.load_file('cifar-10-train2-image.json')
y_train2=dataset_obj.load_file('cifar-10-train2-label.json')
x_test=dataset_obj.load_file('cifar-10-test-image.json')
y_test=dataset_obj.load_file('cifar-10-test-label.json')
print('x_train shape:', x_train2.shape)
print('y_train shape:', y_train2.shape)
x_train shape: (20000, 32, 32, 3) y_train shape: (20000, 10)
Specify checkpoint to save the model after training the simple model on x_train2,y_train2 dataset.
save_dir = os.path.join(os.getcwd(), 'saved_models')
model_name = 'resnet_target_model_unweighted.h5'
if not os.path.isdir(save_dir):
os.makedirs(save_dir)
filepath = os.path.join(save_dir, model_name)
Specify Learning Rate Schedule and all the hyper parameters for training. In this example, these are recommended setting from a popular Keras implementation of resnet models for CIFAR-10.
lr_scheduler = LearningRateScheduler(lr_schedule)
lr_reducer = ReduceLROnPlateau(factor=np.sqrt(0.1),cooldown=0,patience=5,min_lr=0.5e-6)
hps = HParams(lr_scheduler=lr_scheduler,lr_reducer=lr_reducer,batch_size=128,epochs=200,checkpoint_path=filepath,num_classes=10,complexity_param=1,optimizer=Adam(lr=lr_schedule(0)))
Learning rate: 0.001
ProfWeightExplainer Class has a fit function that trains a simple model using a provided keras model that is built by calling the resnet_v1 function specified in the model file resnet_keras_model.py
a=ProfweightExplainer()
m=a.fit(x_train2,y_train2,x_test,y_test,resnet_v1,hps,'neural_keras')
print("Initial Simple Model Accuracy:",m[1])
__________________________________________________________________________________________________ Layer (type) Output Shape Param # Connected to ================================================================================================== input_1 (InputLayer) (None, 32, 32, 3) 0 __________________________________________________________________________________________________ conv2d_1 (Conv2D) (None, 32, 32, 16) 448 input_1[0][0] __________________________________________________________________________________________________ batch_normalization_1 (BatchNor (None, 32, 32, 16) 64 conv2d_1[0][0] __________________________________________________________________________________________________ activation_1 (Activation) (None, 32, 32, 16) 0 batch_normalization_1[0][0] __________________________________________________________________________________________________ conv2d_2 (Conv2D) (None, 32, 32, 16) 2320 activation_1[0][0] __________________________________________________________________________________________________ batch_normalization_2 (BatchNor (None, 32, 32, 16) 64 conv2d_2[0][0] __________________________________________________________________________________________________ activation_2 (Activation) (None, 32, 32, 16) 0 batch_normalization_2[0][0] __________________________________________________________________________________________________ conv2d_3 (Conv2D) (None, 32, 32, 16) 2320 activation_2[0][0] __________________________________________________________________________________________________ batch_normalization_3 (BatchNor (None, 32, 32, 16) 64 conv2d_3[0][0] __________________________________________________________________________________________________ add_1 (Add) (None, 32, 32, 16) 0 activation_1[0][0] batch_normalization_3[0][0] __________________________________________________________________________________________________ activation_3 (Activation) (None, 32, 32, 16) 0 add_1[0][0] __________________________________________________________________________________________________ conv2d_4 (Conv2D) (None, 16, 16, 32) 4640 activation_3[0][0] __________________________________________________________________________________________________ batch_normalization_4 (BatchNor (None, 16, 16, 32) 128 conv2d_4[0][0] __________________________________________________________________________________________________ activation_4 (Activation) (None, 16, 16, 32) 0 batch_normalization_4[0][0] __________________________________________________________________________________________________ conv2d_5 (Conv2D) (None, 16, 16, 32) 9248 activation_4[0][0] __________________________________________________________________________________________________ conv2d_6 (Conv2D) (None, 16, 16, 32) 544 activation_3[0][0] __________________________________________________________________________________________________ batch_normalization_5 (BatchNor (None, 16, 16, 32) 128 conv2d_5[0][0] __________________________________________________________________________________________________ add_2 (Add) (None, 16, 16, 32) 0 conv2d_6[0][0] batch_normalization_5[0][0] __________________________________________________________________________________________________ activation_5 (Activation) (None, 16, 16, 32) 0 add_2[0][0] __________________________________________________________________________________________________ conv2d_7 (Conv2D) (None, 8, 8, 64) 18496 activation_5[0][0] __________________________________________________________________________________________________ batch_normalization_6 (BatchNor (None, 8, 8, 64) 256 conv2d_7[0][0] __________________________________________________________________________________________________ activation_6 (Activation) (None, 8, 8, 64) 0 batch_normalization_6[0][0] __________________________________________________________________________________________________ conv2d_8 (Conv2D) (None, 8, 8, 64) 36928 activation_6[0][0] __________________________________________________________________________________________________ conv2d_9 (Conv2D) (None, 8, 8, 64) 2112 activation_5[0][0] __________________________________________________________________________________________________ batch_normalization_7 (BatchNor (None, 8, 8, 64) 256 conv2d_8[0][0] __________________________________________________________________________________________________ add_3 (Add) (None, 8, 8, 64) 0 conv2d_9[0][0] batch_normalization_7[0][0] __________________________________________________________________________________________________ activation_7 (Activation) (None, 8, 8, 64) 0 add_3[0][0] __________________________________________________________________________________________________ average_pooling2d_1 (AveragePoo (None, 1, 1, 64) 0 activation_7[0][0] __________________________________________________________________________________________________ flatten_1 (Flatten) (None, 64) 0 average_pooling2d_1[0][0] __________________________________________________________________________________________________ dense_1 (Dense) (None, 10) 650 flatten_1[0][0] ================================================================================================== Total params: 78,666 Trainable params: 78,186 Non-trainable params: 480 __________________________________________________________________________________________________ Train on 20000 samples, validate on 500 samples Learning rate: 0.001 Epoch 1/200 19968/20000 [============================>.] - ETA: 0s - loss: 1.7537 - acc: 0.3788 Epoch 00001: val_acc improved from -inf to 0.19600, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_unweighted.h5 20000/20000 [==============================] - 78s 4ms/step - loss: 1.7537 - acc: 0.3789 - val_loss: 2.7654 - val_acc: 0.1960 Learning rate: 0.001 Epoch 2/200 19968/20000 [============================>.] - ETA: 0s - loss: 1.4443 - acc: 0.4983 Epoch 00002: val_acc improved from 0.19600 to 0.37400, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_unweighted.h5 20000/20000 [==============================] - 79s 4ms/step - loss: 1.4440 - acc: 0.4985 - val_loss: 1.7532 - val_acc: 0.3740 Learning rate: 0.001 Epoch 3/200 19968/20000 [============================>.] - ETA: 0s - loss: 1.2890 - acc: 0.5572 Epoch 00003: val_acc improved from 0.37400 to 0.50800, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_unweighted.h5 20000/20000 [==============================] - 78s 4ms/step - loss: 1.2887 - acc: 0.5575 - val_loss: 1.3537 - val_acc: 0.5080 Learning rate: 0.001 Epoch 4/200 19968/20000 [============================>.] - ETA: 0s - loss: 1.1897 - acc: 0.5937 Epoch 00004: val_acc improved from 0.50800 to 0.57000, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_unweighted.h5 20000/20000 [==============================] - 84s 4ms/step - loss: 1.1895 - acc: 0.5938 - val_loss: 1.2342 - val_acc: 0.5700 Learning rate: 0.001 Epoch 5/200 19968/20000 [============================>.] - ETA: 0s - loss: 1.1156 - acc: 0.6255 Epoch 00005: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 1.1159 - acc: 0.6253 - val_loss: 1.2336 - val_acc: 0.5560 Learning rate: 0.001 Epoch 6/200 19968/20000 [============================>.] - ETA: 0s - loss: 1.0482 - acc: 0.6499 Epoch 00006: val_acc did not improve 20000/20000 [==============================] - 78s 4ms/step - loss: 1.0483 - acc: 0.6499 - val_loss: 1.3257 - val_acc: 0.5380 Learning rate: 0.001 Epoch 7/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.9800 - acc: 0.6763 Epoch 00007: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.9800 - acc: 0.6763 - val_loss: 1.4286 - val_acc: 0.5180 Learning rate: 0.001 Epoch 8/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.9250 - acc: 0.6953 Epoch 00008: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.9251 - acc: 0.6953 - val_loss: 1.5477 - val_acc: 0.4940 Learning rate: 0.001 Epoch 9/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.8890 - acc: 0.7098 Epoch 00009: val_acc improved from 0.57000 to 0.59000, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_unweighted.h5 20000/20000 [==============================] - 93s 5ms/step - loss: 0.8891 - acc: 0.7099 - val_loss: 1.2582 - val_acc: 0.5900 Learning rate: 0.001 Epoch 10/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.8331 - acc: 0.7266 Epoch 00010: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.8339 - acc: 0.7262 - val_loss: 1.3667 - val_acc: 0.5540 Learning rate: 0.001 Epoch 11/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.7970 - acc: 0.7408 Epoch 00011: val_acc improved from 0.59000 to 0.61600, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_unweighted.h5 20000/20000 [==============================] - 89s 4ms/step - loss: 0.7973 - acc: 0.7407 - val_loss: 1.1424 - val_acc: 0.6160 Learning rate: 0.001 Epoch 12/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.7522 - acc: 0.7549 Epoch 00012: val_acc did not improve 20000/20000 [==============================] - 92s 5ms/step - loss: 0.7526 - acc: 0.7548 - val_loss: 1.2989 - val_acc: 0.5720 Learning rate: 0.001 Epoch 13/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.7266 - acc: 0.7656 Epoch 00013: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.7266 - acc: 0.7654 - val_loss: 1.3133 - val_acc: 0.5740 Learning rate: 0.001 Epoch 14/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.6790 - acc: 0.7840 Epoch 00014: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.6790 - acc: 0.7839 - val_loss: 1.1774 - val_acc: 0.6020 Learning rate: 0.001 Epoch 15/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.6408 - acc: 0.7941 Epoch 00015: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.6410 - acc: 0.7941 - val_loss: 1.6373 - val_acc: 0.4840 Learning rate: 0.001 Epoch 16/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.6084 - acc: 0.8099 Epoch 00016: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.6082 - acc: 0.8100 - val_loss: 1.7080 - val_acc: 0.5360 Learning rate: 0.001 Epoch 17/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.5642 - acc: 0.8271 Epoch 00017: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.5646 - acc: 0.8269 - val_loss: 1.2826 - val_acc: 0.5880 Learning rate: 0.001 Epoch 18/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.5350 - acc: 0.8375 Epoch 00018: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.5351 - acc: 0.8374 - val_loss: 1.9862 - val_acc: 0.5160 Learning rate: 0.001 Epoch 19/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.4997 - acc: 0.8496 Epoch 00019: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.4994 - acc: 0.8497 - val_loss: 1.8156 - val_acc: 0.5320 Learning rate: 0.001 Epoch 20/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.4797 - acc: 0.8594 Epoch 00020: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.4797 - acc: 0.8594 - val_loss: 1.5741 - val_acc: 0.5660 Learning rate: 0.001 Epoch 21/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.4519 - acc: 0.8655 Epoch 00021: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.4518 - acc: 0.8656 - val_loss: 2.7822 - val_acc: 0.4080 Learning rate: 0.001 Epoch 22/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.4252 - acc: 0.8798 Epoch 00022: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.4252 - acc: 0.8798 - val_loss: 2.0501 - val_acc: 0.5220 Learning rate: 0.001 Epoch 23/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.3957 - acc: 0.8877 Epoch 00023: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.3957 - acc: 0.8878 - val_loss: 1.8616 - val_acc: 0.5000 Learning rate: 0.001 Epoch 24/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.3740 - acc: 0.8965 Epoch 00024: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.3744 - acc: 0.8964 - val_loss: 1.6495 - val_acc: 0.5780 Learning rate: 0.001 Epoch 25/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.3571 - acc: 0.9023 Epoch 00025: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.3576 - acc: 0.9022 - val_loss: 1.8401 - val_acc: 0.5260 Learning rate: 0.001 Epoch 26/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.3336 - acc: 0.9100 Epoch 00026: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.3342 - acc: 0.9097 - val_loss: 2.1686 - val_acc: 0.5180 Learning rate: 0.001 Epoch 27/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.3244 - acc: 0.9151 Epoch 00027: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.3242 - acc: 0.9152 - val_loss: 1.9763 - val_acc: 0.5760 Learning rate: 0.001 Epoch 28/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2920 - acc: 0.9259 Epoch 00028: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.2924 - acc: 0.9258 - val_loss: 2.8018 - val_acc: 0.4860 Learning rate: 0.001 Epoch 29/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2748 - acc: 0.9329 Epoch 00029: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.2748 - acc: 0.9330 - val_loss: 1.8500 - val_acc: 0.5360 Learning rate: 0.001 Epoch 30/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2637 - acc: 0.9363 Epoch 00030: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.2637 - acc: 0.9363 - val_loss: 1.7060 - val_acc: 0.5840 Learning rate: 0.001 Epoch 31/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2463 - acc: 0.9440 Epoch 00031: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.2464 - acc: 0.9438 - val_loss: 1.8693 - val_acc: 0.5800 Learning rate: 0.001 Epoch 32/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2426 - acc: 0.9442 Epoch 00032: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.2424 - acc: 0.9443 - val_loss: 1.9180 - val_acc: 0.5740 Learning rate: 0.001 Epoch 33/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2293 - acc: 0.9496 Epoch 00033: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.2294 - acc: 0.9496 - val_loss: 2.3893 - val_acc: 0.5100 Learning rate: 0.001 Epoch 34/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2318 - acc: 0.9478 Epoch 00034: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.2319 - acc: 0.9478 - val_loss: 2.1293 - val_acc: 0.5540 Learning rate: 0.001 Epoch 35/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2225 - acc: 0.9510 Epoch 00035: val_acc did not improve 20000/20000 [==============================] - 98s 5ms/step - loss: 0.2235 - acc: 0.9507 - val_loss: 2.0747 - val_acc: 0.5560 Learning rate: 0.001 Epoch 36/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2295 - acc: 0.9485 Epoch 00036: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.2296 - acc: 0.9484 - val_loss: 1.9203 - val_acc: 0.5820 Learning rate: 0.001 Epoch 37/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1914 - acc: 0.9645 Epoch 00037: val_acc did not improve 20000/20000 [==============================] - 93s 5ms/step - loss: 0.1916 - acc: 0.9645 - val_loss: 2.1618 - val_acc: 0.5700 Learning rate: 0.001 Epoch 38/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1979 - acc: 0.9586 Epoch 00038: val_acc did not improve 20000/20000 [==============================] - 98s 5ms/step - loss: 0.1978 - acc: 0.9587 - val_loss: 2.7718 - val_acc: 0.5240 Learning rate: 0.001 Epoch 39/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1896 - acc: 0.9627 Epoch 00039: val_acc did not improve 20000/20000 [==============================] - 89s 4ms/step - loss: 0.1896 - acc: 0.9627 - val_loss: 2.3221 - val_acc: 0.5620 Learning rate: 0.001 Epoch 40/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1977 - acc: 0.9584 Epoch 00040: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.1977 - acc: 0.9583 - val_loss: 2.8365 - val_acc: 0.5180 Learning rate: 0.001 Epoch 41/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1861 - acc: 0.9636 Epoch 00041: val_acc did not improve 20000/20000 [==============================] - 99s 5ms/step - loss: 0.1864 - acc: 0.9634 - val_loss: 2.3616 - val_acc: 0.5620 Learning rate: 0.001 Epoch 42/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1911 - acc: 0.9603 Epoch 00042: val_acc did not improve 20000/20000 [==============================] - 89s 4ms/step - loss: 0.1911 - acc: 0.9603 - val_loss: 2.4828 - val_acc: 0.5220 Learning rate: 0.001 Epoch 43/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1840 - acc: 0.9633 Epoch 00043: val_acc did not improve 20000/20000 [==============================] - 90s 4ms/step - loss: 0.1849 - acc: 0.9630 - val_loss: 3.1005 - val_acc: 0.5040 Learning rate: 0.001 Epoch 44/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1935 - acc: 0.9606 Epoch 00044: val_acc did not improve 20000/20000 [==============================] - 90s 5ms/step - loss: 0.1936 - acc: 0.9605 - val_loss: 3.0432 - val_acc: 0.5220 Learning rate: 0.001 Epoch 45/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1810 - acc: 0.9648 Epoch 00045: val_acc did not improve 20000/20000 [==============================] - 90s 5ms/step - loss: 0.1810 - acc: 0.9647 - val_loss: 1.9895 - val_acc: 0.5780 Learning rate: 0.001 Epoch 46/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1550 - acc: 0.9742 Epoch 00046: val_acc did not improve 20000/20000 [==============================] - 90s 5ms/step - loss: 0.1551 - acc: 0.9741 - val_loss: 2.5270 - val_acc: 0.5460 Learning rate: 0.001 Epoch 47/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1533 - acc: 0.9772 Epoch 00047: val_acc did not improve 20000/20000 [==============================] - 90s 5ms/step - loss: 0.1535 - acc: 0.9770 - val_loss: 3.1516 - val_acc: 0.4940 Learning rate: 0.001 Epoch 48/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1610 - acc: 0.9728 Epoch 00048: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.1610 - acc: 0.9728 - val_loss: 3.0021 - val_acc: 0.5100 Learning rate: 0.001 Epoch 49/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1375 - acc: 0.9811 Epoch 00049: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.1375 - acc: 0.9810 - val_loss: 2.4277 - val_acc: 0.5660 Learning rate: 0.001 Epoch 50/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1541 - acc: 0.9740 Epoch 00050: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.1542 - acc: 0.9739 - val_loss: 2.5801 - val_acc: 0.5660 Learning rate: 0.001 Epoch 51/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1927 - acc: 0.9586 Epoch 00051: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.1927 - acc: 0.9586 - val_loss: 3.5708 - val_acc: 0.5020 Learning rate: 0.001 Epoch 52/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1670 - acc: 0.9703 Epoch 00052: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.1671 - acc: 0.9701 - val_loss: 2.5823 - val_acc: 0.5500 Learning rate: 0.001 Epoch 53/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1715 - acc: 0.9656 Epoch 00053: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.1713 - acc: 0.9657 - val_loss: 3.0892 - val_acc: 0.5240 Learning rate: 0.001 Epoch 54/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1691 - acc: 0.9690 Epoch 00054: val_acc did not improve 20000/20000 [==============================] - 90s 5ms/step - loss: 0.1691 - acc: 0.9689 - val_loss: 3.4058 - val_acc: 0.4600 Learning rate: 0.001 Epoch 55/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1751 - acc: 0.9654 Epoch 00055: val_acc did not improve 20000/20000 [==============================] - 90s 4ms/step - loss: 0.1760 - acc: 0.9651 - val_loss: 2.2525 - val_acc: 0.5820 Learning rate: 0.001 Epoch 56/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1994 - acc: 0.9570 Epoch 00056: val_acc did not improve 20000/20000 [==============================] - 90s 4ms/step - loss: 0.1992 - acc: 0.9570 - val_loss: 2.3523 - val_acc: 0.5820 Learning rate: 0.001 Epoch 57/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1409 - acc: 0.9797 Epoch 00057: val_acc did not improve 20000/20000 [==============================] - 89s 4ms/step - loss: 0.1411 - acc: 0.9797 - val_loss: 2.2169 - val_acc: 0.6040 Learning rate: 0.001 Epoch 58/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1257 - acc: 0.9863 Epoch 00058: val_acc did not improve 20000/20000 [==============================] - 90s 4ms/step - loss: 0.1258 - acc: 0.9863 - val_loss: 2.2568 - val_acc: 0.5820 Learning rate: 0.001 Epoch 59/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1108 - acc: 0.9925 Epoch 00059: val_acc did not improve 20000/20000 [==============================] - 90s 4ms/step - loss: 0.1108 - acc: 0.9926 - val_loss: 2.6571 - val_acc: 0.5600 Learning rate: 0.001 Epoch 60/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1090 - acc: 0.9919 Epoch 00060: val_acc did not improve 20000/20000 [==============================] - 89s 4ms/step - loss: 0.1091 - acc: 0.9919 - val_loss: 2.5297 - val_acc: 0.5540 Learning rate: 0.001 Epoch 61/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1234 - acc: 0.9851 Epoch 00061: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.1234 - acc: 0.9851 - val_loss: 2.7876 - val_acc: 0.5600 Learning rate: 0.001 Epoch 62/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1862 - acc: 0.9607 Epoch 00062: val_acc did not improve 20000/20000 [==============================] - 92s 5ms/step - loss: 0.1861 - acc: 0.9607 - val_loss: 3.2215 - val_acc: 0.5500 Learning rate: 0.001 Epoch 63/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2270 - acc: 0.9443 Epoch 00063: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.2272 - acc: 0.9442 - val_loss: 3.0210 - val_acc: 0.5680 Learning rate: 0.001 Epoch 64/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1723 - acc: 0.9677 Epoch 00064: val_acc did not improve 20000/20000 [==============================] - 97s 5ms/step - loss: 0.1725 - acc: 0.9676 - val_loss: 2.7429 - val_acc: 0.5700 Learning rate: 0.001 Epoch 65/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1528 - acc: 0.9743 Epoch 00065: val_acc did not improve 20000/20000 [==============================] - 103s 5ms/step - loss: 0.1528 - acc: 0.9743 - val_loss: 2.5961 - val_acc: 0.5600 Learning rate: 0.001 Epoch 66/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1234 - acc: 0.9873 Epoch 00066: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.1234 - acc: 0.9873 - val_loss: 2.7328 - val_acc: 0.5500 Learning rate: 0.001 Epoch 67/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1089 - acc: 0.9926 Epoch 00067: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.1089 - acc: 0.9926 - val_loss: 2.9422 - val_acc: 0.5380 Learning rate: 0.001 Epoch 68/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1028 - acc: 0.9938 Epoch 00068: val_acc did not improve 20000/20000 [==============================] - 90s 5ms/step - loss: 0.1029 - acc: 0.9937 - val_loss: 2.6488 - val_acc: 0.5720 Learning rate: 0.001 Epoch 69/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1310 - acc: 0.9832 Epoch 00069: val_acc did not improve 20000/20000 [==============================] - 90s 4ms/step - loss: 0.1318 - acc: 0.9829 - val_loss: 3.1946 - val_acc: 0.5280 Learning rate: 0.001 Epoch 70/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2078 - acc: 0.9527 Epoch 00070: val_acc did not improve 20000/20000 [==============================] - 94s 5ms/step - loss: 0.2078 - acc: 0.9528 - val_loss: 3.4378 - val_acc: 0.4840 Learning rate: 0.001 Epoch 71/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1849 - acc: 0.9635 Epoch 00071: val_acc did not improve 20000/20000 [==============================] - 89s 4ms/step - loss: 0.1850 - acc: 0.9634 - val_loss: 2.8612 - val_acc: 0.5340 Learning rate: 0.001 Epoch 72/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1604 - acc: 0.9710 Epoch 00072: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.1606 - acc: 0.9709 - val_loss: 3.1511 - val_acc: 0.5300 Learning rate: 0.001 Epoch 73/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1516 - acc: 0.9759 Epoch 00073: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.1518 - acc: 0.9759 - val_loss: 3.2399 - val_acc: 0.5400 Learning rate: 0.001 Epoch 74/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1296 - acc: 0.9845 Epoch 00074: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.1297 - acc: 0.9845 - val_loss: 2.5100 - val_acc: 0.5960 Learning rate: 0.001 Epoch 75/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1159 - acc: 0.9899 Epoch 00075: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.1160 - acc: 0.9899 - val_loss: 2.5246 - val_acc: 0.5820 Learning rate: 0.001 Epoch 76/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1098 - acc: 0.9916 Epoch 00076: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.1099 - acc: 0.9915 - val_loss: 2.5748 - val_acc: 0.5700 Learning rate: 0.001 Epoch 77/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1372 - acc: 0.9813 Epoch 00077: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.1373 - acc: 0.9813 - val_loss: 3.0990 - val_acc: 0.5480 Learning rate: 0.001 Epoch 78/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1553 - acc: 0.9718 Epoch 00078: val_acc did not improve 20000/20000 [==============================] - 89s 4ms/step - loss: 0.1552 - acc: 0.9718 - val_loss: 3.6318 - val_acc: 0.5080 Learning rate: 0.001 Epoch 79/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1658 - acc: 0.9688 Epoch 00079: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.1660 - acc: 0.9687 - val_loss: 3.4663 - val_acc: 0.5200 Learning rate: 0.001 Epoch 80/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1556 - acc: 0.9742 Epoch 00080: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.1558 - acc: 0.9741 - val_loss: 3.7072 - val_acc: 0.4900 Learning rate: 0.001 Epoch 81/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1420 - acc: 0.9788 Epoch 00081: val_acc did not improve 20000/20000 [==============================] - 89s 4ms/step - loss: 0.1420 - acc: 0.9788 - val_loss: 3.0134 - val_acc: 0.5460 Learning rate: 0.0001 Epoch 82/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0994 - acc: 0.9956 Epoch 00082: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.0994 - acc: 0.9956 - val_loss: 2.1839 - val_acc: 0.6140 Learning rate: 0.0001 Epoch 83/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0903 - acc: 0.9991 Epoch 00083: val_acc did not improve 20000/20000 [==============================] - 95s 5ms/step - loss: 0.0903 - acc: 0.9991 - val_loss: 2.1926 - val_acc: 0.6060 Learning rate: 0.0001 Epoch 84/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0879 - acc: 0.9994 Epoch 00084: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0879 - acc: 0.9995 - val_loss: 2.1914 - val_acc: 0.6040 Learning rate: 0.0001 Epoch 85/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0865 - acc: 0.9996 Epoch 00085: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0866 - acc: 0.9996 - val_loss: 2.1996 - val_acc: 0.6080 Learning rate: 0.0001 Epoch 86/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0852 - acc: 0.9997 Epoch 00086: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0853 - acc: 0.9997 - val_loss: 2.2075 - val_acc: 0.6040 Learning rate: 0.0001 Epoch 87/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0846 - acc: 0.9998 Epoch 00087: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0846 - acc: 0.9999 - val_loss: 2.2367 - val_acc: 0.6160 Learning rate: 0.0001 Epoch 88/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0838 - acc: 0.9999 Epoch 00088: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0840 - acc: 0.9999 - val_loss: 2.2325 - val_acc: 0.6040 Learning rate: 0.0001 Epoch 89/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0837 - acc: 0.9998 Epoch 00089: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0837 - acc: 0.9999 - val_loss: 2.2448 - val_acc: 0.6120 Learning rate: 0.0001 Epoch 90/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0824 - acc: 0.9999 Epoch 00090: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0825 - acc: 1.0000 - val_loss: 2.2410 - val_acc: 0.6140 Learning rate: 0.0001 Epoch 91/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0823 - acc: 0.9999 Epoch 00091: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.0823 - acc: 1.0000 - val_loss: 2.2553 - val_acc: 0.6100 Learning rate: 0.0001 Epoch 92/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0815 - acc: 1.0000 Epoch 00092: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.0815 - acc: 1.0000 - val_loss: 2.2517 - val_acc: 0.6160 Learning rate: 0.0001 Epoch 93/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0808 - acc: 1.0000 Epoch 00093: val_acc did not improve 20000/20000 [==============================] - 89s 4ms/step - loss: 0.0808 - acc: 1.0000 - val_loss: 2.2757 - val_acc: 0.6060 Learning rate: 0.0001 Epoch 94/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0806 - acc: 1.0000 Epoch 00094: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0806 - acc: 1.0000 - val_loss: 2.2620 - val_acc: 0.6100 Learning rate: 0.0001 Epoch 95/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0802 - acc: 1.0000 Epoch 00095: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0802 - acc: 1.0000 - val_loss: 2.2760 - val_acc: 0.6040 Learning rate: 0.0001 Epoch 96/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0799 - acc: 0.9999 Epoch 00096: val_acc did not improve 20000/20000 [==============================] - 80s 4ms/step - loss: 0.0799 - acc: 1.0000 - val_loss: 2.2982 - val_acc: 0.6060 Learning rate: 0.0001 Epoch 97/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0792 - acc: 0.9999 Epoch 00097: val_acc did not improve 20000/20000 [==============================] - 80s 4ms/step - loss: 0.0793 - acc: 1.0000 - val_loss: 2.2948 - val_acc: 0.6120 Learning rate: 0.0001 Epoch 98/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0790 - acc: 0.9999 Epoch 00098: val_acc did not improve 20000/20000 [==============================] - 79s 4ms/step - loss: 0.0790 - acc: 1.0000 - val_loss: 2.2924 - val_acc: 0.6060 Learning rate: 0.0001 Epoch 99/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0788 - acc: 0.9999 Epoch 00099: val_acc did not improve 20000/20000 [==============================] - 79s 4ms/step - loss: 0.0788 - acc: 0.9999 - val_loss: 2.3238 - val_acc: 0.6040 Learning rate: 0.0001 Epoch 100/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0780 - acc: 1.0000 Epoch 00100: val_acc did not improve 20000/20000 [==============================] - 78s 4ms/step - loss: 0.0780 - acc: 1.0000 - val_loss: 2.3238 - val_acc: 0.6120 Learning rate: 0.0001 Epoch 101/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0775 - acc: 1.0000 Epoch 00101: val_acc did not improve 20000/20000 [==============================] - 78s 4ms/step - loss: 0.0775 - acc: 1.0000 - val_loss: 2.3456 - val_acc: 0.6060 Learning rate: 0.0001 Epoch 102/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0773 - acc: 1.0000 Epoch 00102: val_acc did not improve 20000/20000 [==============================] - 78s 4ms/step - loss: 0.0773 - acc: 1.0000 - val_loss: 2.3443 - val_acc: 0.5940 Learning rate: 0.0001 Epoch 103/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0766 - acc: 1.0000 Epoch 00103: val_acc did not improve 20000/20000 [==============================] - 78s 4ms/step - loss: 0.0767 - acc: 1.0000 - val_loss: 2.3351 - val_acc: 0.6040 Learning rate: 0.0001 Epoch 104/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0766 - acc: 0.9999 Epoch 00104: val_acc did not improve 20000/20000 [==============================] - 80s 4ms/step - loss: 0.0767 - acc: 0.9999 - val_loss: 2.3501 - val_acc: 0.6140 Learning rate: 0.0001 Epoch 105/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0760 - acc: 1.0000 Epoch 00105: val_acc did not improve 20000/20000 [==============================] - 80s 4ms/step - loss: 0.0760 - acc: 1.0000 - val_loss: 2.3564 - val_acc: 0.5980 Learning rate: 0.0001 Epoch 106/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0752 - acc: 1.0000 Epoch 00106: val_acc did not improve 20000/20000 [==============================] - 79s 4ms/step - loss: 0.0752 - acc: 1.0000 - val_loss: 2.3593 - val_acc: 0.6080 Learning rate: 0.0001 Epoch 107/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0753 - acc: 0.9999 Epoch 00107: val_acc did not improve 20000/20000 [==============================] - 80s 4ms/step - loss: 0.0754 - acc: 1.0000 - val_loss: 2.3625 - val_acc: 0.6080 Learning rate: 0.0001 Epoch 108/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0745 - acc: 1.0000 Epoch 00108: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0745 - acc: 1.0000 - val_loss: 2.3905 - val_acc: 0.5920 Learning rate: 0.0001 Epoch 109/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0740 - acc: 1.0000 Epoch 00109: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0740 - acc: 1.0000 - val_loss: 2.3621 - val_acc: 0.6120 Learning rate: 0.0001 Epoch 110/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0731 - acc: 1.0000 Epoch 00110: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0733 - acc: 1.0000 - val_loss: 2.3654 - val_acc: 0.5920 Learning rate: 0.0001 Epoch 111/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0732 - acc: 1.0000 Epoch 00111: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.0732 - acc: 1.0000 - val_loss: 2.4044 - val_acc: 0.5960 Learning rate: 0.0001 Epoch 112/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0723 - acc: 1.0000 Epoch 00112: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0723 - acc: 1.0000 - val_loss: 2.3979 - val_acc: 0.6000 Learning rate: 0.0001 Epoch 113/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0715 - acc: 1.0000 Epoch 00113: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0715 - acc: 1.0000 - val_loss: 2.3851 - val_acc: 0.6020 Learning rate: 0.0001 Epoch 114/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0711 - acc: 1.0000 Epoch 00114: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0712 - acc: 1.0000 - val_loss: 2.4106 - val_acc: 0.6080 Learning rate: 0.0001 Epoch 115/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0714 - acc: 0.9998 Epoch 00115: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0714 - acc: 0.9999 - val_loss: 2.4110 - val_acc: 0.6120 Learning rate: 0.0001 Epoch 116/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0702 - acc: 1.0000 Epoch 00116: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0703 - acc: 1.0000 - val_loss: 2.4085 - val_acc: 0.6060 Learning rate: 0.0001 Epoch 117/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0700 - acc: 1.0000 Epoch 00117: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0700 - acc: 1.0000 - val_loss: 2.4191 - val_acc: 0.5980 Learning rate: 0.0001 Epoch 118/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0693 - acc: 0.9999 Epoch 00118: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0693 - acc: 1.0000 - val_loss: 2.4271 - val_acc: 0.6140 Learning rate: 0.0001 Epoch 119/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0688 - acc: 0.9999 Epoch 00119: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0688 - acc: 0.9999 - val_loss: 2.4389 - val_acc: 0.6120 Learning rate: 0.0001 Epoch 120/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0681 - acc: 1.0000 Epoch 00120: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0681 - acc: 1.0000 - val_loss: 2.5083 - val_acc: 0.5900 Learning rate: 0.0001 Epoch 121/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0672 - acc: 1.0000 Epoch 00121: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0672 - acc: 1.0000 - val_loss: 2.4561 - val_acc: 0.6000 Learning rate: 1e-05 Epoch 122/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0668 - acc: 1.0000 Epoch 00122: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0668 - acc: 1.0000 - val_loss: 2.4685 - val_acc: 0.6000 Learning rate: 1e-05 Epoch 123/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0667 - acc: 1.0000 Epoch 00123: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0667 - acc: 1.0000 - val_loss: 2.4675 - val_acc: 0.5960 Learning rate: 1e-05 Epoch 124/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0667 - acc: 1.0000 Epoch 00124: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0667 - acc: 1.0000 - val_loss: 2.4628 - val_acc: 0.6100 Learning rate: 1e-05 Epoch 125/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0665 - acc: 1.0000 Epoch 00125: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0665 - acc: 1.0000 - val_loss: 2.4635 - val_acc: 0.6100 Learning rate: 1e-05 Epoch 126/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0664 - acc: 0.9999 Epoch 00126: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0664 - acc: 1.0000 - val_loss: 2.4627 - val_acc: 0.6040 Learning rate: 1e-05 Epoch 127/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0664 - acc: 1.0000 Epoch 00127: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0664 - acc: 1.0000 - val_loss: 2.4656 - val_acc: 0.6080 Learning rate: 1e-05 Epoch 128/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0662 - acc: 1.0000 Epoch 00128: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0663 - acc: 1.0000 - val_loss: 2.4634 - val_acc: 0.6060 Learning rate: 1e-05 Epoch 129/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0662 - acc: 1.0000 Epoch 00129: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0662 - acc: 1.0000 - val_loss: 2.4599 - val_acc: 0.6080 Learning rate: 1e-05 Epoch 130/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0660 - acc: 1.0000 Epoch 00130: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0660 - acc: 1.0000 - val_loss: 2.4649 - val_acc: 0.6120 Learning rate: 1e-05 Epoch 131/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0660 - acc: 1.0000 Epoch 00131: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0660 - acc: 1.0000 - val_loss: 2.4654 - val_acc: 0.6100 Learning rate: 1e-05 Epoch 132/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0659 - acc: 1.0000 Epoch 00132: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.0659 - acc: 1.0000 - val_loss: 2.4722 - val_acc: 0.6000 Learning rate: 1e-05 Epoch 133/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0659 - acc: 1.0000 Epoch 00133: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.0659 - acc: 1.0000 - val_loss: 2.4743 - val_acc: 0.6020 Learning rate: 1e-05 Epoch 134/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0657 - acc: 1.0000 Epoch 00134: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.0657 - acc: 1.0000 - val_loss: 2.4747 - val_acc: 0.6100 Learning rate: 1e-05 Epoch 135/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0657 - acc: 1.0000 Epoch 00135: val_acc did not improve 20000/20000 [==============================] - 89s 4ms/step - loss: 0.0657 - acc: 1.0000 - val_loss: 2.4735 - val_acc: 0.6040 Learning rate: 1e-05 Epoch 136/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0655 - acc: 1.0000 Epoch 00136: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.0655 - acc: 1.0000 - val_loss: 2.4763 - val_acc: 0.6040 Learning rate: 1e-05 Epoch 137/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0654 - acc: 1.0000 Epoch 00137: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.0654 - acc: 1.0000 - val_loss: 2.4752 - val_acc: 0.6020 Learning rate: 1e-05 Epoch 138/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0654 - acc: 1.0000 Epoch 00138: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0655 - acc: 1.0000 - val_loss: 2.4690 - val_acc: 0.6040 Learning rate: 1e-05 Epoch 139/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0653 - acc: 1.0000 Epoch 00139: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0653 - acc: 1.0000 - val_loss: 2.4633 - val_acc: 0.6060 Learning rate: 1e-05 Epoch 140/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0651 - acc: 1.0000 Epoch 00140: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0651 - acc: 1.0000 - val_loss: 2.4702 - val_acc: 0.6060 Learning rate: 1e-05 Epoch 141/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0651 - acc: 1.0000 Epoch 00141: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0652 - acc: 1.0000 - val_loss: 2.4639 - val_acc: 0.6080 Learning rate: 1e-05 Epoch 142/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0653 - acc: 1.0000 Epoch 00142: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0653 - acc: 1.0000 - val_loss: 2.4688 - val_acc: 0.6120 Learning rate: 1e-05 Epoch 143/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0650 - acc: 1.0000 Epoch 00143: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0650 - acc: 1.0000 - val_loss: 2.4832 - val_acc: 0.6060 Learning rate: 1e-05 Epoch 144/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0649 - acc: 1.0000 Epoch 00144: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0649 - acc: 1.0000 - val_loss: 2.4797 - val_acc: 0.6040 Learning rate: 1e-05 Epoch 145/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0650 - acc: 1.0000 Epoch 00145: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0650 - acc: 1.0000 - val_loss: 2.4790 - val_acc: 0.6080 Learning rate: 1e-05 Epoch 146/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0649 - acc: 1.0000 Epoch 00146: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.0649 - acc: 1.0000 - val_loss: 2.4721 - val_acc: 0.6000 Learning rate: 1e-05 Epoch 147/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0647 - acc: 0.9999 Epoch 00147: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.0647 - acc: 1.0000 - val_loss: 2.4751 - val_acc: 0.6000 Learning rate: 1e-05 Epoch 148/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0647 - acc: 0.9999 Epoch 00148: val_acc did not improve 20000/20000 [==============================] - 90s 4ms/step - loss: 0.0647 - acc: 1.0000 - val_loss: 2.4759 - val_acc: 0.5980 Learning rate: 1e-05 Epoch 149/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0646 - acc: 1.0000 Epoch 00149: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0646 - acc: 1.0000 - val_loss: 2.4768 - val_acc: 0.6000 Learning rate: 1e-05 Epoch 150/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0645 - acc: 1.0000 Epoch 00150: val_acc did not improve 20000/20000 [==============================] - 92s 5ms/step - loss: 0.0645 - acc: 1.0000 - val_loss: 2.4797 - val_acc: 0.6020 Learning rate: 1e-05 Epoch 151/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0644 - acc: 1.0000 Epoch 00151: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0644 - acc: 1.0000 - val_loss: 2.4785 - val_acc: 0.5980 Learning rate: 1e-05 Epoch 152/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0643 - acc: 1.0000 Epoch 00152: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.0643 - acc: 1.0000 - val_loss: 2.4847 - val_acc: 0.5980 Learning rate: 1e-05 Epoch 153/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0642 - acc: 1.0000 Epoch 00153: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0642 - acc: 1.0000 - val_loss: 2.4887 - val_acc: 0.6020 Learning rate: 1e-05 Epoch 154/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0642 - acc: 1.0000 Epoch 00154: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0642 - acc: 1.0000 - val_loss: 2.4807 - val_acc: 0.6000 Learning rate: 1e-05 Epoch 155/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0639 - acc: 1.0000 Epoch 00155: val_acc did not improve 20000/20000 [==============================] - 93s 5ms/step - loss: 0.0639 - acc: 1.0000 - val_loss: 2.4842 - val_acc: 0.6000 Learning rate: 1e-05 Epoch 156/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0639 - acc: 1.0000 Epoch 00156: val_acc did not improve 20000/20000 [==============================] - 90s 4ms/step - loss: 0.0639 - acc: 1.0000 - val_loss: 2.4750 - val_acc: 0.6040 Learning rate: 1e-05 Epoch 157/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0639 - acc: 1.0000 Epoch 00157: val_acc did not improve 20000/20000 [==============================] - 90s 4ms/step - loss: 0.0639 - acc: 1.0000 - val_loss: 2.4832 - val_acc: 0.6040 Learning rate: 1e-05 Epoch 158/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0638 - acc: 1.0000 Epoch 00158: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.0638 - acc: 1.0000 - val_loss: 2.4910 - val_acc: 0.6060 Learning rate: 1e-05 Epoch 159/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0636 - acc: 1.0000 Epoch 00159: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.0636 - acc: 1.0000 - val_loss: 2.4761 - val_acc: 0.6040 Learning rate: 1e-05 Epoch 160/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0636 - acc: 1.0000 Epoch 00160: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.0636 - acc: 1.0000 - val_loss: 2.4783 - val_acc: 0.6040 Learning rate: 1e-05 Epoch 161/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0635 - acc: 0.9999 Epoch 00161: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.0635 - acc: 1.0000 - val_loss: 2.4850 - val_acc: 0.6120 Learning rate: 1e-06 Epoch 162/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0634 - acc: 1.0000 Epoch 00162: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.0635 - acc: 1.0000 - val_loss: 2.4845 - val_acc: 0.6040 Learning rate: 1e-06 Epoch 163/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00163: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4844 - val_acc: 0.5980 Learning rate: 1e-06 Epoch 164/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00164: val_acc did not improve 20000/20000 [==============================] - 90s 5ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4869 - val_acc: 0.6020 Learning rate: 1e-06 Epoch 165/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0634 - acc: 1.0000 Epoch 00165: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.0637 - acc: 0.9999 - val_loss: 2.4867 - val_acc: 0.6000 Learning rate: 1e-06 Epoch 166/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00166: val_acc did not improve 20000/20000 [==============================] - 90s 4ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4872 - val_acc: 0.5960 Learning rate: 1e-06 Epoch 167/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0634 - acc: 1.0000 Epoch 00167: val_acc did not improve 20000/20000 [==============================] - 90s 5ms/step - loss: 0.0634 - acc: 1.0000 - val_loss: 2.4839 - val_acc: 0.5980 Learning rate: 1e-06 Epoch 168/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00168: val_acc did not improve 20000/20000 [==============================] - 90s 5ms/step - loss: 0.0634 - acc: 1.0000 - val_loss: 2.4866 - val_acc: 0.6000 Learning rate: 1e-06 Epoch 169/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00169: val_acc did not improve 20000/20000 [==============================] - 90s 5ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4852 - val_acc: 0.5960 Learning rate: 1e-06 Epoch 170/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0634 - acc: 1.0000 Epoch 00170: val_acc did not improve 20000/20000 [==============================] - 90s 5ms/step - loss: 0.0634 - acc: 1.0000 - val_loss: 2.4865 - val_acc: 0.5980 Learning rate: 1e-06 Epoch 171/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00171: val_acc did not improve 20000/20000 [==============================] - 90s 5ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4876 - val_acc: 0.6000 Learning rate: 1e-06 Epoch 172/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0634 - acc: 1.0000 Epoch 00172: val_acc did not improve 20000/20000 [==============================] - 90s 5ms/step - loss: 0.0634 - acc: 1.0000 - val_loss: 2.4898 - val_acc: 0.6040 Learning rate: 1e-06 Epoch 173/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0632 - acc: 1.0000 Epoch 00173: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.0632 - acc: 1.0000 - val_loss: 2.4887 - val_acc: 0.5960 Learning rate: 1e-06 Epoch 174/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00174: val_acc did not improve 20000/20000 [==============================] - 92s 5ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4906 - val_acc: 0.6040 Learning rate: 1e-06 Epoch 175/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00175: val_acc did not improve 20000/20000 [==============================] - 92s 5ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4880 - val_acc: 0.6020 Learning rate: 1e-06 Epoch 176/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00176: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4883 - val_acc: 0.6020 Learning rate: 1e-06 Epoch 177/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0632 - acc: 1.0000 Epoch 00177: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.0632 - acc: 1.0000 - val_loss: 2.4861 - val_acc: 0.5960 Learning rate: 1e-06 Epoch 178/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00178: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4904 - val_acc: 0.6040 Learning rate: 1e-06 Epoch 179/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 0.9999 Epoch 00179: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4898 - val_acc: 0.6040 Learning rate: 1e-06 Epoch 180/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0632 - acc: 1.0000 Epoch 00180: val_acc did not improve 20000/20000 [==============================] - 91s 5ms/step - loss: 0.0632 - acc: 1.0000 - val_loss: 2.4898 - val_acc: 0.6000 Learning rate: 1e-06 Epoch 181/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00181: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4890 - val_acc: 0.5960 Learning rate: 5e-07 Epoch 182/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0632 - acc: 1.0000 Epoch 00182: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0632 - acc: 1.0000 - val_loss: 2.4893 - val_acc: 0.5960 Learning rate: 5e-07 Epoch 183/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0632 - acc: 1.0000 Epoch 00183: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0632 - acc: 1.0000 - val_loss: 2.4870 - val_acc: 0.5980 Learning rate: 5e-07 Epoch 184/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0631 - acc: 1.0000 Epoch 00184: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0632 - acc: 1.0000 - val_loss: 2.4875 - val_acc: 0.5980 Learning rate: 5e-07 Epoch 185/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00185: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4883 - val_acc: 0.6000 Learning rate: 5e-07 Epoch 186/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0632 - acc: 1.0000 Epoch 00186: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0632 - acc: 1.0000 - val_loss: 2.4885 - val_acc: 0.5980 Learning rate: 5e-07 Epoch 187/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00187: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0634 - acc: 1.0000 - val_loss: 2.4894 - val_acc: 0.6000 Learning rate: 5e-07 Epoch 188/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0631 - acc: 1.0000 Epoch 00188: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0632 - acc: 1.0000 - val_loss: 2.4876 - val_acc: 0.6000 Learning rate: 5e-07 Epoch 189/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0632 - acc: 1.0000 Epoch 00189: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0632 - acc: 1.0000 - val_loss: 2.4879 - val_acc: 0.6000 Learning rate: 5e-07 Epoch 190/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0632 - acc: 1.0000 Epoch 00190: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0632 - acc: 1.0000 - val_loss: 2.4872 - val_acc: 0.5960 Learning rate: 5e-07 Epoch 191/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00191: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4866 - val_acc: 0.5960 Learning rate: 5e-07 Epoch 192/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00192: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4882 - val_acc: 0.5960 Learning rate: 5e-07 Epoch 193/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0631 - acc: 1.0000 Epoch 00193: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0631 - acc: 1.0000 - val_loss: 2.4902 - val_acc: 0.6000 Learning rate: 5e-07 Epoch 194/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0632 - acc: 1.0000 Epoch 00194: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4892 - val_acc: 0.5980 Learning rate: 5e-07 Epoch 195/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0632 - acc: 1.0000 Epoch 00195: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0632 - acc: 1.0000 - val_loss: 2.4873 - val_acc: 0.5960 Learning rate: 5e-07 Epoch 196/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0632 - acc: 1.0000 Epoch 00196: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0632 - acc: 1.0000 - val_loss: 2.4908 - val_acc: 0.6000 Learning rate: 5e-07 Epoch 197/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 1.0000 Epoch 00197: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4893 - val_acc: 0.6020 Learning rate: 5e-07 Epoch 198/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0631 - acc: 1.0000 Epoch 00198: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.0632 - acc: 1.0000 - val_loss: 2.4889 - val_acc: 0.5980 Learning rate: 5e-07 Epoch 199/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0632 - acc: 1.0000 Epoch 00199: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0632 - acc: 1.0000 - val_loss: 2.4904 - val_acc: 0.6020 Learning rate: 5e-07 Epoch 200/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0632 - acc: 1.0000 Epoch 00200: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0633 - acc: 1.0000 - val_loss: 2.4902 - val_acc: 0.6040 10000/10000 [==============================] - 15s 1ms/step Initial Simple Model Accuracy: 0.6364
List of all filenames - each of which contains the probe confidences of a specific layer corresponding to the samples in x_train2,y_train2 dataset. This is assumed to have been obtained using functions in attach_probe_checkpoint.py and train_probes.py.
list_probe_filenames=[parent_dir+'/probe_output/probe_2_out_pred'+str(x)+'.npy' for x in range(10,17)]
Specify a new checkpoint for the simple model with Prof Weight + set identical hyper parameters for learning rate schedule and training.
save_dir = os.path.join(os.getcwd(), 'saved_models')
model_name = 'resnet_target_model_weighted.h5'
if not os.path.isdir(save_dir):
os.makedirs(save_dir)
filepath = os.path.join(save_dir, model_name)
hps = HParams(lr_scheduler=lr_scheduler,lr_reducer=lr_reducer,batch_size=128,epochs=200,checkpoint_path=filepath,num_classes=10,complexity_param=1,optimizer=Adam(lr=lr_schedule(0)))
Learning rate: 0.001
Call the ProfWeight Explainer Class's explain function - This is same as the fit function but additionally specifies list of probe filenames and start and end layer whose confidences need to be averaged to be used as the sample weights. This explain function also scores the new simple model obtained after weighted training on the test data set.
a.explain(x_train2,y_train2,x_test,y_test,resnet_v1,hps,list_probe_filenames,2,6,'neural_keras')
__________________________________________________________________________________________________ Layer (type) Output Shape Param # Connected to ================================================================================================== input_2 (InputLayer) (None, 32, 32, 3) 0 __________________________________________________________________________________________________ conv2d_10 (Conv2D) (None, 32, 32, 16) 448 input_2[0][0] __________________________________________________________________________________________________ batch_normalization_8 (BatchNor (None, 32, 32, 16) 64 conv2d_10[0][0] __________________________________________________________________________________________________ activation_8 (Activation) (None, 32, 32, 16) 0 batch_normalization_8[0][0] __________________________________________________________________________________________________ conv2d_11 (Conv2D) (None, 32, 32, 16) 2320 activation_8[0][0] __________________________________________________________________________________________________ batch_normalization_9 (BatchNor (None, 32, 32, 16) 64 conv2d_11[0][0] __________________________________________________________________________________________________ activation_9 (Activation) (None, 32, 32, 16) 0 batch_normalization_9[0][0] __________________________________________________________________________________________________ conv2d_12 (Conv2D) (None, 32, 32, 16) 2320 activation_9[0][0] __________________________________________________________________________________________________ batch_normalization_10 (BatchNo (None, 32, 32, 16) 64 conv2d_12[0][0] __________________________________________________________________________________________________ add_4 (Add) (None, 32, 32, 16) 0 activation_8[0][0] batch_normalization_10[0][0] __________________________________________________________________________________________________ activation_10 (Activation) (None, 32, 32, 16) 0 add_4[0][0] __________________________________________________________________________________________________ conv2d_13 (Conv2D) (None, 16, 16, 32) 4640 activation_10[0][0] __________________________________________________________________________________________________ batch_normalization_11 (BatchNo (None, 16, 16, 32) 128 conv2d_13[0][0] __________________________________________________________________________________________________ activation_11 (Activation) (None, 16, 16, 32) 0 batch_normalization_11[0][0] __________________________________________________________________________________________________ conv2d_14 (Conv2D) (None, 16, 16, 32) 9248 activation_11[0][0] __________________________________________________________________________________________________ conv2d_15 (Conv2D) (None, 16, 16, 32) 544 activation_10[0][0] __________________________________________________________________________________________________ batch_normalization_12 (BatchNo (None, 16, 16, 32) 128 conv2d_14[0][0] __________________________________________________________________________________________________ add_5 (Add) (None, 16, 16, 32) 0 conv2d_15[0][0] batch_normalization_12[0][0] __________________________________________________________________________________________________ activation_12 (Activation) (None, 16, 16, 32) 0 add_5[0][0] __________________________________________________________________________________________________ conv2d_16 (Conv2D) (None, 8, 8, 64) 18496 activation_12[0][0] __________________________________________________________________________________________________ batch_normalization_13 (BatchNo (None, 8, 8, 64) 256 conv2d_16[0][0] __________________________________________________________________________________________________ activation_13 (Activation) (None, 8, 8, 64) 0 batch_normalization_13[0][0] __________________________________________________________________________________________________ conv2d_17 (Conv2D) (None, 8, 8, 64) 36928 activation_13[0][0] __________________________________________________________________________________________________ conv2d_18 (Conv2D) (None, 8, 8, 64) 2112 activation_12[0][0] __________________________________________________________________________________________________ batch_normalization_14 (BatchNo (None, 8, 8, 64) 256 conv2d_17[0][0] __________________________________________________________________________________________________ add_6 (Add) (None, 8, 8, 64) 0 conv2d_18[0][0] batch_normalization_14[0][0] __________________________________________________________________________________________________ activation_14 (Activation) (None, 8, 8, 64) 0 add_6[0][0] __________________________________________________________________________________________________ average_pooling2d_2 (AveragePoo (None, 1, 1, 64) 0 activation_14[0][0] __________________________________________________________________________________________________ flatten_2 (Flatten) (None, 64) 0 average_pooling2d_2[0][0] __________________________________________________________________________________________________ dense_2 (Dense) (None, 10) 650 flatten_2[0][0] ================================================================================================== Total params: 78,666 Trainable params: 78,186 Non-trainable params: 480 __________________________________________________________________________________________________ Train on 20000 samples, validate on 500 samples Learning rate: 0.001 Epoch 1/200 19968/20000 [============================>.] - ETA: 0s - loss: 1.3629 - acc: 0.3731 Epoch 00001: val_acc improved from -inf to 0.34000, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 84s 4ms/step - loss: 1.3625 - acc: 0.3733 - val_loss: 1.8125 - val_acc: 0.3400 Learning rate: 0.001 Epoch 2/200 19968/20000 [============================>.] - ETA: 0s - loss: 1.0352 - acc: 0.5020 Epoch 00002: val_acc improved from 0.34000 to 0.40200, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 83s 4ms/step - loss: 1.0350 - acc: 0.5019 - val_loss: 1.8655 - val_acc: 0.4020 Learning rate: 0.001 Epoch 3/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.8876 - acc: 0.5634 Epoch 00003: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.8878 - acc: 0.5632 - val_loss: 1.7293 - val_acc: 0.3940 Learning rate: 0.001 Epoch 4/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.7974 - acc: 0.5972 Epoch 00004: val_acc improved from 0.40200 to 0.56800, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 84s 4ms/step - loss: 0.7976 - acc: 0.5970 - val_loss: 1.2677 - val_acc: 0.5680 Learning rate: 0.001 Epoch 5/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.7146 - acc: 0.6343 Epoch 00005: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.7145 - acc: 0.6344 - val_loss: 1.5109 - val_acc: 0.4760 Learning rate: 0.001 Epoch 6/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.6566 - acc: 0.6574 Epoch 00006: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.6565 - acc: 0.6572 - val_loss: 1.6429 - val_acc: 0.5040 Learning rate: 0.001 Epoch 7/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.6042 - acc: 0.6796 Epoch 00007: val_acc improved from 0.56800 to 0.59400, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 84s 4ms/step - loss: 0.6045 - acc: 0.6794 - val_loss: 1.1950 - val_acc: 0.5940 Learning rate: 0.001 Epoch 8/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.5631 - acc: 0.6968 Epoch 00008: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.5630 - acc: 0.6966 - val_loss: 1.5353 - val_acc: 0.4900 Learning rate: 0.001 Epoch 9/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.5159 - acc: 0.7171 Epoch 00009: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.5159 - acc: 0.7171 - val_loss: 1.3132 - val_acc: 0.5880 Learning rate: 0.001 Epoch 10/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.4871 - acc: 0.7240 Epoch 00010: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.4871 - acc: 0.7242 - val_loss: 1.5911 - val_acc: 0.5100 Learning rate: 0.001 Epoch 11/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.4496 - acc: 0.7440 Epoch 00011: val_acc improved from 0.59400 to 0.61600, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 83s 4ms/step - loss: 0.4497 - acc: 0.7439 - val_loss: 1.2388 - val_acc: 0.6160 Learning rate: 0.001 Epoch 12/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.4194 - acc: 0.7586 Epoch 00012: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.4192 - acc: 0.7587 - val_loss: 1.3255 - val_acc: 0.6040 Learning rate: 0.001 Epoch 13/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.3897 - acc: 0.7711 Epoch 00013: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.3895 - acc: 0.7711 - val_loss: 1.7558 - val_acc: 0.5180 Learning rate: 0.001 Epoch 14/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.3648 - acc: 0.7805 Epoch 00014: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.3653 - acc: 0.7803 - val_loss: 1.3449 - val_acc: 0.6100 Learning rate: 0.001 Epoch 15/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.3428 - acc: 0.7918 Epoch 00015: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.3428 - acc: 0.7918 - val_loss: 1.4443 - val_acc: 0.6120 Learning rate: 0.001 Epoch 16/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.3115 - acc: 0.8069 Epoch 00016: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.3115 - acc: 0.8069 - val_loss: 2.1172 - val_acc: 0.4660 Learning rate: 0.001 Epoch 17/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2919 - acc: 0.8152 Epoch 00017: val_acc improved from 0.61600 to 0.62000, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 82s 4ms/step - loss: 0.2922 - acc: 0.8152 - val_loss: 1.2935 - val_acc: 0.6200 Learning rate: 0.001 Epoch 18/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2703 - acc: 0.8247 Epoch 00018: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.2704 - acc: 0.8246 - val_loss: 1.5217 - val_acc: 0.5980 Learning rate: 0.001 Epoch 19/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2528 - acc: 0.8345 Epoch 00019: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.2531 - acc: 0.8343 - val_loss: 1.4426 - val_acc: 0.6000 Learning rate: 0.001 Epoch 20/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2398 - acc: 0.8391 Epoch 00020: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.2400 - acc: 0.8389 - val_loss: 1.8150 - val_acc: 0.5780 Learning rate: 0.001 Epoch 21/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2277 - acc: 0.8463 Epoch 00021: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.2279 - acc: 0.8463 - val_loss: 1.5997 - val_acc: 0.5840 Learning rate: 0.001 Epoch 22/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2096 - acc: 0.8548 Epoch 00022: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.2097 - acc: 0.8548 - val_loss: 2.4682 - val_acc: 0.5080 Learning rate: 0.001 Epoch 23/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1986 - acc: 0.8591 Epoch 00023: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1986 - acc: 0.8591 - val_loss: 1.9452 - val_acc: 0.5600 Learning rate: 0.001 Epoch 24/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1884 - acc: 0.8646 Epoch 00024: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1886 - acc: 0.8645 - val_loss: 2.0089 - val_acc: 0.5560 Learning rate: 0.001 Epoch 25/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1869 - acc: 0.8652 Epoch 00025: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.1871 - acc: 0.8653 - val_loss: 1.9945 - val_acc: 0.5780 Learning rate: 0.001 Epoch 26/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1798 - acc: 0.8678 Epoch 00026: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1797 - acc: 0.8679 - val_loss: 2.0091 - val_acc: 0.5920 Learning rate: 0.001 Epoch 27/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1583 - acc: 0.8800 Epoch 00027: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1585 - acc: 0.8799 - val_loss: 1.8829 - val_acc: 0.6040 Learning rate: 0.001 Epoch 28/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1601 - acc: 0.8788 Epoch 00028: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1602 - acc: 0.8787 - val_loss: 2.5501 - val_acc: 0.5540 Learning rate: 0.001 Epoch 29/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1521 - acc: 0.8812 Epoch 00029: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1521 - acc: 0.8813 - val_loss: 2.4368 - val_acc: 0.5140 Learning rate: 0.001 Epoch 30/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1407 - acc: 0.8882 Epoch 00030: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1407 - acc: 0.8881 - val_loss: 2.8118 - val_acc: 0.5100 Learning rate: 0.001 Epoch 31/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1435 - acc: 0.8867 Epoch 00031: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1439 - acc: 0.8863 - val_loss: 2.2212 - val_acc: 0.5640 Learning rate: 0.001 Epoch 32/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1683 - acc: 0.8731 Epoch 00032: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1685 - acc: 0.8731 - val_loss: 2.2477 - val_acc: 0.5720 Learning rate: 0.001 Epoch 33/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1378 - acc: 0.8904 Epoch 00033: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1380 - acc: 0.8903 - val_loss: 2.2082 - val_acc: 0.5620 Learning rate: 0.001 Epoch 34/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1395 - acc: 0.8878 Epoch 00034: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1395 - acc: 0.8877 - val_loss: 1.9936 - val_acc: 0.6060 Learning rate: 0.001 Epoch 35/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1248 - acc: 0.8975 Epoch 00035: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1248 - acc: 0.8976 - val_loss: 2.5040 - val_acc: 0.5200 Learning rate: 0.001 Epoch 36/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1251 - acc: 0.8941 Epoch 00036: val_acc improved from 0.62000 to 0.62200, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1251 - acc: 0.8943 - val_loss: 1.8172 - val_acc: 0.6220 Learning rate: 0.001 Epoch 37/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1217 - acc: 0.8988 Epoch 00037: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1218 - acc: 0.8987 - val_loss: 2.2856 - val_acc: 0.6080 Learning rate: 0.001 Epoch 38/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1354 - acc: 0.8912 Epoch 00038: val_acc improved from 0.62200 to 0.63200, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 83s 4ms/step - loss: 0.1354 - acc: 0.8910 - val_loss: 1.7511 - val_acc: 0.6320 Learning rate: 0.001 Epoch 39/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1251 - acc: 0.8977 Epoch 00039: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.1255 - acc: 0.8976 - val_loss: 2.2910 - val_acc: 0.5800 Learning rate: 0.001 Epoch 40/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1656 - acc: 0.8758 Epoch 00040: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1660 - acc: 0.8756 - val_loss: 2.9480 - val_acc: 0.5640 Learning rate: 0.001 Epoch 41/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1332 - acc: 0.8918 Epoch 00041: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1332 - acc: 0.8918 - val_loss: 2.4033 - val_acc: 0.5800 Learning rate: 0.001 Epoch 42/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1154 - acc: 0.9017 Epoch 00042: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.1155 - acc: 0.9017 - val_loss: 2.0254 - val_acc: 0.6100 Learning rate: 0.001 Epoch 43/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1126 - acc: 0.9055 Epoch 00043: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1126 - acc: 0.9053 - val_loss: 2.5272 - val_acc: 0.5660 Learning rate: 0.001 Epoch 44/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0999 - acc: 0.9103 Epoch 00044: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0999 - acc: 0.9103 - val_loss: 1.9496 - val_acc: 0.6300 Learning rate: 0.001 Epoch 45/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0959 - acc: 0.9130 Epoch 00045: val_acc improved from 0.63200 to 0.65200, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0960 - acc: 0.9130 - val_loss: 1.8603 - val_acc: 0.6520 Learning rate: 0.001 Epoch 46/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1202 - acc: 0.9001 Epoch 00046: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1206 - acc: 0.9000 - val_loss: 3.4532 - val_acc: 0.5100 Learning rate: 0.001 Epoch 47/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1979 - acc: 0.8628 Epoch 00047: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1978 - acc: 0.8627 - val_loss: 2.2592 - val_acc: 0.6040 Learning rate: 0.001 Epoch 48/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1180 - acc: 0.9032 Epoch 00048: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1180 - acc: 0.9032 - val_loss: 3.8494 - val_acc: 0.4820 Learning rate: 0.001 Epoch 49/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0983 - acc: 0.9128 Epoch 00049: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0983 - acc: 0.9129 - val_loss: 2.0801 - val_acc: 0.6300 Learning rate: 0.001 Epoch 50/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0838 - acc: 0.9205 Epoch 00050: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0838 - acc: 0.9205 - val_loss: 1.8530 - val_acc: 0.6400 Learning rate: 0.001 Epoch 51/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0882 - acc: 0.9178 Epoch 00051: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0882 - acc: 0.9179 - val_loss: 2.2185 - val_acc: 0.6220 Learning rate: 0.001 Epoch 52/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0963 - acc: 0.9150 Epoch 00052: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0964 - acc: 0.9149 - val_loss: 2.8008 - val_acc: 0.6060 Learning rate: 0.001 Epoch 53/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1259 - acc: 0.8982 Epoch 00053: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1259 - acc: 0.8982 - val_loss: 2.8354 - val_acc: 0.5540 Learning rate: 0.001 Epoch 54/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1369 - acc: 0.8915 Epoch 00054: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.1370 - acc: 0.8912 - val_loss: 4.0077 - val_acc: 0.4560 Learning rate: 0.001 Epoch 55/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1293 - acc: 0.8973 Epoch 00055: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1293 - acc: 0.8975 - val_loss: 2.1551 - val_acc: 0.6080 Learning rate: 0.001 Epoch 56/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1202 - acc: 0.8977 Epoch 00056: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.1202 - acc: 0.8978 - val_loss: 2.1962 - val_acc: 0.6000 Learning rate: 0.001 Epoch 57/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0972 - acc: 0.9135 Epoch 00057: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.0972 - acc: 0.9136 - val_loss: 2.3782 - val_acc: 0.6080 Learning rate: 0.001 Epoch 58/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0871 - acc: 0.9213 Epoch 00058: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0871 - acc: 0.9213 - val_loss: 2.1894 - val_acc: 0.6380 Learning rate: 0.001 Epoch 59/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0789 - acc: 0.9252 Epoch 00059: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0791 - acc: 0.9252 - val_loss: 1.9817 - val_acc: 0.6440 Learning rate: 0.001 Epoch 60/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1147 - acc: 0.9039 Epoch 00060: val_acc did not improve 20000/20000 [==============================] - 90s 4ms/step - loss: 0.1148 - acc: 0.9039 - val_loss: 2.6443 - val_acc: 0.5940 Learning rate: 0.001 Epoch 61/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1360 - acc: 0.8936 Epoch 00061: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.1361 - acc: 0.8936 - val_loss: 4.9183 - val_acc: 0.3640 Learning rate: 0.001 Epoch 62/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1366 - acc: 0.8943 Epoch 00062: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.1365 - acc: 0.8943 - val_loss: 3.1165 - val_acc: 0.5560 Learning rate: 0.001 Epoch 63/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0972 - acc: 0.9142 Epoch 00063: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.0972 - acc: 0.9142 - val_loss: 2.2720 - val_acc: 0.5880 Learning rate: 0.001 Epoch 64/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0856 - acc: 0.9199 Epoch 00064: val_acc improved from 0.65200 to 0.66400, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 82s 4ms/step - loss: 0.0856 - acc: 0.9200 - val_loss: 1.9621 - val_acc: 0.6640 Learning rate: 0.001 Epoch 65/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0760 - acc: 0.9268 Epoch 00065: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0761 - acc: 0.9268 - val_loss: 2.0084 - val_acc: 0.6640 Learning rate: 0.001 Epoch 66/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0849 - acc: 0.9218 Epoch 00066: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0849 - acc: 0.9219 - val_loss: 2.7412 - val_acc: 0.6060 Learning rate: 0.001 Epoch 67/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0994 - acc: 0.9131 Epoch 00067: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0994 - acc: 0.9131 - val_loss: 2.7860 - val_acc: 0.5840 Learning rate: 0.001 Epoch 68/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1368 - acc: 0.8916 Epoch 00068: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1369 - acc: 0.8917 - val_loss: 3.5017 - val_acc: 0.5540 Learning rate: 0.001 Epoch 69/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1421 - acc: 0.8891 Epoch 00069: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1421 - acc: 0.8891 - val_loss: 4.0718 - val_acc: 0.4700 Learning rate: 0.001 Epoch 70/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1074 - acc: 0.9098 Epoch 00070: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.1074 - acc: 0.9098 - val_loss: 2.0360 - val_acc: 0.6440 Learning rate: 0.001 Epoch 71/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0893 - acc: 0.9198 Epoch 00071: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0894 - acc: 0.9198 - val_loss: 3.2752 - val_acc: 0.5300 Learning rate: 0.001 Epoch 72/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0843 - acc: 0.9207 Epoch 00072: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0843 - acc: 0.9207 - val_loss: 2.1851 - val_acc: 0.6360 Learning rate: 0.001 Epoch 73/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0754 - acc: 0.9278 Epoch 00073: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0755 - acc: 0.9278 - val_loss: 2.1552 - val_acc: 0.6340 Learning rate: 0.001 Epoch 74/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0721 - acc: 0.9292 Epoch 00074: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0721 - acc: 0.9294 - val_loss: 1.9981 - val_acc: 0.6460 Learning rate: 0.001 Epoch 75/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0659 - acc: 0.9331 Epoch 00075: val_acc improved from 0.66400 to 0.67200, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0659 - acc: 0.9331 - val_loss: 1.9187 - val_acc: 0.6720 Learning rate: 0.001 Epoch 76/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0643 - acc: 0.9339 Epoch 00076: val_acc did not improve 20000/20000 [==============================] - 80s 4ms/step - loss: 0.0643 - acc: 0.9338 - val_loss: 2.1630 - val_acc: 0.6620 Learning rate: 0.001 Epoch 77/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0628 - acc: 0.9349 Epoch 00077: val_acc did not improve 20000/20000 [==============================] - 80s 4ms/step - loss: 0.0628 - acc: 0.9350 - val_loss: 2.0802 - val_acc: 0.6420 Learning rate: 0.001 Epoch 78/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.2322 - acc: 0.8555 Epoch 00078: val_acc did not improve 20000/20000 [==============================] - 80s 4ms/step - loss: 0.2326 - acc: 0.8553 - val_loss: 4.0073 - val_acc: 0.4900 Learning rate: 0.001 Epoch 79/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1854 - acc: 0.8698 Epoch 00079: val_acc did not improve 20000/20000 [==============================] - 80s 4ms/step - loss: 0.1853 - acc: 0.8700 - val_loss: 2.1362 - val_acc: 0.5880 Learning rate: 0.001 Epoch 80/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.1022 - acc: 0.9119 Epoch 00080: val_acc did not improve 20000/20000 [==============================] - 80s 4ms/step - loss: 0.1023 - acc: 0.9120 - val_loss: 2.4133 - val_acc: 0.6080 Learning rate: 0.001 Epoch 81/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0854 - acc: 0.9225 Epoch 00081: val_acc did not improve 20000/20000 [==============================] - 80s 4ms/step - loss: 0.0854 - acc: 0.9225 - val_loss: 2.0171 - val_acc: 0.6140 Learning rate: 0.0001 Epoch 82/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0723 - acc: 0.9309 Epoch 00082: val_acc improved from 0.67200 to 0.68200, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 80s 4ms/step - loss: 0.0723 - acc: 0.9308 - val_loss: 1.7146 - val_acc: 0.6820 Learning rate: 0.0001 Epoch 83/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0693 - acc: 0.9327 Epoch 00083: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0694 - acc: 0.9326 - val_loss: 1.7464 - val_acc: 0.6800 Learning rate: 0.0001 Epoch 84/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0682 - acc: 0.9330 Epoch 00084: val_acc improved from 0.68200 to 0.68200, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0685 - acc: 0.9330 - val_loss: 1.7338 - val_acc: 0.6820 Learning rate: 0.0001 Epoch 85/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0675 - acc: 0.9332 Epoch 00085: val_acc improved from 0.68200 to 0.68600, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0675 - acc: 0.9332 - val_loss: 1.7476 - val_acc: 0.6860 Learning rate: 0.0001 Epoch 86/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0670 - acc: 0.9330 Epoch 00086: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0670 - acc: 0.9330 - val_loss: 1.7452 - val_acc: 0.6840 Learning rate: 0.0001 Epoch 87/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0664 - acc: 0.9341 Epoch 00087: val_acc improved from 0.68600 to 0.68600, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0664 - acc: 0.9341 - val_loss: 1.7541 - val_acc: 0.6860 Learning rate: 0.0001 Epoch 88/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0658 - acc: 0.9344 Epoch 00088: val_acc did not improve 20000/20000 [==============================] - 80s 4ms/step - loss: 0.0658 - acc: 0.9344 - val_loss: 1.7468 - val_acc: 0.6780 Learning rate: 0.0001 Epoch 89/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0655 - acc: 0.9343 Epoch 00089: val_acc did not improve 20000/20000 [==============================] - 80s 4ms/step - loss: 0.0656 - acc: 0.9342 - val_loss: 1.7672 - val_acc: 0.6760 Learning rate: 0.0001 Epoch 90/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0651 - acc: 0.9341 Epoch 00090: val_acc did not improve 20000/20000 [==============================] - 80s 4ms/step - loss: 0.0651 - acc: 0.9342 - val_loss: 1.7668 - val_acc: 0.6820 Learning rate: 0.0001 Epoch 91/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0648 - acc: 0.9357 Epoch 00091: val_acc improved from 0.68600 to 0.69000, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0648 - acc: 0.9357 - val_loss: 1.7704 - val_acc: 0.6900 Learning rate: 0.0001 Epoch 92/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0644 - acc: 0.9348 Epoch 00092: val_acc did not improve 20000/20000 [==============================] - 80s 4ms/step - loss: 0.0645 - acc: 0.9347 - val_loss: 1.7688 - val_acc: 0.6840 Learning rate: 0.0001 Epoch 93/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0640 - acc: 0.9358 Epoch 00093: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0640 - acc: 0.9357 - val_loss: 1.7954 - val_acc: 0.6800 Learning rate: 0.0001 Epoch 94/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0637 - acc: 0.9358 Epoch 00094: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0637 - acc: 0.9359 - val_loss: 1.7979 - val_acc: 0.6720 Learning rate: 0.0001 Epoch 95/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0633 - acc: 0.9366 Epoch 00095: val_acc did not improve 20000/20000 [==============================] - 81s 4ms/step - loss: 0.0633 - acc: 0.9366 - val_loss: 1.8099 - val_acc: 0.6820 Learning rate: 0.0001 Epoch 96/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0628 - acc: 0.9357 Epoch 00096: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.0628 - acc: 0.9358 - val_loss: 1.7989 - val_acc: 0.6820 Learning rate: 0.0001 Epoch 97/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0625 - acc: 0.9363 Epoch 00097: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.0625 - acc: 0.9363 - val_loss: 1.8067 - val_acc: 0.6840 Learning rate: 0.0001 Epoch 98/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0620 - acc: 0.9366 Epoch 00098: val_acc did not improve 20000/20000 [==============================] - 82s 4ms/step - loss: 0.0620 - acc: 0.9366 - val_loss: 1.8088 - val_acc: 0.6800 Learning rate: 0.0001 Epoch 99/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0616 - acc: 0.9361 Epoch 00099: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0616 - acc: 0.9362 - val_loss: 1.8229 - val_acc: 0.6800 Learning rate: 0.0001 Epoch 100/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0614 - acc: 0.9365 Epoch 00100: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0614 - acc: 0.9365 - val_loss: 1.8511 - val_acc: 0.6880 Learning rate: 0.0001 Epoch 101/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0607 - acc: 0.9364 Epoch 00101: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0607 - acc: 0.9362 - val_loss: 1.8381 - val_acc: 0.6820 Learning rate: 0.0001 Epoch 102/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0601 - acc: 0.9372 Epoch 00102: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0602 - acc: 0.9371 - val_loss: 1.8337 - val_acc: 0.6720 Learning rate: 0.0001 Epoch 103/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0596 - acc: 0.9372 Epoch 00103: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0596 - acc: 0.9371 - val_loss: 1.8453 - val_acc: 0.6760 Learning rate: 0.0001 Epoch 104/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0592 - acc: 0.9369 Epoch 00104: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0592 - acc: 0.9369 - val_loss: 1.8373 - val_acc: 0.6760 Learning rate: 0.0001 Epoch 105/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0588 - acc: 0.9381 Epoch 00105: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0588 - acc: 0.9381 - val_loss: 1.8490 - val_acc: 0.6720 Learning rate: 0.0001 Epoch 106/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0581 - acc: 0.9382 Epoch 00106: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0581 - acc: 0.9381 - val_loss: 1.8366 - val_acc: 0.6720 Learning rate: 0.0001 Epoch 107/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0576 - acc: 0.9381 Epoch 00107: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0576 - acc: 0.9380 - val_loss: 1.8733 - val_acc: 0.6820 Learning rate: 0.0001 Epoch 108/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0571 - acc: 0.9384 Epoch 00108: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0571 - acc: 0.9383 - val_loss: 1.8534 - val_acc: 0.6780 Learning rate: 0.0001 Epoch 109/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0564 - acc: 0.9381 Epoch 00109: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0567 - acc: 0.9378 - val_loss: 1.8978 - val_acc: 0.6740 Learning rate: 0.0001 Epoch 110/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0583 - acc: 0.9369 Epoch 00110: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0583 - acc: 0.9371 - val_loss: 1.8575 - val_acc: 0.6880 Learning rate: 0.0001 Epoch 111/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0559 - acc: 0.9388 Epoch 00111: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0559 - acc: 0.9388 - val_loss: 1.8460 - val_acc: 0.6780 Learning rate: 0.0001 Epoch 112/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0555 - acc: 0.9388 Epoch 00112: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0555 - acc: 0.9387 - val_loss: 1.8494 - val_acc: 0.6680 Learning rate: 0.0001 Epoch 113/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0547 - acc: 0.9387 Epoch 00113: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0547 - acc: 0.9385 - val_loss: 1.8962 - val_acc: 0.6720 Learning rate: 0.0001 Epoch 114/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0546 - acc: 0.9395 Epoch 00114: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0546 - acc: 0.9394 - val_loss: 1.9005 - val_acc: 0.6800 Learning rate: 0.0001 Epoch 115/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0538 - acc: 0.9389 Epoch 00115: val_acc did not improve 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0538 - acc: 0.9388 - val_loss: 1.9350 - val_acc: 0.6760 Learning rate: 0.0001 Epoch 116/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0532 - acc: 0.9393 Epoch 00116: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0532 - acc: 0.9392 - val_loss: 1.8662 - val_acc: 0.6780 Learning rate: 0.0001 Epoch 117/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0530 - acc: 0.9393 Epoch 00117: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0530 - acc: 0.9393 - val_loss: 1.8919 - val_acc: 0.6820 Learning rate: 0.0001 Epoch 118/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0523 - acc: 0.9403 Epoch 00118: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0524 - acc: 0.9403 - val_loss: 1.9177 - val_acc: 0.6800 Learning rate: 0.0001 Epoch 119/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0530 - acc: 0.9386 Epoch 00119: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0530 - acc: 0.9386 - val_loss: 1.8767 - val_acc: 0.6800 Learning rate: 0.0001 Epoch 120/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0519 - acc: 0.9399 Epoch 00120: val_acc improved from 0.69000 to 0.70200, saving model to /Users/1j1060/Research/Codes/Transfer/Runs-neurips-2019/saved_models/resnet_target_model_weighted.h5 20000/20000 [==============================] - 83s 4ms/step - loss: 0.0519 - acc: 0.9398 - val_loss: 1.8863 - val_acc: 0.7020 Learning rate: 0.0001 Epoch 121/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0511 - acc: 0.9398 Epoch 00121: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0512 - acc: 0.9398 - val_loss: 1.8754 - val_acc: 0.6840 Learning rate: 1e-05 Epoch 122/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0507 - acc: 0.9401 Epoch 00122: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0507 - acc: 0.9401 - val_loss: 1.8750 - val_acc: 0.6860 Learning rate: 1e-05 Epoch 123/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0506 - acc: 0.9399 Epoch 00123: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0506 - acc: 0.9400 - val_loss: 1.8796 - val_acc: 0.6820 Learning rate: 1e-05 Epoch 124/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0505 - acc: 0.9405 Epoch 00124: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0505 - acc: 0.9405 - val_loss: 1.8852 - val_acc: 0.6800 Learning rate: 1e-05 Epoch 125/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0504 - acc: 0.9403 Epoch 00125: val_acc did not improve 20000/20000 [==============================] - 84s 4ms/step - loss: 0.0505 - acc: 0.9404 - val_loss: 1.8907 - val_acc: 0.6800 Learning rate: 1e-05 Epoch 126/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0503 - acc: 0.9402 Epoch 00126: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0503 - acc: 0.9401 - val_loss: 1.8920 - val_acc: 0.6840 Learning rate: 1e-05 Epoch 127/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0503 - acc: 0.9411 Epoch 00127: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0503 - acc: 0.9412 - val_loss: 1.8953 - val_acc: 0.6840 Learning rate: 1e-05 Epoch 128/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0503 - acc: 0.9401 Epoch 00128: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0503 - acc: 0.9401 - val_loss: 1.8953 - val_acc: 0.6840 Learning rate: 1e-05 Epoch 129/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0502 - acc: 0.9398 Epoch 00129: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0502 - acc: 0.9397 - val_loss: 1.8910 - val_acc: 0.6860 Learning rate: 1e-05 Epoch 130/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0501 - acc: 0.9398 Epoch 00130: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0501 - acc: 0.9398 - val_loss: 1.8937 - val_acc: 0.6840 Learning rate: 1e-05 Epoch 131/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0501 - acc: 0.9403 Epoch 00131: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0501 - acc: 0.9403 - val_loss: 1.8931 - val_acc: 0.6860 Learning rate: 1e-05 Epoch 132/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0500 - acc: 0.9399 Epoch 00132: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0500 - acc: 0.9398 - val_loss: 1.9057 - val_acc: 0.6860 Learning rate: 1e-05 Epoch 133/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0500 - acc: 0.9395 Epoch 00133: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0500 - acc: 0.9396 - val_loss: 1.9008 - val_acc: 0.6820 Learning rate: 1e-05 Epoch 134/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0498 - acc: 0.9404 Epoch 00134: val_acc did not improve 20000/20000 [==============================] - 85s 4ms/step - loss: 0.0498 - acc: 0.9404 - val_loss: 1.9022 - val_acc: 0.6800 Learning rate: 1e-05 Epoch 135/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0497 - acc: 0.9405 Epoch 00135: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0497 - acc: 0.9405 - val_loss: 1.8961 - val_acc: 0.6820 Learning rate: 1e-05 Epoch 136/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0496 - acc: 0.9402 Epoch 00136: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0496 - acc: 0.9402 - val_loss: 1.8998 - val_acc: 0.6820 Learning rate: 1e-05 Epoch 137/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0496 - acc: 0.9409 Epoch 00137: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0496 - acc: 0.9409 - val_loss: 1.9124 - val_acc: 0.6820 Learning rate: 1e-05 Epoch 138/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0494 - acc: 0.9411 Epoch 00138: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0494 - acc: 0.9410 - val_loss: 1.9086 - val_acc: 0.6840 Learning rate: 1e-05 Epoch 139/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0494 - acc: 0.9407 Epoch 00139: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0494 - acc: 0.9405 - val_loss: 1.9020 - val_acc: 0.6820 Learning rate: 1e-05 Epoch 140/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0493 - acc: 0.9403 Epoch 00140: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0493 - acc: 0.9403 - val_loss: 1.8963 - val_acc: 0.6780 Learning rate: 1e-05 Epoch 141/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0492 - acc: 0.9405 Epoch 00141: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0492 - acc: 0.9403 - val_loss: 1.8969 - val_acc: 0.6800 Learning rate: 1e-05 Epoch 142/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0490 - acc: 0.9401 Epoch 00142: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0490 - acc: 0.9400 - val_loss: 1.9065 - val_acc: 0.6820 Learning rate: 1e-05 Epoch 143/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0491 - acc: 0.9409 Epoch 00143: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0491 - acc: 0.9409 - val_loss: 1.9020 - val_acc: 0.6780 Learning rate: 1e-05 Epoch 144/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0489 - acc: 0.9410 Epoch 00144: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0489 - acc: 0.9410 - val_loss: 1.9113 - val_acc: 0.6800 Learning rate: 1e-05 Epoch 145/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0487 - acc: 0.9404 Epoch 00145: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0487 - acc: 0.9403 - val_loss: 1.9060 - val_acc: 0.6840 Learning rate: 1e-05 Epoch 146/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0487 - acc: 0.9407 Epoch 00146: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0487 - acc: 0.9407 - val_loss: 1.8993 - val_acc: 0.6780 Learning rate: 1e-05 Epoch 147/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0486 - acc: 0.9405 Epoch 00147: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0486 - acc: 0.9405 - val_loss: 1.9037 - val_acc: 0.6820 Learning rate: 1e-05 Epoch 148/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0485 - acc: 0.9410 Epoch 00148: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0485 - acc: 0.9411 - val_loss: 1.8996 - val_acc: 0.6760 Learning rate: 1e-05 Epoch 149/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0483 - acc: 0.9409 Epoch 00149: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0483 - acc: 0.9408 - val_loss: 1.9071 - val_acc: 0.6780 Learning rate: 1e-05 Epoch 150/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0483 - acc: 0.9400 Epoch 00150: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0484 - acc: 0.9401 - val_loss: 1.8995 - val_acc: 0.6800 Learning rate: 1e-05 Epoch 151/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0483 - acc: 0.9410 Epoch 00151: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0483 - acc: 0.9411 - val_loss: 1.9181 - val_acc: 0.6800 Learning rate: 1e-05 Epoch 152/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0481 - acc: 0.9416 Epoch 00152: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0481 - acc: 0.9416 - val_loss: 1.9218 - val_acc: 0.6840 Learning rate: 1e-05 Epoch 153/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0480 - acc: 0.9410 Epoch 00153: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0480 - acc: 0.9410 - val_loss: 1.9119 - val_acc: 0.6780 Learning rate: 1e-05 Epoch 154/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0479 - acc: 0.9404 Epoch 00154: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0479 - acc: 0.9405 - val_loss: 1.9089 - val_acc: 0.6840 Learning rate: 1e-05 Epoch 155/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0478 - acc: 0.9410 Epoch 00155: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0478 - acc: 0.9410 - val_loss: 1.9190 - val_acc: 0.6800 Learning rate: 1e-05 Epoch 156/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0477 - acc: 0.9412 Epoch 00156: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0477 - acc: 0.9412 - val_loss: 1.9179 - val_acc: 0.6820 Learning rate: 1e-05 Epoch 157/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0477 - acc: 0.9413 Epoch 00157: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0477 - acc: 0.9413 - val_loss: 1.9207 - val_acc: 0.6820 Learning rate: 1e-05 Epoch 158/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0476 - acc: 0.9403 Epoch 00158: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.0476 - acc: 0.9403 - val_loss: 1.9211 - val_acc: 0.6780 Learning rate: 1e-05 Epoch 159/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0475 - acc: 0.9403 Epoch 00159: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0475 - acc: 0.9403 - val_loss: 1.9237 - val_acc: 0.6800 Learning rate: 1e-05 Epoch 160/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0474 - acc: 0.9411 Epoch 00160: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0474 - acc: 0.9411 - val_loss: 1.9182 - val_acc: 0.6760 Learning rate: 1e-05 Epoch 161/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0472 - acc: 0.9414 Epoch 00161: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0472 - acc: 0.9414 - val_loss: 1.9108 - val_acc: 0.6820 Learning rate: 1e-06 Epoch 162/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0473 - acc: 0.9411 Epoch 00162: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0473 - acc: 0.9410 - val_loss: 1.9165 - val_acc: 0.6840 Learning rate: 1e-06 Epoch 163/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0472 - acc: 0.9403 Epoch 00163: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0472 - acc: 0.9403 - val_loss: 1.9189 - val_acc: 0.6840 Learning rate: 1e-06 Epoch 164/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0472 - acc: 0.9415 Epoch 00164: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0473 - acc: 0.9415 - val_loss: 1.9207 - val_acc: 0.6860 Learning rate: 1e-06 Epoch 165/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0472 - acc: 0.9401 Epoch 00165: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0472 - acc: 0.9402 - val_loss: 1.9205 - val_acc: 0.6860 Learning rate: 1e-06 Epoch 166/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0473 - acc: 0.9407 Epoch 00166: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0473 - acc: 0.9407 - val_loss: 1.9226 - val_acc: 0.6900 Learning rate: 1e-06 Epoch 167/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0472 - acc: 0.9415 Epoch 00167: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0472 - acc: 0.9414 - val_loss: 1.9230 - val_acc: 0.6880 Learning rate: 1e-06 Epoch 168/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0472 - acc: 0.9409 Epoch 00168: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0472 - acc: 0.9410 - val_loss: 1.9217 - val_acc: 0.6880 Learning rate: 1e-06 Epoch 169/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0472 - acc: 0.9411 Epoch 00169: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0472 - acc: 0.9410 - val_loss: 1.9216 - val_acc: 0.6840 Learning rate: 1e-06 Epoch 170/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0472 - acc: 0.9414 Epoch 00170: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0472 - acc: 0.9414 - val_loss: 1.9190 - val_acc: 0.6840 Learning rate: 1e-06 Epoch 171/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0472 - acc: 0.9417 Epoch 00171: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0472 - acc: 0.9418 - val_loss: 1.9214 - val_acc: 0.6880 Learning rate: 1e-06 Epoch 172/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0471 - acc: 0.9407 Epoch 00172: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0471 - acc: 0.9407 - val_loss: 1.9208 - val_acc: 0.6880 Learning rate: 1e-06 Epoch 173/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0471 - acc: 0.9414 Epoch 00173: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0471 - acc: 0.9414 - val_loss: 1.9194 - val_acc: 0.6860 Learning rate: 1e-06 Epoch 174/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0472 - acc: 0.9414 Epoch 00174: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0472 - acc: 0.9415 - val_loss: 1.9188 - val_acc: 0.6880 Learning rate: 1e-06 Epoch 175/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0471 - acc: 0.9411 Epoch 00175: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0471 - acc: 0.9410 - val_loss: 1.9202 - val_acc: 0.6880 Learning rate: 1e-06 Epoch 176/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0471 - acc: 0.9408 Epoch 00176: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0471 - acc: 0.9408 - val_loss: 1.9205 - val_acc: 0.6880 Learning rate: 1e-06 Epoch 177/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0472 - acc: 0.9418 Epoch 00177: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0472 - acc: 0.9419 - val_loss: 1.9215 - val_acc: 0.6920 Learning rate: 1e-06 Epoch 178/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9408 Epoch 00178: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0470 - acc: 0.9409 - val_loss: 1.9202 - val_acc: 0.6900 Learning rate: 1e-06 Epoch 179/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0471 - acc: 0.9412 Epoch 00179: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0471 - acc: 0.9412 - val_loss: 1.9220 - val_acc: 0.6920 Learning rate: 1e-06 Epoch 180/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0471 - acc: 0.9412 Epoch 00180: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0471 - acc: 0.9412 - val_loss: 1.9226 - val_acc: 0.6900 Learning rate: 1e-06 Epoch 181/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9410 Epoch 00181: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0470 - acc: 0.9408 - val_loss: 1.9228 - val_acc: 0.6920 Learning rate: 5e-07 Epoch 182/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0471 - acc: 0.9412 Epoch 00182: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0471 - acc: 0.9412 - val_loss: 1.9210 - val_acc: 0.6920 Learning rate: 5e-07 Epoch 183/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9422 Epoch 00183: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0470 - acc: 0.9421 - val_loss: 1.9209 - val_acc: 0.6880 Learning rate: 5e-07 Epoch 184/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0471 - acc: 0.9415 Epoch 00184: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0471 - acc: 0.9412 - val_loss: 1.9230 - val_acc: 0.6900 Learning rate: 5e-07 Epoch 185/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9412 Epoch 00185: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0470 - acc: 0.9411 - val_loss: 1.9236 - val_acc: 0.6920 Learning rate: 5e-07 Epoch 186/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9411 Epoch 00186: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0470 - acc: 0.9411 - val_loss: 1.9233 - val_acc: 0.6900 Learning rate: 5e-07 Epoch 187/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9410 Epoch 00187: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0471 - acc: 0.9410 - val_loss: 1.9225 - val_acc: 0.6900 Learning rate: 5e-07 Epoch 188/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9410 Epoch 00188: val_acc did not improve 20000/20000 [==============================] - 86s 4ms/step - loss: 0.0470 - acc: 0.9410 - val_loss: 1.9250 - val_acc: 0.6900 Learning rate: 5e-07 Epoch 189/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9415 Epoch 00189: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0470 - acc: 0.9415 - val_loss: 1.9258 - val_acc: 0.6900 Learning rate: 5e-07 Epoch 190/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9410 Epoch 00190: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0470 - acc: 0.9411 - val_loss: 1.9255 - val_acc: 0.6900 Learning rate: 5e-07 Epoch 191/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9414 Epoch 00191: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0470 - acc: 0.9412 - val_loss: 1.9238 - val_acc: 0.6900 Learning rate: 5e-07 Epoch 192/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9416 Epoch 00192: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0470 - acc: 0.9416 - val_loss: 1.9254 - val_acc: 0.6900 Learning rate: 5e-07 Epoch 193/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0471 - acc: 0.9412 Epoch 00193: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0471 - acc: 0.9412 - val_loss: 1.9238 - val_acc: 0.6900 Learning rate: 5e-07 Epoch 194/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9418 Epoch 00194: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0470 - acc: 0.9416 - val_loss: 1.9238 - val_acc: 0.6900 Learning rate: 5e-07 Epoch 195/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9415 Epoch 00195: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0471 - acc: 0.9416 - val_loss: 1.9239 - val_acc: 0.6900 Learning rate: 5e-07 Epoch 196/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9415 Epoch 00196: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0470 - acc: 0.9414 - val_loss: 1.9210 - val_acc: 0.6840 Learning rate: 5e-07 Epoch 197/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9409 Epoch 00197: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0470 - acc: 0.9408 - val_loss: 1.9215 - val_acc: 0.6880 Learning rate: 5e-07 Epoch 198/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9402 Epoch 00198: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0470 - acc: 0.9401 - val_loss: 1.9218 - val_acc: 0.6840 Learning rate: 5e-07 Epoch 199/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0469 - acc: 0.9410 Epoch 00199: val_acc did not improve 20000/20000 [==============================] - 87s 4ms/step - loss: 0.0469 - acc: 0.9409 - val_loss: 1.9245 - val_acc: 0.6900 Learning rate: 5e-07 Epoch 200/200 19968/20000 [============================>.] - ETA: 0s - loss: 0.0470 - acc: 0.9412 Epoch 00200: val_acc did not improve 20000/20000 [==============================] - 88s 4ms/step - loss: 0.0470 - acc: 0.9412 - val_loss: 1.9225 - val_acc: 0.6880 10000/10000 [==============================] - 15s 2ms/step Accuracy of Prof-Weighted Simple Model: 0.6563