{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Improvise a Jazz Solo with an LSTM Network\n", "\n", "Welcome to your final programming assignment of this week! In this notebook, you will implement a model that uses an LSTM to generate music. You will even be able to listen to your own music at the end of the assignment. \n", "\n", "**You will learn to:**\n", "- Apply an LSTM to music generation.\n", "- Generate your own jazz music with deep learning.\n" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Updates\n", "\n", "#### If you were working on the notebook before this update...\n", "* The current notebook is version \"3a\".\n", "* You can find your original work saved in the notebook with the previous version name (\"v3\") \n", "* To view the file directory, go to the menu \"File->Open\", and this will open a new tab that shows the file directory.\n", "\n", "#### List of updates\n", "* `djmodel`\n", " - Explains `Input` layer and its parameter `shape`.\n", " - Explains `Lambda` layer and replaces the given solution with hints and sample code (to improve the learning experience).\n", " - Adds hints for using the Keras `Model`.\n", "* `music_inference_model`\n", " - Explains each line of code in the `one_hot` function.\n", " - Explains how to apply `one_hot` with a Lambda layer instead of giving the code solution (to improve the learning experience).\n", " - Adds instructions on defining the `Model`.\n", "* `predict_and_sample`\n", " - Provides detailed instructions for each step.\n", " - Clarifies which variable/function to use for inference.\n", "* Spelling, grammar and wording corrections." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Please run the following cell to load all the packages required in this assignment. This may take a few minutes. " ] }, { "cell_type": "code", "execution_count": 18, "metadata": { "collapsed": true }, "outputs": [], "source": [ "from __future__ import print_function\n", "import IPython\n", "import sys\n", "from music21 import *\n", "import numpy as np\n", "from grammar import *\n", "from qa import *\n", "from preprocess import * \n", "from music_utils import *\n", "from data_utils import *\n", "from keras.models import load_model, Model\n", "from keras.layers import Dense, Activation, Dropout, Input, LSTM, Reshape, Lambda, RepeatVector\n", "from keras.initializers import glorot_uniform\n", "from keras.utils import to_categorical\n", "from keras.optimizers import Adam\n", "from keras import backend as K" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 1 - Problem statement\n", "\n", "You would like to create a jazz music piece specially for a friend's birthday. However, you don't know any instruments or music composition. Fortunately, you know deep learning and will solve this problem using an LSTM network. \n", "\n", "You will train a network to generate novel jazz solos in a style representative of a body of performed work.\n", "\n", "\n", "\n", "\n", "### 1.1 - Dataset\n", "\n", "You will train your algorithm on a corpus of Jazz music. Run the cell below to listen to a snippet of the audio from the training set:" ] }, { "cell_type": "code", "execution_count": 20, "metadata": {}, "outputs": [ { "data": { "text/html": [ "\n", " \n", " " ], "text/plain": [ "" ] }, "execution_count": 20, "metadata": {}, "output_type": "execute_result" } ], "source": [ "IPython.display.Audio('./data/30s_seq.mp3')" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We have taken care of the preprocessing of the musical data to render it in terms of musical \"values.\" \n", "\n", "#### Details about music (optional)\n", "You can informally think of each \"value\" as a note, which comprises a pitch and duration. For example, if you press down a specific piano key for 0.5 seconds, then you have just played a note. In music theory, a \"value\" is actually more complicated than this--specifically, it also captures the information needed to play multiple notes at the same time. For example, when playing a music piece, you might press down two piano keys at the same time (playing multiple notes at the same time generates what's called a \"chord\"). But we don't need to worry about the details of music theory for this assignment. \n", "\n", "#### Music as a sequence of values\n", "* For the purpose of this assignment, all you need to know is that we will obtain a dataset of values, and will learn an RNN model to generate sequences of values. \n", "* Our music generation system will use 78 unique values. \n", "\n", "Run the following code to load the raw music data and preprocess it into values. This might take a few minutes." ] }, { "cell_type": "code", "execution_count": 22, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "number of training examples: 60\n", "Tx (length of sequence): 30\n", "total # of unique values: 78\n", "shape of X: (60, 30, 78)\n", "Shape of Y: (30, 60, 78)\n" ] } ], "source": [ "X, Y, n_values, indices_values = load_music_utils()\n", "print('number of training examples:', X.shape[0])\n", "print('Tx (length of sequence):', X.shape[1])\n", "print('total # of unique values:', n_values)\n", "print('shape of X:', X.shape)\n", "print('Shape of Y:', Y.shape)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "You have just loaded the following:\n", "\n", "- `X`: This is an (m, $T_x$, 78) dimensional array. \n", " - We have m training examples, each of which is a snippet of $T_x =30$ musical values. \n", " - At each time step, the input is one of 78 different possible values, represented as a one-hot vector. \n", " - For example, X[i,t,:] is a one-hot vector representing the value of the i-th example at time t. \n", "\n", "- `Y`: a $(T_y, m, 78)$ dimensional array\n", " - This is essentially the same as `X`, but shifted one step to the left (to the past). \n", " - Notice that the data in `Y` is **reordered** to be dimension $(T_y, m, 78)$, where $T_y = T_x$. This format makes it more convenient to feed into the LSTM later.\n", " - Similar to the dinosaur assignment, we're using the previous values to predict the next value.\n", " - So our sequence model will try to predict $y^{\\langle t \\rangle}$ given $x^{\\langle 1\\rangle}, \\ldots, x^{\\langle t \\rangle}$. \n", "\n", "- `n_values`: The number of unique values in this dataset. This should be 78. \n", "\n", "- `indices_values`: python dictionary mapping integers 0 through 77 to musical values." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### 1.2 - Overview of our model\n", "\n", "Here is the architecture of the model we will use. This is similar to the Dinosaurus model, except that you will implement it in Keras.\n", "\n", "\n", "\n", "\n", "* $X = (x^{\\langle 1 \\rangle}, x^{\\langle 2 \\rangle}, \\cdots, x^{\\langle T_x \\rangle})$ is a window of size $T_x$ scanned over the musical corpus. \n", "* Each $x^{\\langle t \\rangle}$ is an index corresponding to a value.\n", "* $\\hat{y}^{t}$ is the prediction for the next value.\n", "* We will be training the model on random snippets of 30 values taken from a much longer piece of music. \n", " - Thus, we won't bother to set the first input $x^{\\langle 1 \\rangle} = \\vec{0}$, since most of these snippets of audio start somewhere in the middle of a piece of music. \n", " - We are setting each of the snippets to have the same length $T_x = 30$ to make vectorization easier." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Overview of parts 2 and 3\n", "\n", "* We're going to train a model that predicts the next note in a style that is similar to the jazz music that it's trained on. The training is contained in the weights and biases of the model. \n", "* In Part 3, we're then going to use those weights and biases in a new model which predicts a series of notes, using the previous note to predict the next note. \n", "* The weights and biases are transferred to the new model using 'global shared layers' described below\"\n" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 2 - Building the model\n", "\n", "* In this part you will build and train a model that will learn musical patterns. \n", "* The model takes input X of shape $(m, T_x, 78)$ and labels Y of shape $(T_y, m, 78)$. \n", "* We will use an LSTM with hidden states that have $n_{a} = 64$ dimensions." ] }, { "cell_type": "code", "execution_count": 23, "metadata": { "collapsed": true }, "outputs": [], "source": [ "# number of dimensions for the hidden state of each LSTM cell.\n", "n_a = 64 " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "\n", "#### Sequence generation uses a for-loop\n", "* If you're building an RNN where, at test time, the entire input sequence $x^{\\langle 1 \\rangle}, x^{\\langle 2 \\rangle}, \\ldots, x^{\\langle T_x \\rangle}$ is given in advance, then Keras has simple built-in functions to build the model. \n", "* However, for **sequence generation, at test time we don't know all the values of $x^{\\langle t\\rangle}$ in advance**.\n", "* Instead we generate them one at a time using $x^{\\langle t\\rangle} = y^{\\langle t-1 \\rangle}$. \n", " * The input at time \"t\" is the prediction at the previous time step \"t-1\".\n", "* So you'll need to implement your own for-loop to iterate over the time steps. \n", "\n", "#### Shareable weights\n", "* The function `djmodel()` will call the LSTM layer $T_x$ times using a for-loop.\n", "* It is important that all $T_x$ copies have the same weights. \n", " - The $T_x$ steps should have shared weights that aren't re-initialized.\n", "* Referencing a globally defined shared layer will utilize the same layer-object instance at each time step.\n", "* The key steps for implementing layers with shareable weights in Keras are: \n", "1. Define the layer objects (we will use global variables for this).\n", "2. Call these objects when propagating the input.\n", "\n", "#### 3 types of layers\n", "* We have defined the layers objects you need as global variables. \n", "* Please run the next cell to create them. \n", "* Please read the Keras documentation and understand these layers: \n", " - [Reshape()](https://keras.io/layers/core/#reshape): Reshapes an output to a certain shape.\n", " - [LSTM()](https://keras.io/layers/recurrent/#lstm): Long Short-Term Memory layer\n", " - [Dense()](https://keras.io/layers/core/#dense): A regular fully-connected neural network layer.\n" ] }, { "cell_type": "code", "execution_count": 25, "metadata": { "collapsed": true }, "outputs": [], "source": [ "n_values = 78 # number of music values\n", "reshapor = Reshape((1, n_values)) # Used in Step 2.B of djmodel(), below\n", "LSTM_cell = LSTM(n_a, return_state = True) # Used in Step 2.C\n", "densor = Dense(n_values, activation='softmax') # Used in Step 2.D" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "* `reshapor`, `LSTM_cell` and `densor` are globally defined layer objects, that you'll use to implement `djmodel()`. \n", "* In order to propagate a Keras tensor object X through one of these layers, use `layer_object()`.\n", " - For one input, use `layer_object(X)`\n", " - For more than one input, put the inputs in a list: `layer_object([X1,X2])`" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ " **Exercise**: Implement `djmodel()`. \n", "\n", "#### Inputs (given)\n", "* The `Input()` layer is used for defining the input `X` as well as the initial hidden state 'a0' and cell state `c0`.\n", "* The `shape` parameter takes a tuple that does not include the batch dimension (`m`).\n", " - For example,\n", " ```Python\n", " X = Input(shape=(Tx, n_values)) # X has 3 dimensions and not 2: (m, Tx, n_values)\n", " ```\n", "#### Step 1: Outputs (TODO)\n", "1. Create an empty list \"outputs\" to save the outputs of the LSTM Cell at every time step." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "#### Step 2: Loop through time steps (TODO)\n", "* Loop for $t \\in 1, \\ldots, T_x$:\n", "\n", "#### 2A. Select the 't' time-step vector from X.\n", "* X has the shape (m, Tx, n_values).\n", "* The shape of the 't' selection should be (n_values,). \n", "* Recall that if you were implementing in numpy instead of Keras, you would extract a slice from a 3D numpy array like this:\n", "```Python\n", "var1 = array1[:,1,:]\n", "```\n", " \n", "#### Lambda layer\n", "* Since we're using Keras, we need to define this step inside a custom layer.\n", "* In Keras, this is a Lambda layer [Lambda](https://keras.io/layers/core/#lambda)\n", "* As an example, a Lambda layer that takes the previous layer and adds '1' looks like this\n", "``` \n", " lambda_layer1 = Lambda(lambda z: z + 1)(previous_layer)\n", "``` \n", "* The previous layer in this case is `X`.\n", "* `z` is a local variable of the lambda function. \n", " * The `previous_layer` gets passed into the parameter `z` in the lowercase `lambda` function.\n", " * You can choose the name of the variable to be something else if you want.\n", "* The operation after the colon ':' should be the operation to extract a slice from the previous layer.\n", "* **Hint**: You'll be using the variable `t` within the definition of the lambda layer even though it isn't passed in as an argument to Lambda." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "#### 2B. Reshape x to be (1,n_values).\n", "* Use the `reshapor()` layer. It is a function that takes the previous layer as its input argument.\n", "\n", "#### 2C. Run x through one step of LSTM_cell.\n", "* Initialize the `LSTM_cell` with the previous step's hidden state $a$ and cell state $c$. \n", "* Use the following formatting:\n", "```python\n", "next_hidden_state, _, next_cell_state = LSTM_cell(inputs=input_x, initial_state=[previous_hidden_state, previous_cell_state])\n", "```\n", " * Choose appropriate variables for inputs, hidden state and cell state.\n", "\n", "#### 2D. Dense layer\n", "* Propagate the LSTM's hidden state through a dense+softmax layer using `densor`. \n", " \n", "#### 2E. Append output\n", "* Append the output to the list of \"outputs\".\n" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "#### Step 3: After the loop, create the model\n", "* Use the Keras `Model` object to create a model.\n", "* specify the inputs and outputs:\n", "```Python\n", "model = Model(inputs=[input_x, initial_hidden_state, initial_cell_state], outputs=the_outputs)\n", "```\n", " * Choose the appropriate variables for the input tensor, hidden state, cell state, and output.\n", "* See the documentation for [Model](https://keras.io/models/model/)" ] }, { "cell_type": "code", "execution_count": 38, "metadata": { "collapsed": true }, "outputs": [], "source": [ "# GRADED FUNCTION: djmodel\n", "\n", "def djmodel(Tx, n_a, n_values):\n", " \"\"\"\n", " Implement the model\n", " \n", " Arguments:\n", " Tx -- length of the sequence in a corpus\n", " n_a -- the number of activations used in our model\n", " n_values -- number of unique values in the music data \n", " \n", " Returns:\n", " model -- a keras instance model with n_a activations\n", " \"\"\"\n", " \n", " # Define the input layer and specify the shape\n", " X = Input(shape=(Tx, n_values))\n", " \n", " # Define the initial hidden state a0 and initial cell state c0\n", " # using `Input`\n", " a0 = Input(shape=(n_a,), name='a0')\n", " c0 = Input(shape=(n_a,), name='c0')\n", " a = a0\n", " c = c0\n", " \n", " ### START CODE HERE ### \n", " # Step 1: Create empty list to append the outputs while you iterate (≈1 line)\n", " outputs = []\n", " \n", " # Step 2: Loop\n", " for t in range(Tx):\n", " \n", " # Step 2.A: select the \"t\"th time step vector from X. \n", " x = Lambda(lambda x: X[:,t,:])(X)\n", " # Step 2.B: Use reshapor to reshape x to be (1, n_values) (≈1 line)\n", " x = reshapor(x)\n", " # Step 2.C: Perform one step of the LSTM_cell\n", " a, _, c = LSTM_cell(x, initial_state=[a, c])\n", " # Step 2.D: Apply densor to the hidden state output of LSTM_Cell\n", " out = densor(a)\n", " # Step 2.E: add the output to \"outputs\"\n", " outputs.append(out)\n", " \n", " # Step 3: Create model instance\n", " model = Model(inputs=[X, a0, c0], outputs=outputs)\n", " \n", " ### END CODE HERE ###\n", " \n", " return model" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "#### Create the model object\n", "* Run the following cell to define your model. \n", "* We will use `Tx=30`, `n_a=64` (the dimension of the LSTM activations), and `n_values=78`. \n", "* This cell may take a few seconds to run. " ] }, { "cell_type": "code", "execution_count": 39, "metadata": { "collapsed": true }, "outputs": [], "source": [ "model = djmodel(Tx = 30 , n_a = 64, n_values = 78)" ] }, { "cell_type": "code", "execution_count": 40, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "____________________________________________________________________________________________________\n", "Layer (type) Output Shape Param # Connected to \n", "====================================================================================================\n", "input_5 (InputLayer) (None, 30, 78) 0 \n", "____________________________________________________________________________________________________\n", "lambda_141 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "reshape_3 (Reshape) (None, 1, 78) 0 lambda_141[0][0] \n", " lambda_142[0][0] \n", " lambda_143[0][0] \n", " lambda_144[0][0] \n", " lambda_145[0][0] \n", " lambda_146[0][0] \n", " lambda_147[0][0] \n", " lambda_148[0][0] \n", " lambda_149[0][0] \n", " lambda_150[0][0] \n", " lambda_151[0][0] \n", " lambda_152[0][0] \n", " lambda_153[0][0] \n", " lambda_154[0][0] \n", " lambda_155[0][0] \n", " lambda_156[0][0] \n", " lambda_157[0][0] \n", " lambda_158[0][0] \n", " lambda_159[0][0] \n", " lambda_160[0][0] \n", " lambda_161[0][0] \n", " lambda_162[0][0] \n", " lambda_163[0][0] \n", " lambda_164[0][0] \n", " lambda_165[0][0] \n", " lambda_166[0][0] \n", " lambda_167[0][0] \n", " lambda_168[0][0] \n", " lambda_169[0][0] \n", " lambda_170[0][0] \n", "____________________________________________________________________________________________________\n", "a0 (InputLayer) (None, 64) 0 \n", "____________________________________________________________________________________________________\n", "c0 (InputLayer) (None, 64) 0 \n", "____________________________________________________________________________________________________\n", "lambda_142 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lstm_3 (LSTM) [(None, 64), (None, 6 36608 reshape_3[30][0] \n", " a0[0][0] \n", " c0[0][0] \n", " reshape_3[31][0] \n", " lstm_3[30][0] \n", " lstm_3[30][2] \n", " reshape_3[32][0] \n", " lstm_3[31][0] \n", " lstm_3[31][2] \n", " reshape_3[33][0] \n", " lstm_3[32][0] \n", " lstm_3[32][2] \n", " reshape_3[34][0] \n", " lstm_3[33][0] \n", " lstm_3[33][2] \n", " reshape_3[35][0] \n", " lstm_3[34][0] \n", " lstm_3[34][2] \n", " reshape_3[36][0] \n", " lstm_3[35][0] \n", " lstm_3[35][2] \n", " reshape_3[37][0] \n", " lstm_3[36][0] \n", " lstm_3[36][2] \n", " reshape_3[38][0] \n", " lstm_3[37][0] \n", " lstm_3[37][2] \n", " reshape_3[39][0] \n", " lstm_3[38][0] \n", " lstm_3[38][2] \n", " reshape_3[40][0] \n", " lstm_3[39][0] \n", " lstm_3[39][2] \n", " reshape_3[41][0] \n", " lstm_3[40][0] \n", " lstm_3[40][2] \n", " reshape_3[42][0] \n", " lstm_3[41][0] \n", " lstm_3[41][2] \n", " reshape_3[43][0] \n", " lstm_3[42][0] \n", " lstm_3[42][2] \n", " reshape_3[44][0] \n", " lstm_3[43][0] \n", " lstm_3[43][2] \n", " reshape_3[45][0] \n", " lstm_3[44][0] \n", " lstm_3[44][2] \n", " reshape_3[46][0] \n", " lstm_3[45][0] \n", " lstm_3[45][2] \n", " reshape_3[47][0] \n", " lstm_3[46][0] \n", " lstm_3[46][2] \n", " reshape_3[48][0] \n", " lstm_3[47][0] \n", " lstm_3[47][2] \n", " reshape_3[49][0] \n", " lstm_3[48][0] \n", " lstm_3[48][2] \n", " reshape_3[50][0] \n", " lstm_3[49][0] \n", " lstm_3[49][2] \n", " reshape_3[51][0] \n", " lstm_3[50][0] \n", " lstm_3[50][2] \n", " reshape_3[52][0] \n", " lstm_3[51][0] \n", " lstm_3[51][2] \n", " reshape_3[53][0] \n", " lstm_3[52][0] \n", " lstm_3[52][2] \n", " reshape_3[54][0] \n", " lstm_3[53][0] \n", " lstm_3[53][2] \n", " reshape_3[55][0] \n", " lstm_3[54][0] \n", " lstm_3[54][2] \n", " reshape_3[56][0] \n", " lstm_3[55][0] \n", " lstm_3[55][2] \n", " reshape_3[57][0] \n", " lstm_3[56][0] \n", " lstm_3[56][2] \n", " reshape_3[58][0] \n", " lstm_3[57][0] \n", " lstm_3[57][2] \n", " reshape_3[59][0] \n", " lstm_3[58][0] \n", " lstm_3[58][2] \n", "____________________________________________________________________________________________________\n", "lambda_143 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_144 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_145 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_146 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_147 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_148 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_149 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_150 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_151 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_152 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_153 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_154 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_155 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_156 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_157 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_158 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_159 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_160 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_161 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_162 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_163 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_164 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_165 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_166 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_167 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_168 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_169 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "lambda_170 (Lambda) (None, 78) 0 input_5[0][0] \n", "____________________________________________________________________________________________________\n", "dense_3 (Dense) (None, 78) 5070 lstm_3[30][0] \n", " lstm_3[31][0] \n", " lstm_3[32][0] \n", " lstm_3[33][0] \n", " lstm_3[34][0] \n", " lstm_3[35][0] \n", " lstm_3[36][0] \n", " lstm_3[37][0] \n", " lstm_3[38][0] \n", " lstm_3[39][0] \n", " lstm_3[40][0] \n", " lstm_3[41][0] \n", " lstm_3[42][0] \n", " lstm_3[43][0] \n", " lstm_3[44][0] \n", " lstm_3[45][0] \n", " lstm_3[46][0] \n", " lstm_3[47][0] \n", " lstm_3[48][0] \n", " lstm_3[49][0] \n", " lstm_3[50][0] \n", " lstm_3[51][0] \n", " lstm_3[52][0] \n", " lstm_3[53][0] \n", " lstm_3[54][0] \n", " lstm_3[55][0] \n", " lstm_3[56][0] \n", " lstm_3[57][0] \n", " lstm_3[58][0] \n", " lstm_3[59][0] \n", "====================================================================================================\n", "Total params: 41,678\n", "Trainable params: 41,678\n", "Non-trainable params: 0\n", "____________________________________________________________________________________________________\n" ] } ], "source": [ "# Check your model\n", "model.summary()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Expected Output** \n", "Scroll to the bottom of the output, and you'll see the following:\n", "\n", "```Python\n", "Total params: 41,678\n", "Trainable params: 41,678\n", "Non-trainable params: 0\n", "```" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "#### Compile the model for training\n", "* You now need to compile your model to be trained. \n", "* We will use:\n", " - optimizer: Adam optimizer\n", " - Loss function: categorical cross-entropy (for multi-class classification)" ] }, { "cell_type": "code", "execution_count": 41, "metadata": { "collapsed": true }, "outputs": [], "source": [ "opt = Adam(lr=0.01, beta_1=0.9, beta_2=0.999, decay=0.01)\n", "\n", "model.compile(optimizer=opt, loss='categorical_crossentropy', metrics=['accuracy'])" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "#### Initialize hidden state and cell state\n", "Finally, let's initialize `a0` and `c0` for the LSTM's initial state to be zero. " ] }, { "cell_type": "code", "execution_count": 42, "metadata": { "collapsed": true, "scrolled": true }, "outputs": [], "source": [ "m = 60\n", "a0 = np.zeros((m, n_a))\n", "c0 = np.zeros((m, n_a))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "#### Train the model\n", "* Lets now fit the model! \n", "* We will turn `Y` into a list, since the cost function expects `Y` to be provided in this format \n", " - `list(Y)` is a list with 30 items, where each of the list items is of shape (60,78). \n", " - Lets train for 100 epochs. This will take a few minutes. " ] }, { "cell_type": "code", "execution_count": 43, "metadata": { "scrolled": true }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Epoch 1/100\n", "60/60 [==============================] - 6s - loss: 125.9067 - dense_3_loss_1: 4.3527 - dense_3_loss_2: 4.3483 - dense_3_loss_3: 4.3447 - dense_3_loss_4: 4.3393 - dense_3_loss_5: 4.3492 - dense_3_loss_6: 4.3405 - dense_3_loss_7: 4.3397 - dense_3_loss_8: 4.3431 - dense_3_loss_9: 4.3418 - dense_3_loss_10: 4.3331 - dense_3_loss_11: 4.3417 - dense_3_loss_12: 4.3482 - dense_3_loss_13: 4.3420 - dense_3_loss_14: 4.3365 - dense_3_loss_15: 4.3437 - dense_3_loss_16: 4.3417 - dense_3_loss_17: 4.3346 - dense_3_loss_18: 4.3381 - dense_3_loss_19: 4.3432 - dense_3_loss_20: 4.3412 - dense_3_loss_21: 4.3449 - dense_3_loss_22: 4.3310 - dense_3_loss_23: 4.3462 - dense_3_loss_24: 4.3400 - dense_3_loss_25: 4.3396 - dense_3_loss_26: 4.3388 - dense_3_loss_27: 4.3419 - dense_3_loss_28: 4.3393 - dense_3_loss_29: 4.3416 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.1000 - dense_3_acc_3: 0.0167 - dense_3_acc_4: 0.0500 - dense_3_acc_5: 0.0167 - dense_3_acc_6: 0.0500 - dense_3_acc_7: 0.0667 - dense_3_acc_8: 0.0500 - dense_3_acc_9: 0.0000e+00 - dense_3_acc_10: 0.1500 - dense_3_acc_11: 0.0333 - dense_3_acc_12: 0.0167 - dense_3_acc_13: 0.0167 - dense_3_acc_14: 0.0167 - dense_3_acc_15: 0.0167 - dense_3_acc_16: 0.0500 - dense_3_acc_17: 0.1167 - dense_3_acc_18: 0.0667 - dense_3_acc_19: 0.0333 - dense_3_acc_20: 0.0500 - dense_3_acc_21: 0.0167 - dense_3_acc_22: 0.0333 - dense_3_acc_23: 0.0333 - dense_3_acc_24: 0.0333 - dense_3_acc_25: 0.0167 - dense_3_acc_26: 0.0667 - dense_3_acc_27: 0.0000e+00 - dense_3_acc_28: 0.1000 - dense_3_acc_29: 0.0667 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 2/100\n", "60/60 [==============================] - 0s - loss: 123.3107 - dense_3_loss_1: 4.3375 - dense_3_loss_2: 4.3123 - dense_3_loss_3: 4.2903 - dense_3_loss_4: 4.2854 - dense_3_loss_5: 4.2756 - dense_3_loss_6: 4.2733 - dense_3_loss_7: 4.2572 - dense_3_loss_8: 4.2511 - dense_3_loss_9: 4.2530 - dense_3_loss_10: 4.2287 - dense_3_loss_11: 4.2484 - dense_3_loss_12: 4.2689 - dense_3_loss_13: 4.2409 - dense_3_loss_14: 4.2262 - dense_3_loss_15: 4.2415 - dense_3_loss_16: 4.2369 - dense_3_loss_17: 4.2359 - dense_3_loss_18: 4.2445 - dense_3_loss_19: 4.2263 - dense_3_loss_20: 4.2470 - dense_3_loss_21: 4.2457 - dense_3_loss_22: 4.2345 - dense_3_loss_23: 4.2560 - dense_3_loss_24: 4.2314 - dense_3_loss_25: 4.2493 - dense_3_loss_26: 4.2125 - dense_3_loss_27: 4.2308 - dense_3_loss_28: 4.2280 - dense_3_loss_29: 4.2415 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.1500 - dense_3_acc_3: 0.1333 - dense_3_acc_4: 0.1667 - dense_3_acc_5: 0.2167 - dense_3_acc_6: 0.0833 - dense_3_acc_7: 0.1500 - dense_3_acc_8: 0.1833 - dense_3_acc_9: 0.1333 - dense_3_acc_10: 0.1333 - dense_3_acc_11: 0.1333 - dense_3_acc_12: 0.1167 - dense_3_acc_13: 0.0833 - dense_3_acc_14: 0.1167 - dense_3_acc_15: 0.0667 - dense_3_acc_16: 0.1000 - dense_3_acc_17: 0.1833 - dense_3_acc_18: 0.1500 - dense_3_acc_19: 0.1500 - dense_3_acc_20: 0.0667 - dense_3_acc_21: 0.0667 - dense_3_acc_22: 0.1167 - dense_3_acc_23: 0.0833 - dense_3_acc_24: 0.0833 - dense_3_acc_25: 0.1000 - dense_3_acc_26: 0.2167 - dense_3_acc_27: 0.0667 - dense_3_acc_28: 0.2000 - dense_3_acc_29: 0.1333 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 3/100\n", "60/60 [==============================] - 0s - loss: 117.4297 - dense_3_loss_1: 4.3145 - dense_3_loss_2: 4.2654 - dense_3_loss_3: 4.2095 - dense_3_loss_4: 4.2015 - dense_3_loss_5: 4.1519 - dense_3_loss_6: 4.1541 - dense_3_loss_7: 4.1033 - dense_3_loss_8: 4.0278 - dense_3_loss_9: 4.0330 - dense_3_loss_10: 3.9978 - dense_3_loss_11: 3.9876 - dense_3_loss_12: 4.0718 - dense_3_loss_13: 4.0149 - dense_3_loss_14: 3.8780 - dense_3_loss_15: 3.9907 - dense_3_loss_16: 3.9961 - dense_3_loss_17: 3.9426 - dense_3_loss_18: 4.1699 - dense_3_loss_19: 3.9261 - dense_3_loss_20: 4.1486 - dense_3_loss_21: 4.1405 - dense_3_loss_22: 3.9439 - dense_3_loss_23: 4.0719 - dense_3_loss_24: 4.0760 - dense_3_loss_25: 4.0585 - dense_3_loss_26: 3.7204 - dense_3_loss_27: 3.8641 - dense_3_loss_28: 3.9029 - dense_3_loss_29: 4.0665 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.1000 - dense_3_acc_3: 0.1333 - dense_3_acc_4: 0.1167 - dense_3_acc_5: 0.1500 - dense_3_acc_6: 0.0833 - dense_3_acc_7: 0.0833 - dense_3_acc_8: 0.1500 - dense_3_acc_9: 0.0667 - dense_3_acc_10: 0.1000 - dense_3_acc_11: 0.0500 - dense_3_acc_12: 0.0667 - dense_3_acc_13: 0.0333 - dense_3_acc_14: 0.0667 - dense_3_acc_15: 0.0667 - dense_3_acc_16: 0.0833 - dense_3_acc_17: 0.1167 - dense_3_acc_18: 0.0667 - dense_3_acc_19: 0.0667 - dense_3_acc_20: 0.1000 - dense_3_acc_21: 0.0833 - dense_3_acc_22: 0.0667 - dense_3_acc_23: 0.0167 - dense_3_acc_24: 0.0167 - dense_3_acc_25: 0.0833 - dense_3_acc_26: 0.1500 - dense_3_acc_27: 0.0667 - dense_3_acc_28: 0.0833 - dense_3_acc_29: 0.1333 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 4/100\n", "60/60 [==============================] - 0s - loss: 113.4645 - dense_3_loss_1: 4.2957 - dense_3_loss_2: 4.2194 - dense_3_loss_3: 4.1234 - dense_3_loss_4: 4.1074 - dense_3_loss_5: 4.0115 - dense_3_loss_6: 4.0257 - dense_3_loss_7: 3.9557 - dense_3_loss_8: 3.7725 - dense_3_loss_9: 3.8240 - dense_3_loss_10: 3.6975 - dense_3_loss_11: 3.7843 - dense_3_loss_12: 4.0462 - dense_3_loss_13: 3.7754 - dense_3_loss_14: 3.7355 - dense_3_loss_15: 3.8115 - dense_3_loss_16: 3.8044 - dense_3_loss_17: 3.9172 - dense_3_loss_18: 3.9386 - dense_3_loss_19: 3.7156 - dense_3_loss_20: 4.0442 - dense_3_loss_21: 4.0320 - dense_3_loss_22: 3.8452 - dense_3_loss_23: 3.8858 - dense_3_loss_24: 3.8170 - dense_3_loss_25: 4.0390 - dense_3_loss_26: 3.5931 - dense_3_loss_27: 3.7707 - dense_3_loss_28: 3.8171 - dense_3_loss_29: 4.0590 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.1167 - dense_3_acc_3: 0.1667 - dense_3_acc_4: 0.1000 - dense_3_acc_5: 0.2000 - dense_3_acc_6: 0.1333 - dense_3_acc_7: 0.1333 - dense_3_acc_8: 0.1833 - dense_3_acc_9: 0.1333 - dense_3_acc_10: 0.1500 - dense_3_acc_11: 0.1167 - dense_3_acc_12: 0.1167 - dense_3_acc_13: 0.1667 - dense_3_acc_14: 0.1500 - dense_3_acc_15: 0.1500 - dense_3_acc_16: 0.1167 - dense_3_acc_17: 0.1500 - dense_3_acc_18: 0.1333 - dense_3_acc_19: 0.1167 - dense_3_acc_20: 0.1000 - dense_3_acc_21: 0.1000 - dense_3_acc_22: 0.1167 - dense_3_acc_23: 0.1167 - dense_3_acc_24: 0.1167 - dense_3_acc_25: 0.0833 - dense_3_acc_26: 0.2333 - dense_3_acc_27: 0.1167 - dense_3_acc_28: 0.1833 - dense_3_acc_29: 0.0833 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 5/100\n", "60/60 [==============================] - 0s - loss: 110.4102 - dense_3_loss_1: 4.2781 - dense_3_loss_2: 4.1743 - dense_3_loss_3: 4.0514 - dense_3_loss_4: 4.0284 - dense_3_loss_5: 3.9277 - dense_3_loss_6: 3.9164 - dense_3_loss_7: 3.8665 - dense_3_loss_8: 3.6801 - dense_3_loss_9: 3.7591 - dense_3_loss_10: 3.6048 - dense_3_loss_11: 3.6930 - dense_3_loss_12: 3.9390 - dense_3_loss_13: 3.7007 - dense_3_loss_14: 3.6204 - dense_3_loss_15: 3.7007 - dense_3_loss_16: 3.6914 - dense_3_loss_17: 3.8117 - dense_3_loss_18: 3.8140 - dense_3_loss_19: 3.5708 - dense_3_loss_20: 3.8482 - dense_3_loss_21: 3.8875 - dense_3_loss_22: 3.7421 - dense_3_loss_23: 3.7026 - dense_3_loss_24: 3.6653 - dense_3_loss_25: 3.8916 - dense_3_loss_26: 3.4965 - dense_3_loss_27: 3.6475 - dense_3_loss_28: 3.7934 - dense_3_loss_29: 3.9069 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.1000 - dense_3_acc_2: 0.1167 - dense_3_acc_3: 0.2000 - dense_3_acc_4: 0.1667 - dense_3_acc_5: 0.2167 - dense_3_acc_6: 0.1333 - dense_3_acc_7: 0.1000 - dense_3_acc_8: 0.2167 - dense_3_acc_9: 0.2000 - dense_3_acc_10: 0.1667 - dense_3_acc_11: 0.1000 - dense_3_acc_12: 0.0667 - dense_3_acc_13: 0.1833 - dense_3_acc_14: 0.1833 - dense_3_acc_15: 0.1333 - dense_3_acc_16: 0.1333 - dense_3_acc_17: 0.1500 - dense_3_acc_18: 0.0333 - dense_3_acc_19: 0.1500 - dense_3_acc_20: 0.1167 - dense_3_acc_21: 0.0500 - dense_3_acc_22: 0.1833 - dense_3_acc_23: 0.1000 - dense_3_acc_24: 0.0833 - dense_3_acc_25: 0.0833 - dense_3_acc_26: 0.2500 - dense_3_acc_27: 0.1000 - dense_3_acc_28: 0.1167 - dense_3_acc_29: 0.0833 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 6/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 107.2678 - dense_3_loss_1: 4.2639 - dense_3_loss_2: 4.1327 - dense_3_loss_3: 3.9775 - dense_3_loss_4: 3.9502 - dense_3_loss_5: 3.8383 - dense_3_loss_6: 3.8287 - dense_3_loss_7: 3.7906 - dense_3_loss_8: 3.5722 - dense_3_loss_9: 3.6534 - dense_3_loss_10: 3.5154 - dense_3_loss_11: 3.5947 - dense_3_loss_12: 3.8219 - dense_3_loss_13: 3.6171 - dense_3_loss_14: 3.5404 - dense_3_loss_15: 3.5989 - dense_3_loss_16: 3.5627 - dense_3_loss_17: 3.6245 - dense_3_loss_18: 3.6384 - dense_3_loss_19: 3.4829 - dense_3_loss_20: 3.6784 - dense_3_loss_21: 3.7394 - dense_3_loss_22: 3.6098 - dense_3_loss_23: 3.5981 - dense_3_loss_24: 3.5687 - dense_3_loss_25: 3.7648 - dense_3_loss_26: 3.3818 - dense_3_loss_27: 3.5370 - dense_3_loss_28: 3.6661 - dense_3_loss_29: 3.7194 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.1000 - dense_3_acc_2: 0.1500 - dense_3_acc_3: 0.2167 - dense_3_acc_4: 0.2000 - dense_3_acc_5: 0.2167 - dense_3_acc_6: 0.1167 - dense_3_acc_7: 0.1000 - dense_3_acc_8: 0.1500 - dense_3_acc_9: 0.1333 - dense_3_acc_10: 0.1333 - dense_3_acc_11: 0.1000 - dense_3_acc_12: 0.0500 - dense_3_acc_13: 0.0833 - dense_3_acc_14: 0.1167 - dense_3_acc_15: 0.1000 - dense_3_acc_16: 0.0833 - dense_3_acc_17: 0.1833 - dense_3_acc_18: 0.0833 - dense_3_acc_19: 0.1167 - dense_3_acc_20: 0.1167 - dense_3_acc_21: 0.1000 - dense_3_acc_22: 0.1167 - dense_3_acc_23: 0.0833 - dense_3_acc_24: 0.0833 - dense_3_acc_25: 0.1167 - dense_3_acc_26: 0.2333 - dense_3_acc_27: 0.0833 - dense_3_acc_28: 0.2000 - dense_3_acc_29: 0.1500 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 7/100\n", "60/60 [==============================] - 0s - loss: 103.5019 - dense_3_loss_1: 4.2472 - dense_3_loss_2: 4.0852 - dense_3_loss_3: 3.8976 - dense_3_loss_4: 3.8663 - dense_3_loss_5: 3.7379 - dense_3_loss_6: 3.7369 - dense_3_loss_7: 3.6998 - dense_3_loss_8: 3.4461 - dense_3_loss_9: 3.5140 - dense_3_loss_10: 3.3688 - dense_3_loss_11: 3.4746 - dense_3_loss_12: 3.6831 - dense_3_loss_13: 3.4492 - dense_3_loss_14: 3.4054 - dense_3_loss_15: 3.4593 - dense_3_loss_16: 3.4248 - dense_3_loss_17: 3.4793 - dense_3_loss_18: 3.4785 - dense_3_loss_19: 3.3816 - dense_3_loss_20: 3.4713 - dense_3_loss_21: 3.5390 - dense_3_loss_22: 3.4195 - dense_3_loss_23: 3.4759 - dense_3_loss_24: 3.4395 - dense_3_loss_25: 3.5541 - dense_3_loss_26: 3.2498 - dense_3_loss_27: 3.4065 - dense_3_loss_28: 3.5109 - dense_3_loss_29: 3.5997 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.1000 - dense_3_acc_2: 0.1167 - dense_3_acc_3: 0.2167 - dense_3_acc_4: 0.2000 - dense_3_acc_5: 0.2167 - dense_3_acc_6: 0.1000 - dense_3_acc_7: 0.1000 - dense_3_acc_8: 0.1833 - dense_3_acc_9: 0.1667 - dense_3_acc_10: 0.1500 - dense_3_acc_11: 0.1167 - dense_3_acc_12: 0.0667 - dense_3_acc_13: 0.1333 - dense_3_acc_14: 0.2000 - dense_3_acc_15: 0.1333 - dense_3_acc_16: 0.1500 - dense_3_acc_17: 0.1167 - dense_3_acc_18: 0.1167 - dense_3_acc_19: 0.1667 - dense_3_acc_20: 0.1000 - dense_3_acc_21: 0.1167 - dense_3_acc_22: 0.1333 - dense_3_acc_23: 0.1667 - dense_3_acc_24: 0.0667 - dense_3_acc_25: 0.0833 - dense_3_acc_26: 0.2000 - dense_3_acc_27: 0.1167 - dense_3_acc_28: 0.1833 - dense_3_acc_29: 0.1000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 8/100\n", "60/60 [==============================] - 0s - loss: 101.0993 - dense_3_loss_1: 4.2337 - dense_3_loss_2: 4.0426 - dense_3_loss_3: 3.8096 - dense_3_loss_4: 3.7776 - dense_3_loss_5: 3.6265 - dense_3_loss_6: 3.6401 - dense_3_loss_7: 3.6055 - dense_3_loss_8: 3.2965 - dense_3_loss_9: 3.3564 - dense_3_loss_10: 3.2483 - dense_3_loss_11: 3.3564 - dense_3_loss_12: 3.5072 - dense_3_loss_13: 3.2903 - dense_3_loss_14: 3.2627 - dense_3_loss_15: 3.3222 - dense_3_loss_16: 3.3103 - dense_3_loss_17: 3.3469 - dense_3_loss_18: 3.3981 - dense_3_loss_19: 3.2821 - dense_3_loss_20: 3.4338 - dense_3_loss_21: 3.4668 - dense_3_loss_22: 3.3057 - dense_3_loss_23: 3.4427 - dense_3_loss_24: 3.4588 - dense_3_loss_25: 3.5568 - dense_3_loss_26: 3.2285 - dense_3_loss_27: 3.3818 - dense_3_loss_28: 3.4580 - dense_3_loss_29: 3.6534 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.1000 - dense_3_acc_2: 0.1167 - dense_3_acc_3: 0.2167 - dense_3_acc_4: 0.1833 - dense_3_acc_5: 0.2833 - dense_3_acc_6: 0.1000 - dense_3_acc_7: 0.1000 - dense_3_acc_8: 0.2000 - dense_3_acc_9: 0.1667 - dense_3_acc_10: 0.1667 - dense_3_acc_11: 0.1833 - dense_3_acc_12: 0.1167 - dense_3_acc_13: 0.2000 - dense_3_acc_14: 0.2000 - dense_3_acc_15: 0.1167 - dense_3_acc_16: 0.1500 - dense_3_acc_17: 0.1667 - dense_3_acc_18: 0.1333 - dense_3_acc_19: 0.1833 - dense_3_acc_20: 0.1167 - dense_3_acc_21: 0.0667 - dense_3_acc_22: 0.1500 - dense_3_acc_23: 0.1000 - dense_3_acc_24: 0.0500 - dense_3_acc_25: 0.0833 - dense_3_acc_26: 0.1833 - dense_3_acc_27: 0.1167 - dense_3_acc_28: 0.1167 - dense_3_acc_29: 0.1167 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 9/100\n", "60/60 [==============================] - 0s - loss: 96.5578 - dense_3_loss_1: 4.2201 - dense_3_loss_2: 4.0023 - dense_3_loss_3: 3.7328 - dense_3_loss_4: 3.6937 - dense_3_loss_5: 3.5251 - dense_3_loss_6: 3.5416 - dense_3_loss_7: 3.4910 - dense_3_loss_8: 3.1773 - dense_3_loss_9: 3.2248 - dense_3_loss_10: 3.0890 - dense_3_loss_11: 3.2406 - dense_3_loss_12: 3.3926 - dense_3_loss_13: 3.1693 - dense_3_loss_14: 3.1587 - dense_3_loss_15: 3.1628 - dense_3_loss_16: 3.1832 - dense_3_loss_17: 3.0909 - dense_3_loss_18: 3.1728 - dense_3_loss_19: 3.1359 - dense_3_loss_20: 3.2933 - dense_3_loss_21: 3.2941 - dense_3_loss_22: 3.0466 - dense_3_loss_23: 3.1844 - dense_3_loss_24: 3.2412 - dense_3_loss_25: 3.3630 - dense_3_loss_26: 3.0009 - dense_3_loss_27: 3.0564 - dense_3_loss_28: 3.2772 - dense_3_loss_29: 3.3964 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.1000 - dense_3_acc_2: 0.1167 - dense_3_acc_3: 0.2167 - dense_3_acc_4: 0.1833 - dense_3_acc_5: 0.2667 - dense_3_acc_6: 0.1000 - dense_3_acc_7: 0.1000 - dense_3_acc_8: 0.2167 - dense_3_acc_9: 0.1833 - dense_3_acc_10: 0.1667 - dense_3_acc_11: 0.1667 - dense_3_acc_12: 0.1167 - dense_3_acc_13: 0.1833 - dense_3_acc_14: 0.1667 - dense_3_acc_15: 0.1667 - dense_3_acc_16: 0.1833 - dense_3_acc_17: 0.2167 - dense_3_acc_18: 0.1167 - dense_3_acc_19: 0.1833 - dense_3_acc_20: 0.2000 - dense_3_acc_21: 0.2000 - dense_3_acc_22: 0.1667 - dense_3_acc_23: 0.1333 - dense_3_acc_24: 0.1167 - dense_3_acc_25: 0.1333 - dense_3_acc_26: 0.2500 - dense_3_acc_27: 0.2167 - dense_3_acc_28: 0.1833 - dense_3_acc_29: 0.1333 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 10/100\n", "60/60 [==============================] - 0s - loss: 93.2772 - dense_3_loss_1: 4.2087 - dense_3_loss_2: 3.9654 - dense_3_loss_3: 3.6645 - dense_3_loss_4: 3.6087 - dense_3_loss_5: 3.4273 - dense_3_loss_6: 3.4251 - dense_3_loss_7: 3.3715 - dense_3_loss_8: 3.0531 - dense_3_loss_9: 3.1099 - dense_3_loss_10: 3.0066 - dense_3_loss_11: 3.1364 - dense_3_loss_12: 3.2442 - dense_3_loss_13: 3.0378 - dense_3_loss_14: 3.0149 - dense_3_loss_15: 3.0575 - dense_3_loss_16: 3.0612 - dense_3_loss_17: 3.0185 - dense_3_loss_18: 3.0208 - dense_3_loss_19: 3.0964 - dense_3_loss_20: 3.1264 - dense_3_loss_21: 3.1232 - dense_3_loss_22: 2.9505 - dense_3_loss_23: 3.1416 - dense_3_loss_24: 3.0676 - dense_3_loss_25: 3.2097 - dense_3_loss_26: 2.8680 - dense_3_loss_27: 3.0454 - dense_3_loss_28: 3.0294 - dense_3_loss_29: 3.1868 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0833 - dense_3_acc_2: 0.1833 - dense_3_acc_3: 0.2167 - dense_3_acc_4: 0.1833 - dense_3_acc_5: 0.2833 - dense_3_acc_6: 0.1000 - dense_3_acc_7: 0.1167 - dense_3_acc_8: 0.2500 - dense_3_acc_9: 0.1833 - dense_3_acc_10: 0.1833 - dense_3_acc_11: 0.1833 - dense_3_acc_12: 0.1500 - dense_3_acc_13: 0.2000 - dense_3_acc_14: 0.2333 - dense_3_acc_15: 0.1667 - dense_3_acc_16: 0.1500 - dense_3_acc_17: 0.2167 - dense_3_acc_18: 0.2167 - dense_3_acc_19: 0.2000 - dense_3_acc_20: 0.1667 - dense_3_acc_21: 0.1833 - dense_3_acc_22: 0.1833 - dense_3_acc_23: 0.2333 - dense_3_acc_24: 0.1333 - dense_3_acc_25: 0.1333 - dense_3_acc_26: 0.2667 - dense_3_acc_27: 0.2000 - dense_3_acc_28: 0.2000 - dense_3_acc_29: 0.1500 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 11/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 89.7774 - dense_3_loss_1: 4.1967 - dense_3_loss_2: 3.9256 - dense_3_loss_3: 3.5923 - dense_3_loss_4: 3.5117 - dense_3_loss_5: 3.3100 - dense_3_loss_6: 3.2893 - dense_3_loss_7: 3.2642 - dense_3_loss_8: 2.9527 - dense_3_loss_9: 2.9944 - dense_3_loss_10: 2.9050 - dense_3_loss_11: 3.0681 - dense_3_loss_12: 3.0528 - dense_3_loss_13: 2.8347 - dense_3_loss_14: 2.8333 - dense_3_loss_15: 2.9265 - dense_3_loss_16: 2.8885 - dense_3_loss_17: 2.7442 - dense_3_loss_18: 2.8901 - dense_3_loss_19: 2.9598 - dense_3_loss_20: 2.9747 - dense_3_loss_21: 2.9813 - dense_3_loss_22: 2.8475 - dense_3_loss_23: 3.1287 - dense_3_loss_24: 2.9326 - dense_3_loss_25: 3.0973 - dense_3_loss_26: 2.7781 - dense_3_loss_27: 2.9584 - dense_3_loss_28: 2.9191 - dense_3_loss_29: 3.0198 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.2000 - dense_3_acc_3: 0.2333 - dense_3_acc_4: 0.1833 - dense_3_acc_5: 0.3000 - dense_3_acc_6: 0.1167 - dense_3_acc_7: 0.1667 - dense_3_acc_8: 0.2167 - dense_3_acc_9: 0.1667 - dense_3_acc_10: 0.2167 - dense_3_acc_11: 0.2167 - dense_3_acc_12: 0.1167 - dense_3_acc_13: 0.3000 - dense_3_acc_14: 0.3333 - dense_3_acc_15: 0.1833 - dense_3_acc_16: 0.1667 - dense_3_acc_17: 0.2667 - dense_3_acc_18: 0.2000 - dense_3_acc_19: 0.1833 - dense_3_acc_20: 0.2333 - dense_3_acc_21: 0.1667 - dense_3_acc_22: 0.2000 - dense_3_acc_23: 0.1000 - dense_3_acc_24: 0.1500 - dense_3_acc_25: 0.1667 - dense_3_acc_26: 0.3333 - dense_3_acc_27: 0.1000 - dense_3_acc_28: 0.2500 - dense_3_acc_29: 0.1833 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 12/100\n", "60/60 [==============================] - 0s - loss: 86.1381 - dense_3_loss_1: 4.1851 - dense_3_loss_2: 3.8850 - dense_3_loss_3: 3.5297 - dense_3_loss_4: 3.4131 - dense_3_loss_5: 3.2159 - dense_3_loss_6: 3.1708 - dense_3_loss_7: 3.1263 - dense_3_loss_8: 2.8819 - dense_3_loss_9: 2.8328 - dense_3_loss_10: 2.7485 - dense_3_loss_11: 2.9368 - dense_3_loss_12: 2.9211 - dense_3_loss_13: 2.7100 - dense_3_loss_14: 2.7404 - dense_3_loss_15: 2.7736 - dense_3_loss_16: 2.8558 - dense_3_loss_17: 2.6848 - dense_3_loss_18: 2.7083 - dense_3_loss_19: 2.7587 - dense_3_loss_20: 2.8939 - dense_3_loss_21: 2.8221 - dense_3_loss_22: 2.6711 - dense_3_loss_23: 2.8983 - dense_3_loss_24: 2.7623 - dense_3_loss_25: 3.0229 - dense_3_loss_26: 2.6133 - dense_3_loss_27: 2.8025 - dense_3_loss_28: 2.7344 - dense_3_loss_29: 2.8388 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.2000 - dense_3_acc_3: 0.2833 - dense_3_acc_4: 0.2000 - dense_3_acc_5: 0.2833 - dense_3_acc_6: 0.1667 - dense_3_acc_7: 0.1833 - dense_3_acc_8: 0.2500 - dense_3_acc_9: 0.2333 - dense_3_acc_10: 0.2833 - dense_3_acc_11: 0.2333 - dense_3_acc_12: 0.1833 - dense_3_acc_13: 0.3000 - dense_3_acc_14: 0.3333 - dense_3_acc_15: 0.2667 - dense_3_acc_16: 0.1667 - dense_3_acc_17: 0.3000 - dense_3_acc_18: 0.2167 - dense_3_acc_19: 0.2333 - dense_3_acc_20: 0.2667 - dense_3_acc_21: 0.2000 - dense_3_acc_22: 0.2167 - dense_3_acc_23: 0.2000 - dense_3_acc_24: 0.2333 - dense_3_acc_25: 0.1833 - dense_3_acc_26: 0.3667 - dense_3_acc_27: 0.2000 - dense_3_acc_28: 0.2333 - dense_3_acc_29: 0.2500 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 13/100\n", "60/60 [==============================] - 0s - loss: 83.0048 - dense_3_loss_1: 4.1759 - dense_3_loss_2: 3.8460 - dense_3_loss_3: 3.4680 - dense_3_loss_4: 3.3173 - dense_3_loss_5: 3.1173 - dense_3_loss_6: 3.0510 - dense_3_loss_7: 2.9889 - dense_3_loss_8: 2.7988 - dense_3_loss_9: 2.7163 - dense_3_loss_10: 2.6419 - dense_3_loss_11: 2.8107 - dense_3_loss_12: 2.7711 - dense_3_loss_13: 2.6191 - dense_3_loss_14: 2.6568 - dense_3_loss_15: 2.6911 - dense_3_loss_16: 2.7627 - dense_3_loss_17: 2.5963 - dense_3_loss_18: 2.6295 - dense_3_loss_19: 2.6522 - dense_3_loss_20: 2.7368 - dense_3_loss_21: 2.6396 - dense_3_loss_22: 2.5529 - dense_3_loss_23: 2.7474 - dense_3_loss_24: 2.6789 - dense_3_loss_25: 2.8978 - dense_3_loss_26: 2.5337 - dense_3_loss_27: 2.7028 - dense_3_loss_28: 2.5108 - dense_3_loss_29: 2.6932 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.2500 - dense_3_acc_3: 0.3167 - dense_3_acc_4: 0.2000 - dense_3_acc_5: 0.2667 - dense_3_acc_6: 0.1833 - dense_3_acc_7: 0.2500 - dense_3_acc_8: 0.2833 - dense_3_acc_9: 0.3167 - dense_3_acc_10: 0.2833 - dense_3_acc_11: 0.2667 - dense_3_acc_12: 0.1833 - dense_3_acc_13: 0.3333 - dense_3_acc_14: 0.3833 - dense_3_acc_15: 0.2833 - dense_3_acc_16: 0.1833 - dense_3_acc_17: 0.2833 - dense_3_acc_18: 0.2667 - dense_3_acc_19: 0.2333 - dense_3_acc_20: 0.2833 - dense_3_acc_21: 0.2667 - dense_3_acc_22: 0.2667 - dense_3_acc_23: 0.2667 - dense_3_acc_24: 0.2500 - dense_3_acc_25: 0.1667 - dense_3_acc_26: 0.3833 - dense_3_acc_27: 0.2167 - dense_3_acc_28: 0.3000 - dense_3_acc_29: 0.2000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 14/100\n", "60/60 [==============================] - 0s - loss: 79.0719 - dense_3_loss_1: 4.1663 - dense_3_loss_2: 3.8087 - dense_3_loss_3: 3.4003 - dense_3_loss_4: 3.2259 - dense_3_loss_5: 2.9954 - dense_3_loss_6: 2.9358 - dense_3_loss_7: 2.8625 - dense_3_loss_8: 2.6763 - dense_3_loss_9: 2.6039 - dense_3_loss_10: 2.4892 - dense_3_loss_11: 2.6584 - dense_3_loss_12: 2.6078 - dense_3_loss_13: 2.4825 - dense_3_loss_14: 2.5514 - dense_3_loss_15: 2.5484 - dense_3_loss_16: 2.6027 - dense_3_loss_17: 2.4027 - dense_3_loss_18: 2.4791 - dense_3_loss_19: 2.5219 - dense_3_loss_20: 2.5299 - dense_3_loss_21: 2.4862 - dense_3_loss_22: 2.4257 - dense_3_loss_23: 2.6476 - dense_3_loss_24: 2.4565 - dense_3_loss_25: 2.6770 - dense_3_loss_26: 2.3889 - dense_3_loss_27: 2.6094 - dense_3_loss_28: 2.3659 - dense_3_loss_29: 2.4654 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.2333 - dense_3_acc_3: 0.3167 - dense_3_acc_4: 0.2000 - dense_3_acc_5: 0.3000 - dense_3_acc_6: 0.2167 - dense_3_acc_7: 0.2500 - dense_3_acc_8: 0.2667 - dense_3_acc_9: 0.3333 - dense_3_acc_10: 0.3000 - dense_3_acc_11: 0.3000 - dense_3_acc_12: 0.2500 - dense_3_acc_13: 0.3333 - dense_3_acc_14: 0.3000 - dense_3_acc_15: 0.2833 - dense_3_acc_16: 0.2500 - dense_3_acc_17: 0.3167 - dense_3_acc_18: 0.2833 - dense_3_acc_19: 0.2667 - dense_3_acc_20: 0.3333 - dense_3_acc_21: 0.3167 - dense_3_acc_22: 0.2333 - dense_3_acc_23: 0.2500 - dense_3_acc_24: 0.2333 - dense_3_acc_25: 0.1500 - dense_3_acc_26: 0.4167 - dense_3_acc_27: 0.2500 - dense_3_acc_28: 0.3333 - dense_3_acc_29: 0.2500 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 15/100\n", "60/60 [==============================] - 0s - loss: 75.4414 - dense_3_loss_1: 4.1564 - dense_3_loss_2: 3.7674 - dense_3_loss_3: 3.3228 - dense_3_loss_4: 3.1187 - dense_3_loss_5: 2.8622 - dense_3_loss_6: 2.8109 - dense_3_loss_7: 2.7416 - dense_3_loss_8: 2.5302 - dense_3_loss_9: 2.4563 - dense_3_loss_10: 2.3512 - dense_3_loss_11: 2.5117 - dense_3_loss_12: 2.4126 - dense_3_loss_13: 2.2999 - dense_3_loss_14: 2.4006 - dense_3_loss_15: 2.3811 - dense_3_loss_16: 2.4643 - dense_3_loss_17: 2.2281 - dense_3_loss_18: 2.3949 - dense_3_loss_19: 2.4170 - dense_3_loss_20: 2.3722 - dense_3_loss_21: 2.4219 - dense_3_loss_22: 2.3248 - dense_3_loss_23: 2.5244 - dense_3_loss_24: 2.3268 - dense_3_loss_25: 2.5027 - dense_3_loss_26: 2.2544 - dense_3_loss_27: 2.5240 - dense_3_loss_28: 2.2352 - dense_3_loss_29: 2.3271 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.2333 - dense_3_acc_3: 0.3500 - dense_3_acc_4: 0.2167 - dense_3_acc_5: 0.3167 - dense_3_acc_6: 0.1833 - dense_3_acc_7: 0.2500 - dense_3_acc_8: 0.2833 - dense_3_acc_9: 0.3333 - dense_3_acc_10: 0.3333 - dense_3_acc_11: 0.3000 - dense_3_acc_12: 0.2667 - dense_3_acc_13: 0.3833 - dense_3_acc_14: 0.3000 - dense_3_acc_15: 0.3167 - dense_3_acc_16: 0.3000 - dense_3_acc_17: 0.3167 - dense_3_acc_18: 0.2167 - dense_3_acc_19: 0.2333 - dense_3_acc_20: 0.3333 - dense_3_acc_21: 0.3000 - dense_3_acc_22: 0.2500 - dense_3_acc_23: 0.2667 - dense_3_acc_24: 0.2167 - dense_3_acc_25: 0.2500 - dense_3_acc_26: 0.4000 - dense_3_acc_27: 0.2500 - dense_3_acc_28: 0.4000 - dense_3_acc_29: 0.3333 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 16/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 71.7663 - dense_3_loss_1: 4.1465 - dense_3_loss_2: 3.7265 - dense_3_loss_3: 3.2414 - dense_3_loss_4: 3.0035 - dense_3_loss_5: 2.7335 - dense_3_loss_6: 2.6863 - dense_3_loss_7: 2.6216 - dense_3_loss_8: 2.3765 - dense_3_loss_9: 2.3230 - dense_3_loss_10: 2.2207 - dense_3_loss_11: 2.3979 - dense_3_loss_12: 2.2693 - dense_3_loss_13: 2.0989 - dense_3_loss_14: 2.1999 - dense_3_loss_15: 2.2687 - dense_3_loss_16: 2.3802 - dense_3_loss_17: 2.1471 - dense_3_loss_18: 2.2193 - dense_3_loss_19: 2.2368 - dense_3_loss_20: 2.2320 - dense_3_loss_21: 2.3192 - dense_3_loss_22: 2.1732 - dense_3_loss_23: 2.3451 - dense_3_loss_24: 2.2468 - dense_3_loss_25: 2.3530 - dense_3_loss_26: 2.0803 - dense_3_loss_27: 2.4072 - dense_3_loss_28: 2.1060 - dense_3_loss_29: 2.2058 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.2333 - dense_3_acc_3: 0.3667 - dense_3_acc_4: 0.2667 - dense_3_acc_5: 0.3167 - dense_3_acc_6: 0.2667 - dense_3_acc_7: 0.2833 - dense_3_acc_8: 0.3000 - dense_3_acc_9: 0.3833 - dense_3_acc_10: 0.3167 - dense_3_acc_11: 0.3000 - dense_3_acc_12: 0.2833 - dense_3_acc_13: 0.3833 - dense_3_acc_14: 0.3833 - dense_3_acc_15: 0.3000 - dense_3_acc_16: 0.3000 - dense_3_acc_17: 0.3167 - dense_3_acc_18: 0.3167 - dense_3_acc_19: 0.3500 - dense_3_acc_20: 0.3833 - dense_3_acc_21: 0.3000 - dense_3_acc_22: 0.3333 - dense_3_acc_23: 0.2833 - dense_3_acc_24: 0.2833 - dense_3_acc_25: 0.2833 - dense_3_acc_26: 0.4500 - dense_3_acc_27: 0.2833 - dense_3_acc_28: 0.4000 - dense_3_acc_29: 0.3667 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 17/100\n", "60/60 [==============================] - 0s - loss: 68.3355 - dense_3_loss_1: 4.1376 - dense_3_loss_2: 3.6849 - dense_3_loss_3: 3.1586 - dense_3_loss_4: 2.8805 - dense_3_loss_5: 2.6052 - dense_3_loss_6: 2.5593 - dense_3_loss_7: 2.5123 - dense_3_loss_8: 2.2539 - dense_3_loss_9: 2.2053 - dense_3_loss_10: 2.1198 - dense_3_loss_11: 2.2773 - dense_3_loss_12: 2.1259 - dense_3_loss_13: 1.9597 - dense_3_loss_14: 2.0574 - dense_3_loss_15: 2.1531 - dense_3_loss_16: 2.3343 - dense_3_loss_17: 2.0600 - dense_3_loss_18: 2.0405 - dense_3_loss_19: 2.0549 - dense_3_loss_20: 2.0826 - dense_3_loss_21: 2.1626 - dense_3_loss_22: 2.0489 - dense_3_loss_23: 2.1525 - dense_3_loss_24: 2.1346 - dense_3_loss_25: 2.2580 - dense_3_loss_26: 1.9660 - dense_3_loss_27: 2.2506 - dense_3_loss_28: 2.0324 - dense_3_loss_29: 2.0668 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0333 - dense_3_acc_2: 0.2667 - dense_3_acc_3: 0.3833 - dense_3_acc_4: 0.2833 - dense_3_acc_5: 0.3667 - dense_3_acc_6: 0.3167 - dense_3_acc_7: 0.2833 - dense_3_acc_8: 0.3667 - dense_3_acc_9: 0.4167 - dense_3_acc_10: 0.3000 - dense_3_acc_11: 0.3833 - dense_3_acc_12: 0.3333 - dense_3_acc_13: 0.4167 - dense_3_acc_14: 0.4333 - dense_3_acc_15: 0.3667 - dense_3_acc_16: 0.2833 - dense_3_acc_17: 0.3500 - dense_3_acc_18: 0.4167 - dense_3_acc_19: 0.3500 - dense_3_acc_20: 0.4167 - dense_3_acc_21: 0.3000 - dense_3_acc_22: 0.3667 - dense_3_acc_23: 0.4000 - dense_3_acc_24: 0.2833 - dense_3_acc_25: 0.2167 - dense_3_acc_26: 0.4500 - dense_3_acc_27: 0.3333 - dense_3_acc_28: 0.4167 - dense_3_acc_29: 0.4167 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 18/100\n", "60/60 [==============================] - 0s - loss: 65.0833 - dense_3_loss_1: 4.1293 - dense_3_loss_2: 3.6417 - dense_3_loss_3: 3.0788 - dense_3_loss_4: 2.7682 - dense_3_loss_5: 2.4811 - dense_3_loss_6: 2.4453 - dense_3_loss_7: 2.4273 - dense_3_loss_8: 2.1346 - dense_3_loss_9: 2.1290 - dense_3_loss_10: 2.0295 - dense_3_loss_11: 2.1759 - dense_3_loss_12: 2.0149 - dense_3_loss_13: 1.8437 - dense_3_loss_14: 1.9521 - dense_3_loss_15: 2.0572 - dense_3_loss_16: 2.2185 - dense_3_loss_17: 1.9628 - dense_3_loss_18: 1.9189 - dense_3_loss_19: 1.9525 - dense_3_loss_20: 1.9539 - dense_3_loss_21: 2.0265 - dense_3_loss_22: 1.9472 - dense_3_loss_23: 2.0406 - dense_3_loss_24: 1.9760 - dense_3_loss_25: 2.1097 - dense_3_loss_26: 1.8616 - dense_3_loss_27: 2.0695 - dense_3_loss_28: 1.8369 - dense_3_loss_29: 1.9000 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.2667 - dense_3_acc_3: 0.3833 - dense_3_acc_4: 0.2667 - dense_3_acc_5: 0.3667 - dense_3_acc_6: 0.3500 - dense_3_acc_7: 0.2833 - dense_3_acc_8: 0.4167 - dense_3_acc_9: 0.4167 - dense_3_acc_10: 0.3333 - dense_3_acc_11: 0.4167 - dense_3_acc_12: 0.3833 - dense_3_acc_13: 0.4833 - dense_3_acc_14: 0.4667 - dense_3_acc_15: 0.4000 - dense_3_acc_16: 0.3167 - dense_3_acc_17: 0.4667 - dense_3_acc_18: 0.4833 - dense_3_acc_19: 0.4833 - dense_3_acc_20: 0.5000 - dense_3_acc_21: 0.3000 - dense_3_acc_22: 0.4167 - dense_3_acc_23: 0.4000 - dense_3_acc_24: 0.4000 - dense_3_acc_25: 0.3167 - dense_3_acc_26: 0.5167 - dense_3_acc_27: 0.3667 - dense_3_acc_28: 0.4333 - dense_3_acc_29: 0.4500 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 19/100\n", "60/60 [==============================] - 0s - loss: 61.7766 - dense_3_loss_1: 4.1210 - dense_3_loss_2: 3.5950 - dense_3_loss_3: 2.9932 - dense_3_loss_4: 2.6612 - dense_3_loss_5: 2.3656 - dense_3_loss_6: 2.3017 - dense_3_loss_7: 2.2957 - dense_3_loss_8: 2.0237 - dense_3_loss_9: 2.0302 - dense_3_loss_10: 1.8768 - dense_3_loss_11: 2.0286 - dense_3_loss_12: 1.8729 - dense_3_loss_13: 1.7130 - dense_3_loss_14: 1.8330 - dense_3_loss_15: 1.9161 - dense_3_loss_16: 2.0448 - dense_3_loss_17: 1.7650 - dense_3_loss_18: 1.7871 - dense_3_loss_19: 1.9010 - dense_3_loss_20: 1.8505 - dense_3_loss_21: 1.9037 - dense_3_loss_22: 1.8330 - dense_3_loss_23: 1.9260 - dense_3_loss_24: 1.8647 - dense_3_loss_25: 1.9076 - dense_3_loss_26: 1.8110 - dense_3_loss_27: 1.9703 - dense_3_loss_28: 1.7766 - dense_3_loss_29: 1.8078 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.2667 - dense_3_acc_3: 0.3833 - dense_3_acc_4: 0.2667 - dense_3_acc_5: 0.3667 - dense_3_acc_6: 0.3667 - dense_3_acc_7: 0.3667 - dense_3_acc_8: 0.4833 - dense_3_acc_9: 0.4500 - dense_3_acc_10: 0.3667 - dense_3_acc_11: 0.3833 - dense_3_acc_12: 0.4500 - dense_3_acc_13: 0.4833 - dense_3_acc_14: 0.4333 - dense_3_acc_15: 0.4333 - dense_3_acc_16: 0.3500 - dense_3_acc_17: 0.5333 - dense_3_acc_18: 0.5000 - dense_3_acc_19: 0.4167 - dense_3_acc_20: 0.5167 - dense_3_acc_21: 0.4500 - dense_3_acc_22: 0.4333 - dense_3_acc_23: 0.4500 - dense_3_acc_24: 0.3667 - dense_3_acc_25: 0.3333 - dense_3_acc_26: 0.5333 - dense_3_acc_27: 0.3500 - dense_3_acc_28: 0.4500 - dense_3_acc_29: 0.5000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 20/100\n", "60/60 [==============================] - 0s - loss: 58.5124 - dense_3_loss_1: 4.1127 - dense_3_loss_2: 3.5456 - dense_3_loss_3: 2.9150 - dense_3_loss_4: 2.5649 - dense_3_loss_5: 2.2502 - dense_3_loss_6: 2.1436 - dense_3_loss_7: 2.1437 - dense_3_loss_8: 1.9123 - dense_3_loss_9: 1.8941 - dense_3_loss_10: 1.7268 - dense_3_loss_11: 1.8765 - dense_3_loss_12: 1.7430 - dense_3_loss_13: 1.5816 - dense_3_loss_14: 1.7101 - dense_3_loss_15: 1.8160 - dense_3_loss_16: 1.8765 - dense_3_loss_17: 1.6366 - dense_3_loss_18: 1.6804 - dense_3_loss_19: 1.7571 - dense_3_loss_20: 1.7336 - dense_3_loss_21: 1.7536 - dense_3_loss_22: 1.7377 - dense_3_loss_23: 1.8607 - dense_3_loss_24: 1.7680 - dense_3_loss_25: 1.7912 - dense_3_loss_26: 1.6995 - dense_3_loss_27: 1.8596 - dense_3_loss_28: 1.7114 - dense_3_loss_29: 1.7106 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.2833 - dense_3_acc_3: 0.3833 - dense_3_acc_4: 0.2667 - dense_3_acc_5: 0.4000 - dense_3_acc_6: 0.4000 - dense_3_acc_7: 0.4167 - dense_3_acc_8: 0.4500 - dense_3_acc_9: 0.4667 - dense_3_acc_10: 0.5000 - dense_3_acc_11: 0.5167 - dense_3_acc_12: 0.5833 - dense_3_acc_13: 0.6167 - dense_3_acc_14: 0.5000 - dense_3_acc_15: 0.4500 - dense_3_acc_16: 0.4167 - dense_3_acc_17: 0.5667 - dense_3_acc_18: 0.5333 - dense_3_acc_19: 0.5167 - dense_3_acc_20: 0.5333 - dense_3_acc_21: 0.4833 - dense_3_acc_22: 0.5333 - dense_3_acc_23: 0.4667 - dense_3_acc_24: 0.3833 - dense_3_acc_25: 0.3833 - dense_3_acc_26: 0.5667 - dense_3_acc_27: 0.4167 - dense_3_acc_28: 0.5333 - dense_3_acc_29: 0.5833 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 21/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 55.6948 - dense_3_loss_1: 4.1049 - dense_3_loss_2: 3.4964 - dense_3_loss_3: 2.8339 - dense_3_loss_4: 2.4755 - dense_3_loss_5: 2.1567 - dense_3_loss_6: 2.0391 - dense_3_loss_7: 2.0218 - dense_3_loss_8: 1.8022 - dense_3_loss_9: 1.8249 - dense_3_loss_10: 1.6399 - dense_3_loss_11: 1.7723 - dense_3_loss_12: 1.6310 - dense_3_loss_13: 1.5004 - dense_3_loss_14: 1.5776 - dense_3_loss_15: 1.7338 - dense_3_loss_16: 1.7779 - dense_3_loss_17: 1.5848 - dense_3_loss_18: 1.6005 - dense_3_loss_19: 1.6140 - dense_3_loss_20: 1.6417 - dense_3_loss_21: 1.6502 - dense_3_loss_22: 1.6325 - dense_3_loss_23: 1.7198 - dense_3_loss_24: 1.6616 - dense_3_loss_25: 1.6674 - dense_3_loss_26: 1.5857 - dense_3_loss_27: 1.7353 - dense_3_loss_28: 1.5917 - dense_3_loss_29: 1.6214 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.3000 - dense_3_acc_3: 0.4000 - dense_3_acc_4: 0.2833 - dense_3_acc_5: 0.4000 - dense_3_acc_6: 0.4333 - dense_3_acc_7: 0.4667 - dense_3_acc_8: 0.4500 - dense_3_acc_9: 0.4500 - dense_3_acc_10: 0.5500 - dense_3_acc_11: 0.5000 - dense_3_acc_12: 0.5667 - dense_3_acc_13: 0.6500 - dense_3_acc_14: 0.5833 - dense_3_acc_15: 0.4833 - dense_3_acc_16: 0.4500 - dense_3_acc_17: 0.5333 - dense_3_acc_18: 0.5500 - dense_3_acc_19: 0.5333 - dense_3_acc_20: 0.6833 - dense_3_acc_21: 0.6000 - dense_3_acc_22: 0.6500 - dense_3_acc_23: 0.5000 - dense_3_acc_24: 0.5167 - dense_3_acc_25: 0.4000 - dense_3_acc_26: 0.6167 - dense_3_acc_27: 0.4333 - dense_3_acc_28: 0.5500 - dense_3_acc_29: 0.6000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 22/100\n", "60/60 [==============================] - 0s - loss: 52.7499 - dense_3_loss_1: 4.0961 - dense_3_loss_2: 3.4452 - dense_3_loss_3: 2.7487 - dense_3_loss_4: 2.3677 - dense_3_loss_5: 2.0577 - dense_3_loss_6: 1.9272 - dense_3_loss_7: 1.8913 - dense_3_loss_8: 1.7128 - dense_3_loss_9: 1.7173 - dense_3_loss_10: 1.5048 - dense_3_loss_11: 1.6246 - dense_3_loss_12: 1.4999 - dense_3_loss_13: 1.3960 - dense_3_loss_14: 1.4897 - dense_3_loss_15: 1.6020 - dense_3_loss_16: 1.6375 - dense_3_loss_17: 1.4490 - dense_3_loss_18: 1.4838 - dense_3_loss_19: 1.5098 - dense_3_loss_20: 1.5391 - dense_3_loss_21: 1.5463 - dense_3_loss_22: 1.5071 - dense_3_loss_23: 1.6056 - dense_3_loss_24: 1.5809 - dense_3_loss_25: 1.5760 - dense_3_loss_26: 1.4914 - dense_3_loss_27: 1.6325 - dense_3_loss_28: 1.5324 - dense_3_loss_29: 1.5775 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.3000 - dense_3_acc_3: 0.4333 - dense_3_acc_4: 0.2833 - dense_3_acc_5: 0.4500 - dense_3_acc_6: 0.4500 - dense_3_acc_7: 0.4500 - dense_3_acc_8: 0.5333 - dense_3_acc_9: 0.5000 - dense_3_acc_10: 0.6000 - dense_3_acc_11: 0.5833 - dense_3_acc_12: 0.6500 - dense_3_acc_13: 0.6667 - dense_3_acc_14: 0.6833 - dense_3_acc_15: 0.6000 - dense_3_acc_16: 0.5667 - dense_3_acc_17: 0.7333 - dense_3_acc_18: 0.6667 - dense_3_acc_19: 0.7667 - dense_3_acc_20: 0.7667 - dense_3_acc_21: 0.6833 - dense_3_acc_22: 0.7000 - dense_3_acc_23: 0.6000 - dense_3_acc_24: 0.5667 - dense_3_acc_25: 0.5167 - dense_3_acc_26: 0.7167 - dense_3_acc_27: 0.6167 - dense_3_acc_28: 0.6167 - dense_3_acc_29: 0.6167 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 23/100\n", "60/60 [==============================] - 0s - loss: 50.0865 - dense_3_loss_1: 4.0873 - dense_3_loss_2: 3.3924 - dense_3_loss_3: 2.6599 - dense_3_loss_4: 2.2665 - dense_3_loss_5: 1.9571 - dense_3_loss_6: 1.8179 - dense_3_loss_7: 1.8136 - dense_3_loss_8: 1.6007 - dense_3_loss_9: 1.6287 - dense_3_loss_10: 1.3928 - dense_3_loss_11: 1.5430 - dense_3_loss_12: 1.3969 - dense_3_loss_13: 1.2929 - dense_3_loss_14: 1.3787 - dense_3_loss_15: 1.5679 - dense_3_loss_16: 1.5375 - dense_3_loss_17: 1.3362 - dense_3_loss_18: 1.3794 - dense_3_loss_19: 1.3953 - dense_3_loss_20: 1.4269 - dense_3_loss_21: 1.4462 - dense_3_loss_22: 1.4546 - dense_3_loss_23: 1.5470 - dense_3_loss_24: 1.4388 - dense_3_loss_25: 1.4712 - dense_3_loss_26: 1.3819 - dense_3_loss_27: 1.5626 - dense_3_loss_28: 1.4134 - dense_3_loss_29: 1.4990 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.3000 - dense_3_acc_3: 0.4333 - dense_3_acc_4: 0.3167 - dense_3_acc_5: 0.4833 - dense_3_acc_6: 0.4667 - dense_3_acc_7: 0.4500 - dense_3_acc_8: 0.6000 - dense_3_acc_9: 0.5500 - dense_3_acc_10: 0.6833 - dense_3_acc_11: 0.6333 - dense_3_acc_12: 0.7000 - dense_3_acc_13: 0.7500 - dense_3_acc_14: 0.6500 - dense_3_acc_15: 0.6000 - dense_3_acc_16: 0.6000 - dense_3_acc_17: 0.7667 - dense_3_acc_18: 0.6500 - dense_3_acc_19: 0.7333 - dense_3_acc_20: 0.7500 - dense_3_acc_21: 0.7333 - dense_3_acc_22: 0.6333 - dense_3_acc_23: 0.6667 - dense_3_acc_24: 0.7333 - dense_3_acc_25: 0.5833 - dense_3_acc_26: 0.7667 - dense_3_acc_27: 0.6000 - dense_3_acc_28: 0.7167 - dense_3_acc_29: 0.7000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 24/100\n", "60/60 [==============================] - 0s - loss: 47.3293 - dense_3_loss_1: 4.0794 - dense_3_loss_2: 3.3383 - dense_3_loss_3: 2.5686 - dense_3_loss_4: 2.1640 - dense_3_loss_5: 1.8703 - dense_3_loss_6: 1.7208 - dense_3_loss_7: 1.6661 - dense_3_loss_8: 1.5116 - dense_3_loss_9: 1.5256 - dense_3_loss_10: 1.3162 - dense_3_loss_11: 1.4563 - dense_3_loss_12: 1.3335 - dense_3_loss_13: 1.1835 - dense_3_loss_14: 1.2767 - dense_3_loss_15: 1.4614 - dense_3_loss_16: 1.4095 - dense_3_loss_17: 1.2758 - dense_3_loss_18: 1.3108 - dense_3_loss_19: 1.3140 - dense_3_loss_20: 1.3340 - dense_3_loss_21: 1.3294 - dense_3_loss_22: 1.3148 - dense_3_loss_23: 1.4156 - dense_3_loss_24: 1.3646 - dense_3_loss_25: 1.3697 - dense_3_loss_26: 1.3194 - dense_3_loss_27: 1.4448 - dense_3_loss_28: 1.2937 - dense_3_loss_29: 1.3606 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.2833 - dense_3_acc_3: 0.4333 - dense_3_acc_4: 0.3833 - dense_3_acc_5: 0.5500 - dense_3_acc_6: 0.5500 - dense_3_acc_7: 0.5667 - dense_3_acc_8: 0.6000 - dense_3_acc_9: 0.6167 - dense_3_acc_10: 0.7333 - dense_3_acc_11: 0.6667 - dense_3_acc_12: 0.7833 - dense_3_acc_13: 0.9167 - dense_3_acc_14: 0.8000 - dense_3_acc_15: 0.6333 - dense_3_acc_16: 0.7000 - dense_3_acc_17: 0.8000 - dense_3_acc_18: 0.7333 - dense_3_acc_19: 0.8000 - dense_3_acc_20: 0.7500 - dense_3_acc_21: 0.7500 - dense_3_acc_22: 0.7833 - dense_3_acc_23: 0.7333 - dense_3_acc_24: 0.6833 - dense_3_acc_25: 0.6667 - dense_3_acc_26: 0.7333 - dense_3_acc_27: 0.6833 - dense_3_acc_28: 0.7833 - dense_3_acc_29: 0.7833 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 25/100\n", "60/60 [==============================] - 0s - loss: 44.7783 - dense_3_loss_1: 4.0718 - dense_3_loss_2: 3.2835 - dense_3_loss_3: 2.4775 - dense_3_loss_4: 2.0668 - dense_3_loss_5: 1.7819 - dense_3_loss_6: 1.6204 - dense_3_loss_7: 1.5602 - dense_3_loss_8: 1.4220 - dense_3_loss_9: 1.4096 - dense_3_loss_10: 1.1763 - dense_3_loss_11: 1.3380 - dense_3_loss_12: 1.2300 - dense_3_loss_13: 1.1102 - dense_3_loss_14: 1.1792 - dense_3_loss_15: 1.3255 - dense_3_loss_16: 1.2836 - dense_3_loss_17: 1.2231 - dense_3_loss_18: 1.2147 - dense_3_loss_19: 1.2093 - dense_3_loss_20: 1.2483 - dense_3_loss_21: 1.2718 - dense_3_loss_22: 1.2400 - dense_3_loss_23: 1.3111 - dense_3_loss_24: 1.2858 - dense_3_loss_25: 1.2806 - dense_3_loss_26: 1.2397 - dense_3_loss_27: 1.3657 - dense_3_loss_28: 1.2613 - dense_3_loss_29: 1.2905 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.3167 - dense_3_acc_3: 0.4333 - dense_3_acc_4: 0.3833 - dense_3_acc_5: 0.5667 - dense_3_acc_6: 0.5500 - dense_3_acc_7: 0.5667 - dense_3_acc_8: 0.6667 - dense_3_acc_9: 0.6667 - dense_3_acc_10: 0.8333 - dense_3_acc_11: 0.8167 - dense_3_acc_12: 0.8167 - dense_3_acc_13: 0.9333 - dense_3_acc_14: 0.8333 - dense_3_acc_15: 0.7333 - dense_3_acc_16: 0.8000 - dense_3_acc_17: 0.8000 - dense_3_acc_18: 0.8667 - dense_3_acc_19: 0.8667 - dense_3_acc_20: 0.8167 - dense_3_acc_21: 0.7667 - dense_3_acc_22: 0.8167 - dense_3_acc_23: 0.7167 - dense_3_acc_24: 0.7333 - dense_3_acc_25: 0.6833 - dense_3_acc_26: 0.7500 - dense_3_acc_27: 0.7000 - dense_3_acc_28: 0.7833 - dense_3_acc_29: 0.8667 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 26/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 42.3643 - dense_3_loss_1: 4.0625 - dense_3_loss_2: 3.2319 - dense_3_loss_3: 2.3908 - dense_3_loss_4: 1.9691 - dense_3_loss_5: 1.6800 - dense_3_loss_6: 1.5297 - dense_3_loss_7: 1.4879 - dense_3_loss_8: 1.3161 - dense_3_loss_9: 1.3222 - dense_3_loss_10: 1.0940 - dense_3_loss_11: 1.2371 - dense_3_loss_12: 1.1577 - dense_3_loss_13: 1.0459 - dense_3_loss_14: 1.1061 - dense_3_loss_15: 1.2350 - dense_3_loss_16: 1.1857 - dense_3_loss_17: 1.1212 - dense_3_loss_18: 1.1218 - dense_3_loss_19: 1.1169 - dense_3_loss_20: 1.2073 - dense_3_loss_21: 1.2015 - dense_3_loss_22: 1.1525 - dense_3_loss_23: 1.2273 - dense_3_loss_24: 1.1788 - dense_3_loss_25: 1.2191 - dense_3_loss_26: 1.1470 - dense_3_loss_27: 1.2623 - dense_3_loss_28: 1.1583 - dense_3_loss_29: 1.1985 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.3167 - dense_3_acc_3: 0.4333 - dense_3_acc_4: 0.4000 - dense_3_acc_5: 0.6000 - dense_3_acc_6: 0.5833 - dense_3_acc_7: 0.5667 - dense_3_acc_8: 0.7500 - dense_3_acc_9: 0.7167 - dense_3_acc_10: 0.8333 - dense_3_acc_11: 0.7667 - dense_3_acc_12: 0.8500 - dense_3_acc_13: 0.9333 - dense_3_acc_14: 0.8500 - dense_3_acc_15: 0.7833 - dense_3_acc_16: 0.8333 - dense_3_acc_17: 0.8333 - dense_3_acc_18: 0.8167 - dense_3_acc_19: 0.8833 - dense_3_acc_20: 0.8167 - dense_3_acc_21: 0.8000 - dense_3_acc_22: 0.8000 - dense_3_acc_23: 0.7333 - dense_3_acc_24: 0.7333 - dense_3_acc_25: 0.7333 - dense_3_acc_26: 0.8333 - dense_3_acc_27: 0.7500 - dense_3_acc_28: 0.8167 - dense_3_acc_29: 0.8333 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 27/100\n", "60/60 [==============================] - 0s - loss: 40.0433 - dense_3_loss_1: 4.0551 - dense_3_loss_2: 3.1792 - dense_3_loss_3: 2.3078 - dense_3_loss_4: 1.8701 - dense_3_loss_5: 1.6002 - dense_3_loss_6: 1.4202 - dense_3_loss_7: 1.3684 - dense_3_loss_8: 1.2572 - dense_3_loss_9: 1.2079 - dense_3_loss_10: 1.0039 - dense_3_loss_11: 1.1371 - dense_3_loss_12: 1.0759 - dense_3_loss_13: 0.9785 - dense_3_loss_14: 1.0105 - dense_3_loss_15: 1.1250 - dense_3_loss_16: 1.1220 - dense_3_loss_17: 1.0157 - dense_3_loss_18: 1.0468 - dense_3_loss_19: 1.0427 - dense_3_loss_20: 1.1347 - dense_3_loss_21: 1.1172 - dense_3_loss_22: 1.0427 - dense_3_loss_23: 1.1396 - dense_3_loss_24: 1.1495 - dense_3_loss_25: 1.1457 - dense_3_loss_26: 1.0536 - dense_3_loss_27: 1.1969 - dense_3_loss_28: 1.1147 - dense_3_loss_29: 1.1245 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.3667 - dense_3_acc_3: 0.5000 - dense_3_acc_4: 0.4333 - dense_3_acc_5: 0.6333 - dense_3_acc_6: 0.6000 - dense_3_acc_7: 0.6333 - dense_3_acc_8: 0.7500 - dense_3_acc_9: 0.7500 - dense_3_acc_10: 0.8667 - dense_3_acc_11: 0.8333 - dense_3_acc_12: 0.8667 - dense_3_acc_13: 0.9500 - dense_3_acc_14: 0.8667 - dense_3_acc_15: 0.7833 - dense_3_acc_16: 0.8167 - dense_3_acc_17: 0.8833 - dense_3_acc_18: 0.9333 - dense_3_acc_19: 0.8667 - dense_3_acc_20: 0.8167 - dense_3_acc_21: 0.8333 - dense_3_acc_22: 0.9000 - dense_3_acc_23: 0.7667 - dense_3_acc_24: 0.7500 - dense_3_acc_25: 0.7000 - dense_3_acc_26: 0.8667 - dense_3_acc_27: 0.7167 - dense_3_acc_28: 0.8000 - dense_3_acc_29: 0.8500 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 28/100\n", "60/60 [==============================] - 0s - loss: 37.8408 - dense_3_loss_1: 4.0473 - dense_3_loss_2: 3.1271 - dense_3_loss_3: 2.2280 - dense_3_loss_4: 1.7658 - dense_3_loss_5: 1.5225 - dense_3_loss_6: 1.3421 - dense_3_loss_7: 1.2817 - dense_3_loss_8: 1.1570 - dense_3_loss_9: 1.1156 - dense_3_loss_10: 0.9424 - dense_3_loss_11: 1.0540 - dense_3_loss_12: 1.0167 - dense_3_loss_13: 0.9276 - dense_3_loss_14: 0.9488 - dense_3_loss_15: 1.0503 - dense_3_loss_16: 1.0384 - dense_3_loss_17: 0.9626 - dense_3_loss_18: 0.9555 - dense_3_loss_19: 0.9663 - dense_3_loss_20: 1.0471 - dense_3_loss_21: 1.0445 - dense_3_loss_22: 0.9935 - dense_3_loss_23: 1.0451 - dense_3_loss_24: 1.0450 - dense_3_loss_25: 1.0580 - dense_3_loss_26: 0.9897 - dense_3_loss_27: 1.0922 - dense_3_loss_28: 1.0376 - dense_3_loss_29: 1.0385 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.3667 - dense_3_acc_3: 0.5000 - dense_3_acc_4: 0.4500 - dense_3_acc_5: 0.6333 - dense_3_acc_6: 0.6333 - dense_3_acc_7: 0.7000 - dense_3_acc_8: 0.7833 - dense_3_acc_9: 0.7667 - dense_3_acc_10: 0.9167 - dense_3_acc_11: 0.8500 - dense_3_acc_12: 0.8667 - dense_3_acc_13: 0.9667 - dense_3_acc_14: 0.8667 - dense_3_acc_15: 0.7833 - dense_3_acc_16: 0.8833 - dense_3_acc_17: 0.9333 - dense_3_acc_18: 0.9333 - dense_3_acc_19: 0.9167 - dense_3_acc_20: 0.8333 - dense_3_acc_21: 0.8333 - dense_3_acc_22: 0.9000 - dense_3_acc_23: 0.8333 - dense_3_acc_24: 0.8500 - dense_3_acc_25: 0.8667 - dense_3_acc_26: 0.8833 - dense_3_acc_27: 0.8500 - dense_3_acc_28: 0.8500 - dense_3_acc_29: 0.9000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 29/100\n", "60/60 [==============================] - 0s - loss: 35.7033 - dense_3_loss_1: 4.0396 - dense_3_loss_2: 3.0754 - dense_3_loss_3: 2.1505 - dense_3_loss_4: 1.6715 - dense_3_loss_5: 1.4395 - dense_3_loss_6: 1.2575 - dense_3_loss_7: 1.1955 - dense_3_loss_8: 1.0794 - dense_3_loss_9: 1.0436 - dense_3_loss_10: 0.8661 - dense_3_loss_11: 0.9597 - dense_3_loss_12: 0.9444 - dense_3_loss_13: 0.8435 - dense_3_loss_14: 0.8956 - dense_3_loss_15: 0.9755 - dense_3_loss_16: 0.9516 - dense_3_loss_17: 0.9014 - dense_3_loss_18: 0.8765 - dense_3_loss_19: 0.8926 - dense_3_loss_20: 0.9688 - dense_3_loss_21: 0.9781 - dense_3_loss_22: 0.9283 - dense_3_loss_23: 0.9825 - dense_3_loss_24: 0.9446 - dense_3_loss_25: 0.9978 - dense_3_loss_26: 0.9041 - dense_3_loss_27: 0.9991 - dense_3_loss_28: 0.9786 - dense_3_loss_29: 0.9620 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.3667 - dense_3_acc_3: 0.5333 - dense_3_acc_4: 0.4833 - dense_3_acc_5: 0.6667 - dense_3_acc_6: 0.6500 - dense_3_acc_7: 0.7167 - dense_3_acc_8: 0.8167 - dense_3_acc_9: 0.8000 - dense_3_acc_10: 0.9333 - dense_3_acc_11: 0.8500 - dense_3_acc_12: 0.9333 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 0.8833 - dense_3_acc_15: 0.8667 - dense_3_acc_16: 0.9167 - dense_3_acc_17: 0.9500 - dense_3_acc_18: 0.9500 - dense_3_acc_19: 0.9000 - dense_3_acc_20: 0.8667 - dense_3_acc_21: 0.9333 - dense_3_acc_22: 0.9167 - dense_3_acc_23: 0.8500 - dense_3_acc_24: 0.9000 - dense_3_acc_25: 0.8167 - dense_3_acc_26: 0.9333 - dense_3_acc_27: 0.8833 - dense_3_acc_28: 0.8833 - dense_3_acc_29: 0.9000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 30/100\n", "60/60 [==============================] - 0s - loss: 33.7039 - dense_3_loss_1: 4.0328 - dense_3_loss_2: 3.0228 - dense_3_loss_3: 2.0741 - dense_3_loss_4: 1.5809 - dense_3_loss_5: 1.3546 - dense_3_loss_6: 1.1808 - dense_3_loss_7: 1.1003 - dense_3_loss_8: 1.0085 - dense_3_loss_9: 0.9891 - dense_3_loss_10: 0.7921 - dense_3_loss_11: 0.8800 - dense_3_loss_12: 0.8485 - dense_3_loss_13: 0.7649 - dense_3_loss_14: 0.8186 - dense_3_loss_15: 0.8983 - dense_3_loss_16: 0.8932 - dense_3_loss_17: 0.8247 - dense_3_loss_18: 0.8080 - dense_3_loss_19: 0.8348 - dense_3_loss_20: 0.8945 - dense_3_loss_21: 0.9249 - dense_3_loss_22: 0.8583 - dense_3_loss_23: 0.9381 - dense_3_loss_24: 0.8961 - dense_3_loss_25: 0.9232 - dense_3_loss_26: 0.8441 - dense_3_loss_27: 0.9324 - dense_3_loss_28: 0.8961 - dense_3_loss_29: 0.8892 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.3833 - dense_3_acc_3: 0.5500 - dense_3_acc_4: 0.5000 - dense_3_acc_5: 0.6833 - dense_3_acc_6: 0.6833 - dense_3_acc_7: 0.7500 - dense_3_acc_8: 0.8667 - dense_3_acc_9: 0.8667 - dense_3_acc_10: 0.9500 - dense_3_acc_11: 0.8667 - dense_3_acc_12: 0.9833 - dense_3_acc_13: 0.9833 - dense_3_acc_14: 0.8833 - dense_3_acc_15: 0.8667 - dense_3_acc_16: 0.9500 - dense_3_acc_17: 0.9667 - dense_3_acc_18: 0.9833 - dense_3_acc_19: 0.9167 - dense_3_acc_20: 0.9167 - dense_3_acc_21: 0.9333 - dense_3_acc_22: 0.9167 - dense_3_acc_23: 0.8667 - dense_3_acc_24: 0.8667 - dense_3_acc_25: 0.8500 - dense_3_acc_26: 0.9833 - dense_3_acc_27: 0.9000 - dense_3_acc_28: 0.9000 - dense_3_acc_29: 0.9167 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 31/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 31.7804 - dense_3_loss_1: 4.0260 - dense_3_loss_2: 2.9710 - dense_3_loss_3: 1.9995 - dense_3_loss_4: 1.4864 - dense_3_loss_5: 1.2747 - dense_3_loss_6: 1.0995 - dense_3_loss_7: 1.0271 - dense_3_loss_8: 0.9407 - dense_3_loss_9: 0.8778 - dense_3_loss_10: 0.7492 - dense_3_loss_11: 0.8115 - dense_3_loss_12: 0.7882 - dense_3_loss_13: 0.7049 - dense_3_loss_14: 0.7604 - dense_3_loss_15: 0.8373 - dense_3_loss_16: 0.8212 - dense_3_loss_17: 0.7532 - dense_3_loss_18: 0.7486 - dense_3_loss_19: 0.7763 - dense_3_loss_20: 0.8250 - dense_3_loss_21: 0.8591 - dense_3_loss_22: 0.7948 - dense_3_loss_23: 0.8666 - dense_3_loss_24: 0.8291 - dense_3_loss_25: 0.8538 - dense_3_loss_26: 0.7809 - dense_3_loss_27: 0.8669 - dense_3_loss_28: 0.8259 - dense_3_loss_29: 0.8248 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.3833 - dense_3_acc_3: 0.5667 - dense_3_acc_4: 0.5500 - dense_3_acc_5: 0.7167 - dense_3_acc_6: 0.7167 - dense_3_acc_7: 0.8833 - dense_3_acc_8: 0.8833 - dense_3_acc_9: 0.8833 - dense_3_acc_10: 0.9500 - dense_3_acc_11: 0.8667 - dense_3_acc_12: 0.9833 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 0.9500 - dense_3_acc_15: 0.9333 - dense_3_acc_16: 0.9167 - dense_3_acc_17: 0.9833 - dense_3_acc_18: 0.9833 - dense_3_acc_19: 0.9167 - dense_3_acc_20: 0.9500 - dense_3_acc_21: 0.9500 - dense_3_acc_22: 0.9500 - dense_3_acc_23: 0.9000 - dense_3_acc_24: 0.9333 - dense_3_acc_25: 0.9000 - dense_3_acc_26: 0.9667 - dense_3_acc_27: 0.9167 - dense_3_acc_28: 0.9667 - dense_3_acc_29: 0.9500 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 32/100\n", "60/60 [==============================] - 0s - loss: 29.9572 - dense_3_loss_1: 4.0191 - dense_3_loss_2: 2.9193 - dense_3_loss_3: 1.9249 - dense_3_loss_4: 1.3964 - dense_3_loss_5: 1.1966 - dense_3_loss_6: 1.0274 - dense_3_loss_7: 0.9507 - dense_3_loss_8: 0.8630 - dense_3_loss_9: 0.8138 - dense_3_loss_10: 0.6854 - dense_3_loss_11: 0.7322 - dense_3_loss_12: 0.7169 - dense_3_loss_13: 0.6653 - dense_3_loss_14: 0.6980 - dense_3_loss_15: 0.7561 - dense_3_loss_16: 0.7678 - dense_3_loss_17: 0.6893 - dense_3_loss_18: 0.6953 - dense_3_loss_19: 0.7289 - dense_3_loss_20: 0.7689 - dense_3_loss_21: 0.8059 - dense_3_loss_22: 0.7554 - dense_3_loss_23: 0.7780 - dense_3_loss_24: 0.7614 - dense_3_loss_25: 0.7823 - dense_3_loss_26: 0.7236 - dense_3_loss_27: 0.8064 - dense_3_loss_28: 0.7633 - dense_3_loss_29: 0.7654 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.3833 - dense_3_acc_3: 0.5833 - dense_3_acc_4: 0.6667 - dense_3_acc_5: 0.7000 - dense_3_acc_6: 0.8000 - dense_3_acc_7: 0.8833 - dense_3_acc_8: 0.9167 - dense_3_acc_9: 0.9000 - dense_3_acc_10: 0.9667 - dense_3_acc_11: 0.8833 - dense_3_acc_12: 0.9833 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 0.9500 - dense_3_acc_15: 0.9833 - dense_3_acc_16: 0.9500 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 0.9500 - dense_3_acc_20: 0.9500 - dense_3_acc_21: 0.9667 - dense_3_acc_22: 0.9667 - dense_3_acc_23: 0.9167 - dense_3_acc_24: 0.9500 - dense_3_acc_25: 0.9500 - dense_3_acc_26: 0.9667 - dense_3_acc_27: 0.9667 - dense_3_acc_28: 0.9833 - dense_3_acc_29: 0.9500 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 33/100\n", "60/60 [==============================] - 0s - loss: 28.2330 - dense_3_loss_1: 4.0134 - dense_3_loss_2: 2.8687 - dense_3_loss_3: 1.8519 - dense_3_loss_4: 1.3162 - dense_3_loss_5: 1.1228 - dense_3_loss_6: 0.9444 - dense_3_loss_7: 0.8796 - dense_3_loss_8: 0.7973 - dense_3_loss_9: 0.7531 - dense_3_loss_10: 0.6308 - dense_3_loss_11: 0.6741 - dense_3_loss_12: 0.6602 - dense_3_loss_13: 0.6183 - dense_3_loss_14: 0.6453 - dense_3_loss_15: 0.6876 - dense_3_loss_16: 0.7099 - dense_3_loss_17: 0.6308 - dense_3_loss_18: 0.6505 - dense_3_loss_19: 0.6624 - dense_3_loss_20: 0.7103 - dense_3_loss_21: 0.7301 - dense_3_loss_22: 0.6854 - dense_3_loss_23: 0.7145 - dense_3_loss_24: 0.6995 - dense_3_loss_25: 0.7296 - dense_3_loss_26: 0.6677 - dense_3_loss_27: 0.7509 - dense_3_loss_28: 0.7098 - dense_3_loss_29: 0.7177 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.3833 - dense_3_acc_3: 0.6333 - dense_3_acc_4: 0.7167 - dense_3_acc_5: 0.7333 - dense_3_acc_6: 0.8333 - dense_3_acc_7: 0.9333 - dense_3_acc_8: 0.9333 - dense_3_acc_9: 0.9167 - dense_3_acc_10: 0.9833 - dense_3_acc_11: 0.9500 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 0.9667 - dense_3_acc_15: 0.9667 - dense_3_acc_16: 0.9833 - dense_3_acc_17: 0.9833 - dense_3_acc_18: 0.9833 - dense_3_acc_19: 0.9667 - dense_3_acc_20: 0.9500 - dense_3_acc_21: 0.9667 - dense_3_acc_22: 0.9833 - dense_3_acc_23: 0.9500 - dense_3_acc_24: 0.9500 - dense_3_acc_25: 0.9500 - dense_3_acc_26: 0.9833 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 0.9833 - dense_3_acc_29: 0.9500 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 34/100\n", "60/60 [==============================] - 0s - loss: 26.5968 - dense_3_loss_1: 4.0066 - dense_3_loss_2: 2.8167 - dense_3_loss_3: 1.7786 - dense_3_loss_4: 1.2290 - dense_3_loss_5: 1.0510 - dense_3_loss_6: 0.8713 - dense_3_loss_7: 0.8221 - dense_3_loss_8: 0.7358 - dense_3_loss_9: 0.6864 - dense_3_loss_10: 0.5716 - dense_3_loss_11: 0.6296 - dense_3_loss_12: 0.6015 - dense_3_loss_13: 0.5649 - dense_3_loss_14: 0.5869 - dense_3_loss_15: 0.6331 - dense_3_loss_16: 0.6397 - dense_3_loss_17: 0.5567 - dense_3_loss_18: 0.5959 - dense_3_loss_19: 0.6151 - dense_3_loss_20: 0.6522 - dense_3_loss_21: 0.6839 - dense_3_loss_22: 0.6312 - dense_3_loss_23: 0.6669 - dense_3_loss_24: 0.6570 - dense_3_loss_25: 0.6747 - dense_3_loss_26: 0.6279 - dense_3_loss_27: 0.6883 - dense_3_loss_28: 0.6555 - dense_3_loss_29: 0.6668 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.3833 - dense_3_acc_3: 0.6333 - dense_3_acc_4: 0.7167 - dense_3_acc_5: 0.7333 - dense_3_acc_6: 0.8500 - dense_3_acc_7: 0.9167 - dense_3_acc_8: 0.9500 - dense_3_acc_9: 0.9500 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 0.9500 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 0.9667 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 0.9833 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 0.9833 - dense_3_acc_20: 0.9667 - dense_3_acc_21: 0.9833 - dense_3_acc_22: 0.9833 - dense_3_acc_23: 0.9667 - dense_3_acc_24: 0.9500 - dense_3_acc_25: 0.9667 - dense_3_acc_26: 0.9833 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 0.9833 - dense_3_acc_29: 0.9500 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 35/100\n", "60/60 [==============================] - 0s - loss: 25.0555 - dense_3_loss_1: 3.9999 - dense_3_loss_2: 2.7651 - dense_3_loss_3: 1.7112 - dense_3_loss_4: 1.1411 - dense_3_loss_5: 0.9883 - dense_3_loss_6: 0.8102 - dense_3_loss_7: 0.7598 - dense_3_loss_8: 0.6819 - dense_3_loss_9: 0.6191 - dense_3_loss_10: 0.5225 - dense_3_loss_11: 0.5772 - dense_3_loss_12: 0.5470 - dense_3_loss_13: 0.5182 - dense_3_loss_14: 0.5437 - dense_3_loss_15: 0.5749 - dense_3_loss_16: 0.5989 - dense_3_loss_17: 0.5253 - dense_3_loss_18: 0.5412 - dense_3_loss_19: 0.5755 - dense_3_loss_20: 0.6061 - dense_3_loss_21: 0.6264 - dense_3_loss_22: 0.5693 - dense_3_loss_23: 0.6107 - dense_3_loss_24: 0.6060 - dense_3_loss_25: 0.6175 - dense_3_loss_26: 0.5755 - dense_3_loss_27: 0.6228 - dense_3_loss_28: 0.6056 - dense_3_loss_29: 0.6144 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.3833 - dense_3_acc_3: 0.6500 - dense_3_acc_4: 0.7167 - dense_3_acc_5: 0.7500 - dense_3_acc_6: 0.8667 - dense_3_acc_7: 0.9167 - dense_3_acc_8: 0.9500 - dense_3_acc_9: 0.9500 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 0.9333 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 0.9833 - dense_3_acc_16: 0.9833 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 0.9833 - dense_3_acc_20: 0.9833 - dense_3_acc_21: 0.9833 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 0.9833 - dense_3_acc_24: 0.9500 - dense_3_acc_25: 0.9667 - dense_3_acc_26: 0.9833 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 0.9833 - dense_3_acc_29: 0.9500 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 36/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 23.5779 - dense_3_loss_1: 3.9930 - dense_3_loss_2: 2.7169 - dense_3_loss_3: 1.6461 - dense_3_loss_4: 1.0652 - dense_3_loss_5: 0.9224 - dense_3_loss_6: 0.7446 - dense_3_loss_7: 0.7031 - dense_3_loss_8: 0.6223 - dense_3_loss_9: 0.5618 - dense_3_loss_10: 0.4803 - dense_3_loss_11: 0.5266 - dense_3_loss_12: 0.5056 - dense_3_loss_13: 0.4829 - dense_3_loss_14: 0.4842 - dense_3_loss_15: 0.5274 - dense_3_loss_16: 0.5364 - dense_3_loss_17: 0.4826 - dense_3_loss_18: 0.4989 - dense_3_loss_19: 0.5226 - dense_3_loss_20: 0.5567 - dense_3_loss_21: 0.5702 - dense_3_loss_22: 0.5278 - dense_3_loss_23: 0.5624 - dense_3_loss_24: 0.5477 - dense_3_loss_25: 0.5641 - dense_3_loss_26: 0.5171 - dense_3_loss_27: 0.5727 - dense_3_loss_28: 0.5658 - dense_3_loss_29: 0.5703 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4000 - dense_3_acc_3: 0.6500 - dense_3_acc_4: 0.7667 - dense_3_acc_5: 0.7667 - dense_3_acc_6: 0.9333 - dense_3_acc_7: 0.9167 - dense_3_acc_8: 0.9667 - dense_3_acc_9: 0.9500 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 0.9833 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 0.9833 - dense_3_acc_20: 0.9833 - dense_3_acc_21: 0.9833 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 0.9667 - dense_3_acc_25: 0.9667 - dense_3_acc_26: 0.9833 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 0.9833 - dense_3_acc_29: 0.9500 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 37/100\n", "60/60 [==============================] - 0s - loss: 22.2596 - dense_3_loss_1: 3.9865 - dense_3_loss_2: 2.6684 - dense_3_loss_3: 1.5846 - dense_3_loss_4: 0.9982 - dense_3_loss_5: 0.8616 - dense_3_loss_6: 0.6853 - dense_3_loss_7: 0.6511 - dense_3_loss_8: 0.5623 - dense_3_loss_9: 0.5202 - dense_3_loss_10: 0.4396 - dense_3_loss_11: 0.4867 - dense_3_loss_12: 0.4665 - dense_3_loss_13: 0.4393 - dense_3_loss_14: 0.4387 - dense_3_loss_15: 0.4889 - dense_3_loss_16: 0.4684 - dense_3_loss_17: 0.4381 - dense_3_loss_18: 0.4597 - dense_3_loss_19: 0.4720 - dense_3_loss_20: 0.5177 - dense_3_loss_21: 0.5265 - dense_3_loss_22: 0.4868 - dense_3_loss_23: 0.5142 - dense_3_loss_24: 0.5083 - dense_3_loss_25: 0.5311 - dense_3_loss_26: 0.4714 - dense_3_loss_27: 0.5359 - dense_3_loss_28: 0.5203 - dense_3_loss_29: 0.5315 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4000 - dense_3_acc_3: 0.6500 - dense_3_acc_4: 0.8333 - dense_3_acc_5: 0.7833 - dense_3_acc_6: 0.9167 - dense_3_acc_7: 0.9167 - dense_3_acc_8: 0.9833 - dense_3_acc_9: 0.9500 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 0.9833 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 0.9833 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 0.9833 - dense_3_acc_20: 0.9833 - dense_3_acc_21: 0.9833 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 0.9833 - dense_3_acc_24: 0.9833 - dense_3_acc_25: 0.9667 - dense_3_acc_26: 0.9833 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 0.9833 - dense_3_acc_29: 0.9500 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 38/100\n", "60/60 [==============================] - 0s - loss: 21.0232 - dense_3_loss_1: 3.9804 - dense_3_loss_2: 2.6199 - dense_3_loss_3: 1.5233 - dense_3_loss_4: 0.9319 - dense_3_loss_5: 0.8066 - dense_3_loss_6: 0.6395 - dense_3_loss_7: 0.5961 - dense_3_loss_8: 0.5117 - dense_3_loss_9: 0.4813 - dense_3_loss_10: 0.4049 - dense_3_loss_11: 0.4359 - dense_3_loss_12: 0.4250 - dense_3_loss_13: 0.4014 - dense_3_loss_14: 0.4074 - dense_3_loss_15: 0.4434 - dense_3_loss_16: 0.4303 - dense_3_loss_17: 0.4081 - dense_3_loss_18: 0.4178 - dense_3_loss_19: 0.4378 - dense_3_loss_20: 0.4825 - dense_3_loss_21: 0.4894 - dense_3_loss_22: 0.4419 - dense_3_loss_23: 0.4597 - dense_3_loss_24: 0.4672 - dense_3_loss_25: 0.4959 - dense_3_loss_26: 0.4356 - dense_3_loss_27: 0.4870 - dense_3_loss_28: 0.4699 - dense_3_loss_29: 0.4915 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4000 - dense_3_acc_3: 0.6500 - dense_3_acc_4: 0.8500 - dense_3_acc_5: 0.8000 - dense_3_acc_6: 0.9500 - dense_3_acc_7: 0.9500 - dense_3_acc_8: 0.9833 - dense_3_acc_9: 0.9667 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 0.9833 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 0.9833 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 0.9833 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 0.9833 - dense_3_acc_25: 0.9667 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 0.9833 - dense_3_acc_29: 0.9667 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 39/100\n", "60/60 [==============================] - 0s - loss: 19.8751 - dense_3_loss_1: 3.9746 - dense_3_loss_2: 2.5733 - dense_3_loss_3: 1.4618 - dense_3_loss_4: 0.8673 - dense_3_loss_5: 0.7507 - dense_3_loss_6: 0.5973 - dense_3_loss_7: 0.5490 - dense_3_loss_8: 0.4720 - dense_3_loss_9: 0.4451 - dense_3_loss_10: 0.3663 - dense_3_loss_11: 0.3971 - dense_3_loss_12: 0.3873 - dense_3_loss_13: 0.3661 - dense_3_loss_14: 0.3782 - dense_3_loss_15: 0.3949 - dense_3_loss_16: 0.4009 - dense_3_loss_17: 0.3739 - dense_3_loss_18: 0.3858 - dense_3_loss_19: 0.3968 - dense_3_loss_20: 0.4307 - dense_3_loss_21: 0.4470 - dense_3_loss_22: 0.4193 - dense_3_loss_23: 0.4326 - dense_3_loss_24: 0.4215 - dense_3_loss_25: 0.4502 - dense_3_loss_26: 0.3995 - dense_3_loss_27: 0.4470 - dense_3_loss_28: 0.4456 - dense_3_loss_29: 0.4436 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4000 - dense_3_acc_3: 0.6500 - dense_3_acc_4: 0.8500 - dense_3_acc_5: 0.8667 - dense_3_acc_6: 0.9500 - dense_3_acc_7: 0.9500 - dense_3_acc_8: 0.9833 - dense_3_acc_9: 0.9667 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 0.9833 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 0.9833 - dense_3_acc_25: 0.9667 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 0.9833 - dense_3_acc_29: 0.9833 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 40/100\n", "60/60 [==============================] - 0s - loss: 18.7796 - dense_3_loss_1: 3.9695 - dense_3_loss_2: 2.5250 - dense_3_loss_3: 1.4047 - dense_3_loss_4: 0.8124 - dense_3_loss_5: 0.6982 - dense_3_loss_6: 0.5515 - dense_3_loss_7: 0.5060 - dense_3_loss_8: 0.4353 - dense_3_loss_9: 0.4078 - dense_3_loss_10: 0.3386 - dense_3_loss_11: 0.3650 - dense_3_loss_12: 0.3561 - dense_3_loss_13: 0.3352 - dense_3_loss_14: 0.3438 - dense_3_loss_15: 0.3629 - dense_3_loss_16: 0.3682 - dense_3_loss_17: 0.3341 - dense_3_loss_18: 0.3501 - dense_3_loss_19: 0.3548 - dense_3_loss_20: 0.4060 - dense_3_loss_21: 0.4123 - dense_3_loss_22: 0.3668 - dense_3_loss_23: 0.3938 - dense_3_loss_24: 0.3893 - dense_3_loss_25: 0.4077 - dense_3_loss_26: 0.3644 - dense_3_loss_27: 0.4088 - dense_3_loss_28: 0.4010 - dense_3_loss_29: 0.4102 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4000 - dense_3_acc_3: 0.6500 - dense_3_acc_4: 0.8500 - dense_3_acc_5: 0.8833 - dense_3_acc_6: 0.9500 - dense_3_acc_7: 0.9500 - dense_3_acc_8: 0.9833 - dense_3_acc_9: 0.9667 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 0.9833 - dense_3_acc_29: 0.9833 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 41/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 17.8124 - dense_3_loss_1: 3.9637 - dense_3_loss_2: 2.4795 - dense_3_loss_3: 1.3516 - dense_3_loss_4: 0.7597 - dense_3_loss_5: 0.6509 - dense_3_loss_6: 0.5115 - dense_3_loss_7: 0.4671 - dense_3_loss_8: 0.4007 - dense_3_loss_9: 0.3737 - dense_3_loss_10: 0.3047 - dense_3_loss_11: 0.3351 - dense_3_loss_12: 0.3234 - dense_3_loss_13: 0.3062 - dense_3_loss_14: 0.3110 - dense_3_loss_15: 0.3314 - dense_3_loss_16: 0.3362 - dense_3_loss_17: 0.3025 - dense_3_loss_18: 0.3209 - dense_3_loss_19: 0.3256 - dense_3_loss_20: 0.3686 - dense_3_loss_21: 0.3829 - dense_3_loss_22: 0.3382 - dense_3_loss_23: 0.3599 - dense_3_loss_24: 0.3623 - dense_3_loss_25: 0.3773 - dense_3_loss_26: 0.3415 - dense_3_loss_27: 0.3792 - dense_3_loss_28: 0.3702 - dense_3_loss_29: 0.3768 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4000 - dense_3_acc_3: 0.6500 - dense_3_acc_4: 0.9000 - dense_3_acc_5: 0.9167 - dense_3_acc_6: 0.9667 - dense_3_acc_7: 0.9500 - dense_3_acc_8: 0.9833 - dense_3_acc_9: 0.9667 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 0.9833 - dense_3_acc_29: 0.9833 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 42/100\n", "60/60 [==============================] - 0s - loss: 16.8927 - dense_3_loss_1: 3.9581 - dense_3_loss_2: 2.4346 - dense_3_loss_3: 1.3023 - dense_3_loss_4: 0.7049 - dense_3_loss_5: 0.6070 - dense_3_loss_6: 0.4741 - dense_3_loss_7: 0.4330 - dense_3_loss_8: 0.3669 - dense_3_loss_9: 0.3391 - dense_3_loss_10: 0.2749 - dense_3_loss_11: 0.3027 - dense_3_loss_12: 0.2934 - dense_3_loss_13: 0.2759 - dense_3_loss_14: 0.2865 - dense_3_loss_15: 0.2986 - dense_3_loss_16: 0.3103 - dense_3_loss_17: 0.2814 - dense_3_loss_18: 0.2921 - dense_3_loss_19: 0.3058 - dense_3_loss_20: 0.3253 - dense_3_loss_21: 0.3499 - dense_3_loss_22: 0.3225 - dense_3_loss_23: 0.3340 - dense_3_loss_24: 0.3194 - dense_3_loss_25: 0.3451 - dense_3_loss_26: 0.3141 - dense_3_loss_27: 0.3447 - dense_3_loss_28: 0.3484 - dense_3_loss_29: 0.3478 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4333 - dense_3_acc_3: 0.6833 - dense_3_acc_4: 0.9000 - dense_3_acc_5: 0.9333 - dense_3_acc_6: 0.9667 - dense_3_acc_7: 0.9667 - dense_3_acc_8: 0.9833 - dense_3_acc_9: 0.9667 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 0.9833 - dense_3_acc_29: 0.9833 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 43/100\n", "60/60 [==============================] - 0s - loss: 16.0529 - dense_3_loss_1: 3.9528 - dense_3_loss_2: 2.3914 - dense_3_loss_3: 1.2529 - dense_3_loss_4: 0.6558 - dense_3_loss_5: 0.5668 - dense_3_loss_6: 0.4398 - dense_3_loss_7: 0.4016 - dense_3_loss_8: 0.3381 - dense_3_loss_9: 0.3117 - dense_3_loss_10: 0.2542 - dense_3_loss_11: 0.2830 - dense_3_loss_12: 0.2646 - dense_3_loss_13: 0.2555 - dense_3_loss_14: 0.2702 - dense_3_loss_15: 0.2712 - dense_3_loss_16: 0.2846 - dense_3_loss_17: 0.2589 - dense_3_loss_18: 0.2661 - dense_3_loss_19: 0.2818 - dense_3_loss_20: 0.3056 - dense_3_loss_21: 0.3200 - dense_3_loss_22: 0.2921 - dense_3_loss_23: 0.2968 - dense_3_loss_24: 0.2921 - dense_3_loss_25: 0.3161 - dense_3_loss_26: 0.2890 - dense_3_loss_27: 0.3074 - dense_3_loss_28: 0.3113 - dense_3_loss_29: 0.3212 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4500 - dense_3_acc_3: 0.7000 - dense_3_acc_4: 0.9167 - dense_3_acc_5: 0.9333 - dense_3_acc_6: 0.9667 - dense_3_acc_7: 0.9667 - dense_3_acc_8: 0.9833 - dense_3_acc_9: 0.9833 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 0.9833 - dense_3_acc_29: 0.9833 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 44/100\n", "60/60 [==============================] - ETA: 0s - loss: 15.8690 - dense_3_loss_1: 3.9675 - dense_3_loss_2: 2.4741 - dense_3_loss_3: 1.2134 - dense_3_loss_4: 0.6951 - dense_3_loss_5: 0.5687 - dense_3_loss_6: 0.4379 - dense_3_loss_7: 0.4113 - dense_3_loss_8: 0.3412 - dense_3_loss_9: 0.3005 - dense_3_loss_10: 0.2478 - dense_3_loss_11: 0.2865 - dense_3_loss_12: 0.2555 - dense_3_loss_13: 0.2459 - dense_3_loss_14: 0.2683 - dense_3_loss_15: 0.2655 - dense_3_loss_16: 0.2738 - dense_3_loss_17: 0.2444 - dense_3_loss_18: 0.2636 - dense_3_loss_19: 0.2739 - dense_3_loss_20: 0.2999 - dense_3_loss_21: 0.3134 - dense_3_loss_22: 0.2900 - dense_3_loss_23: 0.2764 - dense_3_loss_24: 0.2637 - dense_3_loss_25: 0.2609 - dense_3_loss_26: 0.2518 - dense_3_loss_27: 0.3022 - dense_3_loss_28: 0.2913 - dense_3_loss_29: 0.2845 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0938 - dense_3_acc_2: 0.3750 - dense_3_acc_3: 0.7188 - dense_3_acc_4: 0.9062 - dense_3_acc_5: 0.9375 - dense_3_acc_6: 0.9688 - dense_3_acc_7: 0.9688 - dense_3_acc_8: 0.9688 - dense_3_acc_9: 0.9688 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+ - 0s - loss: 15.2957 - dense_3_loss_1: 3.9482 - dense_3_loss_2: 2.3490 - dense_3_loss_3: 1.2071 - dense_3_loss_4: 0.6131 - dense_3_loss_5: 0.5251 - dense_3_loss_6: 0.4072 - dense_3_loss_7: 0.3723 - dense_3_loss_8: 0.3088 - dense_3_loss_9: 0.2854 - dense_3_loss_10: 0.2340 - dense_3_loss_11: 0.2631 - dense_3_loss_12: 0.2418 - dense_3_loss_13: 0.2342 - dense_3_loss_14: 0.2461 - dense_3_loss_15: 0.2485 - dense_3_loss_16: 0.2583 - dense_3_loss_17: 0.2370 - dense_3_loss_18: 0.2447 - dense_3_loss_19: 0.2541 - dense_3_loss_20: 0.2809 - dense_3_loss_21: 0.2950 - dense_3_loss_22: 0.2716 - dense_3_loss_23: 0.2716 - dense_3_loss_24: 0.2702 - dense_3_loss_25: 0.2923 - dense_3_loss_26: 0.2646 - dense_3_loss_27: 0.2894 - dense_3_loss_28: 0.2896 - dense_3_loss_29: 0.2928 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4500 - dense_3_acc_3: 0.7167 - dense_3_acc_4: 0.9333 - dense_3_acc_5: 0.9500 - dense_3_acc_6: 0.9667 - dense_3_acc_7: 0.9667 - dense_3_acc_8: 0.9833 - dense_3_acc_9: 0.9833 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 45/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 14.5843 - dense_3_loss_1: 3.9434 - dense_3_loss_2: 2.3067 - dense_3_loss_3: 1.1616 - dense_3_loss_4: 0.5686 - dense_3_loss_5: 0.4884 - dense_3_loss_6: 0.3751 - dense_3_loss_7: 0.3416 - dense_3_loss_8: 0.2853 - dense_3_loss_9: 0.2635 - dense_3_loss_10: 0.2147 - dense_3_loss_11: 0.2336 - dense_3_loss_12: 0.2228 - dense_3_loss_13: 0.2181 - dense_3_loss_14: 0.2226 - dense_3_loss_15: 0.2284 - dense_3_loss_16: 0.2348 - dense_3_loss_17: 0.2224 - dense_3_loss_18: 0.2270 - dense_3_loss_19: 0.2331 - dense_3_loss_20: 0.2570 - dense_3_loss_21: 0.2722 - dense_3_loss_22: 0.2464 - dense_3_loss_23: 0.2526 - dense_3_loss_24: 0.2472 - dense_3_loss_25: 0.2680 - dense_3_loss_26: 0.2448 - dense_3_loss_27: 0.2664 - dense_3_loss_28: 0.2682 - dense_3_loss_29: 0.2696 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4500 - dense_3_acc_3: 0.7167 - dense_3_acc_4: 0.9333 - dense_3_acc_5: 0.9667 - dense_3_acc_6: 0.9667 - dense_3_acc_7: 0.9667 - dense_3_acc_8: 0.9833 - dense_3_acc_9: 0.9833 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 46/100\n", "60/60 [==============================] - 0s - loss: 13.9437 - dense_3_loss_1: 3.9384 - dense_3_loss_2: 2.2669 - dense_3_loss_3: 1.1208 - dense_3_loss_4: 0.5329 - dense_3_loss_5: 0.4561 - dense_3_loss_6: 0.3484 - dense_3_loss_7: 0.3151 - dense_3_loss_8: 0.2675 - dense_3_loss_9: 0.2430 - dense_3_loss_10: 0.1970 - dense_3_loss_11: 0.2144 - dense_3_loss_12: 0.2046 - dense_3_loss_13: 0.2002 - dense_3_loss_14: 0.2068 - dense_3_loss_15: 0.2080 - dense_3_loss_16: 0.2219 - dense_3_loss_17: 0.2043 - dense_3_loss_18: 0.2077 - dense_3_loss_19: 0.2173 - dense_3_loss_20: 0.2384 - dense_3_loss_21: 0.2510 - dense_3_loss_22: 0.2249 - dense_3_loss_23: 0.2287 - dense_3_loss_24: 0.2266 - dense_3_loss_25: 0.2459 - dense_3_loss_26: 0.2245 - dense_3_loss_27: 0.2404 - dense_3_loss_28: 0.2456 - dense_3_loss_29: 0.2463 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4500 - dense_3_acc_3: 0.7500 - dense_3_acc_4: 0.9333 - dense_3_acc_5: 0.9667 - dense_3_acc_6: 0.9667 - dense_3_acc_7: 0.9833 - dense_3_acc_8: 0.9833 - dense_3_acc_9: 0.9833 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 47/100\n", "60/60 [==============================] - 0s - loss: 13.3688 - dense_3_loss_1: 3.9339 - dense_3_loss_2: 2.2250 - dense_3_loss_3: 1.0834 - dense_3_loss_4: 0.5021 - dense_3_loss_5: 0.4267 - dense_3_loss_6: 0.3258 - dense_3_loss_7: 0.2958 - dense_3_loss_8: 0.2433 - dense_3_loss_9: 0.2256 - dense_3_loss_10: 0.1787 - dense_3_loss_11: 0.2034 - dense_3_loss_12: 0.1871 - dense_3_loss_13: 0.1841 - dense_3_loss_14: 0.1913 - dense_3_loss_15: 0.1943 - dense_3_loss_16: 0.2030 - dense_3_loss_17: 0.1859 - dense_3_loss_18: 0.1925 - dense_3_loss_19: 0.1956 - dense_3_loss_20: 0.2176 - dense_3_loss_21: 0.2277 - dense_3_loss_22: 0.2124 - dense_3_loss_23: 0.2129 - dense_3_loss_24: 0.2087 - dense_3_loss_25: 0.2256 - dense_3_loss_26: 0.2049 - dense_3_loss_27: 0.2257 - dense_3_loss_28: 0.2280 - dense_3_loss_29: 0.2280 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4500 - dense_3_acc_3: 0.7500 - dense_3_acc_4: 0.9333 - dense_3_acc_5: 0.9833 - dense_3_acc_6: 0.9833 - dense_3_acc_7: 0.9833 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 0.9833 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 48/100\n", "60/60 [==============================] - 0s - loss: 12.8284 - dense_3_loss_1: 3.9291 - dense_3_loss_2: 2.1852 - dense_3_loss_3: 1.0439 - dense_3_loss_4: 0.4681 - dense_3_loss_5: 0.3993 - dense_3_loss_6: 0.3034 - dense_3_loss_7: 0.2756 - dense_3_loss_8: 0.2242 - dense_3_loss_9: 0.2079 - dense_3_loss_10: 0.1653 - dense_3_loss_11: 0.1837 - dense_3_loss_12: 0.1727 - dense_3_loss_13: 0.1727 - dense_3_loss_14: 0.1746 - dense_3_loss_15: 0.1797 - dense_3_loss_16: 0.1870 - dense_3_loss_17: 0.1733 - dense_3_loss_18: 0.1771 - dense_3_loss_19: 0.1797 - dense_3_loss_20: 0.2028 - dense_3_loss_21: 0.2131 - dense_3_loss_22: 0.1925 - dense_3_loss_23: 0.1963 - dense_3_loss_24: 0.1933 - dense_3_loss_25: 0.2094 - dense_3_loss_26: 0.1895 - dense_3_loss_27: 0.2074 - dense_3_loss_28: 0.2109 - dense_3_loss_29: 0.2107 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4667 - dense_3_acc_3: 0.7500 - dense_3_acc_4: 0.9333 - dense_3_acc_5: 0.9833 - dense_3_acc_6: 0.9833 - dense_3_acc_7: 0.9833 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 0.9833 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 49/100\n", "60/60 [==============================] - 0s - loss: 12.3410 - dense_3_loss_1: 3.9244 - dense_3_loss_2: 2.1481 - dense_3_loss_3: 1.0082 - dense_3_loss_4: 0.4405 - dense_3_loss_5: 0.3713 - dense_3_loss_6: 0.2851 - dense_3_loss_7: 0.2523 - dense_3_loss_8: 0.2073 - dense_3_loss_9: 0.1925 - dense_3_loss_10: 0.1517 - dense_3_loss_11: 0.1667 - dense_3_loss_12: 0.1613 - dense_3_loss_13: 0.1649 - dense_3_loss_14: 0.1621 - dense_3_loss_15: 0.1659 - dense_3_loss_16: 0.1748 - dense_3_loss_17: 0.1635 - dense_3_loss_18: 0.1646 - dense_3_loss_19: 0.1676 - dense_3_loss_20: 0.1904 - dense_3_loss_21: 0.1977 - dense_3_loss_22: 0.1710 - dense_3_loss_23: 0.1821 - dense_3_loss_24: 0.1767 - dense_3_loss_25: 0.1942 - dense_3_loss_26: 0.1757 - dense_3_loss_27: 0.1887 - dense_3_loss_28: 0.1953 - dense_3_loss_29: 0.1964 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4667 - dense_3_acc_3: 0.7500 - dense_3_acc_4: 0.9500 - dense_3_acc_5: 0.9833 - dense_3_acc_6: 0.9833 - dense_3_acc_7: 0.9833 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 0.9833 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 50/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 11.8817 - dense_3_loss_1: 3.9201 - dense_3_loss_2: 2.1109 - dense_3_loss_3: 0.9744 - dense_3_loss_4: 0.4148 - dense_3_loss_5: 0.3459 - dense_3_loss_6: 0.2664 - dense_3_loss_7: 0.2354 - dense_3_loss_8: 0.1937 - dense_3_loss_9: 0.1789 - dense_3_loss_10: 0.1390 - dense_3_loss_11: 0.1589 - dense_3_loss_12: 0.1478 - dense_3_loss_13: 0.1485 - dense_3_loss_14: 0.1518 - dense_3_loss_15: 0.1516 - dense_3_loss_16: 0.1636 - dense_3_loss_17: 0.1476 - dense_3_loss_18: 0.1508 - dense_3_loss_19: 0.1563 - dense_3_loss_20: 0.1721 - dense_3_loss_21: 0.1817 - dense_3_loss_22: 0.1631 - dense_3_loss_23: 0.1656 - dense_3_loss_24: 0.1646 - dense_3_loss_25: 0.1792 - dense_3_loss_26: 0.1605 - dense_3_loss_27: 0.1766 - dense_3_loss_28: 0.1797 - dense_3_loss_29: 0.1822 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4667 - dense_3_acc_3: 0.7500 - dense_3_acc_4: 0.9667 - dense_3_acc_5: 0.9833 - dense_3_acc_6: 0.9833 - dense_3_acc_7: 0.9833 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 51/100\n", "60/60 [==============================] - 0s - loss: 11.4789 - dense_3_loss_1: 3.9154 - dense_3_loss_2: 2.0758 - dense_3_loss_3: 0.9416 - dense_3_loss_4: 0.3913 - dense_3_loss_5: 0.3242 - dense_3_loss_6: 0.2500 - dense_3_loss_7: 0.2201 - dense_3_loss_8: 0.1820 - dense_3_loss_9: 0.1658 - dense_3_loss_10: 0.1290 - dense_3_loss_11: 0.1495 - dense_3_loss_12: 0.1370 - dense_3_loss_13: 0.1362 - dense_3_loss_14: 0.1410 - dense_3_loss_15: 0.1414 - dense_3_loss_16: 0.1519 - dense_3_loss_17: 0.1387 - dense_3_loss_18: 0.1381 - dense_3_loss_19: 0.1439 - dense_3_loss_20: 0.1615 - dense_3_loss_21: 0.1710 - dense_3_loss_22: 0.1509 - dense_3_loss_23: 0.1542 - dense_3_loss_24: 0.1521 - dense_3_loss_25: 0.1681 - dense_3_loss_26: 0.1510 - dense_3_loss_27: 0.1623 - dense_3_loss_28: 0.1660 - dense_3_loss_29: 0.1689 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4667 - dense_3_acc_3: 0.7500 - dense_3_acc_4: 0.9833 - dense_3_acc_5: 0.9833 - dense_3_acc_6: 0.9833 - dense_3_acc_7: 0.9833 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 52/100\n", "60/60 [==============================] - 0s - loss: 11.0993 - dense_3_loss_1: 3.9107 - dense_3_loss_2: 2.0405 - dense_3_loss_3: 0.9114 - dense_3_loss_4: 0.3669 - dense_3_loss_5: 0.3038 - dense_3_loss_6: 0.2353 - dense_3_loss_7: 0.2060 - dense_3_loss_8: 0.1696 - dense_3_loss_9: 0.1547 - dense_3_loss_10: 0.1194 - dense_3_loss_11: 0.1364 - dense_3_loss_12: 0.1275 - dense_3_loss_13: 0.1273 - dense_3_loss_14: 0.1312 - dense_3_loss_15: 0.1332 - dense_3_loss_16: 0.1385 - dense_3_loss_17: 0.1303 - dense_3_loss_18: 0.1305 - dense_3_loss_19: 0.1338 - dense_3_loss_20: 0.1497 - dense_3_loss_21: 0.1592 - dense_3_loss_22: 0.1371 - dense_3_loss_23: 0.1453 - dense_3_loss_24: 0.1419 - dense_3_loss_25: 0.1568 - dense_3_loss_26: 0.1400 - dense_3_loss_27: 0.1493 - dense_3_loss_28: 0.1555 - dense_3_loss_29: 0.1575 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4667 - dense_3_acc_3: 0.7500 - dense_3_acc_4: 0.9833 - dense_3_acc_5: 0.9833 - dense_3_acc_6: 0.9833 - dense_3_acc_7: 0.9833 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 53/100\n", "60/60 [==============================] - 0s - loss: 10.7506 - dense_3_loss_1: 3.9065 - dense_3_loss_2: 2.0074 - dense_3_loss_3: 0.8801 - dense_3_loss_4: 0.3459 - dense_3_loss_5: 0.2841 - dense_3_loss_6: 0.2216 - dense_3_loss_7: 0.1914 - dense_3_loss_8: 0.1576 - dense_3_loss_9: 0.1454 - dense_3_loss_10: 0.1123 - dense_3_loss_11: 0.1262 - dense_3_loss_12: 0.1195 - dense_3_loss_13: 0.1194 - dense_3_loss_14: 0.1225 - dense_3_loss_15: 0.1248 - dense_3_loss_16: 0.1282 - dense_3_loss_17: 0.1203 - dense_3_loss_18: 0.1232 - dense_3_loss_19: 0.1247 - dense_3_loss_20: 0.1389 - dense_3_loss_21: 0.1473 - dense_3_loss_22: 0.1271 - dense_3_loss_23: 0.1372 - dense_3_loss_24: 0.1319 - dense_3_loss_25: 0.1446 - dense_3_loss_26: 0.1293 - dense_3_loss_27: 0.1398 - dense_3_loss_28: 0.1465 - dense_3_loss_29: 0.1472 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4667 - dense_3_acc_3: 0.7833 - dense_3_acc_4: 0.9833 - dense_3_acc_5: 0.9833 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 54/100\n", "60/60 [==============================] - 0s - loss: 10.4316 - dense_3_loss_1: 3.9021 - dense_3_loss_2: 1.9754 - dense_3_loss_3: 0.8538 - dense_3_loss_4: 0.3274 - dense_3_loss_5: 0.2653 - dense_3_loss_6: 0.2091 - dense_3_loss_7: 0.1780 - dense_3_loss_8: 0.1472 - dense_3_loss_9: 0.1358 - dense_3_loss_10: 0.1057 - dense_3_loss_11: 0.1188 - dense_3_loss_12: 0.1124 - dense_3_loss_13: 0.1118 - dense_3_loss_14: 0.1153 - dense_3_loss_15: 0.1165 - dense_3_loss_16: 0.1222 - dense_3_loss_17: 0.1119 - dense_3_loss_18: 0.1138 - dense_3_loss_19: 0.1154 - dense_3_loss_20: 0.1291 - dense_3_loss_21: 0.1376 - dense_3_loss_22: 0.1208 - dense_3_loss_23: 0.1262 - dense_3_loss_24: 0.1218 - dense_3_loss_25: 0.1343 - dense_3_loss_26: 0.1205 - dense_3_loss_27: 0.1305 - dense_3_loss_28: 0.1352 - dense_3_loss_29: 0.1379 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4667 - dense_3_acc_3: 0.7833 - dense_3_acc_4: 0.9833 - dense_3_acc_5: 0.9833 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 55/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 10.1442 - dense_3_loss_1: 3.8976 - dense_3_loss_2: 1.9431 - dense_3_loss_3: 0.8279 - dense_3_loss_4: 0.3104 - dense_3_loss_5: 0.2499 - dense_3_loss_6: 0.1987 - dense_3_loss_7: 0.1657 - dense_3_loss_8: 0.1395 - dense_3_loss_9: 0.1282 - dense_3_loss_10: 0.0990 - dense_3_loss_11: 0.1111 - dense_3_loss_12: 0.1053 - dense_3_loss_13: 0.1046 - dense_3_loss_14: 0.1091 - dense_3_loss_15: 0.1087 - dense_3_loss_16: 0.1153 - dense_3_loss_17: 0.1050 - dense_3_loss_18: 0.1058 - dense_3_loss_19: 0.1080 - dense_3_loss_20: 0.1218 - dense_3_loss_21: 0.1277 - dense_3_loss_22: 0.1128 - dense_3_loss_23: 0.1170 - dense_3_loss_24: 0.1143 - dense_3_loss_25: 0.1256 - dense_3_loss_26: 0.1127 - dense_3_loss_27: 0.1219 - dense_3_loss_28: 0.1270 - dense_3_loss_29: 0.1303 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4667 - dense_3_acc_3: 0.7833 - dense_3_acc_4: 0.9833 - dense_3_acc_5: 0.9833 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 56/100\n", "60/60 [==============================] - 0s - loss: 9.8730 - dense_3_loss_1: 3.8936 - dense_3_loss_2: 1.9131 - dense_3_loss_3: 0.8021 - dense_3_loss_4: 0.2925 - dense_3_loss_5: 0.2334 - dense_3_loss_6: 0.1881 - dense_3_loss_7: 0.1553 - dense_3_loss_8: 0.1311 - dense_3_loss_9: 0.1197 - dense_3_loss_10: 0.0922 - dense_3_loss_11: 0.1035 - dense_3_loss_12: 0.0988 - dense_3_loss_13: 0.0981 - dense_3_loss_14: 0.1025 - dense_3_loss_15: 0.1022 - dense_3_loss_16: 0.1070 - dense_3_loss_17: 0.0990 - dense_3_loss_18: 0.1006 - dense_3_loss_19: 0.1012 - dense_3_loss_20: 0.1142 - dense_3_loss_21: 0.1207 - dense_3_loss_22: 0.1050 - dense_3_loss_23: 0.1105 - dense_3_loss_24: 0.1082 - dense_3_loss_25: 0.1179 - dense_3_loss_26: 0.1058 - dense_3_loss_27: 0.1142 - dense_3_loss_28: 0.1198 - dense_3_loss_29: 0.1228 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4833 - dense_3_acc_3: 0.7833 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 57/100\n", "60/60 [==============================] - 0s - loss: 9.6293 - dense_3_loss_1: 3.8893 - dense_3_loss_2: 1.8841 - dense_3_loss_3: 0.7782 - dense_3_loss_4: 0.2775 - dense_3_loss_5: 0.2202 - dense_3_loss_6: 0.1774 - dense_3_loss_7: 0.1466 - dense_3_loss_8: 0.1236 - dense_3_loss_9: 0.1130 - dense_3_loss_10: 0.0868 - dense_3_loss_11: 0.0972 - dense_3_loss_12: 0.0931 - dense_3_loss_13: 0.0927 - dense_3_loss_14: 0.0954 - dense_3_loss_15: 0.0967 - dense_3_loss_16: 0.0999 - dense_3_loss_17: 0.0936 - dense_3_loss_18: 0.0948 - dense_3_loss_19: 0.0949 - dense_3_loss_20: 0.1071 - dense_3_loss_21: 0.1145 - dense_3_loss_22: 0.0984 - dense_3_loss_23: 0.1038 - dense_3_loss_24: 0.1027 - dense_3_loss_25: 0.1117 - dense_3_loss_26: 0.1002 - dense_3_loss_27: 0.1074 - dense_3_loss_28: 0.1133 - dense_3_loss_29: 0.1155 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.4833 - dense_3_acc_3: 0.7833 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 58/100\n", "60/60 [==============================] - 0s - loss: 9.3991 - dense_3_loss_1: 3.8851 - dense_3_loss_2: 1.8558 - dense_3_loss_3: 0.7558 - dense_3_loss_4: 0.2640 - dense_3_loss_5: 0.2068 - dense_3_loss_6: 0.1672 - dense_3_loss_7: 0.1384 - dense_3_loss_8: 0.1172 - dense_3_loss_9: 0.1061 - dense_3_loss_10: 0.0822 - dense_3_loss_11: 0.0920 - dense_3_loss_12: 0.0877 - dense_3_loss_13: 0.0876 - dense_3_loss_14: 0.0898 - dense_3_loss_15: 0.0912 - dense_3_loss_16: 0.0950 - dense_3_loss_17: 0.0878 - dense_3_loss_18: 0.0891 - dense_3_loss_19: 0.0894 - dense_3_loss_20: 0.1004 - dense_3_loss_21: 0.1087 - dense_3_loss_22: 0.0931 - dense_3_loss_23: 0.0974 - dense_3_loss_24: 0.0960 - dense_3_loss_25: 0.1056 - dense_3_loss_26: 0.0946 - dense_3_loss_27: 0.1007 - dense_3_loss_28: 0.1056 - dense_3_loss_29: 0.1084 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.5000 - dense_3_acc_3: 0.8000 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 59/100\n", "60/60 [==============================] - 0s - loss: 9.1859 - dense_3_loss_1: 3.8812 - dense_3_loss_2: 1.8290 - dense_3_loss_3: 0.7328 - dense_3_loss_4: 0.2525 - dense_3_loss_5: 0.1945 - dense_3_loss_6: 0.1593 - dense_3_loss_7: 0.1305 - dense_3_loss_8: 0.1112 - dense_3_loss_9: 0.1011 - dense_3_loss_10: 0.0771 - dense_3_loss_11: 0.0873 - dense_3_loss_12: 0.0827 - dense_3_loss_13: 0.0832 - dense_3_loss_14: 0.0852 - dense_3_loss_15: 0.0859 - dense_3_loss_16: 0.0904 - dense_3_loss_17: 0.0828 - dense_3_loss_18: 0.0843 - dense_3_loss_19: 0.0848 - dense_3_loss_20: 0.0940 - dense_3_loss_21: 0.1013 - dense_3_loss_22: 0.0877 - dense_3_loss_23: 0.0920 - dense_3_loss_24: 0.0896 - dense_3_loss_25: 0.0994 - dense_3_loss_26: 0.0890 - dense_3_loss_27: 0.0950 - dense_3_loss_28: 0.0999 - dense_3_loss_29: 0.1021 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.5333 - dense_3_acc_3: 0.8167 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 60/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 8.9934 - dense_3_loss_1: 3.8769 - dense_3_loss_2: 1.8038 - dense_3_loss_3: 0.7125 - dense_3_loss_4: 0.2415 - dense_3_loss_5: 0.1846 - dense_3_loss_6: 0.1519 - dense_3_loss_7: 0.1227 - dense_3_loss_8: 0.1058 - dense_3_loss_9: 0.0960 - dense_3_loss_10: 0.0730 - dense_3_loss_11: 0.0827 - dense_3_loss_12: 0.0780 - dense_3_loss_13: 0.0797 - dense_3_loss_14: 0.0813 - dense_3_loss_15: 0.0815 - dense_3_loss_16: 0.0860 - dense_3_loss_17: 0.0786 - dense_3_loss_18: 0.0794 - dense_3_loss_19: 0.0801 - dense_3_loss_20: 0.0896 - dense_3_loss_21: 0.0956 - dense_3_loss_22: 0.0823 - dense_3_loss_23: 0.0865 - dense_3_loss_24: 0.0844 - dense_3_loss_25: 0.0937 - dense_3_loss_26: 0.0836 - dense_3_loss_27: 0.0898 - dense_3_loss_28: 0.0948 - dense_3_loss_29: 0.0970 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.5667 - dense_3_acc_3: 0.8167 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 61/100\n", "60/60 [==============================] - 0s - loss: 8.8137 - dense_3_loss_1: 3.8729 - dense_3_loss_2: 1.7784 - dense_3_loss_3: 0.6920 - dense_3_loss_4: 0.2304 - dense_3_loss_5: 0.1756 - dense_3_loss_6: 0.1448 - dense_3_loss_7: 0.1164 - dense_3_loss_8: 0.1008 - dense_3_loss_9: 0.0912 - dense_3_loss_10: 0.0691 - dense_3_loss_11: 0.0784 - dense_3_loss_12: 0.0738 - dense_3_loss_13: 0.0755 - dense_3_loss_14: 0.0771 - dense_3_loss_15: 0.0775 - dense_3_loss_16: 0.0812 - dense_3_loss_17: 0.0749 - dense_3_loss_18: 0.0750 - dense_3_loss_19: 0.0758 - dense_3_loss_20: 0.0851 - dense_3_loss_21: 0.0906 - dense_3_loss_22: 0.0783 - dense_3_loss_23: 0.0823 - dense_3_loss_24: 0.0801 - dense_3_loss_25: 0.0892 - dense_3_loss_26: 0.0794 - dense_3_loss_27: 0.0855 - dense_3_loss_28: 0.0901 - dense_3_loss_29: 0.0924 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.5667 - dense_3_acc_3: 0.8167 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 62/100\n", "60/60 [==============================] - 0s - loss: 8.6436 - dense_3_loss_1: 3.8692 - dense_3_loss_2: 1.7535 - dense_3_loss_3: 0.6728 - dense_3_loss_4: 0.2203 - dense_3_loss_5: 0.1661 - dense_3_loss_6: 0.1380 - dense_3_loss_7: 0.1110 - dense_3_loss_8: 0.0950 - dense_3_loss_9: 0.0868 - dense_3_loss_10: 0.0660 - dense_3_loss_11: 0.0748 - dense_3_loss_12: 0.0704 - dense_3_loss_13: 0.0714 - dense_3_loss_14: 0.0734 - dense_3_loss_15: 0.0741 - dense_3_loss_16: 0.0765 - dense_3_loss_17: 0.0707 - dense_3_loss_18: 0.0716 - dense_3_loss_19: 0.0713 - dense_3_loss_20: 0.0806 - dense_3_loss_21: 0.0862 - dense_3_loss_22: 0.0746 - dense_3_loss_23: 0.0781 - dense_3_loss_24: 0.0765 - dense_3_loss_25: 0.0845 - dense_3_loss_26: 0.0751 - dense_3_loss_27: 0.0815 - dense_3_loss_28: 0.0861 - dense_3_loss_29: 0.0879 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.5667 - dense_3_acc_3: 0.8167 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 63/100\n", "60/60 [==============================] - 0s - loss: 8.4803 - dense_3_loss_1: 3.8652 - dense_3_loss_2: 1.7303 - dense_3_loss_3: 0.6527 - dense_3_loss_4: 0.2111 - dense_3_loss_5: 0.1572 - dense_3_loss_6: 0.1311 - dense_3_loss_7: 0.1059 - dense_3_loss_8: 0.0899 - dense_3_loss_9: 0.0824 - dense_3_loss_10: 0.0631 - dense_3_loss_11: 0.0708 - dense_3_loss_12: 0.0673 - dense_3_loss_13: 0.0676 - dense_3_loss_14: 0.0698 - dense_3_loss_15: 0.0708 - dense_3_loss_16: 0.0726 - dense_3_loss_17: 0.0672 - dense_3_loss_18: 0.0684 - dense_3_loss_19: 0.0676 - dense_3_loss_20: 0.0765 - dense_3_loss_21: 0.0821 - dense_3_loss_22: 0.0708 - dense_3_loss_23: 0.0737 - dense_3_loss_24: 0.0730 - dense_3_loss_25: 0.0801 - dense_3_loss_26: 0.0712 - dense_3_loss_27: 0.0768 - dense_3_loss_28: 0.0817 - dense_3_loss_29: 0.0836 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.5667 - dense_3_acc_3: 0.8333 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 64/100\n", "60/60 [==============================] - 0s - loss: 8.3350 - dense_3_loss_1: 3.8612 - dense_3_loss_2: 1.7085 - dense_3_loss_3: 0.6360 - dense_3_loss_4: 0.2029 - dense_3_loss_5: 0.1498 - dense_3_loss_6: 0.1250 - dense_3_loss_7: 0.1015 - dense_3_loss_8: 0.0860 - dense_3_loss_9: 0.0787 - dense_3_loss_10: 0.0602 - dense_3_loss_11: 0.0675 - dense_3_loss_12: 0.0644 - dense_3_loss_13: 0.0643 - dense_3_loss_14: 0.0665 - dense_3_loss_15: 0.0674 - dense_3_loss_16: 0.0694 - dense_3_loss_17: 0.0641 - dense_3_loss_18: 0.0652 - dense_3_loss_19: 0.0648 - dense_3_loss_20: 0.0726 - dense_3_loss_21: 0.0782 - dense_3_loss_22: 0.0670 - dense_3_loss_23: 0.0701 - dense_3_loss_24: 0.0692 - dense_3_loss_25: 0.0763 - dense_3_loss_26: 0.0677 - dense_3_loss_27: 0.0728 - dense_3_loss_28: 0.0779 - dense_3_loss_29: 0.0798 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.5667 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 65/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 8.1981 - dense_3_loss_1: 3.8571 - dense_3_loss_2: 1.6858 - dense_3_loss_3: 0.6208 - dense_3_loss_4: 0.1947 - dense_3_loss_5: 0.1430 - dense_3_loss_6: 0.1192 - dense_3_loss_7: 0.0965 - dense_3_loss_8: 0.0825 - dense_3_loss_9: 0.0753 - dense_3_loss_10: 0.0572 - dense_3_loss_11: 0.0643 - dense_3_loss_12: 0.0614 - dense_3_loss_13: 0.0615 - dense_3_loss_14: 0.0635 - dense_3_loss_15: 0.0643 - dense_3_loss_16: 0.0664 - dense_3_loss_17: 0.0613 - dense_3_loss_18: 0.0619 - dense_3_loss_19: 0.0619 - dense_3_loss_20: 0.0690 - dense_3_loss_21: 0.0746 - dense_3_loss_22: 0.0644 - dense_3_loss_23: 0.0670 - dense_3_loss_24: 0.0657 - dense_3_loss_25: 0.0730 - dense_3_loss_26: 0.0649 - dense_3_loss_27: 0.0697 - dense_3_loss_28: 0.0744 - dense_3_loss_29: 0.0768 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.5667 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 66/100\n", "60/60 [==============================] - 0s - loss: 8.0686 - dense_3_loss_1: 3.8535 - dense_3_loss_2: 1.6649 - dense_3_loss_3: 0.6038 - dense_3_loss_4: 0.1871 - dense_3_loss_5: 0.1365 - dense_3_loss_6: 0.1141 - dense_3_loss_7: 0.0920 - dense_3_loss_8: 0.0790 - dense_3_loss_9: 0.0722 - dense_3_loss_10: 0.0547 - dense_3_loss_11: 0.0615 - dense_3_loss_12: 0.0586 - dense_3_loss_13: 0.0590 - dense_3_loss_14: 0.0607 - dense_3_loss_15: 0.0616 - dense_3_loss_16: 0.0637 - dense_3_loss_17: 0.0589 - dense_3_loss_18: 0.0590 - dense_3_loss_19: 0.0590 - dense_3_loss_20: 0.0662 - dense_3_loss_21: 0.0715 - dense_3_loss_22: 0.0614 - dense_3_loss_23: 0.0641 - dense_3_loss_24: 0.0626 - dense_3_loss_25: 0.0698 - dense_3_loss_26: 0.0622 - dense_3_loss_27: 0.0669 - dense_3_loss_28: 0.0707 - dense_3_loss_29: 0.0735 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.5667 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 67/100\n", "60/60 [==============================] - 0s - loss: 7.9463 - dense_3_loss_1: 3.8499 - dense_3_loss_2: 1.6431 - dense_3_loss_3: 0.5892 - dense_3_loss_4: 0.1803 - dense_3_loss_5: 0.1312 - dense_3_loss_6: 0.1091 - dense_3_loss_7: 0.0882 - dense_3_loss_8: 0.0760 - dense_3_loss_9: 0.0691 - dense_3_loss_10: 0.0526 - dense_3_loss_11: 0.0587 - dense_3_loss_12: 0.0562 - dense_3_loss_13: 0.0562 - dense_3_loss_14: 0.0581 - dense_3_loss_15: 0.0590 - dense_3_loss_16: 0.0607 - dense_3_loss_17: 0.0566 - dense_3_loss_18: 0.0562 - dense_3_loss_19: 0.0563 - dense_3_loss_20: 0.0638 - dense_3_loss_21: 0.0683 - dense_3_loss_22: 0.0583 - dense_3_loss_23: 0.0609 - dense_3_loss_24: 0.0602 - dense_3_loss_25: 0.0665 - dense_3_loss_26: 0.0596 - dense_3_loss_27: 0.0639 - dense_3_loss_28: 0.0679 - dense_3_loss_29: 0.0702 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6000 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 68/100\n", "60/60 [==============================] - 0s - loss: 7.8323 - dense_3_loss_1: 3.8459 - dense_3_loss_2: 1.6238 - dense_3_loss_3: 0.5742 - dense_3_loss_4: 0.1740 - dense_3_loss_5: 0.1255 - dense_3_loss_6: 0.1045 - dense_3_loss_7: 0.0848 - dense_3_loss_8: 0.0728 - dense_3_loss_9: 0.0663 - dense_3_loss_10: 0.0506 - dense_3_loss_11: 0.0563 - dense_3_loss_12: 0.0540 - dense_3_loss_13: 0.0538 - dense_3_loss_14: 0.0559 - dense_3_loss_15: 0.0567 - dense_3_loss_16: 0.0581 - dense_3_loss_17: 0.0541 - dense_3_loss_18: 0.0539 - dense_3_loss_19: 0.0540 - dense_3_loss_20: 0.0610 - dense_3_loss_21: 0.0657 - dense_3_loss_22: 0.0556 - dense_3_loss_23: 0.0584 - dense_3_loss_24: 0.0578 - dense_3_loss_25: 0.0636 - dense_3_loss_26: 0.0570 - dense_3_loss_27: 0.0613 - dense_3_loss_28: 0.0653 - dense_3_loss_29: 0.0674 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6000 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 69/100\n", "60/60 [==============================] - 0s - loss: 7.7259 - dense_3_loss_1: 3.8424 - dense_3_loss_2: 1.6042 - dense_3_loss_3: 0.5603 - dense_3_loss_4: 0.1681 - dense_3_loss_5: 0.1207 - dense_3_loss_6: 0.1004 - dense_3_loss_7: 0.0818 - dense_3_loss_8: 0.0701 - dense_3_loss_9: 0.0637 - dense_3_loss_10: 0.0487 - dense_3_loss_11: 0.0541 - dense_3_loss_12: 0.0519 - dense_3_loss_13: 0.0515 - dense_3_loss_14: 0.0540 - dense_3_loss_15: 0.0541 - dense_3_loss_16: 0.0557 - dense_3_loss_17: 0.0517 - dense_3_loss_18: 0.0521 - dense_3_loss_19: 0.0521 - dense_3_loss_20: 0.0582 - dense_3_loss_21: 0.0628 - dense_3_loss_22: 0.0536 - dense_3_loss_23: 0.0562 - dense_3_loss_24: 0.0555 - dense_3_loss_25: 0.0610 - dense_3_loss_26: 0.0545 - dense_3_loss_27: 0.0587 - dense_3_loss_28: 0.0629 - dense_3_loss_29: 0.0650 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6000 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 70/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 7.6246 - dense_3_loss_1: 3.8387 - dense_3_loss_2: 1.5855 - dense_3_loss_3: 0.5467 - dense_3_loss_4: 0.1624 - dense_3_loss_5: 0.1159 - dense_3_loss_6: 0.0961 - dense_3_loss_7: 0.0787 - dense_3_loss_8: 0.0674 - dense_3_loss_9: 0.0613 - dense_3_loss_10: 0.0470 - dense_3_loss_11: 0.0521 - dense_3_loss_12: 0.0499 - dense_3_loss_13: 0.0496 - dense_3_loss_14: 0.0520 - dense_3_loss_15: 0.0522 - dense_3_loss_16: 0.0537 - dense_3_loss_17: 0.0496 - dense_3_loss_18: 0.0501 - dense_3_loss_19: 0.0502 - dense_3_loss_20: 0.0558 - dense_3_loss_21: 0.0603 - dense_3_loss_22: 0.0517 - dense_3_loss_23: 0.0540 - dense_3_loss_24: 0.0533 - dense_3_loss_25: 0.0587 - dense_3_loss_26: 0.0524 - dense_3_loss_27: 0.0563 - dense_3_loss_28: 0.0606 - dense_3_loss_29: 0.0625 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6000 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 71/100\n", "60/60 [==============================] - 0s - loss: 7.5271 - dense_3_loss_1: 3.8350 - dense_3_loss_2: 1.5668 - dense_3_loss_3: 0.5344 - dense_3_loss_4: 0.1575 - dense_3_loss_5: 0.1116 - dense_3_loss_6: 0.0922 - dense_3_loss_7: 0.0756 - dense_3_loss_8: 0.0647 - dense_3_loss_9: 0.0591 - dense_3_loss_10: 0.0454 - dense_3_loss_11: 0.0500 - dense_3_loss_12: 0.0478 - dense_3_loss_13: 0.0478 - dense_3_loss_14: 0.0500 - dense_3_loss_15: 0.0502 - dense_3_loss_16: 0.0519 - dense_3_loss_17: 0.0477 - dense_3_loss_18: 0.0482 - dense_3_loss_19: 0.0480 - dense_3_loss_20: 0.0538 - dense_3_loss_21: 0.0578 - dense_3_loss_22: 0.0495 - dense_3_loss_23: 0.0518 - dense_3_loss_24: 0.0509 - dense_3_loss_25: 0.0565 - dense_3_loss_26: 0.0504 - dense_3_loss_27: 0.0541 - dense_3_loss_28: 0.0581 - dense_3_loss_29: 0.0603 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6000 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 72/100\n", "60/60 [==============================] - 0s - loss: 7.4372 - dense_3_loss_1: 3.8315 - dense_3_loss_2: 1.5490 - dense_3_loss_3: 0.5218 - dense_3_loss_4: 0.1527 - dense_3_loss_5: 0.1079 - dense_3_loss_6: 0.0890 - dense_3_loss_7: 0.0729 - dense_3_loss_8: 0.0626 - dense_3_loss_9: 0.0571 - dense_3_loss_10: 0.0437 - dense_3_loss_11: 0.0483 - dense_3_loss_12: 0.0459 - dense_3_loss_13: 0.0461 - dense_3_loss_14: 0.0481 - dense_3_loss_15: 0.0485 - dense_3_loss_16: 0.0500 - dense_3_loss_17: 0.0459 - dense_3_loss_18: 0.0463 - dense_3_loss_19: 0.0463 - dense_3_loss_20: 0.0517 - dense_3_loss_21: 0.0555 - dense_3_loss_22: 0.0480 - dense_3_loss_23: 0.0499 - dense_3_loss_24: 0.0490 - dense_3_loss_25: 0.0545 - dense_3_loss_26: 0.0487 - dense_3_loss_27: 0.0522 - dense_3_loss_28: 0.0557 - dense_3_loss_29: 0.0583 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6000 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 73/100\n", "60/60 [==============================] - 0s - loss: 7.3495 - dense_3_loss_1: 3.8279 - dense_3_loss_2: 1.5313 - dense_3_loss_3: 0.5108 - dense_3_loss_4: 0.1484 - dense_3_loss_5: 0.1041 - dense_3_loss_6: 0.0856 - dense_3_loss_7: 0.0703 - dense_3_loss_8: 0.0602 - dense_3_loss_9: 0.0551 - dense_3_loss_10: 0.0420 - dense_3_loss_11: 0.0466 - dense_3_loss_12: 0.0442 - dense_3_loss_13: 0.0444 - dense_3_loss_14: 0.0464 - dense_3_loss_15: 0.0467 - dense_3_loss_16: 0.0482 - dense_3_loss_17: 0.0441 - dense_3_loss_18: 0.0446 - dense_3_loss_19: 0.0445 - dense_3_loss_20: 0.0498 - dense_3_loss_21: 0.0536 - dense_3_loss_22: 0.0460 - dense_3_loss_23: 0.0481 - dense_3_loss_24: 0.0472 - dense_3_loss_25: 0.0523 - dense_3_loss_26: 0.0468 - dense_3_loss_27: 0.0504 - dense_3_loss_28: 0.0536 - dense_3_loss_29: 0.0561 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6000 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 74/100\n", "60/60 [==============================] - 0s - loss: 7.2670 - dense_3_loss_1: 3.8245 - dense_3_loss_2: 1.5149 - dense_3_loss_3: 0.4984 - dense_3_loss_4: 0.1439 - dense_3_loss_5: 0.1005 - dense_3_loss_6: 0.0824 - dense_3_loss_7: 0.0680 - dense_3_loss_8: 0.0580 - dense_3_loss_9: 0.0530 - dense_3_loss_10: 0.0407 - dense_3_loss_11: 0.0449 - dense_3_loss_12: 0.0427 - dense_3_loss_13: 0.0429 - dense_3_loss_14: 0.0447 - dense_3_loss_15: 0.0451 - dense_3_loss_16: 0.0466 - dense_3_loss_17: 0.0426 - dense_3_loss_18: 0.0432 - dense_3_loss_19: 0.0429 - dense_3_loss_20: 0.0480 - dense_3_loss_21: 0.0518 - dense_3_loss_22: 0.0443 - dense_3_loss_23: 0.0465 - dense_3_loss_24: 0.0457 - dense_3_loss_25: 0.0506 - dense_3_loss_26: 0.0453 - dense_3_loss_27: 0.0486 - dense_3_loss_28: 0.0521 - dense_3_loss_29: 0.0543 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6000 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 75/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 7.1906 - dense_3_loss_1: 3.8212 - dense_3_loss_2: 1.4984 - dense_3_loss_3: 0.4878 - dense_3_loss_4: 0.1400 - dense_3_loss_5: 0.0973 - dense_3_loss_6: 0.0798 - dense_3_loss_7: 0.0659 - dense_3_loss_8: 0.0561 - dense_3_loss_9: 0.0514 - dense_3_loss_10: 0.0393 - dense_3_loss_11: 0.0433 - dense_3_loss_12: 0.0412 - dense_3_loss_13: 0.0416 - dense_3_loss_14: 0.0432 - dense_3_loss_15: 0.0438 - dense_3_loss_16: 0.0450 - dense_3_loss_17: 0.0410 - dense_3_loss_18: 0.0417 - dense_3_loss_19: 0.0415 - dense_3_loss_20: 0.0464 - dense_3_loss_21: 0.0502 - dense_3_loss_22: 0.0427 - dense_3_loss_23: 0.0449 - dense_3_loss_24: 0.0442 - dense_3_loss_25: 0.0489 - dense_3_loss_26: 0.0438 - dense_3_loss_27: 0.0471 - dense_3_loss_28: 0.0504 - dense_3_loss_29: 0.0526 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6167 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 76/100\n", "60/60 [==============================] - 0s - loss: 7.1130 - dense_3_loss_1: 3.8177 - dense_3_loss_2: 1.4822 - dense_3_loss_3: 0.4763 - dense_3_loss_4: 0.1360 - dense_3_loss_5: 0.0937 - dense_3_loss_6: 0.0773 - dense_3_loss_7: 0.0636 - dense_3_loss_8: 0.0539 - dense_3_loss_9: 0.0499 - dense_3_loss_10: 0.0380 - dense_3_loss_11: 0.0419 - dense_3_loss_12: 0.0398 - dense_3_loss_13: 0.0403 - dense_3_loss_14: 0.0418 - dense_3_loss_15: 0.0424 - dense_3_loss_16: 0.0435 - dense_3_loss_17: 0.0397 - dense_3_loss_18: 0.0404 - dense_3_loss_19: 0.0400 - dense_3_loss_20: 0.0446 - dense_3_loss_21: 0.0487 - dense_3_loss_22: 0.0414 - dense_3_loss_23: 0.0433 - dense_3_loss_24: 0.0425 - dense_3_loss_25: 0.0473 - dense_3_loss_26: 0.0424 - dense_3_loss_27: 0.0454 - dense_3_loss_28: 0.0485 - dense_3_loss_29: 0.0508 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6167 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 77/100\n", "60/60 [==============================] - 0s - loss: 7.0435 - dense_3_loss_1: 3.8143 - dense_3_loss_2: 1.4670 - dense_3_loss_3: 0.4667 - dense_3_loss_4: 0.1321 - dense_3_loss_5: 0.0912 - dense_3_loss_6: 0.0751 - dense_3_loss_7: 0.0618 - dense_3_loss_8: 0.0525 - dense_3_loss_9: 0.0484 - dense_3_loss_10: 0.0368 - dense_3_loss_11: 0.0406 - dense_3_loss_12: 0.0384 - dense_3_loss_13: 0.0390 - dense_3_loss_14: 0.0405 - dense_3_loss_15: 0.0411 - dense_3_loss_16: 0.0421 - dense_3_loss_17: 0.0384 - dense_3_loss_18: 0.0389 - dense_3_loss_19: 0.0387 - dense_3_loss_20: 0.0434 - dense_3_loss_21: 0.0471 - dense_3_loss_22: 0.0400 - dense_3_loss_23: 0.0417 - dense_3_loss_24: 0.0411 - dense_3_loss_25: 0.0457 - dense_3_loss_26: 0.0410 - dense_3_loss_27: 0.0438 - dense_3_loss_28: 0.0471 - dense_3_loss_29: 0.0493 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6167 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 78/100\n", "60/60 [==============================] - 0s - loss: 6.9744 - dense_3_loss_1: 3.8108 - dense_3_loss_2: 1.4516 - dense_3_loss_3: 0.4569 - dense_3_loss_4: 0.1284 - dense_3_loss_5: 0.0884 - dense_3_loss_6: 0.0726 - dense_3_loss_7: 0.0598 - dense_3_loss_8: 0.0508 - dense_3_loss_9: 0.0468 - dense_3_loss_10: 0.0358 - dense_3_loss_11: 0.0393 - dense_3_loss_12: 0.0372 - dense_3_loss_13: 0.0377 - dense_3_loss_14: 0.0393 - dense_3_loss_15: 0.0398 - dense_3_loss_16: 0.0407 - dense_3_loss_17: 0.0372 - dense_3_loss_18: 0.0377 - dense_3_loss_19: 0.0375 - dense_3_loss_20: 0.0422 - dense_3_loss_21: 0.0455 - dense_3_loss_22: 0.0385 - dense_3_loss_23: 0.0404 - dense_3_loss_24: 0.0400 - dense_3_loss_25: 0.0442 - dense_3_loss_26: 0.0397 - dense_3_loss_27: 0.0424 - dense_3_loss_28: 0.0457 - dense_3_loss_29: 0.0477 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6167 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 79/100\n", "60/60 [==============================] - 0s - loss: 6.9106 - dense_3_loss_1: 3.8073 - dense_3_loss_2: 1.4372 - dense_3_loss_3: 0.4478 - dense_3_loss_4: 0.1251 - dense_3_loss_5: 0.0859 - dense_3_loss_6: 0.0705 - dense_3_loss_7: 0.0580 - dense_3_loss_8: 0.0492 - dense_3_loss_9: 0.0454 - dense_3_loss_10: 0.0347 - dense_3_loss_11: 0.0382 - dense_3_loss_12: 0.0360 - dense_3_loss_13: 0.0365 - dense_3_loss_14: 0.0382 - dense_3_loss_15: 0.0387 - dense_3_loss_16: 0.0395 - dense_3_loss_17: 0.0361 - dense_3_loss_18: 0.0366 - dense_3_loss_19: 0.0364 - dense_3_loss_20: 0.0408 - dense_3_loss_21: 0.0441 - dense_3_loss_22: 0.0375 - dense_3_loss_23: 0.0392 - dense_3_loss_24: 0.0387 - dense_3_loss_25: 0.0428 - dense_3_loss_26: 0.0385 - dense_3_loss_27: 0.0413 - dense_3_loss_28: 0.0444 - dense_3_loss_29: 0.0463 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6167 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 80/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 6.8469 - dense_3_loss_1: 3.8039 - dense_3_loss_2: 1.4228 - dense_3_loss_3: 0.4383 - dense_3_loss_4: 0.1220 - dense_3_loss_5: 0.0832 - dense_3_loss_6: 0.0684 - dense_3_loss_7: 0.0563 - dense_3_loss_8: 0.0478 - dense_3_loss_9: 0.0441 - dense_3_loss_10: 0.0337 - dense_3_loss_11: 0.0371 - dense_3_loss_12: 0.0348 - dense_3_loss_13: 0.0354 - dense_3_loss_14: 0.0370 - dense_3_loss_15: 0.0375 - dense_3_loss_16: 0.0381 - dense_3_loss_17: 0.0349 - dense_3_loss_18: 0.0355 - dense_3_loss_19: 0.0353 - dense_3_loss_20: 0.0395 - dense_3_loss_21: 0.0427 - dense_3_loss_22: 0.0364 - dense_3_loss_23: 0.0380 - dense_3_loss_24: 0.0374 - dense_3_loss_25: 0.0415 - dense_3_loss_26: 0.0373 - dense_3_loss_27: 0.0400 - dense_3_loss_28: 0.0428 - dense_3_loss_29: 0.0450 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6167 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 81/100\n", "60/60 [==============================] - 0s - loss: 6.7864 - dense_3_loss_1: 3.8005 - dense_3_loss_2: 1.4082 - dense_3_loss_3: 0.4299 - dense_3_loss_4: 0.1189 - dense_3_loss_5: 0.0809 - dense_3_loss_6: 0.0665 - dense_3_loss_7: 0.0546 - dense_3_loss_8: 0.0465 - dense_3_loss_9: 0.0429 - dense_3_loss_10: 0.0328 - dense_3_loss_11: 0.0360 - dense_3_loss_12: 0.0338 - dense_3_loss_13: 0.0344 - dense_3_loss_14: 0.0360 - dense_3_loss_15: 0.0364 - dense_3_loss_16: 0.0370 - dense_3_loss_17: 0.0339 - dense_3_loss_18: 0.0344 - dense_3_loss_19: 0.0343 - dense_3_loss_20: 0.0383 - dense_3_loss_21: 0.0414 - dense_3_loss_22: 0.0354 - dense_3_loss_23: 0.0368 - dense_3_loss_24: 0.0362 - dense_3_loss_25: 0.0403 - dense_3_loss_26: 0.0362 - dense_3_loss_27: 0.0388 - dense_3_loss_28: 0.0415 - dense_3_loss_29: 0.0437 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6333 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 82/100\n", "60/60 [==============================] - 0s - loss: 6.7280 - dense_3_loss_1: 3.7971 - dense_3_loss_2: 1.3945 - dense_3_loss_3: 0.4210 - dense_3_loss_4: 0.1159 - dense_3_loss_5: 0.0785 - dense_3_loss_6: 0.0646 - dense_3_loss_7: 0.0530 - dense_3_loss_8: 0.0452 - dense_3_loss_9: 0.0416 - dense_3_loss_10: 0.0318 - dense_3_loss_11: 0.0349 - dense_3_loss_12: 0.0329 - dense_3_loss_13: 0.0334 - dense_3_loss_14: 0.0350 - dense_3_loss_15: 0.0354 - dense_3_loss_16: 0.0360 - dense_3_loss_17: 0.0330 - dense_3_loss_18: 0.0334 - dense_3_loss_19: 0.0333 - dense_3_loss_20: 0.0372 - dense_3_loss_21: 0.0403 - dense_3_loss_22: 0.0342 - dense_3_loss_23: 0.0356 - dense_3_loss_24: 0.0352 - dense_3_loss_25: 0.0392 - dense_3_loss_26: 0.0351 - dense_3_loss_27: 0.0376 - dense_3_loss_28: 0.0403 - dense_3_loss_29: 0.0425 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6333 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 83/100\n", "60/60 [==============================] - 0s - loss: 6.6728 - dense_3_loss_1: 3.7937 - dense_3_loss_2: 1.3814 - dense_3_loss_3: 0.4125 - dense_3_loss_4: 0.1132 - dense_3_loss_5: 0.0764 - dense_3_loss_6: 0.0628 - dense_3_loss_7: 0.0517 - dense_3_loss_8: 0.0440 - dense_3_loss_9: 0.0404 - dense_3_loss_10: 0.0310 - dense_3_loss_11: 0.0340 - dense_3_loss_12: 0.0321 - dense_3_loss_13: 0.0324 - dense_3_loss_14: 0.0340 - dense_3_loss_15: 0.0344 - dense_3_loss_16: 0.0350 - dense_3_loss_17: 0.0320 - dense_3_loss_18: 0.0326 - dense_3_loss_19: 0.0323 - dense_3_loss_20: 0.0362 - dense_3_loss_21: 0.0392 - dense_3_loss_22: 0.0333 - dense_3_loss_23: 0.0346 - dense_3_loss_24: 0.0342 - dense_3_loss_25: 0.0381 - dense_3_loss_26: 0.0341 - dense_3_loss_27: 0.0366 - dense_3_loss_28: 0.0394 - dense_3_loss_29: 0.0414 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6333 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 84/100\n", "60/60 [==============================] - 0s - loss: 6.6191 - dense_3_loss_1: 3.7904 - dense_3_loss_2: 1.3682 - dense_3_loss_3: 0.4042 - dense_3_loss_4: 0.1108 - dense_3_loss_5: 0.0742 - dense_3_loss_6: 0.0611 - dense_3_loss_7: 0.0503 - dense_3_loss_8: 0.0428 - dense_3_loss_9: 0.0393 - dense_3_loss_10: 0.0302 - dense_3_loss_11: 0.0330 - dense_3_loss_12: 0.0312 - dense_3_loss_13: 0.0314 - dense_3_loss_14: 0.0330 - dense_3_loss_15: 0.0336 - dense_3_loss_16: 0.0340 - dense_3_loss_17: 0.0310 - dense_3_loss_18: 0.0318 - dense_3_loss_19: 0.0313 - dense_3_loss_20: 0.0352 - dense_3_loss_21: 0.0381 - dense_3_loss_22: 0.0324 - dense_3_loss_23: 0.0337 - dense_3_loss_24: 0.0333 - dense_3_loss_25: 0.0370 - dense_3_loss_26: 0.0332 - dense_3_loss_27: 0.0357 - dense_3_loss_28: 0.0383 - dense_3_loss_29: 0.0403 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6333 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 85/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 6.5676 - dense_3_loss_1: 3.7872 - dense_3_loss_2: 1.3549 - dense_3_loss_3: 0.3965 - dense_3_loss_4: 0.1084 - dense_3_loss_5: 0.0724 - dense_3_loss_6: 0.0595 - dense_3_loss_7: 0.0491 - dense_3_loss_8: 0.0416 - dense_3_loss_9: 0.0383 - dense_3_loss_10: 0.0294 - dense_3_loss_11: 0.0321 - dense_3_loss_12: 0.0304 - dense_3_loss_13: 0.0306 - dense_3_loss_14: 0.0321 - dense_3_loss_15: 0.0328 - dense_3_loss_16: 0.0332 - dense_3_loss_17: 0.0302 - dense_3_loss_18: 0.0309 - dense_3_loss_19: 0.0304 - dense_3_loss_20: 0.0343 - dense_3_loss_21: 0.0372 - dense_3_loss_22: 0.0314 - dense_3_loss_23: 0.0328 - dense_3_loss_24: 0.0324 - dense_3_loss_25: 0.0361 - dense_3_loss_26: 0.0324 - dense_3_loss_27: 0.0346 - dense_3_loss_28: 0.0372 - dense_3_loss_29: 0.0392 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6333 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 86/100\n", "60/60 [==============================] - 0s - loss: 6.5181 - dense_3_loss_1: 3.7838 - dense_3_loss_2: 1.3424 - dense_3_loss_3: 0.3894 - dense_3_loss_4: 0.1061 - dense_3_loss_5: 0.0706 - dense_3_loss_6: 0.0580 - dense_3_loss_7: 0.0477 - dense_3_loss_8: 0.0406 - dense_3_loss_9: 0.0372 - dense_3_loss_10: 0.0287 - dense_3_loss_11: 0.0312 - dense_3_loss_12: 0.0295 - dense_3_loss_13: 0.0299 - dense_3_loss_14: 0.0312 - dense_3_loss_15: 0.0319 - dense_3_loss_16: 0.0324 - dense_3_loss_17: 0.0294 - dense_3_loss_18: 0.0300 - dense_3_loss_19: 0.0297 - dense_3_loss_20: 0.0335 - dense_3_loss_21: 0.0362 - dense_3_loss_22: 0.0305 - dense_3_loss_23: 0.0319 - dense_3_loss_24: 0.0315 - dense_3_loss_25: 0.0351 - dense_3_loss_26: 0.0315 - dense_3_loss_27: 0.0336 - dense_3_loss_28: 0.0364 - dense_3_loss_29: 0.0382 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6500 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 87/100\n", "60/60 [==============================] - 0s - loss: 6.4721 - dense_3_loss_1: 3.7805 - dense_3_loss_2: 1.3303 - dense_3_loss_3: 0.3824 - dense_3_loss_4: 0.1041 - dense_3_loss_5: 0.0690 - dense_3_loss_6: 0.0567 - dense_3_loss_7: 0.0466 - dense_3_loss_8: 0.0398 - dense_3_loss_9: 0.0364 - dense_3_loss_10: 0.0280 - dense_3_loss_11: 0.0304 - dense_3_loss_12: 0.0288 - dense_3_loss_13: 0.0292 - dense_3_loss_14: 0.0305 - dense_3_loss_15: 0.0312 - dense_3_loss_16: 0.0316 - dense_3_loss_17: 0.0287 - dense_3_loss_18: 0.0292 - dense_3_loss_19: 0.0290 - dense_3_loss_20: 0.0326 - dense_3_loss_21: 0.0352 - dense_3_loss_22: 0.0297 - dense_3_loss_23: 0.0310 - dense_3_loss_24: 0.0307 - dense_3_loss_25: 0.0342 - dense_3_loss_26: 0.0308 - dense_3_loss_27: 0.0327 - dense_3_loss_28: 0.0355 - dense_3_loss_29: 0.0373 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6500 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 88/100\n", "60/60 [==============================] - 0s - loss: 6.4252 - dense_3_loss_1: 3.7774 - dense_3_loss_2: 1.3186 - dense_3_loss_3: 0.3744 - dense_3_loss_4: 0.1021 - dense_3_loss_5: 0.0672 - dense_3_loss_6: 0.0553 - dense_3_loss_7: 0.0454 - dense_3_loss_8: 0.0387 - dense_3_loss_9: 0.0354 - dense_3_loss_10: 0.0273 - dense_3_loss_11: 0.0297 - dense_3_loss_12: 0.0281 - dense_3_loss_13: 0.0284 - dense_3_loss_14: 0.0298 - dense_3_loss_15: 0.0303 - dense_3_loss_16: 0.0309 - dense_3_loss_17: 0.0279 - dense_3_loss_18: 0.0285 - dense_3_loss_19: 0.0282 - dense_3_loss_20: 0.0317 - dense_3_loss_21: 0.0344 - dense_3_loss_22: 0.0290 - dense_3_loss_23: 0.0302 - dense_3_loss_24: 0.0299 - dense_3_loss_25: 0.0333 - dense_3_loss_26: 0.0300 - dense_3_loss_27: 0.0319 - dense_3_loss_28: 0.0346 - dense_3_loss_29: 0.0365 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6500 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 89/100\n", "60/60 [==============================] - 0s - loss: 6.3808 - dense_3_loss_1: 3.7741 - dense_3_loss_2: 1.3067 - dense_3_loss_3: 0.3676 - dense_3_loss_4: 0.1002 - dense_3_loss_5: 0.0658 - dense_3_loss_6: 0.0541 - dense_3_loss_7: 0.0444 - dense_3_loss_8: 0.0379 - dense_3_loss_9: 0.0346 - dense_3_loss_10: 0.0267 - dense_3_loss_11: 0.0290 - dense_3_loss_12: 0.0274 - dense_3_loss_13: 0.0278 - dense_3_loss_14: 0.0291 - dense_3_loss_15: 0.0296 - dense_3_loss_16: 0.0302 - dense_3_loss_17: 0.0271 - dense_3_loss_18: 0.0278 - dense_3_loss_19: 0.0275 - dense_3_loss_20: 0.0309 - dense_3_loss_21: 0.0335 - dense_3_loss_22: 0.0283 - dense_3_loss_23: 0.0294 - dense_3_loss_24: 0.0291 - dense_3_loss_25: 0.0325 - dense_3_loss_26: 0.0292 - dense_3_loss_27: 0.0312 - dense_3_loss_28: 0.0336 - dense_3_loss_29: 0.0356 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6500 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 90/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 6.3361 - dense_3_loss_1: 3.7710 - dense_3_loss_2: 1.2947 - dense_3_loss_3: 0.3607 - dense_3_loss_4: 0.0981 - dense_3_loss_5: 0.0643 - dense_3_loss_6: 0.0525 - dense_3_loss_7: 0.0432 - dense_3_loss_8: 0.0370 - dense_3_loss_9: 0.0336 - dense_3_loss_10: 0.0260 - dense_3_loss_11: 0.0283 - dense_3_loss_12: 0.0267 - dense_3_loss_13: 0.0270 - dense_3_loss_14: 0.0284 - dense_3_loss_15: 0.0289 - dense_3_loss_16: 0.0294 - dense_3_loss_17: 0.0264 - dense_3_loss_18: 0.0272 - dense_3_loss_19: 0.0268 - dense_3_loss_20: 0.0301 - dense_3_loss_21: 0.0327 - dense_3_loss_22: 0.0276 - dense_3_loss_23: 0.0287 - dense_3_loss_24: 0.0285 - dense_3_loss_25: 0.0316 - dense_3_loss_26: 0.0285 - dense_3_loss_27: 0.0305 - dense_3_loss_28: 0.0328 - dense_3_loss_29: 0.0348 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6500 - dense_3_acc_3: 0.8667 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 91/100\n", "60/60 [==============================] - 0s - loss: 6.2944 - dense_3_loss_1: 3.7680 - dense_3_loss_2: 1.2830 - dense_3_loss_3: 0.3540 - dense_3_loss_4: 0.0963 - dense_3_loss_5: 0.0628 - dense_3_loss_6: 0.0514 - dense_3_loss_7: 0.0422 - dense_3_loss_8: 0.0361 - dense_3_loss_9: 0.0328 - dense_3_loss_10: 0.0254 - dense_3_loss_11: 0.0276 - dense_3_loss_12: 0.0261 - dense_3_loss_13: 0.0264 - dense_3_loss_14: 0.0278 - dense_3_loss_15: 0.0283 - dense_3_loss_16: 0.0288 - dense_3_loss_17: 0.0258 - dense_3_loss_18: 0.0265 - dense_3_loss_19: 0.0263 - dense_3_loss_20: 0.0294 - dense_3_loss_21: 0.0319 - dense_3_loss_22: 0.0269 - dense_3_loss_23: 0.0281 - dense_3_loss_24: 0.0278 - dense_3_loss_25: 0.0308 - dense_3_loss_26: 0.0279 - dense_3_loss_27: 0.0297 - dense_3_loss_28: 0.0321 - dense_3_loss_29: 0.0340 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6500 - dense_3_acc_3: 0.8833 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 92/100\n", "60/60 [==============================] - 0s - loss: 6.2567 - dense_3_loss_1: 3.7647 - dense_3_loss_2: 1.2727 - dense_3_loss_3: 0.3486 - dense_3_loss_4: 0.0947 - dense_3_loss_5: 0.0617 - dense_3_loss_6: 0.0503 - dense_3_loss_7: 0.0414 - dense_3_loss_8: 0.0354 - dense_3_loss_9: 0.0321 - dense_3_loss_10: 0.0249 - dense_3_loss_11: 0.0270 - dense_3_loss_12: 0.0255 - dense_3_loss_13: 0.0258 - dense_3_loss_14: 0.0271 - dense_3_loss_15: 0.0276 - dense_3_loss_16: 0.0282 - dense_3_loss_17: 0.0253 - dense_3_loss_18: 0.0259 - dense_3_loss_19: 0.0257 - dense_3_loss_20: 0.0288 - dense_3_loss_21: 0.0313 - dense_3_loss_22: 0.0263 - dense_3_loss_23: 0.0274 - dense_3_loss_24: 0.0272 - dense_3_loss_25: 0.0302 - dense_3_loss_26: 0.0273 - dense_3_loss_27: 0.0290 - dense_3_loss_28: 0.0313 - dense_3_loss_29: 0.0333 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6500 - dense_3_acc_3: 0.8833 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 93/100\n", "60/60 [==============================] - 0s - loss: 6.2148 - dense_3_loss_1: 3.7618 - dense_3_loss_2: 1.2613 - dense_3_loss_3: 0.3410 - dense_3_loss_4: 0.0929 - dense_3_loss_5: 0.0602 - dense_3_loss_6: 0.0492 - dense_3_loss_7: 0.0404 - dense_3_loss_8: 0.0345 - dense_3_loss_9: 0.0314 - dense_3_loss_10: 0.0244 - dense_3_loss_11: 0.0262 - dense_3_loss_12: 0.0249 - dense_3_loss_13: 0.0253 - dense_3_loss_14: 0.0263 - dense_3_loss_15: 0.0271 - dense_3_loss_16: 0.0275 - dense_3_loss_17: 0.0247 - dense_3_loss_18: 0.0252 - dense_3_loss_19: 0.0251 - dense_3_loss_20: 0.0281 - dense_3_loss_21: 0.0306 - dense_3_loss_22: 0.0256 - dense_3_loss_23: 0.0267 - dense_3_loss_24: 0.0266 - dense_3_loss_25: 0.0295 - dense_3_loss_26: 0.0267 - dense_3_loss_27: 0.0283 - dense_3_loss_28: 0.0305 - dense_3_loss_29: 0.0325 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6500 - dense_3_acc_3: 0.8833 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 94/100\n", "60/60 [==============================] - 0s - loss: 6.1760 - dense_3_loss_1: 3.7586 - dense_3_loss_2: 1.2508 - dense_3_loss_3: 0.3346 - dense_3_loss_4: 0.0911 - dense_3_loss_5: 0.0589 - dense_3_loss_6: 0.0481 - dense_3_loss_7: 0.0395 - dense_3_loss_8: 0.0337 - dense_3_loss_9: 0.0307 - dense_3_loss_10: 0.0239 - dense_3_loss_11: 0.0257 - dense_3_loss_12: 0.0244 - dense_3_loss_13: 0.0247 - dense_3_loss_14: 0.0258 - dense_3_loss_15: 0.0265 - dense_3_loss_16: 0.0269 - dense_3_loss_17: 0.0242 - dense_3_loss_18: 0.0247 - dense_3_loss_19: 0.0245 - dense_3_loss_20: 0.0275 - dense_3_loss_21: 0.0299 - dense_3_loss_22: 0.0251 - dense_3_loss_23: 0.0261 - dense_3_loss_24: 0.0259 - dense_3_loss_25: 0.0289 - dense_3_loss_26: 0.0260 - dense_3_loss_27: 0.0277 - dense_3_loss_28: 0.0298 - dense_3_loss_29: 0.0319 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6500 - dense_3_acc_3: 0.8833 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 95/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 6.1399 - dense_3_loss_1: 3.7556 - dense_3_loss_2: 1.2401 - dense_3_loss_3: 0.3291 - dense_3_loss_4: 0.0897 - dense_3_loss_5: 0.0576 - dense_3_loss_6: 0.0472 - dense_3_loss_7: 0.0386 - dense_3_loss_8: 0.0330 - dense_3_loss_9: 0.0302 - dense_3_loss_10: 0.0234 - dense_3_loss_11: 0.0252 - dense_3_loss_12: 0.0238 - dense_3_loss_13: 0.0242 - dense_3_loss_14: 0.0252 - dense_3_loss_15: 0.0260 - dense_3_loss_16: 0.0263 - dense_3_loss_17: 0.0236 - dense_3_loss_18: 0.0242 - dense_3_loss_19: 0.0239 - dense_3_loss_20: 0.0269 - dense_3_loss_21: 0.0293 - dense_3_loss_22: 0.0246 - dense_3_loss_23: 0.0255 - dense_3_loss_24: 0.0254 - dense_3_loss_25: 0.0283 - dense_3_loss_26: 0.0255 - dense_3_loss_27: 0.0271 - dense_3_loss_28: 0.0292 - dense_3_loss_29: 0.0312 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6500 - dense_3_acc_3: 0.8833 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 96/100\n", "60/60 [==============================] - 0s - loss: 6.1045 - dense_3_loss_1: 3.7525 - dense_3_loss_2: 1.2298 - dense_3_loss_3: 0.3241 - dense_3_loss_4: 0.0881 - dense_3_loss_5: 0.0565 - dense_3_loss_6: 0.0463 - dense_3_loss_7: 0.0378 - dense_3_loss_8: 0.0324 - dense_3_loss_9: 0.0295 - dense_3_loss_10: 0.0229 - dense_3_loss_11: 0.0247 - dense_3_loss_12: 0.0233 - dense_3_loss_13: 0.0236 - dense_3_loss_14: 0.0247 - dense_3_loss_15: 0.0254 - dense_3_loss_16: 0.0258 - dense_3_loss_17: 0.0231 - dense_3_loss_18: 0.0237 - dense_3_loss_19: 0.0234 - dense_3_loss_20: 0.0263 - dense_3_loss_21: 0.0287 - dense_3_loss_22: 0.0241 - dense_3_loss_23: 0.0249 - dense_3_loss_24: 0.0249 - dense_3_loss_25: 0.0277 - dense_3_loss_26: 0.0249 - dense_3_loss_27: 0.0265 - dense_3_loss_28: 0.0286 - dense_3_loss_29: 0.0305 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6500 - dense_3_acc_3: 0.8833 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 97/100\n", "60/60 [==============================] - 0s - loss: 6.0704 - dense_3_loss_1: 3.7495 - dense_3_loss_2: 1.2201 - dense_3_loss_3: 0.3186 - dense_3_loss_4: 0.0868 - dense_3_loss_5: 0.0555 - dense_3_loss_6: 0.0453 - dense_3_loss_7: 0.0370 - dense_3_loss_8: 0.0318 - dense_3_loss_9: 0.0288 - dense_3_loss_10: 0.0224 - dense_3_loss_11: 0.0241 - dense_3_loss_12: 0.0229 - dense_3_loss_13: 0.0231 - dense_3_loss_14: 0.0242 - dense_3_loss_15: 0.0248 - dense_3_loss_16: 0.0253 - dense_3_loss_17: 0.0226 - dense_3_loss_18: 0.0232 - dense_3_loss_19: 0.0229 - dense_3_loss_20: 0.0257 - dense_3_loss_21: 0.0281 - dense_3_loss_22: 0.0235 - dense_3_loss_23: 0.0243 - dense_3_loss_24: 0.0243 - dense_3_loss_25: 0.0271 - dense_3_loss_26: 0.0245 - dense_3_loss_27: 0.0259 - dense_3_loss_28: 0.0280 - dense_3_loss_29: 0.0299 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6500 - dense_3_acc_3: 0.8833 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 98/100\n", "60/60 [==============================] - 0s - loss: 6.0356 - dense_3_loss_1: 3.7463 - dense_3_loss_2: 1.2099 - dense_3_loss_3: 0.3130 - dense_3_loss_4: 0.0853 - dense_3_loss_5: 0.0543 - dense_3_loss_6: 0.0444 - dense_3_loss_7: 0.0362 - dense_3_loss_8: 0.0311 - dense_3_loss_9: 0.0282 - dense_3_loss_10: 0.0220 - dense_3_loss_11: 0.0236 - dense_3_loss_12: 0.0224 - dense_3_loss_13: 0.0226 - dense_3_loss_14: 0.0237 - dense_3_loss_15: 0.0243 - dense_3_loss_16: 0.0248 - dense_3_loss_17: 0.0222 - dense_3_loss_18: 0.0227 - dense_3_loss_19: 0.0225 - dense_3_loss_20: 0.0253 - dense_3_loss_21: 0.0275 - dense_3_loss_22: 0.0230 - dense_3_loss_23: 0.0238 - dense_3_loss_24: 0.0238 - dense_3_loss_25: 0.0265 - dense_3_loss_26: 0.0240 - dense_3_loss_27: 0.0253 - dense_3_loss_28: 0.0275 - dense_3_loss_29: 0.0293 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.0667 - dense_3_acc_2: 0.6500 - dense_3_acc_3: 0.9000 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 99/100\n", "60/60 [==============================] - 0s - loss: 6.0022 - dense_3_loss_1: 3.7435 - dense_3_loss_2: 1.2005 - dense_3_loss_3: 0.3073 - dense_3_loss_4: 0.0836 - dense_3_loss_5: 0.0533 - dense_3_loss_6: 0.0435 - dense_3_loss_7: 0.0355 - dense_3_loss_8: 0.0305 - dense_3_loss_9: 0.0277 - dense_3_loss_10: 0.0215 - dense_3_loss_11: 0.0231 - dense_3_loss_12: 0.0220 - dense_3_loss_13: 0.0221 - dense_3_loss_14: 0.0232 - dense_3_loss_15: 0.0238 - dense_3_loss_16: 0.0243 - dense_3_loss_17: 0.0217 - dense_3_loss_18: 0.0222 - dense_3_loss_19: 0.0220 - dense_3_loss_20: 0.0248 - dense_3_loss_21: 0.0269 - dense_3_loss_22: 0.0226 - dense_3_loss_23: 0.0233 - dense_3_loss_24: 0.0233 - dense_3_loss_25: 0.0259 - dense_3_loss_26: 0.0235 - dense_3_loss_27: 0.0248 - dense_3_loss_28: 0.0269 - dense_3_loss_29: 0.0287 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.1000 - dense_3_acc_2: 0.6500 - dense_3_acc_3: 0.9000 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n", "Epoch 100/100\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "60/60 [==============================] - 0s - loss: 5.9722 - dense_3_loss_1: 3.7405 - dense_3_loss_2: 1.1917 - dense_3_loss_3: 0.3031 - dense_3_loss_4: 0.0824 - dense_3_loss_5: 0.0523 - dense_3_loss_6: 0.0428 - dense_3_loss_7: 0.0348 - dense_3_loss_8: 0.0299 - dense_3_loss_9: 0.0272 - dense_3_loss_10: 0.0211 - dense_3_loss_11: 0.0227 - dense_3_loss_12: 0.0215 - dense_3_loss_13: 0.0217 - dense_3_loss_14: 0.0228 - dense_3_loss_15: 0.0234 - dense_3_loss_16: 0.0238 - dense_3_loss_17: 0.0213 - dense_3_loss_18: 0.0217 - dense_3_loss_19: 0.0215 - dense_3_loss_20: 0.0243 - dense_3_loss_21: 0.0264 - dense_3_loss_22: 0.0221 - dense_3_loss_23: 0.0229 - dense_3_loss_24: 0.0228 - dense_3_loss_25: 0.0254 - dense_3_loss_26: 0.0231 - dense_3_loss_27: 0.0244 - dense_3_loss_28: 0.0263 - dense_3_loss_29: 0.0282 - dense_3_loss_30: 0.0000e+00 - dense_3_acc_1: 0.1000 - dense_3_acc_2: 0.6500 - dense_3_acc_3: 0.9167 - dense_3_acc_4: 1.0000 - dense_3_acc_5: 1.0000 - dense_3_acc_6: 1.0000 - dense_3_acc_7: 1.0000 - dense_3_acc_8: 1.0000 - dense_3_acc_9: 1.0000 - dense_3_acc_10: 1.0000 - dense_3_acc_11: 1.0000 - dense_3_acc_12: 1.0000 - dense_3_acc_13: 1.0000 - dense_3_acc_14: 1.0000 - dense_3_acc_15: 1.0000 - dense_3_acc_16: 1.0000 - dense_3_acc_17: 1.0000 - dense_3_acc_18: 1.0000 - dense_3_acc_19: 1.0000 - dense_3_acc_20: 1.0000 - dense_3_acc_21: 1.0000 - dense_3_acc_22: 1.0000 - dense_3_acc_23: 1.0000 - dense_3_acc_24: 1.0000 - dense_3_acc_25: 1.0000 - dense_3_acc_26: 1.0000 - dense_3_acc_27: 1.0000 - dense_3_acc_28: 1.0000 - dense_3_acc_29: 1.0000 - dense_3_acc_30: 0.0000e+00 \n" ] }, { "data": { "text/plain": [ "" ] }, "execution_count": 43, "metadata": {}, "output_type": "execute_result" } ], "source": [ "model.fit([X, a0, c0], list(Y), epochs=100)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "#### Expected Output\n", "\n", "The model loss will start high, (100 or so), and after 100 epochs, it should be in the single digits. These won't be the exact number that you'll see, due to random initialization of weights. \n", "For example:\n", "```\n", "Epoch 1/100\n", "60/60 [==============================] - 3s - loss: 125.7673\n", "...\n", "```\n", "Scroll to the bottom to check Epoch 100\n", "```\n", "...\n", "Epoch 100/100\n", "60/60 [==============================] - 0s - loss: 6.1861\n", "```\n", "\n", "Now that you have trained a model, let's go to the final section to implement an inference algorithm, and generate some music! " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## 3 - Generating music\n", "\n", "You now have a trained model which has learned the patterns of the jazz soloist. Lets now use this model to synthesize new music. \n", "\n", "#### 3.1 - Predicting & Sampling\n", "\n", "\n", "\n", "At each step of sampling, you will:\n", "* Take as input the activation '`a`' and cell state '`c`' from the previous state of the LSTM.\n", "* Forward propagate by one step.\n", "* Get a new output activation as well as cell state. \n", "* The new activation '`a`' can then be used to generate the output using the fully connected layer, `densor`. \n", "\n", "##### Initialization\n", "* We will initialize the following to be zeros:\n", " * `x0` \n", " * hidden state `a0` \n", " * cell state `c0` " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Exercise:** \n", "* Implement the function below to sample a sequence of musical values. \n", "* Here are some of the key steps you'll need to implement inside the for-loop that generates the $T_y$ output characters: \n", "\n", "* Step 2.A: Use `LSTM_Cell`, which takes in the input layer, as well as the previous step's '`c`' and '`a`' to generate the current step's '`c`' and '`a`'. \n", "```Python\n", "next_hidden_state, _, next_cell_state = LSTM_cell(input_x, initial_state=[previous_hidden_state, previous_cell_state])\n", "```\n", " * Choose the appropriate variables for the input_x, hidden_state, and cell_state\n", "\n", "* Step 2.B: Compute the output by applying `densor` to compute a softmax on '`a`' to get the output for the current step. \n", "\n", "* Step 2.C: Append the output to the list `outputs`.\n", "\n" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "* Step 2.D: Sample x to be the one-hot version of '`out`'. \n", "* This allows you to pass it to the next LSTM's step. \n", "* We have provided the definition of `one_hot(x)` in the 'music_utils.py' file and imported it.\n", "Here is the definition of `one_hot`\n", "```Python\n", "def one_hot(x):\n", " x = K.argmax(x)\n", " x = tf.one_hot(indices=x, depth=78) \n", " x = RepeatVector(1)(x)\n", " return x\n", "```\n", "Here is what the `one_hot` function is doing:\n", "* argmax: within the vector `x`, find the position with the maximum value and return the index of that position. \n", " * For example: argmax of [-1,0,1] finds that 1 is the maximum value, and returns the index position, which is 2. Read the documentation for [keras.argmax](https://www.tensorflow.org/api_docs/python/tf/keras/backend/argmax).\n", "* one_hot: takes a list of indices and the depth of the one-hot vector (number of categories, which is 78 in this assignment). It converts each index into the one-hot vector representation. For instance, if the indices is [2], and the depth is 5, then the one-hot vector returned is [0,0,1,0,0]. Check out the documentation for [tf.one_hot](https://www.tensorflow.org/api_docs/python/tf/one_hot) for more examples and explanations.\n", "* RepeatVector(n): This takes a vector and duplicates it `n` times. Notice that we had it repeat 1 time. This may seem like it's not doing anything. If you look at the documentation for [RepeatVector](https://keras.io/layers/core/#repeatvector), you'll notice that if x is a vector with dimension (m,5) and it gets passed into `RepeatVector(1)`, then the output is (m,1,5). In other words, it adds an additional dimension (of length 1) to the resulting vector.\n", "* Apply the custom one_hot encoding using the [Lambda](https://keras.io/layers/core/#lambda) layer. You saw earlier that the Lambda layer can be used like this:\n", "```Python\n", "result = Lambda(lambda x: x + 1)(input_var)\n", "```\n", "\n", "If you pre-define a function, you can do the same thing:\n", "```Python\n", "def add_one(x)\n", " return x + 1\n", "\n", "# use the add_one function inside of the Lambda function\n", "result = Lambda(add_one)(input_var)\n", "```" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "#### Step 3: Inference Model: \n", "This is how to use the Keras `Model`.\n", "```Python\n", "model = Model(inputs=[input_x, initial_hidden_state, initial_cell_state], outputs=the_outputs)\n", "```\n", "\n", "\n", "* Choose the appropriate variables for the input tensor, hidden state, cell state, and output.\n", "* **Hint**: the inputs to the model are the **initial** inputs and states." ] }, { "cell_type": "code", "execution_count": 44, "metadata": { "collapsed": true }, "outputs": [], "source": [ "# GRADED FUNCTION: music_inference_model\n", "\n", "def music_inference_model(LSTM_cell, densor, n_values = 78, n_a = 64, Ty = 100):\n", " \"\"\"\n", " Uses the trained \"LSTM_cell\" and \"densor\" from model() to generate a sequence of values.\n", " \n", " Arguments:\n", " LSTM_cell -- the trained \"LSTM_cell\" from model(), Keras layer object\n", " densor -- the trained \"densor\" from model(), Keras layer object\n", " n_values -- integer, number of unique values\n", " n_a -- number of units in the LSTM_cell\n", " Ty -- integer, number of time steps to generate\n", " \n", " Returns:\n", " inference_model -- Keras model instance\n", " \"\"\"\n", " \n", " # Define the input of your model with a shape \n", " x0 = Input(shape=(1, n_values))\n", " \n", " # Define s0, initial hidden state for the decoder LSTM\n", " a0 = Input(shape=(n_a,), name='a0')\n", " c0 = Input(shape=(n_a,), name='c0')\n", " a = a0\n", " c = c0\n", " x = x0\n", "\n", " ### START CODE HERE ###\n", " # Step 1: Create an empty list of \"outputs\" to later store your predicted values (≈1 line)\n", " outputs = []\n", " \n", " # Step 2: Loop over Ty and generate a value at every time step\n", " for t in range(Ty):\n", " \n", " # Step 2.A: Perform one step of LSTM_cell (≈1 line)\n", " a, _, c = LSTM_cell(x, initial_state=[a, c])\n", " \n", " # Step 2.B: Apply Dense layer to the hidden state output of the LSTM_cell (≈1 line)\n", " out = densor(a)\n", "\n", " # Step 2.C: Append the prediction \"out\" to \"outputs\". out.shape = (None, 78) (≈1 line)\n", " outputs.append(out)\n", " \n", " # Step 2.D: \n", " # Select the next value according to \"out\",\n", " # Set \"x\" to be the one-hot representation of the selected value\n", " # See instructions above.\n", " x = Lambda(one_hot)(out)\n", " \n", " # Step 3: Create model instance with the correct \"inputs\" and \"outputs\" (≈1 line)\n", " inference_model = Model(inputs=[x0, a0, c0], outputs=outputs) \n", " \n", " ### END CODE HERE ###\n", " \n", " return inference_model" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Run the cell below to define your inference model. This model is hard coded to generate 50 values." ] }, { "cell_type": "code", "execution_count": 45, "metadata": { "collapsed": true }, "outputs": [], "source": [ "inference_model = music_inference_model(LSTM_cell, densor, n_values = 78, n_a = 64, Ty = 50)" ] }, { "cell_type": "code", "execution_count": 46, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "____________________________________________________________________________________________________\n", "Layer (type) Output Shape Param # Connected to \n", "====================================================================================================\n", "input_6 (InputLayer) (None, 1, 78) 0 \n", "____________________________________________________________________________________________________\n", "a0 (InputLayer) (None, 64) 0 \n", "____________________________________________________________________________________________________\n", "c0 (InputLayer) (None, 64) 0 \n", "____________________________________________________________________________________________________\n", "lstm_3 (LSTM) [(None, 64), (None, 6 36608 input_6[0][0] \n", " a0[0][0] \n", " c0[0][0] \n", " lambda_171[0][0] \n", " lstm_3[60][0] \n", " lstm_3[60][2] \n", " lambda_172[0][0] \n", " lstm_3[61][0] \n", " lstm_3[61][2] \n", " lambda_173[0][0] \n", " lstm_3[62][0] \n", " lstm_3[62][2] \n", " lambda_174[0][0] \n", " lstm_3[63][0] \n", " lstm_3[63][2] \n", " lambda_175[0][0] \n", " lstm_3[64][0] \n", " lstm_3[64][2] \n", " lambda_176[0][0] \n", " lstm_3[65][0] \n", " lstm_3[65][2] \n", " lambda_177[0][0] \n", " lstm_3[66][0] \n", " lstm_3[66][2] \n", " lambda_178[0][0] \n", " lstm_3[67][0] \n", " lstm_3[67][2] \n", " lambda_179[0][0] \n", " lstm_3[68][0] \n", " lstm_3[68][2] \n", " lambda_180[0][0] \n", " lstm_3[69][0] \n", " lstm_3[69][2] \n", " lambda_181[0][0] \n", " lstm_3[70][0] \n", " lstm_3[70][2] \n", " lambda_182[0][0] \n", " lstm_3[71][0] \n", " lstm_3[71][2] \n", " lambda_183[0][0] \n", " lstm_3[72][0] \n", " lstm_3[72][2] \n", " lambda_184[0][0] \n", " lstm_3[73][0] \n", " lstm_3[73][2] \n", " lambda_185[0][0] \n", " lstm_3[74][0] \n", " lstm_3[74][2] \n", " lambda_186[0][0] \n", " lstm_3[75][0] \n", " lstm_3[75][2] \n", " lambda_187[0][0] \n", " lstm_3[76][0] \n", " lstm_3[76][2] \n", " lambda_188[0][0] \n", " lstm_3[77][0] \n", " lstm_3[77][2] \n", " lambda_189[0][0] \n", " lstm_3[78][0] \n", " lstm_3[78][2] \n", " lambda_190[0][0] \n", " lstm_3[79][0] \n", " lstm_3[79][2] \n", " lambda_191[0][0] \n", " lstm_3[80][0] \n", " lstm_3[80][2] \n", " lambda_192[0][0] \n", " lstm_3[81][0] \n", " lstm_3[81][2] \n", " lambda_193[0][0] \n", " lstm_3[82][0] \n", " lstm_3[82][2] \n", " lambda_194[0][0] \n", " lstm_3[83][0] \n", " lstm_3[83][2] \n", " lambda_195[0][0] \n", " lstm_3[84][0] \n", " lstm_3[84][2] \n", " lambda_196[0][0] \n", " lstm_3[85][0] \n", " lstm_3[85][2] \n", " lambda_197[0][0] \n", " lstm_3[86][0] \n", " lstm_3[86][2] \n", " lambda_198[0][0] \n", " lstm_3[87][0] \n", " lstm_3[87][2] \n", " lambda_199[0][0] \n", " lstm_3[88][0] \n", " lstm_3[88][2] \n", " lambda_200[0][0] \n", " lstm_3[89][0] \n", " lstm_3[89][2] \n", " lambda_201[0][0] \n", " lstm_3[90][0] \n", " lstm_3[90][2] \n", " lambda_202[0][0] \n", " lstm_3[91][0] \n", " lstm_3[91][2] \n", " lambda_203[0][0] \n", " lstm_3[92][0] \n", " lstm_3[92][2] \n", " lambda_204[0][0] \n", " lstm_3[93][0] \n", " lstm_3[93][2] \n", " lambda_205[0][0] \n", " lstm_3[94][0] \n", " lstm_3[94][2] \n", " lambda_206[0][0] \n", " lstm_3[95][0] \n", " lstm_3[95][2] \n", " lambda_207[0][0] \n", " lstm_3[96][0] \n", " lstm_3[96][2] \n", " lambda_208[0][0] \n", " lstm_3[97][0] \n", " lstm_3[97][2] \n", " lambda_209[0][0] \n", " lstm_3[98][0] \n", " lstm_3[98][2] \n", " lambda_210[0][0] \n", " lstm_3[99][0] \n", " lstm_3[99][2] \n", " lambda_211[0][0] \n", " lstm_3[100][0] \n", " lstm_3[100][2] \n", " lambda_212[0][0] \n", " lstm_3[101][0] \n", " lstm_3[101][2] \n", " lambda_213[0][0] \n", " lstm_3[102][0] \n", " lstm_3[102][2] \n", " lambda_214[0][0] \n", " lstm_3[103][0] \n", " lstm_3[103][2] \n", " lambda_215[0][0] \n", " lstm_3[104][0] \n", " lstm_3[104][2] \n", " lambda_216[0][0] \n", " lstm_3[105][0] \n", " lstm_3[105][2] \n", " lambda_217[0][0] \n", " lstm_3[106][0] \n", " lstm_3[106][2] \n", " lambda_218[0][0] \n", " lstm_3[107][0] \n", " lstm_3[107][2] \n", " lambda_219[0][0] \n", " lstm_3[108][0] \n", " lstm_3[108][2] \n", "____________________________________________________________________________________________________\n", "dense_3 (Dense) (None, 78) 5070 lstm_3[60][0] \n", " lstm_3[61][0] \n", " lstm_3[62][0] \n", " lstm_3[63][0] \n", " lstm_3[64][0] \n", " lstm_3[65][0] \n", " lstm_3[66][0] \n", " lstm_3[67][0] \n", " lstm_3[68][0] \n", " lstm_3[69][0] \n", " lstm_3[70][0] \n", " lstm_3[71][0] \n", " lstm_3[72][0] \n", " lstm_3[73][0] \n", " lstm_3[74][0] \n", " lstm_3[75][0] \n", " lstm_3[76][0] \n", " lstm_3[77][0] \n", " lstm_3[78][0] \n", " lstm_3[79][0] \n", " lstm_3[80][0] \n", " lstm_3[81][0] \n", " lstm_3[82][0] \n", " lstm_3[83][0] \n", " lstm_3[84][0] \n", " lstm_3[85][0] \n", " lstm_3[86][0] \n", " lstm_3[87][0] \n", " lstm_3[88][0] \n", " lstm_3[89][0] \n", " lstm_3[90][0] \n", " lstm_3[91][0] \n", " lstm_3[92][0] \n", " lstm_3[93][0] \n", " lstm_3[94][0] \n", " lstm_3[95][0] \n", " lstm_3[96][0] \n", " lstm_3[97][0] \n", " lstm_3[98][0] \n", " lstm_3[99][0] \n", " lstm_3[100][0] \n", " lstm_3[101][0] \n", " lstm_3[102][0] \n", " lstm_3[103][0] \n", " lstm_3[104][0] \n", " lstm_3[105][0] \n", " lstm_3[106][0] \n", " lstm_3[107][0] \n", " lstm_3[108][0] \n", " lstm_3[109][0] \n", "____________________________________________________________________________________________________\n", "lambda_171 (Lambda) (None, 1, 78) 0 dense_3[60][0] \n", "____________________________________________________________________________________________________\n", "lambda_172 (Lambda) (None, 1, 78) 0 dense_3[61][0] \n", "____________________________________________________________________________________________________\n", "lambda_173 (Lambda) (None, 1, 78) 0 dense_3[62][0] \n", "____________________________________________________________________________________________________\n", "lambda_174 (Lambda) (None, 1, 78) 0 dense_3[63][0] \n", "____________________________________________________________________________________________________\n", "lambda_175 (Lambda) (None, 1, 78) 0 dense_3[64][0] \n", "____________________________________________________________________________________________________\n", "lambda_176 (Lambda) (None, 1, 78) 0 dense_3[65][0] \n", "____________________________________________________________________________________________________\n", "lambda_177 (Lambda) (None, 1, 78) 0 dense_3[66][0] \n", "____________________________________________________________________________________________________\n", "lambda_178 (Lambda) (None, 1, 78) 0 dense_3[67][0] \n", "____________________________________________________________________________________________________\n", "lambda_179 (Lambda) (None, 1, 78) 0 dense_3[68][0] \n", "____________________________________________________________________________________________________\n", "lambda_180 (Lambda) (None, 1, 78) 0 dense_3[69][0] \n", "____________________________________________________________________________________________________\n", "lambda_181 (Lambda) (None, 1, 78) 0 dense_3[70][0] \n", "____________________________________________________________________________________________________\n", "lambda_182 (Lambda) (None, 1, 78) 0 dense_3[71][0] \n", "____________________________________________________________________________________________________\n", "lambda_183 (Lambda) (None, 1, 78) 0 dense_3[72][0] \n", "____________________________________________________________________________________________________\n", "lambda_184 (Lambda) (None, 1, 78) 0 dense_3[73][0] \n", "____________________________________________________________________________________________________\n", "lambda_185 (Lambda) (None, 1, 78) 0 dense_3[74][0] \n", "____________________________________________________________________________________________________\n", "lambda_186 (Lambda) (None, 1, 78) 0 dense_3[75][0] \n", "____________________________________________________________________________________________________\n", "lambda_187 (Lambda) (None, 1, 78) 0 dense_3[76][0] \n", "____________________________________________________________________________________________________\n", "lambda_188 (Lambda) (None, 1, 78) 0 dense_3[77][0] \n", "____________________________________________________________________________________________________\n", "lambda_189 (Lambda) (None, 1, 78) 0 dense_3[78][0] \n", "____________________________________________________________________________________________________\n", "lambda_190 (Lambda) (None, 1, 78) 0 dense_3[79][0] \n", "____________________________________________________________________________________________________\n", "lambda_191 (Lambda) (None, 1, 78) 0 dense_3[80][0] \n", "____________________________________________________________________________________________________\n", "lambda_192 (Lambda) (None, 1, 78) 0 dense_3[81][0] \n", "____________________________________________________________________________________________________\n", "lambda_193 (Lambda) (None, 1, 78) 0 dense_3[82][0] \n", "____________________________________________________________________________________________________\n", "lambda_194 (Lambda) (None, 1, 78) 0 dense_3[83][0] \n", "____________________________________________________________________________________________________\n", "lambda_195 (Lambda) (None, 1, 78) 0 dense_3[84][0] \n", "____________________________________________________________________________________________________\n", "lambda_196 (Lambda) (None, 1, 78) 0 dense_3[85][0] \n", "____________________________________________________________________________________________________\n", "lambda_197 (Lambda) (None, 1, 78) 0 dense_3[86][0] \n", "____________________________________________________________________________________________________\n", "lambda_198 (Lambda) (None, 1, 78) 0 dense_3[87][0] \n", "____________________________________________________________________________________________________\n", "lambda_199 (Lambda) (None, 1, 78) 0 dense_3[88][0] \n", "____________________________________________________________________________________________________\n", "lambda_200 (Lambda) (None, 1, 78) 0 dense_3[89][0] \n", "____________________________________________________________________________________________________\n", "lambda_201 (Lambda) (None, 1, 78) 0 dense_3[90][0] \n", "____________________________________________________________________________________________________\n", "lambda_202 (Lambda) (None, 1, 78) 0 dense_3[91][0] \n", "____________________________________________________________________________________________________\n", "lambda_203 (Lambda) (None, 1, 78) 0 dense_3[92][0] \n", "____________________________________________________________________________________________________\n", "lambda_204 (Lambda) (None, 1, 78) 0 dense_3[93][0] \n", "____________________________________________________________________________________________________\n", "lambda_205 (Lambda) (None, 1, 78) 0 dense_3[94][0] \n", "____________________________________________________________________________________________________\n", "lambda_206 (Lambda) (None, 1, 78) 0 dense_3[95][0] \n", "____________________________________________________________________________________________________\n", "lambda_207 (Lambda) (None, 1, 78) 0 dense_3[96][0] \n", "____________________________________________________________________________________________________\n", "lambda_208 (Lambda) (None, 1, 78) 0 dense_3[97][0] \n", "____________________________________________________________________________________________________\n", "lambda_209 (Lambda) (None, 1, 78) 0 dense_3[98][0] \n", "____________________________________________________________________________________________________\n", "lambda_210 (Lambda) (None, 1, 78) 0 dense_3[99][0] \n", "____________________________________________________________________________________________________\n", "lambda_211 (Lambda) (None, 1, 78) 0 dense_3[100][0] \n", "____________________________________________________________________________________________________\n", "lambda_212 (Lambda) (None, 1, 78) 0 dense_3[101][0] \n", "____________________________________________________________________________________________________\n", "lambda_213 (Lambda) (None, 1, 78) 0 dense_3[102][0] \n", "____________________________________________________________________________________________________\n", "lambda_214 (Lambda) (None, 1, 78) 0 dense_3[103][0] \n", "____________________________________________________________________________________________________\n", "lambda_215 (Lambda) (None, 1, 78) 0 dense_3[104][0] \n", "____________________________________________________________________________________________________\n", "lambda_216 (Lambda) (None, 1, 78) 0 dense_3[105][0] \n", "____________________________________________________________________________________________________\n", "lambda_217 (Lambda) (None, 1, 78) 0 dense_3[106][0] \n", "____________________________________________________________________________________________________\n", "lambda_218 (Lambda) (None, 1, 78) 0 dense_3[107][0] \n", "____________________________________________________________________________________________________\n", "lambda_219 (Lambda) (None, 1, 78) 0 dense_3[108][0] \n", "====================================================================================================\n", "Total params: 41,678\n", "Trainable params: 41,678\n", "Non-trainable params: 0\n", "____________________________________________________________________________________________________\n" ] } ], "source": [ "# Check the inference model\n", "inference_model.summary()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "** Expected Output**\n", "If you scroll to the bottom of the output, you'll see:\n", "```\n", "Total params: 41,678\n", "Trainable params: 41,678\n", "Non-trainable params: 0\n", "```" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "#### Initialize inference model\n", "The following code creates the zero-valued vectors you will use to initialize `x` and the LSTM state variables `a` and `c`. " ] }, { "cell_type": "code", "execution_count": 47, "metadata": { "collapsed": true }, "outputs": [], "source": [ "x_initializer = np.zeros((1, 1, 78))\n", "a_initializer = np.zeros((1, n_a))\n", "c_initializer = np.zeros((1, n_a))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Exercise**: Implement `predict_and_sample()`. \n", "\n", "* This function takes many arguments including the inputs [x_initializer, a_initializer, c_initializer]. \n", "* In order to predict the output corresponding to this input, you will need to carry-out 3 steps:\n", "\n", "\n", "#### Step 1\n", "* Use your inference model to predict an output given your set of inputs. The output `pred` should be a list of length $T_y$ where each element is a numpy-array of shape (1, n_values).\n", "```Python\n", "inference_model.predict([input_x_init, hidden_state_init, cell_state_init])\n", "```\n", " * Choose the appropriate input arguments to `predict` from the input arguments of this `predict_and_sample` function.\n", " \n", "#### Step 2\n", "* Convert `pred` into a numpy array of $T_y$ indices. \n", " * Each index is computed by taking the `argmax` of an element of the `pred` list. \n", " * Use [numpy.argmax](https://docs.scipy.org/doc/numpy/reference/generated/numpy.argmax.html).\n", " * Set the `axis` parameter.\n", " * Remember that the shape of the prediction is $(m, T_{y}, n_{values})$\n", "\n", "#### Step 3 \n", "* Convert the indices into their one-hot vector representations. \n", " * Use [to_categorical](https://keras.io/utils/#to_categorical).\n", " * Set the `num_classes` parameter. Note that for grading purposes: you'll need to either:\n", " * Use a dimension from the given parameters of `predict_and_sample()` (for example, one of the dimensions of x_initializer has the value for the number of distinct classes).\n", " * Or just hard code the number of distinct classes (will pass the grader as well).\n", " * Note that using a global variable such as n_values will not work for grading purposes." ] }, { "cell_type": "code", "execution_count": 48, "metadata": { "collapsed": true }, "outputs": [], "source": [ "# GRADED FUNCTION: predict_and_sample\n", "\n", "def predict_and_sample(inference_model, x_initializer = x_initializer, a_initializer = a_initializer, \n", " c_initializer = c_initializer):\n", " \"\"\"\n", " Predicts the next value of values using the inference model.\n", " \n", " Arguments:\n", " inference_model -- Keras model instance for inference time\n", " x_initializer -- numpy array of shape (1, 1, 78), one-hot vector initializing the values generation\n", " a_initializer -- numpy array of shape (1, n_a), initializing the hidden state of the LSTM_cell\n", " c_initializer -- numpy array of shape (1, n_a), initializing the cell state of the LSTM_cel\n", " \n", " Returns:\n", " results -- numpy-array of shape (Ty, 78), matrix of one-hot vectors representing the values generated\n", " indices -- numpy-array of shape (Ty, 1), matrix of indices representing the values generated\n", " \"\"\"\n", " \n", " ### START CODE HERE ###\n", " # Step 1: Use your inference model to predict an output sequence given x_initializer, a_initializer and c_initializer.\n", " pred = inference_model.predict([x_initializer, a_initializer, c_initializer])\n", " # Step 2: Convert \"pred\" into an np.array() of indices with the maximum probabilities\n", " indices = np.argmax(pred, axis=-1)\n", " # Step 3: Convert indices to one-hot vectors, the shape of the results should be (1, )\n", " results = to_categorical(indices, num_classes=78)\n", " ### END CODE HERE ###\n", " \n", " return results, indices" ] }, { "cell_type": "code", "execution_count": 49, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "np.argmax(results[12]) = 7\n", "np.argmax(results[17]) = 51\n", "list(indices[12:18]) = [array([7]), array([4]), array([7]), array([54]), array([77]), array([51])]\n" ] } ], "source": [ "results, indices = predict_and_sample(inference_model, x_initializer, a_initializer, c_initializer)\n", "print(\"np.argmax(results[12]) =\", np.argmax(results[12]))\n", "print(\"np.argmax(results[17]) =\", np.argmax(results[17]))\n", "print(\"list(indices[12:18]) =\", list(indices[12:18]))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**Expected (Approximate) Output**: \n", "\n", "* Your results **may likely differ** because Keras' results are not completely predictable. \n", "* However, if you have trained your LSTM_cell with model.fit() for exactly 100 epochs as described above: \n", " * You should very likely observe a sequence of indices that are not all identical. \n", " * Moreover, you should observe that: \n", " * np.argmax(results[12]) is the first element of list(indices[12:18]) \n", " * and np.argmax(results[17]) is the last element of list(indices[12:18]). \n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
\n", " **np.argmax(results[12])** =\n", " \n", " 1\n", "
\n", " **np.argmax(results[17])** =\n", " \n", " 42\n", "
\n", " **list(indices[12:18])** =\n", " \n", " [array([1]), array([42]), array([54]), array([17]), array([1]), array([42])]\n", "
" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "#### 3.3 - Generate music \n", "\n", "Finally, you are ready to generate music. Your RNN generates a sequence of values. The following code generates music by first calling your `predict_and_sample()` function. These values are then post-processed into musical chords (meaning that multiple values or notes can be played at the same time). \n", "\n", "Most computational music algorithms use some post-processing because it is difficult to generate music that sounds good without such post-processing. The post-processing does things such as clean up the generated audio by making sure the same sound is not repeated too many times, that two successive notes are not too far from each other in pitch, and so on. One could argue that a lot of these post-processing steps are hacks; also, a lot of the music generation literature has also focused on hand-crafting post-processors, and a lot of the output quality depends on the quality of the post-processing and not just the quality of the RNN. But this post-processing does make a huge difference, so let's use it in our implementation as well. \n", "\n", "Let's make some music! " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Run the following cell to generate music and record it into your `out_stream`. This can take a couple of minutes." ] }, { "cell_type": "code", "execution_count": 50, "metadata": { "scrolled": false }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "Predicting new values for different set of chords.\n", "Generated 50 sounds using the predicted values for the set of chords (\"1\") and after pruning\n", "Generated 51 sounds using the predicted values for the set of chords (\"2\") and after pruning\n", "Generated 51 sounds using the predicted values for the set of chords (\"3\") and after pruning\n", "Generated 51 sounds using the predicted values for the set of chords (\"4\") and after pruning\n", "Generated 51 sounds using the predicted values for the set of chords (\"5\") and after pruning\n", "Your generated music is saved in output/my_music.midi\n" ] } ], "source": [ "out_stream = generate_music(inference_model)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "To listen to your music, click File->Open... Then go to \"output/\" and download \"my_music.midi\". Either play it on your computer with an application that can read midi files if you have one, or use one of the free online \"MIDI to mp3\" conversion tools to convert this to mp3. \n", "\n", "As a reference, here is a 30 second audio clip we generated using this algorithm. " ] }, { "cell_type": "code", "execution_count": 51, "metadata": {}, "outputs": [ { "data": { "text/html": [ "\n", " \n", " " ], "text/plain": [ "" ] }, "execution_count": 51, "metadata": {}, "output_type": "execute_result" } ], "source": [ "IPython.display.Audio('./data/30s_trained_model.mp3')" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Congratulations!\n", "\n", "You have come to the end of the notebook. \n", "\n", "\n", "## What you should remember\n", "- A sequence model can be used to generate musical values, which are then post-processed into midi music. \n", "- Fairly similar models can be used to generate dinosaur names or to generate music, with the major difference being the input fed to the model. \n", "- In Keras, sequence generation involves defining layers with shared weights, which are then repeated for the different time steps $1, \\ldots, T_x$. " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Congratulations on completing this assignment and generating a jazz solo! " ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "**References**\n", "\n", "The ideas presented in this notebook came primarily from three computational music papers cited below. The implementation here also took significant inspiration and used many components from Ji-Sung Kim's GitHub repository.\n", "\n", "- Ji-Sung Kim, 2016, [deepjazz](https://github.com/jisungk/deepjazz)\n", "- Jon Gillick, Kevin Tang and Robert Keller, 2009. [Learning Jazz Grammars](http://ai.stanford.edu/~kdtang/papers/smc09-jazzgrammar.pdf)\n", "- Robert Keller and David Morrison, 2007, [A Grammatical Approach to Automatic Improvisation](http://smc07.uoa.gr/SMC07%20Proceedings/SMC07%20Paper%2055.pdf)\n", "- François Pachet, 1999, [Surprising Harmonies](http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.5.7473&rep=rep1&type=pdf)\n", "\n", "We're also grateful to François Germain for valuable feedback." ] } ], "metadata": { "coursera": { "course_slug": "nlp-sequence-models", "graded_item_id": "EG0F7", "launcher_item_id": "cxJXc" }, "kernelspec": { "display_name": "Python 3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.6.0" } }, "nbformat": 4, "nbformat_minor": 2 }