{ "metadata": { "name": "multilayer_perceptron" }, "nbformat": 3, "nbformat_minor": 0, "worksheets": [ { "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# pylearn2 tutorial: Multilayer Perceptron\n", "by [Ian Goodfellow](http://www-etud.iro.umontreal.ca/~goodfeli)\n", "\n", "## Introduction\n", "This ipython notebook will teach you the basics of how multilayer perceptrons work, and show you how to use multilayer perceptrons in pylearn2.\n", "\n", "To do this, we will go over several concepts:\n", "\n", "Part 1: What pylearn2 is doing for you in this example\n", "\n", " - Review of softmax regression, and how MLPs are similar\n", "\n", " - The multilayer perceptron model\n", "\n", " - Some beneficial properties of MLPs\n", "\n", " - Some detrimental properties of MLPs\n", "\n", "Part 2: How to use pylearn2 to train an MLP\n", "\n", "Part 3: A deeper MLP, and pylearn2 polymorphism\n", "\n", "Part 4: Regularization, and pylearn2 costs\n", "\n", "\n", "Note that this won't explain in detail how the individual classes are implemented. The classes\n", "follow pretty good naming conventions and have pretty good docstrings, but if you have trouble\n", "understanding them, write to me and I might add a part 3 explaining how some of the parts work\n", "under the hood.\n", "\n", "Please write to pylearn-dev@googlegroups.com if you encounter any problem with this tutorial." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Requirements\n", "\n", "Before running this notebook, you must have installed pylearn2.\n", "Follow the [download and installation instructions](http://deeplearning.net/software/pylearn2/#download-and-installation)\n", "if you have not yet done so.\n", "\n", "This tutorial also assumes you already know about softmax regression, and know how to train and evaluate a softmax regression model in pylearn2. If not, work through softmax_regression.ipynb before starting this tutorial.\n", "\n", "It's also strongly recommend that you run this notebook with THEANO_FLAGS=\"device=gpu\". This is a processing intensive example and the GPU will make it run a lot faster, if you have one available. Execute the next cell to verify that you are using the GPU.\n", "\n" ] }, { "cell_type": "code", "collapsed": false, "input": [ "import theano\n", "print theano.config.device" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "gpu\n" ] }, { "output_type": "stream", "stream": "stderr", "text": [ "Using gpu device 0: GeForce GTX 285\n" ] } ], "prompt_number": 1 }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Part 1: What pylearn2 is doing for you in this example\n", "\n", "In this part, we won't get into any specifics of pylearn2 yet. We'll just discuss how to train a multilayer perceptron (MLP). If you already know about MLPs, feel free to skip straight to part 2, where we show how to do all of this in pylearn2.\n", "\n", "\n", "### Review of softmax regression, and how MLPs are similar\n", "\n", "In softmax_regression.ipynb, we saw how softmax regression is a classification model that learns to map an input vector $x$ to a probability distribution $p(y\\mid x)$ where $y$ is a categorical value with $k$ different values. We then described how a dataset $\\mathcal{D}$ of $(x, y)$ tuples could be used to train a softmax regression model by maximizing the log likelihood,\n", "\n", "$$ \\sum_{x,y \\in \\mathcal{D} } \\log P(y \\mid x). $$\n", "\n", "A multilayer perceptron is a very general machine learning model. In many cases, we can think of it as mapping $x$ to $P(y\\mid x)$, and train it by maximizing the log likelihood. We'll start with that basic perspective, because of its similarity to softmax regression. (It is, however, possible to interpret the output of a multiplayer perceptron non-probabilistically, to use it for regression rather than classification, and to train it by optimizing functions other than the log likelihood)\n", "\n", "Everything we described above is still relevant to the MLP. However, there is one more fact about softmax regression that does not apply to the MLP. Specifically, softmax regression assumes that\n", "\n", "$$ p(y \\mid x) = \\frac { \\exp( x^T W + b ) } { \\sum_i \\exp(x^T W + b)_i } = \\text{softmax}( x^T W + b). $$\n", "\n", "The MLP makes a different assumption about the functional form of $p(y \\mid x)$.\n", "\n", "## The multilayer perceptron model\n", "\n", "The multilayer perceptron model assumption is very weak. Essentially, the assumption is that the relationship between inputs and outputs can be represented by the composition of several simpler functions. Each function being composed can be thought of as another \"layer\" or stage of processing. The number of compositions determines the \"depth\" of the model.\n", "\n", "Suppose we have a sequence of functions implementing the layers, $g_1, g_2, \\dots, g_L$. Then the output of our MLP is\n", "\n", "$$f(x) = g_L(g_{L-1}( \\dots g_2( g_1 ( x )) \\dots )).$$\n", "\n", "In the first example for this tutorial, we will use just two layers. The final layer will be\n", "\n", "$ g_2(g_1) = \\text{softmax}( g_1^T W^{(2)} + b^{(2)}),$\n", "\n", "so we can think of this model as using $g_1$ to transform $x$ into a different space, then doing softmax regression in that space.\n", "\n", "For the first layer, we will use an affine transform followed by elementwise-application of the logistic sigmoid function, $\\sigma(z) = \\frac {1 } { 1 + \\exp(-z) }.$ This is a very commonly used type of layer in multilayer perceptrons. Putting it all together, we get\n", "\n", "$ g_1(x) = \\sigma ( x^T W^{(1)} + b^{(1)} ).$\n", "\n", "The full model is thus\n", "\n", "$$ f(x) = \\text{softmax}( \\sigma ( x^T W^{(1)} + b^{(1)} )^T W^{(2)} + b^{(2)}). $$\n", "\n", "If we interpret $f(x)$ as defining $p(y \\mid x)$, it makes sense to train the parameters $W^{(1)}$, $W^{(2)}$, $b^{(1)}$, and $b^{(2)}$ by maximizing the log likelihood of the training data. \n", "\n", "\n", "## Some beneficial properties of MLPs\n", "\n", "An obvious problem with softmax regression and other linear classifiers is that linear functions are very simple. They prevent solutions to even very simple classification problems, such as the class of 2 bit patterns whose XOR is true. XOR is true when $x=[1,0]$ or $x=[0,1]$ but not when $x=[0,0]$ or $x=[1,1]$. Suppose we draw a line that separates $[0,0]$ from $[0,1]$. Then it must pass through some point $[0,p]$. We require that this line also pass through $[q,1]$ in order to separate $[0,1]$ from $[1,1]$. But this means it slope must be negative and its $x$-intercept must be negative. Since a line only has one $x$ intercept, it does not pass between $[0,0]$ and $[1,0]$. Those two points belong to different classes, so any linear classifier must fail.\n", "\n", "An MLP solves this problem by introducing extra stages of processing. In our two layer example, suppose the dimensionality of the first layer is 2. We call the outputs of this layer \"hidden units\" because they are neither inputs nor outputs of the system; they are unobserved variables that the network must decide what to do with. The MLP can set one of these hidden units to be active when the sum of the two input variables is less than 1. It can set the other to be active when the sum of the two input variables is greater than 1. It can then set the output unit to be active by default, and to deactivate when either of the two hidden variables is active.\n", "\n", "More generally, an MLP with one sufficient large hidden layer can represent any function. This result is known as the \"universal approximator theorem.\"\n", "\n", "Another advantage of MLPs is that they can be made deeper and deeper, rather than just wider and wider. Many functions can be represented more efficiently (using fewer parameters) with a deep architecture than with a wide one. Using fewer parameters is beneficial both because the MLP takes less memory to represent, but also because the parameters may be estimated more accurately from a smaller amount of data.\n", "\n", "## Some detrimental properties of MLPs\n", "\n", "Unfortunately, just because an MLP can represent any function does not mean that it will learn to represent the right function. The problem of overfitting can still make the MLP perform badly on the test set even if it classifies the training set perfectly. While larger MLPs are capable of fitting more complicated training sets, they are also likely to overfit worse than smaller MLPs.\n", "\n", "A related issue with MLPs is that they have many configuration options. The model itself imposes design decisions such as what type of function to use for each layer, the dimensionality of each layer. Also, the log likelihood is no longer generally concave, so the choice of optimization procedure matters more than it did with softmax regression. These configuration options are known as \"hyperparameters.\" Choosing the right hyperparameters is an open and exciting research problem. \n", "\n", "Most of the hyperparameters in this tutorial were not chosen particularly carefully. Feel free to play with all of the settings in this notebook. If you find better ones, write to me and I'll put your settings and your name in the tutorial!" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "#Part 2: How to use pylearn2 to train an MLP\n", "\n", "Now that we've described the theory of what we're going to do, it's time to do it! This part describes\n", "how to use pylearn2 to run the algorithms described above.\n", "\n", "As in the softmax regression tutorial, we will use the MLP to do optical character recognition on the MNIST dataset.\n", "The yaml string we construct is similar ot the one we use before. The main difference is that the MLP model class\n", "takes a \"layers\" argument describing the various layers of the model.\n", "\n", "Note that for each layer, we need to specify what class to load. The identity of this class determines what type of layer\n", "appears at each position in the network. Here, we use a sigmoid hidden layer followed by a softmax output layer.\n", "\n", "Every layer of the MLP needs a unique name. Here we name the first hidden layer 'h0' and the output label representing the\n", "prediction of the class $y$ 'y'. These layer names are used to generate monitor channel names later so that we can track properties of each layer separately.\n", "\n", "The hidden layer needs some configuration that is pretty similar to the configuration for the output layer. Much as we need to tell the output layer its size (10 classes) we also need to tell the hidden layer its dimension, or the number of hidden units to go in that layer. In this case we use 500. We also need to tell it how to initialize its weights. The Sigmoid class supports the irange argument that we demonstrated for Softmax in the softmax regression tutorial, and we could use that here. Instead, we demonstrate a different argument, sparse_init. When sparse_init is specified, each unit gets exactly sparse_init non-zero weights initially. These weights are drawn from $N(0,1)$, so they are quite large compared to how weights are usually initialized.\n" ] }, { "cell_type": "code", "collapsed": false, "input": [ "import os\n", "import pylearn2\n", "path = os.path.join(pylearn2.__path__[0], 'scripts', 'tutorials', 'multilayer_perceptron', 'mlp_tutorial_part_2.yaml')\n", "with open(path, 'r') as f:\n", " train = f.read()\n", "hyper_params = {'train_stop' : 50000,\n", " 'valid_stop' : 60000,\n", " 'dim_h0' : 500,\n", " 'max_epochs' : 10000,\n", " 'save_path' : '.'}\n", "train = train % (hyper_params)\n", "print train" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "!obj:pylearn2.train.Train {\n", " dataset: &train !obj:pylearn2.datasets.mnist.MNIST {\n", " which_set: 'train',\n", " start: 0,\n", " stop: 50000\n", " },\n", " model: !obj:pylearn2.models.mlp.MLP {\n", " layers: [\n", " !obj:pylearn2.models.mlp.Sigmoid {\n", " layer_name: 'h0',\n", " dim: 500,\n", " sparse_init: 15,\n", " }, !obj:pylearn2.models.mlp.Softmax {\n", " layer_name: 'y',\n", " n_classes: 10,\n", " irange: 0.\n", " }\n", " ],\n", " nvis: 784,\n", " },\n", " algorithm: !obj:pylearn2.training_algorithms.bgd.BGD {\n", " batch_size: 10000,\n", " line_search_mode: 'exhaustive',\n", " conjugate: 1,\n", " updates_per_batch: 10,\n", " monitoring_dataset:\n", " {\n", " 'train' : *train,\n", " 'valid' : !obj:pylearn2.datasets.mnist.MNIST {\n", " which_set: 'train',\n", " start: 50000,\n", " stop: 60000\n", " },\n", " 'test' : !obj:pylearn2.datasets.mnist.MNIST {\n", " which_set: 'test',\n", " }\n", " },\n", " termination_criterion: !obj:pylearn2.termination_criteria.And {\n", " criteria: [\n", " !obj:pylearn2.termination_criteria.MonitorBased {\n", " channel_name: \"valid_y_misclass\"\n", " },\n", " !obj:pylearn2.termination_criteria.EpochCounter {\n", " max_epochs: 10000\n", " }\n", " ]\n", " }\n", " },\n", " extensions: [\n", " !obj:pylearn2.train_extensions.best_params.MonitorBasedSaveBest {\n", " channel_name: 'valid_y_misclass',\n", " save_path: \"mlp_best.pkl\"\n", " },\n", " ]\n", "}\n" ] } ], "prompt_number": 2 }, { "cell_type": "markdown", "metadata": {}, "source": [ "Note that we still do not specify a cost to be minimized. In the case of LogisticRegression, the model requested the negative log likelihood by default. In the case of the MLP, it is up to the final layer of the MLP to specify the default cost if the user does not provide one. In this case, since the final layer is a Softmax layer, we still have the same objective function as in the SoftmaxRegression tutorial.\n", "\n", "Now, we use pylearn2's yaml_parse.load to construct the Train object, and run its main loop. The same thing could be accomplished by running pylearn2's train.py script on a file containing the yaml string.\n", "\n", "Execute the next cell to train the model. This will take several minutes and possible as much as a few hours depending on how fast your computer is." ] }, { "cell_type": "code", "collapsed": false, "input": [ "from pylearn2.config import yaml_parse\n", "train = yaml_parse.load(train)\n", "train.main_loop()" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "compiling begin_record_entry...\n" ] }, { "output_type": "stream", "stream": "stderr", "text": [ "/u/goodfeli/pylearn2/models/mlp.py:36: UserWarning: MLP changing the recursion limit.\n", " warnings.warn(\"MLP changing the recursion limit.\")\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "compiling begin_record_entry done. Time elapsed: 0.479222 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitored channels: \n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling accum...\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "graph size: 160\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "graph size: 157\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "graph size: 157\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling accum done. Time elapsed: 11.082528 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23503398895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82355618477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06193995476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999900639057\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.909942150116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.508436858654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.901069939137\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.476713299751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.152832776308\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.480607658625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0718067958951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 0.000174344575498\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89326095581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98549151421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 2.30258440971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.0999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.099990285933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.0999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.901999950409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 2.30258440971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23503303528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82355594635\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06193971634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999884188175\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.910601377487\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.542480230331\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.899177610874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.477026820183\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.158626437187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.458495438099\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0697233080864\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 0.000107248379209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89326000214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98549151421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 2.30258440971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.0999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.0999902933836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.0999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.901359915733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 2.30258440971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23503398895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82355618477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06193995476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999902307987\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.910734891891\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.505713641644\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.897212743759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.477113306522\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.159442692995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.474104195833\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0706818476319\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 0.000110276472697\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89326095581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98549151421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 2.30258440971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.0999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.099990285933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.0999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.900900006294\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 2.30258440971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.338505 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 1\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 5\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 50000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.566698908806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.567735552788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.291175425053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.24065446854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.83268666267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.0723836422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999798893929\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.930105090141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.600322246552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.863031387329\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.476889610291\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.171247333288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.412737071514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0536084063351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 0.000199288566364\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89763784409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.99287319183\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0068221190013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.350786328316\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 2.74948716164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 2.56346487999\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 2.34412789345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999794960022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.840726792812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.207839608192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0983999967575\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.350786328316\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.701220929623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.34330791235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0764839723706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.24065446854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.83268642426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.07238340378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999829530716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.930867910385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.617025732994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.860394179821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.477169722319\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.177841931581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.386521846056\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0524694435298\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 0.000151637359522\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89763736725\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.99287295341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0068221190013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.372914284468\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 2.74948716164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 2.56346464157\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 2.34412789345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999826908112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.833846986294\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.198893502355\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.106319993734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.372914284468\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.701220929623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.343307882547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0764839798212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.24065446854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.83268666267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.0723836422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999864041805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.930580854416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.638543665409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.858349621296\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.477255016565\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.177810654044\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.361713379622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0531250722706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 0.000215846084757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89763784409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.99287319183\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0068221190013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.339448153973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 2.74948716164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 2.56346487999\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 2.34412789345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999945104122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.845010101795\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.196165680885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0965999960899\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.339448153973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.701220929623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.34330791235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0764839723706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.029214 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 2\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 100000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.648920476437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.385089039803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.205155700445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.2453122139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.8378276825\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.07804393768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999864637852\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.93498313427\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.613258361816\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.847131431103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.476234823465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.172577545047\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.381593316793\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0493729114532\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 0.000119279786304\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.90795898438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.99731445312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0140750305727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.296338170767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.20915484428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.00029850006\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 2.73683047295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.9999589324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.878535091877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.236884206533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0850000008941\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.296338170767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.839111089706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.403169810772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0928392037749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.24531269073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.83782744408\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.07804393768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999843478203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.935774207115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.630811154842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.843988478184\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.476507484913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.179330348969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.372446238995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.048459071666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 0.000123051402625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.90795898438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.99731445312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.014075031504\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.310930907726\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.20915460587\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.00029873848\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 2.73683071136\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999969184399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.872422754765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.206743046641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0889399945736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.310930907726\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.839111089706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.403169810772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0928391963243\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.2453122139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.8378276825\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.07804393768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999864220619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.935237765312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.672344446182\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.842247903347\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.476582586765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.178887397051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.358671993017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0488182529807\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 0.000185967219295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.90795898438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.99731445312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0140750305727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.286341637373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.20915484428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.00029850006\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 2.73683047295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999980926514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.880788624287\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.193636313081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0813999921083\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.286341637373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.839111089706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.403169810772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0928392037749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.009148 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 3\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 15\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 150000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.747792065144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.265085607767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.150685995817\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.24948835373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.84261131287\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.08266615868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.99994790554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.937485575676\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.633630394936\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.859075248241\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.475113451481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.166715249419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.368945479393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0472293719649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 5.30257530045e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.91970491409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.00150084496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0220027510077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.269680500031\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.56634759903\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.29666876793\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.00721621513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999979376793\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.893490552902\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.250094264746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0763000026345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.269680500031\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.959613263607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.443394243717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.103941932321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.24948787689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.84261083603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.08266615868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.99988758564\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.938323676586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.649454653263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.846590101719\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.475384742022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.171920359135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.365952074528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0464779213071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 6.07749607298e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.91970491409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.00150060654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.022002749145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.278353452682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.56634736061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.29666852951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.00721621513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999987363815\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.889036417007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.227912455797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0788599997759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.278353452682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.959613204002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.443394213915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.103941932321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.24948835373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.84261131287\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.08266615868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999919652939\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.937573850155\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.684871912003\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.850003778934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.475453108549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.170857235789\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.353432744741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0467779003084\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 6.80360026308e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.91970491409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.00150084496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0220027510077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.26020783186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.56634759903\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.29666876793\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.00721621513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999977052212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.896274268627\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.17623616755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0750000029802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.26020783186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.959613263607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.443394243717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.103941932321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.058853 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 4\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 20\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 200000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.788351774216\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.187993511558\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.113317854702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.25235366821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.84656834602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.08510184288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999974727631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.938515424728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.650707960129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.87255191803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.474163293839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.160470247269\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.364907234907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0464833118021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.23769111471e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.93058395386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.0049738884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0284670460969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.252513170242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.77643465996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.49576759338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.21715569496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999990880489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.902969479561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.223742827773\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0724000036716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.252513170242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.04190921783\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.47004455328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.109351947904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.25235366821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.84656858444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.08510160446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999940037727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.939188420773\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.661542713642\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.85992783308\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.474434643984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.163209468126\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.358978569508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0456797704101\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 3.15167126246e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.93058395386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.00497412682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0284670442343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.257761448622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.77643465996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.49576735497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.21715545654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999995172024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.898737490177\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.233332633972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0732599943876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.257761448622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.04190921783\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.470044583082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.109351947904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.25235366821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.84656834602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.08510184288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999963521957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.938330054283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.685399234295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.864110708237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.474497437477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.161501988769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.347681999207\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0459976904094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 2.87672100967e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.93058395386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.0049738884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0284670460969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.242218419909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.77643465996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.49576759338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.21715569496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999983727932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.90525239706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.237812787294\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.070799998939\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.242218419909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.04190921783\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.47004455328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.109351947904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 34.824181 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 5\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 25\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 250000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.822910606861\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.140246614814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0910708159208\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.2554602623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.85085010529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.08709287643\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999985814095\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.939129829407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.667058110237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.881521999836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.473096251488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.148683413863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.366505622864\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0459363907576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 9.1133879323e-06\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.94399118423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.00873041153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0347110852599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.236052155495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.98437142372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.68210268021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.41360712051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.99999153614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.909221351147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.227106332779\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0672999992967\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.236052155495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.12676775455\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.494562119246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.114525236189\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.2554602623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.85085010529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.08709263802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999965369701\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.939886808395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.672379374504\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.869372367859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.473366141319\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.151700764894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.357233524323\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0450618416071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.45595986396e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.9439907074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.00873041153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0347110852599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.239308148623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.9843711853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.68210220337\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.41360712051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999996185303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.905649185181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.236008346081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0679599940777\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.239308148623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.12676763535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.494562089443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.114525228739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.2554602623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.85085010529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.08709287643\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999980926514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.939110815525\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.683836042881\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.873598277569\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.473425507545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.149841591716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.346154510975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0454438403249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.18227362691e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.94399118423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.00873041153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0347110852599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.22658072412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.98437142372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.68210268021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.41360712051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999987483025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.911411643028\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.217763110995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0644000023603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.22658072412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.12676775455\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.494562119246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.114525236189\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.012249 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 6\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 30\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 300000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.849331319332\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.110973127186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0771789103746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.25832700729\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.85529947281\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.08869576454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999991595745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.93943220377\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.680398881435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.887371778488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.472293674946\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.139431104064\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.367107391357\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0457468703389\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 3.69549866264e-06\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.9600777626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.01261997223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0412151031196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.222071394324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.16519927979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.85762476921\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.61017894745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999991238117\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.913735508919\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.246407344937\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0631999969482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.222071394324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.19918644428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.517221450806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.117476500571\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.25832748413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.85529899597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.08869576454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999979615211\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.94024169445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.675026059151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.87550008297\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.472564071417\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.142730906606\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.356041908264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.044754832983\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 6.11660334471e-06\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.96007823944\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.01261997223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0412151031196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.222275063396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.16519880295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.85762453079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.61017894745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999996602535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.910623729229\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.235357835889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.062839999795\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.222275063396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.19918644428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.517221450806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.11747649312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.25832700729\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.85529947281\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.08869576454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999989330769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.939590632915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.678366243839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.879810392857\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.472620040178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.140709280968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.344533830881\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0452971383929\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 4.94029472975e-06\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.9600777626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.01261997223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0412151031196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.213480621576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.16519927979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.85762476921\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.61017894745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999992728233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.915528953075\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.230840429664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0590999983251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.213480621576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.19918644428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.517221450806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.117476500571\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 34.796789 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 7\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 35\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 350000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.921035170555\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0949304848909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0732585340738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.26188564301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.86070275307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.09020781517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999995708466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.940146625042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.672576725483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.892456889153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.47117972374\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.127655550838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.367071986198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0451025255024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.38111693104e-06\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.97794675827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.01733326912\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0475185476243\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.2069362849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.37119436264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.05648756027\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.72235488892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999992549419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.920760273933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.212535321712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0597999989986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.2069362849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.28081488609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.54237049818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.120768107474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.26188564301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.86070251465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.09020781517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999989151955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.941006839275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.670265555382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.880909919739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.471454769373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.130571871996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.354819297791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0440064184368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 2.32596198657e-06\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.97794628143\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.0173330307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0475185438991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.205675914884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.3711938858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.05648708344\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.72235488892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999997496605\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.917994856834\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.242114007473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0586799941957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.205675914884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.2808150053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.542370438576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.120768100023\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.26188564301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.86070275307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.09020781517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999994754791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.940389454365\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.653915822506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.885270357132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.471503049135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.129038855433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.343496620655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0445692464709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.89789943761e-06\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.97794675827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.01733326912\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0475185476243\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.199690312147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.37119436264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.05648756027\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.72235488892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999996244907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.922058641911\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.22336602211\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.055799998343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.199690312147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.28081488609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.54237049818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.120768107474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 34.805092 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 8\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 40\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 400000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.991648554802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0825677365065\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0698289051652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.26615095139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.86642217636\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.0920112133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999997377396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.940795004368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.66545778513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.901528179646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.470299869776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.121718779206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.370387345552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0449309423566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 5.55576320949e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.99863862991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.02230143547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0541109740734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.1924007833\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.68016433716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.25164651871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.82015967369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999988377094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.924113929272\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.210057422519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0555000007153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.1924007833\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.36218941212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.566706836224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.123096778989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.26615047455\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.86642193794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.0920112133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999993860722\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.941651582718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.657282650471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.89084905386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.470575273037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.124335050583\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.357388138771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0438850969076\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 9.09530456283e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.99863910675\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.02230119705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0541109666228\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.187867701054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.680164814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.25164651871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.82015943527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999996304512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.922073721886\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.237471118569\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0530999973416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.187867701054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.36218929291\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.566706776619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.123096778989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.26615095139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.86642217636\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.0920112133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999996244907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.940959215164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.634269952774\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.894827961922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.470626890659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.123129568994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.344170331955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0444831475616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 7.30816509531e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.99863862991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.02230143547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0541109740734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.184409946203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.68016433716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.25164651871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.82015967369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999994754791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.926723182201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.219980046153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.047499999404\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.184409946203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.36218941212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.566706836224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.123096778989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.663056 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 9\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 45\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 450000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.00632071495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0730155408382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0651284307241\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.27027750015\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.87175488472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.09271168709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.99999833107\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.941553533077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.65441852808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.903928875923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.469605773687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.114903002977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.373793333769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.044343251735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.48894650667e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.01675319672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.0269382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0595724433661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.178400695324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.93448925018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.4312376976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.912296772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.99998986721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.929982662201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.206445708871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0520999990404\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.178400695324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.42163467407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.588779568672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.124702431262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.27027750015\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.87175512314\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.09271168709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999995946884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.942493140697\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.638945221901\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.893475353718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.469883978367\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.117275975645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.360578835011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0432931296527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 3.94163265582e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.01675271988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.0269382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0595724396408\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.173733517528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.93448877335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.4312376976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.91229653358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999996066093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.92810434103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.229242756963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0490399971604\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.173733517528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.42163455486\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.588779509068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.124702423811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.27027750015\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.87175488472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.09271168709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999997377396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.941749632359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.622578442097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.897465348244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.469932496548\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.116939790547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.347404718399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0439214892685\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 3.13890211601e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.01675319672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.0269382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0595724433661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.172197133303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.93448925018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.4312376976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.912296772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999996781349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.932501792908\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.216077208519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0454999953508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.172197133303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.42163467407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.588779568672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.124702431262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.404834 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 50\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 500000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.06833612919\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0678643658757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0653440654278\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.27522420883\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.87793588638\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.09417295456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999998867512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.942130804062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.645175695419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.909636974335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.468845933676\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.104815065861\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.378569096327\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0440588444471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.15133666156e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.03866481781\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.03230404854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.065353885293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.167283341289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.2253780365\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.62542486191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.01688957214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999992907047\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.933511257172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.242168530822\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0492999963462\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.167283341289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.50107598305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.612406551838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.125712171197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.27522373199\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.87793540955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.09417295456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999997496605\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.943212330341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.628583967686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.899803757668\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.469121694565\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.107625767589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.36565092206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0430302321911\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.75549445203e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.03866481781\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.03230404854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.065353885293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.159167990088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.22537755966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.62542486191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.01688957214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999997138977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.931973934174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.241810530424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0449799969792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.159167990088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.50107610226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.612406492233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.125712156296\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.27522420883\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.87793588638\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.09417295456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999998152256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.942497193813\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.619423508644\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.903488636017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.469177812338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.108095638454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.349716216326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.04355686903\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.34484281489e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.03866481781\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.03230404854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.065353885293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.160998404026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.2253780365\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.62542486191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.01688957214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999998152256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.936175227165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.220791786909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0441000014544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.160998404026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.50107598305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.612406551838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.125712171197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.425083 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 55\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 550000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.14648592472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0634888410568\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0666681230068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.28032588959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.88434314728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.09576916695\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999999403954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.942800343037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.63667178154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.915984809399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.468008965254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.101051539183\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.390204340219\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0434938073158\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 5.66224080956e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.06034469604\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.03785538673\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0704936757684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.15456405282\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.50095510483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.82304191589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.1173620224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999992728233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.936915397644\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.252786010504\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0443000011146\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.15456405282\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.60092997551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.636273026466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.124862372875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.28032636642\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.88434290886\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.09576892853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999998629093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.944033026695\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.631079792976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.90686249733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.468293100595\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.103928506374\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.373679548502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0424839258194\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 8.3652395233e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.06034517288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.03785514832\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0704936683178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.146077007055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.50095510483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.82304239273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.11736249924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999997377396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.935088992119\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.235717624426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0411599949002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.146077007055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.60092973709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.636273086071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.124862357974\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.28032588959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.88434314728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.09576916695\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999998867512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.943427741528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.627752363682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.910161554813\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.468341171741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.104510381818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.357529014349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0429090820253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 6.19904838572e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.06034469604\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.03785538673\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0704936757684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.149976089597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.50095510483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.82304191589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.1173620224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999998509884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.939062952995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.239928662777\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0416000001132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.149976089597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.60092997551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.636273026466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.124862372875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.174293 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 60\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 600000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.16790962219\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0593062080443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0650760680437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.28521823883\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.89019036293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.09752202034\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999999582767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.94396853447\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.629440486431\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.920006334782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.467411011457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0957048162818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.389512062073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0425479598343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 3.20807167498e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.08012914658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.04289364815\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0743318274617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.144802451134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.74849033356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.00328540802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.21305179596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999994158745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.941429018974\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.231030538678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0408000014722\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.144802451134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.7184125185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.658156752586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.125041946769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.28521871567\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.89019012451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.09752202034\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.945232570171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.634238958359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.911378622055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.467698544264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0993719547987\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.373709738255\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0415380932391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 4.67483047828e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.08012914658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.04289340973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0743318200111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.135217413306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.74849033356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.00328493118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.21305131912\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999997973442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.939604878426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.252161383629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0378999970853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.135217413306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.71841263771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.658156752586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.125041931868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.28521823883\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.89019036293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.09752202034\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.99999922514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.944651842117\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.645568966866\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.914412498474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.467748105526\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0972835198045\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.359061449766\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0419331230223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 3.37856427279e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.08012914658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.04289364815\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0743318274617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.141469165683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.74849033356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.00328540802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.21305179596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999998867512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.943582773209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.241308540106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0379000008106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.141469165683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.7184125185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.658156752586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.125041946769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.417259 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 13\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 65\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 650000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.26017534733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0564817748964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.066411331296\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.29147386551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.89687585831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.09867763519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.944756031036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.627687215805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.920987069607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.46668151021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0932114943862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.397424399853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.041878964752\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.39939251298e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.10229206085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.04865932465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0787999555469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.135829210281\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.01105213165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.20304250717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.33085250854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999994754791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.945015072823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.230172082782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0381999947131\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.135829210281\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.85168874264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.682141900063\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.125363498926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.29147338867\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.89687561989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.09867739677\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999403954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.946107804775\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.63179987669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.912519574165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466963618994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0961530357599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.379027783871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0408683530986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.94427727251e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.10229253769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.04865932465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0787999555469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.12386597693\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.01105213165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.20304203033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.33085203171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999997973442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.943518102169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.246507614851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.034559994936\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.12386597693\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.85168862343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.682141840458\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.125363498926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.29147386551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.89687585831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.09867763519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999999403954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.945632517338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.651219964027\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.915507853031\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.467023015022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0969914197922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.364903271198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0411523580551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.40916096569e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.10229206085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.04865932465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0787999555469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.133389517665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.01105213165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.20304250717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.33085250854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999165535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.946852385998\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.214304342866\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.03579999879\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.133389517665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.85168874264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.682141900063\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.125363498926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.366187 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 14\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 70\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 700000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.40761697292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0550340935588\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0714166760445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.29854393005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.90459442139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.1004254818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.94591987133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.614766418934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.921078026295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466091096401\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0916782915592\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.396448850632\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0410171151161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 7.75897479599e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.12455701828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.05531406403\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0834630578756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.125504016876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.29601860046\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.42890501022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.46609354019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999994575977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.949410498142\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.201501131058\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0355000011623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.125504016876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.01360034943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.709331393242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.125074863434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.29854393005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.90459418297\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.10042524338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999523163\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.947336554527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.624508261681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.912684559822\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466372013092\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0946839675307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.383265286684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0400523841381\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.04573256721e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.12455654144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.05531382561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0834630504251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.112524747849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.29601955414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.42890501022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.46609306335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999997973442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.948245584965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.237888276577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.031159998849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.112524747849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.01360034943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.709331333637\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.125074848533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.29854393005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.90459442139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.1004254818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999999582767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.946813523769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.649647653103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.915705919266\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466423898935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0953802764416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.369607925415\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0402967631817\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 7.3467920636e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.12455701828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.05531406403\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0834630578756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.124651312828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.29601860046\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.42890501022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.46609354019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.950519561768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.27420938015\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0340000018477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.124651312828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.01360034943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.709331393242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.125074863434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.379965 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 15\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 75\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 750000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.47251427174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0522134304047\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.071938700974\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.30543804169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.91161727905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.10170149803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.947175860405\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.611504435539\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.926122069359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466326773167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0923119410872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.401742935181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.040495429188\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 3.92714794017e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.1450252533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.0613322258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0881084352732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.118968196213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.55995035172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.62976980209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.59543800354\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.951547503471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.228803291917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0349999964237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.118968196213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.14034724236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.733418226242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.12729588151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.30543756485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.91161704063\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.10170149803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999880791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.948555886745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.618095517159\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.918341517448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466599404812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0956889539957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.392006248236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0395230464637\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 5.12299225264e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.14502477646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.06133174896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.088108420372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.103299617767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.55995082855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.62976932526\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.5954375267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999997377396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.951093494892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.249234974384\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0284799989313\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.103299617767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.14034700394\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.733418226242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.12729588151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.30543804169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.91161727905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.10170149803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.947986066341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.642793953419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.920964062214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466656267643\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0940045118332\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.377251118422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.03970798105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 3.59755203405e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.1450252533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.0613322258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0881084352732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.119057364762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.55995035172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.62976980209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.59543800354\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999998807907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.953496754169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.279151201248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0322999954224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.119057364762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.14034724236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.733418226242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.12729588151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.163641 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 16\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 80\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 800000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.55044400692\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0495749413967\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.071437291801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.31254959106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.91860723495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.10440206528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.948059678078\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.594348907471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.927690863609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465816915035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0875093266368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.399484992027\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0397286936641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.14466333581e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.16418838501\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.06732678413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.091041892767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.111787736416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.79865264893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.8274474144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.71656274796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999996483326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.954726696014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.287018150091\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0328000001609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.111787736416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.27131104469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.757337749004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.12875507772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.31254959106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.91860699654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.10440182686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999880791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.949532628059\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.603366672993\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.920095324516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466088950634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0905980989337\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.391806066036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0387711115181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 2.82344658764e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.16418838501\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.06732654572\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0910418853164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0944318547845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.79865264893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.82744646072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.71656322479\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999998569489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.954577803612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.255649060011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0261199977249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0944318547845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.27131080627\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.757337749004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.128755062819\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.31254959106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.91860723495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.10440206528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.948857724667\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.6251745224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.922635018826\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.46614703536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0918302312493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.379304587841\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0389546044171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.96204941183e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.16418838501\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.06732678413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.091041892767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.110771089792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.79865264893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.8274474144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.71656274796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999165535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.95663100481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.264041811228\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0305000003427\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.110771089792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.27131104469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.757337749004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.12875507772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.246666 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 17\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 85\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 850000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.59982562065\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0473937280476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0712730288506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.31961965561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.92528343201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.10622811317\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.949356853962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.59099650383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.927693426609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465647280216\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0867232903838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.39404541254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0387796163559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.4791411429e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.18163251877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.07301926613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0938726961613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.106328338385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 7.01830482483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.0149974823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.83683490753\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999997198582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.95773011446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.291382759809\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0320000015199\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.106328338385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.38739275932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.780075967312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.130353063345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.31961917877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.92528319359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.10622787476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.950781822205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.600085794926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.920143485069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.465922415257\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0898449495435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.391092181206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0378985367715\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.99124361444e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.18163204193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.07301878929\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0938726961613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.088271394372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 7.01830387115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.0149974823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.83683490753\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999998629093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.957574307919\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.276376664639\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.023999998346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.088271394372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.3873925209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.780075907707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.130353048444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.31961965561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.92528343201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.10622811317\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.950090706348\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.620329141617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.922675073147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.465976387262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0912392660975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.378798425198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0380813851953\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.35891120578e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.18163251877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.07301926613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0938726961613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.107352338731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 7.01830482483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.0149974823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.83683490753\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999998867512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.959039092064\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.278402447701\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0296999998391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.107352338731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.38739275932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.780075967312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.130353063345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.302343 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 18\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 90\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 900000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.79280376434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0464615598321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0771328359842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.32822799683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.93359160423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.10832476616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.95045799017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.586617648602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.929918944836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465379714966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.083888605237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.397964477539\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0380010083318\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 7.37118366345e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.20447731018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.08011174202\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0980293303728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.100425355136\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 7.28403282166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.2393155098\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.98830795288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999997019768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.959611177444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.283116281033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.03039999865\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.100425355136\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.53001952171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.806962490082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.131183430552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.32822799683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.93359088898\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.10832476616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.951834976673\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.594883143902\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.922610759735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.465650081635\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0870256572962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.393012464046\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0370769426227\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 9.6733221433e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.20447683334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.0801115036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0980293378234\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0801135376096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 7.28403186798\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.23931598663\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.98830747604\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999998509884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.960199356079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.269580304623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0213200002909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0801135376096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.53001952171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.806962549686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.131183415651\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.32822799683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.93359160423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.10832476616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.951114416122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.613163709641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.925033152103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.465698361397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0884924307466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.386198699474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0373685508966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 6.73591848965e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.20447731018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.08011174202\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0980293303728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.101348236203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 7.28403282166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.2393155098\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.98830795288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.99999922514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.961142122746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.255374312401\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.028299998492\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.101348236203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.53001952171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.806962490082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.131183430552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.215917 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 19\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 95\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 950000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.94697141647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0453744120896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0806727781892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.33764886856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.94183731079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.11102938652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.951863646507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.580549895763\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.932179749012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465434730053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0796971917152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.390337795019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0372235476971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 6.10773209786e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.22417736053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.08713316917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.101160049438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0948458611965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 7.54131317139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.45906209946\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.14208126068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999998509884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.962593019009\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.309717655182\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0273999981582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0948458611965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.65757870674\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.83378046751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.132128432393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.3376493454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.94183754921\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.1110291481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.953146517277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.591403305531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.925151884556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.465704083443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0828539133072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.392235994339\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0363104119897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 8.38429381478e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.2241768837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.08713316917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.101160041988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.073119558394\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 7.54131317139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.45906209946\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.14208078384\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.963022887707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.268300741911\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0194799974561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.073119558394\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.65757846832\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.833780527115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.132128432393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.33764886856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.94183731079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.11102938652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.952474594116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.606046676636\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.927380979061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.465753525496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0843893289566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.386562854052\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0366778969765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 5.66411417768e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.22417736053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.08713316917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.101160049438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.09637324512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 7.54131317139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.45906209946\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.14208126068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999463558\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.96346116066\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.277560830116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0262000001967\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.09637324512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.65757870674\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.83378046751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.132128432393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 34.760706 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 20\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 100\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1000000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.02213191986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0437575168908\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.081667304039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34621286392\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.94933509827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.11350440979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.953083157539\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.574586033821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.934979915619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465407788754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0830942466855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.386586099863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0363725870848\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 3.24080540182e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.2420706749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.09350514412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.104648023844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0911609381437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 7.76595830917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.65801715851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.27815532684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999998688698\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.964522898197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.28780567646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0263999979943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0911609381437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.76887655258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.858034849167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.135387971997\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.34621238708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.94933462143\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.11350440979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.95438170433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.584669828415\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.928267598152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.465672910213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0862845480442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.389768064022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0354867391288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 4.38173886064e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.2420706749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.0935049057\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.104648023844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0672194138169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 7.76595830917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.65801715851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.27815580368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999523163\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.965664386749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.276637971401\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0176799986511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0672194138169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.76887631416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.858034789562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.135387957096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34621286392\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.94933509827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.11350440979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.953744530678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.597306787968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.930288851261\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.465717792511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.087476670742\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.389485627413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0357559174299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 3.05218794683e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.2420706749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.09350514412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.104648023844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0925975292921\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 7.76595830917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.65801715851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.27815532684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999761581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.965861082077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.303610026836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0258000008762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0925975292921\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.76887655258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.858034849167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.135387971997\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.213061 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 21\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1050000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.08118438721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0415316298604\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.080756470561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.35434007645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.95622348785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.11573195457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.953851401806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.567606449127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.933193147182\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465032488108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0830998793244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.383445978165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0356372632086\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.19485554731e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.25859546661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.09933209419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.107006825507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0886002033949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 7.9637556076\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.83463764191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.3923330307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.99999833107\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.965270340443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.310471683741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0262000001967\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0886002033949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.86672186852\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.879510939121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.136433556676\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.35433912277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.95622301102\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.11573171616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.955171644688\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.579390406609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.926286578178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.465295374393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0863517001271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.384008407593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0348346866667\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 2.7790120205e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.25859498978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.09933185577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.107006818056\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0625123158097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 7.96375513077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.83463668823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.3923330307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.99999922514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.967036545277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.273270666599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0158599987626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0625123158097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.8667216301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.879510939121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.136433571577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.35434007645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.95622348785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.11573195457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.95438760519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.590360045433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.928494334221\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.465345591307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0878760442138\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.384474813938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0351748354733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.96166291544e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.25859546661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.09933209419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.107006825507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0909144356847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 7.9637556076\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.83463764191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.3923330307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999403954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.966769099236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.282997220755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.025399999693\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0909144356847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.86672186852\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.879510939121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.136433556676\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.132773 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 22\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 110\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1100000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.14148879051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0403550490737\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0810787156224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.3625164032\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.96336507797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.11782503128\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.954942882061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.564869940281\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.935991108418\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465213596821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0809470117092\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.385282725096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0350002162158\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.53522847213e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.27728748322\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.10535025597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.109762132168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0847353041172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 8.15684700012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 7.01448202133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.519551754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999998867512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.967154860497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.283250451088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0249000005424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0847353041172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.96138525009\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.901844441891\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.138287782669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.3625164032\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.96336531639\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.11782479286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.956164836884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.575154662132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.929373860359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.465472817421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0842097327113\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.385039448738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0342263542116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.99991759264e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.27728748322\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.10535001755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.109762117267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0575138144195\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 8.15684700012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 7.01448202133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.51955223083\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999582767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.96871650219\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.287014901638\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0142399985343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0575138144195\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.96138525009\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.901844382286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.138287782669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.3625164032\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.96336507797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.11782503128\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.955441474915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.589357554913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.93136715889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.46551990509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.086060911417\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.390778958797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0345365256071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.45148310038e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.27728748322\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.10535025597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.109762132168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0865774899721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 8.15684700012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 7.01448202133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.519551754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999761581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.96779280901\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.273192465305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0244999974966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0865774899721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.96138525009\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.901844441891\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.138287782669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.193111 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 23\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1150000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.29178571701\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0395583026111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0849489048123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.37209796906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.97117829323\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.11957788467\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.956251323223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.561847269535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.934819757938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465812414885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0860762521625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.382852345705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0343066453934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.00234549827e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.29464244843\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.11194372177\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.112373262644\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0813909471035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 8.37556743622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 7.21202421188\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.66676425934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.99999922514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.969460964203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.304885983467\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0245999991894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0813909471035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.05758142471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.926100432873\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.141218408942\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.37209796906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.97117805481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.11957764626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.957390427589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.571023106575\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.928050994873\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466074705124\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.089665055275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.383693158627\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0335417687893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.25948085294e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.29464149475\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.11194324493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.112373247743\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0530071258545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 8.37556743622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 7.21202325821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.6667637825\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999761581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.971323847771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.274939656258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0134199988097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0530071258545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.05758142471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.926100373268\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.141218394041\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.37209796906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.97117829323\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.11957788467\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.956661045551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.585293292999\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.930199086666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466111898422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0879896134138\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.389526426792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0339160002768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 9.11426628614e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.29464244843\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.11194372177\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.112373262644\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0844431295991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 8.37556743622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 7.21202421188\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.66676425934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999761581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.970053553581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.252451866865\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0244999974966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0844431295991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.05758142471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.926100432873\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.141218408942\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.101327 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 24\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 120\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1200000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.4745285511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.037980530411\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0874084308743\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.38188457489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.97928380966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.12256121635\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.957348406315\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.559364676476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.934902369976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465777903795\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0820802301168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.37371224165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0335819907486\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 6.84129905504e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.31191539764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.11876320839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.114646181464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0791404470801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 8.59417057037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 7.40912103653\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.81003856659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.99999922514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.969864010811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.260499119759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0230999998748\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0791404470801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.15858983994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.950569629669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.144145652652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.38188409805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.97928357124\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.12256097794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.958476305008\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.567814290524\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.928138375282\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.46603512764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0855919569731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.379186630249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0329259894788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 8.38127969804e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.31191492081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.11876296997\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.114646181464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0484027862549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 8.59417057037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 7.40912055969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.81003761292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999701977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.972274065018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.297603964806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0116999996826\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0484027862549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.15858960152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.95056951046\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.144145637751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.38188457489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.97928380966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.12256121635\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.957733333111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.57974678278\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.930305242538\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466072052717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0875690802932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.382509231567\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0332807153463\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 6.19569395788e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.31191539764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.11876320839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.114646181464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0832240283489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 8.59417057037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 7.40912103653\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.81003856659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999761581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.970567047596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.264748305082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.023999998346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0832240283489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.15858983994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.950569629669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.144145652652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.537865 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 25\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1250000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.61537218094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0366696789861\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0890378654003\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.39218759537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.98763632774\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.1254658699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.958310782909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.550610423088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.936276137829\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.46598726511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0805417820811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.375468403101\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0328881442547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 7.84403653142e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.33220767975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.1257724762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.116853624582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0754533782601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 8.81067371368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 7.60889148712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.96597194672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999761581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.971746265888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.288777351379\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0232999995351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0754533782601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.24519085884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.975342810154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.148321658373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.3921880722\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.98763632774\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.1254658699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.959453582764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.561280608177\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.929621398449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466242551804\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0841432288289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.38017898798\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0322615392506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.0068777756e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.33220720291\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.1257724762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.116853624582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.043993473053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 8.81067276001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 7.60889053345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.96597194672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999821186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.974251687527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.270618349314\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0104199992493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.043993473053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.24519062042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.975342690945\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.148321658373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.39218759537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.98763632774\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.1254658699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.958616793156\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.574836432934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.931737542152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466278731823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0861588418484\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.383438080549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.032565869391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 7.15359646519e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.33220767975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.1257724762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.116853624582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0792490914464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 8.81067371368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 7.60889148712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.96597194672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999821186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.972301781178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.278648257256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0228000003844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0792490914464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.24519085884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.975342810154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.148321658373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.095306 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 26\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 130\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1300000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.71106290817\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0348753891885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0883127823472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.4017291069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.99520802498\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.12854385376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.959264814854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.55078792572\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.935866773129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466203004122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.078706741333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.367448121309\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0321592055261\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 4.60236952715e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.34829235077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.13210654259\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.118406176567\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0733289569616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 9.00574874878\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 7.78995084763\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 6.10382938385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999761581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.972537279129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.267330288887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0230999998748\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0733289569616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.33722496033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.997784733772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.151363104582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.40172863007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.9952082634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.12854361534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.960306882858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.562210321426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.929156780243\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466451466084\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0823357179761\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.377736270428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0315755605698\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 5.56277697517e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.34829139709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.13210630417\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.118406184018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0409014374018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 9.00574874878\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 7.78995037079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 6.10382938385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999821186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.975649058819\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.290484070778\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00971999950707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0409014374018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.33722496033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.997784733772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.151363104582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.4017291069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.99520802498\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.12854385376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.959495425224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.576115489006\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.931356489658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466476142406\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.084395840764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.37360149622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0320250503719\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 4.11951479873e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.34829235077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.13210654259\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.118406176567\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0791732370853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 9.00574874878\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 7.78995084763\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 6.10382938385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999821186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.973247587681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.254454284906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0232999995351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0791732370853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.33722496033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.997784733772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.151363104582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.406078 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 27\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1350000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.80285286903\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0334513224661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.088192678988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.41177082062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.00275707245\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.13091373444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.960214793682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.547308385372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.936411142349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466299444437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0786798894405\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.366961061954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0315478779376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 4.00019496694e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.36605072021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.13841247559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.119428776205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0725825279951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 9.19264411926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 7.96643924713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 6.2465171814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999821186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.974697828293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.284473180771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0219000000507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0725825279951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.41140413284\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.01977562904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.155052781105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.41176986694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.00275659561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.13091373444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.96123111248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.556509852409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.929732501507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466540902853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0823666229844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.371994018555\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0308939814568\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 5.01665688157e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.36605024338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.13841223717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.119428783655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0370035469532\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 9.19264411926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 7.96643972397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 6.24651670456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.977714180946\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.2884734869\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00885999947786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0370035469532\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.41140389442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.01977562904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.155052781105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.41177082062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.00275707245\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.13091373444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.960400640965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.574073672295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.931940674782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466566413641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0844538062811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.369769692421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0312857404351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 3.6578275131e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.36605072021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.13841247559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.119428776205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0765716135502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 9.19264411926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 7.96643924713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 6.2465171814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.974825143814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.268961429596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0228999983519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0765716135502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.41140413284\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.01977562904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.155052781105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 34.780491 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 28\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 140\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1400000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 3.07722043991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0323846936226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0927985981107\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.42322683334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.01182746887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.13467645645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.961281061172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.549638330936\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.939934492111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466522186995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0823039337993\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.357347339392\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.030734334141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 5.08886266459e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.38524675369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.1459903717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.121352598071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0716430544853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 9.41203117371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 8.17550086975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 6.39991140366\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999821186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.974777877331\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.270264923573\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0223999992013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0716430544853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.5011806488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.04629290104\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.159884780645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.42322635651\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.01182699203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.13467645645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.962265074253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.556583762169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.93360298872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.4667532444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0861736312509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.366083562374\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0301264487207\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 6.59544779902e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.38524627686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.1459903717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.121352590621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0347100757062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 9.41203117371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 8.17550086975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 6.39991092682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.978323638439\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.29167419672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00763999950141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0347100757062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.50118041039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.04629290104\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.159884765744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.42322683334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.01182746887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.13467645645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.961273550987\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.570200264454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.935558438301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466782003641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0883660390973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.355543404818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0304867494851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 4.62212004781e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.38524675369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.1459903717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.121352598071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0746665000916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 9.41203117371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 8.17550086975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 6.39991140366\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999821186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.975300252438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.280865699053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0222999975085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0746665000916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.5011806488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.04629290104\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.159884780645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.278322 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 29\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1450000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 3.31815242767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0319525785744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0989938527346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.43632364273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.02131462097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.13684439659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.96216905117\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.548579275608\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.941554307938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.46652469039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0799239650369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.357737779617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0300854835659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.19761518011e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.40747022629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.15389037132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.123720750213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0690323263407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 9.64226436615\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 8.3891248703\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 6.57722139359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.976467430592\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.293188840151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0212999973446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0690323263407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.5816681385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.07294213772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.162085324526\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.43632364273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.02131462097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.13684439659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.963165700436\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.55665397644\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.935373008251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466756403446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0838716328144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.36525374651\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0295039452612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 2.68275124338e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.40747022629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.15389037132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.123720750213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0306258164346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 9.64226341248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 8.3891248703\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 6.57722091675\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.980324864388\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.283443570137\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00647999951616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0306258164346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.58166790009\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.07294213772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.162085309625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.43632364273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.02131462097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.13684439659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.962217152119\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.571269631386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.937248468399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466767311096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0859551951289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.352124005556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0299664791673\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 2.06817705323e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.40747022629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.15389037132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.123720750213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0733132436872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 9.64226436615\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 8.3891248703\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 6.57722139359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.976790785789\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.291347831488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0217000003904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0733132436872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.5816681385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.07294213772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.162085324526\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.082858 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 30\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 150\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1500000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 3.39051413536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0302216522396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0965146124363\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.44657659531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.02922582626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.14045143127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.963280200958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.548351347446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.940559446812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466341674328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0799687504768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.357499152422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0293492469937\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.20450845079e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.4218788147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.16045355797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.124831520021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0672078579664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 9.82299423218\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 8.56633377075\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 6.71553707123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.977503836155\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.255842655897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0198999978602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0672078579664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.65550899506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.09536457062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.163716614246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.44657611847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.02922534943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.14045143127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.964230835438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.55356913805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.934283614159\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466563820839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0839123427868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.358219176531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0287974383682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 2.7636832059e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.42187833786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.16045331955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.12483151257\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0282621402293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 9.82299423218\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 8.56633377075\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 6.71553659439\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.981470048428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.304827183485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00591999944299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0282621402293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.65550875664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.09536445141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.163716599345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.44657659531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.02922582626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.14045143127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.963276088238\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.567677497864\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.936259627342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466583073139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0857717692852\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.344594448805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0292918123305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 2.15348190669e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.4218788147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.16045355797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.124831520021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0722089111805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 9.82299423218\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 8.56633377075\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 6.71553707123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.977750241756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.297483742237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.021099999547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0722089111805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.65550899506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.09536457062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.163716614246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.012923 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 31\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 155\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1550000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 3.48831152916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0287408661097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0940494984388\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.45725250244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.03711128235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.14304447174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.963537156582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.54846316576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.940077364445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466366380453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0763043165207\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.358212590218\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0289474800229\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.33178042847e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.44061088562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.16697835922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.125991553068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0662763118744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 10.0062093735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 8.73837566376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 6.84926891327\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.978273510933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.285628795624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0193999987096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0662763118744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.72132134438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.11716985703\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.168285727501\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.45725250244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.03711175919\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.14304423332\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.964494287968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.551624715328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.933692634106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466590344906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0803528800607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.359871029854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0284454971552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 3.10430431361e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.44061088562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.16697835922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.125991553068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0254283007234\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 10.0062084198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 8.73837471008\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 6.84926795959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.982455551624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.295360028744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00481999944896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0254283007234\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.72132158279\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.11716985703\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.168285742402\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.45725250244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.03711128235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.14304447174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.96359193325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.566685140133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.935809135437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466593444347\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0823497697711\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.342845439911\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0289610140026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 2.35798464088e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.44061088562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.16697835922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.125991553068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0720023438334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 10.0062093735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 8.73837566376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 6.84926891327\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.978184223175\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.33930772543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0208999998868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0720023438334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.72132134438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.11716985703\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.168285727501\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.375439 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 32\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 160\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1600000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 3.63046574593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0268990695477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.091931194067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.46750497818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.04480981827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.1463572979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.96414077282\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.551202893257\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.938820004463\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466768145561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0774406716228\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.35613399744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0284414924681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.09623499114e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.45651197433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.17332720757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.126796171069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0663162916899\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 10.1816034317\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 8.90622425079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 6.98152685165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.978770077229\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.294499635696\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0207000002265\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0663162916899\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.78270602226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.13857710361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.170636937022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.46750450134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.04480981827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.1463572979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.965125858784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.553418159485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.932287812233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466983139515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0815795511007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.351988613605\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0279593002051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 2.79454966112e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.4565114975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.17332744598\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.126796171069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0232511665672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 10.1816034317\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 8.90622425079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 6.98152732849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.98363161087\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.305530905724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00421999953687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0232511665672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.78270626068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.13857698441\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.170636937022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.46750497818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.04480981827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.1463572979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.964271306992\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.568406701088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.934549808502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466980487108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0836460664868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.336699128151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.028556285426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 2.1281049839e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.45651197433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.17332720757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.126796171069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0705031752586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 10.1816034317\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 8.90622425079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 6.98152685165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.978758752346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.291737556458\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0208999998868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0705031752586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.78270602226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.13857710361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.170636937022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.379330 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 33\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1650000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 3.85002589226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0255950912833\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0920957773924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.47780418396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.05291509628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.14965701103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.965208768845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.553891956806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.941352784634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.467216670513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0769760459661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.357422113419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.027681870386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.6821729773e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.47196292877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.18000507355\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.127480790019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0658261179924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 10.3589458466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 9.08145141602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 7.12754154205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.980045855045\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.275538861752\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.019999999553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0658261179924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.84528589249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.16080152988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.173613965511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.47780418396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.05291461945\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.14965701103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.966172575951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.551838994026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.935074448586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.46742233634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0811282843351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.346001476049\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0272373519838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 2.30680283902e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.47196340561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.18000459671\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.127480790019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.02110886015\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 10.3589458466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 9.08145141602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 7.12754058838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.984871923923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.292335510254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00331999990158\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.02110886015\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.84528613091\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.16080152988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.173613965511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.47780418396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.05291509628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.14965701103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.965333819389\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.567090988159\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.937143027782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.467420905828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0815225914121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.317524284124\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0278288982809\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.7383304865e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.47196292877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.18000507355\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.127480790019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0706555917859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 10.3589458466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 9.08145141602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 7.12754154205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.979981780052\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.314534544945\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0206000003964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0706555917859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.84528589249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.16080152988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.173613965511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.182908 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 34\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 170\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1700000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 4.07905960083\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0242200661451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0924715399742\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.48900747299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.06139850616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.1522192955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.965900540352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.551373183727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.942069590092\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.467438340187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0787537544966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.359593838453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0271878745407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.29720010775e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.49045753479\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.18700146675\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.128459200263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0644877254963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 10.5396261215\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 9.26142787933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 7.278901577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.98046040535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.25162255764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0206000003964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0644877254963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.90689897537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.18369758129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.177592679858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.48900747299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.06139850616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.15221905708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.966917276382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.551108419895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.935860812664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.467652916908\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0830486863852\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.34869286418\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0267758108675\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.72074004351e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.49045705795\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.18700098991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.128459185362\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0193602163345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 10.5396251678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 9.26142692566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 7.27890205383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.985767424107\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.336476325989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00289999973029\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0193602163345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.90689897537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.18369758129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.177592664957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.48900747299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.06139850616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.1522192955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.966026246548\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.568945586681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.937908649445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.467648357153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0835038796067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.32678771019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0274151265621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.33190177637e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.49045753479\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.18700146675\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.128459200263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0707407668233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 10.5396261215\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 9.26142787933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 7.278901577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.980556607246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.298538506031\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0219000000507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0707407668233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.90689897537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.18369758129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.177592679858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.400439 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 35\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 175\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1750000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 4.3184633255\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.022776318714\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0920493155718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.49970197678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.06945180893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.15374016762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.966324806213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.55324202776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.94215297699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466998904943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.076045922935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.358031690121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0268286950886\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.09078423377e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.50839042664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.19361257553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.129599049687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0635969266295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 10.7156534195\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 9.42882728577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 7.41432905197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.980757176876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.248226299882\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0193999987096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0635969266295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.96717524529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.20508480072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.180099412799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.4997010231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.06945180893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.1537399292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.967268288136\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.551735162735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.935940921307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.467215240002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0804425179958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.343524694443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0264016315341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.46074211754e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.50839090347\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.19361257553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.129599064589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0171565413475\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 10.7156524658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 9.42882633209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 7.41432905197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.986733615398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.337424963713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00196000002325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0171565413475\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.96717500687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.20508468151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.1800994277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.49970197678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.06945180893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.15374016762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.966409444809\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.564903616905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.938026130199\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.467201501131\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0823206305504\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.31958258152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0270514041185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.14466379084e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.50839042664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.19361257553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.129599049687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0689148977399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 10.7156534195\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 9.42882728577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 7.41432905197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.980640649796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.264637023211\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.021099999547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0689148977399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.96717524529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.20508480072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.180099412799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.392445 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 36\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 180\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1800000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 4.55049180984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0215135067701\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0914682373405\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.5103468895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.07773399353\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.15385961533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.967212915421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.559629559517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.943103969097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466701477766\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0809521302581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.355958789587\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0261587612331\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 8.34188967902e-12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.52430438995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.20039582253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.130876362324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0621786899865\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 10.8925733566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 9.60350131989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 7.55749177933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.981753587723\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.330662488937\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0190999973565\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0621786899865\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 4.02781057358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.22741234303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.181874185801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.51034593582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.07773399353\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.15385937691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.968181371689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.555752873421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.936968684196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466913819313\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0854497775435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.338039875031\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0257331542671\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.09208597027e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.52430438995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.20039534569\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.130876347423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0157043337822\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 10.892572403\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 9.60350131989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 7.55749130249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.987937808037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.323045521975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00203999993391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0157043337822\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 4.02781057358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.22741222382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.181874185801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.5103468895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.07773399353\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.15385961533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.967329084873\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.567208707333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.939025402069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466897398233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0875384286046\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.311605006456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0264036990702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 8.81185142215e-12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.52430438995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.20039582253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.130876362324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0682094246149\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 10.8925733566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 9.60350131989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 7.55749177933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.982199847698\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.324392050505\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0208000000566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0682094246149\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 4.02781057358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.22741234303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.181874185801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 34.710048 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 37\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1850000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 4.72839355469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0204669237137\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0900116711855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.52083969116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.08554124832\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.15409636497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.967603981495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.557713389397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.943118810654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466896891594\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0787230879068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.356404840946\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0257684588432\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 9.0589402299e-12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.53848934174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.206792593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.131754085422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0623081922531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 11.052611351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 9.76351451874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 7.68663883209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.982231199741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.287253022194\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0188999995589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0623081922531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 4.08399629593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.24770605564\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.185720145702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.52083921432\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.08554124832\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.15409636497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.968553900719\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.553573608398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.937007129192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.467112243176\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0832107812166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.334134042263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0253749713302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.24377470129e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.5384888649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.20679235458\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.131754085422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0140552837402\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 11.0526103973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 9.76351451874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 7.68663883209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.988768100739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.329038023949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00163999991491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0140552837402\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 4.08399581909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.24770605564\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.1857201159\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.52083969116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.08554124832\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.15409636497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.967728018761\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.569734930992\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.939063310623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.467084676027\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0852277651429\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.310160905123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0260545928031\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 9.77232097327e-12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.53848934174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.206792593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.131754085422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0679266303778\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 11.052611351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 9.76351451874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 7.68663883209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.982333242893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.319318085909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0204000007361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0679266303778\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 4.08399629593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.24770605564\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.185720145702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.364850 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 38\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 190\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1900000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 5.14290428162\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0190559756011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0913925841451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.53183841705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.09429168701\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.1546792984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.968341529369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.560349822044\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.94111353159\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466603428125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0797407329082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.351446330547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0251497104764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 7.31677132076e-12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.55737257004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.21393060684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.132736563683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0633104071021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 11.2310876846\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 9.94289398193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 7.82843732834\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.982944607735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.318380922079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0193999987096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0633104071021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 4.14330053329\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.27068781853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.189937055111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.53183746338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.09429121017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.15467905998\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.969276428223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.554496645927\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.934813499451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466816186905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0843253731728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.332267045975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0247781910002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 9.73409200467e-12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.5573720932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.21393036842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.132736548781\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0125638237223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 11.231086731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 9.94289398193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 7.82843637466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.989765167236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.37343031168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00133999995887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0125638237223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 4.14330005646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.27068758011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.189937055111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.53183841705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.09429168701\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.1546792984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.968490362167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.566503345966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.93706715107\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466789364815\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0863413140178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.307645887136\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0253705345094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 7.80784985277e-12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.55737257004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.21393060684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.132736563683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0684154629707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 11.2310876846\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 9.94289398193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 7.82843732834\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.983206391335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.354223191738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0201999973506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0684154629707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 4.14330053329\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.27068781853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.189937055111\n" ] } ], "prompt_number": 3 }, { "cell_type": "markdown", "metadata": {}, "source": [ "As the model trained, it should have printed out progress messages. Most of these are the values of the various channels being monitored throughout training." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can use the print_monitor script to print the last monitoring entry of a saved model. By running it on \"mlp_best.pkl\", we can see the performance of the model at the point where it did the best on the validation set." ] }, { "cell_type": "code", "collapsed": false, "input": [ "!print_monitor.py mlp_best.pkl | grep test_y_misclass" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "Using gpu device 2: GeForce GTX 285\r\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "/u/goodfeli/pylearn2/models/mlp.py:36: UserWarning: MLP changing the recursion limit.\r\n", " warnings.warn(\"MLP changing the recursion limit.\")\r\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "test_y_misclass : 0.0193999987096\r\n" ] } ], "prompt_number": 4 }, { "cell_type": "markdown", "metadata": {}, "source": [ "The test set error has dropped to 1.94%! This is a big improvement over softmax regression." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Another common way of analyzing trained models is to look at their weights. Here we use the show_weights script to visualize $W$:" ] }, { "cell_type": "code", "collapsed": false, "input": [ "!show_weights.py mlp_best.pkl" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "Using gpu device 0: GeForce GTX 285\r\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "making weights report\r\n", "loading model\r\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "loading done\r\n", "loading dataset...\r\n", "...done\r\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "smallest enc weight magnitude: 0.0\r\n", "mean enc weight magnitude: 0.0409141770966\r\n", "max enc weight magnitude: 4.76068\r\n", "min norm: 2.15468\r\n", "mean norm: 4.09429199219\r\n", "max norm: 6.53184\r\n" ] } ], "prompt_number": 5 }, { "cell_type": "markdown", "metadata": {}, "source": [ "#Part 3 A deeper MLP, and pylearn2 polymorphism" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "So far in these tutorials, there has not been much benefit to using pylearn2, rather than some other machine learning library, or even just an implementation of softmax regression or an MLP without an accompanying library.\n", "\n", "Now it's time to see some of why pylearn2 is useful. We're going to make several changes to our experimental setup, while still re-using most of the code. The beauty of pylearn2 is that it is built from interchangeable parts, so that if you want to create a new machine learning experiment, you don't need to rewrite the whole experiment from scratch.\n", "\n", "We're going to take the MLP example above and change it in three major ways:\n", "\n", "-Instead of training just a two layer MLP, we'll train a three layer MLP. We can do this just by putting one more layer in the \"layers\" list. We don't need to change the training algorithm or the main MLP model.\n", "\n", "-Instead of using the Sigmoid Layer class, we'll use a different kind of layer, called a rectified linear layer. The rectified linear layer uses the usual affine function $z = x^T W + b$ to compute the presynaptic inputs, then passes each element of $z$ through the function $g(z) = \\mathbb{I}_{z > 0} z$. In other words, values greater than 0 are left unchanged, while negative values are replaced with zeros. In pylearn2, we can do this just by loading a different class in the layers list. We don't need to change the training algorithm or the main MLP model.\n", "\n", "-Instead of optimizing the log likelihood using the nonlinear conjugate gradient descent algorithm, we will optimize it using a minibatch version of [stochastic gradient descent](http://en.wikipedia.org/wiki/Stochastic_gradient_descent). We can do this just by passing in a different TrainingAlgorithm object. No changes to the model or the code for the cost are needed.\n", "\n", "Here is the updated YAML description of the experiment:" ] }, { "cell_type": "code", "collapsed": false, "input": [ "import os\n", "import pylearn2\n", "path = os.path.join(pylearn2.__path__[0], 'scripts', 'tutorials', 'multilayer_perceptron', 'mlp_tutorial_part_3.yaml')\n", "with open(path, 'r') as f:\n", " train_2 = f.read()\n", "hyper_params = {'train_stop' : 50000,\n", " 'valid_stop' : 60000,\n", " 'dim_h0' : 500,\n", " 'dim_h1' : 1000,\n", " 'sparse_init_h1' : 15,\n", " 'max_epochs' : 10000,\n", " 'save_path' : '.'}\n", "train_2 = train_2 % (hyper_params)\n", "print train_2" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "!obj:pylearn2.train.Train {\n", " dataset: &train !obj:pylearn2.datasets.mnist.MNIST {\n", " which_set: 'train',\n", " start: 0,\n", " stop: 50000\n", " },\n", " model: !obj:pylearn2.models.mlp.MLP {\n", " layers: [ !obj:pylearn2.models.mlp.RectifiedLinear {\n", " layer_name: 'h0',\n", " dim: 500,\n", " sparse_init: 15\n", " }, !obj:pylearn2.models.mlp.RectifiedLinear {\n", " layer_name: 'h1',\n", " dim: 1000,\n", " sparse_init: 15\n", " }, !obj:pylearn2.models.mlp.Softmax {\n", " layer_name: 'y',\n", " n_classes: 10,\n", " irange: 0.\n", " }\n", " ],\n", " nvis: 784,\n", " },\n", " algorithm: !obj:pylearn2.training_algorithms.sgd.SGD {\n", " batch_size: 100,\n", " learning_rate: .01,\n", " monitoring_dataset:\n", " {\n", " 'train' : *train,\n", " 'valid' : !obj:pylearn2.datasets.mnist.MNIST {\n", " which_set: 'train',\n", " start: 50000,\n", " stop: 60000\n", " },\n", " 'test' : !obj:pylearn2.datasets.mnist.MNIST {\n", " which_set: 'test',\n", " }\n", " },\n", " learning_rule: !obj:pylearn2.training_algorithms.learning_rule.Momentum {\n", " init_momentum: .5\n", " },\n", " termination_criterion: !obj:pylearn2.termination_criteria.And {\n", " criteria: [\n", " !obj:pylearn2.termination_criteria.MonitorBased {\n", " channel_name: \"valid_y_misclass\",\n", " prop_decrease: 0.,\n", " N: 10\n", " },\n", " !obj:pylearn2.termination_criteria.EpochCounter {\n", " max_epochs: 10000\n", " }\n", " ]\n", " }\n", " },\n", " extensions: [ !obj:pylearn2.train_extensions.best_params.MonitorBasedSaveBest {\n", " channel_name: 'valid_y_misclass',\n", " save_path: \"mlp_2_best.pkl\"\n", " }, !obj:pylearn2.training_algorithms.learning_rule.MomentumAdjustor {\n", " start: 1,\n", " saturate: 10,\n", " final_momentum: .99\n", " }\n", " ]\n", "}\n" ] } ], "prompt_number": 6 }, { "cell_type": "markdown", "metadata": {}, "source": [ "This YAML config file also introduces another use of extensions to the Train object. Here, we add the MomentumAdjustor. It uses a callback to adjust the momentum setting of the SGD algorithm at the end of each epoch. Here, we configure it to start increasing the momentum after 1 epoch, and to continue increasing it until it reaches a value of .99 at the end of the tenth epoch. See the docstring for the SGD class for more information on what this momentum setting does." ] }, { "cell_type": "code", "collapsed": false, "input": [ "from pylearn2.config import yaml_parse\n", "train_2 = yaml_parse.load(train_2)\n", "train_2.main_loop()" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "Parameter and initial learning rate summary:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\th0_W: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\th0_b: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\th1_W: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\th1_b: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tsoftmax_b: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tsoftmax_W: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling sgd_update...\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling sgd_update done. Time elapsed: 2.516152 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "compiling begin_record_entry...\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "compiling begin_record_entry done. Time elapsed: 0.395491 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitored channels: \n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling accum...\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "graph size: 165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "graph size: 163\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "graph size: 163\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling accum done. Time elapsed: 11.563393 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.499999672174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23503017426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82356023788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06193947792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89326524734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98549389839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99438333511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80721712112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71524214745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80886650085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40815734863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97773504257\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 2.30258488655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.100000023842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.100000031292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.100000023842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.901999890804\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 2.30258488655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23505115509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82354259491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.0619494915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89324569702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98548007011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99438095093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80721092224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71524274349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80887794495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40813541412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97772955894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 2.30257916451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.100000545382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.100000545382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.100000545382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.901360213757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 2.30257916451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23503017426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82356023788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06193947792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89326524734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98549389839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99438333511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80721712112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71524214745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80886650085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40815734863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97773504257\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 2.30258488655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.100000023842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.100000031292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.100000023842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.90089994669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 2.30258488655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.343442 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 1\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 50000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.499999672174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23488473892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82359194756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06265735626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89264249802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98556685448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00163861282635\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99485731125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80723309517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71526324749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80893564224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40817546844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97778272629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.268750548363\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 0.645500898361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.596350252628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.520334303379\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999946475029\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.904475390911\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.38064879179\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0812000110745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.268750548363\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.17966529727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.0518538914621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000149252169649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23488473892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82361268997\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06266713142\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89267301559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98556661606\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.001638607122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99485683441\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80721235275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71525621414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80892753601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.4081993103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97776818275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.264730095863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 0.645499527454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.596347033978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.520334303379\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999963521957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.899078428745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.361695259809\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0793600603938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.264730095863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.179665282369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.051854070276\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000149251762195\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23488473892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82359194756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06265735626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89264249802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98556685448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00163861282635\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99485731125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80723309517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71526324749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80893564224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40817546844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97778272629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.252131432295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 0.645500898361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.596350252628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.520334303379\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999965012074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.907301902771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.362495720387\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0754000097513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.252131432295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.17966529727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.0518538914621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000149252169649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.325040 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 2\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 1000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 100000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.554444551468\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.2346944809\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82387781143\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06334352493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89264249802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98581314087\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00337248062715\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99546384811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80735421181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71530222893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80887699127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40835094452\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97777676582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.209201917052\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 0.849824726582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.752399742603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.648707330227\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999981224537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.928354024887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.417280673981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0621000118554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.209201917052\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.202846974134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.0668164640665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000276584294625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23466491699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82387685776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06333851814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89267301559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98582696915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.00337246293202\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99549293518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80733585358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71530234814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80891132355\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.4083533287\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97776651382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.192548781633\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 0.849820315838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.752397358418\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.648707211018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999981343746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.925991177559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.379428476095\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0572400614619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.192548781633\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.202847748995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.0668167173862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000276583392406\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.2346944809\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82387781143\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06334352493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89264249802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98581314087\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00337248062715\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99546384811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80735421181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71530222893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80887699127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40835094452\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97777676582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.201314240694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 0.849824726582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.752399742603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.648707330227\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999982595444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.93180680275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.40289413929\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0579000003636\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.201314240694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.202846974134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.0668164640665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000276584294625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.321143 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 3\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 1500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 150000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.608888924122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23464679718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82416844368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06404829025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89243221283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98607397079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00511313043535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99604940414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80747485161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71535277367\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80883836746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40852594376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97782230377\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.18524043262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.00719892979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.879001736641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.748181402683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999993741512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.939781844616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.445061296225\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0548000186682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.18524043262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.216917276382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.0788432434201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000395227049012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23464632034\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82414579391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06404733658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89245033264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98607373238\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.00511312671006\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99604892731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80745625496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71535873413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80887460709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40852594376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.9778380394\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.161898091435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.00719916821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.87899774313\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.748184919357\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999991238117\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.93733805418\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.405598640442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0483000576496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.161898091435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.216916337609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.0788431763649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000395228940761\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23464679718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82416844368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06404829025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89243221283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98607397079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00511313043535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99604940414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80747485161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71535277367\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80883836746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40852594376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97782230377\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.174453571439\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.00719892979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.879001736641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.748181402683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999995052814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.94245827198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.418575078249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0514000207186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.174453571439\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.216917276382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.0788432434201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000395227049012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.407873 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 4\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 2000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 200000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.663333714008\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23483276367\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82449483871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06498026848\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89247989655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98636126518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00637936964631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99670314789\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80761146545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71540987492\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80886650085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40871572495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97799134254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.167924150825\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.14452064037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.995063841343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.840617954731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.99999588728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.946992635727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.455186247826\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0552000291646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.167924150825\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.23083357513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.08986672014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000483248528326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.2348651886\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82447862625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06498932838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89249992371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98634982109\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.00637934077531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99670362473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80763316154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71541762352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80887794495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40874290466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97797679901\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.138446286321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.1445235014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.995067954063\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.840613126755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999992251396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.945943057537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.423846125603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0430600605905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.138446286321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.230833858252\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.0898664072156\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000483250943944\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23483276367\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82449483871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06498026848\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89247989655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98636126518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00637936964631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99670314789\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80761146545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71540987492\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80886650085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40871572495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97799134254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.157675400376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.14452064037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.995063841343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.840617954731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999996602535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.949966013432\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.442742049694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.046300008893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.157675400376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.23083357513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.08986672014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000483248528326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.220654 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 5\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 2500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 250000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.717777192593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23521852493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82483482361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06603121758\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89207363129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98667144775\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00797319039702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99737501144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80774116516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71550190449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80892467499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40890693665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97820734978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.13814201951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.26785862446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 1.10942089558\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.9239538908\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999995410442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.953776538372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.461881011724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0431000031531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.13814201951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.258687496185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.10072222352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000603844528086\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23519468307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82483053207\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06602716446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89205408096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98667001724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0079732267186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99740314484\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80775809288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71549510956\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80892419815\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40891933441\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97820615768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.104295127094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.26785480976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 1.109421134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.923955321312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999992787838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.954641282558\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.442351669073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0312000326812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.104295127094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.258685946465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.100721813738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000603846099693\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23521852493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82483482361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06603121758\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89207363129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98667144775\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00797319039702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99737501144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80774116516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71550190449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80892467499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40890693665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97820734978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.136576414108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.26785862446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 1.10942089558\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.9239538908\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999996840954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.956140458584\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.448911756277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0386999994516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.136576414108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.258687496185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.10072222352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000603844528086\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.204515 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 6\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 3000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 300000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.772221684456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23541164398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82526040077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.0674469471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89197492599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98706746101\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00963484868407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.9978518486\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80790233612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71558940411\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80901002884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40913200378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97820520401\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.12612003088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.39495909214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 1.23315572739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 1.02864944935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999998807907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.961598396301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.503333091736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.040100004524\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.12612003088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.288501292467\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.112407810986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000765459961258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23538017273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82528162003\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.0674469471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89197683334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98705887794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.00963485334069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99787998199\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80790233612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.7155970335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80897331238\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40915393829\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97820544243\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0812869444489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.39496576786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 1.23315918446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 1.02865147591\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.99999409914\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.963725090027\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.476592302322\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0230800136924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0812869444489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.288501352072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.112407691777\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.00076545990305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23541164398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82526040077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.0674469471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89197492599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98706746101\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00963484868407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.9978518486\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80790233612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71558940411\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80901002884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40913200378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97820520401\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.127863824368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.39495909214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 1.23315572739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 1.02864944935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.964188098907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.480807334185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0376999974251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.127863824368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.288501292467\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.112407810986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000765459961258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.235264 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 7\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 3500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 350000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.826667308807\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23617553711\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82576131821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06955361366\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.8926115036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98752951622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.011014319025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99838781357\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.8080675602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71574032307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80883789062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40936756134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97880935669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.127731248736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.54538154602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 1.37167823315\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 1.13854420185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.9629342556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.519809484482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0402000173926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.127731248736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.32344275713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.125407382846\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000886962865479\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23615169525\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82577753067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06954622269\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89259195328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98751401901\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0110142948106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99837732315\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80804681778\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71573352814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80887413025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.4093914032\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97880387306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0784979835153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.54537415504\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 1.37168061733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 1.13854324818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.965206980705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.486533343792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0245000198483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0784979835153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.323444247246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.125407934189\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000886966707185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23617553711\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82576131821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06955361366\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.8926115036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98752951622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.011014319025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99838781357\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.8080675602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71574032307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80883789062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40936756134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97880935669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.126347467303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.54538154602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 1.37167823315\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 1.13854420185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999165535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.966301620007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.483229219913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0362999886274\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.126347467303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.32344275713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.125407382846\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000886962865479\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.324166 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 8\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 4000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 400000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.881111502647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23693847656\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.8264799118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.07238268852\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89200305939\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98819732666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0122548062354\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99879837036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80823135376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71583795547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80892133713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40960502625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97916102409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.121290750802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.74212527275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 1.55456089973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 1.29530310631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999284744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.970344901085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.541184604168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0355000011623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.121290750802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.393140137196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.142595127225\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.00119761796668\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23696804047\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82649302483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.07238888741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89202260971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98821163177\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0122548071668\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99882984161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80823636055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71583855152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80892324448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40962982178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.979159832\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0608208738267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.7421246767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 1.55455350876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 1.29530549049\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.97307318449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.52649885416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.018220026046\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0608208738267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.393138289452\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.142595857382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.00119762122631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23693847656\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.8264799118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.07238268852\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89200305939\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98819732666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0122548062354\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99879837036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80823135376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71583795547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80892133713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40960502625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97916102409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.120653524995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.74212527275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 1.55456089973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 1.29530310631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.971736133099\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.502751410007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0357999950647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.120653524995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.393140137196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.142595127225\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.00119761796668\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.219467 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 9\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 4500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 450000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.935554862022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23974847794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82828760147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.07858109474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89074993134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98990464211\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0139329638332\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00128126144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80823659897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71664977074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80959177017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40965270996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.98309516907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.133454963565\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 2.09113478661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 1.89531803131\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 1.55502259731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.972993254662\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.555838704109\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.03900000453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.133454963565\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.505987465382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.174324646592\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.00215850048698\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23972511292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82828736305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.07858753204\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89076900482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98989081383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0139330253005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00125265121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80825352669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.7166570425\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80962467194\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40965032578\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.98309373856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0678227543831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 2.09112644196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 1.8953114748\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 1.55502521992\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.976901352406\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.541133284569\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0215600207448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0678227543831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.505986630917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.174323886633\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.00215849909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23974847794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82828760147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.07858109474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89074993134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98990464211\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0139329638332\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00128126144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80823659897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71664977074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80959177017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40965270996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.98309516907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.14155356586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 2.09113478661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 1.89531803131\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 1.55502259731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.975651443005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.524011075497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0348999835551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.14155356586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.505987465382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.174324646592\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.00215850048698\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.242812 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 5000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 500000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.33813095093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.00221395493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23122644424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.13888168335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.13162064552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0540144480765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99460268021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.81764769554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72675585747\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80806827545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.42556667328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.22008705139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.242982923985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.86701011658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.50406503677\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.79116678238\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.970284223557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.494895517826\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0614000074565\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.242982923985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.25091540813\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.422105878592\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.00902531389147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.33812093735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.00221395493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23123693466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.13886117935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.13162612915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0540147125721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99457454681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.81765389442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.726749897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80803012848\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.42554092407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.2200820446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.216101527214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.86700248718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.50406646729\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.7911875248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.971834897995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.494699120522\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0546000786126\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.216101527214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.25092113018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.422105282545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.00902529340237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.33813095093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.00221395493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23122644424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.13888168335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.13162064552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0540144480765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99460268021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.81764769554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72675585747\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80806827545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.42556667328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.22008705139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.262977838516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.86701011658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.50406503677\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.79116678238\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.972873926163\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.484322339296\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0602999925613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.262977838516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.25091540813\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.422105878592\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.00902531389147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.246498 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 5500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 550000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34423732758\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.09757995605\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23610663414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.29168701172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.20701622963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0794842615724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99344968796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.83266830444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72617077827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.81531667709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.44732666016\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.22785973549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.149660229683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.28322935104\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.86907577515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.24763870239\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.971002280712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.500847101212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0448000095785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.149660229683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.53015840054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.458264380693\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0079955086112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.34425830841\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.09757804871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23611760139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.29168462753\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.20700359344\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0794841647148\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99343013763\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.83267450333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72616374493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.81534910202\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.44732189178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.22785782814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.115495532751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.2832069397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.86906385422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.24765825272\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.974365890026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.503006339073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0362600125372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.115495532751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.53016579151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.458266496658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.00799546111375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34423732758\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.09757995605\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23610663414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.29168701172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.20701622963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0794842615724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99344968796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.83266830444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72617077827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.81531667709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.44732666016\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.22785973549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.1691185534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.28322935104\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.86907577515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.24763870239\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.974966526031\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.529185950756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0438999943435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.1691185534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.53015840054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.458264380693\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0079955086112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.224365 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 6000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 600000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34843397141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.13394451141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23612523079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.36067008972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.23545217514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.111102260649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99360513687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.8399875164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72649633884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.9447259903\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.45721006393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.23267006874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.138930052519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.38853263855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.97749423981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.37515115738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.976369380951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.539442539215\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0395999997854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.138930052519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.5151270628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.468785196543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.00989222805947\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.34842920303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.13394021988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23612689972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.36069536209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.23545718193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.111102797091\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99360513687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.83997154236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72650408745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.94476556778\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.45718336105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.23268294334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0762413665652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.38851499557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.97747087479\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.37513685226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.980703771114\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.538486421108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0236600115895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0762413665652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.51513409615\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.46878734231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.00989221502095\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34843397141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.13394451141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23612523079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.36067008972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.23545217514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.111102260649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99360513687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.8399875164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72649633884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.9447259903\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.45721006393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.23267006874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.158047273755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.38853263855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.97749423981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.37515115738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.978621006012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.533575236797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0357999950647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.158047273755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.5151270628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.468785196543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.00989222805947\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.233253 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 13\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 6500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 650000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34697389603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.15769052505\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23618888855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.40273475647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.25405025482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.113349400461\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99226903915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.84424233437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.7265651226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.25644397736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.46302652359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.24811220169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.126156955957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.49813652039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.06592178345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.50360441208\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.983133792877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.586351394653\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0298999845982\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.126156955957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.57926058769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.477343022823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0155787682161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.34694576263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.15768814087\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23619389534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.40273189545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.25405526161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.113349400461\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99224901199\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.84425520897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72656738758\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.25643634796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.46304035187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.24809789658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0474301576614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.49815416336\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.06591844559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.5035943985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.986293017864\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.579336941242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0156600344926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0474301576614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.57926678658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.477343559265\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0155787058175\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34697389603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.15769052505\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23618888855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.40273475647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.25405025482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.113349400461\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99226903915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.84424233437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.7265651226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.25644397736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.46302652359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.24811220169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.136303275824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.49813652039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.06592178345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.50360441208\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.983997404575\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.568609714508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0302999857813\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.136303275824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.57926058769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.477343022823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0155787682161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.243910 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 14\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 7000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 700000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.3465590477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.17470979691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23621320724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.44742536545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.26748609543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.117137983441\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99374818802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.84760499001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.7263559103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.39470767975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.46778011322\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.26342630386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.107709117234\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.54377269745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.13376808167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.58503246307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.985660552979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.598270595074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0245999917388\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.107709117234\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.54413878918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.484508126974\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0144754517823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.346534729\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.17470979691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23620676994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.44738912582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.26749873161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.117138013244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99376821518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.84760093689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72634637356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.39471530914\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.46780490875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.26344394684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0289139077067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.54377365112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.13377904892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.58502912521\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.990230798721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.636234402657\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0095800133422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0289139077067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.54413354397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.484510302544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0144755160436\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.3465590477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.17470979691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23621320724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.44742536545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.26748609543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.117137983441\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99374818802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.84760499001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.7263559103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.39470767975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.46778011322\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.26342630386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.118425898254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.54377269745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.13376808167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.58503246307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.987525939941\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.608628451824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0258999839425\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.118425898254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.54413878918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.484508126974\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0144754517823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.231089 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 15\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 7500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 750000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34646034241\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.18901968002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23616552353\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.49371194839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.27877855301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.122728899121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.9948592186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.85039448738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72630560398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.49246692657\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.47177028656\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27335119247\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.120883144438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.61785268784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.21456623077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.61228704453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.985354423523\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.593527436256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0276999864727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.120883144438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.59560739994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.492057174444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0153611358255\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.34646320343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.18901586533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23617053032\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.49373817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.27876186371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.122729450464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99485731125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.8503715992\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72631311417\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.49246883392\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.47177219391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27336573601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0283282585442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.61785554886\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.21454381943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.61229038239\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.990546524525\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.649133205414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00910001061857\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0283282585442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.59561276436\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.492054820061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0153612047434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34646034241\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.18901968002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23616552353\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.49371194839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.27877855301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.122728899121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.9948592186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.85039448738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72630560398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.49246692657\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.47177028656\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27335119247\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.126225486398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.61785268784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.21456623077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.61228704453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.987080872059\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.583371043205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0265999827534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.126225486398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.59560739994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.492057174444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0153611358255\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.249726 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 16\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 8000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 800000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34652328491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.20311164856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23617291451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.52294111252\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.28994369507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.123597666621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99608755112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.85341596603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72634136677\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.52042388916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.47620201111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27072739601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.140668272972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.69501256943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.31268548965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.74868249893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.989543557167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.626976370811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0258999932557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.140668272972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.60322284698\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.500980615616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0168750006706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.34652090073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.20310306549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23617100716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.52291107178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.28993988037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.123597674072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99606466293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.85343289375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72633349895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.52042198181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.47621965408\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27073836327\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0259083565325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.69503641129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.31268262863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.74867868423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.993756473064\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.699871182442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0079400036484\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0259083565325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.6032307148\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.500979840755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0168750379235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34652328491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.20311164856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23617291451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.52294111252\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.28994369507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.123597666621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99608755112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.85341596603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72634136677\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.52042388916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.47620201111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27072739601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.140435069799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.69501256943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.31268548965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.74868249893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.990495383739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.633842229843\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0265999827534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.140435069799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.60322284698\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.500980615616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0168750006706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.211907 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 17\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 8500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 850000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34764194489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.21877479553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23619961739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.5714468956\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.30228757858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.13643656671\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99594020844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.85699319839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72638630867\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.61135101318\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.48117828369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27077460289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.152983635664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.81860494614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.40938711166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.81085681915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.990412473679\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.641472399235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0277999881655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.152983635664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.66027259827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.509944438934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0174780637026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.3476524353\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.21879482269\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23619699478\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.57147264481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.30230164528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.136435881257\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.9959692955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.85701036453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72638809681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.61137866974\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.48117685318\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27077269554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0280419886112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.81860494614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.40940761566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.81083345413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.993593096733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.69740664959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00842001195997\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0280419886112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.66027379036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.509946644306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0174781102687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34764194489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.21877479553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23619961739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.5714468956\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.30228757858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.13643656671\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99594020844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.85699319839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72638630867\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.61135101318\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.48117828369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27077460289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.156515717506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.81860494614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.40938711166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.81085681915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.991046726704\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.649928092957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0286999810487\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.156515717506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.66027259827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.509944438934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0174780637026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.213883 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 18\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 9000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 900000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34813308716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.2329621315\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23619866371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.60563611984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.31354284286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.142215177417\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99625921249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.86032938957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72629284859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.70863246918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.48595952988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27107739449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.1266990453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.94182395935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.48706197739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.85955810547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.991642594337\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.680797755718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0225999932736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.1266990453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.65575671196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.517508506775\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0219007991254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.34813261032\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.23297452927\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23619627953\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.6056265831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.31354165077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.142215907574\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99623250961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.86034679413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72628378868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.70865249634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.48598957062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27109384537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0143134472892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.94185161591\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.48704767227\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.85954427719\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.996097743511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.768372476101\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00466000149027\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0143134472892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.6557571888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.517506301403\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0219009146094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34813308716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.2329621315\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23619866371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.60563611984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.31354284286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.142215177417\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99625921249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.86032938957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72629284859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.70863246918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.48595952988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27107739449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.158007115126\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.94182395935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.48706197739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.85955810547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.99270170927\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.685421526432\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0256999861449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.158007115126\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.65575671196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.517508506775\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0219007991254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.216884 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 19\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 9500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 950000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.35075473785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.24279737473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23619127274\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.61569023132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.32117795944\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.160097524524\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99536848068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.86252450943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72685301304\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.74706554413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.48911523819\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27158546448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.128275766969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.00630426407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.54901790619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.95159053802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.992789447308\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.689596951008\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0208999924362\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.128275766969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.56810212135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.523332059383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0221748072654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.35075521469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.24279022217\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23619437218\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.61565685272\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.32117271423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.160097926855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99534845352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.86250782013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.7268614769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.74709033966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.48911237717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27158045769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0107667120174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.00630140305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.54901885986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.95157289505\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.996949017048\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.813183248043\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00347999692895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0107667120174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.56809437275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.523329675198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0221747960895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.35075473785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.24279737473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23619127274\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.61569023132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.32117795944\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.160097524524\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99536848068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.86252450943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72685301304\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.74706554413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.48911523819\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27158546448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.152880609035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.00630426407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.54901790619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.95159053802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.992956161499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.687586247921\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0238999892026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.152880609035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.56810212135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.523332059383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0221748072654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.381361 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 20\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 10000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1000000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.36764955521\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.25145339966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23608016968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.65068340302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.32794356346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.160930916667\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99686193466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.86456871033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72680532932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.77167224884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.49206733704\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27174091339\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.135456323624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.06686162949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.60846662521\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.02197170258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.992590069771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.687869131565\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0230999924242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.135456323624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.63880228996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.528553962708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0211624447256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.36767864227\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.25147294998\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23607754707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.65068531036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.32795858383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.160931810737\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.9968791008\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.86455130577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72680592537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.77168178558\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.49205350876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27172803879\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0139410560951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.06685829163\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.60847902298\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.02197313309\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.997198402882\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.82025551796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00411999737844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0139410560951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.63881158829\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.528555572033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0211624447256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.36764955521\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.25145339966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23608016968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.65068340302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.32794356346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.160930916667\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99686193466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.86456871033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72680532932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.77167224884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.49206733704\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27174091339\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.154028758407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.06686162949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.60846662521\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.02197170258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.993701696396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.705734312534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0234999880195\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.154028758407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.63880228996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.528553962708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0211624447256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.224501 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 21\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 10500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1050000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.36559724808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.25865936279\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.65287876129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.33374094963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.160923495889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.9981341362\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.866314888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72683930397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.78785800934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.49455070496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27166962624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.132553175092\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.10146903992\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.65123224258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.06749105453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.992962539196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.700105249882\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0216999929398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.132553175092\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.6686950922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.532644450665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0201863590628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.36559391022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.25863981247\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23606181145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.6528468132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.33372306824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.160924375057\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.9981341362\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.86631464958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.7268487215\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.78784656525\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.494576931\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27167153358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00576127693057\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.10144424438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.65123510361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.06749773026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998003363609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.865698575974\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00196000072174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00576127693057\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.66869258881\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.532643556595\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0201863981783\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.36559724808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.25865936279\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.65287876129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.33374094963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.160923495889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.9981341362\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.866314888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72683930397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.78785800934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.49455070496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27166962624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.149952054024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.10146903992\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.65123224258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.06749105453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.993861615658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.696114599705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0218999926001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.149952054024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.6686950922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.532644450665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0201863590628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.191485 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 22\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 11000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1100000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.37540435791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.26554250717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.68969488144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.33926701546\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.15927760303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99918460846\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.86793661118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72684121132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.80519104004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.49690055847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27168059349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.129877910018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.1563615799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.69634532928\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.04322528839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.993051469326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.701347351074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0222999919206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.129877910018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.71757590771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.536909937859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.019919058308\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.37537336349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.26554632187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23606181145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.68972921371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.33928227425\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.159278333187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99916362762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.86795496941\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72684931755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.80523300171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.4969124794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27169203758\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00547823868692\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.15638256073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.69631719589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.04325008392\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998302519321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.880661785603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00176000059582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00547823868692\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.71756851673\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.53690803051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0199191085994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.37540435791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.26554250717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.68969488144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.33926701546\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.15927760303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99918460846\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.86793661118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72684121132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.80519104004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.49690055847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27168059349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.151706501842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.1563615799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.69634532928\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.04322528839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.99382263422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.683702290058\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0223999917507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.151706501842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.71757590771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.536909937859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.019919058308\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.206554 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 23\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 11500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1150000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.38593149185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.27048826218\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.67957162857\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.34312343597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.159357041121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99570322037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.8691701889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72683918476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.81508731842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.49859952927\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27181625366\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.123887695372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.22244215012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.73378896713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.06025886536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.993882775307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.726153492928\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0201999936253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.123887695372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.69931674004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.540387809277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.020066447556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.38596725464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.27046966553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23606181145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.67954874039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.34311199188\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.159357577562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.9957318306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.86917424202\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72684860229\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.81507587433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.49862718582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27181768417\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00308265769854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.22247123718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.73379087448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.06026697159\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998538374901\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.894672214985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000919999612961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00308265769854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.69932484627\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.540388822556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0200663488358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.38593149185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.27048826218\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.67957162857\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.34312343597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.159357041121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99570322037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.8691701889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72683918476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.81508731842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.49859952927\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27181625366\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.14809820056\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.22244215012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.73378896713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.06025886536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.993686497211\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.684677302837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0215999912471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.14809820056\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.69931674004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.540387809277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.020066447556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.230241 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 24\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 12000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1200000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.392578125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.27436256409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.68859195709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.34622907639\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.159570723772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99895811081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.87013435364\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72682142258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.82981967926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.49993467331\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27214646339\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.123282536864\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.26617622375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.76239967346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.08875703812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.994056642056\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.738864719868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0195999927819\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.123282536864\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.71165382862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.542974531651\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0200950335711\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.39255237579\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.27436685562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23606181145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.68859434128\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.34621357918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.159569814801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99892854691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.8701300621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72681927681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.82980918884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.49992132187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27214837074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00190907681827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.26617431641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.76240110397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.08878278732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998930156231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.918284237385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000559999898542\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00190907681827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.71166217327\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.542971789837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0200951248407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.392578125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.27436256409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.68859195709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.34622907639\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.159570723772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99895811081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.87013435364\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72682142258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.82981967926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.49993467331\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27214646339\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.146879151464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.26617622375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.76239967346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.08875703812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.994406104088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.706291854382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0211999956518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.146879151464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.71165382862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.542974531651\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0200950335711\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.222738 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 25\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 12500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1250000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.4013338089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.27870225906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.69665718079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.34976291656\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.160002231598\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00171422958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.87124419212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72680687904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.85285282135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.50152254105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27291631699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.121946468949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.27880191803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.80026340485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.12123060226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.993581533432\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.695117354393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0199999921024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.121946468949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.76450884342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.546270668507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0209660548717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.40130519867\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.2786822319\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.69668722153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.34977436066\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.160001769662\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00171136856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.87122607231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.726806283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.85290527344\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.5015130043\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27290010452\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0036760433577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.27877187729\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.80025196075\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.12123060226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998859524727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.912291646004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00121999997646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0036760433577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.76451909542\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.546273350716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0209659561515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.4013338089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.27870225906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.69665718079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.34976291656\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.160002231598\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00171422958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.87124419212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72680687904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.85285282135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.50152254105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27291631699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.137758076191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.27880191803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.80026340485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.12123060226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.994390308857\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.728678107262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.019999993965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.137758076191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.76450884342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.546270668507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0209660548717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.272793 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 26\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 13000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1300000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.4121389389\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.28374528885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.71324443817\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.35392951965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.1600792557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00099658966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.87249565125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72674298286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.85911655426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.50325918198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27451777458\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.148935392499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.33092308044\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.83676052094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.21046447754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.993810713291\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.718041598797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0221999920905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.148935392499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.7590252161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.54948079586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.020847639069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.41210317612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.2837562561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.71320962906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.35394501686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.16007861495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00099611282\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.87251186371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72674548626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.85914611816\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.50324678421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27453041077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00680599268526\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.33095264435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.83674097061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.21046924591\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.99815505743\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.87034368515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00213999999687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00680599268526\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.75903534889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.549481749535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0208476502448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.4121389389\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.28374528885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.71324443817\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.35392951965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.1600792557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00099658966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.87249565125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72674298286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.85911655426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.50325918198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27451777458\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.157335549593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.33092308044\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.83676052094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.21046447754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.994030356407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.726344525814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0226999893785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.157335549593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.7590252161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.54948079586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.020847639069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.208633 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 27\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 13500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1350000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.41813564301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.28969669342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.7286157608\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.35873889923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.160087496042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00020074844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.87404108047\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72669911385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.87103843689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.50552749634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27386808395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.143524944782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.35547590256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.87758922577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.21483325958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.994994282722\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.740391731262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0209999959916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.143524944782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.73408651352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.5533670187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0205177664757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.41816806793\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.28971195221\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.72864484787\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.35872411728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.160087764263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00021934509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.87405753136\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72669124603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.87106800079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.50554513931\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27385210991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00366839556955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.3555059433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.87757110596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.21484279633\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998865902424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.908865869045\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00126000004821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00366839556955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.73407900333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.553368866444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0205178782344\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.41813564301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.28969669342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.7286157608\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.35873889923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.160087496042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00020074844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.87404108047\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72669911385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.87103843689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.50552749634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27386808395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.155297890306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.35547590256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.87758922577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.21483325958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.994454801083\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.73979562521\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0205999910831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.155297890306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.73408651352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.5533670187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0205177664757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.239587 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 28\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 14000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1400000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.42320108414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.29595088959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.73588323593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.36365532875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.160095050931\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00109481812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.87561798096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72673380375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.90102100372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.50783443451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27579259872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.176090538502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.37317848206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.91372203827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.26935434341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.994395077229\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.743200361729\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0221999939531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.176090538502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.72095572948\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.556442499161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0208181608468\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.4232301712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.29595375061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.73585557938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.36363792419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.160095304251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00107383728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.87561368942\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72674226761\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.90106678009\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.50785970688\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27577996254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00485403602943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.37316846848\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.91373300552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.26935815811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998713254929\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.896820962429\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00136000022758\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00485403602943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.72096157074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.556439995766\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0208181329072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.42320108414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.29595088959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.73588323593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.36365532875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.160095050931\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00109481812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.87561798096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72673380375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.90102100372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.50783443451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27579259872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.183195546269\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.37317848206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.91372203827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.26935434341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.994852602482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.74536216259\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0237999893725\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.183195546269\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.72095572948\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.556442499161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0208181608468\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.306142 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 29\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 14500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1450000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.45381164551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.30269384384\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.74906110764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.36890244484\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.159244820476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00183820724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.87737250328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.7269256115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.89922237396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.51038217545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27727627754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.158995479345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.38246154785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.95248889923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.29096841812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.994712769985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.747330605984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0207999963313\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.158995479345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.74560809135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.559956371784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0206812545657\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.45380783081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.3027176857\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.74909591675\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.36888813972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.159244179726\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00187015533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.87737822533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72692549229\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.89921569824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.51035165787\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27729272842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00499874725938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.38246393204\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.9525179863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.29098033905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998843669891\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.907702028751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00154000031762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00499874725938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.7455984354\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.559955894947\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0206812303513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.45381164551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.30269384384\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.74906110764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.36890244484\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.159244820476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00183820724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.87737250328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.7269256115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.89922237396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.51038217545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27727627754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.161353841424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.38246154785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.95248889923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.29096841812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995362341404\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.764035582542\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0211999919266\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.161353841424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.74560809135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.559956371784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0206812545657\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.264931 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 30\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 15000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1500000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.45126152039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.30855321884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.77185153961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.37364006042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.159440949559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00142860413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.8789036274\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72696387768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.92525005341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.5125746727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27923321724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.159945309162\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.50855636597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.9870095253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.30891561508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.995383441448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.755910158157\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0218999926001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.159945309162\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.7809484005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.563234627247\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0199234094471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.45129537582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.30855226517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.77182006836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.37362527847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.159441739321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00145721436\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.87892222404\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72697114944\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.92523765564\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.5125579834\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27921772003\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0052194846794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.50858449936\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.98699235916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.3088889122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998774111271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.904954195023\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00160000030883\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0052194846794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.78094053268\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.56323415041\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0199234373868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.45126152039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.30855321884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.77185153961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.37364006042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.159440949559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00142860413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.8789036274\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72696387768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.92525005341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.5125746727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27923321724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.172797784209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.50855636597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.9870095253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.30891561508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995368361473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.741488099098\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0201999936253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.172797784209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.7809484005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.563234627247\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0199234094471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.279603 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 31\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 15500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1550000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.45977544785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.31496477127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605561256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.77787017822\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.37872552872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.167061835527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00070905685\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88056731224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.7269756794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.94437408447\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.51490449905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27992272377\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.131766811013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.49069547653\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.01968860626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.32379293442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.99406349659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.709186255932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0214999895543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.131766811013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.75881135464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.566387176514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0195109490305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.45976924896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.31498289108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.77783346176\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.37874174118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.167062133551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00073814392\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.88058972359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72698163986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.94434833527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.51487779617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27992391586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00692026689649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.49070358276\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.01966762543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.323802948\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.99833124876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.877075016499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00206000055186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00692026689649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.7588135004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.566390037537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0195109229535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.45977544785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.31496477127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605561256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.77787017822\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.37872552872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.167061835527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00070905685\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88056731224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.7269756794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.94437408447\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.51490449905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27992272377\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.161748409271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.49069547653\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.01968860626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.32379293442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.994541585445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.741445958614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0221999902278\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.161748409271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.75881135464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.566387176514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0195109490305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.251266 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 32\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 16000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1600000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.45842170715\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.32045173645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605561256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.78466415405\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.38315415382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.16744081676\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00018596649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88205099106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72608160973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.9562330246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.51705217361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28056788445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.156137660146\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.55750894547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.04845666885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.33018064499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.995250225067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.769113063812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0210999939591\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.156137660146\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.7797113657\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.568675458431\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0223224461079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.45844841003\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.32046604156\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.7846736908\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.3831589222\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.167441576719\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00020599365\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.88205075264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.7260876894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.9562292099\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.51702356339\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.280554533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00448899809271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.55747938156\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.0484457016\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.33017015457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998964965343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.915260314941\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0013400001917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00448899809271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.77971935272\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.568675458431\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0223225466907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.45842170715\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.32045173645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605561256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.78466415405\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.38315415382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.16744081676\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00018596649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88205099106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72608160973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.9562330246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.51705217361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28056788445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.185146003962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.55750894547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.04845666885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.33018064499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995594918728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.771956503391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0222999881953\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.185146003962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.7797113657\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.568675458431\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0223224461079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.265816 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 33\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 16500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1650000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.48042154312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.32581949234\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605561256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.79249668121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.38737988472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.167504921556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.0035238266\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88333916664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72610199451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.94651126862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.51890897751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28360319138\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.142962425947\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.59494447708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.06826543808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.36811923981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.995299935341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.757121562958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0198999904096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.142962425947\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.8589527607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.570496380329\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0232647489756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.48045063019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.32584047318\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.79252815247\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.38736534119\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.167504131794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00354385376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.88335561752\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72609436512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.94646167755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.51891183853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28361749649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00277355127037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.59491348267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.06824493408\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.36814403534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999049842358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.921933472157\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000999999581836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00277355127037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.85895049572\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.570495426655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0232646763325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.48042154312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.32581949234\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605561256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.79249668121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.38737988472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.167504921556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.0035238266\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88333916664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72610199451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.94651126862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.51890897751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28360319138\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.179574415088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.59494447708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.06826543808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.36811923981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995453417301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.75123167038\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0197999905795\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.179574415088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.8589527607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.570496380329\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0232647489756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.231476 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 34\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 17000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1700000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.4917049408\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.33141994476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.79732465744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.39186024666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171120882034\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00534772873\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88460206985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72610270977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.96625423431\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.52066421509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28276824951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.141110450029\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.61644887924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.09203910828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.40572547913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.994820356369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.726503133774\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0200999956578\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.141110450029\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.85092616081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.572713196278\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0240506455302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.49167537689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.33143472672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.79731702805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.39186143875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171120166779\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00534725189\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.88458299637\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72609496117\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.9662437439\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.52065134048\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28278303146\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00290546845645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.61642169952\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.09206676483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.40573072433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999073982239\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.924475312233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000939999590628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00290546845645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.85091614723\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.572711467743\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0240505319089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.4917049408\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.33141994476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.79732465744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.39186024666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171120882034\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00534772873\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88460206985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72610270977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.96625423431\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.52066421509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28276824951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.162981122732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.61644887924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.09203910828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.40572547913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995312690735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.743762373924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0194999910891\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.162981122732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.85092616081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.572713196278\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0240506455302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.214131 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 35\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 17500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1750000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.49574804306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.3364033699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.8160161972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.39588427544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171171665192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00441598892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88574457169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72610199451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.98808574677\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.52225542068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28273797035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.170048907399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.62913417816\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.11489725113\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.41416931152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.994616866112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.73312073946\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0217999909073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.170048907399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.85863983631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.574832618237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0238261986524\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.49571895599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.33637952805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605918884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.81597948074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.39588832855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171171709895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00439691544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.88574552536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72609436512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.98807621002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.52225255966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28275132179\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00725457724184\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.62916135788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.11490011215\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.41417980194\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998784661293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.90457379818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00184000050649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00725457724184\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.85864841938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.574829816818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0238260868937\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.49574804306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.3364033699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.8160161972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.39588427544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171171665192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00441598892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88574457169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72610199451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.98808574677\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.52225542068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28273797035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.188135892153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.62913417816\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.11489725113\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.41416931152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.99530762434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.754189014435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0216999892145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.188135892153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.85863983631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.574832618237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0238261986524\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.284179 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 36\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 18000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1800000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.50911712646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.34344434738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.84686803818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.40156388283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171174243093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00547456741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88733744621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72609961033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.016705513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.5244436264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28328037262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.147451668978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.66465806961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.14104557037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.43022489548\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.994985222816\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.730050563812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0206999927759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.147451668978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.78328752518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.577396690845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.025094171986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.50908374786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.34342718124\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605918884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.8468914032\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.40154623985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171174883842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00550603867\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.8873193264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72609198093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.0167131424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.52441453934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28326916695\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00539966486394\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.66468572617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.14102125168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.43022203445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.99889010191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.915294647217\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00152000051457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00539966486394\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.78329563141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.57739341259\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0250942651182\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.50911712646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.34344434738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.84686803818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.40156388283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171174243093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00547456741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88733744621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72609961033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.016705513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.5244436264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28328037262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.161581993103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.66465806961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.14104557037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.43022489548\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995217263699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.752208411694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0202999934554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.161581993103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.78328752518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.577396690845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.025094171986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.277391 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 37\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 18500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1850000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.51882982254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.34898805618\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.86316585541\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.40600013733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171176031232\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00360631943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88884663582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72619795799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.0371131897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.526512146\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28363656998\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.174357533455\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.70250511169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.17451667786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.43355512619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.995144307613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.754079401493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0214999951422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.174357533455\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.83495354652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.580399692059\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0246269144118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.51883935928\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.34899139404\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.86313438416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.40601491928\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171176567674\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00361680984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.88884592056\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72620582581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.03706741333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.52653741837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28362202644\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00331209623255\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.70247983932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.17454624176\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.43355798721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999139487743\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.931698381901\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000979999545962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00331209623255\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.83494448662\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.580400049686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0246269479394\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.51882982254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.34898805618\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.86316585541\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.40600013733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171176031232\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00360631943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88884663582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72619795799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.0371131897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.526512146\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28363656998\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.164556577802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.70250511169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.17451667786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.43355512619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995738983154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.76286149025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0205999910831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.164556577802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.83495354652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.580399692059\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0246269144118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.300500 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 38\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 19000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1900000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.52381372452\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.35216140747\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.87646770477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.40848636627\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171177119017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00470304489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88970422745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72622287273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.0545091629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.52772140503\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28486537933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.16956473887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.70925521851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.2000246048\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.47072219849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.996227920055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.774923741817\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0192999932915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.16956473887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.87937033176\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.582399070263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0244527608156\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.52384281158\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.35217618942\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.87646818161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.40846681595\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171177104115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00473213196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.88968753815\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72621440887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.05449295044\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.52773332596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28484797478\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0016456496669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.70928049088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.20005607605\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.47074699402\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999532461166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.958807349205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000520000001416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0016456496669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.87937915325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.582397639751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0244527999312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.52381372452\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.35216140747\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.87646770477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.40848636627\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171177119017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00470304489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88970422745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72622287273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.0545091629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.52772140503\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28486537933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.174608826637\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.70925521851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.2000246048\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.47072219849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.996570110321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.792669534683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0185999963433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.174608826637\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.87937033176\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.582399070263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0244527608156\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.301847 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 39\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 19500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1950000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.52631568909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.35376691818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.87409830093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.40977239609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171177133918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00363349915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.89011406898\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72623074055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.06535053253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.52831077576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28474617004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.158702552319\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.72936153412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.2109913826\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.48157644272\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.995932340622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.764656722546\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0200999919325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.158702552319\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.87921774387\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.583407759666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.024447273463\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.52629041672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.35376310349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.87408828735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.40976953506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171177104115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00362253189\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.8901321888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72622382641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.06535148621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.52829360962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28472876549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00152394291945\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.7293639183\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.21102333069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.48156309128\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999768614769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.979155957699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000379999983124\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00152394291945\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.87921559811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.583409488201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0244472324848\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.52631568909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.35376691818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.87409830093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.40977239609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171177133918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00363349915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.89011406898\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72623074055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.06535053253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.52831077576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28474617004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.17522443831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.72936153412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.2109913826\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.48157644272\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.996479153633\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.788241684437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0187999941409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.17522443831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.87921774387\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.583407759666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.024447273463\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.268098 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 40\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 20000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 2000000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.53570699692\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.35643339157\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.86570596695\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.41193628311\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171177208424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00472784042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.89065885544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72635400295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.0626745224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.52905321121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28488898277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.16143476963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.73923158646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.22264146805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.52369451523\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.995911836624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.785954415798\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.019199995324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.16143476963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.85353505611\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.584432959557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0243270788342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.5357131958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.35641145706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.86573553085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.411921978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171177133918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00474691391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.89064121246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72634625435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.06272411346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.52907943726\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28490185738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00306967948563\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.73919677734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.22266340256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.52368307114\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999223351479\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.938300907612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00105999980588\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00306967948563\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.85352873802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.584433317184\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0243270788342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.53570699692\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.35643339157\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.86570596695\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.41193628311\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171177208424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00472784042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.89065885544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72635400295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.0626745224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.52905321121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28488898277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.182417109609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.73923158646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.22264146805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.52369451523\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.996435403824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.793238520622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0203999951482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.182417109609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.85353505611\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.584432959557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0243270788342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.294892 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 41\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 20500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 2050000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.5425863266\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.35914468765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.87823629379\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.41422724724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171178132296\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00586032867\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.89139056206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72638916969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.06592273712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.53010177612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28573608398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.158061608672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.74868965149\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.23669672012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.50828027725\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.995399415493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.739345610142\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0194999948144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.158061608672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.86322903633\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.585780024529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0242832899094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.54261350632\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.3591375351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.87820577621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.41424489021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171177610755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00583934784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.89137220383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72638905048\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.06593418121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.53011369705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28573846817\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00130198767874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.74868011475\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.23671960831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.50826644897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999629914761\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.966445803642\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000419999967562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00130198767874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.86323726177\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.585781753063\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0242832992226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.5425863266\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.35914468765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.87823629379\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.41422724724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171178132296\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00586032867\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.89139056206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72638916969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.06592273712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.53010177612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28573608398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.168345704675\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.74868965149\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.23669672012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.50828027725\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995861887932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.767153561115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0193999931216\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.168345704675\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.86322903633\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.585780024529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0242832899094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.283051 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 42\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 21000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 2100000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.54826259613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.36148118973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.87971019745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.41604399681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171194016933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00196123123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.89196276665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72636771202\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.06931400299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.53089809418\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28621292114\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.152915328741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.76382827759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.25065279007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.53469228745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.995481073856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.755885243416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0184999946505\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.152915328741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.87736725807\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.586914539337\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0246897321194\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.54823541641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.36147928238\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.87974071503\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.4160592556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171194061637\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00195074081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.8919467926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72637498379\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.06928443909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.53089904785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28621530533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00141110678669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.76386547089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.25062465668\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.5346660614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999635100365\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.967330634594\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000319999962812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00141110678669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.87736737728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.58691483736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0246896371245\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.54826259613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.36148118973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.87971019745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.41604399681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171194016933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00196123123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.89196276665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72636771202\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.06931400299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.53089809418\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28621292114\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.164742320776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.76382827759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.25065279007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.53469228745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.996081888676\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.769794583321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0189999956638\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.164742320776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.87736725807\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.586914539337\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0246897321194\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.293110 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 43\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 21500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 2150000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.55259990692\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.36336374283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.8740735054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.41756176949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.17119500041\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.0039639473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.89240264893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72636425495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.07901191711\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.53150510788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28636312485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.136897221208\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.77247095108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.26096439362\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.51252508163\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.995941281319\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.776527881622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0178999938071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.136897221208\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.87920343876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.587858736515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0247891973704\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.55262708664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.36338043213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.8740811348\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.41757678986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171194568276\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00393533707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.89241600037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72637200356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.07898330688\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.53153181076\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28636193275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00148291292135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.77250146866\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.26093387604\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.51249742508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999666690826\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.971082031727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000460000039311\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00148291292135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.87921154499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.58786034584\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0247890818864\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.55259990692\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.36336374283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.8740735054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.41756176949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.17119500041\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.0039639473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.89240264893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72636425495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.07901191711\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.53150510788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28636312485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.161794766784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.77247095108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.26096439362\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.51252508163\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995917260647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.753068387508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0201999936253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.161794766784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.87920343876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.587858736515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0247891973704\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.359274 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 44\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 22000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 2200000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.55098342896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.36544847488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.87497997284\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.41930341721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171195015311\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00462388992\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.89291667938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72640001774\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.07387065887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.53226518631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28615379333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.140558704734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.78662919998\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.26840209961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.52506113052\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.996500074863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.794377505779\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0174999963492\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.140558704734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.89163661003\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.58866494894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0248291995376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.5510134697\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.36544466019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.87498617172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.41928720474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171194568276\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00459194183\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.89290046692\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72639226913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.07389450073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.53226518631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28615093231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.000438805494923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.7865986824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.2684264183\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.52509069443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999836444855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.985349237919\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000159999981406\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.000438805494923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.89162778854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.588665127754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0248291157186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.55098342896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.36544847488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.87497997284\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.41930341721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171195015311\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00462388992\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.89291667938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72640001774\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.07387065887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.53226518631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28615379333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.157897502184\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.78662919998\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.26840209961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.52506113052\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995646238327\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.742088675499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0179999954998\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.157897502184\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.89163661003\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.58866494894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0248291995376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.258919 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 45\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 22500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 2250000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.55773639679\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.36757230759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.88162136078\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.42107534409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171194553375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00479459763\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.89360809326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72638893127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.08829307556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.53330039978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28643465042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.172753751278\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.79764652252\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.28485965729\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.55204916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.99615073204\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.77610886097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.020499991253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.172753751278\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.87029504776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.590070128441\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0248381886631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.55770730972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.36758470535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.8816576004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.4210703373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171194195747\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00480556488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.89361214638\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72638893127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.08830928802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.53328752518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28645133972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00231568375602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.79761791229\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.2848906517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.55205202103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999481022358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.955595433712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000539999979082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00231568375602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.87028670311\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.590068638325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0248383041471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.55773639679\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.36757230759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.88162136078\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.42107534409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171194553375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00479459763\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.89360809326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72638893127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.08829307556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.53330039978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28643465042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.17547737062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.79764652252\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.28485965729\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.55204916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995465695858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.7330275774\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.020799998194\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.17547737062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.87029504776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.590070128441\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0248381886631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.263050 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 46\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 23000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 2300000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.59422492981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.37052488327\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.8726644516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.42359375954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171194955707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00406217575\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.89443039894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72642493248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.08111953735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.53444480896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28672647476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.176214575768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.79807567596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.29843473434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.56106996536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.996127128601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.767001569271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0188999976963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.176214575768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.88375401497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.591480791569\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0244950912893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.59419536591\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.37053442001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.87265539169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.42357826233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171194553375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00408983231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.89444637299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72643446922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.08109664917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.53442716599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28672146797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00163910887204\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.79804325104\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.29846715927\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.56109666824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999451816082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.952225148678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00061999988975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00163910887204\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.88374614716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.591483712196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0244949962944\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.59422492981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.37052488327\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.8726644516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.42359375954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171194955707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00406217575\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.89443039894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72642493248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.08111953735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.53444480896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28672647476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.186354964972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.79807567596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.29843473434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.56106996536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.99598556757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.759403705597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0206999909133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.186354964972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.88375401497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.591480791569\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0244950912893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.263870 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 47\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 23500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 2350000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.61253595352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.37271356583\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.87648153305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.425365448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.17119538784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00418663025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.8950676918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72642803192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.10107326508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.53528594971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28674340248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.160995185375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.79669380188\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.31103897095\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.58734273911\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.995669007301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.77006238699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0187999941409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.160995185375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.89035248756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.592762053013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0258602239192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.61253833771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.37270545959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.87647247314\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.42536139488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171194672585\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00415945053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.89505052567\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72643530369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.10108375549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.53529548645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28672790527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0021845579613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.79666471481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.31101417542\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.58734083176\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999446511269\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.954655766487\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000679999880958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0021845579613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.89036035538\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.59276509285\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0258601009846\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.61253595352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.37271356583\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.87648153305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.425365448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.17119538784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00418663025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.8950676918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72642803192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.10107326508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.53528594971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28674340248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.158408492804\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.79669380188\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.31103897095\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.58734273911\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995150506496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.737409770489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0196999944746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.158408492804\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.89035248756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.592762053013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0258602239192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.246123 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 48\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 24000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 2400000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.60942840576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.37416505814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.88673448563\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.42650437355\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171197414398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00638771057\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.89544963837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72642791271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.09871959686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.53591918945\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.2867603302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.175691723824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.78237819672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.3183298111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.59972047806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.996128737926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.775415062904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0199999921024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.175691723824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.88972866535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.593335032463\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0257790517062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.60943603516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.37415838242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.88672494888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.4265191555\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171197369695\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00641536713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.8954308033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72643482685\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.09872722626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.53590679169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28674817085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.000762883864809\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.78235006332\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.31833028793\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.59973287582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.99974834919\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.978080093861\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000239999950281\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.000762883864809\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.88971841335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.593334615231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0257790144533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.60942840576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.37416505814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.88673448563\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.42650437355\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171197414398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00638771057\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.89544963837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72642791271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.09871959686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.53591918945\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.2867603302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.178655579686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.78237819672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.3183298111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.59972047806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.996117174625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.773514211178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0190999954939\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.178655579686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.88972866535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.593335032463\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0257790517062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.274107 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 49\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 24500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 2450000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.61158514023\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.37596178055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.89095163345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.42802858353\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171208888292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00729322433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.89590859413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72634100914\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.11584568024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.53655290604\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28674292564\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.173922881484\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.80417919159\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.32538461685\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.59382343292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.995864152908\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.774653494358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0195999965072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.173922881484\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.90011572838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.593958258629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0259114392102\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.61158514023\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.37594175339\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.89095973969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.42801046371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171208947897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00726985931\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.89590215683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.7263327837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.11585617065\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.53655576706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28672790527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00186892366037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.80421066284\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.32541131973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.59379386902\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999438583851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.950516223907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000539999979082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00186892366037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.90012443066\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.59395968914\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.025911314413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.61158514023\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.37596178055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.89095163345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.42802858353\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171208888292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00729322433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.89590859413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72634100914\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.11584568024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.53655290604\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28674292564\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.167324125767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.80417919159\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.32538461685\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.59382343292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995694279671\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.751230061054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0211999900639\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.167324125767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.90011572838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.593958258629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0259114392102\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.276921 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 50\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 25000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 2500000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.61482906342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.37731599808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.90527057648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.42910242081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171211406589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.01254796982\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.89633321762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72635316849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.1068277359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.53717756271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28689336777\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.178737580776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.81128787994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.33507156372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.58309650421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.99630522728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.788845181465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0197999924421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.178737580776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.93474268913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.594771564007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0260054916143\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.6148557663\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.37733840942\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.90530347824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.42908787727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171211794019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.01251840591\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.89634943008\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72634553909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.10683345795\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.53719091415\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28687477112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00155572697986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.81132364273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.33503913879\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.58306837082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999542534351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.959059894085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000539999920875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00155572697986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.93475210667\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.594768106937\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0260053742677\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.61482906342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.37731599808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.90527057648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.42910242081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171211406589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.01254796982\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.89633321762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72635316849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.1068277359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.53717756271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28689336777\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.168507456779\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.81128787994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.33507156372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.58309650421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.996147751808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.789148688316\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0197999924421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.168507456779\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.93474268913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.594771564007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0260054916143\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.200028 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 51\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 25500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 2550000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.6147813797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.37828779221\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.90187358856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.42986750603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171211406589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.0115852356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.89659976959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72635293007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.1057882309\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.53757143021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28781795502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.172010108829\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.82110786438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.33999061584\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.59692811966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.996686458588\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.808368086815\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0198999941349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.172010108829\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.93597054482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.595229923725\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0260351337492\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.61475372314\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.37829828262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.9019112587\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.42988300323\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171211794019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.01156425476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.89659571648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72634553909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.10573482513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.53757476807\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28780126572\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00100987718906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.8211388588\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.34001255035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.59689760208\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999795496464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.98121035099\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000219999958063\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00100987718906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.93596208096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.59522998333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0260351262987\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.6147813797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.37828779221\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.90187358856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.42986750603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171211406589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.0115852356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.89659976959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72635293007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.1057882309\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.53757143021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28781795502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.175070494413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.82110786438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.33999061584\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.59692811966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.996282696724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.780044913292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0196999944746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.175070494413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.93597054482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.595229923725\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0260351337492\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.239240 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 52\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 26000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 2600000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.61600589752\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.37898588181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.90484142303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.43044447899\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171211466193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.01123189926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.8968091011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72635233402\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.11070537567\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.53788709641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28822088242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.160425424576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.80656099319\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.34523868561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.59447908401\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.996790707111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.826726913452\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0184999965131\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.160425424576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.94036662579\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.595700562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0263105537742\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.61604356766\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.37900781631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.9048409462\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.43045806885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171212136745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.01124334335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.89682626724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72634339333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.11072158813\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.53790187836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28823471069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.000158851937158\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.8065943718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.34526729584\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.59449052811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999920845032\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.992827177048\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 7.9999997979e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.000158851937158\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.94036877155\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.595700562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0263105835766\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.61600589752\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.37898588181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.90484142303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.43044447899\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171211466193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.01123189926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.8968091011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72635233402\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.11070537567\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.53788709641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28822088242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.169489264488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.80656099319\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.34523868561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.59447908401\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.996821761131\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.813496589661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0197999961674\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.169489264488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.94036662579\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.595700562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0263105537742\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.259741 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 53\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 26500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 2650000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.6160197258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.3792681694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.90263414383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.43065404892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171211466193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.01123523712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.89689803123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72635245323\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.11182498932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.53798723221\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.2883348465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.151598215103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.82387685776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.34804153442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.58777189255\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.99653673172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.809294104576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0181999951601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.151598215103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.94308698177\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.595957636833\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0262990482152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.61604738235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.3792719841\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.9026427269\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.43063807487\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171212136745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.01124382019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.89692115784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72634339333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.11186790466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.53798723221\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28835225105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.000210020065424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.82384681702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.348072052\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.58779907227\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999953627586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.996000170708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 5.99999984843e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.000210020065424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.94309675694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.595957219601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0262989122421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.6160197258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.3792681694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.90263414383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.43065404892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171211466193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.01123523712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.89689803123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72635245323\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.11182498932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.53798723221\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.2883348465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.163225889206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.82387685776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.34804153442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.58777189255\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.996884763241\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.818299531937\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0186999943107\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.163225889206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.94308698177\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.595957636833\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0262990482152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.224364 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 54\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 27000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 2700000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.61593580246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.37931966782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.90164899826\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.43070554733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171211466193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.01123189926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.89690995216\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72635293007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.10886287689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.53801727295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28835773468\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.156616300344\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.82711935043\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.34913825989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.58710432053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.996679246426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.821564376354\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0183999948204\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.156616300344\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.94326412678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.596061944962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0262778773904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.61593151093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.37929821014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.90168523788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.43071746826\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171212136745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.01124286652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.89692831039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72634553909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.10885238647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.53799200058\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28836083412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 1.18671387099e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.82711696625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.34910583496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.5871014595\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999985456467\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.999015629292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 1.18671387099e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.94327509403\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.596063792706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0262779761106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.61593580246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.37931966782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605632782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.90164899826\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.43070554733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171211466193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.01123189926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.89690995216\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72635293007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.10886287689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.53801727295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28835773468\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.168142601848\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.82711935043\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.34913825989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.58710432053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.997302770615\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.829375386238\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0184999927878\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.168142601848\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.94326412678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.596061944962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0262778773904\n" ] } ], "prompt_number": 7 }, { "cell_type": "code", "collapsed": false, "input": [ "!print_monitor.py mlp_2_best.pkl | grep test_y_misclass" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "Using gpu device 2: GeForce GTX 285\r\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "/u/goodfeli/pylearn2/models/mlp.py:36: UserWarning: MLP changing the recursion limit.\r\n", " warnings.warn(\"MLP changing the recursion limit.\")\r\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "test_y_misclass : 0.0174999963492\r\n" ] } ], "prompt_number": 8 }, { "cell_type": "markdown", "metadata": {}, "source": [ "Using the deeper architecture, rectifier units, and SGD brought the test error rate down from 1.94% to 1.75%." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Part 4: Regularization and pylearn2 costs\n", "\n", "In softmax_regression.ipynb, we discussed the problem of overfitting, and how early stopping guided by validation set performance can result in better test set performance. Another way to prevent overfitting is to explicitly change the cost function to discourage overfitting.\n", "\n", "The best way to prevent overfitting is to use Bayesian inference to predict labels on the new data. Suppose we have been given a dataset $\\mathcal{D}$, and we want to classify a new point $x'$. Call its uknown label $y'$. Suppose that we also have a probability distribution over all possible model parameters, and that we call the set of all parameters $\\theta$. Then\n", "\n", "$$p(y' \\mid x', \\mathcal{D} ) = \\int p(y', \\theta \\mid x', \\mathcal{D}) d \\theta $$\n", "\n", "$$ = \\int p( y' \\mid x' , \\theta ) p( \\theta \\mid \\mathcal{D} ) d \\theta $$\n", "\n", "$$ \\propto \\int p( y' \\mid x' , \\theta ) p( \\mathcal{D} \\mid \\theta ) p(\\theta) d \\theta $$\n", "\n", "(On the last line, we only worry about computing the distribution over $y'$ up to a constant, because we can easily find this constant by summing over the $k$ possible values of $y'$)\n", "\n", "In other words, the right thing to do is to have all of the infinitely many possible values of $\\theta$ vote on how to classify $x'$, with each value of $\\theta$'s vote weighted by $p(\\theta) p(\\mathcal{D} \\mid \\theta)$.\n", "\n", "Unfortunately, while conceptually straight forward, there is not an obvious way to evaluate this integral for a large multilayer perceptron. Instead, we assume that the distribution $p(\\theta) p(\\mathcal{D} \\mid \\theta)$ is very peaked, so that we can get a good prediction by using the single most likely value of $\\theta$.\n", "\n", "This suggests that we should maximize $p(\\theta) p(\\mathcal{D} \\mid \\theta)$, rather than maximizing $p(\\mathcal{D} \\mid \\theta)$ as we have so far. Note that in log space, this is $\\log p(\\theta) + \\log p( \\mathcal{D} \\mid \\theta)$. We can thus add regularization to our training procedure by adding a term for $\\log p(\\theta)$ to our objective function.\n", "\n", "This is very easy to do in pylearn2 using the SumOfCosts class. The following YAML string sets up the same experiment as before, but using SumOfCosts to add a regularization term. Before, we did not specify the \"cost\" argument to the training algorithm. The model provided the training algorithm with a default cost. Now, we specify that the cost should be the sum of two different costs. The first is the Default cost, which just asks the output layer what cost to use. This is the same cost we have implicitly been using all along, because models.mlp.MLP.get_default_cost() returns costs.mlp.Default(). The second term of our new cost function is called WeightDecay, and it implements a prior on our model parameters $\\theta$." ] }, { "cell_type": "code", "collapsed": false, "input": [ "import os\n", "import pylearn2\n", "path = os.path.join(pylearn2.__path__[0], 'scripts', 'tutorials', 'multilayer_perceptron', 'mlp_tutorial_part_4.yaml')\n", "with open(path, 'r') as f:\n", " train_3 = f.read()\n", "hyper_params = {'train_stop' : 50000,\n", " 'valid_stop' : 60000,\n", " 'dim_h0' : 500,\n", " 'dim_h1' : 1000,\n", " 'sparse_init_h1' : 15,\n", " 'max_epochs' : 10000,\n", " 'save_path' : '.'}\n", "train_3 = train_3 % (hyper_params)\n", "print train_3" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "!obj:pylearn2.train.Train {\n", " dataset: &train !obj:pylearn2.datasets.mnist.MNIST {\n", " which_set: 'train',\n", " start: 0,\n", " stop: 50000\n", " },\n", " model: !obj:pylearn2.models.mlp.MLP {\n", " layers: [ !obj:pylearn2.models.mlp.RectifiedLinear {\n", " layer_name: 'h0',\n", " dim: 500,\n", " sparse_init: 15\n", " }, !obj:pylearn2.models.mlp.RectifiedLinear {\n", " layer_name: 'h1',\n", " dim: 500,\n", " sparse_init: 15\n", " }, !obj:pylearn2.models.mlp.Softmax {\n", " layer_name: 'y',\n", " n_classes: 10,\n", " irange: 0.\n", " }\n", " ],\n", " nvis: 784,\n", " },\n", " algorithm: !obj:pylearn2.training_algorithms.sgd.SGD {\n", " batch_size: 100,\n", " learning_rate: .01,\n", " monitoring_dataset:\n", " {\n", " 'train' : *train,\n", " 'valid' : !obj:pylearn2.datasets.mnist.MNIST {\n", " which_set: 'train',\n", " start: 50000,\n", " stop: 60000\n", " },\n", " 'test' : !obj:pylearn2.datasets.mnist.MNIST {\n", " which_set: 'test',\n", " }\n", " },\n", " cost: !obj:pylearn2.costs.cost.SumOfCosts { costs: [\n", " !obj:pylearn2.costs.mlp.Default {\n", " }, !obj:pylearn2.costs.mlp.WeightDecay {\n", " coeffs: [ .00005, .00005, .00005 ]\n", " }\n", " ]\n", " },\n", " learning_rule: !obj:pylearn2.training_algorithms.learning_rule.Momentum {\n", " init_momentum: .5\n", " },\n", " termination_criterion: !obj:pylearn2.termination_criteria.And {\n", " criteria: [\n", " !obj:pylearn2.termination_criteria.MonitorBased {\n", " channel_name: \"valid_y_misclass\",\n", " prop_decrease: 0.,\n", " N: 10\n", " },\n", " !obj:pylearn2.termination_criteria.EpochCounter {\n", " max_epochs: 10000\n", " }\n", " ]\n", " }\n", " },\n", " extensions: [\n", " !obj:pylearn2.train_extensions.best_params.MonitorBasedSaveBest {\n", " channel_name: 'valid_y_misclass',\n", " save_path: \"mlp_3_best.pkl\"\n", " }, !obj:pylearn2.training_algorithms.learning_rule.MomentumAdjustor {\n", " start: 1,\n", " saturate: 10,\n", " final_momentum: .99\n", " }\n", " ]\n", "}\n", "\n" ] } ], "prompt_number": 9 }, { "cell_type": "markdown", "metadata": {}, "source": [ "The WeightDecay class adds a cost based on the sum of the squares of the elements of $W$ for the different layers, multiplying each by a different coefficient. This corresponds to $p(\\theta)$ being Gaussian distribution on $W$, with a diagonal covariance matrix. (We don't regularize $b$, which is a bit of a hack, but can be thought of as putting extremely high variance on $b$ in the prior) In other words, our prior belief about $\\theta$ is that the weights should be small. This basically says that, all else being equal, the different units in our network shouldn't interact with each other. Compared to the unregularized network, a network trained with weight decay wants to see more evidence that two units should interact before it allows them to do so.\n", "\n", "Note that the SumOfCosts class doesn't explicitly have anything to do with the MLP. There is no requirement that the cost function be closely tied to the code for a particular model in pylearn2. This gives you great flexibility in the kind of experiments pylearn2 can run. The SumOfCosts class allows you to combine several pre-existing building blocks in pylearn2. By implementing your own cost classes, you can get even greater flexibility.\n", "\n", "Of course, some costs are tightly integrated with a specific kind of model. The costs.mlp.Default cost expects to be able to ask a model for its last layer, and ask that layer what kind of cost to apply to the target values $y$ and an estimate of them produced by calling the model's fprop method. This implies that the cost can really only be used with MLP subclasses. Likewise, the WeightDecay cost depends on the assumption that the model is organized into layers and each layer has a single weight matrix. This means that it can only be used with an MLP,and even then only with layers that are governed by a weight matrix. It's OK to make a Cost that is this tightly integrated with a specific kind of model. Doing so is inevitable. Usually in pylearn2 we put the costs for a specific model family in their own submodule of pylearn2 so it's easy to tell what models they can be used with.\n", "\n", "We now show what happens when you train the regularized MLP:" ] }, { "cell_type": "code", "collapsed": false, "input": [ "from pylearn2.config import yaml_parse\n", "train_3 = yaml_parse.load(train_3)\n", "train_3.main_loop()" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "Parameter and initial learning rate summary:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\th0_W: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\th0_b: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\th1_W: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\th1_b: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tsoftmax_b: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tsoftmax_W: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling sgd_update...\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling sgd_update done. Time elapsed: 2.973035 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "compiling begin_record_entry...\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "compiling begin_record_entry done. Time elapsed: 0.457965 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitored channels: \n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling accum...\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "graph size: 171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "graph size: 169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "graph size: 169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling accum done. Time elapsed: 13.418733 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.499999672174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23503017426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82356023788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06193947792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89326524734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98549389839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99438333511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80721712112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71524214745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80886650085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40815734863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97773504257\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 3.4297709465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 2.30258488655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 1.12718772888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.100000023842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.100000031292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.100000023842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.901999890804\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 2.30258488655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23505115509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82354259491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.0619494915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89324569702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98548007011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99438095093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80721092224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71524274349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80887794495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40813541412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97772955894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 3.42977070808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 2.30257916451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 1.12718474865\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.100000545382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.100000545382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.100000545382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.901360213757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 2.30257916451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23503017426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82356023788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06193947792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89326524734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98549389839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99438333511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80721712112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71524214745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80886650085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40815734863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97773504257\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 3.4297709465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 2.30258488655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 1.12718772888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.100000023842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.100000031292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.100000023842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.90089994669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 2.30258488655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.310886 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 1\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 50000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.499999672174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.22863864899\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.81978034973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06060481071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.88668251038\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98259210587\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00163801340386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.98888349533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80343770981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71354997158\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80116271973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40278577805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97481369972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 1.39391481876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.268794178963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 1.12512099743\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 0.645387113094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.59630638361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.520404875278\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999945759773\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.904323577881\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.380515068769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0813000127673\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.268794178963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.179665878415\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.0518467575312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000148977691424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.2286696434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.81979823112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06059765816\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.88671255112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.9826066494\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.00163802062161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.9888548851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80346035957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71355748177\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80111694336\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40279817581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97482800484\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 1.38994812965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.264828205109\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 1.12512207031\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 0.645388245583\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.596305251122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.520407259464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.99996304512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.898920297623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.361467987299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0793600603938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.264828205109\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.179665371776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.0518467389047\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000148977618665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.22863864899\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.81978034973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06060481071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.88668251038\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98259210587\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00163801340386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.98888349533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80343770981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71354997158\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80116271973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40278577805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97481369972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 1.37731289864\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.252192467451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 1.12512099743\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 0.645387113094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.59630638361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.520404875278\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999964594841\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.907153248787\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.362326830626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0756999999285\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.252192467451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.179665878415\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.0518467575312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000148977691424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.343837 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 2\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 1000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 100000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.554444551468\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.22144937515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.81579256058\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.05898046494\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.88006973267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.9794948101\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00336797139607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.98277664185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.79929542542\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71166646481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.79234170914\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.3969039917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97146487236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 1.3320376873\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.209235101938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 1.12280321121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 0.849509298801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.752226889133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.648749351501\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999980688095\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.928127348423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.417017698288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0624000132084\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.209235101938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.202931031585\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.0667919442058\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.00027507453342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.22147130966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.81577634811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.0589826107\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.8800983429\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.9795088768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.00336798490025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.98279714584\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.7993118763\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71166646481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.79229545593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.39690923691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97145032883\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 1.31553328037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.192730411887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 1.12280583382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 0.849513113499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.752230584621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.648747861385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999980807304\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.925747811794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.379059791565\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0572400614619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.192730411887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.202931344509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.0667921230197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.00027507476625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.22144937515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.81579256058\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.05898046494\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.88006973267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.9794948101\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00336797139607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.98277664185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.79929542542\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71166646481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.79234170914\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.3969039917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97146487236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 1.32417428493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.201371654868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 1.12280321121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 0.849509298801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.752226889133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.648749351501\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999982237816\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.931577861309\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.40255895257\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0578999966383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.201371654868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.202931031585\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.0667919442058\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.00027507453342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.283221 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 3\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 1500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 150000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.608888924122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.21347379684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.81121587753\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.05705142021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.87235736847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.97595834732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00510276248679\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.97572278976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.79457330704\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.70953249931\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.78235435486\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.39019727707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.96771478653\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 1.30544030666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.185299769044\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 1.12013947964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.00650155544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.878560483456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.748090326786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999993503094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.939459979534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.444366723299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0547000169754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.185299769044\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.217191457748\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.0787876471877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000392778747482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.21344470978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.81123256683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.05706167221\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.87232971191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.97594833374\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.00510273734108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.97572278976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.79455709457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.70952439308\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.78239917755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.39017248154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.96771502495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 1.2823060751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.162165120244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 1.12014472485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.00650632381\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.878564417362\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.748090386391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999991178513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.93700414896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.404900848866\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0482200570405\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.162165120244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.21719174087\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.0787875503302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000392780813854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.21347379684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.81121587753\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.05705142021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.87235736847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.97595834732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00510276248679\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.97572278976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.79457330704\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.70953249931\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.78235435486\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.39019727707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.96771478653\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 1.29470717907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.174566537142\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 1.12013947964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.00650155544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.878560483456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.748090326786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999994695187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.942149102688\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.417711257935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.051200017333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.174566537142\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.217191457748\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.0787876471877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000392778747482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.301401 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 4\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 2000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 200000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.663333714008\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.20446586609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.80589365959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.05491876602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.86368274689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.97183966637\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00636858073995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.96751737595\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.78907322884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.70705342293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.77082681656\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.38239336014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.96349358559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 1.28483641148\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.167798668146\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 1.11703836918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.14337170124\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.994192421436\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.840292572975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999995589256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.946651279926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.454940706491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0549000278115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.167798668146\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.231142029166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.089763648808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000477136200061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.20444250107\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.80587768555\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.05492663383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.86367082596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.97184991837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.00636860262603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.96753835678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.7890689373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.70706069469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.77079200745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.38238239288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.96350455284\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 1.25564575195\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.138607770205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 1.11704432964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.14337110519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.994198083878\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.840297460556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999992132187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.945581674576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.42304289341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0431200563908\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.138607770205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.231140971184\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.0897636190057\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000477139052236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.20446586609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.80589365959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.05491876602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.86368274689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.97183966637\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00636858073995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.96751737595\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.78907322884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.70705342293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.77082681656\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.38239336014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.96349358559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 1.27460837364\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.157571211457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 1.11703836918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.14337170124\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.994192421436\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.840292572975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999996304512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.949614882469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.442067503929\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0465000085533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.157571211457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.231142029166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.089763648808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000477136200061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.266055 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 5\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 2500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 250000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.717777192593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.19388818741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.79951477051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.05230784416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.85298204422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.96690416336\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00795079302043\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.95764780045\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.78251552582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.70412421227\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.7571387291\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.37306642532\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.95853662491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 1.25132834911\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.138001933694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 1.11332631111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.26581287384\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 1.10778701305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.922472834587\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999994754791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.953354179859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.460847198963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0430000051856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.138001933694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.258754551411\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.100538700819\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000593058066443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.19387769699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.79953241348\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.05230736732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.85295391083\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.96689033508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0079507548362\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.95761966705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.78251123428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.70413899422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.75717258453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.37306880951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.95853638649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 1.21803998947\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.104714490473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 1.11332845688\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.26581907272\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 1.1077862978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.922471702099\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999992728233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.954178750515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.440906405449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0312400292605\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.104714490473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.258753240108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.100538358092\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000593057950027\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.19388818741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.79951477051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.05230784416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.85298204422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.96690416336\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00795079302043\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.95764780045\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.78251552582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.70412421227\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.7571387291\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.37306642532\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.95853662491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 1.24973428249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.136407867074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 1.11332631111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.26581287384\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 1.10778701305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.922472834587\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999996542931\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.955720424652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.447657436132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0386000014842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.136407867074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.258754551411\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.100538700819\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000593058066443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.281634 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 6\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 3000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 300000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.772221684456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.18053913116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.79164195061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.04931807518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.84014606476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.96080875397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00960826966912\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.94511365891\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.77440404892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.70048546791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.74020195007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.3615436554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.95202755928\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 1.23484170437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.126101091504\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 1.10874140263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.39184403419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 1.23041391373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 1.02565836906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999998748302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.961094081402\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.502607226372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0397000052035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.126101091504\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.288574844599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.112107351422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000744926044717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.18052864075\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.79166030884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.04932594299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.84012889862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.96080327034\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0096082771197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.94514036179\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.77440428734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.7004776001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.74021291733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.36155557632\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.9520175457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 1.19061946869\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.0818792134523\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 1.10874009132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.39184439182\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 1.2304173708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 1.02565360069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994039536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.963193774223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.475303918123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0230600107461\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0818792134523\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.288575559855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.112107902765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000744922028389\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.18053913116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.79164195061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.04931807518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.84014606476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.96080875397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00960826966912\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.94511365891\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.77440404892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.70048546791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.74020195007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.3615436554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.95202755928\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 1.23645818233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.127717524767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 1.10874140263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.39184403419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 1.23041391373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 1.02565836906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999998986721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.963711440563\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.479158580303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0373999997973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.127717524767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.288574844599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.112107351422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000744926044717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.285549 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 7\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 3500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 350000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.826667308807\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.16351413727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.78127264977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.04552721977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.82413673401\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.95279192924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0109715117142\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.92860794067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.7637283802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.69574940205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.71776247025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.34639310837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.94415974617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 1.2293548584\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.126640558243\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 1.1027148962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.53999233246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 1.36674308777\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 1.134085536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999998986721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.962450027466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.520037055016\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0400000177324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.126640558243\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.323384702206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.124884955585\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000862787244841\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.1635351181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.78129315376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.04552340508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.82410860062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.95280575752\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0109714772552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.92858171463\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.76370692253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.69575130939\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.71779823303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.34638214111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.94414997101\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 1.18144452572\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.0787304490805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 1.10271286964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.54000031948\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 1.36673867702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 1.13409137726\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994158745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.964662730694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.485619604588\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0242600161582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0787304490805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.323384910822\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.124885700643\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000862783577759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.16351413727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.78127264977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.04552721977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.82413673401\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.95279192924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0109715117142\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.92860794067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.7637283802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.69574940205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.71776247025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.34639310837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.94415974617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 1.22817146778\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.125456944108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 1.1027148962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.53999233246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 1.36674308777\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 1.134085536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.99999910593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.965774953365\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.481605708599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0360999889672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.125456944108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.323384702206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.124884955585\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000862787244841\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.275973 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 8\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 4000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 400000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.881111502647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.13874149323\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.76625037193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.03984022141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.79944992065\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.94116210938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0121828410774\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.90430831909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.74820208549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.68876981735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.68556308746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.32432985306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.93232631683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 1.21413767338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.12014952302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 1.09398806095\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.73185801506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 1.54484415054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 1.28760778904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999284744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.969546198845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.53670758009\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0355999991298\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.12014952302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.390541791916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.141607090831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.00119230698328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.13874340057\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.76626849174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.03984594345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.79946660995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.94116210938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0121827786788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.90427827835\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.74818611145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.68877720833\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.68560028076\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.32434654236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.93231272697\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 1.15510380268\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.0611156411469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 1.09398496151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.73185968399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 1.54483699799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 1.28760266304\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.97226446867\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.523442387581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0181600283831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0611156411469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.390543580055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.141606390476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.00119230675045\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.13874149323\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.76625037193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.03984022141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.79944992065\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.94116210938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0121828410774\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.90430831909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.74820208549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.68876981735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.68556308746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.32432985306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.93232631683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 1.2128187418\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.118830725551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 1.09398806095\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.73185801506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 1.54484415054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 1.28760778904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999284744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.971059143543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.500100016594\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0353999920189\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.118830725551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.390541791916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.141607090831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.00119230698328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.273986 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 9\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 4500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 450000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.935554862022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.09445524216\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.73940348625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.03072142601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.75560235977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.92046833038\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.014029703103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.86166810989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.71971082687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.67665565014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.62777662277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.2838845253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.91292881966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 1.20774161816\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.129474073648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 1.0782674551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 2.063549757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 1.8654705286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 1.53516829014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.971782028675\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.541796386242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0371000058949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.129474073648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.496850013733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.171486049891\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.00181403872557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.09445524216\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.73938298225\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.03072929382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.75560045242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.92047595978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0140297813341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.86169338226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.71969389915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.67666423321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.62774133682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.2838549614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.91291928291\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 1.14386320114\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.0655960813165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 1.07827007771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 2.06355881691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 1.86546158791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 1.53517353535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.976020038128\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.536927580833\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0207600202411\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0655960813165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.4968495965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.17148527503\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.00181404093746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.09445524216\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.73940348625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.03072142601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.75560235977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.92046833038\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.014029703103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.86166810989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.71971082687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.67665565014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.62777662277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.2838845253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.91292881966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 1.21526145935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.136994019151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 1.0782674551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 2.063549757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 1.8654705286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 1.53516829014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.974301934242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.516560852528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0349999815226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.136994019151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.496850013733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.171486049891\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.00181403872557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.317775 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 5000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 500000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 5.92522621155\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.73818850517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.15961098671\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.7353053093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.92477583885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0341217853129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.61352205276\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.57546806335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.61370325089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.31059169769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.08152914047\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.99987840652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 1.26450061798\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.236082434654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 1.02841842175\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.73058700562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.18089103699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.5669798851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.968040525913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.498749941587\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.059400010854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.236082434654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.891591668129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.392109334469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0124359438196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 5.92519760132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.73817253113\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.15960621834\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.73533010483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.92479014397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0341217927635\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.61354923248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.57545208931\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.61369478703\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.31061649323\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.08150863647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.99989366531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 1.2140481472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.185629963875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 1.02841842175\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.73060131073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.18090629578\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.56698012352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.968826234341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.484800755978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0509400516748\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.185629963875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.891595542431\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.392109185457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0124359484762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 5.92522621155\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.73818850517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.15961098671\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.7353053093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.92477583885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0341217853129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.61352205276\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.57546806335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.61370325089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.31059169769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.08152914047\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.99987840652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 1.27066576481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.242247447371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 1.02841842175\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.73058700562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.18089103699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.5669798851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.969310641289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.485083043575\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0584000013769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.242247447371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.891591668129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.392109334469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0124359438196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.378083 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 5500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 550000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 5.70130395889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.63394594193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06413507462\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.63436841965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.84383249283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0585759952664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.33032464981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.41074442863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.54273200035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 6.95094776154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 4.84889364243\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.85255265236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 1.09497404099\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.145816907287\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.94915664196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.7894949913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.32798671722\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.85334467888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.976011812687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.533329129219\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0402000099421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.145816907287\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.16048634052\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.407433569431\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0134850135073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 5.70130395889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.63395118713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06412315369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.63437128067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.84384655952\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0585760846734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.33032464981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.4107298851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.54273247719\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 6.95091104507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 4.84888315201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.8525583744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 1.04947304726\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.10031542182\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.949151813984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.78949642181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.32800579071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.85332846642\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.977987766266\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.520123898983\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0307400058955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.10031542182\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.16048312187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.407431900501\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0134850600734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 5.70130395889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.63394594193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06413507462\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.63436841965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.84383249283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0585759952664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.33032464981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.41074442863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.54273200035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 6.95094776154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 4.84889364243\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.85255265236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 1.09732854366\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.148171290755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.94915664196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.7894949913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.32798671722\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.85334467888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.977250099182\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.51136559248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0399999879301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.148171290755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.16048634052\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.407433569431\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0134850135073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.333940 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 6000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 600000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 5.4267373085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.48842096329\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 1.96254551411\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.41478538513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.7299387455\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0784849375486\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.06470775604\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.24842214584\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.46678352356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 6.60853338242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 4.6184220314\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.71205830574\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.985752701759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.119499914348\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.866252303123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.76992559433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.27050018311\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.78093886375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.979267477989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.543375730515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0315999910235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.119499914348\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.912945210934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.402993023396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0216930937022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 5.42672777176\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.48842120171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 1.96254348755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.41479063034\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.72992825508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0784846991301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.06472110748\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.24842524529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.46679055691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 6.60850334167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 4.61840820312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.71205258369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.922969102859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.0567165091634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.866256058216\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.76994085312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.27052545547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.7809548378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.982750058174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.558061778545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.018240025267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0567165091634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.912941157818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.402991384268\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0216932129115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 5.4267373085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.48842096329\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 1.96254551411\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.41478538513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.7299387455\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0784849375486\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.06470775604\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.24842214584\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.46678352356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 6.60853338242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 4.6184220314\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.71205830574\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.983159482479\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.11690659076\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.866252303123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.76992559433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.27050018311\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.78093886375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.981662929058\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.533038794994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0296999812126\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.11690659076\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.912945210934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.402993023396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0216930937022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.286931 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 13\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 6500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 650000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 5.16044139862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.34162855148\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 1.86588740349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.20599794388\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.61515665054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0764672607183\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 4.8263502121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.09343934059\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.39710497856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 6.2830324173\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 4.39829969406\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.57847547531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.8922701478\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.102732278407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.789536893368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.68681240082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.23078680038\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.78408479691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.983542442322\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.593747019768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0273999907076\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.102732278407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.966835141182\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.398707449436\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0218474734575\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 5.16042280197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.34164571762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 1.86587870121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.2060174942\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.61516785622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0764675214887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 4.82632637024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.09345006943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.39711165428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 6.28304100037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 4.39832401276\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.5784881115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.829474568367\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.0399360619485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.789532542229\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.6868262291\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.23076534271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.78406834602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.987834095955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.609752178192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0125200273469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0399360619485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.96683973074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.398709416389\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0218475684524\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 5.16044139862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.34162855148\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 1.86588740349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.20599794388\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.61515665054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0764672607183\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 4.8263502121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.09343934059\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.39710497856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 6.2830324173\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 4.39829969406\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.57847547531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.903808116913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.114270374179\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.789536893368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.68681240082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.23078680038\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.78408479691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.984707713127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.566586375237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.028899980709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.114270374179\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.966835141182\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.398707449436\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0218474734575\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.373106 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 14\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 7000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 700000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 4.90614843369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.19672346115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 1.77398645878\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 4.96580123901\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.50189256668\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0782802626491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 4.59008312225\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 2.94533538818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.32907187939\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 5.97338581085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 4.18786859512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.45148181915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.819695711136\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.100928872824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.718766570091\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.5962023735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.16727113724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.66778349876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.987643420696\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.622340202332\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0252999924123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.100928872824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.958882212639\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.392418205738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0207168832421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 4.90617132187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.19671821594\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 1.77399635315\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 4.96578741074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.50188994408\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0782798752189\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 4.5900592804\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 2.94533443451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.32906579971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 5.97335529327\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 4.18784570694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.45149064064\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.745359420776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.0265923049301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.718770325184\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.5962138176\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.16729164124\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.66780090332\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.990943193436\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.66484606266\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00918001402169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0265923049301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.95888376236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.392418503761\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0207169353962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 4.90614843369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.19672346115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 1.77398645878\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 4.96580123901\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.50189256668\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0782802626491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 4.59008312225\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 2.94533538818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.32907187939\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 5.97338581085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 4.18786859512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.45148181915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.827313005924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.108545988798\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.718766570091\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.5962023735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.16727113724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.66778349876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.987360954285\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.601630806923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0260999873281\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.108545988798\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.958882212639\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.392418205738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0207168832421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.270202 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 15\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 7500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 750000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 4.66921758652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.05542969704\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 1.68660902977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 4.75306463242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.39132237434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0765107423067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 4.3710064888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 2.8040626049\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.26379609108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 5.67917490005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 3.98712182045\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.33073425293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.737741053104\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.083799123764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.653942167759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.54380941391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.11158180237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.66944622993\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.987535178661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.639883577824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0226999949664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.083799123764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.992673635483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.386759877205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0214904490858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 4.66919612885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.05544400215\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 1.68661606312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 4.75308895111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.39132881165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0765103250742\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 4.37101602554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 2.80404901505\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.26379692554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 5.67914772034\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 3.98710203171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.33073854446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.66691416502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.0129722505808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.653943121433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.54378795624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.11155748367\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.66946792603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.993395149708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.715351760387\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00405999692157\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0129722505808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.992678523064\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.386759728193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0214903373271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 4.66921758652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.05542969704\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 1.68660902977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 4.75306463242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.39132237434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0765107423067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 4.3710064888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 2.8040626049\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.26379609108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 5.67917490005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 3.98712182045\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.33073425293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.734254300594\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0803121104836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.653942167759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.54380941391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.11158180237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.66944622993\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.987278044224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.594924449921\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0219999905676\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0803121104836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.992673635483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.386759877205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0214904490858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.281498 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 16\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 8000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 800000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 4.46374130249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 2.9173309803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 1.60354030132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 4.55304861069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.28333234787\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0760971903801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 4.15992879868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 2.66938233376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.20336544514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 5.3994641304\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 3.79574894905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.21593642235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.674262106419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0797682702541\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.594494223595\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.41636514664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.05042076111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.58171629906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.986650168896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.618766665459\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0221999883652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0797682702541\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.987005531788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.380280554295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0215586218983\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 4.46375417709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 2.91732239723\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 1.60354280472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 4.55305957794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.2833340168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0760968104005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 4.159927845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 2.66937685013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.20335972309\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 5.39946508408\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 3.79574465752\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.21593785286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.604817152023\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.0103233894333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.594495952129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.41635942459\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.05040311813\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.58173537254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.993671536446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.732953190804\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00291999848559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0103233894333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.987000524998\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.380278617144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0215585716069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 4.46374130249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 2.9173309803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 1.60354030132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 4.55304861069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.28333234787\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0760971903801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 4.15992879868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 2.66938233376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.20336544514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 5.3994641304\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 3.79574894905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.21593642235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.67914390564\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0846498459578\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.594494223595\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.41636514664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.05042076111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.58171629906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.987098455429\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.597771346569\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0203999932855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0846498459578\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.987005531788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.380280554295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0215586218983\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.317685 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 17\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 8500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 850000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 4.26407384872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 2.78463411331\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 1.52455866337\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 4.34796571732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.17960953712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0764012187719\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 3.95875430107\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 2.54128909111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.14473068714\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 5.13351964951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 3.61375975609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.1067969799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.610892295837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0704278945923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.540464937687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.3217663765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.00428628922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.53744649887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.988494455814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.640034735203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0186999924481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0704278945923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.994636058807\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.3746727705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0214648172259\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 4.26409387589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 2.78462028503\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 1.52456390858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 4.34795570374\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.17961931229\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0764016136527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 3.95873188972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 2.54130077362\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.14473164082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 5.13353729248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 3.61374282837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.10678911209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.5477257967\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.007261632476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.540465056896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.32178735733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.00426435471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.5374417305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.995666265488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.789768993855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00194000091869\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.007261632476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.994630157948\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.374674469233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0214648637921\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 4.26407384872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 2.78463411331\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 1.52455866337\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 4.34796571732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.17960953712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0764012187719\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 3.95875430107\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 2.54128909111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.14473068714\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 5.13351964951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 3.61375975609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.1067969799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.617604732513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0771402940154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.540464937687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.3217663765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.00428628922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.53744649887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.989329993725\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.605314671993\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0208999905735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0771402940154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.994636058807\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.3746727705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0214648172259\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.269546 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 18\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 9000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 900000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 4.07507371902\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 2.65655350685\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 1.44946885109\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 4.15038585663\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.07941555977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0857979208231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 3.77103662491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 2.41892313957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.08750927448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 4.88069534302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 3.43979096413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.00302839279\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.562726557255\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0717355385423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.490990847349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.28208780289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.93249392509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.48496580124\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.990153551102\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.659395575523\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0185999944806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0717355385423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.942749202251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.367405802011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.019349604845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 4.07505750656\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 2.65656781197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 1.44946610928\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 4.15039014816\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.07942199707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0857974886894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 3.77104258537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 2.41892194748\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.08750891685\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 4.88067293167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 3.43978619576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.00302529335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.496095150709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.00510408030823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.490992516279\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.28208827972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.93247795105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.48496460915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.996478378773\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.825236082077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00105999980588\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00510408030823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.942744672298\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.367404073477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0193495322019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 4.07507371902\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 2.65655350685\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 1.44946885109\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 4.15038585663\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.07941555977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0857979208231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 3.77103662491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 2.41892313957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.08750927448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 4.88069534302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 3.43979096413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.00302839279\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.568551659584\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0775607377291\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.490990847349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.28208780289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.93249392509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.48496580124\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.989968895912\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.620238602161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0208999887109\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0775607377291\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.942749202251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.367405802011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.019349604845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.304628 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 19\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 9500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 950000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 3.88326621056\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 2.53280711174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 1.37807917595\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 3.96461653709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.98260319233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.09099239856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 3.58734297752\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 2.30225491524\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.03453934193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 4.64029741287\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 3.27396249771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 1.90437150002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.510573804379\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0647685080767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.445804834366\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.17118215561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.85513329506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.38714289665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.989724636078\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.680286705494\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0178999938071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0647685080767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.922487914562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.359323531389\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0180249232799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 3.883248806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 2.53280425072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 1.37807655334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 3.96463823318\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.982614398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.090992718935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 3.58735847473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 2.30224943161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.03453481197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 4.64032030106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 3.2739636898\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 1.90436935425\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.449831366539\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.00402596499771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.445802211761\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.17116117477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.85511660576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.3871281147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.996860563755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.843070626259\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000819999666419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00402596499771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.922493100166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.359325319529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0180248413235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 3.88326621056\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 2.53280711174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 1.37807917595\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 3.96461653709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.98260319233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.09099239856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 3.58734297752\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 2.30225491524\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.03453934193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 4.64029741287\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 3.27396249771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 1.90437150002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.517447412014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0716420337558\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.445804834366\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.17118215561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.85513329506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.38714289665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.990103065968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.65864700079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.019399991259\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0716420337558\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.922487914562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.359323531389\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0180249232799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.352973 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 20\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 10000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1000000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 3.69830107689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 2.41490340233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 1.31020438671\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 3.78174734116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.89037334919\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0872991830111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 3.41410470009\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 2.19139242172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.983708977699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 4.41174936295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 3.11639881134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 1.81057536602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.4696611166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.064779728651\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.404881685972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.09565019608\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.78634428978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.3164498806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.98881983757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.653255581856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.017599998042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.064779728651\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.925839364529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.351857930422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0175057649612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 3.69831848145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 2.41490244865\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 1.31020689011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 3.78176569939\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.89036512375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0872987210751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 3.41411972046\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 2.19141077995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.983713150024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 4.41172409058\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 3.11639785767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 1.81056690216\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.409165471792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.00428416905925\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.404880315065\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.09566497803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.78633141518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.31643605232\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.996947467327\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.855619430542\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000879999657627\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00428416905925\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.925839066505\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.351859807968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0175057388842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 3.69830107689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 2.41490340233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 1.31020438671\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 3.78174734116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.89037334919\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0872991830111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 3.41410470009\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 2.19139242172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.983708977699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 4.41174936295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 3.11639881134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 1.81057536602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.475686132908\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0708047524095\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.404881685972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.09565019608\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.78634428978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.3164498806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.989249825478\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.616850614548\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0192999914289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0708047524095\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.925839364529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.351857930422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0175057649612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.278321 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 21\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 10500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1050000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 3.52711653709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 2.30246567726\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 1.2456703186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 3.60426926613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.80239653587\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0854785442352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 3.24995541573\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 2.08604121208\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.935500979424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 4.19445514679\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 2.96661686897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 1.72139751911\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.435198038816\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0674102455378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.367787539959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.01598834991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.72248363495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.24742627144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.988867938519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.670085370541\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0185999963433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0674102455378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.902759611607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.344950795174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0167198460549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 3.52713274956\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 2.30245995522\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 1.24567604065\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 3.60428500175\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.80238819122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0854781419039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 3.24996852875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 2.08604311943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.935496866703\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 4.19447517395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 2.96663236618\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 1.72139537334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.372235387564\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.00444769486785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.367789417505\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.01601171494\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.7224612236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.24741005898\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.996587693691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.846141993999\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000799999630544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00444769486785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.902763843536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.344951033592\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0167199298739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 3.52711653709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 2.30246567726\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 1.2456703186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 3.60426926613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.80239653587\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0854785442352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 3.24995541573\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 2.08604121208\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.935500979424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 4.19445514679\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 2.96661686897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 1.72139751911\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.439748078585\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0719603598118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.367787539959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.01598834991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.72248363495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.24742627144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.989000380039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.610602736473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0192999914289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0719603598118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.902759611607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.344950795174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0167198460549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.292022 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 22\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 11000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1100000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 3.36697125435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 2.19646573067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 1.18431913853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 3.44316983223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.71948647499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0820252001286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 3.09565114975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 1.98627471924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.889862000942\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 3.98788499832\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 2.82480931282\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 1.63661336899\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.394841223955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0604076348245\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.334433555603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.01139307022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.67662405968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.18460655212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.989187180996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.643190681934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0180999971926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0604076348245\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.901866018772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.339687138796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.01714236103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 3.36695551872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 2.19647264481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 1.18431949615\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 3.44315481186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.7194788456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0820248499513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 3.09563612938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 1.98626804352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.889865934849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 3.98790216446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 2.82479405403\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 1.63662087917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.337020277977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.00258666928858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.334432244301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.01139307022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.67662858963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.18459391594\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.997638344765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.894991517067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000179999973625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00258666928858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.901870131493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.339686959982\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0171423424035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 3.36697125435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 2.19646573067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 1.18431913853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 3.44316983223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.71948647499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0820252001286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 3.09565114975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 1.98627471924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.889862000942\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 3.98788499832\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 2.82480931282\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 1.63661336899\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.399684429169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.065250813961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.334433555603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.01139307022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.67662405968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.18460655212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.989832878113\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.622855961323\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0177999921143\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.065250813961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.901866018772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.339687138796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.01714236103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.278771 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 23\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 11500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1150000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 3.2081348896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 2.09370923042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 1.12598621845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 3.28446102142\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.63902020454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0778670459986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 2.94689941406\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 1.89091038704\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.846523106098\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 3.79147481918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 2.68924212456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 1.55600595474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.359032511711\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0552162267268\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.303816497326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.92041349411\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.61436057091\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.12086963654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.989588081837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.669209182262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.016299996525\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0552162267268\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.909698069096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.333013266325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0162505507469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 3.20815110207\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 2.09371638298\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 1.12598991394\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 3.28445625305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.63901221752\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0778671503067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 2.94688630104\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 1.89090168476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.846526682377\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 3.79145789146\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 2.68924236298\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 1.55599808693\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.306422680616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.00260642380454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.303818255663\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.92042994499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.61433935165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.12087059021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.997653722763\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.897151112556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000119999996969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00260642380454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.909693837166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.333012223244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0162506196648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 3.2081348896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 2.09370923042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 1.12598621845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 3.28446102142\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.63902020454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0778670459986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 2.94689941406\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 1.89091038704\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.846523106098\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 3.79147481918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 2.68924212456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 1.55600595474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.370760649443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0669444948435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.303816497326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.92041349411\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.61436057091\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.12086963654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.989882349968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.639726042747\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0178999956697\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0669444948435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.909698069096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.333013266325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0162505507469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.283699 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 24\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 12000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1200000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 3.0553176403\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 1.99559020996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 1.07052779198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 3.1363966465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.56222510338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0742355883121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 2.80656790733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 1.80023908615\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.805699706078\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 3.60472822189\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 2.5603313446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 1.47936725616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.333813428879\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0577764734626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.276036947966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.85618805885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.55425548553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.04648113251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.989487826824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.649445652962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0160999950022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0577764734626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.918738484383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.326478481293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0155664272606\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 3.055331707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 1.99557840824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 1.07052719593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 3.1363966465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.56223297119\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0742354020476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 2.80655431747\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 1.80023896694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.805703580379\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 3.60474324226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 2.56033945084\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 1.47937119007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.278264194727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.00222728447989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.276037305593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.85618400574\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.55425071716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.04648280144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.997917592525\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.919997572899\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 7.9999997979e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00222728447989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.918739795685\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.326479077339\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0155664980412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 3.0553176403\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 1.99559020996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 1.07052779198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 3.1363966465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.56222510338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0742355883121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 2.80656790733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 1.80023908615\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.805699706078\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 3.60472822189\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 2.5603313446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 1.47936725616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.338611006737\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.062574096024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.276036947966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.85618805885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.55425548553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.04648113251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.98962688446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.629032611847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0176999941468\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.062574096024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.918738484383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.326478481293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0155664272606\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.319413 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 25\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 12500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1250000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 2.91628909111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 1.90174818039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 1.01780152321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 2.98749780655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.48878085613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0709456577897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 2.6732199192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 1.71399199963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.766523241997\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 3.42718911171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 2.43771839142\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 1.40650296211\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.305504858494\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0546990483999\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.2508058846\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.78892588615\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.49624156952\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.00044965744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.989326953888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.664230465889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0153999980539\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0546990483999\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.914359211922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.320046216249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0148301701993\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 2.9162979126\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 1.90174603462\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 1.01780331135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 2.98750209808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.48878598213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0709457397461\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 2.67322587967\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 1.71399140358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.766523063183\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 3.42717552185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 2.4377117157\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 1.40649604797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.252682715654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.00187695620116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.250807106495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.78894209862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.49625706673\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.00046014786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998175680637\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.935915350914\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00187695620116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.914363384247\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.320046842098\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0148302586749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 2.91628909111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 1.90174818039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 1.01780152321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 2.98749780655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.48878085613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0709456577897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 2.6732199192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 1.71399199963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.766523241997\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 3.42718911171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 2.43771839142\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 1.40650296211\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.310465872288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0596601851285\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.2508058846\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.78892588615\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.49624156952\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.00044965744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.989892303944\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.631849765778\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0163999944925\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0596601851285\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.914359211922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.320046216249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0148301701993\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.332601 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 26\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 13000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1300000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 2.78018331528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 1.81279492378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 0.967669785023\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 2.84347510338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.41918671131\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0677683353424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 2.54604840279\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 1.63219892979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.7294241786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 3.26415896416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 2.32143187523\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 1.33722984791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.282132327557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0540966317058\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.228035539389\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.75175428391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.44715094566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 2.93773794174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.989186286926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.657333433628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0153999971226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0540966317058\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.922168970108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.314452946186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0141052464023\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 2.7801964283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 1.81280255318\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 0.967675149441\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 2.84348917007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.41918671131\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0677684471011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 2.54606103897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 1.63219988346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.729421555996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 3.26416134834\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 2.3214328289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 1.33723008633\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.230251327157\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.00221558846533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.228034421802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.75175452232\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.44716668129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 2.93775320053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.997844338417\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.929183900356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00221558846533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.922172784805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.314453363419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0141053134575\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 2.78018331528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 1.81279492378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 0.967669785023\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 2.84347510338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.41918671131\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0677683353424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 2.54604840279\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 1.63219892979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.7294241786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 3.26415896416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 2.32143187523\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 1.33722984791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.287775874138\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0597402378917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.228035539389\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.75175428391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.44715094566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 2.93773794174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.989176094532\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.624788343906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0166999921203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0597402378917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.922168970108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.314452946186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0141052464023\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.284030 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 27\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 13500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1350000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 2.65619587898\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 1.72903525829\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 0.920009553432\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 2.71527957916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.3536605835\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0648870319128\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 2.42550611496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 1.55485773087\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.694191396236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 3.11506414413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 2.21147465706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 1.27136671543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.261537849903\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0539344884455\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.207603096962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.72367501259\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.41610884666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 2.90950012207\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.98896753788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.650016546249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0154999988154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0539344884455\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.928149938583\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.310383200645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0134189818054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 2.6562101841\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 1.72902774811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 0.920005261898\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 2.71527171135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.35366332531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0648870840669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 2.42551159859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 1.5548504591\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.694188058376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 3.1150598526\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 2.21146249771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 1.27136695385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.20999661088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.002393146744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.207603022456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.7236533165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.41609406471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 2.90950846672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.997686505318\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.923012793064\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 1.99999994948e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.002393146744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.928141772747\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.310382217169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0134189641103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 2.65619587898\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 1.72903525829\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 0.920009553432\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 2.71527957916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.3536605835\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0648870319128\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 2.42550611496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 1.55485773087\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.694191396236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 3.11506414413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 2.21147465706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 1.27136671543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.268219769001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0606164671481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.207603096962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.72367501259\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.41610884666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 2.90950012207\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.989122092724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.619553089142\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0165999922901\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0606164671481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.928149938583\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.310383200645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0134189818054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.261071 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 28\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 14000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1400000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 2.53800392151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 1.65007030964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 0.874696552753\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 2.59223008156\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.29187560081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0620772130787\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 2.31092762947\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 1.48166322708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.660871863365\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 2.96952915192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 2.10743236542\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 1.20874655247\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.244267836213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0550341755152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.189233824611\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.7156329155\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.3953909874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 2.88775634766\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.988679349422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.66010850668\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.015999995172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0550341755152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.940686166286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.307195395231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0127685274929\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 2.53800177574\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 1.65007722378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 0.874697685242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 2.59221696854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.29187226295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0620768405497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 2.3109228611\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 1.48165631294\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.660868704319\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 2.96951341629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 2.10743737221\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 1.208745718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.19228720665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.00305363954976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.18923483789\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.71563386917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.39540982246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 2.88775682449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.99712729454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.899743020535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 9.99999974738e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00305363954976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.940682113171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.307196319103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0127684678882\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 2.53800392151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 1.65007030964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 0.874696552753\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 2.59223008156\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.29187560081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0620772130787\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 2.31092762947\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 1.48166322708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.660871863365\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 2.96952915192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 2.10743236542\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 1.20874655247\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.250370264053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0611366219819\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.189233824611\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.7156329155\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.3953909874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 2.88775634766\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.98891800642\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.613278985023\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0181999895722\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0611366219819\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.940686166286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.307195395231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0127685274929\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.281839 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 29\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 14500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1450000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 2.42693471909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 1.57674181461\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 0.831614494324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 2.47894763947\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.23453938961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0597868897021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 2.20548892021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 1.41274940968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.629146695137\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 2.83711600304\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 2.00946569443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 1.14921236038\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.231429338455\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0585358664393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.17289365828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.72800803185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.39454960823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 2.87621188164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.988135576248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.641624808311\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0174999944866\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0585358664393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.94206482172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.305722147226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0122694317251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 2.42693591118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 1.57673621178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 0.831611156464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 2.47895431519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.23453593254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0597870908678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 2.20549035072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 1.41274940968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.629147231579\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 2.83710312843\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 2.0094628334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 1.14921247959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.176759794354\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.00386637193151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.172893241048\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.72802448273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.39456868172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 2.87620210648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.996502935886\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.867810547352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000219999958063\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00386637193151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.942059278488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.305722266436\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.012269385159\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 2.42693471909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 1.57674181461\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 0.831614494324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 2.47894763947\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.23453938961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0597868897021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 2.20548892021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 1.41274940968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.629146695137\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 2.83711600304\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 2.00946569443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 1.14921236038\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.233349367976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0604558549821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.17289365828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.72800803185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.39454960823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 2.87621188164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.988323628902\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.623263895512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0180999934673\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0604558549821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.94206482172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.305722147226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0122694317251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.305740 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 30\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 15000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1500000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 2.32734417915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 1.50859749317\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 0.790655136108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 2.3708486557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.18130934238\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0573941357434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 2.10413718224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 1.34777581692\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.599398136139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 2.71429800987\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 1.91710066795\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 1.09260857105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.213433161378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0551191605628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.158313959837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.74245023727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.40365672112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 2.87184524536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.988063156605\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.63681012392\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0161999966949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0551191605628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.970815420151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.305047929287\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0117727546021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 2.32733273506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 1.50859475136\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 0.790655434132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 2.37083745003\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.18130576611\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0573940649629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 2.10414910316\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 1.34777891636\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.599396586418\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 2.71428489685\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 1.91711127758\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 1.09261226654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.161947190762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.00363326980732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.158314481378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.74245476723\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.40366172791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 2.87186050415\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.996790409088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.880268752575\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0002599999425\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00363326980732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.970812141895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.305047690868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0117728123441\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 2.32734417915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 1.50859749317\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 0.790655136108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 2.3708486557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.18130934238\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0573941357434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 2.10413718224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 1.34777581692\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.599398136139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 2.71429800987\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 1.91710066795\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 1.09260857105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.221332803369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0630188435316\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.158313959837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.74245023727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.40365672112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 2.87184524536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.988815426826\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.629059970379\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0181999914348\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0630188435316\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.970815420151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.305047929287\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0117727546021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.277658 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 31\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 15500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1550000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 2.22986006737\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 1.44450759888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 0.751711428165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 2.27136349678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.13126826286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.055449090898\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 2.01123976707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 1.28632330894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.570827186108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 2.59384894371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 1.82977592945\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 1.03879511356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.199405178428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0542121008039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.145193070173\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.75564265251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.41556763649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 2.89411330223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.98805475235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.651372611523\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0173999965191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0542121008039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.984490036964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.30471482873\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0115118613467\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 2.22986245155\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 1.44451439381\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 0.751711428165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 2.27136206627\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.13127017021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0554490871727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 2.01124000549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 1.28632640839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.570830464363\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 2.59386348724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 1.8297867775\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 1.03879117966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.148557990789\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.00336487870663\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.145192667842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.75566291809\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.41558241844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 2.89412260056\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.996838271618\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.885646343231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 7.9999997979e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00336487870663\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.98448997736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.304714143276\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0115119209513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 2.22986006737\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 1.44450759888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 0.751711428165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 2.27136349678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.13126826286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.055449090898\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 2.01123976707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 1.28632330894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.570827186108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 2.59384894371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 1.82977592945\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 1.03879511356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.204451009631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0592579171062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.145193070173\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.75564265251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.41556763649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 2.89411330223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.989104747772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.617950022221\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0168999936432\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0592579171062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.984490036964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.30471482873\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0115118613467\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.299106 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 32\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 16000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1600000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 2.14349389076\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 1.38710844517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 0.714687824249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 2.18458104134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.08642613888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0531989820302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 1.92048859596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 1.22870218754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.54377913475\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 2.48094320297\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 1.74789762497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 0.987630963326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.198874086142\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0651714801788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.13370269537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.78167033195\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.43723106384\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 2.910176754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.986017048359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.594191014767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0199999921024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0651714801788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.997191548347\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.305199384689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0112372441217\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 2.14350128174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 1.38711500168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 0.714688956738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 2.18457770348\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.08642041683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0531990006566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 1.92047715187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 1.22869598866\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.543776392937\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 2.4809448719\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 1.74790513515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 0.987626254559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.142097592354\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.00839497055858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.133703291416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.78167462349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.43724656105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 2.91016840935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.993861615658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.764626443386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00168000021949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00839497055858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.997187256813\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.305199593306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0112373000011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 2.14349389076\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 1.38710844517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 0.714687824249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 2.18458104134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.08642613888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0531989820302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 1.92048859596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 1.22870218754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.54377913475\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 2.48094320297\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 1.74789762497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 0.987630963326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.206293180585\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0725905746222\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.13370269537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.78167033195\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.43723106384\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 2.910176754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.98618721962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.584758162498\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0210999920964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0725905746222\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.997191548347\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.305199384689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0112372441217\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.316685 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 33\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 16500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1650000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 2.07966470718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 1.34304857254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 0.67948693037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 2.12437868118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.05228435993\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0516484305263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 1.84021937847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 1.17601656914\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.518966257572\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 2.38222265244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 1.67307877541\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 0.938986539841\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.1945425421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0701323673129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.124409988523\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.7988409996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.48081755638\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 2.99444794655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.985891222954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.610743761063\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.021299995482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0701323673129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.03870010376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.307827204466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0110923619941\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 2.07966327667\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 1.34305346012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 0.679490327835\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 2.12437534332\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.05228734016\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0516487248242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 1.84022164345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 1.17601895332\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.518965959549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 2.3822286129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 1.67308568954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 0.93898332119\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.135569825768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.0111596826464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.124409854412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.79884195328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.48080062866\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 2.99444794655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.992844820023\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.72961461544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00289999856614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0111596826464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.03869926929\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.307827889919\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0110923871398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 2.07966470718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 1.34304857254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 0.67948693037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 2.12437868118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.05228435993\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0516484305263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 1.84021937847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 1.17601656914\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.518966257572\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 2.38222265244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 1.67307877541\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 0.938986539841\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.197794348001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0733841732144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.124409988523\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.7988409996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.48081755638\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 2.99444794655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.986917078495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.61943089962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0203999932855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0733841732144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.03870010376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.307827204466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0110923619941\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.390813 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 34\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 17000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1700000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 2.09944272041\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 1.31166350842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 0.646019160748\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 2.08779644966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.02819681168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0544924363494\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 1.76557374001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 1.12808454037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.495299696922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 2.29631304741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 1.60503029823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 0.892738819122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.189725786448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0726886093616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.117037259042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.87525558472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.52211046219\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.00069046021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.983940660954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.607474207878\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0210999920964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0726886093616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.04711163044\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.310424894094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0110520040616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 2.09944820404\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 1.31166100502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 0.646022617817\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 2.08778810501\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.02820193768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0544921904802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 1.76556527615\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 1.12807917595\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.495299696922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 2.29631876945\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 1.60503292084\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 0.892735242844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.138252094388\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.0212149638683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.117037393153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.87525558472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.5221259594\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.00070405006\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.989364624023\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.659551143646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00660000368953\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0212149638683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.04711127281\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.310425490141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0110520040616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 2.09944272041\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 1.31166350842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 0.646019160748\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 2.08779644966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.02819681168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0544924363494\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 1.76557374001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 1.12808454037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.495299696922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 2.29631304741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 1.60503029823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 0.892738819122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.204115614295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0870784968138\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.117037259042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.87525558472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.52211046219\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.00069046021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.984562575817\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.597014904022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0247999858111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0870784968138\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.04711163044\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.310424894094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0110520040616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.325348 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 35\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 17500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1750000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 2.33471369743\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 1.30764365196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 0.614201545715\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 2.11369776726\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 1.02605807781\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0789580345154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 1.72045576572\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 1.08744347095\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 0.471859395504\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 2.22104668617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 1.54732775688\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 0.848768413067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.186729609966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_0: 0.0738602727652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_term_1_weight_decay: 0.112869426608\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.81233644485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.53644061089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.07366251945\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.982964873314\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.570746660233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0224999897182\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0738602727652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.04587638378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.311368614435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0108088394627\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 2.33471369743\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 1.30764782429\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 0.614198505878\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 2.11369967461\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 1.02606165409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0789578035474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 1.72044575214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 1.08744776249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 0.471859931946\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 2.2210419178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 1.54733288288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 0.848769664764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.133081272244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_0: 0.020211936906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_term_1_weight_decay: 0.112869039178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.81231951714\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.53645634651\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.07366323471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.989763617516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.656112134457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00610000034794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.020211936906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.04588091373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.311368972063\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0108088953421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 2.33471369743\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 1.30764365196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 0.614201545715\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 2.11369776726\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 1.02605807781\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0789580345154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 1.72045576572\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 1.08744347095\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 0.471859395504\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 2.22104668617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 1.54732775688\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 0.848768413067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.191735550761\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_0: 0.0788661986589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_term_1_weight_decay: 0.112869426608\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.81233644485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.53644061089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.07366251945\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.985468804836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.593561589718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0224999915808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0788661986589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.04587638378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.311368614435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0108088394627\n" ] } ], "prompt_number": 10 }, { "cell_type": "code", "collapsed": false, "input": [ "!print_monitor.py mlp_3_best.pkl | grep test_y_misclass" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "Using gpu device 2: GeForce GTX 285\r\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "/u/goodfeli/pylearn2/models/mlp.py:36: UserWarning: MLP changing the recursion limit.\r\n", " warnings.warn(\"MLP changing the recursion limit.\")\r\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "test_y_misclass : 0.0153999980539\r\n" ] } ], "prompt_number": 11 }, { "cell_type": "markdown", "metadata": {}, "source": [ "Using a simple form of regularization thus brought the test error rate for this MLP down from 1.75% to 1.54%." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Further reading\n", "\n", "You can find more information on MLPs from the following sources:\n", "\n", "[LISA lab's Deep Learning Tutorials: Multilayer Perception](http://deeplearning.net/tutorial/mlp.html)\n", "\n", "\n", "This is by no means a complete list." ] } ], "metadata": {} } ] }