{ "metadata": { "name": "multilayer_perceptron" }, "nbformat": 3, "nbformat_minor": 0, "worksheets": [ { "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# pylearn2 tutorial: Multilayer Perceptron\n", "by [Ian Goodfellow](http://www-etud.iro.umontreal.ca/~goodfeli)\n", "\n", "## Introduction\n", "This ipython notebook will teach you the basics of how multilayer perceptrons work, and show you how to use multilayer perceptrons in pylearn2.\n", "\n", "To do this, we will go over several concepts:\n", "\n", "Part 1: What pylearn2 is doing for you in this example\n", "\n", " - Review of softmax regression, and how MLPs are similar\n", "\n", " - The multilayer perceptron model\n", "\n", " - Some beneficial properties of MLPs\n", "\n", " - Some detrimental properties of MLPs\n", "\n", "Part 2: How to use pylearn2 to train an MLP\n", "\n", "Part 3: A deeper MLP, and pylearn2 polymorphism\n", "\n", "Part 4: Regularization, and pylearn2 costs\n", "\n", "\n", "Note that this won't explain in detail how the individual classes are implemented. The classes\n", "follow pretty good naming conventions and have pretty good docstrings, but if you have trouble\n", "understanding them, write to me and I might add a part 3 explaining how some of the parts work\n", "under the hood.\n", "\n", "Please write to pylearn-dev@googlegroups.com if you encounter any problem with this tutorial." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Requirements\n", "\n", "Before running this notebook, you must have installed pylearn2.\n", "Follow the [download and installation instructions](http://deeplearning.net/software/pylearn2/#download-and-installation)\n", "if you have not yet done so.\n", "\n", "This tutorial also assumes you already know about softmax regression, and know how to train and evaluate a softmax regression model in pylearn2. If not, work through softmax_regression.ipynb before starting this tutorial.\n", "\n", "It's also strongly recommend that you run this notebook with THEANO_FLAGS=\"device=gpu\". This is a processing intensive example and the GPU will make it run a lot faster, if you have one available. Execute the next cell to verify that you are using the GPU.\n", "\n" ] }, { "cell_type": "code", "collapsed": false, "input": [ "import theano\n", "print theano.config.device" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "gpu\n" ] }, { "output_type": "stream", "stream": "stderr", "text": [ "Using gpu device 0: GeForce GTX 285\n" ] } ], "prompt_number": 1 }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Part 1: What pylearn2 is doing for you in this example\n", "\n", "In this part, we won't get into any specifics of pylearn2 yet. We'll just discuss how to train a multilayer perceptron (MLP). If you already know about MLPs, feel free to skip straight to part 2, where we show how to do all of this in pylearn2.\n", "\n", "\n", "### Review of softmax regression, and how MLPs are similar\n", "\n", "In softmax_regression.ipynb, we saw how softmax regression is a classification model that learns to map an input vector $x$ to a probability distribution $p(y\\mid x)$ where $y$ is a categorical value with $k$ different values. We then described how a dataset $\\mathcal{D}$ of $(x, y)$ tuples could be used to train a softmax regression model by maximizing the log likelihood,\n", "\n", "$$\\sum_{x,y \\in \\mathcal{D} } \\log P(y \\mid x).$$\n", "\n", "A multilayer perceptron is a very general machine learning model. In many cases, we can think of it as mapping $x$ to $P(y\\mid x)$, and train it by maximizing the log likelihood. We'll start with that basic perspective, because of its similarity to softmax regression. (It is, however, possible to interpret the output of a multiplayer perceptron non-probabilistically, to use it for regression rather than classification, and to train it by optimizing functions other than the log likelihood)\n", "\n", "Everything we described above is still relevant to the MLP. However, there is one more fact about softmax regression that does not apply to the MLP. Specifically, softmax regression assumes that\n", "\n", "$$p(y \\mid x) = \\frac { \\exp( x^T W + b ) } { \\sum_i \\exp(x^T W + b)_i } = \\text{softmax}( x^T W + b).$$\n", "\n", "The MLP makes a different assumption about the functional form of $p(y \\mid x)$.\n", "\n", "## The multilayer perceptron model\n", "\n", "The multilayer perceptron model assumption is very weak. Essentially, the assumption is that the relationship between inputs and outputs can be represented by the composition of several simpler functions. Each function being composed can be thought of as another \"layer\" or stage of processing. The number of compositions determines the \"depth\" of the model.\n", "\n", "Suppose we have a sequence of functions implementing the layers, $g_1, g_2, \\dots, g_L$. Then the output of our MLP is\n", "\n", "$$f(x) = g_L(g_{L-1}( \\dots g_2( g_1 ( x )) \\dots )).$$\n", "\n", "In the first example for this tutorial, we will use just two layers. The final layer will be\n", "\n", "$g_2(g_1) = \\text{softmax}( g_1^T W^{(2)} + b^{(2)}),$\n", "\n", "so we can think of this model as using $g_1$ to transform $x$ into a different space, then doing softmax regression in that space.\n", "\n", "For the first layer, we will use an affine transform followed by elementwise-application of the logistic sigmoid function, $\\sigma(z) = \\frac {1 } { 1 + \\exp(-z) }.$ This is a very commonly used type of layer in multilayer perceptrons. Putting it all together, we get\n", "\n", "$g_1(x) = \\sigma ( x^T W^{(1)} + b^{(1)} ).$\n", "\n", "The full model is thus\n", "\n", "$$f(x) = \\text{softmax}( \\sigma ( x^T W^{(1)} + b^{(1)} )^T W^{(2)} + b^{(2)}).$$\n", "\n", "If we interpret $f(x)$ as defining $p(y \\mid x)$, it makes sense to train the parameters $W^{(1)}$, $W^{(2)}$, $b^{(1)}$, and $b^{(2)}$ by maximizing the log likelihood of the training data. \n", "\n", "\n", "## Some beneficial properties of MLPs\n", "\n", "An obvious problem with softmax regression and other linear classifiers is that linear functions are very simple. They prevent solutions to even very simple classification problems, such as the class of 2 bit patterns whose XOR is true. XOR is true when $x=[1,0]$ or $x=[0,1]$ but not when $x=[0,0]$ or $x=[1,1]$. Suppose we draw a line that separates $[0,0]$ from $[0,1]$. Then it must pass through some point $[0,p]$. We require that this line also pass through $[q,1]$ in order to separate $[0,1]$ from $[1,1]$. But this means it slope must be negative and its $x$-intercept must be negative. Since a line only has one $x$ intercept, it does not pass between $[0,0]$ and $[1,0]$. Those two points belong to different classes, so any linear classifier must fail.\n", "\n", "An MLP solves this problem by introducing extra stages of processing. In our two layer example, suppose the dimensionality of the first layer is 2. We call the outputs of this layer \"hidden units\" because they are neither inputs nor outputs of the system; they are unobserved variables that the network must decide what to do with. The MLP can set one of these hidden units to be active when the sum of the two input variables is less than 1. It can set the other to be active when the sum of the two input variables is greater than 1. It can then set the output unit to be active by default, and to deactivate when either of the two hidden variables is active.\n", "\n", "More generally, an MLP with one sufficient large hidden layer can represent any function. This result is known as the \"universal approximator theorem.\"\n", "\n", "Another advantage of MLPs is that they can be made deeper and deeper, rather than just wider and wider. Many functions can be represented more efficiently (using fewer parameters) with a deep architecture than with a wide one. Using fewer parameters is beneficial both because the MLP takes less memory to represent, but also because the parameters may be estimated more accurately from a smaller amount of data.\n", "\n", "## Some detrimental properties of MLPs\n", "\n", "Unfortunately, just because an MLP can represent any function does not mean that it will learn to represent the right function. The problem of overfitting can still make the MLP perform badly on the test set even if it classifies the training set perfectly. While larger MLPs are capable of fitting more complicated training sets, they are also likely to overfit worse than smaller MLPs.\n", "\n", "A related issue with MLPs is that they have many configuration options. The model itself imposes design decisions such as what type of function to use for each layer, the dimensionality of each layer. Also, the log likelihood is no longer generally concave, so the choice of optimization procedure matters more than it did with softmax regression. These configuration options are known as \"hyperparameters.\" Choosing the right hyperparameters is an open and exciting research problem. \n", "\n", "Most of the hyperparameters in this tutorial were not chosen particularly carefully. Feel free to play with all of the settings in this notebook. If you find better ones, write to me and I'll put your settings and your name in the tutorial!" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "#Part 2: How to use pylearn2 to train an MLP\n", "\n", "Now that we've described the theory of what we're going to do, it's time to do it! This part describes\n", "how to use pylearn2 to run the algorithms described above.\n", "\n", "As in the softmax regression tutorial, we will use the MLP to do optical character recognition on the MNIST dataset.\n", "The yaml string we construct is similar ot the one we use before. The main difference is that the MLP model class\n", "takes a \"layers\" argument describing the various layers of the model.\n", "\n", "Note that for each layer, we need to specify what class to load. The identity of this class determines what type of layer\n", "appears at each position in the network. Here, we use a sigmoid hidden layer followed by a softmax output layer.\n", "\n", "Every layer of the MLP needs a unique name. Here we name the first hidden layer 'h0' and the output label representing the\n", "prediction of the class $y$ 'y'. These layer names are used to generate monitor channel names later so that we can track properties of each layer separately.\n", "\n", "The hidden layer needs some configuration that is pretty similar to the configuration for the output layer. Much as we need to tell the output layer its size (10 classes) we also need to tell the hidden layer its dimension, or the number of hidden units to go in that layer. In this case we use 500. We also need to tell it how to initialize its weights. The Sigmoid class supports the irange argument that we demonstrated for Softmax in the softmax regression tutorial, and we could use that here. Instead, we demonstrate a different argument, sparse_init. When sparse_init is specified, each unit gets exactly sparse_init non-zero weights initially. These weights are drawn from $N(0,1)$, so they are quite large compared to how weights are usually initialized.\n" ] }, { "cell_type": "code", "collapsed": false, "input": [ "import os\n", "import pylearn2\n", "path = os.path.join(pylearn2.__path__[0], 'scripts', 'tutorials', 'multilayer_perceptron', 'mlp_tutorial_part_2.yaml')\n", "with open(path, 'r') as f:\n", " train = f.read()\n", "hyper_params = {'train_stop' : 50000,\n", " 'valid_stop' : 60000,\n", " 'dim_h0' : 500,\n", " 'max_epochs' : 10000,\n", " 'save_path' : '.'}\n", "train = train % (hyper_params)\n", "print train" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "!obj:pylearn2.train.Train {\n", " dataset: &train !obj:pylearn2.datasets.mnist.MNIST {\n", " which_set: 'train',\n", " start: 0,\n", " stop: 50000\n", " },\n", " model: !obj:pylearn2.models.mlp.MLP {\n", " layers: [\n", " !obj:pylearn2.models.mlp.Sigmoid {\n", " layer_name: 'h0',\n", " dim: 500,\n", " sparse_init: 15,\n", " }, !obj:pylearn2.models.mlp.Softmax {\n", " layer_name: 'y',\n", " n_classes: 10,\n", " irange: 0.\n", " }\n", " ],\n", " nvis: 784,\n", " },\n", " algorithm: !obj:pylearn2.training_algorithms.bgd.BGD {\n", " batch_size: 10000,\n", " line_search_mode: 'exhaustive',\n", " conjugate: 1,\n", " updates_per_batch: 10,\n", " monitoring_dataset:\n", " {\n", " 'train' : *train,\n", " 'valid' : !obj:pylearn2.datasets.mnist.MNIST {\n", " which_set: 'train',\n", " start: 50000,\n", " stop: 60000\n", " },\n", " 'test' : !obj:pylearn2.datasets.mnist.MNIST {\n", " which_set: 'test',\n", " }\n", " },\n", " termination_criterion: !obj:pylearn2.termination_criteria.And {\n", " criteria: [\n", " !obj:pylearn2.termination_criteria.MonitorBased {\n", " channel_name: \"valid_y_misclass\"\n", " },\n", " !obj:pylearn2.termination_criteria.EpochCounter {\n", " max_epochs: 10000\n", " }\n", " ]\n", " }\n", " },\n", " extensions: [\n", " !obj:pylearn2.train_extensions.best_params.MonitorBasedSaveBest {\n", " channel_name: 'valid_y_misclass',\n", " save_path: \"mlp_best.pkl\"\n", " },\n", " ]\n", "}\n" ] } ], "prompt_number": 2 }, { "cell_type": "markdown", "metadata": {}, "source": [ "Note that we still do not specify a cost to be minimized. In the case of LogisticRegression, the model requested the negative log likelihood by default. In the case of the MLP, it is up to the final layer of the MLP to specify the default cost if the user does not provide one. In this case, since the final layer is a Softmax layer, we still have the same objective function as in the SoftmaxRegression tutorial.\n", "\n", "Now, we use pylearn2's yaml_parse.load to construct the Train object, and run its main loop. The same thing could be accomplished by running pylearn2's train.py script on a file containing the yaml string.\n", "\n", "Execute the next cell to train the model. This will take several minutes and possible as much as a few hours depending on how fast your computer is." ] }, { "cell_type": "code", "collapsed": false, "input": [ "from pylearn2.config import yaml_parse\n", "train = yaml_parse.load(train)\n", "train.main_loop()" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "compiling begin_record_entry...\n" ] }, { "output_type": "stream", "stream": "stderr", "text": [ "/u/goodfeli/pylearn2/models/mlp.py:36: UserWarning: MLP changing the recursion limit.\n", " warnings.warn(\"MLP changing the recursion limit.\")\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "compiling begin_record_entry done. Time elapsed: 0.479222 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitored channels: \n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling accum...\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "graph size: 160\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "graph size: 157\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "graph size: 157\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling accum done. Time elapsed: 11.082528 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23503398895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82355618477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06193995476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999900639057\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.909942150116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.508436858654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.901069939137\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.476713299751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.152832776308\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.480607658625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0718067958951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 0.000174344575498\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89326095581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98549151421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 2.30258440971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.0999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.099990285933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.0999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.901999950409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 2.30258440971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23503303528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82355594635\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06193971634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999884188175\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.910601377487\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.542480230331\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.899177610874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.477026820183\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.158626437187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.458495438099\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0697233080864\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 0.000107248379209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89326000214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98549151421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 2.30258440971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.0999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.0999902933836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.0999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.901359915733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 2.30258440971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23503398895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82355618477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06193995476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999902307987\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.910734891891\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.505713641644\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.897212743759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.477113306522\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.159442692995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.474104195833\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0706818476319\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 0.000110276472697\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89326095581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98549151421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 2.30258440971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.0999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.099990285933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.0999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.900900006294\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 2.30258440971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.338505 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 1\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 5\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 50000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.566698908806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.567735552788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.291175425053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.24065446854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.83268666267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.0723836422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999798893929\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.930105090141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.600322246552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.863031387329\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.476889610291\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.171247333288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.412737071514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0536084063351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 0.000199288566364\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89763784409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.99287319183\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0068221190013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.350786328316\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 2.74948716164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 2.56346487999\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 2.34412789345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999794960022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.840726792812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.207839608192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0983999967575\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.350786328316\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.701220929623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.34330791235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0764839723706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.24065446854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.83268642426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.07238340378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999829530716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.930867910385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.617025732994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.860394179821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.477169722319\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.177841931581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.386521846056\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0524694435298\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 0.000151637359522\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89763736725\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.99287295341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0068221190013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.372914284468\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 2.74948716164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 2.56346464157\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 2.34412789345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999826908112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.833846986294\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.198893502355\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.106319993734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.372914284468\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.701220929623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.343307882547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0764839798212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.24065446854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.83268666267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.0723836422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999864041805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.930580854416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.638543665409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.858349621296\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.477255016565\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.177810654044\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.361713379622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0531250722706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 0.000215846084757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89763784409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.99287319183\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0068221190013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.339448153973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 2.74948716164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 2.56346487999\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 2.34412789345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999945104122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.845010101795\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.196165680885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0965999960899\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.339448153973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.701220929623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.34330791235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0764839723706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.029214 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 2\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 100000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.648920476437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.385089039803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.205155700445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.2453122139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.8378276825\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.07804393768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999864637852\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.93498313427\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.613258361816\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.847131431103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.476234823465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.172577545047\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.381593316793\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0493729114532\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 0.000119279786304\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.90795898438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.99731445312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0140750305727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.296338170767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.20915484428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.00029850006\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 2.73683047295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.9999589324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.878535091877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.236884206533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0850000008941\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.296338170767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.839111089706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.403169810772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0928392037749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.24531269073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.83782744408\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.07804393768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999843478203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.935774207115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.630811154842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.843988478184\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.476507484913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.179330348969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.372446238995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.048459071666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 0.000123051402625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.90795898438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.99731445312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.014075031504\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.310930907726\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.20915460587\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.00029873848\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 2.73683071136\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999969184399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.872422754765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.206743046641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0889399945736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.310930907726\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.839111089706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.403169810772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0928391963243\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.2453122139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.8378276825\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.07804393768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999864220619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.935237765312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.672344446182\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.842247903347\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.476582586765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.178887397051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.358671993017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0488182529807\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 0.000185967219295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.90795898438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.99731445312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0140750305727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.286341637373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.20915484428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.00029850006\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 2.73683047295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999980926514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.880788624287\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.193636313081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0813999921083\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.286341637373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.839111089706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.403169810772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0928392037749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.009148 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 3\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 15\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 150000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.747792065144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.265085607767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.150685995817\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.24948835373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.84261131287\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.08266615868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.99994790554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.937485575676\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.633630394936\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.859075248241\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.475113451481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.166715249419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.368945479393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0472293719649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 5.30257530045e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.91970491409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.00150084496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0220027510077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.269680500031\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.56634759903\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.29666876793\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.00721621513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999979376793\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.893490552902\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.250094264746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0763000026345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.269680500031\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.959613263607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.443394243717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.103941932321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.24948787689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.84261083603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.08266615868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.99988758564\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.938323676586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.649454653263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.846590101719\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.475384742022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.171920359135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.365952074528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0464779213071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 6.07749607298e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.91970491409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.00150060654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.022002749145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.278353452682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.56634736061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.29666852951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.00721621513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999987363815\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.889036417007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.227912455797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0788599997759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.278353452682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.959613204002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.443394213915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.103941932321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.24948835373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.84261131287\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.08266615868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999919652939\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.937573850155\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.684871912003\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.850003778934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.475453108549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.170857235789\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.353432744741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0467779003084\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 6.80360026308e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.91970491409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.00150084496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0220027510077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.26020783186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.56634759903\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.29666876793\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.00721621513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999977052212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.896274268627\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.17623616755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0750000029802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.26020783186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.959613263607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.443394243717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.103941932321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.058853 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 4\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 20\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 200000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.788351774216\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.187993511558\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.113317854702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.25235366821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.84656834602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.08510184288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999974727631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.938515424728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.650707960129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.87255191803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.474163293839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.160470247269\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.364907234907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0464833118021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.23769111471e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.93058395386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.0049738884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0284670460969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.252513170242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.77643465996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.49576759338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.21715569496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999990880489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.902969479561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.223742827773\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0724000036716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.252513170242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.04190921783\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.47004455328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.109351947904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.25235366821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.84656858444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.08510160446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999940037727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.939188420773\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.661542713642\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.85992783308\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.474434643984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.163209468126\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.358978569508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0456797704101\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 3.15167126246e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.93058395386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.00497412682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0284670442343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.257761448622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.77643465996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.49576735497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.21715545654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999995172024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.898737490177\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.233332633972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0732599943876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.257761448622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.04190921783\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.470044583082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.109351947904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.25235366821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.84656834602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.08510184288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999963521957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.938330054283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.685399234295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.864110708237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.474497437477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.161501988769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.347681999207\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0459976904094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 2.87672100967e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.93058395386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.0049738884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0284670460969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.242218419909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.77643465996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.49576759338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.21715569496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999983727932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.90525239706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.237812787294\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.070799998939\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.242218419909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.04190921783\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.47004455328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.109351947904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 34.824181 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 5\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 25\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 250000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.822910606861\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.140246614814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0910708159208\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.2554602623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.85085010529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.08709287643\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999985814095\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.939129829407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.667058110237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.881521999836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.473096251488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.148683413863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.366505622864\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0459363907576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 9.1133879323e-06\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.94399118423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.00873041153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0347110852599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.236052155495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 3.98437142372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.68210268021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.41360712051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.99999153614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.909221351147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.227106332779\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0672999992967\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.236052155495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.12676775455\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.494562119246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.114525236189\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.2554602623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.85085010529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.08709263802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999965369701\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.939886808395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.672379374504\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.869372367859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.473366141319\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.151700764894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.357233524323\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0450618416071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.45595986396e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.9439907074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.00873041153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0347110852599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.239308148623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 3.9843711853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.68210220337\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.41360712051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999996185303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.905649185181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.236008346081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0679599940777\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.239308148623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.12676763535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.494562089443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.114525228739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.2554602623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.85085010529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.08709287643\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999980926514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.939110815525\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.683836042881\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.873598277569\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.473425507545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.149841591716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.346154510975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0454438403249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.18227362691e-05\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.94399118423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.00873041153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0347110852599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.22658072412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 3.98437142372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.68210268021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.41360712051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999987483025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.911411643028\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.217763110995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0644000023603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.22658072412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.12676775455\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.494562119246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.114525236189\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.012249 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 6\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 30\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 300000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.849331319332\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.110973127186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0771789103746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.25832700729\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.85529947281\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.08869576454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999991595745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.93943220377\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.680398881435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.887371778488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.472293674946\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.139431104064\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.367107391357\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0457468703389\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 3.69549866264e-06\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.9600777626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.01261997223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0412151031196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.222071394324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.16519927979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 3.85762476921\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.61017894745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999991238117\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.913735508919\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.246407344937\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0631999969482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.222071394324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.19918644428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.517221450806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.117476500571\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.25832748413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.85529899597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.08869576454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999979615211\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.94024169445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.675026059151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.87550008297\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.472564071417\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.142730906606\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.356041908264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.044754832983\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 6.11660334471e-06\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.96007823944\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.01261997223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0412151031196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.222275063396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.16519880295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 3.85762453079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.61017894745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999996602535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.910623729229\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.235357835889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.062839999795\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.222275063396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.19918644428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.517221450806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.11747649312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.25832700729\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.85529947281\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.08869576454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999989330769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.939590632915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.678366243839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.879810392857\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.472620040178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.140709280968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.344533830881\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0452971383929\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 4.94029472975e-06\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.9600777626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.01261997223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0412151031196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.213480621576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.16519927979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 3.85762476921\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.61017894745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999992728233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.915528953075\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.230840429664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0590999983251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.213480621576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.19918644428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.517221450806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.117476500571\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 34.796789 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 7\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 35\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 350000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.921035170555\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0949304848909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0732585340738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.26188564301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.86070275307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.09020781517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999995708466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.940146625042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.672576725483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.892456889153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.47117972374\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.127655550838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.367071986198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0451025255024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.38111693104e-06\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.97794675827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.01733326912\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0475185476243\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.2069362849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.37119436264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.05648756027\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.72235488892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999992549419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.920760273933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.212535321712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0597999989986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.2069362849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.28081488609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.54237049818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.120768107474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.26188564301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.86070251465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.09020781517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999989151955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.941006839275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.670265555382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.880909919739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.471454769373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.130571871996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.354819297791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0440064184368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 2.32596198657e-06\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.97794628143\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.0173330307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0475185438991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.205675914884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.3711938858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.05648708344\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.72235488892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999997496605\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.917994856834\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.242114007473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0586799941957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.205675914884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.2808150053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.542370438576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.120768100023\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.26188564301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.86070275307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.09020781517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999994754791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.940389454365\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.653915822506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.885270357132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.471503049135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.129038855433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.343496620655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0445692464709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.89789943761e-06\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.97794675827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.01733326912\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0475185476243\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.199690312147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.37119436264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.05648756027\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.72235488892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999996244907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.922058641911\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.22336602211\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.055799998343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.199690312147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.28081488609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.54237049818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.120768107474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 34.805092 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 8\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 40\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 400000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 0.991648554802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0825677365065\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0698289051652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.26615095139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.86642217636\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.0920112133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999997377396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.940795004368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.66545778513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.901528179646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.470299869776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.121718779206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.370387345552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0449309423566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 5.55576320949e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.99863862991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.02230143547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0541109740734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.1924007833\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.68016433716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.25164651871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.82015967369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999988377094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.924113929272\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.210057422519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0555000007153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.1924007833\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.36218941212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.566706836224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.123096778989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.26615047455\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.86642193794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.0920112133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999993860722\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.941651582718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.657282650471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.89084905386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.470575273037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.124335050583\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.357388138771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0438850969076\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 9.09530456283e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.99863910675\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.02230119705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0541109666228\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.187867701054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.680164814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.25164651871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.82015943527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999996304512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.922073721886\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.237471118569\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0530999973416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.187867701054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.36218929291\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.566706776619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.123096778989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.26615095139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.86642217636\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.0920112133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999996244907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.940959215164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.634269952774\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.894827961922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.470626890659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.123129568994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.344170331955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0444831475616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 7.30816509531e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.99863862991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.02230143547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0541109740734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.184409946203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.68016433716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.25164651871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.82015967369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999994754791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.926723182201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.219980046153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.047499999404\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.184409946203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.36218941212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.566706836224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.123096778989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.663056 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 9\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 45\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 450000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.00632071495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0730155408382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0651284307241\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.27027750015\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.87175488472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.09271168709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.99999833107\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.941553533077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.65441852808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.903928875923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.469605773687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.114903002977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.373793333769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.044343251735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.48894650667e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.01675319672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.0269382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0595724433661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.178400695324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.93448925018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.4312376976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.912296772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.99998986721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.929982662201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.206445708871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0520999990404\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.178400695324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.42163467407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.588779568672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.124702431262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.27027750015\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.87175512314\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.09271168709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999995946884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.942493140697\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.638945221901\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.893475353718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.469883978367\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.117275975645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.360578835011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0432931296527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 3.94163265582e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.01675271988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.0269382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0595724396408\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.173733517528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.93448877335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.4312376976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.91229653358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999996066093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.92810434103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.229242756963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0490399971604\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.173733517528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.42163455486\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.588779509068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.124702423811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.27027750015\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.87175488472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.09271168709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999997377396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.941749632359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.622578442097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.897465348244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.469932496548\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.116939790547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.347404718399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0439214892685\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 3.13890211601e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.01675319672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.0269382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0595724433661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.172197133303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.93448925018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.4312376976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.912296772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999996781349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.932501792908\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.216077208519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0454999953508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.172197133303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.42163467407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.588779568672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.124702431262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.404834 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 50\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 500000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.06833612919\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0678643658757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0653440654278\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.27522420883\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.87793588638\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.09417295456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999998867512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.942130804062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.645175695419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.909636974335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.468845933676\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.104815065861\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.378569096327\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0440588444471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.15133666156e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.03866481781\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.03230404854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.065353885293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.167283341289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.2253780365\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.62542486191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.01688957214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999992907047\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.933511257172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.242168530822\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0492999963462\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.167283341289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.50107598305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.612406551838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.125712171197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.27522373199\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.87793540955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.09417295456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999997496605\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.943212330341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.628583967686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.899803757668\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.469121694565\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.107625767589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.36565092206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0430302321911\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.75549445203e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.03866481781\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.03230404854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.065353885293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.159167990088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.22537755966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.62542486191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.01688957214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999997138977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.931973934174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.241810530424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0449799969792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.159167990088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.50107610226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.612406492233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.125712156296\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.27522420883\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.87793588638\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.09417295456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999998152256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.942497193813\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.619423508644\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.903488636017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.469177812338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.108095638454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.349716216326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.04355686903\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.34484281489e-07\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.03866481781\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.03230404854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.065353885293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.160998404026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.2253780365\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.62542486191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.01688957214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999998152256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.936175227165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.220791786909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0441000014544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.160998404026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.50107598305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.612406551838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.125712171197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.425083 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 55\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 550000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.14648592472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0634888410568\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0666681230068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.28032588959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.88434314728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.09576916695\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999999403954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.942800343037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.63667178154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.915984809399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.468008965254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.101051539183\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.390204340219\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0434938073158\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 5.66224080956e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.06034469604\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.03785538673\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0704936757684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.15456405282\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.50095510483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.82304191589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.1173620224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999992728233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.936915397644\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.252786010504\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0443000011146\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.15456405282\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.60092997551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.636273026466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.124862372875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.28032636642\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.88434290886\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.09576892853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999998629093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.944033026695\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.631079792976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.90686249733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.468293100595\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.103928506374\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.373679548502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0424839258194\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 8.3652395233e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.06034517288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.03785514832\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0704936683178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.146077007055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.50095510483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.82304239273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.11736249924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999997377396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.935088992119\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.235717624426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0411599949002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.146077007055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.60092973709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.636273086071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.124862357974\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.28032588959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.88434314728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.09576916695\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999998867512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.943427741528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.627752363682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.910161554813\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.468341171741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.104510381818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.357529014349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0429090820253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 6.19904838572e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.06034469604\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.03785538673\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0704936757684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.149976089597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.50095510483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.82304191589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.1173620224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999998509884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.939062952995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.239928662777\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0416000001132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.149976089597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.60092997551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.636273026466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.124862372875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.174293 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 60\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 600000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.16790962219\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0593062080443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0650760680437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.28521823883\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.89019036293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.09752202034\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 0.999999582767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.94396853447\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.629440486431\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.920006334782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.467411011457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0957048162818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.389512062073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0425479598343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 3.20807167498e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.08012914658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.04289364815\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0743318274617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.144802451134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.74849033356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.00328540802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.21305179596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999994158745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.941429018974\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.231030538678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0408000014722\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.144802451134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.7184125185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.658156752586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.125041946769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.28521871567\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.89019012451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.09752202034\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.945232570171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.634238958359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.911378622055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.467698544264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0993719547987\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.373709738255\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0415380932391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 4.67483047828e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.08012914658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.04289340973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0743318200111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.135217413306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.74849033356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.00328493118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.21305131912\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999997973442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.939604878426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.252161383629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0378999970853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.135217413306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.71841263771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.658156752586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.125041931868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.28521823883\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.89019036293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.09752202034\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.99999922514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.944651842117\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.645568966866\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.914412498474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.467748105526\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0972835198045\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.359061449766\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0419331230223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 3.37856427279e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.08012914658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.04289364815\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0743318274617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.141469165683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.74849033356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.00328540802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.21305179596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999998867512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.943582773209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.241308540106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0379000008106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.141469165683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.7184125185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.658156752586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.125041946769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.417259 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 13\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 65\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 650000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.26017534733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0564817748964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.066411331296\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.29147386551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.89687585831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.09867763519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.944756031036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.627687215805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.920987069607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.46668151021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0932114943862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.397424399853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.041878964752\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.39939251298e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.10229206085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.04865932465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0787999555469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.135829210281\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.01105213165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.20304250717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.33085250854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999994754791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.945015072823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.230172082782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0381999947131\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.135829210281\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.85168874264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.682141900063\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.125363498926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.29147338867\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.89687561989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.09867739677\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999403954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.946107804775\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.63179987669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.912519574165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466963618994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0961530357599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.379027783871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0408683530986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.94427727251e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.10229253769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.04865932465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0787999555469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.12386597693\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.01105213165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.20304203033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.33085203171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999997973442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.943518102169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.246507614851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.034559994936\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.12386597693\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.85168862343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.682141840458\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.125363498926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.29147386551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.89687585831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.09867763519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999999403954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.945632517338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.651219964027\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.915507853031\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.467023015022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0969914197922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.364903271198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0411523580551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.40916096569e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.10229206085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.04865932465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0787999555469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.133389517665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.01105213165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.20304250717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.33085250854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999165535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.946852385998\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.214304342866\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.03579999879\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.133389517665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.85168874264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.682141900063\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.125363498926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.366187 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 14\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 70\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 700000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.40761697292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0550340935588\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0714166760445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.29854393005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.90459442139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.1004254818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.94591987133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.614766418934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.921078026295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466091096401\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0916782915592\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.396448850632\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0410171151161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 7.75897479599e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.12455701828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.05531406403\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0834630578756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.125504016876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.29601860046\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.42890501022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.46609354019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999994575977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.949410498142\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.201501131058\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0355000011623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.125504016876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.01360034943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.709331393242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.125074863434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.29854393005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.90459418297\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.10042524338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999523163\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.947336554527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.624508261681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.912684559822\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466372013092\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0946839675307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.383265286684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0400523841381\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.04573256721e-08\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.12455654144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.05531382561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0834630504251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.112524747849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.29601955414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.42890501022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.46609306335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999997973442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.948245584965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.237888276577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.031159998849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.112524747849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.01360034943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.709331333637\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.125074848533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.29854393005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.90459442139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.1004254818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 0.999999582767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.946813523769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.649647653103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.915705919266\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466423898935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0953802764416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.369607925415\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0402967631817\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 7.3467920636e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.12455701828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.05531406403\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0834630578756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.124651312828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.29601860046\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.42890501022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.46609354019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.950519561768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.27420938015\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0340000018477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.124651312828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.01360034943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.709331393242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.125074863434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.379965 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 15\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 75\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 750000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.47251427174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0522134304047\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.071938700974\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.30543804169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.91161727905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.10170149803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.947175860405\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.611504435539\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.926122069359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466326773167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0923119410872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.401742935181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.040495429188\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 3.92714794017e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.1450252533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.0613322258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0881084352732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.118968196213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.55995035172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.62976980209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.59543800354\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.951547503471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.228803291917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0349999964237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.118968196213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.14034724236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.733418226242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.12729588151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.30543756485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.91161704063\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.10170149803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999880791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.948555886745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.618095517159\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.918341517448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466599404812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0956889539957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.392006248236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0395230464637\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 5.12299225264e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.14502477646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.06133174896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.088108420372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.103299617767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.55995082855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.62976932526\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.5954375267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999997377396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.951093494892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.249234974384\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0284799989313\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.103299617767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.14034700394\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.733418226242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.12729588151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.30543804169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.91161727905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.10170149803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.947986066341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.642793953419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.920964062214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466656267643\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0940045118332\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.377251118422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.03970798105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 3.59755203405e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.1450252533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.0613322258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0881084352732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.119057364762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.55995035172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.62976980209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.59543800354\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999998807907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.953496754169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.279151201248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0322999954224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.119057364762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.14034724236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.733418226242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.12729588151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.163641 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 16\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 80\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 800000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.55044400692\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0495749413967\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.071437291801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.31254959106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.91860723495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.10440206528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.948059678078\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.594348907471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.927690863609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465816915035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0875093266368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.399484992027\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0397286936641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.14466333581e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.16418838501\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.06732678413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.091041892767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.111787736416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.79865264893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.8274474144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.71656274796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999996483326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.954726696014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.287018150091\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0328000001609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.111787736416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.27131104469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.757337749004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.12875507772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.31254959106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.91860699654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.10440182686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999880791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.949532628059\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.603366672993\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.920095324516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466088950634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0905980989337\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.391806066036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0387711115181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 2.82344658764e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.16418838501\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.06732654572\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0910418853164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0944318547845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.79865264893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.82744646072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.71656322479\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999998569489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.954577803612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.255649060011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0261199977249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0944318547845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.27131080627\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.757337749004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.128755062819\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.31254959106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.91860723495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.10440206528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.948857724667\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.6251745224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.922635018826\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.46614703536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0918302312493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.379304587841\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0389546044171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.96204941183e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.16418838501\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.06732678413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.091041892767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.110771089792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.79865264893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.8274474144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.71656274796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999165535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.95663100481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.264041811228\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0305000003427\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.110771089792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.27131104469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.757337749004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.12875507772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.246666 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 17\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 85\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 850000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.59982562065\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0473937280476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0712730288506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.31961965561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.92528343201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.10622811317\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.949356853962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.59099650383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.927693426609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465647280216\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0867232903838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.39404541254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0387796163559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.4791411429e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.18163251877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.07301926613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0938726961613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.106328338385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 7.01830482483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.0149974823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.83683490753\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999997198582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.95773011446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.291382759809\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0320000015199\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.106328338385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.38739275932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.780075967312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.130353063345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.31961917877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.92528319359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.10622787476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.950781822205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.600085794926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.920143485069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.465922415257\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0898449495435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.391092181206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0378985367715\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.99124361444e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.18163204193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.07301878929\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0938726961613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.088271394372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 7.01830387115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.0149974823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.83683490753\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999998629093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.957574307919\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.276376664639\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.023999998346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.088271394372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.3873925209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.780075907707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.130353048444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.31961965561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.92528343201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.10622811317\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.950090706348\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.620329141617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.922675073147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.465976387262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0912392660975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.378798425198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0380813851953\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.35891120578e-09\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.18163251877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.07301926613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0938726961613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.107352338731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 7.01830482483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.0149974823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.83683490753\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999998867512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.959039092064\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.278402447701\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0296999998391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.107352338731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.38739275932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.780075967312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.130353063345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.302343 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 18\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 90\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 900000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.79280376434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0464615598321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0771328359842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.32822799683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.93359160423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.10832476616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.95045799017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.586617648602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.929918944836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465379714966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.083888605237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.397964477539\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0380010083318\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 7.37118366345e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.20447731018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.08011174202\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0980293303728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.100425355136\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 7.28403282166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.2393155098\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.98830795288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999997019768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.959611177444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.283116281033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.03039999865\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.100425355136\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.53001952171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.806962490082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.131183430552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.32822799683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.93359088898\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.10832476616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.951834976673\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.594883143902\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.922610759735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.465650081635\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0870256572962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.393012464046\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0370769426227\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 9.6733221433e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.20447683334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.0801115036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0980293378234\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0801135376096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 7.28403186798\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.23931598663\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.98830747604\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999998509884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.960199356079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.269580304623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0213200002909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0801135376096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.53001952171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.806962549686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.131183415651\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.32822799683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.93359160423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.10832476616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.951114416122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.613163709641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.925033152103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.465698361397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0884924307466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.386198699474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0373685508966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 6.73591848965e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.20447731018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.08011174202\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0980293303728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.101348236203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 7.28403282166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.2393155098\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.98830795288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.99999922514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.961142122746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.255374312401\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.028299998492\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.101348236203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.53001952171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.806962490082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.131183430552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.215917 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 19\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 95\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 950000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 1.94697141647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0453744120896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0806727781892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.33764886856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.94183731079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.11102938652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.951863646507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.580549895763\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.932179749012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465434730053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0796971917152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.390337795019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0372235476971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 6.10773209786e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.22417736053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.08713316917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.101160049438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0948458611965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 7.54131317139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.45906209946\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.14208126068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999998509884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.962593019009\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.309717655182\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0273999981582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0948458611965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.65757870674\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.83378046751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.132128432393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.3376493454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.94183754921\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.1110291481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.953146517277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.591403305531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.925151884556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.465704083443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0828539133072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.392235994339\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0363104119897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 8.38429381478e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.2241768837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.08713316917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.101160041988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.073119558394\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 7.54131317139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.45906209946\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.14208078384\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.963022887707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.268300741911\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0194799974561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.073119558394\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.65757846832\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.833780527115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.132128432393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.33764886856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.94183731079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.11102938652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.952474594116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.606046676636\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.927380979061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.465753525496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0843893289566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.386562854052\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0366778969765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 5.66411417768e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.22417736053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.08713316917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.101160049438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.09637324512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 7.54131317139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.45906209946\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.14208126068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999463558\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.96346116066\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.277560830116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0262000001967\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.09637324512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.65757870674\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.83378046751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.132128432393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 34.760706 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 20\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 100\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1000000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.02213191986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0437575168908\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.081667304039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34621286392\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.94933509827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.11350440979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.953083157539\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.574586033821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.934979915619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465407788754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0830942466855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.386586099863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0363725870848\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 3.24080540182e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.2420706749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.09350514412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.104648023844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0911609381437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 7.76595830917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.65801715851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.27815532684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999998688698\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.964522898197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.28780567646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0263999979943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0911609381437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.76887655258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.858034849167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.135387971997\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.34621238708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.94933462143\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.11350440979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.95438170433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.584669828415\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.928267598152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.465672910213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0862845480442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.389768064022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0354867391288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 4.38173886064e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.2420706749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.0935049057\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.104648023844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0672194138169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 7.76595830917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.65801715851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.27815580368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999523163\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.965664386749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.276637971401\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0176799986511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0672194138169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.76887631416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.858034789562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.135387957096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34621286392\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.94933509827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.11350440979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.953744530678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.597306787968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.930288851261\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.465717792511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.087476670742\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.389485627413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0357559174299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 3.05218794683e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.2420706749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.09350514412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.104648023844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0925975292921\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 7.76595830917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.65801715851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.27815532684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999761581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.965861082077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.303610026836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0258000008762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0925975292921\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.76887655258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.858034849167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.135387971997\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.213061 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 21\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1050000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.08118438721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0415316298604\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.080756470561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.35434007645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.95622348785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.11573195457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.953851401806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.567606449127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.933193147182\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465032488108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0830998793244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.383445978165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0356372632086\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.19485554731e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.25859546661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.09933209419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.107006825507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0886002033949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 7.9637556076\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.83463764191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.3923330307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.99999833107\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.965270340443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.310471683741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0262000001967\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0886002033949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.86672186852\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.879510939121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.136433556676\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.35433912277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.95622301102\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.11573171616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.955171644688\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.579390406609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.926286578178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.465295374393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0863517001271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.384008407593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0348346866667\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 2.7790120205e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.25859498978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.09933185577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.107006818056\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0625123158097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 7.96375513077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.83463668823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.3923330307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.99999922514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.967036545277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.273270666599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0158599987626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0625123158097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.8667216301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.879510939121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.136433571577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.35434007645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.95622348785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.11573195457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.95438760519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.590360045433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.928494334221\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.465345591307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0878760442138\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.384474813938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0351748354733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.96166291544e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.25859546661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.09933209419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.107006825507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0909144356847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 7.9637556076\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.83463764191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.3923330307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999403954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.966769099236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.282997220755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.025399999693\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0909144356847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.86672186852\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.879510939121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.136433556676\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.132773 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 22\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 110\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1100000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.14148879051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0403550490737\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0810787156224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.3625164032\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.96336507797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.11782503128\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.954942882061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.564869940281\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.935991108418\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465213596821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0809470117092\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.385282725096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0350002162158\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.53522847213e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.27728748322\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.10535025597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.109762132168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0847353041172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 8.15684700012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 7.01448202133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.519551754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999998867512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.967154860497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.283250451088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0249000005424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0847353041172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 2.96138525009\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.901844441891\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.138287782669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.3625164032\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.96336531639\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.11782479286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.956164836884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.575154662132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.929373860359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.465472817421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0842097327113\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.385039448738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0342263542116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.99991759264e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.27728748322\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.10535001755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.109762117267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0575138144195\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 8.15684700012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 7.01448202133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.51955223083\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999582767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.96871650219\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.287014901638\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0142399985343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0575138144195\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 2.96138525009\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.901844382286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.138287782669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.3625164032\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.96336507797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.11782503128\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.955441474915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.589357554913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.93136715889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.46551990509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.086060911417\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.390778958797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0345365256071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.45148310038e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.27728748322\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.10535025597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.109762132168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0865774899721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 8.15684700012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 7.01448202133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.519551754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999761581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.96779280901\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.273192465305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0244999974966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0865774899721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 2.96138525009\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.901844441891\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.138287782669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.193111 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 23\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1150000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.29178571701\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0395583026111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0849489048123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.37209796906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.97117829323\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.11957788467\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.956251323223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.561847269535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.934819757938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465812414885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0860762521625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.382852345705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0343066453934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.00234549827e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.29464244843\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.11194372177\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.112373262644\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0813909471035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 8.37556743622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 7.21202421188\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.66676425934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.99999922514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.969460964203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.304885983467\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0245999991894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0813909471035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.05758142471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.926100432873\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.141218408942\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.37209796906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.97117805481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.11957764626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.957390427589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.571023106575\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.928050994873\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466074705124\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.089665055275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.383693158627\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0335417687893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.25948085294e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.29464149475\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.11194324493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.112373247743\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0530071258545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 8.37556743622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 7.21202325821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.6667637825\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999761581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.971323847771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.274939656258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0134199988097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0530071258545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.05758142471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.926100373268\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.141218394041\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.37209796906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.97117829323\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.11957788467\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.956661045551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.585293292999\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.930199086666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466111898422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0879896134138\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.389526426792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0339160002768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 9.11426628614e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.29464244843\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.11194372177\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.112373262644\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0844431295991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 8.37556743622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 7.21202421188\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.66676425934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999761581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.970053553581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.252451866865\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0244999974966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0844431295991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.05758142471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.926100432873\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.141218408942\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.101327 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 24\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 120\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1200000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.4745285511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.037980530411\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0874084308743\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.38188457489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.97928380966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.12256121635\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.957348406315\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.559364676476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.934902369976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.465777903795\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0820802301168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.37371224165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0335819907486\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 6.84129905504e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.31191539764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.11876320839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.114646181464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0791404470801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 8.59417057037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 7.40912103653\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.81003856659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.99999922514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.969864010811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.260499119759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0230999998748\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0791404470801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.15858983994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.950569629669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.144145652652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.38188409805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.97928357124\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.12256097794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.958476305008\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.567814290524\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.928138375282\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.46603512764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0855919569731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.379186630249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0329259894788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 8.38127969804e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.31191492081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.11876296997\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.114646181464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0484027862549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 8.59417057037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 7.40912055969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.81003761292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999701977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.972274065018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.297603964806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0116999996826\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0484027862549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.15858960152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.95056951046\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.144145637751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.38188457489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.97928380966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.12256121635\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.957733333111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.57974678278\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.930305242538\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466072052717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0875690802932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.382509231567\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0332807153463\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 6.19569395788e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.31191539764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.11876320839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.114646181464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0832240283489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 8.59417057037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 7.40912103653\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.81003856659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999761581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.970567047596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.264748305082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.023999998346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0832240283489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.15858983994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.950569629669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.144145652652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.537865 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 25\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1250000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.61537218094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0366696789861\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0890378654003\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.39218759537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.98763632774\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.1254658699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.958310782909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.550610423088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.936276137829\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.46598726511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0805417820811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.375468403101\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0328881442547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 7.84403653142e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.33220767975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.1257724762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.116853624582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0754533782601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 8.81067371368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 7.60889148712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.96597194672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999761581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.971746265888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.288777351379\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0232999995351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0754533782601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.24519085884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.975342810154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.148321658373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.3921880722\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.98763632774\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.1254658699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.959453582764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.561280608177\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.929621398449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466242551804\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0841432288289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.38017898798\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0322615392506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.0068777756e-10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.33220720291\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.1257724762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.116853624582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.043993473053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 8.81067276001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 7.60889053345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.96597194672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999821186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.974251687527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.270618349314\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0104199992493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.043993473053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.24519062042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.975342690945\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.148321658373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.39218759537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.98763632774\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.1254658699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.958616793156\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.574836432934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.931737542152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466278731823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0861588418484\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.383438080549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.032565869391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 7.15359646519e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.33220767975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.1257724762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.116853624582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0792490914464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 8.81067371368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 7.60889148712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.96597194672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999821186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.972301781178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.278648257256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0228000003844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0792490914464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.24519085884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.975342810154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.148321658373\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.095306 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 26\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 130\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1300000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.71106290817\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0348753891885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0883127823472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.4017291069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.99520802498\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.12854385376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.959264814854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.55078792572\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.935866773129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466203004122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.078706741333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.367448121309\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0321592055261\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 4.60236952715e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.34829235077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.13210654259\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.118406176567\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0733289569616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 9.00574874878\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 7.78995084763\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 6.10382938385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999761581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.972537279129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.267330288887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0230999998748\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0733289569616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.33722496033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.997784733772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.151363104582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.40172863007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.9952082634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.12854361534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.960306882858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.562210321426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.929156780243\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466451466084\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0823357179761\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.377736270428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0315755605698\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 5.56277697517e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.34829139709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.13210630417\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.118406184018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0409014374018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 9.00574874878\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 7.78995037079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 6.10382938385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999821186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.975649058819\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.290484070778\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00971999950707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0409014374018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.33722496033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.997784733772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.151363104582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.4017291069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.99520802498\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.12854385376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.959495425224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.576115489006\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.931356489658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466476142406\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.084395840764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.37360149622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0320250503719\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 4.11951479873e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.34829235077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.13210654259\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.118406176567\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0791732370853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 9.00574874878\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 7.78995084763\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 6.10382938385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999821186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.973247587681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.254454284906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0232999995351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0791732370853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.33722496033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.997784733772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.151363104582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.406078 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 27\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1350000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 2.80285286903\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0334513224661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.088192678988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.41177082062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.00275707245\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.13091373444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.960214793682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.547308385372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.936411142349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466299444437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0786798894405\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.366961061954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0315478779376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 4.00019496694e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.36605072021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.13841247559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.119428776205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0725825279951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 9.19264411926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 7.96643924713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 6.2465171814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999821186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.974697828293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.284473180771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0219000000507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0725825279951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.41140413284\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.01977562904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.155052781105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.41176986694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.00275659561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.13091373444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.96123111248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.556509852409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.929732501507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466540902853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0823666229844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.371994018555\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0308939814568\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 5.01665688157e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.36605024338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.13841223717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.119428783655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0370035469532\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 9.19264411926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 7.96643972397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 6.24651670456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.977714180946\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.2884734869\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00885999947786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0370035469532\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.41140389442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.01977562904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.155052781105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.41177082062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.00275707245\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.13091373444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.960400640965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.574073672295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.931940674782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466566413641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0844538062811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.369769692421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0312857404351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 3.6578275131e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.36605072021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.13841247559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.119428776205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0765716135502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 9.19264411926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 7.96643924713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 6.2465171814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.974825143814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.268961429596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0228999983519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0765716135502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.41140413284\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.01977562904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.155052781105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 34.780491 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 28\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 140\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1400000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 3.07722043991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0323846936226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0927985981107\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.42322683334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.01182746887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.13467645645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.961281061172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.549638330936\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.939934492111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466522186995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0823039337993\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.357347339392\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.030734334141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 5.08886266459e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.38524675369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.1459903717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.121352598071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0716430544853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 9.41203117371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 8.17550086975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 6.39991140366\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999821186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.974777877331\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.270264923573\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0223999992013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0716430544853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.5011806488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.04629290104\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.159884780645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.42322635651\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.01182699203\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.13467645645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.962265074253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.556583762169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.93360298872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.4667532444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0861736312509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.366083562374\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0301264487207\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 6.59544779902e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.38524627686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.1459903717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.121352590621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0347100757062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 9.41203117371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 8.17550086975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 6.39991092682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.978323638439\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.29167419672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00763999950141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0347100757062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.50118041039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.04629290104\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.159884765744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.42322683334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.01182746887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.13467645645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.961273550987\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.570200264454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.935558438301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466782003641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0883660390973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.355543404818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0304867494851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 4.62212004781e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.38524675369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.1459903717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.121352598071\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0746665000916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 9.41203117371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 8.17550086975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 6.39991140366\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999821186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.975300252438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.280865699053\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0222999975085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0746665000916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.5011806488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.04629290104\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.159884780645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.278322 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 29\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1450000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 3.31815242767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0319525785744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0989938527346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.43632364273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.02131462097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.13684439659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.96216905117\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.548579275608\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.941554307938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.46652469039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0799239650369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.357737779617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0300854835659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.19761518011e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.40747022629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.15389037132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.123720750213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0690323263407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 9.64226436615\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 8.3891248703\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 6.57722139359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.976467430592\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.293188840151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0212999973446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0690323263407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.5816681385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.07294213772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.162085324526\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.43632364273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.02131462097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.13684439659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.963165700436\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.55665397644\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.935373008251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466756403446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0838716328144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.36525374651\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0295039452612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 2.68275124338e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.40747022629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.15389037132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.123720750213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0306258164346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 9.64226341248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 8.3891248703\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 6.57722091675\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.980324864388\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.283443570137\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00647999951616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0306258164346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.58166790009\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.07294213772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.162085309625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.43632364273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.02131462097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.13684439659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.962217152119\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.571269631386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.937248468399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466767311096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0859551951289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.352124005556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0299664791673\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 2.06817705323e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.40747022629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.15389037132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.123720750213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0733132436872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 9.64226436615\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 8.3891248703\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 6.57722139359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.976790785789\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.291347831488\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0217000003904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0733132436872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.5816681385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.07294213772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.162085324526\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.082858 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 30\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 150\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1500000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 3.39051413536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0302216522396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0965146124363\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.44657659531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.02922582626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.14045143127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.963280200958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.548351347446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.940559446812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466341674328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0799687504768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.357499152422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0293492469937\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.20450845079e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.4218788147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.16045355797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.124831520021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0672078579664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 9.82299423218\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 8.56633377075\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 6.71553707123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.977503836155\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.255842655897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0198999978602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0672078579664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.65550899506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.09536457062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.163716614246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.44657611847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.02922534943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.14045143127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.964230835438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.55356913805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.934283614159\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466563820839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0839123427868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.358219176531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0287974383682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 2.7636832059e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.42187833786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.16045331955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.12483151257\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0282621402293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 9.82299423218\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 8.56633377075\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 6.71553659439\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.981470048428\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.304827183485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00591999944299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0282621402293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.65550875664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.09536445141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.163716599345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.44657659531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.02922582626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.14045143127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.963276088238\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.567677497864\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.936259627342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466583073139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0857717692852\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.344594448805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0292918123305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 2.15348190669e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.4218788147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.16045355797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.124831520021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0722089111805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 9.82299423218\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 8.56633377075\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 6.71553707123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.977750241756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.297483742237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.021099999547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0722089111805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.65550899506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.09536457062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.163716614246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.012923 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 31\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 155\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1550000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 3.48831152916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0287408661097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0940494984388\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.45725250244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.03711128235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.14304447174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.963537156582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.54846316576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.940077364445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466366380453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0763043165207\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.358212590218\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0289474800229\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.33178042847e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.44061088562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.16697835922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.125991553068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0662763118744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 10.0062093735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 8.73837566376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 6.84926891327\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.978273510933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.285628795624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0193999987096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0662763118744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.72132134438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.11716985703\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.168285727501\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.45725250244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.03711175919\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.14304423332\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.964494287968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.551624715328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.933692634106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466590344906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0803528800607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.359871029854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0284454971552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 3.10430431361e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.44061088562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.16697835922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.125991553068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0254283007234\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 10.0062084198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 8.73837471008\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 6.84926795959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.982455551624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.295360028744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00481999944896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0254283007234\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.72132158279\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.11716985703\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.168285742402\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.45725250244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.03711128235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.14304447174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.96359193325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.566685140133\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.935809135437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466593444347\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0823497697711\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.342845439911\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0289610140026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 2.35798464088e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.44061088562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.16697835922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.125991553068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0720023438334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 10.0062093735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 8.73837566376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 6.84926891327\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.978184223175\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.33930772543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0208999998868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0720023438334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.72132134438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.11716985703\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.168285727501\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.375439 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 32\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 160\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1600000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 3.63046574593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0268990695477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.091931194067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.46750497818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.04480981827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.1463572979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.96414077282\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.551202893257\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.938820004463\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466768145561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0774406716228\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.35613399744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0284414924681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 2.09623499114e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.45651197433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.17332720757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.126796171069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0663162916899\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 10.1816034317\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 8.90622425079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 6.98152685165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.978770077229\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.294499635696\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0207000002265\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0663162916899\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.78270602226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.13857710361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.170636937022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.46750450134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.04480981827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.1463572979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.965125858784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.553418159485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.932287812233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466983139515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0815795511007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.351988613605\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0279593002051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 2.79454966112e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.4565114975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.17332744598\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.126796171069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0232511665672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 10.1816034317\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 8.90622425079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 6.98152732849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.98363161087\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.305530905724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00421999953687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0232511665672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.78270626068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.13857698441\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.170636937022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.46750497818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.04480981827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.1463572979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.964271306992\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.568406701088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.934549808502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466980487108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0836460664868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.336699128151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.028556285426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 2.1281049839e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.45651197433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.17332720757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.126796171069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0705031752586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 10.1816034317\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 8.90622425079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 6.98152685165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.978758752346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.291737556458\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0208999998868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0705031752586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.78270602226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.13857710361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.170636937022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.379330 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 33\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1650000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 3.85002589226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0255950912833\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0920957773924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.47780418396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.05291509628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.14965701103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.965208768845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.553891956806\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.941352784634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.467216670513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0769760459661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.357422113419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.027681870386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.6821729773e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.47196292877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.18000507355\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.127480790019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0658261179924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 10.3589458466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 9.08145141602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 7.12754154205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.980045855045\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.275538861752\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.019999999553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0658261179924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.84528589249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.16080152988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.173613965511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.47780418396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.05291461945\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.14965701103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.966172575951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.551838994026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.935074448586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.46742233634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0811282843351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.346001476049\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0272373519838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 2.30680283902e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.47196340561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.18000459671\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.127480790019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.02110886015\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 10.3589458466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 9.08145141602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 7.12754058838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.984871923923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.292335510254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00331999990158\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.02110886015\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.84528613091\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.16080152988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.173613965511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.47780418396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.05291509628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.14965701103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.965333819389\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.567090988159\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.937143027782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.467420905828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0815225914121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.317524284124\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0278288982809\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.7383304865e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.47196292877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.18000507355\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.127480790019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0706555917859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 10.3589458466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 9.08145141602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 7.12754154205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.979981780052\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.314534544945\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0206000003964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0706555917859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.84528589249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.16080152988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.173613965511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.182908 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 34\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 170\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1700000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 4.07905960083\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0242200661451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0924715399742\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.48900747299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.06139850616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.1522192955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.965900540352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.551373183727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.942069590092\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.467438340187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0787537544966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.359593838453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0271878745407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.29720010775e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.49045753479\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.18700146675\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.128459200263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0644877254963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 10.5396261215\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 9.26142787933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 7.278901577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.98046040535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.25162255764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0206000003964\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0644877254963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.90689897537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.18369758129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.177592679858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.48900747299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.06139850616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.15221905708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.966917276382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.551108419895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.935860812664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.467652916908\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0830486863852\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.34869286418\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0267758108675\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.72074004351e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.49045705795\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.18700098991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.128459185362\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0193602163345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 10.5396251678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 9.26142692566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 7.27890205383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.985767424107\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.336476325989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00289999973029\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0193602163345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.90689897537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.18369758129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.177592664957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.48900747299\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.06139850616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.1522192955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.966026246548\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.568945586681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.937908649445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.467648357153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0835038796067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.32678771019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0274151265621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.33190177637e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.49045753479\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.18700146675\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.128459200263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0707407668233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 10.5396261215\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 9.26142787933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 7.278901577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.980556607246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.298538506031\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0219000000507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0707407668233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.90689897537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.18369758129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.177592679858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.400439 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 35\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 175\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1750000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 4.3184633255\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.022776318714\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0920493155718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.49970197678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.06945180893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.15374016762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.966324806213\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.55324202776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.94215297699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466998904943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.076045922935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.358031690121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0268286950886\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 1.09078423377e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.50839042664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.19361257553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.129599049687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0635969266295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 10.7156534195\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 9.42882728577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 7.41432905197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.980757176876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.248226299882\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0193999987096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0635969266295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 3.96717524529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.20508480072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.180099412799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.4997010231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.06945180893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.1537399292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.967268288136\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.551735162735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.935940921307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.467215240002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0804425179958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.343524694443\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0264016315341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.46074211754e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.50839090347\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.19361257553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.129599064589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0171565413475\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 10.7156524658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 9.42882633209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 7.41432905197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.986733615398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.337424963713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00196000002325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0171565413475\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 3.96717500687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.20508468151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.1800994277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.49970197678\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.06945180893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.15374016762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.966409444809\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.564903616905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.938026130199\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.467201501131\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0823206305504\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.31958258152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0270514041185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 1.14466379084e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.50839042664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.19361257553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.129599049687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0689148977399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 10.7156534195\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 9.42882728577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 7.41432905197\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.980640649796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.264637023211\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.021099999547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0689148977399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 3.96717524529\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.20508480072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.180099412799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.392445 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 36\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 180\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1800000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 4.55049180984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0215135067701\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0914682373405\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.5103468895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.07773399353\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.15385961533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.967212915421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.559629559517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.943103969097\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466701477766\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0809521302581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.355958789587\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0261587612331\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 8.34188967902e-12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.52430438995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.20039582253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.130876362324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0621786899865\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 10.8925733566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 9.60350131989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 7.55749177933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.981753587723\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.330662488937\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0190999973565\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0621786899865\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 4.02781057358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.22741234303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.181874185801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.51034593582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.07773399353\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.15385937691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.968181371689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.555752873421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.936968684196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466913819313\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0854497775435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.338039875031\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0257331542671\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.09208597027e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.52430438995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.20039534569\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.130876347423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0157043337822\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 10.892572403\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 9.60350131989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 7.55749130249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.987937808037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.323045521975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00203999993391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0157043337822\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 4.02781057358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.22741222382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.181874185801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.5103468895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.07773399353\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.15385961533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.967329084873\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.567208707333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.939025402069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466897398233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0875384286046\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.311605006456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0264036990702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 8.81185142215e-12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.52430438995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.20039582253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.130876362324\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0682094246149\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 10.8925733566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 9.60350131989\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 7.55749177933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.982199847698\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.324392050505\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0208000000566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0682094246149\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 4.02781057358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.22741234303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.181874185801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 34.710048 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 37\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1850000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 4.72839355469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0204669237137\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0900116711855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.52083969116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.08554124832\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.15409636497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.967603981495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.557713389397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.943118810654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466896891594\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0787230879068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.356404840946\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0257684588432\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 9.0589402299e-12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.53848934174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.206792593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.131754085422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0623081922531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 11.052611351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 9.76351451874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 7.68663883209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.982231199741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.287253022194\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0188999995589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0623081922531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 4.08399629593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.24770605564\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.185720145702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.52083921432\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.08554124832\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.15409636497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.968553900719\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.553573608398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.937007129192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.467112243176\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0832107812166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.334134042263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0253749713302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 1.24377470129e-11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.5384888649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.20679235458\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.131754085422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0140552837402\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 11.0526103973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 9.76351451874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 7.68663883209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.988768100739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.329038023949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00163999991491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0140552837402\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 4.08399581909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.24770605564\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.1857201159\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.52083969116\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.08554124832\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.15409636497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.967728018761\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.569734930992\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.939063310623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.467084676027\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0852277651429\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.310160905123\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0260545928031\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 9.77232097327e-12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.53848934174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.206792593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.131754085422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0679266303778\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 11.052611351\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 9.76351451874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 7.68663883209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.982333242893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.319318085909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0204000007361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0679266303778\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 4.08399629593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.24770605564\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.185720145702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 35.364850 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 38\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 190\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1900000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_mult: 5.14290428162\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_grad_size: 0.0190559756011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tave_step_size: 0.0913925841451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.53183841705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.09429168701\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.1546792984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_mean_u: 0.968341529369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_max_x_min_u: 0.560349822044\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_max_u: 0.94111353159\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_mean_u: 0.466603428125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_mean_x_min_u: 0.0797407329082\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_max_u: 0.351446330547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_mean_u: 0.0251497104764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_min_x_min_u: 7.31677132076e-12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.55737257004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.21393060684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.132736563683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.0633104071021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 11.2310876846\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 9.94289398193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 7.82843732834\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.982944607735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.318380922079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0193999987096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.0633104071021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 4.14330053329\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 1.27068781853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.189937055111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.53183746338\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.09429121017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.15467905998\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_max_u: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_mean_u: 0.969276428223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_max_x_min_u: 0.554496645927\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_max_u: 0.934813499451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_mean_u: 0.466816186905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_mean_x_min_u: 0.0843253731728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_max_u: 0.332267045975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_mean_u: 0.0247781910002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_min_x_min_u: 9.73409200467e-12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.5573720932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.21393036842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.132736548781\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0125638237223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 11.231086731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 9.94289398193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 7.82843637466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999999940395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.989765167236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.37343031168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00133999995887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0125638237223\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 4.14330005646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 1.27068758011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.189937055111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.53183841705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.09429168701\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.1546792984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_max_u: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_mean_u: 0.968490362167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_max_x_min_u: 0.566503345966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_max_u: 0.93706715107\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_mean_u: 0.466789364815\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_mean_x_min_u: 0.0863413140178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_max_u: 0.307645887136\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_mean_u: 0.0253705345094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_min_x_min_u: 7.80784985277e-12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.55737257004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.21393060684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.132736563683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.0684154629707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 11.2310876846\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 9.94289398193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 7.82843732834\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 1.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.983206391335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.354223191738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0201999973506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.0684154629707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 4.14330053329\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 1.27068781853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.189937055111\n" ] } ], "prompt_number": 3 }, { "cell_type": "markdown", "metadata": {}, "source": [ "As the model trained, it should have printed out progress messages. Most of these are the values of the various channels being monitored throughout training." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "We can use the print_monitor script to print the last monitoring entry of a saved model. By running it on \"mlp_best.pkl\", we can see the performance of the model at the point where it did the best on the validation set." ] }, { "cell_type": "code", "collapsed": false, "input": [ "!print_monitor.py mlp_best.pkl | grep test_y_misclass" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "Using gpu device 2: GeForce GTX 285\r\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "/u/goodfeli/pylearn2/models/mlp.py:36: UserWarning: MLP changing the recursion limit.\r\n", " warnings.warn(\"MLP changing the recursion limit.\")\r\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "test_y_misclass : 0.0193999987096\r\n" ] } ], "prompt_number": 4 }, { "cell_type": "markdown", "metadata": {}, "source": [ "The test set error has dropped to 1.94%! This is a big improvement over softmax regression." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "Another common way of analyzing trained models is to look at their weights. Here we use the show_weights script to visualize $W$:" ] }, { "cell_type": "code", "collapsed": false, "input": [ "!show_weights.py mlp_best.pkl" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "Using gpu device 0: GeForce GTX 285\r\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "making weights report\r\n", "loading model\r\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "loading done\r\n", "loading dataset...\r\n", "...done\r\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "smallest enc weight magnitude: 0.0\r\n", "mean enc weight magnitude: 0.0409141770966\r\n", "max enc weight magnitude: 4.76068\r\n", "min norm: 2.15468\r\n", "mean norm: 4.09429199219\r\n", "max norm: 6.53184\r\n" ] } ], "prompt_number": 5 }, { "cell_type": "markdown", "metadata": {}, "source": [ "#Part 3 A deeper MLP, and pylearn2 polymorphism" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "So far in these tutorials, there has not been much benefit to using pylearn2, rather than some other machine learning library, or even just an implementation of softmax regression or an MLP without an accompanying library.\n", "\n", "Now it's time to see some of why pylearn2 is useful. We're going to make several changes to our experimental setup, while still re-using most of the code. The beauty of pylearn2 is that it is built from interchangeable parts, so that if you want to create a new machine learning experiment, you don't need to rewrite the whole experiment from scratch.\n", "\n", "We're going to take the MLP example above and change it in three major ways:\n", "\n", "-Instead of training just a two layer MLP, we'll train a three layer MLP. We can do this just by putting one more layer in the \"layers\" list. We don't need to change the training algorithm or the main MLP model.\n", "\n", "-Instead of using the Sigmoid Layer class, we'll use a different kind of layer, called a rectified linear layer. The rectified linear layer uses the usual affine function $z = x^T W + b$ to compute the presynaptic inputs, then passes each element of $z$ through the function $g(z) = \\mathbb{I}_{z > 0} z$. In other words, values greater than 0 are left unchanged, while negative values are replaced with zeros. In pylearn2, we can do this just by loading a different class in the layers list. We don't need to change the training algorithm or the main MLP model.\n", "\n", "-Instead of optimizing the log likelihood using the nonlinear conjugate gradient descent algorithm, we will optimize it using a minibatch version of [stochastic gradient descent](http://en.wikipedia.org/wiki/Stochastic_gradient_descent). We can do this just by passing in a different TrainingAlgorithm object. No changes to the model or the code for the cost are needed.\n", "\n", "Here is the updated YAML description of the experiment:" ] }, { "cell_type": "code", "collapsed": false, "input": [ "import os\n", "import pylearn2\n", "path = os.path.join(pylearn2.__path__[0], 'scripts', 'tutorials', 'multilayer_perceptron', 'mlp_tutorial_part_3.yaml')\n", "with open(path, 'r') as f:\n", " train_2 = f.read()\n", "hyper_params = {'train_stop' : 50000,\n", " 'valid_stop' : 60000,\n", " 'dim_h0' : 500,\n", " 'dim_h1' : 1000,\n", " 'sparse_init_h1' : 15,\n", " 'max_epochs' : 10000,\n", " 'save_path' : '.'}\n", "train_2 = train_2 % (hyper_params)\n", "print train_2" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "!obj:pylearn2.train.Train {\n", " dataset: &train !obj:pylearn2.datasets.mnist.MNIST {\n", " which_set: 'train',\n", " start: 0,\n", " stop: 50000\n", " },\n", " model: !obj:pylearn2.models.mlp.MLP {\n", " layers: [ !obj:pylearn2.models.mlp.RectifiedLinear {\n", " layer_name: 'h0',\n", " dim: 500,\n", " sparse_init: 15\n", " }, !obj:pylearn2.models.mlp.RectifiedLinear {\n", " layer_name: 'h1',\n", " dim: 1000,\n", " sparse_init: 15\n", " }, !obj:pylearn2.models.mlp.Softmax {\n", " layer_name: 'y',\n", " n_classes: 10,\n", " irange: 0.\n", " }\n", " ],\n", " nvis: 784,\n", " },\n", " algorithm: !obj:pylearn2.training_algorithms.sgd.SGD {\n", " batch_size: 100,\n", " learning_rate: .01,\n", " monitoring_dataset:\n", " {\n", " 'train' : *train,\n", " 'valid' : !obj:pylearn2.datasets.mnist.MNIST {\n", " which_set: 'train',\n", " start: 50000,\n", " stop: 60000\n", " },\n", " 'test' : !obj:pylearn2.datasets.mnist.MNIST {\n", " which_set: 'test',\n", " }\n", " },\n", " learning_rule: !obj:pylearn2.training_algorithms.learning_rule.Momentum {\n", " init_momentum: .5\n", " },\n", " termination_criterion: !obj:pylearn2.termination_criteria.And {\n", " criteria: [\n", " !obj:pylearn2.termination_criteria.MonitorBased {\n", " channel_name: \"valid_y_misclass\",\n", " prop_decrease: 0.,\n", " N: 10\n", " },\n", " !obj:pylearn2.termination_criteria.EpochCounter {\n", " max_epochs: 10000\n", " }\n", " ]\n", " }\n", " },\n", " extensions: [ !obj:pylearn2.train_extensions.best_params.MonitorBasedSaveBest {\n", " channel_name: 'valid_y_misclass',\n", " save_path: \"mlp_2_best.pkl\"\n", " }, !obj:pylearn2.training_algorithms.learning_rule.MomentumAdjustor {\n", " start: 1,\n", " saturate: 10,\n", " final_momentum: .99\n", " }\n", " ]\n", "}\n" ] } ], "prompt_number": 6 }, { "cell_type": "markdown", "metadata": {}, "source": [ "This YAML config file also introduces another use of extensions to the Train object. Here, we add the MomentumAdjustor. It uses a callback to adjust the momentum setting of the SGD algorithm at the end of each epoch. Here, we configure it to start increasing the momentum after 1 epoch, and to continue increasing it until it reaches a value of .99 at the end of the tenth epoch. See the docstring for the SGD class for more information on what this momentum setting does." ] }, { "cell_type": "code", "collapsed": false, "input": [ "from pylearn2.config import yaml_parse\n", "train_2 = yaml_parse.load(train_2)\n", "train_2.main_loop()" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "Parameter and initial learning rate summary:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\th0_W: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\th0_b: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\th1_W: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\th1_b: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tsoftmax_b: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tsoftmax_W: 0.00999999977648\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling sgd_update...\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling sgd_update done. Time elapsed: 2.516152 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "compiling begin_record_entry...\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "compiling begin_record_entry done. Time elapsed: 0.395491 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitored channels: \n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling accum...\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "graph size: 165\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "graph size: 163\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "graph size: 163\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Compiling accum done. Time elapsed: 11.563393 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.499999672174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23503017426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82356023788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06193947792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89326524734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98549389839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99438333511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80721712112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71524214745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80886650085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40815734863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97773504257\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 2.30258488655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.100000023842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.100000031292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.100000023842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.901999890804\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 2.30258488655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23505115509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82354259491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.0619494915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89324569702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98548007011\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99438095093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80721092224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71524274349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80887794495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40813541412\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97772955894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 2.30257916451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.100000545382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.100000545382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.100000545382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.901360213757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 2.30257916451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23503017426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82356023788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06193947792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89326524734\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98549389839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99438333511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80721712112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71524214745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80886650085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40815734863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97773504257\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 2.30258488655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.100000023842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.100000031292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.100000023842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.90089994669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 2.30258488655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.343442 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 1\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 50000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.499999672174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23488473892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82359194756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06265735626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89264249802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98556685448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00163861282635\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99485731125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80723309517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71526324749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80893564224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40817546844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97778272629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.268750548363\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 0.645500898361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.596350252628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.520334303379\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999946475029\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.904475390911\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.38064879179\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0812000110745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.268750548363\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.17966529727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.0518538914621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000149252169649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23488473892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82361268997\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06266713142\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89267301559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98556661606\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.001638607122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99485683441\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80721235275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71525621414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80892753601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.4081993103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97776818275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.264730095863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 0.645499527454\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.596347033978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.520334303379\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999963521957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.899078428745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.361695259809\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0793600603938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.264730095863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.179665282369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.051854070276\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000149251762195\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23488473892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82359194756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06265735626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89264249802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98556685448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00163861282635\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99485731125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80723309517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71526324749\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80893564224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40817546844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97778272629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.252131432295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 0.645500898361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.596350252628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.520334303379\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999965012074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.907301902771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.362495720387\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0754000097513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.252131432295\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.17966529727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.0518538914621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000149252169649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.325040 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 2\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 1000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 100000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.554444551468\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.2346944809\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82387781143\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06334352493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89264249802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98581314087\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00337248062715\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99546384811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80735421181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71530222893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80887699127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40835094452\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97777676582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.209201917052\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 0.849824726582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.752399742603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.648707330227\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999981224537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.928354024887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.417280673981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0621000118554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.209201917052\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.202846974134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.0668164640665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000276584294625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23466491699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82387685776\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06333851814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89267301559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98582696915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.00337246293202\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99549293518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80733585358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71530234814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80891132355\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.4083533287\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97776651382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.192548781633\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 0.849820315838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.752397358418\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.648707211018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999981343746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.925991177559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.379428476095\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0572400614619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.192548781633\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.202847748995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.0668167173862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000276583392406\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.2346944809\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82387781143\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06334352493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89264249802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98581314087\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00337248062715\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99546384811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80735421181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71530222893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80887699127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40835094452\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97777676582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.201314240694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 0.849824726582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.752399742603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.648707330227\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999982595444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.93180680275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.40289413929\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0579000003636\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.201314240694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.202846974134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.0668164640665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000276584294625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.321143 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 3\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 1500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 150000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.608888924122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23464679718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82416844368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06404829025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89243221283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98607397079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00511313043535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99604940414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80747485161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71535277367\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80883836746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40852594376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97782230377\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.18524043262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.00719892979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.879001736641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.748181402683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999993741512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.939781844616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.445061296225\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0548000186682\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.18524043262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.216917276382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.0788432434201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000395227049012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23464632034\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82414579391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06404733658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89245033264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98607373238\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.00511312671006\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99604892731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80745625496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71535873413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80887460709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40852594376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.9778380394\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.161898091435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.00719916821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.87899774313\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.748184919357\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999991238117\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.93733805418\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.405598640442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0483000576496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.161898091435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.216916337609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.0788431763649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000395228940761\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23464679718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82416844368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06404829025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89243221283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98607397079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00511313043535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99604940414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80747485161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71535277367\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80883836746\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40852594376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97782230377\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.174453571439\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.00719892979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.879001736641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.748181402683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999995052814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.94245827198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.418575078249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0514000207186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.174453571439\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.216917276382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.0788432434201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000395227049012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.407873 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 4\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 2000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 200000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.663333714008\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23483276367\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82449483871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06498026848\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89247989655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98636126518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00637936964631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99670314789\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80761146545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71540987492\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80886650085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40871572495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97799134254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.167924150825\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.14452064037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 0.995063841343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.840617954731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.99999588728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.946992635727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.455186247826\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0552000291646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.167924150825\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.23083357513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.08986672014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000483248528326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.2348651886\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82447862625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06498932838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89249992371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98634982109\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.00637934077531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99670362473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80763316154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71541762352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80887794495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40874290466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97797679901\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.138446286321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.1445235014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 0.995067954063\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.840613126755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999992251396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.945943057537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.423846125603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0430600605905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.138446286321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.230833858252\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.0898664072156\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000483250943944\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23483276367\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82449483871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06498026848\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89247989655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98636126518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00637936964631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99670314789\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80761146545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71540987492\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80886650085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40871572495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97799134254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.157675400376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.14452064037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 0.995063841343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.840617954731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999996602535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.949966013432\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.442742049694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.046300008893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.157675400376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.23083357513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.08986672014\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000483248528326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.220654 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 5\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 2500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 250000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.717777192593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23521852493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82483482361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06603121758\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89207363129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98667144775\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00797319039702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99737501144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80774116516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71550190449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80892467499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40890693665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97820734978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.13814201951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.26785862446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 1.10942089558\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 0.9239538908\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999995410442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.953776538372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.461881011724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0431000031531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.13814201951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.258687496185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.10072222352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000603844528086\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23519468307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82483053207\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06602716446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89205408096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98667001724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0079732267186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99740314484\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80775809288\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71549510956\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80892419815\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40891933441\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97820615768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.104295127094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.26785480976\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 1.109421134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 0.923955321312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999992787838\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.954641282558\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.442351669073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0312000326812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.104295127094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.258685946465\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.100721813738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000603846099693\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23521852493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82483482361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06603121758\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89207363129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98667144775\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00797319039702\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99737501144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80774116516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71550190449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80892467499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40890693665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97820734978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.136576414108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.26785862446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 1.10942089558\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 0.9239538908\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999996840954\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.956140458584\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.448911756277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0386999994516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.136576414108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.258687496185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.10072222352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000603844528086\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.204515 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 6\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 3000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 300000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.772221684456\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23541164398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82526040077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.0674469471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89197492599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98706746101\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.00963484868407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.9978518486\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80790233612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71558940411\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80901002884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40913200378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97820520401\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.12612003088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.39495909214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 1.23315572739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 1.02864944935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999998807907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.961598396301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.503333091736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.040100004524\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.12612003088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.288501292467\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.112407810986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000765459961258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23538017273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82528162003\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.0674469471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89197683334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98705887794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.00963485334069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99787998199\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80790233612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.7155970335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80897331238\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40915393829\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97820544243\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0812869444489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.39496576786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 1.23315918446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 1.02865147591\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.99999409914\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.963725090027\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.476592302322\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0230800136924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0812869444489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.288501352072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.112407691777\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.00076545990305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23541164398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82526040077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.0674469471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89197492599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98706746101\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.00963484868407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.9978518486\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80790233612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71558940411\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80901002884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40913200378\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97820520401\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.127863824368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.39495909214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 1.23315572739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 1.02864944935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.964188098907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.480807334185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0376999974251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.127863824368\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.288501292467\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.112407810986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000765459961258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.235264 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 7\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 3500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 350000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.826667308807\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23617553711\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82576131821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.06955361366\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.8926115036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98752951622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.011014319025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99838781357\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.8080675602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71574032307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80883789062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40936756134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97880935669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.127731248736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.54538154602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 1.37167823315\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 1.13854420185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.9629342556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.519809484482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0402000173926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.127731248736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.32344275713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.125407382846\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.000886962865479\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23615169525\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82577753067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.06954622269\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89259195328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98751401901\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0110142948106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99837732315\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80804681778\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71573352814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80887413025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.4093914032\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.97880387306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0784979835153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.54537415504\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 1.37168061733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 1.13854324818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.965206980705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.486533343792\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0245000198483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0784979835153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.323444247246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.125407934189\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.000886966707185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23617553711\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82576131821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.06955361366\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.8926115036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98752951622\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.011014319025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99838781357\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.8080675602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71574032307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80883789062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40936756134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97880935669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.126347467303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.54538154602\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 1.37167823315\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 1.13854420185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999165535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.966301620007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.483229219913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0362999886274\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.126347467303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.32344275713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.125407382846\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.000886962865479\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.324166 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 8\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 4000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 400000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.881111502647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23693847656\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.8264799118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.07238268852\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89200305939\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98819732666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0122548062354\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99879837036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80823135376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71583795547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80892133713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40960502625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.97916102409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.121290750802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 1.74212527275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 1.55456089973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 1.29530310631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999284744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.970344901085\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.541184604168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0355000011623\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.121290750802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.393140137196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.142595127225\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.00119761796668\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23696804047\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82649302483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.07238888741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89202260971\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98821163177\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0122548071668\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99882984161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80823636055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.71583855152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80892324448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40962982178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.979159832\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0608208738267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 1.7421246767\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 1.55455350876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 1.29530549049\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.97307318449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.52649885416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.018220026046\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0608208738267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.393138289452\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.142595857382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.00119762122631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23693847656\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.8264799118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.07238268852\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89200305939\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98819732666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0122548062354\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99879837036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80823135376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71583795547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80892133713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40960502625\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.97916102409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.120653524995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 1.74212527275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 1.55456089973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 1.29530310631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.971736133099\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.502751410007\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0357999950647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.120653524995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.393140137196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.142595127225\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.00119761796668\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.219467 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 9\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 4500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 450000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.935554862022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.23974847794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 3.82828760147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.07858109474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 5.89074993134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 2.98990464211\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0139329638332\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00128126144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.80823659897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.71664977074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80959177017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.40965270996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 2.98309516907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.133454963565\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 2.09113478661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 1.89531803131\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 1.55502259731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.972993254662\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.555838704109\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.03900000453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.133454963565\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 0.505987465382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.174324646592\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.00215850048698\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.23972511292\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 3.82828736305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.07858753204\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 5.89076900482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 2.98989081383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0139330253005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00125265121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.80825352669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.7166570425\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80962467194\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.40965032578\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 2.98309373856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0678227543831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 2.09112644196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 1.8953114748\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 1.55502521992\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.976901352406\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.541133284569\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0215600207448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0678227543831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 0.505986630917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.174323886633\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.00215849909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.23974847794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 3.82828760147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.07858109474\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 5.89074993134\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 2.98990464211\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0139329638332\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00128126144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.80823659897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.71664977074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80959177017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.40965270996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 2.98309516907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.14155356586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 2.09113478661\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 1.89531803131\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 1.55502259731\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.975651443005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.524011075497\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0348999835551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.14155356586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 0.505987465382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.174324646592\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.00215850048698\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.242812 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 10\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 5000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 500000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.33813095093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.00221395493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23122644424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.13888168335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.13162064552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0540144480765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99460268021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.81764769554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72675585747\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.80806827545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.42556667328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.22008705139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.242982923985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 4.86701011658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.50406503677\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 3.79116678238\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.970284223557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.494895517826\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0614000074565\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.242982923985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.25091540813\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.422105878592\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.00902531389147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.33812093735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.00221395493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23123693466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.13886117935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.13162612915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0540147125721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99457454681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.81765389442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.726749897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.80803012848\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.42554092407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.2200820446\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.216101527214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 4.86700248718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.50406646729\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 3.7911875248\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.971834897995\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.494699120522\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0546000786126\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.216101527214\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.25092113018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.422105282545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.00902529340237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.33813095093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.00221395493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23122644424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.13888168335\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.13162064552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0540144480765\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99460268021\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.81764769554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72675585747\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.80806827545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.42556667328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.22008705139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.262977838516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 4.86701011658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.50406503677\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 3.79116678238\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.972873926163\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.484322339296\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0602999925613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.262977838516\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.25091540813\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.422105878592\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.00902531389147\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.246498 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 11\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 5500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 550000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34423732758\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.09757995605\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23610663414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.29168701172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.20701622963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.0794842615724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99344968796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.83266830444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72617077827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.81531667709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.44732666016\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.22785973549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.149660229683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.28322935104\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.86907577515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.24763870239\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.971002280712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.500847101212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0448000095785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.149660229683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.53015840054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.458264380693\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0079955086112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.34425830841\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.09757804871\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23611760139\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.29168462753\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.20700359344\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.0794841647148\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99343013763\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.83267450333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72616374493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.81534910202\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.44732189178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.22785782814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.115495532751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.2832069397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.86906385422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.24765825272\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.974365890026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.503006339073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0362600125372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.115495532751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.53016579151\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.458266496658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.00799546111375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34423732758\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.09757995605\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23610663414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.29168701172\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.20701622963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.0794842615724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99344968796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.83266830444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72617077827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.81531667709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.44732666016\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.22785973549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.1691185534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.28322935104\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.86907577515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.24763870239\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.974966526031\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.529185950756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0438999943435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.1691185534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.53015840054\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.458264380693\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0079955086112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.224365 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 12\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 6000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 600000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34843397141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.13394451141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23612523079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.36067008972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.23545217514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.111102260649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99360513687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.8399875164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72649633884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 7.9447259903\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.45721006393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.23267006874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.138930052519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.38853263855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 4.97749423981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.37515115738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.976369380951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.539442539215\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0395999997854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.138930052519\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.5151270628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.468785196543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.00989222805947\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.34842920303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.13394021988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23612689972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.36069536209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.23545718193\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.111102797091\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99360513687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.83997154236\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72650408745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 7.94476556778\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.45718336105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.23268294334\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0762413665652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.38851499557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 4.97747087479\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.37513685226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.980703771114\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.538486421108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0236600115895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0762413665652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.51513409615\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.46878734231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.00989221502095\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34843397141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.13394451141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23612523079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.36067008972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.23545217514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.111102260649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99360513687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.8399875164\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72649633884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 7.9447259903\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.45721006393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.23267006874\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.158047273755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.38853263855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 4.97749423981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.37515115738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.978621006012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.533575236797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0357999950647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.158047273755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.5151270628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.468785196543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.00989222805947\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.233253 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 13\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 6500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 650000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34697389603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.15769052505\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23618888855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.40273475647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.25405025482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.113349400461\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99226903915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.84424233437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.7265651226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.25644397736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.46302652359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.24811220169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.126156955957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.49813652039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.06592178345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.50360441208\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.983133792877\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.586351394653\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0298999845982\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.126156955957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.57926058769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.477343022823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0155787682161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.34694576263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.15768814087\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23619389534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.40273189545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.25405526161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.113349400461\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99224901199\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.84425520897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72656738758\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.25643634796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.46304035187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.24809789658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0474301576614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.49815416336\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.06591844559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.5035943985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.986293017864\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.579336941242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0156600344926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0474301576614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.57926678658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.477343559265\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0155787058175\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34697389603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.15769052505\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23618888855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.40273475647\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.25405025482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.113349400461\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99226903915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.84424233437\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.7265651226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.25644397736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.46302652359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.24811220169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.136303275824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.49813652039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.06592178345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.50360441208\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.983997404575\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.568609714508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0302999857813\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.136303275824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.57926058769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.477343022823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0155787682161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.243910 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 14\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 7000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 700000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.3465590477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.17470979691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23621320724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.44742536545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.26748609543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.117137983441\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99374818802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.84760499001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.7263559103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.39470767975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.46778011322\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.26342630386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.107709117234\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.54377269745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.13376808167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.58503246307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.985660552979\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.598270595074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0245999917388\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.107709117234\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.54413878918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.484508126974\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0144754517823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.346534729\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.17470979691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23620676994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.44738912582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.26749873161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.117138013244\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99376821518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.84760093689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72634637356\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.39471530914\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.46780490875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.26344394684\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0289139077067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.54377365112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.13377904892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.58502912521\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.990230798721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.636234402657\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0095800133422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0289139077067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.54413354397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.484510302544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0144755160436\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.3465590477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.17470979691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23621320724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.44742536545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.26748609543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.117137983441\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99374818802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.84760499001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.7263559103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.39470767975\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.46778011322\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.26342630386\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.118425898254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.54377269745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.13376808167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.58503246307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.987525939941\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.608628451824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0258999839425\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.118425898254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.54413878918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.484508126974\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0144754517823\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.231089 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 15\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 7500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 750000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34646034241\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.18901968002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23616552353\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.49371194839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.27877855301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.122728899121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.9948592186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.85039448738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72630560398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.49246692657\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.47177028656\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27335119247\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.120883144438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.61785268784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.21456623077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.61228704453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.985354423523\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.593527436256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0276999864727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.120883144438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.59560739994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.492057174444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0153611358255\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.34646320343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.18901586533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23617053032\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.49373817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.27876186371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.122729450464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99485731125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.8503715992\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72631311417\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.49246883392\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.47177219391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27336573601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0283282585442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.61785554886\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.21454381943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.61229038239\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.990546524525\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.649133205414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00910001061857\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0283282585442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.59561276436\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.492054820061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0153612047434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34646034241\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.18901968002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23616552353\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.49371194839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.27877855301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.122728899121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.9948592186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.85039448738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72630560398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.49246692657\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.47177028656\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27335119247\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.126225486398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.61785268784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.21456623077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.61228704453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.987080872059\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.583371043205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0265999827534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.126225486398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.59560739994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.492057174444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0153611358255\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.249726 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 16\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 8000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 800000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34652328491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.20311164856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23617291451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.52294111252\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.28994369507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.123597666621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99608755112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.85341596603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72634136677\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.52042388916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.47620201111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27072739601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.140668272972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.69501256943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.31268548965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.74868249893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.989543557167\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.626976370811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0258999932557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.140668272972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.60322284698\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.500980615616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0168750006706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.34652090073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.20310306549\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23617100716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.52291107178\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.28993988037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.123597674072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99606466293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.85343289375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72633349895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.52042198181\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.47621965408\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27073836327\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0259083565325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.69503641129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.31268262863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.74867868423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.993756473064\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.699871182442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0079400036484\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0259083565325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.6032307148\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.500979840755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0168750379235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34652328491\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.20311164856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23617291451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.52294111252\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.28994369507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.123597666621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99608755112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.85341596603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72634136677\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.52042388916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.47620201111\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27072739601\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.140435069799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.69501256943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.31268548965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.74868249893\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.990495383739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.633842229843\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0265999827534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.140435069799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.60322284698\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.500980615616\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0168750006706\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.211907 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 17\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 8500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 850000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34764194489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.21877479553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23619961739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.5714468956\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.30228757858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.13643656671\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99594020844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.85699319839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72638630867\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.61135101318\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.48117828369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27077460289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.152983635664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.81860494614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.40938711166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.81085681915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.990412473679\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.641472399235\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0277999881655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.152983635664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.66027259827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.509944438934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0174780637026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.3476524353\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.21879482269\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23619699478\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.57147264481\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.30230164528\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.136435881257\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.9959692955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.85701036453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72638809681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.61137866974\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.48117685318\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27077269554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0280419886112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.81860494614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.40940761566\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.81083345413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.993593096733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.69740664959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00842001195997\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0280419886112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.66027379036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.509946644306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0174781102687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34764194489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.21877479553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23619961739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.5714468956\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.30228757858\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.13643656671\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99594020844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.85699319839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72638630867\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.61135101318\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.48117828369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27077460289\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.156515717506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.81860494614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.40938711166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.81085681915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.991046726704\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.649928092957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0286999810487\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.156515717506\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.66027259827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.509944438934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0174780637026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.213883 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 18\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 9000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 900000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.34813308716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.2329621315\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23619866371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.60563611984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.31354284286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.142215177417\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99625921249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.86032938957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72629284859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.70863246918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.48595952988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27107739449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.1266990453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 5.94182395935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.48706197739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.85955810547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.991642594337\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.680797755718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0225999932736\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.1266990453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.65575671196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.517508506775\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0219007991254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.34813261032\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.23297452927\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23619627953\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.6056265831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.31354165077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.142215907574\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99623250961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.86034679413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72628378868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.70865249634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.48598957062\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27109384537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0143134472892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 5.94185161591\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.48704767227\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.85954427719\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.996097743511\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.768372476101\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00466000149027\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0143134472892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.6557571888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.517506301403\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0219009146094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.34813308716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.2329621315\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23619866371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.60563611984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.31354284286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.142215177417\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99625921249\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.86032938957\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72629284859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.70863246918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.48595952988\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27107739449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.158007115126\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 5.94182395935\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.48706197739\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.85955810547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.99270170927\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.685421526432\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0256999861449\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.158007115126\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.65575671196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.517508506775\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0219007991254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.216884 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 19\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 9500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 950000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.35075473785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.24279737473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23619127274\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.61569023132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.32117795944\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.160097524524\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99536848068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.86252450943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72685301304\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.74706554413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.48911523819\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27158546448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.128275766969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.00630426407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.54901790619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 4.95159053802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.992789447308\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.689596951008\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0208999924362\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.128275766969\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.56810212135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.523332059383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0221748072654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.35075521469\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.24279022217\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23619437218\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.61565685272\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.32117271423\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.160097926855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99534845352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.86250782013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.7268614769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.74709033966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.48911237717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27158045769\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0107667120174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.00630140305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.54901885986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 4.95157289505\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.996949017048\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.813183248043\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00347999692895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0107667120174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.56809437275\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.523329675198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0221747960895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.35075473785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.24279737473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23619127274\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.61569023132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.32117795944\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.160097524524\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99536848068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.86252450943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72685301304\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.74706554413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.48911523819\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27158546448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.152880609035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.00630426407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.54901790619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 4.95159053802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.992956161499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.687586247921\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0238999892026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.152880609035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.56810212135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.523332059383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0221748072654\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.381361 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 20\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 10000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1000000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.36764955521\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.25145339966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23608016968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.65068340302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.32794356346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.160930916667\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99686193466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.86456871033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72680532932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.77167224884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.49206733704\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27174091339\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.135456323624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.06686162949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.60846662521\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.02197170258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.992590069771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.687869131565\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0230999924242\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.135456323624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.63880228996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.528553962708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0211624447256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.36767864227\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.25147294998\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23607754707\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.65068531036\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.32795858383\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.160931810737\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.9968791008\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.86455130577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72680592537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.77168178558\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.49205350876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27172803879\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0139410560951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.06685829163\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.60847902298\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.02197313309\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.997198402882\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.82025551796\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00411999737844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0139410560951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.63881158829\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.528555572033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0211624447256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.36764955521\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.25145339966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23608016968\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.65068340302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.32794356346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.160930916667\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99686193466\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.86456871033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72680532932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.77167224884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.49206733704\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27174091339\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.154028758407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.06686162949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.60846662521\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.02197170258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.993701696396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.705734312534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0234999880195\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.154028758407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.63880228996\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.528553962708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0211624447256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.224501 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 21\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 10500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1050000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.36559724808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.25865936279\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.65287876129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.33374094963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.160923495889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.9981341362\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.866314888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72683930397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.78785800934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.49455070496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27166962624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.132553175092\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.10146903992\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.65123224258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.06749105453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.992962539196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.700105249882\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0216999929398\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.132553175092\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.6686950922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.532644450665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0201863590628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.36559391022\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.25863981247\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23606181145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.6528468132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.33372306824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.160924375057\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.9981341362\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.86631464958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.7268487215\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.78784656525\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.494576931\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27167153358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00576127693057\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.10144424438\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.65123510361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.06749773026\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998003363609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.865698575974\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00196000072174\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00576127693057\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.66869258881\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.532643556595\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0201863981783\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.36559724808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.25865936279\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.65287876129\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.33374094963\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.160923495889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.9981341362\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.866314888\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72683930397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.78785800934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.49455070496\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27166962624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.149952054024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.10146903992\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.65123224258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.06749105453\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.993861615658\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.696114599705\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0218999926001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.149952054024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.6686950922\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.532644450665\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0201863590628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.191485 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 22\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 11000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1100000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.37540435791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.26554250717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.68969488144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.33926701546\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.15927760303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99918460846\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.86793661118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72684121132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.80519104004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.49690055847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27168059349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.129877910018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.1563615799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.69634532928\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.04322528839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.993051469326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.701347351074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0222999919206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.129877910018\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.71757590771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.536909937859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.019919058308\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.37537336349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.26554632187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23606181145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.68972921371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.33928227425\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.159278333187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99916362762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.86795496941\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72684931755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.80523300171\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.4969124794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27169203758\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00547823868692\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.15638256073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.69631719589\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.04325008392\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998302519321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.880661785603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00176000059582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00547823868692\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.71756851673\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.53690803051\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0199191085994\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.37540435791\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.26554250717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.68969488144\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.33926701546\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.15927760303\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99918460846\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.86793661118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72684121132\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.80519104004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.49690055847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27168059349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.151706501842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.1563615799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.69634532928\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.04322528839\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.99382263422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.683702290058\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0223999917507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.151706501842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.71757590771\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.536909937859\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.019919058308\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.206554 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 23\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 11500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1150000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.38593149185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.27048826218\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.67957162857\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.34312343597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.159357041121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99570322037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.8691701889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72683918476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.81508731842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.49859952927\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27181625366\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.123887695372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.22244215012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.73378896713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.06025886536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.993882775307\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.726153492928\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0201999936253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.123887695372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.69931674004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.540387809277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.020066447556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.38596725464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.27046966553\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23606181145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.67954874039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.34311199188\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.159357577562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.9957318306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.86917424202\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72684860229\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.81507587433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.49862718582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27181768417\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00308265769854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.22247123718\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.73379087448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.06026697159\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998538374901\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.894672214985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000919999612961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00308265769854\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.69932484627\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.540388822556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0200663488358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.38593149185\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.27048826218\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.67957162857\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.34312343597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.159357041121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99570322037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.8691701889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72683918476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.81508731842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.49859952927\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27181625366\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.14809820056\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.22244215012\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.73378896713\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.06025886536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.993686497211\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.684677302837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0215999912471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.14809820056\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.69931674004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.540387809277\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.020066447556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.230241 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 24\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 12000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1200000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.392578125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.27436256409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.68859195709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.34622907639\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.159570723772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 5.99895811081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.87013435364\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72682142258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.82981967926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.49993467331\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27214646339\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.123282536864\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.26617622375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.76239967346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.08875703812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.994056642056\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.738864719868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0195999927819\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.123282536864\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.71165382862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.542974531651\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0200950335711\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.39255237579\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.27436685562\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23606181145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.68859434128\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.34621357918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.159569814801\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 5.99892854691\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.8701300621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72681927681\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.82980918884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.49992132187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27214837074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00190907681827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.26617431641\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.76240110397\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.08878278732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998930156231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.918284237385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000559999898542\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00190907681827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.71166217327\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.542971789837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0200951248407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.392578125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.27436256409\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23606491089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.68859195709\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.34622907639\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.159570723772\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 5.99895811081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.87013435364\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72682142258\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.82981967926\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.49993467331\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27214646339\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.146879151464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.26617622375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.76239967346\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.08875703812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.994406104088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.706291854382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0211999956518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.146879151464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.71165382862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.542974531651\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0200950335711\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.222738 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 25\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 12500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1250000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.4013338089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.27870225906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.69665718079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.34976291656\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.160002231598\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00171422958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.87124419212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72680687904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.85285282135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.50152254105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27291631699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.121946468949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.27880191803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.80026340485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.12123060226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.993581533432\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.695117354393\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0199999921024\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.121946468949\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.76450884342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.546270668507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0209660548717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.40130519867\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.2786822319\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.69668722153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.34977436066\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.160001769662\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00171136856\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.87122607231\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.726806283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.85290527344\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.5015130043\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27290010452\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0036760433577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.27877187729\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.80025196075\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.12123060226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998859524727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.912291646004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00121999997646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0036760433577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.76451909542\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.546273350716\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0209659561515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.4013338089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.27870225906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.69665718079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.34976291656\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.160002231598\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00171422958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.87124419212\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72680687904\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.85285282135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.50152254105\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27291631699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.137758076191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.27880191803\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.80026340485\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.12123060226\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.994390308857\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.728678107262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.019999993965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.137758076191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.76450884342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.546270668507\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0209660548717\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.272793 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 26\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 13000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1300000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.4121389389\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.28374528885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.71324443817\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.35392951965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.1600792557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00099658966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.87249565125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72674298286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.85911655426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.50325918198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27451777458\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.148935392499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.33092308044\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.83676052094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.21046447754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.993810713291\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.718041598797\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0221999920905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.148935392499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.7590252161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.54948079586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.020847639069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.41210317612\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.2837562561\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.71320962906\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.35394501686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.16007861495\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00099611282\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.87251186371\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72674548626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.85914611816\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.50324678421\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27453041077\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00680599268526\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.33095264435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.83674097061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.21046924591\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.99815505743\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.87034368515\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00213999999687\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00680599268526\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.75903534889\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.549481749535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0208476502448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.4121389389\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.28374528885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.71324443817\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.35392951965\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.1600792557\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00099658966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.87249565125\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72674298286\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.85911655426\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.50325918198\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27451777458\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.157335549593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.33092308044\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.83676052094\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.21046447754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.994030356407\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.726344525814\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0226999893785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.157335549593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.7590252161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.54948079586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.020847639069\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.208633 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 27\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 13500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1350000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.41813564301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.28969669342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.7286157608\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.35873889923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.160087496042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00020074844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.87404108047\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72669911385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.87103843689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.50552749634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27386808395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.143524944782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.35547590256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.87758922577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.21483325958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.994994282722\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.740391731262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0209999959916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.143524944782\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.73408651352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.5533670187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0205177664757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.41816806793\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.28971195221\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.72864484787\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.35872411728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.160087764263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00021934509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.87405753136\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72669124603\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.87106800079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.50554513931\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27385210991\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00366839556955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.3555059433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.87757110596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.21484279633\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998865902424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.908865869045\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00126000004821\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00366839556955\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.73407900333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.553368866444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0205178782344\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.41813564301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.28969669342\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.7286157608\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.35873889923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.160087496042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00020074844\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.87404108047\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72669911385\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.87103843689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.50552749634\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27386808395\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.155297890306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.35547590256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.87758922577\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.21483325958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.994454801083\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.73979562521\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0205999910831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.155297890306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.73408651352\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.5533670187\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0205177664757\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.239587 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 28\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 14000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1400000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.42320108414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.29595088959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.73588323593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.36365532875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.160095050931\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00109481812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.87561798096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72673380375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.90102100372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.50783443451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27579259872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.176090538502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.37317848206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.91372203827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.26935434341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.994395077229\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.743200361729\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0221999939531\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.176090538502\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.72095572948\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.556442499161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0208181608468\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.4232301712\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.29595375061\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.73585557938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.36363792419\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.160095304251\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00107383728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.87561368942\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72674226761\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.90106678009\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.50785970688\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27577996254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00485403602943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.37316846848\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.91373300552\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.26935815811\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998713254929\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.896820962429\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00136000022758\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00485403602943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.72096157074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.556439995766\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0208181329072\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.42320108414\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.29595088959\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.73588323593\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.36365532875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.160095050931\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00109481812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.87561798096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72673380375\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.90102100372\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.50783443451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27579259872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.183195546269\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.37317848206\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.91372203827\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.26935434341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.994852602482\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.74536216259\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0237999893725\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.183195546269\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.72095572948\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.556442499161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0208181608468\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.306142 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 29\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 14500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1450000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.45381164551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.30269384384\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.74906110764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.36890244484\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.159244820476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00183820724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.87737250328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.7269256115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.89922237396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.51038217545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27727627754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.158995479345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.38246154785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.95248889923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.29096841812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.994712769985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.747330605984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0207999963313\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.158995479345\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.74560809135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.559956371784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0206812545657\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.45380783081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.3027176857\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.74909591675\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.36888813972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.159244179726\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00187015533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.87737822533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72692549229\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.89921569824\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.51035165787\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27729272842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00499874725938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.38246393204\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.9525179863\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.29098033905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998843669891\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.907702028751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00154000031762\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00499874725938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.7455984354\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.559955894947\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0206812303513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.45381164551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.30269384384\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.74906110764\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.36890244484\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.159244820476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00183820724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.87737250328\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.7269256115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.89922237396\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.51038217545\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27727627754\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.161353841424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.38246154785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.95248889923\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.29096841812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995362341404\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.764035582542\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0211999919266\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.161353841424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.74560809135\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.559956371784\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0206812545657\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.264931 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 30\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 15000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1500000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.45126152039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.30855321884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.77185153961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.37364006042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.159440949559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00142860413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.8789036274\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72696387768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.92525005341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.5125746727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27923321724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.159945309162\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.50855636597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 5.9870095253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.30891561508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.995383441448\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.755910158157\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0218999926001\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.159945309162\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.7809484005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.563234627247\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0199234094471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.45129537582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.30855226517\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.77182006836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.37362527847\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.159441739321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00145721436\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.87892222404\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72697114944\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.92523765564\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.5125579834\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27921772003\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0052194846794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.50858449936\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 5.98699235916\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.3088889122\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998774111271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.904954195023\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00160000030883\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0052194846794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.78094053268\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.56323415041\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0199234373868\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.45126152039\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.30855321884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.2360560894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.77185153961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.37364006042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.159440949559\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00142860413\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.8789036274\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72696387768\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.92525005341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.5125746727\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27923321724\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.172797784209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.50855636597\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 5.9870095253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.30891561508\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995368361473\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.741488099098\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0201999936253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.172797784209\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.7809484005\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.563234627247\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0199234094471\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.279603 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 31\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 15500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1550000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.45977544785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.31496477127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605561256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.77787017822\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.37872552872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.167061835527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00070905685\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88056731224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.7269756794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.94437408447\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.51490449905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.27992272377\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.131766811013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.49069547653\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.01968860626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.32379293442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.99406349659\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.709186255932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0214999895543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.131766811013\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.75881135464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.566387176514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0195109490305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.45976924896\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.31498289108\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.77783346176\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.37874174118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.167062133551\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00073814392\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.88058972359\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72698163986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.94434833527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.51487779617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.27992391586\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00692026689649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.49070358276\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.01966762543\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.323802948\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.99833124876\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.877075016499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00206000055186\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00692026689649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.7588135004\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.566390037537\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0195109229535\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.45977544785\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.31496477127\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605561256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.77787017822\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.37872552872\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.167061835527\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00070905685\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88056731224\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.7269756794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.94437408447\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.51490449905\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.27992272377\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.161748409271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.49069547653\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.01968860626\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.32379293442\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.994541585445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.741445958614\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0221999902278\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.161748409271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.75881135464\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.566387176514\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0195109490305\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.251266 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 32\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 16000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1600000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.45842170715\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.32045173645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605561256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.78466415405\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.38315415382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.16744081676\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00018596649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88205099106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72608160973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.9562330246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.51705217361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28056788445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.156137660146\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.55750894547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.04845666885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.33018064499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.995250225067\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.769113063812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0210999939591\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.156137660146\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.7797113657\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.568675458431\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0223224461079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.45844841003\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.32046604156\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.7846736908\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.3831589222\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.167441576719\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00020599365\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.88205075264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.7260876894\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.9562292099\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.51702356339\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.280554533\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00448899809271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.55747938156\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.0484457016\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.33017015457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998964965343\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.915260314941\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.0013400001917\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00448899809271\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.77971935272\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.568675458431\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0223225466907\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.45842170715\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.32045173645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605561256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.78466415405\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.38315415382\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.16744081676\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00018596649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88205099106\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72608160973\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.9562330246\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.51705217361\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28056788445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.185146003962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.55750894547\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.04845666885\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.33018064499\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995594918728\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.771956503391\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0222999881953\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.185146003962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.7797113657\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.568675458431\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0223224461079\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.265816 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 33\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 16500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1650000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.48042154312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.32581949234\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605561256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.79249668121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.38737988472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.167504921556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.0035238266\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88333916664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72610199451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.94651126862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.51890897751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28360319138\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.142962425947\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.59494447708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.06826543808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.36811923981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.995299935341\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.757121562958\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0198999904096\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.142962425947\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.8589527607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.570496380329\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0232647489756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.48045063019\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.32584047318\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605871201\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.79252815247\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.38736534119\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.167504131794\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00354385376\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.88335561752\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72609436512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.94646167755\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.51891183853\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28361749649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00277355127037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.59491348267\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.06824493408\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.36814403534\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999049842358\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.921933472157\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000999999581836\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00277355127037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.85895049572\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.570495426655\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0232646763325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.48042154312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.32581949234\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605561256\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.79249668121\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.38737988472\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.167504921556\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.0035238266\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88333916664\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72610199451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.94651126862\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.51890897751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28360319138\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.179574415088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.59494447708\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.06826543808\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.36811923981\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995453417301\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.75123167038\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0197999905795\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.179574415088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.8589527607\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.570496380329\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0232647489756\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.231476 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 34\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 17000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1700000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.4917049408\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.33141994476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.79732465744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.39186024666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171120882034\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00534772873\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88460206985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72610270977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.96625423431\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.52066421509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28276824951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.141110450029\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.61644887924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.09203910828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.40572547913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.994820356369\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.726503133774\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0200999956578\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.141110450029\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.85092616081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.572713196278\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0240506455302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.49167537689\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.33143472672\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.79731702805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.39186143875\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171120166779\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00534725189\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.88458299637\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72609496117\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.9662437439\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.52065134048\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28278303146\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00290546845645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.61642169952\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.09206676483\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.40573072433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999073982239\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.924475312233\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000939999590628\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00290546845645\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.85091614723\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.572711467743\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0240505319089\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.4917049408\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.33141994476\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.79732465744\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.39186024666\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171120882034\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00534772873\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88460206985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72610270977\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.96625423431\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.52066421509\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28276824951\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.162981122732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.61644887924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.09203910828\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.40572547913\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995312690735\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.743762373924\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0194999910891\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.162981122732\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.85092616081\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.572713196278\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0240506455302\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.214131 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 35\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 17500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1750000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.49574804306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.3364033699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.8160161972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.39588427544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171171665192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00441598892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88574457169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72610199451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 8.98808574677\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.52225542068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28273797035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.170048907399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.62913417816\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.11489725113\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.41416931152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.994616866112\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.73312073946\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0217999909073\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.170048907399\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.85863983631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.574832618237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0238261986524\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.49571895599\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.33637952805\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605918884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.81597948074\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.39588832855\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171171709895\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00439691544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.88574552536\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72609436512\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 8.98807621002\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.52225255966\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28275132179\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00725457724184\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.62916135788\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.11490011215\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.41417980194\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.998784661293\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.90457379818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00184000050649\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00725457724184\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.85864841938\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.574829816818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0238260868937\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.49574804306\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.3364033699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.8160161972\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.39588427544\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171171665192\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00441598892\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88574457169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72610199451\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 8.98808574677\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.52225542068\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28273797035\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.188135892153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.62913417816\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.11489725113\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.41416931152\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.99530762434\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.754189014435\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0216999892145\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.188135892153\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.85863983631\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.574832618237\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0238261986524\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.284179 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 36\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 18000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1800000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.50911712646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.34344434738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.84686803818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.40156388283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171174243093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00547456741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88733744621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72609961033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.016705513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.5244436264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28328037262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.147451668978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.66465806961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.14104557037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.43022489548\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.994985222816\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.730050563812\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0206999927759\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.147451668978\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.78328752518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.577396690845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.025094171986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.50908374786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.34342718124\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605918884\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.8468914032\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.40154623985\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171174883842\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00550603867\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.8873193264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72609198093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.0167131424\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.52441453934\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28326916695\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00539966486394\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.66468572617\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.14102125168\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.43022203445\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.99889010191\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.915294647217\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.00152000051457\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00539966486394\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.78329563141\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.57739341259\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0250942651182\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.50911712646\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.34344434738\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.84686803818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.40156388283\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171174243093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00547456741\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88733744621\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72609961033\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.016705513\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.5244436264\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28328037262\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.161581993103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.66465806961\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.14104557037\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.43022489548\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995217263699\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.752208411694\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0202999934554\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.161581993103\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.78328752518\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.577396690845\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.025094171986\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.277391 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 37\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 18500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1850000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.51882982254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.34898805618\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.86316585541\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.40600013733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171176031232\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00360631943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88884663582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72619795799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.0371131897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.526512146\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28363656998\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.174357533455\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.70250511169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.17451667786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.43355512619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.995144307613\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.754079401493\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0214999951422\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.174357533455\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.83495354652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.580399692059\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0246269144118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.51883935928\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.34899139404\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.86313438416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.40601491928\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171176567674\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00361680984\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.88884592056\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72620582581\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.03706741333\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.52653741837\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28362202644\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.00331209623255\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.70247983932\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.17454624176\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.43355798721\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999139487743\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.931698381901\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000979999545962\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.00331209623255\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.83494448662\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.580400049686\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0246269479394\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.51882982254\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.34898805618\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.86316585541\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.40600013733\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171176031232\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00360631943\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88884663582\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72619795799\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.0371131897\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.526512146\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28363656998\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.164556577802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.70250511169\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.17451667786\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.43355512619\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.995738983154\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.76286149025\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0205999910831\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.164556577802\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.83495354652\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.580399692059\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0246269144118\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.300500 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 38\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 19000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1900000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.52381372452\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.35216140747\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.87646770477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.40848636627\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171177119017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00470304489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.88970422745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72622287273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.0545091629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.52772140503\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28486537933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_objective: 0.16956473887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_max: 6.70925521851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_mean: 6.2000246048\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_col_norms_min: 5.47072219849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_mean_max_class: 0.996227920055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_min_max_class: 0.774923741817\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_misclass: 0.0192999932915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_nll: 0.16956473887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_max: 1.87937033176\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_mean: 0.582399070263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_y_row_norms_min: 0.0244527608156\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_max: 6.52384281158\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_mean: 4.35217618942\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_col_norms_min: 2.23605895042\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_max: 6.87646818161\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_mean: 3.40846681595\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h0_row_norms_min: 0.171177104115\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_max: 6.00473213196\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_mean: 3.88968753815\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_col_norms_min: 1.72621440887\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_max: 9.05449295044\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_mean: 5.52773332596\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_h1_row_norms_min: 3.28484797478\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_objective: 0.0016456496669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_max: 6.70928049088\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_mean: 6.20005607605\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_col_norms_min: 5.47074699402\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_max_max_class: 0.999994218349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_mean_max_class: 0.999532461166\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_min_max_class: 0.958807349205\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_misclass: 0.000520000001416\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_nll: 0.0016456496669\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_max: 1.87937915325\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_mean: 0.582397639751\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttrain_y_row_norms_min: 0.0244527999312\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_max: 6.52381372452\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_mean: 4.35216140747\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_max: 6.87646770477\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_mean: 3.40848636627\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h0_row_norms_min: 0.171177119017\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_max: 6.00470304489\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_mean: 3.88970422745\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_col_norms_min: 1.72622287273\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_max: 9.0545091629\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_mean: 5.52772140503\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_h1_row_norms_min: 3.28486537933\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_objective: 0.174608826637\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_max: 6.70925521851\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_mean: 6.2000246048\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_col_norms_min: 5.47072219849\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_max_max_class: 0.999999344349\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_mean_max_class: 0.996570110321\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_min_max_class: 0.792669534683\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_misclass: 0.0185999963433\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_nll: 0.174608826637\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_max: 1.87937033176\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_mean: 0.582399070263\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tvalid_y_row_norms_min: 0.0244527608156\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Time this epoch: 3.301847 seconds\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "Monitoring step:\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tEpochs seen: 39\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tBatches seen: 19500\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tExamples seen: 1950000\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tlearning_rate: 0.00999999046326\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\tmomentum: 0.989998817444\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_max: 6.52631568909\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_mean: 4.35376691818\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_col_norms_min: 2.23605656624\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_max: 6.87409830093\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_mean: 3.40977239609\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h0_row_norms_min: 0.171177133918\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_max: 6.00363349915\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_mean: 3.89011406898\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_col_norms_min: 1.72623074055\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_max: 9.06535053253\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_mean: 5.52831077576\n" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\ttest_h1_row_norms_min: 3.28474617004\n" ] }, { "output_type": "stream", "stream": "stdout",