{ "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Predicting and Generating Texts\n", "\n", "This notebook explores the idea of predicting items in a sequence, and then using those predictions to generate new sequences based on the probabilities.\n" ] }, { "cell_type": "code", "execution_count": 1, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "Using Theano backend.\n", "ConX, version 3.6.0\n" ] } ], "source": [ "import conx as cx" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## EmbeddingLayer\n", "\n", "An EmbeddingLayer allows the system to find (or use) distributed representations for words or letters. \n", "\n", "First, we need a method of encoding and decoding our sequenced data. We'll begin with characters." ] }, { "cell_type": "code", "execution_count": 2, "metadata": {}, "outputs": [], "source": [ "def encode(s):\n", " \"\"\"Convert string or char into integers\"\"\"\n", " if len(s) == 1:\n", " return (1 + ord(s.lower()) - ord('a')) if s.isalpha() else 0\n", " else:\n", " return cleanup([encode(c) for c in s])\n", "\n", "def cleanup(items):\n", " \"\"\"Remove repeated zeros\"\"\"\n", " retval = []\n", " for i in items:\n", " if ((i != 0) or \n", " (len(retval) == 0) or \n", " (retval[-1] != 0)):\n", " retval.append(i)\n", " return retval\n", "\n", "def decode(n):\n", " \"\"\"Convert integers into characters\"\"\"\n", " if isinstance(n, (list, tuple)):\n", " return [decode(v) for v in n]\n", " elif n == 0:\n", " return ' '\n", " else:\n", " return chr(ord('a') + int(n) - 1)" ] }, { "cell_type": "code", "execution_count": 3, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "8" ] }, "execution_count": 3, "metadata": {}, "output_type": "execute_result" } ], "source": [ "encode(\"H\")" ] }, { "cell_type": "code", "execution_count": 4, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[8, 5, 12, 12, 15, 0, 23, 15, 18, 12, 4, 0]" ] }, "execution_count": 4, "metadata": {}, "output_type": "execute_result" } ], "source": [ "encode(\"Hello, world!\")" ] }, { "cell_type": "code", "execution_count": 5, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[1, 1, 1, 1]" ] }, "execution_count": 5, "metadata": {}, "output_type": "execute_result" } ], "source": [ "encode(\"AaaA\")" ] }, { "cell_type": "code", "execution_count": 6, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "'h'" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "decode(8)" ] }, { "cell_type": "code", "execution_count": 7, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[' ', 'w', 'h', 'a', 't', ' ', 's', ' ', 'u', 'p', ' ', 'd', 'o', 'c', ' ']" ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "decode(encode(\" what's up doc? \"))" ] }, { "cell_type": "code", "execution_count": 8, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "' what s up doc '" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "\"\".join(decode(encode(\" what's up doc? \")))" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Given 1 - Predict 1\n", "\n", "Let's start out with sequence of characers of length 1. We'll just try to predict what the next character is given a single letter. We'll start with a fairly small corpus:" ] }, { "cell_type": "code", "execution_count": 9, "metadata": {}, "outputs": [], "source": [ "corpus = \"\"\"Four score and seven years ago our fathers brought forth on this continent, \n", "a new nation, conceived in Liberty, and dedicated to the proposition that all men are \n", "created equal. Now we are engaged in a great civil war, testing whether that nation, or \n", "any nation so conceived and so dedicated, can long endure. We are met on a great battle-field \n", "of that war. We have come to dedicate a portion of that field, as a final resting place \n", "for those who here gave their lives that that nation might live. It is altogether fitting \n", "and proper that we should do this. But, in a larger sense, we can not dedicate — we can not \n", "consecrate — we can not hallow — this ground. The brave men, living and dead, who struggled \n", "here, have consecrated it, far above our poor power to add or detract. The world will little \n", "note, nor long remember what we say here, but it can never forget what they did here. It is \n", "for us the living, rather, to be dedicated here to the unfinished work which they who fought \n", "here have thus far so nobly advanced. It is rather for us to be here dedicated to the great \n", "task remaining before us — that from these honored dead we take increased devotion to that \n", "cause for which they gave the last full measure of devotion — that we here highly resolve that \n", "these dead shall not have died in vain — that this nation, under God, shall have a new birth of \n", "freedom — and that government of the people, by the people, for the people, shall not perish \n", "from the earth.\"\"\"" ] }, { "cell_type": "code", "execution_count": 10, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "'four score and seven years ago our fathers brought forth on this continent a new nation conceived in liberty and dedicated to the proposition that all men are created equal now we are engaged in a great civil war testing whether that nation or any nation so conceived and so dedicated can long endure we are met on a great battle field of that war we have come to dedicate a portion of that field as a final resting place for those who here gave their lives that that nation might live it is altogether fitting and proper that we should do this but in a larger sense we can not dedicate we can not consecrate we can not hallow this ground the brave men living and dead who struggled here have consecrated it far above our poor power to add or detract the world will little note nor long remember what we say here but it can never forget what they did here it is for us the living rather to be dedicated here to the unfinished work which they who fought here have thus far so nobly advanced it is rather for us to be here dedicated to the great task remaining before us that from these honored dead we take increased devotion to that cause for which they gave the last full measure of devotion that we here highly resolve that these dead shall not have died in vain that this nation under god shall have a new birth of freedom and that government of the people by the people for the people shall not perish from the earth '" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "\"\".join(decode(encode(corpus)))" ] }, { "cell_type": "code", "execution_count": 11, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "26" ] }, "execution_count": 11, "metadata": {}, "output_type": "execute_result" } ], "source": [ "len_vocab = max(encode(corpus)) + 1\n", "len_vocab" ] }, { "cell_type": "code", "execution_count": 13, "metadata": {}, "outputs": [], "source": [ "dataset = []\n", "encoded_corpus = encode(corpus)\n", "for i in range(len(encoded_corpus) - 1):\n", " code = encoded_corpus[i]\n", " next_code = encoded_corpus[i + 1]\n", " dataset.append([[code], cx.onehot(next_code, len_vocab)])" ] }, { "cell_type": "code", "execution_count": 16, "metadata": {}, "outputs": [], "source": [ "net = cx.Network(\"Given 1 - Predict 1\")\n", "net.add(cx.Layer(\"input\", 1), \n", " cx.EmbeddingLayer(\"embed\", 26, 64), # in, out\n", " cx.FlattenLayer(\"flatten\"),\n", " cx.Layer(\"output\", 26, activation=\"softmax\"))\n", "net.connect()\n", "net.compile(error=\"categorical_crossentropy\", optimizer=\"adam\")" ] }, { "cell_type": "code", "execution_count": 17, "metadata": {}, "outputs": [], "source": [ "net.dataset.load(dataset)" ] }, { "cell_type": "code", "execution_count": 18, "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "57578a9fbf584081b67bb4617df2e7b1", "version_major": 2, "version_minor": 0 }, "text/html": [ "

Failed to display Jupyter Widget of type Dashboard.

\n", "

\n", " If you're reading this message in the Jupyter Notebook or JupyterLab Notebook, it may mean\n", " that the widgets JavaScript is still loading. If this message persists, it\n", " likely means that the widgets JavaScript library is either not installed or\n", " not enabled. See the Jupyter\n", " Widgets Documentation for setup instructions.\n", "

\n", "

\n", " If you're reading this message in another frontend (for example, a static\n", " rendering on GitHub or NBViewer),\n", " it may mean that your frontend doesn't currently support widgets.\n", "

\n" ], "text/plain": [ "Dashboard(children=(Accordion(children=(HBox(children=(VBox(children=(Select(description='Dataset:', index=1, options=('Test', 'Train'), rows=1, value='Train'), FloatSlider(value=0.5, continuous_update=False, description='Zoom', layout=Layout(width='65%'), max=1.0, style=SliderStyle(description_width='initial')), IntText(value=150, description='Horizontal space between banks:', style=DescriptionStyle(description_width='initial')), IntText(value=30, description='Vertical space between layers:', style=DescriptionStyle(description_width='initial')), HBox(children=(Checkbox(value=False, description='Show Targets', style=DescriptionStyle(description_width='initial')), Checkbox(value=False, description='Errors', style=DescriptionStyle(description_width='initial')))), Select(description='Features:', options=('',), rows=1, value=''), IntText(value=3, description='Feature columns:', style=DescriptionStyle(description_width='initial')), FloatText(value=1.0, description='Feature scale:', style=DescriptionStyle(description_width='initial'))), layout=Layout(width='100%')), VBox(children=(Select(description='Layer:', index=3, options=('input', 'embed', 'flatten', 'output'), rows=1, value='output'), Checkbox(value=True, description='Visible'), Select(description='Colormap:', options=('', 'Accent', 'Accent_r', 'Blues', 'Blues_r', 'BrBG', 'BrBG_r', 'BuGn', 'BuGn_r', 'BuPu', 'BuPu_r', 'CMRmap', 'CMRmap_r', 'Dark2', 'Dark2_r', 'GnBu', 'GnBu_r', 'Greens', 'Greens_r', 'Greys', 'Greys_r', 'OrRd', 'OrRd_r', 'Oranges', 'Oranges_r', 'PRGn', 'PRGn_r', 'Paired', 'Paired_r', 'Pastel1', 'Pastel1_r', 'Pastel2', 'Pastel2_r', 'PiYG', 'PiYG_r', 'PuBu', 'PuBuGn', 'PuBuGn_r', 'PuBu_r', 'PuOr', 'PuOr_r', 'PuRd', 'PuRd_r', 'Purples', 'Purples_r', 'RdBu', 'RdBu_r', 'RdGy', 'RdGy_r', 'RdPu', 'RdPu_r', 'RdYlBu', 'RdYlBu_r', 'RdYlGn', 'RdYlGn_r', 'Reds', 'Reds_r', 'Set1', 'Set1_r', 'Set2', 'Set2_r', 'Set3', 'Set3_r', 'Spectral', 'Spectral_r', 'Vega10', 'Vega10_r', 'Vega20', 'Vega20_r', 'Vega20b', 'Vega20b_r', 'Vega20c', 'Vega20c_r', 'Wistia', 'Wistia_r', 'YlGn', 'YlGnBu', 'YlGnBu_r', 'YlGn_r', 'YlOrBr', 'YlOrBr_r', 'YlOrRd', 'YlOrRd_r', 'afmhot', 'afmhot_r', 'autumn', 'autumn_r', 'binary', 'binary_r', 'bone', 'bone_r', 'brg', 'brg_r', 'bwr', 'bwr_r', 'cool', 'cool_r', 'coolwarm', 'coolwarm_r', 'copper', 'copper_r', 'cubehelix', 'cubehelix_r', 'flag', 'flag_r', 'gist_earth', 'gist_earth_r', 'gist_gray', 'gist_gray_r', 'gist_heat', 'gist_heat_r', 'gist_ncar', 'gist_ncar_r', 'gist_rainbow', 'gist_rainbow_r', 'gist_stern', 'gist_stern_r', 'gist_yarg', 'gist_yarg_r', 'gnuplot', 'gnuplot2', 'gnuplot2_r', 'gnuplot_r', 'gray', 'gray_r', 'hot', 'hot_r', 'hsv', 'hsv_r', 'inferno', 'inferno_r', 'jet', 'jet_r', 'magma', 'magma_r', 'nipy_spectral', 'nipy_spectral_r', 'ocean', 'ocean_r', 'pink', 'pink_r', 'plasma', 'plasma_r', 'prism', 'prism_r', 'rainbow', 'rainbow_r', 'seismic', 'seismic_r', 'spectral', 'spectral_r', 'spring', 'spring_r', 'summer', 'summer_r', 'tab10', 'tab10_r', 'tab20', 'tab20_r', 'tab20b', 'tab20b_r', 'tab20c', 'tab20c_r', 'terrain', 'terrain_r', 'viridis', 'viridis_r', 'winter', 'winter_r'), rows=1, value=''), HTML(value=''), FloatText(value=0.0, description='Leftmost color maps to:', style=DescriptionStyle(description_width='initial')), FloatText(value=1.0, description='Rightmost color maps to:', style=DescriptionStyle(description_width='initial')), IntText(value=0, description='Feature to show:', style=DescriptionStyle(description_width='initial')), HBox(children=(Checkbox(value=False, description='Rotate network', layout=Layout(width='52%'), style=DescriptionStyle(description_width='initial')), Button(icon='save', layout=Layout(width='10%'), style=ButtonStyle())))), layout=Layout(width='100%')))),), selected_index=None, _titles={'0': 'Given 1 - Predict 1'}), VBox(children=(HBox(children=(IntSlider(value=0, continuous_update=False, description='Dataset index', layout=Layout(width='100%'), max=1419), Label(value='of 1420', layout=Layout(width='100px'))), layout=Layout(height='40px')), HBox(children=(Button(icon='fast-backward', layout=Layout(width='100%'), style=ButtonStyle()), Button(icon='backward', layout=Layout(width='100%'), style=ButtonStyle()), IntText(value=0, layout=Layout(width='100%')), Button(icon='forward', layout=Layout(width='100%'), style=ButtonStyle()), Button(icon='fast-forward', layout=Layout(width='100%'), style=ButtonStyle()), Button(description='Play', icon='play', layout=Layout(width='100%'), style=ButtonStyle()), Button(icon='refresh', layout=Layout(width='25%'), style=ButtonStyle())), layout=Layout(height='50px', width='100%'))), layout=Layout(width='100%')), HTML(value='

', layout=Layout(justify_content='center', overflow_x='auto', overflow_y='auto', width='95%')), Output()))" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "application/javascript": [ "\n", "require(['base/js/namespace'], function(Jupyter) {\n", " Jupyter.notebook.kernel.comm_manager.register_target('conx_svg_control', function(comm, msg) {\n", " comm.on_msg(function(msg) {\n", " var data = msg[\"content\"][\"data\"];\n", " var images = document.getElementsByClassName(data[\"class\"]);\n", " for (var i = 0; i < images.length; i++) {\n", " if (data[\"href\"]) {\n", " images[i].setAttributeNS(null, \"href\", data[\"href\"]);\n", " }\n", " if (data[\"src\"]) {\n", " images[i].setAttributeNS(null, \"src\", data[\"src\"]);\n", " }\n", " }\n", " });\n", " });\n", "});\n" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "net.dashboard()" ] }, { "cell_type": "code", "execution_count": 19, "metadata": {}, "outputs": [ { "data": { "image/svg+xml": [ "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "========================================================\n", " | Training | Training \n", "Epochs | Error | Accuracy \n", "------ | --------- | --------- \n", "# 30 | 2.09850 | 0.32324 \n", "Saving network... Saved!\n" ] } ], "source": [ "if net.saved():\n", " net.load()\n", " net.plot_results()\n", "else:\n", " net.train(30, accuracy=.95, save=True)" ] }, { "cell_type": "code", "execution_count": 23, "metadata": {}, "outputs": [], "source": [ "def generate(net, count, len_vocab):\n", " retval = \"\"\n", " # start at a random point:\n", " inputs = cx.choice(net.dataset.inputs)\n", " # now we get the next, and the next, ...\n", " for i in range(count):\n", " # use the outputs as a prob distrbution\n", " outputs = net.propagate(inputs)\n", " code = cx.choice(p=outputs)\n", " c = decode(code)\n", " print(c, end=\"\")\n", " retval += c\n", " return retval" ] }, { "cell_type": "code", "execution_count": 24, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "fhdhaittw twatbwdsnfhtapuyndodntwicnboiptndtafptnwnditiahtnyfpwiwsfthscocbnwqtlhnwwawpnnitaonejhtwagtlndathftptowdclwfawtpaafdohwioawnlwtddcwaaclettgocctehnltpttthttdoatttdgwbtodtapowviwtfacsfdvbiphbdftaltffbwttndwnardnfpcwttrifchtbfahiboatthtttoapbaowrogcgshtdahwiahtmtatfptsftstlwotgmnphaowwhaathlmcctcapaftqtttguwwwsbgcbwitphttvcwwitatfdset btirabdatawtaftbafbstfgfnataattctdrottnsaahbaagttwtdimdwttsyddgwtatgndgtttdsthsctfswhofwhgtgmctfbhoorcxsaatcahtndotpthnoalttatbwnwisobtwwdthpgalbtafhctsfedp" ] }, { "data": { "text/plain": [ "'fhdhaittw twatbwdsnfhtapuyndodntwicnboiptndtafptnwnditiahtnyfpwiwsfthscocbnwqtlhnwwawpnnitaonejhtwagtlndathftptowdclwfawtpaafdohwioawnlwtddcwaaclettgocctehnltpttthttdoatttdgwbtodtapowviwtfacsfdvbiphbdftaltffbwttndwnardnfpcwttrifchtbfahiboatthtttoapbaowrogcgshtdahwiahtmtatfptsftstlwotgmnphaowwhaathlmcctcapaftqtttguwwwsbgcbwitphttvcwwitatfdset btirabdatawtaftbafbstfgfnataattctdrottnsaahbaagttwtdimdwttsyddgwtatgndgtttdsthsctfswhofwhgtgmctfbhoorcxsaatcahtndotpthnoalttatbwnwisobtwwdthpgalbtafhctsfedp'" ] }, "execution_count": 24, "metadata": {}, "output_type": "execute_result" } ], "source": [ "generate(net, 500, len_vocab)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "### Given 5 - Predict 1" ] }, { "cell_type": "code", "execution_count": 25, "metadata": {}, "outputs": [], "source": [ "net2 = cx.Network(\"Given 5 - Predict 1\")\n", "net2.add(cx.Layer(\"input\", 5),\n", " cx.EmbeddingLayer(\"embed\", 26, 64),\n", " cx.FlattenLayer(\"flatten\"),\n", " cx.Layer(\"output\", 26, activation=\"softmax\"))\n", "net2.connect()\n", "net2.compile(error=\"categorical_crossentropy\", optimizer=\"adam\")" ] }, { "cell_type": "code", "execution_count": 26, "metadata": {}, "outputs": [], "source": [ "dataset = []\n", "encoded_corpus = encode(corpus)\n", "for i in range(len(encoded_corpus) - 5):\n", " code = encoded_corpus[i:i+5]\n", " next_code = encoded_corpus[i + 5]\n", " if len(code) == 5:\n", " dataset.append([code, cx.onehot(next_code, len_vocab)])" ] }, { "cell_type": "code", "execution_count": 27, "metadata": {}, "outputs": [], "source": [ "net2.dataset.load(dataset)" ] }, { "cell_type": "code", "execution_count": 28, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "0 ['f', 'o', 'u', 'r', ' '] s\n", "1 ['o', 'u', 'r', ' ', 's'] c\n", "2 ['u', 'r', ' ', 's', 'c'] o\n", "3 ['r', ' ', 's', 'c', 'o'] r\n", "4 [' ', 's', 'c', 'o', 'r'] e\n", "5 ['s', 'c', 'o', 'r', 'e'] \n", "6 ['c', 'o', 'r', 'e', ' '] a\n", "7 ['o', 'r', 'e', ' ', 'a'] n\n", "8 ['r', 'e', ' ', 'a', 'n'] d\n", "9 ['e', ' ', 'a', 'n', 'd'] \n" ] } ], "source": [ "for i in range(10):\n", " print(i, decode(net2.dataset.inputs[i]), decode(cx.argmax(net2.dataset.targets[i])))" ] }, { "cell_type": "code", "execution_count": 29, "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "d5f61d6d5f7e4fccb20c370cff8fcb09", "version_major": 2, "version_minor": 0 }, "text/html": [ "

Failed to display Jupyter Widget of type Dashboard.

\n", "

\n", " If you're reading this message in the Jupyter Notebook or JupyterLab Notebook, it may mean\n", " that the widgets JavaScript is still loading. If this message persists, it\n", " likely means that the widgets JavaScript library is either not installed or\n", " not enabled. See the Jupyter\n", " Widgets Documentation for setup instructions.\n", "

\n", "

\n", " If you're reading this message in another frontend (for example, a static\n", " rendering on GitHub or NBViewer),\n", " it may mean that your frontend doesn't currently support widgets.\n", "

\n" ], "text/plain": [ "Dashboard(children=(Accordion(children=(HBox(children=(VBox(children=(Select(description='Dataset:', index=1, options=('Test', 'Train'), rows=1, value='Train'), FloatSlider(value=0.5, continuous_update=False, description='Zoom', layout=Layout(width='65%'), max=1.0, style=SliderStyle(description_width='initial')), IntText(value=150, description='Horizontal space between banks:', style=DescriptionStyle(description_width='initial')), IntText(value=30, description='Vertical space between layers:', style=DescriptionStyle(description_width='initial')), HBox(children=(Checkbox(value=False, description='Show Targets', style=DescriptionStyle(description_width='initial')), Checkbox(value=False, description='Errors', style=DescriptionStyle(description_width='initial')))), Select(description='Features:', options=('',), rows=1, value=''), IntText(value=3, description='Feature columns:', style=DescriptionStyle(description_width='initial')), FloatText(value=1.0, description='Feature scale:', style=DescriptionStyle(description_width='initial'))), layout=Layout(width='100%')), VBox(children=(Select(description='Layer:', index=3, options=('input', 'embed', 'flatten', 'output'), rows=1, value='output'), Checkbox(value=True, description='Visible'), Select(description='Colormap:', options=('', 'Accent', 'Accent_r', 'Blues', 'Blues_r', 'BrBG', 'BrBG_r', 'BuGn', 'BuGn_r', 'BuPu', 'BuPu_r', 'CMRmap', 'CMRmap_r', 'Dark2', 'Dark2_r', 'GnBu', 'GnBu_r', 'Greens', 'Greens_r', 'Greys', 'Greys_r', 'OrRd', 'OrRd_r', 'Oranges', 'Oranges_r', 'PRGn', 'PRGn_r', 'Paired', 'Paired_r', 'Pastel1', 'Pastel1_r', 'Pastel2', 'Pastel2_r', 'PiYG', 'PiYG_r', 'PuBu', 'PuBuGn', 'PuBuGn_r', 'PuBu_r', 'PuOr', 'PuOr_r', 'PuRd', 'PuRd_r', 'Purples', 'Purples_r', 'RdBu', 'RdBu_r', 'RdGy', 'RdGy_r', 'RdPu', 'RdPu_r', 'RdYlBu', 'RdYlBu_r', 'RdYlGn', 'RdYlGn_r', 'Reds', 'Reds_r', 'Set1', 'Set1_r', 'Set2', 'Set2_r', 'Set3', 'Set3_r', 'Spectral', 'Spectral_r', 'Vega10', 'Vega10_r', 'Vega20', 'Vega20_r', 'Vega20b', 'Vega20b_r', 'Vega20c', 'Vega20c_r', 'Wistia', 'Wistia_r', 'YlGn', 'YlGnBu', 'YlGnBu_r', 'YlGn_r', 'YlOrBr', 'YlOrBr_r', 'YlOrRd', 'YlOrRd_r', 'afmhot', 'afmhot_r', 'autumn', 'autumn_r', 'binary', 'binary_r', 'bone', 'bone_r', 'brg', 'brg_r', 'bwr', 'bwr_r', 'cool', 'cool_r', 'coolwarm', 'coolwarm_r', 'copper', 'copper_r', 'cubehelix', 'cubehelix_r', 'flag', 'flag_r', 'gist_earth', 'gist_earth_r', 'gist_gray', 'gist_gray_r', 'gist_heat', 'gist_heat_r', 'gist_ncar', 'gist_ncar_r', 'gist_rainbow', 'gist_rainbow_r', 'gist_stern', 'gist_stern_r', 'gist_yarg', 'gist_yarg_r', 'gnuplot', 'gnuplot2', 'gnuplot2_r', 'gnuplot_r', 'gray', 'gray_r', 'hot', 'hot_r', 'hsv', 'hsv_r', 'inferno', 'inferno_r', 'jet', 'jet_r', 'magma', 'magma_r', 'nipy_spectral', 'nipy_spectral_r', 'ocean', 'ocean_r', 'pink', 'pink_r', 'plasma', 'plasma_r', 'prism', 'prism_r', 'rainbow', 'rainbow_r', 'seismic', 'seismic_r', 'spectral', 'spectral_r', 'spring', 'spring_r', 'summer', 'summer_r', 'tab10', 'tab10_r', 'tab20', 'tab20_r', 'tab20b', 'tab20b_r', 'tab20c', 'tab20c_r', 'terrain', 'terrain_r', 'viridis', 'viridis_r', 'winter', 'winter_r'), rows=1, value=''), HTML(value=''), FloatText(value=0.0, description='Leftmost color maps to:', style=DescriptionStyle(description_width='initial')), FloatText(value=1.0, description='Rightmost color maps to:', style=DescriptionStyle(description_width='initial')), IntText(value=0, description='Feature to show:', style=DescriptionStyle(description_width='initial')), HBox(children=(Checkbox(value=False, description='Rotate network', layout=Layout(width='52%'), style=DescriptionStyle(description_width='initial')), Button(icon='save', layout=Layout(width='10%'), style=ButtonStyle())))), layout=Layout(width='100%')))),), selected_index=None, _titles={'0': 'Given 5 - Predict 1'}), VBox(children=(HBox(children=(IntSlider(value=0, continuous_update=False, description='Dataset index', layout=Layout(width='100%'), max=1415), Label(value='of 1416', layout=Layout(width='100px'))), layout=Layout(height='40px')), HBox(children=(Button(icon='fast-backward', layout=Layout(width='100%'), style=ButtonStyle()), Button(icon='backward', layout=Layout(width='100%'), style=ButtonStyle()), IntText(value=0, layout=Layout(width='100%')), Button(icon='forward', layout=Layout(width='100%'), style=ButtonStyle()), Button(icon='fast-forward', layout=Layout(width='100%'), style=ButtonStyle()), Button(description='Play', icon='play', layout=Layout(width='100%'), style=ButtonStyle()), Button(icon='refresh', layout=Layout(width='25%'), style=ButtonStyle())), layout=Layout(height='50px', width='100%'))), layout=Layout(width='100%')), HTML(value='

', layout=Layout(justify_content='center', overflow_x='auto', overflow_y='auto', width='95%')), Output()))" ] }, "metadata": {}, "output_type": "display_data" }, { "data": { "application/javascript": [ "\n", "require(['base/js/namespace'], function(Jupyter) {\n", " Jupyter.notebook.kernel.comm_manager.register_target('conx_svg_control', function(comm, msg) {\n", " comm.on_msg(function(msg) {\n", " var data = msg[\"content\"][\"data\"];\n", " var images = document.getElementsByClassName(data[\"class\"]);\n", " for (var i = 0; i < images.length; i++) {\n", " if (data[\"href\"]) {\n", " images[i].setAttributeNS(null, \"href\", data[\"href\"]);\n", " }\n", " if (data[\"src\"]) {\n", " images[i].setAttributeNS(null, \"src\", data[\"src\"]);\n", " }\n", " }\n", " });\n", " });\n", "});\n" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "net2.dashboard()" ] }, { "cell_type": "code", "execution_count": 30, "metadata": {}, "outputs": [ { "data": { "image/svg+xml": [ "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "========================================================\n", " | Training | Training \n", "Epochs | Error | Accuracy \n", "------ | --------- | --------- \n", "# 80 | 1.12873 | 0.63983 \n", "Saving network... Saved!\n" ] } ], "source": [ "if net2.saved():\n", " net2.load()\n", " net2.plot_results()\n", "else:\n", " net2.train(80, accuracy=.95, plot=True, save=True)" ] }, { "cell_type": "code", "execution_count": 31, "metadata": {}, "outputs": [], "source": [ "def generate2(net, count, len_vocab):\n", " # start at a random point:\n", " inputs = cx.choice(net.dataset.inputs)\n", " retval = \"\".join(decode(inputs))\n", " print(retval, end=\"\")\n", " # now we get the next, and the next, ...\n", " for i in range(count):\n", " # use the outputs as a prob distrbution\n", " outputs = net.propagate(inputs)\n", " pickone = cx.choice(p=outputs)\n", " inputs = inputs[1:] + [pickone]\n", " c = decode(pickone)\n", " print(c, end=\"\")\n", " retval += c\n", " return retval" ] }, { "cell_type": "code", "execution_count": 32, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "e peopleiby vat ongtinn ar angarese rag we the plople shere tibi fromet on which they nat bevel we iond inge hethat theasgre wer an te te areat t as allonot have ifiogr ad thas the hen nats ansur tois not hsus tofint in aly and worker measer abeveicin nation conted and poreshave diditt w us the unf refuld shall forly ghe seaded coute cattictiscrmanttonn in as reltngated titilingread dedecrten neveromed sored what we iond ingatherediin wer at bevey dedicored mant we aread ingo ged hore onot heveriend thatl ofot devicitticane wera the s all mot ung lint at an thet ca these rat se ar us te bed wh lingogat devation now efremensunfor ho here ed incaitno finglthit fitt on this thag wer gowt ha ploush newir for share ofvem ther conthe nigilllm ther forge her ghave comticin neate dedicare dist wa thes can nor lingllln fiea und wh liwis re herage wencre ted in lion trea n areso now hare deargwen reatibe med seadedicaut th se fad d se what or and dedicadedd arevot here aat of thas nfrelatg and wencre" ] }, { "data": { "text/plain": [ "'e peopleiby vat ongtinn ar angarese rag we the plople shere tibi fromet on which they nat bevel we iond inge hethat theasgre wer an te te areat t as allonot have ifiogr ad thas the hen nats ansur tois not hsus tofint in aly and worker measer abeveicin nation conted and poreshave diditt w us the unf refuld shall forly ghe seaded coute cattictiscrmanttonn in as reltngated titilingread dedecrten neveromed sored what we iond ingatherediin wer at bevey dedicored mant we aread ingo ged hore onot heveriend thatl ofot devicitticane wera the s all mot ung lint at an thet ca these rat se ar us te bed wh lingogat devation now efremensunfor ho here ed incaitno finglthit fitt on this thag wer gowt ha ploush newir for share ofvem ther conthe nigilllm ther forge her ghave comticin neate dedicare dist wa thes can nor lingllln fiea und wh liwis re herage wencre ted in lion trea n areso now hare deargwen reatibe med seadedicaut th se fad d se what or and dedicadedd arevot here aat of thas nfrelatg and wencre'" ] }, "execution_count": 32, "metadata": {}, "output_type": "execute_result" } ], "source": [ "generate2(net2, 1000, 26)" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## LSTMLayer\n", "\n", "\n", "\n", "### Many to One Model" ] }, { "cell_type": "code", "execution_count": 33, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "/home/dblank/.local/lib/python3.6/site-packages/keras/layers/recurrent.py:1993: UserWarning: RNN dropout is no longer supported with the Theano backend due to technical limitations. You can either set `dropout` and `recurrent_dropout` to 0, or use the TensorFlow backend.\n", " 'RNN dropout is no longer supported with the Theano backend '\n" ] } ], "source": [ "net3 = cx.Network(\"LSTM - Many to One\")\n", "net3.add(cx.Layer(\"input\", 40), # sequence length\n", " cx.EmbeddingLayer(\"embed\", 26, 64), # sequence_length from input\n", " cx.LSTMLayer(\"lstm\", 64),\n", " cx.Layer(\"output\", 26, activation=\"softmax\"))\n", "net3.connect()\n", "net3.compile(loss='categorical_crossentropy', optimizer='adam')" ] }, { "cell_type": "code", "execution_count": 34, "metadata": {}, "outputs": [], "source": [ "dataset = []\n", "encoded_corpus = encode(corpus)\n", "for i in range(len(encoded_corpus) - 40):\n", " code = encoded_corpus[i:i+40]\n", " next_code = encoded_corpus[i + 40]\n", " if len(code) == 40:\n", " dataset.append([code, cx.onehot(next_code, len_vocab)])" ] }, { "cell_type": "code", "execution_count": 35, "metadata": {}, "outputs": [], "source": [ "net3.dataset.load(dataset)" ] }, { "cell_type": "code", "execution_count": 37, "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "71ac0e6a4b9341b09221855273163812", "version_major": 2, "version_minor": 0 }, "text/html": [ "

Failed to display Jupyter Widget of type Dashboard.

\n", "

\n", " If you're reading this message in the Jupyter Notebook or JupyterLab Notebook, it may mean\n", " that the widgets JavaScript is still loading. If this message persists, it\n", " likely means that the widgets JavaScript library is either not installed or\n", " not enabled. See the Jupyter\n", " Widgets Documentation for setup instructions.\n", "

\n", "

\n", " If you're reading this message in another frontend (for example, a static\n", " rendering on GitHub or NBViewer),\n", " it may mean that your frontend doesn't currently support widgets.\n", "

\n" ], "text/plain": [ "Dashboard(children=(Accordion(children=(HBox(children=(VBox(children=(Select(description='Dataset:', index=1, options=('Test', 'Train'), rows=1, value='Train'), FloatSlider(value=0.5, continuous_update=False, description='Zoom', layout=Layout(width='65%'), max=1.0, style=SliderStyle(description_width='initial')), IntText(value=150, description='Horizontal space between banks:', style=DescriptionStyle(description_width='initial')), IntText(value=30, description='Vertical space between layers:', style=DescriptionStyle(description_width='initial')), HBox(children=(Checkbox(value=True, description='Show Targets', style=DescriptionStyle(description_width='initial')), Checkbox(value=False, description='Errors', style=DescriptionStyle(description_width='initial')))), Select(description='Features:', options=('',), rows=1, value=''), IntText(value=3, description='Feature columns:', style=DescriptionStyle(description_width='initial')), FloatText(value=1.0, description='Feature scale:', style=DescriptionStyle(description_width='initial'))), layout=Layout(width='100%')), VBox(children=(Select(description='Layer:', index=3, options=('input', 'embed', 'lstm', 'output'), rows=1, value='output'), Checkbox(value=True, description='Visible'), Select(description='Colormap:', options=('', 'Accent', 'Accent_r', 'Blues', 'Blues_r', 'BrBG', 'BrBG_r', 'BuGn', 'BuGn_r', 'BuPu', 'BuPu_r', 'CMRmap', 'CMRmap_r', 'Dark2', 'Dark2_r', 'GnBu', 'GnBu_r', 'Greens', 'Greens_r', 'Greys', 'Greys_r', 'OrRd', 'OrRd_r', 'Oranges', 'Oranges_r', 'PRGn', 'PRGn_r', 'Paired', 'Paired_r', 'Pastel1', 'Pastel1_r', 'Pastel2', 'Pastel2_r', 'PiYG', 'PiYG_r', 'PuBu', 'PuBuGn', 'PuBuGn_r', 'PuBu_r', 'PuOr', 'PuOr_r', 'PuRd', 'PuRd_r', 'Purples', 'Purples_r', 'RdBu', 'RdBu_r', 'RdGy', 'RdGy_r', 'RdPu', 'RdPu_r', 'RdYlBu', 'RdYlBu_r', 'RdYlGn', 'RdYlGn_r', 'Reds', 'Reds_r', 'Set1', 'Set1_r', 'Set2', 'Set2_r', 'Set3', 'Set3_r', 'Spectral', 'Spectral_r', 'Vega10', 'Vega10_r', 'Vega20', 'Vega20_r', 'Vega20b', 'Vega20b_r', 'Vega20c', 'Vega20c_r', 'Wistia', 'Wistia_r', 'YlGn', 'YlGnBu', 'YlGnBu_r', 'YlGn_r', 'YlOrBr', 'YlOrBr_r', 'YlOrRd', 'YlOrRd_r', 'afmhot', 'afmhot_r', 'autumn', 'autumn_r', 'binary', 'binary_r', 'bone', 'bone_r', 'brg', 'brg_r', 'bwr', 'bwr_r', 'cool', 'cool_r', 'coolwarm', 'coolwarm_r', 'copper', 'copper_r', 'cubehelix', 'cubehelix_r', 'flag', 'flag_r', 'gist_earth', 'gist_earth_r', 'gist_gray', 'gist_gray_r', 'gist_heat', 'gist_heat_r', 'gist_ncar', 'gist_ncar_r', 'gist_rainbow', 'gist_rainbow_r', 'gist_stern', 'gist_stern_r', 'gist_yarg', 'gist_yarg_r', 'gnuplot', 'gnuplot2', 'gnuplot2_r', 'gnuplot_r', 'gray', 'gray_r', 'hot', 'hot_r', 'hsv', 'hsv_r', 'inferno', 'inferno_r', 'jet', 'jet_r', 'magma', 'magma_r', 'nipy_spectral', 'nipy_spectral_r', 'ocean', 'ocean_r', 'pink', 'pink_r', 'plasma', 'plasma_r', 'prism', 'prism_r', 'rainbow', 'rainbow_r', 'seismic', 'seismic_r', 'spectral', 'spectral_r', 'spring', 'spring_r', 'summer', 'summer_r', 'tab10', 'tab10_r', 'tab20', 'tab20_r', 'tab20b', 'tab20b_r', 'tab20c', 'tab20c_r', 'terrain', 'terrain_r', 'viridis', 'viridis_r', 'winter', 'winter_r'), rows=1, value=''), HTML(value=''), FloatText(value=0.0, description='Leftmost color maps to:', style=DescriptionStyle(description_width='initial')), FloatText(value=1.0, description='Rightmost color maps to:', style=DescriptionStyle(description_width='initial')), IntText(value=0, description='Feature to show:', style=DescriptionStyle(description_width='initial')), HBox(children=(Checkbox(value=True, description='Rotate network', layout=Layout(width='52%'), style=DescriptionStyle(description_width='initial')), Button(icon='save', layout=Layout(width='10%'), style=ButtonStyle())))), layout=Layout(width='100%')))),), selected_index=None, _titles={'0': 'LSTM - Many to One'}), VBox(children=(HBox(children=(IntSlider(value=0, continuous_update=False, description='Dataset index', layout=Layout(width='100%'), max=1380), Label(value='of 1381', layout=Layout(width='100px'))), layout=Layout(height='40px')), HBox(children=(Button(icon='fast-backward', layout=Layout(width='100%'), style=ButtonStyle()), Button(icon='backward', layout=Layout(width='100%'), style=ButtonStyle()), IntText(value=0, layout=Layout(width='100%')), Button(icon='forward', layout=Layout(width='100%'), style=ButtonStyle()), Button(icon='fast-forward', layout=Layout(width='100%'), style=ButtonStyle()), Button(description='Play', icon='play', layout=Layout(width='100%'), style=ButtonStyle()), Button(icon='refresh', layout=Layout(width='25%'), style=ButtonStyle())), layout=Layout(height='50px', width='100%'))), layout=Layout(width='100%')), HTML(value='

', layout=Layout(justify_content='center', overflow_x='auto', overflow_y='auto', width='95%')), Output()))" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "dash = net3.dashboard()\n", "dash" ] }, { "cell_type": "code", "execution_count": 38, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[0.038273777812719345,\n", " 0.03815032169222832,\n", " 0.03845784068107605,\n", " 0.03826185688376427,\n", " 0.03870994597673416,\n", " 0.03826727718114853,\n", " 0.03833876550197601,\n", " 0.038511499762535095,\n", " 0.03865756466984749,\n", " 0.03865499049425125,\n", " 0.038360513746738434,\n", " 0.03830300644040108,\n", " 0.038377050310373306,\n", " 0.03853989392518997,\n", " 0.03817221522331238,\n", " 0.03834393247961998,\n", " 0.038742661476135254,\n", " 0.038073718547821045,\n", " 0.03857533633708954,\n", " 0.03845741227269173,\n", " 0.038555778563022614,\n", " 0.03872159868478775,\n", " 0.03873656317591667,\n", " 0.03813197463750839,\n", " 0.03850744664669037,\n", " 0.039117053151130676]" ] }, "execution_count": 38, "metadata": {}, "output_type": "execute_result" } ], "source": [ "dash.propagate(net3.dataset.inputs[0])" ] }, { "cell_type": "code", "execution_count": 40, "metadata": {}, "outputs": [ { "data": { "image/png": "iVBORw0KGgoAAAANSUhEUgAAAlYAAAEWCAYAAACkFdnuAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3Xl8XHW9//HXZyaTTJqkTdukC90pZUmVFoiVCrKIIpvwE1GpC8IP5eeCyhXQuvwUUe9F/V0UkQuCIOLlgoBe7JUqgoDsS4AWulDaYqF70rRN07RZJvn8/jgnZZomTZqezEym7+fjcR5zlu+c+ZyTzHc+53u+5xxzd0RERERk/8WyHYCIiIhIvlBiJSIiIhIRJVYiIiIiEVFiJSIiIhIRJVYiIiIiEVFiJSIiIhIRJVYZZmY3mdn/zXYcuczMHjOzz4bjnzSzv2U7JpF8pPqod6qPZF8psYqYmZ1vZs+ZWZOZ1YbjXzQzA3D3z7v7DzIcU6GZ3Wdmq8zMzeyk/VzfVWbWZmbbzWyrmT1tZrMjCnc37n6nu5/ax5j+s5cyl5pZjZm1mNnt+xKHmV1oZu3hNqcPB+3LekQySfVRtHKlPkpbx0nhPvxGf94vA0OJVYTM7HLgOuCnwBhgNPB54DigMIuhATwJfArYENH6fu/upUBluO4/dlbW6cysIKLPi8I64IfAbf18/zPuXtplWNe1UHfb3J/9YGbxfsYpovoo/+sjgM8Am4ELIoloH+TYvswpSqwiYmbDgKuBL7r7fe7e6IGX3f2T7t4SlrvdzH4Yji81s7PS1lFgZnVmdnQ4fWx49LXVzBamH9mFzdM/MLOnzKzRzP5mZhXdxebure7+c3d/EmiPcrvdvQ34LUHFPTJs2XnKzH5mZvXAVWG8/zvc3i1m9qCZTUrblg+Y2Wtm1mBmvwQsbdmFZvZk2vR0M3vIzDab2UYz+5aZnQZ8C/h4eNS6sIdY/+ju9wP1Ue6DMK5VZvYNM3sFaAr/lt3NOyL82201s8VmdnbaOm43sxvNbL6ZNQEnRx2nHBhUH+V/fWRmJcB5wJeAaWZW3WX58Wl/r9VmdmE4v9jM/t3M3gy38clw3klmtqbLOlaZ2fvD8assaGn8TzPbBlxoZrPM7JnwM9ab2S/NrDDt/d3tnzFmtsPMRqaVOzr8X0v0Z1/kGiVW0ZkNFAF/2of33AXMSZv+ILDJ3V8ys3HAAwRHNCOAK4A/mFllWvlPABcBowiOQK/of/j9Y2ZFwIXAanffFM5+N/AGwRHyj8zsHIKK5lyCI8onCLadsPL9I/AdoAJYSXBE3d1nlQEPA38FDgIOAf7u7n8F/pXwqNXdZ/RzW7aa2fH9eW9oDnAmUO7uqa7zCCro/wH+RvA3+zJwp5kdlraOTwA/AsoIjrxF+kP1Uf7XR+cC24F7gQcJWq863zsJ+AtwfbiNM4EF4eL/BxwDvIfgb/l1oKOPYZ0D3EdQn91JkBj/C8G+mg2cAnwxjKGn/bMBeAz4WNp6Pw3cHSbGg54Sq+hUEFRCnT+opB0t7DSzE7p5z38BZ5vZkHD6E4RfcIJm8vnuPt/dO9z9IaAGOCPt/b9x99fdfSdwD8GXJ1M+ZmZbgdUEX9IPpy1b5+7Xu3sqjO3zwL+5+9Jw//wrMDP88p8BLA6PqtuAn9Pz6YGzgA3u/u/u3hwehT8X1Qa5e3l4FN2TY8O/Z+ewssvyX7j76nCbu5t3LFAKXBMetT8C/Jndf8z+5O5PhX/z5kg2TA5Eqo/elq/10WcIkrd2gr/d+WktPp8AHnb3u9y9zd3r3X2BmcWA/w181d3Xunu7uz/d2YLZB8+4+/3h/8BOd3/R3Z8N9+0q4FfAiWHZve2f3xL8T3V2eZgD/K6PMeQ8JVbRqQcqLO28s7u/x93Lw2V77Gt3XwEsBT4UVmZnE3xBACYBH03/IQeOB8amrSL9C7+D4Ed7v5jZe+3tjtmL91L0nvCLP8rd3+fuL6YtW92l7CTgurTt2EzQejOO4EhmV3l3927e32kCwRFktjwbbnPnMLXL8u7iTp93EMGRdPrR4ZsE+2Fv6xDZV6qP3pZ39ZGZTSDoKnBnOOtPQJKgdRx6jq0iLNffuHfbF2Z2qJn92cw2hKcH/zX8jL3F0BlvlZlNAT4ANLj78/2MKecosYrOM0ALQVPpvuhsfj8HWBJWbhD8A/+uyw95ibtfE13Ie3L3J/ztjtnT+7uaLtOrgf/TZVuK3f1pYD3BFxAAM7P06W7Wc3AfPzMbuoshfd46YEJ41NhpIrC2l3WI7CvVR2mr6TKdD/XRpwl+v//HzDYQnOpM8vbpwNVA1wM/gE1Acw/LmoDO1srOlqTKLmW6bteNwGvANHcfSnCKtbNPWo/7J2yNv4eg1erT5FFrFSixioy7bwW+D/yHmZ1nZmVmFjOzmUDJXt56N3Aq8AXePjoE+E+CI8cPmlnczJJh58Lx/YnPzIrMLBlOFobr2+OqmQFyE/BNM5sexjLMzD4aLnsAmG5m54ZH118h6HjanT8DY83ssnB7yszs3eGyjcDkLknLbizojJsE4kDnPs3klS3PERzJf93MEhZ0/v0Qwf+ASGRUH+1VPtRHnyH4+85MGz4CnGFBp/A7gfeb2cfCzxlpZjPD1vLbgGvN7KDwbznbgr5prwNJMzszPKX4HYJ+entTBmwDtpvZ4QT/N33ZPwB3EPSHOxslVtITd/8J8DWCzoAbw+FXwDeAp3t4z3qCo8v3AL9Pm7+a4KjxW0AdQfZ/Jf3/my0DdhI0dz8Yjk/a6zsi4u7/DfwYuDtsLl4EnB4u2wR8FLiG4BTFNOCpHtbTSNBs/CGC0w7LefvKuXvD13oze6mHUL5DsN1zCY6UdobzAAhPN7x3L5sy2/a8j9W79rrxu8ffGsZ+OsGR438AF7j7a31dh0hfqT7q3mCvj8zsWIJ9dYO7b0gb5gErgDnu/hZBf7HLCU51LgA6O9FfAbwKvBAu+zEQc/cGgo7nvyZoRW8CdrtKsBtXEPTnagRuYff/mb3tH9z9KYJO8y+5+5u9fM6gYsEpZBEREZHMMbNHgP9y919nO5YoKbESERGRjApb+x8CJoStW3lDpwJFREQkY8zstwT3uLos35IqUIuViIiISGTUYiUiIiISkaw9RLGiosInT56crY8XkSx48cUXN7l713vjDEqqw0QOLH2tv7KWWE2ePJmamppsfbyIZIGZ5c1l1arDRA4sfa2/dCpQREREJCI5n1i5O1feu5AHXllPqr2vD+AWERERybysnQrsq7rtLTy/ajP3vriGceXFXHTcZD7+rgmUJRO9v1lEREQkg3I+sRpVluSRy0/i4aUbufWJf/LDB5Zy3cPLOX/WBC48bgrjyouzHaLkqLa2NtasWUNzc3O2QzngJJNJxo8fTyKhAyCR/lIdlh37W3/lfGIFEI8ZH5w+hg9OH8PC1Vu59cl/cttTq7jtqVWc8c6xfO69UzhyfHm2w5Qcs2bNGsrKypg8eTKZe76ruDv19fWsWbOGKVOmZDsckUFLdVjmRVF/5Xwfq65mTCjnF3OO4vGvn8xnj5/CY8tqOfuXT/GnBWuzHZrkmObmZkaOHKkKKcPMjJEjR+ooW2Q/qQ7LvCjqr0GXWHUaV17MN884gme+eQqzpozgyntf4YVVm7MdluQYVUjZof0uEg19lzJvf/f5oE2sOpUWFXDzp49h/IhiPndHDf/c1JTtkEREROQANegTK4DyIYX85sJ3ETPjot88z+am1myHJEJ9fT0zZ85k5syZjBkzhnHjxu2abm3t2//oRRddxLJly/Za5oYbbuDOO++MIuR98sgjj/Dss89m/HNFJDNUh/XPoOi83heTRpZwywXVzLnlWT53Rw13fvbdJBPxbIclB7CRI0eyYMECAK666ipKS0u54oordivj7rg7sVj3xzi/+c1vev2cL33pS/sfbD888sgjVFRUcOyxx2bl80VkYKkO65+8aLHqdMyk4fzsYzN58c0tXHHvQjo6PNshiexhxYoVVFVV8clPfpLp06ezfv16LrnkEqqrq5k+fTpXX331rrLHH388CxYsIJVKUV5ezty5c5kxYwazZ8+mtrYWgO985zv8/Oc/31V+7ty5zJo1i8MOO4ynn34agKamJj7ykY9QVVXFeeedR3V19a4KM92VV15JVVUVRx55JN/4xjcA2LhxI+eeey7V1dXMmjWLZ599lpUrV/LrX/+an/70p8ycOXPX54hI/lMdtnd502LV6cwjx7Jmy+H8219eY8KIIXzjtMOzHZLkgO//z2KWrNsW6TqrDhrK9z40vV/vfe2117jjjjuorq4G4JprrmHEiBGkUilOPvlkzjvvPKqqqnZ7T0NDAyeeeCLXXHMNX/va17jtttuYO3fuHut2d55//nnmzZvH1VdfzV//+leuv/56xowZwx/+8AcWLlzI0Ucfvcf7Nm7cyPz581m8eDFmxtatWwH4yle+wte//nWOPfZYVq1axVlnncWiRYv47Gc/S0VFBZdddlm/9oGI9J3qsMFTh+VdYgVwyQkH8+bmHdz42EomjhjCnFkTsx2SyG6mTp26q0ICuOuuu7j11ltJpVKsW7eOJUuW7FEpFRcXc/rppwNwzDHH8MQTT3S77nPPPXdXmVWrVgHw5JNP7jp6mzFjBtOn71mZjhgxglgsxuc+9znOPPNMzjrrLAAefvjh3fpIbNmyhZ07d/Zzy0UkH6gO61leJlZmxtVnT2ftlp185/5FHFRezImHVmY7LMmi/h6VDZSSkpJd48uXL+e6667j+eefp7y8nE996lPd3kOlsLBw13g8HieVSnW77qKiol7LdCeRSFBTU8NDDz3Evffey4033sjf/va3XUeP6Z8/mJjZbcBZQK27v6Ob5QZcB5wB7AAudPeXMhulyN6pDutdrtRhedXHKl1BPMYNnzyaaaNK+erdL1O/vSXbIYl0a9u2bZSVlTF06FDWr1/Pgw8+GPlnHHfccdxzzz0AvPrqqyxZsmSPMo2NjWzbto2zzjqLn/3sZ7z88ssAvP/97+eGG27YVa6zX0NZWRmNjY2RxzoAbgdO28vy04Fp4XAJcGMGYhLJG6rDdpe3iRUE97i6fs5RNLWk+OEDS7Mdjki3jj76aKqqqjj88MO54IILOO644yL/jC9/+cusXbuWqqoqvv/971NVVcWwYcN2K9PQ0MCZZ57JjBkzOPHEE7n22muB4FLop556iiOPPJKqqipuueUWAM455xzuuecejjrqqJzuvO7ujwN7u3vwOcAdHngWKDezsZmJTmTwUx22O3Pf+5VzZpYEHgeKCE4d3ufu3+tSpgi4AzgGqAc+7u6r9rbe6upqr6mp6X/k++Davy3jF4+s4HcXz+K903RK8ECxdOlSjjjiiGyHkRNSqRSpVIpkMsny5cs59dRTWb58OQUFA9cboLv9b2Yvunt1D28ZMGY2GfhzD6cC/wxc4+5PhtN/B77h7ntUUGZ2CUGrFhMnTjzmzTffHMiw5QCnOuxtma7D9qf+6ktELcD73H27mSWAJ83sL+GRXaeLgS3ufoiZnQ/8GPh43zdhYH3x5EP48yvr+fZ/L+LBy06guFD3t5IDy/bt2znllFNIpVK4O7/61a8GNKnKV+5+M3AzBAeHWQ5H5IAxmOqwXqPyoElreziZCIeuFco5wFXh+H3AL83MvLfmsAxJJuL88MPv4BO3PMcvHlmuWzDIAae8vJwXX3wx22HkqrXAhLTp8eE8EckRg6kO61MfKzOLm9kCoBZ4yN2f61JkHLAawN1TQAMwspv1XGJmNWZWU1dXt3+R76P3TK3gvGPGc8vjb/DahmjvBSK5K0dy+wPOINvv84ALLHAs0ODu67MdlAgMuu9SXtjffd6nxMrd2919JsGR3Cwz26OfQh/Xc7O7V7t7dWVl5vs6ffuMIxhanOCbf3xVd2U/ACSTSerr61UxZZi7U19fTzKZzHYoAJjZXcAzwGFmtsbMLjazz5vZ58Mi84E3gBXALcAXsxSqyG5Uh2VeFPXXPp2gdPetZvYowaXLi9IWdTalrzGzAmAYQSf2nDK8pJDvnHkEX7tnIXc+9yafnj052yHJABo/fjxr1qwh062jEvwgjB8/PtthAODuc3pZ7kB2HlYmsheqw7Jjf+uvXhMrM6sE2sKkqhj4AEHn9HTzgM8QHBWeBzySK/2ruvrwUeP4w0tr+Mlfl3Hq9DGMHpobR9USvUQiwZQpU7IdhohIv6gOG5z6cipwLPComb0CvEDQx+rPZna1mZ0dlrkVGGlmK4CvAXs+/CdHmBk/+l/vpLW9g6vmLc52OCIiIpJH+nJV4CvAUd3M/27aeDPw0WhDGziTK0r4yinT+OmDy3hoyUY+UDU62yGJiIhIHsjrO6/vzSUnHMxho8v47p8Wsb2l788iEhEREenJAZtYJeIx/vXcd7JhWzPXPfx6tsMRERGRPHDAJlYAx0wazkePGc/tT6/izfqmbIcjIiIig9wBnVgBXH7qYSTiMa75y2vZDkVEREQGuQM+sRo9NMnnT5zKXxZt4IVVm7MdjoiIiAxiB3xiBfC59x7MmKFJfvjnJboju4iIiPSbEiuguDDOlR88jIVrGpi3cF22wxEREZFBSolV6MNHjeMd44by47++xs7W9myHIyIiIoOQEqtQLGZ858wq1jc0c+uTb2Q7HBERERmElFilOfbgkXxw+mj+47GV1DY2ZzscERERGWSUWHUx9/QjaGvv4GcP6aahIiIism+UWHUxpaKEC2ZP5vcvrGbp+m3ZDkdEREQGESVW3fjK+6YxtDjBjx5YirtuvyAiIiJ9o8SqG8OGJPjqKdN4csUmHltWl+1wREREZJBQYtWDTx07iYMrSvjhA0toa+/IdjgiIiIyCCix6kEiHuObZxzByrombnpsZbbDERERkUFAidVefKBqNGfPOIjr/r6cV9c0ZDscERERyXFKrHrxg3PeQUVpEZf9/mWa23RHdhEREemZEqteDBuS4KcfPZKVdU38+K+vZTscERERyWFKrPrgvdMq+czsSfzmqVU8tWJTtsMRERGRHKXEqo/mnn4EB1eWcMW9C2nY2ZbtcERERCQHKbHqo+LCOD/72ExqG1v43p8WZTscERERyUFKrPbBjAnlfPl9h3D/gnU88Mr6bIcjIiIiOabXxMrMJpjZo2a2xMwWm9lXuylzkpk1mNmCcPjuwISbfV86+RBmjB/Gt+9/lY3bmrMdjoiIiOSQvrRYpYDL3b0KOBb4kplVdVPuCXefGQ5XRxplDknEY1z78Zk0t7Vz5X2v6FmCIiIiskuviZW7r3f3l8LxRmApMG6gA8tlUytL+dYZR/D463X853NvZTscEdkLMzvNzJaZ2Qozm9vN8olhq/zLZvaKmZ2RjThFJD/sUx8rM5sMHAU8183i2Wa20Mz+YmbTI4gtp3362EmccGgl35+3mPtfXpvtcESkG2YWB24ATgeqgDndtLh/B7jH3Y8Czgf+I7NRikg+6XNiZWalwB+Ay9x9W5fFLwGT3H0GcD1wfw/ruMTMasyspq6urr8x5wQz45efOIrqycO57PcL+PUTb2Q7JBHZ0yxghbu/4e6twN3AOV3KODA0HB8GrMtgfCKSZ/qUWJlZgiCputPd/9h1ubtvc/ft4fh8IGFmFd2Uu9ndq929urKycj9Dz76hyQS3XzSLM945hh8+sJQfPbCEjg71uRLJIeOA1WnTa9izK8NVwKfMbA0wH/hyTyvLp4NDERkYfbkq0IBbgaXufm0PZcaE5TCzWeF666MMNFclE3Gun3M0n5k9iVue+Cdfu2cBramObIclIn03B7jd3ccDZwC/M7Nu68Z8OzgUkegV9KHMccCngVfNbEE471vARAB3vwk4D/iCmaWAncD5fgBdLhePGVedPZ1RQ5P89MFl1De1cuOnjqG0qC+7V0QG0FpgQtr0+HBeuouB0wDc/RkzSwIVQG1GIhSRvNLrL7+7PwlYL2V+CfwyqqAGIzPjSycfQmVZEd/846vMuflZbrvwXVSWFWU7NJED2QvANDObQpBQnQ98okuZt4BTgNvN7AggCeg8n4j0i+68HrGPVU/glguOYXltI+fd9DQrardnOySRA5a7p4BLgQcJbhVzj7svNrOrzezssNjlwOfMbCFwF3DhgdTiLiLRsmzVH9XV1V5TU5OVz86El97awsW3v0Bjc4pPz57EV943jeElhdkOSySrzOxFd6/OdhxRyPc6TER219f6Sy1WA+ToicN58F9O4KPVE/jt06s48aePcsvjb9CSas92aCIiIjJAlFgNoFFlSf7t3Hfyl6+ewNGThvOj+Ut5/7X/4M+vrNOjcERERPKQEqsMOGxMGbdfNIvfXTyLksICLv2vlzn3xqepWbU526GJiIhIhJRYZdB7p1XywFfey08+ciRrt+zkvJue4UPXP8mtT/6T2sbmbIcnIiIi+0k3WsqweMz42LsmcNaMsdz1/Gruf3ktP/jzEn70wBKOn1bJh486iFOrxlCie2CJiIgMOvr1zpIhhQVcfPwULj5+Css3NnL/grXc//I6/uX3CylOLOKD00fzoRkH8e6DR+pGoyIiIoOEfrFzwLTRZVz5wcO5/AOHUfPmFv775bU88Mo67l+wjnjMmDF+GLOnjuQ9Uys4ZtJwkol4tkMWERGRbiixyiGxmDFryghmTRnBVWdX8cI/t/DMG5t4emU9N/3jDW54dCWF8RhHTSxn9tSRVE8awTvGDaV8iO6PJSIikguUWOWoooI4x0+r4PhpFQBsb0nxwj8388wb9Ty9chPX/X05nXdsGD+8mHeOG8Y7OoeDhjKyVI/SERERyTQlVoNEaVEBJx8+ipMPHwVAw442Xl3bwKJ1Dby6toHFaxv4y6INu8qPHZbkkFGlTK0sZeqoUqZWljC1spRRZUWY7fXRjyIiItJPSqwGqWFDEru1aAE07GxjybptLF7XwKK1Daysa+KemtXsaH37bu+lRQUcXFnCwRUlTBwxhPEjhjBxxBAmjBjCmKFJ4jElXSIiIv2lxCqPDCtOMHvqSGZPHblrnruzYVszK2ubeGPTdlbWbmdlXRMvrNrCvIXr6Ei7AXwibowrL2bCiCGMH17MmKHFjB2WZMyw5K7XsmQiC1smIiIyOCixynNmxthhxYwdVrxb6xZAa6qDdVt3snrLDt7avIPVm3eyenMwvnT9NjZtb91jfaVFBYwZlmRUWVEwDE1SWVrEqKFFaa9JhhYX6JSjiIgccJRYHcAKC2JMrihhckVJt8tbUu3UbmthfUMz6xt2sqGhmfUNzWxoaKa2sZmaN7dQ29hCa6pjj/cWxIzhJYWMGFLIiJK3h2BeguElhQwfEgzlQxKMKClkSGFcyZiIiAxqSqykR0UFcSaE/a964u5sa05R19hMbWMLdeGwual1t2Hphm1sbmpl6462HtdVGI9RPiQRDMWFDC0OxocVB0Pn+NBkgrJkAWXJBEOLg9cSJWUiIpIDlFjJfjGzXYnPIaPKei2fau+gYWcbW3a0sWVHK1vCZGvLjlY272hla1MbW3e20rCzjTVbdrBkXRtbd7bt1gG/OzGDsjDhKi0Kh2QBJUUFlIXTJUUFlBTFKS4sYEgi/vZ4YZziRHzX8rKiBMlETImaiIjsMyVWklEF8RgjS4v2+T5brakgIWvY2UZjcxvbmlM0NrfRGL5u2/n29PaWYNjS1Mpbm3ewPZzXW3KWLh4zSgrjlCUTYVIWJF7FiTjFYSKWTBsvTsQpSsRIxGMUxmMkCoLXwgKjMB4nEbdu35dMxHUlpohIHlFiJYNCYUGMyrIiKsv6f+PT9g5nR2uKna3t7AiHnW0pmlo6p1M0tbaHiVgbTS3tNDanaGp5O1mra2yhua2dnW3t7Gxtp7mtg9b2PfuY7eu2JQtiFBbEKSqIUbgrKYuRiFswXRBPS9TCBK4geC0KXxPxGIlweWH6vLhREIsRjxmJuBGPBdMFcaMgZnusq/PzO5PDRNzUeici0kdKrOSAEY9ZeLow2ltGpNo7aE510Jo+tL/92tbeQUtbx66ErDkcguSsY9e8Xe/puo6wta4tbX2tqXC94fJUh9Oefu+MiHUmWImCt1vlOhO/P3zhPboNh4hISImVyH4qiMcojccgy08Rau/wIOlq76At1UFb+9vTncuC1yAJS3V0kOos0yUZ7EzcgumgTFvnvM7pcEjEY9ndcBGRHKLESiRPxGNGPBb02xIRkezQoaaIiIhIRHpNrMxsgpk9amZLzGyxmX21mzJmZr8wsxVm9oqZHT0w4YqIiIjkrr6cCkwBl7v7S2ZWBrxoZg+5+5K0MqcD08Lh3cCN4auIiIjIAaPXFit3X+/uL4XjjcBSYFyXYucAd3jgWaDczMZGHq2IiIhIDtunPlZmNhk4Cniuy6JxwOq06TXsmXxhZpeYWY2Z1dTV1e1bpCIiIiI5rs+JlZmVAn8ALnP3bf35MHe/2d2r3b26srKyP6sQERERyVl9SqzMLEGQVN3p7n/spshaYELa9PhwnohIVpnZaWa2LLy4Zm4PZT6WdoHOf2U6RhHJH325KtCAW4Gl7n5tD8XmAReEVwceCzS4+/oI4xQR2WdmFgduILjApgqYY2ZVXcpMA74JHOfu04HLMh6oiOSNvlwVeBzwaeBVM1sQzvsWMBHA3W8C5gNnACuAHcBF0YcqIrLPZgEr3P0NADO7m+Bim/Srmj8H3ODuWwDcvTbjUYpI3ug1sXL3J4G9PoHV3R34UlRBiYhEpLsLa7reCuZQADN7CogDV7n7X7tbmZldAlwCMHHixMiDFZHBT3deF5EDXQHBPfhOAuYAt5hZeXcFdQGOiPRGiZWI5LO+XFizBpjn7m3u/k/gdYJES0RknymxEpF89gIwzcymmFkhcD7BxTbp7idorcLMKghODb6RySBFJH8osRKRvOXuKeBS4EGCp0bc4+6LzexqMzs7LPYgUG9mS4BHgSvdvT47EYvIYNeXqwJFRAYtd59PcOVy+rzvpo078LVwEBHZL2qxEhEREYmIEisRERGRiCixEhEREYmIEisRERGRiCixEhEREYmIEisRERGRiCixEhEREYmIEisRERGRiCixEhEREYmIEitkOsxIAAAV30lEQVQRERGRiCixEhEREYmIEisRERGRiCixEhEREYmIEisRERGRiCixEhEREYmIEisRERGRiCixEhEREYmIEisRERGRiCixEhEREYlIr4mVmd1mZrVmtqiH5SeZWYOZLQiH70YfpoiIiEjuK+hDmduBXwJ37KXME+5+ViQRiYiIiAxSvbZYufvjwOYMxCIiIiIyqEXVx2q2mS00s7+Y2fSeCpnZJWZWY2Y1dXV1EX20iIiISG6IIrF6CZjk7jOA64H7eyro7je7e7W7V1dWVkbw0SIiIiK5Y78TK3ff5u7bw/H5QMLMKvY7MhEREZFBZr8TKzMbY2YWjs8K11m/v+sVERERGWx6vSrQzO4CTgIqzGwN8D0gAeDuNwHnAV8wsxSwEzjf3X3AIhYRERHJUb0mVu4+p5flvyS4HYOISM4xs9OA64A48Gt3v6aHch8B7gPe5e41GQxRRPKI7rwuInnLzOLADcDpQBUwx8yquilXBnwVeC6zEYpIvlFiJSL5bBawwt3fcPdW4G7gnG7K/QD4MdCcyeBEJP8osRKRfDYOWJ02vSact4uZHQ1McPcHeluZ7sUnIr1RYiUiBywziwHXApf3pbzuxScivVFiJSL5bC0wIW16fDivUxnwDuAxM1sFHAvMM7PqjEUoInlFiZWI5LMXgGlmNsXMCoHzgXmdC929wd0r3H2yu08GngXO1lWBItJfSqxEJG+5ewq4FHgQWArc4+6LzexqMzs7u9GJSD7q9T5WIiKDWfiorfld5n23h7InZSImEclfarESERERiYgSKxEREZGIKLESERERiYgSKxEREZGIKLESERERiYgSKxEREZGIKLESERERiYjuYyUiIgLsbG1n845WdramaG7roCXVvsdrqt0pSyYYVhwOQ4LXksI4ZgaAu7OzrZ2GnW3BsCN4bWxOUVIUZ9TQJKOHJqksLaKwYODaN5rb2lm0toEFq7fy+sZGSooKGFlSyIiSIkaUFFJRWsiIkkJGlhRRliwgDL9btreFvUi1d9Cc6qClrX3Xa0uqg+bwtSxZwIQRQxiaTPRpfQ0721i+sZHltdup3dZC+ZAEI9O2ZURJIcOHJCiIx3bth9ptLdQ2NrOxy+u5R43n+GkV/d627iixEhERIEgI2tqd5lQ7LT0kFp3zW1IdFMRibycY4VCWLCAW2/NH2N1JdfiuH9P2DqeoIEZRQZyigli37+nocLY1t7Fpeyubm1rZ3NTCpu2tbGlqZUdbEEtnrOkxp9qdwoIYyUSMZCJYf/pra6qD+qZgnfXbW3aN72ht7/e+i8eMockC4jGjYWcbbe3ep/eNKClkVFkRo8JEqyxZQElRnCGFBZQWFVBSVEBJYZySogKGFMb32J6iRJxkIkYiFuOf9U0seGsrC1Zv5eXVW3htfSOpjiCOitJCmts62N6S6tf2lQ9JMHHEECaMGMLELsOooUVs2t7KW/U7WL15B2+lDas376C+qbXfnzFmWJL1W5tZXtvI8o3beX1jI7WNLb2uywzKixO0dzjbmvfc5kTcGFWW5Lip0SZVoMRKRCSnbd3RyqbtLWwNWz26Dq2pjj1/bDvHEzGa2zr2eM+2tNfmLklJR9/ygR6ZQVlRAWXJBB3+diLV3Lb3dRfGYxQlgkQrGca9ZUcr7T28qSBm3SYZRQUxCmJGU2uq28SrOdVOIh6joqSQEaVB683BlaVBS05pISOGFFJSVLBHMlaUiJEsiBOPGduad9+P6UN7B3skm+lJ5/aWFLWNzdRua9mt9aSusZkVGxvZ3pKiqbW9x+3ui9KiAo4cP4xLTjiYmRPKmTmxnFFlSSBovdmyo5X67a1hQtlC/fbWvSZc7lDf1MJbm3eyZN02/rZ4w14Tx3jMOKg8ycQRQzh1+mhGD01SnAiSwmTa37gzqd7W3MZbm3fwZn2QjC1e28CDizbsSgoBihNxpo0u5fhpFRw6uoxDR5cybVQZY4Yl2bqjLUiSm1rCZPntbYuZMXpoclfyOnpoEaPKkpQXJ7pN5qOgxEpEJEf94/U6PvvbF3r8ESstKqCwIEZrmLik9vJjXBCzXT/wQ4sTDB9SyKSRJRT30KqzqzWpm+Wd89vaO3ad5uqatDU2pyiI224/oumvsZiFcXfTMtbWTmFBLDy9U8TIksLdTvUML0lQVBDv1z51D/bR/pza2n/D9rrU3WlJddDUkqKppZ3tLSl2tAYJV9fTaOnj48qTHDVxOFMrS4n3kDQkE3HGDitm7LDifkff3uFs2Na8q4VqfUMzlWVFu1qZxpYnScT37xRne4ezvmEn6xuaGTM0ybjy4h4TocqyIirLioCy/frMqCixEhHJQR0dzr/NX8pB5cVcfuphe7R+DE0W7OpD0inV3rHHj21RQXC6bkhaH6AD2WDYB2YWtu7EGVma7Wj2FI8Z48qLGVdezOypIwfsM8YPH8L44UMGZP0DSYmViEgO+p9X1vHahkauO38mZ884qE/vKYjHKIjHKCka4OBEpEe63YKISI5pa+/gZw+9zuFjyvjQkX1LqkQkNyixEhHJMfe9uIZV9Tu44tTDBqyDrYgMDCVWIiI5pLmtneseXs7RE8s55YhR2Q5HRPZRr4mVmd1mZrVmtqiH5WZmvzCzFWb2ipkdHX2YIiIHhv989k02bGvmyg8ePig6WovI7vrSYnU7cNpelp8OTAuHS4Ab9z8sEZEDz/aWFP/x2EreO61iwK62EpGB1Wti5e6PA5v3UuQc4A4PPAuUm9nYqAIUETlQ3PbkP9nc1MoVpx6W7VBEpJ+i6GM1DlidNr0mnLcHM7vEzGrMrKauri6CjxYRyQ9bmlq55fE3+OD00cyYUJ7tcESknzLaed3db3b3anevrqyszORHi4jktJv+sZLtrSkuV2uVyKAWRWK1FpiQNj0+nCciIn2wcVsztz+9ig/PHMeho3PjsRwi0j9RJFbzgAvCqwOPBRrcfX0E6xUROSBc/8hy2jucy95/aLZDEZH91OsjbczsLuAkoMLM1gDfAxIA7n4TMB84A1gB7AAuGqhgRUTyzVv1O7j7+dXMmTWRiSMH33PRRGR3vSZW7j6nl+UOfCmyiEREDiA/f/h1CuLGl993SLZDEZEI6M7rIiJZ0rCjjT8tXMcn3z2JUUOT2Q5HRCKgxEpEJEseX15He4dz5pG69Z9IvlBiJSJ5zcxOM7Nl4WO35naz/GtmtiR8JNffzWxSpmJ7dFktw4ckmDFe960SyRdKrEQkb5lZHLiB4NFbVcAcM6vqUuxloNrdjwTuA36Sidg6OpzHX6/jhEMricf0TECRfKHESkTy2Sxghbu/4e6twN0Ej+Haxd0fdfcd4eSzBPfiG3CL1jWwaXsrJx82KhMfJyIZosRKRPJZnx+5FboY+EtPC6N8LNejr9VhBiccqqdQiOQTJVYiIoCZfQqoBn7aU5koH8v16LJaZowvZ0RJ4X6tR0RyixIrEclnfXrklpm9H/g2cLa7twx0UJubWlm4ZqtOA4rkISVWIpLPXgCmmdkUMysEzid4DNcuZnYU8CuCpKo2E0E9/nod7nDy4ToNKJJvlFiJSN5y9xRwKfAgsBS4x90Xm9nVZnZ2WOynQClwr5ktMLN5PawuMo8uq6WitJB3HDRsoD9KRDKs10faiIgMZu4+n+CZpunzvps2/v5MxtPe4fzj9Tred/goYrrNgkjeUYuViEgGLVi9la072tS/SiRPKbESEcmgfyyrJWZwwjT1rxLJR0qsREQy6NFldRwzaTjDhiSyHYqIDAAlViIiGVLb2Myraxs4SacBRfKWEisRkQz5x7Lgbu0nHabTgCL5SomViEiGPLasjlFlRVSNHZrtUERkgCixEhHJgFR7B48vr+Pkw0ZhptssiOQrJVYiIhnw0ltbaWxO6W7rInlOiZWISAY8uqyWgphx3CEV2Q5FRAaQEisRkQx49LVaqicPpyyp2yyI5DMlViIiA2xDQzOvbWjU3dZFDgBKrEREBthjy2oBOPlwJVYi+U6JlYjIAHt0WS0HDUsybVRptkMRkQHWp8TKzE4zs2VmtsLM5naz/EIzqzOzBeHw2ehDFREZfFpTHTy5fBMnHa7bLIgcCAp6K2BmceAG4APAGuAFM5vn7ku6FP29u186ADGKiAxaNas209Tarv5VIgeIvrRYzQJWuPsb7t4K3A2cM7BhiYjkh8der6MwHuM9U0dmOxQRyYC+JFbjgNVp02vCeV19xMxeMbP7zGxCdysys0vMrMbMaurq6voRrojI4DKkMM6ZR46lpKjXEwQikgei+qb/D3CXu7eY2f8Bfgu8r2shd78ZuBmgurraI/psEZGcddn7D812CCKSQX1psVoLpLdAjQ/n7eLu9e7eEk7+GjgmmvBEREREBo++JFYvANPMbIqZFQLnA/PSC5jZ2LTJs4Gl0YUoIiIiMjj0eirQ3VNmdinwIBAHbnP3xWZ2NVDj7vOAr5jZ2UAK2AxcOIAxi4iIiOSkPvWxcvf5wPwu876bNv5N4JvRhiYiIiIyuOjO6yIiIiIRUWIlIiIiEhElViIiIiIRUWIlIiIiEhElViIiIiIRUWIlIiIiEhElViKS18zsNDNbZmYrzGxuN8uLzOz34fLnzGxy5qMUkXyhxEpE8paZxYEbgNOBKmCOmVV1KXYxsMXdDwF+Bvw4s1GKSD5RYiUi+WwWsMLd33D3VuBu4JwuZc4heHA8wH3AKWZmGYxRRPKIEisRyWfjgNVp02vCed2WcfcU0ACM7G5lZnaJmdWYWU1dXd0AhCsig50SKxGRPnL3m9292t2rKysrsx2OiOQgJVYiks/WAhPSpseH87otY2YFwDCgPiPRiUjeUWIlIvnsBWCamU0xs0LgfGBelzLzgM+E4+cBj7i7ZzBGEckjBdkOQERkoLh7yswuBR4E4sBt7r7YzK4Gatx9HnAr8DszWwFsJki+RET6RYmViOQ1d58PzO8y77tp483ARzMdl4jkJ50KFBEREYmIEisRERGRiCixEhEREYmIEisRERGRiCixEhEREYmIEisRERGRiCixEhEREYmIEisRERGRiCixEhEREYlInxIrMzvNzJaZ2Qozm9vN8iIz+324/Dkzmxx1oCIiIiK5rtfEysziwA3A6UAVMMfMqroUuxjY4u6HAD8Dfhx1oCIiIiK5ri8tVrOAFe7+hru3AncD53Qpcw7w23D8PuAUM7PowhQRERHJfX15CPM4YHXa9Brg3T2VCZ8m3wCMBDalFzKzS4BLwsntZrZsH2Kt6Lq+HJGrcUHuxqa49l2uxravcU0aqEAy7cUXX9xkZm/2sXiu/v0gd2NTXPsuV2PL1bhg32LrU/3Vl8QqMu5+M3Bzf95rZjXuXh1xSPstV+OC3I1Nce27XI0tV+PKBHev7GvZXN5PuRqb4tp3uRpbrsYFAxNbX04FrgUmpE2PD+d1W8bMCoBhQH0UAYqIiIgMFn1JrF4AppnZFDMrBM4H5nUpMw/4TDh+HvCIu3t0YYqIiIjkvl5PBYZ9pi4FHgTiwG3uvtjMrgZq3H0ecCvwOzNbAWwmSL6i1q9TiBmQq3FB7samuPZdrsaWq3HlmlzeT7kam+Lad7kaW67GBQMQm6lhSURERCQauvO6iIiISESUWImIiIhEJOcTq94ep5NNZrbKzF41swVmVpPFOG4zs1ozW5Q2b4SZPWRmy8PX4TkU21VmtjbcbwvM7IwsxDXBzB41syVmttjMvhrOz+p+20tcubDPkmb2vJktDGP7fjh/SvgoqxXho60KMx1bLsvVOixX6q8wlpysw1R/RRpbVvdbRusvd8/ZgaCz/ErgYKAQWAhUZTuutPhWARU5EMcJwNHAorR5PwHmhuNzgR/nUGxXAVdkeZ+NBY4Ox8uA1wke2ZTV/baXuHJhnxlQGo4ngOeAY4F7gPPD+TcBX8hmnLk05HIdliv1VxhLTtZhqr8ijS2r+y2T9Veut1j15XE6Bzx3f5zgasx06Y8Z+i3wvzIaVKiH2LLO3de7+0vheCOwlOAJAlndb3uJK+s8sD2cTISDA+8jeJQVZPF/LUepDuuDXK3DVH9FGltWZbL+yvXEqrvH6WT9D5TGgb+Z2YsWPK4nl4x29/Xh+AZgdDaD6calZvZK2NSeldOUncxsMnAUwRFMzuy3LnFBDuwzM4ub2QKgFniIoDVmq7unwiK59h3Ntlyuw3K5/oIc+i52I+vfxU65Wn9B7tVhmaq/cj2xynXHu/vRwOnAl8zshGwH1B0P2jhz6b4aNwJTgZnAeuDfsxWImZUCfwAuc/dt6cuyud+6iSsn9pm7t7v7TIInMMwCDs9GHBKJQVF/Qc7VYTnxXYTcrb8gN+uwTNVfuZ5Y9eVxOlnj7mvD11rgvwn+ULlio5mNBQhfa7Mczy7uvjH8B+8AbiFL+83MEgRf/Dvd/Y/h7Kzvt+7iypV91sndtwKPArOBcgseZQU59h3NATlbh+V4/QU58F3sTq58F3O1/uoptlzZb2EsA1p/5Xpi1ZfH6WSFmZWYWVnnOHAqsGjv78qo9McMfQb4UxZj2U3nFz/0YbKw38zMCJ4YsNTdr01blNX91lNcObLPKs2sPBwvBj5A0H/iUYJHWUGO/a/lgJyswwZB/QU5WoflyHcxJ+uvvcWW7f2W0forWz30+zoAZxBcVbAS+Ha240mL62CCK3wWAouzGRtwF0HTahvBOeKLgZHA34HlwMPAiByK7XfAq8ArBBXB2CzEdTxBM/krwIJwOCPb+20vceXCPjsSeDmMYRHw3XD+wcDzwArgXqAoG/9ruTrkYh2WS/VXGE9O1mGqvyKNLav7LZP1lx5pIyIiIhKRXD8VKCIiIjJoKLESERERiYgSKxEREZGIKLESERERiYgSKxEREZGIKLGSfjOz9rQnlS8ws7kRrnty+hPlRUSipPpLBkpB70VEerTTg8cDiIgMNqq/ZECoxUoiZ2arzOwnZvaqmT1vZoeE8yeb2SPhQzj/bmYTw/mjzey/zWxhOLwnXFXczG4xs8Vm9rfwbrkiIgNG9ZfsLyVWsj+KuzSlfzxtWYO7vxP4JfDzcN71wG/d/UjgTuAX4fxfAP9w9xnA0QR3ggaYBtzg7tOBrcBHBnh7ROTAofpLBoTuvC79Zmbb3b20m/mrgPe5+xvhwzg3uPtIM9tE8BiDtnD+enevMLM6YLy7t6StYzLwkLtPC6e/ASTc/YcDv2Uiku9Uf8lAUYuVDBTvYXxftKSNt6M+gSKSGaq/pN+UWMlA+Xja6zPh+NPA+eH4J4EnwvG/A18AMLO4mQ3LVJAiIt1Q/SX9pgxa9kexmS1Im/6ru3desjzczF4hOGqbE877MvAbM7sSqAMuCud/FbjZzC4mOLL7AsET5UVEBorqLxkQ6mMlkQv7KFS7+6ZsxyIisi9Uf8n+0qlAERERkYioxUpEREQkImqxEhEREYmIEisRERGRiCixEhEREYmIEisRERGRiCixEhEREYnI/weLAUPfr4YXZQAAAABJRU5ErkJggg==\n", "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "if net3.saved():\n", " net.load()\n", " net.plot_results()\n", "else:\n", " net3.train(150, save=True)" ] }, { "cell_type": "code", "execution_count": 41, "metadata": {}, "outputs": [], "source": [ "def generate3(net, count, len_vocab):\n", " # start with a full sentence:\n", " inputs = cx.choice(net.dataset.inputs)\n", " print(\"\".join(decode(inputs)), end=\"\")\n", " for i in range(count):\n", " outputs = net.propagate(inputs)\n", " pickone = cx.choice(p=outputs)\n", " inputs = inputs[1:] + [pickone]\n", " print(decode(pickone), end=\"\")" ] }, { "cell_type": "code", "execution_count": 42, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "highly resolve that these dead shall not at cate forg tan thate ond or we ive cave we rive polly whls eor wit sas lore cane niter niand deat of the hereg dead pefpyate hipnl unsg inglinginreminon dored toicon fir lony dad divhe heage ralgle ar reos id do hur lony ar bbere brare nmated wo dedidad wo af herer here vashe that late dedicathre leather that or kecamen ant genont ferecond dedicat bere the bislic thall to uk ur borke thkal therto the hieg to dishe dediondgiin ur lorcem berey od cavt thath we alled onicatint inng keveretin seo" ] } ], "source": [ "generate3(net3, 500, len_vocab)" ] }, { "cell_type": "markdown", "metadata": { "collapsed": true }, "source": [ "## Many to Many LSTM\n" ] }, { "cell_type": "code", "execution_count": 43, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "/home/dblank/.local/lib/python3.6/site-packages/keras/layers/recurrent.py:1993: UserWarning: RNN dropout is no longer supported with the Theano backend due to technical limitations. You can either set `dropout` and `recurrent_dropout` to 0, or use the TensorFlow backend.\n", " 'RNN dropout is no longer supported with the Theano backend '\n" ] }, { "name": "stdout", "output_type": "stream", "text": [ "_________________________________________________________________\n", "Layer (type) Output Shape Param # \n", "=================================================================\n", "input (InputLayer) (None, None) 0 \n", "_________________________________________________________________\n", "embed (Embedding) (None, None, 64) 1664 \n", "_________________________________________________________________\n", "lstm (LSTM) (None, None, 256) 328704 \n", "_________________________________________________________________\n", "output (TimeDistributed) (None, None, 26) 6682 \n", "=================================================================\n", "Total params: 337,050\n", "Trainable params: 337,050\n", "Non-trainable params: 0\n", "_________________________________________________________________\n" ] } ], "source": [ "net4 = cx.Network(\"Many-to-Many LSTM\")\n", "net4.add(cx.Layer(\"input\", None), # None for variable number \n", " cx.EmbeddingLayer(\"embed\", 26, 64),\n", " cx.LSTMLayer(\"lstm\", 256, return_sequences=True), # , stateful=True\n", " cx.Layer(\"output\", 26, activation='softmax', time_distributed=True))\n", "net4.connect()\n", "net4.compile(error=\"categorical_crossentropy\", optimizer=\"adam\")\n", "net4.model.summary()" ] }, { "cell_type": "code", "execution_count": 45, "metadata": {}, "outputs": [], "source": [ "dataset = []\n", "encoded_corpus = ([0] * 39) + encode(corpus)\n", "for i in range(len(encoded_corpus) - 40):\n", " code = encoded_corpus[i:i+40]\n", " next_code = encoded_corpus[i+1:i+40+1]\n", " if len(code) == 40:\n", " dataset.append([code, list(map(lambda n: cx.onehot(n, len_vocab), next_code))])" ] }, { "cell_type": "code", "execution_count": 47, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "(40, 26)" ] }, "execution_count": 47, "metadata": {}, "output_type": "execute_result" } ], "source": [ "cx.shape(dataset[0][1])" ] }, { "cell_type": "code", "execution_count": 48, "metadata": {}, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "WARNING: network 'Many-to-Many LSTM' target bank #0 has a multi-dimensional shape, which is not allowed\n" ] } ], "source": [ "net4.dataset.load(dataset)" ] }, { "cell_type": "code", "execution_count": 50, "metadata": {}, "outputs": [ { "data": { "application/vnd.jupyter.widget-view+json": { "model_id": "c3fc188c410f483aba2ed16d55303933", "version_major": 2, "version_minor": 0 }, "text/html": [ "

Failed to display Jupyter Widget of type Dashboard.

\n", "

\n", " If you're reading this message in the Jupyter Notebook or JupyterLab Notebook, it may mean\n", " that the widgets JavaScript is still loading. If this message persists, it\n", " likely means that the widgets JavaScript library is either not installed or\n", " not enabled. See the Jupyter\n", " Widgets Documentation for setup instructions.\n", "

\n", "

\n", " If you're reading this message in another frontend (for example, a static\n", " rendering on GitHub or NBViewer),\n", " it may mean that your frontend doesn't currently support widgets.\n", "

\n" ], "text/plain": [ "Dashboard(children=(Accordion(children=(HBox(children=(VBox(children=(Select(description='Dataset:', index=1, options=('Test', 'Train'), rows=1, value='Train'), FloatSlider(value=0.5, continuous_update=False, description='Zoom', layout=Layout(width='65%'), max=1.0, style=SliderStyle(description_width='initial')), IntText(value=150, description='Horizontal space between banks:', style=DescriptionStyle(description_width='initial')), IntText(value=30, description='Vertical space between layers:', style=DescriptionStyle(description_width='initial')), HBox(children=(Checkbox(value=False, description='Show Targets', style=DescriptionStyle(description_width='initial')), Checkbox(value=False, description='Errors', style=DescriptionStyle(description_width='initial')))), Select(description='Features:', options=('',), rows=1, value=''), IntText(value=3, description='Feature columns:', style=DescriptionStyle(description_width='initial')), FloatText(value=1.0, description='Feature scale:', style=DescriptionStyle(description_width='initial'))), layout=Layout(width='100%')), VBox(children=(Select(description='Layer:', index=3, options=('input', 'embed', 'lstm', 'output'), rows=1, value='output'), Checkbox(value=True, description='Visible'), Select(description='Colormap:', options=('', 'Accent', 'Accent_r', 'Blues', 'Blues_r', 'BrBG', 'BrBG_r', 'BuGn', 'BuGn_r', 'BuPu', 'BuPu_r', 'CMRmap', 'CMRmap_r', 'Dark2', 'Dark2_r', 'GnBu', 'GnBu_r', 'Greens', 'Greens_r', 'Greys', 'Greys_r', 'OrRd', 'OrRd_r', 'Oranges', 'Oranges_r', 'PRGn', 'PRGn_r', 'Paired', 'Paired_r', 'Pastel1', 'Pastel1_r', 'Pastel2', 'Pastel2_r', 'PiYG', 'PiYG_r', 'PuBu', 'PuBuGn', 'PuBuGn_r', 'PuBu_r', 'PuOr', 'PuOr_r', 'PuRd', 'PuRd_r', 'Purples', 'Purples_r', 'RdBu', 'RdBu_r', 'RdGy', 'RdGy_r', 'RdPu', 'RdPu_r', 'RdYlBu', 'RdYlBu_r', 'RdYlGn', 'RdYlGn_r', 'Reds', 'Reds_r', 'Set1', 'Set1_r', 'Set2', 'Set2_r', 'Set3', 'Set3_r', 'Spectral', 'Spectral_r', 'Vega10', 'Vega10_r', 'Vega20', 'Vega20_r', 'Vega20b', 'Vega20b_r', 'Vega20c', 'Vega20c_r', 'Wistia', 'Wistia_r', 'YlGn', 'YlGnBu', 'YlGnBu_r', 'YlGn_r', 'YlOrBr', 'YlOrBr_r', 'YlOrRd', 'YlOrRd_r', 'afmhot', 'afmhot_r', 'autumn', 'autumn_r', 'binary', 'binary_r', 'bone', 'bone_r', 'brg', 'brg_r', 'bwr', 'bwr_r', 'cool', 'cool_r', 'coolwarm', 'coolwarm_r', 'copper', 'copper_r', 'cubehelix', 'cubehelix_r', 'flag', 'flag_r', 'gist_earth', 'gist_earth_r', 'gist_gray', 'gist_gray_r', 'gist_heat', 'gist_heat_r', 'gist_ncar', 'gist_ncar_r', 'gist_rainbow', 'gist_rainbow_r', 'gist_stern', 'gist_stern_r', 'gist_yarg', 'gist_yarg_r', 'gnuplot', 'gnuplot2', 'gnuplot2_r', 'gnuplot_r', 'gray', 'gray_r', 'hot', 'hot_r', 'hsv', 'hsv_r', 'inferno', 'inferno_r', 'jet', 'jet_r', 'magma', 'magma_r', 'nipy_spectral', 'nipy_spectral_r', 'ocean', 'ocean_r', 'pink', 'pink_r', 'plasma', 'plasma_r', 'prism', 'prism_r', 'rainbow', 'rainbow_r', 'seismic', 'seismic_r', 'spectral', 'spectral_r', 'spring', 'spring_r', 'summer', 'summer_r', 'tab10', 'tab10_r', 'tab20', 'tab20_r', 'tab20b', 'tab20b_r', 'tab20c', 'tab20c_r', 'terrain', 'terrain_r', 'viridis', 'viridis_r', 'winter', 'winter_r'), rows=1, value=''), HTML(value=''), FloatText(value=0.0, description='Leftmost color maps to:', style=DescriptionStyle(description_width='initial')), FloatText(value=1.0, description='Rightmost color maps to:', style=DescriptionStyle(description_width='initial')), IntText(value=0, description='Feature to show:', style=DescriptionStyle(description_width='initial')), HBox(children=(Checkbox(value=False, description='Rotate network', layout=Layout(width='52%'), style=DescriptionStyle(description_width='initial')), Button(icon='save', layout=Layout(width='10%'), style=ButtonStyle())))), layout=Layout(width='100%')))),), selected_index=None, _titles={'0': 'Many-to-Many LSTM'}), VBox(children=(HBox(children=(IntSlider(value=0, continuous_update=False, description='Dataset index', layout=Layout(width='100%'), max=1419), Label(value='of 1420', layout=Layout(width='100px'))), layout=Layout(height='40px')), HBox(children=(Button(icon='fast-backward', layout=Layout(width='100%'), style=ButtonStyle()), Button(icon='backward', layout=Layout(width='100%'), style=ButtonStyle()), IntText(value=0, layout=Layout(width='100%')), Button(icon='forward', layout=Layout(width='100%'), style=ButtonStyle()), Button(icon='fast-forward', layout=Layout(width='100%'), style=ButtonStyle()), Button(description='Play', icon='play', layout=Layout(width='100%'), style=ButtonStyle()), Button(icon='refresh', layout=Layout(width='25%'), style=ButtonStyle())), layout=Layout(height='50px', width='100%'))), layout=Layout(width='100%')), HTML(value='

', layout=Layout(justify_content='center', overflow_x='auto', overflow_y='auto', width='95%')), Output()))" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "dash4 = net4.dashboard()\n", "dash4" ] }, { "cell_type": "code", "execution_count": 51, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[0.038582801818847656,\n", " 0.03854098543524742,\n", " 0.03847697377204895,\n", " 0.03838202357292175,\n", " 0.03834330290555954,\n", " 0.038367994129657745,\n", " 0.03852173313498497,\n", " 0.038350626826286316,\n", " 0.03852957487106323,\n", " 0.03840670734643936,\n", " 0.03827265650033951,\n", " 0.03853010758757591,\n", " 0.038478899747133255,\n", " 0.03837151452898979,\n", " 0.03848860412836075,\n", " 0.03852129355072975,\n", " 0.038462840020656586,\n", " 0.03820224106311798,\n", " 0.03863661736249924,\n", " 0.03847706317901611,\n", " 0.03856559842824936,\n", " 0.03870689496397972,\n", " 0.038411181420087814,\n", " 0.03848462179303169,\n", " 0.038547102361917496,\n", " 0.03834003955125809]" ] }, "execution_count": 51, "metadata": {}, "output_type": "execute_result" } ], "source": [ "dash4.propagate([13])" ] }, { "cell_type": "code", "execution_count": 52, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "[[0.038582801818847656,\n", " 0.03854098543524742,\n", " 0.03847697377204895,\n", " 0.03838202357292175,\n", " 0.03834330290555954,\n", " 0.038367994129657745,\n", " 0.03852173313498497,\n", " 0.038350626826286316,\n", " 0.03852957487106323,\n", " 0.03840670734643936,\n", " 0.03827265650033951,\n", " 0.03853010758757591,\n", " 0.038478899747133255,\n", " 0.03837151452898979,\n", " 0.03848860412836075,\n", " 0.03852129355072975,\n", " 0.038462840020656586,\n", " 0.03820224106311798,\n", " 0.03863661736249924,\n", " 0.03847706317901611,\n", " 0.03856559842824936,\n", " 0.03870689496397972,\n", " 0.038411181420087814,\n", " 0.03848462179303169,\n", " 0.038547102361917496,\n", " 0.03834003955125809],\n", " [0.038359951227903366,\n", " 0.03863690048456192,\n", " 0.038495197892189026,\n", " 0.03845957666635513,\n", " 0.03829522803425789,\n", " 0.03846903145313263,\n", " 0.03871066868305206,\n", " 0.03860457241535187,\n", " 0.03868010640144348,\n", " 0.0382499098777771,\n", " 0.038345471024513245,\n", " 0.03847820684313774,\n", " 0.03828677162528038,\n", " 0.038221828639507294,\n", " 0.03835667297244072,\n", " 0.038571350276470184,\n", " 0.03840469941496849,\n", " 0.03841114416718483,\n", " 0.03850405290722847,\n", " 0.038442227989435196,\n", " 0.038479533046483994,\n", " 0.038574136793613434,\n", " 0.03831023722887039,\n", " 0.038695789873600006,\n", " 0.03851288557052612,\n", " 0.038443852216005325]]" ] }, "execution_count": 52, "metadata": {}, "output_type": "execute_result" } ], "source": [ "dash4.propagate([13, 21])" ] }, { "cell_type": "code", "execution_count": 53, "metadata": {}, "outputs": [ { "data": { "image/svg+xml": [ "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stdout", "output_type": "stream", "text": [ "Interrupted! Cleaning up...\n", "========================================================\n", " | Training | Training \n", "Epochs | Error | Accuracy \n", "------ | --------- | --------- \n", "# 3 | 2.64581 | 0.23125 \n" ] }, { "ename": "KeyboardInterrupt", "evalue": "", "output_type": "error", "traceback": [ "\u001b[0;31m---------------------------------------------------------------------------\u001b[0m", "\u001b[0;31mKeyboardInterrupt\u001b[0m Traceback (most recent call last)", "\u001b[0;32m\u001b[0m in \u001b[0;36m\u001b[0;34m()\u001b[0m\n\u001b[0;32m----> 1\u001b[0;31m \u001b[0mnet4\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mtrain\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;36m10\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m", "\u001b[0;32m~/.local/lib/python3.6/site-packages/conx/network.py\u001b[0m in \u001b[0;36mtrain\u001b[0;34m(self, epochs, accuracy, error, batch_size, report_rate, verbose, kverbose, shuffle, tolerance, class_weight, sample_weight, use_validation_to_stop, plot, record, callbacks, save)\u001b[0m\n\u001b[1;32m 1337\u001b[0m \u001b[0mprint\u001b[0m\u001b[0;34m(\u001b[0m\u001b[0;34m\"Saved!\"\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 1338\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0minterrupted\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0;32m-> 1339\u001b[0;31m \u001b[0;32mraise\u001b[0m \u001b[0mKeyboardInterrupt\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[0m\u001b[1;32m 1340\u001b[0m \u001b[0;32mif\u001b[0m \u001b[0mverbose\u001b[0m \u001b[0;34m==\u001b[0m \u001b[0;36m0\u001b[0m\u001b[0;34m:\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n\u001b[1;32m 1341\u001b[0m \u001b[0;32mreturn\u001b[0m \u001b[0;34m(\u001b[0m\u001b[0mself\u001b[0m\u001b[0;34m.\u001b[0m\u001b[0mepoch_count\u001b[0m\u001b[0;34m,\u001b[0m \u001b[0mresult\u001b[0m\u001b[0;34m)\u001b[0m\u001b[0;34m\u001b[0m\u001b[0m\n", "\u001b[0;31mKeyboardInterrupt\u001b[0m: " ] } ], "source": [ "net4.train(10)" ] }, { "cell_type": "code", "execution_count": 56, "metadata": {}, "outputs": [], "source": [ "def generate4(net, count, len_vocab):\n", " letters = [cx.choice(len_vocab)] # choose a random letter\n", " for i in range(count):\n", " print(decode(letters[-1]), end=\"\")\n", " outputs = net.propagate(letters)\n", " if len(cx.shape(outputs)) == 1:\n", " p = outputs\n", " else:\n", " p = outputs[-1]\n", " letters.append(cx.choice(p=p))\n", " letters = letters[-40:]" ] }, { "cell_type": "code", "execution_count": 57, "metadata": {}, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ " cie a ccl ltnnndeririwsaosdie pthhhar o tctgedr fde loch hgotnhat cer encrccniscttee nurte oto n s l datnaryiearlidnttshaerr eihent no e r d thh cv herede rdh ighgcdltd vedlotuotss iee sbewita nde niwro iidwto fvrt ooretedprau leneofneigovn dedghr rccerdefnglog hnieianfn trchhc eutd cervo oletahdt uin eepfogfiwga ced iihgg ihirthtetatuteoneeonhanf tthbyt tu eawrte at w afsdltavovrrn gbvpn eh nehneruno yearsosteirishtd rrncitt ctihgoftscd weoef ra tew waroraodvgeaaie a antdcpd fnnedagt have" ] } ], "source": [ "generate4(net4, 500, len_vocab)" ] }, { "cell_type": "code", "execution_count": 60, "metadata": {}, "outputs": [ { "data": { "text/html": [ "\n", " \n", " \n", " \n", " \n", " \n", " \n", " Layer: output (output)\n", " output range: (0, 1)\n", " shape = (26,)\n", " Keras class = Dense\n", " activation = softmaxoutputWeights from lstm to output\n", " output/kernel has shape (256, 26)\n", " output/bias has shape (26,)Layer: lstm (hidden)\n", " output range: (-Infinity, +Infinity)\n", " Keras class = LSTM\n", " return_sequences = TruelstmWeights from embed to lstm\n", " lstm/kernel has shape (64, 1024)\n", " lstm/recurrent_kernel has shape (256, 1024)\n", " lstm/bias has shape (1024,)Layer: embed (hidden)\n", " output range: (-Infinity, +Infinity)\n", " shape = (None, 64)\n", " Keras class = DenseembedWeights from input to embed\n", " embed/embeddings has shape (26, 64)Layer: input (input)\n", " output range: (0, +Infinity)\n", " shape = (None,)\n", " Keras class = Input\n", " dtype = int32inputMany-to-Many LSTM" ], "text/plain": [ "" ] }, "execution_count": 60, "metadata": {}, "output_type": "execute_result" } ], "source": [ "net4.picture([1, 100, 4, 2])" ] }, { "cell_type": "code", "execution_count": 63, "metadata": {}, "outputs": [ { "data": { "text/html": [ "\n", " \n", " \n", " \n", " \n", " \n", " \n", " Layer: output (output)\n", " output range: (0, 1)\n", " shape = (26,)\n", " Keras class = Dense\n", " activation = softmaxoutputWeights from lstm to output\n", " output/kernel has shape (256, 26)\n", " output/bias has shape (26,)Layer: lstm (hidden)\n", " output range: (-Infinity, +Infinity)\n", " Keras class = LSTM\n", " return_sequences = TruelstmWeights from embed to lstm\n", " lstm/kernel has shape (64, 1024)\n", " lstm/recurrent_kernel has shape (256, 1024)\n", " lstm/bias has shape (1024,)Layer: embed (hidden)\n", " output range: (-Infinity, +Infinity)\n", " shape = (None, 64)\n", " Keras class = DenseembedWeights from input to embed\n", " embed/embeddings has shape (26, 64)Layer: input (input)\n", " output range: (0, +Infinity)\n", " shape = (None,)\n", " Keras class = Input\n", " dtype = int32inputMany-to-Many LSTM" ], "text/plain": [ "" ] }, "execution_count": 63, "metadata": {}, "output_type": "execute_result" } ], "source": [ "net4.picture([3, 69, 200, 10, 4])" ] }, { "cell_type": "code", "execution_count": 64, "metadata": {}, "outputs": [], "source": [ "output = net4.propagate(range(4))" ] }, { "cell_type": "code", "execution_count": 65, "metadata": {}, "outputs": [ { "data": { "text/plain": [ "(4, 40)" ] }, "execution_count": 65, "metadata": {}, "output_type": "execute_result" } ], "source": [ "cx.shape(net4.dataset.inputs[43:47])" ] }, { "cell_type": "code", "execution_count": null, "metadata": {}, "outputs": [], "source": [] } ], "metadata": { "kernelspec": { "display_name": "Python 3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.6.3" }, "widgets": { "application/vnd.jupyter.widget-state+json": { "state": { "00012d4c437b4d2093811805441d8d2c": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "00036bd395aa43f6910dbbcdbcc58d86": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Visible", "disabled": false, "layout": "IPY_MODEL_c471e2ce6c3847ecb1368ffa4438e5c8", "style": "IPY_MODEL_3aef0953eff54a8aa2cd9f64b8b7c8cc", "value": true } }, "00045888bf0a4598864758fa9d6f9a0a": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "VBoxModel", "state": { "children": [ "IPY_MODEL_590b3c62d3064671abe29e1685d16dee", "IPY_MODEL_d610a9382fbd4e6f827734c7e29b7361", "IPY_MODEL_c2d3da3c29664285bc7334a1cc1b3831", "IPY_MODEL_4f0e6dd61f9c43818877833b76949987" ], "layout": "IPY_MODEL_0ce9ff14a8684cb4b456ab71e7db168f" } }, "002b81d3e70541b1a7a00d1ea4e2b150": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0034ec1a4f4045e5aa3a8edb4640a547": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Errors", "disabled": false, "layout": "IPY_MODEL_e48429cf371f44d1a1d136eaec824768", "style": "IPY_MODEL_94f686a520b545d1a0018c3562c244cc", "value": false } }, "005e9c9638fb4828aa0531e6b18de811": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "description": "Play", "icon": "play", "layout": "IPY_MODEL_f834a6424a1c470a8944607b4dc82366", "style": "IPY_MODEL_14b9c8503f0540e393a784047f6c3c1f" } }, "006d829388e446f994cc2ebaf91f9ab4": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntSliderModel", "state": { "continuous_update": false, "description": "Dataset index", "layout": "IPY_MODEL_c6d3800cf55d4777be12fe47c915791d", "max": 1415, "style": "IPY_MODEL_a29e6a0d7bca46f59dd70bc53325d0f1" } }, "00723abb5a5243a3b6400901e0058819": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_b736a5f8a64f419f935cc67a90e49e45", "IPY_MODEL_145ff5220a8b44ed93e5f272a0c03176" ], "layout": "IPY_MODEL_26153b578b764305a6fb74007b7d8ea1" } }, "007b7c69f4d448d98c9071b2d492b8e4": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0084f743741d4cb299ed2c691b7d78bb": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_c2ac69e7f6ea4f059b89585d086b5b28", "style": "IPY_MODEL_63d01e6d85504ef5ac3ab26f89fdbb13", "value": "" } }, "009a988acb914234a8b4bd4866258fcb": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "009d1d51d3b14616bb87b82f5b8d584b": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "00bdedf1dc434b729c5f1d783fc75a7a": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "65%" } }, "00c0b4bb02a341df9dc8575f8f66a414": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "icon": "refresh", "layout": "IPY_MODEL_e58537e7b8ba488c8516a0ba30e56dec", "style": "IPY_MODEL_ebb8949202e6462f89a157e219edeee6" } }, "00dec0b068bb4eb2835ed2867904907e": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Visible", "disabled": false, "layout": "IPY_MODEL_41f3d0f730c04afa8ff68271019af59e", "style": "IPY_MODEL_51ef13107ed6468f9b3d6ab9e8867d82", "value": true } }, "00e4efc1f0a047c5a5f353f932e8e481": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "00eadca4cdd0481ab42e9d25a812f30d": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "00eb3b0fe26b4cb983a05216beead13a": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "00ecbe0114924d3692ebcfbf3591e961": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_74f30cb2c14b450692e66abb19c8b73c", "IPY_MODEL_03bc3d9e53a2452fb040e21a2fc6bb16" ], "layout": "IPY_MODEL_eea9721d5eda4a31854fd12fc8f21407" } }, "00ece2505ffa483f892287f0ec06189a": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "01019877e07f480bb7db45002ee3498e": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "010d041752ac472cb5b6c51141404077": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Rightmost color maps to:", "layout": "IPY_MODEL_d90842d1654e43c5b63b7ca090058708", "step": 1, "style": "IPY_MODEL_2c4635d4d9b046c199a967ba70d61679", "value": 26 } }, "010de26433a64ab0b691262bd8356d63": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "icon": "backward", "layout": "IPY_MODEL_8e5f8e7fa9364ab68ecc40806e44fcf9", "style": "IPY_MODEL_27d2230b166d4548bcd7da23eff3e010" } }, "0127316e18264221a2d2ddc2aa93f428": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "icon": "refresh", "layout": "IPY_MODEL_25c04056ca074cc1a922df26242cb000", "style": "IPY_MODEL_f327429be6854bd28cd459c1efdb61e4" } }, "012e12b3f02643a29a9eb9ad603b75be": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0137010e3cae420081f033928a03fc76": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0139e0ad5c8048e09adc91887ca73157": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_9bc303f9d7674a4dbe43bc7dede58223", "style": "IPY_MODEL_1f9957802d594b8aa32f0dc1af3bebc6", "value": "

\n \n \n \n \n Given 1 - Predict 1Layer: output (output)\n shape = (26,)\n Keras class = Dense\n activation = softmaxoutputWeights from flatten to output\n output/kernel has shape (64, 26)\n output/bias has shape (26,)Layer: flatten (hidden)\n Keras class = FlattenflattenWeights from embed to flattenLayer: embed (hidden)\n shape = (1, 64)\n Keras class = DenseembedWeights from input to embed\n embed/embeddings has shape (26, 64)Layer: input (input)\n shape = (1,)\n Keras class = Input\n dtype = int32input

" } }, "01496a4bcf1f41b9bb229014b5a1c8f5": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100px" } }, "014b46791be64c15b8d58dd72fb0e220": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Horizontal space between banks:", "layout": "IPY_MODEL_021cf662f967431f83dbaa09c3dc9f5a", "step": 1, "style": "IPY_MODEL_1805874502524297b8ff68930e5e653b", "value": 150 } }, "014e7e6c2b6e44ad92d0e9a009485f87": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "FloatSliderModel", "state": { "continuous_update": false, "description": "Zoom", "layout": "IPY_MODEL_f497c7718eca47da9fb7fab61607bf41", "max": 3, "min": 0.5, "step": 0.1, "style": "IPY_MODEL_d3df395e4a1f44e8aa9a156d569adad4", "value": 1 } }, "0152cd1e47e4484584dd4e8371695885": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "015c10d3da224176bafccfec439369db": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "016331c9faba435fbdc351a422f2c856": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_cd29ff03647f497ea58f3ebbfadf093d", "IPY_MODEL_f3ec412c61414eb49734c4aab193112a", "IPY_MODEL_5aea96da96bf43f080279fbb22d68933", "IPY_MODEL_8a2eafd9ce8345f7b680d47f59b8f514", "IPY_MODEL_b7fdfb7a65e2492c960dd2a208c3d7b0", "IPY_MODEL_038cee5a29aa4cfdabba80845d13f0e3" ], "layout": "IPY_MODEL_21be9af6c3da460ab73028028940fe89" } }, "016f7a96b2a443a9b081f7f75b7123ee": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "018ca4a9906f405f89f5bc4b690676d3": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Horizontal space between banks:", "layout": "IPY_MODEL_86df1956657045ed8cce354d92e913a7", "step": 1, "style": "IPY_MODEL_418634dbfab84a078bbe5edb4812ff43", "value": 150 } }, "0197d87a4a9249139658c0a3ee951b44": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "0197fbc793de4833b0f048abafb18180": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "01997949d7544f3f86ebb5e1c22a05f1": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Leftmost color maps to:", "layout": "IPY_MODEL_ac7b904fc96b443c94f72303a1844bcb", "step": 1, "style": "IPY_MODEL_d9c9a983e7bb4abc986dae0272add16e", "value": -1 } }, "01a0d9158fd0404b92e1407c713dc948": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "01aaed4cda2d4f6881b4ddf26eab05b5": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_0946bffed88d4e0580953c0f9e669a57", "style": "IPY_MODEL_c10b5ab360c8489ba0b63da62250180d", "value": "


flatten bank:

" } }, "01b76ec38d1c49b4bee628c8cb71a713": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "01b85a9b36044ade8e445fc37c9fa626": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_864e6b54a06d440a97978442f6b7d380", "style": "IPY_MODEL_57988f5e5d6a4be1af20175ebb936c4e", "value": "

\n \n \n \n \n Given 1 - Predict 1Layer: output (output)\n shape = (26,)\n Keras class = Dense\n activation = softmaxoutputWeights from flatten to output\n output/kernel has shape (64, 26)\n output/bias has shape (26,)Layer: flatten (hidden)\n Keras class = FlattenflattenWeights from embed to flattenLayer: embed (hidden)\n shape = (1, 64)\n Keras class = DenseembedWeights from input to embed\n embed/embeddings has shape (26, 64)Layer: input (input)\n shape = (1,)\n Keras class = Input\n dtype = int32input

" } }, "01be312960e143f8865de62062213c55": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "01c5de50074e4a9c876f29b5bd34ff59": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Rightmost color maps to:", "layout": "IPY_MODEL_4748e9b10800481885541b67ab9d3634", "step": 1, "style": "IPY_MODEL_83b1a2351f3a4acd8b9bb07b329803a5", "value": 1 } }, "01c9af3b86f94231b88312720abc36e5": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "01d9911127804fedb0f6080c17d991dd": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "01ee701dd57a485694ddfb2d3812d009": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SliderStyleModel", "state": { "description_width": "" } }, "020c0296ffb04329b9411c646809a719": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "021cf662f967431f83dbaa09c3dc9f5a": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "021d892a8c1a4ca1aa03e368bac416ee": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Leftmost color maps to:", "layout": "IPY_MODEL_a2ff8d8b2cf242ffb02cb7618c91848b", "step": 1, "style": "IPY_MODEL_4629d5ac94d04c5baa91e5a35be3e300", "value": -1 } }, "022cc5fefeac417d885f6c3156c9aa02": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SelectModel", "state": { "_options_labels": [ "", "Accent", "Accent_r", "Blues", "Blues_r", "BrBG", "BrBG_r", "BuGn", "BuGn_r", "BuPu", "BuPu_r", "CMRmap", "CMRmap_r", "Dark2", "Dark2_r", "GnBu", "GnBu_r", "Greens", "Greens_r", "Greys", "Greys_r", "OrRd", "OrRd_r", "Oranges", "Oranges_r", "PRGn", "PRGn_r", "Paired", "Paired_r", "Pastel1", "Pastel1_r", "Pastel2", "Pastel2_r", "PiYG", "PiYG_r", "PuBu", "PuBuGn", "PuBuGn_r", "PuBu_r", "PuOr", "PuOr_r", "PuRd", "PuRd_r", "Purples", "Purples_r", "RdBu", "RdBu_r", "RdGy", "RdGy_r", "RdPu", "RdPu_r", "RdYlBu", "RdYlBu_r", "RdYlGn", "RdYlGn_r", "Reds", "Reds_r", "Set1", "Set1_r", "Set2", "Set2_r", "Set3", "Set3_r", "Spectral", "Spectral_r", "Vega10", "Vega10_r", "Vega20", "Vega20_r", "Vega20b", "Vega20b_r", "Vega20c", "Vega20c_r", "Wistia", "Wistia_r", "YlGn", "YlGnBu", "YlGnBu_r", "YlGn_r", "YlOrBr", "YlOrBr_r", "YlOrRd", "YlOrRd_r", "afmhot", "afmhot_r", "autumn", "autumn_r", "binary", "binary_r", "bone", "bone_r", "brg", "brg_r", "bwr", "bwr_r", "cool", "cool_r", "coolwarm", "coolwarm_r", "copper", "copper_r", "cubehelix", "cubehelix_r", "flag", "flag_r", "gist_earth", "gist_earth_r", "gist_gray", "gist_gray_r", "gist_heat", "gist_heat_r", "gist_ncar", "gist_ncar_r", "gist_rainbow", "gist_rainbow_r", "gist_stern", "gist_stern_r", "gist_yarg", "gist_yarg_r", "gnuplot", "gnuplot2", "gnuplot2_r", "gnuplot_r", "gray", "gray_r", "hot", "hot_r", "hsv", "hsv_r", "inferno", "inferno_r", "jet", "jet_r", "magma", "magma_r", "nipy_spectral", "nipy_spectral_r", "ocean", "ocean_r", "pink", "pink_r", "plasma", "plasma_r", "prism", "prism_r", "rainbow", "rainbow_r", "seismic", "seismic_r", "spectral", "spectral_r", "spring", "spring_r", "summer", "summer_r", "terrain", "terrain_r", "viridis", "viridis_r", "winter", "winter_r" ], "description": "Colormap:", "index": 0, "layout": "IPY_MODEL_e5a827d8ed56432aa8ea9515d979340d", "rows": 1, "style": "IPY_MODEL_6b000ddb32b44ff3b24e2856288134ee" } }, "022cebf33ac142ba952df6619866cc49": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "02348b690ed04c4f9e3b58ee62a1bccc": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "0239e02ecb654e69a2293b2d78725488": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "024a8bb09d8f4c74b1a869c4d1356b0e": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Leftmost color maps to:", "layout": "IPY_MODEL_7a1b19883a0d49f588eef903b9c90da9", "step": 1, "style": "IPY_MODEL_881e19622aad4667b33a743c91db1e3a" } }, "0267d984a06d46c8b336bcb0cb56cc38": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "026caabf60284f1b8cea68690f86c703": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "027093e908ac46cd92c646775bb2c4d0": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "027563aec9ea4f2e9a07068dc049b7db": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "justify_content": "center", "overflow_x": "auto", "overflow_y": "auto", "width": "95%" } }, "027cf71ced5a48b2b343ad1e2bca83f2": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "layout": "IPY_MODEL_958c090c97e6497f9d5a2f92392007ae", "step": 1, "style": "IPY_MODEL_4c171c0b96334618a9bf02c900da6683" } }, "027d66544322462883f364abde73754f": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_ce894a2858f94eb58549ed33c4b97af9", "IPY_MODEL_4a44fcce5766424cbd3cf8bcbb87bdbc" ], "layout": "IPY_MODEL_43efae193a7044ceb6ee1d72b363f853" } }, "02800c49b47b46838b9f52a33e3c71b9": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_7b30115914e84d47bbaa35a6c9a3b54a", "IPY_MODEL_bc4e567528984d7182f1ff0157661e4c" ], "layout": "IPY_MODEL_1f1590680e274a01811dcd59fcd9cb1a" } }, "0283cac43017406d9f5c5e9dcea588fa": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_bd5d100837a3450aac20e6d5601ffd83", "style": "IPY_MODEL_21e0c953936f43fd968864dd2c3b4397", "value": "" } }, "02874ea18a4c4d818a8b238fbb72e202": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "height": "40px" } }, "028a14cdb94945eea49299fd0a8bd37c": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "02916c8a0b7f4cdfbc192583267dabf9": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "02937d5515484930a7de6d32e3dec24a": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0293f677ab884d2294a7a6d416b356ac": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SliderStyleModel", "state": { "description_width": "" } }, "029454aaaf24439d93648adb60075de2": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "icon": "fast-backward", "layout": "IPY_MODEL_10224d8106ef44a48d30d692d4cc5eb5", "style": "IPY_MODEL_655a5dab11cb4c9498a43e8bbd80ef4b" } }, "029634c34c4e451990562657a4276b43": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_9eace6062b664797ba6a7fa336a44c26", "style": "IPY_MODEL_f5b131c6fc874818a225dbc8bfcc1d5c", "value": "" } }, "029f702393a3479692edfb0d1b4904da": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "icon": "fast-backward", "layout": "IPY_MODEL_9c1f49f1854b4b12a8ab26708e33da8f", "style": "IPY_MODEL_09a8c31108de455aa9de2b8ff944c970" } }, "02a6dd9ea8ee410cb758aa5b79d34c09": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "02ab4e00d48e4fbd986a99262baa39e2": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Leftmost color maps to:", "layout": "IPY_MODEL_5470c49af7ac4f7480fdee3308bbfc14", "step": 1, "style": "IPY_MODEL_9957604c616541319a043b888a4ad778", "value": -1 } }, "02d059a6951a43d4a5fe6bd046c7bdc5": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "02d618a66cf64dd3bdcbef85593e69bc": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "VBoxModel", "state": { "children": [ "IPY_MODEL_8056ec8631444aa08cafba4e87f90f5f", "IPY_MODEL_9763a50d971040ee87241352b89e0ee6", "IPY_MODEL_33639934fb154e139fe3d36e4c55f956", "IPY_MODEL_267c69a9a7a74fa6a12c15d77c2aa381" ], "layout": "IPY_MODEL_e5c4de94566047bea67d276ddabf49f2" } }, "02eba1580b6e4dccb212b8c6b66093e4": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "02ec94a179b7461d8692ca3c58f7d21d": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "02f90ba3dc124ff28a4ab4c4ac667c63": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Visible", "disabled": false, "layout": "IPY_MODEL_130b2e3ab1cf4e82b8701bb2c699a480", "style": "IPY_MODEL_385519d295494cd79f2bd38dad85947b", "value": true } }, "030532f0808744ff94b06d091f4451c4": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0307f67396e54f1ea184da53615c1c0e": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "030be5da5fc443e0a77c9089b68d96d4": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "0316e112985a488bb89db9b078c48ecc": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "03181d76a5504dbab668d84deb6bed23": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "031887699e1a44229e8b9704427c802d": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "03195749ab164277a0f4c495edc8bd10": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_4901525385844dfbb9413d1bdc152799", "IPY_MODEL_47c65de6f41b41daae2918b55e28198d", "IPY_MODEL_3bf1ad554b0345f692e9c17cfc58d892" ], "layout": "IPY_MODEL_903a78a79a074b3182743e23a507b4c8" } }, "0331b1756101458bbbe3433de65e0602": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "VBoxModel", "state": { "children": [ "IPY_MODEL_4cb3354508e2453a917c0904528e12cb", "IPY_MODEL_ebf3589b4f944bf5aac538e6322b7773", "IPY_MODEL_aa9b03f0d49a4f23968dfaf39b3f46a6", "IPY_MODEL_f3dcc968cf0f4e3bb1031c2aeefcffd6", "IPY_MODEL_65f03b14ca5c42dfbda740d4bae0e278", "IPY_MODEL_597625e6fd284a38b9ba17705ed6adad", "IPY_MODEL_ebea50c991b64ce3a7e8f3142bc9795a", "IPY_MODEL_f9f00a81d82244e3a3491356a77d7db4" ], "layout": "IPY_MODEL_aae06e7c13d1426c9da139bc0cd70c52" } }, "033456e55be549009cb9c044401205ac": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "03452229929442f68b76b834e238199f": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0345e9dff0a34aed80a75aabfdf81f35": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "AccordionModel", "state": { "_titles": { "0": "LSTM - Many to One" }, "children": [ "IPY_MODEL_def49bbd35e749eba57583fe8ae0795d" ], "layout": "IPY_MODEL_f1c103debc06421b9d91f682bc84b05e", "selected_index": null } }, "03489bc8f8be4231a6baf26528259176": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "AccordionModel", "state": { "_titles": { "0": "Network configuration", "1": "output bank", "2": "flatten bank", "3": "embed bank", "4": "input bank" }, "children": [ "IPY_MODEL_595e46cadc31440e9674a3f2cde6e73f", "IPY_MODEL_66432f58a6684ea08bbf6a21ae8aedd2", "IPY_MODEL_a07a8c7326fa4f709b0b42800015dc0d", "IPY_MODEL_1212bdcc099749779b85c4decbb71f5d", "IPY_MODEL_2fea9fb306584ca2834a364c1c98cb71" ], "layout": "IPY_MODEL_071b11d088c94d9eb6fc0ec43ce7a88b" } }, "03495c0136f84a6ca1f9156ef1160ab9": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "0365704f27154439b4aa0ad95f404283": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100px" } }, "0374e52f58d14942931f9c18e94a0ac1": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SliderStyleModel", "state": { "description_width": "" } }, "038cee5a29aa4cfdabba80845d13f0e3": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "description": "Play", "icon": "play", "layout": "IPY_MODEL_cecc4dbce73246e5baf76d051f034c89", "style": "IPY_MODEL_b7ee613cbd7c497aa31e57a004bfff15" } }, "039bcb6b0c4a48ed8de40341ccd924e5": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_5818eb6512334911984b5e0c1640f3d8", "IPY_MODEL_545a6815d2084cc889203dc643158f31", "IPY_MODEL_6fe2b48c452d4b7b8edc630bbf1ebce0", "IPY_MODEL_509d2abbf7ea4006bcd59084fec96d28", "IPY_MODEL_c4e0050e581241f7b217fe09126b89f9", "IPY_MODEL_c82a2e1e8fb0433499a54e09cf7250b9", "IPY_MODEL_eb1dd8752fc14573be00513bab20c81d" ], "layout": "IPY_MODEL_67ad436c2c484143b10195e1f6ac8188" } }, "03a71f91f2bc43858826ebc9758524a3": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_91b8e9cecfb54f6482461238df08e1f6", "style": "IPY_MODEL_2a23e71b83e24fa9898cd5af68a489b5", "value": "" } }, "03a77944fe0a4fd1a95bd7a22e3e1086": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SelectModel", "state": { "_options_labels": [ "", "Accent", "Accent_r", "Blues", "Blues_r", "BrBG", "BrBG_r", "BuGn", "BuGn_r", "BuPu", "BuPu_r", "CMRmap", "CMRmap_r", "Dark2", "Dark2_r", "GnBu", "GnBu_r", "Greens", "Greens_r", "Greys", "Greys_r", "OrRd", "OrRd_r", "Oranges", "Oranges_r", "PRGn", "PRGn_r", "Paired", "Paired_r", "Pastel1", "Pastel1_r", "Pastel2", "Pastel2_r", "PiYG", "PiYG_r", "PuBu", "PuBuGn", "PuBuGn_r", "PuBu_r", "PuOr", "PuOr_r", "PuRd", "PuRd_r", "Purples", "Purples_r", "RdBu", "RdBu_r", "RdGy", "RdGy_r", "RdPu", "RdPu_r", "RdYlBu", "RdYlBu_r", "RdYlGn", "RdYlGn_r", "Reds", "Reds_r", "Set1", "Set1_r", "Set2", "Set2_r", "Set3", "Set3_r", "Spectral", "Spectral_r", "Vega10", "Vega10_r", "Vega20", "Vega20_r", "Vega20b", "Vega20b_r", "Vega20c", "Vega20c_r", "Wistia", "Wistia_r", "YlGn", "YlGnBu", "YlGnBu_r", "YlGn_r", "YlOrBr", "YlOrBr_r", "YlOrRd", "YlOrRd_r", "afmhot", "afmhot_r", "autumn", "autumn_r", "binary", "binary_r", "bone", "bone_r", "brg", "brg_r", "bwr", "bwr_r", "cool", "cool_r", "coolwarm", "coolwarm_r", "copper", "copper_r", "cubehelix", "cubehelix_r", "flag", "flag_r", "gist_earth", "gist_earth_r", "gist_gray", "gist_gray_r", "gist_heat", "gist_heat_r", "gist_ncar", "gist_ncar_r", "gist_rainbow", "gist_rainbow_r", "gist_stern", "gist_stern_r", "gist_yarg", "gist_yarg_r", "gnuplot", "gnuplot2", "gnuplot2_r", "gnuplot_r", "gray", "gray_r", "hot", "hot_r", "hsv", "hsv_r", "inferno", "inferno_r", "jet", "jet_r", "magma", "magma_r", "nipy_spectral", "nipy_spectral_r", "ocean", "ocean_r", "pink", "pink_r", "plasma", "plasma_r", "prism", "prism_r", "rainbow", "rainbow_r", "seismic", "seismic_r", "spectral", "spectral_r", "spring", "spring_r", "summer", "summer_r", "tab10", "tab10_r", "tab20", "tab20_r", "tab20b", "tab20b_r", "tab20c", "tab20c_r", "terrain", "terrain_r", "viridis", "viridis_r", "winter", "winter_r" ], "description": "Colormap:", "index": 0, "layout": "IPY_MODEL_17a92caf54e54473b071ce64e26d9449", "rows": 1, "style": "IPY_MODEL_e85990782e5f48faa8fdeb8fe0a491f6" } }, "03ad4d0ea63642db9f748c865cc0ac25": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "height": "50px", "width": "100%" } }, "03bb8940dbe340c9bd455ec9069b74a2": { "model_module": "@jupyter-widgets/output", "model_module_version": "1.0.0", "model_name": "OutputModel", "state": { "layout": "IPY_MODEL_6b2edad4ba594ad581233ee3d783c325" } }, "03bc3d9e53a2452fb040e21a2fc6bb16": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_2435d2ac9b11483eb9c8963b8d4d33a2", "style": "IPY_MODEL_48fab23a71b74216aaa408047cca742b", "value": "" } }, "03c32896e7294f7c9e2afee8b75ccf2b": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "03cdb7b2ad6d44099efe2cc9963efdaf": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Show Errors", "disabled": false, "layout": "IPY_MODEL_436ac5f70bc04de690afa0873667d1c5", "style": "IPY_MODEL_5bfe24d302984c49a3bfd03eb0715bfb", "value": false } }, "03ee923cb4964bf78729b74ddae4df7a": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "03f5996c888c4d66a8f033702a98a5fb": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Leftmost color maps to:", "layout": "IPY_MODEL_a90fccc629c24c0f8daef128825acb2e", "step": 1, "style": "IPY_MODEL_9fb99fd8fa0941d5a576a7bffa122fb8", "value": -1 } }, "03f9e2f09a984a61bdfe5655108ca9c0": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0403b0e6f826416d9e4b0697bf469738": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "040c362595df4876a1748af9a16fc4cb": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Feature columns:", "layout": "IPY_MODEL_efca0a0b8a164613bc67803debc1a5af", "step": 1, "style": "IPY_MODEL_f62bd6e1d30640f2a152af37e1082b9d", "value": 3 } }, "0417d7d928af4ad7ac6a809c0d57f9df": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "layout": "IPY_MODEL_f70c62a45abb47c685ecbe98ef9e30a0", "step": 1, "style": "IPY_MODEL_29f2b50582294f8d9d2ab404f35efffa", "value": 16 } }, "041ace9c5249424c94ec86e0ac739f6b": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "042b72bda487401aa09bff588a71dc07": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "042e0517c3db47d58265bbf77c790aff": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "VBoxModel", "state": { "children": [ "IPY_MODEL_46c5477d402b4ab1b2a353a935683fc5" ], "layout": "IPY_MODEL_72f029ab6a524295af5b03aaa2f9319f" } }, "0445364e936641f38ab9dfcaa9d7e87e": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "0452697ae860459fa9376facf78e7426": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "046b459d253849889c7ffc3ff472dd98": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "046e2abd182b41d887f43d4f1d35a6e7": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Leftmost color maps to:", "layout": "IPY_MODEL_dc4ea0f2aad940c8bbd0ddb3d8738276", "step": 1, "style": "IPY_MODEL_a03b893ee2604d58988a9fd3f73d29cf" } }, "0472635fe986437a9e014c1908d994f3": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "0484bfb9685f4d36acb00360c66a10d5": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "AccordionModel", "state": { "_titles": { "0": "LSTM - Many to One" }, "children": [ "IPY_MODEL_a5acf868b04d49a980dbbfa8eb65af24" ], "layout": "IPY_MODEL_c928a5bd660a4dc0a25b91d14a6a6cd2", "selected_index": null } }, "048b1e7189494e13b5b708a394b40e31": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntSliderModel", "state": { "continuous_update": false, "description": "Dataset index", "layout": "IPY_MODEL_07b851d3878943938d5cdd1176f777ee", "max": 1415, "style": "IPY_MODEL_97f9c33cfb46410dae2940ccb242f371" } }, "04a3194d619a49688f96993cc8a4b6c6": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "04c1f04f07a645a28f21c3456ff935b2": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "04ee81a42069496bbedea78f63e16bb4": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "04f2febca1964c6eaf0a619050026b26": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "04fc4ff68ca44622afd4b76229a80831": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "05020d4f22ec4ad7bb2fd1c46ffcb4c0": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_9a925fdd474f4c3a894fc0597ccaec74", "IPY_MODEL_f8487df2a6bf4857b688faa1db8d5546" ], "layout": "IPY_MODEL_f7e400f1dc6542139a3b7df79c2dc4ba" } }, "050611bfa4ae4bdc8f8aa732673c3cf6": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0523c35dc8434e9997a4cf1e0e285fd8": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Visible", "disabled": false, "layout": "IPY_MODEL_654633b4be86459fb56a80f8e3486e4e", "style": "IPY_MODEL_e83771aa89d244b99ff58439e2ee978e", "value": true } }, "05258e9bf68f4b3ba1c63510d10a14d6": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Leftmost color maps to:", "layout": "IPY_MODEL_cb1fc0007ef3488a90a8b7f94f265f3f", "step": 1, "style": "IPY_MODEL_c6c2cc1e306a43b084ed8d05497c4a2f" } }, "0535b91d7318403e85ac98fd640f9edd": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Visible", "disabled": false, "layout": "IPY_MODEL_130b2e3ab1cf4e82b8701bb2c699a480", "style": "IPY_MODEL_45f9aecdd33244979a34223e382cd293", "value": true } }, "053dbc11e5094b0090096f03a9cef159": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "0565163979ef4fc9b9551186fe44c30e": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "057f2b2395574dc5b98da1e651dd7691": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_272fdad742ba41ce9ad9aba21e76270c", "IPY_MODEL_544aa4460cb84b36a83dbf91b709a9db", "IPY_MODEL_92fd88f7da1f4ab48dac138965774e57", "IPY_MODEL_befb7fd42aec49348a59fa0ecf9b3ef8", "IPY_MODEL_68359c263f304872a16d98569dad1ab4", "IPY_MODEL_0e734771c9b84916977e42909a5dcd7d", "IPY_MODEL_50f0db02bd6846a7a5cd420c56f944d6" ], "layout": "IPY_MODEL_60df1b4f620b495bae258bede342bbe1" } }, "058123f7ee114485b79a5e8b1977655c": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0585b43364a345c0896a5d526dc1645a": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0588b1a044e14b6384ab175fcd954ce5": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "058d63e1a00148d1aab349a48e2fb503": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SelectModel", "state": { "_options_labels": [ "", "Accent", "Accent_r", "Blues", "Blues_r", "BrBG", "BrBG_r", "BuGn", "BuGn_r", "BuPu", "BuPu_r", "CMRmap", "CMRmap_r", "Dark2", "Dark2_r", "GnBu", "GnBu_r", "Greens", "Greens_r", "Greys", "Greys_r", "OrRd", "OrRd_r", "Oranges", "Oranges_r", "PRGn", "PRGn_r", "Paired", "Paired_r", "Pastel1", "Pastel1_r", "Pastel2", "Pastel2_r", "PiYG", "PiYG_r", "PuBu", "PuBuGn", "PuBuGn_r", "PuBu_r", "PuOr", "PuOr_r", "PuRd", "PuRd_r", "Purples", "Purples_r", "RdBu", "RdBu_r", "RdGy", "RdGy_r", "RdPu", "RdPu_r", "RdYlBu", "RdYlBu_r", "RdYlGn", "RdYlGn_r", "Reds", "Reds_r", "Set1", "Set1_r", "Set2", "Set2_r", "Set3", "Set3_r", "Spectral", "Spectral_r", "Vega10", "Vega10_r", "Vega20", "Vega20_r", "Vega20b", "Vega20b_r", "Vega20c", "Vega20c_r", "Wistia", "Wistia_r", "YlGn", "YlGnBu", "YlGnBu_r", "YlGn_r", "YlOrBr", "YlOrBr_r", "YlOrRd", "YlOrRd_r", "afmhot", "afmhot_r", "autumn", "autumn_r", "binary", "binary_r", "bone", "bone_r", "brg", "brg_r", "bwr", "bwr_r", "cool", "cool_r", "coolwarm", "coolwarm_r", "copper", "copper_r", "cubehelix", "cubehelix_r", "flag", "flag_r", "gist_earth", "gist_earth_r", "gist_gray", "gist_gray_r", "gist_heat", "gist_heat_r", "gist_ncar", "gist_ncar_r", "gist_rainbow", "gist_rainbow_r", "gist_stern", "gist_stern_r", "gist_yarg", "gist_yarg_r", "gnuplot", "gnuplot2", "gnuplot2_r", "gnuplot_r", "gray", "gray_r", "hot", "hot_r", "hsv", "hsv_r", "inferno", "inferno_r", "jet", "jet_r", "magma", "magma_r", "nipy_spectral", "nipy_spectral_r", "ocean", "ocean_r", "pink", "pink_r", "plasma", "plasma_r", "prism", "prism_r", "rainbow", "rainbow_r", "seismic", "seismic_r", "spectral", "spectral_r", "spring", "spring_r", "summer", "summer_r", "tab10", "tab10_r", "tab20", "tab20_r", "tab20b", "tab20b_r", "tab20c", "tab20c_r", "terrain", "terrain_r", "viridis", "viridis_r", "winter", "winter_r" ], "description": "Colormap:", "index": 0, "layout": "IPY_MODEL_b42198bf824a469996080267d983678f", "rows": 1, "style": "IPY_MODEL_429c67ae8ee54c4898492f03d863396e" } }, "05a188cff4f94c539e17ae68e7f4ee02": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "05dd314f8da24f6ebf8ebde9121f2085": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "05e58c025f2046eca28db69d6ccb21ae": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "VBoxModel", "state": { "children": [ "IPY_MODEL_e21ad71b14ef4cf2a9d0f05a30ea915d", "IPY_MODEL_66b48e8839bc401399c8ef6481c9ac5b" ], "layout": "IPY_MODEL_98d5a65e25c34af2af3880ad3946aad9" } }, "05e6142e5a8c446a9cd26f408fa92ed7": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "AccordionModel", "state": { "_titles": { "0": "Network configuration", "1": "output bank", "2": "flatten bank", "3": "embed bank", "4": "input bank" }, "children": [ "IPY_MODEL_a370fcb228f246b28f3a8da25a49d93e", "IPY_MODEL_347c2a19b6df4861b9a2d6c3351adb10", "IPY_MODEL_dd2e2aa522e94be38246034e6c9fa049", "IPY_MODEL_65fedc6a4c2e4b10aeee59c475903b9b", "IPY_MODEL_646876e28a24471289e7da719970274c" ], "layout": "IPY_MODEL_685d124400954d75bf0618fa3a4c760d" } }, "05f2ac7b6526452ea55cedc653f5bbf1": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "05f85608b2964b5281d861fc8c504e00": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "060aedbb016147498fa87255c2abae1c": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_6c86474a06c14aa7937c27a20032d1d9", "style": "IPY_MODEL_40b18b4631034194b9a1dfa6c476e8c1", "value": "


embed bank:

" } }, "060f2d2dab5e41529780fbed2c9d55e5": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0612bf7261de4e95b6841e5461ac0ef2": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Visible", "disabled": false, "layout": "IPY_MODEL_130b2e3ab1cf4e82b8701bb2c699a480", "style": "IPY_MODEL_d36966275a5d48c3887d67d63b635147", "value": true } }, "0615187c8cae4161860a92719290f7be": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "061d7d0f701c4fe49603b514828821db": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Horizontal space between banks:", "layout": "IPY_MODEL_17a92caf54e54473b071ce64e26d9449", "step": 1, "style": "IPY_MODEL_00eb3b0fe26b4cb983a05216beead13a", "value": 150 } }, "0625f40c0168462d8aefef55fa253704": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "06399704fe6844b7bb5332be62add872": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Leftmost color maps to:", "layout": "IPY_MODEL_53c1fac31301440282e06ac3fd5cd595", "step": 1, "style": "IPY_MODEL_db7139935d354c468842b066412c89a2", "value": -1 } }, "0647d6e8778c40c88313bb5d2c0f1296": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_38be94f6a32747eaa86861df699e2903", "IPY_MODEL_78bc24249fbb441d90b2a1f19aa005e4" ], "layout": "IPY_MODEL_d8e78bbe8eaf481881654062602a55f4" } }, "064f8857511340e1a653c0494990fa65": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "066b56ae10744be3bb24458f01a8f629": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Show Targets", "disabled": false, "layout": "IPY_MODEL_c36f8a140a3141d1a74c8118a62cadfd", "style": "IPY_MODEL_df8e1257d7c846aca920cefc7661f202", "value": false } }, "066ffd9a1bb64e99b1103d334055743f": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_6778d05af4204de897f61fa793f1a2d5", "IPY_MODEL_641d168540dd43b8a9f3f6ef11e14a3b" ], "layout": "IPY_MODEL_5cdd18fc5b5448e68e0aa3644f722bc9" } }, "0677a1a9b00e45bfa47d6d477ac4006e": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Visible", "disabled": false, "layout": "IPY_MODEL_49b1528a5e5344a3801560b7b1f7f452", "style": "IPY_MODEL_635a5799826c455794e84d6a2b9c0dc3", "value": true } }, "068143c0c4fc4e8db4f092e49476996c": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "95%" } }, "068f20b4b5db4750b72767c865cf7f33": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SliderStyleModel", "state": { "description_width": "" } }, "06a04330291a4356ad9dabe2fbbbe8d4": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "06a654b9bc094d0c937596dd7cf28df5": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "icon": "refresh", "layout": "IPY_MODEL_939dd0ebe59e4d6eb64fc1bd82f38c0c", "style": "IPY_MODEL_3fe52d508a134f9b8f842fb0529f7b7d" } }, "06b7aac93a864a9e980074b18a9f2d87": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "LabelModel", "state": { "layout": "IPY_MODEL_1c58ffbd0aa1464199448c84cfbda3ab", "style": "IPY_MODEL_01d9911127804fedb0f6080c17d991dd", "value": "of 1381" } }, "06c3934566a04cfbbd93e72585e15dcc": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Feature columns:", "layout": "IPY_MODEL_3b152912ee7f4a54b47d7a1f6ea988ed", "step": 1, "style": "IPY_MODEL_94c3c3a8f7884f5ab3f75dfb609e0f45", "value": 3 } }, "06cc1d639fcd45b9809bc57ba89f38e7": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "06dd9dd4f5ed40baa940004d8909c98b": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_1b736f3d77c442bb93c5b6d892db3767", "IPY_MODEL_2aed5501b64d482e9f103cab904c0923" ], "layout": "IPY_MODEL_8fb087f6883f4c37bc4156d162cda228" } }, "070455e4b6294e678adefd544991e3c6": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "070c949dd51c42f1a31f6d5991a81979": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "0710c91f877f4f828a39d35663ec1acf": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "071b11d088c94d9eb6fc0ec43ce7a88b": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0746a7a9a2604a1abc42261a7e5545e2": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "074f50b4ea0746d6b8b74f39a6b6b223": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_0239e02ecb654e69a2293b2d78725488", "style": "IPY_MODEL_84a4e2c93225483cbb4708eb0536a223", "value": "" } }, "0761af4d2195408787b1787395d32268": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0776a30eb73c4e0b81b3bb1c8f9f43c5": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "077b069c62684f618acb68d943de9361": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0783ad5fb84c4bf6b6591b8b459dc75d": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "icon": "forward", "layout": "IPY_MODEL_4d5302784797437a9d827094b9dacf08", "style": "IPY_MODEL_4423f927e99e4e64ac45b865b78801c8" } }, "07a3ff99943c4311bd32fef76dedbc16": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "height": "40px" } }, "07b684c946944e128498c6ea4afd4e63": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "95%" } }, "07b851d3878943938d5cdd1176f777ee": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "95%" } }, "07be7fd380514917b1e7292a70b328e7": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "07c4873b1cee4683981e5c676a1536d8": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "07d9e30c28da457890ae69168eba5084": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "07e4836b7bee49648cdfbac4bccb06a6": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "07e5628c02624f4fabedaff92fc247d4": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "VBoxModel", "state": { "children": [ "IPY_MODEL_18f249d0e10547abbab0e6eef1632086", "IPY_MODEL_238cf07b8bac416f81883c8e05f700b5", "IPY_MODEL_f939926451b94b3fb14e509e01ef7e7c", "IPY_MODEL_7c96376202dc47c89664994769ed6632" ], "layout": "IPY_MODEL_24c7b48c78f049a88ebb670a5c8ca899" } }, "080a4278c9374674bf51c748cb8669db": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100px" } }, "080d94619e544f2f88b3ff3d5adbaf09": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_0946bffed88d4e0580953c0f9e669a57", "style": "IPY_MODEL_7594ccde2b2742c69410befe49aa6227", "value": "


output bank:

" } }, "0821b2e5225e4922a170894997ea4670": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0827c9d9d2b941abadd98ada4949d2b3": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SliderStyleModel", "state": { "description_width": "" } }, "083c20d0608643d6a1b1c7ed3bbd052f": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_47ecc24bd92b47d3a02a1f29848f592a", "IPY_MODEL_1e06e234557e4ff08387c7bbc97f5dbf" ], "layout": "IPY_MODEL_ba77787fb41b46f6904c712f5f440187" } }, "0847cb610be74314adeec7ac0aef8a68": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "084b148190414115a6ada43a930bcabd": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SelectModel", "state": { "_options_labels": [ "", "Accent", "Accent_r", "Blues", "Blues_r", "BrBG", "BrBG_r", "BuGn", "BuGn_r", "BuPu", "BuPu_r", "CMRmap", "CMRmap_r", "Dark2", "Dark2_r", "GnBu", "GnBu_r", "Greens", "Greens_r", "Greys", "Greys_r", "OrRd", "OrRd_r", "Oranges", "Oranges_r", "PRGn", "PRGn_r", "Paired", "Paired_r", "Pastel1", "Pastel1_r", "Pastel2", "Pastel2_r", "PiYG", "PiYG_r", "PuBu", "PuBuGn", "PuBuGn_r", "PuBu_r", "PuOr", "PuOr_r", "PuRd", "PuRd_r", "Purples", "Purples_r", "RdBu", "RdBu_r", "RdGy", "RdGy_r", "RdPu", "RdPu_r", "RdYlBu", "RdYlBu_r", "RdYlGn", "RdYlGn_r", "Reds", "Reds_r", "Set1", "Set1_r", "Set2", "Set2_r", "Set3", "Set3_r", "Spectral", "Spectral_r", "Vega10", "Vega10_r", "Vega20", "Vega20_r", "Vega20b", "Vega20b_r", "Vega20c", "Vega20c_r", "Wistia", "Wistia_r", "YlGn", "YlGnBu", "YlGnBu_r", "YlGn_r", "YlOrBr", "YlOrBr_r", "YlOrRd", "YlOrRd_r", "afmhot", "afmhot_r", "autumn", "autumn_r", "binary", "binary_r", "bone", "bone_r", "brg", "brg_r", "bwr", "bwr_r", "cool", "cool_r", "coolwarm", "coolwarm_r", "copper", "copper_r", "cubehelix", "cubehelix_r", "flag", "flag_r", "gist_earth", "gist_earth_r", "gist_gray", "gist_gray_r", "gist_heat", "gist_heat_r", "gist_ncar", "gist_ncar_r", "gist_rainbow", "gist_rainbow_r", "gist_stern", "gist_stern_r", "gist_yarg", "gist_yarg_r", "gnuplot", "gnuplot2", "gnuplot2_r", "gnuplot_r", "gray", "gray_r", "hot", "hot_r", "hsv", "hsv_r", "inferno", "inferno_r", "jet", "jet_r", "magma", "magma_r", "nipy_spectral", "nipy_spectral_r", "ocean", "ocean_r", "pink", "pink_r", "plasma", "plasma_r", "prism", "prism_r", "rainbow", "rainbow_r", "seismic", "seismic_r", "spectral", "spectral_r", "spring", "spring_r", "summer", "summer_r", "terrain", "terrain_r", "viridis", "viridis_r", "winter", "winter_r" ], "description": "Colormap:", "index": 0, "layout": "IPY_MODEL_6c86474a06c14aa7937c27a20032d1d9", "rows": 1, "style": "IPY_MODEL_25ed185da60e43ef811fb98551da1c6d" } }, "08660d70bb58429aa5ef310cea17d679": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "08674307c2fb4b3090241ffc7f2c5ba3": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "0871405f7df34c82b54d300f7b004479": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Visible", "disabled": false, "layout": "IPY_MODEL_436ac5f70bc04de690afa0873667d1c5", "style": "IPY_MODEL_7c2b6b6aaf7544fda7ce2240787c9f4f", "value": true } }, "087983076e2e44e78a44e796971415e0": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Vertical space between layers:", "layout": "IPY_MODEL_134ff00c50c34e67a7850754f75d1e2d", "step": 1, "style": "IPY_MODEL_d7a24734fe9c406d8965be15b17dbc10", "value": 30 } }, "08878229dc9741b1ae2a48aef3bb30b4": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "088cfb08e13d4009bf17b05b06f823e9": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "icon": "refresh", "layout": "IPY_MODEL_8b97b2450102488b9fd299c7afcc6950", "style": "IPY_MODEL_1c5b1b67cd364149abcba9dcf6575ad1" } }, "088ed3d7d7644b72895b5105150b76e7": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "089c88f9177e4436ab59a808303c7d1b": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "08a03a25fdf040af8ba20484ae2867c9": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "08a5d4c873f6434c8b4e4c691f24ebee": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Visible", "disabled": false, "layout": "IPY_MODEL_51ae2e25f6c146a697dd7c07c3bec940", "style": "IPY_MODEL_a204cb037e6d4782a5592e5c6d8424a1", "value": true } }, "08cb8e382b7349389e4a56f1f3c4caee": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "description": "Play", "icon": "play", "layout": "IPY_MODEL_aca9fbd8b6f54d4d9aa92a25ccca4a95", "style": "IPY_MODEL_5239bd38ab4c4a88a2549cc27ac7af65" } }, "08ebf2e94ecf48fab65751348f19b151": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Show Errors", "disabled": false, "layout": "IPY_MODEL_0d6637518c9141c196cca818d7a8e8ee", "style": "IPY_MODEL_ee03f81b968e4c02baaa8ec7545614da", "value": false } }, "08f891d239c04cce8d64dbf20836437c": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Leftmost color maps to:", "layout": "IPY_MODEL_b058acc8327843fda1a59a29b4ff53b6", "step": 1, "style": "IPY_MODEL_e7e4971fa4b640889f17035a56439873" } }, "092413a39c294fe693d8ceb61a66d956": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0932e860600a4068aa516ff7da899ac1": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "VBoxModel", "state": { "children": [ "IPY_MODEL_20d1860f0bb545ae9301317341381c57", "IPY_MODEL_3d0b1fd82734429abfb2ebfd9f39dfef", "IPY_MODEL_1b4251d7081b4344b9dfec725921f2e1", "IPY_MODEL_4c1b3dd6586b4ff3aaa92f8cea46dabe", "IPY_MODEL_ae0c9d91b45a402c9398d81f9e549763", "IPY_MODEL_fcf8ac84e8844155b8e73eed5f4ed179", "IPY_MODEL_8ab1df331fd849708788f8523f0c3592" ], "layout": "IPY_MODEL_90f457fb153043caaba979d5357096c3" } }, "0946bffed88d4e0580953c0f9e669a57": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "09480aff9b18438e9c11380bf83b2f02": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Rightmost color maps to:", "layout": "IPY_MODEL_56ec534cc4274d88aee20764b738dc89", "step": 1, "style": "IPY_MODEL_a2b404e7569d40c283d53c3e5223f8ff", "value": 26 } }, "095b24716dbf417bb203bb4d20b4a15e": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100px" } }, "095e1be6123a41d49dc9bc3446cd0303": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0969b1c4a7d844819d1ff64085e738df": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "09700505ab6e4d93a50844f5ea114229": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SelectModel", "state": { "_options_labels": [ "", "Accent", "Accent_r", "Blues", "Blues_r", "BrBG", "BrBG_r", "BuGn", "BuGn_r", "BuPu", "BuPu_r", "CMRmap", "CMRmap_r", "Dark2", "Dark2_r", "GnBu", "GnBu_r", "Greens", "Greens_r", "Greys", "Greys_r", "OrRd", "OrRd_r", "Oranges", "Oranges_r", "PRGn", "PRGn_r", "Paired", "Paired_r", "Pastel1", "Pastel1_r", "Pastel2", "Pastel2_r", "PiYG", "PiYG_r", "PuBu", "PuBuGn", "PuBuGn_r", "PuBu_r", "PuOr", "PuOr_r", "PuRd", "PuRd_r", "Purples", "Purples_r", "RdBu", "RdBu_r", "RdGy", "RdGy_r", "RdPu", "RdPu_r", "RdYlBu", "RdYlBu_r", "RdYlGn", "RdYlGn_r", "Reds", "Reds_r", "Set1", "Set1_r", "Set2", "Set2_r", "Set3", "Set3_r", "Spectral", "Spectral_r", "Vega10", "Vega10_r", "Vega20", "Vega20_r", "Vega20b", "Vega20b_r", "Vega20c", "Vega20c_r", "Wistia", "Wistia_r", "YlGn", "YlGnBu", "YlGnBu_r", "YlGn_r", "YlOrBr", "YlOrBr_r", "YlOrRd", "YlOrRd_r", "afmhot", "afmhot_r", "autumn", "autumn_r", "binary", "binary_r", "bone", "bone_r", "brg", "brg_r", "bwr", "bwr_r", "cool", "cool_r", "coolwarm", "coolwarm_r", "copper", "copper_r", "cubehelix", "cubehelix_r", "flag", "flag_r", "gist_earth", "gist_earth_r", "gist_gray", "gist_gray_r", "gist_heat", "gist_heat_r", "gist_ncar", "gist_ncar_r", "gist_rainbow", "gist_rainbow_r", "gist_stern", "gist_stern_r", "gist_yarg", "gist_yarg_r", "gnuplot", "gnuplot2", "gnuplot2_r", "gnuplot_r", "gray", "gray_r", "hot", "hot_r", "hsv", "hsv_r", "inferno", "inferno_r", "jet", "jet_r", "magma", "magma_r", "nipy_spectral", "nipy_spectral_r", "ocean", "ocean_r", "pink", "pink_r", "plasma", "plasma_r", "prism", "prism_r", "rainbow", "rainbow_r", "seismic", "seismic_r", "spectral", "spectral_r", "spring", "spring_r", "summer", "summer_r", "terrain", "terrain_r", "viridis", "viridis_r", "winter", "winter_r" ], "description": "Colormap:", "index": 0, "layout": "IPY_MODEL_0d6637518c9141c196cca818d7a8e8ee", "rows": 1, "style": "IPY_MODEL_c27f50b073cf4c23b9b705385612912d" } }, "097e7f4cf8f44b2ba6b3cbc579fcc8cb": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "VBoxModel", "state": { "children": [ "IPY_MODEL_2adfed4fe7ee4b1ebeb93e00a91aa005", "IPY_MODEL_bd7ead508a684e138a77e036590ac1dc", "IPY_MODEL_0fcd31095f0b494fa8aa3005234041c1", "IPY_MODEL_1b199ffd618d4bc89aa204aa68a1917d" ], "layout": "IPY_MODEL_6a3487c5432b4effa4d557bd412191b1" } }, "09a632246ba34853a44d86e9e2e61bdc": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "09a8c31108de455aa9de2b8ff944c970": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "09c45e14f2b44f878e5a5e0da7e6d38b": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SelectModel", "state": { "_options_labels": [ "", "Accent", "Accent_r", "Blues", "Blues_r", "BrBG", "BrBG_r", "BuGn", "BuGn_r", "BuPu", "BuPu_r", "CMRmap", "CMRmap_r", "Dark2", "Dark2_r", "GnBu", "GnBu_r", "Greens", "Greens_r", "Greys", "Greys_r", "OrRd", "OrRd_r", "Oranges", "Oranges_r", "PRGn", "PRGn_r", "Paired", "Paired_r", "Pastel1", "Pastel1_r", "Pastel2", "Pastel2_r", "PiYG", "PiYG_r", "PuBu", "PuBuGn", "PuBuGn_r", "PuBu_r", "PuOr", "PuOr_r", "PuRd", "PuRd_r", "Purples", "Purples_r", "RdBu", "RdBu_r", "RdGy", "RdGy_r", "RdPu", "RdPu_r", "RdYlBu", "RdYlBu_r", "RdYlGn", "RdYlGn_r", "Reds", "Reds_r", "Set1", "Set1_r", "Set2", "Set2_r", "Set3", "Set3_r", "Spectral", "Spectral_r", "Vega10", "Vega10_r", "Vega20", "Vega20_r", "Vega20b", "Vega20b_r", "Vega20c", "Vega20c_r", "Wistia", "Wistia_r", "YlGn", "YlGnBu", "YlGnBu_r", "YlGn_r", "YlOrBr", "YlOrBr_r", "YlOrRd", "YlOrRd_r", "afmhot", "afmhot_r", "autumn", "autumn_r", "binary", "binary_r", "bone", "bone_r", "brg", "brg_r", "bwr", "bwr_r", "cool", "cool_r", "coolwarm", "coolwarm_r", "copper", "copper_r", "cubehelix", "cubehelix_r", "flag", "flag_r", "gist_earth", "gist_earth_r", "gist_gray", "gist_gray_r", "gist_heat", "gist_heat_r", "gist_ncar", "gist_ncar_r", "gist_rainbow", "gist_rainbow_r", "gist_stern", "gist_stern_r", "gist_yarg", "gist_yarg_r", "gnuplot", "gnuplot2", "gnuplot2_r", "gnuplot_r", "gray", "gray_r", "hot", "hot_r", "hsv", "hsv_r", "inferno", "inferno_r", "jet", "jet_r", "magma", "magma_r", "nipy_spectral", "nipy_spectral_r", "ocean", "ocean_r", "pink", "pink_r", "plasma", "plasma_r", "prism", "prism_r", "rainbow", "rainbow_r", "seismic", "seismic_r", "spectral", "spectral_r", "spring", "spring_r", "summer", "summer_r", "terrain", "terrain_r", "viridis", "viridis_r", "winter", "winter_r" ], "description": "Colormap:", "index": 0, "layout": "IPY_MODEL_764f9514db024b4288ead9ab6738c008", "rows": 1, "style": "IPY_MODEL_a5b93bf0ee8148008e0d9576f2c02524" } }, "09c585ceeedb488b9d223afd19544a29": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_f02245da4a464d46bdb056217948c188", "IPY_MODEL_b403b9763d1245be94451292e4e0cccb" ], "layout": "IPY_MODEL_87e0b509f0d542a6a9b2239d4dcc43fd" } }, "09cb7d7c1ea9482b85cd792144d508aa": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "09e204fa0e9047d0b53a31e05e022d08": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "09f58ceccd1d4243bd7445aa5851875a": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0a01e1d56d3942298476383878d49b98": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_41f3d0f730c04afa8ff68271019af59e", "style": "IPY_MODEL_06cc1d639fcd45b9809bc57ba89f38e7", "value": "


embed bank:

" } }, "0a0b59974ce94aa3b2dd7b3e6d1ab6be": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "0a3e01e8b9ba476689017a201d65c728": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_f8fd7abde92e43f886eec471330d1a6d", "style": "IPY_MODEL_d1b149b0684e436abcf643a97fa353b3", "value": "" } }, "0a3ff65826284ecf85acc79e5b5da88a": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0a623f5c87c04f85bd15c4cd929c11cf": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0a6f8413bb1244a4b5724a5199f52a00": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SelectModel", "state": { "_options_labels": [ "Test", "Train" ], "description": "Dataset:", "index": 1, "layout": "IPY_MODEL_2ab44133c7f142899e4d8c544607d76c", "rows": 1, "style": "IPY_MODEL_8195febd567f486d9804446683320437" } }, "0a7b7c1cf43c4165b8c6851a716aac7c": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "0a7b985d7f6a4459b673e9948359d790": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "0a8c4a93e8f4454e8dc0b5d03d678f30": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SliderStyleModel", "state": { "description_width": "initial" } }, "0a90280773b14e37be9065b9aa0da9cb": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_8b7c6ece7ee245208f7f6668d83d2473", "IPY_MODEL_0084f743741d4cb299ed2c691b7d78bb" ], "layout": "IPY_MODEL_ed0728503128493bb7ee91d5387ceee8" } }, "0a9e326930774c129e6f78f1f12815e4": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_6221aa7f53494050ae686fb418aea842", "IPY_MODEL_0932e860600a4068aa516ff7da899ac1" ], "layout": "IPY_MODEL_a6ee89d366294b4d94b1c28fc73ddc43" } }, "0acbd1ff74234193ad23ef1532e5f056": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "0ad91c4a00124f78bea4b68f72147d5e": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_cbf0941f25a54d408b1ea3dd9398db93", "IPY_MODEL_7074d2bdaef84b0ab7189cce7adf5699" ], "layout": "IPY_MODEL_33bf4920a5884b09987d0f65b47b11d0" } }, "0ae6c3b01f394ade9a410e68f3ea34f8": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0b1e135536f44879908d8331dca07fa7": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SelectModel", "state": { "_options_labels": [ "" ], "description": "Features:", "index": 0, "layout": "IPY_MODEL_f91b1564cceb45928c23e955e8b64b4e", "rows": 1, "style": "IPY_MODEL_889bd8ac4cd54a87b9b05edd770a3c52" } }, "0b21aad5bba24f77b6a138524fc92a41": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "0b28386178dc4c578ccb67ff27b2bee7": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_33e5abd39b0e4805adf62167e4713c4a", "style": "IPY_MODEL_319ecc8b6a2746c5bf110fcc116c923d", "value": "" } }, "0b2e54eca2e24428872efac8bb981127": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "icon": "refresh", "layout": "IPY_MODEL_251aca5e572b411d838bd17003ff6a41", "style": "IPY_MODEL_a6f3ed71bcb84216a6d94db09ab45c18" } }, "0b34100c73144cd6aba99996b29af2d5": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Visible", "disabled": false, "layout": "IPY_MODEL_134ff00c50c34e67a7850754f75d1e2d", "style": "IPY_MODEL_d2d140aff2d648a9aae85b4b5e94f85d", "value": true } }, "0b352b845ee54532a9a515d046232b2a": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_51d437e4143e4e04bd73e5ef330c27c2", "IPY_MODEL_18a9f19054954b2e914410f34d0dd69c" ], "layout": "IPY_MODEL_c53bc5cc8ad64aa686d66cb51404afe2" } }, "0b3c9529d6a54b648517673d6a324f0e": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0b419f63579143c8ac4e6e747526abf6": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0b6c741e5ed245f1b460e6146d0b820b": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "0b74dd9b76894073bd897969c5927435": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0b9f6f7e59ee472caa161221fec18422": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_566907ffd1194c8d82ce499f4186d179", "style": "IPY_MODEL_fc1ad438667948329128901a6356547c", "value": "


input bank:

" } }, "0bb210cd3fae4c2f9b883b98b30bebc2": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0bc4f3959aa649f8b0698fdffb12a7d0": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "25%" } }, "0bc80190f69d40bbad32abd42717ee3d": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_6c86474a06c14aa7937c27a20032d1d9", "style": "IPY_MODEL_7e3120a2a5844b46bd9c22573b105757", "value": "


lstm bank:

" } }, "0bca43ad5e9e4838a0a9c92e96adce7a": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0bd00b46ac2c4c04882eff1f3d3904e7": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0bedc28bc5a34726bf93a8734bd5b4d4": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SelectModel", "state": { "_options_labels": [ "Test", "Train" ], "description": "Dataset:", "index": 1, "layout": "IPY_MODEL_cbe51e7026bb496c9c577b6d4b5e7b01", "rows": 1, "style": "IPY_MODEL_4f623eb80f2643e9993f467512cc4659" } }, "0bfbafc8dbd340c68b8f308201348abd": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "0c0ba5e2b92f494a85d196dec31febca": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Show Targets", "disabled": false, "layout": "IPY_MODEL_6c86474a06c14aa7937c27a20032d1d9", "style": "IPY_MODEL_e58efa12d8ce4cf6bff65f2e66f58692", "value": false } }, "0c10167656c8414c9845b7a44f112cbe": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "justify_content": "center", "overflow_x": "auto", "overflow_y": "auto", "width": "95%" } }, "0c1a8a15fd4145f78c9dc5f528b5a536": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "95%" } }, "0c21b73937aa4cce94215d80b83e5ecb": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_b3e801c72f974249a71236785ef9fe37", "style": "IPY_MODEL_3e83a7b6a24743a6b78ca819003e4886", "value": "" } }, "0c3930438f6443c9950087be6803ee8a": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0c3a33a3430b4c19a1bafd5b69cd0fc0": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Show Targets", "disabled": false, "layout": "IPY_MODEL_e5a827d8ed56432aa8ea9515d979340d", "style": "IPY_MODEL_f2d11de6d6f14c4da3baf04d853bca4c", "value": false } }, "0c4c442997a642329d56af45f864ed7a": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0c519b134d434339999ce941f125d5db": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "0c5ca8957e07480ba64846ca487b6d77": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0c7661137b8a42828c9ecb8566ff279f": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0c76f6d8effe42d59b623847aeabbf22": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "0c78d785947f404d9171825c65b6231f": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "0c795633fac9471cbff2dd604f1dda1a": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SelectModel", "state": { "_options_labels": [ "", "Accent", "Accent_r", "Blues", "Blues_r", "BrBG", "BrBG_r", "BuGn", "BuGn_r", "BuPu", "BuPu_r", "CMRmap", "CMRmap_r", "Dark2", "Dark2_r", "GnBu", "GnBu_r", "Greens", "Greens_r", "Greys", "Greys_r", "OrRd", "OrRd_r", "Oranges", "Oranges_r", "PRGn", "PRGn_r", "Paired", "Paired_r", "Pastel1", "Pastel1_r", "Pastel2", "Pastel2_r", "PiYG", "PiYG_r", "PuBu", "PuBuGn", "PuBuGn_r", "PuBu_r", "PuOr", "PuOr_r", "PuRd", "PuRd_r", "Purples", "Purples_r", "RdBu", "RdBu_r", "RdGy", "RdGy_r", "RdPu", "RdPu_r", "RdYlBu", "RdYlBu_r", "RdYlGn", "RdYlGn_r", "Reds", "Reds_r", "Set1", "Set1_r", "Set2", "Set2_r", "Set3", "Set3_r", "Spectral", "Spectral_r", "Vega10", "Vega10_r", "Vega20", "Vega20_r", "Vega20b", "Vega20b_r", "Vega20c", "Vega20c_r", "Wistia", "Wistia_r", "YlGn", "YlGnBu", "YlGnBu_r", "YlGn_r", "YlOrBr", "YlOrBr_r", "YlOrRd", "YlOrRd_r", "afmhot", "afmhot_r", "autumn", "autumn_r", "binary", "binary_r", "bone", "bone_r", "brg", "brg_r", "bwr", "bwr_r", "cool", "cool_r", "coolwarm", "coolwarm_r", "copper", "copper_r", "cubehelix", "cubehelix_r", "flag", "flag_r", "gist_earth", "gist_earth_r", "gist_gray", "gist_gray_r", "gist_heat", "gist_heat_r", "gist_ncar", "gist_ncar_r", "gist_rainbow", "gist_rainbow_r", "gist_stern", "gist_stern_r", "gist_yarg", "gist_yarg_r", "gnuplot", "gnuplot2", "gnuplot2_r", "gnuplot_r", "gray", "gray_r", "hot", "hot_r", "hsv", "hsv_r", "inferno", "inferno_r", "jet", "jet_r", "magma", "magma_r", "nipy_spectral", "nipy_spectral_r", "ocean", "ocean_r", "pink", "pink_r", "plasma", "plasma_r", "prism", "prism_r", "rainbow", "rainbow_r", "seismic", "seismic_r", "spectral", "spectral_r", "spring", "spring_r", "summer", "summer_r", "tab10", "tab10_r", "tab20", "tab20_r", "tab20b", "tab20b_r", "tab20c", "tab20c_r", "terrain", "terrain_r", "viridis", "viridis_r", "winter", "winter_r" ], "description": "Colormap:", "index": 0, "layout": "IPY_MODEL_134ff00c50c34e67a7850754f75d1e2d", "rows": 1, "style": "IPY_MODEL_8007fae805244c408b59416723c58318" } }, "0c8729e405ee4cf597aa114392b96c08": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0cb42d54818b469c95dfe2cdb7f30b36": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_e1a33ab088774203a3ac796ec6093c20", "IPY_MODEL_010d041752ac472cb5b6c51141404077" ], "layout": "IPY_MODEL_704b8b42821344298dacec4574e47d82" } }, "0cc192dfec4b433dae1dd152e339455c": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0cc27f04c9064b879f5ae105f8dd268d": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0cc2a4ca470d40389c8cc80939b762e3": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "VBoxModel", "state": { "children": [ "IPY_MODEL_70a96550eac7452e92a687c0ffd5b41a", "IPY_MODEL_49cd82dfda4c499798f287b708823b4a", "IPY_MODEL_be4f0f438b314ba99d1ddedae1bc53d1", "IPY_MODEL_26bab79edafb4aefb281a9ab14c09d25" ], "layout": "IPY_MODEL_3f8d6ed9873b437fbe44f85d7d505896" } }, "0ccc27b0480841cdaa588ef18ef75700": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_f6c2eef8925b4ea0aaa3aa76c930d02b", "style": "IPY_MODEL_1e3af106d51a42b7ac3012b07271577d", "value": "" } }, "0ccd76d4845e4545b95d4a36346aa732": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "0cd03b1d6c994fed9009c5e84245d4cb": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "0cdd4da0a3b4458ca8fbed05d7bcd913": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_27a347465314420796f3c38ad5e720a1", "style": "IPY_MODEL_b65edc2888cd40489991a0baf18bd17b", "value": "" } }, "0ce9ff14a8684cb4b456ab71e7db168f": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0cfb59a799014ff38463e37341a6a64b": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0cfc0d9eba444acab313394c630469d6": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "0d13127e654747f49468d0cedb4b3671": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_c69d3183946247d9a4bd3baff808b6ba", "IPY_MODEL_8a5f49b54e374c38aef9094c47dc8f81" ], "layout": "IPY_MODEL_65c18cd120ff4397b16711f29f842dc5" } }, "0d18cb9f46d2403082f38b48691780e7": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SelectModel", "state": { "_options_labels": [ "", "Accent", "Accent_r", "Blues", "Blues_r", "BrBG", "BrBG_r", "BuGn", "BuGn_r", "BuPu", "BuPu_r", "CMRmap", "CMRmap_r", "Dark2", "Dark2_r", "GnBu", "GnBu_r", "Greens", "Greens_r", "Greys", "Greys_r", "OrRd", "OrRd_r", "Oranges", "Oranges_r", "PRGn", "PRGn_r", "Paired", "Paired_r", "Pastel1", "Pastel1_r", "Pastel2", "Pastel2_r", "PiYG", "PiYG_r", "PuBu", "PuBuGn", "PuBuGn_r", "PuBu_r", "PuOr", "PuOr_r", "PuRd", "PuRd_r", "Purples", "Purples_r", "RdBu", "RdBu_r", "RdGy", "RdGy_r", "RdPu", "RdPu_r", "RdYlBu", "RdYlBu_r", "RdYlGn", "RdYlGn_r", "Reds", "Reds_r", "Set1", "Set1_r", "Set2", "Set2_r", "Set3", "Set3_r", "Spectral", "Spectral_r", "Vega10", "Vega10_r", "Vega20", "Vega20_r", "Vega20b", "Vega20b_r", "Vega20c", "Vega20c_r", "Wistia", "Wistia_r", "YlGn", "YlGnBu", "YlGnBu_r", "YlGn_r", "YlOrBr", "YlOrBr_r", "YlOrRd", "YlOrRd_r", "afmhot", "afmhot_r", "autumn", "autumn_r", "binary", "binary_r", "bone", "bone_r", "brg", "brg_r", "bwr", "bwr_r", "cool", "cool_r", "coolwarm", "coolwarm_r", "copper", "copper_r", "cubehelix", "cubehelix_r", "flag", "flag_r", "gist_earth", "gist_earth_r", "gist_gray", "gist_gray_r", "gist_heat", "gist_heat_r", "gist_ncar", "gist_ncar_r", "gist_rainbow", "gist_rainbow_r", "gist_stern", "gist_stern_r", "gist_yarg", "gist_yarg_r", "gnuplot", "gnuplot2", "gnuplot2_r", "gnuplot_r", "gray", "gray_r", "hot", "hot_r", "hsv", "hsv_r", "inferno", "inferno_r", "jet", "jet_r", "magma", "magma_r", "nipy_spectral", "nipy_spectral_r", "ocean", "ocean_r", "pink", "pink_r", "plasma", "plasma_r", "prism", "prism_r", "rainbow", "rainbow_r", "seismic", "seismic_r", "spectral", "spectral_r", "spring", "spring_r", "summer", "summer_r", "terrain", "terrain_r", "viridis", "viridis_r", "winter", "winter_r" ], "description": "Colormap:", "index": 0, "layout": "IPY_MODEL_e5a827d8ed56432aa8ea9515d979340d", "rows": 1, "style": "IPY_MODEL_a12773b1d51647c9acab500827b20d2e" } }, "0d3e03ee0ec8443cb5c1b6c9f2a4713c": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "95%" } }, "0d445da36dee4fb394274082dfdae7f9": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_2d37419ce3f544e9951f01ff98566392", "IPY_MODEL_600479666163498f94b6dc936d77a2a6" ], "layout": "IPY_MODEL_10bf7e6a6a9144a28bdc6ddc4a4894fc" } }, "0d48d2e92f784da7a02978147caf84b0": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SliderStyleModel", "state": { "description_width": "" } }, "0d4c987530a246598d2212ff6f76aeb8": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0d4fe514c0b04edda2ce19ff30f82121": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0d5d63db3aa941a29b7253b60e22fb77": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_6c77342c0fb84c5ebab41a26a17db8ab", "IPY_MODEL_a14820ae5cea4e4dbb7d72d208a9423b" ], "layout": "IPY_MODEL_a45c4ca118564802bf2e5b69c5ff3864" } }, "0d64c7eed2dd40c88f419020151b5b36": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_53f04a734e7d4a32882964279434c8d1", "IPY_MODEL_2ea89006f7494502869df747aee86b1f", "IPY_MODEL_088cfb08e13d4009bf17b05b06f823e9" ], "layout": "IPY_MODEL_f6718a46b64342aba0b11cb74533e573" } }, "0d6637518c9141c196cca818d7a8e8ee": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0d6b479eddb34183a032e82f854f77ca": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0d6b61827fe84ef0b0c58f316212f62d": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Visible", "disabled": false, "layout": "IPY_MODEL_bfa5275e338f4d599fc906f329bba15c", "style": "IPY_MODEL_69de4b44b7b44b158c17fa5b170ae68f", "value": true } }, "0d73859082f44e229a025faf8521eada": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0d7978b5071147bd8cb78d9bde479ea8": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0d7ccdacda3a432eaa16bd1d24aa3210": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_755a06b9482241d3a50b147c3ca7034c", "style": "IPY_MODEL_7926d1bbb5ec48d79681cd5e092fc55b", "value": "" } }, "0d8108a48c52462ba1126bb9af5caf40": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0d97c815ec374c0884787fba2369ba1c": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_423bedc94961408a8a1d02ae7e1cfcba", "IPY_MODEL_e73afcbd3de446b585e59200f375b7b6" ], "layout": "IPY_MODEL_4cc5135bbf0c4cec908cf51ba373efdb" } }, "0d99aa0ce1e7499cad0ef214b3a1c332": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "VBoxModel", "state": { "children": [ "IPY_MODEL_42c13a010e0043648d3eca054d28e557", "IPY_MODEL_a16440981e3f4eec95e415840cdea154", "IPY_MODEL_5e2d5815fe2a4596a9af52538e382677", "IPY_MODEL_0d97c815ec374c0884787fba2369ba1c" ], "layout": "IPY_MODEL_2cd9e1690649412181971cd43d6eaff4" } }, "0d9c8e2f8421415a83bb128ed9ed10b1": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0d9e3830ee874ab6a21a4fa137d575e8": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0dadd305b4f8437583c60211a51177b0": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0daf3a40dfb34b51aff42a7ab2fc44a7": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "0db0091975094c0e8ef36b5c2eb05f27": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "0db992f273fb44f19527612ef92c7950": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "0dc83df1b4d54904bda75eaf69498fde": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SelectModel", "state": { "_options_labels": [ "", "Accent", "Accent_r", "Blues", "Blues_r", "BrBG", "BrBG_r", "BuGn", "BuGn_r", "BuPu", "BuPu_r", "CMRmap", "CMRmap_r", "Dark2", "Dark2_r", "GnBu", "GnBu_r", "Greens", "Greens_r", "Greys", "Greys_r", "OrRd", "OrRd_r", "Oranges", "Oranges_r", "PRGn", "PRGn_r", "Paired", "Paired_r", "Pastel1", "Pastel1_r", "Pastel2", "Pastel2_r", "PiYG", "PiYG_r", "PuBu", "PuBuGn", "PuBuGn_r", "PuBu_r", "PuOr", "PuOr_r", "PuRd", "PuRd_r", "Purples", "Purples_r", "RdBu", "RdBu_r", "RdGy", "RdGy_r", "RdPu", "RdPu_r", "RdYlBu", "RdYlBu_r", "RdYlGn", "RdYlGn_r", "Reds", "Reds_r", "Set1", "Set1_r", "Set2", "Set2_r", "Set3", "Set3_r", "Spectral", "Spectral_r", "Vega10", "Vega10_r", "Vega20", "Vega20_r", "Vega20b", "Vega20b_r", "Vega20c", "Vega20c_r", "Wistia", "Wistia_r", "YlGn", "YlGnBu", "YlGnBu_r", "YlGn_r", "YlOrBr", "YlOrBr_r", "YlOrRd", "YlOrRd_r", "afmhot", "afmhot_r", "autumn", "autumn_r", "binary", "binary_r", "bone", "bone_r", "brg", "brg_r", "bwr", "bwr_r", "cool", "cool_r", "coolwarm", "coolwarm_r", "copper", "copper_r", "cubehelix", "cubehelix_r", "flag", "flag_r", "gist_earth", "gist_earth_r", "gist_gray", "gist_gray_r", "gist_heat", "gist_heat_r", "gist_ncar", "gist_ncar_r", "gist_rainbow", "gist_rainbow_r", "gist_stern", "gist_stern_r", "gist_yarg", "gist_yarg_r", "gnuplot", "gnuplot2", "gnuplot2_r", "gnuplot_r", "gray", "gray_r", "hot", "hot_r", "hsv", "hsv_r", "inferno", "inferno_r", "jet", "jet_r", "magma", "magma_r", "nipy_spectral", "nipy_spectral_r", "ocean", "ocean_r", "pink", "pink_r", "plasma", "plasma_r", "prism", "prism_r", "rainbow", "rainbow_r", "seismic", "seismic_r", "spectral", "spectral_r", "spring", "spring_r", "summer", "summer_r", "tab10", "tab10_r", "tab20", "tab20_r", "tab20b", "tab20b_r", "tab20c", "tab20c_r", "terrain", "terrain_r", "viridis", "viridis_r", "winter", "winter_r" ], "description": "Colormap:", "index": 0, "layout": "IPY_MODEL_6c851a2cc81a482c93dbde1f8082579e", "rows": 1, "style": "IPY_MODEL_78c746794f6d48268d22ea573ea79116" } }, "0dcfedbbac8f42f19044fa5ffd44787d": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0dd46f05263d4728b9f2d1bfd26c83a2": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "VBoxModel", "state": { "children": [ "IPY_MODEL_902c542059284a88b6e44f9fa6151f9c", "IPY_MODEL_d1d5f155c60f46b5b6778a3e5ba95db5", "IPY_MODEL_416680e777184a92a909d24754253f2f" ], "layout": "IPY_MODEL_6a2f3daa186b4c6aa2c34f4c5f34bc1d" } }, "0dd6945eb3154829a50050d2f8a08466": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_f6733b5240e3424fad92d4fc23082b00", "style": "IPY_MODEL_945b00b40127487bb93fee5e5411ac1f", "value": "" } }, "0de444bb89fe4b93b5defb6c060238de": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0df130ff1b9749c59d49a03a4b52d3c2": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_acc0f874ad8849288e627bf39ba74ca6", "style": "IPY_MODEL_d80959d4ce4844a092faaf05b1892b8f", "value": "" } }, "0df51909d9cc439582c8f5f92816a248": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0e0ab0ba73724618b52cb9decb809830": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0e0f35d99c3b45d882d6616015706acf": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_c1b6dba4dcca46b387957a976c98fe70", "IPY_MODEL_e409f628ef67492bb35688861d336418", "IPY_MODEL_492628505ac14ca8b39b33c26c04f480" ], "layout": "IPY_MODEL_3e23daa846ec4a5c904c2f31430cffe2" } }, "0e199c45e1394be0b479f2350de97b52": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "description": "Play", "icon": "play", "layout": "IPY_MODEL_fb956aa939374ddc92d606399053d5da", "style": "IPY_MODEL_fb2d7620cef841038c3a3593fd317396" } }, "0e1c6c78da6c4d488dd43fc1edc68598": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "height": "50px", "width": "100%" } }, "0e257539b035461095865d456c4af9cb": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0e2809618a4a4ccdb4cd41ff72bd7167": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SelectModel", "state": { "_options_labels": [ "", "Accent", "Accent_r", "Blues", "Blues_r", "BrBG", "BrBG_r", "BuGn", "BuGn_r", "BuPu", "BuPu_r", "CMRmap", "CMRmap_r", "Dark2", "Dark2_r", "GnBu", "GnBu_r", "Greens", "Greens_r", "Greys", "Greys_r", "OrRd", "OrRd_r", "Oranges", "Oranges_r", "PRGn", "PRGn_r", "Paired", "Paired_r", "Pastel1", "Pastel1_r", "Pastel2", "Pastel2_r", "PiYG", "PiYG_r", "PuBu", "PuBuGn", "PuBuGn_r", "PuBu_r", "PuOr", "PuOr_r", "PuRd", "PuRd_r", "Purples", "Purples_r", "RdBu", "RdBu_r", "RdGy", "RdGy_r", "RdPu", "RdPu_r", "RdYlBu", "RdYlBu_r", "RdYlGn", "RdYlGn_r", "Reds", "Reds_r", "Set1", "Set1_r", "Set2", "Set2_r", "Set3", "Set3_r", "Spectral", "Spectral_r", "Vega10", "Vega10_r", "Vega20", "Vega20_r", "Vega20b", "Vega20b_r", "Vega20c", "Vega20c_r", "Wistia", "Wistia_r", "YlGn", "YlGnBu", "YlGnBu_r", "YlGn_r", "YlOrBr", "YlOrBr_r", "YlOrRd", "YlOrRd_r", "afmhot", "afmhot_r", "autumn", "autumn_r", "binary", "binary_r", "bone", "bone_r", "brg", "brg_r", "bwr", "bwr_r", "cool", "cool_r", "coolwarm", "coolwarm_r", "copper", "copper_r", "cubehelix", "cubehelix_r", "flag", "flag_r", "gist_earth", "gist_earth_r", "gist_gray", "gist_gray_r", "gist_heat", "gist_heat_r", "gist_ncar", "gist_ncar_r", "gist_rainbow", "gist_rainbow_r", "gist_stern", "gist_stern_r", "gist_yarg", "gist_yarg_r", "gnuplot", "gnuplot2", "gnuplot2_r", "gnuplot_r", "gray", "gray_r", "hot", "hot_r", "hsv", "hsv_r", "inferno", "inferno_r", "jet", "jet_r", "magma", "magma_r", "nipy_spectral", "nipy_spectral_r", "ocean", "ocean_r", "pink", "pink_r", "plasma", "plasma_r", "prism", "prism_r", "rainbow", "rainbow_r", "seismic", "seismic_r", "spectral", "spectral_r", "spring", "spring_r", "summer", "summer_r", "tab10", "tab10_r", "tab20", "tab20_r", "tab20b", "tab20b_r", "tab20c", "tab20c_r", "terrain", "terrain_r", "viridis", "viridis_r", "winter", "winter_r" ], "description": "Colormap:", "index": 0, "layout": "IPY_MODEL_3411ea7ec8a24decaf157f31047a35a5", "rows": 1, "style": "IPY_MODEL_79d11c38c34e4ac0b7fa05b4fa6eaeda" } }, "0e28e94f726c41038c65c6e7d3b0ec80": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0e36895a55274e6398c1be366781d444": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0e397e6234b9473a9520b2089bed7b20": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0e3bb1cc3c8e4c5e8ffeeb7b4aa7e0d5": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_311e15a17c324c478d474ee95f23874d", "style": "IPY_MODEL_dedd5e996dc344a5bc53357ff879d4a0", "value": "


input bank:

" } }, "0e444115771a4e95942a25c01f8fda56": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0e4f4f2cd3734d5d8286c8c460892dc3": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SliderStyleModel", "state": { "description_width": "" } }, "0e5544a872fb460d97ef7833852efc02": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Visible", "disabled": false, "layout": "IPY_MODEL_17a92caf54e54473b071ce64e26d9449", "style": "IPY_MODEL_61f5a7b7fcab439f9212dcafb00f302d", "value": true } }, "0e579c9d6e05443b82177048f280c56d": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0e6e0a511bd94c5b9e891409bd5ae75b": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_44a7ce47df014df69176168bb24870b0", "IPY_MODEL_d7fdbf075fe9454ba3f472b817294a12" ], "layout": "IPY_MODEL_298a1faba1fb47f9bf7d73f1edfd02e8" } }, "0e72c84cd7b44444be69efbfbd115bc1": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0e734771c9b84916977e42909a5dcd7d": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "description": "Play", "icon": "play", "layout": "IPY_MODEL_c6210275b40e4750b2b39efabb8a6304", "style": "IPY_MODEL_76a61d33fcac4a5fb0ce4d88a72276cb" } }, "0e80feb58b8b4991979ae3a0bdb74a68": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "layout": "IPY_MODEL_2914066dad214e7ca0d1ccbfff6dc8b9", "step": 1, "style": "IPY_MODEL_89add347a40d4e59a1db9bb77017520a", "value": 11 } }, "0e827070ad2c49078d47ab197fdb37f9": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Visible", "disabled": false, "layout": "IPY_MODEL_9b08e16c293b469f9aa7d04f017e26c9", "style": "IPY_MODEL_7e3f5e3d92524921bce71bd7b66d15e7", "value": true } }, "0e86f7c739d44ab89563ac58cf4f5652": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "icon": "refresh", "layout": "IPY_MODEL_de43d18bbf7b4d4f85d1917ef0deca1c", "style": "IPY_MODEL_35fcf18fc2374a2ca79a4147d3631181" } }, "0e908457d35f44b5880a79cc720fb809": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0e92631dc61d486d8e8c59db60983d18": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "40px" } }, "0ea83814c08c460e876fa4a5b161ac37": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "0edf59c9a3af4d09aff56b97ddff8644": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "0ef64c13fae945f2a734c277e356babc": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "VBoxModel", "state": { "children": [ "IPY_MODEL_0b9f6f7e59ee472caa161221fec18422", "IPY_MODEL_259c7d3729454ee4aa455b8c1b82751f", "IPY_MODEL_fc9e454255ee48a682d5e32f774eb802", "IPY_MODEL_93f1ed93445440c69cc84b2dbfc944bf" ], "layout": "IPY_MODEL_4deaf8dc449f4598ad8f35d066dc3527" } }, "0ef6b1b8c527423982d1511c434846cf": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0f0ed8b445044ff39a25669affafb8bc": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Rightmost color maps to:", "layout": "IPY_MODEL_6f0d872828c74052b95aff13d5a346f6", "step": 1, "style": "IPY_MODEL_3e6eada1d53a4cf2bcc1faf66f80fd3b", "value": 1 } }, "0f3b23e788e645699bedde67252bb5bc": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_41f3d0f730c04afa8ff68271019af59e", "style": "IPY_MODEL_dffb25893fd74e758fe117eb005716f8", "value": "


flatten bank:

" } }, "0f3ce3b76a754823a3a8328ab5d470cd": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "icon": "forward", "layout": "IPY_MODEL_83926a06dd1245f8a364a8fe314cd89f", "style": "IPY_MODEL_fdc1a2e78147444cad7015b0f7114af3" } }, "0f523cb93e2f4f9296e194d37f8ac637": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Show Errors", "disabled": false, "layout": "IPY_MODEL_764f9514db024b4288ead9ab6738c008", "style": "IPY_MODEL_7c72a8a5d6e74c74b25dc03912a333ca", "value": false } }, "0f7d36ebd57e4fa6aa5ccfb38ee55aaf": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntTextModel", "state": { "description": "Leftmost color maps to:", "layout": "IPY_MODEL_61412e7951874cc7836be7eb29308497", "step": 1, "style": "IPY_MODEL_9e7c1f5f3a0741ef9ced198b41fc7d73", "value": -1 } }, "0f8f346d6b18445081ed70791b4afa23": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "SliderStyleModel", "state": { "description_width": "" } }, "0f94e7dfc1cf42598862d8f0380a5748": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "VBoxModel", "state": { "children": [ "IPY_MODEL_f0ca09a4beba44148bf18a7a6c6254f4", "IPY_MODEL_9ed1aad3ff2a4bd88bb8b7cc5ffc8381", "IPY_MODEL_ec3a0ffbd2674ccfa1454ffe579f3fc1", "IPY_MODEL_2a89f8b23e664528b8a8accd98008389" ], "layout": "IPY_MODEL_b4bbe8d8c526437088c0d77fffed15cc" } }, "0f98f1739c624c52a2361f0a14b1a881": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "0fb99b1ab8cc499a95b370a8956c5eb6": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "icon": "backward", "layout": "IPY_MODEL_eade8c542cd44db68999d2c6561e740e", "style": "IPY_MODEL_0472635fe986437a9e014c1908d994f3" } }, "0fcd31095f0b494fa8aa3005234041c1": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_8d30b46f0d684561b900b70c5eec1a77", "IPY_MODEL_7b9c5dd4b796455abe754dbd1153a78d" ], "layout": "IPY_MODEL_d0f41a184741411aa1b6f6c120de703f" } }, "0fcdf274d06c4ae3a12776f9aa48f75a": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0fd0cf18bcc142908a8f8b432f5aa71a": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "0fd173222e2c46389051bead883e9984": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "0fe2cba99d994e3d9cd6e5f6c6e75e14": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "VBoxModel", "state": { "children": [ "IPY_MODEL_8ddeab7d1ec54d1a933c2d8fc7635ece", "IPY_MODEL_ef6b9b7d676d4d8283b51d9f78f74d89", "IPY_MODEL_239fb2d5428d4ee1a84e6a3d41ad0d4b" ], "layout": "IPY_MODEL_1e39806387bf492d86444c0d438fb05d" } }, "0fe2d600eb4d47a0a699dae666e41778": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "0fef41d8f0bb4014837ae1ac96700ee0": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "100600004f634159805f86a710ff9d60": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "101a17fcb54743418c4639165f0b0a40": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "icon": "refresh", "layout": "IPY_MODEL_12910259bd7342cfae98b16eb7f5bf2c", "style": "IPY_MODEL_3eaa8d0dd004445d8064140e1cc95967" } }, "101e5da185214f498f25c6aacbadce8f": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "10224d8106ef44a48d30d692d4cc5eb5": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "103a2473ecda47d8b84b140c061f653f": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "106e4404e7524a40b47f6fc4cb876c46": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "IntSliderModel", "state": { "continuous_update": false, "description": "Dataset index", "layout": "IPY_MODEL_a40ef5fb534e4696a72e2a65db7fbf46", "max": 1419, "style": "IPY_MODEL_46343f683ec54b30b6525c976651d4cc" } }, "107e494d96574656ac05c9fddf1d57da": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "CheckboxModel", "state": { "description": "Visible", "disabled": false, "layout": "IPY_MODEL_fc695ddf82634ecfabdd806eb1774f89", "style": "IPY_MODEL_d7960e4bb665482d8ede9466b23491f8", "value": true } }, "1086b39482de41e49702edc7594dde2d": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "108bb8efae194909a3d7083a55ca341c": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_aa30d37ff6a845449fb7aab32c9fe5aa", "style": "IPY_MODEL_e536aaf175644611a55f37898145686b", "value": "

\n \n \n \n \n Given 5 - Predict 1Layer: output (output)\n shape = (26,)\n Keras class = Dense\n activation = softmaxoutputWeights from flatten to output\n output/kernel has shape (320, 26)\n output/bias has shape (26,)Layer: flatten (hidden)\n Keras class = FlattenflattenWeights from embed to flattenLayer: embed (hidden)\n shape = (5, 64)\n Keras class = DenseembedWeights from input to embed\n embed/embeddings has shape (26, 64)Layer: input (input)\n shape = (5,)\n Keras class = Input\n dtype = int32input

" } }, "10a68b18c97447a08f03a5d605fdca3b": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "10af92b06c514a4985934b4f3a08535c": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "10b015d645b648d2b0dab04c87efec29": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "initial" } }, "10bb8807a85a47d5a4e7911311794981": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "height": "40px" } }, "10bcf9a202964fb8b9efe1d3ccedbd9c": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "10bf7e6a6a9144a28bdc6ddc4a4894fc": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "10c0baab5b854966b9729474c1b18500": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "height": "40px" } }, "10c2800f63304f899f54490e4cfde2e0": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "10c77b97f542425f977a6f5e43b946b6": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "10cf840cb53245f8812b49b9ff75e1d0": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "10f3cce4f6234bf48c5d2dc98de72f9b": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "110315e138454269a9cd0a0616099943": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_caa65d73d5f34b1ba86b5a5c8526993e", "style": "IPY_MODEL_c0ee9c8afdc940b783dec53e9a91b5b6", "value": "" } }, "1110dad74a684e2aa7919aa769f14be7": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "FloatSliderModel", "state": { "continuous_update": false, "description": "Zoom", "layout": "IPY_MODEL_506f1c7500204cc79f6c2a931db3712b", "max": 1, "step": 0.1, "style": "IPY_MODEL_289f6d5c6e18457b851960c6e4edd298", "value": 0.5 } }, "111261b6231241e684cf2e371fae607d": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_fcda3b18975244359cf653b0bfa645bc", "IPY_MODEL_65e3a30c1986455498fc09c9e3dc6a4b" ], "layout": "IPY_MODEL_b46f05bbdac042719e97b383c2bb2e84" } }, "11202405bca046eca2dd3301770d0289": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "DescriptionStyleModel", "state": { "description_width": "" } }, "112874be154a40e6a3b5cf0c9bc7a6f3": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "description": "Play", "icon": "play", "layout": "IPY_MODEL_92c6c1d407e2408ea74bfde3b85f5eeb", "style": "IPY_MODEL_b0ee1fa132f24548b7cb7d5080e5f2b7" } }, "11391efb724940a4a341744e05b7889c": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HBoxModel", "state": { "children": [ "IPY_MODEL_a1312ca9c1d94f3bb5ba7bf3d1786b8d", "IPY_MODEL_0f0ed8b445044ff39a25669affafb8bc" ], "layout": "IPY_MODEL_d7783a1d116745e8b5900fd437e6aa28" } }, "113c87f08b0b459abd48cb3f70ba3622": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_764f9514db024b4288ead9ab6738c008", "style": "IPY_MODEL_ad46418492f14b3a87f7efdfcec8daa3", "value": "


output bank:

" } }, "1145015150db401dbee8cd4a24e10d6c": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonStyleModel", "state": {} }, "11458f6907a04a84b30c3c7ea62a43ad": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "ButtonModel", "state": { "icon": "fast-backward", "layout": "IPY_MODEL_683d3028cd884725a83e4810a0a24ca0", "style": "IPY_MODEL_775b9533642a47559793bc27a4abb9a0" } }, "11513a2108d9439384c0cb40e52a2e31": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "LabelModel", "state": { "layout": "IPY_MODEL_b7bef4cc543d41679dcd60fece30ebda", "style": "IPY_MODEL_e6bd9077d13645128709acb470484849", "value": "of 1420" } }, "1154b9973db54d44b50088cf997860d5": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "VBoxModel", "state": { "children": [ "IPY_MODEL_e8c3497b0eba4dcdbc4386bcbfc73707", "IPY_MODEL_91940d4fe76b430caa57bc6c1c2de4eb", "IPY_MODEL_3a099ec2ec2246b99f3343f15004c739", "IPY_MODEL_148d8a25765d4bb79a40f148c5a7784e" ], "layout": "IPY_MODEL_2b0de7af1fcd456b9fd2fef4387c7207" } }, "1162b0e4813947d199297aa927678e89": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "1164bd1645d94597826f90bd71882ef2": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "116d3eac706f4129851b1f73c89dc8f0": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": {} }, "117327e0c7574d268bb32a889eb0a728": { "model_module": "@jupyter-widgets/base", "model_module_version": "1.0.0", "model_name": "LayoutModel", "state": { "width": "100%" } }, "1173ac538d9e4665bcc748783ad6f7f6": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_0d6637518c9141c196cca818d7a8e8ee", "style": "IPY_MODEL_32c9cc080ec7457e9ebf709264bc9daa", "value": "


output bank:

" } }, "1178261f167e4442bcf25b91487653f5": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_c471e2ce6c3847ecb1368ffa4438e5c8", "style": "IPY_MODEL_c4c6d40cacdf4113aa2ab9d8b264c2e8", "value": "


output bank:

" } }, "117c777222c64b4f9cbedd2ffd596f14": { "model_module": "@jupyter-widgets/controls", "model_module_version": "1.1.0", "model_name": "HTMLModel", "state": { "layout": "IPY_MODEL_b3fd251749fd4898b80fe2ded6c39506", "style": "IPY_MODEL_c7d7d4a27ed74dd6b1e08cfc5297e377", "value": "