{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {
    "slideshow": {
     "slide_type": "-"
    }
   },
   "source": [
    "## Population Genetics in *an* RNA World\n",
    "\n",
    "In order to study population genetics, we first need a model of a population. And even before that, we need to define what we mean by *population*. Populations can be defined on many levels and with many diffferent criteria. For our purposes, we will simply say that a population is a set of individuals sharing a common environment. And because this is population *genetics* we can think of individuals as entities comprising of specific genes or chromosomes. \n",
    "\n",
    "So where do we get a population from? As you may have discussed in previous workshops, there are very large datasets containing sequencing information from different populations. So we could download one of these datasets and perform some analysis on it. But I find this can be dry and tedious. So why download data when we can simply create our own?\n",
    "\n",
    "In this workshop we're going to be creating and studying our own \"artificial\" populations to illustrate some important population genetics concepts and methodologies. Not only will this help you learn population genetics, but you will get a lot more programming practice than if we were to simply parse data files and go from there. \n",
    "\n",
    "More specifically, we're going to build our own RNA world.\n",
    "\n",
    "As you may know, RNA is widely thought to be the first self replicating life-form to arise x billion years ago. One of the strongest arguments for this theory is that RNA is able to carry information in its nucleotides like DNA, and like protein, it is able to adopt higher order structures to catalyze reactions, such as self replication. So it is likely, and there is growing evidence that this is the case, that the first form of replicating life was RNA. And because of this dual property of RNA as an information vessel as well as a structural/functional element we can use RNA molecules to build very nice population models. \n",
    "\n",
    "So in this notebook, I'll be walking you through building genetic populations, simulating their evolution, and using statistics and other mathematical tools for understanding key properties of populations.\n",
    "\n",
    "### Building an RNA population\n",
    "\n",
    "As we saw earlier, RNA has the nice property of posessing a strong mapping between information carrying (sequence) and function (structure). This is analogous to what is known in evolutionary terms as a genotype and a phenotype. With these properties, we have everything we need to model a population, and simulate its evolution.\n",
    "\n",
    "#### RNA sequence-structure\n",
    "\n",
    "We can think of the genotype as a sequence $s$ consisting of letters/nucleotides from the alphabet $\\{U,A,C,G\\}$. The corresponding phenotype $\\omega$ is the secondary structure of $s$ which can be thought of as a pairing between nucleotides in the primary sequence that give rise to a 2D architecture. Because it has been shown that the function of many biomolecules, including RNA, is driven by structure this gives us a good proxy for phenotype. \n",
    "\n",
    "Below is an example of what an RNA secondary structure, or pairing, looks like."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {
    "collapsed": false,
    "slideshow": {
     "slide_type": "-"
    }
   },
   "outputs": [
    {
     "data": {
      "text/html": [
       "<img src=\"http://www.tbi.univie.ac.at/~pkerp/forgi/_images/1y26_ss.png\"/>"
      ],
      "text/plain": [
       "<IPython.core.display.Image object>"
      ]
     },
     "execution_count": 18,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "### 1\n",
    "\n",
    "from IPython.display import Image\n",
    "#This will load an image of an RNA secondary structure\n",
    "Image(url='http://www.tbi.univie.ac.at/~pkerp/forgi/_images/1y26_ss.png')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As you can see, unparied positions are forming loop-like structures, and paired positions are forming stem-like structures. It is this spatial arrangement of nucleotides that drives RNA's function. Therefore, another sequence that adopts a similar shape, is likely to behave in a similar manner. Another thing to notice is that, although in reality this is often not the case, in general we only allow pairs between $\\{C,G\\}$ and $\\{A, U\\}$ nucleotides, most modern approaches allow for non-canonical pairings and you will find some examples of this in the above structure.\n",
    "\n",
    "*How do we go from a sequence to a structure?*\n",
    "\n",
    "So a secondary structure is just a list of pairings between positions. How do we get the optimal pairing?\n",
    "\n",
    "The algorithm we're going to be using in our simulations is known as the Nussinov Algorithm. The Nussinov algorithm is one of the first and simplest attempts at predicting RNA structure. Because bonds tend to stabilize RNA, the algorithm tries to maximize the number of pairs in the structure and return that as its solution. Current approaches achieve more accurate solutions by using energy models based one experimental values to then obtain a structure that minimizes free energy. But since we're not really concerned with the accuracy of our predictions, Nussinov is a good entry point. Furthermore, the main algorithmic concepts are the same between Nussinov and state of the art RNA structure prediction algorithms. I implemented the algorithm in a separate file called `fold.py` that we can import and use its functions. I'm not going to go into detail here on how the algorithm works because it is beyond the scope of this workshop but there is a bonus exercise at the end if you're curious.\n",
    "\n",
    "You can predict a secondary structure by calling `nussinov()` with a sequence string and it will return a tuple in the form `(structure, pairs)`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 19,
   "metadata": {
    "collapsed": false,
    "slideshow": {
     "slide_type": "-"
    }
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "ACCCGAUGUUAUAUAUACCU\n",
      "(...(..(((....).))))\n"
     ]
    }
   ],
   "source": [
    "import numpy as np\n",
    "from fold import nussinov\n",
    "\n",
    "sequence_to_fold = \"ACCCGAUGUUAUAUAUACCU\"\n",
    "struc = nussinov(sequence_to_fold)\n",
    "print(sequence_to_fold)\n",
    "print(struc[0])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true,
    "slideshow": {
     "slide_type": "-"
    }
   },
   "source": [
    "You will see a funny dot-bracket string in the output. This is a representation of the structure of an RNA. Quite simply, a matching parir of parentheses (open and close) correspond to the nucleotides at those positions being paried. Whereas, a dot means that that position is unpaired in the structure. Feel free to play around with the input sequence to get a better understanding of the notation.\n",
    "\n",
    "So that's enough about RNA structure prediction. Let's move on to building our populations.\n",
    "\n",
    "### Fitness of a sequence: Target Structure\n",
    "\n",
    "Now that we have a good way of getting a phenotype (secondary structure), we need a way to evaluate the fitness of that phenotype. If we think in real life terms, fitness is the ability of a genotype to replicate into the next generation. If you have a gene carrying a mutation that causes some kind of disease, your fitness is decreased and you have a lower chance of contributing offspring to the next generation. On a molecular level the same concept applies. A molecule needs to accomplish a certain function, i.e. bind to some other molecule or send some kind of signal. And as we've seen before, the most important factor that determines how well it can carry out this function is its structure. So we can imagine that a certain structure, we can call this a 'target' structure, is required in order to accomplish a certain function. So a sequence that folds correctly to a target structure is seen as having a greater fitness than one that does not. Since we've encoded structures as simple dot-bracket strings, we can easily compare structures and thus evaluate the fitness between a given structure and the target, or 'correct' structure. \n",
    "\n",
    "There are many ways to compare structures $w_{1}$ and $w_{2}$, but we're going to use one of the simplest ways, which is base-pair distance. This is just the number of pairs in $w_{1}$ that are not in $w_{2}$. Again, this is beyond the scope of this workshop so I'll just give you the code for it and if you would like to know more you can ask me."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "('((....))', [(0, 7), (1, 6)])\n",
      "('.(....).', [(1, 6)])\n",
      "1\n"
     ]
    }
   ],
   "source": [
    "### 3\n",
    "\n",
    "#ss_to_bp() and bp_distance() by Vladimir Reinharz.\n",
    "def ss_to_bp(ss):\n",
    "    bps = set()\n",
    "    l = []\n",
    "    for i, x in enumerate(ss):\n",
    "            if x == '(':\n",
    "                    l.append(i)\n",
    "            elif x == ')':\n",
    "                    bps.add((l.pop(), i))\n",
    "    return bps\n",
    "\n",
    "def bp_distance(w1, w2):\n",
    "    \"\"\"\n",
    "    return base pair distance between structures w1 and w1. \n",
    "    w1 and w1 are lists of tuples representing pairing indices.\n",
    "    \"\"\"\n",
    "    return len(set(w1).symmetric_difference(set(w2)))\n",
    "\n",
    "#let's fold two sequences\n",
    "w1 = nussinov(\"CCAAAAGG\")\n",
    "w2 = nussinov(\"ACAAAAGA\")\n",
    "\n",
    "print(w1)\n",
    "print(w2)\n",
    "\n",
    "#give the list of pairs to bp_distance and see what the distance is.\n",
    "print(bp_distance(w1[-1], w2[-1]))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Defining a cell: a little bit of Object Oriented Programming (OOP)\n",
    "\n",
    "Since we're going to be playing aroudn with sequences and structures and fitness values a lot, it's best to package it all nicely into an object. As you'll have seen with Vlad, objects are just a nice way of grouping data into an easily accessible form. \n",
    "\n",
    "We're trying to simulate evolution on a very simple kind of organism, or cell. It contains two copies of a RNA gene, each with a corresponding structure. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "('AACCCCUU', '(....).', 'AACCCCUU', '(....).')\n"
     ]
    }
   ],
   "source": [
    "### 4\n",
    "class Cell:\n",
    "    def __init__(self, seq_1, struc_1, seq_2, struc_2):\n",
    "        self.sequence_1 = seq_1\n",
    "        self.sequence_2 = seq_2\n",
    "        self.structure_1 = struc_1\n",
    "        self.structure_2 = struc_2\n",
    "        \n",
    "#for now just try initializing a Cell with made up sequences and structures\n",
    "cell = Cell(\"AACCCCUU\", \"((.....))\", \"GGAAAACA\", \"(....).\")\n",
    "print(cell.sequence_1, cell.structure_2, cell.sequence_1, cell.structure_2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Populations of Cells\n",
    "\n",
    "Now we've defined a 'Cell'. Since a population is a collection of individuals our populations will naturally consist of **lists** of 'Cell' objects, each with their own sequences. Here we initialize all the Cells with random sequences and add them to the 'population' list."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "### 5\n",
    "import random\n",
    "\n",
    "def populate(target, pop_size=100):\n",
    "    \n",
    "    population = []\n",
    "\n",
    "    for i in range(pop_size):\n",
    "        #get a random sequence to start with\n",
    "        sequence = \"\".join([random.choice(\"AUCG\") for _ in range(len(target))])\n",
    "        #use nussinov to get the secondary structure for the sequence\n",
    "        structure = nussinov(sequence)\n",
    "        #add a new Cell object to the population list\n",
    "        new_cell = Cell(sequence, structure, sequence, structure)\n",
    "        new_cell.id = i\n",
    "        new_cell.parent = i\n",
    "        population.append(new_cell)\n",
    "            \n",
    "    return population"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Try creating a new population and printing the first 10 sequences and structures (in dot-bracket) on the first chromosome!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(0, 'GGUGGGGACAUCCCGACGUC', '((((((.....))).))..)', 'GGUGGGGACAUCCCGACGUC', '((((((.....))).))..)')\n",
      "(1, 'GGAACCGAUCGAACCCCCCG', '(((.....))(....))...', 'GGAACCGAUCGAACCCCCCG', '(((.....))(....))...')\n",
      "(2, 'ACCGAGUGGUUAAGACCUAA', '(((....)))((.....)).', 'ACCGAGUGGUUAAGACCUAA', '(((....)))((.....)).')\n",
      "(3, 'UUGGAAUUCUUGUCGGAUAA', '(((.((....).))..).).', 'UUGGAAUUCUUGUCGGAUAA', '(((.((....).))..).).')\n",
      "(4, 'AUGAGUUUGAUCUAUCUAGU', '(((((......))..).).)', 'AUGAGUUUGAUCUAUCUAGU', '(((((......))..).).)')\n",
      "(5, 'GGAUCAGACUAAAAGAAAUA', '..(((.........))..).', 'GGAUCAGACUAAAAGAAAUA', '..(((.........))..).')\n",
      "(6, 'CUCAAGCCCCAAGCUGACGA', '((((.((.....))))).).', 'CUCAAGCCCCAAGCUGACGA', '((((.((.....))))).).')\n",
      "(7, 'AGAGUCCGUGAGAACACUGA', '((.(((.....)).).))..', 'AGAGUCCGUGAGAACACUGA', '((.(((.....)).).))..')\n",
      "(8, 'AGACGUGUUUUCACAGGCGU', '((.((((....))).).).)', 'AGACGUGUUUUCACAGGCGU', '((.((((....))).).).)')\n",
      "(9, 'GACCACUUGUCGCGAGCCAA', '(....)((((....).).))', 'GACCACUUGUCGCGAGCCAA', '(....)((((....).).))')\n"
     ]
    }
   ],
   "source": [
    "### 6\n",
    "target = \"(.(((....).).).)....\"\n",
    "pop = populate(target, pop_size=100)\n",
    "for p in pop[:10]:\n",
    "    print(p.id, p.sequence_1, p.structure_1[0], p.sequence_2, p.structure_2[0])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## The Fitness of a Cell\n",
    "\n",
    "Now that we can store populatoins of cells, we need a way to evaluate the fitness of a given Cell. Recall that a Cell is simply an object that contains two RNA sequences (think of it as two copies of a gene on each chromosome). \n",
    "\n",
    "So we simply need to loop through each Cell in a population and compute base pair distance to the target structure. However, simply using base-pair distance is not a very good measure of fitness. There are two reasons for this: \n",
    "\n",
    "1. We want fitness to represent a *probability* that a cell will reproduce, and base pair distance is an integer.\n",
    "2. We want this probability to be a *relative* measure. That is, we want to be the fitness to be proportional to how good a cell is with respect to all others in the population. This touches on an important principle in evolution where we only need to be 'better' than the competition and not good in some absolute measure. For example, if you and I are being chased by a bear. In order to survive, I only need to be faster than you, and not necessarily some absolute level of fitness.\n",
    "\n",
    "In order to get a probability (number between 0 and 1) we use the following equation to define the fitness of a structure $\\omega$ on a target structure $T$:\n",
    "\n",
    "$$P(\\omega, T) = N^{-1} exp(\\frac{-\\beta \\texttt{dist}(\\omega, T)}{\\texttt{len}(\\omega)})$$\n",
    "\n",
    "$$N = \\sum_{i \\in Pop}{P(\\omega_i, T})$$\n",
    "\n",
    "Here, the $N$ is what gives us the 'relative' measure because we divide the fitness of the Cell by the sum of the fitness of every other Cell. \n",
    "\n",
    "Let's take a quick look at how this function behaves if we plot different base pair distance values.\n",
    "\n",
    "What is the effect of the parameter $\\beta$? Try plotting the same function but with different values of $\\beta$."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 24,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.text.Text at 0x1093ff710>"
      ]
     },
     "execution_count": 24,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYYAAAERCAYAAAB/4wAeAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3Xl8VPXV+PHPTDayk4RJgEACBDiELayCgKi4FBQtUvel\n1YqttbVWa58+2l+1+lSfbtpVn7ovrVoF16IgouCC7PsSDvsSlhC2sCdk+f1xJ8wkDVkgk8lkzvv1\n8iUz9869Jyc398z3fu/9fl2VlZUYY4wxVdzBDsAYY0zLYoXBGGNMNVYYjDHGVGOFwRhjTDVWGIwx\nxlRjhcEYY0w1AS8MIjJMRGbV8v4VIrJAROaIyKRAx2GMMaZhAloYRORnwHNATI33I4EngYuBC4Dv\niYgnkLEYY4xpmEC3GDYAV9Xyfi6wXlUPqepJ4CtgdIBjMcYY0wABLQyq+i5QVsuiJKDY7/VhIDmQ\nsRhjjGmYYHU+H8IpDlUSgYNBisUYY4yfyGbaj6vG63ygu4i0BY7hXEb6fX0b+eb971d6UuL4y08v\nIK5NVADCNMaYVqnmObhOzVUYKgFE5AYgXlWfF5H7gBk4AT+vqrvq28i3xvRg8qfreeqtZdw6rldg\nI27hPJ5EiooOBzuMFsFy4WO58LFc+Hg8iY1a3xVKo6ueLKuovOeJWWzfc4R7ru5PXvd2wQ4paOyg\n97Fc+FgufCwXPh5PYqNaDCH1gFtUpJs7xvcmMsLFS9PWcvhYabBDMsaYViekCgNAp/QErhrdjUNH\nS3n1YyWUWjzGGBMKQq4wAHxjaBY9OiWzWIuYt6Yw2OEYY0yrEpKFwe12cfv43sRERfDPGevYf+hE\nsEMyxphWIyQLA0B621iuv6g7x0vKeOHDfCrskpIxxjSJkC0MAKPzOtI/J438rQf4bHFBsMMxxphW\nIaQLg8vl4rZxvUiIjWLy7I3sKDoS7JCMMSbkhXRhAEhOiOG2cb04WVbBMx+s5mRZebBDMsaYkBby\nhQFgYE8PFwzMpKDoKJNnbQx2OMYYE9JaRWEAuG5MdzqkxTFzcQErNu4LdjjGGBOyWk1hiImK4PtX\n9iEywsWLH66h+Kg9FW2MMWei1RQGgKyMRK4+P4dDx07y4of59lS0McacgVZVGAAuHtqZvl1TWblp\nHzPtFlZjjGm0VlcY3C4Xt1+eS2JcFJNnbWT7HruF1RhjGqPVFQZwbmH97mW5lJU7t7CWnrRbWI0x\npqFaZWEAyOvejosGdWLn3qP867MNwQ7HGGNCRqstDADXjsmhkyeB2Ut3sCDfRmE1xpiGCOjUniLi\nAp4G8oATwCRV3eS3/BbgfuAg8IqqvtiU+4+KjOAHE/rw6MuLeHnaWrLbJ5KREteUuzDGmFYn0C2G\nCUCMqo4AHgCerFogImnAo8Bo4ALgJhHJauoAOqTF8+2xwonScv7vvVU2ZIYxxtQj0IVhFDAdQFXn\nA0P8lnUDlqlqsapWAguB4YEI4tw+7Tmvfwe2FR7hTetvMMaYOgW6MCQBxX6vy0Skap/rgT4i4hGR\nOOAiID5Qgdx4SU8yPfF8tmQHi9buCdRujDEm5AW0jwE4BCT6vXaragWAqh4UkfuAt4F9wGJgb30b\n9HgS61vltH5x2zDu/dPnvDx9LQN7t6d9WsDqULM4m1y0NpYLH8uFj+XizAS6MMwBxgNTRGQ4sLJq\ngYhEAINUdbSIRAMzgAfr22BR0eEzDqaNG26+pCcvfJjPYy/O54GbBxMVGZo3Znk8iWeVi9bEcuFj\nufCxXPg0tkAG+qz4LlAiInOAJ4B7ReQGEZmkquUAIrIEmAX8RVX3BzgeRvbrwMi+7dmy+zCTZ1t/\ngzHG1OQKsYHmKpviG0BJaTmPvrKQXfuOcdeEvgzpld4EoTUv+zbkY7nwsVz4WC58PJ5EV2PWD83r\nKGcpJjqCuyb0JTrKzYsf5bNr39Fgh2SMMS1GWBYGgExPAreO68WJ0nKeencVJ0rLgh2SMca0CGFb\nGACG927PRYOd8ZRema42f4MxxhDmhQGcKUFzMpOYv6aQT23+BmOMscIQGeHmrgn9SIyL4s3PNrCh\noLj+DxljTCsW9oUBICUxhjuv7ENFZSVPv7fS5os2xoQ1KwxeuV1S+db5ORw8Usoz76+ivKIi2CEZ\nY0xQWGHwM25YFgN7tGPttoO88/mm+j9gjDGtkBUGPy6Xi9sv7016SizT5m+zyX2MMWHJCkMNcW0i\nuXtiP2KiI3jxw3y2FdqTk8aY8GKFoRaZngS+N743pWUV/PXtlRw+Zp3RxpjwYYXhNAb29PDNUV3Z\nd+gE//feKsrKrTPaGBMerDDU4YqRXU51Rr9lM78ZY8KEFYY6uF0uJo3vTcd28cxcXMCXK3YGOyRj\njAk4Kwz1iI2J5O5v9SMuJpJ/fKxs3GlPRhtjWjcrDA2QkRLHnd/sQ3lFJU+9s5KDR0qCHZIxxgSM\nFYYG6tstjasvcJ6M/uvbKyk9WR7skIwxJiACOueziLiAp4E84AQwSVU3+S2/CbgPKANeUtW/BzKe\nszX2nCwK9hxl7urdvPhRPt+/sg8uV6MmRjLGmBYv0C2GCUCMqo4AHgCerLH898AYYBTwUxFJDnA8\nZ8XlcnHruF5075TMgvw9fDBnS7BDMsaYJhfowjAKmA6gqvOBITWWLwdSgFjv6xY/U05UpJsfTexH\nu+Q2vP/VZuavsWEzjDGtS6ALQxLgfxtPmYj473M1sBhYCUxV1UMBjqdJJMVFc8/V/WkTHcELH+bb\nnUrGmFbFFcjpLEXkCWCuqk7xvt6mqlnef/cD3gKGAkeB14C3VfXtOjbZoloUi9cW8ujz80hKiOGJ\ne0aTnhIX7JCMMaY2jeoMDWjnMzAHGA9MEZHhOC2DKsXAMaBEVStFZA/OZaU6FRW1nEHtstLiuO6i\nHrwxcz0PPzOXB24eRGxMoFPq8HgSW1Qugsly4WO58LFc+Hg8iY1aP9CXkt4FSkRkDvAEcK+I3CAi\nk1R1G/As8JWIfAEkAy8HOJ4md/HgTlw4MJOCoiM89+81VFS0qEaNMcY0WkAvJQVAZUv8BlBWXsGf\nJi9nzZYDXDykEzde3DPg+7RvQz6WCx/LhY/lwsfjSWzUpSR7wK0JREa4uWtCXzLbxTNzUQEzFmwL\ndkjGGHPGrDA0kbg2UfzkmjySE6J587MNLFq7J9ghGWPMGbHC0ITSktvwk6vziI6O4Nl/r2FDgd3G\naowJPVYYmlh2+0TumtCXiopK/vL2CnbvPxbskIwxplGsMARAv25pfHuscOT4Sf741jIOHbWpQY0x\nocMKQ4CMzuvI+BFdKDp4gj9PWUGJjcZqjAkRVhgC6KrzunJun/Zs3nWIZz9YTXmFzRttjGn5rDAE\nkMvl4rbLepGbncLS9Xv5x8dKiD03YowJQ1YYAiwywhmNNSsjgS+W7+LdLzfV/yFjjAkiKwzNIDYm\nknuvHUB621imfr2VTxZtD3ZIxhhzWlYYmklyfDT3XT+A5Pho3pi5nnlrdgc7JGOMqZUVhmaU3jaW\ne6/NIzYmghem5rNq875gh2SMMf/BCkMzy8pI5Mff6o/L5eKpd1axaWdIzE1kjAkjVhiCQLJSuPOb\nfSgtK+dPk5eza9/RYIdkjDGnWGEIkkE9PXxnbC+OHD/JH/61jL3Fx4MdkjHGAFYYgmp0XkeuuTCH\nA4dL+MMbyzh4pCTYIRljjBWGYBs3LJvxI7qw5+BxnvjXMg4fs3GVjDHBFdAJikXEBTwN5AEngEmq\nusm7LAP4F1CJM1H1AODnqvpsIGNqia46rysnSsuYuaiAJ99azn/dMLDZ5o42xpiaAt1imADEqOoI\n4AHgyaoFqlqoqheq6hjvssXAcwGOp0VyuVxcf1EPRvXvwNbdh/nz5OU26J4xJmgCXRhGAdMBVHU+\nMOQ06/0VuFNVw3YgIbfLxa1je3FObjrrCor52zsrOVlmg+4ZY5pfoAtDEuA/jVmZiFTbp4hcAaxS\n1Q0BjqXFc7tdTBrfm7ycNFZv3s8zNiKrMSYIAn0h+xCQ6Pfarao1z3Q3A39q6AY9nsT6VwpxD91x\nLo88P48l64r4x4z13HfjICIi/rOGh0MuGspy4WO58LFcnJlAF4Y5wHhgiogMB1bWss4QVZ3b0A0W\nFR1uqthatDuv7M0f31rOF8t2UFpaxqTxvXG7XaeWezyJYZOL+lgufCwXPpYLn8YWyEBfSnoXKBGR\nOcATwL0icoOITAIQkXZUv9RkvNpER/KTa/LIyUxi3ppCXvgwn4qKsO2CMcY0I1eITRxTGW7fAI6X\nlPHEm8vYtPMQI/u157bLcnG7XPZtyI/lwsdy4WO58PF4El31r+VjD7i1cLExkdx37QC6dkhkzsrd\nvDJtLRWhVcyNMSHGCkMIiGsTyX3XDSA7I5EvV+ziHx+rXVYyxgSMFYYQEd8mip9eP4Cs9AQ+X7aT\nv7+7wloOxpiAsMIQQhJio7j/hoF0Tk9g2tdbeHW6XVYyxjQ9KwwhJiE2ip/dMJBumcl8sXwXL9nd\nSsaYJmaFIQQlxEbx2J0j6NohiTmrdvP81DX2hLQxpslYYQhRCXHR3H/9ALpnJjNvTSHPvL+asnIr\nDsaYs2eFIYTFxkRy33V5SOe2LNIinn53lQ28Z4w5a1YYQlyb6Eh+cm0evbuksGzDXv72zkpKbchu\nY8xZsMLQCsRERfDjb/Wnb7dUVm7ax5+nrOB4SVmwwzLGhCgrDK1EdFQEd0/sz8Ae7cjfeoAn3lzG\nkeMngx2WMSYEWWFoRaIi3dx1VV9G9G3Ppp2H+O3rSzh4pCTYYRljQowVhlYmwu3mu5fnctHgTuwo\nOsr//nMxRQePBzssY0wIscLQCrldLm68uAdXjuxC0cETPP7PxewoOhLssIwxIcIKQyvlcrmYcF43\nrh/TneIjpfzmtSVs3nUo2GEZY0KAFYZW7tJzsrhtXC+OlZTxuzeWkr9lf7BDMsa0cA2e2lNEUoEK\nVT3YiM+4gKeBPOAEMElVN/ktH4ozsxvAbuBmVS1t6PZNw5yX15HYmEie/fdqnnxrOXdc0ZtzcjOC\nHZYxpoWqs8UgIn1E5GUR2QesB1RECkXkBRHp04DtTwBiVHUE8ADwZI3lzwK3qupoYDqQ3fgfwTTE\nkF7p3HvtAKKj3Pz9/dV8snB7sEMyxrRQpy0MIvJb4EFgMtBFVdNUNQPIAd4BHhGRP9Sz/VE4J3xU\ndT4wxG/7PYF9wH0iMhtIVdX1Z/GzmHrkZqfw8xsHkRwfzRufrmfyrA02bLcx5j/UdSnpTVVdUvNN\nVT0CfAh8KCJD/vNj1SQBxX6vy0TEraoVQDvgXOAuYBMwVUQWqersxvwApnGyMhL5xS2DeeKt5Uyb\nv42DR0q57bJeREZYd5MxxlHX2eAb9X1YVRfVs8ohINF/f96iAE5rYYOqrlPVMpyWRX2FxjSBdm1j\nefDmQXTrmMTc1bv5y5QVnCi1ITSMMY66WgzXAP97ltufA4wHpojIcGCl37JNQIKIdPN2SJ8HPF/f\nBj2exPpWCRtnkwsP8Nsfncdv/7GIRfmFPDl5BQ/dPoyUxDZNF2AzsuPCx3LhY7k4M67K01xjFpEl\nqjrobDbud1dSf+9btwGDgXhVfV5ELgB+6132tareW88mK4uKDp9NSK2Gx5NIU+SirLyCV6crX63c\nRVpSG35ybR6Z7eKbIMLm01S5aA0sFz6WCx+PJ9HVmPXrKgwVQG0LXUClqkY0PryzZoXBqykP+srK\nSv799Rbe+3IzsTGR/OiqvuR2SW2SbTcHOwH4WC58LBc+jS0MdV1KWq6qA88yHhMCXC4XV47siic5\nlpem5fPkW8v5zthejOrfIdihGWOCwG5FMaec27c9P71uAG2iI3jxo3ze+WITp2tRGmNar7oKw+Rm\ni8K0GJKVwoO3DMbTtg1Tv97Cc1PX2HShxoSZ0xYGVX28OQMxLUeHtHh+8e0h5GQmMW91IX/411IO\nHbORSowJF3YpydQqKS6an10/kKG90llfUMyvX1lEwR4butuYcGCFwZxWdFQEd36zDxNGdWVv8Qke\n++dilq4vCnZYxpgAO6PCICLtRSShqYMxLY/L5eLKUV25a0JfKisq+dvbK/lo3lbrlDamFTvTFsM0\nnEH0bmjKYEzLNaRXOg/cPJi2iTFMmb2R56fmc7KsPNhhGWMCoMHzMfiz5xvCU3b7RH75nSH87Z2V\nzF29mz0HjvGjif1ITogJdmjGmCZUb4tBRD4UkTtFpFNzBGRatrYJMfz8xoGc2yeDjTsP8cjLC9m4\no7j+DxpjQkZDLiU9CrQH3haRJSLya++AeCZMRUVGMGl8b669sDvFR0v57etL+GL5zmCHZYxpIvUW\nBlWdr6q/whkl9TngVuCLwIZlWjqXy8XYYVncd90AYqIieHnaWl6ZvtYehjOmFWjIpaSnRGQ58DHQ\nE2diHU+gAzOhoU+XVB6+dShZ6Ql8vmwnv3t9CQcOlwQ7LGPMWWjIpaS2OCOqKpAPrFVVu6hsTmnX\nNpYHbhnMcG+/w6MvL2R9wcFgh2WMOUMNuZR0k6r2x+lriMaZgnNHwCMzISUmKoI7xvfm+ot6cPjY\nSX73+lI+WbTdnncwJgTVe7uqiAhwEXAxMACYjzPnszHVuFwuLh3amc7pCTzz/iremLme9QXF3Dau\nF7ExZ3RntDEmCBry1zoZmAo8iTPLmvUumjrlZqfw8G3n8Pf3V7Fo7R627znCDyf0pVO6PSxvTCio\nawa38ao6ta4Pi8iVqvpBHcurpvbMA04Ak7zzO1ct/wkwCdjjfev7qrq+jl3aDG5eoTA7VVl5Be98\nvonpC7YRHenmlm8II/s1/eQ/oZCL5mK58LFc+DTlDG5dRWQGMAXn9tQCoAzIBsYA1wHv1rP9CUCM\nqo4QkWE4rY4JfssHA7eo6tLGBG1CQ2SEm2vHdCcnM5kXP1rDCx/ms76gmJsu6UFUZDBmhjXGNERd\n8zH8FbgZyATeAHYDhd5/tweuU9U/17P9UcB07/bmA0NqLB8MPCAiX4rIf5/RT2BavMHi4SHvLa1f\nLN/JY68uZvf+Y8EOyxhzGnX2MajqHuBh739nIgnwv7W1TETcfv0UbwBPAYeA90TkMlX96Az3ZVqw\njJQ4HrxlMK/PXMcXy3fxyEsLueUbPRnR1+aVNqalOW1hEJGOwN+AHsBXwAOq2tib0w8BiX6v3TU6\nr/+sqoe8+/sQGAhYYWiloqMiuHVcLr2yU3h1uvL81Hzytxzgpkt70iba7loypqWo66/xJWAx8CxO\nf8Ifgdsauf05OENpTPGOr7SyaoGIJAGrRKQXcByn3+KF+jbo8STWt0rYCNVcXHF+IkP6dOR3/1zE\nnFW72VJ4hJ9/ewhdOyaf8TZDNReBYLnwsVycmbruSlqlqn29/44Clqlqn8Zs3O+upP7et27D6VeI\nV9XnReQm4B6cO5Y+VdVH6tmk3ZXk1RruuCgrr2DK7I3MWLidyAg3143pzphBmbhcjbqBolXkoqlY\nLnwsFz5NeVfSqdnfVfWkiDR6NnhVrQR+UOPtdX7LXwNea+x2TesQGeHm+ot6kJudwgsf5vPaJ+tY\ns2U/t47rRWJcdLDDMyZsNWYGNxvbwAREXvd2PPLdc+iV1Zal6/fy0AsLWLVpX7DDMiZs1XUpqQTw\nHxMp0/vaBVSqarfAh/cf7FKSV2tsJldUVvLxgm288/kmyisquXhwJ66+IIfoqLqfeWiNuThTlgsf\ny4VPU15K6nmWsRjTKG6Xi3HDsumdncqz/17NzMUF5G89wB1X9CYrwzoRjWkup20xtFDWYvBq7d+G\nSk6WM3nWBj5bsoPICBcTR+dw6TmdcdfSMd3ac9EYlgsfy4VPY1sMjeljMKbZxERFcPOlwj1X9ycu\nJpK3Zm3g968vpejg8WCHZkyrZ4XBtGh53dvx6O3DGNijHbr9IA+9uIDZy3bYPA/GBJAVBtPiJcVH\n86OJ/Zg0Phe3y8Wr05U/vrXcphA1JkCsMJiQ4HK5GNG3A/9z+zn07ZrKqs37+eXz85m7are1Hoxp\nYlYYTEhJTWrDvdfm8Z2xQnllJc9NXcPjLy/g4BFrPRjTVGzkMhNyXC4X5w/IpHeXVF78MJ95q3az\nYv1err+oByP7tW/0kBrGmOqsxWBClqdtLD+7cSB3TuxPeWUlL36Uzx/fWs7eYrtzyZizYYXBhDS3\ny8XlI7vW6HtYwKeLC6iwvgdjzogVBtMqtEuO5d5r87j98lwiI1y89sk6fvvaEnbtOxrs0IwJOVYY\nTKvhcrkY2a8Dv540jME9PawvKObhFxfwwVebOVlWUf8GjDGAFQbTCiUnxPDDif24a0Jf4mOjeO+r\nzfzqpQWs297YCQiNCU9WGEyrNaRXOo9NGs6YQZns3neM37y2hJc+yufI8ZPBDs2YFs0Kg2nV4tpE\ncvOlwoO3DKaTJ4EvV+ziF8/NY+5qezDOmNMJ6OiqflN75uFM3zlJVTfVst4zwD5VfbCeTdroql42\ncqRPQ3NRVl7BJwu38/5XmyktqyA3O4WbLulJx3bxzRBl87Djwsdy4dPSRledAMSo6gjgAeDJmiuI\nyPeBvgGOwxgiI9yMG57N/0waRv+cNPK3HuDhFxcwedYGTpSWBTs8Y1qMQBeGUcB0AFWdDwzxXygi\n5wJDgWcCHIcxp3jaxnLP1f25+1v9aJsQw7T52/jFc/NZtHaPXV4yhsAXhiSg2O91mYi4AUSkPfAw\n8COc6UKNaTYul4uBPTz8+o5hXDGiC4ePlfL0e6t48s1l9uyDCXuB7mN4ApirqlO8r7epapb333cD\n3wYOAx2AWOAhVX21jk3a1zkTEDuLjvDMeytZsnYPkREurjgvh+su7kl8bFSwQzOmKTTqy3egC8NE\nYLyqfldEhgO/VNXLa1nvO4BY53PDWceaT1PlorKykiXr9vLmZ+vZW3yCpLgoJp6fw6j+HWqdUrQl\nsuPCx3Lh09jO50CPrvoucImIzPG+vk1EbgDiVfX5AO/bmEZxuVwMFg/9c1L5eMF2ps7dwsvT1jJr\n6Q5uvLgHPTq1DXaIxjSLgLYYAsBaDF72bcgnULk4cLiEKbM3Mnf1bgCG9c7gmgtySE1q0+T7aip2\nXPhYLnxaWovBmJCVkhjDHVf05sJBmbwxcx3z1xSyZF0Rlw7tzGXDs4mNsT8f0zrZk8/G1KN7ZjK/\n+PYQbr88l4TYKD6cu5UHnpnLrKU7KK+wwflM62OFwZgGcHtHbn38e8O56ryulJys4B8fKw+9sIBl\nG/ba8w+mVbG2sDGNEBMVwRUjuzI6ryPvf7WZz5fv5C9TVpCbncI1F+bQpX1SsEM05qxZ53OIso41\nn2DmYkfRESbP3siKjfsAGNornYmju5GRGheUeOy48LFc+FjnszHNKNOTwE+uySN/y36mfL6RhWv3\nsFiLGJ3XgStHdaVtQkywQzSm0awwGNMEcruk8v+yU1isRbz9xSZmL9vJ16t2c8nQzowblkVcG3uC\n2oQOKwzGNBGXy8WQXukM7NmOr1bs4v2vNvPh3K3MXrqDscOyuGhwJ9pE25+cafnsKDWmiUW43Zw/\nIJPhfdrz6eICps3bytufb2LGwu1cNjybCwdmEh0VEewwjTkt63wOUdax5tPSc3HsRBkzFm7jk0Xb\nOV5STnJCNOPP7cLovI5ERTbtHeMtPRfNyXLh09jOZysMIcoOep9QycWR4yf5eIFTIEpPVpCaFMP4\nEV0Y1a8DkRFNUyBCJRfNwXLhY4UhTNhB7xNquTh0tJSP5m1l1tIdnCxzCsTlw7MZ1f/sWxChlotA\nslz4WGEIE3bQ+4RqLg4eKWHavG3MXuYUiJTEGC4bns3ovA5ERZ5ZH0So5iIQLBc+VhjChB30PqGe\ni+IjJXy8YDufLS2g9GQFyQnRjBuWzfkDOhLTyE7qUM9FU7Jc+FhhCBN20Pu0llwcOlrKxwu38dni\nHZScLCcxLopLhnRmzKDMBj8H0Vpy0RQsFz5WGMKEHfQ+rS0Xh4+V8smiAj5bXMCxkjJiYyK4cGAn\nLhnameT46Do/29pycTYsFz5WGMKEHfQ+rTUXx0vKmL10Bx8v3M6ho6VERboZ1b8D487Jol3b2Fo/\n01pzcSYsFz4taqwkEXEBTwN5wAlgkqpu8lv+LeDnQAXwuqr+JZDxGBNKYmMiGTc8m4uHdOKrFbuY\nNn8bs5bs4POlOxmam87Yc7LIbp8Y7DBNKxToJ58nADGqOkJEhgFPet9DRNzA48Bg4BiwRkT+qar7\nAxyTMSElKjKCCwd1YvSAjizI38O0eVuZv6aQ+WsKyc1OYeywLPp2TcXlatSXQmNOK9CFYRQwHUBV\n54vIkKoFqlohIrne/6fjTBpUGuB4jAlZEW435/Zpz/DeGazevJ/pC7axZssB8rceINMTz9hzsrh8\ndHywwzStQKALQxJQ7Pe6TETcqloBp4rDVcBTwFTgaIDjMSbkuVwu+nZLo2+3NLbuPszHC7axIH8P\nL3yYz7tfbuL8AZlcMKAjiXF1d1QbczoB7XwWkSeAuao6xft6m6pmnWbdV4DPVPWVOjYZUj3lxjSX\nPQeO8cEXm5gxfyvHS8qIjnRzweDOXHleN7I72KxyhpbT+QzMAcYDU0RkOLCyaoGIJAL/Bi5V1VKc\n1kK9M6vbXQYOu+PCx3Lh/NV/c0Q2N35DeO+z9cxcvJ0Z87cyY/5WendJ4ZIhnemXk4Y7jPoh7Ljw\n8Xgad5NCoFsMVXcl9fe+dRtOZ3O8qj4vIpOASTh9CyuAu1W1roDsdlUvO+h9LBc+VbmoqKhk+Ya9\nfLJoO2u3HQQgPSWWMQMzGdm/A/FhMHGQHRc+9hxDmLCD3sdy4VNbLrYVHmbmogLmrSmkrLyC6Eg3\nw/u0Z8ygTLIyWu/trnZc+FhhCBN20PtYLnzqysXhY6V8tWIXs5buYG/xCQB6dEpmzKBODBZPkw39\n3VLYceHToh5wM8a0HIlx0Ywbns03zslixcZ9fLakgFWb97O+oJikuChG9e/I6AEdST/NU9UmfFhh\nMCbMuN0uBvRox4Ae7di9/xizl+5gzspdfDRvKx/N20qfrqlcMCCTvO5pra4VYRrGCoMxYax9ahzX\nX9SDiaM2sMOvAAASQUlEQVS7sUj3MHvZTlZv3s/qzftJTojmvP4dOa9/BzzWiggr1scQouz6qY/l\nwqcpclFQdITPl+7k69W7OV5SBkBudgrn5XVgcE/PGU8i1NzsuPCxPgZjzFnp5Engpkt7cvUFOSzS\nPXy5fCf5W52hN+LbRDK8T3vO69+hVd/RFO6sMBhjahUTHcHIfh0Y2a8Du/Yd5asVu5izajefLi7g\n08UFZGckMrJfe4b1zrDhN1oZu5QUoqyZ7GO58Al0LsrKK1i5cR9frtjFio37qKisJMLtIq97O0b2\nbU+/nJbTYW3HhY9dSjLGBExkhJuBPT0M7Omh+Ggp81bvZs7KXSxZV8SSdUUkxkUxrHcGI/q2Jzsj\n0YYCD1HWYghR9m3Ix3LhE4xcVFZWsq3wCHNW7WLe6kKOHD8JQIe0OIZ7hwkPxl1Ndlz42JPPYcIO\neh/LhU+wc1F1qWnumkKWrd9LWbkzLmb3Tsmc2zuDobkZJMQ2zzhNwc5FS2KXkowxQeN/qenYiTIW\nr9vDvNWFrN16gA0Fxbw+cz19uqYyLDeDAT3aERtjp6CWyH4rxpiAiGsT6X1AriMHDpcwb81u5q8p\nZMXGfazYuI+oSDf9c9IYlptB/5w0oqNC4/mIcGCFwRgTcCmJMYwbls24Ydns2neUhfl7mJ9fyGIt\nYrEWERMdwcDu7RjSK52+XVOtSASZ9TGEKLt+6mO58AmlXFRWVlJQdJQF+YXMX1N4asTXmOgI8nLS\nGNornb7d0og5wyIRSrkINOtjMMaEBJfLRef0BDqnJzBxdDe27D7MorV7WKR7WJDv/BcTFUH/nDQG\ni4d+3dKsT6KZWJaNMUHncrno2iGJrh2SuPqCHLYVHmGR7mHhWt9/kRFuendJYXBPDwN6tLOnrQMo\noIXBb2rPPOAEMElVN/ktvwG4BzgJrFTVuwIZjzGm5XO5XGS3TyS7fSITR3dj+54j3gfo9p7quHZN\nh56d2jKop4eBPdrRzkZ/bVKBbjFMAGJUdYSIDAOe9L6HiLQBHgX6qmqJiLwuIuNVdWqAYzLGhAiX\ny0VWRiJZGYlMOK8bew4cY8m6vSxZV4RuP4huP8gbn66nkyeeAT2cIpHdPhG3PXF9VgJdGEYB0wFU\ndb6IDPFbVgKMUNUSv1hOBDgeY0wIS0+JY+ywLMYOy+LgkRKWrd/Lsg17WbPlAFO/3sLUr7eQnBDN\ngO7tGD24Mx3btjnjzutwFujCkAQU+70uExG3qlaoaiVQBCAidwPxqjozwPEYY1qJtgkxXDAwkwsG\nZnKitIzVmw+wbEMRyzfs4/NlO/l82U6iIt30ykqhf04aeTlpdsmpgQJdGA4B/oO2u1W1ouqFtw/i\nd0APYGJDNujx2BjwVSwXPpYLn3DNRefMFMaO6kZ5RSVrt+xnUX4hi/ILWblpHys37eO1T6BzRiJD\nczMYkptBry6pREW2jJFgW5pAF4Y5wHhgiogMB1bWWP4scFxVJzR0g3ZfssPu0faxXPhYLhzpidF8\n5/LeXHZOZ/YVn2DFxr0s37iPtVsP8M7sDbwzewNtoiPIzU6hX7c0+nZNbdWticZ+WQjoA25+dyX1\n9751GzAYiAcWAwuBL73LKoE/q+r7dWzSHnDzshOAj+XCx3LhU1suSk+Ws3bbQVZ5WxGFB46fWtYh\nLY4+XVPp2zUV6ZxCTHTr6Zuw0VXDhJ0AfCwXPpYLn4bkYs+BY6zavJ9Vm/aTv/UAJSfLAYhwu+jR\nKZk+XVPp3SWV7IxE3O7QvdPJCkOYsBOAj+XCx3Lh09hcnCyrYEPBQVZvOcDqzfvZVniYqrNjfJtI\ncruk0js7hdzsFNJTYkNqEiIrDGHCTgA+lgsfy4XP2ebi8LFS8rceYNXm/azZsp/9h0pOLUtNiiE3\nK4XcLinkZqeSkhjTFCEHjI2VZIwxTSAxLppzcjM4JzeDyspKCg8cJ3/rAfK37GfttoPMWbWbOat2\nA5CRGkevrLZIVlukc0qLLxT1scJgjDH1cLlctE+No31qHBcOzKSispKCPUecQrH1AOu2Hzz17ASE\nfqGwwmCMMY3k9huq4xvnZFFeUcG2wiOs3XYA3XbwPwpFu+Q2SOe29OjcFunctsX3UVhhMMaYsxTh\ndp8aHXbcsOxqhWL99mLWF1S/9JQUH03PTsl079SWHp2S6ZyeQGREy3nYzgqDMcY0seqFAioqK9lZ\ndJR1BU5rYt32gyzSIhZpEQDRUW66dUiie6dkumcmk5OZTHybqKDFb4XBGGMCzO1y0Sk9gU7pCYwZ\n1InKykqKik+wsaCY9TuK2VBwEN12kLXbDp76TIe0OHI6JpOTmUROZjId28U326ixVhiMMaaZuVwu\n0tvGkt42lnP7tgfg2ImTbNx5iPUFxWzcUcymXYfYtXIXX63cBUBsTARdOyTRrWMy3Tok0a1jEknx\ngZmsyAqDMca0AHFtoujXLY1+3dIAqKioZMfeo2zc4RSKDTsPsWbLAdZsOXDqM2lJbejW0SkSvbuk\n0jk9oUliscJgjDEtkNvtmxP7goGZABw5fpLNuw6xeechNu06xKadh05NfeoC/nj3qCZpRVhhMMaY\nEJEQW71VUdVXsXnnIU6WVZAY1zQd1lYYjDEmRPn3VTSllnPjrDHGmBbBCoMxxphqrDAYY4ypJqB9\nDH4zuOUBJ4BJqrqpxjpxwAzgu6q6LpDxGGOMqV+gWwwTgBhVHQE8ADzpv1BEBgOfA90CHIcxxpgG\nCnRhGAVMB1DV+cCQGsujcYrH2gDHYYwxpoECXRiSgGK/12UicmqfqjpXVXcALXf8WWOMCTOBLgyH\ngET//alqRYD3aYwx5iwE+gG3OcB4YIqIDAdWnuX2XB5PYv1rhQnLhY/lwsdy4WO5ODOBLgzvApeI\nyBzv69tE5AYgXlWf91uvMsBxGGOMaSBXZaWdk40xxvjYA27GGGOqscJgjDGmGisMxhhjqrHCYIwx\nppqQmI+hIWMuhQMRGQb8RlUvFJEc4GWgAlilqj8ManDNREQigReBLjhPzj8GrCE8c+EGngME52e/\nEyghDHNRRUTSgUXAxUA5YZoLEVmM7+HizcDjNCIXodJiqHPMpXAgIj/DOQnEeN96EnhQVc8H3CLy\nzaAF17xuBvaq6mhgLPA3wjcXVwCVqjoK+CXOH3+45qLqS8PfgWPet8IyFyISA6CqY7z/3U4jcxEq\nhaG+MZfCwQbgKr/Xg1X1S++/p+F8QwoHb+GcBAEigDJgUDjmQlXfB77nfZkNHCBMc+H1B+D/gJ04\nw+yEay7ygHgR+VhEZnqvNDQqF6FSGOoccykcqOq7OCfBKv7jSx0Gkps3ouBQ1WOqelREEoHJwC8I\n01wAqGqFiLwM/AV4nTDNhYjcCuxR1U/w5cD/HBE2ucBpMf1eVb8B/AB4jUYeF6FycrUxl/6T/8+f\nCBwMViDNTUQ6A58Br6jqvwjjXACo6q1AT+B5wH/y33DKxW04oyzMwvnG/Crg8VseTrlYh1MMUNX1\nwD4gw295vbkIlcIwB7gMoInGXGoNlojIaO+/xwFf1rVyayEiGcDHwH+p6ivet5eGaS5uFpH/9r48\ngdPZukhEzve+Fza5UNXzVfVCVb0QWAbcAkwLx+MC+C7wBICIdMS54jKjMcdFSNyVRC1jLgUzmBbi\nfuA5EYkC8oEpQY6nuTwAtAV+KSIP4YyzdQ/w1zDMxTvASyLyOc7f8o9x5jZ5PgxzUZtw/Rt5Aee4\n+BKnNX0rTquhwceFjZVkjDGmmlC5lGSMMaaZWGEwxhhTjRUGY4wx1VhhMMYYU40VBmOMMdVYYTDG\nGFONFYYwICLni8hhEVkiIstEZLWIPBjsuPyJyJJGrp8tIpu9/35ERMbXse4dInLd2cbYWI3dr4gM\nFZHfBDimJBF5txHrN0nuGrtfE1xWGMLHQlUdpKoDgKHAnSLSK9hBVVHVQY38iAvn4TZU9WFVnVrH\nuiPwjUrbnBq7395AeoBiqZKKM2REQzVV7hq7XxNEofLks2laCTgD8hUDiMg1wH1AG5yxdiap6lci\nch/wbZyhFhao6g+8gxf+HjgfZ3TTl1X1z/4b9z56/whwEugMzPdu86SIPAaMAVKAvcBEVd0jIhWq\n6haRh4Hh3s/9TVX/7rfdgTjjAVUCK/zefwmYhfOE/Bv4xoV5FGdAsSuBC0VkF87Im38F4nFOwk+o\n6t+8+80EegBZwAuq+rh3COOncEb4LQV+rapvichQnKGMY70/x/dVdatfTBfV2O9ynCdSs7x5+YWq\nfuy3frI33ngReQBnOPEXvDF1BL5Q1e94c/s7nC91q3Ce+n4VyMEZd78TzjD1Baf5Pf0Z6Cgib6vq\nt/z2n9iA3N0IpHn39XNvHs9X1W3euH7lnStkAM7w13E4T9ze7N1vpoi8jXOszVbVrt59P4wzfPij\nIlKEM59CBs4XmPuBa70/78eqWjUEiAkgazGEj6HeS0nLgU04f5i7vJMgfQ+4XFUHAr8FfiYiEcB/\nA4NxhjmvEJEOwB04f8RDgGHABBEZWdv+gB+oai+ck+cPvZML9VTVc73vbwRu8q7v/wh+jKr29S8K\nXq8A93v3XdtETVcBm1V1KM5YOaNU9VPgA+Ah78ibk4D/UdVhOAXqcb/P98MZjng48N8ikoQzzES8\nN95LcIbiiMKZG+MGbyxP4hSsU2rZ71+BT1U1D7gGeFFEPH7rFwMPAR+o6v8ClwNLVXUkzgB5I7yF\nEZzidaGq3ub9zFpV7YdTjPt51znd7+nHwE7/otCI3IEzF0Yfbwut5rAJVa//CTyiqv2Bf3n3eTew\nw2+/pxtyIQ143NuCvBjf8TcI6CQiN57mc6YJWWEIH1WXkvJwvil3FZGfq2olMBEYKyKP4IyrkqCq\n5TiDFy4CHgaeUtVdOH+sV4rIUpyWQCa+k5G/L1R1g/ff/wDGqOpG4H7vdes/4JyAE2r57Pyab4hI\nGtBBVWd533q5ls99jXMCfBfnG/7/1LLOT4FY7+Bzj+G0HKrMUtVyVS3C+aabDIzGN1JlofcE3BPn\nW/MH3jz8BmdGubqMwWkBoKqbgXk4J+xaeUeNnSki9+AUlVR8uVJVPeL99yU4+UVVF+NrSTX091Sl\nIbmD6r8bV82F3t9Te1Wd5o3pGVX9eW3r1mGB389wDrAYWIJTJPo0YjvmDFlhCEOqegznsstIEYkH\nFuKc2D7HGdff5V3vKpzpIgGme0eqjMAZ2XSgt4VxLvBSLbvxnzvCjTOHxiBghnf7k4H3qP2EcbyW\n9yprrFtWcwVvIeqF8431PO/PVdNknEstq4GaHfAnatnfSf8VvK2eCGCjt9AOxDlhjaZuNX9ON3Vc\nyhWRu3EuGRXi/E7y/bbhn59yqv8dV63T0N8T0ODc1dy3/+8kyvv/k37vISIxItK1xjYqa8Qc5b9Q\nVUv8foY/+eV5GE4xNwFmhSF8+P+xRgAX4HwL6wmUq+rjONfpxwERItJORPKBlar6K+ATnG+cnwLf\nE5FIEUkAvqL2b76jRKSDt0/i2zizRp2P8638WZxRQC/F+eOvFl9tVHU/sFVExnnfuqnmOiLyQ+BR\nVX0b+CHg8V4OKsN3Er4I59LIv705qJpTvKaq977AucZdNZ/wbJxr+akiMsq7ziS8rYoa/Pf7mXc9\nRKQbTqfu3DrWvxh4xttycAED8OXK3wyca/+ISD+cb9SV3v3V9nvy38cpDcxdTUX4vsF/E0BVDwHb\nvH0s4PzuH/Fup6oAHATaikiatw9n7Gm2/xlwi4jEizNt5/vA1adZ1zQhKwzhY7C3j2EpsAY4itOf\nsBxYJiKK02Q/DGSr6l7gGZzx/RfiDHX9sve9dcBSnCb/C6r6RS3724XTKboK2I5zDf5NYICILANm\nevdd9W2yIcP83gL8SpyJzrvW8plXABGRFTgn8Ie9J6qZwIMiMhH4FTBHRBbhXIbZ7BeDv6ptPw0c\n8/bNzAB+pKqHcfoJnvD+LLfgjIFfk/9+fwyM8cb2DnC7qhbWWH8BMFxEHgf+6P1ZF+F0RM85TZyP\nAT28cfwK2I3zrf7v1P57KsQ5cX9aYzuvNiB3NfP9K+AvIjIfZ1rRKlW/pyXePN3vv1/vdv+Ac5ly\nBtUvT53ah7cf423v8hXAElV9tZYcmCZmw26bJue9Q+VhVR0T7FhaOxG5CdikqnPFmdlutqrmBDsu\nE9rsdlVjQtta4O/ey4NlOHeYGXNWrMVgjDGmGutjMMYYU40VBmOMMdVYYTDGGFONFQZjjDHVWGEw\nxhhTjRUGY4wx1fx/AJDGCAJqxLcAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1094adb50>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "%matplotlib inline\n",
    "import matplotlib.pyplot as plt\n",
    "import math\n",
    "import seaborn as sns\n",
    "\n",
    "target_length = 50\n",
    "beta = -2\n",
    "\n",
    "plt.plot([math.exp(beta * (bp_dist / float(target_length))) for bp_dist in range(target_length)])\n",
    "plt.xlabel(\"Base pair distance to target structure\")\n",
    "plt.ylabel(\"P(w, T)\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As you can see, it's a very simple function that evaluates to 1 (highest fitness) if the base pair distance is 0, and decreases as the structures get further and further away from the target. I didn't include the $N$ in the plotting as it will be a bit more annoying to compute, but it is simply a scaling factor so the shape and main idea won't be different.\n",
    "\n",
    "Now we can use this function to get a fitness value for each Cell in our population."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 25,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "(0.0063826223773313052, 10, 10)\n",
      "(0.0095217536982206783, 8, 8)\n",
      "(0.0077957525759672752, 9, 9)\n",
      "(0.011629896229528536, 7, 7)\n",
      "(0.0077957525759672752, 9, 9)\n",
      "(0.011629896229528536, 7, 7)\n",
      "(0.0063826223773313052, 10, 10)\n",
      "(0.0077957525759672752, 9, 9)\n",
      "(0.0063826223773313052, 10, 10)\n",
      "(0.0077957525759672752, 9, 9)\n"
     ]
    }
   ],
   "source": [
    "### 7\n",
    "\n",
    "def compute_fitness(population, target, beta=-2):\n",
    "    \"\"\"\n",
    "    Assigns a fitness and bp_distance value to each cell in the population.\n",
    "    \"\"\"\n",
    "    #store the fitness values of each cell\n",
    "    tot = []\n",
    "    #iterate through each cell\n",
    "    for cell in population:\n",
    "        \n",
    "        #calculate the bp_distance of each chromosome using the cell's structure\n",
    "        bp_distance_1 = bp_distance(cell.structure_1[-1], ss_to_bp(target))\n",
    "        bp_distance_2 = bp_distance(cell.structure_2[-1], ss_to_bp(target))\n",
    "        \n",
    "        #use the bp_distances and the above fitness equation to calculate the fitness of each chromosome\n",
    "        fitness_1 = math.exp((beta * bp_distance_1 / float(len(cell.sequence_1))))\n",
    "        fitness_2 =  math.exp((beta * bp_distance_2 / float(len(cell.sequence_2))))\n",
    "\n",
    "        #get the fitness of the whole cell by multiplying the fitnesses of each chromosome\n",
    "        cell.fitness = fitness_1 * fitness_2\n",
    "               \n",
    "        #store the bp_distance of each chromosome.\n",
    "        cell.bp_distance_1 = bp_distance_1\n",
    "        cell.bp_distance_2 = bp_distance_2\n",
    "    \n",
    "        \n",
    "        #add the cell's fitness value to the list of all fitness values (used for normalization later)\n",
    "        tot.append(cell.fitness)\n",
    "\n",
    "    #normalization factor is sum of all fitness values in population\n",
    "    norm = np.sum(tot)\n",
    "    #divide all fitness values by the normalization factor.\n",
    "    for cell in population:\n",
    "        cell.fitness = cell.fitness / norm\n",
    "\n",
    "    return None\n",
    "\n",
    "compute_fitness(pop, target)\n",
    "for cell in pop[:10]:\n",
    "    print(cell.fitness, cell.bp_distance_1, cell.bp_distance_2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Introducing diversity: Mutations\n",
    "\n",
    "Evolution would go nowhere without random mutations. While mutations are technically just random errors in the copying of genetic material, they are essential in the process of evolution. This is because they introduce novel diversity to populatons, which with a low frequency can be beneficial. And when a beneficial mutation arises (i.e. a mutation that increases fitness, or replication probability) it quickly takes over the population and the populatioin as a whole has a higher fitness.\n",
    "\n",
    "Implementing mutations in our model will be quite straightforward. Since mutations happen at the genotype/sequence level, we simply have to iterate through our strings of nucleotides (sequences) and randomly introduce changes."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 26,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "AAAAGGAGUGUGUAUGU\n",
      "('AAAAGGAGUgcccgUgu', True)\n"
     ]
    }
   ],
   "source": [
    "def mutate(sequence, mutation_rate=0.001):\n",
    "    \"\"\"Takes a sequence and mutates bases with probability mutation_rate\"\"\"\n",
    "    \n",
    "    #start an empty string to store the mutated sequence\n",
    "    new_sequence = \"\"\n",
    "    #boolean storing whether or not the sequence got mutated\n",
    "    mutated = False\n",
    "    #go through every bp in the sequence\n",
    "    for bp in sequence:\n",
    "        #generate a random number between 0 and 1\n",
    "        r = random.random()\n",
    "        #if r is below mutation rate, introduce a mutation\n",
    "        if r < mutation_rate:\n",
    "            #add a randomly sampled nucleotide to the new sequence\n",
    "            new_sequence = new_sequence + random.choice(\"aucg\")\n",
    "            mutated = True\n",
    "        else:\n",
    "            #if the mutation condition did not get met, copy the current bp to the new sequence\n",
    "            new_sequence = new_sequence + bp\n",
    "            \n",
    "    return (new_sequence, mutated)\n",
    "\n",
    "sequence_to_mutate = 'AAAAGGAGUGUGUAUGU'\n",
    "print(sequence_to_mutate)\n",
    "print(mutate(sequence_to_mutate, mutation_rate=0.5))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Selection\n",
    "\n",
    "The final process in this evolution model is selection. Once you have populations with a diverse range of fitnesses, we need to select the fittest individuals and let them replicate and contribute offspring to the next generation. In real populations this is just the process of reproduction. If you're fit enough you will be likely to reproduce more than another individual who is not as well suited to the environment.\n",
    "\n",
    "In order to represent this process in our model, we will use the fitness values that we assigned to each Cell earlier and use that to select replicating Cells. This is equivalent to sampling from a population with the sampling being weighted by the fitness of each Cell. Thankfully, `numpy.random.choice` comes to the rescue here. Once we have sampled enough Cells to build our next generation, we introduce mutations and compute the fitness values of the new generation."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 27,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "CUUGUUCUGGAUGUAUCCGU\n",
      "UCUAUUAACCAAGUAGAUAU\n",
      "CAUUCCACAGUCAAACCCUA\n",
      "AUCAGUCCCUGCAAGUAUAC\n",
      "GUUAACCUAGAGGUGCUGCC\n",
      "GUACCGAUACAUAGGAACCG\n",
      "CUUCCAUGAAGGAGCCAUGC\n",
      "AGGUUCAACACAUCCGGGCA\n",
      "AAUGGAAAGUGCUAUGAAGU\n",
      "CAUUCCACAGUCAAACCCUA\n"
     ]
    }
   ],
   "source": [
    "def selection(population, target, mutation_rate=0.001, beta=-2):\n",
    "    \"\"\"\n",
    "    Returns a new population with offspring of the input population\n",
    "    \"\"\"\n",
    "\n",
    "    #select the sequences that will be 'parents' and contribute to the next generation\n",
    "    parents = np.random.choice(population, len(population), p=[rna.fitness for rna in population], replace=True)\n",
    "\n",
    "    #build the next generation using the parents list\n",
    "    next_generation = []    \n",
    "    for i, p in enumerate(parents):\n",
    "        new_cell = Cell(p.sequence_1, p.structure_1, p.sequence_2, p.structure_2)\n",
    "        new_cell.id = i\n",
    "        new_cell.parent = p.id\n",
    "        \n",
    "        next_generation.append(new_cell)\n",
    "\n",
    "    #introduce mutations in next_generation sequeneces and re-fold when a mutation occurs\n",
    "    for rna in next_generation:      \n",
    "        mutated_sequence_1, mutated_1 = mutate(rna.sequence_1, mutation_rate=mutation_rate)\n",
    "        mutated_sequence_2, mutated_2 = mutate(rna.sequence_2, mutation_rate=mutation_rate)\n",
    "        \n",
    "        if mutated_1:\n",
    "            rna.sequence_1 = mutated_sequence_1\n",
    "            rna.structure_1 = nussinov(mutated_sequence_1)\n",
    "        if mutated_2:\n",
    "            rna.sequence_2 = mutated_sequence_2\n",
    "            rna.structure_2 = nussinov(mutated_sequence_2)\n",
    "        else:\n",
    "            continue\n",
    "\n",
    "    #update fitness values for the new generation\n",
    "    compute_fitness(next_generation, target, beta=beta)\n",
    "\n",
    "    return next_generation\n",
    "\n",
    "next_gen = selection(pop, target)\n",
    "for cell in next_gen[:10]:\n",
    "    print(cell.sequence_1)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Gathering information on our populations\n",
    "\n",
    "Here we simply store some statistics (in a dictionary) on the population at each generation such as the average base pair distance and the average fitness of the populations. No coding to do here, it's not a very interesting function but feel free to give it a look."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 28,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "def record_stats(pop, population_stats):\n",
    "    \"\"\"\n",
    "    Takes a population list and a dictionary and updates it with stats on the population.\n",
    "    \"\"\"\n",
    "    generation_bp_distance_1 = [rna.bp_distance_1 for rna in pop]\n",
    "    generation_bp_distance_2 = [rna.bp_distance_2 for rna in pop]\n",
    "\n",
    "    mean_bp_distance_1 = np.mean(generation_bp_distance_1)\n",
    "    mean_bp_distance_2 = np.mean(generation_bp_distance_2)\n",
    "    \n",
    "    mean_fitness = np.mean([rna.fitness for rna in pop])\n",
    "\n",
    "\n",
    "    population_stats.setdefault('mean_bp_distance_1', []).append(mean_bp_distance_1)\n",
    "    population_stats.setdefault('mean_bp_distance_2', []).append(mean_bp_distance_2)\n",
    "    \n",
    "    population_stats.setdefault('mean_fitness', []).append(mean_fitness)\n",
    "    \n",
    "    return None"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## And finally.... evolution\n",
    "\n",
    "We can put all the above parts together in a simple function that does the following:\n",
    "\n",
    "1. start a new population and compute its fitness\n",
    "2. repeat the following for the desired number of generations:\n",
    "    1. record statistics on population\n",
    "    2. perform selection+mutation\n",
    "    3. store new population\n",
    "\n",
    "And that's it! We have an evolutionary reactor!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 29,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": [
    "def evolve(target, generations=10, pop_size=100, mutation_rate=0.001, beta=-2):\n",
    "    \"\"\"\n",
    "    Takes target structure and sets up initial population, performs selection and iterates for desired generations.\n",
    "    \"\"\"\n",
    "    #store list of all populations throughotu generations [[cells from generation 1], [cells from gen. 2]...]\n",
    "    populations = []\n",
    "    #start a dictionary that will hold some stats on the populations.\n",
    "    population_stats = {}\n",
    "    \n",
    "    #get a starting population\n",
    "    initial_population = populate(target, pop_size=pop_size)\n",
    "    #compute fitness of initial population\n",
    "    compute_fitness(initial_population, target)\n",
    "\n",
    "    #set current_generation to initial population.\n",
    "    current_generation = initial_population\n",
    "\n",
    "    #iterate the selection process over the desired number of generations\n",
    "    for i in range(generations):\n",
    "\n",
    "        #let's get some stats on the structures in the populations   \n",
    "        record_stats(current_generation, population_stats)\n",
    "        \n",
    "        #add the current generation to our list of populations.\n",
    "        populations.append(current_generation)\n",
    "\n",
    "        #select the next generation\n",
    "        new_gen = selection(current_generation, target, mutation_rate=mutation_rate, beta=beta)\n",
    "        #set current generation to be the generation we just obtained.\n",
    "        current_generation = new_gen \n",
    "    \n",
    "    return (populations, population_stats)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Try a run of the `evolve()` function."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 30,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "pops, pops_stats = evolve(\"(((....)))\", generations=20, pop_size=1000, mutation_rate=0.005, beta=-2)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's see if it actually worked by plotting the average base pair distance as a function of generations for both genes in each cell. We should expect a gradual decrease as the populations get closer to the target structure."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 31,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYYAAAERCAYAAAB/4wAeAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3Xl4XGXZ+PHvmTX71qZ7aUuXp/teCvxKoayyCiJLFXwF\nEUFUkFdeAUVEQRERQUBRyiYislhAdoFCN0oXKEu3uyld6Zqm2SfJbOf3x5mUpDTJpMxkMsn9ua65\nMjPnzHPuPJnMPc85z2LZto1SSinVyJXqAJRSSnUumhiUUko1o4lBKaVUM5oYlFJKNaOJQSmlVDOa\nGJRSSjXjSfYBjDG9gBXAiSKyvsnzZwI3ASHgERGZk+xYlFJKtS2pLQZjjAd4AAgc5Pm7gBOB44DL\njTHFyYxFKaVUfJJ9KulO4C/AjgOeHwWUiEiViISARcDMJMeilFIqDklLDMaYbwN7ROQNwDpgcx5Q\n2eRxNZCfrFiUUkrFL5kthkuAk4wxbwMTgb/HrjcAVOEkh0a5QEUSY1FKKRUnqyPmSoolh+81XnyO\nXWNYDUzHuf7wLnCmiOxsrRzbtm3LOrDxoZRSqg3t+uBMeq+kGBvAGDMbyBaROcaYa4H/4gQ8p62k\nAGBZFqWl1cmNtBspLs7V+kwgrc/E0bpMrOLi3Hbt3yEthgSy9c2SOPrPl1han4mjdZlYxcW57Wox\n6AA3pZRSzWhiUEop1YwmBqWUUs1oYlBKKdWMJgallFLNaGJQSinVjCYGpVRa+s1vbmHZsvcSVt7N\nN9/Ihx9+wNKlS3jxxedb3G/BgncoK9ubsOO217333sULL8xN6jE0MSilVBPTpx/FmWee3eL2Z555\nktra2g6MyFFRUcFPfvIjFi9emPRjddTIZ6VUB3h63gaWr9uT0DKnjezF+ccPa3H7q6++xOLFC2ho\naKCsrIzzzruQhQvns2nTp1x11dWEQiGeeuqfuN1uxo+fyPe+dxWlpXu4887fEgqFKCvby3e/eyUz\nZhzL//zPbCZNmszWrZsIh6PcfvsfyMrKbvHYc+c+zRNP/J1oNML119+E2+3mppt+Ss+exezZs4fp\n04/i8su/3+Lr//3vp3n55Rfo0aMnFRXl+3+fLVs2c+mll3PTTT8lEAhQX1/P5Zd/n3A4REnJem69\n9Wb+/Oc5PPTQXxFZS2VlJcOGDeeGG37Bww//jZ07d1Bevo/du3fxox9dy7RpR7J48UIeffRBAEaM\nGMl1193IypXv8+CDf8HtdtO//wCuu+5G3G73QWOtqwvwne98j/feezeeP9uXoolBKfWlBQJ13HXX\nvbz11n95+ukn+etfH2Hlyvd56qkn2L79M+bMeRy/38+vf/0LVqxYBsDs2RczceJkVq36mIcf/hsz\nZhxLIFDLSSedynHHHcUPf3gNS5a8ywknnNTicceNm8A3v/k/LFmymD//+R5++MNr2bVrF3/845/J\nysri+9+/jJISYfhw84XXlpfv49ln/8Xjjz8NwGWXfWv/Nsuy2L79M6qqqvjDH+6lvHwf27Zt5aij\nZjBihOG6624kGGwgNzePu+66D9u2ufji89m71znF5PP5uPPOP7F8+VKeeuoJJk+ext13/545c/5O\nfn4B//zn4+zatYs77riNv/zlYQoKCpgz5wFeffVFzjjj4K2Vvn370bdvP5YsWXzIf6d4aWJQqgs5\n//hhrX67T5YRI5wP3pycXAYNGrz/fl1dHRUVFVx33dXYtk1dXR3bt3/G+PETeeyxh3jppRcACIfD\n+8saPnwEAL169SYYbGj1uBMmTAacBPGXv/wJsBg2bDg5OTkAjB49hq1btxw0MWzf/hmHHz4Uj8f5\nGBw1anSz7UOGHM5ZZ53DL395I+FwhPPOuwAA27axbRufz095+T5uueXnZGRkUldXt//3aDxe7969\nCQaDVFZWkJubS35+AQDf+MbFlJeXU1ZWxi9+cT0ADQ0NTJs2va2q7hCaGJRSX1rLsx5b9OrVmz/+\n8X7cbjevvvoSw4cb5sz5C2ed9TWmTz+KV155kVdffSmOsr5o7drVjB07jg8//IAhQ4YCNps3b6Kh\noQGPx8OaNas5/fSvHvS1AwYcxqZNGwkGg7jdbtavF0455bT92zdu3EAgEOCOO+6mrGwvV175HY46\nagYul4toNMp7773Lnj27uOWW31JRUcHChe8Qmy/0C79DYWERNTU1VFdXk5uby91338kpp5xKr169\n958uW7RoAVlZWXH/7smkiUEplTRer4cLLvgmP/jBd4lEovTt24/jjz+JWbNO5L77/sjjjz9CcXEv\nqqoa1+36/AM1ngSxevUnLFo0H8uyuOGGX2DbNh6Pl5tuup7y8jJmzTqRoUMP3oIqKCjgoou+zRVX\nXEJBQRGZmZnNtg8cOIiHH36Qt99+E9u2ueyyKwEYO3Y8t912M7fffhePPTaHH/zgcgD69evP3r2l\nB43bsiyuvfanXHfd1bjdboYPN4waNYarr76Wn/zkamw7SnZ2Dj//+a/a/J07YukBnV21G9MZLBNL\n6zNxDrUud+3ayS9/+TMeeODhJESVvto7u6q2GJRSnVY4HObHP77qC9+SDztsED/5yQ1xlbFo0QKe\neuqJ/WXYto1lWZx33oUcc8xxiQ75S9m9exe33nrzF2KdOHEyl156eYfFoS2Gbky/4SaW1mfiaF0m\nVpdej+G7//wt9aFgqsNQSqkuLa0SQ6V7K899nPzBHUop1Z2lVWKwbVhWujTVYSilVJeWVokhN9yf\noK+MZZvXpzoUpZTqspLaK8kY4wIeBAwQBa4QkTVNtl8DXAY0Tu7yPREpaam8U4Yfx783P8HLJfM5\nYvCIJEaulOrsfvObWzjxxFM44ogjE1LezTffyDnnfJ2Ghgb27Nnd4kR6Cxa8w5gxY+nRo2dCjhuv\nkhLh7rvvxO124/X6+PnPb6GwsDApx0p2i+FMwBaRGcBNwG8O2D4FuFhEjo/dWkwKAF+behRWMJtS\n61P2VFe2tqtSSh2Szjq76j33/IFrr/0pf/rTA8yceRz/+MejSTtWUlsMIvKCMebF2MPBQPkBu0wB\nbjDG9AVeFpHbWyvP63YzKnsSa0KLeOajeVw145zEB61UGpu74SVW7vkkoWVO6jWOrw07o8XtOrtq\nx8yu+qtf/Zaioh4ARCIR/H5/m3+7Q5X0AW4iEjXGPAqcDXz9gM1PAvcDVcDzxpjTROSV1so7b8Kx\n/HLpEtbWfkg4ehYe18ErUSnVcXR21eTPrtqYFD755CPmzn2G++//26H9seLQISOfReTbxphewDJj\nzCgRqYttukdEqgCMMS8Dk4BWE0OvvHyKo8PY6xVeXbOcM8cm5vyiUl3B14ad0eq3+2TR2VU7ZnbV\nt976L48//ih33nnP/rKSIdkXny8CBsROEdUDEZyL0Bhj8oBVxpiRQB1wPPBQW2UWF+cye+op3PuR\nsHDHEi6d1fK3CdW24uLcVIfQpXTH+szNzSA7209xcS75+ZlkZHgpLs6lrCwbn89Dv359+cc//o7b\n7ea5555j1KhR3H///Vx44fkcc8wxzJ07l+eee47i4lxcLmt/HWZl+cjLy2yxTjMyvGzbtoFZs47m\nk0+WM2rUSIqKsti6dTN5eT48Hg8lJeu46KLZBy1jwoRR/O53m8nP9+N2u9m4sYSCgixqajLIyvJR\nXr4TtzvKI488RGlpKbNnz+ass07F7/dSUJDJ2rUrqaws47777mHfvn2cfvrpFBVlkZ3t3x93dXU2\nXq+bESMGUVcXwO+3ycvL49Zbb+Wss86iX7++PPjgX8nJyWHevHlkZ2e3+Pu+8MILvPjiXJ588gny\n8vIS9wc8iGS3GOYCjxhj5seOdQ3wNWNMtojMMcbcALyDkzTeEpHX2iqwtLSakT0G4KvvRW3GThZ8\nvJpRfQ9L5u/QZem0A4nVXeuzurqeQCBIaWk1lZV11NeHKC2tZt++Wmzb4txzZ3PBBRfun1112rRj\nOProY7nttt+Qn19AcXEvysr2UVpaTTQKe/fW0K9fEXV1Iaqq6lqs0/r6EEuXruC11/67f3bVfftq\ncbk8XHHFVftnVy0q6tdCGV5mz/4W5577dQoKivB6/VRUBPb/Pjk5PVmwYDH/+c9L2LbNJZd8j9LS\naowZw//+70+4/fa72LRpMxdcMBuAPn36sX79ZgKBINXV9ZSWVlNeXksoFGHv3hquvvo6LrnkO/tn\nV+3bdwhXXXUNl1zynWazqx4s1mg0yq233kafPn24/PIr2j1/Unu/sKTtXEn/WrGAhVUv0Y/R/Oz4\nb6c2qjTVXT/IkkXrM3F0dtXE6jazq5494UgWvvUmO9xCdX0tuRkt91xQSqUnnV1VZ1eNR7PZVe98\n+xk22cuZknMclx5xWisvUwej33ATS+szcbQuE6tLz656oPPGzsKOWnxYvoKoHU11OEop1SWkdWIY\nVNyT/NAQIt4a5m/4KNXhKKVUl5DWiQHgpMEzAHhj06IUR6KUUl1D2ieG40aOwVVXSIV7G1v27Up1\nOEoplfbSPjG4LIuJhVOxLHh21bxUh6OUUmkv7RMDwHkTZ2CHfGxsWE19qPUh9EoppVrXJRJDXlYm\n/axR4A7x/OrFqQ5HKaXSWpdIDABnjz4O27ZYuuc90mxshlJKdSpdJjGMHdCfrPoBBD0VrPhsXarD\nUUqptNVlEgPAMf2PAuCl9fNTHIlSSqWvLpUYThs7Cepz2csm9tQcuFicUkqpeHSpxOD1uBmZNQks\nm2c/0a6rSil1KLpUYgA4b8JM7LCHNTUfEoqEUh2OUkqlnS6XGPoU5tEjMhzb3cDrsizV4SilVNrp\ncokB4PThx2LbMH/7u6kORSml0k6XTAzThw7BF+hDwF3Kmj2bUh2OUkqllS6ZGCzLYlrxEQA8v/bt\nFEejlFLppc2lPY0xPuA6wAA/AK4BbheRYJJj+1LOnngEi+e9xXbfeirrq8nPaN9i2Eop1V3Fs+bz\n/UApMBkIA8OAh4CL23qhMcYFPIiTVKLAFSKypsn2M4GbgBDwiIjMae8v0JLsDB+DvWPZ4lrK3FXz\nuWTqGYkqWimlurR4TiVNEZEbgZCIBID/ASbFWf6ZgC0iM3ASwG8aNxhjPMBdwInAccDlxpjidsTe\npnPHHYsdcbOyfAWRaCSRRSulVJcVT2KwY6eTGmem69nkfqtE5AXg8tjDwUDT4cijgBIRqRKRELAI\nmBlPufEa2qcnuQ1DiLgDLNz8YSKLVkqpLiuexHA38CbQxxhzN/A+8Md4DyAiUWPMo8A9wBNNNuUB\nlU0eVwP58ZYbrxMHOUt//nfTwkQXrZRSXVKb1xhE5HFjzPvALMANnC4in7TnICLybWNML2CZMWaU\niNQBVTjJoVEuUNFWWcXF7buIfMGx0/jPYy9Rmb2DCruc4b0Oa9fru7r21qdqndZn4mhdpk48vZLG\nAT8TkQuNMaOAvxpjvisiEsdrLwIGiMjtQD0QwbkIDbAWGGaMKQACOKeRft9WmaWl1W3t8gXj86fw\nYfh1Hl78EtfOaPOaebdRXJx7SPWpDk7rM3G0LhOrvUk2nlNJDwKPAojIWuDXOL2S4jEXmGSMmQ+8\nitPV9WvGmMtEJAxcC/wXWAzMEZGd7Yo+TudOOgq7IYNP69cQCAWScQillOoy4umumi0irzU+EJE3\njDF3xFN4rBfTBa1sfxl4OZ6yvoyi3Cz6MIrdrpW8uHYRF4w/OdmHVEqptBVPi2GPMeYKY0xO7HYZ\nsDvZgSXaWSNnYkddvLd7uS79qZRSrYgnMVwCnAHsBLYCpwOXJTOoZJgwuB/+QF+C7kqkbHOqw1FK\nqU4rnl5JW3ESQ1qzLIsJRRNYHtzOa7KEkT2HpDokpZTqlOLplXQKcCtQBFiNz4vI4UmMKylOHzuN\nZUvf4NPIWiLRCG6XO9UhKaVUpxPPxed7cXoPrSLOEc+dVXFBNnnBwVRnl7B02yqOHjQh1SEppVSn\nE09i2CsiLyU9kg5yZN8pvFFVwrxNSzUxKKXUQcSTGBYaY+4CXsMZpAaAiCxIWlRJdNKYcfz37RfZ\n6dtIIFRHljcz1SEppVSnEk9iOCL2s+mMqjZwfOLDSb7sTC+9Gc4e14fM+3QFZ4w8JtUhKaVUpxJP\nr6RZHRFIR5o15Aie2vkh727XxKCUUgeKp1fSDJwV3HJweiW5gUEiMji5oSXP0SMO56kNRVRm7WRv\nYB89s4pSHZJSSnUa8QxwmwM8j5NE7gdKgOeSGVSyedwuhmSMAgtelSWpDkcppTqVeBJDnYg8AryD\ns9DOd4FjkxlUR/iKmY4dtfiw7COdIkMppZqIJzHUG2OKAAGOFBEbyE5uWMk3ZmBvvLV9qXdV8Gn5\ntlSHo5RSnUY8ieEu4CngReBbxpjVwIqkRtUBLMtiTME4AF5d/26Ko1FKqc4jnsTwJnCyiFQDU4CL\ngJ8nNaoOcsaYadhhLyU1a4hEI6kORymlOoUWE4MxZqAx5jBgITAgdr8HzjrNr3ZQfEnVr2ce2fWH\nEXHV88GOtakORymlOoXWWgy3APOB4cCC2P35wOt0kcQAMK33ZADe3PheiiNRSqnOocVxDCJyKYAx\n5qci8ruOC6ljnTJ2PO/Mf5nPfJ9SH64nw5OR6pCUUiql4rnG8G9jzDeNMZYx5q/GmOWxQW9dQn62\nn57RoeCK8M6mD1IdjlJKpVw8ieFhIAh8FTA4U3DfmcygOtrMQc50UIu2LU9xJEoplXrxTKKXISLP\nGGPmAE+IyEJjjLetFxljPDhJZTDgA24TkRebbL8GZ4nQPbGnviciJe39BRLhmJHDmLupkPLs7eyr\nr6AooyAVYSilVKcQT4shYow5F2d5z5eMMWcD8fTtvAhnLYeZwKnAfQdsnwJcLCLHx24pSQoAfq+b\nw3wGLHh9vV6EVkp1b/EkhsuB04GrRGQncCHON/22PA3c1OQ4oQO2TwFuMMYsNMZcH2e8SXPycGeK\njPf3rEx1KEoplVKtjWPoE7tbCfwSWB4by/B/QEVbBYtIQERqjTG5wDPAzw7Y5UngCmAWMMMYc1r7\nw0+ciUP64a7tTZ2rnM0Vn6UyFKWUSqnWrjHMwTl9NB9nYR6ryTYbOLytwo0xA4G5wH0i8tQBm+8R\nkarYfi/jLAT0SltlFhfntrXLIZvQYxIrg6/y1uZlXH/SqKQdpzNJZn12R1qfiaN1mTpWsmYWNcb0\nBt7GOQX19gHb8oBVwEigDue000Mi8lobxdqlpdXJCBeATbsq+P3Hv8fr8vDHE27GZcVzpi19FRfn\nksz67G60PhNH6zKxiotzrbb3+lyrvZKMMSNxric0foCvAeaISDzTkd4AFAA3GWN+gdPKeBDIFpE5\nxpgbcKbyrgfeiiMpJN2QPgVkvDeAhrxNfLhLmNy3e7QalFKqqRZbDMaYU4HHcWZWXYXzwT4eOBc4\nX0Tmd1SQTSS1xQDwxOL3eLdhLoN8I/m/GZcm9Vippt/KEkvrM3G0LhMrkS2GXwGniMj7TZ80xjyK\nM8BtZrujSwNfGTuBRYtfZWt0Aw2RIH63L9UhKaVUh2rtJHrGgUkBQESW4az/3CX1yM+kMDwU2xVm\n4WadIkMp1f20lhgOHHfQbcwYOAWABTpFhlKqG2rtVFKuMeYYmndTbdRlWwwAx40yvPRGAWVZ26io\nr6QgIz/VISmlVIdpLTF8hnOd4WC2JyGWTiMrw0M/1wh2Wst449OlnDfm5FSHpJRSHaa19RhmdWQg\nnc2JQ4/g758tZ/mulZoYlFLdStcewfUlTB0+AKumF7VWGduqdqQ6HKWU6jCaGFrgcbsYkT0GgNfW\nL0lxNEop1XHaTAzGmNM7IpDO6Csjp2GHPayu+ISoHU11OEop1SHiaTHckfQoOqkRA4rw1Qwg5Aqw\nqnR9qsNRSqkOEc8Kbp8aYx4GluLMlwSAiPw9aVF1EpZlMaHHBFZENvPGhvcY32tkqkNSSqmki6fF\nUIYzluFInLUTZgHHJTGmTuXUcROINmSwKbCeYCSY6nCUUirp2mwxiMglHRFIZ9WnKIe8hiHU+Ney\n5LOPOHbQtFSHpJRSSdViYjDGvCQiZxhjNuHMrNqMiLS5UE9XcVS/qbxRs5Z3Ni/TxKCU6vJaazF8\nN/bzuA6Io1M7fqzh9bfy2ZO1lapgNXk+XVlKKdV1tXiNQUR2xu7uAibjTLN9LHA88J3kh9Z55GX5\n6M1wsGze+nRZqsNRSqmkiufi81zgR8BvgK8Avwa63dJmxw+Zhh21WLrzCzORK6VUlxJPYjA4rYTn\ncMY0HAH0T2ZQndGR5jCoLqaavWyv2ZXqcJRSKmniSQy7RcQG1gHjRWQH4E9uWJ2Pz+vm8MzRALy2\nfnGKo1FKqeSJJzGsNsbcC7wD/NgYcz3gTWpUndQpI6Zih3x8VL6SBh3ToJTqouIZ+XwlcLSIrDHG\n3AycAHyjrRcZYzzAw8BgwAfcJiIvNtl+JnATzkpxj4jInPaH37HGDCkm44PDaShax/wtyzj58Bmp\nDkkppRKu1RZD7MP7GiAMICL/EZGrRWRVHGVfBOwVkZnAqcB9Tcr1AHcBJ+J0h73cGFN8SL9BB3JZ\nFicNmYEdtXhj80Js+wvDO5RSKu21mBiMMb/G+fCeBjxrjLmynWU/jdMiaDxO0zWkRwElIlIlIiFg\nEU532E7v+PFDsSr7EaCcT0rXpTocpZRKuNZaDF8HJojIhcDRwGXtKVhEAiJSa4zJBZ4BftZkcx5Q\n2eRxNZAWCyv7vW6m9pgOwAsyL8XRKKVU4rV2jaFeRAIAIrIldvqnXYwxA3HGQdwnIk812VSFkxwa\n5QIV8ZRZXJz6UcffOXkGy559m105Wwj6aumf3yfVIR2yzlCfXYnWZ+JoXaZOax/2B55Aj7SnYGNM\nb+B14CoRefuAzWuBYcaYAiCAcxrp9/GUW1pa3Z4wkuZwz3g2M585i//D96fNTnU4h6S4OLfT1GdX\noPWZOFqXidXeJNtaYuhrjPlFS49F5FdtlH0DUADcFHudDTwIZIvIHGPMtcB/cab0ntNkCo608PVJ\nM7jjw6WssT8hEDqbLG9mqkNSSqmEaC0xPIDzod3S41aJyDU4PZpa2v4y8HK85XU2Q/rmU7TUUOH/\niNdKFvG10SelOiSllEqIFhODiNzSkYGkozNHzuTv21axcOcSvjryeNwud6pDUkqpLy2ekc+qBUeM\nGICv+jCCVg1Ld3yc6nCUUiohNDF8CS6Xxcz+RwPwSsk7qQ1GKaUSJO7EYIwpTGYg6eq0SWOgqphy\neycby7elOhyllPrS2kwMxpiJxph1wEfGmP7GmA3GmMkdEFtayPB5GJc3FYB/r3kzxdEopdSXF0+L\n4U/AOUCZiGzHmVTvgaRGlWbOnTydaF02m+uFyvqqVIejlFJfSjyJIUtE1jY+EJE36IbrMbSmuCCL\n/owFK8pzaw4cy6eUUuklnsSwzxgzgdhIaGPMN4F9SY0qDX19wkzssIcP9r1PKBpOdThKKXXI4kkM\nVwL3A2OMMZU4g9auSGpUaWjkgGJy6oYScdUzb+OyVIejlFKHrM3EICKfisgMoAgYCJwgIpL0yNLQ\nqUNnYtvw5hZdq0Eplb7i6ZV0hjHmdzjTYSwFNhpjrkp6ZGlo5uiheKr7EbDK+GRPSarDUUqpQxLP\nqaSbgUeAC4FlOEt1XpLEmNKW2+Vieq8jAXhhna7VoJRKT3ENcBORdcDpwH9EpAZnDWd1EGdPmoId\nyGNXeCO7a/emOhyllGq3eBLDbmPMvcBU4DVjzB+ArckNK31lZ3oZkTEJLHj2k7dSHY5SSrVbPIlh\nNrAcmCUitcBGnNNKqgXnTzoGO+hjbc3H1IfqUx2OUkq1SzyJIYizJvNRxphv4ay49n9JjSrN9euR\nR3FkFLYrxIvrFqU6HKWUapd4EsNc4EfAb4CvAL8GRiUzqK7g7NHHYkct3t31HlE7mupwlFIqbvEk\nBgMcDzwH3AEcAfRPZlBdwcTB/ckMDCLormLJ1k9SHY5SSsUtrovPImID64DxIrIDnSupTZZlcfxh\nMwB4ZcM7qQ1GKaXaIZ7EsDrWK+kd4MfGmOsBb1Kj6iJOGTcWq7YHFdZ2NpVvT3U4SikVl3jnSnpa\nRNYAvwD6At+I9wDGmOnGmC9MOWqMucYYs8oYMy92Gx531GnC43YxqXAaAM9+oms1KKXSg6etHUQk\nAiw0xgzCaSn8SUQ+jadwY8x1wMVAzUE2TwEuFpGV7Yg37Zw3+f/x/vz5bI6uo7qhllx/dqpDUkqp\nVrXYYjDGHGGMWWqMecEYcxLwMfBzYLkxJt4pMTbgLPJzMFOAG4wxC2Onp7qkvCw/gzzjwBXhmY91\nmgylVOfX2qmk+3C6qM4F/gMcKyKTgUnEOY5BRJ4DWlqc4Emc6btnATOMMafFG3S6OX/CLOyImw/L\nVxCJRlIdjlJKtaq1U0l+EXkBwBjzMxH5EEBEthhjEjGc9x4RqYqV/zJOwnmlrRcVF+cm4NAdq7g4\nlx4fDGefbx2Lt3/EuZOPTXVI+6VjfXZmWp+Jo3WZOq0lhqZfbQ+8RtDexQaspg+MMXnAKmPMSKAO\nZ5zEQ/EUVFpa3c5Ddw6nHj6TJz5bx4vr3mLmwMmpDgdw/vHStT47I63PxNG6TKz2JtnWEkOP2BQY\nVpP7xB4XtTOuxmVBZwPZIjLHGHMDThfYeuAtEXmtnWWmlaOGD+Xp9X0IZO3i4x0bGN9vWKpDUkqp\ng7JaWmnMGPNIay8UkVSsyWCn87eIZ1Ys4Z2q5+jFMG4+/vJUh6PfyhJM6zNxtC4Tq7g412p7r8+1\n2GJI0Qd/l/bVCdN454032OP/lF3VZfTJ7ZHqkJRS6gviWqhHJYbP62Fs9jSwbB5Y/kyqw1FKqYPS\nxNDBvn3kibjqiihlI6+vW57qcJRS6gs0MXSwTL+Xb448Fztq8eKWl6gM1KY6JKWUaqbNKTGMMacA\ntwGFOD2SLMAWkcOTHFuXdeTQ4SzYMoktrg/407vPcNOJ3051SEoptV88LYZ7gV8CJ+CMUj4u9lN9\nCT+ccQ6uYC47rTXMW6frNSilOo82WwzAXhF5KemRdDOZPj/nDz+Hf235O3M3Pc+0QcPJzcxIdVhK\nKRVXYlh7vWqgAAAZLklEQVRojLkLeA1nMBoAIrIgaVF1E8cMHcvCraPZ7l/DvQuf48aTZ6c6JKWU\niutU0hE48xjdANwSu/0yiTF1Kz88+nxc4Qw+c33IgnXrUx2OUkrFtR6DXk9Iolx/Fl8dcibPbXuG\np0ueY9Kga8jN1JVTlVKpE0+vpBnAdUAOTo8kNzBIRAYnN7Tu48Th03h3+wp2Z2/i/nde4fpTW1rC\nQimlki+eU0lzgOdxksj9QAnwXDKD6o6umn4hVtTLVvdyFq7ZlOpwlFLdWDyJoU5EHsGZCbUc+C7Q\neRYU6CJ6ZBZyysCTsDxhnpLnqQoEUx2SUqqbiicx1BtjigABjhQRG9CFi5Pg9BEzKXL1xc7fyZ/f\nepOWZr5VSqlkiicx3AU8BbwIfMsYsxpYkdSouimX5eKKKbPBdrHVu4RFq7elOiSlVDfUZmIQkWeA\nk0WkGpgCXARcnOzAuqv+uX04tu8xWL4G/rXmRSpqGlIdklKqm2kzMRhjCoG/GWPmARnAD4H8ZAfW\nnZ0z8hRyXYXYPbbwwBsL9ZSSUqpDxXMq6UFgOdADqAZ2Av9IZlDdndfl4bIJF2JZsMX7Lgs+3p7q\nkJRS3Ug8iWGIiPwNiIpIUER+BgxIclzd3rDCIUwrnoYrq4anV7/Gvqr6tl+klFIJEE9iCBtj8gEb\nwBgzHIgmNSoFwAWjziDTysbuVcIDr7+np5SUUh0insRwM84YhkHGmOeBRcDP4z2AMWa6Mebtgzx/\npjFmmTFmsTHmsnjL604yPZlcNOZcLJfNVt8S3v7gs1SHpJTqBuLplfQacBLwLeBhYLyIvBxP4caY\n63CuUfgPeN6D0w32RJz1HS43xhS3K/JuYmKvsYwuHI07t5xnPnmbPRV1qQ5JKdXFtZgYjDHfarwB\np+FcfC4ATok9F48NwMEm/hkFlIhIlYiEcFohM9sXevfxzdHn4LX8WP3W8eAr7xPVU0pKqSRqrcXw\nKHAHcDKfr9rWeDsunsJF5DkgfJBNeUBlk8fVaBfYFhX48zl3+GlYnjDbfEt5c7kOfFNKJU9rs6tO\nBi7AOY30EfAv4E0RScSF5yqc5NAoF6iI54XFxbkJOHz6Obvnibxf+hElbGTuR+9y7LTDGNDry9dF\nd63PZNH6TByty9Sx4unpYoyZipMkZuFMh/EvEXknngMYYwbF9j+qyXMeYDUwHQgA7wJnisjONoqz\nS0ur4zlsl7Srdg+3Lf0jkaCHXrtP5acXHkGmP55F+A6uuDiX7lyfiab1mThal4lVXJxrtWf/eHol\nISIrROQ64MfAOKC9a0A3dnWdbYy5TETCwLXAf4HFwJw4kkK31ye7F6cOOR7L18BO3/v8/smVOgur\nUirhWm0xGGMsnIvC5wGnAh8CzwAvikhth0TYXLduMQCEo2F+u+xudgX2ENpxOEW14/nJBZPoWZDZ\n7rL0W1liaX0mjtZlYiWsxWCM+QuwEbgap9fQeBE5V0T+laKkoACPy8OVEy6hOLMn3n4bKS9cxq3/\nWM62PTWpDk0p1UW02GIwxkSBMqDxE6fZjiJyeHJDO6hu32JoVB2s4a8fP8qmqq1EKnvg3jqVq782\nhREDC+IuQ7+VJZbWZ+JoXSZWe1sMrV25HPIlY1FJlOvL4UeTLueR1U/yMauJDn2XP8wNcsWpU5k0\nQscKKqUOXVy9kjoRbTEcIGpHeWb9CyzYvgQ7mEFw/RS+dew0Zk7o1+Zr9VtZYml9Jo7WZWIlpVeS\n6rxclovzR5zN2UNPw/LV4x+1lL8vWszLSzbrpHtKqUOiiaELsCyLkwYdx7dHz8blieIfuYLnP1nE\nk2+V6PQZSql208TQhUzrM4kfTLgMv8eHb9jHvPPZQv724mrCEZ0lXSkVP00MXYwpGsb/Tvk+eb48\nvIcJK2vf4e5nP6Q+eLApq5RS6os0MXRB/XP68n9Tf0CfrN54em9lg3sed/xrhY6SVkrFRRNDF1WY\nUcBPpn6f4QWH4y7aw478edz2zyXsrdT1HJRSrdPE0IVlejL5wcTLmNZ7Eu7cCqr6vc1t/1rAZ6U6\nSlop1TJNDF2cx+XhW6Mv4ORBs3BlBGgYvJDf/nse67fFNcu5UqobOvQ5m1XacFkuvjr0VAr9+Ty9\n/gWiQ5dw16v1hOyTGTUwH5fVrrEvSqkuThNDNzJzwNHk+/N5eNUThIa+zz1vV9InOppzZoxg4rCe\nWJoglFLolBjd0qbKLfz5o0cIhAPYYQ/hPQPpa4/h3KPHMO7wIk0Qh0incUgcrcvEau+UGJoYuqma\nUC0flH/Ai+vmEQjXYkctImX96Bsdy3lHTWL0oEJNEO2kH2aJo3WZWJoYVNyKi3PZsWsfS3e9z+ub\n5rMvWAZApKKYPpGxXHjEdEYOKkpxlOlDP8wSR+sysTQxqLg1/eeL2lE+2buGlzbMY0fdZ85zNXn0\nDo/jG0fMZMSAwlSGmhb0wyxxtC4TSxODiltL/3wbKzfzgrzFhmoBC6L1mfQKj+YbU07A9O+ZgkjT\ng36YJY7WZWJ1qsQQWzP6z8AEoB64TEQ2Ntl+DXAZsCf21PdEpKSVIjUxJFBb/3y7A6XMXfMmqyo/\nAiuKHfbSM2SYPfFkRvXv04GRpgf9MEscrcvESuQKbolwNuAXkaONMdOBu2LPNZoCXCwiK5MchzoE\nvbOKuXLqbKqDZ/Lv1W+xomw5ZZmruHftGgo/Hsr5405mwoBBqQ5TKZVgyU4MM4DXAERkqTFm6gHb\npwA3GGP6Ai+LyO1JjkcdglxfDt+e9FUuDH+F51bPZ8nuJVT4S/irlJD5cV8mFEzmK6Om0qswO9Wh\nKqUSINmJIQ+obPI4bIxxiUjjAgFPAvcDVcDzxpjTROSVJMekDlGGx8/sCSdzfvQE/rNqCQt2LKY+\nYydL619myXtvkRM4nGm9pnK0GUz/4mzt7qpUmkp2YqgCcps8bpoUAO4RkSoAY8zLwCRAE0Mn53a5\nOWf8DM4ZP4O1uzfzyoaFbIquJVC4hneCa5m3oBc5gWFMGzCaKSN6cXj/PJ12Q6k0kuyLz18DzhCR\nS40xRwI3icjpsW15wCpgJFAHPA08JCKvtVJkWnWh6k7qQvW8tWEJL697h7Kg05cgWp9FZM9AcuqH\ncNSowRw5ri/jhvbE69G5G5XqYJ2yV9L42FOX4FxXyBaROcaYbwJX4/RYektEbmmjSO2VlEDJ6Plh\n2zabq7Yy/7MlfLDnYyJ2GKIuwvv6ENkzEH+oJxOG9WTy8GLGHd4Dv8+d0OOnkvakSRyty8TqVN1V\nk0ATQwIl+5+vNhRg6a73WfjZe+ypKwXAqs+lYdcAImX98Fp+xgwuYsyQIkYPLqRPUVZaX5fQD7PE\n0bpMLE0MKm4d9c9n2zYlFRtZtP09PixdRcSO4MKDp2oAVdv6YtfmARZFeX5GD3KSxKjBReRn+5Ie\nWyLph1niaF0mVmcbx6AUlmUxonAoIwqHUhWs5r0dK1i04z3K2EzGmM34rUwygr2p2p3PYqlg0SeZ\nAAwozmH04EJGDy7CDCzoUqedlOrMtMXQjaXyW1nUjrJ2XwnLd61kfXkJlcHP48iy8nAHelGxM5dg\nRSGEfbhdFsP65+9PFIP75uJ2da6L2PotN3G0LhNLTyWpuHWWfz7bttkV2IPs28C68hJKyjdSH6nf\nvz2HnkSriqjYmUukuhCiHjL9HkYeVsDowUUMH5BPr8JMMnypbQB3lvrsCrQuE0tPJam0Y1kWfbN7\n0ze7N8cN/H9EohG2Vm9HykuQfRvYWLmZcN5efHngwkV2tBcN+wr5aGceKzfkg+20HPKyvBQXZFJc\nkEnPgkyKCzLoFXtckOvXsRRKxUlbDN1YunwrC0aCfFq5Gdm3ASkvYVv1DuzYkBYPPjKiBYQjNqFQ\nlFDYxnlLx5KA7fy0LAufx43P48bvdeP3esjwNf700DOrkEG5AxmUN4AeGYe2il261Gc60LpMLG0x\nqC7H5/YxqmgEo4pGAE432JLyT1lX7iSKvXV7sV02ttemtasO4dgtABDBGVZZ98X9/K5MBmT3Y1jR\nIAbnDWRQ3kDy/XmJ/rWU6rQ0Mai0k+3NYmKvcUzsNe4L22zbxsb+/Gez56IE6sPsraqjtCLA3qo6\n9lbWs7cywI6aPdS5yrCyK4lmV/Jp9FM+rf50f7mZrhz6Z/VnRI9BHF5wGIflDSDbm9WBv7VSHUcT\ng+pSLMvCwmpxAoCMHCjKyWFEvy9uq6oNsm1PDVv3VLNp9162VH9GRWQPVnYlgexKNkSFDTUCW5z9\ns6w8+mX1Z0SPwYzoMYhIRl/qQzaZngxcVufqMaVUe+g1hm5Mz+O2LRiKsH1vLdv21FCyexdbqrax\nN7iLaGYFruwqLE/oiy+ywWv58bsyyPRkkePLIs+fTX5GNtneLLK8WWR5Mp37niyyvZlkebPI9mTh\ndulYDdD3ZqJpd1UVN/3nOzRR22ZvRR1bdlWzfs8ONlVuY2/DbhrsALY7BO4Qlse54QlhuaJtFxqT\n7cmmICOPAn8+Bf488n3O/Xx/Hvmx57K9WV2+RaLvzcTSxKDipv98idWjRw6btu2jsiZIRU1D7BZk\nX00t+2prqKirpqqhltpQANvVmDiCTZJIEMvbgOVrwHJHWjyOCxdZnhzyvXkUZOTRI6uAwox88n15\nFGf1ZGBOP7xubwf+5omn783E0l5JSqWIy2WRl+UjL8vHwF45Le4XtW1q6kKfJ5DqBipqg1TWNFAd\nCFFV2UB1XR3V4SoCkVrw1jvJwleP5W0g6qunyttAtXc72+s+g/Lm5Vu2i2y7B0WevvTN6M+g3MPo\nk1tEXraPvGwfWX5PWk9WmC7CkSjBUJQMnxuXK73qWxODUh3MZcWXQMBJIrV1IaoDIaoDwWY/KwMN\nVNRWU9lQRXW4mkCkmqCnEld2BdVZe6mJlrI18DFLAxDdmkG0poBoTQFWoJBsuwf5WRnkZvvIy/I6\nSSPLR26Wj5xML1kZHrIzPGRleMnO8ODzdu1rH5FohMpgFaWBcnZU7WVPTRlldRVEoxZeOwO3nYEr\n4oeID8I+okEf4ZCbYDBKfTBMQyhCfTBCQyhCQ9C5H4k6Z2MscOoz00tO7JZ9wOOcTK/zOMNLdqaH\nnEwvfq87ZQlcE4NSnZjLssiNfWBD22tqR6M2NfUh9lXXsqF8K1uqt7Kj7jPK2EXIvwt67AIgGHWx\nJ5DPjup8ojuchEEoo8VyPW5XLFF4yM74YuJo/Jmd4SXT78a2IRK1iUSjRCI2kahNuMn9SCRKOGoT\nDkdpiNZRG6mhNlJNwK6iLlqD7QnhjnrwuzPwuzPI9GSQ5ckgy5tJjjeTbH8WOf5M8vxZZHi9+Lwu\nfF43Po+r2YdpOBKlOhBiX00tO6vK2F1bRlldORXBCmrCVQSi1QStGiLuOrDiPK1uAX6wvRb4fNhh\nH1bYhyuagdv24yeDXDLxW84t1OCmvi5KbW2Qssr6/QmjLR63RXaml4HFOVx93vgOnRtME4NSXUjT\n01mDexcCEwBnLEdZ/T42Vm5hU+y23b0LK+fz81A57jyK3H3w2TlEwx4iYTeRoItQ0EWwwUVDvUVV\nncXuUoiG3RB10+bCYFbUOQXmq4v9rMfyH3D/wOspFs4ARPh8VGJDy4ewI26IeLDDXuyIB1fUi8v2\nYhMl6g04x/YepPeYOzabSigDV7AAbzSHTCuHbHce+V7nuo3P58J2NRB1NxC26ghRT9Cupz4aoC7i\n3GpCNdRHqrGbhHuQcZMAZLs8ZLoz8bsz8FkZePDhtv1YUS9EvERDHiIhD6EGN8F6F3V1QWqDbqJR\nG3cH9jfQxKBUN2BZFj0ze9AzswdH9JkMQEMkyJaqbU6iqNrCxsotbA2u//xFbiAzdmvC31gmFj6X\nD6/lw2P5cON1PuBsNyEC1Ns1NDjjzA/KZ2WQ4ykix5NHnjefPG8e+b4CCnz59C4sYmdZOYFQHTXB\nOurCddSF6qmL1NMQqScYbXBudgNhgoTdQSKeIFGrFix7/xrAbtuN184mM1pMjscpv0dmIb2yiuiT\n24P++T3Jzfry82iFomFqQ7VUB2uoCdZSHaqhJlhDdaiWQLiOulAdgXAdgVAdgXCAQLiWvaG92Aeu\nVuyKVbAfiA22j7oziFpTYn+QjqGJQaluyu/27V8nA5xWxd66fVQFq6mPNFAfrqc+Uk9DuIG62OOG\nSAP14QbnAzrc0GS/OqrC5URtp2uu23JTmJHPYRl9KMwooMhfQGFGAYUZhRRlFFDozyfD0/Kpq0Pt\nlWTbNg2RIHXhOtwuN7nenA45T+91eWJdjPPjfo1t29RHGj5PFo3Jo9n9OnK92fhcHdvLTBODUgpw\nWhXFWT0ozupxSK+3bZtwNEwwGkrZ6G/Lssjw+Mnw+NveOcUsyyLT41w/6UFhqsNpRhODUiohLMvC\n6/am/RgKleTEYIyxgD/jXAGrBy4TkY1Ntp8J3ASEgEdEZE4y41FKKdW2ZLf1zgb8InI0cANwV+MG\nY4wn9vhE4DjgcmNMcZLjUUop1YZkJ4YZwGsAIrIUmNpk2yigRESqRCQELAJmJjkepZRSbUh2YsgD\nKps8DhtjXC1sqwbiv6SvlFIqKZKdGKqA3KbHE5Fok21Nl8XKBSqSHI9SSqk2JLtX0mLgDOBZY8yR\nwCdNtq0FhhljCnBWW5wJ/L6N8qzi4tw2dlHtofWZWFqfiaN1mTpJnXa7Sa+k8bGnLgGmANkiMscY\nczpwM84g+IdE5IGkBaOUUiou6bYeg1JKqSTr2stAKaWUajdNDEoppZrRxKCUUqoZTQxKKaWaSYtJ\n9Nqac0m1nzHmfT4fYLhJRL6TynjSkTFmOnC7iMwyxgwFHgWiwCoRuSqlwaWhA+pzIvAS0LhAxF9E\n5JnURZc+YtMNPQwMBnzAbcAa2vH+TJcWQ4tzLqn2M8b4AUTk+NhNk0I7GWOuAx7k83Vr7gJuFJFj\nAZcx5qspCy4NHaQ+pwB/aPIe1aQQv4uAvSIyE/gKcB/tfH+mS2Jobc4l1X4TgGxjzOvGmDdj39RU\n+2wAzmnyeIqILIzdfxVnckgVvy/UJ3C6MWa+MWaOMabtBa9Vo6dxZq0GZ9m3MDC5Pe/PdEkMrc25\npNovAPxeRE4BrgSe0PpsHxF5DucfrlHTZcJ03q92Okh9LgWui33D3Qj8MhVxpSMRCYhIrTEmF3gG\n+BntfH+my4dBa3MuqfZbDzwBICIlQBnQN6URpb+m70ed9+vLe15EVsbuPwdMTGUw6cYYMxCYBzwm\nIv+ine/PdEkMi4HTAA4y55Jqv0uBPwAYY/rhvFF2pjSi9PeBMaZx2vhTgYWt7aza9LoxpvGU8QnA\n+6kMJp0YY3oDrwP/JyKPxZ5e2Z73Z1r0SsL5xnCSMWZx7PElqQymC3gIeMQYsxDnm8Sl2gL70n4C\nPGiM8eJMEPlsiuNJd1cC9xpjgsAu4PIUx5NObgAKgJuMMb8AbOBqnPqM6/2pcyUppZRqJl1OJSml\nlOogmhiUUko1o4lBKaVUM5oYlFJKNaOJQSmlVDOaGJRSSjWTLuMYlGoXY4wbuB74Js5YDTfwdxH5\nbQpiGQz8XEQuM8ZMAb4nItovX3Va2mJQXdVfcCZbnC4iY4FpwAnGmCtTEMtg4HAAEXlfk4Lq7HSA\nm+pyjDH9AQH6iUhVk+dHAGNwplj5KzAApzVxg4jMM8bcDPQHhgOHAQ+JyG9iEwz+HjgWp+XxqIjc\nY4w5FrgD5wvWKpzJyh7CmaCsL/CkiNxojPkIGAI8hjPi9JexNQdGxOIoAmqAH4nI+8aYR3AmjZwS\ni+cWEXnMGHMC8LtYzOXAbBHZl4w6VN2bthhUV3QEsKZpUgAQkfWxWTzvwfnQnwZ8Ffhbk2mdx+FM\nSXwkcL0xJg/4LmCLyFRgOnC2Meb/xfYfDswSkUuA2cA/Y+uGTACuMsYUAT8CVojID2Ovafw29jhw\nt4hMAK4F/h2bsgBggIgcA5xFbF4rnMTzPRE5AngRmPwl60mpg9JrDKqr2t8UNsacC/wc54tQA863\nd2OM+XVsFzcwNHb/bRGJAKXGmDKcb/8nAhNi39gBsnESyFpARKQG584fjDHHGWP+FxgLeGP7fkEs\nEQ0TkRdir10aO56J7fLf2POrjDGFsef+AzxvjHkeeEFE3jzEulGqVdpiUF3R+8BoY0wOgIj8W0Qm\n4Xz7LsZ53x8vIpNizx+NcyoInKVjG9k489i7cWaqbNz/KOCR2D51jTsbY/4A/BDYBNyKM51503nw\nm3IdZJuLz7+s1R+wDRG5G+d0VglwhzHmhtYqQalDpYlBdTkishXnNM1jxph8gNh1gjNxFoOZB1wV\ne3408DGQeZCiGj+45wGXG2M8sWSzCOeU0oFOxFkAaS7ONYp+fL6CVrPWuYhUAxuMMWfH4jgS6M3n\nCeoLjDHvAXki8ifgj+ipJJUkmhhUlyQi38e5yPy2MeYDnDU8JuHMRf8j4MjYReEngW+KSO1Bimk8\nHfUAzuJGK4FlONcnFhxk/98C/zDGLAf+F1iBc9pqLVBgjHnsgP0vBq42xnwM/Ak4R0TCTY57oBuB\nR40xK3Cue9zcRjUodUi0V5JSSqlmtMWglFKqGU0MSimlmtHEoJRSqhlNDEoppZrRxKCUUqoZTQxK\nKaWa0cSglFKqGU0MSimlmvn/1bjhAUtqOQoAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x109744610>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "def evo_plot(pops_stats):\n",
    "    \"\"\"\n",
    "    Plot base pair distance for each chromosome over generations.\n",
    "    \"\"\"\n",
    "    for m in ['mean_bp_distance_1', 'mean_bp_distance_2']:\n",
    "        plt.plot(pops_stats[m], label=m)\n",
    "    plt.legend()\n",
    "    plt.xlabel(\"Generations\")\n",
    "    plt.ylabel(\"Mean Base Pair Distance\")\n",
    "    \n",
    "evo_plot(pops_stats)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "You should see a nice drop in base pair distance! Another way of visualizing this is by plotting a histogram of the base pair distance of all Cells in the initial population versus the final population."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 32,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWwAAAERCAYAAABfI52mAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3Xl8VNX9//HXnclM1kkgyZCwCgE5CiKKC1WrVi1SWreq\ntfVbtdZq1WoXv9WqVWvtYjertsVq1eLSr61L3bVU8acobrixKhwISyBA9m2Syaz3/v6YSUgwy2TP\nvX6effRBMnPv3M+9yHvOPffccw3LshBCCDH6uUa6ACGEEKmRwBZCCJuQwBZCCJuQwBZCCJuQwBZC\nCJuQwBZCCJtI620BpdS3gAsBC8gE5gLFWuumoS1NCCFER0ZfxmErpRYDq7TWfx+6koQQQnQl5S4R\npdThwCwJayGEGBl96cO+HrhlqAoRQgjRs5QCWymVB8zUWr8+xPUIIYToRq8XHZOOA/5fKgtalmUZ\nhtH/ioQQ4rOp1+BMNbAVsDWlLRoG1dWBFD929PH7fbat3861g9Q/0qT+keX3+3pdJqXA1lrfNuBq\nhBBCDIjcOCOEEDYhgS2EEDYhgS2EEDYhgS2EEDYhgS2EEDaR6rC+z4Sa+loq63fSUN/S6XXDMJg5\nTY1QVUKkzrIsAoH+zcvm9Zo0NX16WJzPl4vcWzE6SGB3UF5djlFsEUgPdXo9UN3ETCSwxegXCDSx\nbGUpmVnZfV43J7uO5pZwp9dagy0smD+D3Ny8btdbufIdqqoqOfXUM7p8f+nSF8jNzeOYY47lyScf\n56yzzul1nSVL7qWgoJDTTz+zz/vRV6tWfcgzzzzJLbfc2uX7kUiEl1/+D6ecckanfRkJEthCOExm\nVjZZ2b3fhLGv7JwMTEK9L7iP+fOP6vH9RYtOaf/54Yf/zllnndPrOsOtpzOI2toann/+WU455YxO\n+zISJLCFEAOydOkLlJVt54wzzuLnP7+BoqIiysvLmTXrIH7842tZsuRe8vMLaGpqpKmpidtv/x0H\nHjibsrLtXHbZlfztb3eh9QYaGxuZMWN/rr/+Z11uZ8mSeykr205DQz2BQICrrrqGOXPm8vLLS3ni\niX+RnZ1FUdEErrnmpyxb9l/eeGM5wWCQpqYGLrzwEo4//gS+9rXT+Oc/n8Tj8XDPPYvZb7+pFBeP\nb9/Gk08+zhtvvEYoFCIvbwy33voHHn74AcrKtvHgg/djmmZ7y3/x4jtZu3Y1hmGwYMFCzj77G9x6\n6y14PB727NlDXV0tN9xwM/vvP3hn53LRUQgxYG0t1PLyHVx//c3cd99DvPvuW9TX17W/f8EFF5Gb\nm8f//u+17a8Fg0F8vlxuv30x99//MB9/vI6ampput5OZmcmf/nQ3N930C/74x9/R1NTIkiX38pe/\n3MsjjzxCTo6PZ599CoBwOMSf/vRXbr99MYsX30E8Hqe36Tqamhr505/u5m9/e4BYLMbGjZ/wrW9d\nxNSpJVx44cXty7399ptUVOzm3nsf5K677mPZspfYurUUgOLiCdx++18466xzePbZp/t9TLsiLWwh\nxKCZOHEyGRkZABQUFBIOR3pc3uv1Ul9fxy233EhGRiatra3EYrFul5837wgApk0roa6ult27dzNt\n2vT2bc6deyjvv7+SWbNmc8gh8wAYOzYfn89HQ0M9iQdnJXT18Ja0NA833/xTMjMzqamp6raW7du3\ncfDBhybXSWPWrIPYtm0bADNnJlrU48YVsW7dmh73v6+khS2EGBJdP82q82vvvvs2VVUV3Hzzr7j0\n0isIh8OfWqYjrTcAsHVrKX7/OCZMmMD27VsJhxN976tXf8jkyVMA2LgxsWxdXS0tLS3k5xeQnp5O\nbW0NlmWxefOmTp+9ZUspK1Ys55ZbbuWqq67BNE0sy8IwDEzT7LTstGnTWLt2FQCxWIz169cwZUpi\nu0M5okZa2EI4TGuwpfeFuuAiQrCLUSJ90TGsugquqVNL+OUvf8bhhx8JwOzZB/HQQ/dz5ZXfBWDC\nhInU1FR3G3qbN2t++MPvEQ6HuO66G8nNzeM737mUK6+8lIwML+PGjefyy3/AK6+8RF1dLT/84fcI\nBpu5+urrMAyDc889n6uv/gHjx08gNze302dPmjSZzMwsvve9i7Esi4ICPzU11cyePYdYLMo99ywm\nPT0dgKOO+jwfffQhl112EbFYjBNPXDCofdXd6dMzHVNk2XWKw9Wb1iSG9QU+Paxv0SEnj1BVqXPC\n9JJS/8AMZBx2YaGPmprROw67t6F+HY//0qUvsGNHGZdeesVwljggfr9v0ObDFkLYgGEYPY6Z7kle\nno9IZPT2ko6GL42RJoEthLCFb3/7kpSXHenx0kNl9H6dCiGE6EQCWwghbEICWwghbEL6sIVwEJmt\nz9kksIVwkECgiVdL3yAzK6vP6/oC6QQC+47DDnLijON6HHkSj8e56qoriEajnHDCF5k4cVKfZ7M7\n/fSFPPvsS32uuT++//1LueaanzJlyn5dvr9mzSp8Ph8lJTO48caf8Ktf/X5Y6kqFBLYQDpOZlUW2\nr+/Tq2b7MjD7EQnV1dUEg0Huv//hPq+71+hpwb/44nOcdNLJlJTMGFVhDRLYQogB+uMff0N5+Q5u\nu+035OcXkJ9fwH77TeWRRx7C4/Gwe/duTjppARdccBFbt25h8eI7ME2TxsYGfvzj6znooDl0dTv6\nOeeczuzZcygv38n06TO47rqbaG5u5he/uIlgsIV4PM4ll1zOvHmHc9555zB//hFs2KDJy8vj5pt/\nzWuvvdI+I2AkEuGb3zybJ554rv3zq6uruO223xCNRqmtreGSSy7H7y9i5cq32bRJM3XqNL773W/x\n7LMvsWnTRu688zbcbjdebzrXXnsDpml2mp3wwANnc/XV1w3psZbAFkIMyI9/fB0///kNXH319SxZ\ncm97f3dlZQUPP/wY4XCYM874EhdccBHbtm3lyiuvoqRkOsuW/Zf//Oe5ZGB/Wk1NNZdccjkTJkzk\n5puv5/XXX2P9+rUceeR8zj77G9TUVHP55RfzxBPPEg6HOP300/n+92dy991/4dlnnyQ3N2+fvvfO\nrfiysu2ce+75HHLIPNavX8uSJfdy++2LmT//aBYsWEhRUXH7Or///a1cf/3PmD59Bm+++Tp//vPt\nXHnljygv38Gdd/4Vr9fLOeecTn19HWPH5g/FYQZSDGyl1HXAaYAH+KvW+oEhq0gI4QglJTMwDIOM\njAzS0xOz6fn9fh588H4yMjJoaWkmOzun2/XHjStmwoSJAMyefTA7dpRRVradk09eBEBhoZ+cnGzq\n6+twu9M47LDDqK4OcNBBc1i58h1mz977RdDVFBwFBYU89NDfeeGFZwE6zcy37+I1NdVMnz4DgLlz\n53HPPXcBnWcnLCz09zo74UD1OqxPKXU8cJTW+mjgC8DkIa1ICOFYd955GxdffCk//enNlJTM6HHZ\n6urK9vm0161bQ0nJdKZOncqaNR8l368iEAiQlzeGeDyG1rp92WnTSvB6vdTUVAN7Z/nr6P7772bR\nolO48cZbmDfv8PZQ7zw7X+I1v9/Pli2J+a5Xrdo7I2BHQzAv06ek0sJeCKxXSj0D+IBrhrYkIcRA\ntAaD/VrPRYyWLkaJ9FdXQwEXLlzEjTdeS25uHn7/OBobG9qW/tSyHo+X22//PZWVFRx00ByOOeZY\n5syZy29+8wuWL3+VcDjMtdfegMuVaHfed999lJXtpLh4PN/97hWEQiGefvrfXHHFJcyceQA5Odmd\n6jrhhC+yePEd/OMfDzBuXFF7LbNmHcQ99yxm/PgJ7XX95Cc3cMcdv8eyLNLS0rjuups+tY/DMfSx\n19n6lFL3AlOAU4AS4Dmt9QE9rCKz9Y2Q0TBb3EBI/QPnpNn6+jLU72tfO41ly16moaHvz6QcLQZr\ntr5aYIPWOgZsUkqFlFKFWutun+Pj9/f9AaCjwZiqTBoJ4vNldH6jNWKbfbJLnd2R+gdu3Ljc3hfq\nRl5e/2b6Gwoulyvl4+l2u7Asa1Qc/6GUSmC/CfwAuEMpNQHIIhHi3RrpVkZ/NTS0YhTz6RZ2c8gW\n+zQaWngDIfWPrNFW/9NPL025nkcffQav1zuq6u+rVL5ser3oqLV+EVillHoPeBb4ntZ66HvXhRBC\ndJLSsD6t9dCOBhdCCNErma1PCCFsQgJbCCFsQgJbCCFsQgJbCCFsQgJbCCFsQgJbCCFsQgJbCCFs\nQgJbCCFsQgJbCCFsQgJbCCFsQgJbCCFsQgJbCCFsQgJbCCFsQgJbCCFsQgJbCCFsQgJbCCFsQgJb\nCCFsQgJbCCFsQgJbCCFsQgJbCCFsQgJbCCFsQgJbCCFsQgJbCCFsQgJbCCFsIi2VhZRSHwKNyV+3\naa2/M3QlCSGE6Eqvga2USgfQWp849OUIIYToTiot7LlAtlLqJcAN3KC1Xjm0ZQkhhNhXKn3YQeAP\nWuuFwOXAI0op6fsWQohhlkoLexNQCqC13qyUqgXGA7u6W8Hv9w1OdcNsTFUmjQTx+TI6v9Easc0+\n2aXO7kj9I0vqH91SCeyLgDnAFUqpCYAP2NPTCtXVgUEobfg1NLRiFEMgEOr0eqA5ZIt98vt9tqiz\nO1L/yJL6R1YqXzapBPbfgQeUUisAE7hIa20OsDYhhBB91Gtga62jwHnDUIsQQogeyMVDIYSwCQls\nIYSwCQlsIYSwCQlsIYSwCQlsIYSwCQlsIYSwCQlsIYSwCQlsIYSwCQlsIYSwCQlsIYSwCQlsIYSw\nCQlsIYSwCQlsIYSwCQlsIYSwCQlsIYSwCQlsIYSwCQlsIYSwCQlsIYSwCQlsIYSwCQlsIYSwCQls\nIYSwCQlsIYSwCQlsIYSwCQlsIYSwibRUFlJKjQM+AL6otd40tCUJIYToSq8tbKVUGnAPEBz6csRA\nrKn4hMqWqpEuQwgxRFLpErkNuBvYPcS1iAGIm3F+t+Junip9YaRLEUIMkR4DWyl1IVCltV4GGMNS\nkegX0zKJmTHC8chIlyKEGCK99WF/GzCVUguAQ4CHlVKnaa17PO/2+32DVd+wGlOVSSNBfL6Mzm+0\nRkb9PoViYQDSPK5RX2tP7Fw7SP0jze7196bHwNZaH9/2s1LqNeDS3sIaoLo6MAilDb+GhlaMYggE\nQp1eDzSHRv0+tcYSNYcj0VFfa3f8fp9tawepf6Q5of7e9GVYn9X/UsRQMy0z+af8NQnhVCkN6wPQ\nWp84lIWIgdkb2OYIVyKEGCpy44xDtLWsLQlsIRxLAtshLJItbOm5EsKxJLAdQrpEhHA+CWyHaOsS\nkYuOQjiXBLZDtLWspQ9bCOeSwHYIS7pEhHA8CWyHaLvYKBcdhXAuCWyHkIuOQjifBLZDyDhsIZxP\nAtshLLk1XQjHk8B2CLP9xhlpYQvhVBLYDiGTPwnhfBLYDiF92EI4nwS2Q8goESGcTwLbIdoDW8Zh\nC+FYEtgOYbXPJSItbCGcSgLbIdpGh1hy0VEIx5LAdoj2yZ+wJLSFcCgJbIfoOJxPukWEcCYJbIfo\nOJxPLjwK4UwS2A7RMaRlLLYQziSB7RAdu0GkS0QIZ5LAdojOgS1dIkI4kQS2Q3QcGSITQAnhTGm9\nLaCUcgH3AQowgcu01p8MdWGibzq2sGVYnxDOlEoL+1TA0lp/HrgJuHVoSxL9IX3YQjhfr4GttX4W\n+G7y16lA/VAWJPqnYzeIJcP6hHCkXrtEALTWplLqQeAM4OwhrUj0i9w4I4TzpRTYAFrrC5VS44D3\nlFIHaq1bu1vW7/cNSnHDbUxVJo0E8fkyOr/RGhn1+5RV72n/eezYLPw5o7ve7oz249wbqX9k2b3+\n3qRy0fE8YJLW+rdACIhDz8MQqqsDg1PdMGtoaMUohkAg1On1QHNo1O9TILD3+7O6NoDRmj6C1fSP\n3+8b9ce5J1L/yHJC/b1JpYX9FPCAUur15PI/1FqHB1ibGGRyp6MQztdrYGutg8DXh6EWMQCmzCUi\nhOPJjTMOIRcdhXA+CWyHsOTWdCEcTwLbITrf6SgtbCGcSALbITr2W8tcIkI4kwS2Q8hsfUI4nwS2\nQ1hy0VEIx5PAdoi4FW//WfqwhXAmCWyH6NzCli4RIZxIAtshOl5olIuOQjiTBLZDmNLCFsLxJLAd\nQsZhC+F8EtgOYckTZ4RwPAlsh+jUJSKTPwnhSBLYDtHpoqO0sIVwJAlsh5A+bCGcTwLbIWQcthDO\nJ4HtEKZcdBTC8SSwHaLzbH3SwhbCiSSwHUL6sIVwvlQewitsQMZhi4GwLIvGxkaamnp/6rjPl4th\nGMNQldiXBLZDxGU+bDEAgUATL72zE9PqORJagy0smD+D3Ny8YapMdCSB7RCdRonI5E+iH7KysjHx\njnQZogfSh+0QnfuwpYUthBNJYDuE3OkohPP12CWilEoDlgBTAS/wa63188NQl+gjUx4RJoTj9dbC\nPg+o0VofBywCFg99SaI/LOkSEcLxervo+DjwRPJnFxAd2nJEf5ly0VEIx+sxsLXWQQCllI9EcN8w\nHEWJvpM+bCGcr9dhfUqpycBTwGKt9WOpfKjf7xtoXSNiTFUmjQTx+TI6v9EaGfX75HLvvZEhM8sz\n6uvtjl3rbmPX+r1eE7bW4cvJ6HE5FxEKC33k5Y3O/bTr8U9Vbxcdi4CXgCu01q+l+qHV1b3fLTUa\nNTS0YhRDIBDq9HqgOTTq9ykajbX/3GyDervi9/tsWXcbO9ffdodjoDnU43LBljA1NQEikdE3wMzO\nxx9S+7LprYV9PTAGuEkp9TPAAhZprcMDL08Mpk6z9cnkT0I4Um992D8CfjRMtYgBkD5sIZxv9J3X\niH6RcdhCOJ8EtkPIrelCOJ8EtkN07sOWFrYQTiSB7RByp6MQzieB7RDShy2E80lgO4SJidvlTvws\nLWwhHEkC2yFMyyLNlRilKX3YQjiTBLZDWJZJWrKFLX3YQjiTBLZDmJa5t4UtfdhCOJIEtkOYWO0t\nbAlsIZxJAtshTMvE096HLV0iQjiRBLZDWB0uOlrSwhbCkSSwHcCyLKxOXSLSwhbCiSSwHaCtz1ou\nOgrhbBLYDtDWZ93ewpZx2EI4kgS2A+zbwpZx2EI4kwS2A+wNbBnWJ4STSWA7gCV92EJ8JkhgO0Db\nqBCXy9XpdyGEs0hgO0DbRUaX4cJluLDkoqMQjiSB7QBtXSAuw4ULQ1rYQjhUj09NF/bQNirEZbgw\nDJf0YQvHsCyLQKAppWULC3OGuJqRJ4HtAHtb2AYuw5Bb04VjBAJNLFtZSmZWdo/LtQZbOLfQh9M7\nDSSwHcDs0MJ2GS6Z/Ek4SmZWNlnZvpEuY1RI6etIKTVfKfXaUBcj+qftoqPbcONCukSEcKpeW9hK\nqWuA84HmoS9H9IfVoUvEMOSioxBOlUoLuxT46lAXIvpv3y4R6cMWwpl6DWyt9dNAbBhqEf3UaVif\njBIRwrGG5KKj32/PCwRjqjJpJIjPl9H5jdbIqN6ngDtRr8twkeZ2Y2DfvwO71t3GrvV7vSZsrcOX\nk9Hjci4iFBb6yMsbnv30ek1ysuvITqEusO/xT1VfAttIdcHq6kA/Shl5DQ2tGMUQCIQ6vR5oDo3q\nfaptSlxecBkGlgkxKz6q6+2O3++zZd1t7Fx/U1Oi7kBzqMflgi1hamoCRCLDM3yuqSlAc0sYk97r\nAvtmD6T2ZdOXwJYrWaNU5z5sg5gpXSIiNZZl8aGuZm1pJa2RGL7sTCb6c3C7Um6fiWGUUmBrrcuA\no4e4FtEHHe8Aa25OtCqikShYMvmTSM2OygD/XLaJTeWNHV6txz8mky8cOoHMdLlNY7SRvxGbCgSa\neLX0DTKzsqgJ1wGwo3EXwUgrlksCW/SsrCLAbx75kEjU5ND9Czn2oALWl9WzZXcrZRUB/vNOGSce\nNomxvvSRLlV0IIFtY5lZWWT7sgm4WgBIT0/H5XIRtWRQz3CzLIvGxsb2vuCe+Hy5GMbIdTk0NIf5\n85NriUZNLj1tNvNnFdHU1EhTa4SJ/jGsy/GyurSWVz4o59Rj9iPDKzExWsjfhANYycsLRvJ/Mg57\n+AUCTbz0zk5Mq+d/Uq3BFhbMn0Fubt4wVdZZNBbnL0+uoz4Q5uwvTGf+rKJO7xuGwcEzCjEMg1Wb\na3hnfSVfOHTCiH7BiL0ksB2gPbDb7nSU68MjIisrGxPvSJfRo+ff3s62PU0cNbuYRfOndLvc7JJ8\n9tQG2VnVzKadDagpY4exStEdZ09t9RnRNr2qtLBFT/bUtrD03R3k56Zz/sKZPbaaXYbB5w8uxutx\n8cHGagLByDBWKrojge0AbS1sl5EIbGlhi31ZlsU/XtLETYtvfnFmSv3SWRkejjywiLiZGPonRp4E\ntgO0t7ANA8NAWtjiU979uJKNOxo4ZEYhh870p7zetPE+/GMy2FHZTEVdcAgrFKmQwHaAtva0kWxh\nW8Azpf/h/YpVI1mWGCXCkThPLC/Fm+bifxbs36d1DcPgiAPHAfD+hqr2xoEYGRLYDtD+iDBcGMkZ\nBJbtWM7y8rdGsiwxSvz3vR00NEc4+cgpFOZl9nn9wrxMpk/IpT4QZluFtLJHkgS2A7Q9JT1xEWnv\nhaSWaMsIVSRGi/pAmKUry8jN9vY4KqQ3h870k+Y2+LgsQGs4PogVir6QwHaATqNEOlz4b4lKa+iz\n7uk3thKJmpx5XMmAbjXPykhjTkkB4ajJyx/uGcQKRV9IYDtAp3HYHVrYwVgrcVNaQ59VOyoDvLVu\nD5P82Xx+zvgBf96sqWPJSnfzxtoqKkfZBUjLsojFnX+xXW6ccYC2FnYsGsXaZ6a+yvpKcjydnzg9\n0rdGi6FnWRaPvVqKBXz9xP1xDcLse263i4On5fLuxnoee7WUH5x98MALHYCaxhCfbKujtilEc2uU\nZ9+poGR8LgfsN5YT5k0iL3t038TUHxLYDtDWwt6xp5FgNA7uve+t+GQHPteY9t9H+tZoMTzWbKll\nQ1k9c0oKmD0tf9A+d2JhBtMn5LC6tIaPt9cxe+rgfXaqAsEI722oYld1cg4dj5sxOR5ys9PZXN7I\npvJGln2wk9OOmcZJh00ize2cjgQJbAdoa2F70jy44+5O77kyXGR5nP0UjtFgW2AHIdOF1zXyrbpY\n3OTxV0sxDDjnhOmD+tmGYfDVYybzxyc28Ogrm/n5RUfgdg1fICa6eSqIxkyKxmZy8IwCivOzaA02\nc8YJM2loivPOx5U8s2Irj71ayvsbq7jyzDmMyXHGrIPO+er5DNs7MvbTp70Rq+cndYiBawg3cp/+\nP9YGV450KQAse38nFXVBjp87gYn+nEH//En+LI6dO55dNS28vnr3oH9+VyzLYtXmGpav2o1pWhwz\np5iF86cwviC7U/deVoaHkw6bxG8uPYrPzSpi6+4mfvnQB2yvaBqWOoeaBLbNbajbxO6WCmDvXCId\nhc3WkSjrM8OyLLbX7cHCojZSSzAUG9GbSyrrgjzz5jZyszycefzgtq47+upx08nwunn6ja00tQzt\nPCOWZbHyk0rWbanFl+Xhy0ftx/SJPXfp5WR6uOTUWXztC9NpCIT57SMfsX5b7ZDWORwksG0sHI+w\nuno9e1oqgbb2defAjlitxKwocZkje1CVVzXzxPJSfnrfSu568X0AGiNN/Hv5Fp54bQuvr97NntqW\nYQ1v07J4cOlGojGT/1kwk5xMz5BtKy/by1ePLaElFOPBpRuHbD9jcZOVG+vZtLORsb50vjR/SsoP\nVTAMg0Wf248rz5qDacKf/72WD3XVkNQ5XCSwbawlvs+NMca+7WsIma281PgP3m9ZNmx1OVl5dTN3\nPb2Ony15j6Xv7qA+EKK4OPlV6Q0zqSgTt8ugrCLAsvfLee7N7eyoDAxLcC9ftQu9MzFfyBEHjOvT\nuq2xEFGrby3lkw6fxAFTxrC6tIYVawd/bHY4GufvS7dQXhNi3NhMFh45uV9jyQ/d389V58zF7Xbx\n12fW89Y6+44jl4uONtYS6zwWNhHXnSO7Pl5J0AxgRkf3eOzR/sSWYCjGU29s4bWPdmEBJRNyWTR/\nCnNKCni89CneSWbA4Qfn4HONpaYhhN7ZwLY9TSxftZui/EyOPLCI9CFqIpXuauRfr2wmOyON8xeq\nPh+fezY+hBFL57jcs1Nex2UYXHzKLG76+3v865XNzJw8huL8rL6W3qVgKMqf/r2WzeVNFI9N58TD\nBzba48D9xnLNNw7ljsdX8/cXNxAMx1hw+ORBqXU4SWDb0Fu7V5KH71OBHY2AaRqdhvXVxRLdJSEr\nSMQcvRcgR+sTWyzL4r0NVTz6/zbT2BKhOD+Lr584g4OnF7SHYm2ovn35lngTue58/GMz8Y/NZE5J\nPh/oanZVt/DC29tRk3I48sCi7jbXL/WBMHc9tQ7TsrjsjIP6/BzGQKSZqlAN4z379Xnb+bkZnL9w\nJvc+9wl3PL6an553GHkDHJFR3dDKnU+sYU9tkENnjGVaUcagDM0rmZDLtd+cxx8fW82/XtlMIBjl\njGOn4bLRPQkS2DZT21rPPzc+Sb57HC0BF3Ro0OhPMnAXppHmB6IZkBbGNPa2rJvitcTNOI2RbHIZ\nfeOwR9sTW6rqg/zj5U18vK0OT5qLrx5XwpeOnIInrXN41HUI7KDZeTRCXk46Jx02ifLqZlZ+XMnG\nnc38/rFPuHDRgcwahDHMgWCEPz+5lsaWCN84cUa/xkXvak6cHox1F/Srhs/NKqaiNshzb23njsfX\ncO035/X7NvjS8kb+8tRaAsEoC4+czMJ5ft7+uKJfn9WVSf4crk+G9gtvb6eiLsh3vnIg6R537yuP\nAhLYNtHQ2sTW8iCvbP4AMqA2Wo1FNobpwnAl7m7MGxsnkhnBBKyYBywTw7u3X3Jz3Q72eD5i25Zx\nXFf4oxHak9EvFjdZunIHL7y9nWjMZPa0fM4/eSbjxn76dN+0TBpCDbgNN3ErTovZ9fCxSf4cij6f\nxQcbdlO6u4XbHl3N0QcVc9bx0/v9ZPKaxlZuf2wNFXVBjps7ngVH9O8Uv7w5MTRvTFphv9YHOP3z\n02hsifD66t384V+r+N5XD+rTzIBx0+SFt8t4/q3tWFicf/JMTpg3iaamxn7X1J1xY7O48YLDueup\ndXywsYq/WEMxAAARWElEQVSq+iCXnDqbiYXZva88wnoNbKWUAfwVmAuEgIu11luHujCRuOq/ZVcj\nKz4p40PjMWINhRDzkpYBhsvCyGom1+ujKZLo950wJURFOEwQ8Pt8tMbSaGFvYO+Ir8flibGzZTfv\nbS7DmxcgL93HtLy+nwoPhmjMpD4QIhiOUVsfYE9tK4YrRprbRWZ6Ghle97D2VZuWxUe6mqdXbGVP\nbZC8bC/nfmV/jjhgXLd1NEUCxKw4U3Mms715Jy3x7gPGk+Zibkkepx09hX+/Uc7b6yv4YGMVC46Y\nzMIjp6Q8qsOyLNaU1vLQSxtpbI7wpflTOPsL0/t9rMoDiRb2mH62sCExIuP8kxXxuMWb6/ZwywPv\nc9GXD+SQ/Qt7rMuyLD4pq+fJ5VvYXhEgPzedi78yiwP2G9pnSPqyvFx97qH838ubeGPNbm554H3O\nPK6EBUdMGtYbgfoqlRb2GUC61vpopdR84Pbka2IIRONRdlW3snLDbt5sfp5wbT6W6cI7NYYnv5Jc\nbx6N0b3L+7w5HFk0j3XVn5Bn5LOL7QB4jQxIM2iJ1ZPtyqPFbMSVsbfP+/53XsIzsRQPmVw+8wdE\nM6vI9mQNSXibpkVlfZCyygA7KpvZURlgT22QhkB478MX0ltwj9sJcQ+x3Ynxwy7DIC/Hy5gcL2N9\n6YzxpZPpjg/6iIvWcIz3N1ax7IOd7KpuwTDghHkTOeu4ErIyeg7Rtu6QIk8hO9hNINZAsGXvhdPM\nrJxPBdZkfxY3fusw3lpXwTMrtvLiO2W8/P5O5s8q4vNzxlMyIbfLPlvTtNhc3sCL75axfmsdbpfB\nN06cwclH9n/aVIBdzbvxujzkuPIG9HA5l8vg218+gBmT8vi/lzfxl6fWMbXYx8lHTmbWfvnkdpjb\no64pxNottbzzcQWbyxNfcp+bXcR5C2b2eswHS5rbxYWLDuDg6QU89N+NPP5aKctX7+L0Y6Yxf1bR\noMy/MthSCezPA/8F0FqvVEodPrQljZzKqhoaWltoDraS7tp7mtpc3cR7xsb236cUF1BclPpjlrpS\n01pLrteHCxcvlC7HCI5lT2WMda4XiDXkY7X68EyuxptVS553DA1RsAyLxmgDRVnjqAwmxpPmeLLx\nZxVwdNHh7KwOYpIYb+0x0ttvoilIK8aKmQTNAAYuLEw8E7eAAVFauX3Fo6QVleHGy2n+CyiNv0dh\nTh5nzTiFzQ1bSXd72S93MqFYCJfhxuvu+h+UZVk0tkTYUxukoi7IrupmdlQ2s7OqmfA+o1QKctNR\nU8ZQkJtBa2Y5G3gTjERcTMiaCIFCWlpjNLaEExPn79kbgq+vq2VqcS5TinxMKcqhOD8L/5jMlPtN\nLcuipjHExrJ6Pt5ex5rSWsLROIYBxxxUzClHT6Wol9EOgUgz/9r4ZPvvtc21pFkemq0Gtoc+ASDc\n2oriMLKyPz01gNvl4ri5E5g/q4jlq3bx6kflvLl2D2+u3UOG182MiXnk56bjy/ISCsdpaAmzaWcD\ngWDi23rW1LGc+8WZAzqNr2mtA6AiWMXErPEYhjHgp4EahsFxcydQMj6XZ97cxqpN1dz7XOJ45GZ5\n8KS5CYajnebUnju9gNOPncbU4twBbr1/5s30M2NSHs+s2MaKNbu574VPeHx5KfMPLOJwNY6p432j\nZj6SVP4LzwU6nufFlFIurfWQzmVoWRZV9a17p0zsMMbYMMC0IBYzicVNojGTaPLPWNwkEjUJR+NE\nonFCkXj7z+FonHDyvXA0TjgSb/85Eo0T8TTgmbEGPGHMXTMhko0rLQotuWzdXYHbbZDmdpHtrWJM\n/lbingDZadmke9JoopJcTy7Z3iz2RLeRlzaWTHc2m5o/Ji9tLNmuXFY1vYPP8OOJ5bLLWIM7lkMs\nmIWRV4VlurDMDFzeMGmFezCoAAwsw6QhWscU30R2BnZjYTHXP5sPKiLUhRvweTvfehwn8Q/Ba6Tj\nMhIXUnLd+USsEEEzQJFrCqG0OhoiTWSnZRGMtZJWXJZcN8JTFQ9hpEWhHt7cpIlmVmFYBpONg9nD\nRlyGm/3TjmBHdAOWZZAfOoA6YwfRmEVrxThiWYmHtZoN43DlNGAYUDBuInmFEQry0pk1roTM7Cge\nj8GE7GJqGmu4R6/AY7qZ4ZrDhvgqQgVrmDHpEExi+N2TqWttIBAKEW3Opqalnkgszse7mvi4KoKx\n3sSKZII7SmaGQX7mGHJ9BunpBtmeHCwjhmmZxKNptITCNAZDVDeEiEQsLCv5hebL5KRZRRyq8inI\nzcK0wmxrrCEzLR3TstgRKCcvPZdIPMrKPR9QlD2O0oatbG0saz/uvgwfGfEATWY9m4xV5LjyyM0s\nYHNsNbnhfArSxtMSbyRuxmmIZNMYaMHjSiMzLZPD5mRzyEEzKd3ZxIayBjbvbGR9+W7A6DDvgIEv\nM42jDylg7owCZkzKA6LUheqxLAsLCzP5Z9vvHlcabsNNXagBl+Ei3e1lY90mYpHEl/qLO5cl1zMp\nTBubOHMZpEblpHE5XHnmHCrrgry9voKdVc2UVzdjWhYFuZnk56Yzp6SAg6cX4B/T96fgDLbcLC8X\nLFR8ef4Ulq7cwXsbKnn5/Z28/P5O0twuphb7Eg2DsZmMyfaSk+lh6vjcfl9/6C+jt9NLpdQfgXe0\n1v9O/r5Da93TOZhVXd37WNrevLFmNw8u3dj7gv1kGIlZvtK9btI9bjwZEeomLgXDxIqnYaQN/p2B\nlkX7AwasqAfDk2gteaNjiKY1YRkmB+TMYEfrLoLxVk4oPJp1TRupidRx2viTWd+0ka0tOzhn4ims\nrdvAxtYtHO6bQ4F3LKFQmD11rWzxbCDuijI9PpeYEaHMtYGD4kfTaNSw07WJktAcsvLDrA9u4riC\n+VSGa9DNW5jlm0lVawM1sSrSo2OJEMbyBLEi6eCKY6TFsEwXYGG4Bv8mkGlMIl6fSW1WJS3p9pj3\nYVrWZMpb9xC1Yswx9mdXtJG6tCpclgvTGP1zM7txJwIbk4lRPwe4jiUja0yP67QGW/jcrHH4fMPT\nGg4Emnj3kyoys3o+k2gNtnDuVw4lEhmclnA0ZrJ+ay0fb6+jtLyRndXN7BuV48Zk8tvLjhqU7QH4\n/b5evy5TCewzgVO01hcppT4H3KS1/sog1SiEECJFqXSJPA0sUEq1PdH120NYjxBCiG702sIWQggx\nOoyOS59CCCF6JYEthBA2IYEthBA2IYEthBA2MWSTPymlvgqcrbX+5lBtY7A4Zb6U5NQBv9VanzDS\ntfSFUioNWAJMBbzAr7XWz49oUX2glHIB9wEKMIHLtNafjGxVfaOUGgd8AHxRa71ppOvpC6XUh+y9\nuW+b1vo7I1lPXymlrgNOAzzAX7XWD3S37JC0sJVSdwK/ZtDumxpy7fOlANeTmC/FVpRS15AIDTs+\nHvo8oEZrfRywCFg8wvX01amApbX+PHATcOsI19MnyS/Me4Bgb8uONkqpdACt9YnJ/9strI8Hjkpm\nzxeAHqdcHKoukbeAy4fos4dCp/lSADvOl1IKfHWki+inx0kEHST+m4z2sOyoo7V+Fvhu8tepQH33\nS49KtwF3A8PzCPTBNRfIVkq9pJR6JXmWaScLgfVKqWeA54AXelp4QIGtlLpIKbVOKbW2w5+Haa2f\nGMjnjoAu50sZqWL6Q2v9NGDLJ+1qrYNa6xallA94ArhhpGvqK621qZR6EPgT8MgIl5MypdSFQJXW\nehn2OSPuKAj8QWu9kEQj8RGb/dstBA4DziZR/z97WnhAfdha6yUk+h7trgnoOKXakE9uJTpTSk0G\nngIWa60fG+l6+kNrfWGyL/g9pdSBWuvWka4pBd8GTKXUAuAQ4GGl1Gla2+bx4ptInF2itd6slKoF\nxgO7RrSq1NUCG7TWMWCTUiqklCrUWtd0tbCdvomG0lvAlwGS86WsG9lyBsR2rSSlVBHwEvATrfVD\nI11PXymlzkteOILERes4iYuPo57W+nit9QnJC9WrgQtsFNYAFwF/BFBKTSDR8LLTY9HfBL4E7fVn\nkQjxLskjwhKcNF+KHecauB4YA9yklPoZiX1YpLUOj2xZKXsKeEAp9TqJf1M/tFHtHdnxv52/kzj2\nK0h8SV5kp7NjrfWLSqljlVLvkWhsfU9r3e3fg8wlIoQQNiFdIkIIYRMS2EIIYRMS2EIIYRMS2EII\nYRMS2EIIYRMS2EIIYRMyDvszSCm1H7AN+JvW+vIOrx8CfARcqLV+eIi2/QBwIombA9xAGLhSa/3e\nEG3vZuAyEjdTGEAG8G+t9U09rDMeuE9rfUovn/0aMAkIkJhpLQT8TGu9NPn+CyRmfqzoZv0lwM1a\n65193jHxmSQt7M+uWuBLyall23wdGI673G7SWs/TWs8lMavjX4Z4e3cnt3coiXkbvqGUOrW7hbXW\ne3oL6w4uSn72HBJfDP9QSh2Q/JxTugvrpBOw4Z2pYuRIC/uzqxlYBRwHvJ58bQHwStsCSqkvAbeQ\n+O9kG3CJ1rpeKfU14H9JtFYzSbQi30y2ON8DjiUxqc33tdYvdbHtjiE1BqhIbs9NYta42UARoIEz\nScyR/a/kawC3aK1fUEpNTy6fT2ISoB9orVf3tNNa62By/uSZPWyvGFiutZ6WPCMoAKaTuHX+xe72\nRWv9oVLqMeBi4Gql1DbgeCAPuJfEGUWIxO3UZwETgP8opY4FvtiXY6qUmgI8AIwDWkj83axTSp0P\n/ChZ14fAFVrrSE/HRNiHtLA/2x4HvgaglDocWANEkr8XAr8BTtZaHwa8DPw+2SL/LvCVZIv1d8A1\nHT7Tk5zb939JtJ678gul1EdKqU0k5mFum//6aCCstT4G2J/EvApfJjFt7Dat9RHA+STCC+Ah4Bqt\n9eHApcCjve1wsjvoWODtHrYHnW/TrtFaz+4irLuyHjhgn8+4CrhNa30kibOJ+Vrr35GYznQR0EDq\nx/RXydf+CjyRbNn/HLhBKTULuITE/MrzgOp9PkfYnLSwP7ss4Hn2hurXgceAc5O/zwemAK8lQ9oF\n1GqtLaXUmcCpSilFYtL1jtO6/jf553pgbDfbvqmtjzzZb/66UupgrfUKpVStUup7JEJvBpBDIlx/\nrZSaBLwI/FIplQ0cQWIeibZWbpZSaqzWet/5qC9XSp1BooUbA36ltX4nuf2utrevld3sR1csoG2W\nvra6XgTuUkotIjHf8b87LG/08ZjmJ38+HvgGgNb6v8B/lVJXJPfh3eQx8ZC4JiEcQlrYn2Fa6xZg\ndfKU/AQ6dIeQCLcVHfp+jwC+lgzK90lM1P868Gc6d3GEkn9apNA/m+zC2AIcluxXfoREd80SYAWJ\nQCslEaj/R6J1/H6yvlBbfckaj+oirGFvH/ZcrfVhWuu7AZRSp3W1vS7W78s0qQcDnR4PprV+EjiU\nRPD/iMRZRbt+HtNOD3lQSh1I4pg83uHv7Ejgyj7ULkY5CWzxBPBb4IN9ZjlbCRyllNo/+fvNwB+A\nmUBca30r8BqJU3p3N5/dXWC3v57sophKojvmi8BjydZ3FYn+dXey5fiLZPBdAfiTq29SSn0z+TkL\n2NsXn6qTutpeHz+jnVLqSBJ90/fv8/qjJLpB7iPxZJ15ybdiJM5y+3JM27xOsoWd3Pe/Jdc9Uynl\nT7aw7yHxBSEcQrpExPMkAqbtKS8WgNa6Uil1EfB48gke5SSevdhIolWuSVzseh3Yr+O6HXQ3FeQt\nSqkfsneY3Y+11luUUvcB/0xe1AwD7wDTgN8Djyql1pLoY79Za92klDoPuEcp9ZPk8uf0cd+7214q\n+9DmfqVUc/LnZuCcDsP02ta9NbncTSRaxlclX38B+A+JgE71mLb5fvIzr0iu8x2ttVZK/Rx4lcSx\nXUXiy1g4hEyvKoQQNiFdIkIIYRMS2EIIYRMS2EIIYRMS2EIIYRMS2EIIYRMS2EIIYRMS2EIIYRMS\n2EIIYRP/H9rxdl2OfKKtAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x10b7c3310>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "def bp_distance_distributions(pops):\n",
    "    \"\"\"\n",
    "    Plots histograms of base pair distance in initial and final populations.\n",
    "    \"\"\"\n",
    "    #plot bp_distance_1 for rnas in first population\n",
    "    g = sns.distplot([rna.bp_distance_1 for rna in pops[0]], label='initial population')\n",
    "    #plot bp_distance_1 for rnas in first population\n",
    "    g = sns.distplot([rna.bp_distance_1 for rna in pops[-1]], label='final population')\n",
    "    g.set(xlabel='Mean Base Pair Distance')\n",
    "    g.legend()\n",
    "bp_distance_distributions(pops)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Studying our evolved sequences with some Population Genetics tools\n",
    "\n",
    "Now that we've generated some sequences, we can analyze them!\n",
    "\n",
    "So after several rounds of selection, what do we get? We have a bunch of different sequences. We would like a way to characterize this diversity. One important tool for doing this is by making what is known as phylogenetic trees. \n",
    "\n",
    "Phylogenetic trees tell us about which groups of similar sequences are present and how they are likely related in evolutionary time. \n",
    "\n",
    "There are several ways of building phylogenetic trees using BioPython. Here we will go over one type and I'll leave another one as an exercise.\n",
    "\n",
    "### UPGMA (Unweighted Pair Group Method with Arithmetic Means)\n",
    "\n",
    "This is basically a clustering method based on the distance (or number of differences) between every pair of sequences. It assumes that sequences that are more similar are more likely to be related than the other way around. \n",
    "\n",
    "For $N$ sequences, the algorithm builds an $NxN$ matrix that stores the distance between each sequence to every other sequence. The algorithm goes through this matrix and finds the pair of sequences that is most similar and merges it into a 'cluster' or in tree terms, connects them to a common node. This process is repeated until all the sequences have been assigned to a group. Refer to the wikipedia article on [UPGMA](https://en.wikipedia.org/wiki/UPGMA) for a more detailed explanation. \n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 33,
   "metadata": {
    "collapsed": false,
    "slideshow": {
     "slide_type": "-"
    }
   },
   "outputs": [],
   "source": [
    "from Bio import SeqIO\n",
    "from Bio.Seq import Seq\n",
    "from Bio.SeqRecord import SeqRecord\n",
    "from Bio import AlignIO"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 34,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "sequences = []\n",
    "#let's take the first 10 sequences of our population to keep things simple\n",
    "for seq in pops[-1][:10]:\n",
    "    #store each sequence in the sequences list as a SeqRecord object\n",
    "    sequences.append(SeqRecord(Seq(seq.sequence_1), id=str(seq.id)))\n",
    "    \n",
    "\n",
    "#write our sequences to fasta format\n",
    "with open(\"seq.fasta\", \"w+\") as f:\n",
    "    SeqIO.write(sequences, f, \"fasta\")"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The UPGMA algorithm requires a `MultipleSeqAlignment` object to build the distance matrix. So now that we have the `seq.fasta` file, we can give it to an online multiple sequence alignment tool. We can do this through BioPython but it requires some installation and setup so we will skip that for now. Go to the [MUSCLE Web Server](http://www.ebi.ac.uk/Tools/msa/muscle/) and give it the `seq.fasta` file. It will take a few seconds and it will give you an alignment and click *Download Alignment File*, copy paste the whole thing to a new file called `aln.clustal`. This is the alignment we will use to build our tree."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 35,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "#open the alignmnent file\n",
    "with open(\"aln.clustal\", \"r\") as aln:\n",
    "    #use AlignIO to read the alignment file in 'clustal' format\n",
    "    alignment = AlignIO.read(aln, \"clustal\")"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 36,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "3\t0\n",
      "6\t0.0\t0\n",
      "7\t0.0\t0.0\t0\n",
      "0\t0.2\t0.2\t0.2\t0\n",
      "4\t0.1\t0.1\t0.1\t0.1\t0\n",
      "5\t0.2\t0.2\t0.2\t0.1\t0.1\t0\n",
      "2\t0.5\t0.5\t0.5\t0.3\t0.4\t0.4\t0\n",
      "8\t0.5\t0.5\t0.5\t0.3\t0.4\t0.4\t0.0\t0\n",
      "9\t0.5\t0.5\t0.5\t0.3\t0.4\t0.4\t0.0\t0.0\t0\n",
      "1\t0.6\t0.6\t0.6\t0.5\t0.6\t0.6\t0.2\t0.2\t0.2\t0\n",
      "\t3\t6\t7\t0\t4\t5\t2\t8\t9\t1\n"
     ]
    }
   ],
   "source": [
    "from Bio.Phylo.TreeConstruction import DistanceCalculator\n",
    "\n",
    "#calculate the distance matrix\n",
    "calculator = DistanceCalculator('identity')\n",
    "#adds distance matrix to the calculator object and returns it\n",
    "dm = calculator.get_distance(alignment)\n",
    "print(dm)\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 57,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "from Bio.Phylo.TreeConstruction import DistanceTreeConstructor\n",
    "\n",
    "#initialize a DistanceTreeConstructor object based on our distance calculator object\n",
    "constructor = DistanceTreeConstructor(calculator)\n",
    "\n",
    "#build the tree\n",
    "upgma_tree = constructor.build_tree(alignment)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 58,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX4AAAEMCAYAAADDMN02AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3Xl8VNXdx/HPhBAkmMiSgCyGoIXjVmQR94pa+9goYrXa\noqjUHRB5FFQCQlAQBTSiLAIpKijytGorCBa0fepSLZW1FnzgiCJBCJUQQkEQsj5/zCQEzT65c+/k\nft+vFy8nc+/c851J/M2ZM/eeEygtLUVERPwjxu0AIiISWSr8IiI+o8IvIuIzKvwiIj6jwi8i4jMq\n/CIiPhPrdoCa5OYeqPP5pq1axZOff8iJOA3G6xmVL3xez6h84fNyxuTkhEBV2xpljz82tonbEWrk\n9YzKFz6vZ1S+8EVDxso0ysIvIiJVU+EXEfEZFX4REZ9R4RcR8RkVfhERn1HhFxHxGRV+ERGfUeEX\nEfEZFX4REZ9R4RcR8RkVfhERn/H8JG3hysvbw4QJGRQXF5GQkEhGxkSaN2/udiwREdc0+h7/q68u\n4KqrrmbmzCy6du3G0qWL3Y4kIuKqRt/jHz58JAAlJSXs3v0N7dt3cDmRiIi7Gl2Pv3fvM0lNTT3m\nvqKiIm69dQDr16+lV6+z3QkmIuIRja7wVyY2NpaFC1/joYfGMHFihttxRERc1egLf2bmFNatWwNA\n8+bxNGkSnQsniIg0lEY/xn/DDb/mqaeeZMGCFwgEAowcOcrtSCIirmr0hT8lJZUZM+a6HUNExDMa\n/VCPiIgcS4VfRMRnGv1Qz/Lly8jO3sbgwcMa/Nj33XcPgUCA0tJStm/fxpVX9ueee+5t8HZERBpS\noy/8AIFAwJHjln13kJOzk/HjRzNo0B2OtCMi0pB8UfjLDBhwLd2792D79mxat27DpElTWbHibVau\n/JjDhw+Tk7OTgQNvJS2tH1u3fsGzzz4NQGLiCYwZk4G1m5k9ewZxcXH0738t//VfaQBMn57JkCHD\nOe6449x8eiIiteKrwr9rVw4zZ2aRlJTMkCF3sGnTZwAcPHiQzMzp7NjxNenpI0hL68eUKZMYM2Y8\nnTunsmzZEhYuXECfPudSWFhAVtb88mN++eUXHDp0SFcEi0jUaHSFPydnZ5XbWrZsSVJSMgBt27aj\noKAAgK5du5Xfd+RI8L7s7K/IzJwMBKd86NTpJABSUjofc8x33vkTV1/9i4Z9EiIiDmp0hb8+KvsO\nICUllbFjH6Nt23Zs2PApe/fmhfY99kSotWtXc/PNv4lETBGRBuGzwn+0wNf0he/IkelMnJhBcXEx\nMTExpKePIzd39w/2y8/fS2JiYoMnFRFxSqC0tNTtDNXKzT1Qp4Dt27cCYNeufEfyNJTk5ARycw+4\nHaNKyhc+r2dUvvB5OWNyckKVvVtdwCUi4jMq/CIiPqPCLyLiMxH/ctcYEwu8CKQCccAka+1Sp9o7\nfPgwTz/9JP/+9y4KCwt54IGHOPXU051qTkTE89zo8d8M7LHWXgykATOdbGzRopc5+eQfMXNmFg8/\n/Ajbt2c72ZyIiOe5UfhfA8ZVaL/QycZWrfoHTZs2ZcSI+1iw4AXOOed8J5sTEfE8107nNMYkAEuA\nudba31e1X1FRcWlsbO2XSyxbaH3btm0AXHHFFVx99dUMGzaMxYsXs3LlSqZMmRJGchGRqFDl6Zyu\nXMBljDkJ+CMws7qiD5Cff6hOxy4pKSUmJlB+bm2LFgn07HkuubkH6N79HObMmeuJ8269fP4vKF9D\n8HpG5QuflzMmJydUuS3iQz3GmHbAO8DD1toFTrd31lk9WLnyYwD++c+1dOlyitNNioh4mhs9/tFA\nS2CcMSYDKAXSrLVHnGjs5ptvY8qUiQwefDuxsbGMHTvBiWZERKJGxAu/tfZ+4P5ItZeYmMikSU9F\nqjkREc/TBVwiIj6jwi8i4jMq/CIiPqPCLyLiMyr8IiI+o8IvIuIzKvwiIj6jwi8i4jMq/CIiPqPC\nLyLiMyr8IiI+o8IvIuIzKvwiIj7jykIskTR9eiZbtnxOIBAgL28PCQmJzJnzotuxRERc0+gL//Dh\nIwEoKiri3nvvYtSosS4nEhFxl2+Get5443ecc855dOlysttRRERc5YvCX1RUxFtvvcmNN97sdhQR\nEdf5ovCvXv0JPXr0Ij6+hdtRRERc54vCv2bNKs4770K3Y4iIeIIvCv/XX2+nQ4eObscQEfGERn9W\nD8DUqdPcjiAi4hm+6PGLiMhRjb7Hv3z5MrKztzF48LAGP/bq1Z8wd+4sYmNjOfvsc7jzzsEN3oaI\nSEPzRY8/EAg4ctzZs6eTkTGBOXNeZN26NWzd+qUj7YiINKRG3+OvaMCAa+nevQfbt2fTunUbJk2a\nyooVb7Ny5cccPnyYnJydDBx4K2lp/di69QueffZpABITT2DMmAys3czs2TOIi4ujf/9r6dbtVPbt\n20f79oUUFBTQpEkTl5+hiEjNfFX4d+3KYebMLJKSkhky5A42bfoMgIMHD5KZOZ0dO74mPX0EaWn9\nmDJlEmPGjKdz51SWLVvCwoUL6NPnXAoLC8jKmg/Avn35PPzwA7Rs2ZJTTvkRnTunuvfkRERqyVeF\nv2XLliQlJQPQtm07CgoKAOjatVv5fUeOBO/Lzv6KzMzJQPDK306dTgIgJaUzAN9++y2vvDKfV199\nnTZtknj++eksWvQKN910S0Sfk4hIXfmq8Felsu8AUlJSGTv2Mdq2bceGDZ+yd29eaN/g1yLNmjUj\nPj6e5s2bA5CUlMS+ffsiF1pEpJ58VviPFviavvAdOTKdiRMzKC4uJiYmhvT0ceTm7i7f3rRpU4YN\nu5/777+XZs2acfzxCTzyyKNOBRcRaTCB0tJStzNUKzf3QJ0C9u59JjExAVav3uBUpAaRnJxAbu4B\nt2NUSfnC5/WMyhc+L2dMTk6osnfri9M5RUTkKBV+ERGfUeEXEfEZFX4REZ9xrfAbY9oaY7YbY7q5\nlcFr1q9fy3XXXeV2DBFp5Fwp/MaYWGAOcMiN9r1o9+5veO21RRQXF7sdRUQaObd6/E8Ds4Ecl9r3\nlIKCAp5+ejIjR452O4qI+EDEC78x5jfAbmvtn6l4RZUP9O59Zvm/iqZNm8qNN95MUlIS4O3rKkQk\n+kX8Ai5jzAdASejHHoAF+ltrd1e2f1FRcWlsbO1nvUxNTQVg27Zt4cRscKmpqezYsYNOnToBR/Pt\n3r2bQYMGkZycTGlpKevXr+eKK64gMzPTxbQi0ghU2bF29cpdY8x7wD3W2s+r2qexXLlb1stfu3Yj\nUPUVf9dccwVLlrwT0WyV8fIVieD9fOD9jMoXPi9n9PKVuxrX+AFfjX6JiAtcnaTNWnuZm+170ZIl\nK9yOICKNnNs9fhERiTAVfhERn1HhFxHxGRV+ERGfUeEXEfEZFX4REZ9R4RcR8RkVfhERn1HhFxHx\nGRV+ERGfUeEXEfEZFX4REZ9R4RcR8RlXZ+cU79u/fz833XQdJ5/8IwAuvvgSrr9+gMupRCQcKvxS\nrc8/38zll/+c++9/0O0oItJANNQj1bJ2E9b+H8OG3U1Gxmjy8va4HUlEwqQefxT6/mLtDa1seUiA\nzp27cOqpp9O7dx/efXcF06Y9xeOPT3G0fRFxlnr8UaZ37zPJydkZsfZ69Tqbnj17A9C37yV88UWV\nyyOLSJRQjz8KdejQ8ZheuZOmTJlI374/5bLLLmf16lUYc2pE2hUR59Sq8BtjWgMtCK4E3gToYq39\nq5PBxBuGDBnOE088xuLFb3Dccc1JTx/rdiQRCVONhd8Y8yQwFGgK5AEdgDXAuc5Ga9zefPNNNm7c\nzODBwxr82Dt37uCpp56gqKiIuLg4Hn30CRITE+t1rBNPbM/06XMaOKGIuKk2Y/wDgJOA3wOXAJcD\nuQ5m8o1AIODIcadOncTddw9l5swsrrnml3z99XZH2hGR6FSboZ5d1tr9xpiNwFnW2j8aY6Y6HcxP\nBgy4lu7de7B9ezatW7dh0qSprFjxNitXfszhw4fJydnJwIG3kpbWj0AgQNOmsQwfPpjExBMYMyYD\nazcze/YM4uLiuPrqX5Cfv5ePPvqQ2bNncNpppzNkyHC3n6KIeEhtCv9/jDG3AGuB+4wxOUArZ2OF\nZ8eOHY6f8lhXOTk76dChY6Xbdu3KYebMLJKSkhky5A42bfoMgIMHD5KZOZ0dO74mPX0EaWn9iItr\nSkFBIdOnz2HZsiUsXLiAPn3OpbCwgKys+ezZk8vjj49nxIhR3H33UCZPnsjy5cu48sqrI/l0RcTD\najPUcwfQ1lr7PrANmAs84mCmsKxdu5FOnTq5HaNOWrZsSVJSMgBt27ajoKAAgK5du5Xfd+RI8L6K\nPf4//Wkpe/YER91SUjoDkJCQSIsWLejRoxcAF1zwEzZv/r+IPh8R8bba9PiTrLWZANbakQDGmOsd\nTRWmbdu2kZt7wO0Yx6jPJ5DKvgMoLS0t7/Fv2PApe/fmhfYNvoc3a9aMk05K4V//+ifdu/fg00/X\n0aXLKeGFF5FGpTaF/y1jzCxr7VOh0zpnA12BN5yN5idHC3xNX/gWFBQSF9eUoUPvJCYmhvT0ceTm\n7j5mn1GjxvHMM1MoKSmhffsOGuMXkWMESktLq90hVOynAycDbYHngeestcXOx4Pc3APVB6xEcnKC\nZ3v8ZRde1Tfj94/jFC++hhV5PR94P6Pyhc/LGZOTE6rsRdZmjD8AFALxodsloX8iIhKFalP4PyP4\npe7ZwHnA+cAqBzOJiIiDajPGn2atXR+6nQv82hhzg4OZRETEQbUp/DuNMQ8Ax1Nhrh7gdSeDiYiI\nM2oz1PNHoAdwM8GJ2vqjMX4RkahVm8KfZK0dBCwl+CZwCXCGk6FERMQ5tSn8+aH/WoJz9fwHiAun\nUWNMujHm78aY1caY28I5lohIbb322iLmzp3ldgzX1abw/68x5nXgXWCkMWYOcKi+DRpj+gLnW2sv\nIPjp4aT6HktEpDaOHDnChAnjePNNXXcKtSv8pwGjrLXZwI0Ee/71LvzAFcBGY8xi4C1gWRjHEhGp\nUUFBAWlp/bj11tvdjuIJVZ7VY4x5EziL4MIrPY0xZZuaAtlhtJkEpAD9CF4N/Bag9fxE6iGcWWhj\nYgKUlNT5wviICTdfxavbExIS6NPnXJYvVz8Tqj+dcxDQGngOqDjZSxHwTRht5gGbrLVFwOfGmMPG\nmCRr7Z7Kdm7VKp7Y2CZ1biQ5OSGMiA0vJiZ49XTFXPXJWNlxnOK11/D7vJ4PnM2YmppKTs7OsGaj\nLft78qpw8lX22ickHEd8fFyD/l6i4e/w+6os/Nba/cB+4JoGbvMjgm8k04wxHQhOBZFX1c75+XUf\nVfLi/BllPZeyXPXN+P3jOMWLr2FFXs8HzmcsKSmlQ4eOrF69oV6P9/prGG6+yh574MBhDh0qaLDn\n7eXXsLo3pNqM8Tcoa+3bwHpjzCpgCTDUWuvdz5siIo1Mba7cbXDW2nQ32hURf0tL6+d2BE+IeI9f\nRETcpcIvIuIzKvwiIj6jwi8i4jMq/CIiPqPCLyLiMyr8IiI+48p5/NJwli9fRnb2NgYPHtbgx/7w\nw/eZNetZ2rU7EYA77riHs87q2eDtiEhkqfA3AoGAM/OtWLuJoUP/m759L3Xk+CLiDhX+RmTAgGvp\n3r0H27dn07p1GyZNmsqKFW+zcuXHHD58mJycnQwceCtpaf3YuvULnn32aQASE09gzJgMrN3M7Nkz\niIuLY+DAG7F2E1u2fM5rry3itNPOYOjQ4cTEaHRQJNqp8EdQTs7O8ml06zvlbE7OTjp06Fjptl27\ncpg5M4ukpGSGDLmDTZs+A+DgwYNkZk5nx46vSU8fQVpaP6ZMmcSYMePp3DmVZcuWsHDhAvr0OZfC\nwgKysuaTnJzA11/v4ic/uYT27Tvw1FNPsHjxH7juuhvq/wKIo5wc9vv00/XMmvUcMTEx9OjRy5E2\nJHJU+CNk7dqNYc2dXhstW7YkKSkZgLZt21FQUABA167dyu87ciR4X3b2V2RmTgagqKiITp2CC6Gl\npHQuP96VV/bn+OOPB+Cii/ry4YfvOZpfwufUsN+MGdN4/PGpnHjiiQwfPpgtWz4v/7uS6KPCH0EV\nF4ao73Su9XnzqKwYpKSkMnbsY7Rt244NGz5l79680L5Hh3IGDRrA3LkvkZSUzNq1qzFG6+VEi9oM\n+w0Zcg8XXvjTGof9+ve/lqys+cTExHDo0CG+/fZb4uPjXX6GEg4V/kblaIGvrufXu/eZBAIBrrnm\n5+WPKSwsJBCAJk1iWbp0SWgBjAD9+19BaWkppaWlFBYWMXHio84+hVry+upR4HzG+g77PfhgOhkZ\n6YwfP56+fT9g+/Zsxo59rMphvzKffbaRRx8dQ5cuJ5Oc3Nax5yXOU+GPchWnmV2yZEX57UcfnQRA\njx69yu+Li4tj69YvywtGQUHhMccqLYWSkqP3lZSUlA8NSXSpbthv1qznuP76Abz0UhY9e/bmvff+\nUuOwH8AZZ5zJ66+/xW9/O5uFC+dz++13R/AZSUNS4fehDh06HjPsVBkvrywE3s8Hzmes77Dftm1f\nMWLEKF56KYsf//gs4uLiahz2u/feu5g8+RkSEhKIj4+nsLCwqiYkCqjwizRKVQ/7detm+Pvf/wbA\nRx99QIcOnZg4MYPi4mJiYmJITx9Hbu7uYx5z44238OCDw4mLi6NNmyTS08c5/xTEMSr8Io1EVcN+\nS5cuYenSJeWf8vLy9jBt2lQ6duxIIBBD+/btmTTpqWOO1anTSfTs2bv854suupiLLrrY4WcgkaKr\ncUR8ZvXqT7jnnmG8/PLLxMQE6NPnXLcjSYSpxy/iMykpnXnssbG0aNGcTp06M2LEKLcjSYSp8Iv4\nzOmnn8m8eS9HxRfk4gwN9YiI+IwKv4iIz6jwi4j4jAq/iIjPqPCLiPiMCr+IiM+o8IuI+IwKv4iI\nz+gCLhGfKVuicdy40Q1+7DVrVjFv3hxiY2Np1ao1Y8c+RrNmzRq8HQmPevwiPuTUEo3Tpk1l8uRn\nmDkzi06dTmLZssWOtCPhUY9fxMdqs0TjwIG3kpbWr1ZLNM6YMZeWLVsCUFxcRFycevtepMIvEsVy\ncnbWuCBLfZdozMyczo4dX5OePoK0tH5MmTKJMWPG17hEI8AHH/yV9evXctddQxvkeUrDUuEXiVJr\n126s1ypcFVW3RGPZfWXLb2Znf1WrJRpfe20R77//VzIzZ9K0adOw8okzIl74jTGxwAIgFSgC7rLW\nfh7pHCKNQU1LaMIPl2jcv/8/vPvucqz9jAMHDnDkyJEffAFb2XcAKSmpNS7RuGDBC2zZYnn22eeJ\ni4urz1OSCHDjy90rgSbW2guBicATLmQQ8a1PPllJamoXXnnlFZo0acKyZUuAmr/wHTkynYkTMxg6\n9E7mzp3FKad0PWZ7fv5e5s+fx549exg58j6GDx/M4sV/cOx5SP25MdTzORBrjAkAJwAFLmQQ8a2f\n/ezn5WvqXnVVf2Jjg2Xg0UcnAdCjR6/yfePi4nj99eAbgzGnMmPG3GOOVXGJxlatWvPeeysdzy/h\nc6Pwfwt0ATYDbYB+1e8uIg2pbdt2zJkzk/fe+zPffXeE22+/x+1IEmGB0tLSiDZojMkEDltrHzHG\ndATeA8601lba8y8qKi6NjW0S0YxelpqaCsC2bdtcebxEn7IefVFREQDXXXcdDz74IBdccAEffPAB\nixYtYu7cudUdQqJTlWN3bvT49wKFodv7QhmqrOz5+Yfq3EA0LClX34wlJcE36vo+v9o+3uuvodfz\ngfcylmVp3rwFhYXBmhAbG09eXr6ncpbx2utXGS9nTE5OqHKbG4X/WeBFY8yHQFNgtLX2OxdyiPjS\n/fc/xLRpU5k373kKCoq02LoPRbzwW2sPAr+OdLsiEpSa2oXnnpvt6d6qOEtz9YiI+IwKv88tX76M\nOXNmOtrGyy+/yPjxYxxtQ0RqT4VfHJupEWDlyo9ZufJjR9uQunH6zb64uJixY0exatU/HGtDwqO5\neqRcxZka27dvR0bGE2HN1HjGGT9m6dLF3HnnYJYu1fS8XuLUG/HOnTt4/PHx7NmTC1zrSBsSPhX+\nKFSbGRmre2xtZmocPvzusGZq/O6773jkkYcZN24CX331JZG+XkRqp6GnZT7llK6MHj2OhQsXuPzM\npDoq/FGmIWZkrErFmRrbt28f1kyNq1b9g/z8PMaPH82BA/vJy8vj1VcXMHDgIEeyS/04NS2zeJsK\nfxSqzYyMVanPm0Z9Zmrs2/dS+va9FID169eyZMkfVfRdUtUnPHBmWmbxPhV+qeBoga/tTI3FxcXE\nxMSQnj6ufOIviX71nZZZooMKv8+lpR2dI2/JkhXltzMzM8nNPVDvmRor6tmzd6X3ixfozd6PIj5J\nW13l5h6oc8BouCLRrYxlQz01DRd5/TX0ej7wTsaqfudeyVcVr+cDb2dMTk6o8p1cn9FERHxGhV9E\nxGdU+EVEfEZf7or4zDff/Jsnn5xATAwUFhbz8MOPcNJJKW7HkghSj1/EZ+bNm8P11w/glVde4ZZb\nbmPOnBluR5IIU49fxGfuu+8BWrQ4HgheiNWs2XEuJ5JIU49fxGcSE0+gSZMmbN26leefn85tt93l\ndiSJMPX4RRq5yq7ZWLduDdOnP01GxgSN7/uQCr+Iz6xbt4bnnsvkhRfmERt7vNtxxAUq/CI+M336\nMxQXFzFq1CgKCoro3DmVBx8c7XYsiSAVfhGfmT9/EeDt6QbEWfpyV0TEZ1T4RUR8RoVfRMRnVPhF\nRHxGhV9ExGdU+EVEfEaFX0TEZ1T4RUR8RoVfRMRnVPhFRHxGhV9ExGdU+EVEfEaFX0TEZxyfndMY\ncy4w2Vp7qTHmFGA+UAJstNbe63T7Uj/5+fmMGHE/BQUFtGmTxJgx42nWrJnbsUSkATja4zfGPAT8\nFiirGM8AY6y1fYEYY8w1TrYv9Tdr1ix+9rOfM3NmFl27dmPJkj+4HUlEGojTQz1fANdW+Lm3tfZv\nodvLgcsdbl/qad26dZx33gUAnHfehaxZs9rlRCLSUBwd6rHWvmmM6VzhrkCF2weAE5xsXyqXk7OT\n3r3P/MH9FddmPXjwIC1aBJfli4+P5+DBbyOWT0ScFekVuEoq3E4A9tX0gFat4omNbVLnhpKTE+r8\nmEhzI+P27dmkpqZWuq1inhYtWtC8eYDWrRPIy4PWrVt67jX1Wp7KeD2j8oUvGjJ+X6QL/zpjzMXW\n2g+BNOCvNT0gP/9QnRuJhiXl3My4evWGSu+vmKdXr14sW/YOaWn9WL78z5x22o899Zrqdxw+5Quf\nlzNW94YU6dM5HwQmGGM+BpoCb0S4famlIUOG8Je/vMvQoXfy2Wcb+eUvf+V2JBFpII73+K212cAF\nodtbgEucblPC16ZNGzIzp7sdQ0QcoAu4RER8RoVfRMRnVPhFRHxGhV9ExGdU+EVEfEaFX0TEZ1T4\nRUR8RoVfRMRnVPhFRHxGhV9ExGdU+EVEfEaFX0TEZ1T4RUR8JlBaWup2BhERiSD1+EVEfEaFX0TE\nZ1T4RUR8RoVfRMRnVPhFRHxGhV9ExGccX2zdScaYAPA8cBZwGLjTWru1wvargXFAIfCStXael/KF\n9okH3gVut9Z+7qV8xpgbgf8m+PptsNYOjWS+Wmb8JTAKKAEWWWsjukJ8bX7Hof3mAnnW2jFeymeM\nuR+4E9gduusea+0Wj2XsA2SGfvw3cLO1tsAL+Ywx7YDfAaVAAOgBjLLWZkUqX31Ee4//F0Aza+0F\nwGjgmbINxpjY0M+XA5cAdxtjkr2SL5SxN/ABcHKEc5Wp7vU7DpgA9LXW/gRoaYzp57GMMcATwGXA\nBcBQY0xrr+QrY4y5BzgzwrnK1JSvN3CLtfay0L+IFv2QmjJmAb+x1l4MrAA6eyWftfYba+2l1trL\nQtvWAr+NcL46i/bCfxHBPwSstZ8AZ1fYdhqwxVq731pbCHwEXOyhfABxBP+oNkc4V5nq8h0BLrDW\nHgn9HEuwtxNpVWa01pYAp1lrvwWSCP49R6wnWFM+AGPM+UAfYG6Ec5Wp6W+wNzDaGPM3Y0x6pMOF\nVJnRGNMNyANGGGPeB1q78OZU02tYZgYw2Frr+atio73wJwL/qfBzUagXWNm2A8AJkQpWRYaK+bDW\nrrTW7iT4EdENVeaz1pZaa3MBjDH3AS2stX/xUkYIFn9jzLXAP4H3gYORjVd1PmPMicB4YBge/B2H\n/A8wGLgUuMgYc2Ukw4VUlzEJOB+YTvDT++XGmEsiG6/G17BsWHmjtfaLiCarp2gv/PuBhAo/x4R6\ngWXbEitsSwD2RSpYhQxV5fOCavMZYwLGmKeAnwLXRTpcSI2vobX2TWttB6AZcGskw1F9vhuANsCf\ngHTgJmOMl/IBPGet3WutLQLeBnpGNF1QdRnzgC+stZ+HMq6g6h63G/nK3ExwSCoqRHvh/xi4EsAY\ncx6wocK2TcCPjDEtjTFxBId5VnoonxfUlC+L4NjmLyoM+URalRmNMQnGmPdDv18I9vYj/cZaZT5r\n7QxrbZ/Q+O9kgl8+v+yVfMaYRGCjMSY+9AXmZQTHqCOtur/DrcDxxpiy78F+AnwW2Xi1+v/4bGtt\npOtLvUX1JG0Vvm3vHrrrNoJjli2stfOMMVcR/KgdAF6w1s7xUr4K+/2V4NigW2f1/CAfwQKwGvhb\naFspwd7hEq9kDP2O7yR4VkoB8C/gvkiOsdbhdzwIMC6e1VPV6zeQ4Jlbh4H/tdY+Fsl8tcx4CTAl\ntO3v1toHPJYvCXjXWtsrkrnCEdWFX0RE6i7ah3pERKSOVPhFRHxGhV9ExGdU+EVEfEaFX0TEZ1T4\nRUR8RoVfopIxpq8x5r0ItjfeGJNRwz6DjDEvNXC7fYwxk506vviTCr9EMy9ehNLQmU4H2jp4fPGh\nqJ6PX3wv2RizHOgI/AO411pbaIzJBdYA7YBzCF51eUboZ0tw3qETgTeBjQTnp/k3cIO1dp8x5ibg\nEYLTP6wG7g61d64x5mOgAzC/uqtcQ3PIPwM0B/YQnOc+O/QpZRXBqQeSCF5p/I4xpiPwKtAylKlv\nKPMEoIWEuhNfAAACZElEQVQxZjSQA3QNHSOF4JW2dyNSR+rxSzRLJVjsuxOckG9w6P42wBOhS+jP\nB45Yay8EugLxhOZdIbiwxtPW2h8TnH1xoDGmA6F1HEL3N6mwf1uCBfls4CFjTIvKQhljmhKck/1G\na+3ZoeNVXASoaWhu9xHA46H7ngP+x1rbA3gD6GCt3Q9kAG9Za58M7XcSwam8TwPSjDGn1eUFEwEV\nfoluH1ZYqelVggvulFkFYK39GzDbGDOUYHH9EXB8aJ9vrLX/Ct3eCLQm+EbxkbV2V+jxg6y1b4X2\nWW6tLbLW5gG5of0r0w04BXjLGLOe4DwzqRW2r/hemwA/AxaG2lxM1TPJfmit/U9oBaovCX5qEKkT\nDfVINCuqcDtAcIlIAMpmEzXG9AceA6YBLxIslGVz41dcWKa0wjHK584PTcBVWXtQ9Rz7TYAvyybt\nCk3y1a7C9rJ2y9oEKKZ2HbGKGSo+XqTW1OOXaPYTY0yn0KIYg4A/V7LPT4Hfh6ZD3k1weu4moW2V\nFc3VwDnGmLIvVKcB/euYazPQ2hhzUejnO4FFNTzmXWAggDEmjeBYPwQLvTpo0qBU+CWabSTYi/8U\n2BG6Dcee+fJbggugrCU4dr4S6FLJfgCEhnj+G3jXGPMvgnP8V3YKZZVn14SGYX4FZBpj/gncAtxe\nw+MeAH4Zyvkrjg71rALOM8Y8UcljdYaP1IumZRbxgNDyln+21m42xvQEsqy1fdzOJY2TPkKKeMMW\n4HfGmBLgO+Aul/NII6Yev4iIz2iMX0TEZ1T4RUR8RoVfRMRnVPhFRHxGhV9ExGdU+EVEfOb/AeeG\nfk9noZiEAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x10ac3e510>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "from Bio import Phylo\n",
    "import pylab\n",
    "#draw the tree\n",
    "Phylo.draw(upgma_tree)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Introducing mating to the model\n",
    "\n",
    "The populations we generated evolved asexually. This means that individuals do not mate or exchange genetic information. So to make our simulation a bit more interesting let's let the Cells mate. This is going to require a few small changes in the `selection()` function. Previously, when we selected sequences to go into the next generation we just let them provide one offspring which was a copy of itself and introduced mutations. Now instead of choosing one Cell at a time, we will randomly choose two 'parents' that will mate. When they mate, each parent will contribute one of its chromosomes to the child. We'll repeat this process until we have filled the next generation."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 39,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "AACCGUAUGCCUCUGGCGGG\n",
      "CCGAAUUGAGCUGCGGUUUA\n",
      "UGGGUAUCUGGUCCUAGUCC\n",
      "AGUAUCAUAUAUUCGGACAU\n",
      "GGUGGGGACAUCCCGACGUC\n",
      "AAUCCAGAGGGGGAACCAGG\n",
      "CAUUCCACAGUCAAACCCUA\n",
      "AGAGAUAAGCACAGGACGAG\n",
      "GCAGCCCCUUUCUUGCCAUA\n",
      "UUGGUACGAGGUACGGUGCU\n"
     ]
    }
   ],
   "source": [
    "def selection_with_mating(population, target, mutation_rate=0.001, beta=-2):\n",
    "    next_generation = []\n",
    "    \n",
    "    counter = 0\n",
    "    while len(next_generation) < len(population):\n",
    "        #select two parents based on their fitness\n",
    "        parents_pair = np.random.choice(population, 2, p=[rna.fitness for rna in population], replace=False)\n",
    "        \n",
    "        #take the sequence and structure from the first parent's first chromosome and give it to the child\n",
    "        child_chrom_1 = (parents_pair[0].sequence_1, parents_pair[0].structure_1)\n",
    "\n",
    "        #do the same for the child's second chromosome and the second parent.\n",
    "        child_chrom_2 = (parents_pair[1].sequence_2, parents_pair[1].structure_2)\n",
    "\n",
    "\n",
    "        #initialize the new child Cell witht he new chromosomes.\n",
    "        child_cell = Cell(child_chrom_1[0], child_chrom_1[1], child_chrom_2[0], child_chrom_2[1])\n",
    "\n",
    "        #give the child and id and store who its parents are\n",
    "        child_cell.id = counter\n",
    "        child_cell.parent_1 = parents_pair[0].id\n",
    "        child_cell.parent_2 = parents_pair[1].id\n",
    "\n",
    "        #add the child to the new generation\n",
    "        next_generation.append(child_cell)\n",
    "        \n",
    "        counter = counter + 1\n",
    "            \n",
    "        \n",
    "    #introduce mutations in next_generation sequeneces and re-fold when a mutation occurs (same as before)\n",
    "    for rna in next_generation:      \n",
    "        mutated_sequence_1, mutated_1 = mutate(rna.sequence_1, mutation_rate=mutation_rate)\n",
    "        mutated_sequence_2, mutated_2 = mutate(rna.sequence_2, mutation_rate=mutation_rate)\n",
    "\n",
    "        if mutated_1:\n",
    "            rna.sequence_1 = mutated_sequence_1\n",
    "            rna.structure_1 = nussinov(mutated_sequence_1)\n",
    "        if mutated_2:\n",
    "            rna.sequence_2 = mutated_sequence_2\n",
    "            rna.structure_2 = nussinov(mutated_sequence_2)\n",
    "        else:\n",
    "            continue\n",
    "\n",
    "    #update fitness values for the new generation\n",
    "    compute_fitness(next_generation, target, beta=beta)\n",
    "\n",
    "    return next_generation    \n",
    "\n",
    "#run a small test to make sure it works\n",
    "next_gen = selection_with_mating(pop, target)\n",
    "for cell in next_gen[:10]:\n",
    "    print(cell.sequence_1)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now we just have to update our `evolution()` function to call the new `selection_with_mating()` function."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "def evolve_with_mating(target, generations=10, pop_size=100, mutation_rate=0.001, beta=-2):\n",
    "    populations = []\n",
    "    population_stats = {}\n",
    "    \n",
    "    initial_population = populate(target, pop_size=pop_size)\n",
    "    compute_fitness(initial_population, target)\n",
    "        \n",
    "    current_generation = initial_population\n",
    "\n",
    "    #iterate the selection process over the desired number of generations\n",
    "    for i in range(generations):\n",
    "        #let's get some stats on the structures in the populations   \n",
    "        record_stats(current_generation, population_stats)\n",
    "        \n",
    "        #add the current generation to our list of populations.\n",
    "        populations.append(current_generation)\n",
    "\n",
    "        #select the next generation, but this time with mutations\n",
    "        new_gen = selection_with_mating(current_generation, target, mutation_rate=mutation_rate, beta=beta)\n",
    "        current_generation = new_gen \n",
    "    \n",
    "    return (populations, population_stats)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Try out the new evolution model!"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYYAAAERCAYAAAB/4wAeAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzs3Xd8VfX5wPHPnRk3G5IQRth8CXsLCCiodQCKVOvCUfdo\nq7Xaqq21S2v7a90bRBRxoKIoiloVkSl7w5e9E7L3uOv8/jgBAkJyk9ybxfN+vXiRm3PvOU8O4T73\nu56vxTAMhBBCiKOsjR2AEEKIpkUSgxBCiBNIYhBCCHECSQxCCCFOIIlBCCHECSQxCCGEOIE9lCdX\nSlmBqYAC/MCdWustlceSgfcAA7AAA4A/aK1fC2VMQgghqhfSxABMBAyt9Sil1DnAE8AkAK31EWAs\ngFJqOPAPzCQihBCiEYW0K0lrPRe4vfJhJyDvNE99HrM1IavthBCikYW6xYDW2q+UmoHZUrji5ONK\nqYnAJq31zlDHIoQQomYNMvistb4J6AFMU0pFnHR4CiDjCkII0USEevB5CtBea/0kUA74MAehqxqi\ntV4WyPkMwzAsFkuQoxRCiBavVm+cllAW0VNKRQJvAG0wk9CTQBTg0lpPU0q1Br7WWg8K8JRGVlZR\naII9AyUmRiP3M3jkfgaP3MvgSkyMrlViCGmLQWtdClxVzfFsINCkIIQQogHIAjchhBAnkMQghBDi\nBJIYhBBCnEASgxBCiBNIYhBCCHECSQxCCCFOIIlBCNEsPfHEX1mxYnnQzvfYY4+wbt0afvxxGZ99\n9slpn/fDD9+Tk5MdtOvW1vPPP8XcuXNCeg1JDEIIUcVZZ41g4sRJpz3+wQfvUlJS0oARmfLz83ng\ngd+wZMmikF8r5EX0hBANZ/Z3O1m5LTOo5xzaM4lfjOt22uPz589jyZIfqKioICcnhyuvvJpFixay\nZ88u7rnnXjweD++//w42m41+/QZwxx33kJWVyX/+8088Hg85OdncdttdjBp1DjfeeA0DBw5i//49\neL1+nnzyv0RGuk577TlzZjNr1lv4/T4eeuhRbDYbjz76B1q3TiQzM5OzzhrB7bfffdrXf/TRbD7/\nfC6tWrUmPz/v2M+zb99ebr75dh599A+UlpZSXl7O7bffjdfrYceO7fzjH4/x0kvTeP31V9F6KwUF\nBXTr1p2HH/4z06e/Rnr6YfLycjlyJIPf/OZ+hg4dzpIli5gxw9xZoEePnjz44COsXbuaqVNfxmaz\n0a5dex588BFsNtspYy0rK+WWW+5g+fKlgfyz1YskBiFEvZWWlvHUU8/z7bdfM3v2u7z66husXbua\n99+fxaFDB5k2bSZhYWH8/e9/ZtWqFQBcc831DBgwiE2bNjB9+muMGnUOpaUlXHDBxZx77gh+/ev7\nWLZsKeedd8Fpr9u3b3+uu+5Gli1bwksvPcuvf30/GRkZPP30S0RGRnL33beyY4eme3f1k9fm5eXy\n4YfvMXPmbABuvfWGY8csFguHDh2ksLCQ//73efLycjlwYD8jRoyiRw/Fgw8+gttdQXR0DE899QKG\nYXD99b8gO9vsYnI6nfznP8+xcuWPvP/+LAYNGsozz/wf06a9RWxsHO+8M5OMjAz+/e/Hefnl6cTF\nxTFt2ivMn/8ZEyacurWSktKWlJS2LFu2pM7/ToGSxCBEC/KLcd2q/XQfKj16mG+8UVHRdOzY6djX\nZWVl5Ofn8+CD92IYBmVlZRw6dJB+/Qbw5puvM2/eXAC8Xu+xc3Xv3gOApKRk3O6Kaq/bv79ZUadv\n3/68/PJzgIVu3boTFRUFQK9evdm/f98pE8OhQwfp0qUrdrv5NpiW1uuE4507d+HSSy/nL395BK/X\nx5VXmtV9DMPAMAyczjDy8nL561//RHh4BGVlZcd+jqPXS05Oxu12U1CQT3R0NLGxcQBce+315OXl\nkZOTw5///BAAFRUVDB16Vk23ukFIYhBC1Nvpqx5bSEpK5umnX8RmszF//jy6d1dMm/Yyl146mbPO\nGsEXX3zG/PnzAjjXT23dupk+ffqybt0aOnfuChjs3buHiooK7HY7W7ZsZvz4y0752vbtU9mzZzdu\ntxubzcb27ZoLL7zk2PHdu3dSWlrKv//9DDk52dx11y2MGDEKq9WK3+9n+fKlZGZm8Ne//pP8/HwW\nLfoec6fin/4M8fEJFBcXU1RURHR0NM888x8uvPBikpKSj3WXLV78A5GRkQH/7KEkiUEIETIOh52r\nrrqOX/3qNnw+PykpbRk37gLGjj2fF154mpkz3yAxMYnCwoLKVxx/Qw0kQWzevJHFixdisVh4+OE/\nYxgGdruDRx99iLy8HMaOPZ+uXU/dgoqLi2PKlJu4885fEheXQETEiVvFdOjQkenTp7JgwTcYhsGt\nt94FQJ8+/Xj88cd48smnePPNafzqV+YmlW3btiM7O+uUcVssFu6//w88+OC92Gw2undXpKX15t57\n7+eBB+7FMPy4XFH86U9/q/FnboitB0JadjsEpOx2EElp4+CS+xk8db2XGRnp/OUvf+SVV6aHIKrm\nq0mV3RZCiPrwer389rf3/ORTcmpqRx544OGAzrF48Q+8//6sY+cwDAOLxcKVV17N6NHnBjvkejly\nJIN//OOxn8Q6YMAgbr759gaLQ1oMZzD5hBtccj+DR+5lcNW2xSAL3IQQQpwg1Hs+W4GpgMLc6/lO\nrfWWKseHAv+tfJgBTNFau093vvd/XMS4LgNCGLEQQohQtxgmAobWehTwKPDEScdfA27SWo8BvgQ6\nVneyD/e8w5FjsxeEEEKEQkgTg9Z6LnB0xKQTkHf0mFKqB5AD3K+U+h5I0FrvqO58Fgsczm+84lVC\nCHEmCPkYg9bar5SaATwLzKpyqDUwAngOOB84Xyl1bk3nyyzOD0GUQojm5kyrrrpjh+aee27jN7+5\nk9/97jfk5eXV/KI6apDpqlrrm5RSScAKpVSa1roMs7WwU2u9HUAp9SUwBPi+unOVUkpiYnSoQz5j\nyL0MLrmfwVPTvQwPdxAbGxG0ex4e7iAuLpKhQ8+p9nmffDKbQYP6NPi/9f33P8vf//5XlFK8//77\nzJnzDg899FBIrhXqwecpQHut9ZNAOeDDHIQG2A1EKaW6aK13A6OBaTWdMz03R6axBYlMCQyupnA/\n5+ycx9rMjUE958CkvkzuNuG0xxurump5uYc33niTl156NWjVVfPzS3nrrXerra66ZctW7r//gQav\nrvqnP/2dhIRWZGUVkZ9fgs9nCfj3rbZJLNQthjnAG0qphZXXug+YrJRyaa2nKaVuAd5VSgEs1VrP\nr+mEhR55IxOiqZHqqqGvrpqQ0AqAjRvXM2fOB7z44mt1+8cKQEgTg9a6FLiqmuPfA7UqJ1jiLa5n\nVEK0XJO7Taj2032oSHXVhqmu+u23XzNz5gz+859nj50rFJpdSYwyf2ljhyCEOIlUVw19ddWvvvqC\nTz/9mOeff5Xo6NCObzSrxGB4nLiRxCBEcyHVVY//LPWprur3+3n22f/Spk0bHnnkgZDXT2pWtZKu\neusPhmEv48ULHm/sUFqEpjBY2pLI/Qweqa4aXC26uqqDCNy2Qtw+D06bo7HDEUKEmFRXleqqNbpt\n5v8ZBc7d/GnI70mJad3Y4TR78gk3uOR+Bo/cy+Bq0dVVXQ5zpkF6UW4jRyKEEC1Xs0oMMU5zJD6r\nSMpiCCFEqDSrxBAfEQtATqlUWBVCiFBpVomhtctc0JFXLolBCCFCpVklhuSYBAAKPbL6WQghQqVZ\nJYa28WZikLIYQggROs1qHUOb2FgMv4VyQ1Y/CyFEqDSrFkNcdDiGJ0zKYgghRAg1q8Rgt1mx+sLx\nWctpTgvzhBCiOWlWiQHAbkSAxU+pt6yxQxFCiBap2SWGcMyytDJlVQghQqPZJYYIu7nNX6asfhZC\niJAI9Z7PVmAqoDD3er5Ta72lyvH7gFuBzMpv3aG13lHdOaPsUWQBmcWSGIQQIhRCPV11ImBorUcp\npc4BngCqbmg6GLhea7020BPGhcWAF3JKJTEIIUQohLQrSWs9FzhaRLwTkHfSUwYDDyulFimlHgrk\nnEfrJeWVFwYpSiGEEFWFfIxBa+1XSs0AngVmnXT4XeBOYCwwSil1CTVo7TITQ5FbVj8LIUQoNMjK\nZ631TUqpJGCFUipNa310rumzWutCAKXU58BA4IvqztWjfVvIgDJ/KYmJod0Q+0wg9zC45H4Gj9zL\nxlNjYlBKOYEHMQeQfwXcBzyptXYH8NopQHut9ZNAOeDDHIRGKRUDbFJK9QTKgHHA6zWd0+oDw2un\nxFokOzzVk+ySFVxyP4NH7mVw1TbJBtKV9CLgAgYBXqAbAbyBV5oDDFRKLQTmYyaVyUqpWytbCg8D\n3wMLgU1a6y9rOmFMpLOyLIYscBNCiFAIpCtpsNZ6kFLqYq11qVLqRmBjICfXWpcCV1VzfBY/HXeo\nVrjTBt5w/BE5eP1e7NZmVQdQCCGavEBaDEZld9LR4kStq3zd4CwWCw5/BCAD0EIIEQqBJIZngG+A\nNkqpZ4DVwNMhjaoGYVYzMRRUSB+kEEIEW42JQWs9E3NK6ePAbmC81np6qAOrToTVLIshez8LIUTw\n1ZgYlFJ9gT9rrV8E/ge8qJRSIY+sGtEOc4Q9s/jk9XJCCCHqK5CupKnADACt9Vbg7wQ+KykkYsNi\nAGkxCCFEKASSGFxVp5Fqrf+HOX210SSEmy0GKYshhBDBF8hcz0yl1J3A25WPrwaOhC6kmrWOioMy\nKHLL4LMQQgRbIC2GXwITgHRgPzAes1R2o2kdFYvht1DiLWnMMIQQokWqscWgtd6PmRiajDhXGHid\nlFkkMQghRLAFUivpQuAfQAJgOfp9rXWXEMZVrWhXZVkMRwmGYWCxWGp+kRBCiIAEMsbwPHA/sIlG\nXPFcVVSEHcMThmEppNxXQYQ9vLFDEkKIFiOQxJCttZ4X8khqwWa1YvdHYACF7iJJDEIIEUSBJIZF\nSqmngC8xS2cDoLX+IWRRBSDMEkk5UFhRRHJkYmOGIoQQLUogiWFY5d8Dq3zPwNw/odFE2lyUA3nl\nsshNCCGCKZBZSWMbIpDainJEkQtkFUtiEEKIYApkVtIozB3cojBnJdmAjlrrTqENrXqxTnP1c05p\nfmOGIYQQLU4gC9ymAZ9gJpEXgR3Ax6EMKhDxEbEA5FdIWQwhhAimQMYYyrTWbyilOgF5wG2YezLU\nSCllxSzCpzD3er5Ta73lFM97FcjRWj8SaOCJUXGQC4UVslmPEEIEUyAthnKlVAKggeFaa4PAi+hN\nBAyt9SjgUeCJk5+glLoD6BPg+Y6Jd0Vi+GyU+CQxCCFEMAWSGJ4C3gc+A25QSm0GVgVycq31XOD2\nyoedMFscxyilRgBDgVcDjPeYmMrVz2V+KYshhBDBFEhX0jfAh1prQyk1GOgBBDziq7X2K6VmAJOA\nK45+XynVBnis8vtX1SZogJhIJ4Y7DE9YPn7Dj9USSI4TQghRk9MmBqVUB8xZSF8AFyuljhYkKgDm\nAz0DvYjW+ialVBKwQimVprUuA64EWlWePwWIUEpt01q/Vd25EhPN2UjRMREYnjCwGIRFQ1xEdKDh\niCqO3k8RHHI/g0fuZeOprsXwV2As0BaousrZCwRUIkMpNQVor7V+EnPVtA9zEBqt9fOYdZhQSt0I\nqJqSAkBW1vE9GGw+sxTG7vQMOkRLi6G2EhOjT7ifon7kfgaP3Mvgqm2SPW1i0FrfDKCU+oPW+l91\njGcO8IZSamHlte4DJiulXFrraXU85zFOSyQeoNBdiJm/hBBC1FcgYwwfKaWuA94BXgEGAb/VWi+u\n6YVa61ICGD/QWr8ZQBw/4bK5yAcKZC2DEEIETSD9L9MBN3AZ5nqE+4H/hDKoQLkcUQDklEpiEEKI\nYAkkMYRrrT/A3MVtltZ6EeAIbViBiQ2TshhCCBFsgSQGn1Lq55iJYZ5SahLmIHKjS4iIASC/XAap\nhBAiWAJJDLcD44F7tNbpwNXArSGNKkCtImMxDHOzHiGEEMFx2sRQuQANzHULfwFWKqVSgd9TiwVu\noRQXFQ4eJyVeKYshhBDBUt2spGmY3UcLMTfmsVQ5ZgBdQhhXQKIjK8tiOKUshhBCBEt16xgmVP7d\nueHCqZ2YSAeGJwwfRVT43ITZnI0dkhBCNHvVrmNQSvXEHE/oCZQBW4BpWusDDRBbjcxCemYyKHIX\nERbRqpEjEkKI5q+6MYaLgcVABPA58C2QCKxSSp3TMOFVzxXhAG8YAAUVMgAthBDBUF2L4W/AhVrr\nEzblqayU+h9gTAjjCojVYsGJCz8yM0kIIYKluumq4ScnBQCt9QrM/Z+bhEibuWeQJAYhhAiO6hKD\np8GiqIeoyrIY+eUFjRyJEEK0DNV1JUUrpUZz4jTVo5pMiyE2LJoMpF6SEEIES3WJ4SDmOMOpHApB\nLHWSEBELQJ60GIQQIiiqW8cwtiEDqau4iEiMEquMMQghRJA0+23PYqPCMDxhlHhl9bMQQgRDIBv1\n1JlSygpMxdzHwQ/cqbXeUuX4z4E/VB57R2v9XG2vEVNZFqPcX4jf8GO1NPtcJ4QQjarGd1Gl1Ph6\nnH8iYGitRwGPAk9UOa+18vE4YCRwt1IqobYXiHE5wROGgZ9ST1k9QhVCCAGBdSX9u64n11rPxSzb\nDdAJyKtyzA+kaa2LgdaVsbhre42jLQaAArfMTBJCiPoKpCtpl1JqOvAjZr0kALTWbwVyAa21v3K1\n9CTgilMcuxx4EZgH1HqgIMblOFYvqdBdRDtSansKIYQQVQTSYsjBXMswHBhb+efc2lxEa30T0AOY\nppSKOOnYx1rrtkAYcENtzgvgsNtwGOYpC6VekhBC1FuNLQat9S/renKl1BSgvdb6SaAcc0tQf+Wx\naOAz4Gdaazdma8Ff0zkTE6N/8j2XI8p8sdN9yuPi9OR+BZfcz+CRe9l4TpsYlFLztNYTlFJ7MDfm\nOYHWOpCNeuYAbyilFlZe6z5gslLKpbWeppR6G/hBKeUGNgBv13TCrKyftgoirWZiOJSbfcrj4tQS\nE6PlfgWR3M/gkXsZXLVNstW1GG6r/PvcugajtS4Frqrm+DTMneLqJTYsmiwgt1RWPwshRH1Vt/I5\nvfLLDOASzPpIFsAGdAb+HPLoAhQfYWbD/HKZlSSEEPUVyKykOUAk0A1YhLkPw7JQBlVbca4IjFKH\nlMUQQoggCGRWksJchPYx5pqGYUC7UAZVW9GVaxmkLIYQQtRfIInhiNbaALYB/bTWhzGnljYZ5t7P\nYbiNcjx+b2OHI4QQzVogXUmblVLPAy8Ds5RSbQFHaMOqnZhIx7HVz4UVRbSKiG/kiIQQovkKpMVw\nFzC7svjdY0AKcG1Io6ols8VwfPWzEEKIuqu2xaCUmoi5YnkpgNb6U+DTBoirVqIjzUJ6IIlBCCHq\n67QtBqXU34GngKHAh0qpuxosqlpyhduxeCUxCCFEMFTXlXQF0F9rfTVmWexbGyak2rNYLERYXYAk\nBiGEqK/qEkN55cpltNb7CPGmPvUV5TQXuRVWyCI3IYSoj+oSw8n1kXyhDKS+Yp1HVz9Li0EIIeqj\nulZAilLqz6d7rLX+W+jCqr3YiCgMv4U8KYshhBD1Ul1ieAWzNtLpHjcpca4wjIowimSMQQgh6qW6\nInp/bchA6iva5YDiMEq8xRiGgcXSZHOYEEI0aYEscGsWju797MNHmbes5hcIIYQ4pZaTGGT1sxBC\nBEXAiUEp1aQLEB1tMYAkBiGEqI8a1yYopQYA7wGRSqkRwELgF1rrNQG81gpMxSzd7QfurKy5dPT4\nNcC9gAfYqLW+u04/BccrrIJZSE8IIUTdBNJieA64HMjRWh/CLKr3SoDnnwgYWutRwKPAE0cPKKXC\ngb8B52itRwNxSqkJtQm+quhIB4bbTAwF0mIQQog6CyQxRGqttx59oLX+HwHux6C1ngvcXvmwE5BX\n5XAFMFJrXVH52A6UB3LeU7HbrIRZIgHpShJCiPoIpMxFrlKqP5UroZVS1wG5gV5Aa+1XSs0AJmHW\nXzr6fQPIqjznrwGX1vqbwEP/qWhHFEVIYhBCiPoIJDHcBbwJ9FZKFQDbgSm1uYjW+ialVBKwQimV\nprUuA1BKWTC3C+0OTK5V5KcQ4zQTQ4GMMQghRJ3VmBi01ruAUUopF2Cr/F5AdSeUUlOA9lrrJzG7\niXyYg9BHvQaUaa0nBRpwYmL0aY8lJ8Ry0Gun2Ftc7fPEcXKfgkvuZ/DIvWw8FsM4uVbeiSoHhEcD\nfwdWAonAY1rrF2s6uVIqEngDaIOZhJ4EogAXsLryfIsqn24Az1aOS5yOkZV1+tbAzK81Sz3v4Yoy\n+M85f6kpvDNeYmI01d1PUTtyP4NH7mVwJSZG16oURCBdSY8B1wNXAyuAe4DvgRoTQ2XZ7qvqef2A\nxUQ6MbLDKPPl4vP7sFltwTy9EEKcEQJa4Ka13gaMBz7VWhcDzpBGVUdVVz8XeYobORohhGieAkkM\nR5RSzwNDgC+VUv8F9oc2rLqJiXQc3/tZBqCFEKJOAkkM12COBYzVWpcAuzG7lZqcaCmLIYQQ9RZI\nYnADRcAIpdQNQCnw+5BGVUexLmeV1c+yYY8QQtRFIIO/c4BIoBvmDKIxwLJQBlVXJ7QYKmSMQQgh\n6iKQFoMCxgEfYy5GGwa0C2VQdRURZsPqDwekK0kIIeoqoMHnyvIV24B+WuvDBFgrqaFZLBaiHVGA\nJAYhhKirQLqSNlfOSnoZmKWUags4QhtW3UWHRVFmWCQxCCFEHQXSYrgLmF25j8KfgRTg2pBGVQ9x\nrjDwOCmokMFnIYSoi0BqJfmARUqpjpgthecq6yc1SdGRDgxPGIXuIgzDwGKp1UpwIYQ44502MSil\nhgHPAxnAC8CHwC6gk1Lqd1rrNxomxNqJcTkxcsPw+Aup8FUQbg9v7JCEEKJZqa4r6QXMHdfmAJ9i\n7rQ2CBhIE13HAEf3fjbLYsg4gxBC1F51iSFMaz1Xa/0mcEBrvQ5Aa72Peuy0FmoxJ6x+lrUMQghR\nW9UlBl+Vr09+h62+Vncjiqm6+lkGoIUQotaqG3xuVVkCw1LlayofJ4Q8sjo6OvgM0pUkhBB1UV1i\n+A4Ye4qvARaELKJ6inE5j1dYlcQghBC1dtrEoLX+ZUMGEixmi0EGn4UQoq6CuoPayZRSVmAqZr0l\nP3Bn5UK5qs+JBL4GbtZab6/vNW1WK5H2KPxIYhBCiLoIaAe3epgIGFrrUcCjmNNfj1FKDQYWAl2C\nedHYiEjw2WSzHiGEqIOQJgat9Vzg9sqHnYC8k57iBCZhFugLmphIB/7K1c9CCCFqp8auJKXUhcDj\nQDzmjCQLZisgoE/5Wmu/UmoGZgK44qRjyyqvEdS6FUf3ZShy5+M3/FgtoW4YCdH8lXhK+XT3l7SJ\nTOKc9iPl/80ZLJAxhueB+4FN1HH9gtb6JqVUErBCKZWmtS6ry3kAEhOja3xOcmsXZDgxMAiLsRAX\nXvNrzlSB3E8RuOZ6P3fl7uOp5a+RVZoLwNqc9dw19HpS4xpv65Xmei9bgkASQ7bWel5dTq6UmgK0\n11o/ibla2oc5CF1nWVk1dw85LBxb5LbncDrto6WQ3qkkJkYHdD9FYJrj/TQMg8WHf+TD7XPxGX4u\n6jiOnPJ8Vh5Zwx++/icXdhrHhR3HYreGdJ7KTzTHe9mU1TbJBvKvvUgp9RTwJVVKYWitfwjgtXOA\nN5RSCyuvdR8wWSnl0lpPq/K8oK6kjnYdL4tR4C6ifTBPLkQL4fa5eU9/zI8Zq3HZI7mx9zX0bqUA\nGJLcn3f1HL7Y8z/WZW5kStqVdIzp0MgRi4YSSGIYVvn3wCrfMzC3+6yW1roUuCqA59V4rtqIPaFe\nknzqEOJkR0qzmLZxJodLMugY3YFb+kyhVUT8seN9Wqfxp7j7+WTnFyw+/CP/t+oFzksdw/jOP8Np\na7L7dIkgCWQ/hrE1PaepqdpiKJIpq0KcYF3mRmZunU25r4Ix7UYwuftEHKfoKoqwR3BNz58zOLk/\ns7Z9xDf7F7I+axPX9byS7vFBnWEumphAZiWNAh4EojBnJNmAjlrrTqENre5iXFJ6W4iT+fw+5u6a\nz7cHfsBpdXBTr2sY2mZgja/rEd+NPw77LZ/t/ooFBxbzzNpXGN1uBJd1vZiIk/Y7KS7zsGxzBmel\nJZvlaUSzFEhX0jTgX8BNwHPAxcCaEMZUbzFSSE+IE+RXFDB90yx2FewlOTKRW/tcT9uoNgG/3mlz\n8vPuExmU1J+3t33AokPL2JS9lWt6TqZ3q54A7D9SxAtzNpJdUM7iDek8dN0gIsICH7T2G34yS7PZ\nU7CPyEIHfaL6YrPaav2zthSGYbBtXx5ZBeWM7pfSoLtRBvKvVqa1fkMp1QlzgdptwOqQRlVPYQ4b\nTiMcDChwS+ltcWbbnreL6ZtnUeQuZmBSP6b0vKLOOxt2jk3loaH38tXeb/lq3wJeWj+dYW0Gkeo9\ni/e+3ofH66dzSgx70gt58eON3Hdlf+y2U6+HKPOWs7dwP3sK9rGnYD97C/dT6j0+k71v6zRu6T0F\nxxk2pmEYBht35/LZ0j3sOlSI3WZlWFoS4c6GmxkWyJXKlVIJgAaGa62/U0q5QhxXvVgsFmJc4ZT4\nZPWzOHP5DT/f7FvIp7u/xGKxcEX3Szm3/dn1/uTpsNqZ0OVCBiT25e2tH7AiYw0/ejZhT+jDXaPP\np1/XVrwwZyPrdmbzxhdbuXVCLwyMY62BPYVmIkgvOYJRZUJi6/AEerfqSefYjmwr0Gw4spVXN77J\n7X1vwGlr+d1ShmGwbkc2ny3dy94M831rYPfWXHp25wZNChBYYngKeB+YDKxUSl0HrAppVEEQHemk\n2O2UeknijFTqKeOtre+zMXsLsc4Ybu07hS6xnYJ6DRet8OmReHzrcbTfCZ3WsLLcTWfP5dw4vitZ\nn+5nZd4S9i/4jnJ79gmtAafVQbe4znSKSaVzbEc6x6YS4zw+1/7SfuN4csHLbMrZykvrp3Nnv5ta\n7P7tfsNgjc7is6V7OZBZjAUY0jOJiSM70SEpqlFiCmRW0gdKqQ+11kZl0bsewPrQh1Y/sS4nhzxO\nyn1FuH1zuXvLAAAgAElEQVTuM+IThxAAB4oOM23jW2SX59Ijvhs3976WaGdw32D0/jxenruZwhI3\nZ/UawSVDJ/DBzjmsy9rE5hyN1+/FSDRwALmAyx/D0OSex5JAO1dKteMHTpuD2/pez4zN77I2ayMv\nrJvG3f1vIdIREdSfozH5/QYrth5h3rJ9HM4uwWKB4b2SGT+yE+1aN26nTCCzkuKBfyulugJXAr8G\nfsdPC+I1KdGRDoyi43s/t45ospvOCRE0Sw+vZPb2j/H4vVzUcRzju/wsqDWPDMPgf6sOMvu7nQBc\nc153zh/SHovFwn2D7mTRoeV8d2AR8WGxdI7tSIKtDR9+nkNOkZW+l/dlcPvEgK9lt9r5Ze9rsW/9\ngJVH1vDc2lf51YDbiHI26Z7sGnl9fpZvPsLny/ZyJK8Mq8XC2X3bMGFEJ5ITIhs7PCCwrqSpmPsl\nDAOKgHTgbWB8COOqtxiXEyP3aGIolMQgTimvPJ8VGWtIcSXTL7F3Y4dTJ37Dz9bc7Sw6tJyN2VuI\ntEdwa5/r6dM6LajXqXD7mPHlNn7ccoQYl5O7LuuNSj2+KM5qsXJO+5Gc037kCa/r8PNC/jVrLa99\ntpkHXQPp1j424GvarDZu6PULnDY7Sw6v4NnK5BAb1vzqKHl9fpZsTOfzZfvILijHZrVwzoC2XDK8\nI4lxTaslFEhi6Ky1fk0pdZfW2g38USnV5LuSYqqufpZxhjOSYRi4vX7KKryUVXgprfy7pMzDvpI9\n6NL1HPHtOTYAOiJlKFd0v5Rwe1gjRx6Y7LIclh1eyfKM1eRXFADQOSaVm3pfG/QPQkdyS3nh440c\nyiqha7sY7p7Ul/jowO5TpzYx3DWpD899uIFnP1zPI9cPJqVV4J/6rRYr16if47A6+P7gEp5Z+zK/\nGXA78eFxdf1xGpTH6+OH9enM/3EfuYUV2G1Wxg1qxyXDO5IQ0zTHTQJJDF6lVCyV9YyUUt2pZyG8\nhhDtcsjezy2E2+OjuMxDcZmHkjIPxeXeEx6XlHsoLfdWJgDfCUnA569Shsvmwdb6EPakA1gjSgDw\nl0TjzW6HvfVhlqWvZGf+bm7qfQ2dYlIb6aetntvnYV3WRpYeXsGO/N0AhNvCGdVuOCNThpIa3T7o\n893X7chm6rwtlFV4GTeoHVef1/20U1BPp1/XVtx4seKNL7bx1Pvr+eMNg4mLCjwBH51V5bA6+N/+\n73l6zSv8ZuDtTbonoMLjY+G6w8z/cR8FxW6cdis/G9qBi85KrdXP3hgCSQyPAd8DqUqpT4ARwM2h\nDCoYzBaDrH5uygpK3GzZk0tRqZvicg/FZd7jb/5V3vjd3sA/hzgdViLC7ERHOkiOjzAXWEUUUhix\nnRzbbvx4sWKlY3gafWMG0TG6A8VlXqZ+vglStpPVZjf/Xf0S4ztfwM86jm0SexIYhsH+ooMsTV/J\n6iPrKPOatSy7x3VhRMpQBib1DcnkCr/f4JPFe5i3dC8Ou5VbJ6Qxsk9Knc83ul9b8ooq+GTRHp75\nYD1/uLZ2C+AsFguXdb0Yp83B53v+x9NrXuY3A28nOTLwcYuGUFbh5fu1h/hqxX4KSz2EOW1cPDyV\nC4emNpvV4IHMSvpSKbUKOAuzHMYdWusjIY+snmJcUkivKTIMgx0HC/huzUFW66wTP9FXEe60ERXh\nIKW1i6gIh/kn3IErwn78cYQDV+WfyDA74U7bsU+yHr+XtZkbWHRoCbsL9gHQKjyeUe2GMyJl6E9m\n6Tjs/XhhjgVnSSKRaguf7f6KLTnbubHX1ScUl2tIxZ4SVmasZVn6Sg4VpwMQ64xhTMeRDE8ZQlJk\n69Bdu8zDa59tZtPuXFrHhvOryX1JTa5/v/7EkZ3ILazgh/WHeemTTdx7Rb9atT4sFguXdL4Ah9XB\nJ7u+MJPDgNtrtYo7VErLvXy7+gBfrzxASbmXiDAbE0Z24mdDOxAV0bwW6Z02MSilbjjNoQuVUmit\n3wpRTEFRdYyhQMYYGl1ZhZflW46wYM1BDmaZ3ThtW7sY1TeFxLgIoqq84bsiHLXuqjgqpyyXxYd/\nZOnhFRR7SrBgoXernoxpN4JerdRpWwD9u7Xm1gm9eO3TzVg3jKTniP1sK9jKP1c+zdU9LmdIADWF\ngsFv+NmWu4Ol6SvZmLUZr+HDarEyILEPI1KGVvszBMu+jCJe/NgsbdG3Sytum9graG9sFouF6y/s\nQUFxBet35TBj/jZuGZ9W6+6vCzqei8Pm4IPtcysHpG+lQ3TjbCpUXObhfysP8M3qg5RVeHGF25k0\nujPnD25PZHjzSghHVddimAFkAt8AbswCekcZQJNODFERDix+Oxg2aTE0okNZxSxYe4ilmzIod/uw\nWS0M7ZnEuEHt6NEhLij94easnB38cHApm3O2YWDgskdyfuo5jGo7nMTIVgGd56xeyZS5vbz1pWbP\n8u5cdmEP5h+azxtb3mVTjuYqdRkR9tDMHjlSmsXKjDUsT19NXkU+AG1cyYxMGcqwNoOCvg7hdJZt\nymDGl9vweP1cenYnLh3VGWuQxyxsVit3XtaHf7+7lqWbMoiPDuPn53St9XnObX82Dqudd7fN4dm1\nr3FP/1voHNtwY0OFpW6+XnGAb9ccpMLtIyrCwRXndmXswHa16iJriqqLfhDmXgoXYC5oew/4Rmvd\n5AeeAaxWC9ERTrxeKYvR0Lw+P2t3ZLNgzUG27Tff5OKjw7jorFTG9G9bq4E3v+Gn1FNGiaeEEm8p\nJZ6T/5SwLXcH2eXmlpSdYlIZ024EA5P61WnfgHMHtKOswssHC3bx3bcR/Ornd/PRno9YeWQNuwv2\ncGOva+ga16nW5z2V7LJc1mSuZ82R9RwoPgxAuC2Ms9sOY0TKMDrFdGjQwmlb9uYydd4WIsLs3DWp\nDwO6ha6rKsxp494r+/HEzNV8vmwfCdFhjB1U+y21zm57Fg6rg5lbZ/P8ute4q9/NIS8Jnl9cwZc/\n7uf7dYdwe/zEupxMGtWZcwe0I8zZMor+WQyj5s3TlFJDMJPEWMxyGO9prb8PbWinZNRmu79HX/+R\n3KRvsUUV8cy5jzeJgcSmJNjbJ+YVVbBw3SEWrj9MQbEbgLSO8Ywb1I4B3Vtjsx6//37Dz8Hiw+wr\nPECxu5QSb8lP3vBLPKWUectPqKdzKg6rg6HJAxjdbgSpMcHZr++jhbv4fNk+2ie6eOCa/ixM/56v\n9i0A4KJO53Fxp/N+snI3kPuZV57PmswNrM5cz77CA4A5HTMtoQeDk/ozIKkvYY2wSr+4zMNj01dQ\nWOLmkesH0zklpkGum5lXyuMzV1Nc5uFXl/dlYA9zILm2v5trMzcyffMsbBYbd/a7iZ4J3YMea25h\nOfOX72fh+sN4fX7io8O4ZHhHRvdLwelo2gkhMbF2+xsHlBiOUkqNBp4E+muta2zbKqWsmAvkFOYU\n1zu11luqHJ8IPAp4gDdO2u7zVGqVGP7v3bXscnyHLeEI/xr9GFGO5r1iMtiCkRiOlgb+bu0h1m7P\nxm8YRITZObtvG8YObHfCfPXsslx07g625e1A5+2kxFN6ynNaLVZcjkhcDhcueyRRjsjjj499ffxx\nfFhc0NceGIbB2//bzoI1h+jaNobfXT2AAyX7eXPLe+RV5FeuF7iG1hHHu6lOdz8LKopYm7WBNUfW\ns6tgLwAWLKj4bgxO7k//xD64HI234tUwDF6eu5lV2zK5fEwXJo7s1KDX35NeyL/eWYNhwIPXDKRb\nu9g6/W5uyt7K1E0zAbi1zxT6tu4VlPiy88v4Yvk+Fm9Mx+szaB0bziXDO3J23xQc9ubxYTOoiUEp\nZQHGYJbCuBhYB3wAfKa1Lqnp5Eqpy4CJWutblVLnAL/VWk+qPGYHtgKDgTJgCTBea51VzSlrlRhe\n/XQza0q+w558gD8Ou79JzFxoSuqTGPx+gwVrD/HdmoOk55hv8B2Sohg3qB3De7UhzGmj2FPC9rxd\nZjKo0t0DEBcWS8/47nSL60xsWMwJb/ThtrAG7UI5Hb9h8Pq8LSzbfIS0jvHcd2U/PIab9/QcVmeu\nJ8zm5KoelzOszSAsFssJ97PYXcK6rI2sztzAjrxdGBhYsNAtrjODkvozMKlvg40b1GTppnSmzdtK\nt/axPHTtIKzWhr/3G3Zl89yHG4kMt/PwlEH069mmTr+b23J38MqGGfgMHzf3vo6BSX3rHNORvFI+\nX7qPZZsz8PkNkuIjGD+iIyN6t6nz5IjGUtvEUN2spJeBi4C1wGzgD4Ekg6q01nOVUp9VPuzEifWV\n0oAdWuvCyustxkxCH9XmGtWJjnRg5B+fstoWSQzBUO728srczWzYlYPdZmFE72TGDmpPanIEuwv3\n8eWBr9mWu50DRYePdQOF28Lp17o3PRO60zO+G0mRiU3izb86VouFX16SRlmFj3U7s3ll7mbuvrwP\nv+x9LX1ap/G+/pi3tr7P5pxtXK0up8RtY1n6KlYfWYfO24nfMIfjOsd0ZHCymQziwgIvB9EQsvPL\nePvr7YQ7bdw2oVejJAWAfl1bc8NFihnzt/H07PU8dV/dVjX3TOjOrwbcykvrX2f65lncbb+ZtIQe\ntTpHXlEFny7Zw6L16fgNg5RWkUwY2YlhaUkndIe2ZNUNPt8B5AADK/88oZQ6dlBrHdAIj9bar5Sa\nAUwCrqhyKAYoqPK4CAjq/5pYWcsQdHlFFTz7wXr2ZxbTq3M848fGc7BsL/Mzl7Jrxx48fi8ANouN\nbnGdUfHd6ZnQjdTo9s1yNy67zcpdk3rz9Oz1rN2RzRtfbOPm8WkMazOILrGdeHPLu6zOXI/O20m5\nrwJv5c+fGt2ewcn9GZTUj4TwxlkHURO/32DqvC2Uu33cMj6t0ev1jOlvLoCbu3gPj01dxjXjutO1\nXUytP0B0i+vMXf1u5oV1U5m2cSb3DbqLDtFta3xdSbmHL5bv45tVB/F4/bRJiGTS6M4MUUmNljAb\nS3WJoXOwLqK1vkkplQSsUEqlaa3LgELM5HBUNJBf07kSEwNfZNM2OQZjvZkYfA53rV57pqjNPdl9\nqIAn3l5NrjuLbsMKyQlbzAubio8dT41tR7/knvRt05O01t0IdzTNOjB18dc7RvLoq0tZuimDhLgI\nbp/Ul0RLNI+3f5CPt37Jx1u/ol10MiNSBzOyw2DaRCc1dsg1+uDb7ew4WMDZ/dpy2djuTaIFd8uk\nvlT4DL5ctpcn3l6NSo3nsnO6MrJvCrZadN8kJvbHEvFLnln6Oq9snM7j5/+eRNeppy2Xu73MW7yH\nD7/bQUmZh1ax4Vx7YU/OG9KhVtdsSWo1+FxbSqkpQHut9ZNKqRjMbqleWuuKyjGGzZgrqkuBpZjj\nEenVnLJWYwzrdmbz/PxFhPdexnkdxjC5+4S6/zAtUG3GGFZuP8T0pd9CwgGsUWZDL8rhok/rNHrG\nd6dHfLdmWfGyNorLPPzrnTUcyiph4shOXD7meKPZMAySkmKCOssrlPZmFPL4W6uJjnTwt1vOalIr\ncw3D4EiRm9lfa9bvzMYAWsWEcd7gDozp35bI8MDXCCw4sJgPd3xKcmQSvxt89wmD/F6fn8Ub0pm7\nZA8FxW5c4XbGj+jEuEHtmvwso9oK2hhDkMwB3lBKLay81n3AZKWUS2s9TSl1P2ZJbwswrYakUGsx\nkU6orJckez/XnmEY7MzfzZxNC9lXvh1rqv/YSuIRKUPp0zoNu7V5L+SpjagIB7+7agD/fHs1ny3d\nS0SYnYvOMhdUNYVP24Gq8Ph47dMt+PwGt4wP3qrmYLFYLPTt2po2V4SRkVvK/1YdYMnGdGYv2Mnc\nJXsY068t5w9pH1DX19gOo8grz+fbAz/wyoYZ/HrAbditdlZty+TjH3ZzJK8Mp8PK+BEdufis1Ga7\nUjnYQtpiCIFatRiy88v4/atLiBj6NT3iu3HvwNtDGFrzc7oWQ35FAcvTV7Ps8Eqyy3PMb1a4GNV+\nKBf3OLvJDaA2tKz8Mv759mryi93cdHFPxvQ3+6+DvS4kVGZ+rVmw5hAXDOnANecHf75/MJx8L4vL\nPCxcd4hvVx8kv9iNxQKDeyTys2GpdGtX/e+j3/AzY7M5FtQlsgdF2/qxP6MYm9XCmP5tmXh2pyZf\n7bS+mlqLoVFFu5xgWLH6nTL4XAOv38um7K0sTV/JlhxtTq80bHhz2hLn7sYD48eRGN80dpdqbIlx\nEfzu6oH8a9Ya3py/jXCnjWFpyY0dVkA27MpmwZpDtGvt4opzQ7tCOJiiIhyMH9GJC4elsnJrJl+t\n3M8qncUqnUWXtjH8bGgHBqvEU84aslqsjI6/mM0H09nNdrxh5QxNO4fJY7qSLL/Tp9SiE0OYw0aY\n04bFG06RFNI7pcPFGSxLX8mKjDUUe8zZyO1d7SnYn0zm3jjS2idxzxV9pIl9knatXfz2F/35v3fX\nMvWzLYQ77ZzXxCc3FJa4mf75Vuw2C7dN7IXD3vz60e02KyP6tGF472S2H8jnqxUHWF85lbhVTBjn\nD+nA6H7HxyHSc0r4+IfdrNJZYOtLbP9VkLyfbl1zSI6v+xqHlq5FJwaA2EgnxW4nJc5CPH4vjjOo\nT7w6q4+sZ9G6JezI3QuYA8njOoymS1hvZs1LJ7ewgtH9Urj+QtXsFvM0lM4pMdx7RT+emr2elz7e\nyOZ9ecRFOkhOiCQ5IZKkuIgmszLWMAxmzN9GYamHX4ztFpQS2o3JYrGgUuNRqfHHxyE2pPP+dzuZ\nu3gPo/u1pcLjY/EGcy1C55QYrji3K22Sz+I/q1/kk11fEBcWy9AGqprb3LToMQaAx2eu4kD4Ymyt\nDvP3kQ832TnlDWnhwaXM3v4JFouFtIQejEwZRt/WaWzbW8BLn2yi3O3j5+d04ZLhHZvVoGpj2bAr\nm5fnbqbC7Tvh+xYLtIoJp01lomiTEElyfATJCZG0iglv0LnxC9cd4s0vNT1T43jgmoFBr5gabHUZ\nrzl5HAIgpVUkk8d0ZVCP1sd+lw8XZ/DUmpdw+zzc3f/mkNRVampCWiupCah1Ynj+ow1sLF+MI2Uv\nDw75VZPdsrGhLE9fxcyts4l2RvHXcfcT5jbLMny/9hBvf70dq9XCrRPSmk2feVPh8frxWa1s3ZnF\nkbwyMnJLOZJbSkZe6bGCglXZbRaS4s1EcTRxdEiKolOb6KAn4yO5pTz2xgrsVit/u2VYk91nuKr6\nDOR7fX7WbDcr65xu3GFH3i5eWDcNu9XObwfdRfsAFsA1ZzL4fJIYlxOKKlc/n+HjDGsyN/D21g9w\n2SP59YDbaB+bwpHMQj5csIsvV+wnKsLBb67oV+MsD/FTDruVtonRhJ+i56iswkvmScniSG4pGbml\nHM4+scpM9/axTB7TBZUanJat1+fntc+24Pb4ufmytGaRFOrLbrPW+MGme3xXbuh1NdM3z+Kl9dN5\nYMg90ptQRYtPDNGRUhYDzMqTb2x+hzCbk3sG3EK7qBTK3V5e/ngTq7dnkdIqknuv7E9SI5dFaIki\nwux0bBNNxzYn9usbhkFRqedYwli7I5t1O7P51ztr6d05gcljutS7/PW8pXvZk17IiN7J0go8yeDk\n/hRUFPDRznm8uO517j9pAdyZrMUnhphIxxmfGLbn7WTappmVtep/SceYDhQUV/DPWWvYcSCfnqlx\n3DO5Ly6ZedSgLBYLMS4nMS4nPTrEMbp/W3YdLuDjH3azeU8um/fkMrB7ay4f3YX2SbWvxLrzUAGf\nLd1Lq5gwrrtA1fyCM9C41DHkVRTw3YFFvLrhTX494FYcddjgqaVp+YnB5cQ4tvr5zEsMewr28fKG\nGRiGwR39bqR7fBcOZ5fw9Oz15BSWc3bfNtx4UU+ZedREdG0bywNXD2Tbvjzm/LDbbEXsyGZoWhKT\nRnehTUJgn2jLKrxM/WwzGHDrhF61KiNxprm823jyKwpYk7mBN7e8x819rjvjN/Vq8b8tMVW6ks60\ntQwHig7z4vrpeP1ebukzhV6tFHp/Hs9/tJHSCi9TLurJ2P4pMvOoCerZMZ6Hpwxi4+5cPv5hNyu2\nZrJqWxYj+7bh0rM70Tq2+i6/d7/dQVZ+OZcM7xi08YqWymqxckOvqylyF7M2ayMf7fiMK7pfekb/\nv2jxaTHG5QSvA4thPaO6kjJKMnlh3VTKveVcn/YLBiT2YfnmDP77/joqPD5um9CLqy5QZ/Qvf1Nn\nsVjo17UVf75pCHdP6kNyQgSLN6Tz8KvLmfX1dvKLK075utU6k8Ub0klNjmLS6KAVSW7RHFY7t/e9\nkRRXMt8fXMK3B35o7JAa1ZmRGLBgM8LPmMSQXZbL8+umUuwp4Wp1OUOTB/L5sr289tkWHHYb9/+i\nPyP6yKZFzYXFYmFIzyT+fstZ3DohjYSYML5dc5CHXlnG7AU7KS7zHHtuXlEFM+Zvw2G3cvvE3tJF\nWAuRjgju6X8LcWGxfLzzc1ZlrG3skBpNi/+tiQy3Y7VYsHjNxNDM1m3UWn5FAc+tfY38igImd5vA\niJRhvPWV5qOFu0mICeORKYNI65TQ2GGKOrBaLYzsk8Ljtw3nhosUrggHX/64n9+/vJRPFu2mtNzD\n9C+2UlLu5Rdju9G2texxXlvx4XHc3f9mwm3hvLV1NtvzdjV2SI2ixScGq8VCtMuB3+3E4/dS5i1v\n7JBCpshdzHNrp5JTnsslnS/g7DYjef6jjSxcd5jU5Cj+eP0Q2iU2jX2GRd3ZbVbOHdCOJ+8YztXn\ndcdht/Lpkr3c/8ISNu/JpU+XBMYNatfYYTZb7aJSuKPfjRgYvL11Nm6fp+YXtTAtPjGAOQDtLTen\noLXU7qRSTxkvrJvGkdJMzksdw8jWo/nXrLVs2JVDny4J/OHaQcRHt+zSwmcah93Gz4Z24F93juDn\n53TBbrMS43JyyyVpMnZUTz3iuzKuw2hyyvP4Zv/3jR1Og2vxs5LAXMuQXuHEgZkY2ria/raLtVHu\nreCl9a9zsPgwo9oNZ1jMOTwxczU5hRWM6d+W6y/sccZsYn4mCneaO4+dP6QDPp8hU1OD5OJO57Ei\nYw1f71vAWW2G0CrizJnddUa8W5hrGVrmIje3z8OrG2awp3A/Q5MH0T/sXP45ay05hRVMHtOFGy9S\nkhTOEGEOmySFIAq3hzOp6yV4/F4+3vV5Y4fToEL2W1S5p/N0oBPgBB7XWn9W5fj1wANAPvCm1np6\nqGJpqWUxvH4vr2+ayfb8XfRP7EN3YwxPz14PwG0TezGit8w8EqI+hrYZyKJDy1mbuQGduxOV0K2x\nQ2oQofwoOQXI1lqPAS4GXjh6QCnVCvgbMAY4F7hOKRWysqexruN7P7eUQno+v48ZW95jU842eiX0\nILnwbF6ftw2nw8b9Vw2QpCBEEFgtVn7R4zIsWPhgx1x8fl/NL2oBQpkYZgOPVrlO1aH9LsA6rXWB\n1toAVgLDQxVIdKQTw91yWgx+w8872z5ibeYGusZ2Jjx9OHMX7aPV0emoHc+cvlAhQi01pj0j2w4l\nveQIiw4tb+xwGkTIupK01qUASqlo4APgj1UO7wB6K6USgRLgPECHKpYY1/FCepml2RS7S4hyNs85\n3gUVRXy4Yy5rMjfQIao9/t1DWLIrk47J0dx7Zb8Wv6m5EI1hYpeLWJO5gXl7vmZwcn+inS172ndI\nN+pRSnUA5gAvaK3fPOnYBOD3QA5wBPi86hjEadQp2J0H8vntMwuJHbYQN2UAJLpa0TWhI90SOtI1\noRNd4lOJcIS+Vn16dglb9+YeGyh0RTiO/e0Kd+B0nHofXq/fx5c7FvDBps8p85bTKTaVsi2D2Huo\nnCFpyfz++iFEhMnAoxCh8sX275ix9gPO6zKKO4Ze19jh1FbT2KhHKZUMfAXco7VecNIxGzBIaz1G\nKeUEvgYeCeS8ddnVyec2e7FSS8+je69y9hUdYH/hQZYfWMPyA2sAsGAhOTKRjjEdSI1pT6eYDrSL\nahuUPaIPZ5ewWmeyWmexP7O42ufabRYiwuxEhNmJrPzb78oiM3Il5dYCHITRL+xctv8YQ15hOecM\naMuUn/WguLCM6s/8U/XZJUv8lNzP4GmK93JQ7CC+cv3Ad7uXMCRhEKkx7Rs7pIAlJtZuj+9QfsR8\nGIgDHlVK/Rnz0/5UwKW1nqaUQim1BigD/qu1zg1VINGR5sCztyiaCV3GAOYmKTnleewrPHAsUewv\nOkhGRiY/ZqwGwGax0S6qDakxHegY3YGOMe1JcSXXWJLXMAwOZpWwalsmq7dnHduly2Y1i6L16ZyA\ngVka+eif0grf8a/Lzb/zy/Oh3RZsUUcwDPAd6UDZoe786HUCbtmXWYgGZLPauLL7ZTy37jVmb5/L\n7wbf3WL/77X4PZ+PuufpH0iICePvt5x12uf4DT9HSrPMZFF4kH1FBzhUdBivcXwmgtPmpFeCYmib\ngfRu1fNYi8IwDPZmFLFaZ7FKZ5KZZ3ZZOexW+nROYIhKon+3VkQGsBmOx+fh2wM/8OXe7/D4PaRG\ndeCidhcTZ0umtNxDaYWPhJiweu/u1RQ/lTVncj+Dpynfy2kbZ7I2ayM3pF3FWSmDGzucgMiez6cR\nE+mgqOSnm7JXZbVYSXElk+JKZnjKEMBcK3CoOP1YothdsJd1WRtZl7WRCHsEXV0KS347dmo7uYVm\nGeQwh40hPZMYohLp17UV4c7Ab/PG7C18uP1TsstziXZGcU3XyQxtM/CM3zhEiKbi8m4T2JSzlU92\nfUH/xN6E21vePtpnTmJwOcnML8PvN7BaA0+edqudjjEd6BjTARiBz+dn2e7tLNy3ksNlO9jkXQeW\nddAlnFS6cnb7IYzpoQirRTIAc7bURzs+ZVPONqwWK+M6jOaSzucTYZc9mIVoSlpFxHNBx7F8sed/\nfLn3OyZ1u6SxQwq6MycxRDoxDCgu81Tu0VA7peVeFqw9yDerDlJQ4gbaERmeSnflw5JwiH22HWT5\nNvNJ5mZ+LElmaPJAhiQPrLG+SoXPzVd7v+Pb/Qv/v707D66qvgI4/n1ZzELIHiCBEhDCUSBA2EJE\nZMJCiWsAAAsWSURBVBEsYAUtbafW2o64MMqoM1pbsVp1bGurg0XrVFulSK21FRQEN6yFqegAskQE\nCSdsIrKVBEggCUvI6x/3Bt4LEcnyuHnJ+cww3HfffS8nv7l55/7u7/3Oj2r/KXql9OT7OZPISrAJ\nasa0VOO6jmLl3jUs3bWcgqwhdIzP8DqkZtVmEkN7NxmUV55oUGIorzjBv9fsYum6r6g6foq4mEhG\nDshisHRAuiafXgjl5KmTbCzdzOr9hXxeUsSi7e+xaPt79EjqxpBOeeR16EdC9Jm5E36///QygoeP\nl5Eck8SUnGvIy8httQNaxrQWF0VGM6Xnd3hh48vM37KIO/pNbVV/t20mMSTGu2W3K07AeST3krIq\nlqzaxYef7eFkdQ2J8dFMHJnN6Lwu9RYqi46MJq9DLnkdcqk8WUnhgQ2s3lfI1sM72Fb2BfOKF9E7\nrRdDOuaREZfOgq1vU3x4G1G+SMZnj+GqbmOIiWx4T8YY443+GX2RlJ5sKlU2lhaRm97b65CaTdtJ\nDAE9hnPZU1LBuyt3snLTfk7V+ElLjGV8fldG9Mv82slndcVHxzM8K5/hWfkcOnaYNfs/ZfX+QjaU\nFLGhpOj0cX3TLmFKziQ6xKc3/hczxnjC5/PxvZxJPL56FvO3LOaS1F7NMu+pJWgdv8V5SHTnMhyp\nqH81ph17y3lnxU7WFR/AD2SmxTNxWDb5vTs2ad3clNhkxmWPYlz2KPYc3cfq/YXsObqXyzsPa1VX\nGMa0RVkJnRjZ5TKW7fqIZV8u56puo70OqVm0ncRQT4/B7/ez+cvDvLPiCz7/4hAA3TPbc3VBNwbk\npBPRzPcMsxI6MTlhQrO+pzHGWxO7jWP1vkLe3fkfhmYOJDkmyeuQmqzNJIb2AWMMNX4/67eW8M6K\nnWzbUw7ApdkpTCzIpnd2SqsaRDLGhFZ8dByTe0zglc3zWbD1bW7q8yOvQ2qyNpMYktweQ/FXZTw8\n+xN2u2Uq8nLSmViQTY+s8M/yxhhvDMsczPLdK1mz/1NGdC6gZ3J3r0NqkjYznTYuJoqoSB/7D1ay\nt7SSgj6deOzmodw5pZ8lBWNMk9Qu6AMwr/hNavw1HkfUNG2mx+Dz+fjuFT04dOQ4Ywd3ISPZZhQb\nY5pP96Rs8jsNYtW+tXy8ZxUjOhd4HVKjtZnEADA+P2SrhxpjDJN7TGD9gY0s3raEgR360y463uuQ\nGqXN3EoyxphQS4pJZEL3sVRUV/LW9ve9DqfRLDEYY0wzGtVlOB3jM1i+ewW7j+71OpxGscRgjDHN\nKCoiiik5k/Dj57XihYTZmjdAaJf2jAL+CnQDLgJ+E7ims4jcANwDVANzVPX5UMVijDEXUp80ITe9\nNxtKNvGL5Y+SHpdGelwqaXGppMelkh7rPE6OSSIy4vxK7VxIoRx8/jFQoqo/EZEU4FNgccDzTwKX\nApXAJhF5VVXLQhiPMcZcMD+U64jyRbKnYh+7j+5h55FdZx0T4YsgLTaF9Lg0J2nEpp5OIulxqZ6t\nxxLKxPAaMM/djgDqFilaD6TgrAVNwP/GGBP2kmOSuCX3RsBZNrjseDklVQcpOXaQkqpSSqpKKa06\nSEnVQYoOFtf7Hu2i4+memM20fj+9oKs4hiwxqGolgIi0x0kQv6xzyOfAWuAo8IaqlocqFmOM8VKE\nL4KU2GRSYpPJ4eKznj9WfZzSY06SKK0qdZOHk0DKTpRTXXOKi5pQzLOhQjqPQUS+BbwBPKuq/wrY\nnwtcDWQDFcArIjJFVV8PZTzGGNMSxUbF0Dkhk84JmV6HAoR28LkjsASYrqrL6jxdhjO2cFxV/SLy\nP5zbSt/El5HRvpkjbdusPZuXtWfzsbb0ji9UX6USkVnAD4DNgA9nDOEFoJ2qvigi04CpwHFgG3Cr\nqlaHJBhjjDHnLWSJwRhjTHiyCW7GGGOCWGIwxhgTxBKDMcaYIJYYjDHGBAmL9RhExAf8CegPHANu\nUdXt3kYV3kRkLc7XhgF2qOrNXsYTjkQkH/idqo4WkR7AS0ANsFFVp3saXBiq054DgLeA2inBz6nq\nvK9/talVX506YBMNOD/DpcdwLRCjqpcBM4CnPI4nrIlIDICqjnH/WVJoIBG5D+fr1zHurqeAB1R1\nJBAhIpM9Cy4M1dOeg4CZAeeoJYXzV1un7gpgPPAsDTw/wyUxXA68B6Cqq4DB3oYT9voD7URkiYh8\n4F6pmYbZClwX8HiQqi53t98Fxl74kMLaWe0JXC0i/xWRF0WknUdxhaPXgIfc7UicCtYDG3J+hkti\nSOTMbQ+AahEJl9hbokrgSVX9NnA7TkkSa88GUNUFOH9wtXwB20eApAsbUXirpz1XAfe5V7jbgUe8\niCscqWqlqlbUqVPXoPMzXD4MyoHA+fERqlrjVTCtQDHwCoCqbgFKgZZRpCV8BZ6P7YHDXgXSSixU\n1UJ3ewEwwMtgwo1bp24pMFdV/0kDz89wSQwfAxMBRGQYsMHbcMLeVGAmgIhk4Zwo4bkGYcuxTkSu\ncLcnAMvPdbD5RktEpPaW8ZU4lZjNeQioU/dzVZ3r7i5syPkZFt9KwrliGCciH7uPb/IymFZgNjBH\nRJbjXElMtR5Yk/0MeEFEooEiYL7H8YS724E/isgJYB9wm8fxhJMZQDLwkIj8CqdO3d047Xle56fV\nSjLGGBMkXG4lGWOMuUAsMRhjjAliicEYY0wQSwzGGGOCWGIwxhgTxBKDMcaYIOEyj8GYBhGRSOB+\n4AacuRqRwN9U9XEPYukGPKiqt4jIIGCaqtr38k2LZT0G01o9h1NsMV9V+wJDgCtF5HYPYukGXAyg\nqmstKZiWzia4mVZHRDoDCmSpannA/l5AH5wSK38GuuD0Jmao6lIReRjoDOQAXYHZqvpbt8Dgk8BI\nnJ7HS6r6tIiMBJ7AucDaiFOsbDZOgbJM4FVVfUBE1gPdgbk4M04fcdcc6OXGkQocBe5S1bUiMgen\naOQgN55HVXWuiFwJ/N6N+RBwvaoeDEUbmrbNegymNRoKbApMCgCqWuxW8Xwa50N/CDAZ+EtAWedc\nnJLEw4D7RSQRuBXwq+pgIB+4VkSGu8fnAKNV9SbgeuAf7roh/YHpIpIK3AWsUdU73dfUXo29DMxS\n1f7APcDrbskCgC6qOgKYhFvXCifxTFPVocBiYGAT28mYetkYg2mtTneFRWQK8CDOhdBxnKt3EZHH\n3EMigR7u9jJVPQUcEJFSnKv/sUB/94odoB1OAikCVFWP4mzMFJFRInIv0BeIdo89i5uIeqrqm+5r\nV7k/T9xD3nf3bxSRFHffImChiCwE3lTVDxrZNsack/UYTGu0FugtIgkAqvq6qubhXH1n4Jz3Y1Q1\nz91/Gc6tIHCWjq3lx6ljH4lTqbL2+AJgjntMVe3BIjITuBPYAfwap5x5YB38QBH1PBfBmYu1Y3We\nQ1Vn4dzO2gI8ISIzztUIxjSWJQbT6qjqlzi3aeaKSBKAO05wDc5iMEuB6e7+3sBnQFw9b1X7wb0U\nuE1Eotxk8xHOLaW6xuIsgPQGzhhFFmdW0ArqnavqEWCriFzrxjEM6MiZBHUWEVkJJKrqM8AfsFtJ\nJkQsMZhWSVXvwBlkXiYi63DW8MjDqUV/FzDMHRR+FbhBVSvqeZva21HP4yxuVAh8gjM+8WE9xz8O\n/F1EVgP3AmtwblsVAckiMrfO8TcCd4vIZ8AzwHWqWh3wc+t6AHhJRNbgjHs8/A3NYEyj2LeSjDHG\nBLEegzHGmCCWGIwxxgSxxGCMMSaIJQZjjDFBLDEYY4wJYonBGGNMEEsMxhhjglhiMMYYE+T/luIX\n9zEfml8AAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x104dddc90>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "pops_mating, pops_stats_mating = evolve_with_mating(\"(((....)))\", generations=20, pop_size=1000, beta=0)\n",
    "\n",
    "evo_plot(pops_stats_mating)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Hardy Weinberg Equilibrium\n",
    "\n",
    "When we are presented with data from a population we don't know much about. It is often useful to try to learn whether there are any evolutionary or behavioural influences that are shaping population dynamics. This could be in the form of selective pressure, mating preference, genetic drift, mutations, gene flow, etc. So in order to detect if something like this is happening we need to develop a test. This is where Hardy Weinberg comes in. \n",
    "\n",
    "The Hardy Weinberg equilibrium states that \"allele and genotype frequencies remain constant in the absence of other evolutionary influences. (such as the ones we mentioned above)\" - Wikipedia.\n",
    "\n",
    "So if we can measure allele/genotype frequencies (which we can do because we have sequences), we can see whether the HW principle holds true. If it does not, then we can do more digging to see what could be happening to shift populations away from equilibrium.\n",
    "\n",
    "In order to do this we need to define an 'allele'. An allele (for our purproses) will be a locus (position in a sequence) that can take one of two states, a *reference* state or an *alternate* state. For example, we can look at locus number **5** (position 5 in our RNA sequences) and call reference **C**, and alternate **G**. If we are in HW we can predict the frequency of each allele in our population.\n",
    "\n",
    "To simplify our notation we will call the alternate allele *A* and the reference allele *a*. We can write the probability of each allele as $p_{A} + p_{a} = 1$. Since we are dealing with diploid populations, each individual will have two copies of each locus so it can be $p_{AA}, p{Aa}, p{aA}, p{aa}$. By simple probability laws we can get an expression for the probability of each genotype based on the probabilities of the single loci $p_{a}$ and $p_{A}$.\n",
    "\n",
    "$$p_{aa}\\simeq p_{a}^2$$\n",
    "\n",
    "$$p_{AA}\\simeq p_{A}^2$$\n",
    "\n",
    "$$p_{Aa,~aA} \\simeq 2 p_{a} p_{A}.$$\n",
    "\n",
    "Since it is hard to know what the true probability of observing either $p_{a}$ and $p_{A}$ we can estimate this probability from our data as follows:\n",
    "\n",
    "$$\\hat p_a=\\frac{2N_{aa}+N_{aA}}{2N}=1-\\hat p_A.$$\n",
    "\n",
    "Where $N$ denotes the number of each genotype that we observe in our sequences. \n",
    "\n",
    "Based on these estimates we can expect the following frequencies for each genotype: \n",
    "\n",
    "$N_{aa}\\simeq e_{aa}=N \\hat p_a^2$\n",
    "\n",
    "$N_{AA}\\simeq e_{AA}= N \\hat p_{A}^2$\n",
    "\n",
    "$N_{Aa,~aA} \\simeq e_{Aa} = 2 N \\hat p_{a} \\hat p_{A}.$\n",
    "\n",
    "Now we have expected values, and observed values. We need a test to determine whether we have a significant departure from the hypothesis of Hardy Weinberg equilibrium. The statistical test that is commonly used is known as the $\\chi^{2}$ test. If you take a look at the equation you'll see that the statistic simply takes the squared difference between our observed value and the expected value (divided by expected) and sums this for each possible genotype. The reason we take the squared difference is because we want to deal only with positive values, hence the name $\\chi^{2}$.\n",
    "\n",
    "$$X^2= \\frac{(N_{aa}-e_{aa})^2}{e_{aa}}+ \\frac{(N_{Aa}-e_{Aa})^2}{e_{Aa}}+ \\frac{(N_{AA}-e_{AA})^2}{e_{AA}}.$$\n",
    "\n",
    "The first thing we need to do is get alleles from our sequence data. This boils down to going through each sequence at the position of interest and counting the number of $AA$, $Aa$, $aa$ we get.\n",
    "\n",
    "\n",
    "\\** the sections on Hardy Weinberg and F-statistics are adapted from Simon Gravel's HGEN 661 Notes"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "def allele_finder(pop, locus, ref, alt):\n",
    "    genotypes = []\n",
    "    for p in pop:\n",
    "        #get the nucleotide at the locus from the first chromosome \n",
    "        locus_1 = p.sequence_1[locus].upper()\n",
    "        #same for the second\n",
    "        locus_2 = p.sequence_2[locus].upper()\n",
    "        \n",
    "        #check that it is either ref or alt, we don't care about other alleles for now.\n",
    "        if locus_1 in (ref, alt) and locus_2 in (ref, alt):\n",
    "            #if the alelle is ref, store a value of 1 in allele_1, and 0 otherwise\n",
    "            allele_1 = int(locus_1 == ref)\n",
    "            #same for the second allele\n",
    "            allele_2 = int(locus_2 == ref)\n",
    "        \n",
    "            #add allele to our list of alleles as a tuple. \n",
    "            genotypes.append((allele_1, allele_2))\n",
    "    return genotypes"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "[(0, 0), (1, 1), (1, 1), (0, 1), (0, 0), (0, 0), (0, 0), (1, 1), (0, 1), (1, 1)]\n"
     ]
    }
   ],
   "source": [
    "pop_hw, stats_hw = evolve_with_mating(\"(((....)))\", pop_size=1000, generations=10, beta=0, mutation_rate=0.005)\n",
    "alleles = allele_finder(pop_hw[-1], 5,  'C', 'G')\n",
    "print(alleles[:10])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now that we have alleles represented in the right form, we can see if our population is at Hardy Weinberg equilibrium using the $\\chi_{2}$ test and the equations above."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "(Power_divergenceResult(statistic=0.18676001137908932, pvalue=0.66562702455131029),\n",
       " {'alt_counts': 271,\n",
       "  'genotype_count': 267,\n",
       "  'het': (137, 133.47003745318352),\n",
       "  'hom_alt': (67, 68.76498127340824),\n",
       "  'hom_ref': (63, 64.76498127340824),\n",
       "  'ref_counts': 263})"
      ]
     },
     "execution_count": 44,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "from scipy import stats\n",
    "from scipy.stats import chi2\n",
    "\n",
    "def hardy_weinberg_chi2_test(alleles):\n",
    "    \n",
    "    #store counts for N_AA, N_Aa/aA, N_aa\n",
    "    hom_ref_count = 0\n",
    "    het_count = 0\n",
    "    hom_alt_count = 0\n",
    "    \n",
    "    #each allele in the list alleles is in the form (0,0) or (0,1) or (1,0) or (1,1)\n",
    "    #count how many of each type we have\n",
    "    for a in alleles:\n",
    "        if (a[0]==0 and a[1]==0):\n",
    "            hom_ref_count += 1\n",
    "        elif ((a[0]==0 and a[1]==1) or (a[0]==1 and a[1]==0)):\n",
    "            het_count += 1\n",
    "        elif (a[0]==1 and a[1]==1):\n",
    "            hom_alt_count += 1\n",
    "        else:\n",
    "            continue\n",
    "    \n",
    "    #total number of genotypes: N\n",
    "    genotype_count = hom_ref_count + het_count + hom_alt_count\n",
    "\n",
    "    #estimate p_a, p_A\n",
    "    alt_counts = (2 * hom_alt_count) + het_count\n",
    "    ref_counts = (2 * hom_ref_count) + het_count\n",
    "    \n",
    "    \n",
    "    #get expectations e_AA, e_aA,Aa, e_aa\n",
    "    hom_ref_expectation = ref_counts**2 / (4.*genotype_count) # the expected number of homozygote references  \n",
    "    het_expectation = ref_counts * alt_counts / (2.*genotype_count)  # the expected number of hets  \n",
    "    hom_alt_expectation = alt_counts**2 / (4.*genotype_count)  # the expected number of homozygote nonreferences  \n",
    "\n",
    "    #store observed values in list in the form [N_AA, N_aA,Aa, N_aa]\n",
    "    observations = [hom_ref_count, het_count, hom_alt_count]\n",
    "    #store expected values in the same form\n",
    "    expectations = [hom_ref_expectation, het_expectation, hom_alt_expectation]\n",
    "    \n",
    "    #start a dictionary that will store our results.\n",
    "    statistics = {\n",
    "                'hom_ref': (hom_ref_count, hom_ref_expectation),\n",
    "                'het': (het_count, het_expectation),\n",
    "                'hom_alt': (hom_alt_count, hom_alt_expectation), \n",
    "                'ref_counts': ref_counts, \n",
    "                'alt_counts': alt_counts,\n",
    "                'genotype_count': genotype_count\n",
    "                }\n",
    "\n",
    "    #call scipy function for chi2 test.\n",
    "    chi_2_statistic = stats.chisquare(observations, f_exp=expectations, ddof=1, axis=0)\n",
    "    \n",
    "    #return chi2 and statistics dictionary\n",
    "    return (chi_2_statistic, statistics)\n",
    "\n",
    "hardy_weinberg_chi2_test(alleles)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Can we say that our population is at equilibrium? Can you find parameters for `evolution_with_mating()` that will give us populations outside of the HW equilibrium?"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## A brief interlude on the p-value\n",
    "\n",
    "Let's take a minute to understand what the p-value means. The p-value is a probability. Specifically, it is the probability of observing a value equal to or more extreme than that our statistic given the test distribution. So in our case, it is the probability of observing a $X^2$ greater than or equal to the one the test gives us under a $\\chi^2$ distribution. When this value is very small, it suggests that it is unlikely that we are sampling from our assumed 'null' distribution and that some other alternate distribution is the true distribution. So a low p-value here would be evidence against the neutral Hardy Weinberg model and would suggest that our population is experiencing some influences such as mating preference, selection, mutation etc.\n",
    "\n",
    "A lot of research bases its conclusions solely on p-value and it is important to be very wary of this bad practice. It has become a bad convention that people say a p-value lower than some arbitrary threshold means one's findings are significant. However, very often the p-value does not give us the whole story and we need to know about things like sample size, size of impact, reproducibility, power of the test, etc. (check this out [American Statistical Association statement on p-values](http://www.nature.com/news/statisticians-issue-warning-over-misuse-of-p-values-1.19503), [p-hacking](http://fivethirtyeight.com/features/science-isnt-broken/#part1), and [this](http://allendowney.blogspot.ca/2016/06/there-is-still-only-one-test.html))\n",
    "\n",
    "Let's just visualize this very quickly using the $\\chi^{2}_{1}$ distribution. You will see that the p-value corresponds to the shaded red area under the curve. That area is the probability of observing a value as extreme or more than the one we found. When that is a very small area, we can be more confident that our assumption of HW is false."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "<matplotlib.text.Text at 0x10baa0a50>"
      ]
     },
     "execution_count": 45,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAYUAAAERCAYAAACU1LsdAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAGDNJREFUeJzt3XuUZWV55/HvPufUvau76e7qBuQaRl8xYQSJ0SCKErzg\nigRnXMtkFmY0iZMYZpxMRhzwmsTRcc0YzUwckhkTCV6i0Sgo4yheBgW8ERIUUXnAcBEDSHUDTV+r\n63Lmj33qdNNUV1d1167d76nvZ61aZ5/T7z7neaur69fvu/d+d9Fut5EkCaBRdwGSpCOHoSBJ6jIU\nJEldhoIkqctQkCR1GQqSpK5WnR+eUroUuADoAy6PiCvqrEeSVrraRgoppXOAX4yIs4DnA8fXVYsk\nqVTnSOHFwG0ppauBUeCSGmuRJFFvKGwATgB+GfgZ4LPAU2usR5JWvDoPNG8Bro2IqYi4A9idUtpQ\nYz2StOLVOVK4EXg98L6U0rHAMGVQzKndbreLoliu2iSpVyzqF2dR54J4KaV3A+dSFn1ZRHx5nubt\n8fFty1NYDcbGRrF/+erl/vVy32BF9G9RoVDrKakRcWmdny9JejwvXpMkdRkKkqQuQ0GS1GUoSJK6\nDAVJUpehIEnqMhQkSV2GgiSpy1CQJHUZCpKkLkNBktRlKEiSugwFSVKXoSBJ6jIUJEldhoIkqctQ\nkCR1ZRMKW7dP1F2CJPW8bELhord/gX8a3153GZLU07IJBYBHd+ypuwRJ6mlZhQLtuguQpN6WVSi0\nTQVJqlRWoSBJqlZeoeBAQZIqlVUomAmSVK2sQkGSVK2sQqHtUEGSKpVVKDiBJEnVyiwUJElVatX5\n4Smlvwe2dp7eHRG/OV97p48kqVq1hUJKaQAgIs5d6D5mgiRVq86RwtOBkZTStUATeHNEfLvGeiRp\nxavzmMJO4L9FxIuB1wEfTSnNX49DBUmqVJ2hcAfwUYCIuBPYAhwz3w6ufSRJ1apz+ug3gNOAi1NK\nxwKjwAPz7bBm9RBjY6PLUVsterlvYP9y1st9g97v32LUGQp/CVyRUroBmAF+IyJm5tth69ZdjI9v\nW5biltvY2GjP9g3sX856uW+wMvq3GLWFQkRMAhctZh8njySpWl68JknqyioUvHhNkqqVVSg4gSRJ\n1cosFCRJVcoqFJw+kqRqZRUKkqRqGQqSpK6sQsHZI0mqVlahIEmqVlah0PZIsyRVKqtQkCRVy1CQ\nJHVlFQrOHklStfIKBc8/kqRKZRUKkqRq5RUKDhQkqVJZhYKZIEnVyioUJEnVyisUHCpIUqWyCgXP\nPpKkamUVCpKkamUVCl68JknVyioUJEnVMhQkSV1ZhYLTR5JUrbxCwbOPJKlSWYWCJKlaeYWCAwVJ\nqlRWoWAmSFK1sgoFSVK1WnUXkFLaCNwMnBcRd9RdjyStZLWOFFJKLeDPgZ0Lad/2nFRJqlTd00fv\nAf4MuL/mOiRJ1BgKKaVXAw9FxJeAYiH7OE6QpGrVeUzhNcBMSumFwOnAh1JKF0TEQwfaYdWqQcbG\nRpetwOXWy30D+5ezXu4b9H7/FqO2UIiIc2a3U0rXAb89XyAAbN+2m/HxbZXXVoexsdGe7RvYv5z1\nct9gZfRvMeo+pjBrQTNDTh9JUrVqPyUVICLOXVBDzz6SpEodKSMFSdIRIKtQcJwgSdXKKxRMBUmq\nVFahIEmqVlah4DIXklStvEKh7gIkqcflFQqmgiRVKqtQMBUkqVpZhcKMmSBJlcoqFCRJ1coqFDz7\nSJKqlVco1F2AJPW4vELBkYIkVSqzUKi7AknqbZmFgqkgSVXKKxTqLkCSelxeoWAqSFKlMgsFU0GS\nqpRZKNRdgST1trxCoe4CJKnH5RUKDhUkqVJZhYIkqVpZhcKMIwVJqlRWoeBBBUmqVlah4EBBkqqV\nVyg4VJCkSuUVCmaCJFXKUJAkdWUWCqaCJFWpdbAGKaVVwEuBn0TEN1JKJwMnRsRXD+eDU0oN4ANA\nAmaA34mIH8y3j5kgSdVayEjhUmAX8LMppd8H7gXedKDGKaUNC/zslwHtiDgbeCvwroPtMOOBZkmq\n1EFHCsDfA7dFxDUppSHgAmAIIKX0Eh4fLAXwYuD1B3vTiPhMSumaztOTgEcOtk97xlCQpCotJBR+\nCPwa8K6I2AVcnVJa2/mzM4D792u/ZqEfHhEzKaW/Ai4EXnGw9l7RLEnVOmgoRMTtPHFq54edxysj\nohsKKaWNwJcWU0BEvLqz300ppVM7wTOn/v4+xsZGF/P2WenlvoH9y1kv9w16v3+LsZCRwly2ppRe\nGhH/d7/XXxQRH1nIG6SULgKOi4h3A7uBacoDzge0c9cexse3HVLBR7qxsdGe7RvYv5z1ct9gZfRv\nMQ7plNTO6OGWlNIrAFJKP5dSeh/wLxfxNp8GzkgpfQ34PPDvI2Jivh2cPpKkah3qSAHKg8Pnp5T+\nFLgZ+GvgPy1054jYCbxyMR8444FmSarUIYVCSumjwDDwQeD3Kc9I+mxE7FnC2p7ATJCkah3qSOEr\nEfHBfZ5/OKX0qymlr0bEg0tR2Fw8JVWSqnWoy1xcv/8LEfFx4J8fXjnz85iCJFXrUA80/+gAr3/x\n8MqZn5kgSdXKakE8RwqSVK28QsFjCpJUqbxCwZGCJFUqr1BwpCBJlcorFMwESapUNqHQKJw+kqSq\n5RMKjcKL1ySpYvmEQlE4UpCkimUTCkWjYGbehbUlSYcrm1BwpCBJ1csnFBoFbUNBkiqVTygUhaek\nSlLFsgmFZqPw4jVJqlg2odBoeJ2CJFUtn1AoHClIUtWyCYVms8G0oSBJlcomFFrNBtPTXqggSVXK\nJhT6Wg2mph0pSFKVsgmFVqvBlJc0S1KlsgmFvmaDaUcKklSpbEKh1TnQ7GmpklSdjEKhAHC0IEkV\nyicUWmWpU56BJEmVyScUmmWpXqsgSdXJJhT6mo4UJKlqrbo+OKXUAj4InAT0A++MiGsO1N7pI0mq\nXp0jhYuAzRHxPOB84P3zNe5OH3mgWZIqU9tIAfgE8MnOdgOYnK/x7NlHjhQkqTq1hUJE7ARIKY1S\nhsOb52u/d/rIkYIkVaXOkQIppeOBTwPvj4i/ma/t7IHm0dWDjI2NLkN1y69X+zXL/uWrl/sGvd+/\nxajzQPMm4Frg4oi47mDtZ48pbN6yg3XDfRVXt/zGxkYZH99WdxmVsX/56uW+wcro32LUOVK4DFgL\nvDWl9DagDZwfERNzNfbsI0mqXp3HFH4P+L2Ftm81PaYgSVXL5uK1vaekOlKQpKpkEwr9fWWpe6YM\nBUmqSjahMNjfBGBicrrmSiSpd2UTCgN95eEPQ0GSqpNPKHRGCnsMBUmqTDahsHf6yGMKklSVjEKh\nnD5ypCBJ1ckmFAY80CxJlTMUJEld2YTC7PTRxB5DQZKqklEoePaRJFUtm1DoazUoCs8+kqQqZRMK\nRVEwPNBi18RU3aVIUs/KJhQAhgdb7Ng97107JUmHIbNQ6GPnbkcKklSVrEJhZLDFnqkZJl0pVZIq\nkVkolLfh3OkUkiRVIrNQKK9V2O4UkiRVIqtQGHakIEmVyioUZkcKOxwpSFIl8gqFoXKksGOXIwVJ\nqkJWoTA6XIbCtp2GgiRVIatQWLtqAIBHt0/UXIkk9SZDQZLUlVUorB7powAe3b6n7lIkqSdlFQrN\nRoPRkX5HCpJUkaxCAWBtJxTa7XbdpUhSz8kuFNavGWTP5AzbPC1VkpZcdqGw6ahhAB56ZFfNlUhS\n76k9FFJKz0opXbfQ9huPGgLgoUd2VlaTJK1UrTo/PKV0CfAqYPtC99kbCo4UJGmp1T1S+BHw8sXs\nYChIUnVqDYWIuApY1Op260YH6W81uH/zjoqqkqSVq+6RwqI1GgVPGlvFP23ewdS0d2CTpKVU6zGF\nfRQLaTQ2NgpAOmkddz/wGDun2pxy9GilhS2n2f71KvuXr17uG/R+/xbjSAmFBV2JNj6+DYCNq8s1\nkL57+09ZPdCsrqplNDY22u1fL7J/+erlvsHK6N9i1D59FBH3RsRZi9nn5GNWA/CP9z9WSU2StFLV\nHgqH4viNqxgaaBI/fqTuUiSpp2QZCo1GwVOOW8tPH9nFI9tcHE+SlkqWoQCQTjgKgB/c83DNlUhS\n78g2FE47ZT0At9y5ueZKJKl3ZBsKT9owwjHrh/neXVvYvWdR179Jkg4g21AAODNtZHJqhlv/cUvd\npUhST8g6FJ516kYAbvju/TVXIkm9IetQeNLYKp5y/Fq+f88jPPiwS2lL0uHKOhQAzn3GkwD44k0/\nrrkSScpf9qFwZhpj07phbrj1AR561OW0JelwZB8KzUaDC88+memZNldff1fd5UhS1rIPBYBnnrqR\nE48e5Vs/+Cm33e2ZSJJ0qHoiFBpFwatf8lQaRcGHvhDs3O11C5J0KHoiFABOPHqU8599Apu37uYv\nP/cD2u0FrcYtSdpHz4QCwIXPPZmnnrCWW+7czGe/fk/d5UhSdnoqFJqNBr/zKz/H+tWDfObGu/ni\n391Xd0mSlJWeCgWA1SP9XPJrp7NmVT8f/8qdfO6b9ziVJEkL1HOhALDxqGEu+dUzWLd6gE997S6u\n/MLtTE5N112WJB3xejIUAI7dMMKbX/XznDgC13/3Af7zlTdz/+YddZclSUe0ng0FgKNGB3jL6X28\nYP0U943v4A+vuIlrvnEPk1MzdZcmSUekng4FgIFmwW+eMM3rT55kqJjmquvv4m1/8S1uvv0hZjzW\nIEmP06q7gOXyC2tn+NlVM3zqwSZfGt/F5VffxvFjI7zsOSdzxlM20Gz0fD5K0kGtmFAAGGnBrx83\nzXkbZrj6wSbfHN/O5VffxrpV/Tz/GcfxvKcfy+qR/rrLlKTarKhQmHXsYJvfPWmKC48uuHa8yY0P\nT/Dp6+/iMzfcxdNOXscvnLqJZzxljKGBFfntkbSCrejfescOtnnN8VO88li48eEGN2xp8L27HuZ7\ndz3MlZ+/nVNPOorTfmY9p52ynk1HDdddriRVbkWHwqzhJrxobIYXjc3wwO5pvvVog28/XHQDgi/f\nycY1g6QTj+LJx63lycetYeNRQxRFUXfpkrSkDIX9HDPY5uVHT/Pyo2HznilufazBrY81uG3bLm64\ndTc33PoAAKuHWpxy3FpO2DTKCRtXcfymVaxfPWhQSMqaoTCPDf1w7oYZzt0ww3Qb7ttVcMeOgju2\nN7hj+wy33LmZW+7c3G0/3N/k+E2rOGb9CEevG2bTumGOXj/MhjWDnt0kKQuGwgI1CzhpuM1Jw21e\nNFZe/PboJNy7q+DenY3O4zR33Pcocd/Wx+/bgI1rhli/doj1awZZv7r8Wrd6gPVrBlm7aqCOLknS\nE9QWCimlArgceDqwG/itiMjqfppr+2BtX5unr967rtKeGXhwouDB3QUPTHS+dsGDW3fwwCNz30O6\nKGDtSD+rhvpYs2qA1SP95ddwP2tWldtrhvsZGepjZLBFf19zubooaYWpc6RwITAQEWellJ4FvLfz\nWtb6G3DCUJsThp54tfSuadiyp2DLnoLNk/ts74HHpiYY3zLBfeMHX5+p1SwYGWiVITHUx8hgGRYj\nQ30MD7YY6m8x2N9kcKDFQF+z3O48H+xvMtjXpK/V8PiHpCeoMxTOBr4AEBHfTin9fI21LIuhJhw3\n1Oa4OQJjzZohtm7dxcQMbJ2ErVMFWycLtk7ReSzYMUX5NQ3bJ6fYunuCB7YUtFn8L/dGAYOdwBjo\na9LX16C/r0lfq0l/q0FfX5O+ZoP+vgZ9rQb93dfL7fK1Bn2tJq1mQbNZ0Go0aDUb5XazQbNR0Ops\ntwb72LF7svNa+WeGknTkqTMUVgP7Tr5PpZQaEbGiV6sbaMDGAdg40AYOvjbTTLscgeyYhu3TZXDs\nminYPQ27Z2D3dMGuzuPumc5rU+XjrulpJiYKtu+CyXbBnhmYOYSAOVTNBrQae8Oj2SxoNho0Cmh0\nH4vyqyhoNsvRTaNR0GwUB27XCZxGg067vX82264AiqKgKDqPlNN4jc5rFOX7d9uwT9uC7v6NTtvV\no4Ps2DFRfvf2eZ+9711035999i06bzb7XS9m36Cz3f3b6NSwd7u7ObtTtw/dXfZ5UnR33bvzPh/V\n7d9c7R+bmOaRR3Y+4b0fX9veHYv93mOu9vub86dujv80zNVu7n3nemmO9yuAVouHH9s917vs025h\n/y72bzbU32KgP6/p3jpD4TFgdJ/n1QRCUcBMBvdSmJ4+pDobwEij/NrYd/hlTLXL4yKTM7CnXZSP\nne09MzDZhj0zndc729Ptcr+p9r7bdLbL14pmk12T00zNzL7W7mzDdLtgahqmpsqQm6Rgpg0zlM+n\ngXa7YLrzfDmDSzoc/a2C//q652S1fE6dofB14JeBv00pPRv43kHaF2NjowdpMocLXrL4fWqypu4C\nJK14dYbCVcALU0pf7zx/TY21SJKAwvsXS5JmeZmtJKnLUJAkdRkKkqQuQ0GS1HXEL4jXC2skzSel\n1AI+CJwE9APvjIhrai1qiaWUNgI3A+dFxB1117OUUkqXAhcAfcDlEXFFzSUtmc7P5pWUP5tTwGt7\n5e+vs7TOuyPiBSmlU4C/orw05raIuLjW4pbAfv07HfgflH+HE8CvR8T4gfbNYaTQXSMJuIxyjaRe\nchGwOSKeB5wPvL/mepZU5xfLnwM7665lqaWUzgF+sfOz+Xzg+HorWnIvBZoR8RzgHcC7aq5nSaSU\nLgE+AMwuT/xe4E0RcQ7QSCn9Sm3FLYE5+vcnwMURcS7lpQCXzrd/DqHwuDWSgF5bI+kTwFs72w1g\nssZaqvAe4M+A++supAIvBm5LKV0NfBb4PzXXs9TuAFqd0foaYE/N9SyVHwEv3+f5mRFxQ2f788B5\ny1/Sktq/f6+MiNmLg1vA3Ms1d+QQCnOukVRXMUstInZGxI6U0ijwSeDNdde0VFJKrwYeiogvcYAl\najK3ATgTeAXwOuCv6y1nyW0HTgZuB/4X5RRE9iLiKsqplFn7/mxuI/PFBfbvX0T8FCCldBZwMfC+\n+fbP4Zfr8qyRVKOU0vHA/wOujIi/qbueJfQayqvWrwNOBz7UOb7QK7YA10bEVGeufXdKaUPdRS2h\n/wB8ISIS5TG9D6WU8lnEZ+H2/X0yCjxaVyFVSSm9kvLY7EsjYst8bXMIha9Tzm2ywDWSspJS2gRc\nC7wxIq6su56lFBHnRMQLIuIFwHcoD3A9VHddS+hG4CUAKaVjgWHKoOgVD7N3lP4o5dRDXkt+Lsw/\npJSe19k+H7hhvsa5SSldRDlCeH5E3Huw9kf82Uf0/hpJlwFrgbemlN5GuV72+RExUW9ZS67n1lOJ\niM+llJ6bUrqJcgridyOil/r5J8AHU0rXU55ddVlEzDsfnak3AB9IKfUBPwT+tuZ6lkxnqv2/A/cC\nV6WU2sDXIuIPD7SPax9JkrpymD6SJC0TQ0GS1GUoSJK6DAVJUpehIEnqMhQkSV2GglaElNI5KaX7\n973iOKX0hpTSJxe4/2s7V4XO1+aZKaV3d7ZfllL6g6VoKy2nHC5ekw5bRHwtpfRh4C+ACztXx7+W\nhS+weBZw3UHaPA3Y2Pm8a4D5lkBfTFtp2XjxmlaMzhWr3wauAP4dcFFE3LRfm1HgY8Cmzkt/RLns\n9ycoF0t7LeWKr38KjFD+Yv9j4MPArZ3X/rjT5vkR8ZqU0nuAXwKmgc9QLix3oLbnUa4sW1Behfqv\nImL7kn8zpANw+kgrRkRMUt6/4r3Ax/YPhI6XA3dHxDOBVwFnR8RXKJfGfltnxdffAt4REc8CzgXe\nFRFbgbcBn42I/9J5r3ZK6QTgJRFxBvAc4MmUSxfP1bYf+Ajwqoh4OmVw/Osl/jZI8zIUtNKcDYwD\n5x1gCfZvUE4vXdVp+4452vxHYKhz17V3Uv6P/0B+AuxMKd1IueroWyLiQPclOA34yeza9xHxloj4\nnwvplLRUDAWtGCmlpwFvpzw+MEG5COGZKaVbUkr/kFL63xHxI+CplP9jfy7wd3O81Scp7wj4feBN\n831mZ5n3ZwNvAdYB30op/bMDNJ9kn7X9U0qrU0pPWkwfpcNlKGhFSCkNAh8H3hAR9wCvBv4t5e0m\nz4iIZ0TEv0kpXQz8UUR8inK54bGU0mrKm5bMnpjxS5RTSddQ3oZz9l7i+7aZ/dzTga8B10fEGymD\nJM3VFghgQ0rpqZ3nbwR+e2m+A9LCGApaKd4LfDciPgYQET+mnM75SEppeJ92HwJSSulW4KvA2yPi\nMeDLwJtSSv8C+APg6ymlm4EXAvdQ3qHsJuDZKaV30VkqPCK+A3wT+H6n/T2Ut3ycq+0E5XGMD6eU\nvgOcCry7im+GdCCefSRJ6nKkIEnqMhQkSV2GgiSpy1CQJHUZCpKkLkNBktRlKEiSugwFSVLX/wdE\n2wpoxN0WxQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x10bcf7c10>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "#number of samples to take from the x2 distribution.\n",
    "number_of_samples = 1000\n",
    "\n",
    "range_points = 2000\n",
    "range_start = 0\n",
    "\n",
    "degrees_of_freedom = 1\n",
    "\n",
    "range_end = chi2.ppf(1-1./number_of_samples, degrees_of_freedom)\n",
    "                     \n",
    "x_range = np.linspace(range_start, range_end, range_points) \n",
    "plt.plot(x_range, chi2.pdf(x_range, degrees_of_freedom))\n",
    "\n",
    "#find the index value of our statistic value. you can put in different values here.\n",
    "statistic = 0.5\n",
    "\n",
    "#find the index in x_range corresponding to the statistic value (within 0.01)\n",
    "point = 0\n",
    "for i, nb in enumerate(x_range):\n",
    "    if nb < statistic + .01 and nb > statistic - .01:\n",
    "        point = i\n",
    "\n",
    "#fill area under the curve representing p-value\n",
    "plt.fill_between(x_range[point:], chi2.pdf(x_range, degrees_of_freedom)[point:], alpha=0.3, color=\"red\")\n",
    "\n",
    "plt.xlabel(\"X-statistic\")\n",
    "plt.ylabel(r\"$\\chi^2_%d$\" % degrees_of_freedom)\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "## Population structure: F-statistics\n",
    "\n",
    "The last topic we'll cover is F-statistics. \n",
    "\n",
    "Once we find that our population strays from the HW condition we can begin to ask why that is the case. Often this deviation from the expected allele frequencies under HW is due to mating preference. Hardy Weinberg assumes that all individuals in a population have an equal probability of mating with any other individual (random mating). However, when certain individuals prefer to mate with specific others (in real populations this can be due to culture, race, geographic barriers, etc.), you get what is known as population structure. Population structure means that we begin to see *sub-populations* within our total population where individuals prefer to mate within their sub-population. This biased mating will result in a higher number of homozygotes than we would expect under Hardy-Weinberg equilibrium. Simply because mating preferences will tend to drive populations toward similar genotypes. So if this is the case, and no other factors are biasing allele dynamics, within sub-populations we should have Hardy-Weinberg like conditions. \n",
    "\n",
    "For example, if Raptors fans prefer to mate with other Raptors fans, then when we consider only Raptors fans, we should observe random mating. Simply because if the mating preference criterion is 'being a Raptor's fan' then any Raptor's fan will be equally likely to mate with any other Raptor's fan so we have Hardy Weinberg again.\n",
    "\n",
    "Let's express this in quantities we can measure.\n",
    "\n",
    "From before we calculated the observed and expected number of heterozygotes in a population. Let's call these $\\hat H$ and $H_{IT}$ respectively. $\\hat H$ is just the count of heterozygotes, and $H_{IT}$ is the same as the expected number of heterozygotes we calculated earlier.\n",
    "\n",
    "We define a quantity $e_{IT}$ as a measure of the 'excess heterozygosity' in the population when we consider all individuals $I$ in the total population $T$. $e_{IT} > 1$ when we have more heterozygotes than we expect under HW. And $0 < e_{IT} < 1$ if we have less heterozygotes than we would expect under HW.\n",
    "\n",
    "\n",
    "$$e_{IT}=\\frac{\\mbox{observed proportion of hets}}{\\mbox{expected proportion of hets}}=\\frac{ H_{obs}}{H_{IT}}$$\n",
    "\n",
    "We use $e_{IT}$ to define the statistic $F_{IT}$\n",
    "\n",
    "$$F_{IT}=1-e_{IT}$$\n",
    "\n",
    "So $F_{IT} > 0$ when we have a lack of heterozygotes and $F_{IT} < 0$ when we have an excess of heterozygotes. $F_{IT} = 0$ under random mating.\n",
    "\n",
    "When we have a subpropulation $S$ we can calculate the equivalent quantity but instead of considering heterozygosity in the whole population we only take a sub-population into account.\n",
    "\n",
    "$$e_{IS} = \\frac{H_{obs}}{H_{IS}}$$\n",
    "\n",
    "And lastly, we have $F_{ST}$. This one is not as intuitive to derive so I'm not including the derivation here. But basically it measure the excess heterozygosity in the total population due to the presence of two subpopulations with allele frequencies $p_{1}$ and $p_{2}$.\n",
    "\n",
    "$$F_{ST}= \\frac{(p_1-p_2)^2}{4 p (1-p)}$$"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "def F_statistics(total_pop, sub_pop_1, sub_pop_2):   \n",
    "    \"\"\"\n",
    "    Uses definitions above and allele counts from two sub-populations and a total population to compute F-statistics.\n",
    "    \"\"\"\n",
    "    #recall that the input dictionaries each contain a tuple in the form(observed, expected) for each genotype\n",
    "    f_IT = 1 - total_pop['het'][0] / (1. * total_pop['het'][1])\n",
    "    \n",
    "        \n",
    "    f_IS_1 = 1 - sub_pop_1['het'][0] / (1. * sub_pop_1['het'][1])\n",
    "    f_IS_2 = 1 - sub_pop_2['het'][0] / (1. * sub_pop_2['het'][1])    \n",
    "    \n",
    "    p1 = sub_pop_1['ref_counts'] / (1. * sub_pop_1['genotype_count'])\n",
    "    p2 = sub_pop_2['ref_counts'] / (1. * sub_pop_2['genotype_count'])\n",
    "    \n",
    "    p = total_pop['ref_counts'] / (1. * total_pop['genotype_count'])\n",
    "    \n",
    "    f_ST = ((p1 - p2) ** 2) / (4.0 * p * (1 - p)) \n",
    "    \n",
    "    F_dict = {\n",
    "        'f_IT': f_IT,\n",
    "        'f_IS_1': f_IS_1,\n",
    "        'f_IS_2': f_IS_2,\n",
    "        'f_ST': f_ST\n",
    "    }\n",
    "    \n",
    "    return F_dict"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Let's get some data for our F-tests. First we need to evolve two populations indepenently of each other, to simulate isolated mating. Then to simulate the total population we combine the two sub-populations. We then use our `allele_finder()` function to get all the alleles, and the `hardy_weinberg_chi_2_test()` function to get our expected and observed counts. Finally we plug those into the `f_statistics()` function."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {
    "collapsed": false
   },
   "outputs": [],
   "source": [
    "generation = -1\n",
    "\n",
    "#run two independent simulations\n",
    "sub_pop_1, sub_pop_1_stats= evolve_with_mating(\"(((....)))\", pop_size=1000, generations=15, beta=-1, mutation_rate=0.005)\n",
    "sub_pop_2, sub_pop_2_stats= evolve_with_mating(\"(((....)))\", pop_size=1000, generations=15, beta=-1, mutation_rate=0.005)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 48,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "{'f_IS_2': 0.015663474692202417, 'f_IT': 0.03373987223063235, 'f_IS_1': 0.012878277219995016, 'f_ST': 0.26873678403671875}\n"
     ]
    }
   ],
   "source": [
    "#merge the two populations into a total population.\n",
    "total_pop = sub_pop_1[generation] + sub_pop_2[generation]\n",
    "\n",
    "\n",
    "#choose a reference and alternate allele\n",
    "ref_allele = \"A\"\n",
    "alt_allele = \"G\"\n",
    "\n",
    "#choose the position of the locus of interest.\n",
    "locus = 1\n",
    "\n",
    "#get list of alleles for each population\n",
    "total_pop_alleles = allele_finder(total_pop, locus, ref_allele, alt_allele)\n",
    "sub_pop_1_alleles = allele_finder(sub_pop_1[generation],locus, ref_allele, alt_allele)\n",
    "sub_pop_2_alleles = allele_finder(sub_pop_2[generation],locus, ref_allele, alt_allele)\n",
    "\n",
    "#get homo/het expectations using hardy weinberg function\n",
    "total_pop_counts = hardy_weinberg_chi2_test(total_pop_alleles)[1]\n",
    "sub_pop_1_counts = hardy_weinberg_chi2_test(sub_pop_1_alleles)[1]\n",
    "sub_pop_2_counts = hardy_weinberg_chi2_test(sub_pop_2_alleles)[1]\n",
    "\n",
    "#call f-statistics function\n",
    "f_statistics = F_statistics(total_pop_counts, sub_pop_1_counts, sub_pop_2_counts)\n",
    "print(f_statistics)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Try playing with different evolution parameters and see the effect on the different F-statistics. This workshop is a work in progress so there may be some biases in our simulation scheme that can make for come confusing F-statistics. If you come up with anything interesting I would love to know about it."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Exercises / Extra Material\n",
    "\n",
    "### Programming Exercises\n",
    "\n",
    "i. *Heatmap of mutation rates vs. population sizes.* (short) \n",
    "\n",
    "Make a heatmap that plots the base pair distance of the average base pair distance of the population at generation `-1` for mutation rates $\\mu = \\{0, 0.001, 0.01, 0.1, 0.5\\}$ and population sizes $N=\\{10, 100, 1000, 10000\\}$. The resulting heatmap will be `5x4` dimensions. You may choose how many generations to evolve your populations, just plot the last one in the heatmap."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 49,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "([<matplotlib.axis.YTick at 0x10c0cc190>,\n",
       "  <matplotlib.axis.YTick at 0x10bd23a90>,\n",
       "  <matplotlib.axis.YTick at 0x10c0def90>,\n",
       "  <matplotlib.axis.YTick at 0x10c0de390>,\n",
       "  <matplotlib.axis.YTick at 0x10c0ded90>],\n",
       " <a list of 5 Text yticklabel objects>)"
      ]
     },
     "execution_count": 49,
     "metadata": {},
     "output_type": "execute_result"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAWoAAAEMCAYAAADtdfykAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAGaFJREFUeJzt3X20XGV96PHvnAMYXgKKiO1qBY3KTy0qqVBAAkEIV8Fi\nqbdCKUhDQV7tLaEvEq5cqG/tVWQVxRsCR4Kht1JXWxaXWFC4AgoCCsqr+AOXt9rlWwCRICAQcu4f\nex+ZHJKZfSazZ/Y55/thzcrMnpnn+c2s5DcPv/3s52mNj48jSWqukWEHIEnqzEQtSQ1nopakhjNR\nS1LDmaglqeFM1JLUcJsNO4CNeWbNI84bLN0z9sVhh9AYj65+ctghNMaL5owOO4TG2Pec97U2tY03\n7bywcs65+wc3bnJ/U9HYRC1Jg9RqDTT3TomJWpKAVqu5leDmRiZJAhxRSxIAow0eUZuoJQkYMVFL\nUrM1+WRic39CJEmAI2pJAqBFc0fUJmpJwhq1JDVek2vUJmpJAkZM1JLUbK0Gz60wUUsSlj4kqfEs\nfUhSwzk9T5JmmYjYEbgdWJSZD7Qd3wP4ZPnwp8DRmflMp7aaWz2XpAEaHRmtfOsmIjYDLgQ2tNPF\nRcDizNwPuAbYuVt7tSXqiHht2/1DIuK/R8Q76upPkjbFSKtV+VbBucAy4MftByNiF+AR4PSIuAHY\nPjMf7Brb1D9OZcvLwM4ATgF+DhwXEWfX2Kck9aQ1hf86iYjFwOrMvBZe8OIdgL2BTwGLgEURsX+3\n2AZR+ngncFhmLgMOBw4cQJ+SNCzHAgdFxPXAbsDKsl4NxWj6e5n5QGaupSh97N6twTpPJu4YEfOB\nnwDbUoyotwTm1NinJPWkX2t9ZObCiftlsj4xM1eXh74PbBMR8zLz+8C+wFjX2PoS2YaNAacDuwKn\nRsS2wHeB82vsU5J60mq1Kt+mYBwgIo6MiOMz81ngOODzEXEb8MPMvLpbI7WNqDPzHyYfi4hdM3NN\nXX1KUq/quOAlMw8o7z7QduwGYM+ptDPQ6XmZuSYijh9kn5JURb9OJtZhIIk6Itr7eWIQfUrSVNRU\n+uiL2kofETEPOI/ijObaMlnfAyypq09J6tVsXetjDFiambdNHIiIvYAVwD419itJU9bktT7qLH3M\naU/SAJl5a439SVLPRlojlW+DVueI+q6IuIRiQvdjwFzgEODuGvuUpBmnzkR9CnAYsIDigpc1wCrg\nihr7lKSezMqNAzJznCIpm5glNd6ou5BLUrM1edZHc39CJEmAI2pJAmZpjVqSppMmlz5M1JJEsy94\nMVFLEo6oJanxrFFLUsM5opakhrNGLUkN1+QRtRe8SFLDOaKWJDyZKEmN1+TSR2MT9YeP+OSwQ2iM\n407Ye9ghNMYTjz097BAaY+3adcMOYUYZxoYAVTU3MkkS0OARtSQN0khzKx8makkCTyZKUuN5MlGS\nGs4RtSQ13IiXkEtSszmilqSGs0YtSQ3X4DztBS+S1HSOqCUJSx+S1Hj93jggInYEbgcWZeYDG3h+\nOfBIZp7ZrS0TtSQBoyP9qwRHxGbAhcCTG3n+RGBX4MYq7VmjliSKk4lVbxWcCywDfjz5iYjYG9gD\nWF41NhO1JPVRRCwGVmfmtbB+PSUifgM4G3j/5Oc6MVFLEsXJxKq3Lo4FDoqI64HdgJVlvRrgPcBL\ngX8HzgD+JCKO6dagNWpJon8nEzNz4cT9MlmfmJmry+c+DXy6fO5PgcjMld3arC1RR8QuG3tuQ2dA\nJWmYapqeNw4QEUcCW2fmWC+N1DmivgSYB3yX9Wsx48ABNfYrSVNWR57OzIlc94LBaWZ+rmo7dSbq\n/0Ix9eS9mfmjGvuRpE3W5EWZajuZmJlPAicBO9XVhyT1Sx9PJvZdrScTM/OOOtuXpH5p8IB68NPz\nIuL4QfcpSd00eUQ9kEQdEe39PDGIPiVppqhzet484Dxgd2BtmazvAZbU1ack9arfizL1U5016jFg\naWbeNnEgIvYCVgD71NivJE3ZrJz1AcxpT9IAmXlrjf1JUs9GR1qVb4NW54j6roi4BLgGeAyYCxwC\n3F1jn5I049SZqE8BDgMWANsCa4BVwBU19ilJPWly6aO2RJ2Z4xRJ2cQsqfGGUNGozNXzJIlZOqKW\npOmkwXm6WqKOiFcCv0NxYnCnzPx/dQYlSXpe1+l5EXEEcBXwKYqdCW6JiKPrDkySBmm0NVL5NmhV\nevwA8FZgTblLwXxgaa1RSdKA9Xlz276qkqify8zHJx5k5k+AdfWFJEmD1+RFmarUqO+LiPcDm0fE\nbhTzo++sNyxJ0oQqI+pTgd8CnqLYXmsNcHKdQUnSoLVarcq3Qasyov6jzFxKW106Ik4FPlNbVJI0\nYNNyel5EnEZx6fdJEbHzpPcchYla0gwyjMWWqupU+vgexe7hk29PA4trj0ySBHQYUWfmKmBVRHwh\nM+9vfy4itqw9MkkaoOl+CfkbIuJyYBuKEfUosBXwsjoDk6RBanCerpSoPw4cD/wl8FHg7cAOdQYF\ncOV3bq67i2njhM0XDDuExli3bnzYITTGZpuPDjuEGWUY86OrqjI979HMvB64FdguM88B9q41Kkka\nsCZPz6uSqJ+KiF2A+4H9I2ILYLt6w5IkTaiSqD8IfIRid5YDgZ/hZgCSZpiRkVbl26B1rVFn5o3A\njeXDPSLiJTiiljTDNLhE3fGCl12AvwV+DnwgM38ZEXOBMykuK99qMCFKUv2m68nES4GfUqxBfVZE\nHAw8SLHk6aL6Q5MkQefSxw6ZuaQ8eXgfcARwWmZePpjQJGlwGjyg7pionwDIzGciYg5wYGY+MJiw\nJGmw+j3tLiJ2BG4HFrXnzog4EvgL4Fngnsw8pVtbnUof7VcWPGySljST9XOHl4jYDLgQeHLS8TnA\nh4CFmbkv8OKI+P1u7XUaUb80Io6huGx8+/L+r2Xmyu7hStL00OcR9bnAMl64beHTwFsz8+ny8WbA\nr7o11ilRfwV42wbuQzHaNlFLmjH6lacjYjGwOjOvjYgz25/LzHHgofJ1fw5snZnXdWuz0+p5x25a\nuJI0ffRxet6xwLqIOAjYDVgZEe8qNwcnIloUayi9Fnh3lQarLMokSTNev/J0Zi6cuB8R1wMnTiTp\n0kXAU5l5WNU2TdSSRG3rUY/Dr2d6bA3cQTHi/lqZxMeB8zPzyk6NmKglqSaZeUB5t33W3JTzbtc3\nRMR8isvGt6eYATI5AEma9qbrBS8TVgLLgXtZf251R+Ww/kWTDreA8cx8a+UIJWkAhrEqXlVVEvWT\nmXlBD22fAVwM/CGwtof3S9LATPc9E79Uzvf7Em0TszPzh53elJm3RcRlwJsy0/WrJalHVRL1e8s/\nT287Ng7M6/bGzPxEL0FJ0qA1eEBdaeOAV/XaeES8DNiPYqOBXwC3ZOZPem1PkuoyrUsfZbK9gGIb\nrs0oLic/OTN/1uV9xwMnADcBjwO7AmdGxFhmXripgUtSPzU4T1cqfSwHvg68j2K1vROAzwLdVnw6\nFtgnM5+dOFCubX0zxapSktQYTd7hpUqinpeZ7dejfzwi3rvRVz9vc2BLijVXJ2zFFKb4SdKgNDhP\nV0rU4xHxisz8T4CI2In1k+/GfBi4IyIeBB4DtgVew/onJSWpEaZ1jRo4C7glIm6juGBlT4ryR0eZ\neVVEXA28niJJrwHuz0znVEtqnAbn6UqzPlaVl5H/HkWN+qRJK0F1eu9a4J72YxFxfGaO9RKsJNWl\n1eArEze6FVdEnFD++T+Ak4G3APOBk8pjlUVEez9P9BCnJNWqn1tx9VunEXVr0p/tup4QjIh5wHnA\n7sDaMlnfAyyZapCSNJt12uFleXn3PzLzc+3PRcSpFdoeA5Zm5m1t79sLWAHs00OsklSbabkoU0Sc\nRnES8KSI2HnSe44CPtOl7TntSRogM2+NiF5jlaTaTNdZH9+jqEu3WL/88TSwuELbd0XEJcA1FNPz\n5gKHAHf3FKkk1ajBebpj6WMVsCoivpCZ97c/FxFbVmj7FOAwYAHPT89bBbiSniRNQZV51G+IiMuB\nbShG1qMUVxi+rNObym3Rr8DELGk6aPCQukqi/jhwPPCXwEeBtwM71BmUJA1ak2vUG51H3ebRzLwe\nuBXYLjPPAfauNSpJGrAmz6OukqifiohdgPuB/csV8LarNyxJGqzWSKvybdCqJOoPAh+hOBF4IPAz\nrDtLmmGaPKKuUqN+ODMPL+/vEREvAZwMLWlGaXKNutMFL/tQzPAYi4jjeH4u9WYUC//vUn94kjQY\nDc7THUfUBwELgd8EPtR2fC3Fri+SNGNMyxF1ObuDiHhvZl42sIgkSeupUqM+ICLeNvlgZv5ZDfFI\n0lA0eEBdKVHf0HZ/c+BdwHdriUaShqQ12txMXWWHl8lLnH6WYifxWt10XbfF+WaPh25/cNghNMZo\ng/8xaXprco26yjzqyV5PcYJRkjQAXUfUEbGOYkeXiZ+bh4CldQYlSYPW4AF1pdJHL6NuSZpWmlz6\n6HTByzGd3piZK/sfjiQNR7/zdETsCNwOLMrMB9qOHwqcBTwLrMjMsW5tdRpRXwqsBq4DnmH9XV7G\nARO1pJmjj5k6Iiau4H5yA8fPo9g96yng5oi4MjMf6tRep0T9u8ARFFco3gVcDlyXmet6D1+SmqnP\nq+KdCyzjhefzXg88mJlrACLiJmA/4F87NbbR+nNm3pmZSzNz97LDg4BvRMSFEbF/7/FLUvP0a/W8\niFgMrM7Ma1m/EgHFtoSPtT1+nArLRlc6UZiZt2fmXwNLgDdSLHkqSTNGq9WqfOviWOCgiLge2A1Y\nWdarodg7dtu2184FftGtwY6zPiKiRTEsfw9wMHAn8Gngqm4NS9J00q8SdWYunLhfJusTM3N1eeh+\n4DUR8WKK+vV+wCe6tdlp1scy4B3At4EvAB/IzCd6D1+SZp1xgIg4Etg6M8ci4nTgyxRlkbHM/Em3\nRjqNqE8EHgHml7ePRTy/X0Bmzus9dklqmBrmUWfmAeXdB9qOfRH44lTa6ZSoX9VDXJI0LQ1jL8Sq\nOq1H/YNNaTgiTujQ9kWb0rYk9du0TNR98DrgUOAyXnixjCSpotoSdWaeHhGvA67OzG/W1Y8k9UOD\nl/qodUQNcAywTc19SNImm62lDzLzYeDhiBjx0nNJTTYtV8/bVBExj+cXH3kuIkaAe4Al7StJSVIj\nNDdP1zqiHgOWZuZtEwciYi9gBbBPjf1K0oxS56YAc9qTNEBm3lpjf5LUs5GRkcq3QatzRH1XRFwC\nXEOxWtRc4BDg7hr7lKTeNHgvqzoT9SnAYcACiiS9hmLVvStq7FOSejIrTyZm5ni5KPYoxXqrjwK3\nZKYXvEjSFNQ22I+I4ykWHtkb2IliZP1/IuKkuvqUpF71cT3qvquz9HEssE9mPjtxICK2AG6m2EtM\nkpqjuZWPWhP15sCWFDvtTtgK1/qQ1ECt0eaeTawzUX8YuCMiHqSY9bEt8Brg9Br7lKQZp86TiVdF\nxNUUu+5uSzHr4/7MXFtXn5LUqwZP+qh9rY+1FJeN/1pEHJ+ZY3X2K0lT1eTpeQMpypTrfExw30VJ\nzTPSqn4bsEEsyrQ7sLZ9Uaa6+pSkXjV5RO2iTJLUcC7KJEkUGwdUvQ2aizJJErN3h5f2RZkmpue5\nKJOkZpqNNepy8aUrMDFLmgaafDKxuddMSpKA+nchl6TpobkDahO1JMHsPZkoSdNGawh7IVbV3Mgk\nSYAjakkqWPqQpGZr8vQ8E7UkQd9mfZQL0F0MBLAOOCkzv9P2/FEUG6isBVZkZtetCRubqBcsOnXY\nITTGP51x4rBDaIy1a9cNO4TG2HyLxv7znZb6OKI+FBjPzAURsRD4GMVV2hM+QbGhypPAdyLi85n5\nWKcGPZkoSX2UmVcCJ5QPXwk8OukldwEvodhTFirsI+tPsiTR381tM3NdRFxKMZL+o0lP3wfcAfwS\n+LfMXNOtPUfUkgTFokxVbxVk5mJgF2AsIrYEiIg3Au8EdqYYbb88Iv5rt7ZM1JJEUaOueuskIo6O\niDPKh78CnqM4qQjFks9PAk+XC9etpiiDdGSilqT++jdgfkTcCFwNnAa8u9zY+4fARcBNEfFVYDvg\n0m4NWqOWJOjbBS+Z+SRwRIfnlwPLp9KmiVqS8IIXSWo+E7UkNZvLnEpS0zmilqRms0YtSU1nopak\nZmtyjdoLXiSp4RxRSxJAg/dMNFFLEp5MlKTms0YtSeqVI2pJAlqt5o5bBxJZudmjJDVXnzcO6Kfa\nRtQRMQ84D9gdWFsm63uAJZn5QF39SlIvZuvJxDFgaWbeNnEgIvYCVgD71NivJE3dLD2ZOKc9SQNk\n5q019idJPevXVlx1qHNEfVdEXAJcQ7FP2FzgEODuGvuUpN7M0tLHKRRbpS8AtgXWAKuAK2rsU5J6\n0+BZH7Ul6nKH3SswMUuaBlyUSZLUMy94kSSYtTVqSZo2WiOjww5ho0zUkoQ1aknSJnBELUlgjVqS\nmm62rvUhSdPHbLzgRZKmlQafTDRRSxKWPiSp+Sx9SFKzOaKWpKZzRC1Js0O57eDFQADrgJMy8ztt\nz+8BfLJ8+FPg6Mx8plObzf0JkaQBao20Kt+6OBQYz8wFwFnAxyY9fxGwODP3o9hYZeduDZqoJQn6\ntgt5Zl4JnFA+fCXw6MRzEbEL8AhwekTcAGyfmQ92C81ELUkUq+dVvXWTmesi4lLgfOB/tz21A7A3\n8ClgEbAoIvbvGtv4+Hgvn0mS1EVE7Ah8A3h9Zj4VEQF8ITPfXD5/GrBZZp7bqR1H1JLURxFxdESc\nUT78FfAcxUlFgO8D20TEvPLxvsB93dp0RC1JfRQRWwErgN+gmFn398A2wNaZOVaWOv5n+fKvZ+aS\nbm2aqCWp4Sx9SFLDmaglqeFM1JLUcF5CPklE7An8fWa+LSJeDVxKccb23sw8dajBDUCVzx8R76OY\n0P8s8NHM/OKw4u23Xj9/RMwB/hHYEVgD/GlmPjKMz7Cp+v0dRMRewD+Ur702Mz808A81zTmibhMR\nf01xjf6LykPnAWdm5kJgJCL+YGjBDUCVzx8RLwf+nGLS/juAv4uIzYcScJ9t4uc/Gbi7vCz4MopL\nh6edmr6DZcAfZ+a+wJ4R8ebBfaKZwUS9vu8Bf9j2+C2Z+bXy/tUUVxLNZN0+/0HA7wE3ZebazFwD\nPAi8abBh1qbXz/9mYAHFug0Tr52uf1f6+R0cGBFzgS0y8z/K419i+n43Q2OibpOZVwBr2w61X9T/\nOLDdYCMarAqff1tgLvBY2/FfMkO+l038/O3HJ1477fT5O5g4tmZSGzPi78sgmag7W9d2fy7wi2EF\nMiQb+vxrWD8JzeTvpernf7Q8PnfSa2eCTf0OJv9ozaTvZmBM1J19KyL2K+8fDHyt04tnoA19/m8C\nCyJii4jYDngdcO+wAqzZVD7/14FDytcewsz5u7JJ30FmPg48HRGviogW8HZmznczMM766OyvgIvL\nEyX3A/8y5HgG7QWfPzPHI+JTwE0U/1t8ZrdFz6exyp8/IpYBn4uIrwFPA38ytKj7qx/fwUnAP1EM\nDL+cmd8c+KeY5ryEXJIaztKHJDWciVqSGs5ELUkNZ6KWpIYzUUtSw5moJanhnEetDYqInYEHeH4/\nty2AHwHHZuaP+9jP2cB4pxXVIuIcilXXbo6Ii4FlmfmtTez3jRQrur0UGAVuAf6i3ID0b4FvZuaq\nTelD6hcTtTr5UWb+7sSDiPgYcAHw7gHHsRD4CkBmvq9Pbf4zsDgzvwEQEf8L+DDwV5l5dp/6kPrC\nRK2p+CpwKEDbGsMvAh4GTszM70fE9RRXsO1ZPndaZl4XESuA6zNzZfn+dZm5XuktIt4PHA1sRbHG\nxBEUK7XtDoxFxLuBTwNnZ+ZXI+JM4CiKRYS+DPwNsBNwBcUlzfOBnwLvyczJ60u8HNi67fE5wCvL\nOFYA1wNPAB8Exin+rewK7AH8J7Ac+O0yzjMz8/9O8buUKrNGrUrKS4iPAG4q738eOCUz51Mkrcvb\nXr5FZr6FIomujIgNDQjWuyS2XA7zXcDCzHwTcGXZ/mXA7cBxmXlv2+sPBn6fIhnPB15LcakyFEtu\nnpuZb6RYze2oDfS/BLgqIjIilgO7T4yuJ2Tmv2bm/PL/Kr4CXJCZdwDnA5/NzD2APwCWR8TWkzuQ\n+sVErU5+KyK+FRHfBu4sjy0FdgF+PlEnzsx/AV5dJlsoFp4nM+8CfkyF9arLxXuOAo4sSyyHAtu0\nvaQ16S0HAJ/PzGcycx1wCXBg+dzPMvPu8v69wPYb6G8lxaj6b4BngBURcd6GYouIP6P4MVhSHloE\nfKj8Xq6mqHG/uttnlHpl6UOdrFejnhARr+CFibNFkbBg/fWMR8vH4xPv2dCOMBHx28ANFKWNf6co\nWezWIbbJg4wWz/99/lXb8V/329bXayh2HPkIxcj9yog4H/g2cPqk176V4sdp78x8rq3vAybKKRHx\nm2W8Ui0cUauTycl4QgLbR8RbACLicOAHbXXgPy6P7w68GLiHoo79O+Xzh22gzT2ABzPzfIplNA9m\n/cQ/eVDxFYrR95yytHJseaxT3BMeAv5bROzfdmxXikT9a+WPxz9SJPWHJ/U9sXfgG4C7KerqUi0c\nUauTDS6tWC5peQTwmYjYCvg5cHjbS+ZFxB3l+w8vl8VcBvxzRNxJkegmT/H7EnByRNxHMSK+jSJ5\nQrG904URccxETOVmqrtR1K9Hy9dcALxiY3G3xf9YRLwT+ESZjJ+h+PE5ctLnPoui/LKs/L+AceDv\nKPYLvDgi7ipfd1RmPtGpT2lTuMyp+qqc9XF2Zn512LFIM4WlD/Wbv/xSnzmilqSGc0QtSQ1nopak\nhjNRS1LDmaglqeFM1JLUcCZqSWq4/w+coR4JZOAHfAAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x10bcc4550>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "#lists of mutation rates and population sizes to test\n",
    "mutation_rates = [0, 0.001, 0.01, 0.1, 0.5]\n",
    "population_sizes = [10, 100, 1000, 10000]\n",
    "\n",
    "#number of generations to run each simulation\n",
    "generations = 1\n",
    "#target structure\n",
    "target = \"(.((....)))\"\n",
    "\n",
    "#list to store our results\n",
    "bp_distances = []\n",
    "\n",
    "#nested for loop to go through each combination of mutation rates and population sizes.\n",
    "for m in mutation_rates:\n",
    "    #list to store the population size results for current mutation rate.\n",
    "    bp_distances_by_pop_size = []\n",
    "    #try each population size\n",
    "    for p in population_sizes:\n",
    "        #call evolve() with m and p \n",
    "        pop, pop_stats = evolve(target, mutation_rate=m, pop_size=p, generations=generations)\n",
    "        #add bp_distance of chromosome 1 at generation -1 (last generation) to bp_distances_by_pop_size\n",
    "        bp_distances_by_pop_size.append(pop_stats['mean_bp_distance_1'][-1])\n",
    "    #add to global list once all combinations of current mutation rate and population sizes.\n",
    "    bp_distances.append(bp_distances_by_pop_size)\n",
    "    \n",
    "#use bp_distances matrxi to make a heatmap\n",
    "sns.heatmap(bp_distances)\n",
    "\n",
    "#labels\n",
    "plt.xlabel(\"Population Size\")\n",
    "#xticks/yticks takes a list of numbers that specify the position of the ticks and a list with the tick labels\n",
    "plt.xticks([i + .5 for i in range(len(population_sizes))], population_sizes)\n",
    "plt.ylabel(\"Mutation Rate\")\n",
    "plt.yticks([i + .5 for i in range(len(mutation_rates))], mutation_rates)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "ii. *Introduce mating preferences within a population.* (medium length) \n",
    "\n",
    "Modify the `selection_with_mating()` function to allow for mating preferences within a population. In our example above we were just running two independent simulations to study barriers to gene flow. But now you will implement mating preferences within a single simulation. Your function will assign each Cell a new attribute called `self.preference` which will take a string value denoting the mating type the current cell prefers to mate with. For example we can have a population with three mating types: $\\{A, B, C\\}$. Your function will randomly assign preferences to each cell in the initial population. We will define a preference between types $A$ and $B$ as the probability that two cells of those given types will mate if selected. \n",
    "\n",
    "$$\n",
    "preferences(A,B,C) = \n",
    "\\begin{bmatrix}\n",
    "   0.7 & 0.1 & 0.2 \\\\\n",
    "   0.1 & 0.9 & 0   \\\\\n",
    "   0.2 & 0   & 0.8 \\\\\n",
    "\\end{bmatrix}\n",
    "$$\n",
    "\n",
    "Once you selected two potential parents for mating (as we did earlier) you will use the matrix to evaluate whether or not the two parents will mate and contribute an offspring to the next generation. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 50,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "GAGUUAGGACU\n",
      "CGCUCGGAGUC\n",
      "GAGUUAGGACU\n",
      "GAGUUAGuACU\n",
      "GACCCUCAAGU\n",
      "GAGUUAGGACU\n",
      "GAGUUAGGACU\n",
      "GACCCUCAAGU\n",
      "GAGUUAGGACU\n",
      "GACCCUCAAGU\n"
     ]
    }
   ],
   "source": [
    "def populate_with_preferences(target, preference_types, pop_size=100):\n",
    "    \n",
    "    population = []\n",
    "\n",
    "    for i in range(pop_size):\n",
    "        #get a random sequence to start with\n",
    "        sequence = \"\".join([random.choice(\"AUCG\") for _ in range(len(target))])\n",
    "        #use nussinov to get the secondary structure for the sequence\n",
    "        structure = nussinov(sequence)\n",
    "        #add a new Cell object to the population list\n",
    "        new_cell = Cell(sequence, structure, sequence, structure)\n",
    "        new_cell.id = i\n",
    "        new_cell.parent = i\n",
    "        \n",
    "        #assign preference\n",
    "        new_cell.preference = random.choice(preference_types)\n",
    "        population.append(new_cell)\n",
    "            \n",
    "    return population\n",
    "\n",
    "def selection_with_mating_preference(population, target, preference_matrix, preference_types, mutation_rate=0.001, beta=-2):\n",
    "    next_generation = []\n",
    "    \n",
    "    counter = 0\n",
    "    while len(next_generation) < len(population):\n",
    "        #select two parents based on their fitness\n",
    "        parents_pair = np.random.choice(population, 2, p=[rna.fitness for rna in population], replace=False)\n",
    "        \n",
    "        #look up probabilty of mating in the preference_matrix\n",
    "        mating_probability = preference_matrix[parents_pair[0].preference][parents_pair[1].preference]\n",
    "        \n",
    "        r = random.random()\n",
    "        #if random number below mating_probability, mate the Cells as before\n",
    "        if r < mating_probability:\n",
    "            #take the sequence and structure from the first parent's first chromosome and give it to the child\n",
    "            child_chrom_1 = (parents_pair[0].sequence_1, parents_pair[0].structure_1)\n",
    "\n",
    "            #do the same for the child's second chromosome and the second parent.\n",
    "            child_chrom_2 = (parents_pair[1].sequence_2, parents_pair[1].structure_2)\n",
    "\n",
    "\n",
    "            #initialize the new child Cell witht he new chromosomes.\n",
    "            child_cell = Cell(child_chrom_1[0], child_chrom_1[1], child_chrom_2[0], child_chrom_2[1])\n",
    "\n",
    "            #give the child and id and store who its parents are\n",
    "            child_cell.id = counter\n",
    "            child_cell.parent_1 = parents_pair[0].id\n",
    "            child_cell.parent_2 = parents_pair[1].id\n",
    "            \n",
    "            #give the child a random preference\n",
    "            child_cell.preference = random.choice(preference_types)\n",
    "\n",
    "            #add the child to the new generation\n",
    "            next_generation.append(child_cell)\n",
    "\n",
    "            counter = counter + 1\n",
    "            \n",
    "        \n",
    "    #introduce mutations in next_generation sequeneces and re-fold when a mutation occurs (same as before)\n",
    "    for rna in next_generation:      \n",
    "        mutated_sequence_1, mutated_1 = mutate(rna.sequence_1, mutation_rate=mutation_rate)\n",
    "        mutated_sequence_2, mutated_2 = mutate(rna.sequence_2, mutation_rate=mutation_rate)\n",
    "\n",
    "        if mutated_1:\n",
    "            rna.sequence_1 = mutated_sequence_1\n",
    "            rna.structure_1 = nussinov(mutated_sequence_1)\n",
    "        if mutated_2:\n",
    "            rna.sequence_2 = mutated_sequence_2\n",
    "            rna.structure_2 = nussinov(mutated_sequence_2)\n",
    "        else:\n",
    "            continue\n",
    "\n",
    "    #update fitness values for the new generation\n",
    "    compute_fitness(next_generation, target, beta=beta)\n",
    "\n",
    "    return next_generation    \n",
    "\n",
    "\n",
    "def evolve_with_mating_preferences(target, preference_types, preference_matrix,\\\n",
    "                                   generations=10, pop_size=100, mutation_rate=0.001, beta=-2):\n",
    "    populations = []\n",
    "    population_stats = {}\n",
    "    \n",
    "    initial_population = populate_with_preferences(target, preference_types, pop_size=pop_size)\n",
    "    compute_fitness(initial_population, target)\n",
    "        \n",
    "    current_generation = initial_population\n",
    "\n",
    "    #iterate the selection process over the desired number of generations\n",
    "    for i in range(generations):\n",
    "        #let's get some stats on the structures in the populations   \n",
    "        record_stats(current_generation, population_stats)\n",
    "        \n",
    "        #add the current generation to our list of populations.\n",
    "        populations.append(current_generation)\n",
    "\n",
    "        #select the next generation, but this time with mutations\n",
    "        new_gen = selection_with_mating_preference(current_generation, target, preference_matrix, \\\n",
    "                                                   preference_types, mutation_rate=mutation_rate, beta=beta)\n",
    "        current_generation = new_gen \n",
    "    \n",
    "    return (populations, population_stats)\n",
    "\n",
    "\n",
    "\n",
    "#run a small test to make sure it works\n",
    "target = \".(((....)))\"\n",
    "#for convenience, let's give the preference types integer values in sequential order\n",
    "preference_types = [0,1,2]\n",
    "\n",
    "preference_matrix = np.array([[0.7, 0.1, 0.2],[0.1, 0.9, 0],[0.2, 0, 0.8]])\n",
    "    \n",
    "pops, pop_stats = evolve_with_mating_preferences(target, preference_types, preference_matrix)\n",
    "\n",
    "for cell in pops[-1][:10]:\n",
    "    print(cell.sequence_1)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Population Genetics / Bioinformatics Exercises\n",
    "\n",
    "*Exercise 1.  Make a tree using maximum parsimony.*\n",
    "\n",
    "We saw how to make trees using a distance score. Another popular method is known as the maximum parsimony approach. I won't go into too much detail on this since we are short on time, but I will give a quick intro and we'll look at how ot make a tree using maximum parsimony.\n",
    "\n",
    "This approach is based on the principle of parsimony, which states that the simplest explanation for our data is the most likely to be true. So given an alignment, we assume that the best tree is the one that minimizes the number of changes, or mutations. This is often a reasonable assumption to make since mutation rates in real populations are generally low, and things like back-mutations (e.g. A --> C --> A) are unlikely. Computing the tree that that maximizes parsimony directly is a difficult task, but evaluating the parsimony score of a tree given the tree is easy. So this approach basically generates many random trees for the data and scores them based on parsimony keeping the most parsimonious tree. Take a look at [the biopython manual to work through this example](http://biopython.org/wiki/Phylo), and [this one](http://biopython.org/DIST/docs/api/Bio.Phylo.TreeConstruction.ParsimonyTreeConstructor-class.html).\n",
    "\n",
    "Since we already have an alignment (`aln.clustal`) we will just re-use it and make a maximum parsimony tree instead. "
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 51,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX4AAAEMCAYAAADDMN02AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3Xl4VOXB/vFvQkggGAyQkIIsUYRHBBGNCGJbWovVWLCi\ntQVReevGKlVRjMgiUBDQuCBKQKpggVb0VVD6w60qVl8qEDew+IALYQlKjLFEImT9/TGTGDD7LOck\n5/5cFxfJzJxz7jmZ3DlzZuZ5IsrKyhAREe+IdDqAiIiEl4pfRMRjVPwiIh6j4hcR8RgVv4iIx6j4\nRUQ8JsrpALXJycmv9/tN27SJJS+vIBRxgsbtGZUvcG7PqHyBc3PGxMS4iOqua5JH/FFRzZyOUCu3\nZ1S+wLk9o/IFrjFkrEqTLH4REameil9ExGNU/CIiHqPiFxHxGBW/iIjHqPhFRDxGxS8i4jEqfhER\nj1Hxi4h4jIpfRMRjVPwiIh7j+kHaREQClZv7NbNmTaekpJi4uNZMnz6bli1bOh3LMTriF5Emb9Wq\nFfzmN0NZtGgp3bv34MUX1zodyVE64heRJm/ixEkAlJaWcvDgV3To0NHhRM7SEb+INDkpKb1JSel9\nzGXFxcVce+1w3n8/k7PPPsehZO6g4hcRT4iKimLlyjXccccUZs+e7nQcR6n4RaTJS0+fz3vvbQWg\nZctYmjVrnBOoBIvO8YtIk3fllX/gvvvuZcWKvxAREcGkSXc6HclRKn4RafK6dEnmkUeWOB3DNXSq\nR0TEY1T8IiIeo1M9ItLkbdiwnqys3YwZMyHo67755tFERERQVlbGnj27ueSSSxk9enzQtxNMKn4R\n8YSIiIiQrLf8tYPs7P3MmHEXo0ZdH5LtBJOKX0Q8ZfjwYfTp05c9e7Jo27Ydc+Ys4KWX/sGmTe9w\n5MgRsrP3M3LktaSmDuHzzz/loYfuB6B16xOZMmU61n7C4sWPEB0dzciRIzjvvF8CsHBhOmPHTqRF\nixZO3r06UfGLiKccOJDNokVLSUhIZOzY69mx42MADh8+THr6Qvbt20ta2m2kpg5h/vw5TJkyg65d\nk1m/fh0rV66gX7/+FBUVsnTpchIT48jJyeezzz6loKCg0XwiWMUvIk1Odvb+aq+Lj48nISERgPbt\nkygsLASge/ceFZcdPeq7LCvrC9LT5wG+IR86deoMQJcuXY9Z58sv/z+GDr0suHcihFT8IiJU/RpA\nly7JTJ06k/btk9i27UO++SbXf9tj3xCZmbmFq6/+n3DEDAoVv4h4zA8FX9sLvpMmpTF79nRKSkqI\njIwkLW0aOTkHf3S7vLxvaN26ddCThkpEWVmZ0xlqlJOTX++A5efd3MztGZUvcG7P2JTzdejQBoAD\nB/KCGelH3LwPExPjqv2rpg9wiYh4jIpfRMRjVPwiIh4T9hd3jTFRwBNAMhANzLHWvhjuHCLiHUeO\nHOH+++/lyy8PUFRUxK233sFpp53udCzHOHHEfzXwtbX250AqsMiBDCLiIatXP8Upp5zKokVLmTz5\nbvbsyXI6kqOcKP41wLRK2y9yIIOIeMjmzf+mefPm3HbbzaxY8RfOPfc8pyM5yrG3cxpj4oB1wBJr\n7dPV3a64uKQsKsrb06SJSP0kJycDsHv3bgAuuugihg4dyoQJE1i7di2bNm1i/vz5zgUMj2rfzunI\nB7iMMZ2B54BFNZU+QF5eQb3X7+b31pZze0blC5zbMzblfKWlvgPa8uVbtYrjrLP6k5OTT58+55KR\nsSQo993N+zAxMa7a68J+qscYkwS8DEy21q4I9/ZFxHvi4uJ4+OF0AD74IJOTT+4WtHVv2fIuN9xw\nLWPGXMeyZRlBW28oOXGO/y4gHphmjHnDGPO6MSbGgRwi4hEDB/6MvLxvGDPmOp5+ejXjxv0paOte\nvHgh06fPIiPjCd57byuff/5Z0NYdKmE/1WOtvQW4JdzbFRHvatmyJYMGXcDo0eMZPnwYTzyxJGjj\n8ffocRrffvstHToUUVhYSLNm7n9NUoO0iTQSKSm9g7q+yMiIinPhbhRIvuzs/XTseFKV1wV7PP69\new8wefKtxMfH063bqXTtmtzQuxw2Kn6RRiAlpXeNZSZ1F8zx+PPz8/nrX5ezatUztGuXwGOPLWT1\n6r9y1VXXhPU+1ZeKX6SR6NjxJDIztwdtfW5+RwoElq8hz44aMh5/TEwMsbGxtGzZEoCEhAS+/fbb\nBmUOJxW/iHhM8Mbjj46OZsKEW7jllvHExMRwwglx3H33PaEKHjQaj98hbs+ofIELZsbyI1gd8ddN\nKPZXVdy8DzUev4iIVFDxi4h4jIpfRMRjVPwiIh6j4hcR8RgVv4iIx6j4RUQ8RsUvIuIx+uSuiDR5\nCxems2vXTiIiIsjN/Zq4uNZkZDzhdCzHqPhFpMmbOHES4Btobfz4G7nzzqkOJ3KWil+kEdqwYT1Z\nWbsZM2ZC0Ne9f/8+7rtvLsXFxURHR3PPPXNp3bp10LfjhGef/TvnnjuAk08+xekojlLxizRStQ0w\n1lALFsxh9OjxnH56bzZufIO9e/fQq1dw5wJwQnFxMS+88DzLlj3ldBTHqfhFGrnhw4fRp0/fes8o\nlZjYjkmTphwzo9TQoZeRl/cNb7/9FosXP0LPnqczduxEh+9h/VU1ONuWLe/St+/ZxMa2ciCRu6j4\nRWoQyKxXwZzhKhQzSm3c+PKPZpT6+usc/vznGdx2253cdNM45s2bzYYN67nkkqFBuR9O2rp1MwMG\nnO90DFdQ8YtUo7HMetXQGaUiIspISuoI/DCjVFxca1q1akXfvmcDvknKt259t0kU/969e0hNHeJ0\nDFdQ8YvUIJBZr0IxHn991Daj1N69u/j8873+2/4wo1Tnzl346KMP6NOnLx9++B4nn9wtsPAusWDB\ng05HcA0Vv0ij17AZpWJimjNp0pRjZpQCuPPOaTzwwHxKS0vp0KFjozzHLzXTDFwOcXtG5Qt8FifN\nwBUYt+cDd2fUDFwiIlJBxS8i4jEqfhERj1Hxi4h4jIpfRMRjVPwiIh6j4hcR8RgVv4iIx6j4RUQ8\nRsUvIuIxKn4REY9xrPiNMe2NMXuMMT2cyiDSFL3/fiaXX/4bp2OIizkyOqcxJgrIAAqc2L5IQ4Ry\nntu33nqTRx99iKSknwBw/fWjOfPMs+q9noMHv2LNmtWUlJQEO6I0IU4Ny3w/sBi4y6HtizRIqOa5\ntXYH48b9iUGDftngdRQWFnL//fOYPPlurr/+6iCmk6Ym7MVvjPkf4KC19lVjzJRwb18kGOoyz+3Y\nsaM5//xfHTPPbevWJzJlyvRj5rm99NJhWLuDXbt2smbNanr27MW4cROJjDz2TGx29v4fTchSeZjm\nBx9cwIgRV5OQkAC4e7h1cZYTR/x/BEqNMRcCfYGnjDGXWmsPVnXjNm1iiYpqVu+NJCbGBZYyDNye\n0el8ycnJjm4/O3s/nTp1qtgPcXEtiI2NJjExjgMHslm9ehVJSUmMGDGCL7/cTVxcC4qKjvDkk8vI\nyspi7NixXHbZZUyYMI+5c+fSrVs3nn32WZ577m+cf/75lJWV8PTTfwOgqKiAwYMH06lTJ6ZPn85r\nr61n5MiRFVn27Mmqcn+UZzt48CAff/wRBw8e4K9//QuHDh1i3rx7SE9Pr/E+Ov0zro3b80HjyHi8\nsBe/tXZQ+dfGmDeA0dWVPkBeXv1fBnDz5Ajl3J7R6Xy1zXcbzInMa1JaWlaxH/Lzj1BQUEhOTj7x\n8fFERsaSk5NPmzYJfPVVHvn5R+jatRs5OflERZ3A0aNHycnJ59NPP2Xq1OkAFBcX06lTZ3r1KqBj\nx04V6x406CJiYk4gJyefc84ZyFtvvcGvf33pMVm2bNn2o3zly0dEtOSpp9ZUXP7b315EWto9Nf4M\nnf4Z18bt+cDdGWv6g+T01It6PirVqmm+23DOwFUftc1zu23bh3zzTa7/tj+cyhk1ajhLljxJQkIi\nmZlbMOa0hgf3rT3A5aUpc7T4rbUXOLl9kYZr2Dy3kZGRpKVN+9E8t2lp07jrrttp0aIFycmnMHTo\nsIDSrVv3UkDLS9OmOXcd4vaMTuerbY5Zr825GwrKFzg3Z9ScuyIiUkHFLyLiMSp+ERGPUfGLiHiM\nil9ExGNU/CIiHqPiFxHxGBW/iIjHqPhFRDxGxS8i4jEqfhERj1Hxi4h4jNPDMovUSSjnuy331FNP\n8NlnnzJz5tyQbcNJhw4d4qqrLueUU04F4JJLLubiiy9zOJU4QcUvjUao5rsF2LTpHTZteqdisvOm\naOfOTxg8+GJuueV2wN0jS0poqfil0Rk+fBjnntuPnTs/rXa+25EjryU1dUid5rvt1esMXnxxLTfc\nMIYXX1zr8L0LHWt3YO1/mDDhJtq2bcesWTOAFk7HEgc0yeJPTk4Oy7R8gQjX1IEN5XS+mqZdPHAg\nm1tuuYXIyFjGjr2eHTs+BuDw4cOkpy9k3769pKXdRmrqEObPn8OUKTPo2jWZ9evXsXLlCvr1609R\nUSFLly7n+++/5+67JzNt2iy++OIzjp+foqoJzuvK6X0Ix84l0LXryZx22umkpPTjlVdeYvbs2Uyb\nNsfBdOKUJlf8tc3VKo1ffHw8SUlJ5OTk0759EoWFhQB0794DgPbtkzh61HdZVtYXpKfPA36Y7xag\nS5euAGze/G/y8nKZMeMu8vMPkZuby6pVKxg5chSZmdsbXPpudPbZ59Cihe8If9CgX7BixeMOJxKn\nNLniB+jUqVOVE1O7idvPrzqdL1zz3Q4a9EsGDfolAO+/n8m6dc8xcuSoiuUbOvsWOL8Pjzd//mwG\nDfoVF1wwmC1bNtOrVy+nI4lD6lT8xpi2QCt8E402A0621r4eymAi1QvufLdeMXbsRObOncnatc/S\nokVL7rtvHi6feVVCpNY5d40x9wLjgOZALtAR2Gqt7R/6ePWfczclpTeRkRE64g+Q0/ncMOduoNye\nUfkC5+aMgc65OxzoDDwN/AIYDOQEJZmIiIRdXYr/gLX2ELAdONNa+waQFNpYIiISKnU5x/9fY8w1\nQCZwszEmG2gT2lgiIhIqdTnivx5ob619E9gNLAHuDmEmEREJoboUf4K1Nh3AWjvJWnsmUBLaWCIi\nEip1Kf4XjDF3gO9tncaYp4EpoY0lIiKhUpfiPxs40xjzf8Bm4F2gX0hTiYhIyNSl+COAIiDW/3Wp\n/5+IiDRCdSn+j/G9qHsOMAA4D9+Rv4iINEJ1eTtnqrX2ff/XOcAfjDFXhjCTiIiEUF2Kf78x5lbg\nBCqN1QM8E8pgIiISGnU51fMc0Be4Gt9AbZeic/wiIo1WXd/HPwp4Ed8fgV8AGs9VRKSRqsupnjz/\n/xbfWD3vGmOiA9moMSYN3zOH5sBj1tonA1mfyPH++99vmTlzKoWFhbRrl8CUKTOIiYlxOpaIK9Tl\niP+fxphngFeAScaYDKCgoRs0xgwCzrPWDsT37KFzQ9clUp0nn1zGhRdezKJFS+nevQfr1v2v05FE\nXKMuxd8TuNNamwWMwHfk3+DiBy4Cthtj1gIvAOsDWJdIlT766AMGDBgIwIAB57N16xaHE4m4R7Wn\neowxzwNn4pt45SxjTPlVzYGsALaZAHQBhgCn4Cv/0wJYnzRRNU10XtVE5pUnbSkoKKBVqxMAiI2N\n5fDh70IXVKSRqekc/yigLfAwMLHS5cXAVwFsMxfYYa0tBnYaY44YYxKstV9XdeM2bWKJimpW55VH\nRvomnUlMjAsgYni4PaOT+fbsySI5ObnG25T/rMtVznviiXG0bBlB27Zx5OZC27bxjtwf/YwD4/Z8\n0DgyHq/a4vdPvnII+G2Qt/k2vj8kDxpjOuIbCiK3uhvn5dXvrFJpaRmRkRGunQ6tnJunbAN35Ktp\n+syq8lX+vmfPM1i//mVSU4ewYcOr9Ox5Rtjvjxv2YU2UL3BuzljTH6S6nOMPKmvtP4D3jTGbgXXA\nOGutpnyWoBo16jpee+0Vxo27gY8/3s4VV/ze6UgirlGXt3MGnbU2zYntine0adOW9PSFTscQcaWw\nH/GLiIizVPwiIh6j4hcR8RgVv4iIx6j4RUQ8RsUvIuIxKn4REY9R8YuIeIyKX0TEY1T8IiIeo+IX\nEfEYFb+IiMeo+EVEPMaR0TlF3OSrr77k3ntnUVJSAsDkyXfTuXMXh1OJhI6O+MXzli3L4He/G84j\njyzhmmv+SEbGI05HEgkpHfGL5918860V8/MWFxcTE9PC4UQioaUjfvG81q1PpFmzZuzZs5vHHlvI\nH/94o9ORREJKR/ziOSkpvQHIzNxecdl7723lgQcWMH36LJ3flyZPxS+e9957W3n44XTS0xeSlPQT\np+OIhJyKXzxv4cIHKCkpZs6ceygrK6Nr12Ruv/0up2OJhIyKXzxv+fLVTkcQCSu9uCsi4jEqfhER\nj1Hxi+dt2LCejIxFIVt/SUkJU6feyebN/w7ZNkTqQ8UvAkRERIRkvfv372PChJuwdkdI1i/SEHpx\nV6SS4cOH0adPX/bsyaJt23bMmbOAl176B5s2vcORI0fIzt7PyJHXkpo6hM8//5SHHrof8H0IbMqU\n6Vj7CYsXP0J0dDQjR46gffvO3HXXNFauXOHwPRP5gYpfpJIDB7JZtGgpCQmJjB17PTt2fAzA4cOH\nSU9fyL59e0lLu43U1CHMnz+HKVNm0LVrMuvXr2PlyhX069efoqJCli5dTmJiHDk5+Q7fI5EfU/GL\n52Rn76/2uvj4eBISEgFo3z6JwsJCALp371Fx2dGjvsuysr4gPX0e4Bvjp1OnzgB06dI1ZNlFgkHF\nL1IHVb0G0KVLMlOnzqR9+yS2bfuQb77J9d9WL52Ju6n4RY7xQ8HX9oLvpElpzJ49nZKSEiIjI0lL\nm0ZOzsFQBxQJWERZWZnTGWqUk5Nfr4ApKb2JjIxgy5ZtoYoUFG4//9uU83Xo0AaAAwfyghnpR5ry\nPgwHt+cDd2dMTIyr9shFz0lFRDxGxS8i4jEqfhERjwn7i7vGmChgBZAMFAM3Wmt3hjuHSLmvvvqS\n2bOnA74PYs2Y8WdiYmIcTiUSOk4c8V8CNLPWng/MBuY6kEGkwpo1qxk8+NcsWrSU5OSTWb9+ndOR\nRELKieLfCUQZYyKAE4FCBzKIVDj11B4cOnQIgIKCw0RF6V3O0rQ58Qj/DjgZ+ARoBwxxIINIhfbt\nk8jIWMSrr75EUVEx11032ulIIiEV9vfxG2PSgSPW2ruNMScBbwC9rbVVHvkXF5eURUU1q/P6k5OT\nAdi9e3fAWaVpOv4xcvnll3P77bczcOBANm7cyOrVq1myZIlzAUWCo9r38TtxxP8NUOT/+lt/hmqb\nPS+voF4rLy0tIzIywrUfqijn5g9+QNPOV1rqO9gpX76g4HuefvpZunc/g6ioWHJz84Jy3xMT49iw\n4Z8sW5ZBVFQUbdq0ZerUma554bgp/4zDxc0ZExPjqr3OieJ/CHjCGPMW0By4y1r7vQM5RAD49a9T\nWbfuOSZMuAmA2267M2jrfvDBBTz66DLi4+NZsuRR1q9fyxVX/CFo6xdpiLAXv7X2MKBHvrhGQkIi\nF154MaNHj2f48GE888zfgjYe/yOPLCE+Ph6AkpJioqPdcbQv3qa3L0ijkJLS+5jvIyMjKk7Z1Fd2\n9n46djypyutCNR7/xo2v8/77mdx447gGZRYJJhW/uF5KSu8ayzqYQjEe/5o1q3nzzddJT19E8+bN\nQ34fRGqj4pdGoWPHk8jM3F7xfSAvqh3/7KEuGjoe/4oVf2HXLstDDz1GdHR0g/KKBJuKX+QYwRuP\nPzc3l+XLl2FMTyZNupmIiAguuOBCLrvsipClF6kLjcfvEDe/DQzcla/8CD3YR/yV1xcKbtqHVVG+\nwLk5o8bjFxGRCip+ERGPUfGLiHiMil9ExGNU/CIiHqPiFxHxGBW/iIjHqPhFRDxGn9wVzztwIJs5\nc+4BICnpJ0yefLdrxswXCQUd8YvnPfrowwwb9jsWLVrKWWel8Pe/r3Q6kkhIqfjF83bv/oL+/QcC\ncMYZZ7Jt24cOJxIJLRW/NDobNqwnPT09aOvr0cPw9tsbAXjmmb/x0UcfMGbMdWRkLAraNkTcRMUv\njVJtI2fWJDNz+zEDtI0f/yfefnsjEyeO4Z13/sUZZ/QlI+MJ/vOf7ezatTMYcUVcpUm+uLtv374G\njbkeToHMIBUObspX0yQsw4cPo0+fvgFNlXjvvbM48cQTufLKEeTmfk3Lli0pKCjgu+++IzY2Npx3\nVSQsmtwRf2bmdjp16uR0DAmTAweyuemmcWRkPEFe3jfHTJW4YMGDzJuXzqpVKwCYP38OkyalsXBh\nBgMGDGTlSt/lzZpFUlYGa9f+L/v27aVbtx6MGjWchIQEEhPbO3bfREKlSR7x796927VjZJdz8zje\n4K58NT17C8ZUiT16nMbMmfces95nnnmBxx9fzMqVy7nuupuCe4dEHNYki1+koVMljh9/I/PmPUBc\nXByxsbEUFRWFLbNIuKj4pZEL3lSJACNGXMPtt08kOjqadu0SSEubFpLUIk5qclMvgrtOU1TH7Rnd\nlC/YUy+Gi9szKl/g3JxRUy+KiEgFFb+IiMeo+EVEPEbFLyLiMSp+ERGPUfGLiHiMil9ExGNU/CIi\nHqPiFxHxGBW/iIjHhHysHmNMf2CetfaXxphuwHKgFNhurR0f6u2LiJRbs2Y1eXl5jB7t7eoJ6RG/\nMeYO4HEgxn/RA8AUa+0gINIY89tQbl9EBODo0aPMmjWN559/1ukorhDqUz2fAsMqfZ9irf2X/+sN\nwOAQb19EhMLCQlJTh3Dttdc5HcUVQnqqx1r7vDGma6WLKo8Wlw+cGMrtS9ORnb3/mAlZ3DQ1ZHXc\nnrGp56s8mmtcXBz9+vVnw4b1wYjW6IV7PP7SSl/HAd/WtkCbNrFERTWr94YSE+PqvUy4uT2jW/Lt\n2ZNFcnLyjy6PjGz4hOvh4vaMTTlfVY/fuLgWxMZGB/Wx7Zbfk/oId/G/Z4z5ubX2LSAVeL22BfLy\nCuq9ETePkV3O7Rndlm/Llm3HfO+2fFVxe8amnq+qZfPzj1BQUBi0++3mfVjTH6RwF//twOPGmObA\nDkCvtIiIhFnIi99amwUM9H+9C/hFqLcpIlKV1NQhTkdwBX2AS0TEY1T8IiIeo+IXEfEYFb+IiMeo\n+EVEPEbFLyLiMSp+ERGPUfGLiHiMil9ExGNU/CIiHqPiFxHxGBW/iIjHqPhFRDwmoqzMvTPwiIhI\n8OmIX0TEY1T8IiIeo+IXEfEYFb+IiMeo+EVEPEbFLyLiMSGfbD3YjDERwGPAmcAR4AZr7eeVrh8K\nTAOKgCettctqW8bpfP7LM4H/+m/2hbX2+lDkq0tG/21igVeA66y1O920D6vK578sLPuwDj/jEcCf\n8P2Mt1lrx4Vz/zU0o/9yt+zDK4A7gVJgtbV2oZseg1Xl818ett/jQDS64gcuA2KstQONMf2BB/yX\nYYyJ8n+fAnwPvGOMWQf8tLplXJLvEIC19oIQZapzRn/OFCADOKmuyzidzxgTA2HbhzX9jFsAs4De\n1tqjxpjVxpghQPOa7pNLMr4KrtiHkcBcfL8nBcB/jDErgUHVLeOSfIchrL/HDdYYT/X8FHgJwFr7\nLnBOpet6ArustYestUXAv/A9WGpaxsl8bwM/x3dU0coY87Ix5jX/Ay2Uatsf0fge5J/UYxmn84Vz\nH9aU7ygw0Fp71P99FL4jxnDuv4ZmdMU+tNaWAj2ttd8BCfh6qrCW++SGfOH+PW6wxlj8rfnhqRRA\nsf8vcFXXfQecCMTVsIyT+fL9+Q4D91lrLwLGAqtCmK+2jFhrN1lr9wMRdV3GBfkKCN8+rDaftbbM\nWpsDYIy5GWhlrX2tpmVclNEV+9CfsdQYMwz4AHjTn81Nj8Hj8x0mvPsvIK4MVYtD+Iq8XKT/L3D5\nda0rXRcH5NWyjNP5vgV2AasArLW7gFygQ4jy1ZYxmMs0VEO2tZPw7cMa8xljIowx9wG/Ai6vyzIu\nyeiafejP8Ly1tiMQA1yLr4hd8xisIl84919AGmPxvwNcAmCMGQBsq3TdDuBUY0y8MSYa+BmwCfi/\nGpZxQ77rgHT/Mh3xPeAOOJQxmMs0VEO2Fc59WFu+pfjOD19W6XRKOPdfQzO6Yh8aY+KMMW/6f0fA\ndzRd4l/mN1Ut44J8pYT/97jBGt0gbZVebe/jv+iP+F5kaeV/B89vgBn4TgP8xVqbUdUy5e8EcUm+\n5sCTQFd8D6A7rbX/DkW+umSsdLvXgTHHvavH8X1YTb6w7cOa8gGZwBZ8ry8BlAEPAy8cv0yo9l8A\nGf8BrAC64OA+9P+e3ADcgO/c+UfAzf7bueIxWE2+KML4exyIRlf8IiISmMZ4qkdERAKg4hcR8RgV\nv4iIx6j4RUQ8RsUvIuIxKn4REY9R8UujZIwZZIx5I4zbm2GMmV7LbUYZY54M8nb7GWPmhWr94k0q\nfmnM3PghlGBnOh1oH8L1iwc1xmGZRcolGmM24Bue+d/AeGttkTEmB9gKJAHn4vsEZi//9xbf2DQ/\nAZ4HtgNnAV8CV1prvzXGXAXcje/Tl1uAm/zb62+MeQfoCCy31s6sLpgxph++oXxbAl8Do621Wf5n\nKZvxDdeRANxsrX3ZGHMSvnFe4v2ZBvkzz8I34uNdQDbQ3b+OLsA/rbU3IVJPOuKXxiwZX9n3wTf4\n3Rj/5e2Audbas4HzgKPW2vOB7kAs/jFY8A2je7+19gx8A4CN9I+x8gAw2H95s0q3b4+vkM8B7jDG\ntKoqlH/4iMeBEdbac/zrW1bpJs2ttQOB24A/+y97GPibtbYv8CzQ0Vp7CJgOvGCtvdd/u874hqTu\nCaQaY3rWZ4eJgIpfGre3Ks2KtAr4RaXrNgNYa/8FLDbGjMNXrqcCJ/hv85W19iP/19uBtvj+ULxt\nrT3gX36UtfYF/202WGuLrbW5QI7/9lXpAXQDXjDGvA/Mx/dHqtxLx20T4EJgpX+ba/GN2lrdff6v\ntbYQ+AzfswaRetGpHmnMiit9HYFvGkEAykecNMZcCswEHgSewFeU5eP4H6m0fFmldVSM82+MqVys\nlbcHx85pVNDHAAABLUlEQVQHUFkz4DP/M47yAb+SKl1fvt3ybYJv9Mm6HIhVzlB5eZE60xG/NGY/\nM8Z08k92MQr/1IHH+RXwtLX2KeAgvhnPmvmvq6o0twDnGmPKX1B9ELi0nrk+AdoaY37q//4GYHUt\ny7wCjAQwxqTiO9cPvqLXAZoElYpfGrPt+I7iPwT2+b+GY9/58jhwlfFNgv0svvkPTq7idgD4T/H8\nCXjFGPMRvrHWq3oLZbXvrvGfhvk9kG6M+QC4Bt9Y7TUtdytwhT/n7/nhVM9mYIAxZm4Vy+odPtIg\nGpZZxAX8UyC+aq39xBhzFrDUWtvP6VzSNOkppIg77AL+bowpBb4HbnQ4jzRhOuIXEfEYneMXEfEY\nFb+IiMeo+EVEPEbFLyLiMSp+ERGPUfGLiHjM/wcu9hdH844pkQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x10bc01c10>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "from Bio.Phylo.TreeConstruction import *\n",
    "\n",
    "#open our alignment file (or make a new one if you want)\n",
    "with open('aln.clustal', 'r') as align:\n",
    "    aln = AlignIO.read(align, 'clustal')\n",
    "\n",
    "#create a parsimony scorer object\n",
    "scorer = ParsimonyScorer()\n",
    "#the searcher object will search through possible trees and score them.\n",
    "searcher = NNITreeSearcher(scorer)\n",
    "\n",
    "#takes our searcher object and a seed tree (upgma_tree) to find the best tree\n",
    "constructor = ParsimonyTreeConstructor(searcher, upgma_tree)\n",
    "\n",
    "#build the tree \n",
    "parsimony_tree = constructor.build_tree(aln)\n",
    "\n",
    "#draw the tree\n",
    "Phylo.draw(parsimony_tree)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "*Exercise 2. Bootstrapping*\n",
    "\n",
    "We just saw two methods of growing phylogenetic trees given an alignment. However, as we saw with the maximum parsimony approach, there can be many different trees for a single data set. How do we know our tree is a good representation of the data? By 'good' here we will instead use the word 'robust'. Is the tree we use too sensitive to the particularities of the data we gave it? If we make a small change in the sequence will we get a very different tree? Normally these problems would be addressed by re-sampling and seeing if we obtain similar results. But we can't really re-sample evolution. It happened once and we can't make it happen again. So we use something called *bootstrapping* which is a technique often used in statistics where instead of generating new data, you re-sample from your present data.\n",
    "\n",
    "So we have a multiple sequence alignment with $M$ sequences (rows) each with sequences of length $N$ nucleotides (columns). For each row, we can randomly sample $N$ nucleotides with replacement to make a new 'bootstrapped' sequence also of length $N$. Think of it as a kind of shuffling of the data. This gives us a whole new alignment that we can again use to make a new tree.\n",
    "\n",
    "This process is repeated many times to obtain many trees. The differences in topology (shape/structure) of the trees we obtained are assessed. If after this shuffling/perturbations we still get similar enough looking trees we can say that our final tree is robust to small changes in the data. ([some more reading on this](http://projecteuclid.org/download/pdf_1/euclid.ss/1063994979))\n",
    "\n",
    "Let's run a small example of this using the bootstrapping functions in `BioPython`."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 52,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "CLUSTAL X (1.81) multiple sequence alignment\n",
      "\n",
      "\n",
      "3                                   AAAAUCUUCU\n",
      "6                                   AAAAUCUUCU\n",
      "7                                   AAAAUCUUCU\n",
      "0                                   AAAAUGUUGU\n",
      "4                                   AAAAUGUUGU\n",
      "5                                   AAAAUGUUGU\n",
      "2                                   AAUAUGUUGA\n",
      "8                                   AAUAUGUUGA\n",
      "9                                   AAUAUGUUGA\n",
      "1                                   AAUAAAAUAA\n",
      "\n",
      "\n",
      "\n",
      "CLUSTAL X (1.81) multiple sequence alignment\n",
      "\n",
      "\n",
      "3                                   GCAAGGGGAA\n",
      "6                                   GCAAGGGGAA\n",
      "7                                   GCAAGGGGAA\n",
      "0                                   UGAAUGUUAA\n",
      "4                                   GGAAGGGGAA\n",
      "5                                   AGAAAGAAAA\n",
      "2                                   UGUAUGUUAU\n",
      "8                                   UGUAUGUUAU\n",
      "9                                   UGUAUGUUAU\n",
      "1                                   UAUAUGUUAU\n",
      "\n",
      "\n",
      "\n",
      "CLUSTAL X (1.81) multiple sequence alignment\n",
      "\n",
      "\n",
      "3                                   GAUUAACAGA\n",
      "6                                   GAUUAACAGA\n",
      "7                                   GAUUAACAGA\n",
      "0                                   GAUUAAGAGA\n",
      "4                                   GAUUAAGAGA\n",
      "5                                   GAUUAAGAGA\n",
      "2                                   GAUUAAGUGA\n",
      "8                                   GAUUAAGUGA\n",
      "9                                   GAUUAAGUGA\n",
      "1                                   GAAUAAAUGA\n",
      "\n",
      "\n",
      "\n",
      "CLUSTAL X (1.81) multiple sequence alignment\n",
      "\n",
      "\n",
      "3                                   UCCAGUUAUA\n",
      "6                                   UCCAGUUAUA\n",
      "7                                   UCCAGUUAUA\n",
      "0                                   UGGAGUUAUA\n",
      "4                                   UGGAGUUAUA\n",
      "5                                   UGGAGUUAUA\n",
      "2                                   AGGAGAAAUA\n",
      "8                                   AGGAGAAAUA\n",
      "9                                   AGGAGAAAUA\n",
      "1                                   AAAAGAAAUA\n",
      "\n",
      "\n",
      "\n",
      "CLUSTAL X (1.81) multiple sequence alignment\n",
      "\n",
      "\n",
      "3                                   GGUUUGUUUA\n",
      "6                                   GGUUUGUUUA\n",
      "7                                   GGUUUGUUUA\n",
      "0                                   UUUUUGUUUA\n",
      "4                                   GGUUUGUUUA\n",
      "5                                   AAUUUGUUUA\n",
      "2                                   UUUUAGUUAA\n",
      "8                                   UUUUAGUUAA\n",
      "9                                   UUUUAGUUAA\n",
      "1                                   UUUUAGUAAA\n",
      "\n",
      "\n",
      "\n"
     ]
    }
   ],
   "source": [
    "from Bio.Phylo.Consensus import *\n",
    "\n",
    "#open our alignment file.\n",
    "with open('aln.clustal', 'r') as align:\n",
    "    aln = AlignIO.read(align, 'clustal')\n",
    "\n",
    "#take 5 bootstrap samples from our alignment\n",
    "bootstraps = bootstrap(aln,5)\n",
    "\n",
    "#let's print each new alignment in clustal format. you should see 5 different alignments.\n",
    "for b in bootstraps:\n",
    "    print(b.format('clustal'))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 53,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX4AAAEMCAYAAADDMN02AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3Xt4VNW9xvFvQggSTAyQCYqQBC0uEYsIIpRWsdZqYxGr\n1hbFSusVUDlKVMIdxCgXIwhBILUWWqSn6qmg8YDa06rVQ+VaCx5coEgQQiWEIAiFXM8fMwlBM8kk\nZGbPzH4/z+PjZPbOXu9Mht+sWbP3WjHV1dWIiIh7xDodQEREQkuFX0TEZVT4RURcRoVfRMRlVPhF\nRFxGhV9ExGXinA7QmOLiw00+37R9+wRKS48GI05IKL+zlN9ZkZw/nLJ7PIkx/rZFZY8/Lq6V0xFO\nifI7S/mdFcn5IyV7VBZ+ERHxT4VfRMRlVPhFRFxGhV9ExGVU+EVEXEaFX0TEZVT4RURcRoVfRMRl\nVPhFRFxGhV9ExGVU+EVEXCbsJ2k7VSUl+3nssclUVlaQmJjE5MnTadu2rdOxREQcE/U9/hdeWMqP\nf3wdeXn5dO9+Hq+9tsLpSCIijor6Hv/o0VkAVFVVsW/fF5x1VmeHE4mIOCvqevx9+15IRkbGSfdV\nVFRw++1D2bRpA336XOJMMBGRMBF1hb8+cXFxLFv2Io88Mp7p0yc7HUdExFFRX/hzc2eyceN6ANq2\nTaBVq8hYKEFEJFiifoz/5pt/zuzZT7J06W+IiYkhK2us05FERBwV9YU/LS2D+fMXOx1DRCRsRP1Q\nj4iInEyFX0TEZaJ+qGfVqgIKC3cyYsT9LX7sBx64l5iYGKqrq9m1ayfXXjuEe++9r8XbERFpSVFf\n+AFiYmKCctya7w6KivYwZco4hg+/MyjtiIi0JFcU/hpDh95Ar1692bWrkA4dOpKTM4vVq19nzZr3\nOXbsGEVFexg27HYyMwezY8cnzJ37FABJSWcwfvxkrP2YhQvnEx8fz5AhN3D11ZkAzJuXy8iRoznt\ntNOcfHgiIgFxVeHfu7eIvLx8UlI8jBx5J1u3fgTAkSNHyM2dx+7dn5OdPYbMzMHMnJnD+PFTSE/P\noKBgJcuWLaVfv/6Ul5eRn7+k9piffvoJR48e1RXBIhIxoq7wFxXt8bstOTmZlBQPAKmpnSgrKwOg\ne/fzau87ftx7X2HhZ+TmzgC8Uz506dIVgLS09JOO+cYb/8111/2kZR+EiEgQRV3hb476vgNIS8tg\n4sRppKZ2YvPmDzlwoMS378knQm3YsI7bbvtlKGKKiLQIlxX+EwW+sS98s7KymT59MpWVlcTGxpKd\nPYni4n3f2K+09ABJSUktnlREJFhiqqurnc7QoOLiw00KeNZZ7QHYu7c0KHlCweNJpLj4sNMxmk35\nnaX8zgmn7B5Pot/erS7gEhFxGRV+ERGXUeEXEXGZkH+5a4yJA54HMoB4IMda+1qw2jt27BhPPfUk\n//rXXsrLy3nooUc4//wLgtWciEjYc6LHfxuw31p7OZAJ5AWzseXLf8c553yLvLx8Hn10Art2FQaz\nORGRsOdE4X8RmFSn/fJgNrZ27d9p3bo1Y8Y8wNKlv+HSS78TzOZERMJeyId6rLVHAYwxicBLwISG\n9m/fPoG4uMCXS+zSpQvgPa0K4KuvDlFVdZzf/34JK1as4Lnn8pg5c2Yz04dOTf5IpfzOUn7nREJ2\nRy7gMsZ0Bf4E5Flr/9jQvqWlR5t07KqqamJjY2rPpW3XLpGLL+5PcfFhevW6lEWLFofNebb+hNO5\nwM2h/M5SfueEU/aG3oBCPtRjjOkEvAE8aq1dGuz2LrqoN2vWvA/AP/6xgW7dzg12kyIiYc2JHv84\nIBmYZIyZDFQDmdba48Fo7LbbfsXMmdMZMeIO4uLimDjxsWA0IyISMZwY438QeDBU7SUlJZGTMztU\nzYmIhD1dwCUi4jIq/CIiLqPCLyLiMir8IiIuo8IvIuIyKvwiIi6jwi8i4jIq/CIiLqPCLyLiMir8\nIiIuo8IvIuIyKvwiIi6jwi8i4jKOLMQSSvPm5bJ9+zZiYmIoKdlPYmISixY973QsERHHRH3hHz06\nC4CKigruu+9uxo6d6HAiERFnuWao5+WX/5NLLx1At27nOB1FRMRRrij8FRUVvPrqK9xyy21ORxER\ncZwrCv+6dR/Qu3cfEhLaOR1FRMRxrij869evZcCA7zodQ0QkLLii8H/++S46dz7b6RgiImEh6s/q\nAZg1a47TEUREwoYrevwiInJC1Pf4V60qoLBwJyNG3N/ix1637gMWL15AXFwcl1xyKXfdNaLF2xAR\naWmu6PHHxMQE5bgLF85j8uTHWLToeTZuXM+OHZ8GpR0RkZYU9T3+uoYOvYFevXqza1chHTp0JCdn\nFqtXv86aNe9z7Ngxior2MGzY7WRmDmbHjk+YO/cpAJKSzmD8+MlY+zELF84nPj6eIUNu4Lzzzufg\nwYOcdVY5ZWVltGrVyuFHKCLSOFcV/r17i8jLyyclxcPIkXeydetHABw5coTc3Hns3v052dljyMwc\nzMyZOYwfP4X09AwKClaybNlS+vXrT3l5Gfn5SwA4eLCURx99iOTkZM4991ukp2c49+BERALkqsKf\nnJxMSooHgNTUTpSVlQHQvft5tfcdP+69r7DwM3JzZwDeK3+7dOkKQFpaOgBfffUVv//9El544SU6\ndkzh2WfnsXz577n11l+E9DGJiDSVqwq/P/V9B5CWlsHEidNITe3E5s0fcuBAiW9f79cibdq0ISEh\ngbZt2wKQkpLCwYMHQxdaRKSZXFb4TxT4xr7wzcrKZvr0yVRWVhIbG0t29iSKi/fVbm/dujX33/8g\nDz54H23atOH00xOZMGFqsIKLiLSYmOrqaqczNKi4+HCTAvbteyGxsTGsW7c5WJGCzuNJpLj4sNMx\nmk35naX8zgmn7B5Pot/erStO5xQRkRNU+EVEXEaFX0TEZVT4RURcxrHCb4xJNcbsMsac51SGSLJp\n0wZuvPHHTscQkSjgSOE3xsQBi4CjTrQfafbt+4IXX1xOZWWl01FEJAo41eN/ClgIFDnUfsQoKyvj\nqadmkJU1zukoIhIlQl74jTG/BPZZa9+i7hVVLte374W1/9U1Z84sbrnlNlJSUoDwvuZCRCJDyC/g\nMsa8A1T5fuwNWGCItXZffftXVFRWx8UFPutlRkYGADt37jyVmCGVkZHB7t276dKlC3Ai+759+xg+\nfDgej4fq6mo2bdrENddcQ25uroNpRSRC+O1YO3rlrjHmr8C91tpt/vZxw5W7Nb38DRu2AP6v/rv+\n+mtYufKNkGZrjnC6erE5lN9ZkZw/nLKH85W7GrtoEo2Micipc3SSNmvtlU62H2lWrlztdAQRiQJO\n9/hFRCTEVPhFRFxGhV9ExGVU+EVEXEaFX0TEZVT4RURcRoVfRMRlVPhFRFxGhV9ExGVU+EVEXEaF\nX0TEZVT4RURcRoVfRMRlHJ2dU6LboUOHuPXWGznnnG8BcPnlV/DTnw51OJWIqPBL0Gzb9jFXXfUj\nHnzwYaejiEgdGuqRoLF2K9b+H/fffw+TJ4+jpGS/05FEBPX4o9rXF24PhZrlIwHS07tx/vkX0Ldv\nP958czVz5szm8cdnhjyTiJxMPf4o1bfvhRQV7XE0Q58+l3DxxX0BGDToCj75xO/SyiISQurxR7HO\nnc8+qQceajNnTmfQoB9w5ZVXsW7dWow537EsInJCQIXfGNMBaId3te9WQDdr7V+CGUwi38iRo3ni\niWmsWPEyp53WluzsiU5HEhECKPzGmCeBUUBroAToDKwH+gc3mnu98sorbNnyMSNG3N/ix96zZzez\nZz9BRUUF8fHxTJ36BElJSS3eDsCZZ57FvHmLgnJsEWm+QMb4hwJdgT8CVwBXAcVBzCRATExMUI47\na1YO99wziry8fK6//iY+/3xXUNoRkfAVyFDPXmvtIWPMFuAia+2fjDGzgh1MvIYOvYFevXqza1ch\nHTp0JCdnFqtXv86aNe9z7Ngxior2MGzY7WRmDmbHjk+YO/cpAOLjW1NWVs6mTRtYuHA+8fHxXHfd\nTygtPcB7773LwoXz6dHjAkaOHO3wIxSRUAuk8H9pjPkFsAF4wBhTBLQPbqxTs3v3bkdOZWyuoqI9\ndO58dr3b9u4tIi8vn5QUDyNH3snWrR8BcOTIEXJz57F79+dkZ48hM3MwM2fmMH78FNLTM7j00ouI\ni/P+ecvLy8jPX8L+/cU8/vgUxowZyz33jGLGjOmsWlXAtddeF7LHKiLOC2So504g1Vr7NrATWAxM\nCGKmU7Jhwxa6dOnidIwWk5ycTEqKB4DU1E6UlZUB0L37ebX3HT/uva+w8DNyc2cwevQIWrVqRc1o\nUVpaOgCJiUm0a9eO3r37ADBw4GV8/PH/hfLhiEgYCKTHn2KtzQWw1mYBGGN+GtRUp2jnzp0UFx92\nOkbAmvPppL7vANLSMpg4cRqpqZ3o1+/beE/CgpgY7/t7mzZt6No1jX/+8x/06tWbDz/cSLdu555S\ndhGJPIEU/leNMQustbN9p3UuBLoDLwc3mnidKPCNfeGblZXN9OmTqaysJC6uNeXl5d/YZ+zYSTz9\n9Eyqqqo466zOGuMXcaGY6urqBnfwFft5wDlAKvAs8Iy1tjL48aC4+HDDAevh8SRGZI+/5mKrlsj/\n9WOGUqQ9/1+n/M6K5PzhlN3jSfTbUwxkjD8GKAcSfLerfP+JiEgECqTwf4T3S91LgAHAd4C1Qcwk\nIiJBFMgYf6a1dpPvdjHwc2PMzUHMJCIiQRRI4d9jjHkIOJ06c/UALwUzmIiIBEcgQz1/AnoDt+Gd\nqG0IGuMXEYlYgRT+FGvtcOA1vG8CVwA9gxlKRESCJ5DCX+r7v8U7V8+XQPypNGqMyTbG/K8xZp0x\n5lenciwRkUC9+OJyFi9e4HQMxwVS+P/HGPMS8CaQZYxZBBxtboPGmEHAd6y1A/F+euja3GOJiATi\n+PHjPPbYJF55RdedQmCFvwcw1lpbCNyCt+ff7MIPXANsMcasAF4FCk7hWCIijSorKyMzczC3336H\n01HCgt+zeowxrwAX4V145WJjTM2m1kDhKbSZAqQBg/FeDfwqoDX5xPVaakbZ2NgYqqqafMF72Gip\n/HWvWk9MTKRfv/6sWqV+JjR8OudwoAPwDFB3QpcK4ItTaLME2GqtrQC2GWOOGWNSrLX769u5ffsE\n4uJaNbkRjyfxFCKGVmys98rquplPNX99xwylSHr+6xPq/BkZGRQV7WmxmWVr/v6RqiXy1/c3TEw8\njYSE+KD+fSPhte+38FtrDwGHgOtbuM338L6RzDHGdMY7FUSJv51LS5s+qhRO82UEoqZ3U5O5JfJ/\n/ZihFGnP/9c5kb+qqprOnc9m3brNp3wsPf9e9R3j8OFjHD1aFrTnJ5ye+4begAIZ429R1trXgU3G\nmLXASmCUtTZyP5eKiESYQK7cbXHW2mwn2hURd8vMHOx0hLAQ8h6/iIg4S4VfRMRlVPhFRFxGhV9E\nxGVU+EVEXEaFX0TEZVT4RURcxpHz+CX0Vq0qoLBwJyNG3N/ix3733bdZsGAunTqdCUBW1kOkp5tG\nfktEnKLC7yIxMcGZv8XarYwa9R8MGvR9ILwuWxeRb1Lhd6GhQ2+gV6/e7NpVSIcOHcnJmcXq1a+z\nZs37HDt2jKKiPQwbdjuZmYPZseMT5s59CoCkpDMYP34y1n7MwoXziY+PZ8iQG7B2K9u3b+PFF5fT\no0dPpkyZ4PAjFJGGqPCHiaKiPbXT8rbEtLRFRXvo3Pnserft3VtEXl4+KSkeRo68k61bPwLgyJEj\n5ObOY/fuz8nOHkNm5mBmzsxh/PgppKdnUFCwkmXLltKvX3/Ky8vIz18CwMGDpVx22RWcdVZnZs9+\ngj/84Q9cffWQU8rvdsEcmvvww00sWPAMsbGx9O7dJyhtSHhT4Q8DGzZsabG52AORnJxMSooHgNTU\nTpSVlQHQvft5tfcdP+69r7DwM3JzZwBQUVFBly7eBdPS0tJrj3fttUM4/fTTAfje9waxdu17Kvwt\nIFhDc/Pnz+Hxx2dx5plnMnr0CLZv31b7txd3UOEPE3UXjWiJMfLmvJHUV2jS0jKYOHEaqamd2Lz5\nQw4cKPHte+KEsOHDh7J48W9JSfGwYcM6evbs2fzg8g1NHZrLyppDeXml36G5/PwlxMbGcvToUb76\n6isSEhKcfogSYir8rnSiwDfWq8zKymb69MlUVlayadNGysvLiYmBVq3ieO21lQDExsYyZMg1VFdX\nU11dTWVlJWPHRu4ErE6sYHWqQ3NZWQ/w+uuvsm2bZcCA/kyYMJ233lpd79AcwEcfbWHq1PF063YO\nHk9qKB6ihBEVfpeoOx3typWra29PnZoDQO/efWrvi4+P56WXvEXdmPOZP38xffteWFucqquhqqq8\ndv+qqqraoSGI/NWfwk0gQ3MlJfu5555RzJ79BJ999hm33XYzHk9qvUNzAD17XshLL73Kr3+9kGXL\nlnDHHfeE8BGJ01T4JWCdO5990pCUP5F+OqcT+U91aK6iooL+/QeSlpZBdvajPPvsIoYPv7Peobn7\n7rubGTOeJjExkYSEBMrLy79xbIluKvwiYa/xobm4uNa89947ZGVlM2HCOA4cOMDixQvIzp5EcfG+\nk/a95ZZf8PDDo4mPj6djxxSysycFNb2En5jq6vBe9bC4+HCTA6rHeaIHGUgPvaWPp+e/6Zr69/r6\n/iUl+5kzZxaHDh3iqquu5IMP1pGTMzs4YYMskl8/4ZTd40n0O+aqHr9IFFi37gPuvfd+unZNo6Dg\nZfr16+90JAljKvwiUSAtLZ1p0yYSHx9Pjx6GUaPGOB1JwpgKv0gUuOCCC3nuud8B4TXcIOFJ0zKL\niLiMCr+IiMuo8IuIuIwKv4iIy6jwi4i4jAq/iIjLqPCLiLiMCr+IiMvoAi6RKBDMpRrXr1/Lc88t\nIi4ujvbtOzBx4jTatGnT4u1I6KjHLxIlgrVU45w5s5gx42ny8vLp0qUrBQUrgtKOhI56/CJR5uqr\nr6Znz14BL9U4d+5TAH6Xapw/fzHJyckAVFZWEB+v3n6kU+EXCRNFRXsCXpCloaUad+/ezTPPLGpw\nqcbs7DFkZg5m5swcxo+fQnp6BgUFK/0u1Qjwzjt/YdOmDdx996hTepziPBV+kTCwYcOWZq3CVZ8O\nHTo0ulRjzVKZhYWfkZs7A/Cu4uVvqcYXX1zO22//hdzcPFq3bt0iOcU5IS/8xpg4YCmQAVQAd1tr\nt4U6h0i4acqiOV9/kzh06EvefHMVmzd/yJdffsnx48e/8QVsfd8BpKVlMHHiNFJTO7F584f1LtW4\ndOlv2L7dMnfus8THxzflIUmYcuLL3WuBVtba7wLTgSccyCASVT74YA0ZGd3Iy8snLi6OgoKVQONf\n+GZlZTN9+mRGjbqLxYsXcO653U/aXlp6gCVLnmP//v1kZT3A6NEjWLHiv4L2OCQ0nBjq2QbEGWNi\ngDOAMgcyiESVH/7wR7Vr6950003ExXn/aU+dmgNA7959aveNj4/npZe8bwzGnM/8+YtPOlaXLl25\n+OK+ALRv34G//nVN0PNLaDlR+L8CugEfAx2BwQ5kEIkqqamdWLQoj7feWk11dRXPPvu805EkjIV8\nsXVjTC5wzFo7wRhzNvBX4EJrbb09/4qKyuq4uFYhzRgNMjIyANi5c2dYHk9OTU2PvqKiAoAbb7yR\nhx9+mIEDB/LOO++wfPlyFi9e3NAhJPqF1WLrB4By3+2Dvgx+K3tp6dEmNxDpS8+1RP6qKu8beks9\nD005np7/0KnJ2bZtO8rLYyguPozH46GkpDRiHsPXRdLz/3XhlN3jSfS7zYnCPxd43hjzLtAaGGet\n/bcDOUSixoMPPsKcObOorKwkPj6OMWPGOh1JwljIC7+19gjw81C3KxLNMjK68cwzC4Hw6nVKeNJc\nPSIiLqPCL82yalUBixblBbWN3/3ueaZMGR/UNkTcSIVfmi1Ys0ECrFnzPmvWvB/UNqJJsN+IKysr\nmThxLGvX/j1obUjoaK4eOWVDh95Ar169a2eDzM9fyKpVBc2eDbJnz2/z2msruOuuEbz2mqYADlSw\n3iT37NnN449PYf/+YuCGoLQhoaXCH8WaMttjIMfyNxvk3r1F5OXl184GuXnzZqB5s0H++9//ZsKE\nR5k06TE+++xTQn2dSTRo6WmZzz23O+PGTWLZsqUOPzJpKSr8UaolZ3tsTHJy8kmzQR4/fhxo3myQ\na9f+ndLSEqZMGcfhw4coKSnhhReWMmzY8JA8lmgQrGmZJXqo8Eexpsz22JjmvIk0ZzbIQYO+z6BB\n3wdg06YNrFz5JxX9evj79AXBmZZZoosKv7SAEwU+0NkgKysriY2NJTt7Uu3kYhJczZ2WWaKPCr80\nS2bmibn1Vq5cXXt76tQcPJ5EMjLOr72vKbNB1nXxxX3rvV8CpzdiqU/IJ2lrquLiw00OGOlXLoZj\n/pqhnkCGj8Ixf1NEQv6G/h6RkL8hkZw/nLJ7PIl+3/X1eU5ExGVU+EVEXEaFX0TEZfTlrkgU+OKL\nf/Hkk49RWVlJ69ateOihbLp2TXM6loQp9fhFosBzzy3ipz8dyvz5i7n33ntZtGi+05EkjKnHLxIF\nHnjgIdq1Ox3wXojVps1pDieScKYev0gUSEo6g1atWrFr105mz57Nr351t9ORJIypxy8Sgeo7f3/j\nxvU8/fQs5szJxePp6kAqiRTq8YtEgY0b1/PMM7nk5s7jggsucDqOhDn1+EWiwLx5T1NZWUFOzlTi\n4mLp3LkrDz88zulYEqZU+EWiwJIly2tvh9O0ARKeNNQjIuIyKvwiIi6jwi8i4jIq/CIiLqPCLyLi\nMir8IiIuo8IvIuIyKvwiIi6jwi8i4jIq/CIiLqPCLyLiMir8IiIuo8IvIuIyQZ+d0xjTH5hhrf2+\nMeZcYAlQBWyx1t4X7PYl9EpLSxkz5kHKysro2DGF8eOn0KZNG6djiYhPUHv8xphHgF8DNf/qnwbG\nW2sHAbHGmOuD2b44Y8GCBfzwhz8iLy+f7t3PY+XK/3I6kojUEeyhnk+AG+r83Nda+zff7VXAVUFu\nXxywceNGBgwYCMCAAd9l/fp1DicSkbqCOtRjrX3FGJNe566YOrcPA2cEs31pWUVFe+jb98J6t9Vd\nA/bIkSO0a3c6AAkJCRw58lVI8olIYEK9AldVnduJwMHGfqF9+wTi4lo1uSGPJ7HJvxNOwi3/rl2F\nZGRk+N1eN2+7du1o2zaGDh0SKSmBDh2Sw+7xNCbS8n6d8jsnErKHuvBvNMZcbq19F8gE/tLYL5SW\nHm1yI5G+9Fy45l+3brPfbXXz9unTh4KCN8jMHMyqVW/Ro8e3w/Lx+BOuz3+glN854ZS9oTegUJ/O\n+TDwmDHmfaA18HKI25cQGDlyJH/+85uMGnUXH320hZtu+pnTkUSkjqD3+K21hcBA3+3twBXBblOc\n1bFjR3Jz5zkdQ0T80AVcIiIuo8IvIuIyKvwiIi6jwi8i4jIq/CIiLqPCLyLiMir8IiIuo8IvIuIy\nKvwiIi6jwi8i4jIq/CIiLqPCLyLiMir8IiIuE1NdXe10BhERCSH1+EVEXEaFX0TEZVT4RURcRoVf\nRMRlVPhFRFxGhV9ExGWCvth6MBljYoBngYuAY8Bd1toddbZfB0wCyoHfWmufcySoH43l9+2TALwJ\n3GGt3Rb6lPUL4Lm/BfgPvM/9ZmvtKEeC+hFA/puAsUAVsNxaG1arxwfy2vHttxgosdaOD3HEBgXw\n/D8I3AXs8911r7V2e8iD+hFA/n5Aru/HfwG3WWvLQh7Uj0jv8f8EaGOtHQiMA56u2WCMifP9fBVw\nBXCPMcbjRMgG+M0PYIzpC7wDnONAtsY09NyfBjwGDLLWXgYkG2MGOxPTr4byxwJPAFcCA4FRxpgO\njqT0r8HXDoAx5l7gwlAHC1Bj+fsCv7DWXun7L2yKvk9j+fOBX1prLwdWA+khztegSC/838P7pGKt\n/QC4pM62HsB2a+0ha2058B5weegjNqih/ADxeF9gH4c4VyAayn4cGGitPe77OQ5vryic+M1vra0C\nelhrvwJS8P47CZvemk+Drx1jzHeAfsDi0EcLSGOv/b7AOGPM34wx2aEOFwC/+Y0x5wElwBhjzNtA\nh3B744r0wp8EfFnn5wpfb62+bYeBM0IVLEAN5cdau8ZauweICXmyxvnNbq2tttYWAxhjHgDaWWv/\n7EDGhjT23FcZY24A/gG8DRwJbbxG+c1vjDkTmALcT3i+dqCR5x/4AzAC+D7wPWPMtaEMF4CG8qcA\n3wHm4R1xuMoYc0Vo4zUs0gv/ISCxzs+xvt5azbakOtsSgYOhChaghvKHuwazG2NijDGzgR8AN4Y6\nXAAafe6tta9YazsDbYDbQxkuAA3lvxnoCPw3kA3caoyJpPwAz1hrD1hrK4DXgYtDmq5xDeUvAT6x\n1m7z5V/NNz/ROCrSC//7wLUAxpgBwOY627YC3zLGJBtj4vEO86wJfcQGNZQ/3DWWPR/vGOhP6gz5\nhBO/+Y0xicaYt32vG/D29sPtDdlvfmvtfGttP2vtlcAMvF9O/86ZmH419PwnAVuMMQm+L1GvBDY4\nktK/hl7/O4DTjTE1381dBnwU2ngNi+hJ2up8s97Ld9ev8I4NtrPWPmeM+THej7wxwG+stYucSVq/\nxvLX2e8vwIgwPavnG9nx/iNdB/zNt60abw9uZahz+hPAa+cuvGeVlAH/BB6w1obNP5YmvHaGAyaM\nz+rx9/wPw3tW2DHgf6y105xJWr8A8l8BzPRt+19r7UOhT+lfRBd+ERFpukgf6hERkSZS4RcRcRkV\nfhERl1HhFxFxGRV+ERGXUeEXEXEZFX6JSMaYQcaYv4awvSnGmMmN7DPcGPPbFm63nzFmRrCOL+6k\nwi+RLBwvQmnpTBcAqUE8vrhQRM/HL67nMcasAs4G/g7cZ60tN8YUA+uBTsCleK+w7On72eKdO+hM\n4BVgC955YP4F3GytPWiMuRWYgHeahnXAPb72+htj3gc6A0sauprUNx/700BbYD/e+eQLfZ9S1uK9\njD8F7xUVnEFPAAACd0lEQVTBbxhjzgZeAJJ9mQb5Mj8GtDPGjAOKgO6+Y6ThvaL1HkSaSD1+iWQZ\neIt9L7wT8o3w3d8ReMJa2wfvLInHrbXfBboDCfjmWMG7iMZT1tpv451pcZgxpjO+dRx897eqs38q\n3oJ8CfCIMaZdfaGMMa2BXwO3WGsv8R2v7iJArX3zuI8BHvfd9wzwB2ttb+BloLO19hAwGXjVWvuk\nb7+ueKfq7gFkGmN6NOUJEwEVfols79ZZ9egFvAvu1FgLYK39G7DQGDMKb3H9FnC6b58vrLX/9N3e\nAnTA+0bxnrV2r+/3h1trX/Xts8paW2GtLQGKffvX5zzgXOBVY8wmvHO2ZNTZvvprbQL8EFjma3MF\n/meSfdda+6VvNadP8X5qEGkSDfVIJKuoczsG7zKPANTMCGqMGQJMA+YAz+MtlDVz1NddHKa6zjFq\n57A3xtQtrHXbA/9z3bcCPvV94qiZ0KtTne017da0CVBJYB2xuhnq/r5IwNTjl0h2mTGmi28BjOHA\nW/Xs8wPgj75piffhnZ67lW9bfUVzHXCpMabmC9U5wJAm5voY6GCM+Z7v57uA5Y38zpvAMABjTCbe\nsX7wFnp10KRFqfBLJNuCtxf/IbDbdxtOPvPl13gXItmAd+x8DdCtnv0A8A3x/AfwpjHmn3jn4q/v\nFEq/Z9f4hmF+BuQaY/4B/AK4o5Hfewi4yZfzZ5wY6lkLDDDGPFHP7+oMH2kWTcssEgZ8S1S+Za39\n2BhzMZBvre3ndC6JTvoIKRIetgP/aYypAv4N3O1wHoli6vGLiLiMxvhFRFxGhV9ExGVU+EVEXEaF\nX0TEZVT4RURcRoVfRMRl/h+swS9bQo2oGwAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x10a383f50>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX4AAAEMCAYAAADDMN02AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3Xl4VOXB/vHvDCHIksiSACJLAPFRQAQiSt2w1mpxoWpb\nKy6lrxuISlW0BmQVUEAjQoIsrlj0tWgrKC2IbVWqL7KJCv70AZVFCJUAQSIxZJvfHzOJwWaZwJw5\nkzn357p6dTJzcp57Erxz5pkzz/EFAgFERMQ7/G4HEBGR6FLxi4h4jIpfRMRjVPwiIh6j4hcR8RgV\nv4iIxyS4HaA2ubn5dT7ftEWLJuTlFTgRJ+KU1RnK6gxldYYTWVNTk3zVPRaXR/wJCQ3cjhA2ZXWG\nsjpDWZ0R7axxWfwiIlI9Fb+IiMeo+EVEPEbFLyLiMSp+ERGPUfGLiHiMil9ExGNU/CIiHqPiFxHx\nGBW/iIjHqPhFRDwm5hdpO1b79u3loYfGUVpaQlJSMuPGTaJx48ZuxxIRcU3cH/G/+OICLrvsCrKz\n59Ot28m88cZityOJiLgq7o/4R4wYCUBZWRl79nzDCSe0czmRiIi74u6IPz29J2lpaUfcV1JSwu9+\ndy0bNqynb98z3AkmIhIj4q74q5KQkMDChYu4//7RTJo0zu04IiKuivviz8ycxocfrgOgceMmNGhQ\nfy7OICLihLif4//Nb37Lo48+woIFz+Dz+Rg58gG3I4mIuCrui79jxzSysua5HUNEJGbE/VSPiIgc\nScUvIuIxcT/Vs2zZUrZv38awYXdGfN+7du3k0UcfpqSkhMTERCZMeJjk5OSIjyMiEklxX/wAPp/P\nkf1Onz6FoUPvoHv3nrz77tt8/fUOevTo6chYIiKR4oniL3fttVfRq1dvduzYTsuWrZgyZTrLl/+N\nVavep7CwkJycXVx//e8YOPByvvrqC5544jEAkpOPZ/TocVj7OXPmZJGYmMgVV1xJXt5+3ntvJXPm\nZHHqqd25/fYRLj9DEZHaeWqOf/fuHG67bThz5z5LXt5+PvvsUwAOHTrE9OkzmDo1kxdfXADAtGlT\nGDkyg1mz5tK//9ksXBi8v7i4iOzs+aSn92Pr1q8488z+ZGXN4+DBgyxbttS15yYiEq64O+LPydlV\n7WPNmzcnJSUVgNat21BUVARAt24nV9x3+HDwvu3bt5KZORUILvnQvn0HADp27ARAUlIyTZs2pXfv\nvgCcffZ5rFu3mksvvcKBZyUiEjlxV/xHo6r3ADp2TGPMmIm0bt2GjRs/Zv/+faFtgy+SGjVqRIcO\nHfnkk4/o1as3H3/8IZ07d41qbhGRo+Gx4v+h4Gt7w3fkyAwmTRpHaWkpfr+fjIyx5ObuOWKbBx4Y\ny+OPT6OsrIwTTminOX4RqRd8gUDA7Qw1ys3Nr1PAE05oAcDu3XmO5Im01NQkcnPz3Y4RFmV1hrI6\nw+tZU1OTqj269dSbuyIiouIXEfEcFb+IiMdE/c1dY0wC8CyQBiQCU6y1bzg1XmFhIY899gj/+c9u\niouLueee+znllO5ODSciEvPcOOK/AdhrrT0fGAhkOznYSy+9QJcuJ5GdPZ8//vFBduzY7uRwIiIx\nz43iXwSMrTR+sZODrVnzAQ0bNuTee+9iwYJnOPPMnzg5nIhIzHPtdE5jTBKwBJhnrf1zdduVlJQG\nEhLCv1xi+YXWt23bBsAll1zCFVdcwZ133snixYtZtWoV06ZNO4bkIiL1QrWnc7ryAS5jTAfgr0B2\nTaUPkJdXUKd9l5UF8Pt9FefENm2aRJ8+Z5Gbm0+vXmcyd+68mDq31+vnGjtFWZ2hrM5w6Dz+ah9z\n483dNsCbwB3W2redHi8pKYmZMzOZPfspPvpofUSXVbjrrqH4fD4CgQA7dmzj0ksHMXToHRHbv4iI\nE9w44h8FNAfGGmPGAQFgoLX2sBODnX32ebz66ssMG3YTCQkJjBnzUMT2XX4t35ycXYwfP4ohQ26O\n2L5FRJwS9eK31t4N3B2t8Ro3bsyAARcydOgdXHvtVTz77LyIrMc/aNBVXHzxQABmzcrk9ttHcNxx\nx0XraYmIHDVPLdK2e3cO2dnzSUlJ5fbbbz5iPf7MzFns3Pk1GRn3MnDg5UybNoXRo8fTqVMaS5cu\nYeHCBfTrdxbFxUXMn/98xT6//PILCgoK6Nv3DJeelYhI3cRd8UdrPf5yb775d6644srIPgkREQfF\nXfEfjaNZj7/c+vVrueGG30cjpohIRHis+CO7Hj9AXt5+kpOTI55URMQpWo/fZV4/19gpyuoMZXWG\n1uMXERFHqfhFRDxGxS8i4jEqfhERj1Hxi4h4jIpfRMRjVPwiIh6j4hcR8Zi4/+TurFmZbNmyGZ/P\nx759e0lKSmbu3GfdjiUi4pq4L/4RI0YCwYXW7rjjVh54YIzLiURE3OWZqZ5XX32ZM8/sT+fOXdyO\nIiLiKk8Uf0lJCa+//hqDB9/gdhQREdfF3VRPu3Yn4vcfuTbR2rWr6d27L02aNHUplYhI7PDEEf+6\ndWvo3/8ct2OIiMQETxT/11/voF27E92OISISE+Juqqcq06fPcDuCiEjM8MQRv4iI/EDFLyLiMSp+\nERGPUfGLiHiMil9ExGNU/CIiHqPiFxHxGBW/iIjHqPhFRDxGxS8i4jEqfhERj1Hxi4h4jIpfRMRj\nXFud0xjTGlgHXGSt3exWjlhy8OBBrrvuarp0OQmA88+/gF//+lqXU4lIvHGl+I0xCcBcoMCN8WPV\n5s2fc9FFv+Duu+9zO4qIxDG3pnoeA+YAOS6NH5Os/Qxr/x933nkb48aNYt++vW5HEpE4FPUjfmPM\n74E91tq3jDGjoz3+sUhP7xnxfe7Ysb3idqdOnTnllO6kp/djxYrlzJjxKJMnT4v4mCLibb5AIBDV\nAY0x7wJloS97AxYYZK3dU9X2JSWlgYSEBmHvPy0tDYBt27YdS8wq97tz507at28f0f1Wznno0CEa\nN26M3++nsLCQQYMGsWLFioiOJyKe4avugagf8VtrB5TfNsa8DQytrvQB8vLq9jZAWVkAv99Hbm7+\n0YesZr/t2p3I2rUbI7pfoCLr+PGjGDDgZ1x44UW8995KTjrp5Ig/j2ORmpoUU3lqoqzOUFZnOJE1\nNTWp2sfcvuZudF9uxLjbbx/Bww9PZPHiVznuuMZkZIxxO5KIxCFXi99ae6Gb48eatm1PYNasuW7H\nEJE4pw9wiYh4jIpfRMRjVPwiIh6j4hcR8RgVv4iIx6j4RUQ8RsUvIuIxKn4REY9R8YuIeIyKX0TE\nY1T8IiIeo+IXEfEYFb+IiMeo+EXEMxYteol582a7HcN1Kn4RiXuHDx/moYfG8tprr7odJSa4fSEW\nERHHFRUVMXDg5fTrd9YR17n2Kh3xi0jcS0pKol+/s9yOETNU/CISd9LTe5KWluZ2jJil4hcR8Ziw\n5viNMS2BpoAPaAB0ttb+y8lgIiLijFqL3xjzCDAcaAjsA9oB6wBNmIlIvTJw4OVuR4gJ4Uz1XAt0\nAP4MXABcBOQ6mElERBwUTvHvttYeBDYBp1tr3wbaOBtLREScEs4c/7fGmBuB9cBdxpgcoIWzsURE\nxCnhHPHfDLS21r4DbAPmAQ86mElERBwUTvGnWGszAay1I621pwOlzsYSERGnhFP8rxtj7ofgaZ3G\nmD8Do52NJSIiTgmn+PsCpxtj/g9YA6wG+jmaSkREHBPOm7s+oBhoErpdFvqfpy1btpTt27cxbNid\nEd/3ypXvMHv2E7Rp0xaAm28eyumn94n4OCLiTeEU/6fAHOBWgmfzZAPXo6N+fD6fI/u19jOGD/8D\nAwb81JH9i4i3hVP8A621G0K3c4HfGmN+42Cmeufaa6+iV6/e7NixnZYtWzFlynSWL/8bq1a9T2Fh\nITk5u7j++t8xcODlfPXVFzzxxGMAJCcfT2bmdDZsWM+cOVkkJiYyaNBVWPsZW7ZsZtGilzj11B4M\nHz4Cv1/LKolIZIRT/LuMMfcAzai0Vg/wipPBjsXOnTtJT+8Z0X3m5OyiXbsTq3xs9+4csrPnk5KS\nyu2338xnn30KwKFDh8jMnMXOnV+TkXEvAwdezrRpUxg9ejydOqWxdOkSnnrqKXr06ENxcRHz5z8P\nwIEDeZx33gWccEI7Hn30YRYv/gtXX62/tSJHy8mp2Y8/3sDs2TPx+/307t3XkTEiLZzi/yvwJdAf\nWAxcDHzsZKj6pnnz5qSkpALQunUbioqKAOjW7eSK+w4fDt63fftWMjOnAlBSUsJJJ3WhRw/o2LFT\nxf4uvXQQzZo1A+DccwewcuXbUXsuIvHKqanZrKwZTJ48nbZt2zJixDC2bNlc8d9+rAqn+FOsteca\nYx4j+EfgYeAfzsY6Nu3bt2ft2o0R3efRvIKo6h9ax45pjBkzkdat27Bx48eUlBSEtv1hKmfIkGuZ\nN+85UlJSWb9+LcaccvTBReQIxzI1O3r0OKz9/Iip2fnzn8fv91NQUMB3331HkyZNXH6GtQun+PNC\n/28JrtWz2hiTeCyDGmMygEEEV/x80lr73LHsz30/FHxtRxUjR2YwadI4SktL8fv9rF69CoAGDRJ4\n440lAPj9fgYNuoRAIEAgEKC4uIRJkyY4lj5cfr+PsrKA2zHCoqzOqC9Zc3J20b59+4qvDxzI4803\n/87GjR+za9dOHn88m3btTqzz1OzChQvo1++sI6ZmAT79dBMTJoymc+cupKa2jvbTrbNwiv+fxphX\ngPuAFcaYvkDB0Q5ojBkA/MRae7Yxpikw8mj35abKy7suWbK84vaECVMA6N27b8V9iYmJvPJKsNSN\nOYWsrHlA8FVE+XsHZWXFFduXlZVVTA2JyLH75z/fwphTeOSRTC65ZABvvbWcIUNurvPUbPv2HYAj\np2YBevToySuvvM5TT81h4cLnuemm26L11I5KOMV/KnC/tXa7MWYwMADodgxjXgJsMsYsBpKA+49h\nX7Vy8k2dtWtXM2/ebBISEjjjjDO55ZZhdd6HE9NSTklNTSI3N9/tGGFRVmfUl6w/nprduze34rMw\nDRs2ZOPG/36bMpyp2f3794W2/WFq9o47bmXq1MdJSkqiSZMmFBcX/9d+Yk21xW+MeQ04neCFV/oY\nY8ofaggcy2XqU4COwOVAF+B1wNFJbKfe1JkzZxYTJkyhY8c0hg+/ha+++pIuXbo6MpaIHL22bduy\nc+cOAIqKiigsLATqPjWbkTGW3Nw9R2wzePCN3HffCBITE2nVKoWMjLHOPIkI8gUCVc/XGWOSgZbA\nTGBEpYdKgG+stSVHM2Doil57rLUzQl9/BFxkrd1b1fYlJaWBhIQGYe+//ALL27ZtA+C1115j69at\n3HvvvVx88cWkp6ezdetWUlJSyMrKYvHixbz77rsUFhby9ddfc+utt3LllVeyefNmJk+eDATP2nn9\n9dfx+Xz069ePxMRErrnmGlavXs3VV1/NaaedxuDBg5k+fTpdu4Zf/D/OKiKRkZAQPKYtKQnWVG5u\nLpMmTeLAgQMMGDCAjz76iKysLDcjRkO1f9WqPeIPXXzlIPDLCId5j+AfkhnGmHYEl4LYV93GeXl1\nezuhrCyA3++reDman19IQUERubn57Ny5k5kz51acb79y5Qfk5xeyf/+3R7ypc845PyMjY/QRb+os\nXfo3yspKKSj4ntmznwHg6693c9ttQ2nevDldu55EcnLrOr0M/nHWWFdfXuaDsjqlPmUFKrIuX/5P\nfv/7oXTo0JGXX15Ir159Y+p5OPFzTU1NqvaxsC62HknW2r8ZY84zxqwh+BdpuLU2KqcJHMv59uWv\nCMvf1Pnuu+/405+e58UXX6FVqxSefHIWL730J6677sZoPBURqYOOHTsxceIYEhMT6dy5C/fe+4Db\nkVwV9eIHsNZmuDFudcJ5U+emm24MbRt8U6dRo0Y0adKExo0bA5CSksKBAweiF1pEwta9e0+efvoF\nt2PEDFeK3z1Hf759IBCg8rc0bNiQO++8m7vvvoNGjRrRrFkSDz44waHcIiKRU+2bu7EiNze/TgHT\n03vi9/sc++Tu+vWbIrpPJ7I6pT7N7yqrM+pL1hNOCF4WfPfuvFq2jA0OzfFXe3SrJR9FRDxGxS8i\n4jEqfhERj1Hxi4h4jIpfRMRjVPwiIh7jsfP4RcSLnFyld926NTz99FwSEhJo0aIlY8ZMpFGjRhEf\nJ5J0xC8inuDUKr0zZkxn6tTHyc6eT/v2HVi6dLEj40SSjvhFxFMifenFrKx5NG/eHIDS0hISE2P7\naB9U/CISh9q1OxG/v+oj/N27c8jOnl+xSm8kLr0I8O67/2LDhvXceutwp5/eMVPxi4inHMsqvdVd\nenHRopd4551/kZmZTcOGDaPyPI6Fil9E4t7Bg9+yYsUyNm78mPz8fA4fPvxfb8Ae7aUXFyx4hi1b\nLE888SSJiYnOPpEI0Zu7IhL3Vq9eRVpaZ7Kz59OgQQOWLl0ChL9K7/DhtzBv3my6dj3ycuN5eft5\n/vmn2bt3LyNH3sWIEcNYvPgvjj2PSNERv4jEvZ///BcV18q97LJBFZdmnDBhCgC9e/et2DYxMZFX\nXgn+YTDmFLKy5h2xr/btO9CnTzoALVq05O23VzmeP9JU/CIS91q3bsPcudm89dZyiotLuOmmoW5H\ncpWKX0TiTk7OriO+nj17JmPGTKRfv7NYteo9Jk8ex/TpT7iUzn2a4xeRuJecnEzTpk0BaNUqhfz8\n2L+YjJN0xC8ice/uu+9nxozplJaWAuhi624HEBFxWlpaZ2bOnON2jJihqR4REY9R8ceQZcuWMndu\ntqNjvPDCs4wfP9rRMUQktqn4Y4xTKwgCrFr1PqtWve/oGCKxyOmDqtLSUsaMeYA1az5wbIxI0hx/\njIr0CoI9epzGG28s5pZbhvHGG7G/bKxIpDl1wLNr104mTx7P3r25wFWOjBFpKv46yMnZRXp6z4ju\nr3379lU+FskVBL///nsefPCPjB37EFu3fkkgEIjYcxCpbyJ9UNW1azdGjRrLwoULXH5m4VPxh2n9\n+k0RLf3aRHIFwTVrPiAvbx/jx48iP/8g+/bt48UXF3D99UOi9nxEYoVTyzLXJyr+Oli/flNE93c0\nf0iOZgXBAQN+yoABPwVgw4b1LFnyV5W+xLWa1uN3Ylnm+kbFH7N++Ecb7gqCpaWl+P1+MjLGVixI\nJSLhOdplmesjFX8MGTjw8orbS5Ysr7h9rCsIVtanT3qV94t4hw6qfLH+Rl9ubn6dAqan98Tv97F2\n7UanIkVMfcoKkJqaRG5u/VjjRFmdUV+y6r8tSE1NqvavWv1+vSIiInWm4hcR8RgVv4iIx0T9zV1j\nTAKwAEgDSoBbrbWbo51DRLzjm2/+wyOPPFSxLPMf//ggHTp0dDmVe9w44r8UaGCtPQeYBDzsQgYR\n8ZCnn57Lr399LVlZ87jxxv9h7twstyO5yo3TOTcDCcYYH3A8UORCBhHxkLvuuoemTZsBwQ9iNWp0\nnMuJ3OVG8X8HdAY+B1oBl9e8uYjIsUlOPh6AHTu28eSTs3jkkcdcTuSuqJ/Hb4zJBAqttQ8aY04E\n3gZ6WmurPPIvKSkNJCQ0CHv/aWlpAGzbtu2YszqtPmUVqe8++OADJk2axKOPPkr37t3djhMN1Z7H\n78YR/36gOHT7QChDtc2el1dQp52XlQXw+3314kMm9Skr1J8P74CyOqW+Zv3ww3XMnJnJ9OlPkJra\nNuaeg0Mf4Kr2MTeK/wngWWPMSqAhMMpa+70LOUTEI2bNepzS0hKmTJlAIBCgU6c07rtvlNuxXBP1\n4rfWHgJ+G+1xRcS7nn/+JbcjxBR9gEtExGNU/CIiHqPiFxHxGBW/iIjHqPhFRDxGxS8i4jEqfhER\nj1Hxi4h4jIpfRMRjVPwiIh6j4hcR8RgVv4iIx6j4RUQ8xo1lmaUa3357gIkTx1BUVESrVimMHj2e\nRo0auR1LROKMjvhjyHPPPc3Pf/4LsrPn063bySxZ8he3I4lIHFLxx5BPPvmI/v3PBqB//3NYt26t\ny4lEJB6p+GNIQUEBTZs2A6BJkyYcOvSdy4lEJB6p+F20fv2mIy603rRpUwoKgtcYLigooFmzZi4l\nE5F4puKPIaeddjqrVr0HwAcfvM/pp/dxOZGIxCMVfwwZMuQm/vGPFQwffguffrqJX/3qGrcjiUgc\n0umcMaRFi5ZkZs5yO4aIxDkd8YuIeIyKX0TEY1T8IiIeo+IXEfEYFb+IiMeo+EVEPEbFLyLiMSp+\nERGPUfGLiHiMil9ExGNU/CIiHqPiFxHxGBW/iIjHOF78xpizjDFvh253Ncb82xjzrjFmttNjV7Zh\nw3quvvqyaA4pIhKTHC1+Y8z9wFNAo9BdjwOjrbUDAL8x5pdOjl9uz55vWLToJUpLS6MxnIhITHP6\niP8L4KpKX6dba/8dur0MuMjh8SkqKuKxx6YycuQop4cSEakXHC1+a+1rQEmlu3yVbucDxzs5PsCM\nGdMZPPgGUlJSgIDTw4mIxLxoX4GrrNLtJOBAbd/QokUTEhIahD3Ajh3bK27v2bOHTz/9hD17dvOn\nPz3DwYMHmTp1ApmZmXXJ7LjU1CS3I4RNWZ2hrM5Q1qpFu/g/NMacb61dCQwE/lXbN+TlFdR5kNTU\nJHJz8/H5GvPCC4sq7v/lLy8hI2MCubn5dd6nU8qz1gfK6gxldYbXs9b0hyTaxX8f8JQxpiHwGfBq\ndIf31b6JiEicc7z4rbXbgbNDt7cAFzg9ZnWWLFnu1tAiIjFDH+ASEfEYFb+IiMeo+EVEPEbFLyLi\nMSp+ERGPUfGLiHiMil9ExGNU/CIiHqPiFxHxGBW/iIjHqPhFRDxGxS8i4jEqfhERj/EFAroqlYiI\nl+iIX0TEY1T8IiIeo+IXEfEYFb+IiMeo+EVEPEbFLyLiMY5fbN1Jxhgf8CRwOlAI3GKt/arS41cA\nY4Fi4Dlr7dOuBKX2rKFtmgArgJustZujn7IiR20/18HAHwj+XDdaa4fHaM5fAQ8AZcBL1tpZbuQM\nZan19x/abh6wz1o7OsoRK2eo7ed6N3ALsCd011Br7ZaoByWsrP2AzNCX/wFusNYWRT0oNWc1xrQB\nXgYCgA/oDTxgrZ3vRJb6fsR/JdDIWns2MAp4vPwBY0xC6OuLgAuA24wxqW6EDKk2K4AxJh14F+ji\nQrYfq+nnehzwEDDAWnse0NwYc7k7MWvM6QceBi4EzgaGG2NaupIyqMbfP4AxZijQM9rBqlBb1nTg\nRmvthaH/uVL6IbVlnQ/83lp7PrAc6BTlfJVVm9Va+4219qfW2gtDj60HnnIqSH0v/nMJ/jKx1q4G\nzqj02KnAFmvtQWttMfAecH70I1aoKStAIsF/GJ9HOVdVasp6GDjbWns49HUCwaMXN1Sb01pbBpxq\nrf0OSCH4b92VI72QGn//xpifAP2AedGP9l9q+7eaDowyxvzbGJMR7XA/Um1WY8zJwD7gXmPMO0BL\nl/9I1fZzLZcFDLPWOvbp2vpe/MnAt5W+Lgkd6VX1WD5wfLSCVaGmrFhrV1lrdxF8mee2arNaawPW\n2lwAY8xdQFNr7T9cyAi1/0zLjDFXAR8B7wCHohvvCNVmNca0BcYDdxLjv/+Q/wWGAT8FzjXGXBrN\ncD9SU9YU4CfALIKv/C8yxlwQ3XhHqO3nWj49vcla+4WTQep78R8Ekip97Q8d6ZU/llzpsSTgQLSC\nVaGmrLGmxqzGGJ8x5lHgZ8DV0Q5XSa0/U2vta9badkAj4HfRDPcjNWX9DdAK+DuQAVxnjInVrAAz\nrbX7rbUlwN+APlFNd6Sasu4DvrDWbg5lXU71R9nREE4H3EBwespR9b343wcuBTDG9Ac2VnrsM+Ak\nY0xzY0wiwWmeVdGPWKGmrLGmtqzzCc5VXllpyscN1eY0xiQZY94J/e4heLTv5h/aarNaa7Ostf1C\n87tTCb4R/YI7MYGaf67JwCZjTJPQm5UXEpyPdktN/1a/ApoZY8rfNzsP+DS68Y4QTgecYa11vKfq\n9SJtld4l7xW6638Izj82tdY+bYy5jOBLaB/wjLV2rjtJa89aabt/EZzfi4Wzev4rK8H/yNcC/w49\nFiB4BLgklnKGfv+3EDz7pAj4BLjLyXnTY8laabshgImRs3qq+7leT/CsrkLgn9baie4kDSvrBcC0\n0GP/Z629J/opg8LImgKssNb2dTpLvS5+ERGpu/o+1SMiInWk4hcR8RgVv4iIx6j4RUQ8RsUvIuIx\nKn4REY9R8Uu9ZIwZYIx5O4rjjTfGjKtlmyHGmOciPG4/Y8xUp/Yv3qTil/osFj+EEulM3YHWDu5f\nPKher8cvnpdqjFkGnAh8ANxhrS02xuQC64A2wJkEPy3ZI/S1Jbi+UFvgNWATwbVm/gP8xlp7wBhz\nHfAgwSUe1gK3hcY7yxjzPtAOeL6mT6yG1oF/HGgM7CW4Zv320KuUNQSXD0gh+GniN40xJwIvAs1D\nmQaEMj8ENDXGjAJygG6hfXQk+KnZ2xCpIx3xS32WRrDsexFckG9Y6P5WwMOhj77/BDhsrT0H6AY0\nIbReCsELYjxmrT2N4KqJ1xtj2hG6jkPo/gaVtm9NsJDPAO43xjStKpQxpiHBtdQHW2vPCO2v8kWA\nGobWZL8XmBy6bybwv9ba3sCrQDtr7UFgHPC6tfaR0HYdCC7ffSow0Bhzal1+YCKg4pf6bWWlqy29\nSPCCO+XWAFhr/w3MMcYMJ1iuJwHNQtt8Y639JHR7E9CS4B+K96y1u0PfP8Ra+3pom2XW2hJr7T4g\nN7R9VU4GugKvG2M2EFwrJq3S48t/NCbAz4GFoTEXU/1Ksiuttd+GriL1JcFXDSJ1oqkeqc9KKt32\nEbwUJADlq4YaYwYBE4EZwLMEi7J8zfvKF5AJVNpHxZr4oYWzqhoPql87vwHwZfliW6HFudpUerx8\n3PIxAUoJ70CscobK3y8SNh3xS312njGmfehiFkOAt6rY5mfAn0PLHO8huDx3g9BjVZXmWuBMY0z5\nG6ozgEF1zPU50NIYc27o61uAl2r5nhXA9QDGmIEE5/ohWPQ6QJOIUvFLfbaJ4FH8x8DO0G048syX\npwhe2GSw7jisAAAAn0lEQVQ9wbnzVUDnKrYDIDTF8wdghTHmE4Lr+Fd1CmW1Z9eEpmGuATKNMR8B\nNwI31fJ99wC/CuW8hh+metYA/Y0xD1fxvTrDR46KlmUWiQGhy1i+Za393BjTB5hvre3ndi6JT3oJ\nKRIbtgAvG2PKgO+BW13OI3FMR/wiIh6jOX4REY9R8YuIeIyKX0TEY1T8IiIeo+IXEfEYFb+IiMf8\nf1smUPf6ntq1AAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x10a383f90>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX4AAAEMCAYAAADDMN02AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3Xl4VOXd//H3DCFAYCBABioGCJu3LK4x1SqItbbPL1Zx\n70+k1d9TFxaRqmgJi6yCLEYQokS0Cl5gFakrLTy2jysWBREVLN5uBYSgDhhKJIasvz9mgERISMic\nOZmcz+u6uK7MnMm5v3Mz+cw9Z2a+x1dRUYGIiHiH3+0CREQkthT8IiIeo+AXEfEYBb+IiMco+EVE\nPEbBLyLiMQluF3AsoVBBnT9v2rZtEvn5hU6UE7c0J0fSnFSl+ThSPM9JMBjwVbetUa74ExKauF1C\ng6M5OZLmpCrNx5Ea65w0yuAXEZHqKfhFRDxGwS8i4jEKfhERj1Hwi4h4jIJfRMRjFPwiIh6j4BcR\n8RgFv4iIxyj4RUQ8RsEvIuIxCn4R8Yzly5/ikUcecrsM1yn4RaTRO3DgAFOn3sPzz69wu5QGocG3\nZRaR2EhLS6O8vM5d0BusDRs2H/q5uLiYzMxLyMg4m+3bt7lYVcOgFb+IkJ7ejx07drhdhmMCgQAZ\nGWe7XUaDoRW/iACQmprK+vWb3C5DYkArfhERj1Hwi4h4jA71iIhnZGZe4nYJDYJW/CIiHqPgFxHx\nGAW/iIjHKPhFRDxGwS8i4jEKfhERj1Hwi4h4jIJfRMRjFPwiIh6j4BcR8Ri1bBCRI6xatZJt27Yy\nbNjIqO/7ww838tBDD+L3+zn99DMdGUNqphW/iByVz+dzZL8LFsxl6tSZ5OY+zr/+tZnPPvvUkXGk\nelrxi0iNrr32Ck499XS2b99Gu3btmT59NqtX/5W1a9+mqKiIvLydDBlyPZmZl/Dll58zb979ALRu\n3YZx4yZi7ScsXLiAxMREBg26gkWLFuP3+yksLOT7778nKSnJ5XvoPTEPfmNMAvA4kAYkAtOttS/H\nuo5jSU/v53YJUeX3+xrVafWiQXNyWF7eTlJTU4+6bdeuPHJyFpGSEmT48BvZsuVjAPbv30929nx2\n7PiKrKw7ycy8hFmzpjNu3CS6dk1j5coXyc3N4aOPPmDnzh2cf/7PGTjwQvx+Px9/vJnJk8fRrVt3\ngsEOsbyrgjuHen4L7LbWng9kAjku1FCj9PR+5OXtdLsMkQYhOTmZlJQgAB06dKS4uBiAXr1OOnTd\ngQPh67Zt+zfZ2TMZNWoYf/vby/zzn2vo338g557bnzPOSOfpp5cC0LdvP5599iV69TIsXbo49nfK\n49w41LMceDbysx8ocaGGY+rU6cQqJ2uOd8FggFCowO0yGhTNyWHH8wr3aO8BdOmSxoQJU+jQoSOb\nNn3IpEnj6NOnHzt2fMUpp5zGggUPcOutNzNz5gMEAgGSkpIoKWmQEdCoxTz4rbWFAMaYAOEngPE1\n3b5t2yQSEprUeZxgMHBc9UH4EEB999EQNbb7Ew2ak7AfP+YDgeYkJSUSDAbw+/2Hrm/RIpHk5CS+\n//7w9uLiYpo08REMBvjgg/e5/PJMMjIy8Pv99OvXly++2ELz5k3ZuPEdyspKGDbsFsaOvYPExEQ6\ndOjAvffeS4sWLVy778fSGB8jvoqK2B/jNMZ0Bp4Dcqy1S2q6bShUUOcC67uSO7j60Yq/cdOcHJae\n3g+/31fvk63/+G9nz57dzJ07m3379nHOOefx8ccfMX36nHrXGyvx/BgJBgPVfizLjTd3OwL/A9xq\nrX0t1uOLSOysX/8uQ4eOpHPnLjz99FIyMs52uyTBnWP8Y4Fk4B5jzESgAsi01h5woRYRcVCXLl2Z\nMmUCiYmJdOvWnTvvHON2SYI7x/hvB26P9bgiEnt9+vTjsceedLsM+RF9c1dExGMU/CIiHqPgFxHx\nGAW/iIjHKPhFRDxGwS8i4jEKfhERj1E/fhFxjJNn8nrvvXU89lguCQkJtG3bjgkTptCsWbOoj9MY\nacUvIo5y6kxec+fOZubMB8jJWURqamdWrnzBkXEaI634RSQmon0mrwULHiE5ORmAsrJSEhO12q8t\nBb+IALBjx456n3kuL28nnTqdeNRt9TmT19KlS8jIOJuSkmIWLVpcZb9vvPEqGzdu4OabR9Srdi9R\n8IsIGzZsJiPjFEdPRXk8Z/ICKC0tJTW1MxBu+lbZ8uVP8frrr5KdnUPTpk0dq72xUfCLCABbt26t\nd+95p87k9d13eyK3Pfy25JIlf+Kzzyzz5j1MYmLi8RftQQp+EXHMvn3/4ZVXVrFp04cUFBRw4MAB\nmjVrdsw3fEePzmLatImUlZXh9/vJyrqHUOjbQ9vz879j8eLHMKY3o0ffhs/n48ILf8nll1/l9F1q\nFFw5A1dd6Axc0RHPZxJyiuakqmjMx4//dhYseIDOnbtw+eVXs2jRw7Rvn8JVV/2m3rXGSjw/Rmo6\nA5c+zikijunZ8yT27dsHQGHhfhISdJChIdD/gog4pkOHjuTm5vD3v6+mpKSU3/9+qNslCQp+EYmi\nvLydVS4/9NCDTJgwhYyMs1m7dg333juR2bPnuVSdHKRDPSLimNatW9OyZUsA2rdPoaAgPo+XNzZa\n8YuIY26//W7mzp1NWVkZgE623kAo+EXEMWlp3XjwwYVulyE/okM9IiIeo+AXEfEYBb+IOGbVqpXk\n5uY4tv+ysjImTBjDunXvODZGY6TgFxFHOdWPf+fOHYwceQvWbnFk/42Z3twVkZiIdj/+Hj16MXbs\nPSxdusTlexZ/FPwiEhNO9eOXulPwi0jUVHcSFnCmH78cHwW/iLjqePvxy/FT8ItIjBwO+Pr245f6\nUT/+o1A/fm/QnFTlRD/+eBfPjxH14xcRkUMU/CIiHqPgFxHxGNfe3DXGdADeAy6y1n7qVh0i4pxv\nvvma++6beqgt8x//OJ7Onbu4XJW4EvzGmAQgFyh0Y/y6WrVqJdu2bWXYsJFR3/fOnTuYM2cGpaWl\nJCYmMnnyDFq3bh31cUTc8NhjuVx99bX0738+69a9Q27uAqZPn+N2WZ7n1or/fmAhMNal8evMqX4j\ns2dPZ+jQW+nTpx9vvPEaX321nb59+zkylkis3XbbHbRs2QoIfxGrWbPmLlck4ELwG2P+H/Cttfbv\nxphxsR6/vqLZb+TSSy8nP/871qx5k4ULF9C7dx+GDx/l8j0UiZ7WrdsAsH37Vh5+eD733Xe/yxUJ\nuLPi/2+g3BjzS+B04EljzCBr7VG/ndG2bRIJCU3qNEBaWlq9CszL20lqairBYACAQKA5SUmJBIMB\ndu3K46mnltGxY0cGDx7M119vJRBoTklJEU888Rjbtm1j+PDhXH/9YEaOnMmMGTPo0aMHK1as4Lnn\n/sx5551HRUUZzzzzZ7755hvuvXcSU6dOYfz4MYwfP541a/7BlVdeWa/6q3Pw/shhmpOq6jsf27dv\nO+K6d955h2nTpjF3bjZ9+vSp1/7d0BgfIzEPfmvtwIM/G2NeA4ZWF/oA+fl1exsgPb0feXk7a+wZ\nUhvl5RWHvrhRUFBEYWExoVABycnJ+P1JhEIFtG2bwjff5FNQUETXrj0IhQpISGhFYWERoVABn3/+\nORMmTAQO9xvp27eQTp1SCYUKKClpQsuWLUlLO5lQqIAzzzyH9evfZcCAX9ar9qOJ5y+iOEVzUpUT\n8/H+++/x4IPZzJ49j2DwJ3E33/H8GKnpCcvtlg2OfG04NTWV9es3HffvH/z2YV0cT7+RZs2a0blz\nFz766ANOPfV0Pvzwfbp163HcdYs0NPPnP0BZWSnTp0+moqKCrl3TuOuuuHlrr9FyNfittRe6Of7x\niW6/kTFj7uGBB2ZRXl7OCSd00jF+aVQWL37K7RLkKBpdr5709H74/b6orPgbS78RiO+XrE7RnFSl\n+ThSPM+JevWIiMghCn4REY9R8IuIeIyCX0TEYxT8IiIeo+AXEfEYBb+IiMco+EVEPEbBLyLiMQp+\nERGPUfCLiHiMgl9ExGPcbsssLtizZzdTp06krKyUQKA1EydOo0WLFm6XJSIxohW/By1btoRf//pS\ncnIW0avXSbz88gtulyQiMaQVvweNGjUagPLycr799htOOKGTyxWJSCxpxe9RpaWlXH/9tWzcuIEz\nzzzL7XJEJIYU/B6Qnt7viBPQJyQksHTpcu6+exzTpk10pzARcYWC34Oys2fx/vvvAdCiRRJNmjRx\nuSIRiaVaHeM3xrQDWhI+4WwToJu19lUnCxPnXHPN/2XOnPtYsuRP+Hw+Ro8e43ZJIhJDxwx+Y8x9\nwAigKbAH6AS8B5ztbGnilC5d0liw4BG3yxARl9TmUM+1QGfgGeAC4CIg5GBNIiLioNoE/y5r7T5g\nM3CatfY1oKOzZYmIiFNqE/z/Mcb8DtgADDHGnAO0dbYscdKqVSvJzc1xdIwnn3ycSZPGOTqGiByf\n2gT/jUAHa+3rwFbgEWC8gzVJDPh8Psf2vXbt26xd+7ajY4jI8avNp3pSrLXZANba0QDGmKsdrUpi\n5tprr+DUU09n+/ZttGvXnunTZ7N69V9Zu/ZtioqKyMvbyZAh15OZeQlffvk58+bdD0Dr1m0YN24i\n1n7CwoULSExMZNCgK+jb9xRefvkFbrppmFpBiDRQtVnxv2SMuRvCH+s0xjwD6DV8I7FrVx633DKC\n3NzHyc//ji1bPgZg//79zJ49l5kzs1m2bAkAs2ZNZ/ToLObPz+Wcc85l6dLw9SUlxeTkLGLAgAvI\nzp7F3XePw+fzUVFR4dr9EpHq1WbFfyYw3xjzT6AD8DBwnaNVSVTl5e2sdltycjIpKUEAOnToSHFx\nMQC9ep106LoDB8LXbdv2b7KzZwLhlg+pqZ0B6NKlKwDr1r1Dfv4eJk0aS0HBPvbs2cOyZUsYMuQG\nZ+6YiByX2gS/DygBkiI/l0f+SSN2tOPzXbqkMWHCFDp06MimTR/y3Xd7IrcNv3AcOPDnDBz4cwA2\nbtzAiy8+p9AXaYBqE/wfAwuBmwl/micHGAJkOFiXxMzhgD/Wm7GjR2cxbdpEysrK8Pv9ZGXdQyj0\nrdMFikiU+Y51HNYYc4a1duOPrrvGWvuso5VFhEIFdTpQnJ7eD7/fx/r1m457zPT0fgBs2LD5uPfR\nkJxwQvjTt7t25btcScMSDAYIhQrcLqPB0HwcKZ7nJBgMVLuSq82Kf6cx5g6gFZV69QAxCX4REYmu\n2nyq5zngdOC3hBu1DULH+EVE4lZtgj/FWnsD8DLhJ4ELgL5OFiUiIs6pzaGegweGLeFePe8aYxLr\nM6gxJovwK4emwMPW2ifqs7+arFq1km3btjJs2Mio7/u224Ye+rz69u1bufjiQQwdemvUx4m2oqIi\n7r//Pr7+ehclJSXcccfdnHxyH7fLEpEYqU3w/68x5lngLuAVY8yZQOHxDmiMGQj8zFp7rjGmJTD6\nePdVW061DjjY2jgvbyeTJo3lhhtudGScaHvqqSfp3r0nEyZM4YsvPueLLz5T8It4SG2Cvzdwt7V2\nmzFmMDAQ6FWPMf8L2GyMeQEIAHfXY191Utv2BBB+shg1ahhQfXuCX/0qE4D587MZPnwUzZs3j9Vd\nqZd1697hF7/4FXfeeRutWrXizjt1IhYRL6k2+I0xzwOnET7xyhnGmIObmgLb6jFmCtAFuAToDrwE\nnFyP/dXarl155OQsIiUlyPDhN1ZpT5CdPZ8dO74iK+tOABITmzJ6dBZdu6axcuWLLF26hIyMsykp\nKWbRosWH9vnFF59TWFgYVycs37t3LwUF+3jggQWsXv1XcnLmMmHCFLfLEpEYqWnFfwPQDngQGFXp\n+lLgm3qMuQfYYq0tBT41xhQZY1KstbuPduO2bZNISKj9OWEPticIBgMABALNSUpKJBgM0K5dO3r3\n7g5Aly6pJCUlEAg057TT+hEMBmjTpielpSX4/T58Ph/z588Bwu0JunbtSnJyEr169Ty0b4DFi//B\nkCGDq1zX0KSmpgKH5yQlpR2XXppJMBjgsssu5plnljbo+p3k1ftdHc3HkRrjnFQb/JGTr+wDLovy\nmGsIP5HMNcZ0ItwKYk91N87PP763Ew5+6aKgoIjCwmJCoQLKy8sPXV9UVMLevYUUFBTxww8lhEIF\nFBcXU1ZWQXl5BRUVFYwZM7FKe4K9ewspLi6r8oWOt956myuvvK5Bf8mjvLwCv993qMbmzZOYPHkq\nDz30KG+99QadO6dFrf4333ydhx6aR8eOPwHgxhuHctppZ0Rl39EWz1/OcYLm40jxPCc1PWHV6mTr\n0WSt/asxZoAxZh3hL4SNsNbGqI1j7dsTFBeX1Ko9QX7+d7Ru3TrqlTrp3HMHsGLF0wwb9nsSEhKY\nMGFq1PZt7RZGjPjDoZ49ItLwHLNlg9vq2rIhGu0JGlvLhh+3sVi1aiXbt29j6NBbo96P/5VXVuH3\nN2H//u/p3bsvI0aMwu+vzddFYi+eV3NO0HwcKZ7npL4tGzwpL2/noSeAeJeXt/PQcf4fq+0b3pmZ\nlzBr1nTGjZtU4xvee/fmM2DABZxwQifmzJnBCy/8hSuvvCZWd1VEakHBfxQbNmxuNKF/LNHsxw9w\n8cWDaNWqFQD9+w/kzTdfi80dEZFaU/BXo7Ec5gGO60nsePrxA9xww7U88sgTpKQE2bBhPcbE5JO6\nIlIHCn7Pi24//qysexg79i6aN29OWlp3Lr30CkeqFpHjpzd3PSAa5yhojOL5jTsnaD6OFM9zUtOb\nuw3z4xYiIuIYBb+IiMco+EVEPEbBLyLiMQp+ERGPUfCLiHiMgl9ExGMU/CIiHqNv7nrQ/PnZfPbZ\np/h8Pvbs2U0g0Jrc3MfdLktEYkTB70GjRoXPb19aWsqtt97MmDETXK5IRGJJh3o8bMWKp/npT8+h\nW7fubpciIjGk4Peo0tJSXnrpeQYP/q3bpYhIjCn4PWDDhs1s3bq1ynXr17/L6aefSVJSS3eKEhHX\nKPg96r331nHOOee5XYaIuEDB71FffbWdTp1OdLsMEXGBPtXjUbNnz3W7BBFxiVb8IiIeo+AXEfEY\nBb+IiMco+EVEPEbBLyLiMQp+ERGPUfCLiHiMgl9ExGMU/CIiHqPgFxHxGAW/iIjHKPhFRDxGwS8i\n4jEx785pjEkAlgBpQClws7X2U6fG+8tflvP000vp2PEntG+fwrhxk2jWrFlU9r1+/bs88shDJCQk\ncNZZP+Wmm4ZFZb8iIk5yY8V/MdDEWnseMA2Y4eRga9a8QbduPcjJWUSvXifx4ot/idq+Fy6cz8SJ\nU8nNfZz333+PL7/8Imr7FhFxihv9+D8FEowxPqANUOzkYF99tZ3+/QcC8NxzzwLw6qv/oF279kyf\nPpvVq//K2rVvU1RURF7eToYMuZ7MzEv48svPmTfvfgBat27DuHETsfYTFi5cQGJiIoMGXcFJJ53M\n3r17OeGEEoqLi2nSpImTd0VEJCrcCP7vgW7AJ0B74BInBysuPkBiYiIAu3eHOPnkPuTmPs7w4Tey\nZcvHAOzfv5/s7Pns2PEVWVl3kpl5CbNmTWfcuEl07ZrGypUvsnTpEjIyzqakpJhFixYDsHdvPn/8\n4x0kJyfTo0dPunZNc/KuiIhEhRvBfwew2lo73hhzIvCaMaaftfaoK/+2bZNISKj9Sjo1NRWAYDAA\nQIsWLUhICF9u06YNHTsGCQYDdOmSSlJSAoFAc047rV9ke09KS0sIBgNs376V+fPnAFBaWkrXrl1J\nTk6iV6+eBIMBCgoKWLZsCatXryIYDDJnzhxeemk5N954Y/1mx0EH50QO05xUpfk4UmOcEzeC/zug\nJPLz3kgN1SZ7fn5hnXZeXl6B3+8jFCoAoFOnVD7//N+EQgUcOHCA3r1PIRQqoKiohL17CykoKOKH\nH0oIhQooLi6mrKyCUKiAzp27MmbMRDp06MimTR/y3Xd72Lu3kOLiMkKhAkpKSmjevAWFheHLSUmt\n+frr3YfGbWiCwUCDrc0tmpOqNB9Hiuc5qekJy43gnwc8box5E2gKjLXW/uDUYOedN4Dly//MiBE3\nUVJSylVX/QYAn89X4++NHp3FtGkTKSsrw+/3k5V1D6HQt4e2N23alJEjb+f222+lWbNmtGoVYPz4\nyU7dDRGRqPFVVFS4XUONQqGCOhWYnt4Pv9/H+vWbnCopLsXzysUpmpOqNB9Hiuc5CQYD1a5u9QUu\nERGPUfCLiHiMgl9ExGMU/CIiHqPgFxHxGAW/iIjHKPhFRDxGwS8i4jEKfhERj1Hwi4h4jIJfRMRj\nFPwiIh6j4BcR8RjPBP/GjRu48spfu12GiIjrPBH83377DcuXP0VZWZnbpYiIuK7RB39xcTH33z+T\n0aPHul2KiEiD0OiDf+7c2Qwe/FtSUlKAhn3SGRGRWGjUwb97924++ugDnnjiUW67bSj79u1j8uTx\nbpclIuIqN865GzMpKSksW7bi0OXLLvsvJk+e7mJFIiLua9Qr/iPVfIJ1EREv8FTwv/jiardLEBFx\nnaeCX0REFPwiIp6j4BcR8RgFv4iIxyj4RUQ8RsEvIuIxCn4REY9R8IuIeIyCX0TEYxT8IiIeo+AX\nEfEYBb+IiMco+EVEPMbxfvzGmLOBmdbanxtjegCLgXJgs7X2VqfH37dvH9dddyXdu/cE4PzzL+Dq\nq691elgRkQbL0eA3xtwN/A74PnLVA8A4a+1bxpiFxpjLrLUvOlnDp59+wkUX/R9uv/0uJ4cREYkb\nTh/q+Ry4otLldGvtW5GfVwEXOTw+1m7B2n8xcuQtTJw4lj17djs9pIhIg+Zo8FtrnwdKK11V+RRY\nBUAbJ8cH6Nq1GzfdNJycnEX07z+QuXPnOD2kiEiDFutz7pZX+jkA7D3WL7Rtm0RCQpNaD7B9+7Yq\nl3/1qwto0aIFfr+fq666lCVLHiUYDNR6f42JV+93TTQnVWk+jtQY5yTWwf++MeZ8a+2bQCbw6rF+\nIT+/sM6DBIMBQqECACZNGsvAgb/gwgsvYs2aN+nZ86RD27yk8pxImOakKs3HkeJ5Tmp6wop18N8F\nPGqMaQpsAVY4PeDw4aOYMWMKL7ywgubNW5CVNcHpIUVEGjRfRUWF2zXUKBQqqHOB8fws7RTNyZE0\nJ1VpPo4Uz3MSDAZ81W3TF7hERDxGwS8i4jEKfhERj1Hwi4h4jIJfRMRjFPwiIh6j4BcR8RgFv4iI\nxyj4RUQ8RsEvIuIxCn4REY9R8IuIeIyCX0TEYxp8d04REYkurfhFRDxGwS8i4jEKfhERj1Hwi4h4\njIJfRMRjFPwiIh6T4HYB9WGM8QEPA6cBRcBN1tovK22/FLgHKAGesNY+5kqhMXKs+YjcJgl4Bfi9\ntfbT2FcZW7V4jAwG/kD4MbLJWjvClUJjqBZzchUwBigHnrLWznel0Bipzd9N5HaPAHusteNiXGLU\nxfuK/3KgmbX2XGAs8MDBDcaYhMjli4ALgFuMMUE3ioyhaucDwBiTDrwBdHehNrfU9BhpDkwFBlpr\nBwDJxphL3CkzpmqaEz8wA7gQOBcYYYxp50qVsVPj3w2AMWYo0C/WhTkl3oO/P7AawFr7LnBWpW29\ngc+stfustSXAGuD82JcYUzXNB0Ai4Qf5JzGuy001zckB4Fxr7YHI5QTCK77Grto5sdaWA72ttd8D\nKYQzotiNImOoxr8bY8zPgAzgkdiX5ox4D/7WwH8qXS6NrFiOtq0AaBOrwlxS03xgrV1rrd0J+GJe\nmXuqnRNrbYW1NgRgjLkNaGmt/YcLNcbasR4n5caYK4APgNeB/bEtL+aqnQ9jzE+AScBIGtHfTbwH\n/z4gUOmyP7JiObitdaVtAWBvrApzSU3z4VU1zokxxmeMmQP8Argy1sW55JiPE2vt89baTkAz4PpY\nFueCmubjGqA98DcgC7jOGBP38xHvwf82cDGAMeYcYFOlbVuAnsaYZGNMIuHDPGtjX2JM1TQfXnWs\nOVlE+Pju5ZUO+TR21c6JMSZgjHk98jcD4dV+Y188VDsf1toF1toMa+2FwEzCb3Y/6U6Z0RPXTdoq\nvRt/auSq/wbSCb9kf8wY82vCL9N8wJ+stbnuVBobx5qPSrd7FRjmsU/1HDEnwAZgPfBWZFsF8KC1\n9sVY1xlLtfi7uQm4ifCx/Y+A26y18RsUx1CHv5sbANMYPtUT18EvIiJ1F++HekREpI4U/CIiHqPg\nFxHxGAW/iIjHKPhFRDxGwS8i4jEKfolLxpiBxpjXYjjeJGPMxGPc5gZjzBNRHjfDGDPTqf2LNyn4\nJZ41xC+hRLumPkAHB/cvHhTX/fjF84LGmFXAicA7wK3W2hJjTAh4D+gI/JTwtzL7Ri5bwj15fgI8\nD2wGzgC+Bq6x1u41xlwHjCfcqmA9cEtkvLONMW8DnYDF1top1RVmjMkg3N63BbAbGGqt3RZ5lbIO\nGEC4++Vt1tr/McacCCwDkiM1DYzUPBVoaYwZC+QBvSL76AL8r7X2FkTqSCt+iWdphMP+VMIN+YZF\nrm8PzLDWngn8DDhgrT0P6AUkEenLQvjEG/dba08h3J1xiDGmE5HzOESub1Lp9h0IB/JZwN3GmJZH\nK8oY0xR4FBhsrT0rsr/KJwFqGun9fidwb+S6B4E/W2tPB1YAnay1+4CJwEvW2vsit+tMuLV2byDT\nGNO7LhMmAgp+iW9vVjpT0jLCJ9w5aB2AtfYtYKExZgThcO0JtIrc5htr7UeRnzcD7Qg/Uayx1u6K\n/P4N1tqXIrdZZa0ttdbuAUKR2x/NSUAP4CVjzEZgFuEnqYNW/2hMgF8CSyNjvkD1nWTftNb+x1pb\nDHxB+FWDSJ3oUI/Es9JKP/sInz4RgIOdNo0xg4ApwFzgccJBebCveuWTrlRU2sehvuvGmMrBWnk8\nqL4/exPgi8grjoNNwDpW2n5w3INjApRRu4VY5Roq/75IrWnFL/FsgDEmNXLSjBuAvx/lNr8Anom0\n0v2WcHvuJpFtRwvN9cBPjTEH31CdCwyqY12fAO2MMf0jl28CnjrG77wCDAEwxmQSPtYP4aDXAk2i\nSsEv8Wwz4VX8h8COyM9Q9ZMvjxI+ecYGwsfO1wLdjnI7ACKHeP4AvGKM+YhwP/qjfYSy2k/XRA7D\n/AbINsaQNGMiAAAAe0lEQVR8APwO+P0xfu8O4KpInb/h8KGedcA5xpgZR/ldfcJHjovaMos0AJFT\nP/7dWvuJMeYMYJG1NsPtuqRx0ktIkYbhM+BpY0w58ANws8v1SCOmFb+IiMfoGL+IiMco+EVEPEbB\nLyLiMQp+ERGPUfCLiHiMgl9ExGP+P6jheK+/awZgAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x112ac21d0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX4AAAEMCAYAAADDMN02AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3Xl8VOWh//HPDCFAIBggA4qBBAEfQarWmGJVxFrb+8Mq\n7q2KlfurC4u4gZawyCqIIIKAEpEqWLBWbd1QuNrr7kVBtApefRAUAkRxgFAiKWS9f8wkBs0ygZw5\nM3O+79fL12u2nOc74/DNkzNznuOrrKxERES8w+92ABERiS4Vv4iIx6j4RUQ8RsUvIuIxKn4REY9R\n8YuIeEyS2wEaEgwWNfr7pu3apVBYWOxEHMcoc3TEW+Z4ywvKHC0NZQ4EUn113ZeQM/6kpGZuR2g0\nZY6OeMscb3lBmaPlSDInZPGLiEjdVPwiIh6j4hcR8RgVv4iIx6j4RUQ8RsUvIuIxKn4REY9R8YuI\neIyKX0TEY1T8IiIeo+IXEfEYFb+IeMZTTz3Bww8/6HYM16n4RSThHTx4kClT7uLZZ59xO0pMiPll\nmUW8LCsri4qKRq9M7iq/3xcTmdet21B9uaSkhAEDLiAnpy/5+VtdTBUbNOMXiVHZ2X3Yvn272zES\nQmpqKjk5fd2OETM04xeJYRkZGaxdu97tGI0SCKQSDBa5HUPqoRm/iIjHqPhFRDxGu3pExDMGDLjA\n7QgxQTN+ERGPUfGLiHiMil9ExGNU/CIiHqPiFxHxGBW/iIjHqPhFRDxGxS8i4jEqfhERj1Hxi4h4\njJZsEIkTK1euYOvWLQwdOqLJt/3xxx/x4IMP4Pf7OeWUUx0ZQ2KHZvwiccTn8zmy3fnz5zBlygzy\n8h7lf/93A198sdGRcSQ2aMYvEoeuvPISTjrpFPLzt9K+fQemTZvJqlUvsXr1uxw4cICCgh0MGnQt\nAwZcwJdfbmLu3PsAaNv2KMaOnYC1n7Nw4XySk5MZOPASFi1agt/vp7i4mO+++46UlBSXn6E4KerF\nb4xJAh4FsoBkYJq19sVo56gpO7uPm8MDsXO6usZQZmcVFOwgIyOj1vu+/rqABQsWkZ4eYNiw6/js\ns08B2L9/P7Nnz2P79m2MGnUzL730Ahs3Wk49NZvJk+/h1VdXsWzZUnJy+lJaWsKiRUuqt/nppxuY\nNGks3bodRyDQMRpPUVzixq6ea4Bd1tqzgQHAAhcyVMvO7kNBwQ43I4g0WlpaGunpAQA6duxESUkJ\nAD17Hl992+7du7jkksvx+33k5+dzzTVX8PLLL7JrVxCArl0zD9nmiSf24emnX6BnT8OyZUui92Qk\n6tzY1fMU8HT4sh8odSHDITp3PvaQEzO7IR5PV6fMzjqcv0RrfgZQVlZG375n0LVrFkOHjuCJJx5n\n8ODr2LNnd/ix38/7brrpBmbMuJ/U1FRSUlIoLXX9n6U4KOrFb60tBjDGpBL6BTCuvse3a5dCUlKz\nRo8TCKRG9Di/39eoxzspFjI0ljI754fvzdTUlqSkJBMIpOL3+6tvb9UqmbS0FIYMGYfP52P8+FxK\nSkpITk7m44/f5+67p3DrrbdSWFjIo4/mMW3aNHbu3EnLls2rtzF06I2MGXM7ycnJdOzYkbvvvptW\nrVoddvZ4eY1r8lJmX2Vl9Pd3GmO6AH8HFlhrl9b32GCwqNEBGzOrq5pVacbfeMrsrOzsPvj9vohP\ntv7D9/Lu3buYM2cm+/bt4/TTz+TTTz9h2rRZjuWtEk+vcZVEzBwIpNb5FTA3PtztBPwXcJO19vVo\njy/iFWvXvs+QISPo0qUrTz65jJycvm5Hkhjhxj7+MUAacJcxZgJQCQyw1h50IYtIwuraNZPJk8eT\nnJxMt27HMXLkaLcjSYxwYx//bcBt0R5XxGt69+7D4sWPux1DYpCO3BUR8RgVv4iIx6j4RUQ8RsUv\nIuIxKn4REY9R8YuIeIyKX0TEY7Qev0iCcvKMXR98sIbFi/NISkqiXbv2jB8/mRYtWjT5OOIMzfhF\nEphTZ+yaM2cmM2bcz4IFi8jI6MKKFc85Mo44QzN+EQ9o6jN2zZ//MGlpaQCUl5eRnKzZfjxR8YvE\nsO3bt0e8Ln9BwQ46dz621vsiOWNXbu5IBgy4gHvvncbYsRPJzMxixYrn6zxjF8Cbb77GRx+t44Yb\nhh/R85ToUvGLxKh16zaQk/OTJjlVZCRn7Dp4MHTb1q1fMXv2DCB0MpeMjC7Aj8/Y9dRTT/DGG68x\ne/YCmjdvfsQZJXpU/CIxbMuWLY0+t0Rj1PYZQNeuWYwfP5mOHTuxfv3HtZ6xa+nSP/HFF5a5cx8i\nOTm50eOKu1T8Iglq375/8corK1m//mOKioo4ePAgLVq0aPAD31Gjcpk6dQLl5eX4/X5yc+8iGPy2\n+v7Cwj0sWbIYY3oxatTN+Hw+zj33V1x88WVOPyVpIq6cgasxdAau2KXMzjuS9/L8+ffTpUtXLr74\nchYteogOHdK57LLfOpa1Sry9xpCYmes7A5e+zimSoHr0OJ59+/YBUFy8n6Qk/YEvIXoniCSojh07\nkZe3gFdfXUVpaRl/+MMQtyNJjFDxiySIgoIdh1x/8MEHGD9+Mjk5fVm9+h3uvnsCM2fOdSmdxBLt\n6hFJUG3btqV169YAdOiQTlFRfO3DFudoxi+SoG677U7mzJlJeXk5gE62LtVU/CIJKiurGw88sNDt\nGBKDtKtHRMRjVPwiIh6j4hdJUCtXriAvb4Fj2y8vL2f8+NGsWfOeY2OIM1T8IgnMqfX4d+zYzogR\nN2LtZ45sX5ylD3dFPKCp1+Pv3r0nY8bcxbJlS11+ZnI4VPwiHuDUevwSn1T8IgmirpOwgDPr8Uv8\nUvGLeNjhrscv8U3FL+IJ3xf8ka7HL/FP6/FrPf7DpszO03s5OhIxs9bjFxGRaip+ERGPUfGLiHiM\nax/uGmM6Ah8A51lrN7qVQyRR7dz5DffcM6V6WeY//nEcXbp0dTmVxAJXit8YkwTkAcVujF+flStX\nsHXrFoYOHdHk296xYzuzZk2nrKyM5ORkJk2aTtu2bZt8HBGAxYvzuPzyKznrrLNZs+Y98vLmM23a\nLLdjSQxwa8Z/H7AQGOPS+PVyan2TmTOnMWTITfTu3Yc333ydbdvyOfHEPo6MJXLzzbfTunUbIHQg\nVosWLV1OJLEi6sVvjPlP4Ftr7avGmLHRHr8xmnJ9kwsvvJjCwj28885bLFw4n169ejNs2C0uP0NJ\nZG3bHgVAfv4WHnpoHvfcc5/LiSRWRP17/MaYN4GK8NVTAAsMtNbWeoRIWVl5ZVJSs0aNkZWVFfFj\nt2/fTkZGBlu2bAHg2Wef5auvvmLkyJH07t2b119/nU6dOnHVVVcxZswYNm/ezEsvvcTixYvZunUr\nw4YN4+WXX+Z3v/sd06dPp3v37jzzzDNs27aNM888k+nTp/Pcc8+xc+dO+vfvz5///GdycnIYN24c\n2dnZXHrppY16biKN8d577zF16lRmzZpF79693Y4j0VXnrouoz/ittf2rLhtjXgeG1FX6AIWFjfsY\nIDu7DwUFO+pdt+SHKioqqw+EKCo6QHFxCcFgEWlpafj9KQSDRbRrl87OnYUUFR0gM7M7wWARSUlt\nKC4+QDBYxKZNmxg/fgLw/fomJ55YTOfOGQSDRZSWNqN169ZkZZ1AMFjEqaeeztq179Ov36+AxDyA\nJBbFW+Yjyfvhhx/wwAOzmTlzLoHA0VF73vH2GkNiZg4EUuu8z+0lGxz5cyMjI4O1a9dH9Niqox0b\n43DWN2nRogVdunTlk0/+yUknncLHH39It27dGz22SKTmzbuf8vIypk2bRGVlJZmZWdxxR0x+rCZR\n5mrxW2vPdXP8hjXt+iajR9/F/fffS0VFBccc01n7+MVRS5Y84XYEiVEJt1ZPdnYf/H5fo2f8Wt+k\n8ZTZefGWF5Q5WrRWj4iIREzFLyLiMSp+ERGPUfGLiHiMil9ExGNU/CIiHqPiFxHxGBW/iIjHqPhF\nRDxGxS8i4jEqfhERj1Hxi4h4jNvLMkstdu/exZQpEygvLyM1tS0TJkylVatWbscSkQShGX8MWr58\nKb/5zYUsWLCInj2P58UXn3M7kogkEM34Y9Att4wCoKKigm+/3ckxx3R2OZGIJBLN+GNUWVkZ1157\nJR99tI5TTz3N7TgikkBU/DEgO7vPj04Qn5SUxLJlT3HnnWOZOnWCO8FEJCGp+GPQ7Nn38uGHHwDQ\nqlUKzZo1czmRiCSSiPbxG2PaA60JnYS2GdDNWvuak8G87IorfsesWfewdOmf8Pl8jBo12u1IIpJA\nGix+Y8w9wHCgObAb6Ax8APR1Npp3de2axfz5D7sdQ0QSVCS7eq4EugB/Bc4BzgOCDmYSEREHRVL8\nX1tr9wEbgJOtta8DnZyNJSIiTomk+P9ljPk9sA4YZIw5HWjnbCxvW7lyBXl5Cxwd4/HHH2XixLGO\njiEisSmS4r8O6GitfQPYAjwMjHMwkwA+n8+xba9e/S6rV7/r6BgiErsi+VZPurV2NoC1dhSAMeZy\nR1NJtSuvvISTTjqF/PyttG/fgWnTZrJq1UusXv0uBw4coKBgB4MGXcuAARfw5ZebmDv3PgDatj2K\nsWMnYO3nLFw4n+TkZAYOvIQTT/wJL774HNdfP1RLQYh4VCQz/heMMXdC6Gudxpi/AtpHECVff13A\njTcOJy/vUQoL9/DZZ58CsH//fmbOnMOMGbNZvnwpAPfeO41Ro3KZNy+P008/g2XLQreXlpawYMEi\n+vU7h9mz7+XOO8fi8/morKx07XmJiHsimfGfCswzxvwP0BF4CLja0VQeU1Cwo8770tLSSE8PANCx\nYydKSkoA6Nnz+OrbDh4M3bZ161fMnj0DCC35kJHRBYCuXTMBWLPmPQoLdzNx4hiKivaxe/duli9f\nyqBBg515YiISkyIpfh9QCqSEL1eE/xMX1bZ/vmvXLMaPn0zHjp1Yv/5j9uzZHX5s6A+7/v1/Qf/+\nvwDgo4/W8fzzf1fpi3hQJMX/KbAQuIHQt3kWAIOAHAdzSbXvC76hD2NHjcpl6tQJlJeX4/f7yc29\ni2DwW6cDikic8TW0n9cY81Nr7Uc/uO0Ka+3TjiYLCwaLGrUjOju7D36/j7Vr10f8eIB16zY0PlwT\nOeaY0Ldjv/660LUMhyMQSCUYLHI7RqPEW+Z4ywvKHC0NZQ4EUuucKUYy499hjLkdaEONtXqAqBS/\niIg0rUi+1fN34BTgGkILtQ1E+/hFROJWJMWfbq0dDLxI6JfAOcCJToYSERHnRLKrp2rHsyW0Vs/7\nxpjkIxnUGJNL6C+H5sBD1trHjmR79Vm5cgVbt25h6NARTb7tm28eUv19+Pz8LZx//kCGDLnpiLd7\n4MAB7rvvHr755mtKS0u5/fY7OeGE3k2QWEQksuL/b2PM08AdwCvGmFOB4sMd0BjTH/i5tfYMY0xr\nYNThbitSTi1NULV0ckHBDiZOHMPgwdc1yXafeOJxjjuuB+PHT2bz5k1s3vyFil9Emkwkxd8LuNNa\nu9UYcxXQH+h5BGP+B7DBGPMckArceQTbapTalj9o1syP39+MP/7x9kYvf/DrXw8AYN682Qwbdgst\nW7Zskpxr1rzHL3/5a0aOvJk2bdowcqROxCIiTafO4jfGPAucTOjEKz81xlTd1RzYegRjpgNdgQuA\n44AXgBOOYHsR+/rrAhYsWER6eoBhw66rXv7A54OZM+ewffs2cnNHMmDABdx77zTGjp1IZmYWK1Y8\nz7JlS8nJ6UtpaQmLFi2p3ubmzZsoLi5u0hOi7927l6Kifdx//3xWrXqJBQvmMH785Cbbvoh4W30z\n/sFAe+AB4JYat5cBO49gzN3AZ9baMmCjMeaAMSbdWrurtge3a5dCUlLk55ytWv4gEEgFIDW1JSkp\nyQQCqbRv355evY4DoGvXDFJSkqr30QcCqRx1VA/KykoJBFLJz9/CvHmzgNDyB5mZmaSlpdCzZ4/q\nbQMsWfIPBg266pDbGisjI+OQzOnp7bnwwgEEAqlcdNH5/PWvy45o+06K1Vz1ibfM8ZYXlDlaDjdz\nncUfPvnKPuCiw8xUl3cI/SKZY4zpTGgpiN11Pbiw8PA+Tqg6sKGo6ADFxSUEg0VUVFRU337gQCl7\n9xaHFyrzEQwWUVJSQnl5JcFgEV26ZDJ69IRDlj/Yu7eYkpLyQw6aePvtd7n00quP6OCPiopK/H5f\n9TZatkxh0qQpPPjgI7z99pt06ZLVZAeXvPXWGzz44Fw6dToagOuuG8LJJ//0sLaViAe9xJp4ywvK\nHC0RHMBV530RnWy9KVlrXzLG9DPGrCF0QNhwa22Ulols+uUPCgv30LZt2yZNecYZ/XjmmScZOvQP\nJCUlMX78lCbbtrWfMXz4rdVr9oiI9zS4ZIPbGrtkQ2OXP4iFJRt+uMzEypUryM/fypAhNzX5evyv\nvLISv78Z+/d/R69eJzJ8+C34/ZEczvFjiThLijXxlheUOVqcXrIh4RUU7Kj+BeDW+FX7+X+org+k\n9+/fz+zZ8xr9gfTevYX063cOxxzTmVmzpvPcc3/j0kuviNZTFZEY4PniX7dug6ul35CmXI8f4Pzz\nB9KmTRsAzjqrP2+99Xp0noiIxAzPFz+4u5sHOKxfPIezHj/A4MFX8vDDj5GeHmDdurUYE5Vv0opI\nDFHxx7ym/UA6N/cuxoy5g5YtW5KVdRwXXniJI6lFJHZ5/sPdWNDYcwjEikT8QCzWxFteUOZoOZIP\ndw/v6xwiIhK3VPwiIh6j4hcR8RgVv4iIx6j4RUQ8RsUvIuIxKn4REY9R8YuIeIyO3I1B8+bN5osv\nNuLz+di9exepqW3Jy3vU7VgikiBU/DHolltC558vKyvjpptuYPTo8S4nEpFEol09MeyZZ57kZz87\nnW7djnM7iogkEBV/jCorK+OFF57lqquucTuKiCQYFX8MWLduA1u2bDnktrVr3+eUU04lJaW1O6FE\nJGGp+GPUBx+s4fTTz3Q7hogkIBV/jNq2LZ/OnY91O4aIJCB9qydGzZw5x+0IIpKgNOMXEfEYFb+I\niMeo+EVEPEbFLyLiMSp+ERGPUfGLiHiMil9ExGNU/CIiHqPiFxHxGBW/iIjHqPhFRDxGxS8i4jEq\nfhERj4n66pzGmCRgKZAFlAE3WGs3OjXe3/72FE8+uYxOnY6mQ4d0xo6dSIsWLZpk22vXvs/DDz9I\nUlISp532M66/fmiTbFdExEluzPjPB5pZa88EpgLTnRzsnXfepFu37ixYsIiePY/n+ef/1mTbXrhw\nHhMmTCEv71E+/PADvvxyc5NtW0TEKW6sx78RSDLG+ICjgBInB9u2LZ+zzuoPwN///jQAr732D9q3\n78C0aTNZteolVq9+lwMHDlBQsINBg65lwIAL+PLLTcydex8AbdsexdixE7D2cxYunE9ycjIDB17C\n8cefwN69eznmmFJKSkpo1qyZk09FRKRJuFH83wHdgM+BDsAFTg5WUnKQ5ORkAHbtCnLCCb3Jy3uU\nYcOu47PPPgVg//79zJ49j+3bt5GbO5IBAy7g3nunMXbsRDIzs1ix4nmWLVtKTk5fSktLWLRoCQB7\n9xbyxz/eTlpaGt279yAzM8vJpyIi0iTcKP7bgVXW2nHGmGOB140xfay1tc7827VLISkp8pl0RkYG\nAIFAKgCtWrUiKSl0/aijjqJTpwCBQCpdu2aQkpJEampLTj65T/j+HpSVlRIIpJKfv4V582YBUFZW\nRmZmJmlpKfTs2YNAIJWioiKWL1/KqlUrCQQCzJo1ixdeeIrrrrvusF+YqszxRJmdF295QZmj5XAz\nu1H8e4DS8OW94Qx1NnthYXGjNl5RUYnf7yMYLAKgc+cMNm36imCwiIMHD9Kr108IBos4cKCUvXuL\nKSo6wL//XUowWERJSQnl5ZUEg0V06ZLJ6NET6NixE+vXf8yePbvZu7eYkpJygsEiSktLadmyFcXF\noespKW355ptd1eM2ViCQetg/6xZldl685QVljpaGMtf3S8GN4p8LPGqMeQtoDoyx1v7bqcHOPLMf\nTz31F4YPv57S0jIuu+y3APh8vnp/btSoXKZOnUB5eTl+v5/c3LsIBr+tvr958+aMGHEbt912Ey1a\ntKBNm1TGjZvk1NMQEWkyvsrKSrcz1CsYLGpUwOzsPvj9PtauXe9UJEck4owjFsVb5njLC8ocLRHM\n+Ouc3eoALhERj1Hxi4h4jIpfRMRjVPwiIh6j4hcR8RgVv4iIx6j4RUQ8RsUvIuIxKn4REY9R8YuI\neIyKX0TEY1T8IiIeo+IXEfEYzxT/Rx+t49JLf+N2DBER13mi+L/9didPPfUE5eXlbkcREXFdwhd/\nSUkJ9903g1GjxrgdRUQkJiR88c+ZM5OrrrqG9PR0ILZPOiMiEg0JXfy7du3ik0/+yWOPPcLNNw9h\n3759TJo0zu1YIiKucuOcu1GTnp7O8uXPVF+/6KL/YNKkaS4mEhFxX0LP+H+s/hOsi4h4gaeK//nn\nV7kdQUTEdZ4qfhERUfGLiHiOil9ExGNU/CIiHqPiFxHxGBW/iIjHqPhFRDxGxS8i4jEqfhERj1Hx\ni4h4jIpfRMRjVPwiIh6j4hcR8RjH1+M3xvQFZlhrf2GM6Q4sASqADdbam5wef9++fVx99aUcd1wP\nAM4++xwuv/xKp4cVEYlZjha/MeZO4PfAd+Gb7gfGWmvfNsYsNMZcZK193skMGzd+znnn/T9uu+0O\nJ4cREYkbTu/q2QRcUuN6trX27fDllcB5Do+PtZ9h7f8yYsSNTJgwht27dzk9pIhITHO0+K21zwJl\nNW6qeQqsIuAoJ8cHyMzsxvXXD2PBgkWcdVZ/5syZ5fSQIiIxLdrn3K2ocTkV2NvQD7Rrl0JSUrOI\nB8jP33rI9V//+hxatWqF3+/nsssuZOnSRwgEUiPeXjTFaq76KLPz4i0vKHO0HG7maBf/h8aYs621\nbwEDgNca+oHCwuJGDxIIpBIMFgEwceIY+vf/Jeeeex7vvPMWPXocX31fLKmZOV4os/PiLS8oc7Q0\nlLm+XwrRLv47gEeMMc2Bz4BnnB5w2LBbmD59Ms899wwtW7YiN3e800OKiMQ0x4vfWrsVOCN8+Qvg\nHKfHrOnoo49h3ry8aA4pIhLTdACXiIjHqPhFRDxGxS8i4jEqfhERj1Hxi4h4jIpfRMRjVPwiIh6j\n4hcR8RgVv4iIx6j4RUQ8RsUvIuIxKn4REY9R8YuIeIyvsrLS7QwiIhJFmvGLiHiMil9ExGNU/CIi\nHqPiFxHxGBW/iIjHqPhFRDzG8ZOtO8kY4wMeAk4GDgDXW2u/rHH/hcBdQCnwmLV2sStBv89Tb97w\nY1KAV4A/WGs3Rj/loSJ4ja8CbiX0Gq+31g53JWgNEWS+DBgNVABPWGvnuRK0hkjeG+HHPQzsttaO\njXLEH4ngdb4NuB74NnzTEGvtF1EP+n2ehvLmALPDV78BrrHWlkQ9aA31ZTbGdAKeBCoBH3AKMNpa\nu6ih7cb7jP9ioIW19gxgDHB/1R3GmKTw9fOAc4AbjTEBN0LWUGdeAGNMNvAmcJwL2epS32vcEpgC\n9LfW9gPSjDEXuBPzEPVl9gPTgXOBM4Dhxpj2rqQ8VL3vDQBjzBCgT7SD1aOhzNnA762154b/c630\nwxrKuwj4T2vt2cAqIDPK+WpTZ2Zr7U5r7S+steeG71sHPBLJRuO9+M8i9D8Ia+37wGk17usFfGGt\n3WetLQXeAc6OfsRD1JcXIJnQ/+jPo5yrPvVlPgicYa09GL6eRGhW4rY6M1trK4Be1trvgHRC/wZc\nndWF1fveMMb8HMgBHo5+tDo19H7OBsYYY942xuRGO1wt6sxrjDke2A2MNMa8AbSPgV9U0PBrXGU+\nMNRaG9ERufFe/G2Bf9W4Xhae0dV2XxFwVLSC1aG+vFhrV1trdxD6sy1W1JnZWltprQ0CGGNuBlpb\na//hQsYfauh1rjDGXAL8E3gD2B/deLWqM7Mx5mhgIjCCOHlvhP0FGAr8AjjLGHN+NMPVor686cDP\ngXmE9hKcZ4w5J7rxatXQa1y1S3uDtXZTpBuN9+LfB6TWuO4Pz+iq7mtb475UYG+0gtWhvryxqt7M\nxhifMWYW8Evg0miHq0ODr7O19llrbWegBXBtNMPVob7MVwAdgJeBXOBqY0ysZwZ4wFq7x1pbBrwE\n/DSq6X6svry7gU3W2o3hvKuoe3YdTZF0xjWEdlNFLN6L/13gfABjzOnA+hr3fQb0MMakGWOSCe3m\nWR39iIeoL2+saijzIkL7IC+uscvHbXVmNsakGmPeCL8nIDTbj4VfvnVmttbOt9bmhPflziD0gfTj\n7sQ8RH2vc1tggzEmJfwB5bmE9kG7qb738pdAG2NM1edr/YBPoxuvVpF0xmnW2kZ1W1wv0lbjE++T\nwjf9f0L7FVtbaxcbY35D6E9kH/Ana22eO0lDGspb43GvEdpfF0vf6vlRZkL/kNcCb4fvqyQ0y3s+\n2jlriuB9cT2hb5uUAJ8AN0e6b9QpjXhvDAZMjH2rp67XeRChb3wdAP7bWjvZnaQhEeQ9B7g3fN//\nWGtvj37KQ0WQOR14xVp7amO2G9fFLyIijRfvu3pERKSRVPwiIh6j4hcR8RgVv4iIx6j4RUQ8RsUv\nIuIxKn6JS8aY/saY16M43kRjzIQGHjPYGPNYE4+bY4yZ4dT2xZtU/BLPYvEglKbO1Bvo6OD2xYPi\nej1+8byAMWYlcCzwHnCTtbbUGBMEPgA6AT8jdOTjieHrltCaQkcDzwIbCK0h8w1whbV2rzHmamAc\noaUc1gI3hsfra4x5F+gMLKnvSNTw2u73A62AXYTWot8a/itlDaElAdIJHTX8X8aYY4HlQFo4U/9w\n5ilAa2PMGKAA6BneRldCR8PeiEgjacYv8SyLUNmfRGhBvqHh2zsA08OHsf8cOGitPRPoCaQQXvuE\n0Mkt7rPW/oTQCoiDjDGdCZ/HIXx7sxqP70iokE8D7jTGtK4tlDGmOaF10a+y1p4W3l7NkwA1D6+v\nPhK4O3zbA8BfrLWnAM8Ana21+4AJwAvW2nvCj+tCaOnuXsAAY0yvxrxgIqDil/j2Vo0zKC0ndMKd\nKmsArLVsFSaTAAABuklEQVRvAwuNMcMJlWsPoE34MTuttZ+EL28A2hP6RfGOtfbr8M8Ptta+EH7M\nSmttmbV2NxAMP742xwPdgReMMR8RWv8lq8b9q34wJsCvgGXhMZ+j7pVk37LW/it8ZqjNhP5qEGkU\n7eqReFZW47KP0OkfAahaKdQYMxCYDMwBHiVUlFVr2tc8aUxljW1Ur3kfXgSrtvGg7rXxmwGbqxbO\nCi+01anG/VXjVo0JUE5kE7GaGWr+vEjENOOXeNbPGJMRPjHFYODVWh7zS+Cv4WWMvyW0PHez8H21\nleZa4GfGmKoPVOcAAxuZ63OgvTHmrPD164EnGviZV4BBAMaYAYT29UOo6DVBkyal4pd4toHQLP5j\nYHv4Mhz6zZdHCJ24ZB2hfeergW61PA6A8C6eW4FXjDGfEFqvv7avUNb57ZrwbpjfArONMf8Efg/8\noYGfux24LJzzt3y/q2cNcLoxZnotP6tv+Mhh0bLMIjEgfOrKV621nxtjfgosstbmuJ1LEpP+hBSJ\nDV8ATxpjKoB/Aze4nEcSmGb8IiIeo338IiIeo+IXEfEYFb+IiMeo+EVEPEbFLyLiMSp+ERGP+T+5\nbLaIJTfIEwAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x10baa1e10>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX4AAAEMCAYAAADDMN02AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3Xl8VOWh//FPhhAgkLBlQDGQIOAjgiumbiBWbe8Pq7i3\nKlbvr6gsKldBS0BkFWQLKIsEpAoVrEVaUVG4tLe2LhdlkSpYfQSUNYoDBImkkIXcP2YSg5JkBubM\nmeR836+Xr1dmzuQ83wnxO0/OzHlOQllZGSIi4h0+twOIiEhsqfhFRDxGxS8i4jEqfhERj1Hxi4h4\njIpfRMRjEt0OUJNAoCDiz5s2b55Mfn6hE3FOSrzmgvjNplyRUa7IxGsuOPlsfn9KQlXb6uSMPzGx\nntsRjitec0H8ZlOuyChXZOI1FzibrU4Wv4iIVE3FLyLiMSp+ERGPUfGLiHiMil9ExGNU/CIiHqPi\nFxHxGBW/iIjHqPhFRDxGxS8i4jEqfhERj1Hxi4hnLFnyInPnznY7hutU/CJS5x05coSxYx/nlVeW\nuh0lLsT9sswiEr7MzEyOHo14JXPH+XwJMc+1fv2miq+Lioro1etasrIuYseO7THNEY804xepI7p1\n68quXbvcjhGXUlJSyMq6yO0YcUMzfpE6JD09nbVrN7od40f8/hQCgQK3Y0iIZvwiIh6j4hcR8Rgd\n6hERz+jV61q3I8QFzfhFRDxGxS8i4jEqfhERj1Hxi4h4jIpfRMRjVPwiIh6j4hcR8RgVv4iIx6j4\nRUQ8RsUvIuIxWrJBpI5asWI527dvo3//B6K+748+2sDs2U/j8/k477wLHBlDnKMZv0gdlpCQ4Mh+\nZ86cztixE8nNfY5//WsTmzd/7sg44gzN+EU84LbbbuScc85jx47ttGjRkvHjJ7Ny5RusXv0ehw8f\nJi9vN3363EWvXtfyxRdbeOqpqQCkpjZl+PCRWPsZc+bMJCkpid69b2TevAX4fD4KCwv57rvvSE5O\ndvkZSiRiXvzGmETgOSATSALGW2tfj3UOCF6xKJbcuPxcuOI1m3KFLy9vN+np6cfd9tVXecyaNY+0\nND8DBvTl008/AeDQoUM88kg2I0dmM3XqRNatW8OOHdsZMWIMGRmZLF/+KosWLSQr6yKKi4uYN29B\nxT4/+WQTo0cPp3370/H7W8XiKUqUuHGo505gr7X2cqAXMMuFDHTr1pW8vN1uDC0Sc82aNSMtzQ9A\nq1atKSoqAqBTpzOYPftpbrnlNlq0aMn553dj69bN5ORMZNCg/rz55uvs3RsAoF27jGP22aVLV15+\n+TU6dTIsWrQgps9HTo4bh3qWAC+HvvYBxS5kAKBNm9OOuSCz0+L58nPxmk25wncif8EmJCSwbduX\nDB48lPnz53L22eeSlJTEiBFjaNWqNRs3fsT+/ftCj/1+nnj//fcyceI0UlJSSE5OprjYtf+N5QTE\nvPittYUAxpgUgi8Aj1X3+ObNk0lMrBfxOH5/SrXbfb6EsB4XbbEeLxLxmk25wvPD3+mUlIYkJyfh\n96fg8/kq7l+1agUrVixn2rRpJCcncfbZXdi0aR316iWwYcP7tGvXjokTx1BaWorP52P8+PHs2bOH\nhg3rV+yjf//7GDbsYZKSkmjVqhVPPPEEjRo1qjZfvP28ysVrLnAuW0JZWeyPUxpj2gJ/BmZZaxdW\n99hAoCDigOHMxspnR5rxB8VrNuUKX7duXfH5Emq82PoPf/f37dvL9OmTOXjwIBdffBmffPIx48dP\niWq2ePx5QfzmgpPP5venVPmRLjfe3G0N/Ddwv7X2rViPLyLHWrv2A/r1e4C2bdvx0kuLyMq6yO1I\n4jA3jvEPA5oBjxtjRgJlQC9r7REXsoh4Xrt2GYwZM4KkpCTatz+dwYOHuh1JHObGMf6HgIdiPa6I\nHN9ZZ3Vl/vzfux1DYkhn7oqIeIyKX0TEY1T8IiIeo+IXEfEYFb+IiMeo+EVEPEbFLyLiMVqPX8Tj\nnLxS17p1a5g/P5fk5IY0bpzKiBFjaNCgQdTHkchoxi8ijl2pa/r0yUycOI0XXniB9PS2LF++zJFx\nJDKa8YtIhWhfqWvmzLk0a9YMgNLSEpKSNNuPByp+kTpk165dNa7Ln5e3mzZtTjvutuqu1JWTM4Nd\nu3aSnT2YXr2uZdKk8QwfPqrGK3UBrFq1ig0b1nPvvQOj8jzl5Kj4ReqI9es3kZV19kldErK6K3WV\n33fkSPC+7du/JCdnIgAlJSWkp7cFfnylriVLXuS99/5BTs4s6tevf8LZJHpU/CJ1yLZt28K+FkUk\njvceQLt2mTVeqWvhwt+xebNlwYIFfPutFuCNFyp+EY87ePBbVq1awcaNH1FQUMCRI0do0KBBjW/4\nDhmSzbhxIyuu1JWd/TiBwDcV2/Pz97NgwXyM6Uzfvn0pKTnKlVf+jBtuuNnppyQ1cOUKXJHQFbhi\nI16zKVdkTuR3f+bMabRt244bbriFefOeoWXLNG6++Zcxz+WGeM0Fzl6BSx/nFPG4jh3P4ODBgwAU\nFh4iMVEHAuo6/QuLeFyrVq3JzZ3FX/6ykuLiEn7zm35uRxKHqfhFPCYvb/cxt2fPfpoRI8aQlXUR\nq1e/yxNPjGTy5KdcSiexoEM9Ih6XmppK48aNAWjZMo2Cgvg85i3Roxm/iMc99NCjTJ8+mdLSUgBd\nbN0DVPwiHpeZ2Z6nn57jdgyJIR3qERHxGBW/iIjHqPhFPG7FiuXk5s5ybP+lpaUMGjSINWved2wM\niYyKX0QcW49/9+5dPPDAfWzaFLsz5KVmenNXRCpEez3+Dh06MWzY4yxd+qLLz0wqU/GLSAWn1uOX\n+KLiF/GYqi7CAs6sxy/xR8UvIjU60fX4JT6p+EWkku8L/mTX45f4pfX4tR4/EL/ZlCsy+t2PTLzm\nAq3HLyIiUaTiFxHxGBW/iIjHuPbmrjGmFbAOuNpa+7lbOUS8bs+er3nyybEVyzL/9reP0bZtO5dT\niZNcKX5jTCKQCxS6Mf7xrFixnO3bt9G//wNR3/fu3buYMmUCPh+Aj9GjJ5Camhr1cUROxPz5udxy\ny2107345a9a8T27uTMaPn+J2LHGQWzP+qcAcYJhL4x+XU+uVTJ48nn797qdnz0tYuvQ1du7cQZcu\nXR0ZSyRSDz74MI0bNwGCJ2I1aNDQ5UTitJgXvzHmP4FvrLV/McYMj/X44YjmeiXXXXcD+fn7effd\nt5k//xk6djQMGDDI5Wco8r3U1KYA7NixjWeemcGTT051OZE4Leaf4zfG/AM4Grp5HmCB3tba4575\nUVJSWpaYWC+iMTIzM2t8zK5du0hPT2fbtm0AvPLKK3z55ZcMHjyYs846i7feeovWrVtz++23M2zY\nMLZu3cobb7zB/Pnz2b59OwMGDODNN9/kV7/6FRMmTKBDhw4sXbqUnTt3ctlllzFhwgSWLVvGnj17\n6NmzJy+88AJZWVk89thjdOvWjZtuuimi5yTipPfff59x48YxZcoUzjrrLLfjSHRUeQgj5jN+a23P\n8q+NMW8B/aoqfYD8/MjeBujWrSt5eburXY+k3NGjZRUnSBQUHKawsIhAoIBmzZrh8yUTCBTQvHka\ne/bkU1BwmIyMDgQCBSQmNqGw8DCBQAFbtmxhxIiRwPfrlXTpUkibNukEAgUUF9ejcePGZGaeCcAF\nF1zM2rUf0KPHzyJ6Xk6L1xNZlCsyJ5Lrww/X8fTTOUye/BR+/ymOPK+69POKlSicwFXlNreXbHDk\nz4309HTWrt1Y7WPKz16MxImsV9KgQQPatm3Hxx//k6uu6sFHH31I+/YdIh5bxCkzZkyjtLSE8eNH\nU1ZWRkZGJo88Eldvv0mUuVr81tor3Ry/atFdr2To0MeZNm0Szz47m7S01jrGL3FlwQKtle81dW6t\nnm7duuLzJYQ949d6JUHxmk25IqNckYnXXKC1ekREJIpU/CIiHqPiFxHxGBW/iIjHqPhFRDxGxS8i\n4jEqfhERj1Hxi4h4jIpfRMRjVPwiIh6j4hcR8RgVv4iIx7i9LLNn7du3l7FjR1JaWkJKSiojR46j\nUaNGbscSEQ/QjN8lixcv5Be/uI5Zs+bRqdMZvP76MrcjiYhHaMbvkkGDhgBw9OhRvvlmD6ee2sbl\nRCLiFZrxu6ikpIS77rqNDRvWc8EFF7odR0Q8QsUfI926df3RReATExNZtGgJjz46nHHjRroTTEQ8\nR8XvkpycSXz44ToAGjVKpl69ei4nEhGvCOsYvzGmBdCY4MVo6wHtrbV/czJYXXfrrb9iypQnWbjw\ndyQkJDBkyFC3I4mIR9RY/MaYJ4GBQH1gH9AGWAdc5Gy0uq1du0xmzpzrdgwR8aBwDvXcBrQF/ghc\nAVwNBBzMJCIiDgqn+L+y1h4ENgHnWmvfAlo7G0tERJwSTvF/a4z5NbAe6GOMuRho7mysum/FiuXk\n5s5ydIzf//45Ro0a7ugYIlL7hFP8fYFW1tq/A9uAucBjDmbyjISEBMf2vXr1e6xe/Z6jY4hI7RTO\np3rSrLU5ANbaIQDGmFscTeUxt912I+eccx47dmynRYuWjB8/mZUr32D16vc4fPgweXm76dPnLnr1\nupYvvtjCU09NBSA1tSnDh4/E2s+YM2cmSUlJ9O59I126nM3rry/jnnv6aykIEfmRcGb8rxljHoXg\nxzqNMX8EdPwgir76Ko/77htIbu5z5Ofv59NPPwHg0KFDTJ48nYkTc1i8eCEAkyaNZ8iQbGbMyOXi\niy9l0aLg/cXFRcyaNY8ePa4gJ2cSjz46nISEBMrKylx7XiISn8KZ8V8AzDDG/C/QCngGuMPRVHVQ\nXt7uKrc1a9aMtDQ/AK1ataaoqAiATp3OqLjvyJHgfdu3f0lOzkQguORDenpbANq1ywBgzZr3yc/f\nx6hRwygoOMi+fftYvHghffrc7cwTE5FaJ5ziTwCKgeTQ10dD/4nDjnd8vl27TEaMGEOrVq3ZuPEj\n9u/fF3ps8I+3nj1/Ss+ePwVgw4b1vPrqn1X6InKMcIr/E2AOcC/BT/PMAvoAWQ7m8pjvC76mN2OH\nDMlm3LiRlJaW4vP5yM5+nEDgG6cDikgdklDTMWBjzPnW2g0/uO9Wa+3LjiYLCQQKIjpI3a1bV3y+\nBNau3Vjj4wDWr9904uEicOqpwU/AfvVVfkzGi5Tfn0IgUOB2jB9RrsgoV2TiNRecfDa/P6XKWWQ4\nM/7dxpiHgSZUWqsHiEnxi4hIdIXzqZ4/A+cBdxJcqK03OsYvIlJrhVP8adbau4HXCb4IXAF0cTKU\niIg4J5xDPeUHpS3BtXo+MMYkncygxphsgn851AeesdY+fzL7q86KFcvZvn0b/fs/EPV9P/hgv4rP\nyu/YsY1rrulNv373h/W9hw8fZurUJ/n6668oLi7m4Ycf5cwzz4p6RhGRHwqn+P/HGPMy8Aiwyhhz\nAVB4ogMaY3oCl1hrLzXGNAaGnOi+wuXUsgXlyyrn5e1m1Khh3H1337C/98UXf8/pp3dkxIgxbN26\nha1bN6v4RSQmwin+zsCj1trtxpjbgZ5Ap5MY8z+ATcaYZUAK8OhJ7CsilZdGSEqqT1FRMStWLD/h\npRF+/vNeAMyYkcOAAYNo2LBh2FnWrHmfq676OYMHP0iTJk0YPFgXYhGR2Kiy+I0xrwDnErzwyvnG\nmPJN9YHtJzFmGtAOuBY4HXgNOPMk9he2r77KY9aseaSl+bnkkgsq/hI4dOgQOTkz2LVrJ9nZg+nV\n61omTRrP8OGjyMjIZPnyV1m0aCFZWRdRXFzEvHkLKva5desWCgsLI75Y+oEDBygoOMi0aTNZufIN\nZs2azogRY6L5dEVEjqu6Gf/dQAvgaWBQpftLgD0nMeY+4FNrbQnwuTHmsDEmzVq793gPbt48mcTE\n8K9HW740gt+fAkBKSkOSk5Pw+1No0aIFnTufHnpkGT5fAikpDTn33K74/Sk0bdqRkpJi/P4UduzY\nxowZU4Dg0ggZGRk0a5ZMp04dK/YNsGDBX+nT5/Zj7jue9PT0Y3KlpbXguut64fencP311/DHPy6q\ncR9Oc3v8qihXZJQrMvGaC5zLVmXxhy6+chC4PspjvkvwhWS6MaYNwaUg9lX14Pz8E3s7ofzEh4KC\nwxQWFhEIFHD06NGK+8vKoKysjIKCw/z738UEAgUUFRVRWlpGIFBA27YZDB068pilEQ4cKKSoqPSY\nkyreeec9brrpjhpPtDh6NPhCU/64hg2TGT16LLNnP8s77/yDtm0zo3Yiydtv/53Zs5+idetTAOjb\ntx/nnnt+td8TryeyKFdklCsy8ZoLonICV5XbwrrYejRZa98wxvQwxqwheELYQGttjJaQDP9N3nCX\nRsjP309qamrESS69tAdLl75E//6/ITExkREjxka8j6pY+ykDB/5XxZo9IiKV1bhkg9siXbIh3KUR\nYr1kww+XklixYjk7dmynX7/7o74e/6pVK/D56nHo0Hd07tyFgQMH4fNVf8pGvM58lCsyyhWZeM0F\n7i/ZUGfl5e2ueAGIxVjlx/l/qPKbzgMG9D1mPf4TedP5wIF8evS4glNPbcOUKRNYtuxP3HTTrTF5\nniIS/zxb/OvXb4pZ6dckmuvxA1xzTW+aNGkCQPfuPXn77bdi80REpFbwbPFD7A7zACf0InMi6/ED\n3H33bcyd+zxpaX7Wr1+LMTH5tKyI1BKeLv74Ed31+LOzH2fYsEdo2LAhmZmnc911NzqSWkRqJ8++\nuRtr4V4nwC3x+iaXckVGuSITr7nA2Td3w1mdU0RE6hAVv4iIx6j4RUQ8RsUvIuIxKn4REY9R8YuI\neIyKX0TEY1T8IiIeozN3XTJjRg6bN39OQkIC+/btJSUlldzc59yOJSIeoOJ3yaBBwWvMl5SUcP/9\n9zJ06AiXE4mIV+hQj8uWLn2Jn/zkYtq3P73mB4uIRIGK30UlJSW89tor3H77nW5HEREPUfHHyPr1\nm9i2bdsx961d+wHnnXcBycmN3QklIp6k4nfRunVruPjiy9yOISIeo+J30c6dO2jT5jS3Y4iIx+hT\nPS6aPHm62xFExIM04xcR8RgVv4iIx6j4RUQ8RsUvIuIxKn4REY9R8YuIeIyKX0TEY1T8IiIeo+IX\nEfEYFb+IiMeo+EVEPEbFLyLiMSp+ERGPifnqnMaYRGAhkAmUAPdaaz93arw//WkJL720iNatT6Fl\nyzSGDx9FgwYNorLvtWs/YO7c2SQmJnLhhT/hnnv6R2W/IiJOcmPGfw1Qz1p7GTAOmODkYO+++w/a\nt+/ArFnz6NTpDF599U9R2/ecOTMYOXIsubnP8eGH6/jii61R27eIiFPcWI//cyDRGJMANAWKnBxs\n584ddO/eE4A///llAP72t7/SokVLxo+fzMqVb7B69XscPnyYvLzd9OlzF716XcsXX2zhqaemApCa\n2pThw0di7WfMmTOTpKQkeve+kTPOOJMDBw5w6qnFFBUVUa9ePSefiohIVLhR/N8B7YHPgJbAtU4O\nVlR0hKSkJAD27g1w5plnkZv7HAMG9OXTTz8B4NChQ+TkzGDXrp1kZw+mV69rmTRpPMOHjyIjI5Pl\ny19l0aKFZGVdRHFxEfPmLQDgwIF8fvvbh2nWrBkdOnQkIyPTyaciIhIVbhT/w8BKa+1jxpjTgLeM\nMV2ttced+TdvnkxiYvgz6fT0dAD8/hQAGjVqRGJi8HbTpk1p3dqP359Cu3bpJCcnkpLSkHPP7Rra\n3pGSkmL8/hR27NjGjBlTACgpKSEjI4NmzZLp1Kkjfn8KBQUFLF68kJUrV+D3+5kyZQqvvbaEvn37\nVpuvPFc8itdsyhUZ5YpMvOYC57K5Ufz7geLQ1wdCGaps9vz8woh2fvRoGT5fAoFAAQBt2qSzZcuX\nBAIFHDlyhM6dzyYQKODw4WIOHCikoOAw//53MYFAAUVFRZSWlhEIFNC2bQZDh46kVavWbNz4Efv3\n7+PAgUKKikoJBAooLi6mYcNGFBYGbycnp/L113srxj0evz+l2u1uitdsyhUZ5YpMvOaCk89W3YuG\nG8X/FPCcMeZtoD4wzFr7b6cGu+yyHixZ8gcGDryH4uISbr75lwAkJCRU+31DhmQzbtxISktL8fl8\nZGc/TiDwTcX2+vXr88ADD/HQQ/fToEEDmjRJ4bHHRjv1NEREoiahrKzM7QzVCgQKIgrYrVtXfL4E\n1q7d6FSkE1aXZxdOUa7IKFdk4jUXRGXGX+XsVidwiYh4jIpfRMRjVPwiIh6j4hcR8RgVv4iIx6j4\nRUQ8RsUvIuIxKn4REY9R8YuIeIyKX0TEY1T8IiIeo+IXEfEYFb+IiMd4pvg3bFjPTTf9wu0YIiKu\n80Txf/PNHpYseZHS0lK3o4iIuK7OF39RURFTp05kyJBhbkcREYkLdb74p0+fzO2330laWhoQ3xed\nERGJhTpd/Hv37uXjj//J888/y4MP9uPgwYOMHv2Y27FERFzlxjV3YyYtLY3Fi5dW3L7++v9g9Ojx\nLiYSEXFfnZ7x/1j1F1gXEfECTxX/q6+udDuCiIjrPFX8IiKi4hcR8RwVv4iIx6j4RUQ8RsUvIuIx\nKn4REY9R8YuIeIyKX0TEY1T8IiIeo+IXEfEYFb+IiMeo+EVEPEbFLyLiMY6vx2+MuQiYaK39qTGm\nA7AAOApsstbe7/T4Bw8e5I47buL00zsCcPnlV3DLLbc5PayISNxytPiNMY8Cvwa+C901DRhurX3H\nGDPHGHO9tfZVJzN8/vlnXH31/+Ohhx5xchgRkVrD6UM9W4AbK93uZq19J/T1CuBqh8fH2k+x9l88\n8MB9jBw5jH379jo9pIhIXHO0+K21rwAlle6qfAmsAqCpk+MDZGS05557BjBr1jy6d+/J9OlTnB5S\nRCSuxfqau0crfZ0CHKjpG5o3TyYxsV7YA+zYsf2Y2z//+RU0atQIn8/HzTdfx8KFz+L3p4S9v2hz\nc+yaxGs25YqMckUmXnOBc9liXfwfGmMut9a+DfQC/lbTN+TnF0Y8iN+fQiBQAMCoUcPo2fMqrrzy\nat599206djyjYlusVc4Vb+I1m3JFRrkiE6+54OSzVfeiEevifwR41hhTH/gUWOr0gAMGDGLChDEs\nW7aUhg0bkZ09wukhRUTimuPFb63dDlwa+nozcIXTY1Z2yimnMmNGbiyHFBGJazqBS0TEY1T8IiIe\no+IXEfEYFb+IiMeo+EVEPEbFLyLiMSp+ERGPUfGLiHiMil9ExGNU/CIiHqPiFxHxGBW/iIjHqPhF\nRDwmoayszO0MIiISQ5rxi4h4jIpfRMRjVPwiIh6j4hcR8RgVv4iIx6j4RUQ8xvGLrTvJGJMAPAOc\nCxwG7rHWflFp+3XA40Ax8Ly1dn485Ao9JhlYBfzGWvt5POQyxtwO/BfBn9dGa+3AOMl1MzAUOAq8\naK2dEQ+5Kj1uLrDPWjs8HnIZYx4C7gG+Cd3Vz1q7OU6yZQE5oZtfA3daa4vczGWMaQ28BJQBCcB5\nwFBr7Tw3c4W29wEGAyUEOyw3GuPW9hn/DUADa+2lwDBgWvkGY0xi6PbVwBXAfcYYv9u5Qtm6Af8A\nTo9RnhpzGWMaAmOBntbaHkAzY8y1cZDLB0wArgQuBQYaY1q4natSvn5A1xjlCTdXN+DX1torQ//F\npPTDzDYP+E9r7eXASiDD7VzW2j3W2p9aa68MbVsPPOt2rpApBH/3uwNDjDFNozFobS/+7gR/ebDW\nfgBcWGlbZ2CztfagtbYYeBe4PA5yASQR/Af/LEZ5wsl1BLjUWnskdDuR4AzE1VzW2qNAZ2vtd0Aa\nwd9Zx2eINeUCMMZcAmQBc2OUJ6xcBIt/mDHmHWNMdrxkM8acAewDBhtj/g60iOGLUk0/s3Izgf7W\n2lid2VpTro+A5kCj0O2o5KrtxZ8KfFvpdklohni8bQVAVF4tTzIX1trV1trdBP+sjKUqc1lry6y1\nAQBjzINAY2vtX93OFcp21BhzI/BP4O/AIbdzGWNOAUYBDxBH/44hfwD6Az8FuhtjromTbGnAJcAM\ngn+JX22MuSIOcgEVh4Y3WWu3xChTOLk+IfgXyEZgubX2YDQGre3FfxBIqXTbF5ohlm9LrbQtBTgQ\nB7ncVG0uY0yCMWYKcBVwU7zkArDWvmKtbQM0AO6Kg1y3Ai2BN4Fs4A5jTDzkAnjaWrvfWlsCvAGc\nH6NcNWXbB2yx1n4eyraSqmfescxV7k6Ch6JiqcpcxpizgV8QPByWCbQOvd910mp78b8HXANgjLmY\n4KtiuU+BjsaYZsaYJIKHeVbHQS431ZRrHsHjjTdUOuTjai5jTIox5u+hf0MIzvZj9SJaZS5r7Uxr\nbVbouPBEgm86/97tXMaYVGCTMSY59MbhlQRnjLFS3e/YF0ATY0z5e1s9CM5o3c5V7kJrbaw6olx1\nub4FCoEjoUNP3xA87HPSavUibZXeET8ndNf/J3h8s7G1dr4x5hcE/xxPAH4XrXfETzZXpcf9jeDx\nxFh/qudHuQiWw1rgndC2MoIzx1fdzBX6d7yH4KdUioCPgQdjcQw2gn/HuwHjwqd6qvp59SH46azD\nwP9Ya8fEIleY2a4AJoW2/a+19uE4yZUGrLLWXhCLPBHk6gf8huB7cFuBe0N/LZ2UWl38IiISudp+\nqEdERCKk4hcR8RgVv4iIx6j4RUQ8RsUvIuIxKn4REY9R8UutZIzpaYx5K4bjjTLGjKzhMXcbY56P\n8rhZxpiJTu1fvEnFL7VZPJ6EEu1MZwGtHNy/eFCtXo9fPM9vjFkBnAa8D9xvrS02xgSAdUBr4CcE\nz4zsErptCa5DdArwCrCJ4Fo2XwO3WmsPGGPuAB4juDTEWuC+0HgXGWPeA9oAC6o7Iza07vw0gqsq\n7iW4Jv720F8pawguV5BG8Czk/zbGnAYsBpqFMvUMZR4LNDbGDAPygE6hfbQjeFbufYhESDN+qc0y\nCZb9OQQX5Osfur8lMCF0+v0lBNc6uQzoBCQTWhuF4MUvplprzya4LkofY0wbQtdxCN1fr9LjWxEs\n5AuBR40xjY8XyhhTn+B67rdbay8M7a/yRYDqh9ZfHww8EbrvaeAP1trzgKVAm9BKjCOB16y1T4Ye\n15bgkt5pm9qNAAAB2klEQVSdgV7GmM6R/MBEQMUvtdvbla5WtJjgBXfKrQGw1r4DzDHGDCRYrh2B\nJqHH7LHWfhz6ehPQguALxbvW2q9C33+3tfa10GNWWGtLrLX7gEDo8cdzBtABeM0Ys4Hg2jSZlbav\n/MGYAD8DFoXGXEbVK8m+ba39NnTVqq0E/2oQiYgO9UhtVnmxqgSCl4wEoHx1UWNMb2AMMB14jmBR\nlq+fX/lCM2WV9lGxvn5o8a7jjQdVr8NfD9havuBXaCGu1pW2l49bPiZAKeFNxCpnqPz9ImHTjF9q\nsx7GmPTQhSvuBv5ynMdcBfwxtGTyNwSX564X2na80lwL/MQYU/6G6nSgd4S5PgNaGGO6h27fA7xY\nw/esAvoAGGN6ETzWD8Gi1wRNokrFL7XZJoKz+I+AXaGv4dhPvjxL8CIp6wkeO18NtD/O4wAIHeL5\nL2CVMeZjguv/H+8jlFV+uiZ0GOaXQI4x5p/ArwkurVvd9z0M3BzK+Uu+P9SzBrjYGDPhON+rT/jI\nCdGyzCJxIHS5y79Yaz8zxpwPzLPWZrmdS+om/QkpEh82Ay8ZY44C/wbudTmP1GGa8YuIeIyO8YuI\neIyKX0TEY1T8IiIeo+IXEfEYFb+IiMeo+EVEPOb/AGqhKL8yuTGYAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x10aceae90>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "#now we want to use the bootstrapping to make new trees based on the new samples. we'll go back to making UPGMA trees.\n",
    "\n",
    "#start a calculator that uses sequence identity to calculate differences\n",
    "calculator = DistanceCalculator('identity')\n",
    "#start a distance tree constructor object \n",
    "constructor = DistanceTreeConstructor(calculator)\n",
    "#generate 5 bootstrap UPGMA trees\n",
    "trees =  bootstrap_trees(aln, 5, constructor)\n",
    "\n",
    "#let's look at the trees. (if you have few samples, short sequences the trees might look very similar)\n",
    "for t in trees:\n",
    "    Phylo.draw(t)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 54,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX8AAAEMCAYAAAAs8rYIAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAHCFJREFUeJzt3Xt41NWdx/H3JJMACeGaARouDV44SHGpjcilVq2l62pb\nr2i927oWXBEU8AJqUbmIchGJSBHvXcVq7aJYrSvVSqXViqirtPVAu4ssRDCyYIA0JHPZP2ZiQyXJ\nTMLMb35zPq/n8XGuv/M9zOQzZ87MnBOIxWKIiIhb8rwuQEREMk/hLyLiIIW/iIiDFP4iIg5S+IuI\nOEjhLyLioKDXBbSmunpPyt9F7d69iF27atNRjmdyrU+51h9Qn/wg1/oDzfcpFCoJtHS/nBz5B4P5\nXpdwyOVan3KtP6A++UGu9Qfa3qecDH8REWmZwl9ExEEKfxERByn8RUQcpPAXEXGQwl9ExEEKfxER\nByn8RUQcpPAXEXGQwl9ExEEKfxERBzkT/u++u56zz/6O12WIiGQFJ8L/k0928PTTK4hEIl6XIiKS\nFXI+/Ovr61mw4E6mTp3udSkiIlkj58K/omIo5eXln59ftGgeF1xwMaWlpUDKWwOIiOSknAv/pj79\n9FPef/89HnnkASZOHE9NTQ233Xaz12WJiHgu63fyao/S0lKeeOKZz8+fccYp3HbbHA8rEhHJDjk9\n8v+iFnc1ExFxhlPh/9xzL3ldgohIVnAq/EVEJE7hLyLiIIW/iIiDFP4iIg5S+IuIOEjhLyLiIIW/\niIiDFP4iIg5S+IuIOEjhLyLiIIW/iIiDFP4iIg5S+IuIOCjj6/kbY4LAw0A5UAjMsdY+n672ampq\nuPDCsznssCMAOOGEkxg79vx0NSci4gtebOZyMfCptfZSY0x34D0gbeG/ceOHjBnzL1x77XXpakJE\nxHe8CP+ngZ8nTucBDelszNo/Y+2fuPrqcfTo0ZNrrplKz56l6WxSRCTrBWIxbzY1N8aUAM8B91tr\nn2ruduFwJBYM5id93MbN2zdv3gzAq6++SqdOnRg1ahTPP/88q1evprKysh2Vi4j4QotbF3qyh68x\npj/wH8CSloIfYNeu2pSOHY3GyMsLUF29B4DDD/8KHTt2pLp6D8ccM5J77ln8+XV+EgqV+LLu5uRa\nf0B98oNc6w8036dQqKTF+2X82z7GmN7AfwI3WGsfS3d7d901i9deexWAdevewpjB6W5SRCTreTHy\nnw50A35sjJkBxIBTrbX709HYv/3bJO6443aeffYZOnbsxLRpt6SjGRERX8l4+FtrrwWuzVR7ffp8\nicrKZZlqTkTEF/QjLxERByn8RUQcpPAXEXGQwl9ExEEKfxERByn8RUQcpPAXEXGQwl9ExEEKfxER\nByn8RUQcpPAXEXGQwl9ExEEKfxERB3mymUsmffbZbm6//Rbq6+vp2bOUm266lQ4dOnhdloiIp3J+\n5P/IIw/y7W//C0uWLOfIIwfx3HO/8LokERHP5Xz4v//+e4wcORqAkSO/zttvr/O4IhER7+V8+NfW\n1lJc3BmAoqIi9u3b63FFIiLey7k5/6qqbQecLy4upra2lsLCQmpra+ncubNHlYmIZI+cH/kfffQw\n3nhjLQBvvvk7hg07xuOKRES8l/Phf9lll/PrX7/MVVddwR//uIFzzjnP65JERDyXc9M+/6h79x4s\nXFjpdRkiIlkl50f+IiLyRQp/EREHKfxFRByk8BcRcZDCX0TEQQp/EREHKfxFRByk8BcRcZDCX0TE\nQQp/EREHKfxFRByk8BcRcZDCX0TEQZ6t6mmM6QW8DYyx1m70qg4/qqxcyKZNGwkEAuzc+SklJV1Y\ntuxhr8sSER/xJPyNMUFgGVDrRft+N2nSVADC4TATJvyIG2+8xeOKRMRvvJr2WQD8BKjyqP2c8Mwz\nP+O440YycOBhXpciIj6T8fA3xvwA+MRauxoIZLr9XBEOh1m1aiUXXHCx16WIiA8FYrFYRhs0xqwB\noomzXwUscLq19pOD3T4cjsSCwfykjx8MBhP3C7ev0CxSXl4OwObNmz+/bM2aNbzyyivMnDnTm6JE\nJNu1OLjO+Jy/tfbExtPGmN8A45sLfoBdu9r2sUB19Z423S8bRaMx8vICB/TplVfWMGzYcN/2MxQq\n8W3tzVGfsl+u9Qea71MoVNLi/bz+qmdm33bkkP/93y2UlfX1ugwR8SlPN3C31p7sZft+Nm/eIq9L\nEBEf83rkLyIiHlD4i4g4SOEvIuIghb+IiIMU/iIiDvL02z6HSl1dHYsXL6SkpDO9evWitraWJUvu\nIRwO06tXLy688FKvSxQRySo5Ef6rVq2kuLiY/fv3U19fT1FREX/5S3zVy6FDj/a6PBGRrJMT4b9l\ny0eUl5czduz5PPTQchoaGliwoJJwOMzUqRMZM+aUjNSxbdtWli+/j9LSEN269aB3795s3Gj1DkRE\nsk5OhH8oFKK4uDMAkUiEzp07EwwGCQaDBAKZWztu3769jBs3gb59+zFp0pX07t2H6upP9A5ERLJO\nToT/GWecw4IFd7Bxo6Vr164A3HrrTXTq1Imzzz4vY3UMGjSYmpoapk+fSv/+AxgxYjSjRx+f8Xcg\nIiKtyfiqnqmqrt6TUoEVFUPJywuwbt0HbWqvomJom+4HEAgEaPz3LCgIkp+fT13dfgAKCwupr69v\n03GrqrbRr1+/NvcpG7m0wJaf5Vqfcq0/0OLCbi1Oe+irnk1UVAylqmpbu45RWFhAQcHfl5UuKIif\nz6UlpkXE/3Ji2udQKivry/r1G7wu4wDteTciInIwCn8f2rnzU2bOnEEkEqakpAszZsyiU6dOXpcl\nIj6iaR8feuKJx/jOd77HkiXLOfLIQTz//LNelyQiPqORvw9NmjQVgGg0yief7OBLXyrzuCIR8RuN\n/H0qHA5z6aXn8+676/na1471uhwR8RmFvw9UVW1j69atB1wWDAZ5/PGnuf76m5g1a4ZHlYmIXyn8\nfWjhwrt45523AejUqYj8/HyPKxIRv0lqzt8Y0wMoBgJAPjDQWvtqOguT5p177veZP38ujz32EIFA\ngKlTb/S6JBHxmVbD3xgzF7gKKAB2AmXA28CI9JYmzRkwoJx7773f6zJExMeSmfY5H+gPPAWcBIwB\nqtNYk4iIpFky4f+xtbYG2AAMs9b+Buid3rJERCSdkpnz/8wYcwmwHphojKkCuqe3LDlwb4Bu7N69\nmzfeWMvKlb9g3rxFXpcnIj6XzMj/X4Fe1trXgM3A/cDNaaxJ+PveABMnTqGoqIiioiJ27NhOXd3f\nvC5NRHJAMuFfaq1dCGCtnWqtHQZE0luWDBo0mJKSLkyfPpX6+npqa2s588yxXpclIjkimfBfZYy5\nHuJf+TTGPAXclN6yZNOmjUQiEebOXQjE9wMAyPb9F0TEH5KZ8/8aUGmM+T3QC1gKXJjWqoRIJMLC\nhXPp1as3xcXFdOzYESCj21KKSO5KJvwDQANQlDgdTfwnaTR48FHMnj0PgMcee4S8vHjoV1Yu87Is\nEckRyUz7/JH4B73HAiOBUcBbaaxJRETSLJmR/6nW2ncTp6uB7xtjzk1jTSIikmbJhP82Y8xkoDNN\n1vYBfp7OwkREJH2Smfb5D+CrwMXEF3c7Hc35i4j4WrLf878MeJ74C8FJwFfSWZSIiKRXMtM+uxL/\nt8TX9vmDMaawPY0aY6YRfwdRACy11j7SnuO5pq6ujgUL5rJ9+8c0NDQwefL1DB48xOuyRMRHkhn5\nv2KM+TnwMjDVGLMMqG1rg8aYE4FR1trRxN9F9G/rsVy1YsVPOeywI1iyZDk33HAzW7Z85HVJIuIz\nyYT/UcCN1tqPgAuIvwNoc/gDpwAbjDHPAquAX7bjWE566603KSgoYMqUiTz22EMcd9wor0sSEZ9p\ndtrHGLMSGEZ885ZjjDGNVxUA7RlqlgIDgO8ChxF/ARjcjuM5Z/fu3ezZU8Pdd9/LSy+9wJIli7jl\nltu9LktEfKSlOf/LgB7AYmBSk8vDwI52tLkT+LO1NgxsNMbUGWNKrbWfHuzG3bsXEQwmv0dt4y9h\nQ6GSlAtrz33T6R+ndUpLe/C9751KKFTCGWecxlNPPZ51NSfDjzW3Rn3KfrnWH2hbn5oN/8QGLjXA\nGe2o6WDWEn8xWWSMKSO+bMTO5m68a1dqM0zRaIy8vADV1XtSLiwajS+a1pb7plsoVPJ5XUOGHM2L\nL75MKNSf119fQ//+5VlZc0ua9idXqE/ZL9f6A833qbUXhGTm/A8pa+0LwLvGmLeA54CrrLVpXaqy\nrq6Ou+6aw9Kli5k9+1b27NlDTc1nXHTRWLZv357OptPi4ot/yMaNH3LllZfz1FMruOqqa7wuSUR8\nJpmveh5y1tppmWxv1aqVFBcXs3//fsrLB9KpUycWLryLAQO+nMkyDpkuXbowZ858r8sQER/L+Mjf\nC1u2fESfPn2YPPkGPvvsM6ZMuZoLL7yEkpIuXpcmIuIJT0b+6bZ161YqKoZ+fj4YzCcWizF37myC\nwXyCwSDnnns6eXl5rFq1koaGMABVVdsoK+vrVdkiIhmTcyP/9es30K9fvwMuC4cj5OfnU1AQJBAI\nUFe3n4aGMNFolHA47FGlIiLeycmR/+bNm9v0iX7TdwsiIrks50b+IiLSOoW/iIiDFP4iIg5S+IuI\nOEjhLyLiIIW/iIiDFP4iIg5S+IuIOEjhLyLioJz8ha9INvv44yrmzLkNgN69+3DDDTfToUMHb4sS\n52jkL5Jh9923mLPOGsuSJcs55pgKfvazx70uSRyk8BfJsM2b/4cRI0YDcPTRw/jgg//yuCJxkcJf\nJMMGDTKsXbsGgLVr11BXV+dxReIihb9ImlVUDD1gxdgJE65h7do1TJp0JYFAHl27dvWwOnGVwl8k\nw9at+wPjx19NZeUy8vICDB8+wuuSxEH6to9Ihg0Y8GVuv/0WCgsLGTjwMKZMudHrksRBCn+RDBsy\nZCgPPvhTr8sQx2naR0TEQQp/EREHKfxFRByk8BcRcZDCX0TEQQp/EREHKfxFRByk8BcRcZDCX0TE\nQQp/EREHaXkHSdq2bVtZvvw+SktDdOvWg6qqbUQiYXbv3s3evXtYuvRBr0sUkSQp/CVp+/btZdy4\nCfTt249Jk66ksnIZ0WiUWbNmMG3aLV6XJyIp0LSPJG3QoMGUlHRh+vSp9O8/AIDVq19ixIhR9OjR\n0+PqRCQVgVgsltEGjTFB4DGgHAgDP7LWbmzu9tXVe1IuMBQqobp6T8q1VVQMpapqG2VlfVO+b7rl\n5QWIRjP7WP2jQCBA4/OloCBIOByhoCBIfX1DysfKhv4cas31qfE5tX79Bg+qap+2/i1lqxde+AVb\nt25n/PgJXpdyyDT3GIVCJYGW7ufFyP80IN9a+3VgFnCHBzUc1Pr1G7Iy+LNJYWEBBQXx2cJMDxxE\n2mr//v3MnPljnnzySa9LyRpezPlvBILGmADQFaj3oIZmZevoLNdGYLnWH2i+T023cBRv1NfXc+qp\n3+Vb3zqJDRs+9LqcrOBF+O8FBgIfAj2B73pQg4g00dwLlJ+n55oO5EpKShg+fARr1/7aw4qyixfh\nPxl4yVp7szGmL/AbY8xQa+1B3wF0715EMJifciOhUEk7y8w+udanXOsPHLxPeXmBZq/LBuXl5VRV\nbaNfv34Hvb6xfr9p7t+7qKgwax+LtmpLf7wI//8DGj8h3J2oodl037WrNuUGXJpS8Ktc6w8036fG\nkXO29jcajVFW1pd16z74wnV+fpyaq7u2tt63fTqYFj7wbfF+XoT/PcDDxpjfAgXAdGvt3zyoQ0TE\nWRkPf2vtPuD7mW5XROSss87i+ONzZ9TfHvqRl4iIgxT+IiIOUviLiDhI4S8i4iCFv4iIgxT+IiIO\nUviLiDhIm7mI+MjSpZV07NiR7t178Ne/biISiWDMYM48c6zXpYnPaOQv4hOrVq0kEokQCAQoKiri\nuuumc/31N/Hqq1qsTFKn8BfxgTff/D11dXUcf/wJxGIxTjnlNOrr61m0aD6XXPIDr8sTH9K0j4gP\nvPDCKrp27cY776xj585POeGEb7JixU+59NLLKS8f6HV54kMKf5EMqKradkg2dcnLC5CXl8+ll36f\nWCzGiy/+EojR0BBuV23awc49mvYRSbNDuT1oNBojHA6zf3899fUNNDQ0tCv4xV0a+YtkQLZuDwpf\n3MVrx47tzJo1A4BQqCfTpt1Ghw4dvChN0kgjfxE5wNNPr2DMmH9myZLlHH744fzyl895XZKkgcJf\nRA5wxBGDqKmpAWDfvn0Eg5ogyEV6VEXkAL169WbZsiWsXv0SsViUpUsf9rokSQOFv4jjqqq2HXD+\nvvsWc8sttzN8+Aj+9Kd3mD17BvPm3eNRdZIumvYRkQN06dKF4uJiAEKhEHv2aNvDXKSRv4gc4Npr\nr2fRonlEIhEKC4NMmXKj1yVJGij8ReQA5eUDWbz4JwCEQiVUV2vkn4s07SMi4iCFv4iIgzTtI+Kg\nbdu2snz5fZSWhujWrRvRaJQFC+ZqfwCHaOQv4qB9+/YybtwEJk6cQlFREdFoVPsDOEYjfxEHDRo0\nmJqaGqZPn0p9fT179+6lvr6ee+9dpP0BHKGRv4iDNm3aSCQSYe7chQB06NCBO++cxTnnnMfw4SM9\nrk4yQSN/EQdFIhEWLpxL7959KC4upqSkhLq6Ov793x+hS5euXHPNVK9LlDRT+Is4aPDgo5g9ex4A\njz4aX7vnjjvme1mSZJimfUREHKTwFxFxkMJfRMRBCn8REQcp/EVEHJT2b/sYY0YAd1prv2mMORx4\nFIgCG6y1E9LdvoikZseO7cydO5NIJEJBQT6TJ0+jf/8BXpclh1haR/7GmOuBB4AOiYvuBm6y1p4I\n5Bljzkhn+yKSugcfXMbYsedz7733M378eJYtu9frkiQN0j3t8xfgrCbnK6y1rydO/woYk+b2RSRF\nEydOZtSorwMQDofp0KGjxxVJOqQ1/K21K4Fwk4sCTU7vAbqms30RSV2XLl3Jz89ny5bNzJ8/nx/+\n8EdelyRpkOlf+EabnC4Bdrd2h+7diwgG81NuKBQqSfk+2S7X+pRr/QF/9mnLlo++cNmbb77JrFmz\nmD9/PkOGDPGgqvTx42PUmrb0KdPh/44x5gRr7W+BU4FXW7vDrl21KTeSi1vP5Vqfcq0/kDt9eued\nt1m8eCHz5t3DkCFH5kSfGuXKY9RUc31q7QUh0+F/HfCAMaYA+DPwTIbbF5FWVFbeTSQSZs6c2wgG\n8ygr68911033uiw5xNIe/tbaj4DRidObgJPS3aaItN2jj674/HQujpQlTj/yEhFxkMJfRMRBCn8R\nEQcp/EVEHKTwFxFxkMJfRMRBCn8REQcp/EVEHKTwFxFxkMJfRMRBCn8REQcp/EVEHKTwFxFxUCAW\ni3ldg4iIZJhG/iIiDlL4i4g4SOEvIuIghb+IiIMU/iIiDlL4i4g4KO0buKeTMSYALAWGAXXAFdba\n/25y/feAHwMNwCPW2gc9KTRJrfUncZsi4GXgcmvtxsxXmZokHqMLgGuIP0YfWGuv8qTQJCXRn3OA\nG4EosMJaW+lJoSlI5nmXuN39wE5r7U0ZLjFlSTxO1wJXAJ8kLhpvrd2U8UKTlER/hgMLE2e3Axdb\na+tbOqbfR/5nAh2staOB6cDdjVcYY4KJ82OAk4BxxpiQF0WmoNn+ABhjKoA1wGEe1NZWLT1GHYGZ\nwInW2m8A3Ywx3/WmzKS11J884A7gZGA0cJUxpocnVaamxecdgDFmPDA004W1Q2t9qgAusdaenPgv\na4M/obX+LAd+YK09AXgJ+HJrB/R7+B9PvKNYa/8AHNvkuqOATdbaGmttA7AWOCHzJaakpf4AFBJ/\nEnyY4brao6U+7QdGW2v3J84HiY9qslmz/bHWRoGjrLV7gVLif18tjr6yRIvPO2PMKGA4cH/mS2uz\n1v6WKoDpxpjXjTHTMl1cGzTbH2PMIGAnMMUY8xrQI5kXM7+Hfxfgsybnw4nR18Gu2wN0zVRhbdRS\nf7DWvmGt3QYEMl5Z2zXbJ2ttzFpbDWCMmQgUW2t/7UGNqWjtMYoaY84C3gNeA/Zltrw2abZPxpg+\nwK3A1eTI8y7hSeBK4JvA8caY0zJZXBu01J9SYBRQSXymY4wx5qTWDuj38K8BSpqcz0uMvhqv69Lk\nuhJgd6YKa6OW+uNXLfbJGBMwxswHvgWcneni2qDVx8hau9JaWwZ0AC7NZHFt1FKfzgV6Ai8C04AL\njTF+7xPAYmvt/1lrw8ALwDEZrS51LfVnJ/AXa+3GRH9e4ovvdL7A7+H/O+A0AGPMSOCDJtf9GTjC\nGNPNGFNIfMrnjcyXmJKW+uNXrfVpOfG5zDObTP9ks2b7Y4wpMca8lni+QXzU74cX72b7ZK2911o7\n3Fp7MnAn8Q+xf+pNmSlp6XHqAmwwxhQlPkg9GVjvSZXJa+nv6L+BzsaYxs8CvwH8sbUD+nphtyaf\ngP9T4qIfEp/LK7bWPmiM+Q7xt6wB4CFr7TJvKk1Oa/1pcrtXgSt99m2fL/SJ+B/cOuD1xHUx4iOy\n5zJdZ7KSeM5dQfxbJPXA+8BEa21W/5Gl8Ly7DDA++7ZPc4/TRcS/ZVYHvGKtvd2bSpOTRH9OAu5K\nXPd7a+3k1o7p6/AXEZG28fu0j4iItIHCX0TEQQp/EREHKfxFRByk8BcRcZDCX0TEQQp/8SVjzInG\nmN9ksL1bjTEzWrnNZcaYRw5xu8ONMXem6/jiLoW/+Fk2/kjlUNc0BOiVxuOLo3y9nr84L2SM+RXQ\nF3gTmGCtbTDGVANvA72B44j/MvIrifOW+BpCfYCVwAbi67psB8611u42xlwI3Ex8aYZ1wLhEeyOM\nMb8DyoBHW/pVaGJ99buBTsCnxNeL/yjxbuUt4j/BLyX+C+D/NMb0BZ4AuiVqOjFR80yg2BgzHagC\njkwcYwDxX6aOQ6QNNPIXPysnHvj/RHwRvysTl/cE7rDWfo34aof7rbVfB44EikiskUJ8Y4wF1tqj\nia+YeJExpozEPhCJy/Ob3L4X8VA+FrjeGFN8sKKMMQXAA8AF1tpjE8drupFQQWJd9inA7MRli4En\nrbVfBZ4Byqy1NcAMYJW1dm7idv2JL+t9FHCqMeaoVP7BRBop/MXPfttkN6MniG/a0+gtAGvt68BP\njDFXEQ/YI4DOidvssNa+nzi9AehB/MVirbX248T9L7PWrkrc5lfW2rC1didQnbj9wQwCDgdWGWPe\nJb7mSnmT61/6hzYBvg08nmjzWZpfgfa31trPErs0/ZX4uweRlGnaR/ws3OR0gPhWkAA0rhBqjDkd\nuB1YBDxMPCwb16VvunFMrMkxPl+33hjTNFybtgfNr2+fD/w18c6jcVGu3k2ub2y3sU2ACMkNxprW\n0PT+IinRyF/87BvGmH6JTS0uA1Yf5DbfAp5KLEP8CfGlvfMT1x0sONcBxxljGj9kXQScnmJdHwI9\njDHHJ85fAaxo5T4vAxcBGGNOJT73D/Gw1yBNDjmFv/jZBuKj+f8CtiZOw4HfiHmA+AYk64nPpb8B\nDDzI7QBITPdcA7xsjHmf+Jr8B/t6ZbPfuklMyZwHLDTGvAdcAlzeyv0mA+ck6jyPv0/7vAWMNMbc\ncZD76ps/0mZa0lkkCyS2sVxtrf3QGHMMsNxaO9zruiR36e2kSHbYBPzMGBMF/gb8yON6JMdp5C8i\n4iDN+YuIOEjhLyLiIIW/iIiDFP4iIg5S+IuIOEjhLyLioP8HtJmmHmXARlEAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x10acea590>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "#biopython gives us a useful function that puts all this together by bootstrapping trees and making a 'consensus' tree.\n",
    "consensus_tree = bootstrap_consensus(aln, 100, constructor, majority_consensus)\n",
    "Phylo.draw(consensus_tree)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "*Exercise 3. T-tests*\n",
    "\n",
    "Similarly to the $\\chi^{2}$ test we saw for testing deviations from HW equilibrium, we can use a T-test to compare differences in means between two independent samples. We can use this to revisit a the first programming question in the exercsies section. Does mutation rate and population size have an effect on the fitness of populations? We can translate this question to, is there a difference in the mean base pair distance between populations under different mutation and population size regimes?\n",
    "\n",
    "Scipy has a very useful function that implements the T-test called `scipy.stats.ttest_ind`. Run two independent simulations (with different mutation rates) and compute the difference in mean bp distance between the two at their final generation. Store the populations in two different variables. Give a list of `bp_distance_1` values for each memeber of the population to `ttest_ind()`. \n",
    "\n",
    "Make sure to read teh `ttest_ind()` documentation, particularly about the argumetn `equal_var`. What should we set it to?"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 55,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "data": {
      "text/plain": [
       "Ttest_indResult(statistic=-8.1701837015857031, pvalue=9.0855662742476094e-16)"
      ]
     },
     "execution_count": 55,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "import collections\n",
    "\n",
    "target = \"..(((....).))\"\n",
    "\n",
    "#run two simulations\n",
    "hi_mut_pop, hi_mut_stats = evolve(target, generations=5, pop_size=1000, mutation_rate=0.5)\n",
    "lo_mut_pop, hi_mut_stats = evolve(target, generations=5, pop_size=1000, mutation_rate=0.05)\n",
    "\n",
    "#store lits of base pair distances for each population at last generation.\n",
    "hi_bps = [p.bp_distance_1 for p in hi_mut_pop[-1]]\n",
    "lo_bps = [p.bp_distance_1 for p in lo_mut_pop[-1]]\n",
    "\n",
    "#run the \n",
    "stats.ttest_ind(hi_bps, lo_bps, equal_var=False)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Bonus! (difficult programming exercise)\n",
    "1. *Nussinov Algorithm (Only try this if you are feeling brave and are done with the other exercises or are interested in getting a taste of Computer Science. It is beyond the scope of this workshop.)*\n",
    "\n",
    "There are several approaches for solving this problem, we will look at the simplest one here which is known as the Nussinov Algorithm. This algorithm is a popular example of a class of algorithms know as dynamic programming algorithms. The main idea behind these algorithms is that we can break down the problem into many subproblems which are easier to compute than the full problem. Once we have obtained the solution for the subproblems, we can retrieve the solution to the full problem by doing something called a backtrace (more on the backtrace later). \n",
    "\n",
    "Here, the problem is obtaining the optimal pairing on a string of nucleotides. In order to know how good our structure is, we assign a score to it. One possible scoring scheme could be adding 1 to the score per paired set of nucleotides, and 0 otherwise. So in other words, we want a pairing that will give us the highest possible score. We can write this quantity as $OPT(i, j)$ where $i$ and $j$ are the indices of the sequence between which we obtain the pairing score. Our algorithm is therefore going to compute a folding score for all substrings bound by $i$ and $j$ and store the value in what is known as a dynamic programming table. Our dynamic programming table will be a $N$ x $N$ array where $N$ is the length of our sequence. So now that we have a way of measuring how good a structure is, we need a way to evaluate scores given a subsequence. To do this, we set some rules on the structure of an RNA sequence:\n",
    "\n",
    "\n",
    "If $i$ and $j$ form a pair:\n",
    "1. The pair $i$ and $j$ must form a valid watson-crick pair.\n",
    "2. $i < j-4$. This ensures that bonding is not happening between positions that are too close to each other, which would produce steric clashes.\n",
    "3. If pair $(i,j)$ and $(k, l)$ are in the structure, then $i < k < j < l$. This ensures that there is no crossing over of pairs which would result in pseudoknots.\n",
    "4. No base appears in more than one pair.\n",
    "\n",
    "Using these rules we can begin to build our algorithm. The first part of our algorithm needs to take as input indices $i$ and $j$ and return the value $OPT(i,j)$ which is the optimal score of a structure between $i$ and $j$. We start by thinking about values of $i$ and $j$ for which we can immediately know the solution, this is known as a 'base case'.  This is a case where the solution is known and no further recursion is required. Once the algorithm reaches the base case, it can return a solution and propagate it upward to the first recursive call. So once we have reached $i$ and $j$ that are too close to form a structure (rule number 2), we know that the score is 0. \n",
    "\n",
    "Otherwise, we must weigh the possibility of forming a pair or not forming a pair. If $i$ and $j$ are unpaired, then $OPT(i,j)$ is just $OPT(i, j-1)$ since the score will not increase for unpaired indices. \n",
    "\n",
    "The other case is that $i$ is paired to some index $t$ on the interval $[i,j]$. We then add 1 to the score and consider the structure formed before and after the pairing between $i$ and $t$. We can write these two cases as $OPT(i, t-1)$ and $OPT(t+1, j)$. But how do we know which $t$ to pair $i$ with? Well we simply try all possible values of $t$ within the allowed range and choose the best one. \n",
    "\n",
    "All of this can be summed up as follows:\n",
    "\n",
    "$$ OPT(i,j) = max\\begin{cases}\n",
    "                OPT(i, j-1) \\quad \\text{If $i$ and $j$ are not paired with each other.}\\\\\n",
    "                max(1 + OPT(i, t-1) + OPT(t+1, j)) \\quad \\text{Where we try all values of $t$ < j - 4}\n",
    "                \\end{cases}$$\n",
    "\n",
    "\n",
    "We can now use this recursion to fill our dynamic programming table. Once we have filled the table with scores, we can retrieve the optimal folding by a process called backtracking. We won't go into detail on how this works, but the main idea is that we can start by looking at the entry containing the score for the full sequence $OPT[0][N]$. We can then look at adjacent entries and deduce which case (pairing or not pairing) resulted in the current value. We can continue like this for the full table until we have retrieved the full structure."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 56,
   "metadata": {
    "collapsed": false
   },
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "('ACCCGAUGUUAUAUAUACCU', '(...(..(((....).))))')\n"
     ]
    }
   ],
   "source": [
    "min_loop_length = 4\n",
    "\n",
    "def pair_check(tup):\n",
    "    if tup in [('A', 'U'), ('U', 'A'), ('C', 'G'), ('G', 'C')]:\n",
    "        return True\n",
    "    return False\n",
    "\n",
    "def OPT(i,j, sequence):\n",
    "    \"\"\" returns the score of the optimal pairing between indices i and j\"\"\"\n",
    "    #base case: no pairs allowed when i and j are less than 4 bases apart\n",
    "    if i >= j-min_loop_length:\n",
    "        return 0\n",
    "    else:\n",
    "        #i and j can either be paired or not be paired, if not paired then the optimal score is OPT(i,j-1)\n",
    "        unpaired = OPT(i, j-1, sequence)\n",
    "\n",
    "        #check if j can be involved in a pairing with a position t\n",
    "        pairing = [1 + OPT(i, t-1, sequence) + OPT(t+1, j-1, sequence) for t in range(i, j-4)\\\n",
    "                   if pair_check((sequence[t], sequence[j]))]\n",
    "        if not pairing:\n",
    "            pairing = [0]\n",
    "        paired = max(pairing)\n",
    "\n",
    "\n",
    "        return max(unpaired, paired)\n",
    "\n",
    "\n",
    "def traceback(i, j, structure, DP, sequence):\n",
    "    #in this case we've gone through the whole sequence. Nothing to do.\n",
    "    if j <= i:\n",
    "        return\n",
    "    #if j is unpaired, there will be no change in score when we take it out, so we just recurse to the next index\n",
    "    elif DP[i][j] == DP[i][j-1]:\n",
    "        traceback(i, j-1, structure, DP, sequence)\n",
    "    #hi\n",
    "    else:\n",
    "        #try pairing j with a matching index k to its left.\n",
    "        for k in [b for b in range(i, j-min_loop_length) if pair_check((sequence[b], sequence[j]))]:\n",
    "            #if the score at i,j is the result of adding 1 from pairing (j,k) and whatever score\n",
    "            #comes from the substructure to its left (i, k-1) and to its right (k+1, j-1)\n",
    "            if k-1 < 0:\n",
    "                if DP[i][j] == DP[k+1][j-1] + 1:\n",
    "                    structure.append((k,j))\n",
    "                    traceback(k+1, j-1, structure, DP, sequence)\n",
    "                    break\n",
    "            elif DP[i][j] == DP[i][k-1] + DP[k+1][j-1] + 1:\n",
    "                #add the pair (j,k) to our list of pairs\n",
    "                structure.append((k,j))\n",
    "                #move the recursion to the two substructures formed by this pairing\n",
    "                traceback(i, k-1, structure, DP, sequence)\n",
    "                traceback(k+1, j-1, structure, DP, sequence)\n",
    "                break\n",
    "\n",
    "def write_structure(sequence, structure):\n",
    "    dot_bracket = [\".\" for _ in range(len(sequence))]\n",
    "    for s in structure:\n",
    "        dot_bracket[min(s)] = \"(\"\n",
    "        dot_bracket[max(s)] = \")\"\n",
    "    return \"\".join(dot_bracket)\n",
    "\n",
    "\n",
    "#initialize matrix with zeros where can't have pairings\n",
    "def initialize(N):\n",
    "    #NxN matrix that stores the scores of the optimal pairings.\n",
    "    DP = np.empty((N,N))\n",
    "    DP[:] = np.NAN\n",
    "    for k in range(0, min_loop_length):\n",
    "        for i in range(N-k):\n",
    "            j = i + k\n",
    "            DP[i][j] = 0\n",
    "    return DP\n",
    "\n",
    "def nussinov(sequence):\n",
    "    N = len(sequence)\n",
    "    DP = initialize(N)\n",
    "    structure = []\n",
    "\n",
    "    #fill the DP matrix\n",
    "    for k in range(min_loop_length, N):\n",
    "        for i in range(N-k):\n",
    "            j = i + k\n",
    "            DP[i][j] = OPT(i,j, sequence)\n",
    "\n",
    "    #copy values to lower triangle to avoid null references\n",
    "    for i in range(N):\n",
    "        for j in range(0, i):\n",
    "            DP[i][j] = DP[j][i]\n",
    "\n",
    "\n",
    "    traceback(0,N-1, structure, DP, sequence)\n",
    "    return (sequence, write_structure(sequence, structure))\n",
    "\n",
    "print(nussinov(\"ACCCGAUGUUAUAUAUACCU\"))"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 2",
   "language": "python",
   "name": "python2"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 2
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython2",
   "version": "2.7.11"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 0
}