{
"cells": [
{
"cell_type": "code",
"execution_count": 1,
"metadata": {
"collapsed": false
},
"outputs": [],
"source": [
"%matplotlib inline"
]
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
"# The following code is necessary for animated matplotlib videos\n",
"# Based on http://jakevdp.github.io/blog/2013/05/12/embedding-matplotlib-animations/\n",
"# and on http://nbviewer.ipython.org/gist/edrex/9044756\n",
"# Important: The ffmpeg library needs to be installed to make this work http://www.ffmpeg.org/\n",
"from matplotlib import animation, pyplot as plt\n",
"\n",
"VIDEO_TAG = \"\"\"\"\"\"\n",
"\n",
"# a bit ugly to use a global variable here\n",
"fps = 10\n",
"def anim_to_html(anim):\n",
" if not hasattr(anim, '_encoded_video'):\n",
" anim.save(\"tmp.mp4\", fps=fps, extra_args=['-vcodec', 'libx264'])\n",
"\n",
" video = open(\"tmp.mp4\",\"rb\").read()\n",
" plt.close()\n",
"\n",
" anim._encoded_video = video.encode(\"base64\")\n",
" return VIDEO_TAG.format(anim._encoded_video)\n",
"\n",
"animation.Animation._repr_html_ = anim_to_html"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"#HypTrails Tutorial\n",
"\n",
"This ipython notebook provides a basic tutorial regarding the HypTrails approach. It utilizes the Python implementations provided at https://github.com/psinger/HypTrails and https://github.com/psinger/PathTools. HypTrails is a Bayesian approach that allows to compare hypotheses about human trails on the Web. Fundamentally, HypTrails is based on a first-order Markov chain model. Hypotheses are expressed as belief in parameters of the model. Then, HypTrails incorporates these hypotheses as elicited Dirichlet priors into a Bayesian inference process. The relative plausibility of hypotheses then is determined by their relative marginal likelihoods and Bayes factors.\n",
"\n",
"Details about the paper initially presenting HypTrails as well as further information can be found at:\n",
"http://philippsinger.info/hyptrails.\n",
"\n",
"First, this tutorial provides a short introduction to Bayesian inference which is necessary for understanding the main concepts of HypTrails. Then, a step-by-step example is elaborated which also takes excursions to related topics such as Markov chain models and Dirichlet distribution. Afterwards, a larger synthetic example is elaborated. At the end of this tutorial, some elementary definitions are provided."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"##Bayesian inference\n",
"\n",
"Before we focus on how we can utilize Bayesian inference for comparing hypotheses about human trails with HypTrails, let us go through the basics of Bayesian inference. If you are already familiar with the basics of Bayesian statistics, feel free to completely skip this section (specifically, the coin flip example).\n",
"\n",
"In general, statistical inference is the process of determining properties of a distribution by studying data. In our Markov chain case, this would mean that we e.g., want to determine the parameters (transition probabilities) given the data. Bayesian inference can be seen as the Bayesian counterpart to frequentist inference. In frequentist inference, parameters are usually seen as unknown constants and point estimates are inferred. Contrary, Bayesian inference treats the model parameters as random variables and usually wants to deduce probabilistic statements about the distribution of parameters or also competing models or hypotheses. Bayesian inference utilizes the famous Bayes rule:\n",
"\n",
"$$\n",
" P(A|B) = \\frac{P(B | A) P(A)}{P(B)}\n",
"$$\n",
"\n",
"For model based inference, we can replace $A$ with the parameters $\\theta$ and $B$ with the data $D$ at interest. Furthermore, we can introduce $I$ which can be used to introduce an additional assumption (knowledge) to the inference such as which model to use.\n",
"\n",
"$$\n",
" \\overbrace{P(\\theta| D, I)}^{\\text{posterior}} = \\frac{\\overbrace{P(D | \\theta, I)}^{\\text{likelihood}}\\overbrace{P(\\theta|I)}^{\\text{prior}}}{\\underbrace{P(D|I)}_{\\text{marginal likelihood}}}\n",
"$$\n",
"\n",
"The prior distribution $P(\\theta|I)$ specifies our assumption about the parameters $\\theta$ before taking the data into account. The likelihood $P(D | \\theta, I)$ represents the probability of the data if the parameters $\\theta$ are specified. The marginal likelihood (or evidence) $P(D|I)$ is the distribution of the data $D$ given our additional assumption $I$. It is the normalization of the Bayes rule and plays an important rule for model comparison which HypTrails heavily utilizes and which we will talk about [later in this tutorial](#marginal_likelihood). Finally, the posterior $P(\\theta| D, I)$ is the distribution of the parameters after taking the observed data $D$ and our additional (prior) assumption $I$ into account. We can also say that the posterior is proportional to the likelihood and the prior.\n",
"\n",
"$$\n",
"posterior \\propto likelihood \\times prior\n",
"$$"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"###Example: coin flip\n",
"\n",
"####Introduction\n",
"\n",
"For better understanding of Bayesian inference let us consider the classic coin flip example.\n",
"\n",
"We are observing whether a coin flip results in \"heads\" or \"tails\". We are not sure whether the coin at interest is fair or whether it might be biased due to some asperity or similar things. Thus, we want to conduct statistical inference of the parameter $p$, which should describe the probability of flipping \"heads\", by utilizing the Bayesian framework. The probability of flipping \"tails\" is simply $1-p$. Further, we consider a set of observations $D$ by flipping the coin several times. Thus, by applying Bayes inference, we want to determine:\n",
"\n",
"$$\n",
"P(p|D) \\propto P(D|p) \\times P(p)\n",
"$$\n",
"\n",
"####Model\n",
"\n",
"As underlying model, we can use the binomial distribution which is a discrete probability distribution for the number of successes in a sequence of n independent bianry experiments (e.g., coin flips resulting in \"heads\" or \"tails\"). The binomial distribution is conditioned on the parameters $n$ (number of trials) and $p$ the probability of flipping \"heads\". The probability mass function of the binomial distribution---which determines the probability of observing $k$ \"heads\" with parameters $p$ and $n$---is defined as:\n",
"\n",
"$$\n",
"f(k|p,n) = \\binom nk p^k (1-p)^{n-k}\n",
"$$\n",
"We can rewrite above Bayes rules as:\n",
"\n",
"$$\n",
"P(p|k,n) \\propto P(k|p,n) \\times P(p)\n",
"$$"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
""
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Prior\n",
"\n",
"We know how we can calculate the likelihood based on the PMF of the binomial distribution. But, how can we now use the prior? As mentioned, the prior is our belief in the parameter(s) before observing the data. So basically, we can express our assumption about the parameter $p$ in our model in the form of another probability distribution. In case of the binomial distribution as likelihood, we can use the Beta distribution as a conjugate prior. This means that also the posterior distribution will be of the same family (i.e., Beta distribution) as the prior distribution.\n",
"\n",
"The beta distribution is a continuous probability distribution over the interval $[0,1]$. The PDF of the Beta distribution is defined as:\n",
"\n",
"$$\n",
"f(x|\\alpha,\\beta) = \\frac{1}{B(\\alpha,\\beta)} x^{\\alpha-1}(1-x)^{\\beta-1} = \\frac{\\Gamma(\\alpha+\\beta)}{\\Gamma(\\alpha)\\Gamma(\\beta)}\\, x^{\\alpha-1}(1-x)^{\\beta-1}\n",
"$$\n",
"\n",
"$B$ is the beta function and is a normalization constant to ensure that the probability integrates to 1. $\\Gamma$ is the gamma function.\n",
"\n",
"$\\alpha$ and $\\beta$ are positive shape parameters controlling the shape of the distribution. If they are $>=1$, we can think of them as pseudo counts; i.e., counts before observing the data. So for our example, this would mean that $\\alpha$ would specify the pseudo counts of observing a \"heads\" flip, while $\\beta$ would refer to the counts of observing a \"tails\" flip. The Wikipedia page of the Beta distribution goes into detail about the behavior of the shape parameters.\n",
"\n",
"For a better understanding, let us visualize some examples next for the case of $\\alpha >= 1$ and $\\beta >= 1$. "
]
},
{
"cell_type": "code",
"execution_count": 3,
"metadata": {
"collapsed": false
},
"outputs": [],
"source": [
"from scipy.stats import beta\n",
"import matplotlib.pyplot as plt\n",
"import numpy as np\n",
"\n",
"# helper function for plotting\n",
"def plot_beta(a,b,ax, print_interval=True):\n",
" ax.set_xlabel(\"p\")\n",
" ax.set_ylabel(\"probability density\")\n",
" x = np.linspace(0.00,1, 100)\n",
" label = \"$\\\\alpha= \" + str(a) + \", \\\\beta=\" + str(b) + \"$\"\n",
" dist = beta(a,b)\n",
" # plot density\n",
" ax.plot(x, dist.pdf(x),\n",
" lw=2, alpha=0.6, label=label)\n",
" # determine the 95% HDI\n",
" if print_interval:\n",
" print \"Interval containing 95% of the distribution: \", dist.interval(0.95)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Let us consider a symmetric Beta distribution. This means that we want to express our prior belief that the coin is fair. We can express this prior with the shape parameters $\\alpha$ and $\\beta$ which we can interpret as pseudo counts. As we have a fair belief, we set both shape parameters to the same value. Let us start with $\\alpha=\\beta=10$."
]
},
{
"cell_type": "code",
"execution_count": 4,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Interval containing 95% of the distribution: (0.2886432479169988, 0.7113567520830012)\n"
]
},
{
"data": {
"text/plain": [
""
]
},
"execution_count": 4,
"metadata": {},
"output_type": "execute_result"
},
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAYYAAAEPCAYAAABGP2P1AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3XmUVPWZ//H30wKyCSgoCoIossgiNiCCa7vEKHEZyagx\nRn8mZnRcMpmYTJJx/P3knGRMnDMaYzRqjFFjJtFMjAYT3KURXJAdZEeIIiCK7DRLQz+/P75VdHXT\ndN9ebt1aPq9z6tS91bdvPVy66rnf3dwdERGRtJKkAxARkdyixCAiIjUoMYiISA1KDCIiUoMSg4iI\n1KDEICIiNcSeGMzsIDObbWYvHODn95vZMjOba2alcccjIiL1y0aJ4dvAQmC/ARNmNhY43t37ATcA\nD2UhHhERqUesicHMjgbGAr8GrI5DLgGeBHD3aUAXM+seZ0wiIlK/uEsMPwP+Dag6wM97Aqsy9j8G\njo45JhERqUdsicHMLgI+dffZ1F1a2HdorX3N0SEikqBWMZ77VOCSVDtCW6CTmf3W3a/NOGY10Ctj\n/+jUazWYmZKFiEgTuHt9N+Z1iq3E4O63u3svdz8W+ArwRq2kADABuBbAzEYDm9x93QHOp4c7d955\nZ+Ix5MpD10LXQtei/kdTxVliqM0BzOxGAHd/xN0nmtlYM1sObAe+nsV4RESkDllJDO4+GZic2n6k\n1s9uzUYMIiISjUY+55mysrKkQ8gZuhbVdC2q6Vo0nzWnHipbzMzzIU4RkVxiZngTGp+z2cYgIjnK\nrNHfHZJjWvLmWYlBRICW/WKR7GrpxK42BhERqUGJQUREalBiEBGRGpQYRESkBjU+i0jRmjNnDr/7\n3e/47//+732vPf/88yxcuJCSkhJ69uzJNddcUzRxpCkxiEhRuvfee5k6dSqdO3fe99rmzZv50Y9+\nxMyZMwEYM2YMF154Id26davzHLNnz2blypUArFixgu9973uJxNHSVJUkIkXptttu49JLL63x2ptv\nvsmgQYP27Q8bNoxJkybV+ftz5sxh06ZNjBs3jnHjxjFx4sRE4oiDSgwi0qAbb2yZ8zzySMPHNNWK\nFSt49NFHD/jz0aNH7/cFXHvsxscff0yXLl327Xfp0oVly5bVeb4FCxZw9dVXAzBz5kyGDh3a5Fia\nE0cclBhEJC+sWbOGxx9/nJNOOok333yTm2++ma5du7Jt2zaOPPJIjjvuOH7yk5806py1B4Zt2rSJ\ntm3b7ttv06YN27Zt2+/3Vq1aRe/evZk/fz5PPPEES5cu5ZGMrNfYWJoaR1yUGESkQXHe6Uexfft2\nLrvsMiZOnEjXrl054ogjuO2227j66qu56KKLmnze2nfqhxxyCJ9//vm+/R07dtC9+/7L0L/77rtc\ndtlltGrVinvuuYeHHnqIxx9/nP/4j//IahxxUWIQkZz3zDPPMGLECLp27QrA4Ycfzvz584FwNw1N\nq0qqfafet29fZsyYsW9//fr1DB8+fL9z7dy5k1atqr8+Fy5cSP/+/fftNzaWpsYRFyUGEcl5lZWV\nHH/88fv2t2/fTklJCePGjdv3WlOqkmrfqZ955pl8//vf37c/a9Ys7r77bgCWLVu2L4YpU6bs6z66\nfv163nnnHe66664mx9KYOLJB026LSHp65qTDOKAtW7Zw9913c9ppp1FZWUmHDh147LHHOP/887ny\nyitp3759o8/5wAMP8Mc//pFVq1Zx3XXX8Z3vfIdOnTrx1FNP8eGHH1JVVUXfvn33NTCfcMIJ/Pzn\nP+eII45g1apVbNq0iQ4dOjBv3jyuv/56evXq1cA7tkwcdTnQ/19Tp91WYhCRnE8MuWDv3r1MnjyZ\ndevWcdVVVyUdTg0tnRg0jkFEJIJnn32W0aNHU1JS+F+bsZYYzKwtYa3ngwntGX9y9/G1jikD/gKs\nSL30rLv/uNYxKjGIxEglhoZt27aNjh07Jh1GnVq6xBBr47O77zSzs929wsxaAVPN7EV3n1br0Mnu\nfkmcsYiINEeuJoU4xN4ryd0rUpttgNZAVR2HaV1ByQvusHIlvPsubN9e/fqhh8Lpp8ORRyYXm0hL\niT0xmFkJMAvoCzzg7tNrHeLAqWY2F1gNfM/dF8Ydl0hj7NkD06fDG2/ARx/Vfcyrr8KgQXD22TB0\nKGgZZclXWeuVZGadgeeAb7n7gozXDwH2pqqbLgR+7u79a/2u2hgkMZs3w0MPhZICQMeOoXRw9NHV\nxyxZAtOmwe7dYX/ECLjuOkiNvcp5amPIb3nVxpDJ3Teb2STgAmBBxutbM7ZfNLNfmtlh7r4h8/fH\njx+/b7usrIyysrLYYxZZtQoefBA2boSuXeHii2HkSGjduuZxJ58M48bBW2/B3/4GM2fC55/DzTdD\nxmzKIrEqLy+nvLy82eeJu1dSN2CPu28ys3bAy8BP3X1ixjHdgU/d3c1sFPBHd+9T6zwqMUjWzZsH\nv/417NoFffvCTTfBIYc0/Htr18IDD8D69aHt4ZZboIljn7JGJYb8llcD3MxsKPAkcBBhzMQz7v5j\nM7sRwN0fMbNbgJuAPUAFcJu7v1vrPEoMklVLl8J998HevXDKKXDNNfuXEuqzdSs8/DAsXx6qnm6/\nPZQ4clXtuXok/+RNYmgpSgySTRs2wF13hS/3c86BK65oWkPynj3wy1/CggWhxPD97+dPm4MUBo18\nFmkBlZXhTn/r1tDD6PLLm967qFUr+OY34YgjQlvFU0+F7q4iuU6JQSTFPXx5f/ghHH54+FJv7uwH\n7duHtom2beG99+C111omVpE4KTGIpLz9duhy2qZN+DLv0KFlztujR+i6CvDnP8OKFfUeLpI4JQYR\nQtXRs8+G7a99DXr2bNnzl5bCF78IVVXwu9+FRm2RXKXEIEJICtu3h3aFUaPieY+LLoJu3WD16jCC\nWiRXKTFI0VuyBN55J3RHveqq+KayaNMmnB/ghRdC7yeRXKTEIEVtzx74/e/D9oUXhh5EcRoyJEyX\nsWsXPPNMvO8l0lRKDFLUXnkFPvkEuncPbQDZcMUVoZfSnDkwd2523lOkMZQYpGht2wYvvxy2v/rV\nMO4gG7p0gUtSq48891xokBbJJUoMUrReeQV27gzVOwMHZve9zzorNESvXQszZmT3vUUaosQgRWnL\nFpg0KWxffHH2379VKxg7Nmz/9a8qNUhuUWKQovTKK2HthGHDoE+fZGIYMyaMsF63LgysE8kVSgxS\ndDZvhvSU9UmUFtJKSsLYBghrOGjQm+QKJQYpOi+9FCbLGz48+XUSRo0K60R/9lkYSyGSC5QYpKhs\n2gRTpoRBbOm79SSp1CC5SIlBisrkyaG0UFra8vMhNdWIEaHUsGEDzJ6ddDQiSgxSRCor4c03w/Z5\n5yUbS6aSEjj33LCtabklFygxSNGYNi0MauvTB447Luloaho9OkzzvXKlpuWW5CkxSFFwh9dfD9vn\nnRffRHlN1aYNnHFG2E7HKZKU2BKDmbU1s2lmNsfM3jez8Qc47n4zW2Zmc82sNK54pLgtXAhr1sCh\nh4beSLmorAwOOghmzdLMq5Ks2BKDu+8Eznb3k4CTgAvM7JTMY8xsLHC8u/cDbgAeiiseKW7p9Q/S\nX7656NBDQ0N0VVX1OAuRJMRaleTuFanNNkBroPbA/0uAJ1PHTgO6mFn3OGOS4rN2Lbz/fs3qmlyV\nboSeMiVMzS2ShFgTg5mVmNkcYB3wirtPr3VIT2BVxv7HwNFxxiTFJ333nW7gzWV9+kDfvlBRoWky\nJDmxTjTs7lXASWbWGXjOzAa7+4Jah9VuBvS6zjV+/Ph922VlZZSVlbVgpFKodu+u/oLNlz+ZsjL4\n4AOYOhXOPDPpaCSflJeXU94C9ZDmXuf3cIszs/8LVLj7PRmvPQyUu/vTqf3FwFnuvq7W73q24pTC\n8s478MQTcOyx8MMfJh1NNJWV8IMfhDWo77gj+Wk7JH+ZGe7e6D54cfZK6mZmXVLb7YAvAItqHTYB\nuDZ1zGhgU+2kINIcU6eG51xvW8jUunWo9oLQ1iCSbXG2MRwFvGFmc4H3CG0ME83sRjO7EcDdJwIr\nzGw58Ahwc4zxSJFZuxaWLw/LaI4cmXQ0jXP66eH5vffUCC3ZF1sbg7vPB/brMe7uj9TavzWuGKS4\nvfVWeD75ZDj44GRjaawePcLo7BUrwriGMWOSjkiKiUY+S0Has6d6Guv03Xe+Scedrg4TyRYlBilI\nc+aEeZF69YJjjkk6mqYZOTJUgy1fHqrFRLJFiUEKUvou+/TTc29epKgOPjhUg4FKDZJdSgxScDZs\ngEWLQu+eUaOSjqZ50tVJ06ZpER/JHiUGKTjvvReehw2D9u2TjaW5jjkmLOKzdWtIdiLZoMQgBcW9\neqTzKafUf2w+MKse0/Duu8nGIsWjwcRgZvea2eBsBCPSXB9/HKbX7tgRBhfIX226OmzOHNi5M9lY\npDhEKTEsAn5lZu+Z2T+n5j0SyUnpu+qTT87d6bUbq2tX6N8/TJWhNaElGxpMDO7+qLufRpi6og8w\n38x+b2Znxx2cSGNUVVW3L6SrXwpFulpM1UmSDZHaGMzsIGAgcALwGTAXuM3MnokxNpFGWbQItmyB\n7t3zd+zCgQwfHnpZLVkCGzcmHY0UuihtDD8DlgBjgf909xHufre7X0xYmU0kJ2Q2Oufr2IUDad8e\nTjwxNK6nS0UicYlSYpgHDHP3G9y99p9kAfT7kEKwa1d1/Xsh9EaqS/rfNW1aSBAicYmSGK5x9+2Z\nL5jZ6wDuvimWqEQaac6csCjP8cdDt25JRxOPwYNDb6vVq8NDJC4HTAxm1s7MugLdzOywjEcfwpKc\nIjljemrR2Hwf6VyfVq1CWwPAjBnJxiKFrb4Sw43ADGAAMDPjMQF4IP7QRKKpqICFC6GkBEpLk44m\nXul1JWbMUHWSxOeA6zG4+33AfWb2LXf/RRZjEmmU2bPDPEInnACdOiUdTbz69YPOneGzz+Cjjwqv\n95Xkhvqqks5Jba4xs3G1H1mKT6RB6WqVfFulrSlKSlSdJPGrryrprNTzxQd4iCRu61ZYvDiMci70\naqQ0VSdJ3OqrSroz9Xxd1qIRaaTZs8OI5yFDoEOHpKPJjr594dBDw/TiK1eGJUBFWlKUAW7fNrNO\nFjxmZrPM7ItRTm5mvcxskpktMLP3zexf6jimzMw2m9ns1OOOpvxDpDgVUzVSmln1vzfdG0ukJUUZ\nx3C9u28BzgcOI8yZ9NOI568EvuPug4HRwC1mdkIdx01299LU48cRzy1FbvNmWLo0dOM8qcjG4KcT\nw8yZocQk0pKiJIb05AJfAp5y9/ejntzdP3H3OantbYSZWnvU8x4ikc2aFerYBw+Gdu2Sjia7jjkm\nDOTbvDmsCS3SkqIkhplm9gphrqSXzawT0Oh7lNTAuFJgWq0fOXCqmc01s4lmNqix55biVIzVSGmZ\n1UnqnSQt7YCNzxmuJ0yW94G7b0+Nhv56Y97EzDoCfwK+nSo5ZJoF9HL3CjO7EHge6F/7HOPHj9+3\nXVZWRllZWWNCkAKzeTN88EGYcfTEE5OOJhnDh8NLL4XpQK66qvAmDpTGKy8vp7y8vNnnMY/Q383M\njgZ6ExKJAe7ub0Z6A7PWwF+BF1OD5ho6fiUwwt03ZLzmUeKU4jF5Mvz+92Fd55tvTjqaZLjDHXfA\n+vXwb/8W5okSyWRmuHujbxkaLDGY2d3AlcBCYG/GjxpMDGZmwGPAwgMlBTPrDnzq7m5mowjJakNd\nx4qkzZwZntODvYqRWfj3v/JKaG9RYpCWEqUq6TJggLvvasL5TwO+Bswzs/SihLcTSh+4+yPAPwI3\nmdkeoAL4ShPeR4rI1q2wbFkY1Fas1UhppaXVieHyy1WdJC0jSmL4AGgDNDoxuPtUGmjgdvcHgQcb\ne24pXnPnVg9qa98+6WiSdeyxYbDbxo0a7CYtJ0pi2AHMSa3BkE4O7u77DVYTyQZVI1VLVye9/noY\nBa7EIC0hSnfVCcCPgLcI03Cnp98Wybrt28O6xyUlxTeo7UDSCTI9rkOkuRosMbj7E2bWHujt7ouz\nEJPIAc2bVz3FdrHMjdSQvn3DVNzr12sqbmkZUeZKugSYDbyU2i81swlxByZSF1Uj7c+sembZWbOS\njUUKQ5SqpPHAKcBGAHefDagmU7Ju505YtEjVSHVRdZK0pCiJodLdN9V6TdN2SdbNnw979oT++oW+\nUltj9esHHTvCp5/C2rVJRyP5LkpiWGBmVwOtzKyfmf0CeDvmuET2Mzs1EqZYFuRpjMxSVPo6iTRV\nlMTwLWAwoavqH4AtwL/GGZRIbZWVocQASgwHkr4uSgzSXFF6JW0njFa+Pf5wROq2cCHs3g19+oQB\nXbK/gQOhbVtYtSr0UOrWLemIJF8dMDGY2QsZu07NNRPc3S+JLSqRWlSN1LBWrWDo0LCq2+zZ8IUv\nJB2R5Kv6qpLuST1WEEY//wp4FNiWek0kK/buDeMXQImhIapOkpZwwBKDu5cDmNk97j4i40cTzEwj\nnyVrli4NI5579IDu3ZOOJrcNGRLWqPjgg7BmRefOSUck+ShK43N7M+ub3jGz44Ain7pMsmnOnPCs\n0kLDDj4YBqXWQJw7N9lYJH9FSQzfASaZ2WQzmwxMQr2SJEvcq6tFNKgtGlUnSXNF6ZX0kpn1BwYS\nGqGXuPvO2CMTIUwlvXkzdO0KvXolHU1+OPHEMK5hyZJQBac5paSxopQYcPed7j7H3ecqKUg2ZZYW\ntAhNNB06wIABodE+PfZDpDEiJQaRJGRWI6l9oXE0ClqaQ4lBctaaNfDZZ3DIIWFqaYkunRjSAwNF\nGiPKtNt/NrMvmZmSiGRVujfSsGGhzlyi69IlLPu5ezcsWJB0NJJvonzcHgKuBpab2U/NbEDUk5tZ\nLzObZGYLzOx9M6tzOVAzu9/MlpnZXDNTpYEAqkZqrnSpIZ1gRaJqMDG4+6vu/lVgOPB34HUze9vM\nvm5mrRv49UrgO+4+GBgN3GJmJ2QeYGZjgePdvR9wAyERSZFbvz7M+dO2bZgDSBovnVDTq96JRBWp\ngG5mXYHrgG8Cs4D7gRHAq/X9nrt/4u5zUtvbgEVAj1qHXQI8mTpmGtDFzDS+tcil73KHDAlzAEnj\nde8ORx0FFRVh9LhIVFHaGJ4DphJGO1/s7pe4+9PufitwSNQ3MrM+QCkwrdaPegKrMvY/Bo6Oel4p\nTKpGahmqTpKmiHIv9qi7T8x8wcwOdvddteZQOiAz6wj8Cfh2quSw3yG19vdbnHD8+PH7tsvKyigr\nK4vy1pKHtmwJc/20ahVKDNJ0paXw4oshMXzlKxoLUujKy8spLy9v9nnMG1gg1sxmu3tprddmuXuk\n5dhT7RB/BV509/vq+PnDQLm7P53aXwyc5e7rMo7xhuKUwjF1Kjz1VJhC+tZbk44mv7nD7bfDhg3w\nwx+GnkpSPMwMd2/07cABq5LM7CgzGwG0M7PhZjYi9VxGxEn0zMyAx4CFdSWFlAnAtanjRwObMpOC\nFB/NjdRyzDTYTRqvvqqkLwL/h9AGcE/G61uJvprbacDXgHlmlv6zvB3oDeDuj7j7RDMba2bLge3A\n1xsRvxSYHTtg0aIwbmHYsKSjKQylpfDGG6E66bLLVJ0kDatvPYYngCfM7Mvu/mxTTu7uU4nWJVYV\nBgLA+++HrpX9+4cRz9J8xx8PHTvCunWwdm1Y10KkPvUt7XmNuz8F9DGz2zJ/RFja897Yo5Oio95I\nLS9d+nrrrXB9lRikIfXdzafbEQ45wEOkRVVWVs8GqvaFlqU1GqQx6qtKeiT1PD5r0UhRS0/41qcP\nHHZY0tEUloEDwyjyVavCqPJu3ZKOSHJZfVVJv6jn99zd65z3SKSp1BspPq1bh+6/06eHRujzzks6\nIsll9fVKmkkYaFZXHwYNKpAWtXdvmNMH1L4Ql9LSkBhmz1ZikPo11CtJJCuWLg3LUB51FBx5ZNLR\nFKYhQ0LJ4YMPwnKpnTsnHZHkqvoGuP089fxCHY8J2QtRioF6I8Xv4INh0KAwGnru3KSjkVxWX1XS\nb1PP99TxM1UlSYtxr57kTe0L8SotDUlh9mw488yko5FcVV9V0szUc7mZHQwMBKqAJe6uxQKlxaxY\nEao2DjsMevdOOprCduKJYVzDkiWh6q5Dh6QjklwUZdrtLwHLCWswPAB8kFpcR6RFZFYjabqGeHXo\nAAMG1GzsF6ktykI99wJnu/tZ7n4WUAb8LNaopGi4w6xZYXtEpEncpbmGp+ZF1mA3OZAoiWGLuy/P\n2F8BbIkpHikyH30En38eesgcd1zS0RSHk04KJbMFC2DnzqSjkVxU3wC3L6c2Z5jZROCPqf3LgRlx\nBybFIV1aUDVS9nTqBP36hS7C8+fDyScnHZHkmvpKDBcDFwFtgU+Bs1KPz1KviTRLZjXS8EjLPklL\nSXcLTl9/kUz19Uq6LotxSBFavRo+/TRMr92vX9LRFJfSUnjmmTDN+a5dYYyDSFqDaz6bWTvgemAQ\n0I7UGAZ3/0a8oUmhS9+tnnRS6EIp2XPooaFNZ8WK0NagEptkivJxfAroDlwAlAO9gG0xxiRFIt0r\nRl9KyUhfd1UnSW1REsPx7v5/gW3u/iQwFjgl3rCk0K1dC2vWVPerl+xLtzPMnx/WwhBJi5IY0qOc\nN5vZUKALcHh8IUkxSJcWhg2Dgw5KNpZi1a1bGGm+c2dYC0MkLUpieNTMDgPuACYAC4H/inJyM/uN\nma0zs/kH+HmZmW02s9mpxx2RI5e8NnNmeNakeclKDypM/3+IQITGZ3d/NLU5GTi2ked/HPgF1RPy\n1WWyu1/SyPNKHvvkE/j4Y2jXLsz2KckZMQKeey5MrFdZGablFokyV1I3M/tF6o5+lpn93My6Rjm5\nu08BNjb0FlHOJYUjs7TQqsFbE4nT4YfDMceE6qQFC5KORnJFlKqkpwkD3MYB/0gY4PZMC72/A6ea\n2Vwzm2hmun8sAjNS4+ZHjkw2DgnS1UkzNJ+BpES5XzvS3X+Usf9jM7uyhd5/FtDL3SvM7ELgeaB/\nXQeOHz9+33ZZWRllZWUtFIJk05o11b2RBg5MOhqBkBj+/Ocw2+ru3dCmTdIRSVOVl5dTXl7e7POY\ne/1r7pjZvcB0qksJlwOj3P27kd7ArA/wgrsPjXDsSmCEu2+o9bo3FKfkhxdegL/+FU4/Ha65Julo\nJO2nP4WVK+HGGzWupJCYGe7e6Or6+pb23GZmW4F/Av6H0G11N/AH4IamBlrrPbqbhanTzGwUIVFt\naODXJE+5qxopV6k6STLVN1dSx+ae3Mz+QJh4r5uZrQLuBFqnzv8Ioc3iJjPbA1QAX2nue0ruWrMm\n9Ejq2FGD2nLNiBHwpz+FwW6aO0ki9Qkxs0uBMwmNxZPd/YUov+fuVzXw8weBB6OcS/Jf+m60tFRz\nI+Waww6Dvn3hgw9CclCJrrhF6a76U+BfgAXAIuBfzOwncQcmhcW9upuqvnRyk6qTJC3KfduXgPPd\n/Tfu/hhhMr2L4g1LCs1HH8G6dWGRmP519juTpI0YERZLev992LEj6WgkSVESgxPmR0rrknpNJLL3\n3gvPI0eqGilXdekSknZlpdaDLnZRPqI/AWaZ2RNm9iQwE7gr3rCkkFRVwfTpYXvUqGRjkfql/3/S\niVyKU72JwcxKgCpgDPAc8Cwwxt2fzkJsUiCWLIHNm8P0C336JB2N1Gf48DBNyeLF4f9MilO9icHd\nq4Dvu/sad/+Lu09w97VZik0KRPru85RTQh225K727WHIkNBZIF3Kk+ITpSrpVTP7npn1MrPD0o/Y\nI5OCkFlfrWqk/HBKahkuJYbiFWUcw1cIjc23ZLzmwHGxRCQFZf780MPlmGOge/eko5Eohg6Ftm3h\n738PPcn0/1Z8GiwxuHsfdz+21kNJQSJJVyOptJA/Wreuni9JjdDFKcoAt3Zm9l0ze87M/mxm3zGz\nttkITvJbRUUoMZhpUFu+yeydpPkri0+UNobfAoOA+4EHgMHAU3EGJYVh1izYsydMr92lS8PHS+4Y\nMAA6d4ZPPw1VSlJcorQxDHb3zAV03jAzLR0uDXr77fCcbsyU/FFSEkoNr74K77wDxzZ2UV/Ja1FK\nDLPMbEx6x8xGEwa5iRzQunVhQra2bTW/f74ak/rUv/de6F0mxSNKYhgJvGVmH5rZ34G3gZFmNt/M\n5sUaneStd94Jz8OHawrnfNWzZ+hNtmMHzJ2bdDSSTVGqki6IPQopKFVV8O67YfvUU5ONRZpnzBj4\n8MNQLagOBMWjwcTg7n/PQhxSQJYsgY0bwxQYxx+fdDTSHKNGhQV8Fi2CTZvUiaBYaJ5LaXHpRucx\nYzQFRr7r0AGGDatZCpTCp8QgLaqionoKjNGjk41FWka6EfqddzSmoVgoMUiLmjkz9GAZOBC6dk06\nGmkJgweHMQ2ffAIrVyYdjWRDrInBzH5jZuvMbH49x9xvZsvMbK6ZlcYZj8TvrbfC85gx9R8n+aOk\npHosSvr/Vwpb3CWGx6mnV5OZjQWOd/d+wA3AQzHHIzFatSrcUbZrp7ELhea008Lz9Ola9rMYxJoY\n3H0KsLGeQy4BnkwdOw3oYmaayzFPTZkSnseMgTZtko1FWtaRR4ZpMnbt0sR6xSDpNoaewKqM/Y+B\noxOKRZph506YNi1sn3FGsrFIPNL/r5MnqxG60EUZ4Ba32h0a6/yTGz9+/L7tsrIyysrK4otIGm36\n9JAc+vWDHj2SjkbiUFoKhxwCq1eHKsPjNPl+zikvL6e8vLzZ5zGPOfWbWR/gBXcfWsfPHgbK02tI\nm9li4Cx3X1frOI87Tmk6d7jrLvjoI7j+eq29UMieew5eeilUF153XdLRSEPMDHdv9GiipKuSJgDX\nwr7J+TbVTgqS+z78MCSFjh3DXaUUrtNPD88zZsD27cnGIvGJu7vqHwiT7g0ws1Vm9g0zu9HMbgRw\n94nACjNbDjwC3BxnPBKPN98Mz6eeGlb/ksJ1+OEwaFAYq6KR0IUr1jYGd78qwjG3xhmDxKuionrR\neDU6F4czz4SFC8MNwTnnaNqTQpR0VZLkualTYfduOOEEOOKIpKORbDjxRDj00DASeqGW7CpISgzS\nZFVVMGlnlFRUAAANeklEQVRS2D733GRjkew56CBIdwp8/fVEQ5GYKDFIk82aBRs2hMFPQ4YkHY1k\n0xlnhEGMCxbA2rVJRyMtTYlBmuy118Kz6pmLT4cO1fNhqdRQeJQYpElWrAiDnDp00PTaxSpdffju\nu7BtW7KxSMtSYpAmSd8lnnGG1nQuVt27w9ChoetqusuyFAYlBmm0DRtC+0JmI6QUp3Spobwc9uxJ\nNBRpQUoM0mivvx56JI0YEbotSvEaOBB69oTNmzXraiFRYpBG2bq1utrg/POTjUWSZ1b9d/DSS+GG\nQfKfEoM0ymuvhQFtJ54IvXolHY3kglGjoFs3WLcuLO0q+U+JQSLbvj3UJQOMHZtoKJJDSkrgwgvD\n9sSJWquhECgxSGRvvBHWXBg0CI49NuloJJeMHg2HHQZr1sDs2UlHI82lxCCR7NgREgOotCD7a9UK\nvvjFsK1SQ/5TYpBIysvDTKr9+4dV2kRqO+006NwZVq2C+fOTjkaaQ4lBGlRRAa++Gra/9KVkY5Hc\n1bp1dQ+lF15QqSGfKTFIg15+OTQ89+8PAwYkHY3ksjPPhC5dwop+M2YkHY00lRKD1GvjxurpL778\nZU2WJ/Vr0wYuuSRsP/+8RkPnKyUGqdeECWEunJEjoU+fpKORfDBmDPToAevXw+TJSUcjTaHEIAe0\nenWYOfOgg+DSS5OORvJFSQlcdlnY/tvfQhuV5JfYE4OZXWBmi81smZn9oI6fl5nZZjObnXrcEXdM\nEs1zz4UpDs46S8t2SuMMHRrapLZvD21Ukl9iTQxmdhDwAHABMAi4ysxOqOPQye5emnr8OM6YJJpF\ni0KXw7ZtNW5BGs8stElBaKNavz7ZeKRx4i4xjAKWu/vf3b0SeBqoq1JCTZo5pLIS/vCHsD12LBxy\nSLLxSH7q0yfMo1RZCU8/re6r+STuxNATWJWx/3HqtUwOnGpmc81sopkNijkmacBLL4UJ0Xr0qJ5v\nX6QpLr8c2rULpU9NlZE/WsV8/ij3CLOAXu5eYWYXAs8D/WsfNH78+H3bZWVllGmFmFisWxcSA8BX\nvxqmOhBpqk6dQkP0738PzzwT5tlq2zbpqApXeXk55emZLpvBPMbynZmNBsa7+wWp/X8Hqtz97np+\nZyUwwt03ZLzmccYpgTvcdx8sXhymN7j22qQjkkJQVQX/9V9hjfBzz4Urrkg6ouJhZrh7o6vq465K\nmgH0M7M+ZtYGuBKYkHmAmXU3C8OmzGwUIVlt2P9UErf33gtJoWNHGDcu6WikUJSUwNVXh+dJk8Ko\naMltsSYGd98D3Aq8DCwEnnH3RWZ2o5ndmDrsH4H5ZjYHuA/4SpwxSd02bAgNhBB6k3TsmGw8Ulh6\n9YJzzgmlh8cfDw3SkrtirUpqKapKildVFfzsZ7B0aViZ7eabNfWFtLzdu+E//xM++QTKyuCqq5KO\nqPDlalWS5IFXXglJoVOn0K6gpCBxaNMGvvnNMJK+vBzmzUs6IjkQJYYi9+GHYT4kgOuu05gFiVev\nXtXTZfz2t7BlS7LxSN2UGIpYRQU89hjs3Rt6iwwenHREUgzOOw9OOAG2bg3tDVVVSUcktSkxFKmq\nKnj00TBu4eijq+/iROJmFkqnHTvCwoXw7LNJRyS1KTEUqf/93/Ch7NgxNDa3bp10RFJMunSBf/7n\n0N7w2mvw1ltJRySZlBiK0JQp8MYb4UN5003QtWvSEUkx6tcvjG8A+J//gWXLko1HqikxFJmFC6sn\nyLvmGjj++GTjkeJ22mnwhS+Edq6HHw5dWSV5SgxFZPFi+OUvw4fw/PPDSlsiSRs3LqzfsG0b3Htv\naPeSZCkxFIklS+DBB8OI0zPO0JQXkjtKSuCGG2DAANi8OSSHTz9NOqripsRQBJYuhQceCCNPTz89\n1OtqEJvkkjZt4JZbwqpvmzYpOSRNU2IUuGnTwkCiPXvg1FM1slly265dcP/9sHx56DF3001qB2uO\npk6JocRQoNzhL3+BF18M+2VlcOWVodgukst27oRf/QoWLAjrgVxzDYwenXRU+UmJQfapqICnnoJZ\ns0IiuOIKOPvspKMSia6qKoy1eeONsH/++fAP/xC6WEt0SgwCwKJF8OSTsHFjWFLxn/5JU11I/po8\nOUwHX1UFvXvD178elpyVaJQYityuXfD889V3WH36wDe+Ad27JxqWSLMtWxbmVPr88zBC/9JLw9xe\nqhZtmBJDkaqqgrffDjOkbt4citoXXQQXXKAPjhSOnTtD1dLUqWG/R4/Q5XrIEHWmqI8SQ5GpqoK5\nc0NCWLMmvNanT+iK2rt3oqGJxGbePHjmGVi/PuwPGACXXAJ9+ypB1EWJoUhUVIQSwqRJ1R+Obt1C\nw9zIkfpwSOHbsycs9DNxImzfHl7r3TssHTpypCaEzJSTicHMLiCs43wQ8Gt3v7uOY+4HLgQqgOvc\nfXYdxxR1Yti1C95/H2bOhPnzw0A1gMMPDx+GM88M3fpEiklFBbz6Krz5ZphOA6BDBygtheHDYeBA\n9WLKucRgZgcBS4DzgNXAdOAqd1+UccxY4FZ3H2tmpwA/d/f9eiwXW2LYuzesrLZ0afUjvXj6mjXl\nnHtuGeecE+pXi7kdoby8nLKysqTDyAnFfC0qK2H69NDxYtWq8Bnp0aOMDh1CVVP//mEm1549i69E\n3dTEEOd95ihgubv/HcDMngYuBRZlHHMJ8CSAu08zsy5m1t3di2IarZ07Q3XQ+vXw2WewejV8/DGs\nXRuKy5n69oURI+CVV8r5138tSyTeXFPMX4a1FfO1aN06jOofMyZ8dr773ZAY1qwJY3lmzQrHtW0b\nkkPPnqHx+vDDw5Tz3bqp+qm2OBNDT2BVxv7HwCkRjjka2C8xfPhhS4dXt8yCiXv1fvo5vQxhVVXN\nx9694bFnT7iD2b27+rFjR/Vj69bw2LIlJIYDOeqo6jud/v2hc+fw+pQpLf9vFikEZuELf8AAuPPO\ncLOVWeresAE++CA8auvQIax33qlTmIqjbdswDqhduzCPU/rRunWonmrVKjybhVJ7ejvzkRlX7f1c\nF2diiFr3U/sy1fl7d93VvGByUevW4W4lfdfSo0dYZrNnz/CHKSJNd/jh4XHaaWF/27ZQIk+Xyj//\nPJTWN2wIjdjbt2s9iLQ42xhGA+Pd/YLU/r8DVZkN0Gb2MFDu7k+n9hcDZ9WuSjKz4mlgEBFpQbnW\nxjAD6GdmfYA1wJXAVbWOmQDcCjydSiSb6mpfaMo/TEREmia2xODue8zsVuBlQnfVx9x9kZndmPr5\nI+4+0czGmtlyYDvw9bjiERGRaPJigJuIiGRPTvWCN7MLzGyxmS0zsx8c4Jj7Uz+fa2al2Y4xWxq6\nFmZ2deoazDOzt8zsxCTizIYofxep4042sz1mVrALl0b8jJSZ2Wwze9/MyrMcYtZE+Ix0NrMXzGxO\n6lpcl0CYsTOz35jZOjObX88xjfvedPeceBCqm5YDfYDWwBzghFrHjAUmprZPAd5NOu4Er8UYoHNq\n+4JivhYZx70B/BX4ctJxJ/h30QVYAByd2u+WdNwJXovbgZ+krwPwOdAq6dhjuBZnAKXA/AP8vNHf\nm7lUYtg3IM7dK4H0gLhMNQbEAV3MrBAnlm7wWrj7O+6+ObU7jTD+oxBF+bsA+BbwJ+CzbAaXZVGu\nxVeBZ939YwB3X5/lGLMlyrWoAjqltjsBn7t7raGj+c/dpwAb6zmk0d+buZQY6hrs1jPCMYX4hRjl\nWmS6HpgYa0TJafBamFlPwpfCQ6mXCrXhLMrfRT/gMDObZGYzzOyarEWXXVGuxQPAIDNbA8wFvp2l\n2HJNo783c2nqtRYdEJfnIv+bzOxs4BvAafGFk6go1+I+4Ifu7mZm7P83UiiiXIvWwHDgXKA98I6Z\nvevuy2KNLPuiXIsLgFnufraZ9QVeNbNh7r415thyUaO+N3MpMawGemXs9yJktvqOOTr1WqGJci1I\nNTg/Clzg7vUVJfNZlGsxgjAWBkJd8oVmVunuE7ITYtZEuRargPXuvgPYYWZvAsOAQksMUa7FdcBP\nANz9AzNbCQwgjLEqJo3+3sylqqR9A+LMrA1hQFztD/YE4FrYN7K6zgFxBaDBa2FmvYE/A19z9+UJ\nxJgtDV4Ldz/O3Y9192MJ7Qw3FWBSgGifkb8Ap5vZQWbWntDYuDDLcWZDlGvxEWF2Z1J16gOAFVmN\nMjc0+nszZ0oMrgFx+0S5FsD/Aw4FHkrdKVe6+6ikYo5LxGtRFCJ+Rhab2UvAPELj66PuXnCJIeLf\nxY+AJ8xsHqEq5fvuviGxoGNiZn8AzgK6mdkq4E5ClWKTvzc1wE1ERGrIpaokERHJAUoMIiJSgxKD\niIjUoMQgIiI1KDGIiEgNSgwiIlKDEoOIiNSgxCAiIjUoMYg0QWoqhsVm9jszW2hm/2tm7ZKOS6Ql\nKDGINF1/4EF3HwRsAW5OOB6RFqHEINJ0q9z9ndT274DTkwxGpKUoMYg0XeZEY0Zhrg0iRUiJQaTp\neqemMYawpOaUJIMRaSlKDCJNtwS4xcwWAp2pXlpUJK/lzHoMInloj7sX6prKUsRUYhBpOrUpSEHS\nQj0iIlKDSgwiIlKDEoOIiNSgxCAiIjUoMYiISA1KDCIiUoMSg4iI1PD/AavmkgQIJb5iAAAAAElF\nTkSuQmCC\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"fig, ax = plt.subplots(1,1)\n",
"plot_beta(10,10,ax)\n",
"handles, labels = ax.get_legend_handles_labels()\n",
"ax.legend(handles, labels)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"What we can see is the PDF of the Beta distribution with our given shape parameters. We can see that the parameter $p=0.5$ receives the highest density. However, as we keep our pseudo counts relatively low, we also allow other parameter configurations to receive a certain density. If we determine the interval containing 95% of the distribution, we receive $0.29$ as the lower and $0.71$ as the upper boundary."
]
},
{
"cell_type": "code",
"execution_count": 5,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Interval containing 95% of the distribution: (0.43095093094181675, 0.56904906905818331)\n"
]
},
{
"data": {
"text/plain": [
""
]
},
"execution_count": 5,
"metadata": {},
"output_type": "execute_result"
},
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAYIAAAEPCAYAAABP1MOPAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3XuYXHWd5/H3N+nck+7cCJdADERhuEOiYxBcGsZLluuC\nyxMYBifIqLsiMLBeGJgd4+OswGqYQVAUFoIDo4LERXCiAwoNMoougUBCkIiB0AkQSMitQ+793T9+\nddJF0119urrOrerzep56qur0yTnfPuk63/rdzd0REZHGNSjrAEREJFtKBCIiDU6JQESkwSkRiIg0\nOCUCEZEGp0QgItLgEksEZna7ma0xsyVl275hZs+b2TNm9hMza0nq/CIiEk+SJYL5wKxu2x4EDnf3\no4HlwN8leH4REYkhsUTg7r8G1nfb9pC7d5be/g7YP6nzi4hIPFm2EXwKWJjh+UVEhIwSgZldDexw\n9x9kcX4REenSlPYJzWwOcArwFxX20QRIIiJVcHfr779JtURgZrOALwJnuvu2Svu6ux7ufOUrX8k8\nhrw8dC10LXQtKj+qlWT30R8CvwEOMbN2M/sUcCMwGnjIzJ42s+8kdX4REYknsaohdz+vh823J3U+\nERGpjkYW51xra2vWIeSGrkUXXYsuuhYDZwOpV0qKmXke4xIRyTMzw6toLE6915CI1J5Zvz/7UnC1\n/LKsRCBSJ1SKbhy1TvxqIxARaXBKBCIiDU6JQESkwSkRiIg0ODUWi0hhLV68mLvuuotvfvObe7bd\nd999LFu2jEGDBjF58mQuuOCCitsbOb6IxhGI1IFS//Gsw0jV9ddfz+OPP05LSwvz588HYOPGjZx8\n8sksWrQIgOOOO46f/exnNDU1vWv7Aw88wMSJE3s89tNPP81LL70EwIoVK/jCF76Qq/h6+//WOAKR\nhOzeDXffDevWdW3be2845xxQ9/3sXHHFFUyYMIG2trY92x577DEOO+ywPe+PPvpoHn74YYYPH/6u\n7Y888gjnnHPOu467ePFiNmzYwNlnnw3AySefXFUiSCq+JCgRiPTh+efh0UffuW3pUpgxA6ZNyyam\n/vrsZ2tznO99rzbH6cmKFSu49dZbe/35zJkzOfPMM9+xrfu34lWrVjF27Ng978eOHcsf//hHxo8f\n3+P2njz33HOcf/75ACxatIgjjzyy6hiTiC8JSgQifXj55fD8/vfDccfBY4/BM8/ASy8VJxHkwauv\nvsr8+fM55phjeOyxx/jc5z7HhAkT6OjoYJ999uGggw7immuu6dcxuw+s2rBhA8OHD9/zfujQoXR0\ndGBmPW7vrr29nSlTprBkyRLuuOMOli9fzvfKsl9/Y6x1fElRIhDpQ5QIjjkGjjgCNmwIiWDlykzD\n6pckv8nHsWXLFs466ywWLlzIhAkTmDRpEldccQXnn38+p512WtXH7f6Ne8yYMawrq8PbunUre++9\nN8OHD+9xe3dPPPEEZ511Fk1NTcybN4+bb76Z+fPnc/XVV+civqQoEYhU4N6VCA48MDxPnRqeS22J\nEsPdd9/NjBkzmDBhAgB77bUXS5YsAcK3X6iuaqj7N+5p06bx5JNP7nm/bt06pk+fztixY9+xfe3a\ntUyfPv1d59i2bRtNTV23xWXLlnHwwQfved/fGGsdX2KyXlGnl1V2XCQP1q51/8xn3K+4wr2zM2zb\nvdv9858P2zs6so0vkvfPzHe/+12fN2/envdLly71Qw45ZMDHnT9/vs+ZM2fP+46ODj/iiCP2vD/q\nqKN8zZo1vW53d1++fLl3dnZ6Z2enf/rTn96zz5tvvukzZszwTZs2ZRpfT3r7/y5t7/c9V91HRSpY\ntAhuuSVUCV1ySdf2b3wDXnwRLr0UDj88u/giee8+umnTJq677jqOP/54du7cyahRo7jtttv42Mc+\nxuzZsxk5cmS/j3nTTTdxzz330N7ezpw5c7j88stpbm7mzjvvZOXKlXR2djJt2rQ9Db+9bT/00EO5\n4YYbmDRpEu3t7WzYsIFRo0bx7LPPctFFF3HAAQdU9TvXKr6e1Lr7qBKBSAULFsCDD8Jpp8Hpp3dt\n//GP4Ze/hDPOgFNPzS6+SN4TQZ7t3r2bRx99lDVr1nDeeT0trJg/tU4EmmJCpIKofSBqF4hE76Of\nS3EtWLCAmTNnMmhQ494OG/c3F+lDZ2dXz6BKiUBfxIvtlFNOYeTIkcyePTvrUDKjRCDSi9dfh+3b\nYeJEGDPmnT+bOBFGjYJNm2D9+mzik9oYPXp01iFkTolApBdR99D3vOfdPzPr6k6q6iEpOiUCkV50\nHz/QXZQgNJ5Aik6JQKQXvTUUR9RgLPVCiUCkBzt3wurVMGgQTJnS8z5RInjlldCwLFJUSgQiPWhv\nD9NP77svDBvW8z7NzTB+PGzbFhqWRYpKcw2J9KCvaqHIgQfCW2+F/ffbL+Gg+tB9XhuRuJQIRHrQ\n3h6ee+oxVG7KlDANxapVycdUiUYVy0AkVjVkZreb2RozW1K2bbyZPWRmy83sQTMbW+kYIlmJxgb0\nslLgHnvtFZ7feivZeESSlGQbwXxgVrdtVwIPufvBwK9K70VyJ5oafvz4yvtFPy9fxlKkaBJLBO7+\na6D7mMszgO+XXn8f+C9JnV+kWu5dJYK4iUAlAimytHsN7e3ua0qv1wDpLcEjEtPmzaH76KhRvfcY\nijQ3Q1MTdHTAjh3pxCdSa5l1H40WUcjq/CK9ib7dlxbTqsgMxo0LrzXnkBRV2r2G1pjZPu7+upnt\nC7zR245z587d87q1tZXW1tbkoxOhKxH0VS0UGT8e3nwztBOkuMysCG1tbbS1tQ34OGkngvuBvwau\nKz3f19uO5YlAJE3VJILyfyeSlu5fkr/61a9WdZwku4/+EPgNcIiZtZvZhcC1wEfNbDlwcum9SK4o\nEUijSaxE4O69rfn2kaTOKVIL/U0EUVuCEoEUleYaEukm7hiCiEoEUnRKBCLdqGpIGo0SgUiZHTvC\nmICmpjBGII6o++hbb2n9YikmJQKRMtFYgHHjwhiBOIYODWsa794NGzcmF5tIUpQIRMr0t30gouoh\nKTIlApEy/W0fiET7a3SxFJESgUiZgSYCzUIqRaREIFKmP/MMlVPVkBSZEoFImYGWCJQIpIiUCETK\nKBFII1IiEClx77qRR2MD4lIikCJTIhAp2bQpjAUYMyaMDeiPMWNgyBDYsgW2bUsmPpGkKBGIlFQ7\nhgDC4DN1IZWiUiIQKYm7TnFv1IVUikqJQKSk2obiiNoJpKiUCERKlAikUSkRiJQMpI2g/N8pEUjR\nKBGIlKhEII1KiUCkpNrpJSJqLJaiUiIQAXbuDGMABg+G0aOrO0Y0CG3jRi1QI8WiRCBC14IyLS3x\nF6TpbsgQGDEiDErbsqV2sYkkTYlAhHcmgoGI/r1WKpMiUSIQIUwvAfHXKe5NlAii44kUgRKBCCoR\nSGNTIhCh6xu8EoE0oj4TgZldb2aHpxGMSFaiG/dAq4aif69EIEUSp0TwPHCLmf3ezP6bmQ3wO5NI\n/qhqSBpZn4nA3W919+OBTwJTgSVm9gMzOynp4ETSUutEoMZiKZJYbQRmNhj4M+BQ4E3gGeAKM7s7\nwdhEUlOrRKCqISmipr52MLN/Ak4HHgb+l7v/vvSj68zshWpOamaXAxcBDiwBLnT37dUcS2SgOjth\n8+bwesyYgR1LVUNSRHFKBM8CR7v7Z8qSQOSD/T2hmU0GLgFmuPuRwGDg3P4eR6RWOjpCMhg9Gpr6\n/GpU2ciR4RjbtsF2fbWRgoiTCC5w93cMmDezXwG4+4Yqz9sEjDSzJmAksLrK44gMWK2qhSBMTxFV\nD6mdQIqi10RgZiPMbAIw0czGlz2mApOrPaG7rwbmAa8ArwIb3P2X1R5PZKBqNYYgogZjKZpKBeHP\nApcB+wGLyrZvBm6q9oRmNg44g9ADaSPwYzM7393/tXy/uXPn7nnd2tpKa2trtacUqahWYwgiaieQ\ntLS1tdHW1jbg45j3MV+umV3i7jcO+ExdxzsH+Li7/03p/QXATHe/uGwf7ysukVr5+c/hvvvg4x+H\ns88e+PF+8AN49FE491w4SZ2sJUVmhrv3e/7cXksEZnayuz8MvGpm7/p4uPtP+nuykpXATDMbAWwD\nPgJ0b4QWSU1SVUMqEUhRVKoaOpHQZfR0QjfP7qpKBO7+ezO7F3gK2FV6vqWaY4nUQq2rhjSWQIqm\n10Tg7l8pPc+p9UndfS4wt9bHFalGLXsNlR9HjcVSFHEmnbvMzJotuM3MnjKzj6cRnEgakkoEKhFI\nUcQZR3CRu28CPgaMJ8w5dG2iUYmkxL32iUBVQ1I0cRJB1AJ9KnCnuy9NMB6RVG3fDjt2wNChMGxY\nbY7Z3BwGlkUjlkXyLk4iWGRmDwKnAP9uZs2A/rylLtRi0fruBg8O01WUz2EkkmdxZla5CDgG+JO7\nbymNNr4w2bBE0lHraqFIc3NIAhs31v7YIrXWZyJw991mtgY4rDQ3kNFzd1KRwqn1GIJISwusXq2e\nQ1IMcaahvg6YDSwDdpf96LGkghJJS63HEETUc0iKJE7V0FnAIVovQOpRUlVDSgRSJHEai/8EDE06\nEJEsJFk1BEoEUgxxSgRbgcWlNQiiUoG7+6XJhSWSjqSqhrQmgRRJnERwf+kRNRCrsVjqhqqGROL1\nGrrDzEYCU9z9DynEJJIaJQKReHMNnQE8Dfyi9P5YM7s/6cBEkrZrVxj9O2hQGABWS+XTTGhpDcm7\nOI3FcwmL1K8HcPengYMSjEkkFdGo3zFjQjKopeHDw5QVO3eGhexF8izOn//OHhap1xQTUnhJVQtF\nVD0kRREnETxnZucDTWb2PjO7EfhNwnGJJC6prqMR9RySooiTCC4BDid0Hf0hsAn42ySDEklDUl1H\nIyoRSFHE6TW0Bbiq9BCpG0mXCJQIpCgqLV7/QNlbp2tdAggDys5ILCqRFKiNQCSoVCKYV3o+C9gH\nuIuQDM4D1iQcl0jikq4aUhuBFEWlxevbAMxsnrvPKPvR/Wa2KOnARJKmEoFIEKexeKSZTYvemNlB\nwMjkQhJJh3oNiQRx5hq6HHjEzF4qvZ8KfCaxiERSUL5ovXoNSaOL02voF2Z2MPBnhEbjF9xdYyWl\n0LZuDVNMjBgRFq5PwujRYcRyR0c4V1Ocr10iGYg1sN7dt7n7Ynd/RklA6kHSpQEISWDMmPBai9hL\nntV4hhWRYki6oTii6iEpAiUCaUhRA26SJYLy46vBWPIszjTUPzGzU81MSUPqRtolAiUCybM4N/eb\ngfOBF83sWjM7ZKAnNbOxZnavmT1vZsvMbOZAjynSH0l3HY2Ur0sgkld9JgJ3f8jd/xKYDrwM/MrM\nfmNmF5rZkCrPewOw0N0PBY4Cnq/yOCJVSaOxGNRGIMUQq7rHzCYAc4C/AZ4CvgXMAB7q7wnNrAX4\nsLvfDuDuu9xdHxNJVVolAiUCKYI+ezab2f8ljCG4Ezjd3V8r/ehHVU41cSDwppnNB44GFgGXufvb\nVRxLpCpplQjUWCxFEGeIy63uvrB8g5kNc/ft3eYg6s85pwOfd/f/Z2b/DFwJ/EP5TnPnzt3zurW1\nldbW1ipOJdIzNRZLPWhra6OtrW3AxzHvY2VtM3va3Y/ttu0pd59e1QnN9gF+6+4Hlt6fAFzp7qeV\n7eN9xSVSrV274OKLYfBg+Pa3wazvf1Ot7dvh0kthyBC48cZkzyViZrh7v//KKq1HsC+wHzDCzKYT\npqB2oJkBTDrn7q+bWbuZHezuy4GPAM9VezyR/iofQ5D0jXnYsLCQ/bZtYVqLkZquUXKoUtXQx4G/\nBibTtTYBwGYGvlrZJcC/mtlQ4E/AhQM8nkhsaQ0mi7S0hESwcaMSgeRTpfUI7gDuMLNPuPuCWp7U\n3Z8BPlDLY4rElVZDcaS5GdasCQlo333TOadIf1SqGrrA3e8EpprZFeU/IixVeX3i0YkkIK2G4oga\njCXvKlUNRYXYMYS2gYh1ey9SKGmNIYhodLHkXaWqoe+VnuemFo1ICrIqESgRSF5Vqhq6scK/c3e/\nNIF4RBKXRWMxKBFIflWqGlpEqALqqYOdqoaksNIuEWh0seRdX72GROpO2r2G1FgseVepaugGd7/M\nzB7o4cfu7mckGJdIItzVWCzSXaWqoX8pPc/r4WeqGpJCevvtrkXrh1Q7iXo/aRF7ybtKVUOLSs9t\nZjaMMANpJ/CCu+9IKT6Rmkq7fQC6FrHfuDEsYj9uXHrnFokjzlKVpwIvEtYguAn4k5mdknRgIklI\nu1ooop5DkmdxCqnXAye5+4sAZjYNWFh6iBRK2l1HI0oEkmdxVijbFCWBkhWA+j9IIaXdYyiiLqSS\nZ5V6DX2i9PJJM1sI3FN6fw7wZNKBiSQhizaC8vMpEUgeVaoaOp2u3kFvACeWXr8JDE8yKJGkZJUI\n1IVU8qxSr6E5KcYhkoqsqobURiB5Fmfx+hHARcBhwAhKpQR3/1SyoYnU3oYN4TntLpxjx77z/CJ5\nEqex+E5gb2AW0AYcAHQkGJNIItxh/frwOu1EEJ0vOr9InsRJBO919/8JdLj794FTgA8mG5ZI7W3d\nCjt2hDWEh6fcytXSEgaWbdoURheL5EmcRBCNIt5oZkcCY4G9kgtJJBlZlQYgJIGWllAqUTuB5E2c\nRHCrmY0H/h64H1gG/O9EoxJJQJaJANROIPnVZ2Oxu99aevkocGCy4YgkJ7oBRzfktI0bBy+9pHYC\nyZ84cw1NNLMbzexpM3vKzG4wswlpBCdSS1mXCNRgLHkVp2roR4QBZWcD/5UwoOzuJIMSSYISgUjP\n4kw6t4+7f63s/T+a2eykAhJJStaJQG0EkldxSgQPmtl5Zjao9JgNPJh0YCK1loc2AlCJQPKn0qRz\nHXTNNfS3hIFlEJLHFuB/JBuaSG1lXSJQIpC8qjTX0Og0AxFJ0rZtYUDZ0KEwcmQ2MZTPN9TZGcYW\niORBrNVTzexM4D8RSgiPuntPC9qL5FZ5acAsmxiamsJkd5s2hUdWVVQi3cXpPnotcCnwHPA8cKmZ\nXTPQE5vZ4FKXVCUVSVzW7QMRVQ9JHsUpnJ4KfMzdb3f32wiTz51Wg3NfRhil7H3tKDJQWbcPRJQI\nJI/iJAInzC8UGcsAb95mtj9h8rr/A2RUUJdGkpdEoC6kkkdx2giuAZ4ys0cIN+0TgSsHeN5/Ar4I\npLw8iDSqvCQClQgkjyomAjMbBHQCxwEfIJQErnT316o9oZmdBrzh7k+bWWtv+82dO3fP69bWVlpb\ne91VpE9qI5B61NbWRltb24CPY+6Va3nMbJG7zxjwmbqO93XgAmAXYe3jZmCBu3+ybB/vKy6R/vja\n12DVKrj6apgyJbs4li+HefPgve+FL34xuzikPpkZ7t7v6vY4bQQPmdkXzOwAMxsfPaqIEQB3v8rd\nD3D3A4FzgYfLk4BIEvJSNaQ2AsmjOG0E5xKqhC4u2+bAQTWKQV/9JVE7dsCWLaEf/+iMh0mWVw25\nZzemQaRcnPUIpiZ1cnd/lLDOgUhiytsHsr7xDhkSklFHB2zeHAaYiWStz0RgZiOAzwEnEL69/xq4\n2d23JRybSE3kpVooMm5cSATr1ysRSD7EaSP4F+Aw4FvATcDhdE1AJ5J7eUsEaieQvInTRnC4ux9W\n9v5hM1uWVEAitZaXrqMRdSGVvIlTInjKzI6L3pjZTGBRciGJ1FbeSgRKBJI3cUoE7wf+w8zaCW0E\nU4AXzGwJ4O5+VJIBigyUEoFIZXESwazEoxBJUN4SgdoIJG/idB99OYU4RBKjNgKRyrRGktS1XbvC\nIjCDBuWnq2aUkKJBZSJZUyKQuhZ96x47Nj9LQw4fHpbL3LkzjCcQyVpOPhoiyXjjjfC8117ZxtHd\nxInh+c03s41DBJQIpM5FN9pJk7KNo7sonihRiWRJiUDqWl5LBEoEkidKBFLXohttXksEqhqSPFAi\nkLqmqiGRvikRSN3q7OxKBFHjbF5EVVVvvKEupJI9JQKpW2+9Bbt3h66jw4ZlHc07jRkTupG+/XZ4\niGRJiUDqVl6rhSAskKPqIckLJQKpW3ltKI6UVw+JZEmJQOpWXruORlQikLxQIpC6leeqIVAXUskP\nJQKpW2vWhOe8JwKVCCRrSgRSlzo7Ye3a8FpVQyKVKRFIXVq/PkxB3dKSv66jkagL6ZYt4SGSFSUC\nqUt57zEEoQtpVFpRO4FkSYlA6lJ0Y81rtVBE1UOSB0oEUpeiG+vee2cbR19UIpA8UCKQupT3MQSR\nqEQQ9XASyYISgdSlvI8hiGgsgeRB6onAzA4ws0fM7DkzW2pml6Ydg9Q3d7URiPRHFiWCncDl7n44\nMBO42MwOzSAOqVPr14eF4ZubQ/fMPGtuhqFDwyL2moVUspJ6InD31919cel1B/A8sF/acUj9KkLX\n0Uj5LKSqHpKsZNpGYGZTgWOB32UZh9SXorQPRFQ9JFnLLBGY2WjgXuCyUslApCZeey08FyURRF1c\no7hF0taUxUnNbAiwALjL3e/raZ+5c+fued3a2kpra2sqsUnxvfxyeJ4yJdMwYoviXLky2zikeNra\n2mhraxvwccxTXjDVzAz4PrDO3S/vZR9POy6pD52dcNllsGMHXH89jBqVdUR9W7cOrroKRo+Gb34z\ntBuIVMPMcPd+/wVlUTV0PPBXwElm9nTpMSuDOKQOvfpqSAJ77VWMJAAwfnyYgK6jI6yzLJK21KuG\n3P1xNJBNEhJVr7znPdnG0R9mId6lS0O11oQJWUckjUY3ZKkrUfvA1KlZRtF/UbxR/CJpUiKQuhLd\nSItUIoCueNVgLFlQIpC6sXMnrF4dqlqK0mMoEpUIVq4MU2SIpEmJQOrG6tWwezfsu2/+p5borrkZ\nxo2Dbds0E6mkT4lA6kZRq4UiaieQrCgRSN0oYo+hcmonkKwoEUjdKGqPoUh5O4FImpQIpC5s3w6v\nvw6DB8P++2cdTXWiEsErr4S2DpG0KBFIXXjllTC9xOTJMGRI1tFUZ+TIMCJ6505NQCfpUiKQulD0\n9oGIGowlC0oEUheK3j4QUSKQLCgRSOG5w0svhddFLxFE8a9YkW0c0liUCKTwVq2CtWvDDJ6TJ2cd\nzcBMnRoGw61eHX4nkTQoEUjhLVoUno89FgYV/C96yBA46qjwOvq9RJJW8I+NNDp3eOqp8HrGjGxj\nqZXo91AikLQoEUihrV4d5uYZPRoOPjjraGrj8MND9dDKlaoeknQoEUih1VO1UETVQ5K2OvnoSCNy\n77pR1ku1UGT69PAcVXuJJEmJQAqrvFrokEOyjqa2jjgChg0L4wlUPSRJUyKQwoq+LddTtVBkyBA4\n8sjwWqUCSVqdfXykUdRztVAk+r2UCCRpSgRSSK+8EmYbHTWqfnoLdXfEETB0aBg1rVXLJElKBFI4\n7nDvveH1zJlh6ul6NHQofOAD4fWCBdnGIvVNiUAKZ9EiWL48NBKfemrW0STrzDPDmIJnnoGlS7OO\nRuqVEoEUyvbtXaWBs84KVUP1rKUFTjstvL7nHti1K9t4pD4pEUih/PznsH59mKXzQx/KOpp0nHQS\n7LNPaCf41a+yjkbqkRKBFMYbb8BDD4XX555bf11Ge9PUFH5fgH/7N9iwIdt4pP40yEdJim7tWvjO\nd0LVyIc+BAcdlHVE6Tr00DDaePt2uOkmJQOprUwSgZnNMrM/mNkfzezLWcQgxbFiBVx7bVjHd7/9\n4Oyzs44oG7Nnw6RJ0N4erseqVVlHJPUi9URgZoOBm4BZwGHAeWZ2aNpxFEVbW1vWIWSmsxOeeAKu\nvx42b4YhQ9r40pfCAjSNaOxY+PKX4b3vheeea+Mb3wg9qNyzjixbjfwZqZUsSgR/Drzo7i+7+07g\nR8CZGcRRCI34R75uHTzwAFx1FcyfDzt3woc/DOPHtzFiRNbRZWv0aLj8cjBrY9s2uOUW+Pu/h4UL\nG7e6qBE/I7XWlME5JwPtZe9XAR/svtPKlanFk2sbNhTrWvT07bSzM2zv7ITdu7se27fD22/D1q3h\n93zttfDYuLHr306aBB/9aEgEX/1qer9HnjU1hfmVTjwRfvnL0H7y05+Gx7hxsO++oZdRSwuMHAkj\nRoQJ7AYPDv928GAwC4+eGtzN0v+dBqJon5E8yiIRxCrIfv3rSYdRDE8+GW6UjWToUDjmGDjhhDB9\nRNFuTGkwg5NPDl1Lly2Dxx+HJUtC19r168O2RtGIn5FaM0+5gtHMZgJz3X1W6f3fAZ3ufl3ZPg1e\n6ykiUh137/dXpywSQRPwAvAXwKvA74Hz3P35VAMREREgg6ohd99lZp8H/h0YDNymJCAikp3USwQi\nIpIvmY4sjjOwzMy+Vfr5M2Z2bNoxpqWva2Fm55euwbNm9h9mdlQWcaYh7oBDM/uAme0ys7odYhbz\nM9JqZk+b2VIza0s5xNTE+Iy0mNkDZra4dC3mZBBm4szsdjNbY2ZLKuzTv/umu2fyIFQLvQhMBYYA\ni4FDu+1zCrCw9PqDwBNZxZuDa3Ec0FJ6PauRr0XZfg8DPwM+kXXcGf5djAWeA/YvvZ+YddwZXour\ngGui6wCsA5qyjj2Ba/Fh4FhgSS8/7/d9M8sSQZyBZWcA3wdw998BY81s73TDTEWf18Ldf+vuUQ/7\n3wH7pxxjWuIOOLwEuBd4M83gUhbnWvwlsMDdVwG4e70udR/nWnQCzaXXzcA6d6+7ibvd/dfA+gq7\n9Pu+mWUi6Glg2eQY+9TjDTDOtSh3EbAw0Yiy0+e1MLPJhJvAzaVN9drQFefv4n3AeDN7xMyeNLML\nUosuXXGuxU3AYWb2KvAMcFlKseVNv++bWQwoi8T98HbvE1uPH/rYv5OZnQR8Cjg+uXAyFeda/DNw\npbu7mRnv/hupF3GuxRBgOqE79kjgt2b2hLv/MdHI0hfnWswCnnL3k8xsGvCQmR3t7psTji2P+nXf\nzDIRrAYOKHt/ACFzVdpn/9K2ehPnWlBqIL4VmOXulYqGRRbnWswAfhRyABOB/2xmO939/nRCTE2c\na9EOrHX3rcBWM3sMOBqot0QQ51rMAa4BcPc/mdlLwCHAk2kEmCP9vm9mWTX0JPA+M5tqZkOB2UD3\nD/L9wCd9c3KkAAABrUlEQVRhz4jkDe6+Jt0wU9HntTCzKcBPgL9y9xcziDEtfV4Ldz/I3Q909wMJ\n7QT/vQ6TAMT7jPwUOMHMBpvZSELjYD1OMBHnWrwCfASgVCd+CLAi1Sjzod/3zcxKBN7LwDIz+2zp\n599z94VmdoqZvQhsAS7MKt4kxbkWwD8A44CbS9+Ed7r7n2cVc1JiXouGEPMz8gcz+wXwLKGx9FZ3\nr7tEEPPv4mvAHWb2LKFq5Evu/lZmQSfEzH4InAhMNLN24CuEKsKq75saUCYi0uC0VKWISINTIhAR\naXBKBCIiDU6JQESkwSkRiIg0OCUCEZEGp0QgItLglAhERBqcEoFIDKWpDf5gZneZ2TIz+7GZjcg6\nLpFaUCIQie9g4NvufhiwCfhcxvGI1IQSgUh87e7+29Lru4ATsgxGpFaUCETiK5+Yy6jPtTGkASkR\niMQ3pTStL4QlIn+dZTAitaJEIBLfC8DFZrYMaKFrqUyRQstyhTKRotnl7vW6JrA0MJUIROJTm4DU\nJS1MIyLS4FQiEBFpcEoEIiINTolARKTBKRGIiDQ4JQIRkQanRCAi0uD+P0KN10CVhEGgAAAAAElF\nTkSuQmCC\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"fig, ax = plt.subplots(1,1)\n",
"plot_beta(100,100,ax)\n",
"handles, labels = ax.get_legend_handles_labels()\n",
"ax.legend(handles, labels)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"If we increase our symmetric shape parameters to a value of $100$, we can see a much higher density for parameters around the fair probability of $0.5$. The 95% highest density interval now lies between $0.43$ and $0.71$."
]
},
{
"cell_type": "code",
"execution_count": 6,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Interval containing 95% of the distribution: (0.47809471962068506, 0.52190528037931494)\n"
]
},
{
"data": {
"text/plain": [
""
]
},
"execution_count": 6,
"metadata": {},
"output_type": "execute_result"
},
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAYIAAAEPCAYAAABP1MOPAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAHuJJREFUeJzt3X2UHHW95/H3Z/JgEpDEBAlcBAMsIFzRGO6VeHDX0fUh\nC4oGV1lENN6sctQFBD1X1HuX4bL3IqvhgrInsmwMCLsKe6OIHlSiMAJX0JNAyBMYkQeTRYbwEEOA\nYJL57h9VPdNpZqarZ6a6urs+r3P6dHdVddU3dSb97e/vV79fKSIwM7Py6io6ADMzK5YTgZlZyTkR\nmJmVnBOBmVnJORGYmZWcE4GZWcnllggkTZH0a0lrJK2X1JMu75G0RdJ96WNBXjGYmVl9ynMcgaRp\nEfGCpInAXcC5wALguYi4LLcDm5lZZrk2DUXEC+nLycAkoJJ1lOdxzcwsu1wTgaQuSWuAPuDWiPhN\nuupsSfdLWiZpRp4xmJnZyHJtGho4iDQd+AFwNrA1fQBcDBwUEYtzD8LMzIbUlEQAIOnvgRciYknV\nsjnAjyLiuJptPQGSmdkoRETDTe95XjW0f6XZR9JU4F3AA5IOrNpsIbBuqM9HhB8RXHjhhYXH0CoP\nnwufC5+LkR+jNXHUn6zvIOBaSRNIEs4NEXGLpO9ImkvScfwIcFaOMZiZWR25JYKIWAfMG2L5x/I6\nppmZNc4ji1tcd3d30SG0DJ+LQT4Xg3wuxq5pncWNkBStGJeZWSuTRIyiszjPPgIzGwPJ4y5teOP5\nY9mJwKyFuTK2oYz3jwT3EZiZlZwTgZlZyTkRmJmVnBOBmVnJubPYzFrGmjVruP766/n6178+sOym\nm25i48aNdHV1cfDBB3PmmWeOarnjHkHRc2MMM19GmJVd2f4fLFmyJBYuXBiLFi0aWLZt27aYN2/e\nwPv58+fHU0891dDyrVu3DnvMe++9N1asWBErVqyIr33ta20T93B/G+nyhr9zXRGYWUs4//zzmTVr\nFr29vQPL7rjjDo499tiB92984xu57bbbmDJlSublt99+Ox/60Idedrw1a9awbds2Tj31VADe8Y53\n8IUvfKHl486DE4FZGzprHKdqvOqq8dtXtYcffpirr7562PXz58/n/e9//17LombcxJYtW5gxY/De\nVTNmzOB3v/sdM2fObGj5UDZs2MAZZ5wBwOrVqznuuMHZ8BuNvZlx58GJwCyDtWvh7rsH30+aBCef\nDLNnFxdT0R5//HGWL1/O3LlzueOOO/jMZz7DrFmz2LFjBwceeCCHH344l1xySUP7rB0otW3bNqZM\nmTLwfvLkyezYsQNJDS2vtXnzZg499FDWrVvHNddcw6ZNm7iqKiM2Gnuz4s6LE4FZBj/8IWzZsvey\n6dPhgx8sJp68fsVn9fzzz7Nw4UJuueUWZs2axQEHHMD555/PGWecwXvf+95R77f2l/UrX/lKnn76\n6YH3L774IrNnz2bKlCkNLa91zz33sHDhQiZOnMiSJUtYunQpy5cv5ytf+UpLx50XJwKzDF56KXn+\nyEdg82a4887BZWV0ww03cPzxxzNr1iwAXv3qV7NuXXKPqcmTJwOjaxqq/WV9xBFHsGrVqoH3Tz/9\nNPPmzWPGjBmZlj/11FPMm/ey2fDZuXMnEycOfv1t3LiRo446auB9o7E3K+7cjKaHOe8HJbtawlrf\nF78Y8alPRTzzTMRddyWvr7km32O28v+Db33rW7FkyZKB9+vXr4+jjz56zPtdvnz5Xlff7NixI17/\n+tcPvH/DG94QfX19DS+PiNi0aVP09/dHf39/fPKTnxzYZuvWrXH88cfH9u3bWzLuoQz3t8Eorxry\nNNRmGXz+87BjByxZAhs3wrJl8OY3w+LF+R0znVI4vwOMwfbt27n00ks58cQT2bVrF/vssw/Lli3j\n3e9+N6eddhrTpk1reJ9XXnklN954I5s3b2bRokWcd9557Lffflx33XU89thj9Pf3c8QRRwx08Da6\n/JhjjuGKK67ggAMOYPPmzWzbto199tmHtWvXsnjxYg455JBRnYu84x7KcH8bo52G2onALINzz4Wd\nO+GKK5JEcNVVMG/e+F69U6uVE0E72rNnD7/85S/p6+vj9NNPLzqcMRnvROApJswy2LUreZ40KXlU\nL7P2sGLFCubPn09Xl7/2avmMmNXR3w979oAEXV1Q6WN0ImgvJ510EtOmTeO0004rOpSW40RgVsfu\n3cnzpElJMqhUBJXl1h723XffokNoWU4EZnVUfvlXKgFXBNZpnAjM6qiuCKqfXRFYp8gtEUiaIunX\nktZIWi+pJ10+U9JKSZsk3SppRp1dmRWquqO4+tkVgXWK3BJBROwE3h4Rc4G5wAJJJwAXACsj4ijg\nF+l7s5ZV+eVf2zTkisA6Ra5NQxHxQvpyMjAJCOAU4Np0+bXAB/KMwWysXBFYp8t1riFJXcC9wBHA\nlRHxG0mzI6Iv3aQPKPH8jdYOiuwsrp3DxiwPuSaCiOgH5kqaDvxA0utr1oekIYdO9vT0DLzu7u6m\nu7s7x0jNhldUZ7FHFVs9vb29e90QZ7SaMvtoRPxJ0u3Ae4A+SQdGxBOSDgKeHOoz1YnArEi1FcGE\nCcnz7t0QkYwtMCtC7Y/kiy66aFT7yfOqof0rVwRJmgq8C3gAuBn4eLrZx4Gb8orBbDzUVgQeVGad\nJs+K4CDgWkkTSBLODRFxi6R7gBslLQYeBT6cYwxmY1Z71VDl9a5dyaOSFMzaVW6JICLWAS+7s0JE\nPAO8M6/jmo232qYhSL78X3zRFYF1Bo8sNqujtmkIPM2EdRYnArM6hqsIwBWBdQYnArM6XBFYp3Mi\nMKvDFYF1OicCszpcEVincyIwq8MVgXU6JwKzOlwRWKdzIjCrwxWBdTonArM6RqoInAisEzgRmNUx\nVEXgpiHrJE4EZnUMVRG4acg6iROBWR21dyirfu2KwDqBE4FZHW4ask7nRGBWh5uGrNM5EZjV4YrA\nOp0TgVkdrgis0zkRmNXhisA6nROBWR2uCKzTORGY1eGKwDqdE4FZHa4IrNM5EZjV4QFl1umcCMxG\n0N+fPLq6kkeFm4askzgRmI1gqP4BcNOQdZbcEoGkQyTdLmmDpPWSzkmX90jaIum+9LEgrxjMxmqo\n/gFwRWCdZWL9TUZtF3BeRKyRtC+wWtJKIIDLIuKyHI9tNi5cEVgZ5JYIIuIJ4In09Q5JDwAHp6uV\n13HNxpMrAiuDpvQRSJoDvAm4J110tqT7JS2TNKMZMZiNhisCK4M8m4YASJuF/gU4N60MlgL/kK6+\nGFgCLK79XE9Pz8Dr7u5uuru78w7V7GVcEVgr6+3tpbe3d8z7UUSMPZrhdi5NAn4M/CQiLh9i/Rzg\nRxFxXM3yyDMus6wefhguvRQOOwwuuGBw+c6dcO65MGUKXHFFcfGZVZNERDTc9J7nVUMClgEbq5OA\npIOqNlsIrMsrBrOxckVgZVC3aUjSZcCyiNjQ4L5PBD4KrJV0X7rsy8DpkuaSXD30CHBWg/s1a5rh\n+ggmTEie9+yBCJAvf7A2lqWP4AHgf6bNPN8GvhsRf6r3oYi4i6Erjp80FqJZcYarCKRk2a5dyTa1\n683aSd2moYi4OiJOBD4GzAHWSfo/kt6ed3BmRRuuIqhe5uYha3eZ+ggkTQBeBxwDbAXuB86XdEOO\nsZkVbriKoHqZLyG1dpelj+CfgfcBtwH/GBG/SVddKum3eQZnVjRXBFYGWfoI1gJ/FxHPD7HuhHGO\nx6yluCKwMsjSNHRmbRKQ9AuAiNiWS1RmLcIVgZXBsBWBpKnANGB/STOrVu3H4JxBZh3NFYGVwUhN\nQ2cB5wJ/AayuWv4ccGWeQZm1ClcEVgbDJoJ0NPDlks6OiG82MSazljHUbSorfLtK6xQjNQ29IyJu\nAx6XdGrt+oj4fq6RmbUANw1ZGYzUNPQ2kktG30cyHUQtJwLreG4asjIYqWnowvR5UdOiMWsxrgis\nDOpePirpXEn7KbFM0r2S3tOM4MyK5orAyiDLOILFEbEdeDcwk2TOoa/mGpVZi3BFYGWQJRFUJtg9\nGbguItbnGI9ZS3FFYGWQJRGslnQrcBLwM0n7Af35hmXWGlwRWBlkmWtoMTAX+H1EPC9pFvCJfMMy\naw2uCKwM6iaCiNgjqQ84VtJEkqYi31DYSiFLReBEYO0uyzTUlwKnARuBPVWr7sgrKLNWkaUicNOQ\ntbssTUMLgaMj4qW8gzFrNa4IrAyydBb/HpicdyBmrWikisCdxdYpslQELwJr0nsQVKqCiIhz8gvL\nrDWMVBG4s9g6RZZEcHP6qHQQu7PYSsN9BFYGWa4aukbSNODQiHiwCTGZtYQIjyOwcsgy19ApwH3A\nT9P3b5J0c4bPHSLpdkkbJK2XdE66fKaklZI2SbpV0oyx/iPM8tDfnzy6upJHLTcNWafI0lncQ3KT\n+mcBIuI+4PAMn9sFnBcRfwnMBz4r6RjgAmBlRBwF/CJ9b9ZyKr/0h2oWAlcE1jmyJIJdQ9ykvu4U\nExHxRESsSV/vAB4gudfxKcC16WbXAh/IHq5Z84x0dzJwRWCdI0tn8QZJZwATJR0JnAP8qpGDSJoD\nvAn4NTA7IvrSVX3A7Eb2ZdYsrgisLLIkgrOBr5BcOvpd4GfAxVkPIGlfYAVwbkQ8J2lgXUSEpCGv\nQOrp6Rl43d3dTXd3d9ZDmo0LVwTW6np7e+nt7R3zfhSR35WgkiYBPwZ+EhGXp8seBLoj4glJBwG3\nR8Traj4XecZllsUf/wg9PXDQQclzrWefhQsugFe9Cr7qO3RYC5BERKj+lnsb6eb1P6p6GwzelwCS\nH/On1AlIwDJgYyUJpG4GPg5cmj7f1GjQZs0w0hiC6uWuCKzdjdQ0tCR9XggcCFxPkgxOJ2nbr+dE\n4KPAWkn3pcu+RHJ3sxslLQYeBT7ceNhm+RtpDEH1cvcRWLsb6eb1vQCSlkTE8VWrbpa0ut6OI+Iu\nhr8q6Z2NBGlWBFcEVhZZLh+dJumIyhtJhwPT8gvJrDXU6yyeMAEk2LMnGXhm1q6yXDV0HnC7pEfS\n93OAT+UWkVmLqHf5qJSs27Ur2Xay5+i1NpVlrqGfSjoKeB1Jp/FvI2Jn7pGZFaxeRVBZt2tX8nAi\nsHaVpSIg/eJfk3MsZi2lXkVQvc4dxtbOsvQRmJVS1oqgeluzduREYDYMVwRWFlmmof6+pJMlOWlY\nqbgisLLI8uW+FDgDeEjSVyUdnXNMZi2h3oCy6nWuCKyd1U0EEbEyIj4CzCMZCfwLSb+S9Il0LiGz\njlRvQFn1OlcE1s4yNfdImgUsAv4zcC/wDeB4YGVukZkVrJGKwInA2lndy0cl/YBkDMF1wPsi4o/p\nqu9lmWrCrF01UhG4acjaWZZxBFdHxC3VCyS9IiJeqpmDyKyjuI/AyiJL09A/DrHs7vEOxKzVuI/A\nymKk+xEcBPwFMFXSPJIpqAPYD086ZyXgisDKYqSmofeQ3DjmYAbvTQDwHPDlPIMyawWNDChzRWDt\nbKT7EVwDXCPpgxGxonkhmbWGLE1DrgisE4zUNHRmRFwHzJF0fvUqkltVXpZ7dGYFytI05IrAOsFI\nTUOVfoBXkvQNVKjmvVlHckVgZTFS09BV6XNP06IxayFZ5hpyRWCdYKSmoW+O8LmIiHNyiMesZWTp\nLHZFYJ1gpKah1SRNQBpinZuGrOO5IrCyqHfVkFlpuSKwshipaeiKiDhX0o+GWB0RcUqOcZkVzhWB\nlcVITUPfSZ+XDLEuU9OQpG8DJwNPRsRx6bIekllMt6abfSkifpopWrMm8h3KrCxGahpanT73SnoF\nyQyk/cBvI+LPGfe/HPgmg0kFkiRymcchWCuL8B3KrDyy3KryZOAhknsQXAn8XtJJWXYeEXcCzw61\n20aCNGu2/v4kGXR1JY/huCKwTpBl9tHLgLdHxNsi4m1AN/DPYzzu2ZLul7RM0owx7sts3GWpBqrX\nuyKwdpblfgTbI+KhqvcPA9vHcMylwD+kry8m6YNYXLtRT0/PwOvu7m66u7vHcEizxjgRWDvo7e2l\nt7d3zPsZ6aqhD6YvV0m6Bbgxff8hYNVoDxgRT1Yd438BQ12VtFciMGu2LB3F1evdNGRFqP2RfNFF\nF41qPyP9mb+PwauDngTelr7eCkwZ1dFI7nNQdbvLhcC60e7LLC+uCKxMRrpqaNFYdy7puyQJZH9J\nm4ELgW5Jc0mSzCPAWWM9jtl4c0VgZZLl5vVTSdrwjwWmklYJEfE39T4bEacPsfjbDcZo1nRZZh4F\nVwTWGbJcNXQdMBtYAPQChwA7cozJrHB/TkfKvOIVI283efLe25u1oyyJ4N9ExN8DOyLiWuAk4IR8\nwzIr1ksvJc/1EsGkSSAlFUF/f/5xmeUhSyKo/Nb5k6TjgBnAq/MLyax4WROBNLhN5TNm7SZLIrha\n0kzg74CbgY3Af881KrOCZW0aqt7GicDaVd3O4oi4On35S+CwfMMxaw07dybPTgRWBlnmGtpf0jcl\n3SfpXklXSJrVjODMipK1aah6GycCa1dZmoa+RzKg7FTgP5IMKLshz6DMiuZEYGWSZa6hAyPi4qr3\n/03SaXkFZNYKGkkEU6bs/RmzdpOlIrhV0umSutLHacCteQdmVqRGEkFlLIETgbWrkSad28HgXEOf\nIxlYBknyeB74fL6hmRXHTUNWJiPNNbRvMwMxayVOBFYmWfoIkPR+4N+RVAi/jIghp4426xTuI7Ay\nyXL56FeBc4ANwAPAOZIuyTswsyJVvtSnZJhwvZIsKmMPzNpNlorgZGBuROwBkHQNsAb4Uo5xmRXK\nA8qsTLJcNRQk8wtVzGCwE9msI7mPwMokS0VwCXCvpNsBkdxo5oJcozIrmOcasjIZMRFI6gL6gbcA\nf01SCVxQdatJs47kpiErkxETQUT0S/rbiLgB+GGTYjIr1O7dsGcPTJiQPOpxIrB2l6WPYKWkL0g6\nRNLMyiP3yMwKUt0/INXf3onA2l2WPoL/RNIk9NmqZQEcnktEZgVrpKO4ejsnAmtXWe5HMKcJcZi1\njEYTgQeUWburmwgkTQU+A7yVpBK4E1gaER4+Yx2p0URQmXTOA8qsXWVpGvoOsB34Bsnlox8hmYDu\nQznGZVaY0TYN/fnPEJGtX8GslWRJBH8ZEcdWvb9N0sYsO5f0bZKRyU9GxHHpspkkN7Z5LfAo8OGI\n2NZQ1GY5ajQRTJyYXF20Z0/ymJhpBi+z1pHlqqF7Jb2l8kbSfGB1xv0vBxbULLsAWBkRRwG/wIPT\nrMU0mgjA/QTW3rIkgr8C/lXSY5IeBX4F/JWkdZLWjvTBiLgTeLZm8SnAtenra4EPNBayWb4amXCu\nwhPPWTvLUsTW/qIfq9kR0Ze+7gNmj/P+zcakkVHFFb6E1NpZlstHH83r4BERkoacwK6np2fgdXd3\nN93d3XmFYbaXypd55WqgLJwIrAi9vb309vaOeT9FdGv1STowIp6QdBDw5FAbVScCs2aqTDg3mqYh\nJwJrptofyRdddNGo9pOlj2C83Qx8PH39ceCmAmIwG5abhqxsck0Ekr5L0rl8tKTNkj4BfBV4l6RN\nwDvS92YtYzRXDTkRWDvLtWkoIk4fZtU78zyu2Vg4EVjZFNE0ZNbSnAisbJwIzGo4EVjZOBGY1XAi\nsLJxIjCr4URgZeNEYFbDcw1Z2TgRmNUYy1xDTgTWjpwIzKpEjG2KCU86Z+3IicCsSuXmMpMnQ1cD\n/ztcEVg7cyIwqzKaagCcCKy9ORGYVRnNhHPgRGDtzYnArMpoJpyr3t6JwNqRE4FZldFcOlq9vROB\ntSMnArMqo00ElT6Fl15KOpvN2okTgVmV0SaCrq7BZFDpZzBrF04EZlVGmwiqP+PmIWs3TgRmVZwI\nrIycCMyqOBFYGTkRmFUZSyLwxHPWrpwIzKqMZsK5Cs83ZO3KicCsymgHlFV/xhWBtRsnArMqo51r\nqPozTgTWbpwIzKpUxgCMpY/A4wis3TgRmFVxH4GV0cSiDizpUWA7sAfYFRFvLioWswr3EVgZFZYI\ngAC6I+KZAmMw24vHEVgZFd00pIKPb7YXJwIroyITQQA/l7RK0icLjMNsgBOBlVGRTUMnRsQfJb0a\nWCnpwYi4s7Kyp6dnYMPu7m66u7ubH6GVjhOBtZPe3l56e3vHvB9FC0yeLulCYEdELEnfRyvEZeXS\n3w+f/jRIsHRp8tyIBx6Ayy+H170OzjsvnxjNRiKJiGi4yb2QpiFJ0yS9Mn29D/BuYF0RsZhVVFcD\njSaByueq92PWLopqGpoN/EDJ/7aJwP+OiFsLisUMGFuzEHjSOWtfhSSCiHgEmFvEsc2GM5bBZOAB\nZda+ir581KxljGUwWfXnXBFYu3EiMEuNZcI5cCKw9uVEYJaqTBY32qahiROTm9jv3g179oxfXGZ5\ncyIwS421s1hyVWDtyYnALDXWPoLqzzoRWDtxIjBLjbUiqP6sE4G1EycCs5QTgZWVE4FZyonAysqJ\nwCw1nonAg8qsnTgRmKW2bk2ep08f/T5mzEien3pq7PGYNYsTgRkQAY8+mryeM2f0+3nta5Pnyr7M\n2oETgRnwzDPw3HOw774wa9bo91NJIk4E1k6cCMzYuxoYzRTUFQcfDJMmQV8fvPDCeERmlj8nAjMG\nE0GlaWe0JkyA17wmef3YY2Pbl1mzOBGYMT79AxWHHbb3Ps1anROBlV5/P/zhD8nr8UgE7jC2duNE\nYKXX15dc9z9zJuy339j3V6kI3DRk7cKJwEpvPJuFAA44AKZOhWefhW3bxmefZnlyIrDSG+9EIA02\nD7kqsHbgRGClN96JoHpfjzwyfvs0y4sTgZXa7t2wefPev+LHQyURuCKwduBEYKW2ZUtyW8kDDxz9\nLSqHUj3COGL89muWh0ISgaQFkh6U9DtJXywiBjPIp1kIksnnpk9PRhdXJrMza1VNTwSSJgBXAguA\nY4HTJR3T7DjaRW9vb9EhtIw8zsV4jSiuJeU775D/Lgb5XIxdERXBm4GHIuLRiNgFfA94fwFxtAX/\nkQ8a73PxxBOwaVPyunLt/3iqJILVq+H558d33/67GORzMXYTCzjmwcDmqvdbgBNqN3InW2LbNp+L\nirGci4hkBPGePckso3fdBRs2JOumTh2cH2g8HXlk8rxmDWzcCCecAPPmweTJ0NWVzEs0Wv67GORz\nMXZFJIJMXWf/9E95h9EeVq2CF18sOorWMN7nYvLk5Mv5Xe+CiTn8TzjySPjc5+DnP4f16+HOO5PH\nePDfxSCfi7FTNPmSBknzgZ6IWJC+/xLQHxGXVm3j6yzMzEYhIhqeSL2IRDAR+C3w74HHgd8Ap0fE\nA00NxMzMgAKahiJit6T/AvwMmAAscxIwMytO0ysCMzNrLYWOLM4ysEzSN9L190t6U7NjbJZ650LS\nGek5WCvpXyW9oYg4myHrgENJfy1pt6RTmxlfM2X8P9It6T5J6yX1NjnEpsnwf2S6pB9JWpOei0UF\nhJk7Sd+W1Cdp3QjbNPa9GRGFPEiahR4C5gCTgDXAMTXbnATckr4+AbinqHhb4Fy8BZievl5Q5nNR\ntd1twI+BDxYdd4F/FzOADcBr0vf7Fx13gefiy8AllfMAPA1MLDr2HM7FvwXeBKwbZn3D35tFVgRZ\nBpadAlwLEBG/BmZImt3cMJui7rmIiLsj4k/p218DOVz53hKyDjg8G/gXoJMncMhyLj4CrIiILQAR\n8VSTY2yWLOeiH6jcWmg/4OmI2N3EGJsiIu4Enh1hk4a/N4tMBEMNLDs4wzad+AWY5VxUWwzckmtE\nxal7LiQdTPIlsDRd1KkdXVn+Lo4EZkq6XdIqSWc2LbrmynIurgSOlfQ4cD9wbpNiazUNf28WMaCs\nIut/3tprYjvxP33mf5OktwN/A5yYXziFynIuLgcuiIiQJF7+N9IpspyLScA8ksuxpwF3S7onIn6X\na2TNl+VcLADujYi3SzoCWCnpjRHxXM6xtaKGvjeLTAT/Dzik6v0hJJlrpG1eky7rNFnOBWkH8dXA\ngogYqTRsZ1nOxfHA95IcwP7Af5C0KyJubk6ITZPlXGwGnoqIF4EXJd0BvBHotESQ5VwsAi4BiIjf\nS3oEOBpY1YwAW0jD35tFNg2tAo6UNEfSZOA0oPY/8s3Ax2BgRPK2iOhrbphNUfdcSDoU+D7w0Yh4\nqIAYm6XuuYiIwyPisIg4jKSf4NMdmAQg2/+RHwJvlTRB0jSSzsGNTY6zGbKciz8A7wRI28SPBh5u\napStoeHvzcIqghhmYJmks9L1V0XELZJOkvQQ8DzwiaLizVOWcwH8V+BVwNL0l/CuiHhzUTHnJeO5\nKIWM/0celPRTYC1JZ+nVEdFxiSDj38XFwDWS1pI0jfxtRDxTWNA5kfRd4G3A/pI2AxeSNBGO+nvT\nA8rMzErOt6o0Mys5JwIzs5JzIjAzKzknAjOzknMiMDMrOScCM7OScyIwMys5JwIzs5JzIjDLIJ3a\n4EFJ10vaKOn/SppadFxm48GJwCy7o4D/ERHHAtuBzxQcj9m4cCIwy25zRNydvr4eeGuRwZiNFycC\ns+yqJ+YSnXlvDCshJwKz7A5Np/WF5BaRdxYZjNl4cSIwy+63wGclbQSmM3irTLO2VuQdyszaze6I\n6NR7AluJuSIwy859AtaRfGMaM7OSc0VgZlZyTgRmZiXnRGBmVnJOBGZmJedEYGZWck4EZmYl9/8B\nou0vxNb43u8AAAAASUVORK5CYII=\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"fig, ax = plt.subplots(1,1)\n",
"plot_beta(1000,1000,ax)\n",
"handles, labels = ax.get_legend_handles_labels()\n",
"ax.legend(handles, labels)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"By further increasing the pseudo counts, we can further increase our \"fair\" coin belief.\n",
"\n",
"Next, let us also shortly consider non-symmetric shape parameters (but let us still follow the pseudo count interpretation ant thus, only use parameters larger than one)."
]
},
{
"cell_type": "code",
"execution_count": 7,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Interval containing 95% of the distribution: (0.69150289218123928, 0.99747142145553824)\n"
]
},
{
"data": {
"text/plain": [
""
]
},
"execution_count": 7,
"metadata": {},
"output_type": "execute_result"
},
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAYIAAAEPCAYAAABP1MOPAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3XmUVPWZ//H30+yLgEIU2WRHICiKUYgG2yWJwe1AFmMY\no4lZ5hcnOvrzl2QmmQlzMoP6h44mzjiGMWp0Eo2aGOMhjkZpwbiFHdkXZQeBCEiz2NDP749vFd00\nvdzurlv3VtXndc49t25V9b0Pl+566rubuyMiIqWrLOkAREQkWUoEIiIlTolARKTEKRGIiJQ4JQIR\nkRKnRCAiUuJiSwRm9gsz225mS2o9d5KZvWRmq8zsRTPrEdf1RUQkmjhLBA8Dl9V57gfAS+4+HHg5\ncywiIgmyOAeUmdlA4A/uPiZzvAK40N23m1lvoMLdT48tABERaVK+2whOcfftmcfbgVPyfH0REakj\nscZiD0URzW8hIpKwtnm+3nYz6+3u28zsVOD9+t5kZkoQIiIt4O7W3J/Jd4ngOeD6zOPrgWcbeqO7\na3Pnxz/+ceIxpGXTvdC90L2of/vjH51vfavl35/j7D76a+B1YISZbTSzrwF3Ap82s1XAxZljERFp\nhc2bW/fzsVUNufu1Dbx0aVzXFBEpRa1NBBpZnHLl5eVJh5Aauhc1dC9qlPq9OHIEtm1r3TliHUfQ\nUmbmaYxLRCRttmyBf/kX6NULpk83vAWNxfnuNSQiKWfW7M8RSUD2y/KWLeG4b9+Wn0uJQESOoxJ5\nutVO1tn2gT59Wn4+tRGIiBSwXJQIlAhERApYtkSgRCAiUoIOHYIdO6BNGzj55JafR4lARKRAbd0a\n9r17Q9tWtPgqEYhIyVu4cCG33377Mc89++yzTJ8+nTvvvJPHHnsssTgak4uGYlCvIREpcffccw+v\nvfYa3bt3P/rcnj17+MlPfsK8efMAmDBhAp/73Ofo1atXvedYsGAB7777LgDr1q1r1od5Y3E0JRcN\nxaASgYiUuNtuu42rr776mOdmz57NqFGjjh6feeaZzJo1q96fX7hwIbt372bKlClMmTKFmTNn5iyO\npqhEICJ59+1v5+5cDz6Yu3PVtm7dOmbMmNHg6+PHjz/uA7fuuIlNmzbRo0fNkuo9evRg9erV9Z5v\n6dKlTJ06FYB58+YxZsyYFsfS3PEbuSoRKBGISEHZsmULDz/8MGPHjmX27Nl85zvfoWfPnuzbt4/e\nvXszePBg7rjjjmads+5o6t27d9OxY8ejx+3bt2ffvn3H/dzGjRsZMGAAS5Ys4ZFHHmHVqlU8WCvD\nNTeW5ozq3rcP9uyBDh2gZ8/IP1YvJQIRiSyub/FRVVZWMnnyZGbOnEnPnj05+eSTue2225g6dSpX\nXHFFi89b95v4CSecwK5du44eHzhwgFNOOX5l3TfffJPJkyfTtm1b7r77bh544AEefvhhfvjDH+Yk\njsZkSwN9+kBrZwVRIhCRgvHkk08ybtw4ema+An/sYx9jyZIlQPjWDi2rGqr7TXzIkCHMnTv36PHO\nnTs5++yzjzvXwYMHaVur3+ayZcsYPnz40ePmxtKcEkEuBpJlKRGISMGoqqpi6NChR48rKyspKytj\nypQpR59rSdVQ3W/iEydO5Hvf+97R4/nz53PXXXcBsHr16qMxzJkzh+uuuw4IyeKNN95g+vTpLY6l\nOSWCTZvCPheJQNNQi8gxzCy1k87t3buXu+66i/PPP5+qqiq6dOnCQw89xGc+8xmuueYaOnfu3Oxz\n3n///fzmN79h48aN3HDDDdx6661069aNxx57jPXr11NdXc2QIUOONgiPHDmS++67j5NPPpmNGzey\ne/duunTpwuLFi7nxxhvp379/i/5tDcVRHzNj+nTnvffg9tth2LCa51syDbUSgYgcI82JIA2OHDnC\nq6++yvbt27n22oYWYoyXmXHTTU5VFdx7L3TqVPN8SxKBxhGIiDTDM888w/jx4ykrS/bjs6oqLEaT\nTQKtoUQgItIMkyZNonPnzlxzzTVJh0ILa6GOo0QgItIMXbt2TTqEo5QIRERKnBKBiEiJUyIQESlh\nXbpAremQWkWJQESkAPXv3/qpJbKUCEREClCuqoVAU0yISD2aM+eNJKNfv9ydS4lARI6hUcXp9qMf\nhQXrBwzI3TlVNSQiUiAOHAhJoF07qGdW7BZTIhARKRDZGUf79IE2bXJ3XiUCEZECsXFj2OeyoRiU\nCERECkY2EeSyoRiUCERECka2akglAhGRElRVFZanNFOJQESkJG3eDEeOQO/e0LFjbs+tRCAiUgDW\nrw/7007L/bkTSQRmdquZvWNmS8zsV2bWIYk4REQKxXvvhf3Agbk/d94TgZn1Bb4LjHP3MUAb4Mv5\njkNEpJDEWSJIaoqJtkBnMzsCdAY2JxSHiEjqHToEW7dCWVnuG4ohgRKBu28G7gY2AFuA3e7+p3zH\nISJSKDZtgupq6NsX2rfP/fnzXiIwsxOBq4CBwB7gKTOb6u7/U/t906ZNO/q4vLyc8vLy/AUpIpIi\n2faButVCFRUVVFRUtPr8lu+ZBs3si8Bn3f0bmePrgPHuflOt97hmQBQRCX7xC3jrLZg6FSZObPh9\nZoa7N3sO8SR6Da0HxptZJwuTnl8KLEsgDhGRghBnQzEk00bwNvA0MB9YnHn65/mOQ0SkEBw4ANu2\nQdu2oY0gDon0GnL3acC0JK4tIlJINmwI+379QjKIg0YWi4ikWNzVQqBEICKSag31GMolJQIRkRTL\nlgjimFoiS4lARCSlKith584wiOzUU+O7jhKBiEhKZauF+vcP00vERYlARCSl1q0L+8GD472OEoGI\nSEopEYiIlDB3ePfd8FiJQESkBG3dGkYVn3QS9OgR77WUCEREUihbLTRoUPzXUiIQEUmhfLUPgBKB\niEgq5at9AJQIRERSZ/9+2LIlTDI3YED811MiEBFJmWxp4LTT4ptxtDYlAhGRlMln+wAoEYiIpI4S\ngYhICcvnQLKsJhOBmd1jZqPzEYyISKnbti1/A8myopQIlgM/N7O3zexvzax73EGJiJSqfFcLQYRE\n4O4z3P184KvAQGCJmf3KzC6KOzgRkVKTykQAYGZtgNOBkcAOYBFwm5k9GWNsIiIlZ/XqsB8yJH/X\nbLKHqpn9O3Al8Arwb+7+dualu8xsZZzBiYiUkr17Yft26NAhPwPJsqIMVVgM/MjdK+t57bwcxyMi\nUrJqlwbiXJGsriiXuq5uEjCzlwHcfXcsUYmIlKBsIhg2LL/XbbBEYGadgM5ALzM7qdZL3YC+cQcm\nIlJqUpcIgG8DtwB9gHm1nv8QuD/OoERESk1lJWzeDO3awcCB+b12g4nA3e8F7jWz77r7z/IYk4hI\nyVm7NowqHjQoJIN8aqxq6GJ3fwXYYmZT6r7u7r+NNTIRkRKSrRYaOjT/126sauhCQpfRKwGv53Ul\nAhGRHEmqfQAarxr6cWZ/Q96iEREpQYcOwYYNoctoPkcUZ0WZdO4WM+tmwUNmNt/MPpuP4ERESsG6\ndXDkSBhE1rFj/q8fZRzBje6+F/gMcBJhzqE7Y41KRKSEJFktBNESgWX2lwOPufs7McYjIlJyCiER\nzDOzF4FJwP+aWTegOt6wRERKQ1VVzUI0SfQYgmhzDd0IjAXWunulmfUEvhZvWCIipWHdupAM+veH\nLl2SiaHJRODuR8xsOzDKzNoSqorq604amZn1AP4bGJ0519fd/c3WnFNEpBAtXx72p5+eXAxRpqG+\nC7gGWAYcqfXS7FZc9z5gprt/IZNcEsqDIiLJWrEi7FOdCIDJwAh3P5SLC2aWuvyUu18P4O6HgT25\nOLeISCHZvx/Wr4c2bZJrKIZojcVrgfY5vOYgYIeZPZwZkzDDzDrn8PwiIgVh9Wqorg7zC3XokFwc\nUUoEB4CFmTUIsqUCd/ebW3HNs4G/c/e/mNm9wA+Af27h+UREClK2WmjkyGTjiJIInsts2Qbi1jYW\nbwI2uftfMsdPExLBMaZNm3b0cXl5OeXl5a24pIhI+rS2obiiooKKiopWx2HuTX+mZ6puBrj7ilZf\nMZxvNvANd19lZtOATu7+/Vqve5S4REQK1e7d8P3vhyqhe+6BtlG+ljfBzHB3a/qdx4oy19BVwALg\nhczxWWb2XPNDPMZ3gf8xs0XAGcD0Vp5PRKSgrFwZ9sOH5yYJtEaUy08jLFI/C8DdF5hZq+bHc/dF\nwCdacw4RkUKWhvEDWVF6DVXVs0i9ppgQEWkh93SMH8iKUiJYamZTgbZmNgy4GXg93rBERIrX++/D\nBx/ACSdA375JRxOtRPBdwlQQh4BfA3uBv48zKBGRYpatFhoxAqzZTbu5F2WuoUrgHzObiIi00juZ\nyfxHj042jqzGFq//Q61Dp2ZdAggDyq6KLSoRkSJVVVXTYyj1iQC4O7OfDPQGHickg2uB7THHJSJS\nlFatgo8+CstSdu+edDRBY4vXVwCY2d3uPq7WS8+Z2by4AxMRKUZLl4Z9WkoDEK2xuLOZDckeZMYQ\naJI4EZEWyLYPjBmTbBy1Rek+eiswy8wyi6kxEPhWbBGJiBSpHTtg+3bo3DnMOJoWUXoNvWBmw4HT\nCY3GK939YOyRiYgUmWxpYNQoKItSH5MnkWa4yHzwL4w5FhGRopZNBB//eLJx1JWinCQiUrzS2G00\nS4lARCQPVq4MyeC006Bbt6SjOVaUaah/a2aXm5mShohIC2W7jaatWgiilQgeAKYCa8zsTjMbEXNM\nIiJFxR0WLw6PCzIRuPtL7v4VwjrD7wEvm9nrZvY1M2sXd4AiIoVu82bYuTNUCQ0cmHQ0x4tU3WNm\nPYEbgG8A84GfAuOAl2KLTESkSCxaFPZnnpmubqNZTXYfNbPfEcYQPAZc6e5bMy89oakmRESatjDT\n+X7s2GTjaEiUcQQz3H1m7SfMrIO7H6ozB5GIiNSxaxds2AAdO4b1B9IoSiHl3+p57o1cByIiUoyy\n1UKjR0O7lLaqNrYewalAH6CTmZ1NmILagW5o0jkRkUjSXi0EjVcNfRa4HuhLzdoEAB+i1cpERJpU\nWQmrV0ObNumabbSuxtYjeAR4xMw+7+7P5C8kEZHisHgxVFeHSeY6dUo6moY1VjV0nbs/Bgw0s9tq\nv0RYqvKe2KMTESlghVAtBI1XDWXbAU4gtA1kWZ1jERGp46OPYNmy8PjMM5ONpSmNVQ09mNlPy1s0\nIiJF4p13QjIYNAh69Eg6msY1VjX0s0Z+zt395hjiEREpCnPnhv055yQbRxSNVQ3NI1QBWT2vqWpI\nRKQBBw/CkiXh8bgCGHbbVK8hERFppsWLQ7XQ0KFw4olJR9O0xqqG7nP3W8zsD/W87O5+VYxxiYgU\nrEKqFoLGq4Z+mdnfXc9rqhoSEanH/v2hobisrDCqhaDxqqF5mX2FmXUgzEBaDax094/yFJ+ISEFZ\ntAiOHIHTT0/fkpQNiTIN9eXAfwHrMk8NNrNv152RVERE4C9/CftPfCLZOJojyjTU9wAXufsaADMb\nAszMbCIikvHhh7B8eZhb6Kyzko4muijTUO/NJoGMdcDemOIRESlYCxaEuYVGjoQuXZKOJrrGeg19\nPvNwrpnNBH6TOf4iMDfuwERECs1bb4V9IVULQeNVQ1dS0zvofeDCzOMdQMfWXtjM2hASyiZ3v7K1\n5xMRSdL778OaNdChQ2FVC0HjvYZuiPnatwDLCJPaiYgUtDffDPtx40IyKCRReg11Am4ERgGdyJQS\n3P3rLb2omfUDJhGWwbytibeLiKSaO7yRWcB3woRkY2mJKI3FjwGnAJcBFUB/YF8rr/vvwP8jjEsQ\nESloK1fCX/8KvXrBsGFJR9N8URLBUHf/J2Cfuz9K+CZ/XksvaGZXAO+7+wLqn9BORKSgZEsD48eD\nFeCnWpRxBNlRxHvMbAywDfhYK675SeAqM5tEaHTuZma/dPev1n7TtGnTjj4uLy+nvLy8FZcUEYnH\nwYMwf354PH58fq9dUVFBRUVFq89j7o1PG2Rm3wSeAcYAjwBdgX9y9/9q9cXNLgRur9tryMy8qbhE\nRNLg9dfh0UdDldDttycbi5nh7s0ukzRZInD3GZmHrwKDmnuBCPSJLyIFq5AbibOabCMws15m9jMz\nW2Bm883sPjPrmYuLu/urms5aRArVtm2wahW0b184M43WJ0pj8ROEAWVTgC8QBpQ9GWdQIiKFYPbs\nsD/3XOjY6mG2yYnSWNzb3X9S6/hfzeyauAISESkEH31UUy104YWNvzftopQIXjSza82sLLNdA7wY\nd2AiImk2b15YhGbQIBgwIOloWqexSef2UdOQ+/eEgWUQkkcl8H/jDU1EJL1efTXsJ05MNo5caGyu\noa75DEREpFBs2ADvvgudOxfOusSNidJGgJldDUwklBBedff6FrQXESkJ2UbiCRNCj6FCF6X76J3A\nzcBSYDlws5ndEXdgIiJpdOBAzboDxVAtBNFKBJcDY939CICZPQIsBP4hxrhERFLp9ddDj6ERI6B3\n76SjyY0ovYYc6FHruAcaDSwiJai6Gl55JTy+5JJkY8mlKCWCO4D5ZjaLMFvohcAPYo1KRCSFFiyA\nnTvh5JNhzJiko8mdRhOBmZUR1gyYAHyCUBL4gbtvzUNsIiKp8qc/hf2ll0JZlPqUAtFoInD3ajP7\nnrs/Cfw+TzGJiKTO2rWwbh106ZL/6abjFiWnvWRmt5tZfzM7KbvFHpmISIpkSwMTJxbemsRNidJG\n8GVCldBNtZ5zYHAsEYmIpMzOnbBwIbRpA8W4RlaU9QgG5iEOEZHUevnl0GNowgTo0aPp9xeaJhOB\nmXUCvgNcQCgJzAEecPeDMccmIpK4vXthzpzw+NJLk40lLlGqhn4J7AV+Sug++hXCBHRfjDEuEZFU\neOklqKqCsWOhX7+ko4lHlEQw2t1H1Tp+xcyWxRWQiEhafPghZNeGnzQp0VBiFaXX0HwzO7oap5mN\nB+bFF5KISDq8/HKYTmLMGDjttKSjiU+UEsE5wJ/NbCOhjWAAsNLMlgDu7mfEGaCISBIqK2HWrPD4\n8suTjSVuURLBZbFHISKSMq+8AgcPwqhRYRWyYhal++h7eYhDRCQ19u8P1UJQ/KUBiNZGICJSUl54\nIaw7MHIkDB2adDTxUyIQEanlgw9qppqePDnZWPJFiUBEpJbnnw/jBs45p7h7CtWmRCAikrF1a1iB\nrE0buPrqpKPJHyUCEZGMZ58NcwpdcEFYfKZUKBGIiBDWG1i4ENq3hyuuSDqa/FIiEJGSV10NTz4Z\nHn/609CtW7Lx5JsSgYiUvD//GdavhxNPhM9+Nulo8k+JQERKWmVlaBsA+OIXi2/1sSiUCESkpD33\nHOzbByNGwNlnJx1NMpQIRKRkbdwIs2dDWRl8+ctglnREyVAiEJGS5A6//nVoKL7oIujTJ+mIkqNE\nICIlqaIidBnt3h2uvDLpaJKlRCAiJWfXLvjd78Lja6+FTp2SjSdpeU8EZtbfzGaZ2VIze8fMbs53\nDCJSutzh8cfh0CEYNw7OOivpiJIXZWGaXKsCbnX3hWbWFZhnZi+5+/IEYhGREvPmm7BsGXTpEhqI\nJYESgbtvc/eFmcf7gOVACTfTiEi+7NkDTz0VHn/pS6U3grghibYRmNlA4CzgrSTjEJHi5w4PPxwG\nkH3843DeeUlHlB5JVA0BkKkWehq4JVMyOMa0adOOPi4vL6e8vDxvsYlI8fnTn2D5cujaFb761eIY\nM1BRUUFFRUWrz2Pu3vpomntRs3bA88Af3f3eel73JOISkeK0YQPceSccOQI33QRnnJF0RPEwM9y9\n2SkuiV5DBjwELKsvCYiI5NKhQ/DQQyEJlJcXbxJojSTaCM4H/ga4yMwWZLbLEohDRIpcdvTwtm1h\n5PAXvpB0ROmU9zYCd38NDWQTkTyYPRveeCMsNvONb0C7dklHlE76QBaRorR2bc1iM9ddB337JhtP\nmikRiEjR2bsXHnwwtAtccgmce27SEaWbEoGIFJXDh0MS2LMHhg+Hz38+6YjST4lARIqGOzz6KKxZ\nE5ad/OY3oU2bpKNKPyUCESkav/89vP02dOwYxgtoCololAhEpCjMmQN//GNYbexb34L+/ZOOqHAo\nEYhIwVu0CH71q/B46lQYPTrZeAqNEoGIFLSlS+HnPw9LTk6aBBdckHREhUeJQEQK1qpV8MADoafQ\nxRfDVVclHVFhUiIQkYK0di3cfz9UVYVSwJe+VBwziiYhsWmoRURaasUK+M//DBPKnXdeaBdQEmg5\nJQIRKSiLFoU2gcOHQxK44YbQU0haTolARArGW2/BI4+EhuHy8rDmsEoCradEICKp5w4vvADPPhuO\nJ00KDcNKArmhRCAiqXb4MDz+eJhO2iysKXDppUlHVVyUCEQktT78MEwgt3p1zZoCZ56ZdFTFR4lA\nRFJp7VqYMQM++CBMIHfTTZo2Ii5KBCKSKu7w8svw29+G9QSGDAlzB/XokXRkxUuJQERS48MPQ3vA\nwoXh+NOfhsmTNZV03JQIRCQVFi0KSWDvXujUCa6/Hs46K+moSoMSgYgkav9+eOopeP31cDxiREgC\nPXsmG1cpUSIQkUS4h0Vknn46lALatQvVQBdfrPEB+aZEICJ5t3UrPPFEmDMIYNiwMF/QqacmG1ep\nUiIQkbzZuxeefz6sJlZdDV27hgFi48erFJAkJQIRid3Bg6FL6IsvhsdlZTBxIlx9dUgGkiwlAhGJ\nzYED8MorIQlUVobnzjgDpkxRNVCaKBGISM7t3g2zZsHs2aFXEMDw4XDllWEv6aJEICI54Q7r14cS\nwNy5YVQwhO6gV1yhBJBmSgQi0ir794duoK+9Bhs3hufKyuCcc+CSS2Dw4GTjk6YpEYhIsx0+DEuX\nhoViFi8O6wZDaPj95CfDojEaEFY4lAhEJJKqKli2LMwDtGhRTeMvwOmnw6c+BWPHQlt9qhQc/ZeJ\nSIN27Qrf/JcuDUngo49qXuvXD849N2wnnphcjNJ6SgQictSePbBqVVgIZsUK2L792NcHDgzf+seO\nVffPYqJEIFKiqqpg82Z4992wrVsHO3Yc+55OnWDkSBg9Omz65l+clAhEipx7+Ka/ZUvYNm0KvXu2\nbq3p4pnVoQMMHRq6eg4bFkoAWgug+CWSCMzsMuBeoA3w3+5+VxJxiBQL97Coy86dYduxI1TrZLcD\nB47/mbIy6NMHBgwIXTwHD4a+fcPzUlrM3fN7QbM2wErgUmAz8BfgWndfXus9nu+40qqiooLy8vKk\nw0iFUrwX7qGBdu/eY7c5cyro37+cDz6Av/41bNkunPXp3Dl8yPfpE/b9+4d9hw75+7fEpRR/Lxpi\nZrh7s6fvS6JEcC6wxt3fAzCzJ4CrgeWN/VCp0i95jUK8F0eOwKFD4cP80KEw4Vp2f/Bg+Kae3Sor\nw+Cs/fth376arb4P+LlzKzjnnPJjnuvSBXr1ClvPnnDKKWHr3Tv07y/W2T0L8fcibZJIBH2BjbWO\nNwHn1X3T+vV5iyfVdu9Ox72IWkCr+776fq6h57LP13699vM7dsDy5TXP1X5/Q1t1dcP72pt7+NCu\nrg77xrbDh4/fqqqO3T76KGx16+Bbol076NYtbCecAN27h2qg664LC7r37BkacTt2bP21pDQlkQgi\nfaRMnx53GIVh7tz663dL0dy54UO3kJSVheqX9u3DvmPHsGUfd+pUs3XuHL7VZ/ddu4atffvjv82v\nWQMXXJDMv0mKTxJtBOOBae5+Web4H4Dq2g3GZqYGAhGRFmhJG0ESiaAtobH4EmAL8DZ1GotFRCR/\n8l415O6HzezvgP8ldB99SElARCQ5eS8RiIhIuiQ6dMTMLjOzFWa22sy+38B7fpp5fZGZnZXvGPOl\nqXthZlMz92Cxmf3ZzM5IIs58iPJ7kXnfJ8zssJlNyWd8+RTxb6TczBaY2TtmVpHnEPMmwt9IdzP7\ng5ktzNyLGxIIM3Zm9gsz225mSxp5T/M+N909kY1QLbQGGAi0AxYCI+u8ZxIwM/P4PODNpOJNwb2Y\nAHTPPL6slO9Frfe9AjwPfD7puBP8vegBLAX6ZY57JR13gvfiH4E7svcB2AW0TTr2GO7Fp4CzgCUN\nvN7sz80kSwRHB5a5exWQHVhW21XAowDu/hbQw8xOyW+YedHkvXD3N9x9T+bwLaBfnmPMlyi/FwDf\nBZ4GdtTzWrGIci++Ajzj7psA3H1nnmPMlyj3ohrolnncDdjl7gXW4bhp7j4H+KCRtzT7czPJRFDf\nwLK+Ed5TjB+AUe5FbTcCM2ONKDlN3gsz60v4EHgg81SxNnRF+b0YBpxkZrPMbK6ZXZe36PIryr24\nHxhlZluARcAteYotbZr9uZnk7KNR/3jr9oktxj/6yP8mM7sI+DpwfnzhJCrKvbgX+IG7u5kZx/+O\nFIso96IdcDahO3Zn4A0ze9PdV8caWf5FuReXAfPd/SIzGwK8ZGZnuvuHMceWRs363EwyEWwG+tc6\n7k/IXI29p1/muWIT5V6QaSCeAVzm7o0VDQtZlHsxDngi5AB6AZ8zsyp3fy4/IeZNlHuxEdjp7geA\nA2Y2GzgTKLZEEOVe3ADcAeDua83sXWAEMDcfAaZIsz83k6wamgsMM7OBZtYeuAao+4f8HPBVODoi\nebe711kzqSg0eS/MbADwW+Bv3H1NAjHmS5P3wt0Hu/sgdx9EaCf4P0WYBCDa38jvgQvMrI2ZdSY0\nDi7Lc5z5EOVebCDMakymTnwEsC6vUaZDsz83EysReAMDy8zs25nXH3T3mWY2yczWAJXA15KKN05R\n7gXwz8CJwAOZb8JV7n5uUjHHJeK9KAkR/0ZWmNkLwGJCY+kMdy+6RBDx9+InwCNmtphQNfI9d/9r\nYkHHxMx+DVwI9DKzjcCPCVWELf7c1IAyEZESp7WIRERKnBKBiEiJUyIQESlxSgQiIiVOiUBEpMQp\nEYiIlDglAhGREqdEICJS4pQIRCLITG2wwsweN7NlZvaUmXVKOi6RXFAiEIluOPAf7j4K2At8J+F4\nRHJCiUAkuo3u/kbm8ePABUkGI5IrSgQi0dWemMsozrUxpAQpEYhENyAzrS+EJSLnJBmMSK4oEYhE\ntxK4ycydxYQ5AAAAT0lEQVSWAd2pWSpTpKAluUKZSKE57O7FuiawlDCVCESiU5uAFCUtTCMiUuJU\nIhARKXFKBCIiJU6JQESkxCkRiIiUOCUCEZESp0QgIlLi/j8CG+EVf7+jYAAAAABJRU5ErkJggg==\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"fig, ax = plt.subplots(1,1)\n",
"plot_beta(10,1,ax)\n",
"handles, labels = ax.get_legend_handles_labels()\n",
"ax.legend(handles, labels)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Setting $\\alpha=10$ and $\\beta=1$ increases the belief in an unfair coin biased towards flipping \"heads\". Finally, let us shortly consider what happens when we set $\\alpha=\\beta=1$."
]
},
{
"cell_type": "code",
"execution_count": 8,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Interval containing 95% of the distribution: (0.025000000000000022, 0.97499999999999998)\n"
]
},
{
"data": {
"text/plain": [
""
]
},
"execution_count": 8,
"metadata": {},
"output_type": "execute_result"
},
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAYwAAAEPCAYAAABRHfM8AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAGR5JREFUeJzt3XuQpXV95/H3BwYiA2FQ8LJyCRJQBxblUuJYJEsnscxk\nVCjGTbFIYEGM7BqUhTXrJbvLbKUiUlsYURJCCLdoVjSotZCa9bKRVtwgCgzDwAzICG4GJhkv64hM\neRngu3+cM0xXO9P9Oz399Onueb+quqafy3mebz/TfT7n9/s9l1QVkiRNZo9hFyBJmhsMDElSEwND\nktTEwJAkNTEwJElNDAxJUpNOAyPJ9Uk2JVkzwTofTfJIktVJjh8z/4AktyRZl2RtkiVd1ipJmljX\nLYwbgKU7W5hkGXBkVR0FvAO4esziK4GVVbUYeBWwrstCJUkT6zQwquoO4IcTrHIqcFN/3buAA5K8\nOMki4Ner6vr+sqer6kdd1ipJmtiwxzAOBjaMmX4cOAR4GfC9JDckuTfJtUkWDqVCSRIw/MAAyLjp\nAhYAJwB/XlUnAFuA9810YZKk7RYMef9PAIeOmT6kPy/A41X1zf78W9hBYCTxRliSNAVVNf7D+qSG\n3cK4FTgHoH8W1Oaq2lRV/wxsSPLy/nqvBx7c0Qaqyq8qLr300qHXMFu+PBYeC4/FxF9T1WkLI8kn\ngVOAg5JsAC4F9gKoqmuqamWSZUnW0+t2Om/My98F/E2SvYFvj1smSZphnQZGVZ3ZsM6FO5m/GnjN\ntBclSZqSYXdJaZqMjIwMu4RZw2OxncdiO4/Frsuu9GcNW5Kay/VL0jAkoaYw6D3ss6QkzTPJwO9D\n6tB0fqg2MCRNO1v+s8N0h7djGJKkJgaGJKmJgSFJamJgSJKaGBiStIvuu+8+3vOe98zb/W3jWVKS\ntAs+/OEP87WvfY1FixZNuu6qVat47LHHAHj00Uen9KY/yP6mmy0MSdoFl1xyCaeddtqk6913331s\n3ryZ5cuXs3z5clauXNnp/rpgC0PSjLnggunb1jXXTN+2xnr00Ue59tprd7p8yZIlv/CG3XLdyYMP\nPshZZ50FwD333MOxxx475X0O6zoXA0PSbmXjxo3ccMMNHHfccXz1q1/lne98JwceeCBPPfUUL3nJ\nSzjiiCO47LLLBtrmZBfIbdiwgcMOO4w1a9Zw44038q1vfYtrxiTeoPsc1tX0BoakGdNVq6DVli1b\nOP3001m5ciUHHnggL3rRi7jkkks466yzeNOb3jTl7U72if/rX/86p59+OgsWLOCKK67g6quv5oYb\nbuCP/uiPOtlfVwwMSbuNT33qU5x44okceOCBALzwhS9kzZo1AOy9997A1LqkJvvE/9Of/pQFC7a/\n3a5du5aXv/zlz00Puk9bGJLUsa1bt3LkkUc+N71lyxb22GMPli9f/ty8qXRJ7egT/yOPPPLcvu64\n4w7OPvtsAL7//e9z55138sEPfnDK+xxWC8Pbm0uaVv1bZw+7jB168sknufzyyzn55JPZunUr++67\nL9dddx1veMMbOOOMM1i4cOHA27zqqqv49Kc/zYYNGzj33HO5+OKL2X///Vm8eDFXXnklL3rRi9iw\nYQObN29m33335f777+f888/n0EMPndLPsLP97cjO/i+mentzA0PStJrNgTGTnnnmGb7yla+wadMm\nzjxz0oePdmK6A8PrMCSpA5/5zGdYsmQJe+wxf95mbWFImla2MHqeeuop9ttvv6HWYJfUGAaGNPsY\nGLOHXVKSpKEwMCRJTQwMSVITA0OS1MTAkCQ18dYgkqbdsO51pG4ZGJKmlafUzl+ddkkluT7JpiRr\nJljno0keSbI6yfHjlu2ZZFWS27qsU5I0ua7HMG4Alu5sYZJlwJFVdRTwDuDqcatcBKwF/MgiSUPW\naWBU1R3ADydY5VTgpv66dwEHJHkxQJJDgGXAXwF2iErSkA37LKmDgQ1jph/vzwP4U+APgWdnuihJ\n0i8admDAL7YekuRNwHeratUOlkuShmDYZ0k9AYx9isgh/XlvAU7tj3E8D9g/yV9X1TnjN7BixYrn\nvh8ZGWFkZKTLeiVpzhkdHWV0dHSXt9P53WqTHA7cVlXH7mDZMuDCqlqWZAnwkapaMm6dU4D3VNWb\nd/B671YrSQOa6t1qO21hJPkkcApwUJINwKXAXgBVdU1VrUyyLMl6YAtw3k42ZSpI0pD5PAxJ2s34\nPAxJUqcMDElSEwNDktTEwJAkNTEwJElNDAxJUhMDQ5LUxMCQJDUxMCRJTQwMSVITA0OS1MTAkCQ1\nMTAkSU0MDElSEwNDktTEwJAkNTEwJElNDAxJUhMDQ5LUxMCQJDUxMCRJTQwMSVITA0OS1MTAkCQ1\nMTAkSU0mDYwkH05yzEwUI0mavVpaGOuAv0zyjST/LsmirouSJM0+qaq2FZNXAucCbwW+BlxbVbd3\nV1pTTdVavySpJwlVlUFf1zSGkWRP4JXAYuB7wGrgkiSfGnSHkqS5qWUM40+Bh4FlwJ9U1YlVdXlV\nvRk4bpLXXp9kU5I1E6zz0SSPJFmd5Pj+vEOT3J7kwSQPJHn3YD+WJGm6tbQw7gdeXVXvqKpvjFv2\n2kleewOwdGcLkywDjqyqo4B3AFf3F20FLq6qY4AlwB8kWdxQqySpIy2BcXZVbRk7I8nfA1TV5ole\nWFV3AD+cYJVTgZv6694FHJDkxVX1z1V1X3/+U/QG3l/aUKskqSMLdrYgyT7AQuCgJC8Ys2h/4OBp\n2v/BwIYx048DhwCbxtRxOHA8cNc07VOSNAU7DQzgAuAiep/s7xkz/8fAVdNYw/iR+udOe0qyH3AL\ncFG/pfELVqxY8dz3IyMjjIyMTGNpkjT3jY6OMjo6usvbmfS02iTvqqqPTXkHvRbCbVV17A6W/QUw\nWlU396cfAk6pqk1J9gL+DvhfVfWRnWzb02olaUBTPa12oi6p36yqLwMbkywfv7yqPjvoznbgVuBC\n4OYkS4DN/bAIcB2wdmdhIUmaWRN1SZ0CfBl4M2O6icaYNDCSfLK/nYOSbAAuBfYCqKprqmplkmVJ\n1gNbgPP6Lz0Z+D3g/iSr+vPeX1Wfb/iZJEkdaL7SezayS0qSBtfZld5JLkqyf3quS3Jvkt+eWpmS\npLmq5TqM86vqSeANwAuAc4APdVqVJGnWaQmMbc2WNwIfr6oHOqxHkjRLtQTGPUm+SO9eUl9Isj/w\nbLdlSZJmm5brMPakd5PBb1fV5iQHAgdX1f0zUeBEHPSWpMFN+3UY21TVM0k2AUcnWUCvi8p3aUna\nzUwaGEkuB84A1gLPjFn01a6KkiTNPi1dUt8Cjq2qn81MSe3skpKkwXX5xL1vA3sPXpIkaT6ZtEsK\n+AlwX/8ZGNtaGVVVPgVPknYjLYFxa/9rW9+Pg96StBtqupdUkoXAYVX1UPcltXMMQ5IG1+W9pE4F\nVgGf708fn+TWwUuUJM1lLYPeK4DX0n82d1WtAo7osCZJ0izUEhhbq2rzuHneGkSSdjMtg94PJjkL\nWJDkKODdwD90W5YkabZpaWG8CziG3im1nwSeBP5Dl0VJkmYfn7gnSbuZab/5YJLbxkwW25+LAb0L\n904ddGeSpLlrojGMK/r/ng68BPgEvdA4E9jUcV2SpFmm5eaD91TViZPNGwa7pCRpcF3efHBhkl8d\ns6MjgIWD7kiSNLe1nFZ7MXB7ksf604cD7+isIknSrNR6L6nnAa+kN/j9cFX9tOvCWtglJUmDm2qX\nlKfVStJupssxDEmSDAxJUpuW25t/NskbkxgukrQbawmBq4GzgPVJPpTkFa0bT3J9kk1J1kywzkeT\nPJJkdZLjx8xfmuSh/rL3tu5TktSNSQOjqr5UVW8FTgC+A/x9kn9Icl6SvSZ5+Q3A0p0tTLIMOLKq\njqJ3qu7V/fl7Alf1X3s0cGaSxQ0/jySpI03dTEkOBM4F3g7cC3wUOBH40kSvq6o76D94aSdOBW7q\nr3sXcECSlwAnAeur6jtVtRW4GTitpVZJUjcmvXAvyefoXYPxceDNVfVP/UU3J7lnF/d/MLBhzPTj\n/Xkv3cH81+5oAxdcsIsVSJKatFzpfW1VrRw7I8kvVdXPpul+UgOfCzzW3XeveO77l750hJe+dGQX\ny5Gk+WXjxlE2bhzd5e20BMafACvHzbuT3pjGrnoCOHTM9CH0WhN7jZt/aH/+L7jnnhXTUIYkzWcj\n/a+e5L9NaSsTPQ/jX9DrGtonyQn0WgIF7M/03XzwVuBCet1bS4DNVbUpyQ+Ao5IcDmwEzqB3W3VJ\n0pBM1ML4beDf0htTuGLM/B8DH2jZeJJPAqcAByXZAFxKr/VAVV1TVSuTLEuyHtgCnNdf9nSSC4Ev\nAHsC11XVuoF+MknStGp5HsZbquozM1TPQLyXlCQNbtpvPpjk7Kr6eJL/SK8r6rlF9B7R+uGplTp9\nDAxJGty0P9Ob7eMUv8wOAmPQHUmS5jZvby5Ju5lpb2Ek+dgEr6uqevegO5MkzV0TdUndQ6/raUcp\n5Md6SdrN2CUlSbuZLrqkrqyqi5LctoPFVVWnDrozSdLcNVGX1F/3/71iB8v8WC9Ju5mmLqkkv0Tv\njrXPAg9X1c+7LqyFXVKSNLgursPYtuE3An8BPNqfdUSSC8bfwVaSNL+13BrkYeCNVbW+P/2rwMqq\nan5Ua1dsYUjS4Kbawmh54t6T28Ki71HgyUF3JEma2yY6S+ot/W/vTrIS+HR/+neBu7suTJI0u0w0\nhvFmtp8N9V16tykH+B7wvC6LkiTNPl64J0m7mS7PktoHOB84GtiHfqujqt426M4kSXNXy6D3x4EX\nA0uBUXrP136qw5okSbNQy2m191XVcUnur6pXJdkL+FpVvXZmSpywNrukJGlAXZ5Wu+2q7h8lORY4\nAHjhoDuSJM1tk45hANcmeQHwn4Fbgf2A/9JpVZKkWcezpCRpN9NZl1SSg5J8LMmqJPcmuTLJgVMr\nU5I0V7WMYdxM78K95cC/pnfh3qe6LEqSNPu0nCX1QFX9y3Hz1lTVsZ1W1sAuKUkaXJdnSX0xyZlJ\n9uh/nQF8cfASJUlz2U5bGEmeYvu9pPal9/Ak6IXMlqr65e7Lm5gtDEka3LTfGqSq9tu1kiRJ80nL\ndRgkOQ34V/RaHF+pqts6rUqSNOu0nFb7IeDdwIPAOuDdSS5r2XiSpUkeSvJIkvfuYPnzk3wuyeok\ndyU5Zsyyi5M8kGRNkv/Rf664JGlIWs6SWgMcV1XP9Kf3BO6b7Cyp/noPA68HngC+CZxZVevGrPPf\n6T3R74+TvAL4s6p6fZKDgTuAxVX1sySfovdY2JvG7cMxDEkaUJdnSRW9+0dtcwDbB8MnchKwvqq+\nU1Vb6V3Pcdq4dRYDtwNU1cPA4Um23adqAbAwyQJgIb3QkSQNSUtgXAbcm+TGJDcB9wAfbHjdwcCG\nMdOP9+eNtZreBYEkOQn4FeCQqnoCuAL4R2AjsLmq/nfDPiVJHZlw0DvJHvROp30d8Bp6LYv3VdU/\nNWy7pRXyIeDKJKuANcAq4JkkzwdOBQ4HfgT8bZKzqupvxm9gxYoVz30/MjLCyMhIw24lafcxOjrK\n6OjoLm+nZQzjnqo6ceANJ0uAFVW1tD/9fuDZqrp8gtc8BhwL/A7w21X19v78s4ElVfUH49Z3DEOS\nBtTlGMaXkrwnyaFJXrDtq+F1dwNHJTk8yd7AGfRujz626EX9ZST5fXqn7D4F/F9gSZJ9koTewPna\nQX4wSdL0arkO49/Q614a++m+gCMmelFVPZ3kQuALwJ7AdVW1LskF/eXX0HtO+I1JCniA3rPDqapv\nJLkFuBd4uv/vXw7yg0mSppfPw5Ck3cy03xpkzIb3Ad4J/Bq9lsUdwNVV9dOBq5QkzVktg95/CzwJ\nfAII8FZgUVX9bvflTcwWhiQNbqotjJbAWFtVR082bxgMDEkaXJdnSd2b5HVjdrSE3sV7kqTdSEsL\n4yHg5fSu2i7gMHr3iHoaqKp6VddFTlCbLQxJGlBng97A0inUI0maZzytVpJ2M12OYUiSZGBIktoY\nGJKkJgaGJKmJgSFJamJgSJKaGBiSpCYGhiSpiYEhSWpiYEiSmhgYkqQmBoYkqYmBIUlqYmBIkpoY\nGJKkJgaGJKmJgSFJamJgSJKaGBiSpCYGhiSpiYEhSWrSaWAkWZrkoSSPJHnvDpY/P8nnkqxOcleS\nY8YsOyDJLUnWJVmbZEmXtUqSJtZZYCTZE7gKWAocDZyZZPG41T4A3FtVrwbOAa4cs+xKYGVVLQZe\nBazrqlZJ0uS6bGGcBKyvqu9U1VbgZuC0cessBm4HqKqHgcOTvDDJIuDXq+r6/rKnq+pHHdYqSZpE\nl4FxMLBhzPTj/XljrQaWAyQ5CfgV4BDgZcD3ktyQ5N4k1yZZ2GGtkqRJdBkY1bDOh4ADkqwCLgRW\nAc8AC4ATgD+vqhOALcD7uipUkjS5BR1u+wng0DHTh9JrZTynqn4MvG3bdJLHgEeB/YDHq+qb/UW3\nsJPAWLFixXPfj4yMMDIysuuVS9I8Mjo6yujo6C5vJ1UtDYEpbDhZADwM/BawEfgGcGZVrRuzziLg\nJ1X18yS/D5xcVef2l30VeHtVfSvJCmCfqnrvuH1UV/VL0nyVhKrKoK/rrIVRVU8nuRD4ArAncF1V\nrUtyQX/5NfTOnroxSQEPAOeP2cS7gL9JsjfwbeC8rmqVJE2usxbGTLCFIUmDm2oLwyu9JUlNDAxJ\nUhMDQ5LUxMCQJDUxMCRJTQwMSVITA0OS1MTAkCQ1MTAkSU0MDElSEwNDktTEwJAkNTEwJElNDAxJ\nUhMDQ5LUxMCQJDUxMCRJTQwMSVITA0OS1MTAkCQ1MTAkSU0MDElSEwNDktTEwJAkNTEwJElNDAxJ\nUhMDQ5LUxMCQJDXpNDCSLE3yUJJHkrx3B8ufn+RzSVYnuSvJMeOW75lkVZLbuqxTkjS5zgIjyZ7A\nVcBS4GjgzCSLx632AeDeqno1cA5w5bjlFwFrgeqqzvlidHR02CXMGh6L7TwW23ksdl2XLYyTgPVV\n9Z2q2grcDJw2bp3FwO0AVfUwcHiSFwIkOQRYBvwVkA7rnBf8Y9jOY7Gdx2I7j8Wu6zIwDgY2jJl+\nvD9vrNXAcoAkJwG/AhzSX/anwB8Cz3ZYoySpUZeB0dKN9CHggCSrgAuBVcCzSd4EfLeqVmHrQpJm\nhVR1MzyQZAmwoqqW9qffDzxbVZdP8JrHgFcB7wfOBp4GngfsD3ymqs4Zt75jG5I0BVU18IfxLgNj\nAfAw8FvARuAbwJlVtW7MOouAn1TVz5P8PnByVZ07bjunAO+pqjd3UqgkqcmCrjZcVU8nuRD4ArAn\ncF1VrUtyQX/5NfTOnrqx31J4ADh/Z5vrqk5JUpvOWhiSpPllTlzpPdkFgP11PtpfvjrJ8TNd40xp\nuBjyrP4xuD/J/0nyqmHUORNafi/6670mydNJls9kfTOp8W9kpH8h7ANJRme4xBnT8DeyKMltSe7r\nH4tzh1Bm55Jcn2RTkjUTrDPY+2ZVzeovet1Z64HDgb2A+4DF49ZZBqzsf/9a4OvDrnuIx+J1wKL+\n90t352MxZr0vA38HvGXYdQ/x9+IA4EHgkP70QcOue4jH4gPAZduOA/ADYMGwa+/gWPw6cDywZifL\nB37fnAstjJYLAE8FbgKoqrvonar74pktc0ZMeiyq6s6q+lF/8i62X9cy37T8XgC8C7gF+N5MFjfD\nWo7FW+mdafg4QFV9f4ZrnCktx+JZemde0v/3B1X19AzWOCOq6g7ghxOsMvD75lwIjJYLAHe0znx8\no2w5FmOdD6zstKLhmfRYJDmY3pvF1f1Z83XAruX34ijgBUluT3J3krNnrLqZ1XIsrgKOTrKR3sXD\nF81QbbPNwO+bnZ0lNY1a/8jHn1M8H98cmn+mJL8BvA04ubtyhqrlWHwEeF9VVZIwfy8CbTkWewEn\n0DvNfSFwZ5KvV9UjnVY281qOxVJ697D7jSS/Cnwpyaur6scd1zYbDfS+ORcC4wng0DHTh9JLwonW\nOaQ/b75pORb0B7qvBZZW1URN0rms5VicCNzcywoOAn4nydaqunVmSpwxLcdiA/D9qvoJ8JMkXwVe\nDcy3wGg5FucClwFU1bf7Fwy/Arh7JgqcRQZ+35wLXVJ3A0clOTzJ3sAZwPg/+Fvp3e122xXmm6tq\n08yWOSMmPRZJDgM+C/xeVa0fQo0zZdJjUVVHVNXLqupl9MYx/v08DAto+xv5n8Cv9R8ZsJDeIOfa\nGa5zJrQci38EXg/Q77N/BfDojFY5Owz8vjnrWxjVcAFgVa1MsizJemALcN4QS+5My7EA/ivwfODq\n/ifrrVV10rBq7krjsdgtNP6NPJTk88D99AZ9r62qeRcYjb8Xf0zvguH76XXJ/Keq+n9DK7ojST4J\nnAIclGQDcCm9rskpv2964Z4kqclc6JKSJM0CBoYkqYmBIUlqYmBIkpoYGJKkJgaGJKmJgSFJamJg\nSJKaGBjSNOrfkuKhJJ9IsjbJ3ybZZ9h1SdPBwJCm38uBP6uqo4EngXcOuR5pWhgY0vTbUFV39r//\nBPBrwyxGmi4GhjT9xt6gLczPZ7NoN2RgSNPvsP7toqH3aNQ7hlmMNF0MDGn6PQz8QZK1wCK2PyJW\nmtNm/fMwpDno6aqar8/M1m7MFoY0/Ryz0LzkA5QkSU1sYUiSmhgYkqQmBoYkqYmBIUlqYmBIkpoY\nGJKkJv8fIjaDn0tyDhAAAAAASUVORK5CYII=\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"fig, ax = plt.subplots(1,1)\n",
"plot_beta(1,1,ax)\n",
"handles, labels = ax.get_legend_handles_labels()\n",
"ax.legend(handles, labels)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"We can see that we now have a flat prior, meaning that all parameter configurations are equally likely. I suggest to play around with the shape parameters to see what happens with other configurations; also try to set the parameters lower than one."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Posterior\n",
"\n",
"Now that we have specified the likelihood-distribution as well as the prior-distribution we can rewrite the posterior-distribution as:\n",
"\n",
"$$\n",
"P(p|k,n,\\alpha,\\beta) = \\text{Beta}(p|\\alpha+k, \\beta+(n-k))\n",
"$$\n",
"\n",
"As mentioned earlier, the posterior is from the same distribution family (Beta) as the prior (Beta), if the prior distribution is the conjugate prior to the likelihood distribution (binomial). For details about the derivation of this closed form of the posterior, please refer to this article.\n",
"\n",
"Thus, based on our Bayesian inference, the posterior distribution of the parameter $p$ indicating the probability of flipping \"heads\", is expressed as a Beta distribution. The parameters of this Beta distribution are constituted by both our a-priori assumptions---i.e., the hyperparameters $\\alpha$ and $\\beta$---as well as observed data---i.e., the number of times we flipped \"heads\" $k$ and \"tails\" $n-k$. The resulting posterior can then be used as a new prior as we gather more data."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"For demonstrating how the posterior now changes with an increasing number of observations, let us assume that we know the parameter of flipping \"heads\" in advance---i.e., we manually assume $p$ of the binomial distribution to be $0.4$. For simplicity, let us assume that our inital Beta prior has the hyperparameters $\\alpha=\\beta=1$ meaning that we have no real a-priori tendency and work with a flat prior. Next, we incrementally sample single random variates from the binomial distribution with $p=0.4$ (Bernoulli trials) and update our posterior with corresponding samples."
]
},
{
"cell_type": "code",
"execution_count": 9,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"execution_count": 9,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"from scipy.stats import beta, binom\n",
"\n",
"# initializing plot\n",
"def init_plot():\n",
" fig = plt.figure()\n",
" ax = plt.axes(xlim=(0, 1), ylim=(0, 13))\n",
" line, = ax.plot([], [], lw=2)\n",
" ttl = ax.text(0.6,0.8,'', transform = ax.transAxes, va='center', size=20)\n",
" ax.set_xlabel(\"p\")\n",
" ax.set_ylabel(\"probability density\")\n",
" return fig, ax, ttl, line\n",
"\n",
"# random variates\n",
"samples = binom.rvs(1,0.4, size=200)\n",
"\n",
"# starting parameters and x values\n",
"a = 1\n",
"b = 1\n",
"x = np.linspace(0.00,1, 100)\n",
"\n",
"# init function\n",
"def init():\n",
" ttl.set_text(\"$\\\\alpha= \" + str(a) + \", \\\\beta=\" + str(b) + \"$\")\n",
" y = beta.pdf(x,a,b)\n",
" line.set_data(x,y)\n",
" return line,\n",
"\n",
"# animating the stuff\n",
"def animate(i):\n",
" global a,b\n",
" # somehow the init frame is not drawn, so a small hack here\n",
" if i != 0:\n",
" a += samples[i-1]\n",
" b += 1 - samples[i-1]\n",
" ttl.set_text(\"$\\\\alpha= \" + str(a) + \", \\\\beta=\" + str(b) + \"$\")\n",
" y = beta.pdf(x,a,b)\n",
" line.set_ydata(y)\n",
" return line,\n",
"\n",
"# let's animate\n",
"# you can increase/decrease the FPS at the beginning of this notebook\n",
"fig, ax, ttl, line = init_plot()\n",
"animation.FuncAnimation(fig, animate, init_func=init,\n",
" frames=200, interval=1, blit=True)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"In above animation, we can see that with an increasing amount of random samples from the binomial distribution, starting with an initial uniform (flat) belief (prior), we increasingly belief in the true parameter (i.e., $p=0.4$) from the underlying distribution that we manually specified beforehand. Bayesian inference not only allows us to make statements about the most probable values for $p$, but also about the credibility of these statements (highest density regions).\n",
"\n",
"What happens though, if we have stronger beliefs a-priori? Let us specify a Beta prior with $\\alpha=50$ and $\\beta=10$. Hence, we have decently high belief in a biased coin towards \"heads\", while our binomial distribution is slightly biased towards \"tails\" with $p=0.4$."
]
},
{
"cell_type": "code",
"execution_count": 10,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"execution_count": 10,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"fig, ax, ttl, line = init_plot()\n",
"a = 50\n",
"b = 10\n",
"animation.FuncAnimation(fig, animate, init_func=init,\n",
" frames=200, interval=1, blit=True)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"We can see, that with our 200 samples, our highest posterior belief is around $p=0.5$. This indicates the influence of the prior. Actually, the posterior can be seen as a convex combination of prior belief (pseudo counts) and the data (\"heads\" and \"tails\" counts). If our prior belief is strong, we need more data to \"overrule\" the prior. \n",
"\n",
"However, if we \"steer\" our prior in the right direction, we can increase our credibility around the \"true\" parameter, much faster."
]
},
{
"cell_type": "code",
"execution_count": 11,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"execution_count": 11,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"fig, ax, ttl, line = init_plot()\n",
"a = 4\n",
"b = 6\n",
"animation.FuncAnimation(fig, animate, init_func=init,\n",
" frames=50, interval=1, blit=True)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"You can play around with the parameters here. I also suggest to increase the prior pseudo counts to large numbers which results in the necessity to sample many variates to see differences regarding your prior knowledge (this may take a while though)."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"##Step-by-step example\n",
"\n",
"Equipped with a basic understand about Bayesian inference, this tutorial now demonstrates the main methodological concepts and ideas of HypTrails. This should be achieved by going through a simple example step-by-step. "
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"###Introduction\n",
"\n",
"Let us assume that we are the coach of a small football (soccer) team that---for simplicity---consists of three players (1, 2 and 3). We are interested in better understanding how our three players pass the ball between each other. To that end, we start to track the passes between our players which produce passing trails with each state of each trail corresponding to a player that has received the pass. For a better understanding, let us consider one sample trail depicted next."
]
},
{
"cell_type": "code",
"execution_count": 12,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"execution_count": 12,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"from IPython.display import Image\n",
"Image(url=\"http://i.imgur.com/0K2oEh3.png\")"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"In this example, player 1 first passes the ball to player 2 who then passes the ball to player 3. Finally, player 3 scores a goal and the trail is finished. Thus, this trail would look like:\n",
"\n",
"Player 1 -> Player 2 -> Player 3\n",
"\n",
"Of course, trails can be much longer. For example, player 3 might pass the ball back to player 2.\n",
"\n",
"Having these kind of trails, we are now interested in better understanding the mechanisms producing these trails in order to make informed decisions regarding our team and our potential coaching focus. To that end, we come up with certain hypotheses about how our players prefer to pass the ball between each other and we want to compare their plausibility relatively."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"###Markov chain model\n",
"\n",
"Before we proceed, we need to introduce the underlying model that HypTrails is based on and which we utilize for modeling the data; the Markov chain model (see our PlosOne paper for details). The MC model is a stochastic model that models transition probabilities---which are the parameters of the model---between states. In general, a Markov chain model is memoryless, which means that the next state in a trail only depends on the current one and not on a series of preceding states. We can write the Markov property as:\n",
"\n",
"$$\n",
" P(X_{t+1}=s_j|X_1=s_{i_1}, ..., X_{t-1}=s_{i_{t-1}}, X_t=s_{i_t})= \\\\ \n",
" P(X_{t+1}= s_j|X_t=s_{i_t}) = p_{i,j}.\n",
"$$\n",
"\n",
"The following figure visualizes the various parameters of the model for our simple example."
]
},
{
"cell_type": "code",
"execution_count": 13,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"execution_count": 13,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"Image(url=\"http://i.imgur.com/FR4fqqQ.png\")"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"The players represent the various states and the arrows the parameters (transition probabilities) of the MC model. For example, $p_{2,1}$ represents the probability that player 2 will pass the ball to player 1 if player 2 currently is in possession of the ball. The parameters $p_{i,j}$ are usually expressed in a transition matrix with rows $i$ and columns $j$ representing the various states of the Markov chain. As this matrix is stochastic, it holds for all $i$ that:\n",
"\n",
"$$\n",
"\\sum_j p_{i,j} = 1\n",
"$$\n",
"\n",
"Each row of the transition matrix follows a categorical probability distribution. Hence, the likelihood for a Markov chain can be determined by a product of likelihoods for the individual categorical distributions---$n_{i,j}$ represents the number of times this transition occurs in the data:\n",
"\n",
"$$\n",
"P(D | \\theta) = \\prod_i \\prod_j p_{i,j}^{n_{i,j}}\n",
"$$"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"An example of calculating the log-likelihood of a Markov chain with given transition probabilities (parameters) is given at the [end of this tutorial](#convergence_likelihood)."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
""
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"###Hypotheses\n",
"\n",
"Elementary, we are interested in comparing hypotheses about human trails on the Web. This means that we come up with certain hypotheses that make assumptions about how our three players pass the ball between each other.\n",
"For example, we might hypothesize that our players pass the ball between each other based on their friendship status; i.e., good friends will pass the ball to each other more frequently. Or, we might hypothesize that players always pass the ball to the best player. But, how can we intuitively express these and similar generic hypotheses in a coherent way?\n",
"\n",
"To that end, with HypTrails, hypotheses are expressed as Markov chain parameters (transitions) and our belief in them. This means, that according to a given hypothesis, we increase our belief in certain transitions if the hypothesis supports it. Note, we overall have three states; i.e., $S = {\\text{Player 1}, \\text{Player 2}, \\text{Player 3}}$. This means that we have $|S|*|S|$ parameters; i.e., 9. Next, some examples are presented to give a better understanding about the process of expressing hypotheses with HypTrails. For these examples, we first gather some background information about the players and their relations."
]
},
{
"cell_type": "code",
"execution_count": 14,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"+----------+--------------+------------------------+------------------------+------------------------+\n",
"| Player | Market value | Friendship to Player 1 | Friendship to Player 2 | Friendship to Player 3 |\n",
"+----------+--------------+------------------------+------------------------+------------------------+\n",
"| Player 1 | 1000€ | x | 70 | 30 |\n",
"| Player 2 | 500€ | 70 | x | 50 |\n",
"| Player 3 | 800€ | 30 | 50 | x |\n",
"+----------+--------------+------------------------+------------------------+------------------------+\n"
]
}
],
"source": [
"from prettytable import PrettyTable\n",
"\n",
"x = PrettyTable([\"Player\", \"Market value\", \"Friendship to Player 1\", \"Friendship to Player 2\", \"Friendship to Player 3\"])\n",
"x.add_row([\"Player 1\", \"1000€\", \"x\", \"70\", \"30\"])\n",
"x.add_row([\"Player 2\", \"500€\", \"70\", \"x\", \"50\"])\n",
"x.add_row([\"Player 3\", \"800€\", \"30\", \"50\", \"x\"])\n",
"print x"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"The market value should give us an indication about the strength of a player. The friendship relationship data is totally arbitrary here and might be initialized based on the personal feeling of us (being the coach of the players) based on a scale from 0 (worst enemies) to 100 (bff). We can then utilize this background knowledge to express our hypotheses as belief in Markov transitions. Note that the data utilized for expressing these hypotheses should not stem from the trail data studied because then we would already incorporate data into our hypotheses. Next, we want to express some exemplary hypotheses. Each hypothesis can be captured by a hypothesis matrix $Q$ with elements $q_{i,j}$ denoting the strength of our belief. The only limitations for the values are that they need to be positive and that higher values correspond to more belief; normalization is conducted at a later point.\n",
"\n",
"For the following examples, we will always assign zero belief to elements of the diagonal. We do this because we know that players pass the ball to other players all the time. If we would also somehow collect data that a player keeps the ball instead of passing it to another player, self-loops might happend and we might want to incorporate this into hypotheses at interest."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Friendship hypothesis\n",
"\n",
"Let us start with the friendship hypothesis, which believes that our players prefer to pass the ball to players they are friend with. This means that we want to increase values of $Q$ based on the friendship relations between the players. Thus, we can simply re-use the values provided in above table."
]
},
{
"cell_type": "code",
"execution_count": 15,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"[[ 0. 70. 30.]\n",
" [ 70. 0. 50.]\n",
" [ 30. 50. 0.]]\n"
]
}
],
"source": [
"# First we need to build a vocabulary that assigns indices to state names\n",
"# This is necessary so that the HypTrails framework knows which rows and columns\n",
"# correspond to which player.\n",
"vocab = {\"Player 1\": 0, \"Player 2\": 1, \"Player 3\": 2}\n",
"\n",
"# The HypTrails framework works with sparse scipy matrices\n",
"# Thus, we already start to specify them here\n",
"from scipy.sparse import lil_matrix, csr_matrix\n",
"# Building is better with a lil_matrix\n",
"q_friendship = lil_matrix((3,3))\n",
"q_friendship[vocab[\"Player 1\"], vocab[\"Player 2\"]] = 70.\n",
"q_friendship[vocab[\"Player 2\"], vocab[\"Player 1\"]] = 70.\n",
"q_friendship[vocab[\"Player 1\"], vocab[\"Player 3\"]] = 30.\n",
"q_friendship[vocab[\"Player 3\"], vocab[\"Player 1\"]] = 30.\n",
"q_friendship[vocab[\"Player 2\"], vocab[\"Player 3\"]] = 50.\n",
"q_friendship[vocab[\"Player 3\"], vocab[\"Player 2\"]] = 50.\n",
"\n",
"# We need csr_matrices later\n",
"q_friendship = q_friendship.tocsr()\n",
"print q_friendship.todense()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Market value hypothesis\n",
"\n",
"With this hypothesis, we believe that players prefer to pass the ball to players with high market values. In teams like Barcelona or Real Madrid this would mean that players would prefer to pass the ball to Messi or C. Ronaldo followed by other players of the team ranked by their market value. Note that for this hypothesis, we do not differ between various start players (giving the pass). Regardless whether player 1, 2 or 3 starts to pass, we always believe that the pass will end at the players ranked by their market value. Again, for our small example, we can directly use the values provided in above table for our hypothesis matrix $Q$."
]
},
{
"cell_type": "code",
"execution_count": 16,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"[[ 0. 500. 800.]\n",
" [ 1000. 0. 800.]\n",
" [ 1000. 500. 0.]]\n"
]
}
],
"source": [
"from scipy.sparse import lil_matrix, csr_matrix\n",
"q_market = lil_matrix((3,3))\n",
"\n",
"q_market[:,0] = 1000.\n",
"q_market[:,1] = 500.\n",
"q_market[:,2] = 800.\n",
"# No self-loops\n",
"q_market.setdiag(0.)\n",
"\n",
"# We need csr_matrices later\n",
"q_market = q_market.tocsr()\n",
"print q_market.todense()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Uniform hypothesis\n",
"\n",
"Finally, let us consider a uniform hypothesis which believes that all pass opportunities are equally likely. This can be seen as a baseline hypothesis."
]
},
{
"cell_type": "code",
"execution_count": 17,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"[[ 0. 1. 1.]\n",
" [ 1. 0. 1.]\n",
" [ 1. 1. 0.]]\n"
]
}
],
"source": [
"from scipy.sparse import lil_matrix, csr_matrix\n",
"q_uniform = lil_matrix((3,3))\n",
"q_uniform[:] = 1.\n",
"# No self-loops (also for the uniform)\n",
"q_uniform.setdiag(0.)\n",
"\n",
"# We need csr_matrices later\n",
"q_uniform = q_uniform.tocsr()\n",
"print q_uniform.todense()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"###Data\n",
"\n",
"Now that we have our expressed hypotheses, we need to collect some data. As we do not really coach a three-player soccer team (too bad), we cannot work with real data here. So let us just create some arbitrary passing trails next."
]
},
{
"cell_type": "code",
"execution_count": 18,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
"trails = [\n",
" [\"Player 1\", \"Player 2\", \"Player 3\", \"Player 2\", \"Player 1\"],\n",
" [\"Player 2\", \"Player 1\", \"Player 3\", \"Player 1\", \"Player 2\"],\n",
" [\"Player 1\", \"Player 2\", \"Player 1\", \"Player 2\", \"Player 1\", \"Player 2\", \"Player 1\"],\n",
" [\"Player 1\", \"Player 3\"],\n",
" [\"Player 3\", \"Player 1\", \"Player 2\", \"Player 3\", \"Player 1\", \"Player 2\", \"Player 1\"],\n",
" [\"Player 1\", \"Player 3\", \"Player 2\", \"Player 3\", \"Player 1\", \"Player 2\", \"Player 3\", \"Player 1\", \"Player 2\"],\n",
" [\"Player 1\", \"Player 2\", \"Player 1\", \"Player 2\", \"Player 1\", \"Player 2\"],\n",
" [\"Player 3\", \"Player 1\"],\n",
" [\"Player 2\", \"Player 3\", \"Player 1\", \"Player 2\", \"Player 1\", \"Player 2\", \"Player 1\", \"Player 2\"],\n",
" [\"Player 3\", \"Player 2\", \"Player 1\"]\n",
"]"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"HypTrails directly works with the data provided above. For completeness, let us determine the maximum likelihood (see our PlosOne paper for details) for the parameters which can be simply done by calculating:\n",
"\n",
"$$\n",
"p_{ij} = \\frac{n_{ij}}{\\sum_j n_{ij}}\n",
"$$\n",
"\n",
"The MLE can be seen as a parameter configuration that maximizes the likelihood of given data."
]
},
{
"cell_type": "code",
"execution_count": 19,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"+----------+----------+----------------+----------------+\n",
"| | Player 1 | Player 2 | Player 3 |\n",
"+----------+----------+----------------+----------------+\n",
"| Player 1 | 0.0 | 0.833333333333 | 0.166666666667 |\n",
"| Player 2 | 0.6875 | 0.0 | 0.3125 |\n",
"| Player 3 | 0.7 | 0.3 | 0.0 |\n",
"+----------+----------+----------------+----------------+\n"
]
}
],
"source": [
"# PathTools includes the Markov chain functionality; see https://github.com/psinger/PathTools\n",
"from pathtools.markovchain import MarkovChain\n",
"\n",
"# We initialize a first-order Markov chain model\n",
"# For details about the parameters please refer to the github repo and \n",
"# the synthetic example presented later in this tutorial.\n",
"markov = MarkovChain(k=1, use_prior=False, reset = False, modus=\"mle\")\n",
"markov.prepare_data(trails)\n",
"markov.fit(trails)\n",
"\n",
"t = markov.transition_dict_norm_\n",
"x = PrettyTable([\"\", \"Player 1\", \"Player 2\", \"Player 3\"])\n",
"x.add_row([\"Player 1\", t[(\"Player 1\",)][\"Player 1\"], t[(\"Player 1\",)][\"Player 2\"], t[(\"Player 1\",)][\"Player 3\"]])\n",
"x.add_row([\"Player 2\", t[(\"Player 2\",)][\"Player 1\"], t[(\"Player 2\",)][\"Player 2\"], t[(\"Player 2\",)][\"Player 3\"]])\n",
"x.add_row([\"Player 3\", t[(\"Player 3\",)][\"Player 1\"], t[(\"Player 3\",)][\"Player 2\"], t[(\"Player 3\",)][\"Player 3\"]])\n",
"print x"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"In this table, we can see the transition probabilities (pass probabilities) between the three states (players) as determined by the maximum likelihood estimation. Due to the stochastic nature, each row sums to one. We can see that player 1 passes most of the time to player 2. Player 2 most of the time to player 1 (slightly more balanced) and player 3 also prefers to pass to player 1. We can also take a look at the raw transition counts."
]
},
{
"cell_type": "code",
"execution_count": 20,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"+----------+----------+----------+----------+\n",
"| | Player 1 | Player 2 | Player 3 |\n",
"+----------+----------+----------+----------+\n",
"| Player 1 | 0.0 | 15.0 | 3.0 |\n",
"| Player 2 | 11.0 | 0.0 | 5.0 |\n",
"| Player 3 | 7.0 | 3.0 | 0.0 |\n",
"+----------+----------+----------+----------+\n"
]
}
],
"source": [
"t = markov.transition_dict_\n",
"x = PrettyTable([\"\", \"Player 1\", \"Player 2\", \"Player 3\"])\n",
"x.add_row([\"Player 1\", t[(\"Player 1\",)][\"Player 1\"], t[(\"Player 1\",)][\"Player 2\"], t[(\"Player 1\",)][\"Player 3\"]])\n",
"x.add_row([\"Player 2\", t[(\"Player 2\",)][\"Player 1\"], t[(\"Player 2\",)][\"Player 2\"], t[(\"Player 2\",)][\"Player 3\"]])\n",
"x.add_row([\"Player 3\", t[(\"Player 3\",)][\"Player 1\"], t[(\"Player 3\",)][\"Player 2\"], t[(\"Player 3\",)][\"Player 3\"]])\n",
"print x"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"For players 1 and 2 we have a bit more data compared to passes starting from player 3."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Up to this point, we have expressed our hypotheses as beliefs in parameters and we have collected data. But, we do not know yet how we can make relative judgements about the plausibility of our hypotheses given the data. To that end, HypTrails resorts to Bayesian inference."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"###Comparing hypotheses about human trails with HypTrails\n",
"\n",
"So why have we spent so much time going through the basic of Bayesian inference in the beginning of this tutorial? Because we utilize it for comparing hypotheses about human trails. The main idea that we follow with HypTrails is that we want to incorporate hypotheses as priors into the inference process. The reason behind this is that the prior is exactly what our hypotheses should represent: beliefs about parameters before observing the data. \n",
"\n",
"In the coin flip example at the beginning of this tutorial, we have utilized the Beta prior as a conjugate prior to the binomial distribution. In this case, we work with a Markov chain model where each row of the transition matrix follows a categorical distribution (see beginning of this tutorial). The conjugate prior for the categorical distribution is the Dirichlet distribution which we will shortly describe next."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
""
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Dirichlet prior\n",
"\n",
"The Dirichlet distribution is a continuous multivariate probability distribution and is the multivariate generalization of the Beta distribution described [earlier](#Beta). Similar to the Beta distribution, the parameters of the Dirichlet distribution can be interpreted as pseudo counts when we consider values $>=1$ which we do throughout this tutorial. In detail, the Dirichlet distribution is now parametrized by a vector $\\alpha=[\\alpha_1, \\alpha_2, ..., \\alpha_n]$. The length of this vector is determined by the number of categories considered (or number of states for our Markov chain use case). Thus, the hyperparameters (pseudo counts) can represent our prior belief about the parameters of the Markov chain model; the more we belief in them, the higher we want to set them. This means that the Dirichlet distribution represents probabilities of probabilities---or to be more precise, probabilties over probability configurations. For each row of our transition matrix, we thus have a Dirichlet prior defined by the following probability density function:\n",
"\n",
"$$\n",
"Dir(\\alpha_{i}) = \\frac{\\Gamma(\\sum_j \\alpha_{ij})}{\\prod_j \\Gamma(\\alpha_{ij})}\\prod_j p_{ij}^{\\alpha_{ij} - 1}\n",
"$$\n",
"\n",
"$\\Gamma$ is the gamma function, $\\alpha_j > 0$ for each $j$ and $\\sum_j x_j = 1$ is a probability simplex. The probability outside of the simplex is $0$."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Similar as for the Beta distribution, let us visualize some exemplary settings for the parameters $\\alpha$ of a Dirichlet distribution. For simplicity, let us consider that we only have three categories leading to the hyperparameters $\\alpha=[\\alpha_1, \\alpha_2, \\alpha_3]$ which steer our belief about the underlying parameters $p=[p_1, p_2, p_3]$. We start with a symmetric distribution where all elements of $\\alpha$ have the same value. We start with setting all vaues of $\\alpha$ to $1$ and increase these values by $1$ in each iteration. We visualize the resulting Dirichlet densities on the simplex."
]
},
{
"cell_type": "code",
"execution_count": 21,
"metadata": {
"collapsed": false
},
"outputs": [],
"source": [
"# Many thanks to http://blog.bogatron.net/blog/2014/02/02/visualizing-dirichlet-distributions/\n",
"# for providing the code for plotting Dirichlet distributions\n",
"import matplotlib.tri as tri\n",
"\n",
"corners = np.array([[0, 0], [1, 0], [0.5, 0.75**0.5]])\n",
"triangle = tri.Triangulation(corners[:, 0], corners[:, 1])\n",
"\n",
"midpoints = [(corners[(i + 1) % 3] + corners[(i + 2) % 3]) / 2.0 \\\n",
" for i in range(3)]\n",
"def xy2bc(xy, tol=1.e-3):\n",
" '''Converts 2D Cartesian coordinates to barycentric.'''\n",
" s = [(corners[i] - midpoints[i]).dot(xy - midpoints[i]) / 0.75 \\\n",
" for i in range(3)]\n",
" return np.clip(s, tol, 1.0 - tol)\n",
"\n",
"class Dirichlet(object):\n",
" def __init__(self, alpha):\n",
" from math import gamma\n",
" from operator import mul\n",
" self._alpha = np.array(alpha)\n",
" self._coef = gamma(np.sum(self._alpha)) / \\\n",
" reduce(mul, [gamma(a) for a in self._alpha])\n",
" def pdf(self, x):\n",
" '''Returns pdf value for `x`.'''\n",
" from operator import mul\n",
" return self._coef * reduce(mul, [xx ** (aa - 1)\n",
" for (xx, aa)in zip(x, self._alpha)])\n",
" \n",
"def draw_pdf_contours(dist, nlevels=200, subdiv=8, **kwargs):\n",
" import math\n",
"\n",
" refiner = tri.UniformTriRefiner(triangle)\n",
" trimesh = refiner.refine_triangulation(subdiv=subdiv)\n",
" pvals = [dist.pdf(xy2bc(xy)) for xy in zip(trimesh.x, trimesh.y)]\n",
"\n",
" plt.tricontourf(trimesh, pvals, nlevels, **kwargs)\n",
" plt.axis('equal')\n",
" plt.xlim(0, 1)\n",
" plt.ylim(0, 0.75**0.5)\n",
" plt.axis('off')"
]
},
{
"cell_type": "code",
"execution_count": 22,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
"# initializing plot\n",
"nlevels=200\n",
"subdiv=8\n",
"refiner = tri.UniformTriRefiner(triangle)\n",
"trimesh = refiner.refine_triangulation(subdiv=subdiv)\n",
"\n",
"# initializing plot\n",
"def init_plot():\n",
" fig = plt.figure()\n",
" plt.axis('equal')\n",
" plt.xlim(0, 1)\n",
" plt.ylim(0, 0.75**0.5)\n",
" plt.axis('off')\n",
" return fig\n",
"\n",
"# init function\n",
"def init():\n",
" dist = Dirichlet(alpha)\n",
" pvals = [dist.pdf(xy2bc(xy)) for xy in zip(trimesh.x, trimesh.y)]\n",
" plt.tricontourf(trimesh, pvals, nlevels)\n",
"\n",
"# animating the stuff\n",
"def animate(i):\n",
" para = f(alpha,i)\n",
" plt.title(\"$\\\\alpha=[\"+ \",\".join([str(x) for x in para]) + \"]$\")\n",
" dist = Dirichlet(para)\n",
" pvals = [dist.pdf(xy2bc(xy)) for xy in zip(trimesh.x, trimesh.y)]\n",
" plt.tricontourf(trimesh, pvals, nlevels)"
]
},
{
"cell_type": "code",
"execution_count": 23,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"execution_count": 23,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"# let's animate\n",
"# you can increase/decrease the FPS at the beginning of this notebook\n",
"fig = init_plot()\n",
"alpha = [1, 1, 1]\n",
"f = lambda a,i: [x+i for x in a]\n",
"# change our ugly global fps variable\n",
"fps = 5\n",
"animation.FuncAnimation(fig, animate, init_func=init,\n",
" frames=30, interval=1, blit=True)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"In this simplex, various parameter configurations are depicted. Note that these parameter configurations represent the $p$ values of our three state discrete distribution, not the hyperparameters $\\alpha$ set for the Dirichlet distribution. This is similar to the Beta distribution which expresses the probability distribution of parameter configurations for the single parameter $p$ (e.g., flipping \"heads\"). So to note again, we have probabilities of probabilities.\n",
"\n",
"Thus, the bottom left corner of the simplex corresponds to the parameter configuration $p=[1.0,0.0,0.0]$ while the bottom right corner represents the configuration $p=[0.0,1.0,0.0]$ and the top corner represents $p=[0.0,0.0,1.0]$. The most centric point corresponds to the $p=[1/3,1/3,1/3]$ configuration.\n",
"\n",
"With our symmetric pseudo count configuration, we start with $\\alpha_1=\\alpha_2=\\alpha_3=1$ and thus, we start with a flat prior that is uniform on the simplex meaning that all parameter configurations for $p$ are equally likely. However, with increasing concentration parameter (the sum of all values for $\\alpha$), we increase our symmetric belief and decrease our belief for other parameter configurations. Thus, we have more and more belief about the $p=[1/3,1/3,1/3]$ parameter configuration."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Let us consider another example, where we believe that $p_1$ and $p_3$ are equally important, while $p_2$ is unimportant. Thus, we increase the pseudo counts for $\\alpha_1$ and $\\alpha_3$ with each iteration and leave $\\alpha_2=1$."
]
},
{
"cell_type": "code",
"execution_count": 24,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"execution_count": 24,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"fig = init_plot()\n",
"alpha = [1, 1, 1]\n",
"f = lambda a,i: [a[0]+i, a[0], a[0]+i]\n",
"animation.FuncAnimation(fig, animate, init_func=init,\n",
" frames=30, interval=1, blit=True)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"We can clearly see that the probability mass centers on the left side of the simplex which expresses parameter configurations that have high values for $p_1$ and $p_3$.\n",
"\n",
"Again, I suggest to play around with the parameters. Note that for higher amounts of iterations (frames), the calculation will take some while."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Eliciting Dirichlet priors from expressed hypoitheses\n",
"\n",
"As mentioned, our idea is to incorporate hypotheses about human trails into the inference process as Dirichlet priors. The hyperparameters of the Dirichlet distribution can be interpreted as pseudo counts meaning that given a hypothesis, we want to set those pseudo counts high, that also have high values according to our expressed hypothesis. The overall amount of pseudo counts per distribution (concentration) can steer our amount of belief in a given hypothesis.\n",
"\n",
"For elicitation of priors, we have suggested to use an adapted version of the so-called (trial) roulette method in our original HypTrails paper---for details please refer to the paper. The original (trial) roulette method (which has motivated our adaption) is a\n",
"graphical method that allows experts to express their subjective belief\n",
"by distributing a fixed set of chips (think about casino chips you\n",
"set on a roulette table) to a given grid (e.g., bins representing result\n",
"intervals). The number of chips assigned to an element of the grid\n",
"then reflects an expert's belief in the specific bin. Finally, one can fit a distribution to this chip distribution which can then be used as a prior distribution.\n",
"\n",
"In our case, we already know what kind of distribution we want to utilize (Dirichlet) and we already have a grid: the individual transitions of the Markov chain. Initially, we also already have specified values for the hypothesis grid specified through expressed hypotheses matrices $Q$ (see [earlier in this tutorial](#example_hypotheses) for details). Now, we have a further grid: the pseudo counts for our Dirichlet priors. Concretely, we want to automatically distribute a number of chips to the given pseudo counts according to the values provided in matrix $Q$ expressing a hypothesis. We suggest the overall number of chips to distribute for a given hypothesis to be:\n",
"\n",
"$$\n",
"\\beta = \\overbrace{m^2}^{\\text{flat prior}} + \\underbrace{k\\cdot m^2}_{\\text{additional informative prior}}\n",
"$$\n",
"\n",
"$m$ correspond to the number of states and $k$ can be interpreted as a hypothesis weighting factor. The higher we set $k$, the more we believe in a given hypothesis. This can be explained by the fact that with higher values of $k$, we distribute more chips to the Dirichlet priors. This means that the overall number of pseudo counts---i.e., the concentration parameter---increases. This concentrates the probability mass of the prior on fewer parameter configurations specified by the initial hypothesis (see Dirichlet behavior above). The initial flat prior (proto-prior) is necessary to ensure proper priors and to allow our interpretation of Dirichlet hyperparameters as pseudo counts. This also ensures that we are always in the dense hyperparameter scenario (see this Wikipedia article for a short discussion). Note that the number of chips to distribute and how to distribute them is a suggestion and can be altered by researchers arbitrarily.\n",
"\n",
"In a nutshell, HypTrails utilizes an adapted version of the (trial) roulette method for eliciting Dirichlet priors from expressed hypotheses. To that end, it fairly distributes a number of chips to the pseudo counts of the prior based on the values $q_{i,j}$ provided for a given hypothesis matrix $Q$."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"#####Alterations\n",
"\n",
"Whole matrix vs. row-based elicitation:\n",
"There are several ways one can elicit the Dirichlet priors from hypotheses matrices. One way---the one we have suggested in the original HypTrails paper---is to distribute a number of chips to the whole matrix. Basically, this method normalizes the whole matrix globally, and then fairly distributes the number of chips accordingly. This means that some rows might receive more chips (pseudo counts) than others. Thus, with this method, one is able to alter the amounts of beliefs per state (row) per hypothesis. With the Python HypTrails code, this can be achieved by passing the matrix and the total number of chips to the function ```distr_chips(matrix, chips)```.\n",
"\n",
"Another, only slightly different way of distributing the chips, is to do it row-based. This function normalizes each row individually and distributes the same amount of chips (pseudo counts) to each row. Thus, with this row-based approach, we express a given hypothesis via equal amounts of belief for each state. With the Python HypTrails code, this can be achieved by passing the matrix and the number of chips that should be distributed to each row to the function ```distr_chips_row(matrix, chips)```. In the rest of this tutorial, we will mostly resort to this row-based elicitation.\n",
"\n",
"Integers vs. reals: In our original HypTrails paper, we have elaborated that the hyperparameters of the Dirichlet distribution can be interpreted as pseudo-counts. Thus, we have focused on distributing integer-valued pseudo-clicks (chips) to the Dirichlet hyperparameters (we also focus on this method throughout the rest of this tutorial). However, theoretically, the Dirichlet distribution can be parametrized by hyperparameters being positive reals. Thus, the Python implementation of HypTrails also allows to distribute reals to the hyperparameters of the Dirichlet distributions. The main difference between both approaches can be seen in the following example. Suppose we have a row $i$ of $Q$ with $[1/3,1/3,1/3]$; i.e., uniform belief. Now, we want to distribute $4$ chips. The original integers-based approach starts to distribute $1$ chip to each element and then randomly distributes the remaining final chip to one element; e.g., $[1,2,1]$. The reals-based method equally distributes the final amount (chip) to each element as reals are allowed; i.e., $[4/3,4/3,4/3]$. We can use this elicitation by simply changing the parameter ```mode``` of the distribution functions; e.g., ```distr_chips_row(matrix, chips, mode='reals')```. \n",
"\n",
"Most of the time, the various methods will not show much difference in the large spectrum. Furthermore, notice that HypTrails is completely adaptable with respect to the elicitation of the Dirichlet priors with respect to the initial hypothesis expression in $Q$. Thus, our proposed elicitation (based on the adapted trial roulette method) can be not only adapted, but also replaced by other elicitation methods. Note though, that the main goal should always be to elicit the priors based on the expressed hypothesis and to steer the amount of belief regarding the hypothesis based on the concentration parameter. "
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Next, let us elicit the priors from our expressed hypotheses [earlier](#example_hypotheses) by utilizing the functionality provided in the HypTrails framework."
]
},
{
"cell_type": "code",
"execution_count": 25,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"friendship hypothesis\n",
"[[ 0. 70. 30.]\n",
" [ 70. 0. 50.]\n",
" [ 30. 50. 0.]]\n",
"\n",
"market value hypothesis\n",
"[[ 0. 500. 800.]\n",
" [ 1000. 0. 800.]\n",
" [ 1000. 500. 0.]]\n",
"\n",
"uniform hypothesis\n",
"[[ 0. 1. 1.]\n",
" [ 1. 0. 1.]\n",
" [ 1. 1. 0.]]\n"
]
}
],
"source": [
"# for recap\n",
"print \"friendship hypothesis\"\n",
"print q_friendship.toarray()\n",
"print\n",
"print \"market value hypothesis\"\n",
"print q_market.toarray()\n",
"print\n",
"print \"uniform hypothesis\"\n",
"print q_uniform.toarray()"
]
},
{
"cell_type": "code",
"execution_count": 26,
"metadata": {
"collapsed": false
},
"outputs": [],
"source": [
"# We import the necessary functionality\n",
"# trial_roulette contains methods for Dirichlet elicitation\n",
"from hyptrails.trial_roulette import *"
]
},
{
"cell_type": "code",
"execution_count": 27,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"[[ 0. 1. 1.]\n",
" [ 1. 0. 1.]\n",
" [ 1. 1. 0.]]\n"
]
}
],
"source": [
"# We start with the friendship hypothesis\n",
"# First, we specify the number of chips to distribute\n",
"# The flat prior part is done automatically in the Markov chain framework\n",
"# For the informative part, we start with k = 1\n",
"k = 1\n",
"# We multiply k with the number of states\n",
"# In this case we subtract one from the number of states as we do not allow self-loops\n",
"chips = k*(q_friendship.shape[0]-1.)\n",
"# Now, we distribute the chips\n",
"# We use the row-based method which is why we only specify the number of chips to be distributed per-row\n",
"# Hence, we do not square the number of states when calculating the number of chips\n",
"# Details about that are elaborated in a second\n",
"prior_friendship = distr_chips_row(q_friendship, chips, n_jobs=1)\n",
"\n",
"# Let's check the elicited prior\n",
"print prior_friendship.toarray()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Again, note that only the informative part is done here and the final inference adds one pseudo count to each hyperparameter for ensuring proper priors (see discussion above). In this simple example, we only distributed 2 chips to each row. This leads to the simple behavior of the (trial) roulette method to only assign 1 chip to the corresponding beliefs (see HypTrails paper for details) as no belief is strong enough to justify the assignment of 2 chips to it (because then the other belief of the row would not receive 1 chip). We can see here, that the concentration (sum of pseudo counts per row) is very low which means that our overall amount of belief in this hypothesis is low. This means that the highest density region of the simplex is quite large. To visualize the density of the Dirichlet priors, let us pick the third row of ```prior_friendship``` and visualize the simplex similar to as we did before when explaining the Dirichlet distribution."
]
},
{
"cell_type": "code",
"execution_count": 28,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAW8AAAD7CAYAAAClvBX1AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJztndty20qTrMtDmpJoe13M6+6LHfti3nfiX7ZkyWR4X4BF\nZCequhsgJfGQGWGLBEHwIOpTKSur8eXv378mSZIkXZf+67OfgCRJkjRfgrckSdIVSvCWJEm6Qgne\nkiRJVyjBW5Ik6QoleEuSJF2h1p/9BCTpM/Xly/87ZmX//v2/Xz7zuUjSHKnyliRJukIJ3tLdCqvu\n6LokXbIEb+kuJVBL1y7BW5JAgrp0LRK8pbuTAC3dggRvSSIJ7tI1SPCW7kq9YBbApUuX4C3djQRk\n6ZYkeEtSIsFeumQJ3tJdSCCWbk2CtyRVJOhLlyrBW7p5nQpgAVy6RAnekiRJVyjBW7ppnatqVvUt\nXZq0JKx0s6oDN/vo797luUjSuaXKW7pD1WqWdXq7qm/pkiR4SzepGLQ5mON9JelyJXhLd6IlMJ7e\nR9W3dCkSvKWb0xSwp1TRArh0mRK8JakpWSjS5enL378qIqTb0fyq+wkuvzT2LZMoOmGx9JlSSSHd\njPrB/dSxPQL52hQllC5Fsk2kG1UE7ifLwR3tWz+uvG/pMyV4SzehEqQZuOdqDuwl6WMleEt3oFMB\nzPdX9S19vtSwlK5e9aq7Be6vcPlPY1/2wUf/W81L6aOlhqV0Q+oF99eO7RHIn6ydSJGkj5Eqb+mq\nlVfdEbgzaNcUQRwBrupb+hzJ85auVv3g/mrLwO33ZeHx9cer9DkSvKUbUAvcpyqC/7SyV/NS+kip\nbJCuUjEoe8Hd87GPhnG+WmyjaHhH+nip8pauXBmII3DPXRI22hePO7VPVH1LHyU1LKWr0wjIzC5h\ncJ/jD0yurLECf5nso+al9N5S5S1dldp2yVxwP1nfJCUfJ6rA5UJKHyfBW7pSOSgzcGe2x5PlwK7d\nho8ZPV65j+wT6b0leEtXo9gucTG4WUvWKYnukwFca6BIHyvBW7piOTBr4D7H4lItgPN+qr6l95ca\nltJVaFp1R3bJqePxqGydk3i6stbAVPNSeg+p8pauSKeA+6vNm7TM9s2mK88xDCRJ/VLlLV288qo7\nAvd7TFiaTSvxVgWu6lt6XynbJF202uBGveeEpR/L4YwrDEYTln67pi+l95FsE+mKVGtQtsC9tjw+\nGCnbvz5hmf3CUPNSOrcEb+liVY8G4nb2wHvy3nO0FOAa3pHeT4K3dOFq+dxzpyu/dv6LnkfWoOwB\nuKpv6bwSvKWLVAm6WoPS6Da/PaqW5zQvM5AzwHuHdJT9ls4rwVu6YPWsS2JWH9JpQbtnbZOWFZPZ\nJLJPpPeTooLSxWmoTnvtkgzcPWmUlrLzVWJssB0TLLcrOiidR6q8pYtSn10yF9xLR+Szqrz1uFkF\nzvtL0nIJ3tIFKgJiD7jZ3sigvaRhycfqWQgr3ybvWzpVgrd0MYqrblQL3Ljfucbja+eubD2PaPuT\nqfqWziHBW7ow1arubN8stue31YDdM7xTq+jxtlajsoS9qm/pFKlhKV2Epk3Kll3SAnd+ooR5ikbb\noxUEcXvUqPTtal5K55Eqb+nCFA28tMCdVcK+7ylTlnNG5FsVON9X9om0XKq8pU9XveruAbfRNtyP\nNWdQJ1rTOzsRcasCj+KDqr6l5VLlLX2qpk3KyOc+Fdxzm5W1+7UGdKLni7fzNlXf0jIJ3tIFCCts\nv24Ww7wFy2x8HcUnGo7+sSKI8+Nnz6n9y0bNS2mu9Gtf+jSVdonZ/MWe5gzpzBXeBy0RXNfbH3N3\n2P4H7vcC24xuf4H78PElqU+qvKULUMvnxstzwJ1V0evGv+j59QzpZLZMa9JysE9UfUtzpIal9CmK\nm5SZXdID7lrWG/dbIm5ScqXcigi2GphqXkrzpcpb+nDlTUq+HjX8In+7Zrdk1fSc0Xg+RlaFt+yd\n7FybX03NS2muBG/pkxQ1KTOfuwbBKOtdW8+7J3WS7VuD+ByA15Ixsk+kPulXvfShipuU2fXI8+6p\ntvk+kWpNTLZFsEmJj+E2iDchvSm5tmkTM2pg+mPhc1bzUuqTKm/pk1SzS8zKyrUH3GyjRImTnhMv\n1PatVeJzKvDorwp8bFXfUltqWEofprHqZpD1NChrOe+euCGq9QdntJ6JK5qkxPvUmpR+O97Ga52o\neSn1SbaJ9ElCcLuyBmXPacVq0J77Mef9Eeac4zYrrZLoF0aUA8ecONsxfvzaLxHp3qXKW/oQlVU3\nZ7ozK2EuuHuh3TMmH61rYlYCdU4VHsUEo+074yihqm8pkipv6d01bVKaTUFuFidL8HJtfeysguf9\nesX3iZqV2TQlVuEvtO0r3cePZbS/mZqXUk1qWEofKKyyGbZZsqQF7iwimMUCa/nuWpywt1nJDcus\n4Vp7/biPmpdSLFXe0rsqtktcDvIsWdIDbtyOt2XX5wjvyxG/qMo2iyOD7HNjpR0dW3631JYqb+mD\nFfncZucHd09ccM7qglyRc5XdigzWXl/0Xvg+qr6lWGpYSu+madUdxQRrDcoI3LXVBvmy0f6sWqok\nUramCV5uRQajqCA3MLl5acfral5KLtkm0ieI7RLc5pcR3D3Vdivf3fNRz/Zhm8NhixZKZJW0LBQ8\nBjY2jbZlyRfpnqXKW3oX5VV3BOkl4K6lUYz2Zb1nVJAjg1EFXosKYvXtj1FW46q+JTNV3tI7qG6X\nuBDcvM2sD9yXFhXk/fl147YsKhg9piRNpYal9IGKfG4Lts0B99yo4CnPvdak5EZlq2EZef8WbFPz\nUooleEtnVdsuySDlikbkMyD3Lkp1bvUmTXoB7tf5l5prCnBJEryldxLH31ARzBFKURXO0Pb9PxLa\nrGwox2wewCPrKPrFNkrVt6SGpXQ29VXdWYOy1bDsaVz2PMkZ+8760WitbZJFBqPrvAJhFB9U8/Le\npb+/pLOoH9yoDwD3KWjj+1ZhjrHBKC4Y3eaKViNUs1KqS7aJ9MHKYN4D7rWVNkqiL/DPtTrhHx+3\n+fr8Nfjz9u18m2+Prkf2iZqX0ihV3tLJmm+XcIOyBu4Z1TaDdRXsUxu4RGGEG4+zh8dJscnPMavA\neTuvQtjz5LTy4L1Klbd0RvX63GbTKtJsMbixIuaKOVuqpKXsfnjsZiWeRQNrkUFuYLal6vs+pYal\ndJKWVd0IbguuzwS3WVkdL52Oz8RLnmCxu4fL6Y9SNl3J26Pr2KBU81IaJdtEOlHvDe4ToB19uiMr\nJRJCGY/Dg5Ur2D+1U75aPHFpwXYHeM+fCQh86d4k20RarPLP9V5wo84E7mjIcg37RM3HlrLGJR4f\nH5ftlImyvHeU+a7l46Pjqnl5j1LlLS1S/SQLrmh7NinYAe5atY2HiiB9yvyOF7dYZeNjciXuVXhY\ngbs4HhhV3FGVzi8EPZx/p89dulkJ3tKJamW685jbeP8F4G5BO4P1Y/3VFPodHOuPTdMnHN1+gdvM\nKhDf0fVoW4994tAeqm953/chwVuarbLqNpvnc3O2uxPcDG3f3awO7QzWmYWCXjff97fVQW5WzuZ0\nVeEcF8RtZrFP7g9usI9L0cF7kTxvaYFq/myrQWlwvQFuj+JF1fbaSp8Z7eNH+GeW+9eRaoM6fFx8\nTN+P/XDfnvrgUYywJzKYv8fyvu9DigpKs1RW3f5v3lRgN7jNcpsEoW02rZIZ0Es97yjMgdX5b7j8\nh27nJU72lsQJPQLIMUKODNbig/8xRQfvS7JNpJniqnApuPF4FXDPgXYPsHs/8ZEdbVZaJXt4fLZU\nUGyjmBHEownLyPOu2Sd4XzM1L29fqrylbo1V9z82tU7+sXngjuwUWwbumufdgvUDXH5t7MvDOliV\nO5R/021RFZ42MrnCzlYd5Cqbq3H/p+r7lqXKW+pSu0npqiVLDO6bgDuySeZCmx/uwfpU2++VjruD\nx/RqHCtxFCdSHOCTRmaWMOHfGlmJn53UWLpFCd7SDHGTsrZ2CQt97g5w91bbPPviYhCf6nlzhe6P\nhxB3OcQjK2UxwHvsE4b2i6KDNyzBW2pqrLrNpp733AblTHDPgXYPsOd84iMw/wkeJ9sXq3COFVYB\n7k+0F+DR8M6/NvXBpVuSooJSh2pNSrOzg9vjdQhu3MbgfrARqF+DfXhk3uh+D3QMfNl8Xz6+34/3\nMSsjhn4fHLN/gutFbcyZ71aEMPrrZ/w+KDp4m1LDUqoqblI6KLjq/mF1cJsV4MnA7bu1qm2E7Tk8\n75q4mYk29J9gvx3dtreymYmNzLSJmTUwa/FBbmaqeXmrkm0iNRQ1KfFyNDmZaSG4e6Bds0/ooWeL\nrRJuXvJ+frtbKW6ZZNOeqYUy1/9m+wQnN2Wf3JpUeUuphqrbq2msvh3WWIHPsEsc3JwoYZvELAd3\nC9qn+t0uDnqYxZU27vuHbsPtGCnEqvzkCjyquHHd7+F2Vd+3I1XeUqi4SWlW2iVmi8HtaoG7Be0a\nsKNP99whHd6fI4L++Fk1Ht3PbKzCsZG5qALneKALf8OoeXmLErylRNgcQ4skyncvADdaJQzuCNC1\nSjvzu2uf7szCcF86uu+ucUyz2DJhG4dtlAzghSKA75LtbJ/4k1Z08JYkeEsTjVV3lF7AyzyAsxDc\nmb/dqrYjoPMnes4SsLX9f9OxEeRRTDASVuc1HxwBXnU1OU7olTg+GQyWq/q+JQneUiCHAlbaPXYJ\n3p/AbXS3DNwRoOdCm4F4jk95tDwsK4N4C+7RQE8I8FYDMwum4xMxVd83IjUspUL1JmXUsJzZoOwF\nd6914pcfg23W2NYrblri9d/B9lrjErdxI5OjhNjE7Gpg/oe2c+NSzctbkipv6ai4SVkbwDkzuOdU\n2y1oR5/sOeewdPm6JJnw8aNqfI5OqsDZ/47sEzM1L29HgrcEipqUFlzmZuUCcHOiJAN3C9o1YEew\n7omju/Ds8K4M5jt4ThHEs7F6TqksAnh0ZnrOe/MbqObltUvwlswsalLi12gb+txnAHerUdkL7ejk\nxKzWp96L1Oj+WLBGIHeIe4MzSqi0YoXdAHfxjn/oyfNlNS9vQYK3dBA3Kc1iu8RsapeYvQu4o2o7\ngnYN2LVPeFRV1+7DJ3yvsa9WhbOiqtwBbhbHCP+a5Q3MzD7By2peXrsEb4malGbTTLdZCezI5/aD\n2XxwZzZJVm0ztJFdPdZJptq+XGXz2eKz+yLEsQrPbJTovtGp2I5igHPV/TW47DaLmZnOOH+tErwl\ny5uUmV1iNq3KDzoV3PhUlkKbQTrH585Uq7J7qnGspCNlcUKOKHb53/ikIvtEzctbkOB95yqrbs50\nr2l7lj7xgx2+RqkSsxjcmU2C4M6g3et1n/opZ7vELOYdV+O4HV/T3FRKN8Cj3wD+C5ntE79teLKq\nvq9PgvcdK29SRnaJwT4Nn5vFccAM3JG3jeCuQbtmnWTblqplmeBQY3SbV+HczKw1MrsAzomTln2i\n5uU1S/C+a3GTsmWXLPS5M3Czvz2n2q5V4dH1JRlvs3bOu2aZRFW4q2WjRGoCvOZ/1+wTNS+vUYL3\nnaqsuhnMRtsrdsk5wY3V9hJo13xvvM8czSlIM1hn2yMbpdXIzAB+nPrMKuw/8DWzT4SDa5K+W3cr\nrLYNvn6l2xo+91Jws7+dgbsF7V7fm/ftUeZ1R78Y0AKpQfwcVXi0mNVkCdls+jKKDT6ZNy9VfV+P\nBO87VF+TEiFd8bmXgpv97czbbkF7bqPy1E98T+OS93VrY21TsGMz8zdsi5InKAR40/+O7BNcWKX8\nbSqAX4cE77tUrUnZsksOcrvkXODOqu0WtGuNylPg3bN2d5YuYXHFvQu2mS2rwHEyPvW//9Bl3Kbm\n5bVK8L4zffnyP3/rTcoOu4STJXPBzY3JWrU9B9o98DaLbQfW3GZilj7xXwIR5GsA7/nlYVZW6CnA\nIx+cm5vYvFR08BokeN+R6k3KqBrn5InFDcq54GZ/u6fa7m1U4uUM0j3Jk9aZdjLVIoR+OwPcaNuc\nCjxqYP7EDex/1+wTs7KMly5ZgvddiSvqml3C2w6KGpRzwc2g7qm2a43KDNgZpFt+Mp6WjNW7BGzN\nTumpwnsGenYWn41nZR3+d80+UXTwGiR434mmTco5dokfxKbgfrT54I5Oh4bXI4uEod0D7Bqk554e\nzWwK9R6QtyBeAzgO9ETK3oMu/7tmn2Q+lHRJ0nfnbhTZITW7JPG5owblXHCzv43XM4uEedID7Bqg\na5/8JWBvVcqt+CCvHMjHjo4brURoNkA7BHh0wuLIPhmbl1++/M/fv3//j6rvC5TgfQcaq26srM3q\ndknic0fJklPBHXngRtsZ2j3Arn26l3zye6DeA/HWEE8vwPn0bL4fhkuKAZ5e+0TNy2uQ4H0XipqU\nfj7KzC5JfO4oWTIH3JHfHW0z+srQ7gH2ueHNqsG8BvGeIZ4egGevgRMoP22mfaLm5TVI8L5xldFA\n9rdrdokfADZlyZI54G7ZJJlFwtDuAXbt091aS3uuMpC3IN4CuFmeRMleQ7WBmXndaJ+oeXkNErxv\nWNNoIPrdM+ySVrJkLrhrNklmkTC0e4BdA3QrcbJUcyHekzyJkih8mjQUJ1BC/7tmn6h5eQ3Sd+Sm\ntbbRHuEmZcMuyXzuyCKZC+6adZJZJNmJGfgyAjuD29JP/VdrnNUGVIN4TxXe8sEfLfa8DbZHDcyJ\n/x3ZJ2peXoME7xtV3KSMKuzELsl87ihZMhfckU2SWSQZtCNgM6yzT3frU7+2HIy98mNEEK9V4XN8\n8O9GAznw2PhY2MCc+N+RfZI3L6XLkeB9s4qalDyYU7FLMp+bwe37zQF3ZJNkFkkG7ajC5k9z9Ol+\nnJx6PdbvhQXmgw0nVcDnUIP4qQCPXiNDHX+pTfzvyD75x8z+A7f5A6n6viQJ3jeoviZlwy7JfO7I\nNpkL7sgmyartDNoRsPnTHIF6vZ9ui/TdzHbBmCVCfUmF/mgltKMqvOWD4+Ws+sZfbpH/vcg+UfPy\nkiR435j6m5QNu8SB/c1KYJ8L3GyTZNV2C9qFRQCwziDdC+9MjwT0pRU6V+I9VXgG8FYGHBuY7n8v\nsk/UvLwk6btwc+KqmjPd/q9hl0QNyicrwf3dloObbRKutnuhnQE7gPTm8XWyraW33xRZWe/Lihxh\nXgM52ylmcRX+28qKvgfga5sCnH+yX6z0v71ir9onnP3G5qWq78+W4H1DGpuUDuiZdonDGH1urLQ5\nEngKuKNqG8HcC+0E2BGoVwuq7ug4E6C7HORzq/HH4DLbKDWA4339fmyn+C+D1P9GePuOUfbbrwsd\nny19B25KWZMys0sOP5zsc/+wuEEZRQJPAXet2o6gXQE2QjaC9BJw+/325H3jY4UgXwJxfy88jsiV\ndAvg/vKyIR5/H7+Z2S86RuF/s31iFme/1bz8bAneN6IyGshVdhYVPIh97qhBiRaJ/7nfAvePw/Ez\ncNeq7Rq0G8BmUK/Wp+b+SiHQn74/Hy9PQB5BHC0RtlJaPngN4FhpR0M8UQMz9L9/2HA+y8g+MSub\nl1r35DMleN+MuAH5j5WgxmEdXxrW6j63AzvKcmfgxvhgzd/Oqu3IHkmgnQGbYf2weau8bx3avNnr\n26a9G1fk7o/3VuIOdrZRegGeLVfLclvsD1yfxAdr9olX3x4plD5DgvcNaBoNjDLdic+Ndgn73Oh3\nI7gR0D3grtkkXG3PgPb4dYQ1g3plJ6ZLkuNGrU+syP25LoK42TKAe9GM98PfYzv66vuH9glmvaMR\n+vF2Vd+fI8H7yhWfZAGr74Zd8oO+YqLEv7pNsqbDzwV3ZJPULJJOaCNYGdYteK8OxNo3fhRWtrc9\nlLbbzct4vVKZd0PcvW4UAvybDdXx78O/XoCvg8voe6MjEsYHEdRedaMvrublZ0nv+tWLrRCuvL8G\n+9hol7DP7UDFfDeCFxMpS8Ad2SRcbQfQ7gV2eTn3uh+MrZTx+qu1LZLJ8Q7PJwsjFhB3Pa7aVfh3\nG/jIQz3+0iKAZ1541MBE/zuMD7J9gjDH5qWq74+W4H3FmjYpOSKIwE5igexzR8kSbEKeCm5Okni1\nDRZJD7QjYDOsp4Dus1G29lJU2aPemmA/VuSHany13tl+N/6YbR5fpwA3iyGOzc3IRvFt0YJWuN33\nx9v8KVT978g+iewUVd+fIb3jVy1uUuIATmKX9PrcUaWN1gpbKHPA3ai20R7JoB0BG2EdQbpWiUf7\nRlZK+QthhHm0P1bjCHFPqEysFAe4f1trNkoL4LiSIGbH/RcnvhUvsL3wv9k+wevcvFR08KMleF+p\n8iYlVtuBXYKxQPa58WuULGFwY3xwLriDansJtB2mU6+7XYW3Na20GdIPhd0SK7NUJlZKT0OzF+Bu\ngfAUpgt97x1cD+ODXmVjh5Obl4Nkn3ycBO+rVtSkbNglyHv2uaNkCcO9F9yYTDGLwV2xSBDaPcDO\nKnDeb65iCyWuuP1xqxCH5qanU0Ir5RwAx6V3cYjH36o1fcUKvWmfeNWN22WffKT0Tl+hhqr7H8ub\nlA27xOGa+dxRJLAH3D9oe8MmiartOdDutUxOjQty0oQf7/W43wDyEfgD5CfV+uatrwo/FeCYPMHG\nJTaN8Sv63037BA10tk9UfX+EBO8rU9yk5EhgYpe4TYI+9/fkKwKbF6BaAu7E22aLBO2RFrTjCrxu\nn6C4Qq81IxnACHSszhnKWI3jMbyxeQR/VIU7wP09dHa63dED8GiIBy0VFvrfZol9Eo3Oq3n50dK7\nfHWKmpT+Zy02LAO7BGOBboVwgzJqVCK4EdILwJ1V2xm05wC71+fOKvEteA5L0ybjY5b7ZpYKWylm\nkEhZ783Wq6GhiVX4t8OB+PcSrkrIzUrOgPMIPQ7wYHxwYp/wqLyal58lwfuKNK26I7sEq28r7RLM\nb7d8bob1GcEdVdsIYAR0Xn1fZtoEK/Jh39I6wW3+PPe2KqwUf4+OiRSz3EaJ1kMxKwd5EOZZAxP9\nb9+OPcqjfYJrn3A1Xq57Ir2vBO+rUlZ1z7BLcDcH+SP8iyKBnDI5A7ijarsF7RqwW8M56wW+t99n\nB1X4orRJUHU/2NT3rlbhZssB7opsEm9gupWC/jeGS1L7pEyboFR9v68E7ytRGQ3EhiQ3KRO7xIGM\nlkiWLPGvj3S5B9yPlkLbzApwRxZJD7RbwGZQbxbFBPH+Zm9ggaxtfwR6lDbhavtYXVPV7V752PCc\nVuFmMwC+tnJlQbMY4Hv4ajZtYJqV639Ppi/ZPuHReTUvP0KC99XILRFfLdA97h9WrhgIdglCGmOB\n6HPjyoEcCZwD7mM2fH61nVsmfWkThDWDumWV4H2xwmY9UcWNQHeYt2KDGcT5utk0kVIM9tgmT6Lw\n0rB4Rp497cNf0f/23DfHB2fbJ0LMe0nv7BVojAbW7JKtTewSB67bJeh382QkH5r3ORO4s2o7g/Yc\nYDOoM6skq8SxFfkWNCax4ub9+VrpcceWilsnuC/ut9282H6zste3zXE6c/P4OhzRG5k/A4gjwLPL\nK/qa+d8cH6zaJ6q+P1KC94Wrr0lZsUtwYAYBjnZJLSbIXniUSJkJ7qjangvtCNi1ChyP1aOnQ8ON\nUydRxT3sPwCYLRbOfk8ig2SdYBV+rOJrNsr3Dh88grYXzv4VF7xi/zuND/qHysH9w0r9MVXf7ye9\nqxev3iZlxS5BmwTBjXlvjATyWXMWgHvz+DoZuClBzRDPI4IZsDNYz8l6txSlTp4g182w9m18yZVB\nvFWFN31wI4BzE9NfAsYFowQKg9tsOj4/sU9c0ej8IDUvzy/B+4I1bVL+Q19/2GCXQNWNdgnbJOxz\n8zonEcTdK+8A99P350XV9lJob6ydNFmSMmFFqROUPw8HuVfkWTVuNvXE/b3gKvxsAI/OXcmAxwam\nNzmxcE6nL2WffIYE74sXNikzu+Twk+abMRaY+dxZg9IhjuBGWAfg3hyhXQd3Vm33QLsX2C3rhPfP\nFGW8M8sEK+jxMafVON4/y32blVX4CPTBRllt9kcf/O33wzKA4+COf2YwUYIDPFiN++fBldonal5+\nhPRuXqj6mpRklziM0S5hn/t7cLjIGukB9+Nbt7/dqrYZ0K0qu22dnJb1zqrtpwLUeeLErRWuxmsQ\nn1uFm5ntd2tbrff28nM73NACOI/Ru7CBWfO/zRL7JAqRq/p+TwneF6hFTUqGNdok2QRldFactY2w\nPwHcW3tOID2FutkAv6zSbjUt8Ta83XVKzjuyPKJG5bj3FORYjWcQN0sigwDtmo3y9P25DnD//rtw\njH5v0wZmzf8O7ROHN1fcBttVfZ9TeicvUlGTEjPd6HvDLmiX1HxuHNjx/RzsOHWJFksD3NvNy+Jq\neym0+3Lep3veUfIkgnoEcn+eWI0zxPF62KwkqC8GeFRx/7bp2t/I3Mj/9s+Qq9s+MTP7o+blmSR4\nX5imVTcvOFWxSxDKNZ8bLRLOcuO4/JqOEYB7u322Xpskq7Zr0O5tWg63tVMmvdZJ1Jzk5Ak3Kv34\nrWYl++Ij9Mf9xlTK4HWPwz3jsM+rbezNHiYA3+9W9vZzWwf4HyuHeNAucaEPjrab2RgfDO2TWvMy\nslekJRK8L04M7Rl2idsfPP6OPjfC2Lc/Bv/eEdwI7eEV77ugXQN2K2Uy1zrJBnayRiXGB3ublZvD\nlrdj/T3u548RVeFlJvzQXN2UFfnm+3Md4G6POJzRLokamOx/o31SLF4VwXnavFT1fboE7wtSeZKF\nqEnZaZcwmBngmO9ew3W2ShJwe4ab4byx19nVNjYilzYtcR/cz3VKztusbzTeH2dJs3J4vlMrxdUC\n+Oth79Vmb88AzxTguG7J8CL8hY7CBib7326feKU+WbyK7RNfuOrF1Lw8nwTvi5LTEhuUmOmu2CWc\n6/YfuOjEC1Ek0K8/2mxwb+1lVrXNFkkPtJekTDKLpOWDR2t5c/okS52wepqVGAk0i6vwSWTQRlAj\nzLeblzbAPTLoQOYIITYw2f/2hrhZGR/ssk8c4mpenkN69y5E02ggxwQbdkkUC6w1KPl2BPcxnVIH\nNyZK5oC1ZCutAAAgAElEQVR7U6nG8frwMpeNx0eAXpI6YSjjet218fgsOthKnKCV0qrC0Rc3swLg\n+83Knp+H5mUB8F0D4FhlI7jdRnH5ZwlP3mAW2CdZ83LojKr6Xi7B+wIUNykrme61Tdfoxljgo5U2\nCTcoOVmCVgku67oA3Li9p9pmT5ttlOHltlMmCOtz2iZPh/vy0M5YNU9hnoF8OF5f4sStFKP/zWIb\nxZ8LVt3b7fMU4N9hMSt/SY/01VcQxEqc/W+MD7omi1etbZgAdrltwlaKtESC90Wo1qT0EfiDbcJr\ndLtdgrHAyOfmrDZnuYsTM+TgLn1t97rfZlXbbJFEYB/eldxKyWDdY5vwfVg9KwqyD57bJuOlGsTH\n5mdchfvtaKMgqB3oW3vpBzgCGbWzOO+N9hvu63/BNe0Tzxf+gW3/qHm5UIL3J2usurlJ6ZnuTrvE\n7RA+9yT73rhEbJTt9pH3DnAPXvc8m6RVjZuxbRJDe9mqgn0V+BPsx41Ks/qqgn67V+Rcjdcg7o+B\ntkmtCkfb5M0eugDuJ4BOAf7HYtuEs934x2BUhR/tkyz7XTYvpfkSvD9dP6ystr0CTzLdWbXN9gf6\n3OxrcyQQPW5Yq2QJuL152VNtR/HAKBqYAbt3NP6UxamiMfnWiHwG8vK+JcRbXnfLRjEbf9E4wPe2\nsueDbeEALwZ51ms/gL/YsuLOGph7m1brw5sUrP2NKw/uLGteqvqeL8H7E9XXpAS7xJMhPEXp1XXk\nc3Oum9f4Pq7l3Qfu0dMuI4Jzqu0oHtiCds9oPEM6S5Vs0rNNjnqjctKPVWtW+tHLx/LjtSHOVbbv\nw4kTt1FewE/GyKAZNC/tOQf4dzP7uS4LX1+QKmtgcuPS/e9u+8TvpOblqRK8P1UYDeQmJa4maHW7\nhH1uBDY2KHnxqRPBPa2y+8Dd8r5XiW1SAzaDmgE9t/pe27OZxZOWDvY5zUoEcQZxf10IabNppe2A\nf7Ln4zFfwTbZWNm8nAVwHMbxSCA3MNH/brke/2tB9hsfzD/7ig7Old6tT1JZdaNtUsl0o13yHS5j\n7A+BHTUoMRLotx3W4/bJyRa4s0QJWikZtM0svH3Ynq9z4tvMIv97BHVv9d0rrriHx3guoM4wr43I\ntyDOscHMKpneNv6iwShhBPDVengfJwDHipvTJWinRGuboP+N9snxxMXZUrHevPxhWvdkngTvT1DZ\npHR4r630vw9f3S55sDgWiNU2+9zcoOSTDa/N7PvO8EQKPvLeC+4ne55dbbMNUoN2C9i1bHec9W5b\nJi60ThjieD2COYMcG5GYLmGIc2yQrRK2UV4OcB4x/kpV9xTgOMhzXA88GuJBX5sbmOx/d9kneABf\nAQubl2pczpHg/SlCe4QtEvS+rd8uyXxubk4Wa3v3gztuWOZwfjhkIGrVdi+0M2AjnMvo4GmWyXi/\nfusEAey1L8I/S52sqOKuxQajKtzTKmPFPiZRegC+efTX4/eFDDgnUFx7i/3vmib2yQ9T8/I0Cd4f\nrLhJiQtPba3bLsFGZeRzc4MyiASeC9wjrPvigatgW7TPsP21CuwltklWgXOjEo/Rsk4Y5LgP3m42\n9bpj2yQekWdQD5fGX4LeyMTEySyA7yBCyAkUznmz/z3LPkFol81LqS3B+8OVNSnJ/+6xS1o+Nw7y\n+P2CIZxecDOgnxY0LHuhnVXZvbZJBOeeCtyrbVd/wzIGNYM8g3jZnByAvbd4oSoENTYsuZE5gXUP\nwHerMQPuv8cwgeLX0Z6rsdaL64l98mJl5V02L1V9tyV4f6DqTco1XLbYLomq7czn5tH34yqDI7g3\nj2+2Wu/M/execGeNyVrDMrJIYu/7tbg+7F+3TS6vYZlX3BnEucqernky/j9cyhuWsXWSA9zXA1+t\nV+UUplsomEDBBiYr8r8R7DuD0XnOfkfNS0UHaxK8P0jl+iVP8A+blIcPdGaXtHxuHMTxBiUmS76P\n05MObj8DjgN7Lrh7GpZcbc+BdgvYl9+wnMJ6SHTvaft0nROsrPd0HW2UZ3uaNCxfjoCuA3xlu+G+\nh98Ab78fRoCvIUKYNTDR/+6xT/y+hX2SNS+17klNgveHCa0S/+Amme65dgl+5YGd4yDPmOXuBTcO\n32ADstWwdKAjtId3IIJ6Ce0Izp/dsDSb2ie1hiVX3tm2DOLcsGxV4Vt7mfjgT/ZSANytFQa4f2WA\n23o/jRC6/ljZ0OxRaJ9g89JsgPU/pnVP+iR4f4Cm65dgk5Iy3Vi5rCxvTv6gbdygXBvlwMchnFPA\nHTUmownLrNpmGEfQ7mlYRrDutUxW+zbM96sS1lx516rtUq/B7WUahSHuKjPh0yocJyyjhuXTsWH5\ndER7D8D3u/WYAccIoX82nbU+gcn+d7d9gqmTJ7iMKw6qeZlJ8P4QoTXCTUrKdLsV8g3uktkl+IOT\nNSghEsjTk6eAu8ffzm97tcgeyRqWmfftt+NtZjGcH16Xn0H+9WGscle2P4I9s056kicRxIfXM9os\nnP32/8eBn3HCEv3uacPyZR7AtzZOYfqjegLFbGxg1vzv4g202D7512z8mVDzcq4E73dW3KSM1jOx\nAb5eVSO0s8o7OosONigpEujgdpj2gpsr6wjcDwevtQfaw0uNt2VVds3jRlgzpFfJQoLZ9n3wE7Hd\nvYW3OdQd6K2GZVR5x9fNzF5DKyVa16Tmd492ST/AV7Y6jtFvHl/HCCEmUFAt/xujhWifrA3sky3s\noOZljwTvdxea0k90HTLd6KCwXdLyublBSckSz3IjuN2zjsCNTche33tOtd0D7ZbP7cB2WDOM+fqX\nzj7lmvb7C7DyYzrEt7u3AuivD5smyP01tCC+snE6EytzBzVW3fvjL7RycGcKa/TGY4D7CoVv9mDb\n7ej5HyOEmEDBDHemnXXaJ5j99gSKmpc1Cd7vqLHqzpqUM+ySms/NZ3z3ZEmQ5Ubobu2lC9ycKGHf\nezXZpw5tM5vcbjaFdi+wEdQTSLeW8Mbbg5+GL8HtDvi/DyXQEeY1kHtFvTr8H0G8HBbC20tQu40y\n/OWza9olvM45AvyBbnuzB1utd2MG3BMo3MDEAZ7I/0b56Ssd/M7nI9W98ubmpVYdZAne76S8SYkL\nT1XsEm5U1nxunKDEBuUhEohDOAjuAcT94Gb7BM+iM6farlkoZuRzN4BdwHqXXHa1+pTR7dh/9GP6\nACwshLd+HWFeA/lw9xzivq1MoZS3I6gjG4VH47nazgA+fTvWxyGeYwac/1r03sq3yd0HvdB+yGjv\nVxYnbtjaaKRjJa7GJUvwfje5r4FNyiDTndklHAvMfO6kQYmRwDK3PYLb/W6ENE5N1uwTtknKeGAO\nbbNpyiSDdhPYO/pqNgXw71nftLrw5ARmY+SNYJ6BnKtxjgnGVsm0Cq/ZKJHfzbCOpkZf7cGOmW+Q\nT2GaQYQQEyguHOBh/xv1x0oWT07cgHlvBLfWPWEJ3u+gvElJme6aXcLNyczn5gYlJEs8EojWCIP7\nwV6r4I62rYw98HnVdmSPrGxfVNndwEY4IKijKnrJeYjxJ+TX4Suy79FCmEcgX1E1bqs4JsjbuArH\n6xwbfDpCO5q8dA3NzUhos+xtXUxhuooEinvZke+9szg+aDZCHCPexeg8Rgi9eanoIErwfhdlTUrK\ndNfsEo4FRj531KCEZIlnuR+ONdjbBNwbe5sN7sjfxttr0B5e9r4L2k1g/6bruE92fa4iTxztk18W\nwzwA+criajyD+KDXrioc44EjfNEfH2E9wr4E+M5WE598aGY+Hw+z363LBIpX4D6B6QM83n9hecww\nsk+OKw+yZVJW4qq+BwneZ1bepPTrcFqzml2SrV+CPnfQoMRkiYN6rLzfJuAeKm/0wctFp6JtU/uk\nv9quQbuosnuBnfncUWF5auXtx3QouWWSwZxAztW42RTiw2HQEy8r7awKx5UE3ePGRmYJ68FmiQA+\niQweKu+jpTJa60MCJWpgunY2jQ96hR7ZJ8XKg9isxOalooMuwfvs8oYkNynxuo3TkJldwrHAyOc+\nNjXLM75vt88E6jLbXQM3ZrgzcEf+NvriPdFA97Sr0G4B279mTcvoeiQfIonUqrzxvgjzDORQja/X\nMcTH6c7XiZXyfKRnWYU/2fPhOzraJaWdMsLas+AMcKy8twdz5A2amQ70IoGSNTDRIkHV7JPJ6Hyt\neanooOB9Ro1Vd9SkDD7kNbuEY4GRz328PK5Z4uDGIRzMdiO4OfMdgRvBz7luPMPOnGo7hTZW2b3A\n7q2850QGUXMrb5wmjECO1bhNIe5xvdeHja1W0wbmFqry8rbRGkEfHBuZI6zHtU8Y4Fh5Y+bbv/9m\nw0N5AiVtYOL7iikpntLEytsbwv9rHc1LrXsieJ9J01ObJYtQuV3yaHW7BD/wVb97V6xZgvDFU5ZF\n4I6jgyPUHdzTdbyn/vYDVd41aJuBp12DdgTsCNa1yrsWD4yAzT8ReH8viBnWZjGwI5ADuI+fARsh\nvnoYPPEHe0v98JWVQz/+JNxGeZ5U2yWs3RtvAZzlQPcIoStsYLr/zYtXsX3i7yfbJ/+aqXlZl+B9\nNuH5KKMm5eGDhotH1ewSXuY18rkPDUpfs8STJTw96dd7wY1RwCnMRyD3xgO52k6hjVV2VGHXYF1r\nWpqdFhl0AFHOuwBxDdiZveLPKYH4KvDDx6z326Qq5+ocK2+HtSdRvLpmgO9tP7FOhpe6Lq57AuW4\niJWZFQ1MFMYHGdo7GwoYtk+Of9H8oJ3VvHQJ3mdQGQ3MmpRW2iU+NYl2CU5Rot+d+dyHBiUnS3h6\nkivvHnBjogQbk55YQThn9sliaEcpE96WwboVF4zuw+KfiigiaFZ6t2ubpExSkOO2DOI2plMQ4mil\njIM5Y04et6MPPh3WiQE+3DauhTL0Kbwin05h+iJWm8fXsoGJ1h7HCL1oxu872yc7S846P21e3qsE\n77MIo4FJkxJPsMB2CU9Rsj2S+dyHBiUnS3h6EivvEa7zwM2Abtkk2+eX3CJBaGeAjqwS9r8zUJ8a\nF+T9uVHp2xjqDp0WyHlbBPFdGTE0K60UsxHOkV3CPjg2Ml09ADczqMjHKcy9rS1MoGBvB/Xbxr8g\nMdvtVqFZWaEXKw+yfVI2L++1+ha8T1QZDaw0KT3THdkla7idY4EVnxsblBgJnIJ8rMTds26BGy0R\nBDeuQhilTKrVdq3SziCeATuCNUP3lLhg1Kg0m1ofeDmCuT/XVXIfPz5DHNIpmZWyWpXeNzYzXSsb\n/1zY2/RPkV6Aj9fLMXpMoBQNTPa/MUrI05eRfeL7FfYJQhubl/e57ongfbI8Ghg1KQ9+N1rfNbsk\nigVO8tzT0fcxAvhWgBwr7CXgjgZzavbJar+37a+3HNpmY7WdQXtH+5m1kydmy5uWmfg+Pc1K384J\nE7Px+whxwQLaRtcd+NDw+2LTKvxhxd73WG17Ne7++HB5+hstAriP1L8eUi0I9OHztipBDmV96n/7\na2ffu9s+KReqGqvw+2xcCt4naKi6/9tKn9vpG9gl32x0V9guiWKBSZ6bR989WYLZbgb1UnBHi1Sx\nfdJdbS+B9pyoYDYq75prn5jFPyHRSLzv2xMV9PcFq/EeiCdV+PP2Ce44Vtue0XYffFw9sJy29Hsi\nwFkIdJdHCD2B4iP0+90q9r8fiwOOr9tsrND9Mtonx9H5KPt9v81LwXuhhmjgf9s0YfKPVe0SPD/l\nGq5HscCi6TNtUCK4ywr8dQJqBG9tSIdPyBCBu4D4Adyb3ydAGwHdigridR7iwduM9snEPjYrigr+\nDPYPxuK7ooJsoyDEUQh/K6vw7fPLxEbBattsjA06zIeXM2bBzdoAd/kwT6iN2f5xfXgegf/t4/MY\nItlbCXG0T34bjM5n2W8/6H1V4IL3YuGZ4DnPTZnuml3ih+BYIPvcQYPSkyQYCYxAjWuV9IAbLZEM\n5tiUnFVt16DdigrWYN2KCvacjCHbB8FiFkcFf8L2GsgNtmGDMoJ4BPTf435YhVtgoyCsHdJurTjM\n8au/BRHAd7YqrheZbwY5NzB36/H14CnT+DPgUUKvvF9t9MqPo/PcvPRQwPChuafqW/BeoLxJmWS6\ne+wStFYc4sf8d96gdD8bo4AI6qXg5tOjVW2SX3Y6tFsNS4CWmcWw7p2q7LFP8CeDq/PM63ZgY2Ue\ngZyjglhVc6M0gjj54V9scJjZRmFYl4ta9QEcrRK+Pm7fHkHufnjRwMQz8JiNDVn8nmf2iVlgn2TN\ny/uKDgrei4Trl3gjpZLpbtkleDYcr9KPFXrpc/NiU1iBI5gjkM8Fd5Qyadokvi2CttkI6gzauF8G\n7AjWu+RydL1HfB+OC67pMo/OY3PSr9P6JpOGZTJCnyqowu3b1EYxK1Mno9oAz1S1ToZDH1VMYPrn\nfTzQ+J7Nsk/y5uW9VN+C90yVTUo8kTBlur3ZyHYJQvuHTQHuDcuKzx0lS0bL5CUF+RJwF5FBtkkc\nwL3V9hxot4DNfjhfPveqghwXzCCe+d0IbbMx7x9ZIwzxmpWytyKGt/4V2yg8YDMuEjZAvQfgDGwf\n4vG1VDBH7g3M4xKyu5XZI+DGrWqMU36ny2yfTEbno+blYGPeA8AF7xka1y9pNClrdolDGy/7D7LD\nnnzuqEEZgZsXoIpAzuBmSIfrdu/f2jYJVt1zoY3WCFfoZvHwjgW3m00BXWtYRomUaC0O19y1TSKQ\no7WCCYzM38Z0Cu6DoiQL2ijP34ahHjxPpcOcz13ptkoN4Nm6J37bylaHz9ghRljzv107G8H9YiO4\nfX0UhHqY/ebm5X2seyJ4z5KTuNKkRLvEgc12CaZKDn/qFiPz5HNHDUr/uj5WPW9VkEerBWbgLk57\ndgD3xCb5ZfVq26/X8t1sjWCVHQE7q779+C6G8pyc969gW+Q4JGfQKUBtNn4eIqsEgZxBPMh7HxUB\n/9HMfg82yuqb2fbX6INHscHs5MMtgHvFXbVOXNshPjjxv3dWjs97H5LtE7PyxMU7C7Lf99e8FLw7\nNT3JQtCkjEbgM7sEAe6HI5+7p0HpkUAGN153QM8BtzcmJ0M3aJc4xHuq7Ra0EcwI6wzYUfKklTip\nbY/EPjdui6Yp2eJhWHNFjl7vHIjXqnDf79vwFxL74LYafe65AMd1Tlw+xLOxN9vZasx8UwNz8/h6\nOKbZ0f/GX0juaffaJ2YH+2Rto32yg51vv3kpeHeLve2gSemZbodwyy7xH1a3ScjnxgnKFrizCrwF\n7szznoA7skeySnwutLMquwVshiVfNmPWTBWBObsv/7mPfjdW4WZxysSP4fdjLzuCOD5PrK6j14EJ\npV/jfuiD24NNxuo9990CuF/vrrhRB0P8OMDj/rdX0xgJHB4otk/c4j7aJ/7X77OVzcvBOrnl6lvw\n7tA0GojTlNSk7LVLcPydfO5oECdKlrg3jdOTvCTsEnAXjUn0t7HK9stzq+0atKPqm0frzWJY13zv\nbFvvPlHSBB+zNlFp1o4LIpgjiOPtZnkVjuuHUNSRffCHFUJ6cwR0dGb5F9tOIoI8Nl+Tf0ofNm/l\nAM9uPV3zZGejfWIW2yeT0fmoeXn7654I3l3C9Uvw39aKTDfaJW6PO8Rx0SkHNvrcaytOrPCwGSvo\nrEH5VKnAH+ztJHCvGdSZTYLe9hxoszWSZbvnjMdnHjhqzrremIRw4Ti82dTPNivjgn7/5HRox+c9\nB+JspXi1+svGXwoORU+jkA+eAZwr7ZZ8bH5nq+NXTKCsbGUb/M16aGC+/X4Y/e9XeI1un+B7ENkn\nafabm5e327gUvBsao4Hog/hlyHTjCLxDGy0SnqL0inxyHsrR58YGZQvcWIHPATcnSorGpNslbJNg\nNb5L9pkD7azKbgGbLQuz+c3Kmm3CzctoPe/I50aYY4XtzydaQjbyxlGcTuHb8JfCt8NzX8Nl8sG3\nNjQybTvGBnsBvrfVLMDzfVfr3XgCh98PZe7bbWr/3NTsEzvsM8l+30fzUvCuqFy/BFcKpIWncAS+\nZpfgFGXF544alJwsYevEQY5AXgzuyN9mm4QblwzunzZNj+ySfc2mVXZkoTCse5uVp5xFx2w68Wc2\nWiNmdXskAzlaK49wjAjiyXj8pAr3apvBnfjg3sj0JMrwUsrct4uBHS1UVZNbJxt7Lf3v777+sZV+\nNn/P0T7BxqX/zKXNS6+ebq95KXhXxeuXcNrEykx3zS7BKUo/bOJzj9V2O1mCFTgC2a8zuDllkoLb\nYZ3ZJxHga9V2C9r4wxo1MHualY2z6Pzp8b1BXzlZYpafTSeDOT7HqMr24/dCPLJSvgXH8euYRqGf\n9gjg2LSMmpVRxR1ZJlECBbXfrHL/G983bOaifeLvUWGf8Fl3/Od2Z2Zfb676FrwTdTUpMdONyZLI\nLkFY4/KwFZ/bG5S94B7H4fvBfUyUIKzZ32abJIoH8j5zoM1VdgTsGqwB1AjoXQXWL5UUytNDfP81\npkvsAPfa2XSipiVX5AhobES2IG42DvH8omO5+Jci+uCHbWvzJMrL8Sw9SwDeq1fbjDDP/O/vNp2+\n9NcQ2SfF6Hx01p3bjA4K3qkaTUrMdOMIfM0u8ebSsTqPfW5uUHKyJLJONgD5FrgnGW4Gt1fT7GVH\n+W6uthHsPdDmKjuqsHfBNstBzWCeW3FH+3/FhqQNgPfHdKinMPfnzGeNx7/seZSeIR6pVoVjM9Ph\nblbaKd7INHcyhihhD8DnWCbD01kfh8RQr+tN7H9j09Ih7X/J+na0T4rReQe1++A7u8V1TwTvQNOT\nLARNSsx0Y67bQc52CU5RHk+4EPvcPQ3KWgU+G9wZqDlN0mpc1qrt1treWbMyAbaDE0FdwJy+p0tr\nrq9+PDjgGh4Loe4V+wTmvH53tHaJQ9gshnhUqaOV4sfHKvzRxmam2QhstFP8hMe7eQB3DXmSoecS\nyTMnfPsR5psB5oX/jYtRIbgj+2Rn44kbiux3rXl5G9FBwTsUV9tJkzKySx4ttktwTW8ff4d1S3gQ\nx6vsueD2+7bAfYwCMrhr9glX5z3Vdi+08U9jAHYG6wjUDOhsjKQH5A5tPoY7qr7Psfo+PKcM5l8Z\n2miTGGybC3EUVuEutlHMSh/cgX9IorQA7lYea7htF3rerGENcGiGov+9+2G2g/F5f474/NE+wZUH\n/f2ZLFyFb6z7mdcvwZtURgPR86aFp2p2CUIch3Bg/P24PjcN4nCD0u2RFriHH5YxRTIb3BGgPTHC\nVTZujyrzudDGKhsq7AzYDGsELIN5pmNSvd+aju+AR6BnMH96gIrcIYRreDPYEeIu97h5GwLdt/mL\n4Lw3vjj/6o8DAF/t3ob9VzYBcDSJ2athZcIyxeL+9363Mnt8s2J83l9Dyz5BC2WS/ebm5W1EBwVv\nUL1JCQtPObDXFtslDnH3Fx3gEAt0n9tTJe5zZw1K9rzHsfmySTkL3NyQZKij/+3beqtttFgM9mNo\nJ1U2AjuDNYIUYcvV8qltqq/BtiebPq+v8Ng+GrLbEcgtADknRCKIR2ucZFW4v7fod2Pe27ej9+16\nPJxi7TDMMwB8nMB0PdvWeicsh6e0trWVY/V7GuA5rn/C4/P+mszq9snOxqjhMfvty1fcXvNS8C7U\n0aTkEXg+YbDbJV5to8/9aKHP7RDGBmVPJHAbbAutE5yajKKANX+bm5hLqu0OaM8F9o624214uyW3\n9+prcCyswBHsT3S7wzwDuTc912uCOFoqvRA/NB+P+32z6WBP5IOv6etBPQAftDkWEtyMxAhh5Hkj\nuF9tM/rf31dlfNAtEVy8yuB9Qftkkv2+3eal4H3QWHVXmpQ8Au9V9Xeb2iX+Q+M/SB4LTHxuvOwL\nSkWedw+4iwo8AzcnSiLPO7JJspjgHGiTNfLyWloiCOwM1hGoP8XzPlxGYOO+EcjdK49sldkQN4sb\nld6UjIaX+Kceq3BQBPDM8zYbVx7c2JvtLT/TDsN8+JvyAG72vz0+aDa+8Wyf4OcuzH5z8xJ/tq9X\ngvdRXHVTk9J7HTgCn9klPEV5iAXi+txjnru0RhjW6HnXwB163nPA7YCOmpdsk/ScjGEGtBG+COcM\n2Of2vBm62f26PG/aF/fhx3qyuBqfQNxs/EsFLQ4X7+tPAD1vtlH8fvgVAX7Y9sXsOE7vHvjpnndp\nnfgAT+h/e3wQLREHtz9P/6yhhTLJfnPz8vqrb8HbWk3KINPdskt4ivIQC1yt97A+9ziIww3KzPMe\n8954IobpmiYhuNH+4EQJgzuLDvZW29EkpsXQ5io7AvZcz7u3Ap+zDwLarKy6q563xSDHbVE1HkLc\nG5u1KhwflNc4+UnbI8/boUiV+PrXaQCPPe+1YTM09b9tHU9fsuftz/sP/JvYJ7fTvBS8zSxuUlYy\n3UcbxHK7xKvvQyzQx98jn5vTJD2eNw7ynAxuBnJmk+BxZlTbGbQZ0HOAXau+8Xaj/ebKgfsvbFtb\nCela1V143jaF9o6um3VAPLJSeDgHfe41XDYr1jjhvHehDoAfz2+aNC7fbGPDGjvTHPgDnPXy1TZH\nsLv/vd+tbfP9eYwP8vRlj32yt6H4mixcdf3Ny7uH91h1sxd26FRzk9L/4ZlxOF2CU5SHWOBqvZ+s\nW4I+9/hDUHrevn8L3Mf99/upVRLZIRGkGb4ZuLlxmVTbLXukBe1eYJ9addeE90frw2z4GPxr4w+R\ng9phHFXdeFsL4v7C/PpXszIuiJexwvbbUI11X46/CFgE8NXO7OF1zIG7nm1rG3s9Jkj2h2YlNzn9\nEz38tfhyvLy1FxvPwDNc3m6f++wT/yz65xNhPlm4Cn+IfZT+Otc9+fL379/Pfg6SJEnSTP3XZz8B\nSZIkab4Eb0mSpCuU4C1JknSFErwlSZKuUIK3JEnSFUrwliRJukIJ3pIkSVcowVuSJOkKJXhLkiRd\noQRvSZKkK5TgLUmSdIUSvCVJkq5QgrckSdIVSvCWJEm6QgnekiRJVyjBW5Ik6QoleEuSJF2hBG9J\nknKg3DgAAAAWSURBVKQrlOAtSZJ0hRK8JUmSrlD/H/ExLReO/CTrAAAAAElFTkSuQmCC\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"row = prior_friendship[2,:].toarray()[0]\n",
"# we need to add the uninformative part here\n",
"row = row + [1,1,1]\n",
"draw_pdf_contours(Dirichlet(row))"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Now let us distribute more chips by increasing $k$."
]
},
{
"cell_type": "code",
"execution_count": 29,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"[[ 0. 7. 3.]\n",
" [ 6. 0. 4.]\n",
" [ 4. 6. 0.]]\n"
]
}
],
"source": [
"k = 5\n",
"chips = k*(q_friendship.shape[0]-1.)\n",
"prior_friendship = distr_chips_row(q_friendship, chips, n_jobs=1)\n",
"print prior_friendship.toarray()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"With higher values of $k$ we increase the overall concentration of the Dirichlet distributions. Let us again plot the last row Dirichlet distribution."
]
},
{
"cell_type": "code",
"execution_count": 30,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAW8AAAD7CAYAAAClvBX1AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAG7pJREFUeJztnWtz4kiCRa8LCoyAbm/3ROz+24n5u7vzcDc2GBqq9oNI\nlEoy9RYopXMiHMaSUInX0a2bKfvl58+fAgCAuPj27AMAAID6IG8AgAhB3gAAEYK8AQAiBHkDAEQI\n8gYAiJD5sw8A4Jm8vPzjNlf258+/vzzzWADqQPIGAIgQ5A2TxU7dvp8BhgzyhkmCqCF2kDeABVKH\nWEDeMDkQNIwB5A3ggNwhBpA3TIqqYkbgMHSQN0wGhAxjAnkDBED2MGSQN0wCRAxjA3kDFID0Yagg\nbxg9bQWMwGGIIG8AgAhB3jBqukrNpG8YGsgbRgvChTGDvAEqwskAhgTyhlGCaGHsIG+AGnBSgKGA\nvGF09C1YBA5DAHkDAEQI8oZR8ahUTPqGZ4O8YTQgVJgSyBugIZws4JkgbxgFiBSmBvIGaAEnDXgW\nyBui59kCffa/D9MEeQMARAjyhqgZSuodynHAdEDeEC0IE6YM8gboCE4m8EiQN0QJooSpg7wBOoST\nCjwK5A3RMXRBDv34YBwgb4gKxAiQgrwBeoCTDPQN8oZoQIgAGcgboCc42UCfIG+IglhFGOtxw/BB\n3gAAEYK8YfDEnl5jP34YJsgbBg3iA/CDvAEeACch6BrkDYMF4QGEQd4AD4KTEXQJ8oZBMlbRjfVx\nweNB3gAAEYK8YXCMPZ2O/fHBY0DeMCgQG0A1kDfAE+AkBW1B3jAYEBpAdZA3wJPgZAVtQN4wCKYq\nsqk+bmgP8gYAiBDkDU9n6ulz6o8fmoG84akgLoBmIG+AAcBJDOqCvOFpICyA5iBvgIHAyQzqgLzh\nKSAqPzwvUBXkDQ8HQQG0B3kDDAxOblAF5A0PBTEBdAPyBhggnOSgDOQNDwMh1YPnC4pA3gAAEYK8\n4SGQIpvB8wYhkDf0DgIC6B7kDTBwOPmBD+QNvYJ4APoBeQNEACdBcEHe0BsIp1t4PsEGeQMARAjy\nhl4gJfYDzysYkDd0DoIB6B/kDRAZnBxBQt7QMYgF4DEgb4AI4SQJyBs6A6E8Fp7vaYO8oRMQCcBj\nQd4AEcNJc7ogb2gNAgF4PMgbIHI4eU4T5A2tQBzDgNdheiBvAIAIQd7QGNLesOD1mBbIGxqBKACe\nC/IGGBGcVKcD8obaIAiA54O8AUYGJ9dpgLyhFoghDnidxg/yBgCIEOQNlSHNxQWv17hB3lAJRAAw\nLJA3wIjhpDtekDeUggAAhgfyBhg5nHzHCfKGQvjgjwNex/GBvAEAIgR5QxDS2rjg9RwXyBu88EEH\nGDbIG2BCcFIeD8gb7uADDjB8kDfAxODkPA6QN+Tggz0NeJ3jB3nDDT7QAPGAvAEmCifruEHeIIkP\nMkBsIG+ACcNJO16QN/ABnji8/nGCvAEAIgR5TxxSF0i8D2IEeU8YPrAA8YK8AUASJ/PYQN4ThQ8q\nQNwgbwC4wUk9HpD3BOEDCkXw/ogD5A0AECHIe2KQqqAKvE+GD/KeEHwgAcYD8gYAL5zshw3yngh8\nEAHGBfIGgCCc9IcL8p4AfAChDbx/hgnyBgCIEOQ9ckhN0AW8j4YH8h4xfOAAxgvyBoBKEAaGBfIe\nKXzQAMYN8gaAyhAKhgPyHiF8wKBPeH8NA+Q9MvhgAUwD5A0AtSEkPJ/5sw8AuoMPVJ+sGt7v0OlR\nABhI3gB3rDxfXe1rPBAWnsvLz588/2OAD1JbniXW+JP5z59/f3n2MUwRahOYMENIwuYY4pc4PBaS\n9wggdddhCMIuIz6Rk74fD8k7chB3VWKQtoE0DuUwYAkjJ+aBwniOnRDxeEjeEcMHpog4pFcNkjjc\nQ/KGETImcdsM+3ERJh4LA5aRwgfFx7Dl1i3DTeEMXj4GahMYAX1Lu6uPybmj/UjpYx6uwKF/SN4R\nQuq26Vrcj8wzXcl8eBInffcPyTsyELehS2k/62Pg/rtNZU4KnyIMWEKEdCHuufU1FNocz7CmFRIy\n+gd5RwQfCKm9oIYmbB9tJQ5TAHlDJLRNljFI26Xp/w6GIXDCRr8wYBkJ0/4gtJX2M/99l7bddJ1e\nfBg9OIOX/RBbFIHJ0VScQ60dfPuvI9m5qgucKzPHDMk7AqabupuItIm0h1EzpNQRbTwpnPTdPSTv\ngTNNcU9R2oY6adk85ioSZzrh2GDAEgZG3+Ju8yfJvrf8qkOd46z6+J93sppmCOkXapMBM703fF25\n1JV2HerKtil/1di2SnKuksKfl8CpT7qD2gQGQl/irrPfRwk79G+WibxKpVJlQJMKZQyQvAfKtFJ3\nHcF2Le22wi76d9oIskoiL9r/cBM46bsbSN4DBHGHqPJ2rbK/Jv1zE9qIvUoiL0rQVQYzSeAxw4Al\nPIm6g4Zl4q6yvyoDhyvPVx/U+TeKjrvs/lWet8cyrXDSHyTvgTGNN/aj03YVYTeh6v2qpFt3X777\nmMfhS+JFfXhZD04CjxE674Exfnl3nbaL6ELafSbTKsIs2iZUp4TuU9aDP1bgdN/tQN4DAnHbtBF3\nkbTLjuGZF+6UyTO03ifxpoOZCDwWqE3gQXQl7j6k/aiZKYaiAUiDT6KhauS7Z59NaxQqlFggeQ+E\ncafuqnJsmrabSLtt5dI1RVMDQzL1La+TwoeRwEnfzSB5DwDELXWftptIu6qw21QrISkWTQ0MpWjf\nct+gZuj+JPCYIXkPgPHKu09xdyXtNv14V9QdlPRt3yaFPz+Bk77rQ/J+Moi7K3HXkXYbYXfxkXFl\nWTRN0JfIfUk6lMJ9KZ4EPga4SAd6oC9xhy5W8W3ru3jFd/+ii2Xmnq8uKNtv6Hjc4/dt4y4LPWbf\nMYXo/38g4w0x/UFt8kTG+YZtK+62abtq0q4rsNB92lB3Op+7vZuq3fV1tw/9u0Xbdwv1SXWoTaBD\n2v7u6TbiriLtOsLuevpg0VWRBluO9nEZobrViDs46a73bV82kEmFEgsk7ycxvtTdh7ibpu2m0m4y\nqNkFVa+UdKValKzbpvDnJXDSdzVI3k8AcVe5f5O0XSbtqsJ+xAyU0KCkFE7S7m8KLErWvhReNJjp\nrq/zh47hGZC8n8D05N1W3F1Lu03KL9pvFeom2joJ2V5XNYU3TeCk72dD8n4wiLvofm3Tdl1pV6lX\nfPsJ4bu/b1qej7Pn/gfdTxX0pXFfEv9ecB87ZTdN4PTfz4bk/WDGJe8+xd0mbRdJu+s+vAuqzPqo\nkqrrpvBhJ3DSdzHI+4Eg7tD92oi7K2lXqVZ8+2lLlasg60q5bPuQwIv26e7XBoE/A2qTB4G4Q/er\nI+6qFUnb+4SOLbRdU9xaRMrXHGabsuN0qxF7YNNXkdjblg16UqEMFZL3gxiPvB8l7iZpu4q021Yq\nvu2aUiV110nXvm2rbufeHk4CJ337IXk/AMRdd6CwroS72t53LH2n76bYcnaPxzdIaadwdzCzbCCT\naYRDhOT9AMYh76GLuyvJV03ffVFlELFuwq6bwtskcNL3o0DePYO4bdrWJGUi9km7rrCHkKptygYc\nQ4Kusw0CjxFqEyjh0eIuS9Bl21bdrqGwu/7ElLYPdU8mvt9rYg9UmgHNshqlTYXCAOYjIHn3yPhT\n9yPEXbUiKdquLKUHcB9e0Tjla/nu9BVY7rYjpUIvStVVU3bV9cNK4KTvDJJ3TyBuQ11xV+2260i7\nRsq2d2ffzSfnWfGu7lhbty+efRu5uxc93nmxahoPpeyyFE4CjwGSd0/EL++uxV1lYLKoJqlSkTSU\nttlNSNY+SXdVjbtus6VuZF4ocndHdnIuStl1E7hvnbue9P1ISN49MG5xV71PSJxtapK60m4obFvW\nRdf12FSpTaT76mR7/e6bCLJWKvNXz/0apfGD/FML3XW+BC7POjnrSd+PhOTdA3HLu8kAZdfiLkrl\nLcTtq0RcYYdaG5+c20Yf13NfgXXGfRdnu7882+bu5OvDq6bwYSdw0jfy7hzEXUfcVWqSDqVdR9iv\nnmWStLzffeMJITZH67Zxn0/mtsgbSdy+XbVGQeBDhNoEKjIUcfcgbVfYPllXrU/s/RhCVYnk/22u\nS6Uy3zjbfF3va4JxqFbJebPozOJOK7SX2wOZofvUrVCgS0jeHTLe1N2XuEM1SZW0XVPaVYXtk3VR\nfdIm/oRqE19lcnTWfSkfju1KJZjEm6Rw30BmUQIvm0JI+u4KkndHIG7fujbddVnaLpG2L2VXFXbd\n6qTJ76n6y9lPWdI2odZO5WeF07g3ia+UT8c27mCmPVjpu6DH3KdogFO6T+AMYHYFybsj4pV33+Ju\nMsVvHlgXSNtlSduWcVVhu9t1Oef74lnmmxZYlrbNNkbiZltfEq+Uwt0By7IEbn4uu4S/3/57qumb\n5N0BiNtd11TcvnUV0nZdaduHUibr0HzvOh24i69JMBfw2GK3r1q307b59+xAPPesO1yP33TiOYmX\npfCqXffKWe9L4Ewh7AOSdwfEKe+hiLusJqmQtsukvSxYJ+WFXTTXu6j7rjrP2+AOYob6bt/0QDuR\nu4nbJHFzHzuJB/twN3mb2+6UwdBUwqJL6YsSOOm7Dci7JXGKW6on76bidkf9qtYkFdO2Ldoq0rZT\ndpGwQ1WKbzaKvbwuoRkiX85325XuFMGQrIvqFG+V4srYFrh0L/gygVedQojAm0JtMkkeKe4OaxJf\nRVJV2nbK9u3DPlRTNdjLVLLMxX0afbXvRn6BuyeNL2vZWdlJ5qKspbBrFXMutOuUL2uZ2a+571kK\nvyd8V2WaHbuDmL4BTFnLzINjALMLSN4tiDN1D1HcJTWJryJxe+siabspO1Sx2HJ2RV1F3FUHLd0B\nS5/A7cTsu+2rRKR8Gg8l8Uop3E3gsu7YNoH3N4A5pfRN8m7I+MXt0oW4Q/12hbTtq0h8A5Fl0vYJ\n29eD+0QeGrBs+ikyDtso766LslR+Dtw2g5Bza7kRsgm9Zp0vifvGEHODmTZmh+5AZt0EbuACni4g\neTckPnm3GaDsWtw1a5KyisQn7VC94kvY7j6bXIkp+S+dD+G7HF4q77nt9Czr9pfCqdqk7g91lMLb\nJPD++++ppG+SdwPiE3cRzxZ3oCYpkm8baRcJu+yCHlvOvhkokvRa4a3x9eK/RN5MGTRitztxW7J2\nEreTtJvGZ8oncXO8vhS+sx6rfUzek36bBE7/3RXIexKEUnef4g7NKHH77Yppu0pFErqfK+0iYftk\nnZP5Vc7zrLj+trRjtDT/7rsKJ+X81yz3Rxl+HK0zwuZ6MF/X4Gj31VJe2kbMbg1SJHE5260kvVuP\n2d52p5oCt5c9V+AvL//4OYX0TW1Sk/hSd9MByq7EXbHfDg1KVk3bTaRddmKQUllfRf1tecyJefF6\nkiTN5vn//i8XJ4U4nha5ny/n7DU4faXrzn/NMqmfZ36Zh2oPe/mH7uuUTxVXKR/O/nI1SlmFooJl\ncpbZy6lPmkDyrsF0xB1a3qO4+5D2RuXCvpuhksrapOn598udpI2cZ9c4u1A+eS8VlrcW0lGL3M+n\n60FckjR5H08LXc6pwE5fizSt65rSN1eZ2yK3E/mH7tO4kbhJ2x/yVynv130FBzPLEri7Q7PMTtO+\nKYTUJ01A3qOliymBXYu7oN+uI+5NYPu60vYI25X1cnHKSdqI2SxbOuKeeX9xSZ6tpIs1deVo5H1d\ndlwsblK/JLNbWr+cDzeZe0X+qcyDbqf9ofyvjvVVKbLu93F9HmfX/UqWwEN1if2zT+BmXZUZKNQn\nZSDvisSXukNUFbdvmzri9g1M1ui31/IL12y/0b203eX2PjcqFXZI1jNdbpLO1hmJX9O4J227IreF\nbThqoY12ulyfy5MWN7nfpL6Y6aiFTotM5ncin88z3x2tl8B41IjbSPxdWcdtqhTzmhhsl9714L9c\nX4w/rz83FXhR/w1F0HlXJC55dzlA2YO466bttWd7N137pL3x7e+nvq33XmGHZL3QSTOdg6nblrRb\noYQ4WVNXbonbSuCmWrlorpMWN5mbdSdz+7TQ5TzX6Wuh00eSdeQ73ffYn8rXKOb7Tpmcj9fldpq3\nt/mSE4hNj/2nyqcRNplC2L4+GWv6Rt4VQNx1xV0wo6SKuLe6T9tuErfl7dYorrQ3+ZS92uyDwnZl\nbYvabJ8+jHwCt6U9L6lOzk4CNyI/aXFbZ+QsKSdtW+Z7JTmR7/dJlsY/k7zEjZBtcbs/2wOatrR9\n9/cOZIYEHvr9KCGBdz+AOUaBU5uMiqKeu2jbJ4v7rtLQfdo2QndT9kZ+aW91q0YWm30uZa+0LxW2\nLev5db0t7rLapKj7zvfdC6WGzFK2lAr+pKVOWmilvU5aKnHS90oHnbTQXokummmV7HVIkjSNbw/a\n71b6sVlKH/PsjziYZuJV2eCmXaWkB5K9XjaFPbiUVimSv0Lx/X4Ut9dmALMOyLuEuFJ3iLpTAquK\n215ec0aJm65d+bpp+033FYm93pwAAtJOFodbyk60zwk70SEo67m1naRcGjfr09uuvMPd7cV5PVxh\np9vkk7Ytc3PbpO+V9rporoNWSnTQfrHSabHUbH7W5XzQfhmQ+Mx6Tj+uB2Pf9r017IcVFLjpwn0C\nt3fsm6li6Lb/HuPgJfIuIC5xV61Lniju0CCkLXK7AvGl7Y3nZ6ceMdJOklTSW+1uaXqlwy1hZxLP\nJJ1of5fCXUnb/bebwKWSqYIWdq8tZRL3STskc5PK90qUaJ/7vl3stFts8xJ/vdYpy+vzaIddk8LN\na7a7PaBM1PbYYnrw1kCm+x70Cdz8g7bApfIBTNK3C/IeBUMRd41+2xW5XZMYMZu0bQvblrrZR4m0\njZCNrFOJ74PCtteZZbakfV24oaz7DvXdvn47XT6//h8gFfdeq5zMEyU6a6YPbXXWTIkSHa9SPxiR\nL5JM4qZOeU2k1Usm7ZWyE6WdvlfWbfutYNhdX49GAre3D81AsWkn8LGlb+QdIJ7U3UTcdZZ3LO5c\nUlY+fbszSXxp+07s50Jpm37biNsWuV2blKVv34DlwpG4ocpcb8k/y0SSJ3Fnsn7TXDttblLf66CL\nZkpu/XfWg+910F4rrXS4k/jh+0WneZJOMfRVKW4S1/X19Im8UOCh30ZYdQoh/XcI5B01dQYobcou\nwulB3HeDifLXIEVp2+61N2d9Wx6VbA+3TjskbZOkN9pprsttnVlufnbTuVupuMvdqYNNZ5y4PbdZ\nZovbHpjcanfru83yrXa5/nuvlT60vUo80UznvMR/22q/2evwkei0SbI+3FQpr86XXaMY7LeP8eud\nwIsGMd2+265U7A68u/57TOkbeXuIJ3WHqFqXuOvtdR2J2xa1PehoapJb9aH7tG2vsyoSM097tdmX\nStuk6uQqLl/6zi/PJ3B3OuFt/eUq7vNZy+OP6+3saXipMN3753Wq9+X6VB+X33SZX/vvWT5977TV\nm95vMt9rpe21637Tu/ZKtNNGb1dxJ0rSwUuPxGe6pI9lcdTyt5P2r6esD7erlNAfl3hVvgeXspko\nkjUXvI7A7Z/tSqX7/nssAkfe0dJnz92BuO3pfG6itmuSrbW9XY3YadupSMw8bSPnkLRtOdspe6uP\nW11ihJ3okOvDjawT7bW4nG6Snp2vYjYeOSq75Nz9Y8ElvLxmT5tm0vz1h6RT+vzMT/q5TMV+XH7T\n7/N/aT9b5WRu0rcReZq+V9em+3BL41vttNPWkvjh+hxdbyd7zeZv91WK/bqaL7sPd/FOz24qcKnP\n/nsMcJGOQxyp+5HitpdXELdvINI3nc/I2Za6K3AnbSfbg5Ikk7OZPZLcFHYv8yLBpzLPC3yho5LL\nIS/rT2WStn97n/1X3O3bhqL07cpx6dw2z99MWdKdS+d1KvPDMh2oPCi5E3n2jKRp3H6G8hJPcsl8\np612+206oPmZSB8v0j+Vytr9Mst3ShO4fZGP2SZ3NWaVC3nsn6tcwNNO3rGnb5K3BeLuUNy+gUlX\nzu4g5FqFadtUJK6iXEG7VYm93tzXJGxb2Mnn6V7W5pLyY8l3KZO1nbx91bddR5jfpW2Ebd+2v6/T\n2/NXab7+ofXyQz/X0n6903a5y4k8fVQrqwtf6V1vtyrFTeLpSS79n8ciOSpJEr3/20rh/5S/RjHL\nvitL5j4KE7g7v9t+r5b139NO38h7UvQkbnumyN0FM/L326683ZkkgbTtk/FGu9vPW+1u1Ygtdztl\nm23uhP2HUtl+KBWxLW77tpvAJb/EJf84m/2pcxO3uW2n7rUykZvba+llI61nP7T+NS9yN4Gn4j7c\nSdwsS090ybVKSrTTSbPfLtrZXfj/veT/UEWRrH3kBG7P8XZl7ptCKGddNwKPvftG3lfGn7qLxG3f\nr4W4fTNKbHHb/fZdNWJtE0jbtqTdn1dXKbvS9gl/ddwr+fxxL+zP65cta7O+KIVL/u5bCvffRoQz\n5+eC1J0T+dr6+l/pZS2t1z+0/v1D5/WH9uuF9rNVNtf7+izkJb7XTlslOuhdb5rpor0O2WCum8Lf\n5+lx2H99R87tInICt38bYdEVl1X672mCvKOhC3GHltuSNssbirtoYPJN+QrFrUkCaftN73dCNsts\nKYeW2Sl7bgRtuln756N125a1vc7Xe5el7xB20jY/hzpvW9omga8l/aq8yP+Q5hvpl/VJ299OtzS+\nu57ajLwTHbTTVqurwNPUvde73rTU8Toz5ZJL4R96S2sU+5htca9ULnKvwKVsHqJvAFMqnv89zfSN\nvBVD6m7bc/vWu+K2l3co7lwV4vkqSNu3eiMgZ/vn/zKSlnPfy0HbP05Zyv4s+PKlb5/EnfR9+JL+\nuqTfpUwpe88rYJNYT6ckrV6l77P0uzd5r5WJ3Pf1a/72y7+yNP62/tD7L3mJv+vt2n9/3H5e6KSN\ndrckbua3L5KjZv9z1u4/26xGke7/52BYKoxX4O5ApPue76//jlXgyDta2gxQ+sRtlpeI26SrInGH\n+mxfZbKVvv3+WZi2t9rdKhJTobxZsn7Tf+6kvT3usmrk38rE/G+FhW0L/qw7kR++pD8/01V7Ff/i\nU+l+KM7l7v8/X9dn/DN7JX6RJXUjZzt5e6SttaTfr99/Sx/T/Ffpb79+6O3XTOKmTjEVikneO201\n10Xz20VJaRe+XJy0/O9TWqNom84J/6c5+Ot3V+KhJH4n8K1ng5DAbztwmFatMnl5x5u669zX7bml\n/EtfUdz2f+XriPvVs+xvuqtJsiSdDSzaok7X51N4KutM4G+X97Qe+UOpiO20bYv7Q+UiP6ay3n2l\nst4pL2oz6c2WtS1xKawS+1X1nUJXSsU9l7T6ut7+TL//srZEfq1KbifDz4Lvn9L8KP3t80Or3/Za\nLfdWws5+Ne4tbVu3d/Yv2/otrb1P2koqCaxH3XvZPFm3KzF9f/uyTM6++qQ5MaZv5nkDAETIt2cf\nAAAA1Ad5AwBECPIGAIgQ5A0AECHIGwAgQpA3AECEIG8AgAhB3gAAEYK8AQAiBHkDAEQI8gYAiBDk\nDQAQIcgbACBCkDcAQIQgbwCACEHeAAARgrwBACIEeQMARAjyBgCIEOQNABAh/w+o7JNE5uJhqwAA\nAABJRU5ErkJggg==\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"row = prior_friendship[2,:].toarray()[0]\n",
"# we need to add the uninformative part here\n",
"row = row + [1,1,1]\n",
"draw_pdf_contours(Dirichlet(row))"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Now, we can already see that our belief centers to the belief that the third player (because we took the third row of the matrix) prefers to pass the ball to the first and second player. However, we have more belief in passes to the second compared to the first player. Passes to the third player are not believed in at all, because we initially set the diagonal of $Q$ to zero as we do not consider self-loops.\n",
"\n",
"For completeness, let us animate the behavior for the third Dirichlet prior by incrementally increasing $k$."
]
},
{
"cell_type": "code",
"execution_count": 31,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"execution_count": 31,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"fig = init_plot()\n",
"# uninformative starting part\n",
"alpha = [1, 1, 1]\n",
"\n",
"# distribute chips and pick the third row\n",
"def f(a,i):\n",
" if i == 0:\n",
" return a\n",
" else:\n",
" k = i\n",
" chips = k*(q_friendship.shape[0]-1.)\n",
" prior_friendship = distr_chips_row(q_friendship, chips, n_jobs=1)\n",
" return prior_friendship[2,:].toarray()[0] + a\n",
"\n",
"# change our ugly global fps variable\n",
"fps = 5\n",
"animation.FuncAnimation(fig, animate, init_func=init,\n",
" frames=30, interval=1, blit=True)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"We can say, that with hypothesis matrix $Q$ we express a hypothesis that gives a direction of our belief. With hypothesis weighting factor $k$ we can influence the strength of this belief. With lower values, we give the hypothesis more tolerance to other parameter configurations that surround the single configuration specified in $Q$ and with higher values of $k$ we increase the concentration around this configuration.\n",
"\n",
"Let us now also elicit the priors for our other two hypotheses with an exemplary value of $k=5$ and again visualize the third-row Dirichlet distributions."
]
},
{
"cell_type": "code",
"execution_count": 32,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"[[ 0. 4. 6.]\n",
" [ 6. 0. 4.]\n",
" [ 7. 3. 0.]]\n"
]
},
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAW8AAAD7CAYAAAClvBX1AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAHFNJREFUeJztnW1z2si6RbcHAja2E0+SU3f+7anzd28l5zpjG2zGxPeD\naPSo6ZZaL4Be1qpyAUKAwNbSzu4Wufr4+BAAAAyLPy69AQAAUB/kDQAwQJA3AMAAQd4AAAMEeQMA\nDBDkDQAwQOaX3gCAS3J19Z/DXNmPj39fXXJbAOpA8gYAGCDIGyaLTd2h2wB9BnnDJEHUMHSQN4AB\nqcNQQN4wORA0jAHkDeCB3GEIIG+YFKliRuDQd5A3TAaEDGMCeQNEQPbQZ5A3TAJEDGMDeQOUgPSh\nryBvGD1tBYzAoY8gbwCAAYK8YdR0lZpJ39A3kDeMFoQLYwZ5AyTCwQD6BPKGUYJoYewgb4AacFCA\nvoC8YXScWrAIHPoA8gYAGCDIG0bFuVIx6RsuDfKG0YBQYUogb4CGcLCAS4K8YRQgUpgayBugBRw0\n4FIgbxg8lxbopV8fpgnyBgAYIMgbBk1fUm9ftgOmA/KGwYIwYcogb4CO4GAC5wR5wyBBlDB1kDdA\nh3BQgXOBvGFw9F2Qfd8+GAfIGwYFYgTIQN4AJ4CDDJwa5A2DASEC5CBvgBPBwQZOCfKGQTBUEQ51\nu6H/IG8AgAGCvKH3DD29Dn37oZ8gb+g1iA8gDPIGOAMchKBrkDf0FoQHEAd5A5wJDkbQJcgbeslY\nRTfW9wXnB3kDAAwQ5A29Y+zpdOzvD84D8oZegdgA0kDeABeAgxS0BXlDb0BoAOkgb4ALwcEK2oC8\noRdMVWRTfd/QHuQNADBAkDdcnKmnz6m/f2gG8oaLgrgAmoG8AXoABzGoC/KGi4GwAJqDvAF6Agcz\nqAPyhouAqMLwuUAqyBvODoICaA/yBugZHNwgBeQNZwUxAXQD8gboIRzkoArkDWcDIdWDzwvKQN4A\nAAMEecNZIEU2g88NYiBvODkICKB7kDdAz+HgByGQN5wUxANwGpA3wADgIAg+yBtOBsLpFj5PsCBv\nAIABgrzhJJASTwOfKziQN3QOggE4PcgbYGBwcAQJeUPHIBaA84C8AQYIB0lA3tAZCOW88HlPG+QN\nnYBIAM4L8gYYMBw0pwvyhtYgEIDzg7wBBg4Hz2mCvKEViKMf8HuYHsgbAGCAIG9oDGmvX/D7mBbI\nGxqBKAAuC/IGGBEcVKcD8obaIAiAy4O8AUYGB9dpgLyhFohhGPB7Gj/IGwBggCBvSIY0Nyz4fY0b\n5A1JIAKAfoG8AUYMB93xgryhEgQA0D+QN8DI4eA7TpA3lMKOPw74PY4P5A0AMECQN0QhrY0Lfp/j\nAnlDEHZ0gH6DvAEmBAfl8YC84Qh2cID+g7wBJgYH53GAvKEAO/Y04Pc8fJA3HGCHBhgOyBtgonCw\nHjbIGySxIwMMDeQNMGE4aA8X5A3swBOH3/8wQd4AAAMEeU8cUhdI/B0MEeQ9YdhhAYYL8gYASRzM\nhwbynijsqADDBnkDwAEO6sMBeU8QdlAog7+PYYC8AQAGCPKeGKQqSIG/k/6DvCcEOyTAeEDeABCE\ng32/Qd4TgR0RYFwgbwCIwkG/vyDvCcAOCG3g76efIG8AgAGCvEcOqQm6gL+j/oG8Rww7HMB4Qd4A\nkARhoF8g75HCjgYwbpA3ACRDKOgPyHuEsIPBKeHvqx8g75HBjgUwDZA3XIibxB/oI4SEyzO/9AZA\nd/Rzh2or4NDjNy2fE2D4kLzhBJw6OZPM+0A/w8J0uPr44PMfA/3YkS4tUxL5Jfj4+PfVpbdhilCb\nQEsuLWyL2xYkDuOH5D0CLpO6+yTtMhD5OSB9nx8674GDuKsY0rYCpIO8oQZDHSQc6nYPh36MuUwL\nOu8Bc74dZizioxOH8UDyhgrGIm4LSfwUkL7PCwOWA+U8O0oXguviH3fvHTxHDFJ41zB4eR6oTSBA\nG2mf4k/Kf84uZU6VAsOE5D1ATpu6m4j7khmgS5Ej8K4gfZ8eOu+B0S9xz3X5f7zN1d120IPDcEDe\nsKeOuPog7RBdbBeDmV3A4OXp6eMeCBFOs0PUlfYQcNvZplK5ETUK9Bk67wHRvbxTxd1E2l2l1y4E\n2kbiCLwNdN+nA3kPhMuIu460z1U1tJEpEr8ECPw0DOXfwdApXYn7Et2wfc26Qp2rucCpUaBfkLwH\nQLepu0q4fZV2FXXF2lTiCLwJpO/uIXn3nH6Ju660P9Vc3/FPg8fUPdmm6aAmCRz6AVMFJ0OZeKum\n2KVMn/sU+GlKm+eqO9XvkoOx04Gpg91DbdJjuvuDrxJ3k8dJ7QTdhjrJvE5KrpvCSeB1oT7pDmqT\n0dNE3GWPaSrs2Gs16Z7tNlSJvE6dUndAkwoFLgfJu6d0k7q7FHeKtLvOAnXFnpLIU2Tb5ICCxFMh\nfXcDybuHXEbcTaR96j+fut8m6La1TOIpabnJYCYpHM4LA5ajJCbi2MBkaP2ygcI63yFyk/CTSuqX\nUFUNcqa+bt2DEwOZKTB42Q0k757R/g+7TNwp65YJu8nrphB7bFmStdsTS8hVSTw1hZPAoX+QvEfF\nKcRdltabpOc6pL5GVRovS+Ip208C7xrSd3sYsOwRp0ndKeKOSTvl+X26mD7YduCxLCmXPXfXg5kk\n8CoYvGwOtclo6ErcXQ1mtsF/3pBwy77jpGzAsaxKSZlWWKdGoUKB00Hy7gntUneKuLuSdpWw21QG\nKaJrkpxjsm2TwkngXUH6bgbJuwf0T9wptUrstdsQej5ffGUn6MSScyyJV6VwEjj0F5J3D2gu77bi\nbiLtU5x96ajqussEGHpsnSTeNIWTwLuA9F0fkveFOZ+4y9J2lbTP1XmHns9KtaznDqXosiTeVQon\ngcNlIHlfmGbybiPuOoK/RH1SN13HHpOaxOukcBL4KSF91wN5X5DuUncTcbeRdlfzolOEFxNdqpz9\n9RB4n0Hg6VCbDI5TiruO0EOvXZeyxzsR+q/rpBcauAzVJH4dElonNKAZq1GqKhT/eWJQoUA7SN4X\nopu6pK6460q76vVi6zWlzgBjk5SdktbPmcKRdwjSdxok7wtwPnFXpe2m0u5yADM2ICnlcgt9u2Bo\n8LIqZccGNf0UHhrMPMVAJukbmkPyvgD15V1VWaSKOyTomLTLZqP4jwuRUomU0SQlVyXtuvf7z08C\nPxek72pI3memmy/kSRV3atpOkXbq95+kkCL2sk5byoTnf7NgVdL2k66fqKtSeNMenAQO3UPyPjPt\nU3dVovbFXZa2Q9JOnRse2ra2pMwEqZOWy5J2nftSe3ASeJeQvstB3mfkcuIuE3mVtNvWJ6k0qUlS\nhWvvK5N/FzUKAu8SBB6H2uRM9EfcKdKuU510kb43kecOred4V7HGiFUqfp1SVqU0qVGoUOAykLzP\nRD15n1vcKV15aLv8+5uSkmBTU3ZovZQU3qZGIYGfEtJ3GJL3GWg3SNlE3G2l3ebEnXPjp2w/jaem\n8NBgZ2ygkwQOl4fkfQa6Sd1Vs0rK0nZdaddJ3qcipYuOpeNQEo/dX/VcZT14mwRO+q4D6fsY5H1i\nLifuUNpOlXZI4omU7WKN/9RSqo4ySXdRpaQcKELr+utbEHgdEHgRapPeUFfcIdGGahK7Xpm0ayRs\nfxeala9+xC6yPCr3qoNIaMDTnwculVcpVXVJbHnse1HKBj4d1CfQHJL3CWmeust67hRxx9J2ivAD\nOFn7km7bovhO8qVe+emVVR5+Ei+rUprWKHUHMkngbSF955C8T8RlxR1L24nStrvHLLJa7C/nOrL8\nNbDsXuVnuFuZBz9Nf6P8KYOhJ3aDmlUpPDTwKcUTuFQ9kEkCh+4geZ+IdHk3FXes3y5L24nS9oVt\nN8uXc5PDf8hTr5H7na8qRW5X9pN1WefdNIWTwC8F6TuD5H0C2n9/SVtx+2k7tL7dYMWFfe3ddiwj\nm+5Xz6EJGO6xb2bZnYrucjK36dwX+dGnXNXj+Gm7Tgr303bZNEMSOJwekvcJaJe664rbF3UsbXti\nsym7SthW1FbOsYqkCr9CsV6zQncee/VuS0WRN07iqSm8alZL6kyUrhI48iZ9I+/O6V7cbnlM3H6/\nbdcNVCQxaYeEHRN104HLkHNsHeIkHZJ5TOSVadyuZMWLwIfO1AVObXIRYj23VF/csZokkrZnKgb2\na4WF7WQdGrCM/dWEpgxaOd+b66GBytv9+u61X5U3DktlIrf1yqvZrlKJ242PDWr6IvbrFftCftUi\nhasV6XQVCvXJ1CF5d0h3qbuuuCu67TJpL81DrLBDg5VWzm2mCcamCJYNVNpUXpbGK+uULlM4CfzS\nTDl9k7w7oh/iLpG2ezkr7Sph15l1ksqr4gncitcfqHSpXDpO4zapu8dFJZ5y1NkoPpgZGsgMpXKp\nmwReBQl8qpC8OyJN3hcSd0zaVs5z1ZtxEpttUsWbdzu1y7bLbRp3/rNp/DWy/tFvKDWFpybwqmX2\nsQqs568be0yI6Qp8qumb5N0B9acGVn2LX11xfzYbozRp2wolVKlIxVrFbmZZ6p4pfvq7/1Zdenav\nJeWe8m87Cdtk7dK47cbt9vmd+JHEq7rw0Cn2sQRun6PrBJ4yhRCmBsm7A9qlbn9KYIq4PwfWVS7u\ne1VLO1anSOUDl1JRwHadEKEzK62rQp22dJyk3XWbyH2x+724TfWVfbhNzKHrTXvwcyZw0veUQN4t\n6V7c9j4r7htvuRF3LG3fKS7tmLCtrENJu2nvHTuD0pd2rBLxRSzl0k6RuH8AKK1SYjXKKQWe+nWy\nCDzG1ARObXJyynput8zebiHuOxXT9q3KpR3qv63AQ/O/pWaDlXcKC9yvR9w6tn6xzYJrEPzByZ3y\nj9Gvbpbe4/wqpXJA058W6C8rG8hMrVD8+sRf18EUQsggebegXuqODVD6FYkV92cVU3mg33bCvlYm\nayvje6VJ+5O5r0zcvrRTvwo2dCKOFB6s9AcuXQL3E3msFokl8arHSCUpPFajnCOBM4WwDlNK3yTv\nhtSvS+xtO7PE3a4S92cVns/dZdO2L2srdr9G8YXtz//2u+7YYGXZX5Dvl1fzeFuTuFT+7l13z2+l\n7lK1C6r2xB23rk3im/1rXnuPuVbDFO5WTh3IbJvAY0maQcypQ/JuSLW86w5QJoo7NCjppOxkHbs/\nJm176XfdodQdErad4REi1HP76Voqdtb+tL9Xs+wfFVO1VOy3/SQeSuH+awQFLqX34OdO4KTvEFNJ\n3yTvBtSbGtixuJ2g73TcbS8VT+OflEs8JuyU6kQ6Tt+Wu8Ayvyqx/XcobVs52/vm3uWr8iRupwv6\n69lQ7Cd3935cCg/OSKnqwd0JPdJ5Ezj995QheTcgPXWX9dxV4v5s7tOxuP207Us9Ju3UFC53ff9W\n53lx/cfSP9OmnN9vZrL4+76Hed+Ho1iylsIp+z1y6Sfxuik81oUn9+ChmSgk8EsxhfSNvGtSvy5J\nFbedVeKJ2++371RM264icQOW7tIX/LX5idUm8w9pvjsIev4pk/bieitJms2LolgutkefwNt2Ubi9\ne89j+/Y1u+/9n0ziv9+WRaH7Ypbikg6J/EntJd5Y4NLxQCYCvxRjFzi1SQ2a1SVSa3FbObtEfa9w\nEnc/d+Z+OwvFH8T0hD3/tNPieqvZ/P0g5tl+OsbCnNs+LzmN8n7v7nc32rmQtvtTKXerbJkT/O59\no+3rIpf59V7mVuRldYl/31zSs47rEX+9ZxUHNC1+jVJ6ZqbFDmT6tcqlKxQYGyTvGjSrS0I9t+ux\nE8VtqxB33SXxMqGXJfD5h/64XR/JeqbdQdJz7Y7EHZL2Qnn63qqYut/NfMKDwDU7LN9qqZ1mRubz\ng8wPqTyUyENJ2y5/VrhOeVGHKTw0kNllAi87C7PJFELS95ggeSfSvOd2y2zarhC3nVHi99tLb7kV\ntJ/Aj3rxLGEv7tZHwl5pLUkHec+1O0h5pp2WJnXPSlK3ZWfE/aalpGftNDsI/l0zbbXVTjPdL/a3\nF0vtVpnMbSovJPJnHSdpJ3E/gftJXYHH1k3hZ0vgZWm6yWAkA5hjguSdSD15V/Xc9yoVt1+HuHTt\n3/YFb2VdqE7ylH1zt9ZysdWN1odkbWXtRO0ncKko7cXR1wMW2ZpvtHISP0rbJolvtdjLfHlI5jaV\nu0S+fV4V07gVdCiJP6uYyt2PS9fu8X4Kf1GLHtxP3F0mcPrvuow1fSPvBJrXJWXidtcD4varj5C4\nrZxD6xlpr+43ms3ftVpstNL6IOaVNkey9oUuqZDAJRVSeAwrZkmFtJ3dDkh6f1km8vV6lafxl1Wx\nUrGithK3gn9WXqU8qShn95hQjRKqW04u8FMNYE5L3tI4BU5t0po64r5RkritiEM1ib39RaXSXq3W\nh5SdX2601FtS+pZUEHl2+3iGiU9I1pJM4n6uFPWbltroplCvzFa7Q62y+bTLK5XXebEqsQOX18qr\nFqk4HdEfC7Tzwp+U1yi3Cs8fL61R/O9EqVuhnGoAk/pkDJC8KyhP3SnTAu0g5L1ycZuByypxf9Nx\n2v6u4/R9dyztpbZaaa3F/tIXuZN1ts5x1z3bC2DppW/LUm+HpO0o9t0L7fbmPO68j1P3WquCyN1t\nJ/qNVodLV6msn26yAc7XeTFt24HLF29ZLIU/q1ij2OeoNZBJAu8TY0vfJO8S0qcGlk0LtFMCa4j7\nwVv2oHjafohL+0abg5h9kefS3h5EvQwm7+1B4lIu8hhvezk7YW8Pt3NJu/V2++xvpX2jTWHZSutc\n1lpqrp3eNdNSW70tFtoulprN37V732QSv15K1/M8bTuRZxuR/8pcIg+lcDuYeafjbyqsNZB5yQRe\nBgl8yCDvxqTWJf7ZkxXitpJ+CCy393+XdP2uxd1aD18fg9J2aXulzZGwrdBnhxSeC7wsdYd671D6\ntiL3pb3VoiD0Oz1pq2UhYTuRr3WTyVoLrbTei36jtW601VaLxdtB4pvnnd6XM/2e7ztxW5u4KsU6\n0P0KZ8rS+a1Z90653zbKj73PajETRTqdwH2Y/+24uvrPx5jSN/KOkF6XuNshcTth28uIuB90nLrd\n5ffQ8g8tHp50c7fWarHRvZ4K0vZvuwFKd5l13puDrJ3IiwOYTtpFiWfLjusTvyrJluXp24rapm4r\nc5e+M0lvCul7rdXRbXdpJb78uj104tvnlTSfSfOrXLjP+1/Rq3JJS8V0/slbJh334O7kHzvVMCpw\nJ2J33T1B1wKn/54KyLsVtud22AFKd3+iuK2sr5VL+4ukP1VI23ffH3W/ejqIOibt2HWXwIvVSTF1\n28SdcnZl7IQcP32HkvdaN9pprgc9FiRta5QbrbXVUjfaaKMb3WitjVaH9+De4Vw73SxmWn7dan29\nzaYYzldZlWKFfa1MxlI4nUvFGuVJxf/VvvjmMzoXuCMk8BgIPMaY0jcDlgHSUnesLvEHKN2ygLj9\nWuSbuW5T9iF552n7YfG4F3Weup3EH/R/hZTtVydO2m6ZlfZCb1rtsh159v6u5dtvzcw+f1Vxfs7H\nXnq7/cfztvxDu/k+fc+KM0vetNBWy2DytpduuRP8Zr/l+Tr54ck95mjZepX14S8r6fkq77Nd5/2q\n4kCmm25o53vbQdCy+eBuymF0EFPmesog5rnmgE9D4NI4Bi9J3q0I1SW+uM1PSNwudX9TMYF/lyfx\nPG07WT/ocS/ste71fJB2WYUy03tB6HPttNhttXrZava+l7ObSWG/bc9W3LH9f569RS33f1hzaa7f\n0nK7HyDc6mOWid1JfT27yedwa3VI3vd60lorLfSmneZ7Xedydu8tr042hSQ+O+T83WGK4Wz+nlUp\n81U+tdDWJq4L99+jPWD5Pbh/v6tUnORbJ3ApnMZDZ2EygDklSN4e6am7rOe2UwJd6lax0w6J+09l\n0v5irt9Jf3x50f2fT4e07UTtrluRr7TWnZfIbeq+0Vqr3SaXtZs+96Jc1u7SXZeKMgudo2PHKufm\n9tzcDlx+3OYy3yzzKYA2RW90c6hW3NRBm77d9VDqtve/aZEttyncnW7vflxqtqncT+d2OuGb8qrE\nP+nnSOBSswTeZgoh6TvG0NM3ydtQry6x+AOUieL+l7keEvfDh+7++nlI207Q9vqDHrXQm/7Uo+70\ndKhSHvR4GKh80ONB2HP3z38naytvK257KeX7e0nqLlxfetf9y+vs8mouzW+l+fK3bu+e9TGT1rdP\nRyJf62afsVf7OmhdSN+uB/dTdzYQmxU0rg8vpPDnlfb/RDhO4v77CvXg7tL14f5MFJfSD59bkwTu\nL2cAE5B3TWI9t73tkrcRtzvV3Re3q0W+h66/68tfP47S9p96PIj7Tk9BaRc68Le1bv/+nQvb//FT\nt5W4AtdTPp5l4Lq7nO8/g6V33cn8Vrq9PRZ5PqPkOHmvdaNn3R/VKU7oS2Xf5TLTn7nU97NS1tfb\nLIXPV9qXPvngpa1R3DKpWJNIubjtTJTQVEIE3iuGPniJvPekTw2M9dyu47Zzufc3XcKuEvdf2e0/\nvrzo+//8PKTsb/p5SNnf9EP3eo4m8Xs96WH3qPtf26wS+aWirN3tN2Vi8RP4q/IzC0Odd2h/t39F\nocTtTlF3y27Ndfc95W75rYIif18+a3270HqW6flJ917vvQlK/En3hdTt7nvS3XEKdzNSbPKWiuKW\niv+tm9+Rh9qL4FzwFIG7F/CFXCbwGPTfYwN5V+L33Pa6/W5u9+MlbluNhMT9l7n9Vzab5NvXnwdp\n27TtJO4L/UjavyT9V7mofYG7n2dlUg7J215Kedosk7erFa4D193p/k7aVtxO5reBn/0681vp8+1W\n97dbPX3Z6Ga2PlQqT7ovSNzeXuxT90orPXpVylqbeAqfX4VrFPt+pdy5biDTXTpu95dJApeOpekG\nJVPngNcZwOQEniGnb+StlNPgQ3urPYMyMCVwvl8cE/c+Zec/2WySb6sfuteTvuunHg7SztL2d/0I\nC3z3qM//3Uo/lYnaybpK4K5K2akg782L9M9e1pvX4u69Dnw6K+9TurmWPs2yy0Lqnqkg5IKwneBD\nAv+SX7+6lT6/ZBJf3z7paZmL2knbJe4bJ2fzDYquSnH1yUy7eAr3dw9Xo/gyd7gPqrHApXCS7lLg\nPtQnQxU48i6lrC6xt+2A5X5KoJ1FYsXtkraT9l869NvfF3ni/qYf+q6fB0HbFP7Nid0l7f9VLu3/\nBq5bef9UoSrZvEp/v2S7798qzn0IzXOo+qQ+Sbp53X9KL/kn5FT4+XYvddt1+7JeKhf51/37cNdv\ns9tXX7NKZfXlV0HivrSzqZGZ0t3JPK5KsSn80evCHyVtta9R3H9uEZK2PdHHStt9YPaUe+kEAg/9\nJsoETv89FiYv73jqrqpLbM/tBii9udz35sfO2baJ24g7F3Uubpe8iyL/oe9//9L8lyQn7jKBPysz\n817if79IT6/Zor+Vi9tOYns316Xirm3/ge+IDeUefZP5S/bz+Wcm8c9W2O66E/dn5eL76l1/lfQl\nm+p4++W3ll9+aX270WxWlPZSWz1pe3Sqvzu9f23exUJbPeohu/FVWl9v9fzjQaW7iTvV/tbcdgLf\n7d+8q5x8gRcOBiGBO/w+vGoOuCMmZYTsM8T0zTxvAIAB8selNwAAAOqDvAEABgjyBgAYIMgbAGCA\nIG8AgAGCvAEABgjyBgAYIMgbAGCAIG8AgAGCvAEABgjyBgAYIMgbAGCAIG8AgAGCvAEABgjyBgAY\nIMgbAGCAIG8AgAGCvAEABgjyBgAYIMgbAGCA/D/ixhpnj3nKRQAAAABJRU5ErkJggg==\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"# Market hypothesis\n",
"k = 5\n",
"chips = k*(q_market.shape[0]-1.)\n",
"prior_market = distr_chips_row(q_market, chips, n_jobs=1)\n",
"print prior_market.toarray()\n",
"\n",
"row = prior_market[2,:].toarray()[0]\n",
"# we need to add the uninformative part here\n",
"row = row + [1,1,1]\n",
"draw_pdf_contours(Dirichlet(row))"
]
},
{
"cell_type": "code",
"execution_count": 33,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"[[ 0. 5. 5.]\n",
" [ 5. 0. 5.]\n",
" [ 5. 5. 0.]]\n"
]
},
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAW8AAAD7CAYAAAClvBX1AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAG/1JREFUeJztnX9z4jiiRW8CHQIk3dnZevU+7tZ+3LdVs5OZpCEwofP+\nAGFZlmzZGCzZ51R1BWObmF/Ht68Eufv6+hIAAOTF/dAHAAAA7UHeAAAZgrwBADIEeQMAZAjyBgDI\nEOQNAJAh86EPAGBI7u7+fZ4r+/X1r7shjwWgDSRvAIAMQd4wWezU7VsGSBnkDZMEUUPuIG8AC6QO\nuYC8YXIgaBgDyBvAAblDDiBvmBSxYkbgkDrIGyYDQoYxgbwBAiB7SBnkDZMAEcPYQN4ANSB9SBXk\nDaPnUgEjcEgR5A0AkCHIG0ZNX6mZ9A2pgbxhtCBcGDPIGyASTgaQEsgbRgmihbGDvAFawEkBUgF5\nw+i4tmAROKQA8gYAyBDkDaPiVqmY9A1Dg7xhNCBUmBLIG6AjnCxgSJA3jAJEClMDeQNcACcNGArk\nDdkztECH/v0wTZA3AECGIG/ImlRSbyrHAdMBeUO2IEyYMsgboCc4mcAtQd6QJYgSpg7yBugRTipw\nK5A3ZEfqgkz9+GAcIG/ICsQIcAR5A1wBTjJwbZA3ZANCBChA3gBXgpMNXBPkDVmQqwhzPW5IH+QN\nAJAhyBuSJ/f0mvvxQ5ogb0gaxAfgB3kD3ABOQtA3yBuSBeEBhEHeADeCkxH0CfKGJBmr6MZ6v+D2\nIG8AgAxB3pAcY0+nY79/cBuQNyQFYgOIA3kDDAAnKbgU5A3JgNAA4kHeAAPByQouAXlDEkxVZFO9\n33A5yBsAIEOQNwzO1NPn1O8/dAN5w6AgLoBuIG+ABOAkBm1B3jAYCAugO8gbIBE4mUEbkDcMAqLy\nw+MCsSBvuDkICuBykDdAYnBygxiQN9wUxATQD8gbIEE4yUETyBtuBkJqB48X1IG8AQAyBHnDTSBF\ndoPHDUIgb7g6CAigf5A3QOJw8gMfyBuuCuIBuA7IGyADOAmCC/KGq4Fw+oXHE2yQNwBAhiBvuAqk\nxOvA4woG5A29g2AArg/yBsgMTo4gIW/oGcQCcBuQN0CGcJIE5A29gVBuC4/3tEHe0AuIBOC2IG+A\njOGkOV2QN1wMAgG4PcgbIHM4eU4T5A0XgTjSgOdheiBvAIAMQd7QGdJeWvB8TAvkDZ1AFADDgrwB\nRgQn1emAvKE1CAJgeJA3wMjg5DoNkDe0AjHkAc/T+EHeAAAZgrwhGtJcXvB8jRvkDVEgAoC0QN4A\nI4aT7nhB3tAIAgBID+QNMHI4+Y4T5A218MYfBzyP4wN5AwBkCPKGIKS1ccHzOS6QN3jhjQ6QNsgb\nYEJwUh4PyBsq8AYHSB/kDTAxODmPA+QNJXhjTwOe5/xB3nCGNzRAPiBvgInCyTpvkDdI4o0MkBvI\nG2DCcNLOF+QNvIEnDs9/niBvAIAMQd4Th9QFEq+DHEHeE4Y3LEC+IG8AkMTJPDeQ90ThjQqQN8gb\nAM5wUs8H5D1BeINCHbw+8gB5AwBkCPKeGKQqiIHXSfog7wnBGxJgPCBvAPDCyT5tkPdE4I0IMC6Q\nNwAE4aSfLsh7AvAGhEvg9ZMmyBsAIEOQ98ghNUEf8DpKD+Q9YnjDAYwX5A0AURAG0gJ5jxTeaADj\nBnkDQDSEgnRA3iOENxhcE15faYC8RwZvLIBpgLwBoDWEhOGZD30A0B+8oWJZRmyzvfpRAFwCyRtG\nyrLm3yX7g4GwMCx3X188/mOAN5I0jFxJ6F9f/7ob+himCLUJZM7Qadj+/YgcbgfJewRML3UPLewm\npidx0vftIXlnzrTEnbq0DaRxuD4MWEIG5DxYmPOxxzOtEJEGJO+MGf8bZkzSM/eFJA79QPKGBBlz\nWh3r/ZpCmEgLBiwzZbxvlPHKrco4UziDl7eB2gQS4ZrSvvRl/tnLUVShSoHukLwzZHypu29x3yKT\n9C30cQmc9H19SN6ZMS5x9yXtIV7G7u+8VOakcGgHA5YwEJeKe279S4G+jmUcnf+4QkaapPLKhwjG\n8YboQ9opYx9f1zS+FAkcmiB5ww25RNwppexYLjnm/KdLjiNspAsDlpmQ/xuhq4hSqSL6SMJdk3je\nKZzBy+uQW5SB7Li1tK+VVn2321aq5j61lTg1ClQheWdAvqm7i0i7SDuFeqGLXNtKPF+Bk777h+Sd\nONMRd9uXYgrCtunyTYJtkzjTCaGAAUu4Am3E2mZQr48/R1b359H6+pNnbffP/cTVTL4hJF2oTRIm\nzxf8NaTVVlbXlluX5Bu7T5sqJb8ETn3SH9Qm0COx0ryGtG+ZRt3fFSPR2MpjrnY1Sn4Ch34geSdK\nXqm777Td5i+8p0asTGO2i5V4XgInffcDyTtBpivumNtqK+xvLbev4++IbWIHLmOSeGwKJ4FPEQYs\n4QLa1CR14m4a4IsdRPzm+dcnbW8/5pib1l9rXGA48gon6ULyTox8Xth99dtN0m6ib0G3xf79oWTe\nlLKb1sdOKWQq4ZSg806MPOTdh7gvkXassK+RRmPFWFexNN1G3frx9OB035eBvBNiPOLumrbrbjtG\n2ENUB02S7CpxBA71UJtACy4Vd5e0XSftNrLuWq80DVI2DVDW1Sp1NUfdujY1SvoCh26QvBMh/dR9\nLXG3lXYqPXiT1OukGdo3tM+lKTxtgZO+u0HyToBxi/sW0m4j6zZpvU567u8MpWrf7Zh9ffuEUnjd\nYCYJfIqQvBMgbXnfStxtpd1XndKFrj13aD/f9m1TeN4JnPTdHpL3wOQt7rY1Say0r1GlGNq85ENC\nbPp4fKjnDvXY33R5CieBTw2S98CkK++u4r40bV8qeOk2maROlD5Bxqbr2O3Gl8BJ3+1A3gMyDXF3\nlXEbYff5fSk+un4PSZ8S71PgacpbQuBtoDYBh1uLu6u02yb/Swjdpi1B31+N9w1a+gYrfXWKW6X4\ntgnVME1TCalPxgDJeyDSTN3XFHcf0vb9/ks/Xt+Wth+scQXqbhOTsK+VwtMUOOk7DpL3AIxb3Jem\n7ZiUHZvy644hlropgJI/CdvXuynYTctuEo9N4a54uwxkksBzhuQ9AOnJu4u4+07bTSn7kj69jq5f\n5hQ7HdBdvjSJN60fRwInfTdD8r4x6Ym7iWuIu25dk7Rj6hbfdk3Ebu8mZoObnM227nKXJN4mhZPA\npwLJ+8akJ++2U+6axN01bddJ+9ozUWIJya+pp65Lx3VJvC5ljz+Bk77rQd43ZHzi7pq2u0i76aTg\nuy3DKnB9LJuadZfUICGJ191Gm3Wh6xD4GKA2uRHTEneXiiRG2jGzT0Ki7vpS/6y5zY3ndt2axP20\npV2T2JftOsVXpcTUKLEDmVQoY4DkfSPSkvcQ4u5L2u7xuWLt+pW0IdrUD25CD6XpUFqOSeKhfbvU\nKHkkcNK3H5L3DRivuNvWJG2kHSvsNnO/285EsZOyi28WiX1cdip307Q9KFmXxO1BzaYU3mUgkwSe\nMyTvG5COvK8l7jaJuau0Q8LuY7pgF5qSri3Fjef6pjTdlMJvkcDTkTfpuwryvjKI2yfaWGnHCDtS\n1F3f+tHPXp00jRx9Ere3/dtZti9fUqMg8DFCbTJ5+hZ3bNpuK+1IYfve3rPw5lEcAteXxB46Jnsw\n0q1VpKJScQc3zb7u4KW9vfm9TTXKJRUK9UmqkLyvSPqpuw9xt03bMdL27R+QoytrV9RdxihDuA5z\npe59tn0J2FepuHVKXZXStUZp++nPum2HgfRdQPK+EvmLO2ZGSZ24YyqSkLQbUrb99rVlHTOT0ObR\nc91HzfbPqp/Wbcv8/Oz7Tjr2Tua+G4m7d8IMam6tn+5AqG8QtEsCZwAzJ0jeVyINefct7rY1SSht\nN0m7RtghWbt3ySdm33VN+GTuXucLwl6RG3zdttuLh5J4KIX70vY4Ezjp+wjJ+wqMR9yx/faVpF0n\nbPtuPAYuGy7pvNenn7aMH1UVuFl2P6Nj71tJ4yYV21MDVyqmGbrJOpTCfVMR3WmIfSVwSAWS9xUY\nXt5tZpYMIe6W0q4Tti3rmL47Nq7ETr6wpf7h/KxL5N407qbpS1O4L233kcBJ3ymAvHtmeHFL8am7\njbjb9NvfPNv40nZLabvCvqRCaUtMVSIVcg6JvFbirpRtiSNwl6kLnNpkdFxT3F3Sdktpxwq7qT7x\nvbIXnuvq2FmXn04/XZd9qDqQudWxbjmoXLHY23ol7psqKBVViuR/fkM1Sqgu6aNCYQBzaEjePTJ8\n6k5F3JEVSUjascL2ydoVdJvq3xATNm2x29vXJe26NN6YxGNTeJuBzPwT+JTTN/LuiemKuyltXyjt\nkLBdWd+yNglVJjtnvS1pN2l/qKXEbSn7uvC2Nco4BI684WKGlfetxd0mbbeUtp2yY4Vdl8QNbSsT\nm52zHJO0fSL3SfrDWW9LvnMKv7XASd9DQOfdA9MVd2gmSSBtN0nbt84WdlMKN9u5d8vetgvuV3Kb\n37FTtQu3H6rtaVuz3aeqvbfpxuVZJ1kStw8i1IXbH9aJ6cGbPuATC/33EJC8eyA9edeJ216OFXfT\nbBK3JvFI2+zeRtoLZz+zj5vA7bvhm0Jobq8rvqRtXzbBNaY22amaxt1e3N2vUqXEpPCYHjw2gVOf\npAjyvpD0xC3Vf2VqrLib+u2GmsStSGz5hqTtpuwmYftE7atQzHF0xTeXW6pK2ifzUG0SK3G3amns\nwhH4VKA2yZYu0yj6FHdE2nblXCdtN2X7ErgrbFfUsfO+7X18+D4Sb1z1pOrgo3scZn97Rp5pLkw1\nYpoGu1Ix22xVPF5G4mb74NTCrfxTCt0/KGHSel2F4ptGyBTC1CB5X8BwqfuSnruruCNqEl/aNhLy\nXR+SdqywY6YQXpLA3W8N9FUmdVMCP1VO5X+rXK3YiTt0fV2V4k3h7myU0EDmNRM46fsWkLw7MvzU\nQJdLxN1mYDIwKGmn7VBF4so5lMB9wg5NH+z6qUuDm5Z9+FK3u9/c2tYcw0Hlx+JDRbBdqAiv5uF0\nb3tu3V50CjcJXDpKvG4g81oJnPR9C0jeHUkrdV9b3L7ZJIGaxFeRxCbtb9a+bsL2nRSk+qmF9t0y\ntJkyGJoiGPtBHLevNtf50rgviftSuNnPvT44mOnrwX1TCceTwKeSvkneHZieuGtqkqZu25e2m6Qd\n6sbr5oG3+tBOw9P3cXrvP1vX2f5bq1xzPKlaa9jJ3E7QB2t7N437krh9ne+27RRe24Pb3zwoZxv7\nF3ZN4D5I4NeE5N2BYeTddmaJfdmd/lcnbt/AZGA2SZu03VbaMYOcUmD+9+npmRel9f3CjdHS/Fv1\n75t9/l0txX/trLj+eVpvBB8zDbAuMdtpvEsSb0zhoR48NBPlkgSezgyUKaRv5N2SaYq7od92Jfuk\nfqVd25UXojaCNlJ+eNyfH4XFY1XekjS7LwR++OUfzdx9HOW9/3iQVAj+LPXPWVXmMQOQbST+ph4E\nLhUpvC+BU58MBbVJC9IapOxD3E1TAWtqkljJ2iJ3pb1ueVt2sj7J2ha1EbQR8oMKec88UllY6yVJ\n99JOD5XtlqujfPar4zojeVvqJaE/nWRuf4rSTAl0JfuqcqVi7rddp5wPRP4qxVBbo7ifyvRNJWxT\nobgHZWAA81aQvFuQTuoO9dyXiDs0o+TCtL2WP2k/BW7H3u+8XE7X82+Hs6xtURtBGynPTn3Fwhl5\nfHCl7WFvSXxnjXIeTqX7Tg86nJ6HvR5KQjcy/7VbFKk8pv54lz+Jh1L3z8DtRNcovqmEbRJ4+gOY\nY07fJO9I0he3zQ3E7aZmI+7nmuWQtN19bGkHhG1kbYvaSPqhRt6zyuTtMAcVNYoRuLnOyH2nhQ6a\naXd/XF6uttqvjjKviNxN5Dv5pwO+q5zEpeqgpsFO4W+KHMy0BzLdqYRmfUwCZwBzSEjekdxe3pfO\nLGkj7pqpgEbcRrBuSn5SWbhm2aTtJ1UlHZL2s6KFbWT9cLosHSVtLj+chD1XtUIx24awk7ZUiPrz\nLO5C5EbeZruzzE/J3KTyisjf59U07iZve/ldRap+VzmFvyould88gZO+rwnyjiDN1B0rbrNcJ27P\nVMC6mqQuXT9Z2z6pXKv49n/ROWXfrzdeYa+0qcjayHemgx6001yHs6DtdZKdxEOzIfwcrMfbCLyo\nTRYlqe/P0j7+bBL55m1ZrlXsasSWthGzEbKvSjHb71SIPXQSQOCjgdokSW4t7g41ib1sp20jY3v9\ni8LSfvo8p+znl7dSwl5pWxG2K+ty2q5WKVI5Zcf03QZf721k/KS3QsiO0F2Zb7Us1SvL1VaLx905\nje/fV9KjJXHzmJr65Kf1FL2rWqVI5afYV6OYeuVdDRWKS5cKxYYBzGtB8m4gvbrkxuJ+UbgmeVI5\nbfvS9drZ1pH26nl7TtlLbc6VyLPeKsI2Mp8p3Hk/qNqB2z33Q01d4mLXI5K/9/am65O0XZFvtCrt\nY5Y3m1VRqfxclZO4SdKmNvFVKe62bm1iVy6VGsWXwKXypzFDCTyvKYRjS98k7xrSE7dv2yuJ2xax\nT772TBI3bdsyN3IPSHt5v62kbFOT1Al7pU1F1Gaf46N2UN3AZQy+WSZGyMfLkVWJZnrTs5baaK+F\nNlrpoJlW2mijlZarjbarlQ6/Znr7djhK/PEkcfPHHOwkbaoUqZzCpSJ1m3XvKuors29pINOXwH2f\nxvQlcKmcvm1I19cGeSdNzJRAe9n37YBmOVLcoUFFN0GbrtsVtV2RPKk0EHm/3gSlvTz/3GhuJe+6\nzttsK6l0vd1x23O57QQeO2BpTw08LhfTA21p1/XeGy211PaYsrU6S/ugmR60114PWmiv3f2DZr8d\nqhJ/P0nczEaxqxQj9PfTT1O7mKddKofpFwUEbgs49JfqXYFLZZnXzUAZvj65u/v315jSN/IOkEbq\nblr/zXPZFvdS0eJ2p/DZqdkelKxL297LxUDk88tbSdpG0McUvSuJ3Cd2O42XZV7MQJHcWSf7i6cK\nGpnbg5a+hO2T+UYrPevtLO6lNtqerjNpfKuVltpqq6VW2mpzvyxJfD9fHacZLu+O4n1U0X8bcUv+\nFC6V/fl2eu4+rHWlqYTPKkTr68FtMUvtphAOL/AxgbyT4NKeu0dx+wYibXGby08qp223Ink6Tvl7\neNrUStvUHyttzp23fV0hd7sLL08XNAk9pjqR4uqTusrEnSpo99xut/2iV2201F4LLbU9VygHzaw0\nvtVGy3MiX5xOUEbim8f9cWBzvpLm8yJdGxnLuWwGKd0mw+DOE39TxFxwG9OR5yfwMaVvBiw93DZ1\n9zVA2UHcc2u1PTBZGVxUuR5xE7Yr96dPPTxt9PC412p1lLJP2s96K6VsXxK3hW3330WtUsw8KX1Q\n57DX7PNTi90vSdLM8sVdRPX9dXL34fSQ7hb3p+W59rMiZUs6p2pX5huttNODtlpZYl+el7enR8Zs\ncx7APF2urN+sjlMMf56qFDMw+a7ygKa9/KZi8DI0CGrWRU0ltAcx3cFNc1me5aYBTAYv20LyTo4u\nA5Q9iTvUb9sDjkbQgbRtem1b2qb6cKVtkvWz3s7Je66DlmeRhzvxcxI/vJ0lPfu0xPypo6hMPRD6\nO5QB7h6Lh0kzaf54PAlosZfme30t3nWYH6XuCt0I+EWvp5T9epbwSivt9H4Ws53GTYVi/tdh1m+1\nPJ4SVsf57+cqZT4vnkM7eZ+OuVSjmGrF7cHt7+JqPZWwTQJvStfUJ20heTukmbqbxG32ixB3aCqg\nrxrx1SSh5H1K26YiMaIOSdteZ1K2EbhP2HbPvdxtCln/VCFp+ztBpOJDLHbSti/7Zq/ZD//C+WkG\nas02ZlD3x/G6r8UxqW/WD2eZb7XUp2baanWuS0yyLpaLR+VNz86jFlh3ml64f18dP61pErZJ3a8q\n0rRZthP3q3XZN7WwdQL3Je60P8CTe/omeVtMSty+6Xz2DBL7srcaUW3aftbbOVGHpG0um+3sJG4L\n+/nwptXPfVXW5hOHtqTtL3Cyv0e7ZfKu/KUee9n+dOlC0n+OP++epPlM+v64l9bHdL5Z32u7OKbt\nZ72VEvlxeXmaf2Ky+OYs6uV5bopn3Wl64eZxr81ieZyVsrwrUrg5zncVmNkoBruGNutfVXxAyJvA\n/zotu9+F4iZuKfX+O3eQ9yC06bl9+11B3G6/HapJAmn76f7tLG07Qa+00YteG6VdWecK+08VKXKn\no7iNqE1qNMnb/qMI7mXJH/hczNMRSt1m6t5aZaF/Lx63u0dpvf6l9eJdX+tC5GYGitttGzG/6Sko\n8ZkO5/+BBKsU332xaxT3PhrMTBQj8HOtbQv8u3VZKl6HrsAlf30iNQv8NuQ+eIm8Twz7Xd2xA5Tu\n5R7F7VuuyFqVtP2yeq0IuJD1UU1m2ZZ2OZUXol/uNlr9/FUI26TrnzqGPlvWrsDt1O123+ayVK5O\nQtjSNstG4Hbytn/+kPR/p8fLiH1x/Hn3dBL5+l2f63dt1g96mz2Xum27XvJJ3MyoOdYnq9Ng70Gz\n+8/zrJTNYqlfWhfHaaYUunxzrjf30xa4cWxF4Oa1JVX/RFqswOsgfceAvG+Om6rbDFD6Pj3ZUdzu\nND97/rZP3P9Ubdq2Zfyk6vU+aZs6xaTs+U8dJWy6WyNsc/mgqtCNqH0Vij1YGTNw+egs25XJzFpv\nZL1WWeCmblqrkPna+ndaN3+Svq/3+r7+XT9/K9K4Of296uX8GL3q5ZzLF9qdpf2ql9NkxON1r3o5\np/A/pHCNslS1TpHKL0tzkrPngpcELh2fGHsnW9y+lF03gDlcfZJz+kbeumXqDtUh7vqexe2bReId\ndFS4JvmfcrdtVyEv+qOUsO3k/Xzqen3Sftn9UU3Zf6osbPPPCPrdWf5UUak4g5Z/76TtTvo8eWF7\n+hma/mxzfrTnRROxXEjfjKyN0E3KtqW91lHc/1Ehblfkp3/r339p/c8ijb/OjrK2JW7kvNRGr/rH\naWzgs1KlnFP4/x70+l+rRil/w60f253mI/U20QKXqsm8q8BvQ64CR96D0maA0ly2xW3fTs/iNvI+\n1SQPL2/nmSRGwEbIL3rVUhv9Q69emdvbl6T9XxVCNpfNv9+ty27aNsunDtxI+u2jmAMR86WmIWw9\nLT+l+efp0f4oTpffVYh9uZC+2VWJlbLP/55UFfmP0w39Kc1/SN9/7PW8/o/efhwrFVfix58mde9L\nVcofeimn8N/2en18KQYzdVdO3nYP7g5kSpEC7/IpTJc6gVOf1DF5eQ+XursOUNr4Bi5PbyxTlZiP\nu9vztjuK29QkbsK2f54FrT+qMj+8HuuRP3WUtUnRRty2sEMCPwn7r7+Oifqvz+Pb+y+VJ62ZORE+\niUthJbinRHOd/X+c8/91PqXfPqVvH9LyT+n7XHpen9K5LWv734/T/Vhb98tc91O6W0vfd3ut1r9r\n8X1XSdZmfvvD6cNKRtwzHfTqfvR/paJG0UngLgcV4wRmzMNgC9z8ZZ7SLBQTGurmgJtt62ag1EF9\nEoJ53gAAGXI/9AEAAEB7kDcAQIYgbwCADEHeAAAZgrwBADIEeQMAZAjyBgDIEOQNAJAhyBsAIEOQ\nNwBAhiBvAIAMQd4AABmCvAEAMgR5AwBkCPIGAMgQ5A0AkCHIGwAgQ5A3AECGIG8AgAxB3gAAGfL/\nLXLIU0M+DJwAAAAASUVORK5CYII=\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"# Uniform hypothesis\n",
"k = 5\n",
"chips = k*(q_market.shape[0]-1.)\n",
"prior_uniform = distr_chips_row(q_uniform, chips, n_jobs=1)\n",
"print prior_uniform.toarray()\n",
"\n",
"row = prior_uniform[2,:].toarray()[0]\n",
"# we need to add the uninformative part here\n",
"row = row + [1,1,1]\n",
"draw_pdf_contours(Dirichlet(row))"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Note that the density of the uniform hypothesis does not concentrate at the center of the simplex due to our limitation that we do not allow self-loops."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Above, we used the row-based chip distribution (i.e., each row receives the same amount of chips). For completeness, let us also shortly see what happens if we use the (trial) roulette method that distributes chips to the whole matrix (i.e., rows might receive variable amount of chips)."
]
},
{
"cell_type": "code",
"execution_count": 34,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"[[ 0. 4. 6.]\n",
" [ 6. 0. 4.]\n",
" [ 7. 3. 0.]]\n"
]
},
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAW8AAAD7CAYAAAClvBX1AAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAHFNJREFUeJztnW1z2si6RbcHAja2E0+SU3f+7anzd28l5zpjG2zGxPeD\naPSo6ZZaL4Be1qpyAUKAwNbSzu4Wufr4+BAAAAyLPy69AQAAUB/kDQAwQJA3AMAAQd4AAAMEeQMA\nDBDkDQAwQOaX3gCAS3J19Z/DXNmPj39fXXJbAOpA8gYAGCDIGyaLTd2h2wB9BnnDJEHUMHSQN4AB\nqcNQQN4wORA0jAHkDeCB3GEIIG+YFKliRuDQd5A3TAaEDGMCeQNEQPbQZ5A3TAJEDGMDeQOUgPSh\nryBvGD1tBYzAoY8gbwCAAYK8YdR0lZpJ39A3kDeMFoQLYwZ5AyTCwQD6BPKGUYJoYewgb4AacFCA\nvoC8YXScWrAIHPoA8gYAGCDIG0bFuVIx6RsuDfKG0YBQYUogb4CGcLCAS4K8YRQgUpgayBugBRw0\n4FIgbxg8lxbopV8fpgnyBgAYIMgbBk1fUm9ftgOmA/KGwYIwYcogb4CO4GAC5wR5wyBBlDB1kDdA\nh3BQgXOBvGFw9F2Qfd8+GAfIGwYFYgTIQN4AJ4CDDJwa5A2DASEC5CBvgBPBwQZOCfKGQTBUEQ51\nu6H/IG8AgAGCvKH3DD29Dn37oZ8gb+g1iA8gDPIGOAMchKBrkDf0FoQHEAd5A5wJDkbQJcgbeslY\nRTfW9wXnB3kDAAwQ5A29Y+zpdOzvD84D8oZegdgA0kDeABeAgxS0BXlDb0BoAOkgb4ALwcEK2oC8\noRdMVWRTfd/QHuQNADBAkDdcnKmnz6m/f2gG8oaLgrgAmoG8AXoABzGoC/KGi4GwAJqDvAF6Agcz\nqAPyhouAqMLwuUAqyBvODoICaA/yBugZHNwgBeQNZwUxAXQD8gboIRzkoArkDWcDIdWDzwvKQN4A\nAAMEecNZIEU2g88NYiBvODkICKB7kDdAz+HgByGQN5wUxANwGpA3wADgIAg+yBtOBsLpFj5PsCBv\nAIABgrzhJJASTwOfKziQN3QOggE4PcgbYGBwcAQJeUPHIBaA84C8AQYIB0lA3tAZCOW88HlPG+QN\nnYBIAM4L8gYYMBw0pwvyhtYgEIDzg7wBBg4Hz2mCvKEViKMf8HuYHsgbAGCAIG9oDGmvX/D7mBbI\nGxqBKAAuC/IGGBEcVKcD8obaIAiAy4O8AUYGB9dpgLyhFohhGPB7Gj/IGwBggCBvSIY0Nyz4fY0b\n5A1JIAKAfoG8AUYMB93xgryhEgQA0D+QN8DI4eA7TpA3lMKOPw74PY4P5A0AMECQN0QhrY0Lfp/j\nAnlDEHZ0gH6DvAEmBAfl8YC84Qh2cID+g7wBJgYH53GAvKEAO/Y04Pc8fJA3HGCHBhgOyBtgonCw\nHjbIGySxIwMMDeQNMGE4aA8X5A3swBOH3/8wQd4AAAMEeU8cUhdI/B0MEeQ9YdhhAYYL8gYASRzM\nhwbynijsqADDBnkDwAEO6sMBeU8QdlAog7+PYYC8AQAGCPKeGKQqSIG/k/6DvCcEOyTAeEDeABCE\ng32/Qd4TgR0RYFwgbwCIwkG/vyDvCcAOCG3g76efIG8AgAGCvEcOqQm6gL+j/oG8Rww7HMB4Qd4A\nkARhoF8g75HCjgYwbpA3ACRDKOgPyHuEsIPBKeHvqx8g75HBjgUwDZA3XIibxB/oI4SEyzO/9AZA\nd/Rzh2or4NDjNy2fE2D4kLzhBJw6OZPM+0A/w8J0uPr44PMfA/3YkS4tUxL5Jfj4+PfVpbdhilCb\nQEsuLWyL2xYkDuOH5D0CLpO6+yTtMhD5OSB9nx8674GDuKsY0rYCpIO8oQZDHSQc6nYPh36MuUwL\nOu8Bc74dZizioxOH8UDyhgrGIm4LSfwUkL7PCwOWA+U8O0oXguviH3fvHTxHDFJ41zB4eR6oTSBA\nG2mf4k/Kf84uZU6VAsOE5D1ATpu6m4j7khmgS5Ej8K4gfZ8eOu+B0S9xz3X5f7zN1d120IPDcEDe\nsKeOuPog7RBdbBeDmV3A4OXp6eMeCBFOs0PUlfYQcNvZplK5ETUK9Bk67wHRvbxTxd1E2l2l1y4E\n2kbiCLwNdN+nA3kPhMuIu460z1U1tJEpEr8ECPw0DOXfwdApXYn7Et2wfc26Qp2rucCpUaBfkLwH\nQLepu0q4fZV2FXXF2lTiCLwJpO/uIXn3nH6Ju660P9Vc3/FPg8fUPdmm6aAmCRz6AVMFJ0OZeKum\n2KVMn/sU+GlKm+eqO9XvkoOx04Gpg91DbdJjuvuDrxJ3k8dJ7QTdhjrJvE5KrpvCSeB1oT7pDmqT\n0dNE3GWPaSrs2Gs16Z7tNlSJvE6dUndAkwoFLgfJu6d0k7q7FHeKtLvOAnXFnpLIU2Tb5ICCxFMh\nfXcDybuHXEbcTaR96j+fut8m6La1TOIpabnJYCYpHM4LA5ajJCbi2MBkaP2ygcI63yFyk/CTSuqX\nUFUNcqa+bt2DEwOZKTB42Q0k757R/g+7TNwp65YJu8nrphB7bFmStdsTS8hVSTw1hZPAoX+QvEfF\nKcRdltabpOc6pL5GVRovS+Ip208C7xrSd3sYsOwRp0ndKeKOSTvl+X26mD7YduCxLCmXPXfXg5kk\n8CoYvGwOtclo6ErcXQ1mtsF/3pBwy77jpGzAsaxKSZlWWKdGoUKB00Hy7gntUneKuLuSdpWw21QG\nKaJrkpxjsm2TwkngXUH6bgbJuwf0T9wptUrstdsQej5ffGUn6MSScyyJV6VwEjj0F5J3D2gu77bi\nbiLtU5x96ajqussEGHpsnSTeNIWTwLuA9F0fkveFOZ+4y9J2lbTP1XmHns9KtaznDqXosiTeVQon\ngcNlIHlfmGbybiPuOoK/RH1SN13HHpOaxOukcBL4KSF91wN5X5DuUncTcbeRdlfzolOEFxNdqpz9\n9RB4n0Hg6VCbDI5TiruO0EOvXZeyxzsR+q/rpBcauAzVJH4dElonNKAZq1GqKhT/eWJQoUA7SN4X\nopu6pK6460q76vVi6zWlzgBjk5SdktbPmcKRdwjSdxok7wtwPnFXpe2m0u5yADM2ICnlcgt9u2Bo\n8LIqZccGNf0UHhrMPMVAJukbmkPyvgD15V1VWaSKOyTomLTLZqP4jwuRUomU0SQlVyXtuvf7z08C\nPxek72pI3memmy/kSRV3atpOkXbq95+kkCL2sk5byoTnf7NgVdL2k66fqKtSeNMenAQO3UPyPjPt\nU3dVovbFXZa2Q9JOnRse2ra2pMwEqZOWy5J2nftSe3ASeJeQvstB3mfkcuIuE3mVtNvWJ6k0qUlS\nhWvvK5N/FzUKAu8SBB6H2uRM9EfcKdKuU510kb43kecOred4V7HGiFUqfp1SVqU0qVGoUOAykLzP\nRD15n1vcKV15aLv8+5uSkmBTU3ZovZQU3qZGIYGfEtJ3GJL3GWg3SNlE3G2l3ebEnXPjp2w/jaem\n8NBgZ2ygkwQOl4fkfQa6Sd1Vs0rK0nZdaddJ3qcipYuOpeNQEo/dX/VcZT14mwRO+q4D6fsY5H1i\nLifuUNpOlXZI4omU7WKN/9RSqo4ySXdRpaQcKELr+utbEHgdEHgRapPeUFfcIdGGahK7Xpm0ayRs\nfxeala9+xC6yPCr3qoNIaMDTnwculVcpVXVJbHnse1HKBj4d1CfQHJL3CWmeust67hRxx9J2ivAD\nOFn7km7bovhO8qVe+emVVR5+Ei+rUprWKHUHMkngbSF955C8T8RlxR1L24nStrvHLLJa7C/nOrL8\nNbDsXuVnuFuZBz9Nf6P8KYOhJ3aDmlUpPDTwKcUTuFQ9kEkCh+4geZ+IdHk3FXes3y5L24nS9oVt\nN8uXc5PDf8hTr5H7na8qRW5X9pN1WefdNIWTwC8F6TuD5H0C2n9/SVtx+2k7tL7dYMWFfe3ddiwj\nm+5Xz6EJGO6xb2bZnYrucjK36dwX+dGnXNXj+Gm7Tgr303bZNEMSOJwekvcJaJe664rbF3UsbXti\nsym7SthW1FbOsYqkCr9CsV6zQncee/VuS0WRN07iqSm8alZL6kyUrhI48iZ9I+/O6V7cbnlM3H6/\nbdcNVCQxaYeEHRN104HLkHNsHeIkHZJ5TOSVadyuZMWLwIfO1AVObXIRYj23VF/csZokkrZnKgb2\na4WF7WQdGrCM/dWEpgxaOd+b66GBytv9+u61X5U3DktlIrf1yqvZrlKJ242PDWr6IvbrFftCftUi\nhasV6XQVCvXJ1CF5d0h3qbuuuCu67TJpL81DrLBDg5VWzm2mCcamCJYNVNpUXpbGK+uULlM4CfzS\nTDl9k7w7oh/iLpG2ezkr7Sph15l1ksqr4gncitcfqHSpXDpO4zapu8dFJZ5y1NkoPpgZGsgMpXKp\nmwReBQl8qpC8OyJN3hcSd0zaVs5z1ZtxEpttUsWbdzu1y7bLbRp3/rNp/DWy/tFvKDWFpybwqmX2\nsQqs568be0yI6Qp8qumb5N0B9acGVn2LX11xfzYbozRp2wolVKlIxVrFbmZZ6p4pfvq7/1Zdenav\nJeWe8m87Cdtk7dK47cbt9vmd+JHEq7rw0Cn2sQRun6PrBJ4yhRCmBsm7A9qlbn9KYIq4PwfWVS7u\ne1VLO1anSOUDl1JRwHadEKEzK62rQp22dJyk3XWbyH2x+724TfWVfbhNzKHrTXvwcyZw0veUQN4t\n6V7c9j4r7htvuRF3LG3fKS7tmLCtrENJu2nvHTuD0pd2rBLxRSzl0k6RuH8AKK1SYjXKKQWe+nWy\nCDzG1ARObXJyynput8zebiHuOxXT9q3KpR3qv63AQ/O/pWaDlXcKC9yvR9w6tn6xzYJrEPzByZ3y\nj9Gvbpbe4/wqpXJA058W6C8rG8hMrVD8+sRf18EUQsggebegXuqODVD6FYkV92cVU3mg33bCvlYm\nayvje6VJ+5O5r0zcvrRTvwo2dCKOFB6s9AcuXQL3E3msFokl8arHSCUpPFajnCOBM4WwDlNK3yTv\nhtSvS+xtO7PE3a4S92cVns/dZdO2L2srdr9G8YXtz//2u+7YYGXZX5Dvl1fzeFuTuFT+7l13z2+l\n7lK1C6r2xB23rk3im/1rXnuPuVbDFO5WTh3IbJvAY0maQcypQ/JuSLW86w5QJoo7NCjppOxkHbs/\nJm176XfdodQdErad4REi1HP76Voqdtb+tL9Xs+wfFVO1VOy3/SQeSuH+awQFLqX34OdO4KTvEFNJ\n3yTvBtSbGtixuJ2g73TcbS8VT+OflEs8JuyU6kQ6Tt+Wu8Ayvyqx/XcobVs52/vm3uWr8iRupwv6\n69lQ7Cd3935cCg/OSKnqwd0JPdJ5Ezj995QheTcgPXWX9dxV4v5s7tOxuP207Us9Ju3UFC53ff9W\n53lx/cfSP9OmnN9vZrL4+76Hed+Ho1iylsIp+z1y6Sfxuik81oUn9+ChmSgk8EsxhfSNvGtSvy5J\nFbedVeKJ2++371RM264icQOW7tIX/LX5idUm8w9pvjsIev4pk/bieitJms2LolgutkefwNt2Ubi9\ne89j+/Y1u+/9n0ziv9+WRaH7Ypbikg6J/EntJd5Y4NLxQCYCvxRjFzi1SQ2a1SVSa3FbObtEfa9w\nEnc/d+Z+OwvFH8T0hD3/tNPieqvZ/P0g5tl+OsbCnNs+LzmN8n7v7nc32rmQtvtTKXerbJkT/O59\no+3rIpf59V7mVuRldYl/31zSs47rEX+9ZxUHNC1+jVJ6ZqbFDmT6tcqlKxQYGyTvGjSrS0I9t+ux\nE8VtqxB33SXxMqGXJfD5h/64XR/JeqbdQdJz7Y7EHZL2Qnn63qqYut/NfMKDwDU7LN9qqZ1mRubz\ng8wPqTyUyENJ2y5/VrhOeVGHKTw0kNllAi87C7PJFELS95ggeSfSvOd2y2zarhC3nVHi99tLb7kV\ntJ/Aj3rxLGEv7tZHwl5pLUkHec+1O0h5pp2WJnXPSlK3ZWfE/aalpGftNDsI/l0zbbXVTjPdL/a3\nF0vtVpnMbSovJPJnHSdpJ3E/gftJXYHH1k3hZ0vgZWm6yWAkA5hjguSdSD15V/Xc9yoVt1+HuHTt\n3/YFb2VdqE7ylH1zt9ZysdWN1odkbWXtRO0ncKko7cXR1wMW2ZpvtHISP0rbJolvtdjLfHlI5jaV\nu0S+fV4V07gVdCiJP6uYyt2PS9fu8X4Kf1GLHtxP3F0mcPrvuow1fSPvBJrXJWXidtcD4varj5C4\nrZxD6xlpr+43ms3ftVpstNL6IOaVNkey9oUuqZDAJRVSeAwrZkmFtJ3dDkh6f1km8vV6lafxl1Wx\nUrGithK3gn9WXqU8qShn95hQjRKqW04u8FMNYE5L3tI4BU5t0po64r5RkritiEM1ib39RaXSXq3W\nh5SdX2601FtS+pZUEHl2+3iGiU9I1pJM4n6uFPWbltroplCvzFa7Q62y+bTLK5XXebEqsQOX18qr\nFqk4HdEfC7Tzwp+U1yi3Cs8fL61R/O9EqVuhnGoAk/pkDJC8KyhP3SnTAu0g5L1ycZuByypxf9Nx\n2v6u4/R9dyztpbZaaa3F/tIXuZN1ts5x1z3bC2DppW/LUm+HpO0o9t0L7fbmPO68j1P3WquCyN1t\nJ/qNVodLV6msn26yAc7XeTFt24HLF29ZLIU/q1ij2OeoNZBJAu8TY0vfJO8S0qcGlk0LtFMCa4j7\nwVv2oHjafohL+0abg5h9kefS3h5EvQwm7+1B4lIu8hhvezk7YW8Pt3NJu/V2++xvpX2jTWHZSutc\n1lpqrp3eNdNSW70tFtoulprN37V732QSv15K1/M8bTuRZxuR/8pcIg+lcDuYeafjbyqsNZB5yQRe\nBgl8yCDvxqTWJf7ZkxXitpJ+CCy393+XdP2uxd1aD18fg9J2aXulzZGwrdBnhxSeC7wsdYd671D6\ntiL3pb3VoiD0Oz1pq2UhYTuRr3WTyVoLrbTei36jtW601VaLxdtB4pvnnd6XM/2e7ztxW5u4KsU6\n0P0KZ8rS+a1Z90653zbKj73PajETRTqdwH2Y/+24uvrPx5jSN/KOkF6XuNshcTth28uIuB90nLrd\n5ffQ8g8tHp50c7fWarHRvZ4K0vZvuwFKd5l13puDrJ3IiwOYTtpFiWfLjusTvyrJluXp24rapm4r\nc5e+M0lvCul7rdXRbXdpJb78uj104tvnlTSfSfOrXLjP+1/Rq3JJS8V0/slbJh334O7kHzvVMCpw\nJ2J33T1B1wKn/54KyLsVtud22AFKd3+iuK2sr5VL+4ukP1VI23ffH3W/ejqIOibt2HWXwIvVSTF1\n28SdcnZl7IQcP32HkvdaN9pprgc9FiRta5QbrbXVUjfaaKMb3WitjVaH9+De4Vw73SxmWn7dan29\nzaYYzldZlWKFfa1MxlI4nUvFGuVJxf/VvvjmMzoXuCMk8BgIPMaY0jcDlgHSUnesLvEHKN2ygLj9\nWuSbuW5T9iF552n7YfG4F3Weup3EH/R/hZTtVydO2m6ZlfZCb1rtsh159v6u5dtvzcw+f1Vxfs7H\nXnq7/cfztvxDu/k+fc+KM0vetNBWy2DytpduuRP8Zr/l+Tr54ck95mjZepX14S8r6fkq77Nd5/2q\n4kCmm25o53vbQdCy+eBuymF0EFPmesog5rnmgE9D4NI4Bi9J3q0I1SW+uM1PSNwudX9TMYF/lyfx\nPG07WT/ocS/ste71fJB2WYUy03tB6HPttNhttXrZava+l7ObSWG/bc9W3LH9f569RS33f1hzaa7f\n0nK7HyDc6mOWid1JfT27yedwa3VI3vd60lorLfSmneZ7Xedydu8tr042hSQ+O+T83WGK4Wz+nlUp\n81U+tdDWJq4L99+jPWD5Pbh/v6tUnORbJ3ApnMZDZ2EygDklSN4e6am7rOe2UwJd6lax0w6J+09l\n0v5irt9Jf3x50f2fT4e07UTtrluRr7TWnZfIbeq+0Vqr3SaXtZs+96Jc1u7SXZeKMgudo2PHKufm\n9tzcDlx+3OYy3yzzKYA2RW90c6hW3NRBm77d9VDqtve/aZEttyncnW7vflxqtqncT+d2OuGb8qrE\nP+nnSOBSswTeZgoh6TvG0NM3ydtQry6x+AOUieL+l7keEvfDh+7++nlI207Q9vqDHrXQm/7Uo+70\ndKhSHvR4GKh80ONB2HP3z38naytvK257KeX7e0nqLlxfetf9y+vs8mouzW+l+fK3bu+e9TGT1rdP\nRyJf62afsVf7OmhdSN+uB/dTdzYQmxU0rg8vpPDnlfb/RDhO4v77CvXg7tL14f5MFJfSD59bkwTu\nL2cAE5B3TWI9t73tkrcRtzvV3Re3q0W+h66/68tfP47S9p96PIj7Tk9BaRc68Le1bv/+nQvb//FT\nt5W4AtdTPp5l4Lq7nO8/g6V33cn8Vrq9PRZ5PqPkOHmvdaNn3R/VKU7oS2Xf5TLTn7nU97NS1tfb\nLIXPV9qXPvngpa1R3DKpWJNIubjtTJTQVEIE3iuGPniJvPekTw2M9dyu47Zzufc3XcKuEvdf2e0/\nvrzo+//8PKTsb/p5SNnf9EP3eo4m8Xs96WH3qPtf26wS+aWirN3tN2Vi8RP4q/IzC0Odd2h/t39F\nocTtTlF3y27Ndfc95W75rYIif18+a3270HqW6flJ917vvQlK/En3hdTt7nvS3XEKdzNSbPKWiuKW\niv+tm9+Rh9qL4FzwFIG7F/CFXCbwGPTfYwN5V+L33Pa6/W5u9+MlbluNhMT9l7n9Vzab5NvXnwdp\n27TtJO4L/UjavyT9V7mofYG7n2dlUg7J215Kedosk7erFa4D193p/k7aVtxO5reBn/0681vp8+1W\n97dbPX3Z6Ga2PlQqT7ovSNzeXuxT90orPXpVylqbeAqfX4VrFPt+pdy5biDTXTpu95dJApeOpekG\nJVPngNcZwOQEniGnb+StlNPgQ3urPYMyMCVwvl8cE/c+Zec/2WySb6sfuteTvuunHg7SztL2d/0I\nC3z3qM//3Uo/lYnaybpK4K5K2akg782L9M9e1pvX4u69Dnw6K+9TurmWPs2yy0Lqnqkg5IKwneBD\nAv+SX7+6lT6/ZBJf3z7paZmL2knbJe4bJ2fzDYquSnH1yUy7eAr3dw9Xo/gyd7gPqrHApXCS7lLg\nPtQnQxU48i6lrC6xt+2A5X5KoJ1FYsXtkraT9l869NvfF3ni/qYf+q6fB0HbFP7Nid0l7f9VLu3/\nBq5bef9UoSrZvEp/v2S7798qzn0IzXOo+qQ+Sbp53X9KL/kn5FT4+XYvddt1+7JeKhf51/37cNdv\ns9tXX7NKZfXlV0HivrSzqZGZ0t3JPK5KsSn80evCHyVtta9R3H9uEZK2PdHHStt9YPaUe+kEAg/9\nJsoETv89FiYv73jqrqpLbM/tBii9udz35sfO2baJ24g7F3Uubpe8iyL/oe9//9L8lyQn7jKBPysz\n817if79IT6/Zor+Vi9tOYns316Xirm3/ge+IDeUefZP5S/bz+Wcm8c9W2O66E/dn5eL76l1/lfQl\nm+p4++W3ll9+aX270WxWlPZSWz1pe3Sqvzu9f23exUJbPeohu/FVWl9v9fzjQaW7iTvV/tbcdgLf\n7d+8q5x8gRcOBiGBO/w+vGoOuCMmZYTsM8T0zTxvAIAB8selNwAAAOqDvAEABgjyBgAYIMgbAGCA\nIG8AgAGCvAEABgjyBgAYIMgbAGCAIG8AgAGCvAEABgjyBgAYIMgbAGCAIG8AgAGCvAEABgjyBgAY\nIMgbAGCAIG8AgAGCvAEABgjyBgAYIMgbAGCA/D/ixhpnj3nKRQAAAABJRU5ErkJggg==\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"from math import pow\n",
"# Market hypothesis\n",
"k = 5\n",
"# now we specify the overall amount of chips\n",
"# again, self-loops are ignored\n",
"chips = k*(pow(q_market.shape[0],2)-3)\n",
"# whole matrix (trial) roulette method\n",
"prior_market = distr_chips(q_market, chips)\n",
"print prior_market.toarray()\n",
"\n",
"row = prior_market[2,:].toarray()[0]\n",
"# we need to add the uninformative part here\n",
"row = row + [1,1,1]\n",
"draw_pdf_contours(Dirichlet(row))"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Overall, we see the behavior of the prior is similar, however, different rows might slightly differ in their overall number of pseudo counts (concentration) which allows to steer individual beliefs per states by the values specified in $Q$."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
""
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Marginal likelihoods and Bayes factors\n",
"\n",
"After so much fuzz, you will ask yourself: \"I still don't know how to make relative judgements about the plausibility of expressed hypotheses given data!\". Fair point, which is why this tutorial finally provides the final puzzle part of HypTrails: the marginal likelihood.\n",
"\n",
"Let us re-iterate Bayesian inference:\n",
"\n",
"$$\n",
" \\overbrace{P(\\theta| D, H)}^{\\text{posterior}} = \\frac{\\overbrace{P(D | \\theta, I)}^{\\text{likelihood}}\\overbrace{P(\\theta|H)}^{\\text{prior}}}{\\underbrace{P(D|H)}_{\\text{marginal likelihood}}}\n",
"$$\n",
"\n",
"$\\theta$ corresponds to the parameters of the Markov chain model, $D$ are the human trails at interest and $H$ corresponds to a hypothesis. We have said that we incorporate hypotheses as priors into the inference process. Thus, the priors (with pseudo counts) $P(\\theta|H)$ encode our hypotheses. This means that for individual hypotheses, we have different pseudo count configurations of the prior. Furthermore, for a single hypothesis, we can further steer the amount of belief by the hypothesis weighting factor $k$ leading to increasing cocentration of the prior.\n",
"\n",
"What we want to achieve now, is to determine which prior best reflects the given data. To that end, we utilize the marginal likelihood $P(D|H)$ (also called evidence) which we describe next.\n",
"\n",
"The marginal likelihood corresponds to the probability of the data given a hypothesis where the parameters have been marginalized out:\n",
"\n",
"$$\n",
"P(D | H) = \\int P(D | \\theta, H)P(\\theta | H)d\\theta\n",
"$$\n",
"\n",
"The evidence is the weighted average over all possible values of the parameters $\\theta$ where the weights come from the prior. So basically, the marginal likelihood is an average of the likelihood weighted by the prior.\n",
"\n",
"Generally, we can say that if the prior is well aligned with the data,\n",
"then the evidence is rising with the strength of the prior. The evidence\n",
"is the largest if the prior and the likelihood are concentrated over\n",
"the same parameter regions and it is the lowest if they concentrate\n",
"on different regions. Hence, we want to choose an informative\n",
"prior that captures the same regions as the likelihood.\n",
"This leads to the fact that priors that better capture the underlying mechanisms producing the data, produce higher evidences compare to those that do not capture these mechanisms that well. Furthermore,\n",
"if the prior choice represents a valid hypothesis\n",
"about behavior producing the data (in our case human trails), the evidence\n",
"should be larger than a uniform prior, or an unlikely hypothesis prior\n",
"with an equal amount of pseudo counts. For a more detailed understanding of the marginal likelihood and its application in HypTrails, please consult both our HypTrails paper and PlosOne paper.\n",
"\n",
"For our Markov chain model with a conjugate Dirichlet prior, the marginal likelihood is defined as (please consult our PlosOne paper for derivation):\n",
"\n",
"$$\n",
"P(D | H) = \\prod_i\\frac{\\Gamma(\\sum_j \\alpha_{i,j})}{\\prod_j \\Gamma(\\alpha_{i,j})} \\frac{\\prod_j \\Gamma(n_{i,j}+\\alpha_{i,j})}{\\Gamma(\\sum_j (n_{i,j}+\\alpha_{i,j}))}\n",
"$$\n",
"\n",
"For comparing the plausibility of two hypotheses, we resort to Bayes factors. \n",
"Bayes factors are representing a Bayesian method for model comparison that include a natural Occam's razor guarding against overfitting. In our case, a model represents a hypothesis at interest with each having different priors with different hyperparameters that express corresponding beliefs. For illustrative purposes, we are now interested in comparing hypotheses $H_1$ and $H_2$ where $H_1,H_2\\in\\textbf{H}$, given observed data $D$. We can define the Bayes factor---note that we apply unbiased comparison assuming that all hypotheses are equally likely a priori---as follows:\n",
"\n",
"$$\n",
"B_{1,2} = \\frac{P(D | H_1)}{P(D|H_2)}\n",
"$$"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"The strength of a Bayes factor can be determined by consulting the interpretation tables of Jeffrey or Kass and Raftery.\n",
"\n",
"The better a hypothesis is aligned with the data, the higher the evidence will be. For some examples of this behavior, please consult Section 2.3 of our HypTrails paper. For having a fair comparison, we want to compare hypotheses with each other for the same values of the hypothesis weighting factor $k$."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"###HypTrails in a nutshell\n",
"\n",
"Now, the core concepts of HypTrails can be summarized by following visualization."
]
},
{
"cell_type": "code",
"execution_count": 35,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
""
],
"text/plain": [
""
]
},
"execution_count": 35,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"from IPython.display import Image\n",
"Image(url=\"http://i.imgur.com/EZTKWcc.png\")"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"###Results\n",
"\n",
"Now, that we know how HypTrails work, we can finally complete our experiments and discuss the results. We have already expressed our hypotheses, collected the data and we know how to elicit the priors. What is missing is the calculation of the marginal likelihoods."
]
},
{
"cell_type": "code",
"execution_count": 36,
"metadata": {
"collapsed": false
},
"outputs": [],
"source": [
"from hyptrails.trial_roulette import *\n",
"def calc_evidence(matrix, trails, vocab, ax, label):\n",
"\n",
" shape_matrix = (max(vocab.itervalues()) + 1, max(vocab.itervalues()) + 1)\n",
" \n",
" # We iterate through some values of k (hypothesis weighting factor)\n",
" evidences = {}\n",
" for i in xrange(10):\n",
" # If k = 0 then we can simply use an empty matrix\n",
" if i == 0:\n",
" prior = csr_matrix(shape_matrix, dtype=np.float64)\n",
" # Otherwise, we need to build the hypothesis matrix and elicit the prior\n",
" else:\n",
" # Here we elicit the Dirichlet prior from expressed hypothesis matrix\n",
" # We use the row-wise (trial) roulette chip distribution (i.e., same amount of chips for each row)\n",
" # chips = number of chips to distribute PER ROW\n",
" # The HypTrails paper suggests to distribute |S|*k chips per row.\n",
" # As we ignore self-loops, we distribute (|S|-1)*k chips per row.\n",
" chips = i*(matrix.shape[0]-1.)\n",
" prior = distr_chips_row(matrix, chips, n_jobs=1)\n",
" \n",
" # Now, we can pass everything to the Markov chain framework and calculate corresponding evidences\n",
" # k=1 corresponds to the order of the MC (first-order)\n",
" # reset=False can be set to true if we want to work with a reset state (start end end state for each trail)\n",
" # prior=1. corresponds to the initial uniform prior that is necessary for ensuring proper priors\n",
" markov = MarkovChain(k=1, use_prior=True, reset = False, prior=1., specific_prior=prior,\n",
" specific_prior_vocab = vocab, modus=\"bayes\")\n",
" markov.prepare_data(trails)\n",
" markov.fit(trails)\n",
"\n",
" evidence = markov.bayesian_evidence()\n",
" evidences[i] = evidence\n",
" \n",
" ax.plot(evidences.keys(), evidences.values(), marker='o', clip_on = False, label=label, linestyle='--')\n",
" return evidences"
]
},
{
"cell_type": "code",
"execution_count": 37,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAbsAAAEsCAYAAABaCh3lAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzsnXd4VNXWh9+dQkIPvYdAQBAVQRRsQEAhaEQRLBQLKPd6\nRROsoCASL3i9NryQD8tVsdAsV1EkCgkloBQR6R0DhBp6C6TP+v44kzDJlEySmUzJfp/nPHNmn33O\n+XGYzJq919prKRFBo9FoNBp/JsDTAjQajUajcTfa2Gk0Go3G79HGTqPRaDR+jzZ2Go1Go/F7tLHT\naDQajd+jjZ1Go9Fo/B6PGDul1NtKqR1KqU1Kqe+VUrUtjnVUSq1WSm1VSm1WSoV4QqNGo9Fo/Afl\niXV2Sqk+wBIRMSml/g0gIi8ppYKAP4GHRGSLUqoOcE5ETBUuUqPRaDR+g0dGdiKSbGHAfgeam/f7\nAptFZIu53xlt6DQajUZTXrzBZ/cY8LN5/wpAlFILlVJ/KqVe9KAujUaj0fgJQe66sFIqGWhs49A4\nEfnJ3Gc8kCMicyz03ApcD2QCS5RSf4rIUhvX13nONBqNRoOIqJL6uG1kJyJ9ROQaG1uBoRsO3AkM\nszjtILBCRE6LSCbGiO86B/fwie3RRx/1uAatVWvVWrVWf9TqLJ6KxuwHvAjcIyJZFocWAdcopaqa\ng1V6Ats8odGVREREeFqC02it7kFrdQ9aq3vwJa3O4rZpzBJIAKoAyUopgNUiMkpEziqlpgB/AAIk\nisgvHtKo0Wg0Gj/BI8ZORNo6ODYbmF2BctxOWFiYpyU4jdbqHrRW96C1ugdf0uos3hCN6fd06tTJ\n0xKcRmt1D1qre9Ba3YMvaXUWjywqdwVKKfFV7RqNRqNxDUopxJPRmBqNRqPReAva2FUAKSkpnpbg\nNFqre9Ba3YPW6h58SauzaGOn0Wg0Gr9H++w0Go1G47Non51Go9FoNGa0sasAfGn+W2t1D1qre9Ba\n3YMvaXUWbew0Go1G4/don51Go9FofBbts9NoNBqNxow2dhWAL81/a63uQWt1D1qre/AFrYnJiUSP\niAZAtVULVSN1p6P+nqp6oNFoNBpNmUhMTmT09NGkdk41Gh4imvlEqkYKOSY/2zpH++w0Go1G41Nc\ne/+1bL56s/Em3rwBzGKh7JE7bJ2jR3YajUaj8Qqy8rJIPZ3KrlO72HVyF9c1uY7oNtFW/QIC7Xjg\nqlDV3rW1z64C8IX57wK0VvegtboHrdU9VLTWr7d+TeuprQn7dxiDvhnEF5u+4HTmaapXqW6zf8Oq\nDW1fKIdMe/fQIzuNRqPRuJwL2RfYfWp34Sht16ldXNXgKib0nGDVt0fLHix8aCGtwloRHBhc4rXj\nhsaROj31ss8OYD6pnCfB3jnaZ6fRaDQawAj8mDZnGtmSTYgKIW5oHDF9Yuz2FxGUsl7i9sueXxj0\nzSDa1mtLu3rtjK1+O65rch0dGnRwmdaEuQks+mwRtGEh50mwF5wC2thpNBqNBhsRjkDkhkimPjWV\n23rdxoajG4qM0nad2kWDag1IGZ5ida08Ux4BKoAA5X5PmVcvKldKva2U2qGU2qSU+l4pVdvcPkwp\ntcFiy1dKdfSERlei5+rdg9bqHrRW9+DNWkWEd2a+c9nQ7TNeUjunkjA3gSMXjjB64WiW7FtC9SrV\nGXL1EOYMnMPPw2wPpIICgirE0JUGT/nskoCxImJSSv0beBl4SURmA7MBlFJXA/NEZLOHNGo0Go1f\ncjHnIs8nPc/+s/tJO5dG2tk0cg/lQqR13yxTFq3rtGbt39ZWvFAX4vFpTKXUvcAgEXmoWPu/gHwR\nsfZmoqcxNRqNpgAR4ciFI+w/u7/QgO0/u5/DFw6zYMgCK79avimfD9d9SERYBBFhEbQMa8mgJwaR\nFJFkde3otGgWzlhYUf+UUuPsNKY3RGM+Bsy10f4AcHcFa9FoNBqXUtqgD1vkm/I5fOEwaWfTuKnF\nTQQFWH919/i8Bw2rN6Rl7ZZEhEVwXZPrGHjlQExiIlAFFukbGBDIU12fKtJmK8Ixcn0ksU/Hlkqr\nt+I2Y6eUSgYa2zg0TkR+MvcZD+SIyJxi53YDLonIdkf3iI+PL9yPiooiKiqqnKrdQ0pKitdqK47W\n6h60Vvfg7VqLBH3sAyIgdbphTEoyeM8sfIZNxzaRdjaNwxcOU79afSLCIpg/eD71qtUr0lcpRWpc\nqp0rOUeBnoS5CaQfSadx08bEPh1basPsblJSUsrk/3SbsRORPo6OK6WGA3cCt9k4PBiYY6O9CJbG\nTqPRaLyNaXOmFV0LhhH0MXr6aL65+A37z+7n07s/pU3dNlbn9mzZk/5X9KdlWEta1GpBSFCI2/XG\n9Ikhpk+MV/+IKD6wee2115w6zyM+O6VUP+BdoKeInCx2LAA4ANwqIvsdXEP77DQajVcTNTyK5a2W\nW7W33NCSiRMnEhEWQddmXe1mCtGUjLf77BKAKkCy2XG6WkRGmY/1AA44MnQajUbjTZy6dIpVB1ex\n8uBK7mx7Jz1a9gAgRNkejbWv254RnUdUpMRKj0cWQohIWxFpKSKdzdsoi2MpInKzJ3S5C29eX1Mc\nrdU9aK3uwZNaVx1cxRM/PcFV719Fq6mtmLZ2GtWCq9GoeqPCPnFD44jcYI7nN69di1wfSewQ7w76\n8KXPgLN4QzSmRqPR+BzZedl0aNCBv3f5O9c2vtZmhGSRoI/0dBoHeGfQR2XA4+vsyor22Wk0Gndw\nMeciaw+v5bcDv/Hbwd9oUK0BswbO8rQsjR2c9dlpY6fRaDTA/rP7efB/D7L1+FY6NupI9/Du3Bp+\nKze3uJn61ep7Wp7GDl6dG7Oy4Uvz31qre9Ba3UNptYoI+8/ut3msSY0mvHX7W5x48QSrH1/NW33e\n4u52d7vM0Pnzc/UFtM9Oo9H4Lbn5uWxM31g4Jfnbgd8ICQxh59M7qRZcrUjfkKAQekb09JBSjbvR\n05gajcbncDYFV+ePOpNvyufW8FsLt/Da4R5QrHEX2men0Wj8Elt118LXhfN+3PtWBi87L7tCMo9o\nPIfLfHZKqRuUUs8ppd5RSk1SSj2glKrjGpmVA1+a/9Za3YPW6hqOXzzOy/992aru2oHrD5AwN8Gq\nvzcZOm9+rsXxJa3OYtfYKaVGKKXWY9SaCwV2AseA7sBipdQXSik9H6DRaCqMr7Z+xeGLh20eyzJl\nVbAajS9hdxpTKfUUMENEMu0c7wzUE5HFbtRnFz2NqdH4H2ezzrIibQU5+Tnc1+E+m32iR0T7ZN01\njXsod25MEZnu6EQR2VAWYRqNRlNAVl4Wy/YtY9l+Y9t5cic3Nr+RwVcNtnuOv9dd07iHEgNUlFIJ\ngAAFllOA88AfIvKje+U51OUzIztvLpdRHK3VPWittjly4QhDvhtC74je9GrVi27NujnlZ0tMTixa\nd22I96fg0p8B9+DKqgehQDvgWwyDNwjDLdxRKdVLRJ4pl1KNRuO3ZOdls+bQGpanLeflW18mODC4\nyPGmNZuyfLh1CZyS8IW6axrvwpmR3e/ALSKSZ34fBPwG3ApsEZEr3a7Sti6fGdlpNJWJtYfXkpya\nzNL9S1l7eC1X1r+SXhG9GNd9HLVDa3tansbPcOXILgyoAZw1v68B1BWRPKWUDn/SaDRFmL15NoEB\ngTx747N0D++uDZzGK3AmN+ZbwAal1OdKqc+BDcDbSqnqgEciMX0NX1qzorW6B1/QmpicSPSIaDr1\n60T0iGgSkxOt+pjExMb0jby3+j1WpK2weZ2pd0xlSvQU7rriLrcbOl94rgVorZ6lxJGdiHyqlPoF\nuMHcNE5Ejpj3X3SbMo1GU2EUyUoiQASkTjeiHTt27ciPu35k2f5lpOxPoX61+vSK6MUt4bd4VLNG\nUxqcShemlLoH6GF+myIiP7lVlRNon51G4zocrV17ZtwzfLvtW3q16kWviF40q9XMAwo1Gtu4zGen\nlPo3xqhuNkY0ZpxS6mYRebn8MjUajafJzsvm6KWjNo9lmbLo16Yf/dr0q2BVGo1rccZnFwP0FZEZ\nIvIp0A+4qzw3VUq9rZTaoZTapJT6XilV29webE5DtlkptV0p9VJ57uMt+NL8t9bqHrxN64mLJ/h8\n4+cM+mYQjd5pxIEzBy4f3Hd5NzQgtOLFlQJve66O0Fo9izPGTjAiMgsIM7eVhyTgKhG5FtiNkX8T\n4H6gioh0BLoAT+j8mxqNa8k35dP1k64s2L2Au6+4m92xu5n94mwiN0QW6Re5PpLYIToricY/cGad\n3RDg30CKuakn8JKIfOUSAUrdCwwSkYeUUoOBocC9QB1gJdBNRM7aOE/77DQaB2TnZWMSE1WDq1od\nM4mJAFX0t25BVpIsUxahAaE+kZVEo3FpPTulVFMMv50Aa0UkvfwSC6/9EzBXROaYF6zPAnoD1YBn\nROQTO+dpY6fRFOPExRP8vOdnftr9E4v3LubzAZ8zoP0AT8vSaNxGuQNUlFJdKDpdecj82lQp1VRE\n1pcgIBlobOPQuIJoTqXUeCBHROaYj3UD8oAmQF3gV6XUEhHZZ+M6xMfHF+5HRUV5bdogX0pppLW6\nB3drTUpNIj4lnu0ntnN769u564q7eD/mfRpWb1jqa+nn6h60VteQkpJSJp+io2jMd3Hsm+vl6MIi\n0sfRcaXUcOBO4DaL5iHAQhHJB04opVYC11PEZX4ZS2On0VRmmtVsRnxUPD1b9vSqgqUajaspPrB5\n7bXXnDrPqWlMV6OU6odhTHuKyEmL9jFAexF5zJyhZS3woIhstXENPY2pqTQUTE/+dfovJvWe5Gk5\nGo3X4IppzFtF5DcHx2sD4SKypQz6EoAqQLJSCmC1iIwCpgOfKaW2Yqzpm2HL0Gk0/o6IsO3ENn7a\n9RM/7f6JbSe2cXvr2xnQTvvfNJqy4GjpwX1KqdVKqVeVUjFKqa5KqZ5KqceVUjOBBYB1mJcTiEhb\nEWkpIp3N2yhz+0UReUBErhaRq0Tk3bJc39vwpTUrWqt7KK1WQRg5fySHLxxmYs+JHH/hON898B0P\nX/uwewRa4M/P1ZNorZ7FUaXyZ5RS9TDq192PETSSCewAPnI06tNoNAaJyYlMmzONY0eP0eiLRsQN\njSsSzn/i4gmCA4MJCw0rcl6ACmDNyDUVLVej8Vs84rNzBdpnp/F2iiRXNhO5PpJnH36W843OF05P\nzh44m7uuKFdSIo2m0uLSdXbeiDZ2Gm/HXnLl0BWhjHx+JP3b9dfRkxpNOXHW2DmTLkxTTnxp/ltr\ndR3Zkn35jcXima7Nu5JwZwJ9I/t6paHz9udqidbqHnxJq7NoY6fRuBAR4Y/DfwAQomwbsqqBZYrr\n0mg05cCZ3JjVgecwlhn8TSnVFmgnIgsqQqADXXoaU+M1XMi+wJebvmT6H9MJUAGsenwVv6741abP\nburTU3XOSY3GRbjMZ6eU+gb4E3hERK4yG79V5ooFHkMbO403sPPkTv5v7f8xZ8scbmt9G0/d8BQ9\nW/bEvH5UJ1fWaNyMK312kSLyJpADxlq48oqrbPjS/LfWWjoW711M3ap12fzkZr69/1uiIqIKDR1A\nTJ8YFs5YSPzweBbOWOgThs4bnquzaK3uwZe0OkuJlcqBbKVUoZNBKRUJZDvor9FUGp7u+rSnJWg0\nGidwZhqzLzAe6AAkA7cAw0VkmfvlOdSlpzE1bkdEWHNoDd/t+I63+7xdZNSm0Wg8x4rERJKmTeP1\npCT6waKDMG2ryM/2+jtbz64+cKP57RrL5M2eQhs7jTvJzM1k7ta5TP9jOueyzjHqhlE83fVpqgRW\n8bQ0jabSsyIxkUWjR/N6aioKozzP3+Cv1TDansEr0WenlBoI5InIAnMEZp5SSmejLQW+NP+ttULC\n7wmE/yec73d8z+Rek9kdu5vnbnquXIZOP1f3oLW6B2/XmjRtGq+nphZp+xjahEOsvXOc8dlNFJHv\nC96IyFmlVDzwQ1mFajTezPVNr+f3kb/Tuk5rT0vRaDQ2CEpPt9lew0FxAmd8dptFpGOxti0ick1Z\nRLoKPY2pKS95pjyCApz5vafRaLyJV666isnbtwMUTmMC3AkLfxa5w9Y5ziw9+FMpNUUpFamUaqOU\neg9j3Z1G45NsSt/E33/6O9d8cA0mMXlajkajsSQvD9asgcmTYeZMm136vvUW4yMji7SNhNQDRq1U\nmzhj7GKBXOBr4CsgC3jKWd0a75//tsRftebk5/DV1q+4dcatxMyJIbx2OCmPphCgKiZjnr8+V0+j\ntbqHCtd67BhMmwZ33w3168MTT8Dp09Cmjc3uPWJiiJ46lQnR0YAxolsDcY6iMUucwxGRDGBsGf8J\nGo1XMOz7YZy8dJJnb3yWu9vdTXBgsKclaTSaAk6dgi1bYOhQ+OQTaNiwxFN6xMTQIyaGyUphb+rS\nEmd8du2AF4AILhtHEZHeJapxI9pnpykNmbmZVA3WCZg1Go9w5gwsWwZ//AH/+he4cL2qs+nCnPHO\nfwt8AHwC5JvbtJXReB0ZORmsP7qeHi17WB3Thk6jqWCWLIHkZON11y645Ra4/XbIz4egig8Mc8Zh\nkSsiH4jI7yKyzryVK0BFKfW2UmqHUmqTUup7pVRtc3sVpdRnSqnNSqmNSqme5bmPt6Dn6l1LYnIi\n0SOi6dSvE9Ejovnou494ZuEztPxPSz5e/7Gn5dnEF55rAVqre6h0WufMgZAQmDIFTp6EX36B55/3\niKED50Z2PymlngK+xyInpoicLsd9k4CxImJSSv0beBl4CfgbYBKRjkqpBsAvSqkb9HylpoDE5MTL\nZXMEiIDF0xYzqP8gNjyxgfDa4Z6WqNH4PyKwY4cxauvRA661UQTn008rXpcDnPHZ7cfGtKWItHKJ\nAKXuBQaJyENKqf/DSEc2y3xsMfCyiPxh4zxtAysh0SOiSYpIsm5Pi2bhjIUeUKTR+A8F+SaDsrPJ\nCwmhb1wcPWLMlTrS02HRIli82DBywcHGtGRsLHTq5DHNLvPZiUiESxTZ5zFgrnl/E3C3UmouEA50\nAZoDVsZOUznJFtsFN7JMWRWsRKPxLyzzTRYw3rzfIyYGFi6En3+G226DiRMhMtKlgSbupkRjV9ZK\n5UqpZKCxjUPjROQnc5/xQI6IzDEfmwFcCawD0oBVXA6KsSI+Pr5wPyoqiqioqJL+OR4hJSXFa7UV\nx9u1hqiQy2/2Aeb5hdCAUI/ocRZvf66WaK2upWC0dOjYMZo3alR0tFQR5OdDYKB1++HDMH8+nD8P\n58+TNHMmrx88CEAKEAW8nprKhIQEQ+/w4cbmYVJSUsrkU3TGZ/cZRsaUm83vjwD/AxwaOxHp4+i4\nUmo4cCdwm8U5+RiGtaDPSmC3vWtYGjuNf5KRk8H4JeN5+NqHub7p9cQNjSN1eqrhszMTuT6S2Kft\n5n/VaDyG5WgpBcOAFBktOSIvzwjsMBujwq1aNejb17r/pk0werR1/1tuMaYdi3PhAmzeDLVqQa1a\nBFWxneg8MMu7Zk2KD2xee+01p85zxmf3p4h0UUptEJHO5rZNImLDI+kcSql+wLtAT8tyQeYisQEi\nclEp1QcYLyJRdq6hfXZ+zpK9S/jbT3+jR8seTImeQt2qdQEjSCVhbgJZpixCA0KJHRLrExXANZWP\nV6KjmZxk7WOeEBHBpD59DGPUrBm8+671yWvXQv/+hcaocOvUCWx9wZ85Yxi84v1DnZv1sKs1OppJ\nC73XH+7KdXbuqFSeAFQBks3FMFeLyCigEbBQKWUCDgEPl/M+Gh/kXNY5xiSP4Ze/fuGjuz7ijrZF\nkyPE9InRxk3jEwRl2/6qDFQKunQxjFGzZrZP7trVSKPlLHXqQDmmdPvGxTE+NbWIz25cZCT9Yv1j\n1sQZYxcPLASaK6XmYK5UXp6bikhbO+37gfblubY34gt+hQI8rdUkJnp+3pMbm9/I1lFbqRVSy25f\nT2stDb6g1eO+pTLgdc/VZILly42pwypVyAu57GNOwZjGBMi/4goj/6MXUfB/PSEhgYPp6bRo3Jh+\nsbFe/xlwFmeiMZOUUuu5XKk8zhsqlWv8kwAVQPLDyTSo3sDTUioV5fItaeCvv+CLL+DLLyEsDObN\ng9atfW60VJBv0ut+RLgAuz47pVQXrNfXFZYOEpH17pXmGO2z02hcQF4epKXxygMPMHm99Z+0t/tr\nPM6iRUYpml27jCTGw4dbrTlbkZhIckICgVlZ5IeG0sePRkvegCt8du9iGLaqGOvdNpvbO2IsDbip\nvCI1lZuTl05St2rdCiuzU2kxmSAry4jiK87kyfD55wSdO2fzVG+LxPM6qlWDF16AO+4AO9GMBaMl\njWex+y0jIlEi0gtjqcF1ItJFRLoAnc1tGiepdDnxSkBE+GrrV1z9/tWsPri6zNfRz9UG+/cbaZrG\njoWBA+Hqq6FGDZg0yXb/iRNh/37yunYtbEqxOJxfPJLv449hxQrIzXW18jJRYc/1xAnb7d27wz33\n2DV0lujPq2dxJkClvYhsKXgjIluVUle6UZPGjzly4QijEkfx1+m/+GnIT9zQ7AZPS/ItTp2C3buN\nzBU33mh9PDUVfv0V2raFIUOM1zZtDINnC3MGDKd9S8eOwUcfGfe5/XZjRNOvHzRt6qp/ofdw9ix8\n/bXhizt+3JiqtLU4W+MTOLPO7isgA5iF4bMbCtQQkSHul+dQl/bZ+RAiwhebvmBM8hj+cf0/GN99\nPCFBISWf6OM4zDXoDDt2wOuvw549xmYyGQbs3nth3DiXa3Xat5SebqSP+uUX+PNP/zIEixcbo+Of\nfzYWbz/6KERHG7kgNV6Hsz47Z4xdVeBJoLu5aQXwgYh4dDJfGzvfIt+Uz5OJTzLqhlF0auy5pLEV\nic1cg5GRRE+dSo9evYwIvj17jJEawMsvW1/kyBFISjIMXNu20KCB9+UjFLGt6fx5yMyERo0qXlN5\nmDABGjeGwYOhXj1Pq9GUgLPGDhHxyc2Q7hssW7bM0xKcRmt1HeP79hUxTIEsM78KyCshISKhoSId\nOojcc4/Iiy+KzJnjabmFuOy5JiWJhIWJdOkiMmGCyKpVInl5rrm2mXJpNZlcpsMZvP3zaokvaTXb\nghJthl2fnVLqWxG5Xym1FeslCCIiHctjjTUaf8du9oxOnWDlSv+Z9rNHnz6Gr2vVKmO684knjJHq\nlCnwyCOe0ZSXZywX+OILo7DozJme0aGpcByts2sqIkeUUi0xfHVFECPbicfQ05jeSb4pnw/WfcD9\nHe6nUQ0fm75yJSYTr/TuzeTly60OVeq1a+as+rRoUbH33brVMHCzZkFEhOGHe/BBI8WWxqcp9zo7\nESlYXnAf8JWIHHaVOI1/svPkTh6f/ziBKpD+V/T3tBzPceECPPoofTF8dL6SPaNCcGTkBgyAmjWN\nCM/oaNf5y7KyDMN2zz2wbBm097uMhBoncGY1b00gSSn1m1LqaaVUJf65XjZ8ac1KWbTmmfJ487c3\nuXXGrQy9eigpw1NoGdbS9eKK4ZXPde9euPlmqF+fHklJRE+dyoToaIZfey0ToqPpN3Wq1y8w9thz\nnToVbr3VCPdv3RpuuslYH2hjYfuKxEReiY5meKdOvBIdzYrERPvXDQ01Rnb/+pdHDZ1Xfl7t4Eta\nncWZ3JjxQLxS6lrgAWCFUuqQiNzm+ExNZSA3P5fun3WnZkhN1v19HRFhEZ6W5DmWLDFSRr36Kowa\nBUr5da5Bl9OypeHXe+IJyM421gumpBi+NQts5vHcvh26dKHHo48ayzKK420RrJoKp8SlB4UdlWqC\nMaU5BGOdnUcDVLTPznv4/dDvdG3WFVWZv1D27DGyacydC716eVqNX2O37lrr1kxavBhatfKAKo2n\ncFk9O6XUKIwRXUPgW2CkiGwvv0SNv9CteTdPS/A8bdsaC8B1wIPbsRvl2qKFNnQauzjjswsHnhGR\nDiIyURu60uNL89+OtOab8itOiBN43XN1YOi8TqsDvF1r8RpxBVjl8fQyvP25WuJLWp2lRGMnIi8B\nNZVSIwCUUg2UUvrnUyVjzaE1dPywI5vSN3laiqaS0zcujvGRkUXaxkVG0qcyR7lqSsSZdGHxGCV+\n2onIFUqpZsA3InJLBehzpEv77CqAS7mXmLB0AnO2zmFav2ncf9X9npbkeebMgSuugOuv97SSSouu\nEacpwJW5MTdhlPX5U0Q6m9s26wAV/2f5/uU8Pv9xujXvxtR+U6lfrb6nJXmW/Hwj+fL//gc//ADX\nXONpRRpNpcdZY+eMzy5bREwWF65eLmXGNSYppTYppTYopRaZIz0Ljr2slNqjlNqplOpb3nt5A74w\n/52YnEj0iGg69etE9Iho5i2cx4vJLzIlegqzB872SkNXoc/17Fno3x/WrYO1a0tt6HzhM1CA1uoe\ntFbP4kw9u2+VUh8BYUqpvwOPAZ+U875vicgEAKVULPAq8KRSqgPwINABaAYsVkpdYWlsNa4nMTmR\n0dNHk9o51ciCGgGpH6byn1H/4a52d3lanufZtQvuvtvI6vHuu7rUi0bjgzi1zs48wioYZS0SkWSX\nCVDqZaC5iDxl3jeJyJvmYwuBeBFZY+M8PY3pIqJHRJMUYb1uKTotmoUzKmkOR0vmzTOKpo4c6Wkl\nGo2mGC5bZwcgIkmA9bdhOVBKvQ48DJzDSIIA0BSwNGyHMEZ4GjeSZbJdmtBee6XDVkYOjUbjUzjj\nsysTSqlkpdQWG1t/ABEZLyLhwGzAUcywzw/fvHn+W0TYd3rf5QaL3dAAvW7JVWit7kFrdQ++pNVZ\nnBrZlQUR6eNk1zlAIhAPHAYs06I3N7fZJD4+vnA/KipK5x4sJSLCc4ueI7RdKK3+bMW+LpctXeT6\nSGKfroTrlrKzrXIxajQa7yElJaVMxthRPbv/Ar8Ai0XkQrnUWV+7rYjsMe/HAt1F5AFzgMocoCvm\nABWgjS3nnPbZlQ8R4aXFL5G8N5kljyxh1W+rSJibQJYpi9CAUGKHxBLTp5KtW1q1CoYNM16bNCm5\nv0aj8TjlXmenlLoRuAPoDeQCi4CFIlLuFBpKqf8B7QATsB/4h4gcNR8bhxHxmQeMFpFFdq6hjV05\nmLB0Aj+KBBQkAAAgAElEQVTu+pFljy6jXjUX1Q3zZT79FF5+GT7/HO6809NqNBpNCSQmrmDatCSS\nkl4H+i2Cg9NEtv5s9wQRKXED6gNDgS+BjcBnwAPOnOuuzZDuGyxbtszTEoqQmZspD3//sBzLOGZ1\nzNu0OsIlWnNyRGJjRa64QmTHjvJfzw6V7rlWEFqra1mwYLn07Tterr32Uenbd7wsWLDc05JssmDB\ncomMHCcgAphfR+6Bq+4UOzbD2WjMkxjTi3OUUcelCxBddpus8SShQaF8ee+XnpbhHQweDJcuwe+/\nQ1iYp9Vo/JCCEcixY4do1GgxcXF9iYnp4WlZViQmrmD06EWkpr4O5kqBqanjAVyu99w5OHoUcnKK\nbg0bQocO1v23boXk5Mv9PvssiX37Xi/W6+M2cGcsYHN053Q9O29DT2NqXML27dCuHQQGelqJxg8p\nakAMIiPHM3VqdIUavLNnIS0NMjONwu+ZmcbWrBl0M1foio5+haSkyVbnNmkygR49JpGTAz17wujR\n1tf/9lsYM8baeD30EHz8sXX/b74xahxXqVJ0698fnn/euv/q1cY5Bf1mzownLS3efFRxOWj/geUi\n30TZegZui8bUaHwCWz8jNRoXMW1aUhFDB5Ca+joJCROKGLv9+2HlyqKGKDPT+Hjed5/1dRctgn/+\n09p43XsvfPCBdf+UFJg4EUJDoWrVy1ufPpeNXXa2bXNQq1YgAwYYRsZeucDoaCMvenHjVaWK7f4P\nPGBsznLTTcZWwNq1eaSl2eqZkWnvGtrYVQApKSkeXRaxeO9ioiKiCAoo+b/b01pLg9bqHnxBa9Gp\nweZunxo8fhw2bIALF4wtI8N4bdPG9pf2Tz/BU0/BkSOWf3MpFOTPyMoqOpNw8CD8/LO1MQqy8yfb\nqRO89ZZ1/5o1bfcfMMDYHBESkmdTa0REPoMHOz63Vi1jqyji4vqSmjq+2A+JkalwIMHeOXa//ZRS\ngzDGhpZjxEJE5PvyiNVUDDM2zGBiykRWP76a5rWae1qO58jIgBUrdKSlH2DPt3ThAtx8c49Cg3Th\nAtSuDV27Wl9j7VrDWFj2vXABevWCzz6z7r99O7zzjmFMatUyXmvWtD/7HRUFv/4KI0bksWyZ9fHQ\n0KKFkLt3NzZnadTI2FyJLQMSGTmO2Nh+rr2RCyj4YZOQMIFFiwDuXAgHEhxFYzpaevA5hpFrCNwM\nLDUf6gWsEhGPZgjWPruSmbV5FmMXj2XpI0tpV7+dp+V4jn37jJ+1N94IH34IqsQlORoPc/YsbNwI\nJ08aaUkLtpYtITHRtm8pMHACTZpMKjRENWoYxuuVV6yvf/AgrFlz2WgVbHXquDZOybbPbhxTp/bz\n2iCVhIRksrICCQ3NJza2j1fqtKTcuTFFZLj5QslAB7m8Dq4J8IWLdGrcxNdbv2ZM8hgWP7K4chu6\nZctgyBAYPx6eflobOgcUTA1mZwcREpLn0qnBEycgKamo4Tp50vABvfGGdf9duwwfU716l7fGjY1p\nw+zsIKi6FMJ/gFAFWQIHBnBr10CcTazRooWxuRvLEchlA+Kdhg4Mvd6qrbw4U7x1J3BlwTBKKRUA\nbBeR9hWgz5EunxnZVbQPZPHexTz0/UMkP5zMNY1KX3fN2/01BTjUKgLvv2948efMgdtuq1BtxfH2\n52pratBR1ODRozBzZlHjVTDymjnT+vo7dsCkSUWNV716hrGzDDxwhutuHcGG4CCYOMwY/nXqBK/N\npnNuHut/szEH6SV4+2fAEl/S6sqqB4uBRUqpORj+uwcBl5X40biebs26seSRJVzV8CpPS/EcJ08a\n8dCrVkFkpKfVeD3vvGM7avDhhydw+rS1scvLM4I26tUzHm/9+sZ+06a2r3/llcZvjrJyMT+fU7m5\nhIeGQos8eOLRoh0mDkP9d0bZb6Dxe5wZ2SngXqDAfbpCROa5W1hJ+NLITqOpaPLzYe9ewzdluYnA\nf/9r3f/mm+NZvTreZvvKldbt7uRkTg5TDh1iX1YW+zIz2ZeVxfn8fHqHhZHYsSNRo0ez3EbZpZu/\n/56V06ZVqFaN53HZyE5ERCm1CiM/JsDv5RWn0WjKTm4uHDliGK+TJ22HlJ8+bax9KvBNtWhhzPa1\nbm37mjVr5tlpz7fZXlpEhPScHPZlZbHXwoC9bWPUHaQUVQMCiKlbl9ZVq9IqNJRGVaoQYPa3htj5\nkbv23DneSEtjdPPmVNNJAjTFKNHYKaUeAN4GlpubEpRSL4rIt25V5kf40vy31upaSrsezGSCABtV\nJguyVxw4YAR7NGxoGLBWreCee6zjbho0MEZ2zhIX15fNfw0nPbgW5B2GoGY0zj1HbOzjTl/jfF4e\ntWwsDLuUn0/9lSupERhIq9DQQgN2ZbVqNq8TFhzMhIgI+1oHDCB19mxSh1322UXOmsWYwYNJzsig\n3dq1vBYRwfDGjQsNpDfgC5/XAnxJq7M447N7BbhBRI4DKKUaAEsAbey8gN8O/MbMTTP5qP9HnpZS\nYaxITCRp2jQOHTvG4oYN6Vu7Nj169jSiLb2IknINfvihkTnDcprx6FE4c8ZYIGxJlSowZYqR3qlp\nU/uLjctM1Tzolgd/H3g56OO/nxjtNvjw8GFSLaYZ92ZlkS/CiVtuIaSYta4WGMjxm2+mhotEx/Tu\nDUDCvHmkHzpE4337iB06lJjevfk78Pv588xMT2dE48YuuZ/GP3DGZ7cF6FgsGnOTiJQuzM/FaJ8d\nrD64mnu+uofZA2fTJ9LZWrm+zYrERBaNHs3rqamFbeNDQ4n+9FN6DB3qQWWXyc01QueHDn2FLVus\n14NFR09g4cJJjB1rLHq2nGps1szIilHRRMfFkTRwoFX7bd9/z2IbfrAX/vqL+sHBtDKP0lqHhlIv\nOBjlRSMpTeXAldGYC7GOxvylnPo05WTdkXXc89U9fDHgi0pj6ACSpk0rYugAXs/KYsKXX3rc2I0Z\nY6wl27XLCME/dcr2n1dBqqg336xIdY65aKfdXqLBd9q0cZcUt5KRl+eyEabGt7DhHbBiDPAR0BG4\nBvhIRMa4VZWfUZYS8o7YcHQDMXNi+PTuT7mj7R0uvbartbqaoOzswv0Ui/bArCy33jcrC9avN2q7\n7ttnu0+fPvDJJ8Z6s5074brriucaNCieKsobOHDp0uU3GzcW7tb08pFaaT6veSYTndat4+nduzme\nk+M+UXbw9r8tS3xJq7OUaOzMc4UrgWXmbaW7RWkc89aqt/gg5gP6t+vvaSkVTl5IiM32fDfM/X37\nrVHurkMHI43U8OGweDGcP2+7f58+Rub3griLuLi+REaOL9LHyDXofSPx94cMIXL27CJtkbNmEXvP\nPR5S5HqCAgJYc911BClFh7Vr+ef+/WTk2fZJavwPZ3x2xaMxewAej8aszD47EfF/30h+vpGtt1h6\nDVs+u3GRkfSbOpUeMTGlukVGhlEUsk4do6RdcX75xRildewI7dvbL1fiCG/LNXguL4/adqbxEpcu\nJeHHH8kCQoHYe+4pDAbxN/ZmZvLKvn2knD3Lx+3aEVOvnqclacqIsz47Z4zdZuD24tGYItLRJUrL\nSGU2dn7NkSMwY4ZR8bFpUyO3ZbFR2zvxb7Lk//5LSF4+2UGB3Pb033khfmyJl96yBb77DjZvNrYj\nR4xR2/PPG+kz/ZlDWVm8dfAgs48dY3vXrjQqi+X2Q9adP0+1wEA6VK/uaSmaUpK4dCnTfviBpIQE\n6Np1EcePT5N9++xWPXDGZ6eAExbvT5nbyoVSapJSapNSaoNSapE5wTRKqbpKqWVKqQtKKbu1iXwJ\nX5r/9pjW5cth0CC4+mo4dAh++MEoT1zM0CUmruDDWedZeCqVH899zsJTqXw46zyJiSsAI2zfnk/t\n1CkjzdXgwbBggTEduW5dxRg6Tz3X/ZmZ/GPXLjquW0cVpdh2ww0lGrrK9Hm9vlatCjN0lem5upvE\npUsZPXfu5QjiN9+M5qqrpqpWrezW8HLG2BVEYw5XSo0AfsY10Zhvici1ItIZWAC8am7Pwljb94IL\n7uHzHD5/mOy87JI7+jpbt0LfvpCWZpTh6dzZZjd7lZ+HD08mPBzCw+E//7F9i6gomDzZKLbZvr0b\n1qp5Gd+dOEGXP/+kbnAwu7p25Z02bWhsx+epKcqR7Gx2XLQXo6rxNNN++MFIKmDJCy+0oWHDWHvn\nOPPnPgYYCNyKUd/uI1fkxhSRCxZvawAmc/slYKVSqm157+EtlDUTwcFzB+n5eU/ei36Pe9pXTKCA\nx7ImPPWUU92ysy0/slGFe40aBTJ/PkRE2M5A4mk88VxvCwvjr27dqBMcXKrzfClzhru0bs7I4OGd\nO7m3fn3iIyJo6oIfCfq5OmbpmTMczs4mPSeHYzk5pJu376++2iozT7a9mIWqxdMxXMap3JjAd+bN\npSilXgceBs5h+c1lvrWr7+dLHD5/mN5f9ia2a2yFGTq3cvo0fPGFUTHzq6+criuXmgrJyfDEE8Yp\nISG2o+eaN8+3m/exshJWSiOnuUy/evXY1bUrbxw4wDV//MGoZs14sUULm+nQ/IkCP1i2UoSIEDdg\nQJmDlFIzMwuNl+X2VuvW1Lcxlf7x0aMEAo2rVKFxlSp0qlGDxlWqWGXkAfv5UcnMtLc0tORpTKXU\nIKXUHqXUebMf7YJSyk7wtdW5yUqpLTa2/gAiMl5EwoHZgN3hp69T2vnv9Ix0bvvyNkZ2HsmzNz3r\nHlHFSFy6lOi4ODoNGkR0XByJS5eWfFJJiBgldh55xMhA/OefEOv4vzk/H1auhJdeMoJHbrnFOK1g\nGVjRcP4UwHvD+S1xlw9k/YULDNy6lSVnzrjsmt7ur7HEnVrrBgfzdmQkG66/ngNZWVz1xx9cyi/7\nGklvf66WfrDlrVqRNHAgo+fOLfwuyMzPZ39mJr+fP8+PJ0/y0ZEjvLZ/P8fsrFl8avduxu/bx7cn\nTrD70iWqBQRwc61aVLEz9TK3QwdmdejAO23a8EJ4OA81bsztdevaNHZxAwZYLZXh7bdTOX7cbpyH\nMz9T3gLuEpEdTvQtgog4+w00B0gE4ktz/fj4y92joqJ8aprAHicvneS2L29j2DXDGHtryRGGrqDg\nQ26ZWDfV/EEqV+j5vffC9u3GsGzKFKPoWQnceSekp0P//sYC7uuvLzotaVn5OT39II0bL/Hqys/u\n4vfz55m0fz8bMzJ4MTycm2rV8rQkvyU8NJQvrrySo9nZfl1N4Z1586z8YKnDhpEwbx4xvXtz+6ZN\nHMzOLhx5NTK/2ouKX3jttW7RmZKSwh8rVtA1JwfGjiUVYOzYhRw/nuAoGtOZpQcrReQWF+tFKdVW\nRPaY92OB7iLygMXx4UAXEbE5FPDXpQeZuZl8u/1bHrn2kQq7p728iNHz5rFw6tSyX/jQISPZo40p\ny/x8sPW9cfEi6Chw+xzMyuLxXbvYdekSL4WHM6JxY0L9+AtY4z7mnTjBkjNn2H7pEtsuXuTUxx+T\nP3y4Vb+e8+aRUp7vATdT7tyYSqlB5t11SqmvgR+AgvGqiMj35dT4hlKqHUZgyn7gHxb33g/UBKoo\npe4B+orIznLezyeoGly1Qg0d2Hf2OpWAKyMD/vrLyJJfnObNC3dFjHRb8+cbW79+8MYb1qdoQ+eY\nesHBDG7YkIcaNbI7HaSpWP6dlkZMvXpcU6OGp6UU4VRuLtsuXiQ8JIQIG3Eb5/LyaFO1KvfUr0+H\n6tV57OuvSbJxHQ/kJXcLjv5a+gN3AbUw8sH2Nb+/y3ysXIjIfSJyjXn5wT0ictTiWISI1BORmiIS\n7uuGzpvn6k0iHLH06VrkRXT4Id+0CUaNMmL9P/3Ubrf9++Ef/zDs3tChhu9t2jSYNKnc0r36uRbH\nVVqrBQbyWJMmbjV0lfG5lhURoVpgILdv2sSInTs56CBHq7u1ppw5Q+yePdy2cSONV66k9Zo1jN27\nl+2WeU8tGN6kCc+0aEGfunVpFhJS1A9m/h7wp5Rxdkd2IjK8AnVoPMCp3Fwe2bGDwBtuoOWsWaQ9\n9FDhschZs4gdOpS9mZmsOHuWYY0aEawUfPmlsQ7u0CEYOdJIRWIxgitOUBC0aQNLl9pOyaWxRkT4\n6dQpQgMC6Fu3rqflaByglCKueXMebdyYNw8coNO6dYxs0oSXw8NdHg17xjxSqxEYSKeaNa2O54jQ\nKjSUu+rVo0O1ajQPCSlVWkFHdQL9Abs+O6XUWBF5004WExGROPdKc4w/+Owu5lxk8orJTIyaSGhQ\nxU4WrDl3jge3b+f+Bg14o3VrklJSbOZF3HbxInF79pCamcmY8HAee+89Qnv0MCJJgoIQgW3bYOFC\nePZZ2344jXOYRPj+xAkmp6WhlOLt1q25XRs7n+JwdjYT9+2jZWhoYbX1sobzb87I4NOjRwt9ahn5\n+XSoVo2RTZowsmlTN/9LfAdX1LPbbn7908Yx37YyXsCl3Evc/dXdhNcOp0pgxecpPJ6by7S2bbnH\nHCFZMzOT63fuJCg7m7yQEGr27QvAVdWrs6RTJ9acO8e/Dhxg8sCBxDZpztUpsPgnw/8mYkRPXrwI\nOiiw9OSL8M3x40xOS6N6YCCTWrXirnr1/D/Ztx/SLCSET9q3L4xQLBLpbKYg0vmW7t3ZdukSOSYT\nverUsbqWwogEvaNuXTpUr06LUo7UNMUQEZ/cDOm+wbJly4q8z8zNlL4z+8qw74ZJXn6eZ0RZsHzB\nAhkXGSkCssywXTKuTh1ZvmCBVd9NFy5I0/e3ybV9M2XyZJHNm0VMJg+IFuvn6s040pqbny9Dt22T\nhadOiclTD9MCf3mu3kDf2Fhh2TJje++9wv2QRx6R6suXyw3r1slr+/Z5WqYV3v5cLTHbghJthqNo\nzJ8c20i529WGtzKQnZfNoG8GUSe0Dp8P+JzAAM/P+9ms/n3mDOOnJliVzelYowb7Hu9AlScrUqHv\nUjCFdezwYRp9/73NKayggABmd+jgIYUad2Iv0rlTrVqs6t6dAD1SqzAcTWO+W2Eq/BzLxe5TVk8h\nNCiUmffOJCjA/amHRIStFy/aD4sWIWfjpsK3URaHdq1Pt3mKvaT5f126RHBAAC3dUEjVFt6eRMDW\nFNb2mTP5kHIu1ncz3v5cLfF2rUXSWlkszwkLCPBqQ+ftz7Us2I1fFpGUgg1YCxwt1qYpA8/d9Bxz\nB80lOND9eQsv5OUxZPt2Ht+1i3x7wTxKcfSi7XyTF7lgs90ev1+4wHXr1jF8xw526ozxNjOzH3r4\nYRJ+/NFDijQVja20Vv4Uzu9LOJMb825gA7DI/L6zUmq+u4X5A4nJiUSPiKZTv05Ej4gmMTmRkKCQ\nCglI2ZyRwfV//kntoCCWd+pEoINfkbta9OVBIoGCbJPwAJGcbdytVPcc1qgRf3XrRmTVqvTYuJH7\nt21jw4XSGczS4Ok1Vo4QEfZY5gy0WL/o1GJ9D+LNz7U43q41pndvpg4ZQvS8eVybkED0vHlM9YFw\nfm9/rmXBmXm0eKAbsAxARDYopXR++RJITE5k9PTRpHZONWJXIyB1uuEXi+kT4/Dc8iAifJaezti9\ne3kvMpKHGje2PGgzdVed8Nb8vHMYN5BALukE05idxHJL8zWlvn+d4GAmRETwbPPm/PfoUYbt2MEf\nXbpQvZKtSVBKEWQy2TzmLxkpNM4R07s3Mb17k5KS4pfTg76CM7kxfxeRbkqpDWIUWkUptVlEOlaI\nQvu6pCTtniR6RDRJEdbJd6LTolk4Y6Hb7ns8J4eBW7fy33btilZgXr0ann4aZs40yglYkJi4gtGj\nFxUpihoZOY6pU8ufYFlE/DJcOiMvj5SzZ0k+c4bBDRtyU+3aVn1s+ewiZ83yiV/2Go2v4Ip1dgVs\nU0oNA4LMBVXjgFXlFejvZIvt6uJZJvdOYjWsUoVfO3e+bGBOnYKXXkISE1l577tMm3glX39TdIBn\nWUkgKyuQ0NB8l1USsGfojuXk0CA42Kud9MXZdekS/ztxguTTp/kzI4Mbatakb506dgt7WmakKFys\nrw2dRuMZSlqbAFQD/gWsM2+vA6HOrGtw54aXr7PrO7yvEI+xPUrhfvSI6IoRkJ8vMmOGSKNGcuT+\nWOnd5ax06SKyYoXj0ypqfc1jO3bI1WvXyuz0dMnNzy/TNSp6LdA3x47JM3v2yM8nT0pGXunWR/rS\nuiWt1T1ore4BJ9fZOZNNdoiIjBOR683beEpZd64yclPPmwheVjTiMnJ9JLFDXFejNttkKszUYMWZ\nM2R+8TXjO//MDaum8Uhsbdauhe7dXXb7cvFJu3a83bo1Hxw5Qvu1a/n4yBGy7fi4KorzeXnMP3mS\nz48etXn8/oYNea9NG+6oV6/S+SA1Gl/HGZ/dL8BsEZllfj8dqCoij1WAPke6pCTtniLflE+njzox\nIHQAf/z6B1mmLEIDQokdEuuy4JS/Ll3i/u3b+WdEBP3tFEX95BM4cADGjAEvqz5ShBVnz/KvtDTO\n5eez+rrrKuy++SL8cf48yWfOkHTmDBszMuhWsyb3NWjAP5o1qzAdGo2m7Djrs3PG2FUF5gMzgDuA\nMyIy2iUqy4E3G7vPNnzGjI0zWDF8hVuCM749fpyn9uwhPiKCJ5s29ZsAkNO5udR1caZ4R5zPy6Pn\nxo3cFhZGn7p16V67tl9XotZo/BFnjZ3daUylVF2lVF2gKjASGAucB14zt2vsUDW4Ku/2fbfQCLlq\nzUq2yUTcnj2M3buXXzp2ZFSzZqh9++D5543S3y7Ak+tr7Bk6k50fNc5oPZuby7wTJ8jIs144Xyso\niA3XX887bdoQXbeuWw2dL61b0lrdg9bqWRxFY66naHUDBcSYN4BW7hLl6wy+erBbrhu7Zw8ncnNZ\n36ULYSYTTJ5M/pT/8HX4i+R/KTw8wi239Sgiwk3r13Nz7dq80KIFzUJCHOabzDWZWHvhAkmnT5N8\n5gxbLl7kllq16FSjBjWC3J+eTaPReCclTmN6K948jekuzuTmEhYUhFq6FNM/RrEz4EqGHJvKwGdb\n8sILYLmszp84nJ3NuwcP8nl6Ol337WPH8uUcsCw0O3s2U4cMIaZ3b0bs3MmmjAz61KlD37p1uaVW\nLUL11KRG47eU22enlOotIkuVUoOwUb9ORL4vv8yyUxmNHYBpUTKXhv2NpyWB/Dv788YbDguF+xUn\nc3Lo9tRT7C2WbxIget48Fk6dSp7JRFCAM0HGGo3GHyi3zw7oaX7tb2fTOIkr57+l922M7b+dJ3/u\nz8yZrjd03jxXX79KFVpUq3a5wUa+SW81dN78XIujtboHrdWz2HViiMhE8+twd9xYKTUJuBswAceB\n4SJyVCnVB3gDqALkAC+KyDJ3aHAlS/YuoUfLHi6pZrDo9Gm+P3GCj9q1szoWGBzA9M+q2TirchBi\nZzSv801qNBpHOJrGfN5Gs2AEqoiITCnXjZWqKSIXzPuxQAcReVIp1QlIF5F0pdRVwCIRsRq/eNM0\n5qb0TUTPimZ37G5qhdQq83XyRYjfv58ZR48yp0ULeuzbj+rhJavAvQSdb1Kj0VjiityYNbHhq3MV\nBYbOTA2MER4istGifTtQVSkVLCK57tJSXsYuHsv47uPLZejSs7MZumMHAcC6PanUvmMgn1R5jIcO\ndKdqVddp9XV0vkn/x1/WjWpcT7kGOM7kFHPXhpFn8wCwBahn4/h9QJKdc53ImuZ+FqculsipkZKd\nl223T0l55nZkZEjTlStl4u+/y8lre8q2ql3k8Y5r5Y8/XCzWCXwpJ57W6h48rdVb/rY13oW9zwVO\n5sZ068IjpVQy0NjGoXEi8pMYeTbHK6VeAmKxyLlpnsL8N9DH3vXj4wu7ExUVVeG1okxiYsziMbze\n+/VyFWRtXbUqH637i+4vPs87NeLpOOMffPxgoK3ScxqNRlOpSUlJKVMAjVess1NKhQOJInKN+X1z\nYAlG0MpqO+eIp7Uv2L2A15a/xu8jfydAlS8KcMv/drH0z9r8/dXGetpSU6kx+2A8LUPjZdj7XLgs\nN6a7UEq1FZE95v1YoLuIPKCUCgOWAxNF5AcH53vc2JnExMlLJ2lYvaFHdWg0/oQ2dhpblNfYOcqN\n+byD7bly6gZ4Qym1RSm1CbgdKEgu/TQQCUxUSm0wb7bT+nuYABXglKErGHKLCO+npXHixBk3Kys7\nvrS+Rmt1D76kVaNxlrJEYyo77aVCRO6z0z4ZmFze63sDj40cxfzfV5Obk01g1WpUv+MOGrZsRdVF\nWYyYN8rT8jQajZfy5JNP0qxZM1555RUAPvjgA+Lj48nMzCQtLY06dep4WKHv4RU+u7LgDdOYjnhs\n5Ci+3buLjFcnFLZV+c9/6PdXPl//MZ/Qqjr6RKOxhZ7GLEpubi61a9dm7dq1XH311Z6W4zHc7rMz\n17N7HOiAUe6nIO5fF291QP1rOnMq4T2r9nqxz3JyywYPKNJofAN7X2qJiSuYNi2J7OwgQkLyiIvr\nS0xMD7dq8cQ9i3Pw4EFatmxJbm4ugaVMal7wHP1h7aLbfHYWzAQaAf2AFKAFkFE6mf7DC0kvkLI/\npeSOISGX9y1yOBZp90J8yV+jtboHb9SamLiC0aMXkZQ0meXL40lKmszo0YtITFzhtfcMCAhg7969\nhe+HDx/OhAnGTE9KSgrNmzdnypQpNGrUiKZNm/L5559b9d2zZw/t27cHICwsjNtvvx2AVatWccMN\nNxAWFkbXrl1Zvfpy0HpUVBSvvPIKt9xyCzVq1GDv3r0EBATwwQcfcMUVV1CrVi1effVVUlNTufnm\nm6lduzYPPvggublem7fDJThj7NqIyAQgQ0S+AO4EurlXlney/cR2vtj0Bdc2urbkztnZpWvXaDR2\nmTYtidTU14u0paa+TkJCss/cUylVZIR17Ngxzp8/z5EjR/j000956qmnOHfuXJG+bdu2Zfv27QCc\nO3eOxYsXc/r0aWJiYnjmmWc4ffo0zz33HDExMZw5cznwbdasWXzyySdcuHCB8PBwAJKSkli/fj1r\n1j+f9w8AACAASURBVKzhzTff5IknnmDOnDkcPHiQrVu3Mnfu3DL9u3wFZ4xdjvn1nFLqGiAMaOA+\nSd7Ly0teZuwtY6lTtWTn8N3dbqLGPycZbzp1AqDGa5O4u9tN7pRYbip6YX550Frdgzdqzc62HUu3\naJGRfEEpsMgxUYT4eAr7WG4l9U9Ksn3PrKyy10e0nIYLDg7m1VdfJTAwkDvuuIMaNWqwa9cuq77F\np+4SExNp164dw4YNIyAggMGDB9O+fXvmz58PGIZy+PDhXHnllQQEBBAcbCSnHzNmDDVq1KBDhw5c\nc801REdHExERQa1atbjjjjvYsMG/3SvOZFD5WClVF3gFmI+Rx3KC41P8j98O/MbG9I18fd/XTvWf\n8cn7MHIU82OfNaYus7O5u9tNRrtGoykVISF5Ntujo/NZuNDxufHx9g2bo/7R0XkkJVkfDw3Nd/5i\nDqhXrx4BFiWpqlWrRkZGyR6iI0eOFI7WCmjZsiVHjhwpfN+iRQur8xo1alS4X7VqVav36enppdLv\na5Q4shORj0XktIgsF5FWItJARD6sCHHegogwJnkMk3pNIjTIcTEZU76pcH/GJ+9zcssG/vfOvzm5\nZYNPGDpv9NfYQ2t1D96oNS6uL5GR44u0RUaOIzbWbjZBj9+zWrVqXLp0qfD90aNHXRIo0qxZM9LS\n0oq0paWl0axZs8L3/hCQ4mpKHNkppUKBQUAEEMjlEj//dK807+Fc9jk6NurIsGusK2RbsntHOgN/\nTWZB735EtKmUM70ajVsoiIBMSJhAVlYgoaH5xMb2c2tkZHnv2alTJ2bPns3kyZNJTk5mxYoVdO3a\n1alzHUWa33nnncTGxjJ37lzuv/9+vvvuO3bu3Mldd93l1Pm2+nhzZLurcGYa80fgLPAnRkFolywq\n9yXCQsP48C7Hg1lTvonHfk7k6gtYGTpv9IHYQ2t1D1pr+YmJ6VHhYf/luefUqVN59NFHmT59OgMG\nDODee+8tctzR6Kt4MIvlft26dVmwYAGjR4/mySefpG3btixYsIC6devavbatexW/vr+PBp1ZZ7dV\nRLxuJaO3rbMb9dosVjYysXLoA9SopetmazRlRS8q19iiItbZrVJKdSyLuMrC13PX8G3Hmnx41U02\nDZ03+kDsobW6B61Vo/EszkxjdgdGKKX2AQWLxEREtAEELmVk85IpjWf3VuOme9t6Wo5Go9FobODM\nNGaErXYR2e96Oc7j7mnMU5dOkZWXRbNazUrsuyRpO7f17eA2LRpNZUJPY2ps4bbcmEqpWiJy3rzG\nzgoROV1asa7E3cYu9udYggKCeK+fdX5LjUbjPrSx09jCnT67gtwx6zEiMS23daWX6jv8dfov5m6d\ny7ju41xyPV/ygWit7kFr1Wg8i12fnYjEmF8jKkyNlzB+6XieufEZGlTXa+U0Go3GH3DGZ3edjeZz\nQJqI2M7hUwG4axrzj8N/MODrAex+ejfVq1S32eeXBZu54y4dn6PRuAM9jamxRXmnMZ2Jxnwf6AJs\nNr+/BtgG1FZKPSkii0qh1+sZt3QcE3tOtGvoXvn3d3zdJIctmVcSWjW4gtVpNBqNpiw4s87uCNBJ\nRLqISBegE7AX6AO85U5xnmD6ndN5rLPturSLF27jw/bBvFurXakMnS/5QLRW96C1aqBoTTtNxeKM\nsWsnItsK3ojIdqC9iKRSxrRhSqlJSqlNSqkNSqlFSqkm5vau5rYNSqmNSqkBZbl+ebii3hUEBVgP\neM+evkTs4Y08uuUSd99ra2ZXo9FoHONsWq6oqCg+/fTTClBUeXBmGnObUuoD4CuMvJgPANuVUiFA\nWUvbvmUuCItSKhZ4FXgS2AJ0ERGTUqoxsEkpNV9ETA6uVSGM+L85NA2Bt8fZHvU5wltzDdpCa3UP\nWmv5SUxOZNqcaWRLNiEqhLihccT0ifG5ezrjj/T3PJWewJmR3aNAKvAMMBpjCvNRDEPXuyw3FZEL\nFm9rACZze6aFYatW0O5p/tp5jP0NgvnswYEEBDrzyDQajStJTE5k9PTRJEUksbzVcpIikhg9fTSJ\nyYlefc8NGzZw3XXXUatWLQYPHkxWVhYAZ8+e5a677qJhw4bUrVuX/v37c/jwYQDGjx/Pr7/+ytNP\nP03NmjWJi4sDYPTo0YSHh1O7dm2uv/56fvvtN9f/o/0Yh9/cSqkg4GcReUdE7jVv74jIJRExFTNa\npUIp9bpS6gAwFGNkV9DeVSm1DdgE/MMbRnVt2jfiz78/THiEzfX1JeJLPhCt1T1oreVj2pxppHZO\nLdKW2jmVhLkJXnvPnJwcBgz4//bOPDqqKtvD3yZMIYEwKcQIhAZtRBFQaQGJRASZRBGVISjEVlCQ\nSX0+AcVEcWrEVlFaGxtURFBBRBEVtCEIzwXYMoOiIgQVpVECJMEwZb8/7k1RCZWkQlJUVdjfWnfl\n3HPPPed3b5Ladaa9ezN48GAyMjI84XhEhNzcXG6//XZ27drFrl27iIyMZMSIEQA8/vjjJCQkMHXq\nVDIzM5kyZQoAf/nLX9iwYQMZGRkkJSVx8803c+TIkbJ96HJMkcOYqnpMRHJFpKaq7i9JxSLyKVDf\nx6XxqrpQVR8EHhSRscBIINVtcw1woYg0A14XkU9U9bCPekj1Cj+cmJh4SsMv+/7Yx/1L7ueV616h\nghRu+61HZxjB47DvjwAW/7AYecQZ8kvpmEJqYupJZVLTUnlk+SMn5RdbfgdOFM8C5OTm+KV51apV\nHDt2jNGjRwNw44030qZNG8AJ0+Md8mf8+PF06pR/oKzgcOfAgSfiad5777089thjbNu2jRYtWvil\np7yQlpZ2Sl/I/JmzywY2ucYr281TVR1V1E2q6m8I4dnAIlxj53X/NyKSBVyI48XlJLyN3any5Ion\nqVihYpGGrrSE6hyIL0xrYDCtpaOKVPGZ3/VPXfkk5ZMi701NTPVp1Ior33VnV5aw5KTrVSv4F8Jr\n9+7d+aKHAzRq1AiAP/74gzFjxrB48WIyMjIAyMrKQlU983UF5+0mT57MjBkz2L17NyLCwYMH+e23\n3/x+rvJCwY7NI4+c/EXGF/58ws8HJgCfk99l2CkjIt7hAa4Hvnbz492hU0SkEdAM2Fmatopi14Fd\nzFg/o0T/CIZhnH5GJY2iybom+fKarG3CyAEjQ7bN2NhYzzxcHunp6agqkydP5ttvv2XNmjUcOHCA\n5cuXo6qe3lxBQ7dixQqefvpp5s6dy/79+8nIyCAmJsY235eAYo2dqr7m43i9lO0+KSKbRGQD0Bln\n4QtAB2C9iKzDMbLDAulwesKyCQy/bDix1WPz5a9dk86dqTPLrJ1QnAMpDNMaGExr6ejZpSfP3/08\nXdO70nFHR7qmd+X5Ec8HdDVmadts3749FStWZMqUKRw9epT58+fz5ZdfAk4vLjIykpiYGPbt23dS\n76RevXps335ivjAzM5OKFStSt25djhw5wqOPPsrBgwfL7mHPAIodxhSR84EngOZApJutqvqnU21U\nVW8qJH8WMOtU6y0JG37dwOLvF/PtyG/z5R85fIyha5ZhzsAMI7To2aVnwLcalGWblSpVYv78+QwZ\nMoSHHnqIHj16cOONNyIijBkzhqSkJOrWrUtcXBz33nsvH3zwgefe0aNHM3jwYF566SUGDRrE3//+\nd7p168b5559PVFQU99xzDw0bNiyrxzwj8Mc35v8BKcDfgV7AbUBE3j65YFFa35gzN8wk51gOQy8d\nmi8/OfU1ttZWVt55K5Wr+DOlaRhGWWK+MQ1fBCyenVdFa1X1EhHZpKotvPNOVXRZEAhH0NOmLWNC\nnf182vgyLr6kQZnWbRiGf5ixM3wRyHh2eeSISATwvYiMEJE+gG8vyWHM1k27Sa2VwcN7osvc0IXi\nHEhhmNbAYFoNI7j4Y+zG4HgzGQVcBtyC40GlXKGqJH+Xy93D/d0xYRiGYYQLxQ5jhiqBimdnGEZw\nsWFMwxcBj2cnIm2A8Ti+BPLKq6qG3YLFnw/+TFyNuOILGoZhGOUKf4Yx3wReBW7EWY3ZC7gukKIC\nwcHDB7lk2iV8v+/70952OM2BmNbAYFoNI7j4s7b+v6r6QfHFQptJ/zeJ7k2707R2UwByj+dy7Fiu\nbS8wDMM4A/Bn60FnoD/wbyDPxbaq6vwAayuSkszZ7c7cTYuXWrDuznU0jHE2Yo55dA7pZPPew3cE\nUqZhGCXE5uwMX5yOrQfJQCugG3Cte/QqmczgkpqWyu2tb/cYugXv/odZF0cxqt0VQVZmGEZ5Ztu2\nbbRq1YoaNWrw4osvnnR92LBhPPbYYwFpu0KFCvzwww9FlklLS6NBg8K3WgVS3+nGnzG8NkCzcF36\n+PXer1nwzQK2jdgGwO6f9nPPH9sZ+XNlrnrggtOiIS0tLSQ9yfvCtAYG03pmMmnSJK6++mrWr1/v\n8/pLL710mhWVjFDXVxL8MXZf4PjF3BJgLQGhUc1GLBywkFqRtcg9nsttb8zjwuOQ8pANXxpGOPH5\nokUsmTKFiocPc6xKFa4ZNYorewbWV2Zp20xPT6d9+/Y+r+Xm5lKhgsXJPG3khZUo7AC+AY4C3wKb\n3GNjcfcF+nCkl4xnnvtIm742W/fuOVjiew3DOD34+t9e/uGHOr5JE1XwHOObNNHlH34YMB2lbfOq\nq67SiIgIrVq1qkZHR2tSUpLedddd2r17d42KitLPPvtMBw8erA899JDnnoULF2rLli21Zs2a2r59\ne924caPnWqNGjXTy5Ml68cUXa0xMjPbr109zcnI81ydNmqSxsbEaFxen06dPVxHR7du3q6rqokWL\ntHnz5lq9enWNi4vTyZMnq6rqsmXL9Nxzz9VnnnlGzz77bI2NjdVXX33VU6e3vmXLlmlcXJw+8cQT\nWrduXY2Pj9c333zzlN9vSSnsM9/NL95mFFvA2V930uFP5YE8TsXYHc45qhu+2lXi+wzDOH34+t9+\n8Jpr8hmdvOOhrl0DpqMs2kxMTNTp06erqmM4YmJi9IsvvlBV1ZycHE1OTtYJEyaoquratWv17LPP\n1jVr1mhubq6+/vrrGh8fr0eOHFFV1fj4eL388sv1l19+0X379ukFF1ygL7/8sqqqfvzxx1qvXj3d\nsmWLZmdn64ABA/IZu/r16+vKlStVVXX//v26du1aVXUMWMWKFTUlJUWPHTumH330kVarVk3379+v\nqppPX17Z++67T48cOaLLly/XqKgo3bZtW6nes7+U1tj5E89up6+jbPqVp5fKVSoGxcFzOO1bMq2B\nwbSWjoqHD/vMj1i8GEScIzXV982pqSfKeB/FlK+45OQo5QAROTklle+hd+/etGvXDoAqVfJHX582\nbRp33nknbdq0QUQYNGgQVapUYdWqVZ4yo0aNon79+tSqVYtevXp55gLfeecd/vrXv9K8eXOqVat2\nUny8ypUrs2XLFg4ePEhMTAytW7f2XKtUqRIPP/wwERERdO/enejoaLZt2+a5rgWWa0ycOJFKlSpx\n5ZVX0rNnT955551Tfh+nExswNgwj5DlWwDDkcbxr1xN9rqKMl68+WjHlj11zje82q1YtqXzAWSJf\n1MrH9PR0nnnmGWrVquU5fvrpJ3bv3u0pU79+fU86MjKS7OxsAH755Zd8dReMdffuu+/y0UcfER8f\nT2JiYj4DWqdOnXxzh9WqVSMrK8unxlq1ahEZGek5b9SoUT59oUy5NHZzt8xl2Y5lwZbhIZxWtpnW\nwGBaS8c1o0bxYJMm+fLGN2lCl5Ejy02bDRs25MEHHyQjI8NzZGVl0a9fv2LvjY2NZdeuXZ5z7zTA\nZZddxoIFC9i7dy+9e/emb9++fusSObGFLSMjg0OHDnnO09PTiYsLDxeM5c59SPaRbMYsHsP7/d9n\n1crvqVatisWmM4wwJ28F5IQXXiAiJ4fjVavSbeTIgK7GLOs2Cw4H5uXl5Q8ZMoQbbriBzp0706ZN\nGw4dOkRaWhodO3YkOjq6yDr79u3LbbfdxqBBg2jUqFG+YcyjR4/yzjvvcO211xITE0P16tWJiIjw\nW3NB3SkpKTzxxBOsWrWKRYsWMXHiRL/qCjblztg9u+pZEhom0Cz6ItpunUuXPRV59pIBQdUUTvuW\nTGtgMK2l58qePQO+1SCQbYpIvl5SwbxLL72UV155hREjRvDdd98RGRlJQkJCob8L73u7devGmDFj\n6NSpExEREUycOJE5c+Z4ys6aNYuRI0dy/PhxmjVrxptvvpmvHn81580XnnPOOURFRfHPf/6T888/\nv8TvIhgEJcSPiEzEcSadC/wXSFbVX7yuNwS2Aimq+kwhdWhB7Xuz93LB1AtYfcdqxr6Qxp4oSLvn\nNipEBHe0NlQ/PHxhWgODafUfcxcWmqSlpXHrrbfy448/BqX90roLC5axq66qmW56JNBcVYd5XZ8H\nHAfWlMTYjfp4FACNvu3Gs/UP8XnrK/nT+WcH6CkMwwgEZuxCk3A3dkHp8uQZOpdonB4eACLSG/gB\np2fnN0ePH+WrX77iushknmpwhMf/qGeGzjAMowwpasgz1Ana+J6IPC4iu4Ak4GE3Lxr4XyC1pPVV\niqjEyttWsuyLH+iz8SCDkxPKVG9pCMV9S4VhWgODaTXCncTExJNWeYYTAVugIiKfAvV9XBqvqgtV\n9UHgQREZC4zEMXCpwLOqekj8+AqR6rVPJjExkcTERB4ff1MZqDcMwzBCkbS0tFP6QhaUObt8ApzF\nKItUtYWIfA7k7ROoiTO8OUFV/+HjvpPm7AzDCH9szs7wRWnn7IKy9UBEzlPV79zT64GvAVT1Sq8y\nKUCmL0NnGIZhGCUhWHN2T4rIJhHZAHQGRp9KJcdzj3Po6KHiCwaZcJoDMa2BwbQaRnAJSs9OVYud\nWFPVR4orM2vjLN5990v6njeAWwZZ1HHDMAzDN0GfsztVRETbPZjAd5fey0f1W9KmXeNgSzIMowyw\nOTv/SU5OpkGDBiHlsuu1115j+vTprFixokzrDct9dqUhulbtpTHNLzgOsObb+sT/c6YZOsMwzkh8\nuSDzh+TkZCZMmBAARaFLWBm76Fq1l9K65VUH//FSBYDjw4fz9ZEMuvXsFWxpRRJOcyCmNTCY1tKz\naOlSuo4aReLo0XQdNYpFS5eWyzb95fjx44BvB9PGyYSVsYuIrdcx++GUfHnZD6ewauf2ICkyDON0\nsGjpUkbPmcOSPn1YfsMNLOnTh9Fz5gTU+JRFm/Hx8UyePJmWLVsSHR3NHXfcwZ49e+jevTs1atSg\nS5cu7N+/31P+5ptvJjY2lpo1a9KxY0e2bj3hSCo5OZlhw4bRo0cPoqOjT/pSkpmZyVVXXcWYMWMA\n+Oabb+jSpQt16tShWbNmzJ07F3CCxM6ePZtJkyZRvXp1rr/++pN0Dxs2jPvvvz9f3vXXX89zzz0H\nwFNPPUXTpk2pUaMGF154IQsWLPD5/Dt37qRChQrk5nqcZJGYmMj06dM95zNmzKB58+bUrl2bbt26\nBWzjelgZO6la1adeOcVgiqeLcHEADKY1UJjW0jFlwQK2DxyYL2/7wIG88P77Id2miDB//nw+++wz\nvv32WxYuXEiPHj146qmn2Lt3L7m5uUyZMsVTvmfPnnz//ffs3buXSy65hIEF2p8zZw4TJkwgKyuL\nDh06eNr4/fffufrqq0lISOC5554jOzubLl26cMstt7B3717eeusthg8fztdff83QoUMZOHAgDzzw\nAJmZmbzv43mSkpJ4++23PecZGRl8+umn9O/fH4CmTZuycuVKDh48SEpKCrfccgt79uzx+53kDb2+\n//77PPnkk7z33nv89ttvJCQkMGBAYKLUhJWx05yc3ELyT7cUwzBOI4cLmZdafOAAkpaGpKWRumOH\nzzKpO3Z4yngfxZVfcvCgz+sl/bQZOXIkZ511Fueccw4JCQm0bduWli1bUqVKFW644QbWrVvnKZuc\nnExUVBSVKlUiJSWFDRs2kJl5wpVw7969adeuHQBV3OjtP//8M4mJifTr149HH30UgA8//JDGjRsz\nePBgKlSoQKtWrejTp4+nd+crTp03HTp0QEQ8i0zmzZtH+/btPZHSb7rpJk+6b9++nHfeeaxevbqE\nbwZefvllxo0bx5///GcqVKjAuHHjWL9+fUCcTYeVsTv+y57lUY/m35EQ9cgjtI1vUsgdoUGozoH4\nwrQGBtNaOqoU8sHcNSYGTUxEExNJbex7oVpq48aeMt5HceWvqVHD5/WSjiPVq1fPk46MjMx3XrVq\nVbKysgBnDm7s2LE0bdqUmJgYGrv6fvvtN8DpETVokD8QtaqyaNEicnJyuPPOOz356enprF69mlq1\nanmO2bNne3pfxS1qERH69+/viYk3e/bsfL3MmTNn0rp1a0/dmzdv5vfffy/hm3F0jh492lNPnTp1\nAMeAlzVhZeyyMvZ1Yt2GZTWGD8sFiLl7OB2qRfPJooXBlmYYRgAZ1bs3TbwCjgI0mTWLkT7mm0K9\nzcJ6VLNnz+aDDz7g3//+NwcOHGCH2/MsqgcmIgwZMoSuXbvSo0cPDh1ynGw0bNiQjh07kpGR4Tky\nMzOZOnWq577iGDBgAPPmzSM9PZ01a9Zw4403Ao6BGjp0KFOnTmXfvn1kZGRw0UUX+dQZFRUF4NEF\n8Ouvv3rSDRs2ZNq0afl0Zmdn07Zt22L1lZSwi1SelbGvEzj77PZvKVEUoKARinMghWFaA4NpLR09\nO3UC4IX33iMHp3c1MinJk18e2szKyqJKlSrUrl2b7Oxsxo8fn++6L2OSl/fiiy8yZMgQevXqxaJF\ni+jZsydjx45l1qxZ9OvXD4D169dTvXp1mjVrRr169fjhhx+K1NOqVSvq1q3LHXfcQbdu3ajh9nSz\ns7MREerWrUtubi4zZ85k8+bNPus466yziIuL44033mDo0KG8/vrrbN9+YkHhXXfdxYQJE2jZsiXN\nmzfnwIEDLFmyhJtvvtn/F+cnYdWzMwzjzKVnp0588vzzpD3/PJ88/3xADV0g2/TuVXkv1hg0aBCN\nGjUiLi6Oiy66iHbt2hVa1lfetGnTOPfcc+nduzeVK1dmyZIlvPXWW8TFxREbG8u4ceM4cuQIALff\nfjtbt26lVq1a9OnTp1CtSUlJLF26lKSkJE9e8+bNue+++2jXrh3169dn8+bNnsUyvnS+8sorPP30\n09StW5etW7dyxRUnvF317t2bBx54gP79+xMTE0OLFi1YvHhxid6nv4S1B5Vw0Z6WlhaS35Z9YVoD\ng2n1H/OgYvjijPOgYhiGYRglxXp2hmGEFNazM3xhPTvDMAzDKAYzdqeBUNy3VBimNTCYVsMILmbs\nDMMwjHKPzdkZhhFS2Jyd4YvSztmF3aZywzDKP6cSo80wisKGMU8D4TQHYloDg2n1nzwnxf4cy5Yt\nK1H5YB6mtfRHaQiKsRORiSKyQUTWichiEYl18+NF5A83f52I/CMY+sqa9evXB1uC35jWwGBaA4Np\nDQzhpNVfgtWzm6SqLVW1NfAh8LDXte9VtbV7DA+SvjLFOzhjqGNaA4NpDQymNTCEk1Z/CYqxU9VM\nr9NowGecOsMwDMMoC4K2QEVEHgduBQ4AiV6XGovIOjf/IVVdGQR5ZcrOnTuDLcFvTGtgMK2BwbQG\nhnDS6i8B23ogIp8C9X1cGq+qC73KjQWqqmqqiFQGolQ1Q0QuARYAFxboCebdZ2uTDcMwDNSPrQdB\n32cnIg2BRarawse1ZcB9qrr29CszDMMwygvBWo15ntfp9cDXbn5dEYlw038CzgOKjjBoGIZhGMUQ\nrDm7J0XkzzgLU3YCd7n5VwKPishR99qdqlr+lgUZhmEYp5WgD2MahmEYRqAJOw8qItJNRL4Rke9E\n5IFg6ykKEZkhIntEZFOwtRSFiDQQkWUiskVENovIqGBrKgwRqSoiq0Vkvas1NdiaikNEIlwnCQuL\nLx1cRGSniGx09a4Jtp6iEJGaIjJPRL4Wka0i0jbYmnwhIn/2cpSxTkQOhPj/2D3u/9YmEZktIlWC\nrakwRGS0q3OziIwusmw49ezc+bxtQGfgZ+BLYICqfh1UYYUgIglAFjDT1wKcUEFE6gP1VXW9iEQD\nXwG9Q/i9VlPVQyJSEVgJjFbV1cHWVRgici9wKVBdVa8Ltp6iEJEdwKWqui/YWopDRF4HlqvqDPdv\nIUpVDwRbV1GISAWcz66/qOqPwdZTEBGJA1YAF6jqYRF5G/hIVV8PsrSTEJGLgDlAG+Ao8Alwl6pu\n91U+3Hp2f8HxsLJTVY8Cb+EscAlJVHUFkBFsHcWhqr+q6no3nYWzYOic4KoqHFU95CYrA5UIYacE\nInIu0AP4FxAu3o1DXqeIxAAJqjoDQFWPhbqhc+kMbA9FQ+dFRaCa+wWiGo5xDkWaAatVNUdVjwPL\ngT6FFQ43YxcHeP+R/OTmGWWEiMQDrYFQ7ilVEJH1wB5giap+GWxNRfAscD8hbJALoMBnIvIfERkS\nbDFF0BjYKyKvishaEXlFRKoFW5Qf9AdmB1tEYajqz8AzwC5gN7BfVT8LrqpC2QwkiEht93ffEzi3\nsMLhZuzCZ8w1DHGHMOfhDAtmBVtPYahqrqq2wvnDvlxELgy2Jl+IyLXAf1V1HWHQW3K5wvVZ2x24\n2x2KD0UqApcA/1DVS4BsYGxwJRWN6zSjFzA32FoKQ0RqAdcB8TijO9EiMjCoogpBVb8B/gYsAT4G\n1lHEl8pwM3Y/Aw28zhvg9O6MUiIilYB3gVmquiDYevzBHbZaBnQLtpZCaA9c586DzQE6icjMIGsq\nElX9xf25F3gPZ+ogFPkJ+MmrVz8Px/iFMt2Br9x3G6p0Bnao6u+qegyYj/N3HJKo6gxVvUxVOwL7\ncdZ0+CTcjN1/gPPcUECVgX7AB0HWFPaIEylzOrBVVZ8Ltp6icB0P1HTTkUAXXKcEoYaqjlfVBqra\nGGf4aqmqDgq2rsIQkWoiUt1NRwHXACG5klhVfwV+FJHz3azOwJYgSvKHAThfekKZdKCtiES6Oukk\nmgAABqpJREFUnwudga1B1lQoInK2+7MhcANFDBGHVaRyVT0mIiOAxUAEMD1UVwwCiMgcoCNQR0R+\nBB5W1VeDLMsXVwC3ABtdJ9wA41T1kyBqKoxY4HV3ZW4F4G1V/SjImvwl1Ifh6wHvOZ9xVATeVNUl\nwZVUJCOBN90vvtuB24Ksp1DcLw+dgVCeB0VV14jIPGAtcMz9OS24qopknojUwVmNOVxVDxZWMKy2\nHhiGYRjGqRBuw5iGYRiGUWLM2BmGYRjlHjN2hmEYRrnHjJ1hGIZR7jFjZxiGYZR7zNgZhmEY5R4z\ndkZI4joOCOiGZhG5XkQu8DpPE5FLy6DeRSJSo7T1FNNGr+JCXIlIYmFhhURkjLspP++8zDSLyNNu\nyJW/ncK948ug/Z0iUru09RjlCzN2xpnMDUBzr/My2XSqqj2L2txaRm0sVNUSGxMvRuN4tM+rryw1\nDwFaqOqpxJscV5LC4lIg2zYPGydhxs4IZSJEZJrbS1jsBm5tIiJf5RUQkfPyzt1v9H9zg4+uFpEm\nbn68iCwVkQ0i8pk4wWrb4zjlfdr1mv8nt8qb3Xu3iUgH9/4It7eyxq1jqJsfKyKfixOQc5OIXOGl\no7aIRLk9pvXu9b7eDyciZ4vIf9x0SxHJdUMCISLb3ec9S5wApWvco717PVlEXnDTTURklfvcj4lI\nplcz0SIyV5wAp7Pc8qNwnPwuE5F/F9Ac75bN997dMm3kRGDXp331vEXkAyAaWCsifUXkWlfbWhH5\n1Mu9U7Q4EQs2uu+0j4g8CUS69b/hlrvXfXebxA3O6WrcJk48u00U4uleHJdXH4vI7UX+lRlnBqpq\nhx0hd+B4XT8KXOyevw0MdNNLgZZu+gngbje9A8fNGcCtwEI3vRC41U3fBrznpl8F+ni1uQx42k13\nBz5100OBB910FZygwfHAvcB4N78CEO2lozZwIzDNq/4aPp5zM1AdGIETVikJaAR84V6fjROJAKAh\njv9SgGTgBTf9IdDPTd8JZLrpRBznuOfgRF34AmjvrdFLR57mot77ZuByN/0ksLGQ312mV7qmV/oO\nYLKb/hvw94LlCtx7KbARiASi3PZbuRqP4wRA9dX+DvcdfgrcEuy/ZTtC47CenRHK7FDVjW76K5wP\nOXACod4mTtTnvuR3/prnaPctoJ2bbutVZhbQwat8wSGw+e7PtV7tXQMMEsdv6Coco9AUx+jdJiIp\nOMN2BcMibQS6iMhTItJBfQ8TfoHjmzQBx4Bc6er73L3eGXjRbft9oLo4fha9acuJsDEFHQ2vUdXd\nqqrAeq9nKoqT3rs4wVKj9URE+Nn4F7aogYgsEZGNwP9wYtj4amBqXiFV3e/j3g7AfFX9Q1WzcX43\nCTjDlOmquqaQNgXnXc1Q1Vl+aDTOAMzYGaHMYa/0cU44Lp+P0/O6FidkSmHR4L3nbgr7YC44v5PX\npnd7ACNUtbV7NFHVz9SJRJ+AE3rqNRG5NV/Fqt/hBMLdBDwmIhN8tP85joFriPMB3QrnQ36Fl+7L\nvdpu4H7w+zsvVdg7LO09/sbnewGYoqoX4/Q6I72uFVeHFigjnHju7GLuW4nzN2IYgBk7IwxR1Ryc\nyBcvATMKXO7n9fMLN/0FTogdgIGc6DVlAv6sQFwMDBeRigAicr444XAaAntV9V84IZJae98kIrFA\njqq+CUzGd7y1FTgRJ75ze1/7gB44H9bgBKYc5VVnq7ykVx2rgJvcdH/8w99nBzyxAzNFJC++nb/t\n1MCJeA3O0GsenwJ3552IG7YJOJr3nnHeTW937i0K6O3m+WNoHwYyRGRqsSWNMwIzdkYoU7D34n0+\nGycqccEQNLVEZANO+Jd73LyROMONG3CM3Wg3/y3gfhH5ymuBiq/2/oUT02utuyjjJZzeTiKwXkTW\nAjcDzxe4rwWw2h2CnABMPKkB1XQ3mWeAVwAZrnEBx9Bd5i7i2IIzf5jXRl47Y4B7RWQ90ATIu9db\nS0GmAZ/kLVAp5LkLnt8OvOI+T7UC7RR2fyow112Is9fr2mM4v6tNru5EL10bReQNdSK8vwaswTHo\nr6jqhmKey3NNVUfjLHgpzapVo5xgIX6MsERE/georqopXnk7gEtVdV/wlJ1+RCRSVf9w0/1xFqvc\nEIB2otwhVERkLFBPVe8p5jbDCAnCKnirYQCIyHtAY6BTgUtn6je3S0XkRZzhvQzgrwFqp6eIjMP5\n3NhJ/mFJwwhprGdnGIZhlHtszs4wDMMo95ixMwzDMMo9ZuwMwzCMco8ZO8MwDKPcY8bOMAzDKPf8\nP0iofIXU1ZHfAAAAAElFTkSuQmCC\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"fig = plt.figure()\n",
"ax = fig.add_subplot(111)\n",
"\n",
"# Now, let us calculate the evidences\n",
"\n",
"# Uniform hypothesis\n",
"ret = calc_evidence(q_uniform, trails, vocab, ax, \"uniform\")\n",
"\n",
"# Let us also consider a data hypothesis which should be the best\n",
"\n",
"markov = MarkovChain(k=1, use_prior=False, reset = False, modus=\"mle\")\n",
"markov.prepare_data(trails)\n",
"markov.fit(trails)\n",
"mle = markov.transition_dict_norm_\n",
"\n",
"# Now we use the parameter configuration from the MLE as a hypothesis\n",
"i_indices = list()\n",
"j_indices = list()\n",
"values = list()\n",
"for s,targets in mle.iteritems():\n",
" for t, v in targets.iteritems():\n",
" i_indices.append(vocab[s[0]])\n",
" j_indices.append(vocab[t])\n",
" values.append(v)\n",
"\n",
"q_data = csr_matrix((values, (i_indices, j_indices)),\n",
" shape=(len(vocab), len(vocab)), dtype=np.float64)\n",
"\n",
"ret = calc_evidence(q_data, trails, vocab, ax, \"data\")\n",
"\n",
"# Friendship hypothesis\n",
"ret = calc_evidence(q_friendship, trails, vocab, ax, \"friendship\")\n",
"\n",
"# Market value hypothesis\n",
"ret = calc_evidence(q_market, trails, vocab, ax, \"market value\")\n",
"\n",
"# Further plotting\n",
"ax.set_xlabel(\"hypothesis weighting factor k\")\n",
"ax.set_ylabel(\"marginal likelihood / evidence (log)\")\n",
"\n",
"plt.legend(loc=4, handlelength = 3)\n",
"plt.grid(False)\n",
"ax.xaxis.grid(True)\n",
"plt.tight_layout(pad=0.2)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"In this figure, we can see on the x-axis the hypothesis weighting factor $k$ and on the y-axis the corresponding evidence. Each hypothesis is displayed in a different color. For $k=0$ all hypotheses have the same evidence as only the uninformative part is considered (all $\\alpha=1$). We can compare the plausibility of hypotheses, by comparing the evidence values for the same values of $k$. Higher evidence means higher plausibility; calculating Bayes factors can determine the strength of these differences.\n",
"\n",
"Not surprisingly, we can see that for all values of $k>0$ displayed, the data hypothesis is the most plausible one as it accurately represents the data studied. The most plausible hypothesis out of our set of real hypotheses is the friendship hypothesis which indicates the highest evidence values and also higher values compared to the uniform (baseline) hypothesis. The market value is the least plausible (at least for $k>2$).\n",
"\n",
"The tendencies of the individual curves for rising values of $k$ give us indication of the relevance of this hypothesis with rising overall belief in this given hypothesis. The reason why the evidences of all hypotheses are in general rising with higher $k$ (even for the uniform) can be explained by the low number of states and small amount of data studied in this small toy example. As we exclude the self-loop in all hypotheses, we already provide good explanations of the data as no self-loops are present there. The fluctuations regarding the evidences for rising values of $k$ (e.g., sometimes falling then rising again) can also be explained by the small amount of states and data at interest and the implementation of the (trial) roulette method; the general tendencies are clear though.\n",
"\n",
"For completeness, the following graph shows how a self-loop hypothesis would behave."
]
},
{
"cell_type": "code",
"execution_count": 38,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAbsAAAEsCAYAAABaCh3lAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzt3Xl8FfW9//HXR1BAxCtWBUEQBTesClq1SsFohWChWvel\nt261tVUBW22VTWJBBdu60Vo33Fr37VZFQ0AIWBfccBeXCChi+dm6gRiE8Pn9MZN4COckAzlz5kzy\nfj4e88icmXPOvHMI+Wa+q7k7IiIizdlGSQcQERGJmwo7ERFp9lTYiYhIs6fCTkREmj0VdiIi0uyp\nsBMRkWYvkcLOzMab2StmNs/MppnZthnnRprZu2Y238wGJZFPRESaF0tinJ2ZdXD3ZeH+MKC3u//a\nzHoDdwL7Al2BGcDO7r6m4CFFRKTZSOTOrragC20G1BZmRwB3ufsqd18IvAfsV+B4IiLSzLRO6sJm\ndgnwM+ALoCQ83AV4NuNpiwnu8ERERDZYbIWdmU0HOmc5NcrdH3H30cBoM7sQGAaU5XirdepZzUxz\nnImICADubo09J7ZqTHcf6O57ZNkeqffUO4Gjw/2PgG4Z57YLj2V7/9Rsp5xySuIZlFVZlVVZm2PW\nqJLqjblTxsMjgLfC/YeBE8xsEzPbAdgJeK7Q+fKtR48eSUeITFnjoazxUNZ4pClrVEm12V1mZrsQ\ndExZCPwKwN3fNLN7gTeB1cBZvj5Ft4iISBaJFHbufkwD5y4FLi1gnNhtscUWSUeITFnjoazxUNZ4\npClrVJpBpQD69OmTdITIlDUeyhoPZY1HmrJGlcig8qYyM9VuiogIZoYn2RtTRESkWKiwK4DKysqk\nI0SmrPFQ1ngoazzSlDUqFXYiItLsqc1ORERSS212IiIiIRV2BZCm+m9ljYeyxkNZ45GmrFGpsBMR\nkWZPbXYiIpJaarMTEREJpaqwM/vuj8wOKwcoLR3D1Klzko4USZrqv5U1HsoaD2WNR5qyRpXYSuXr\ny+y7P4IDroYbe4FRUTGBqqrRAAwZMiDhdCIiUsxS02YX3NE9Xho+onYB89LSsZSXj08umIiIJKYZ\nttl1aJvtaHV1q0IHERGRlElRYbesOtvRFStqCh1kvaWp/ltZ46Gs8VDWeKQpa1QpKuw+vAZ+8V7m\nkS5dRvH22wMpL08qk4iIpEFq2uygtpNK92Hw+ODS0jEMGzaQLbccwPDh8NRTsMkmSScUEZFCitpm\nl6rCrlb9QeVr1sBGKbpHFRGR/GiGHVRyK/aCLk3138oaD2WNh7LGI01ZoyryYkJERKTpmkU1ZjZP\nPgn9+xcokIiIJKJFVWPWt2wZ/PKXUFYGKSzLRUQkz5plYdehA8yeDQ89BBdckHyBl6b6b2WNh7LG\nQ1njkaasUTXLwg5gm21g1qxgGzYs6LEpIiItU7Nts6v1xRcwZAiUlMCECfHmEhGRwmpR4+wa89VX\n8Omn0K1bjKFERKTgWnQHlfrat0+2oEtT/beyxkNZ46Gs8UhT1qhaRGEnIiItW4uoxszGHaqroV27\nPIUSEZGCUzVmI/75TzjkEPj886STiIhI3FpsYXfEEbD//kGB95//xHutNNV/K2s8lDUeyhqPNGWN\nqsUWdmZw5ZVw2GFw0EHw8cdJJxIRkbgk2mZnZucBfwS2cvdPw2MjgdOBGmC4u1dkeV2T2+wyXXIJ\n3HorPPEEdO+et7cVEZGYRW2za12IMNmYWTdgILAo41hv4HigN9AVmGFmO7t7rPOfjB4NnTtD68Q+\nDRERiVOj1Zhmtq+Z/dbM/mRm483sODPrmIdrXwH8vt6xI4C73H2Vuy8E3gP2y8O1GvXzn0OXLvG8\nd5rqv5U1HsoaD2WNR5qyRpWzsDOz08zsJWAk0BaYDywF+hPccd1mZhtU6WdmRwCL3f3Veqe6AIsz\nHi8muMMTERHZYDnb7MzsbOBmd/86x/m+wHfcfUaO89OBzllOjQZGAYPc/UszWwB8z93/a2aTgWfd\n/Y7wPW4CHnP3B+u9t48bN67ucUlJCSUlJQ1/pyIiknqVlZVr3XlefPHFxTk3ppl9F3gCWBEe2g74\nCNgfOA3A3SeGzy0Hxrn73HrvkdcOKrmMGweHHqpFYEVEilXeBpWb2WQzuyb8Wrs/IayKXG/u/rq7\nd3L3Hdx9B4Kqyr3dfSnwMHCCmW1iZjsAOwHPbch18qF/fzj6aJiR9d41ujTVfytrPJQ1HsoajzRl\njSrKOLu2QB/gHeBdYC+Cu7Gfm9lVechQd4vm7m8C9wJvAo8DZxXkFi6HQw+FBx6Ak06CRx9NKoWI\niDRVo9WYZjYX6Ofuq8PHrYF/AT8AXnP33WJPuW6mgpaBzz0HP/4x/OUvcOyxBbusiIg0Ip9zY24B\nbJbxeDNgy7Dwq97AfKmy335QUQHXXw+rVyedRkRE1leUwu5yYJ6Z3WpmtwLzgD+aWXugia1Z6bHX\nXjB9+oYNPE9T/beyxkNZ46Gs8UhT1qga/dXt7lPM7HFg3/DQKHdfEu7/LrZkRcgavVEWEZFiFGno\nQdjzckD4sNLdH4k1VeN5kuy3IiIiRSKfQw8mAsOBNwh6SQ43s8uaHjH91qyBhx4KFoIVEZHiFaXN\nbgjBbCc3u/sUYDAwNN5Y6bB8OYwfD+ee23CBl6b6b2WNh7LGQ1njkaasUUUp7JygR2atLcgYG9eS\nbb45zJwZDE0480yoqUk6kYiIZBNlnN2JwESgMjx0EHChu98db7QGMxVVm92yZcE4vO22C9bF01JB\nIiKFEbXNLmoHlS4EvTEdeM7d/930iBuu2Ao7gBUr4MgjYZ994NJLk04jItIyNLmDipntY2Z7m9ne\nBKsXLCaYsLlLeEwybLopPPwwnH/+uufSVP+trPFQ1ngoazzSlDWqhirc/kzDbXMH5zlL6rVpE2y1\npk6dwzXXVLB06WI6dZrB8OGDGDJkQO43EBGRWBR8iZ98KMZqzPqmTp3DiBHTqKq6pO5Yz56jufrq\nUhV4IiJ5ko9qzB80coH/MbM9NiRcS3DNNRVrFXQAVVWXMHny9IQSiYi0XA0NPTjGzJ4xs4vMbIiZ\n7WdmB5nZz83s78CjQLsC5UydlSsza4gr6/aqq1sVPMv6SFNdvbLGQ1njoazJytlm5+7nmtl3gKOB\nY4Ftga+Bt4Dr3f1fhYmYTm3aZF8eoU0bDcYTESk0tdnFJFubXdu2o9hpp8FUVAygc+cEw4mINBN5\nHWdXbNJQ2EFQ4E2ePJ3q6la0bVvDWWcN5MUXB7BoUTD4XEREmiafi7fKBhoyZADl5eMpKyuhvHw8\nhx8+gIsvhilTkk6WW5rq6pU1HsoaD2VNlgq7BLQq7j4qIiLNTpS5MdsDvwW6u/svzGwnYBd3f7QQ\nAXNkSkU15vqoqVEhKCKyvvJZjXkL8A1wYPh4CXBJ7qfLhjjuOLjssmCNPBERya8ohV1Pd59EUODh\n7l/FG6n5iVL/fdVV8OijMHQo/Oc/8WfKJU119coaD2WNh7ImK0pht9LM6gaPm1lPYGV8kVqmbt2g\nshK++13Ye2946qmkE4mINB9R2uwGAaOB3sB0oB9wqrvPij9ezkzNrs0u0yOPwBlnBKso7L9/0mlE\nRIpXvtez2wr4fvjwWXdPsKKt+Rd2AEuWQOfOsJH6y4qI5JS3DipmdhSw2t0fDXtgrjazn+QjZEux\nIfXfXbokU9Clqa5eWeOhrPFQ1mRF+XU6zt0/r30Q7pfFlkhERCTPorTZverue9Y79pq7J7a8T0uo\nxszmo49g7Fi44grYYouk04iIJC+f4+xeNLMrzKynmfUysyuBF5seUdbXVltB+/ZBb80XXkg6jYhI\nekQp7IYBq4B7gLuBauDsOEM1N/mq/27TBiZPhkmT4LDD4C9/gXzf4Kaprl5Z46Gs8VDWZOVcz66W\nuy8HLihAFono2GOhb9/g69NPwx13gDV6Ey8i0nJFabPbBTgf6MG3haO7+yHxRmswU4tss6uvuhpm\nz4bS0qSTiIgkI2/j7MzsVeBvwEtA7TLb7u6JtdupsBMREchvB5VV7v43d5/r7i+EW5MKOjMrM7PF\nZjYv3A7LODfSzN41s/nh7C2pl6b6b2WNh7LGQ1njkaasUTXaZgc8YmZnAw+SMSemu3/ahOs6cIW7\nX5F50Mx6A8cTTE3WFZhhZju7u9YCWA8zZwY9N/fcs/Hnioi0BFGqMRcSFE5rcfcdNviiZuOA5e7+\n53rHRwJrwlUWMLNyoMzdn633PFVjNuDee+Hss2HiRDj9dHVeEZHmK2/VmO7ew913qL/lIeMwM3vF\nzKaYWe0Q6S7A4oznLCa4w5P1cNxxMGcOXHklnHIKfKVFmUSkhYsyN2Z7MxtrZjeGj3cys6ERXjfd\nzF7Lsh1O0OFlB6AP8DHw5wbeKustXFlZWd1W7PXLSeTbbTeYOzdY/XzffeGNN6K9rtg/y0zKGg9l\njYey5kdlZeVav/+jitJmdwvBjCmZK5XfDzza0IvcfWCUAGZ2E/BI+PAjoFvG6e3CY+tYn2+ypWrf\nHm65BW69FT5tSguriEiRKCkpoaSkpO7xxRdfHOl1UdrsXnT3fcxsnrv3DY+94u57bWhYM9vW3T8O\n938D7OvuJ4UdVO4E9iPsoAL0qt9ApzY7ERGB6G12Ue7s4lipfJKZ9SGoolwAnAng7m+a2b3Am8Bq\n4CyVaiIi0lRRxtmVAeXAdmZ2JzCTJk4f5u4nu/ue7r6Xu//E3ZdmnLvU3Xu5+67uPq0p1ykWxVr/\n/cor6x4r1qzZKGs8lDUeypqsKHNjVpjZS3y7UvnwpFcql6ZbsSLotVlSAlddBTNnzuGaaypYunQx\nnTrNYPjwQQwZMiDpmCIieZGzzc7M9mHdnpBWe8zdX4o3Wm5qs8uPL7+EX/4S5s6dw5o10/jgg0vq\nzvXsOZqrry5VgSciRa3Jc2OaWSVBwdYO2Ad4NTy1J/CCux+Qn6jrT4Vd/rjD7ruP4a23JqxzrrR0\nLOXl4xNIJSISTZMHlbt7ibsfTDDUYG9338fd9wH6hsckomKu/zaDbbbJrM2urNurrm5V8Dzro5g/\n1/qUNR7KGo80ZY0qSgeVXd39tdoH7v46sFt8kaTQ2rRZnfV427Y1WY+LiKRNlHF2dwPLgX8QtNmd\nBGzm7ifGHy9nJlVj5tHUqXMYMWIaVVWZbXajuPrqwWqzE5Gils/17NoBvwb6h4fmAH9z9+omp9xA\nKuzyb+rUOUyePJ3q6la0bVvDsGEDGTJkAKtWwbXXwplnQtu2SacUEVlbPieC/trdr3D3I8PtyiQL\nujRKQ/33kCEDKC8fT1lZCeXl4+vu6JYvD1ZD32svmDUr4ZD1pOFzraWs8VDWeKQpa1Q5x9mZ2X3u\nfqyZvc66QxDc3bVaWgvQsSM8+CD885/BCgo//CH86U/wne8knUxEJLqGhh50cfclZrY9QVvdWtx9\nYczZclI1ZjKWLYOxY+Huu+GZZ2CHfCz0JCLSBPlsszsPuNvds64+kAQVdsl6881gCSEtCisiSctb\nmx3QAagws3+Z2Tlm1qnp8VqWNNV/R8nau3dxFHTN7XMtFsoaD2VNVpQOKmXuvjtwNrAtMMfMnog9\nmaTOJ58knUBEJLtGqzHrnmi2LXAMcCLBOLvEOqioGrP4rF4Nu+8OhxwCl10GW2yRdCIRaQnyVo1p\nZmeF82Q+AWwFnKGemFJf69Ywd27tXJtw773BvohIMYjSZtcdONfde7v7OHd/M+5QzU2a6r+bknWL\nLeC66+C+++APf4ChQ+GDD/KXrb6W8rkWmrLGQ1mTFaXN7kKgg5mdBmBmW5uZOp1LTgceCC+9BP36\nBYPSRUSSFmXoQRnBEj+7uPvOZtYVuNfd+xUgX65MarMTEZG8Dj04EjgC+AogHG/XoWnxRERECidK\nYbfS3dfUPjCz9jHmaZbSVP9diKwjRsD//V/T30efazyUNR7Kmqwohd19ZnY9sIWZ/ZKgV+ZN8caS\n5uzII+GCC4KvixcnnUZEWoJI4+zMbBAwKHw4zd2nx5qq8Txqs0u56upgPN5f/wrjxsFZZ0Gr4l4Y\nXUSKUN7mxixGKuyaj7feCtbKO+ooOPfcpNOISNrks4OKNFGa6r8LnXW33aCyMrizW1/6XOOhrPFQ\n1mSpsJPEbbQRbLJJ0ilEpDlraD27G4DHgRnuvqygqRqhasyWYd486NIFOmmdDRHJIR/VmDcDfYDH\nzGymmV1gZnvlLaFII2bPhj32gBtvhDVrGn++iEguOQs7d382nAuzP3Ac8CFwnpm9bGa3mNlxBUuZ\ncmmq/y6mrOeeCzNmwJQpcNBBwaKxmYopa2OUNR7KGo80ZY2qdZQnuft/gDuBO83MCKYPK40zmAjA\nnnvCU0/B9dcHBd7o0bDTTnO45poKli5dTKdOMxg+fBBDhgxIOqqIFDENPZDUWLIE7rxzDtddN42q\nqkvqjvfsOZqrry5VgSfSAmnogTQ7XbrA9OkVaxV0AFVVlzB5cqLzHIhIkVNhVwBpqv8u9qwrV2bW\nvFfW7X35ZXFPv1Lsn2smZY2HsiYrZ5udmR0NOGDh17W4+4Mx5hLJqk2b1VmPP/98DRdfDOedB5tt\nVuBQIlL0GhpndytBIbcNcCAwMzx1MPC0uw9t0oXNhgFnATXAVHe/IDw+Ejg9PD7c3SuyvFZtdi3U\n1KlzGDGifpvdKEaOHMysWQN44gkYOxZ+8QvYeOMEg4pIQeRtbkwzmw6c7O4fh4+3BW5z90ENvrDh\n9zwYGAX8yN1XmdnW7v6JmfUm6PW5L9AVmAHsnLnEUPh6FXYt2NSpc5g8eTrV1a1o27aGYcMG1nVO\nmTcPLrwQ3n8fnn4att464bAiEqt8dlDpBvw74/FSoPuGBgv9GrjM3VcBuPsn4fEjgLvcfZW7LwTe\nA/Zr4rUSl6b67zRkHTJkAOXl4ykrK6G8fPxavTD79oVp0+COO2CrrRIMWU8aPtdayhoPZU1WlMJu\nBjDNzE41s9OAx4Cmdn3bCRhgZs+aWaWZfS883gXIXOFsMcEdnsh62W8/sEb/1hORliJKNaYBRwL9\nw0Nz3P2hRt84qP7snOXUaOASYKa7jzCzfYF73H1HM5sMPOvud4TvcRPwWP3OMKrGlA31wAOw777Q\nval1EyJSFKJWYzY6g4q7u5k9DawKD82NEsDdBzYQ7tfAg+HznjezNWa2FfARQbVpre3CY+soKyur\n2y8pKaGkpCRKLGnh5s+HX/4STj8dRo6ELbdMOpGIrI/KysoNq2Z19wY3gnkxFwG3h9tC4NjGXtfI\ne54JXBzu7wx8EO73Bl4GNgF2AKoI7z7rvd7TZNasWUlHiKwlZF2yxP3MM9232sp90iT3FSvymyub\nlvC5JkFZ45GmrGF50Gi5E6XNbgywr7uf7O4nE/SUHLv+xepabgZ2NLPXgLuAk8MS7E3gXuBNguWF\nzgq/GZG82XZbuO46ePJJmDtXK6SLtARR2uxeA/asLXTMbCPgFXffowD5cmVSGSh58803WjxWJK3y\n1mYHlBP0xryTYDaV4wnuukSaBRV0Is1flGrM3wPXA3sCewDXu/vvY03VzKRpzIqyBt55B44/Pvia\nD/pc46Gs8UhT1qgaLezC+sKngFnh9lTcoUSStt12wQD1Aw+Es86Cf/+78deISPGK0mZ3HPBHYHZ4\naADwO3e/L+ZsDWVSm50UxH//C5dcArfdBuecA+efDx06JJ1KRGrlc27MV4FD3f3/hY+3Bp5w9z3z\nknQDqLCTQlu4EC6+GMaPD+76RKQ45HNuTAM+yXj83/CYRJSm+m9lza5HD7jllg0v6PS5xkNZ45Gm\nrFGpN6ZIE61YAZtumnQKEWlI1LkxjwJ+QLC+3ZMeYW7MOKkaU4rJaacFHVgmToS99ko6jUjLkrc2\nu2Kkwk6KyTffwA03wIQJMGhQ0K63/fZJpxJpGfLWZmdmR5vZu2b2pZktC7cv8xOzZUhT/beyrr9N\nNgl6ar7zTtC2t/feQWcWCBaaLS0dQ58+p1JaOoapU+ckmjWKYvlco1DWeKQpa1RR2uwuB4a6+1tx\nhxFJs803hz/8IRiX98orQUE3YsQ0qqouASqBEqqqRgOsteCsiMQvSpvdU+7er0B5IlE1pqRBaekY\nKiomZDk+lvLy8QkkEml+mjw3ppkdHe6+YGb3AP8HfBMec6+3oKqIrG3lyuz/vZYvb1XgJCLSUJvd\nj4GhwObA18Cg8PHQ8JxElKb6b2XNnzZtVmc8qqzbe+65GsrKgtlZilGxf66ZlDUeacoaVc47O3c/\ntYA5RJqd4cMHUVU1OmyzC/TsOYrf/34wzz8PO+0UDFs47zzo0iXBoCItQM42OzO7wN0nmdnkLKfd\n3YfHGy03tdlJWkydOofJk6dTXd2Ktm1rGDZsYF3nlMWL4c9/hj594JRTEg4qklJNHmdnZj9290fM\n7NQsp93db2tixg2mwk5ERCAP4+zc/ZHw661ZtsQKujRKU/23ssZjfbN+8w08/3w8WRrTnD/XJClr\nshrqjflIA69zdz88hjwiAlRVwdFHw847w6hRcPDBYJp+XWSDNVSNWdLQC929MoY8kagaU1qCb76B\nO+4I5tzs2DEo9IYOhY2irFUi0kLkdW5MM9sU6Obub+cjXFOpsJOWpKYGHnoILr002AYPTjqRSPHI\n59yYhwPzgGnh475m9nDTI7Ycaar/VtZ4NCVrq1ZwzDHw4otQWpq/TLm0lM+10JQ1WVEqRMqA/YHP\nANx9HrBjjJlEJAuz7O12X30Fy5cXPo9ImkSZG3Ouu+9vZvPcvW947FV337MgCbNnUjWmSOiBB+DX\nv4Zhw4LVFzp2TDqRSOHkrRoTeMPMfgq0NrOdwkHmTzc5oYjkxdFHw5w58P770KsXXHBBsJisiHwr\nSmF3DrA7sBK4C/gSODfOUM1Nmuq/lTUecWfddVe45RZ46SVYsQJ694ZFizbsvfS5xkNZkxWlsDvR\n3Ue5+/fCbTRBO56IFJntt4fJk+G997RaukimKG12jwN3uPs/wsd/Bdq5++kFyJcrk9rsRDZATU3Q\nu1Okuchnm91RwClmdqKZ3Q6sTrKgE5ENd9FFwfCF2bNBfy9KS5KzsDOzLc1sS6AdcAZwAUF73cXh\ncYkoTfXfyhqPYsl60UVw7LHw85/DD34AU6d+W+hNnTqH0tIx9OlzKqWlY5g6dU6yYSMols81CmVN\nVs65MYGXgMy//QwYEm4AO8QVSkTi0aYNnHEGnHoq3H9/MAXZRRfBmDFz+N3vpoVr71UCJVRVjQao\nW5JIJM0iTRdWbNRmJ5If7jBvHowcOYaKignrnC8tHUt5+fgEkolEE7XNrqFVDw5x95lmdjRr3+EB\n4O4PNjGjiCTMDPbeG1auzP6roLpavVmkeWiog8pB4dcf59gkojTVfytrPIo9a5s2qzMeVdbtvf12\nDXPnFjxOZMX+uWZS1mTlvLNz93Hh11PzfVEzuxvYJXy4BfB5xlRkI4HTgRpguLtX5Pv6IrK24cMH\nUVU1OmyzC/ToMYpDDhnMiSfCVlsF05Edd1zQ7ieSNg2tZ3delsNO0FHF3f2KvAQw+xNBYTfBzHoD\ndwL7Al2BGcDO7r6m3mvUZieSZ1OnzmHy5OlUV7eibdsahg0byJAhA6ipgcceCwarv/8+zJ8PrRvq\n2iZSQE1ez87MysjSVlfL3S/e4HTfXsOARcDB7l4V3tWtcfdJ4flyoMzdn633OhV2Ign45BPYeuuk\nU4h8q8mDyt29zN0vzrXlKWd/YKm7V4WPuwCLM84vJrjDS7U01X8razyaS9ZcBd0HH0B1dTx5GtJc\nPtdik6asUcVWGWFm04HOWU6NcvdHwv0TCaotG5L1Fq6srKxuv6SkhJKSkvUPKSJ5cf31cNNNwWD1\nX/8aunVLOpE0V5WVlRtUGCc2zs7MWhPcue3t7kvCYxcCuPvE8HE5MM7d59Z7raoxRYrMO+/AX/8K\nf/87HHJI0KFlwIDsC86K5EuT2+ziZmaDgQvc/eCMY7UdVPbj2w4qveqXbCrsRIrXsmVw++1w771Q\nUaHemxKvJrfZmdl5DWy/zUPG4wnWx6vj7m8C9wJvAo8DZzWHUi1N9d/KGo+WlLVDBzj77GCy6bgL\nupb0uRZSmrJG1VCbXQeyt5dZjuPrxd1Py3H8UuDSpr6/iBSniopg6MLBB6uKUwpHc2OKSEE9+GAw\n+TTAOefAz34G7dsnm0nSK29tdmbWDvg50JtguR8H0OKtIrKh3GHWrGCg+pNPwimnwPjxsOmmSSeT\ntMnn4q1/BzoBgwkmzesGLG9SuhYmTfXfyhoPZV2bWdBj86GH4IUXgunI2rZd//fR5xqPNGWNKkph\n18vdxwLL3f024EfA/vHGEpGWokcPGDkSNory20hkA0WpxnzO3fczsyeBs4B/A3PdfcdCBMyRSdWY\nIi3AlVfCwoVB295OOyWdRopRPqsxbzSzLYExwMMEwwIub2I+EZFGHXNM0HmlXz847DB4/HFYsyaY\ntLq0dAwlJWWUlo5h6tQ5SUeVItdoYefuN7r7p+4+2913cPet3f26QoRrLtJU/62s8VDWDdOtG1x6\nKSxaFCwvNHo0bLfdHIYNm0ZFxQRmzy6homICI0ZMK/oCr5g+18akKWtUjRZ2ZtbWzH5qZqPN7CIz\nG2dmFxUinIgIQLt2cNpp8OKL0KNHBQsWXLLW+aqqS5g8eXpC6SQNorTZTQM+B14kWFC1dj27P8cf\nL2cmtdmJtFAlJWXMnl22zvEDDijj0UfL2HLLwmeS5ERts4uy6kFXdy/NQyYRkSZr02Z11uPLl9ew\n444weHCw+sIPf6genvKtKD8KT5vZnrEnacbSVP+trPFQ1vwZPnwQPXuODh9VAtCz5yguu2wgCxZA\n//5wwQWw445w8cXwn/8kFnUtxf65ZkpT1qii3Nn1B04zswXAyvCYu7sKQBEpuCFDBgAwefJY/v3v\nD+nc+QmGDRtcd/zss4Nt3jyYMgW+/jrJtFIsorTZ9ch23N0X5j9ONGqzExERyM8SP5uHu1/m2ERE\nUulf/4J994XrroMvvkg6jRRCQ212tWvNvUTQEzNzeyHmXM1Kmuq/lTUeyhqPDc16wAHwhz/AE0/A\n9tvDySe5hizwAAAYKklEQVQH6+/FWWHUEj7XYpazsHP3IeHXHuFg8swtsanCRESaqlWrYEaW++6D\nd9+Fvn2Ddr5bbkk6mcQlSpvd3lkOfwEscvfsfYBjpjY7Eck3d6ipCRaWlfTI59yY1wJzgRvD7Vng\nfuAdM9P4OxFpFsyyF3SrVsHYsTB/fuEzSf5EKeyWAH3cfR933wfoA7wPDEQTQkeSpvpvZY2Hssaj\nEFm//hq++QYOPjiYkPrmm2H5Bqzoqc81WVEKu13c/Y3aB+7+JrCru1cRrlouItJcbb45TJoEH3wQ\nDFb/5z+DCaqvvDLpZLI+orTZ3Qv8F7ibYF7M44Ctgf8F/uXu+8YdMksmtdmJSGI+/hg+/RR23z3p\nJBK1zS5KYdcOOBvoFx56iqAdrxpo7+7Lmph1vamwE5Fi9dprsNtu37b/TZ06h2uuqWDlyta0abOa\n4cMH1c32Ik2Xlw4qZtYaeMzd/+TuR4bbn9x9hbuvSaKgS6M01X8razyUNR7FltUdzjsPevQI1t67\n6aY5jBihtfeKQYOFXTi0YI2ZbVGgPCIiqWUGFRVQXh50bDnrrAqqqrT2XjGIUo35MNAXmA58FR52\ndx8ec7aGMqkaU0SK3oABZTz5ZNk6xw86qIzKynWPy/rL53p2D4ZbJpU0IiKNaNcu+7wbbdvWAPDl\nl9ChQ3BHKPFqdOiBu9+aZbutEOGaizTVfytrPJQ1HsWeNdfae8OGDQRg1CjYeWcYNw7efjuZjNkU\n++e6IRq9szOznYFLgd5Au/Cwa35MEZGGNbb23uTJ8MILcOedUFICXbvCSSfBL34R3PFJ/kRps3sK\nGAdcAfwYOA1o5e5j44+XM5Pa7ESkWampgcpKuOeeYMB6+/ZJJ0qHfI6ze8nd9zaz19x9j8xjecq6\n3lTYiUhLs3JlMLShbdukkxSXfE4EXW1mrYD3zOwcMzsK0N8c6yFN9d/KGg9ljUdLyjpnDnTpAqef\nDjNmBHeCcUnT5xpVlMLuXGBTYDjwPYJpwk6JM5SIiKxt4EB4/XX47nfhwguD+Tl/85vi6thSzBqt\nxixGqsYUkZZu/ny46y446CA45JCk0yQnn212+wKjgB5823vT3X3PJoTrA1wHtAFWA2e5+/PhuZHA\n6UANMNzdK7K8XoWdiEgDvvgC/ud/kk4Rv3y22d0B3AIcTdAb88fA4U2Lx+XAOHfvC1wUPsbMegPH\nEwxzGAxca2ZRMha1NNV/K2s8lDUeyprdypWwyy5B1ecttwQF3/pI0+caVZSC5P+5+8Pu/r67L6zd\nmnjdNUDt3xxbAB+F+0cAd7n7qvAa7wH7NfFaIiItSps2sGABnHkmPPwwdO8OxxwDjz2WdLLkRKnG\nPBQ4AXgC+CY87O5efwqx6Bc12xWYRrA+3kbAAe7+oZlNBp519zvC590EPO7uD9R7vaoxRUQi+uwz\neOAB+PxzOP/8pNPkVz7nxjwV2BXYmOCOrFaDhZ2ZTQc6Zzk1GjgUONfdHzKzY4GbgYE53iprqVZW\nVla3X1JSQklJSUNxRERarI4d4Ywzcp//4otgRfbHHiv+tfcqKys3rJrV3RvcgLcJ7wDztQGfZ+wb\n8EW4fyFwYca5cmD/LK/3NJk1a1bSESJT1ngoazyUNT9OPtm9a9fZ3rHjKA+Grs9ycO/Zc5Q/+ujs\npOM1KCwPGi13orTZPU3QYSSflpjZQeH+IcA74f7DwAlmtomZ7QDsBDyX52uLiEiGW2+F7bar4LPP\nmu/ae1Ha7OYDPYEFwMrwsHvThh70A64mqEb9mmDowbzw3CiCoQergRHuPi3L672x3CIiEl1JSRmz\nZ5etc7zY197LZ5vd4DzkWYu7P0UwG0u2c5cSrLIgIiIF0qZNw2vv1frsM/jwQ9hjj3StwxdlPbuF\n2bYCZGs20jRmRVnjoazxUNb8aWztvVpvvw1HHBGswzdyZLBEURoq2qLc2YmISDPX2Np7tb7/fXj/\nfXjppWA4w0knwTffwBVXwFFHJZE8Gs2NKSIiG8w9mKC6XTvo1avw18/b3JjFSIWdiEg6XH459OkD\nBx8MG2+c//fP59yY0kTFXlefSVnjoazxUNZ45CurO7RuDePGQefOcNpp8OijwdydhabCTkREYmEG\nv/0tPPMMvPwy9O0b3Onts08CWdJYHahqTBGR9FqxAjbdND/vpWpMEREpSrkKumuvhcMPh9tvD8bz\n5ZMKuwJoiXX1haCs8WipWc1MW8Lb2WcbjzxinHKKseWW655vCo2zExEJqXmkeNUv7KZODVZoCM4d\nVg4fXuP+es4V+9RmJyJCXdtP0jEkh8x/n6lT5zBixDSqqi4hWDjHgV+8B8+MyFXgqRpTRERS5Zpr\nKsKCLtONvaD7sFyvUWFXAC21DSRuyhoPZZVit3Jlrha4zdrleo0KOxERSZVcKzTA8q9zvUaFXQGU\nlJQkHSEyZY2HssYjTVmL2cKFC9loo41Ys2YNAEuXLmXAgAFsvvnm/O53v1vn+SUlJUyZMqXQMeus\nvUJDrTOq4IPJuV6j3pgiIrKWG264gW222YYvv/wy6/l8DAVoiswVGqZNA/hROXwwuaHemLqzK4A0\ntSsoazyUNR6FyDp16hxKS8dQUlJGaekYpk6d0yyvmWnRokXstttuBb3m+hoyZADl5eMBcH/ssIYK\nOlBhJyKSU20X94qKCcyeXUZFxQRGjJgWa+GTj2tOmjSJ7bbbjs0335xdd92VmTNn4u5MnDiRXr16\nsdVWW3H88cfzWb1pStydU089ldtvv53LL7+cDh06MHPmzAav5e5MmDCBHj160KlTJ0455ZS17ggf\nfvhhdt99dzp27MjBBx/M/Pnz68716NGDiRMnsvvuu7Plllty+umnszKuWaLdPXVbEFtEJH+y/V4Z\nNGi0B3P3r72Vlo6JLUdTrzl//nzv1q2bf/zxx+7uvmjRIq+qqvKrrrrKDzjgAP/oo4/8m2++8TPP\nPNNPPPFEd3dfsGCBm5nX1NS4u/upp57qY8eOzXmNkpISnzJliru7T5kyxXv16uULFizw5cuX+1FH\nHeU/+9nP3N397bff9vbt2/uMGTN89erVfvnll3uvXr181apV7u6+/fbb+x577OGLFy/2Tz/91Pv1\n6+djxmT/PnP93g+PN1pu6M5ORCSHXF3cp01rhVkwq39ZWfbXlpVR95zMrbHnV1Rkv2Z1datImVu1\nasXKlSt54403WLVqFd27d2fHHXfk+uuvZ8KECXTp0oWNN96YcePGcf/999d1SqnPIw6wv+OOOzjv\nvPPo0aMH7du357LLLuPuu++mpqaGe+65h6FDh/LDH/6QVq1acf755/P111/z9NNPA0Hb3znnnEPX\nrl3p2LEjo0eP5q677op03fWlwq4A1AYSD2WNh7J+K1cX99LSmrp7roYKr3Xvzxp//qBB2a/Ztm1N\npMy9evXiqquuoqysjE6dOnHiiSeyZMkSFi5cyJFHHknHjh3p2LEjvXv3pnXr1ixdujTr+9R2QPnV\nr35Fhw4d6NChAxMnTlzneR9//DHbb7993ePu3buzevVqli5dyscff0z37t3Xes9u3brx0Ucf1R3r\n1q3bWq9dsmRJpO9zfamwExHJIVsX9549RzFs2MCivuaJJ57Ik08+yaJFizAzLrjgArp37055eTmf\nffZZ3bZixQq23XbbrO9Re2d33XXXsWzZMpYtW8aFF164zvO6dOnCwoUL6x5/8MEHtG7dms6dO9Ol\nSxcWLVq01nt++OGHdO3ada3nZ+536dIl8ve5PjT0oADSNBZIWeOhrPGIO2tmF/fq6la0bVvDsGGD\n644X4zXfeecdFi9eTL9+/WjTpg1t27bF3fnVr37FqFGjuO222+jevTuffPIJzzzzDIcffvg67xG1\nChOCgnXSpEkcdthhbLXVVowaNYoTTjiBjTbaiGOPPZaJEycyc+ZM+vfvz9VXX03btm058MAD665z\n7bXXMnToUNq1a8cll1zCCSecEPna60OFnYhIA4YMGRBr4Zbva65cuZKRI0fy1ltvsfHGG9OvXz9u\nuOEGOnXqhLszaNAglixZwjbbbMMJJ5xQV9hljptbn3F0p59+OkuWLGHAgAFUV1czePBgJk8Oxnbv\nsssu/OMf/2DYsGF89NFH9O3bl0ceeYTWrVvXXeekk06qy/STn/yEMWPGbND33RitelAAlZWVqflr\nWVnjoazxyGdWrXpQeDvssANTpkzhkEMOafS5uf59tFK5iIhISHd2IiLozi4JhbyzU2EnIoIKu2Kn\naswU0LileChrPJRVmiMVdiIi0uypGlNEBFVjFrumVmNqnJ2ISCjJNdokXqrGLIA0tSsoazyUNR75\nzBpl5vymbLNmzUp8xZi0Z22KRAo7M9vLzJ4xs1fN7GEz65BxbqSZvWtm881sUBL58u3ll19OOkJk\nyhoPZY2HssYjTVmjSurO7ibg9+6+J/AQ8DsAM+sNHA/0BgYD15pZ6u8+P//886QjRKas8VDWeChr\nPNKUNaqkCpKd3P3JcH8GcHS4fwRwl7uvcveFwHvAfgnkExGRZiSpwu4NMzsi3D8WqF3QqAuwOON5\ni4GupFzm8hfFTlnjoazxUNZ4pClrVLENPTCz6UDnLKdGAe8A1wDfAR4Ghrv7VmY2GXjW3e8I3+Mm\n4DF3f7Dee6t/sIiIACQ79MDdG1tpsBTAzHYGhoTHPuLbuzyA7cJj9d9b/YNFRCSypHpjbh1+3QgY\nA/wtPPUwcIKZbWJmOwA7Ac8lkVFERJqPpNrsTjSzt4G3gMXufiuAu78J3Au8CTwOnKWpUkREpKlS\nOV2YiIjI+kjdGDYzGxwOOH/XzC5IOk8uZnazmS01s9eSztIYM+tmZrPM7A0ze93MhiedKRcza2tm\nc83s5TBrWdKZGmNmrcxsnpk9knSWxpjZwnCyh3lmVtRNCGa2hZndb2ZvmdmbZvb9pDNlY2a7hJ9n\n7fZFkf8f+034f+s1M7vTzNoknSkXMxsR5nzdzEY0+Nw03dmZWSvgbeBQgo4rzwMnuvtbiQbLwsz6\nA8uB2919j6TzNMTMOgOd3f1lM9sMeBH4STF+rgBmtqm7rzCz1sC/gBHuPjfpXLmY2W+BfYAO7n54\n0nkaYmYLgH3c/dOkszTGzG4DZrv7zeHPQnt3/yLpXA0J+yl8BOzn7h8mnac+M+sKPAns5u4rzewe\ngh7xtyUcbR1m9l3gLmBfYBVQDvzK3auyPT9td3b7Ae+5+0J3XwXcTTAQveiEg+Y/SzpHFO7+b3d/\nOdxfTtCW2iXZVLm5+4pwdxNgY2BNgnEaZGbbAT8imDUoLb2Iiz6nmf0P0N/dbwZw99XFXtCFDgWq\nirGgy9Aa2DT8A2JTsvSILxK7AnPdvdrda4DZwFG5npy2wq4rkPlD0iwGnRcTM+sB9AWK+U5pIzN7\nGVgKVLj780lnasCVBNPhFW2BXI8DM8zsBTP7RdJhGrAD8ImZ3WJmL5nZjWa2adKhIjgBuDPpELm4\n+0fAn4EPgCXA5+4+I9lUOb0O9DezLcN/+yEEw9WySlthl5461xQKqzDvJ6gWXJ50nlzcfY279yH4\nwd7fzHZPOlM2ZjYU+H/uPo8U3C2F+rl7X+Aw4OywOr4YtQb2Bq51972Br4ALk43UMDPbBPgxcF/S\nWXIxs47A4UAPgtqdzczsp4mGysHd5wOTgAqC3vvzaOCPyrQVdvUHnXdj7enFZAOZ2cbAA8A/3P3/\nks4TRVhtNYtg0vBidCBweNgOdhdwiJndnnCmBrn7x+HXTwgmaS/WuWkXEwxbqr2rv5+g8CtmhwEv\nhp9tsToUWODu/3X31cCDBD/HRcndb3b377n7QcDnBH06skpbYfcCsJOZ9Qj/SjqeYCC6NIEFK1ZO\nAd5096uSztMQM9vKzLYI99sBAwnaGIuOu49y927uvgNB9dVMdz856Vy5mNmmtcttmVl7YBBQlL2J\n3f3fwIfhDEwQ/JJ+I8FIUZxI8EdPMVsEfN/M2oW/Fw4lGPdclMxsm/Brd+BIGqgiTtVK5e6+2szO\nAaYBrYApRdxj8C7gIOA7ZvYhcJG735JwrFz6Af8LvGpm88JjI929PMFMuWwL3Bb2zN0IuMfdH0s4\nU1TFXg3fCXgoXK27NXCHu1ckG6lBw4A7wj98q4DTEs6TU/jHw6FAMbeD4u7Pmdn9wEvA6vDrDcmm\natD9ZvYdgt6YZ7n7l7memKqhByIiIhsibdWYIiIi602FnYiINHsq7EREpNlTYSciIs2eCjsREWn2\nVNiJiEizp8JOik44aUCsg5nN7Agz2y3jcaWZ7ZOH951qZps39X0aucaPG1veysxKci0pZGbnhgPy\nax/nLbOZ/TFcbmXSBrx2VB6uv9DMtmzq+0jzo8JOWqojgd4Zj/My4NTdhzQ0sDVP13jE3de7MMkw\ngmA2+9r3y2fmXwB7uPuGrDU5cn2ebKF6hzVwWLJSYSfFqpWZ3RDeJUwLF23taWYv1j7BzHaqfRz+\nRT8pXHh0rpn1DI/3MLOZZvaKmc2wYKHaAwkm5P1jOGP+juFbHhu+9m0z+0H4+lbh3cpz4Xv8Mjy+\nrZnNsWAxztfMrF9Gji3NrH14x/RyeP64zG/OzLYxsxfC/b3MbE24HBBmVhV+v1tbsDjpc+F2YHj+\nVDObHO73NLNnw+97gpkty7jMZmZ2nwWLm/4jfP5wggl+Z5nZE/Uy9wifu9bnHj5nX/t2Udc/Zrvz\nNrOHgc2Al8zsODMbGmZ7ycymZ0zttJkFqxW8Gn6mR5nZZUC78P3/Hj7vt+Fn95qFC3OGGd+2YC27\n18gxy70F0109bmY/b/CnTFoOd9emrag2ghnXVwF7ho/vAX4a7s8E9gr3LwXODvcXEExxBvAz4JFw\n/xHgZ+H+acBD4f4twFEZ15wF/DHcPwyYHu7/Ehgd7rchWDC4B/BbYFR4fCNgs4wcWwJHAzdkvP/m\nWb7P14EOwDkESyqdBGwPPB2ev5NgFQKA7gRzlwKcCkwO9x8Fjg/3zwSWhfslBBPjdiFYceFp4MDM\njBk5ajM39Lm/Duwf7l8GvJrj325Zxv4WGftnAH8K9ycBV9R/Xr3X7gO8CrQD2ofX7xNmrCFY/DTb\n9ReEn+F04H+T/lnWVjyb7uykWC1w91fD/RcJfslBsAjqaRas+Hwca0/8WjvJ7t3AAeH+9zOe8w/g\nBxnPr18F9mD49aWM6w0CTrZgztBnCQqFXgSF3mlmNo6g2q7+kkivAgPNbKKZ/cCzVxM+TTAvaX+C\nAmRAmG9OeP5Q4C/htf8JdLBgjsVM3+fbJWPqTzL8nLsvcXcHXs74nhqyzuduwUKpm/m3q8HfSbQl\ni7qZWYWZvQqcz7fVxj8E/lr7JHf/PMtrfwA86O5fu/tXBP82/QmqKRe5+3M5rmkEn9XN7v6PCBml\nhVBhJ8VqZcZ+Dd9OWv4gwZ3XUILlUnKtBp/ZdpPrF3P99p3aa2ZeD+Acd+8bbj3dfYYHK9H3J1h2\n6lYz+9lab+z+LsEiuK8BE8xsbJbrzyEo4LoT/ILuQ/BL/smM3PtnXLtb+Is/artUrs+wqa+Jujbf\nZOAad9+T4K6zXca5xt7D6z3H+Pb7/qqR1/2L4GdEpI4KO0kVd68mWPXib8DN9U4fn/H16XD/aYLl\ndQB+yrd3TcuAKD0QpwFnmVlrADPb2YKlcLoDn7j7TQTLI/XNfJGZbQtUu/sdwJ/IvtbakwSrTbwb\n3n19CvyI4Jc1BItSDs94zz61uxnv8SxwTLh/AtFE/d6BunUDl5lZ7dp2Ua+zOcFq1xBUvdaaDpxd\n+8DCJZuAVbWfM8Fn85Ow7a098JPwWJSC9iLgMzP7a6PPlBZDhZ0Uq/p3L5mP7yRYkbj+8jMdzewV\ngqVffhMeG0ZQ3fgKQWE3Ijx+N/A7M3sxo4NKtuvdRLCe10thp4y/EdztlAAvm9lLwLHA1fVetwcw\nN6yCHAuMX+cC7ovC3doC+Engs7BwgaCg+17YieMNgvbD2mvUXudc4Ldm9jLQE6h9bWaW+m4Ayms7\nqOT4vus//jlwY/j9bFrvOrleXwbcF3bE+STj3ASCf6vXwtwlGbleNbO/e7C6+63AcwQF+o3u/koj\n31fdOXcfQdDhpSm9VqUZ0RI/kjpmdj7Qwd3HZRxbAOzj7p8ml6zwzKydu38d7p9A0FnlyBiu0z6s\nQsXMLgQ6uftvGnmZSNFI1eKtImb2ELADcEi9Uy31r7Z9zOwvBNV7nwGnx3SdIWY2kuB3xkLWrpYU\nKXq6sxMRkWZPbXYiItLsqbATEZFmT4WdiIg0eyrsRESk2VNhJyIizd7/B2MtAvlkh4AiAAAAAElF\nTkSuQmCC\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"fig = plt.figure()\n",
"ax = fig.add_subplot(111)\n",
"# And finally, also a self-loop hypothesis which should be the worst\n",
"q_selfloop = lil_matrix((len(vocab), len(vocab)), dtype=np.float64)\n",
"# As we only believe in self-loops we only believe in transitions from the diagonal of Q\n",
"q_selfloop.setdiag(1)\n",
"q_selfloop = q_selfloop.tocsr()\n",
"\n",
"ret = calc_evidence(q_selfloop, trails, vocab, ax, \"self-loop\")\n",
"# Further plotting\n",
"ax.set_xlabel(\"hypothesis weighting factor k\")\n",
"ax.set_ylabel(\"marginal likelihood / evidence (log)\")\n",
"\n",
"plt.legend(loc=4, handlelength = 3)\n",
"plt.grid(False)\n",
"ax.xaxis.grid(True)\n",
"plt.tight_layout(pad=0.2)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
""
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Here, we can clearly see, that the evidence of the self-loop hypothesis falls the more we believe in it (higher $k$). \n",
"\n",
"In more large-scale examples, it might frequently happen that the evidence rises for lower values of $k$, but then falls. This indicates that the hypothesis goes into the right direction, but with more belief in it, we limit ourself too much on it and do not believe in other parameter configurations that might also be important. For a discussion of the behavior of the evidence for various $k$, please refer to Section 5 of our HypTrails paper. Basically, interpretation should always be conducted dataset-independent and based on expressed hypotheses. "
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"##Synthetic example\n",
"\n",
"In this example, we take a look at a more large-scale example. In detail, we create a synthetic graph and generate synthetic trails by letting a random walker walk through this graph. We then compare some hypotheses with each other which should further demonstrate the mechanics of HypTrails. We use the python code provided at https://github.com/psinger/HypTrails."
]
},
{
"cell_type": "code",
"execution_count": 39,
"metadata": {
"collapsed": false
},
"outputs": [],
"source": [
"#First, we import the necessary functionality\n",
"#trial_roulette contains methods for Dirichlet elicitation\n",
"#PathTools includes the Markov chain functionality; see https://github.com/psinger/PathTools\n",
"from hyptrails.trial_roulette import *\n",
"from pathtools.markovchain import MarkovChain"
]
},
{
"cell_type": "code",
"execution_count": 40,
"metadata": {
"collapsed": false
},
"outputs": [],
"source": [
"#For running this example networkx is needed\n",
"import networkx as nx"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"###Synthetic data generation\n",
"\n",
"First, we generate a random graph. To that end, we create a Barabasi-Albert random network with 13 nodes and new nodes are attached to the existing graph with 2 edges. The graph layout is visualized.\n",
"\n",
"Note that this network is undirected. However, there are also extensions that allow to generate directed Barabasi-Albert networks. For simplicity, we focus on the undirected case here though."
]
},
{
"cell_type": "code",
"execution_count": 41,
"metadata": {
"collapsed": false
},
"outputs": [],
"source": [
"g = nx.barabasi_albert_graph(13, 2)"
]
},
{
"cell_type": "code",
"execution_count": 42,
"metadata": {
"collapsed": false,
"scrolled": true
},
"outputs": [
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAd8AAAFBCAYAAAA2bKVrAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzs3XlcVFX/B/DPsA/DjiAprqSoqI9ruVFa4JorkJmVT8tj\naqZmpZUiorZoVo+m5a9cn9IWwUzMLQU3QCVxRc19wQVUQGAYtpnv74+BG8MMOsudBfi+X6/70mHu\nPefcO3C/c849i4SICIwxxhizGDtrF4Axxhirbzj4MsYYYxbGwZcxxhizMA6+jDHGmIVx8GWMMcYs\njIMvY4wxZmEcfBljjDEL4+DLGGOMWRgHX8YYY8zCOPgyxhhjFsbBlzHGGLMwDr6MMcaYhXHwZYwx\nxiyMgy9jjDFmYRx8GWOMMQvj4MsYY4xZGAdfxhhjzMI4+DLGGGMWxsGXMcYYszAOvowxxpiFcfBl\njDHGLIyDL2OMMWZhHHwZY4wxC+PgyxhjjFkYB1/GGGPMwjj4MsYYYxbGwZcxxhizMA6+jDHGmIVx\n8GWMMcYsjIMvY4wxZmEcfBljjDEL4+DLGGOMWRgHX8YYY8zCOPgyxhhjFsbBlzHGGLMwB2sXgDEx\nZWdnIyMjA3K5HAAgk8kQEhICf39/K5eMMcb+wcGX1WplZWXYsmUL1q9YgbT0dBTK5ejg4gKPivfz\nAZwqLoabTIbuXbpg7IQJGDZsGBwdHa1ZbMZYPSchIrJ2IRgzlEKhwBcLF+LbJUsQpFTijYIC9AbQ\nEoCk2r4E4DKAZAAr3d1xyd4eE6dOxbszZ0IqlVq66IwxxsGX1T4pKSl49fnn0TEnB3MUCnQw8PhT\nAOZJpTjl64s1v/6Knj17mqOYjDFWI+5wxWoNIsL8OXMQERaGj2/exEYjAi8AdACwUaHAgsxMjHz2\nWcyfMwf8HZQxZklc82W1AhHh3cmTkbR2LXYUFaGhSOneATBIJkO/cePwxbJlkEiqN1ozxpj4uObL\naoUFMTFIWrsWSSIGXgAIAJAklyNp3TosiIkRMWXGGKsZ13yZzUtJSUFEWBiOKxSiBt6q7gDoLJVi\n0549/AyYMWZ2HHyZTVMoFOjcujU+zsxEhJnzigMwOzAQx86f517QjDGz4mZnZtO+WLgQHe7fN3vg\nBYBIAB3u38cXCxdaIDfGWH3GNV9ms8rKytDc3x878vKM6tVsjJMABnt740pWFk/EwRgzG675Mpu1\nZcsWBCmVFgu8ANARQIvyciQkJFgwV8ZYfcPBl9ms9StW4I2CAoOPOwvgGQBeAFoB2Gzg8W8UFGD9\nihUG58sYY/ri4MtsVlp6OnobeEw5gOEAhgHIBfAdgJcAXDAgjd4A0o4eNTBnxhjTHz/zZTYpOzsb\nwU2bIqekRGuu5oc5DaAngKr15QEAngQwT880CIC3kxMuZGbCz8/PgNyZNfBKVqw24lWNmE3KyMhA\nBxcXSEpKTE5LBXVQ1pcEQAepFBkZGejbt6/J+TNx8UpWrC7g4MtsklwuF26mhggG4A/gcwDTACQB\n2A/1M2BDeAAoLCw0ogTMXHStZPU5KlayqvYljQBcLilB8u7dWHL4MKbwSlbMxnCzM7NJW7duxYqX\nXsLWBw8MPvYUgLehru12B9AAgAuA7w1II1Qiwf02bdCxY0c0adJEYwsMDIS/vz/s7LjLhKXwSlas\nruGaL7NJMpkM+UYe2wHA3iqvewF41cA08ohw9uxZnD17Vuf7Tk5OaNy4sVZQrvra19eXF2owERFh\nQUwMvlm8GF8rFIg0Mp3KlaziKlayeuu99zA7NpY/H2Y1XPNlNsnYDleAupbTCupnvd8A+BbAOQD6\nPvEjAK4Aig3MtzoXFxetgFw9SHt5eXEAqAGvZMXqMg6+zGY18fXF3pwcBBl43AwAKwGUAXgKwNdQ\nPxfU10UAfb288MOmTbhx44awZWZmCv/Pzc01sFS6yWQynbXmqj/z8DDm6XftN3/OHGz64gskFRXB\nS+S08wD0k8kwavp0RM/Ttx88Y+Lh4Mts1qjwcIzYvRuvWDjfdQC2hIcjfteuGveRy+VaAbl6kM7P\nN7bhXJOHh0eNTduVm6urqyh52QpeyYrVdRx8mc2Kj4/Hly+/jGSFwqL5hrq74521azFq1CiT0snP\nz9dZa666FRUViVJmb2/vhzZvBwYGwsXFRZS8zI1XsmL1AQdfZpOSk5MxZ84cpCYm4jBg8YUVrmZn\nw8HBvP0RiQh5eXk1Nm1Xvi4uNvXps5qfn99Dm7cbN24MJycnUfIyxYK5c3Fi0SJstNCXriipFP+a\nMQOz5861SH6MARx8mY1JSUnB3Llz8eeffwIA7KGeoeoPC+VvazdiIsL9+/d11porA3VmZibKyspM\nzksikaBhw4YPfQbdqFEjs34p4ZWsWH3BwZfZhOpBt5JEIkEDqRTfFBUZPcxEXxsBRNfCJkiVSoXs\n7OyHPoO+efMmlEqlyXnZ2dnhsccee+gz6IYNG8Le3t6o9OPj47Hk1Vex34gFNUwh1qMGxvTFwZdZ\nVWpqKubOnYtd1To32dnZ4eWXX8asWbNw7949jHr2We58YwKlUok7d+489Bn07du3IcbtwMHBAY0a\nNXroM2g/Pz+dk5SY0snuZwCxAG4ACACwFkAfPY/Vp5MdY2Li4Mus4mFB96WXXsLs2bPRqlUr4efz\n58zBpi+/RJJczsNOzKSsrAy3b9+usXn7xo0byMrKEiUvJycnBAYGatWc582cieTCQoOHl/0J4D8A\nfgXwBIDbUI/XbqTn8RcBPOPjg+v37xuYM2PG4eDLLCo1NRWxsbHYuXOnxs9rCrqVhAkX1q3Ddrkc\nASKVhydcMExJSQlu3rz50CFW9+7dMzp9KQA5YPDEKr2gDr6GzmRWiVeyYpbG00syizh06BDmzp2r\nM+iOHTsWs2fPRuvWrWs8XiKR4Itly7DA1xedTZxqsNJGAG9LpXhr+nSealBPzs7OaNmyJVq2rHna\nEoVCodEZTFeQrmmSksdheOBVAjgK9TrOraCemWwE1Itr6Du4ileyYpbGNV9mVocOHUJsbCx27Nih\n8XN9g64uqamp+HdUlNGT7J8EMJ8n2beqwsJCjcCcmZmJ5ORklCYmIqm83KC0bgEIBNANQALUNYrh\nAPoCWGBAOkM8PTHxxx/x3HPPGZQ/Y0Yhxszg0KFDNHDgQIK6RU/Y7Ozs6KWXXqJz586ZlH5RURHN\nj4mhxt7e1MfdndYCdAEgFUBUbVNVvLcWoH8B5CeT0fyYGCoqKhLpbJkYEhISaIinp9bn96gtByAJ\nQP+r8rN4gDobmM5gT09KSEiw9mVg9QQ3OzNRHT58GLGxsdi+fbvGz+3s7PDiiy9i9uzZCA4ONjkf\nqVSK2XPnYuasWUhISMD6FSsQffQoCuRytK++sLpCAUd7exQrFCgEMGbYMJsZx8v+YexKVt5Q13xN\nlQ/Azc1NhJQYezRudmaiOHLkCObOnasz6I4ZMwazZ89GmzZtzF6O7OxsnDlzBoWFhQDUN9OQkBDc\nuHEDXbt2BQD4+PggOzvb6LGozDxMWckqBsB2qCdjcQAwDMAzUA890gd3uGKWxsGXmeTIkSOIjY3F\ntm3bNH4ukUiEmq4lgu6jEBECAwNx69YtAMDBgwfRu3dvK5eKVWfsSlblAKYC2AB1J6vRABYB0Hey\nTB5qxCxNe5Q7Y3o4cuQIhgwZgieffFIj8FYG3TNnzuDHH3+0icALqMs1ePBg4fXWrVutWBpWk+5d\nuiDZiOMcACwHkAv1GN//Qv/ACwDJALpXtIwwZgkcfJlB0tLS8Nxzz9UYdDMyMrB+/XqbCbpVVe3F\nysHXNo2dMAEr3d0tnu9Kd3eMnTDB4vmy+oubnZle0tLSEBsbiz/+0FziQCKR4IUXXkB0dDTatm1r\npdLpp7CwEL6+vigtLQUAXL16Fc2aNbNyqVhV1lxYwRIrWTFWiWu+7KH++usvDB06FE888YRG4JVI\nJBgzZgwyMjKwYcMGmw+8gLrzVb9+/YTX1b9IMOtzdHTExKlTMc+CC1vMl0oxYcoUDrzMojj4Mp0q\ng2737t01mmgra7qnT5+uNUG3qqpNzxx8bdO7M2filK8v4iyQ10YAp3x98e7MmRbIjbF/cLMz03D0\n6FHExsYiISFB4+cSiQSjR49GdHQ02rVrZ6XSme7KlSvC1IguLi64f/8+XF1drVwqVl1qaqpFVrLq\n5OKC3xITeZYzZnFc82UA1EF32LBh6Natm0bgrQy6p06dwk8//VSrAy8AtGjRQjiH4uJiJCYmWrlE\nTJeePXti0nvvYaBMhjwzpJ8H4CkApQ4O8PX1NUMOjD0cB996Lj09HcOHD39o0P35558REhJixVKK\na8iQIcL/udez7ZodG4t2AwfiCahrqWK5A/Wyg9cA5BYWom/fvvj7779FzIGxR+PgW09VBt2uXbti\ny5Ytws8lEgmef/55nDx5ss4F3UrVn/vykxfblJmZid0HDuAKgGBAlGfAGwF0kkoR+vLLsK/o1HX7\n9m307dsX586dEyEHxvTDz3wtLDs7GxkZGZDL5QDU89mGhITA39/fIvkfO3YMsbGx+P333zV+LpFI\nEBUVhejoaLRv394iZbGW8vJy+Pn5IS9P3aB5/Phx/Otf/7JyqVhVcrkcffr0wfHjxwEAHh4eaCCV\nokt+vtErWX0I4Ky/P9Zv3oyePXti3759GDx4MIqKigAAAQEBSEpKsskx6qwOss56DvVHaWkpxcXF\n0ciwMAr08SEvZ2cK9fSkIRVbqKcneTk7U6CPD40MC6O4uDgqLS0VvRzp6ek0fPhwrVWGANDzzz9P\np06dEj1PW/bCCy8I579gwQJrF4dVoVQqaeTIkcLn4+DgQHv37jV6JatuDg7kCpA9QEOGDNHIa9++\nfSSTyYS8GjZsSGfOnLHSmbP6hIOvmVTeKBp5eVGouzutA+jiQ24UFwFaB1Couzs18vISbcm7Y8eO\n0YgRI3QG3aioqHoXdCv98MMPwnXo2bOntYvDqpg1a5bG7+n333+v8X5paSnFx8fTqPBwalLxhbaP\npycNrtj6eHqSp5MTNfHxoVHh4bRkyRKN9KoH1/3792sF4IyMDEueMquHOPiaQXJyMrVu3JgipVI6\naeCaogTQSYAipVIKDgyklJQUo8rwqKB78uRJkc+6drl79y7Z2dkRAJJIJJSdnW3tIjEiWr9+vcbv\n6rRp0x55TFZWFiUlJVFCQgIlJCRQUlKS1uc5bNgwIc3XXntNK43qAdjf359Onz4t2nkxVh0HXxGp\nVCqaFx1NAVIpbTQi6FbfNgLUUCqledHRpFKp9CrDsWPHNJrsqm6RkZH1PuhW1bt3b+Ha/O9//7N2\nceq9Q4cOkbOzs/CZDBo0iMrKykRJ++DBg0K6jo6OdPPmTa19Dhw4QG5ubsJ+fn5+HICZ2XDwFYlK\npaJ3Jk2iTq6udEeEwFu53Qaok0xG70ya9NAAfPz4cQ66Bvrkk080nnsz67l+/To1bNhQ+Dzatm1L\neXl5oubRq1cvIf0ZM2bo3OfgwYNaAbi+Ppph5sXBVyTzoqOpk6sr5YoYeCu33IoAPC86WivfEydO\n0KhRo3QG3YiICDpx4oQVrkbtcPLkSeFaeXp6UmZmJiUmJgrNl4mJiZSVlWXtYtZ5hYWF1KlTJ+Gz\n8PHxoYsXL4qez+bNm4U8PDw8agzuycnJ5O7uLuzboEED/vLKRMfBVwTJyckUIJWKWuPVVQMOkEqF\nZ8AnTpygiIgIDromKCkpIV9fX3IDyBUgT0dHq/REr8+USqXGl0cHBwdKSkoyW17BwcFCXosWLapx\n35SUFK0AzH9TTEwcfE1UVFREwYGBFGfGwFu5bQSoZcOGNXakGjVqFB0/ftzal8TmVe2J3t3R0Wo9\n0Zl2z+bvvvvOrPmtXLlSyKtRo0ZUXFxc476pqank4eEh7O/r68t/X0w0HHxNND8mhiKlUrMH3spt\nMNTjFTnoGscWeqIzNWN6NpuquLiYAgIChDxXr1790P0PHTrEAZiZBQdfE5SWllIjLy+jbuLGbieg\nbiIFQCNHjqRjx45Z+zLUCrbQE539o3rP5oEDB4rWs/lRPvvsMyHftm3bklKpfGRZqwZgHx8f/rtj\nJuPga4K4uDgKdXe3WOCt3Lo6ONDixYutffq1hrV7ojNN169f16h9mqNn88Pk5uZqPM/dsmXLI485\nfPgweXp6agTg9PR0C5SW1VW8sIIJ1q9YgTcKCh653zIA3QC4AHi1ys/LAEQCaAH1Chf79Mz37fJy\npOzcaVhh67EFMTFIWrsWSUVFoq4NGwAgSS5H0rp1WBATI2LKdZdcLsewYcNw5456nSIfHx8kJCTA\n09PTYmXw8vLChAkThNeLFi165DFPPPEE/vzzT6GcOTk5ePbZZ5Genm62crK6jRdWMEETX1/szclB\n0CP2+w3q4LoTgALAmoqflwH4FkBXAFEAfoZ6jdFHuQjgGR8fXL9/36hy1ycpKSmICAsz+6LsnaVS\nbNqzhxdlfwiVSoWoqChs2rQJAODg4IA///wTffv2tXhZbt68iRYtWqCsrAwAkJycjF69egF4+OIn\nf/31F8LDw4VFOby9vbF792506dLF4ufAajcOvkbKzs5GcNOmyCkpgUTPY6IBZOKf4FtVEwDroV/w\nJQDeTk64kJkJPz8/PXOvfxQKBTq3bo2PMzMRYea84gDMDgzEsfPnIa1Yqo5pio6OxoIFC4TX3333\nHf7zn/9YrTyvvfYa1qxR/zV2794dgZ6eSEtPR6Fcjg4uLvCo2C8fwKniYrjJZOjepQt6hIfj008/\nFQKwl5cXdu/eja5du1rnRFjtZN1W79orMTGRQj09DXpGOAugf9fwXiBA+wxIq4+np9nGQ9YVlu6J\nHimV0vyYGGuftk2q3rN56tSp1i4SHT16lOwBkgLUCTBoyFlDd3dyc3ERzsfLy4vS0tKsfUqsFuFn\nvkaSy+XCN2N96VtD1ocHgMLCQhFTrFvKysrw7ZIlmKNQWCzPaIUCK5YuFZoymdrhw4fx2muvCa8H\nDBiAxYsXW7FE6scRY4YNw2A7OxwGcAzAKwCCoPvvVFLx3isA9hcU4M+CAvQngptEvXdeXh7CwsKQ\nlpZmoTNgtR0HXwvi9n3L2bJlC4KUSoMXXTdFRwAtysuRkJBgwVxt240bNzBixAiUlJQAANq2bYtf\nfvkFDg4OVikPEWH+nDmICAvDxzdvYotKZdTvSAcA8SUlWEMETwAOAB48eIDw8HAcOXJE3EKzOomD\nr5FkMhnyDTxGzJpvPgA3NzcRU6xb9O2JXt1LAB4D4AkgGMAqA49/o6AA61esMDjfukgul2P48OFW\n7dlcFRHh3cmTsemLL3BcoUCkCGlGAjgHoCUAJ/wTgA8fPixC6qwu4+BrpJCQEJwqLtarNqsEUAyg\nvOL/JRX/ouL/xTr+/zAE4JRCgZCQEMMKXY+kpaejtxHHfQjgCoAHALYAmA3AkMEkvQGkHT1qRM51\ni0qlwrhx43Ds2DEA6p7N8fHxCAp61NgA8zHnkLPDAJpDXQPOz89H//79cejQIRFzYXUNB18j+fv7\nw00mw2U99p0PwBXAQgA/ApAC+LjiveCK924BGABABuD6I9K7BMDDzY17OtcgOzsbhXI5WhpxbAjU\n47ErSQC9PuNKQQDyCwtx9+5dI3KvO2JiYhAfHy+8Xr58uVWGFFVKSUnBN4sXY0dREbzMkL4X1OP0\nZRWvOQCzR+Hga4LuXbogWY/95gJQVdvmVLx3teK1ssq/TR+RXjKA7jysoUYZGRno4OJidDP/JKhv\nom0BNAIw2IBjJQA6SKXIyMgwMvfa76efftIYUjR16lSMHz/eauVRKBR4bfRoLDPjWG9AXQNeCcDd\nTn1bLSgoQP/+/ZGammrGXFltxcHXBGMnTMBKd3eL57vS3R1jq8zQwzQZ0xO9qm8AFAI4AGAk1M/y\nDFGfe6IfOXIEr776zzxuttCz+YuFC9Hh/n2zj/UG1M+Awx0d4V4x1rsyAKekpFggd1abcPA1wbBh\nw3DJ3h6nLJjnSQBXHBwwbNgwC+Za/0igfn6bCfUsZOzRMjMzMXz4cKFnc5s2bazasxmwzpCzmJIS\nyBwd0aBBAwDqL2IDBgxAcrI+7WSsvuDgawJHR0dMnDoV8yw4o9F8qRQTpkyx6g3N1hnTE70mZTDs\nmS9QP3ui28KczbpYa8jZ40SYNWsW/P39AagD8MCBA3Hw4EELloTZMg6+Jnp35kyc8vVFnAXy2gjg\niKsr3p050wK51V6G9ESv6i7U82sXQv3sfWfF62cNSKM+9kTX1bM5Li4Ojz/+uJVLZvriJwCwB0Ab\nqPsBPINHd4gE1EPODmzbhqSkJK0AfODAAQPOgNVZVp5hq05ISUmhAKlU1OXqdC1f51Exld2MGTMs\ntvZpbRXo40MXDbzGdwF6GiCvimvdEaCVBqZxAaAmPj7WPn2Lio6O1pg6csWKFdYukkDf34NNAG0G\naCI0p4C9C5AnQHEAlQD0PkA9DPw9yMjIoIYNGwrXRyaT0b59+6x8ZZi1cfAVybzoaOokk1GuGQJv\nLkCtJRJyqHKDe+aZZyg7O9vap22zRoaF0TozfhmqaVsLkJe9Pb366qu0e/duKi8vt/alMKsNGzZo\nBN4pU6ZYu0iCrKws8nJ21jlXc03b7GrB9/8A6l3ltRzquaD/fkQ6KoA8nZyEv9EzZ85wAGYaOPiK\nRFiwXSaj2yLezCsXbJ/4+us0aNAgjRtdkyZN6MiRI9Y+dZsUFxdHoe7uFg++/6ry+QCgRo0a0fTp\n0+no0aOkUqmsfVl0ysrKosTEREpISKCEhARKTEykrKysRx53+PBhcnZ2Fs51wIABNtUiI8biJ1MA\nmlRtnw4AxeuRVvXFT86ePUsBAQHC9XJ1daW9e/da7wIxq+LgKyKVSkXzoqMpQCqljSLcyH8FqKFU\nSvOio0mlUpFSqaS5c+eSRCIR/oCdnJzo+++/t/ap25zS0lJq5OVFJy0YeE8A5GZnpxF8q25t2rSh\n+fPn06VLl6x+beLi4mhkWBgF+viQl7MzhXp60pCKLdTTk7ycnSnQx4dGhoVRXFwclZaWaqRx48YN\njUASHBxMubm5Vjoj3RISEmiIgcG3es33dYA+qLZPb0CvVpXBnp6UkJCgUSZdAZhXJ6ufOPiaQUpK\nCrVu3JgipVKjbv4noF6eLjgwkFJSUrTS/+OPP8jLy0vjxv7GG2+QQqGwwtnaLmssKTgvJoZSU1Np\n8uTJ5OfnV2Mg7tmzJy1btsyijw6KiopofkwMNfLyolB3d4OW0Gvk5UXzY2KoqKiICgsLqUuXLsK5\neHt704ULFyx2HvoyJvhWr/lOhXbNtz3Uz4iNCb5EROfOnaPHHntMuH5SqZQSExOtcIWYNXHwNZPK\nG11jb2/q4+5Oa6HuhFHTje4C1M8L+7i7U2Nvb+FGV5OLFy9Sx44dNW7o3bp1o2vXrlnwLG1bUVER\nBQcGitIK8ajtV4CCAwM1PrPS0lLatm0bjR07lmQymc4g7ODgQIMHD6b169dTYWGh2a5FcnKySV8I\nT+KfL4T9+vXTKL+tBg5jmp2r13y/g+Yz30Lo98yX8PA1t//++29q1KiRRgDes2ePZS8QsyoOvmZW\nWlpK8fHxNCo8nJpUNPH18fSkwRVbH09P8nRyoiY+PjQqPJzi4+O1mvhqIpfLaezYsRo38wYNGtDu\n3bvNfFa1h6V6ogdIpTpbKSoVFhbS+vXrafDgwWRvb68zEMtkMho7dixt27ZNtGenYj8K2Qh1T/DK\nzn+21LO5OkM6XJUDpIC6ifllgIorflbZ2zm+4v33AeqpR3rVO1zpcv78eY0A7OLiwn+79QgHXwvL\nysqipKQkoXNLUlKSSU2PKpWKli5dSg4ODsIfsZ2dHS1cuNBmO/hYmrl7oneSyWhedLTe5cnOzqbl\ny5dTr169dAZhAOTn50eTJ0+m1NRUoz9HoROgq6uoXz5uA9QKoK4dOtj875i+Q41iAJJU22Ir3tsN\nUBuoa7z9ALqmR3r6Djk7f/48NW7cWCMA//nnnxa4MszaOPjWEQcOHNDoyAGAIiIiKD8/39pFszpz\n9kRvDdD4ceOMDkKXL1+mBQsWUNu2bWsMxEFBQRQdHU3nzp0zKO150dHUydXVfF86XF0N+tJhDdYc\ncjYqPFyvMl64cIECAwM1AvCuXbvMfGWYtXHwrUNu3bpFvXv31rhxt2nThs6ePWvtolmdOXqiVza/\n9urVS+9HBQ8rX3p6Or377rsaTZHVt65du9KXX35Jt27demh6ycnJNtHcbi3l5eW0efNmatu2LXWy\nQvDt4+5O8fHxepf34sWLWgF4586dZrxCzNo4+NYxJSUl9Pbbb2vcsN0NvBHUZWL1RG/u56cx5Gva\ntGmilbG8vJz27NlDr732Gnl4eOgMwnZ2dhQWFkZr1qyhvLw8jeMrO5rFWSDIbIR2RzNrKiwspOXL\nl9Pjjz8uXCspYPEhZ429vQ1+bn/x4kVq0qSJUG5nZ2fasWOHma4UszYOvnXUDz/8QFKpVOOG/cEH\nH9T5GZf0IVZP9E8//VTj+v7888+il1WhUKjH5I4cSU5OTjoDsbOzM0VGRtJvv/1GxcXFVhliNT8m\nRvRzN8StW7foo48+Ih8fH63r4yiR0FB7+1pxPS5dukRNmzbV+Gy3b98u7sViNoGDbx12/Phxatmy\npcaNKCwsjO7evWvtotkEU3uiq1QqGjFihHBtZTIZZWRkmK28OTk59P3331Pfvn01at1VNy8vL/Jy\ncrJKTc/UpndjnDhxgsaNG0eOjo46r8XMmTPp/PnzVh1yZqjLly9rBeBt27aJeNWYLeDgW8fl5OTQ\n4MGDNW5KTZs2pbS0NGsXzeYY0xM9Ly+PWrVqJVzb4OBgevDggdnLeuPGDVq0aBH961//0go6teEZ\npylUKhVt376dwsLCdH4BadGiBS1dupQKCgqEY2xlyJm+Ll++TM2aNRPOycnJif744w+T02W2g4Nv\nPaBUKikmJkbjBuXs7EyrVq2ydtHqhJMnT2o08UdERFh0CM7p06fpww8/pGbNmpEb9Jv6sPp2H6AR\nAMkAagZ0hPABAAAgAElEQVTQBgOPN6R3r7EUCgWtXLmS2rVrpzPo9urVi+Lj42t8tGJrQ84e5cqV\nK1oBeOvWraKlz6yLg289kpCQQJ6enho3rPHjx1NxcbG1i1br/fjjjxrX9fPPP7d4GZRKJQW4uxu8\nlCIB9ELFJgfoINQTS2QYcLw5l1LMzs6m2NhY8vf31wq4dnZ2FBUVRampqY9Mx9yLn7wzaZLoX7qu\nXr1KzZs31wjAuqasZLUPB9965sKFC9ShQweNG9gTTzxB169ft3bRar3JkycL19Te3t7iE+Ybs4Qe\nQT1lolNFAK382SvQXlDgYZs+MzoZ6uzZszR+/HhycXHRCrpubm40bdo0unLlikFpmnvxE3O4evUq\ntWjRQjh3R0dH2rJli1nyYpbDwbceKiwspDFjxmjczPz8/Gx2jt7aoqSkhHr27ClcU39/f8rMzLRY\n/sbMZUwApQPkWu1nXwA01MB0HjaXsb5UKhXt2bOHhgwZohVwAVBgYCB9/vnnJq+gZO7FT8R27do1\nrQD8+++/G5SGsUtHMvPg4FtPqVQq+u9//6s1LeXnn39u81MG2rIbN25oNI/26tWLSkpKLJK3Mav4\nEED7AQqo9rPvAOprYDo1reKjj5KSEvrf//5HnTp10hl0u3btShs2bBC1R7W5Fz8R27Vr1zRGLzg6\nOtLmzZtr3F+MpSOZ+XDwref2799PDRs21LjRRUVF8bSUJkhMTCS7Kuv6TpkyxSL5Ght8ddV8Pzei\n5mtM8M3JyaHPPvtM56xeEomEhg0bRvv27TPrF0JzLn4ituvXr1NQUJBwjRwcHOi3337T2EespSOZ\neXHwZXTz5k2N5lIA1LZtW4PnEmb/WLhwocb13LBhg9nzNLbZWdcz35cA+tDAdAxpdr548SK9/fbb\nOpdalEqlNHHiRPr777/Ne8FqIPbiJ2K7ceOGVgDetGkTEYm7dKQtThtal3DwZUSkbvZ76623NG6C\n7u7uwh81M4xKpaKRI0cK19LV1ZVOnTpl1jyN7XBFUPd0HgN1b+cDUPd2PmPA8fp0uFKpVHTw4EEa\nNWqUzklCAgICaMGCBXTv3j2zXqe64MaNGxpTaNrb29OYyEhRl440d0ey+o6DL9Pwv//9T6t36Ycf\nfsjTUhrhwYMH1Lp1a+E6tm7dWmseZrHpu4Re9S0HmuN8fzLw+IcNNSorK6NffvmFnnzySa2AC4A6\ndOhAa9as4SFvBsrMzBQmeHGCeplHsZeONNcQKsbBl+lw7NgxjZ6VACg8PJynpTTC6dOnydXVVbiO\nI0eONOuNzJaW0Hvw4AF9+eWXGhNFVN0GDBhAu3bt4hu7CTIzM8nf25taAbVm8hCmxsGX6XT//n0a\nOHCgxs2yWbNm9Ndff1m7aLXOhg0bNK7jwoULzZZXXFwchbq7Wzz4Vp1e8tq1a/Tuu+/qXJHJycmJ\nXnvtNbM3wdcXycnJ1NDFpdZMm8n+wcGX1ai8vJyio6M1bp48LaVxpkyZIlxDOzs72rNnj1nyKS0t\npUZeXlZZWCE1NZXGjBlD9vb2WkHX19eXoqOj6c6dO2Y57/qoPi8dWRdw8GWPtGXLFq1pKd98801+\nRmeAkpIS6tWrl3D9/Pz86MaNG2bJ692pU2monZ3Fgu9IJydqWWUVnqpbcHAwrVixgm/aZlAfl46s\nSzj4Mr2cP3+e2rdvr3FjffLJJ80WQOqimzdvaoyp7tGjh6gTcKhUKlqxYgXJZDKSVdRWzH1D/hXq\nMcLVg26/fv0oISGBlEqlaOfH/mHNFg6eiEMcHHyZ3goLC+mFF17QuMnytJSG2bt3r0az7OTJk0VJ\n9+rVq/Tss89qfDaeELf3a/XtNkAeVfJzcHCgl156iY4ePSrKObGa2cKzfWYaDr7MICqVir766iuN\nAGJvb0+LFy/mXqt6Wrx4sUaQ/PHHH41OS6VS0bfffktubm5Uvbl3/KuvmnUJvVYAOeCfReu5FcRy\njOnV/jVAXQFyBujfRn7uunq1M+Nw8GVG2bdvn9a0lM8//7zGAuZMN5VKRZGRkcJ1k0qldPLkSYPT\nuXLlCj3zzDMan4GdnR3NmDGDioqKzLqEXiuAGri705IlS/gztwJjxnNvAmgzQBNNCL7mXDqyvuHg\ny4yWmZlJPXr00Lj5t2vXjqel1EN+fj4FBwcL1+3xxx/XewIOpVKps7bbpk0brXVtzbGEnpedHY2J\njKSysjJzXBr2CKbMZEYAzTYh+Jpj6cj6ioMvM0lJSQlNmjRJIwi4u7trTfbOtGVkZGjMbTx8+PBH\ndlB6WG1XoVDUeJwYS+gNtbOjFv7+PN7Tyoydw7tym2VC8CWIs3QkI7IDYyZwcnLC8uXLsW7dOri4\nuAAACgoKMHLkSMyaNQtKpdLKJbRd7dq1w+rVq4XXv//+OxYtWqRzX5VKhW+//Rbt27dHYmKi8PM2\nbdogJSUFCxcuFK6/Lj179sTxCxfwrxkzMMjbG6Hu7lgH4CLUEbw6qnhvHYDujo4Y6OmJJ6KjkXH1\nKnr27GnM6TKRyOVyeJhwvMTE/D0AFBYWmpgK45ovE016ejo1b95co1bWv39/nij/EaZNm6ZRi929\ne7fG+5cvXzaqtluTynVe+3btSl6OjiQFqD1AvSu29gBJAfJzdaWh/fpZdQk9ps3YpSPFqvmasm4z\n+wcHXyaqe/fu0YABAzQCRfPmzXn4yUOUlpZSnz59hOvVoEEDun79OimVSvrmm2+0lt1r27YtHTp0\nyKi8SkpK6IcffqDOnTtrpFl98/LyEvksmVhMbXY25ZkvNzuLh4MvE115eTnNnj1b42bu4uJCa9as\nsXbRbNatW7coICBAuF6dOnWip59+Wqu2O3PmTKNqu5WL1jdu3Fgr0FYuWp+YmKjxc67t2iZjO1yV\nA6QA6AOAXgaouOJnhqTBHa7Ew8GXmc3vv/+uNbn+xIkTRZ3VqS7Zv3+/znmRTantGrpovZ+fn/B+\nZmammKfHRGTMUKMYgCTVtlgD0+ChRuLhDlfMbIYNG4a0tDSEhIQIP/v222/x9NNP4+bNm1YsmW0K\nDAxEixYtNH4mkUjwwQcfID09HU8++aRe6RARkpOTERERgVatWuHrr7+GXC4X3g8ICMCCBQtw/fp1\nfPPNN2jdurXGe5WysrJMPCNmDiqVCi2aNkWygcfNBaCqts0xMI1kAN27djXwKKaTtaM/q/sKCgpo\n9OjRGrUuf39/2rt3r7WLZhOUSiUtX75cZ+3U2dmZjh8/rlc6ZWVl9Ouvv5q0aH1YWJiw/7Zt28Q6\nRSaC/Px8WrZsmTA+vJMJz22Nft7L00uKhoMvswiVSkVffvml1rSUX375Zb2elvLy5cvUr18/rWew\nvr6+wuugoCDKzc2tMY38/Hz66quvtHqaV26GLFo/duxY4Th+Rm8bLl26RO+8847WIxwpYJWFFXhy\nFXFw8GUWlZSURP7+/ho3kdGjR9e7KQqVSiUtW7ZMq7bbrl07Onz4MJ05c0ZjBquhQ4dqTcBx/fp1\neu+990RdtH769OlCGp999pmYp8wMoFKpaM+ePTRs2DCSSCRan6+Hhwf16dGDIlxcLBZ8eUlBcXHw\nZRZ348YNrWkpQ0JC6Pz589YumkVcvnyZ+vbtq3H+dnZ29MEHH2j0ZN64caPGPh9//DEREaWlpZlt\n0fqFCxcKab3zzjuinC/Tn1wup++++05r+c7KrXXr1rRs2TLKz8+noqIiCg4MtNjSkcGBgbwus4g4\n+DKrKC4upokTJ2p9m//999+tXTSzeVht98iRIzqPqVoTrXxuq+umXLlovVwuN6mMa9euFdJ88cUX\nTUqL6e/69es0c+ZM8vHx0fn5Dhw4kLZt26bV+pGSkkIBUqnZl44MkEp5WlGRcfBlVrVmzRpydnbW\nuNHMnj2bysvLrV00UV26dElnbffDDz986LjdvLw8evzxx3XekAHxF63fvn27kPYzzzwjSppMN5VK\nRQcOHKDIyEidrRgymYzeeustOnv27EPTmRcdbdalIzvJZDQvOtpCV6X+4ODLrO7o0aPUrFkzjRvP\ngAED6P79+9YumsmMqe0SqSfdmDVrls6akEQioRdeeMEss4YdO3ZMyCckJET09Jm61Wft2rXUpUsX\nnV+oWrRoQV988cVDO9lVZc6lIzvJZPTOpEn1ulOkuXDwZTbh3r171L9/f42bUPPmzSk9Pd3aRTPa\npUuXdM5S9eGHH9Y43OfEiRP073//m5ycnGqs7QKgN9980yxlvnXrlpBHgwYNzJJHfXXr1i2Kjo7W\n6nBYtaVh8+bNRrX6mGPpyIZSKc2LjubAayYcfJnNKC8vp48++kjjhuTi4kLr1q2zdtEMolQq6euv\nvyZXV1eNcwkJCdFZ21WpVLR9+3YKDw+vsSa0ZMkSjc5QAGjt2rWil72srEzoXSuRSHhYiQgOHz5M\nY8eOJUdHR63P1sXFhd544w06efKkKHmJsXRkpFRKwYGB/IzXzDj4MpuzefNmcnd317hJTZo0qVZM\nS3nx4kWt2q69vT199NFHWrVdhUJBK1eupHbt2ukMur169aK4uDihJqRSqTQmK3FxcaFjx46Jfg4N\nGjQQ8rh165bo6dcHpaWltGHDBq1e/ZVbYGAgffrpp2ZZ8auoqIjmx8RQY29v6uPuTmuhnhZS11zQ\nqor31kI9gUZjb2+aHxPDvZotgIMvs0nnzp3TCko9e/Y0ab7hrKwsSkxMpISEBEpISKDExETKysoS\npbxKpZKWLl2qs7ablpamsW92djbFxsbqbH60s7OjqKgoSk1N1ZlPQUGBxnVp0aIF5eTkiHIOlUJC\nQoT0zRHc67Ls7GxasGABNWrUSGfQ7d27N/36668WaVEoLS2l+Ph4GhUeTk18fMjL2Zn6eHrS4Iqt\nj6cneTo5URMfHxoVHs5LR1oYB19mswoKCigqKkrj5tWwYUPat2+fXsdXrls7MiyMAituPqGenjSk\nYgv19CQvZ2cK9PGhkWFhFBcXZ9TNR9/a7tmzZ2n8+PHk4uKidVN2c3OjadOm0eXLlx+Z37lz5zRa\nBoYMGSJab2ci0lg7eMeOHaKlW5cdO3aMXn31Va2e+4B6wpNXXnmF/vrrL6uWMSsri5KSkoQvn0lJ\nSbw6kRVx8GU2TaVS0eLFi7Wmpfzqq69q7AhS2ezWyMuLQt3daR1AFx/S7HYRoHUAhbq7UyMvL72b\n3fSp7apUKkpMTKTnnnuuxubHRYsW6d2ztVJcXJxGOvPnzzfo+Id58cUXzfpcua4oKyuj+Ph4euqp\np3R+tgEBARQbG2v0hCesbuPgy2qFxMREjeXuANALL7xAhYWFGvslJyeb1OHkpJ4dTi5evKh107W3\nt6dZs2ZRcXHxIxet79q1K23YsMGkZr73339fSE8ikYhWS33nnXeEdBcuXChKmnVJTk4OLVq0iJo2\nbarzs+3WrRv98MMPtaKPArMeDr6s1rhx4wY98cQTGje69u3b0/nz50UfarERuoda1FTbbd++PaWl\npem1aP2+fftEGb5RVlamMXGHj48PXb161eR0P/vsMyHN6dOnm5xeXZGRkUFvvvmm1mcPgBwcHOiF\nF16glJQUHprD9MLBl9UqxcXF9Oabb2rc+Dw8PGjEoEHUydVV1Gn2qk8ycOHChRpru2fOnDFo0Xqx\n3LlzR6NzT7du3R46Y5Y+1qxZI6Q3duxYkUpaOymVSkpISNBYarHq5uvrSx999JFJHQFZ/cTBl9VK\nq1evFjq3OADUCjDr9HrP9e9PUqlUq7a7atUqGjVqFNnZ2WndmBs2bEgLFiygu3fvmvVaJCcnk4OD\ng5Dvf/7zH5PS27Ztm5BWWFiYSKWsXR48eED//e9/KSgoSGfQ7dixI61atYqH5DCjcfBltdZff/1F\nDRs2JE/A7BPLe1S58drZ2dGoUaNqXLS+ffv2j1y0XmxLly7VKMOqVauMTuvo0aNCOh06dBCxlLbv\n/Pnz9Pbbb2ss51j1cx85ciTt3buXm5aZyTj4slqrqKiIWjVqRHFmDLyV20aAXCtqszWN4TRk0Xqx\nqVQqGjNmjFAWZ2dno+d+zszMFNLx8/MTuaS2R6VS0c6dO2nIkCE618718vKi9957j65cuWLtorI6\nREJEBMZqoQVz5+LEokXYqFBYJL8hAHYCUFb5mZOTE1566SW88847aN++vUXKURO5XI4ePXrg9OnT\nAIDmzZvj6NGj8PHxMSidsrIyODk5AQAkEglKS0vh4OAgenmtTS6X44cffsDSpUtx9uxZrffbtm2L\nKVOm4OWXX4ZMJrNCCVldxsGX1UplZWVo7u+PHXl56GChPE8C6AmgCICvry8mTZqEt956Cw0bNrRQ\nCR7t/Pnz6N69O/Lz8wEAgwYNwtatW2FnZ2dQOg0aNMD9+/cBALdv30ZAQIDoZbWWq1evYvny5Vi5\nciXy8vK03h8yZAimTp2KsLAwSCQSK5SQ1QeG/UUyZiO2bNmCIKXSYoEXADoCCJZI8Oabb+L69euY\nN2+eTQVeAGjdujXWrl0rvN6+fTvmz59vcDpVzysrK0uMolkVEWHfvn0YNWoUgoKCsHjxYo3A6+7u\njilTpuD8+fPYunUrwsPDOfAys+Lgy2ql9StW4I2CAqOPvwDABcDLBh43lQh3L1+Gq6ur0Xmb28iR\nIzFz5kzhdWxsLHbs2GFQGnUl+BYXF2P16tXo3Lkz+vbti99++w0qlUp4//HHH8eSJUuQmZmJJUuW\noFWrVlYsLatPOPiyWiktPR29TTj+LQBPADC0btMbQNrRoybkbBkLFixAv379AKhrfS+++CKuXLmi\n9/G1PfjevHkTs2bNQpMmTfD666/jxIkTGu+Hh4cjISEBf//9N6ZMmQIPDw8rlZTVVxx8Wa2TnZ2N\nQrkcLY08/mcA3gCehbo7qyGCAOQXFuLu3btG5m4ZDg4O+Pnnn9G4cWMAQG5uLiIjI1FcXKzX8bUx\n+BIRUlNT8cILL6B58+b45JNPcO/ePeF9V1dXTJgwARkZGdi1axeee+45g5+FMyYW/s1jtU5GRgY6\nuLgYXGsFgHwAMQC+guGBF1DXlDtIpcjIyDDiaMvy9/fHxo0b4ejoCABIT0/H5MmT9Tq2avC9c+eO\nWconltLSUvz444948skn0atXL/zyyy8oLy8X3m/atCkWLVqEzMxMfPvtt2jXrp0VS8uYGgdfVuvI\n5XIY20gYDeANAI1geJNzJQ8AhYWFRh5tWT179sRXX30lvF61ahVWrlz5yOOq9m621ZpvVlYWYmNj\n0axZM7z88stIS0vTeP/pp59GfHw8Ll26hPfffx/e3t5WKilj2ure4D3GanAcwB4Axype15cxdpMm\nTUJqairWr18PAJg8eTI6d+6Mrl271niMLTc7Hz16FEuXLsXPP/+M0tJSjfecnZ3x4osvYsqUKejU\nqZOVSsjYo3HwZbWOTCZDvhHH7QNwFUDTiteFUE+YcRbAXwakk6dS1apJFyQSCf7v//4PJ0+exKlT\np1BSUoKIiAgcPXoUvr6+Oo+pGnwvXLiArVu3QiaTISQkBP7+/pYquqC8vBybNm3C0qVLkZycrPV+\no0aNMGnSJIwfPx5+fn4WLx9jhuJJNlitk52djeCmTZFTUmJQ07ECQOXgJAKwGOpgvAKA7hCkjQC4\nAnBr0ABPP/00nnrqKYSGhqJjx46wt7c3oDSWd+HCBXTr1k2YgGPAgAH4448/hHKXlZVhy5YtWL9i\nBQ7/9Rdy8/LwOAAviQQeHh7IB3CquBhuMhm6d+mCsRMmYNiwYcIzZXO4f/8+vv/+eyxfvhyZmZla\n7/fo0QNTp05FRESEWcvBmOisNrElY0a4dOkSLVy4kDzs7emiifM1zwXoZQOPuVAxxzOqbR4eHjRo\n0CD69NNP6eDBgxZdVMEQmzdv1ij3nDlzqKioiObHxFAjLy8KdXendQBdBEil4/xVFe+tAyjU3Z0a\neXnR/JgY0Vf3OXnyJL3xxhvk4uKida0dHR1p7NixdPjwYVHzZMySuObLbN6FCxcQFxeHjRs34tgx\n9RNbNwDLAbxi4bKsAzDNwQF5VXrT6uLi4oInn3xSqBn37NkTbm5ulinkI3z00Uf49NNPhddNfX3x\nRFER5igUBs8YdgrAPKkUp3x9sebXX9GzZ0+jy6VUKrF161YsWbIESUlJWu/7+/tjwoQJmDBhAh57\n7DGj82HMFnDwZTbp3Llz2LhxI+Li4nDy5Emd+3TCP52nLCXU3R1TV69GcHAw9u/fjwMHDmD//v24\nffv2Q4+zt7dHly5dhGDcp0+fGp+3mptSqUT//v2xPzERMgArAUSamGYcgMlSKd567z3Mjo01aGrG\nvLw8rF69GsuWLdM5EUiXLl0wdepUjB49Gs7OziaWlDHbwMGX2QQiQkZGBuLi4hAXF1fjOFonJycM\nGDAAI0aMwOzp07HzwQOLLqww2NsbV7OzNVb5ISJcvnxZIxhfunTpkemFhIQIwTg0NBSBgYFmLP0/\niAiTXn8diWvXYj8RxJqd+g6AQTIZ+o0bhy+WLXtkAD537hy+/vprrFu3DnK5XOM9e3t7jBo1ClOm\nTEHv3r15nmVW91itwZvVeyqVio4fP06zZ8+mNm3a6FwjFxVr044YMYJ+/PFHysvLE46fHxNDkVKp\n2dfyrdwipVKaHxOj17ndvHmTfvnlF3rrrbeoY8eOOteJrb61aNGCxo0bRytXrqS///7bbOsCz4uO\npk6urpRrhmuUC1AnmYzmRUfrzFupVNK2bdtowIABOq+Bj48PzZw5k65du2aWc2fMVnDwZRalUqno\n6NGj9MEHH9Djjz9eYyCSSqUUERFBP//8M+Xn5+tMq6ioiIIDA2mjBQLvrwAFBwYa3bEoJyeHEhIS\n6P3336cePXqQg4PDI4Nxw4YNKTIykpYuXUrHjh2j8vJyUy49ERElJydTgFRKd8x4rW4DFCCVUkpK\nipBvfn4+ff3119S6dWud59q+fXv67rvvSC6Xm3yOjNUG3OzMzI6IkJaWJjQp1zTBv0wmw3PPPYfI\nyEgMGjRIr7G0qampGPXssziuUIjWfFrdHQCdpVJs2rPHpA5FVcnlchw+fFhoqk5NTYVCoXjoMZ6e\nnujdu7fQVN2tWzdh0Xt9KBQKdG7dGh9nZiLC1BN4hDgAswMDsWnnTnz//fdYvXq1MMSpkkQiwdCh\nQzF16lT069ePm5ZZvcLBl5mFSqXC4cOHhYB7/fp1nfu5u7tj6NChiIyMxMCBAyGVSg3Oa/6cOdj0\n5ZdIksvhZWrBq8kD0E8mw6jp0xE9b57Iqf+jtLQU6enpwjPjgwcP6lzovSqpVKrVo/phX1gWzJ2L\nE4sWYeMjgrxYhtnZYbtKher9wj08PPD6669j8uTJaNnS2OUxGKvdOPgy0ahUKiQnJyMuLg7x8fG4\nefOmzv08PT0xbNgwREVFITw8HC4uLiblS0R4d/JkJK1bh+1yOQIefYheDO1AJCaVSoXTp08LwfjA\ngQN69aju2rUrQkND8dRTT6FPnz7w8fEBoJ5Ao7m/P3bk5Vm0g1pPAEUVr1u3bo0pU6Zg3LhxNjPs\nijFr4eDLTKJUKnHgwAHExcVh06ZNNQYIb29vjBgxApGRkXj22WdFHzJCRFgQE4NvFi/G1wqFyUNn\nNgJ428ihM+ZARLh06ZJGMNanR3X79u0RGhoKZ2dn/PX99zhQrVexuXUCIOnUCZ9++in69+/PS/gx\nVoGDLzNYeXk59u3bJwTc7Oxsnfv5+vpi5MiRiIyMxDPPPGOR6f9SU1Px76godMzJMWrSiJMA5os0\naYS53bp1CwcOHBAC8qlTp2rc15hJSUoBTIR6MYocqNcy/hTAQAPSWAdgS3g44nftMuAoxuo+Dr4W\nlp2djYyMDGFcozUnqzdEWVkZkpKSsHHjRvz222+4f/++zv38/PwwatQoREVF4emnn9YYD2spCoUC\nXyxciBVLl+KxggJMLi9Hb6iDR/X6KwG4BCAZ6jV+L9vbY8bs2Xh35kyjnj9bU05ODpKTk4VgfPTo\nUWFdW1eov1gEGZBeEYDPAbwK9WIUfwAYA/WsVs30TOMigGd8fHC9ht8XxuorDr5mVnWy+rT0dBTK\n5ejg4iKsR2uNyer1VVpait27dyMuLg6bN29Gbm6uzv0CAgIQERGByMhIhIaG2swCA6WlpQgICEBZ\nbi5UABwdHdHB1VXz2isUcJfJkJ+Xh/yKP4XTp08jJCTEWsUWjVwux6FDh7Bjxw58+8UXKCAyeg3j\nSv8CMBfASD33JwDeTk64kJnJqw0xVpWlxzbVF7Y4Wb0+FAoFbdmyhV555RXy9PSscQxq48aNacqU\nKbR//35Rxp+aw6lTp4Tyenl50a1btygpKYkSEhIoISGBkpKSKDs7m4iIoqKihH1nzZpl5ZKLKzEx\nkUI9PU0ev3sHIBeA/jbwuD6enpSUlGTty8CYTeH1fM0gJSUFrz7/PDrm5GCHHs8dJVA3BwYBeKWg\nQD1Z/aJF6LxqlUWeOyoUCuzcuRNxcXHYsmULCgoKdO7XpEkTREZGIioqCk8++aTNd57ZuXOn8P+w\nsDA89thjNU7I/+KLL2Ljxo0AgA0bNmD+/PlW72QlFrlcLtT2jVUGYCyAfwNobeCxHgAKCwtNLAFj\ndQsHXxGRSD1uOwDYqFAgLjMTI5991iw9buVyObZv3464uDhs3bpVa27dSs2bN0dUVBQiIyPRvXv3\nWhWQdlXp5DNgwICH7jto0CB4enriwYMHuHLlCg4fPowePXqYu4i1ggrAywBcACyzclkYqys4+IqE\nKsearl0r2mxLkQD6KBQY9OWXyL1/3+SxpoWFhfjjjz8QFxeHbdu2oaioSOd+QUFBQsDt0qVLrQq4\nlRQKBfbv3y+87t+//0P3d3Z2RkREBFavXg0A+Omnn+pM8JXJZMh/9G46EYDXAdwFsA2AMU/z8wEe\n18tYddZu964rrDlZ/cM8ePCA1q9fTyNGjNC5MHnl1rp1a5o1axYdP37cbBP6W9KOHTuEc2vTpo1e\nxwc6xQAAAB+8SURBVOzevVtjXuWysjIzl9IysrKyyMvZWWd/g0dtbwLUA6BCI393VQB5OjkJz9YZ\nY2ocfEVgrcnqa5Kbm0vr1q2joUOHkpOTU40Bt127dhQTE0OnTp2qEwG3qunTpwvnOXXqVL2OKS8v\np4CAAOG4Xbt2mbmUlhPo40MXDfyduwqQBCApQG5Vtg0GpHEBoCY+PtY+fcZsDjc7m0ihUOC10aOx\nzIwT+wNAAICvFQq8+vzzOHb+vNYY1JycHPz++++Ii4vDn3/+ibKyMp3pdOzYEZGRkYiIiEC7du3M\nWGLrqtrZ6lHPeyvZ29tj9OjRWLJkCQB103N4eLhZymdp3bt0QfLu3QaN820G9fNeUyQD6N61q4mp\nMFYHWTv613bWXFP27t279P3331P//v0fukRd586d6eOPP6a///7buhfLQm7cuCGcu5OTExUWFup9\n7OHDh4VjPTw8SKFQmLGklrN8+XLq7uBgsd/Tyq2PuzvFx8db+/QZszkcfE1QWlpKjby86KQFb2Yn\nAGrg6kr9+vUje3v7GgNut27daOHChXTx4kVrXyaLW716tXAdnn32WYOOValUFBQUJBxf2wPHlStX\n6I033iB7e3uSAhb/XW3s7V1nnp0zJibbHqhp47Zs2YIgpdJiq8QAQEcAjYuKkJSUBKVSqfFejx49\nsHjxYly5cgVpaWmYMWMGgoIMaWisG4xpcq4kkUjw4osvCq83bNggWrks6dq1axg/fjxatWqFlStX\nQqlUohTABxYsw3ypFBOmTLHKFKOM2TxrR//abGRYGK0zokZwBaBBAHkDFADQZIDKDTh+LdQdXwBQ\n79696b///S9dv37d2pfDJpSXl5OPj49Qcz1+/LjBaZw5c0Y43tnZmR48eGCGkprHtWvX6M033yRH\nR0et1pDQ0FBq7udHGy1Q6/0VoODAQKvM0sZYbcDB1wTG9CClisD7b4BKoJ6yrwNASw04/gJAfq6u\nlJmZae1LYHOOHDkiBJuAgACje3F36tRJSGft2rUil1J8N27coIkTJ+oMuk899ZQwvWNKSopN9cxn\nrL7iZmcjZWdno1AuR0sjjr0KYDQAJwANoV6iLcOA44MAlJaXw8nJyYjc67aqTc79+/c3eoKQ2tL0\nfPPmTUyePBlBQUH49ttvNXq59+nTB3v27MHevXvRt29fAEDPnj0x6b33MFAmQ54ZypMHYJBMhknv\nvWfTyzEyZm0cfI2UkZGBDi4uRq0SMw3AzwAUAG4C2A5gkAHHSwB0kEqRkWFIyK4fqgdfY40ePVr4\n/549e5CVlWVSucR269YtTJkyBUFBQVi+fDlKS0uF93r16oU///wT+/fvxzPPPKP1BWR2bCz6jRuH\nfjIZ7ohYpjsA+slk6DduHGbHxoqYMmN1DwdfI5kyWX0ogNNQTzjfBEB3AMMNTIMnq9eWn5+P1NRU\n4bUpY3SbNm2K0NBQAIBSqRQWXbC227dvY9q0aQgKCsLXX3+NkpIS4b0ePXpg586dOHjwIMLCwmqs\n9UskEnyxbBnaDhqEYABxIpRrI4BOUilGTZ9u8jSojNUHHHwtTAV1M3ME1IuV3wOQA2CmNQtVRyQm\nJgo9wLt06QJ/f3+T0rOlpuesrCxMnz4dLVu2xJIlS1BcXCy898QTT2D79u1ISUnRu6k9JycHiQcO\nIB/AOADD7e1xyohynQQQJZUiOjAQv+3Zg+h58zjwMqYHDr5GMnay+hwANwBMBuAIwAfqZdq2GZgO\nT1avTawm50qRkZHCMJnU1FRcuXLF5DQNlZ2djffeew8tWrTAV199pRF0u3Xrhj/++AOHDh3CwIED\nDQp606ZNE5rSPR97DB3efReDvL0R6u6OdQAuQt1bqzqqeG8dgE4ABnl54V8zZuDY+fP8jJcxQ1i7\nx1dtZcpk9S0BWlgxvCgXoBEAjTXgeJ6sXreWLVsKPXzFWrx98ODBQpqffPKJKGnqIzs7m95//31y\ndXXV6r3ctWtXSkhIMLond0JCgkZ6CQkJRKSeNCY+Pp5GhYdTEx8f8nJ2pj6enjS4Yuvj6UmeTk7k\nYW8vDHVbtWqVmKfNWL3BwdcExg41Og5QX6jH+TYAaDRA2QYONeLJ6jVduHBBCCZubm5UUlIiSro/\n/vijkG779u1FSfNh7t69SzNmzNAZdDt37kxbtmwxaRGM3NxcatSokZDm2LFja9w3KyuLkpKSKCEh\ngRISEigpKYmys7Np4cKFwvHDhw83uiyM1WccfE1g7CQbpm5rARph4LSJdd2yZcuEgDB06FDR0i0o\nKCCpVCqkffLkSdHSrurevXv0wQcfkEwm0wq6nTp1os2bN4uy8tTrr78upOvv70/37t0zOI3z588L\nabi4uFBBQYHJ5WKsvuFnviYYO2ECVrq7WzzfrwDsS0/HZ599htzcXIvnb4t27dol/F+M572V3Nzc\nMHz4P33Rf/rpJ9HSBtQdn2bNmoXmzZvjs88+g1wuF97r2LEjNm3ahKNHj2L48OEmd2TatWsXVq1a\nJbz+5ptv4Ovra3A6rVq1QocO6klVi4uLsWPHDpPKxVi9ZO3oX5tZa2EF1yq1IldXV5o8eTJduHDB\n2pfDakpKSsjNzU24JufPnxc1/d9//11Iu1mzZqLUQHNycmj27Nnk7u6uVdNt3749xcXFkVKpFKH0\navn5+dS0aVMhj6ioKJPSi4mJEdIaM2aMSKVkrP7g4GsiSy8pONzBgTx1NE1KJBIaMWIE7d+/X5Tg\nUJvs3btXuA4tWrQQ/fxLSkrI29tbyCM5OdnotHJzc2nOnDnk4eGh9RmGhITQr7/+KmrQrTRx4kQh\nH19fX8rKyjIpvRMnTgjpubu7U3FxsUglZax+4OBroqKiIgoODLToZPW5ubm0du1a6tixo9YNHFAv\nJ7hhwwYqLS219uWxiA8//FA49zfffNMsefznP/8R8njrrbcMPj4vL4/mzp1Lnp6eWp9X27Zt6eef\nfzZL0CUiSkpK0shvw4YNJqdZfenFP/74Q4SSMlZ/cPAVgbUmq1epVLR7926N4TBVt8DAQFq0aBHl\n5uZa8eqYX9euXYVz3rRpk1nySExMFPLw8/PTe43aBw8e0Lx588jLy0vr82nTpg1t2LCBysvLzVJm\nIqLCwkKNIVjDhg0TrWXg/fffF9J9/fXXRUmTsfqCg69I5kVHUyeZjHLNEHhzAeokk9G86Oga8z9z\n5gyNHz+eXFxctG7ybm5uNHXqVLp8+bIFr4hlZGdnk0QiIQBkb29PeXl5ZsmnvLxcY4jOjh07Hrr/\ngwcPaMGCBRrN1ZVbcHAwrV+/3qxBt9K0adOEfL28vOjmzZuipZ2amiqk3aBBA72/kDDGOPiKRqVS\n0TuTJlEnmYxui1zj7SST0TuTJulVY8nOzqbY2Fjy9/fXuunb2dlRRESESc8sbc369euF8+vdu7dZ\n85o+fbqQ1yuvvKJzn/z8fPrkk0801hSu3Fq1akU//PCDRYIuEdHBgweFLyYAaM2aNaKmr1QqNb6Q\niDWxCWP1AQdfEalUKpoXHU0BUqkoz4B/BaihVErzoqMNbipUKBS06v/bu/eoqK57D+Df4SUDjAgT\nEOWhCDGkQGKSmpSKjQ9cTdKYXqnaxphyzTK5tmpSia+bBFFIVi0aNEKiaA3S2zRLEbVqb2oSFt50\n+SoajUhvbgo+8TWCD2AY3vv+MXDKyETmuWcg389as4bX2XvP/MF3zjm/vffWrSI+Pt7sJeknnnhC\nbN++vd+fraSlpSmvKSsry6l9HT9+XOlLo9GYbBTf0NAgVq9eLbRaba/3OiYmRhQVFUl9r5uamsTo\n0aOVMTz11FNOKcSbP3++0sfChQsd3j7RQMXwdYLDhw+L0eHhYrpabdM0pK8AMV2tFg9ERNi9IXln\nZ6c4cOCA+PGPf2w2hEeMGCFyc3PFnTt3HPTq5ens7BTDhg1TXsuxY8ec3t/999+v9FdcXCwaGxtF\nTk6OuO+++3q9t6NGjRKFhYUu+YCzdOlSkw8KFy9edEo/paWlSj/h4eFOKxojGmgYvk7S1NQksjMz\nRXhQkEjWaMQ2GJeFNLcWdGfX77YBIlmjEeFBQSI7M9PkzMoRKioqxEsvvSR8fHx6BYVGoxHp6eni\n/PnzDu3TmXpOdwkODpZyObfn/NaEhAQREhLS672Mjo4WW7dudVm1+d///nfh4eGhjKegoMBpfbW1\ntZlcYnf2ByCigYLh62SWLlYfGRwsUqdMESUlJU7/p33t2jWxYsUKs2drnp6eYubMmeLo0aNOHYMj\nrFmzRhn3zJkzpfR58uRJs1cQuq8ibNmyxaVTvJqbm01uNUyaNMnp877nzJmj9Lds2TKn9kU0UDB8\nJfu2xepdoampSWzevFnExcWZDZNx48aJkpISaQVC1kpJSVHG6uzddZqamsS6detEWFhYr/cpKipK\nFBQUOGwzB3tkZGQo4/Lz85NS4d5zl6TY2Njv3CIvRLZQCSEE6Duts7MTBw4cQG5uLj7//PNev4+O\njsZvfvMbzJkzBxoXrGWt0+lQWVmprHvs7++P6OhoxMXFoaWlBQBw6dIlREREOLzv5uZmbN68GatX\nr8bVq1d7/T4uLg5fffUVfHx8HN63tU6dOoWxY8eivb0dALBhwwYsXLjQ6f02NzcjJCQEjY2NAICK\nigokJCQ4vV+ifs3V6U/u5dSpUyItLU14e3v3OsMLDAwUS5YscVrxTrfW1laxc+dOMS0lRUR0Xaof\nHxgoftL1GB8YKAZ7ews/QATAuJiIoy/1GgwGkZeXZzKVpvsRFhamTOHx8PAQV69edWjftmhtbRVj\nxoxRxpicnCy1+OnnP/+50veqVauk9UvUXzF8yawrV66IN9980+x8VU9PT/H888+L8vJyh/bZXaQ2\nfMgQMV6jEUWAqLpHkVoVIIoA8bi3txg+ZIhDitSam5vF+++/L8LDw3u97uHDh4v8/HzR3NwsJkyY\noPz8vffec9A7YLvs7GxlPL6+vg7fXKIv27dvV/p/+OGHpfZN1B8xfOme9Hq92Lhxo8mc0Z6PH/3o\nR2LPnj123xc+dOiQXdOzTsO+6VktLS1i48aNIjIystdrHDZsmNiwYYMwGAzK3xcUFCi/f+KJJ+x6\n7fY6c+aMyZWKtWvXSh9DfX29GDRokDKGqqoq6WMg6k8YvmSRjo4OsXfvXpMzvp6P2NhYkZ+fLxob\nG61q19ELkxTDuoVJWlpaREFBgcl2ez0vL69fv97s2XRtba1J4LkqbNra2sTYsWNNPgi4qkBu6tSp\nyjjWrFnjkjEQ9RcMX7LaiRMnxOzZs4WXl1evwAoKChLLly8XNTU1fbajLMnp5+fQTSksWZKztbVV\nbNmyRYwYMaLXaxg6dKjIzc3t8xJ2z7DJzs626b20V05OjjIGHx8fUVlZ6ZJxCCFEYWGhMpakpCSX\njYOoP2D4ks1qamrE8uXLze7Y4+XlJV588UXx5ZdffuvxWRkZYoyfn9TNKFpbW8XWrVtFdHR0rzGH\nhISItWvXCr1eb9Hr//jjj5VjH3zwQelTbL7++muTS73vvPOO1P7vVltbKzw9PZXxXLlyxaXjIXJn\nDF+yW0NDg8jLyzPZ37XnY+LEiWLfvn0m1beHDh2Sug1jW1ub+PDDD0221+t+3HfffSInJ8fqS+aN\njY3Cz89PaefUqVOOfmu/VXt7u/jhD3+o9P3oo4+6xf7NkydPVsb0wQcfuHo4RG6L4UsO097eLnbv\n3i3Gjx9vNoRHjx4tNm7cKGpra8UDERFipxODt/tRDIiIoCCzZ7parVasXr1aNDQ02PyaZ82apbS3\ndOlSB76b97Z+/XqTqwwyg/9e8vPzlXGlpKS4ejhEbouLbJBTlJeXY926ddixYwc6OjpMfhfg64vJ\n7e3Y07UYhLP9BMABAN2jCA4OxpIlS7BgwQIEBATY1fZf/vIXPPvsswCAqKgonDt3Dh4eHna12Zfq\n6mokJibCYDAAADIzM7Fy5Uqn9mmpy5cvK4udeHp6QqfTITg42MWjInI/DF9yqkuXLiEvLw+bN2/G\nnTt3AABqAMcAJEoaw2kASQB8hgzBkiVLsHDhQoet1NXW1oZhw4ahrq4OAPC3v/0NycnJDmnbnM7O\nTkyePBkHDx4EACQmJuL48eNuscJWt6SkJBw9ehQAsG3bNqSlpbl4RETux7kf0ek7LzIyEjk5Obh0\n6RLWr1+PkJAQPAB5wQsADwGI9/FBXl4e3njjDYcukent7Y3p06cr3//pT39yWNvmFBQUKMHr6emJ\nwsJCtwpeAEhNTVW+3rVrlwtHQuS+eOZLUk1LScG00lL80srjJsB4tuzV9X0EgP+14vgiAHunTEHJ\np59a2XPfvvjiCzz55JMAAK1Wi6tXr8Lb29vh/Vy4cAEJCQnKGsrLly/Hb3/7W4f3Y6+qqircf//9\nAIBBgwahtrbW7sv7RAMNz3xJquMnT2KcDcepALwPoKHrYU3wAsA4AOUnTtjQc9+Sk5OV+5x1dXVm\nN6ewlxACL7/8shK8cXFxyMzMdHg/jhAbG4uHHnoIANDS0oJPPvnExSMicj8MX5JGp9OhUa/HKBuP\nt+cSTQyA+sZG3Lhxw45WzPPw8MAvfvEL5XtnXHouLCzEZ599BgBQqVT48MMP4evr6/B+HIWXnonu\njeFL0lRWViLR1xcqG4//TwAhAJIB/I+Vx6oAJKrVqKystLH3e5s1a5by9e7du9HU1OSwti9fvoz0\n9HTl+0WLFiEpKclh7TtDz/Ddv38/mpubXTgaIvfD8CVp9Ho9Btt47O8AnANwBcArAKYCOGtlG4MB\n5bKto40ZMwZxcXEAjK9z//79DmlXCIF58+YpleKxsbHIzs52SNvOlJCQgNjYWADG97y0tBQ6nQ5l\nZWXYv38/9u/fj7KyMuh0OhePlMg1GL7ULzwOwB+AN4BfwngP97+tbKO9vR23bt2CM2oMVSqVydmv\noy49f/TRRyZBvnXrVvj5+TmkbWdSqVT46U9/CgAIAPBiaioeiIpC5rRp2DR7NjbNno3MadPwQFQU\nIrVapE6ZgpKSErS1tbl24ESSsNqZpCkrK0PmtGn4ousszh5Pw7h4xgIrjkkEcAaAv78/Ro0ahdjY\nWMTExJg8R0ZGwtPT06Yx9azy9fb2xvXr1xEUFGRTWwBw7do1fO9738OtW7cAAPPnz0d+fr7N7cli\nMBjw7u9+h/zcXAxraMAiGD8sjQJ63XIQMF7BOATg9xoNqj098avXXsPry5ZBrVZLHjmRPAxfkkan\n0+GBqCjcbGmx6r7vHQBHATwJ41Sj7QD+A8ApALEWtiEA+AHo686jt7c3oqOje4VyTEwMoqOjMWjQ\noHse//jjj6O8vBwAsGXLFsydO9fCEd41XiEwffp0pVhpxIgROHPmjNtP2Tl8+DDmzJyJh27exAqD\nwer53BUAstRqVGi1KNyxw+3vbRPZiuFLUkVqtTh48yZirDimFsAzAL4G4AngQQDZACZb0UYVgMc8\nPaEKCFDun1pLpVIhMjJSCeOewRwTEwONRoP169dj0aJFAIBJkyahtLTUpr6Ki4sxc+ZM5fvPPvsM\nKSkpNrUlgxACb2dm4oO1a5FnMGB634fc004AC9RqzF+8GG+tWgWVytYyPSL3xPAlqVKnTMG/ff65\n1Yts2Kt7kY2dBw7g5s2bqKqqQnV1tfLc/fX169dt7iM0NBRRUVE4fvy48rN9+/bhBz/4AbRarcUB\ncuPGDcTHxyvTol5++WVs3rzZ5nE5mxACry9YgLJt2/DXpiYMdVC71wA87e+PiWlpeDc/nwFMAwrD\nl6QqKSnBe3Pm4IuGBqn9jtdosGjbNpMpMOY0NDTg7NmzJsHc/Xzx4kWbi7U0Gg3CwsIwdOhQhIWF\nYeTIkRg3bhy+//3vY/jw4SabMcyaNQsff/wxACAiIgJnzpxBYGCgTf3KkL1iBXa9+y7KmpowxMFt\n3wYw0d8fqenpyMjKcnDrRK7D8CWp2traMDI0FH+9fVvqxgrPBAXhvE4HLy+vPv/+27S0tOD8+fNm\nz5rPnj1rtlI3AEAnjPecYwF0R+gdGC+FqwB4qVQYHB6OMWPGwMPDA3v37lWO//Of/4znnnvO5jE7\n2+HDh/GzlBScMhgcdsZ7t2sAHlGrsau0lPeAacBg+JJ0b69cia9yclDctSWes81Qq/Hw0qV4y4nb\n7nV0dKCmpgaVlZV4/733cPDTTzEasLjSdx2A/wPQin9tfQgYN08YOXKk2QKwUaNGubQi2GAw4JHR\no/FOTQ1+5uS+dgJ4KyICJ7/5hlXQNCAwfEm67n/ab9fU2F2Y05diABmS/mk7otJ3OYCDACxdHys8\nPNxsMMfExGDIEEdfBDY1ED9EEcnC8CWXOHLkCFInTx4QlyudUek7V6WCh78/btmxIpdWqzUbyrGx\nsQgNDbWrgMmVtw/OXb/ulF2jiGSy/QYYkR2SkpLw68WL8VRuLsr0eqcU6jzt749fp6c7PXi7K30d\n9UFiOoBkIfC0EHjhlVfwyoIFOHv2bK97zRcuXEBHR8e3tlNXV4e6ujocO3as1+8CAgJ6TZfqfo6I\niOhzoZG9e/cipqND+r7M0e3t2LdvX5+Fc0Tujme+5DJKcBUV4RO9HmEOalfmFBVXVvq2tbXhwoUL\nZiuzq6ur0dLSYlO/Pj4+iI6ONrsC2MiRI+Hj42PTlLEAmN73NgD4NYANVrThzH2ZiWRi+JJLOfqS\nbTGAhZIWZ3DnSt/Ozk5cuXKlVyh3P9fX19s0Hg8PD0RGRuL25cs40d5u1WIpPekBhAH4BMZdqixV\nBWBScDAu1tXZ2DORe2D4kls4cuQI/n3GDJuLlU4DyJa4LGF/rvQVQqC2ttZkcZGez5bsNKSGMUBt\n/WhTBOMqZVVWHicABPn44J81NQgJCbGxdyLXY/iS2+hekH/Thg2Ibm/H3IYGjAMQA/PTdKrxrwX5\nz3l5Yd6rr0pbkH8gV/rW19ebvcdcVVWFmpoaCCGQCOMHHltNAjABwAobjh0fGIjsPXswYcIEO0ZA\n5FoMX3I7bW1t2LdvHz7atAnlJ06gQa9Hgq+vshdwPYAKgwGDAwIw9rHH8MK8eZg6daq0CtjvcqVv\nc3MzCgsLsWfxYhxosnRClKkLMH6gqgYwwobjfxIYiF/98Y949tlnbeqfyB2w2pncjre3N1JTU5WK\nVp1Oh3/84x9o7Jp2ExAQgPj4eJdddvwuV/r6+voiMjLSrg8A/wVgPGwLXqKBguFLbi80NBShoaGu\nHobio02bMLePtanzAWyDcf/g5wEUdv38KIAMAF/CuEPTBBirfS2p9J7b0ICPNm1y+TQbf39/2Fau\nZfQHAG/YcXw94PZbKxL1xaPvPyGinsq//BLj+vibcBhD9qW7fn4bwDwYL71eAKABMMfCfscBKD9x\nwoqROkd8fDwqmpthy/2qwwCuAJhhY98CxlsO8fHxNrZA5B545ktkBZ1Oh0a9HqP6+LtpXc/HAdT0\n+PlTd/3dfBjPfi0RA6C+sRE3btxwaaVvaGgoAvz9cbalxeqpRn8A8DMA/jb2XQ1gcEAAK52p3+OZ\nL5EVKisrkejra/EUm77ODr8AkGBhWyoAiWo1KisrLTzCecY++igO2XDcJhinGdnqEICxjz1mRwtE\n7oHhS2QFvV6vVF1b4l4hfRrGua5rrGhvMKAUnrnSC/Pm4fcajfR+f6/R4IV586T3S+RoDF8iJ/q2\nM98qAM/AWGzV1/1jd/Tcc8+h2tMTFRL7PA3gnJeXW+9vTGQphi+RFayt9DV35nsBwBQYF5h4wcr+\n3aXS19vbG7967TVkSdxbN1utxrxXX4WXF0tVqP9j+BJZwdJK3w4AzQDau75u6Xq+DOPqTgsAvGJl\n3+5W6fv6smWo0GqxU0JfxQAqtFq8vmyZhN6InI8rXBFZKVKrxcGbN+9Z6bsSwN37EGXCeCa8EqbV\nvirAorNpd9xUYCDty0wkE898iaxkSaXvSgCddz0yYbzU3AmgocfD0svY7ljpq+zL7O+P205oX9mX\nefFiBi8NKAxfIiux0tfUW6tWYWJaGib6++OaA9u9BuN+xhPT0vDWqlUObJnI9Ri+RFZipa8plUqF\nd/PzkZqejkfUaofcAy4GMEatRmp6Ot7Nz3fqvsxErsDwJbISK317U6lUyMjKwq7SUrwZHo4ZarVN\nH05Ow7h9YkZEBHaXliIjK4vBSwMSC66IbGAwGPDI6NF4u6YG053cVzGAjIgInPzmGyl7FdurP+3L\nTOQqDF8iG7HS997cfV9mIldi+BLZIXvFCuzKzUWZXo8hDm77NowFR6np6cjIunviUv/jbvsyE7kS\nw5fIDkIIvL5gAcqKivCJXm/RvryWuAbjFJuJaWksOCIagFhwRWQHVvoSkS145kvkIEeOHMG/z5iB\nh27exAqDAYlWHn8axqrmCq0WhTt29Lt7vERkOZ75EjlIUlISTv3zn3h46VI8HRSE8RoNimBcFtLc\nJ1zR9bsiAOM1GjwTFISHly7FyW++YfASDXA88yVyAlb6EtG9MHyJJGClLxH1xPAlIiKSjPd8iYiI\nJGP4EhERScbwJSIikozhS0REJBnDl4iISDKGLxERkWQMXyIiIskYvkRERJIxfImIiCRj+BIREUnG\n8CUiIpKM4UtERCQZw5eIiEgyhi8REZFkDF8iIiLJGL5ERESSMXyJiIgkY/gSERFJxvAlIiKSjOFL\nREQkGcOXiIhIMoYvERGRZAxfIiIiyRi+REREkjF8iYiIJGP4EhERScbwJSIikozhS0REJBnDl4iI\nSDKGLxERkWQMXyIiIskYvkRERJIxfImIiCRj+BIREUnG8CUiIpKM4UtERCQZw5eIiEgyhi8REZFk\nDF8iIiLJGL5ERESSMXyJiIgkY/gSERFJxvAlIiKSjOFLREQk2f8DwBvrAvVA8CMAAAAASUVORK5C\nYII=\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"nx.draw(g, with_labels=True, node_size=1000, width=3)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Next, we let a random walker run through the network. At each step, the walker chooses one out-link at random. Overall, we generate 100 trails with a length of 5 for each one."
]
},
{
"cell_type": "code",
"execution_count": 43,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"[[0, 4, 5, 2, 5], [12, 4, 0, 6, 1], [6, 10, 6, 0, 2], [3, 0, 4, 10, 4], [8, 5, 7, 2, 12], [11, 4, 12, 2, 4], [6, 0, 4, 0, 2], [6, 0, 3, 2, 3], [12, 2, 3, 9, 3], [8, 5, 2, 7, 5]]\n"
]
}
],
"source": [
"import numpy as np\n",
"from random import choice\n",
"#let us create 100 individual trails\n",
"i = 100\n",
"trails = []\n",
"while(i>0):\n",
" #pick random vertex of G\n",
" v = choice(g.nodes())\n",
" trail = []\n",
" trail.append(v)\n",
" #let us try to produce trails with length 5\n",
" x=4\n",
" while x>0:\n",
" #pick random neighbor node\n",
" v = choice(g.neighbors(v))\n",
" trail.append(v)\n",
" x -= 1\n",
"\n",
" i-=1\n",
" trails.append(trail)\n",
"\n",
"#show some trails\n",
"print trails[:10]"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Next, we visualize one random walk on the network which ends in one human navigation trail out of the set of 100 trails."
]
},
{
"cell_type": "code",
"execution_count": 44,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAd8AAAFBCAYAAAA2bKVrAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzs3XlcVNX7wPHPwLDMgPu+L7iisogbLrmUYoKalrjvlpZW\nlpZl9c0yy6VfabmUlam5pmkqmvuSipIiIO4iuIv7AswwzHJ/f4xeRUVmYGYY5LxfL151h3vPOSDw\nzD33nOdRSJIkIQiCIAiCw7jk9QAEQRAEoaARwVcQBEEQHEwEX0EQBEFwMBF8BUEQBMHBRPAVBEEQ\nBAcTwVcQBEEQHEwEX0EQBEFwMBF8BUEQBMHBRPAVBEEQBAcTwVcQBEEQHEwEX0EQBEFwMBF8BUEQ\nBMHBRPAVBEEQBAcTwVcQBEEQHEwEX0EQBEFwMBF8BUEQBMHBRPAVBEEQBAcTwVcQBEEQHEwEX0EQ\nBEFwMBF8BUEQBMHBRPAVBEEQBAcTwVcQBEEQHEwEX0EQBEFwMBF8BUEQBMHBRPAVBEEQBAcTwVcQ\nBEEQHEwEX0EQBEFwMBF8BUEQBMHBRPAVBEEQBAcTwVcQBEEQHEwEX0EQBEFwMBF8BUEQBMHBRPAV\nBEEQBAcTwVcQBEEQHEwEX0EQBEFwMGVeD0AQhNxJT0/n8OHDnDt3Dp1Oh1KppHjx4gQGBlKqVKm8\nHp4gCE8hgq8g5EPnz59n1pxZrFyzkvOJ51GXUSMVl5BcJRQmBQqNgvQL6RQqUoiWLVsy+q3RtG7d\nGoVCkddDFwQBUEiSJOX1IARBsEx8fDzvjXuPvXv2IjWQ0NXVQVnA7Sknm4DboEhQ4BXnRXF1cSZ8\nMoFBAweJICwIeUwEX0HIB/R6PZO+mcTU76aS3jwdKVACdysakICz4LXDi4DqASxZsITKlSvbabSC\nIGRHBF9BcHLXrl2jXcd2JKUnoemogSK5aMwIykglHtEerFy6ko4dO9psnIIgWE4EX0FwYlevXqVx\n88YkV05G31oPtpotPg+qVSqWzl9K165dbdSoIAiWEsFXEJxUWloa/o39OVfuHIYXDLbv4DKolqvY\nuHYjL7zwgu3bFwQhS2KfryA4qfc/eJ9LqksYWtkh8AKUB22oltd6v8a9e/fs04cgCE8lgq8gOKFd\nu3axaPki0tun226q+WlqQUqFFN55/x07diIIwuPEtLMgOBlJkqhWqxrnGp2DOg7oMB3Uv6jZvXk3\nDRs2dECHgiCIO19BcDI7duzgZvpNqO2gDj1BF6jj/2b8n4M6FARB3PkKgpN5ucvLbDRuhCYO7DQV\nPH/y5PL5yxQrVsyBHQtCwSTufAXBiWi1WrZt2QZ+OWwgHpgJTAJmAOcsvM4blD5K1q5dm8OOBUGw\nhgi+guBE4uLiUJVVgWcOLj4DbAVeAT4BhgBW3MSmlk5l7/69OehYEARricIKguBEoqOj0ZfW5+zi\nHUAboOL940JWXl8e9v4ngq8gOIIIvoLgRA4dPoS2uNb6C03AFSAN+AEwYF4p3Z6nF114mtKQdDrJ\n+r4FQbCamHYWBCeSkppiXcGEB1IBI3AM83TzCMzB+F8r2nCHDG1GDjoXBMFaIvgKgjPJaUKNB3e3\nTQFvQA0EA6et7N5FlBoUBEcQ086CkMe0Wi1HjhwhNjaWo/FHzfV5raUCCudyIDpw98zJbbcgCNYS\nwVcQHCg5OZm4uDhiY2OJjY0lLi6OkydPYjKZHp6Uw/VWBAJRQA3Mc1r7sS5RRzJoM7S0adOG5s2b\n06JFC4KDgylevHgOByQIQlZEkg1BsAODwcCpU6fkAPvgv1evXs3+4sLA+zno1AhsxLzXVwnUw7zg\nytK32Lvuf5gyv1y3bl05GDdv3pxatWqhUIjpaUHIDRF8BSGX7t27x+HDhzMF2iNHjpCenm7R9QqF\nglq1auHv70/9+vX5ctKXGN4xgJedB/74OH5XIJ3L/s9ByZIlad68uRyQg4KCUKlUDhihIDw/RPAV\nCpTbt29z6NAhEhIS0Gq1uLq6UqxYMfz9/albty5KZda3iZIkcf78+Ux3srGxsSQmJlrcv5eXF35+\nfvj7+xMQEEBAQAD169fHy+thpO3Ztycrr6/E1ML0jJZs7A6o56mJizZ/TXv37iUyMpJDhw5hMDy7\npKGbmxtBQUGZ7o7Lls3Jg2tBKDhE8H0OmUwmzpw5Q3R0NIeiorh+6RJ6nQ4PlYpKtWoR1LgxQUFB\nlC9fPq+H6hAJCQn8NGMGf69YwdVbtwhQqahjMKAyGDApFNxwcyNGoeCSTkejevUYMno0Xbt2JTEx\n8Ynns3fu3LG43woVKhAQEJAp0Pr4+ODi8uxNBv/99x/tOrcjbUSaw/YjKHcoGVZ/GHNmzsn0ukaj\n4eDBg3IwjoyM5NatW9m2V716dTkYt2jRAl9fX1xdXe01fEHId0TwfY5cunSJX+bM4ZfZs1FmZBDk\n4kJQairlJAk3QAckuroS7eVFdEYG5cuW5c0PPqBf//4UKmRtOiTnd/jwYT586y0ORUcz2Gikv15P\nXSCrEHAPc5Ko/3Nx4YDJhAFzrorsKJVKfH195SDr7++Pv78/JUuWzPHYGwQ14Gjlo0gBDvj1TAHV\nrypi/4ulVq1azzzVZDJx6tQpORjv3buXkydPZttF4cKFCQ4OlgNykyZNnsufOUGwlAi+z4E7d+4w\nduRIVq1aRW9J4k2djvrZXCMB24HZXl7sMJn44OOP+eDjj5857Zpf6PV6Jk+cyI/ffsuX6ekMkiSr\nUyUnAG9jzlGheeT1okWLZrqb9ff3x9fXFw8PD5uNH8w5noNbB6Mdqs39FqJnkUC9Ss3I0JFM/WZq\njpq4ceMG+/btkwPygQMHsn3e7eLigr+/f6ap6sqVKxeohVxarZajR49y8+ZNDAYDnp6eVKtWjWrV\nqhWo70NBJYJvPrdhwwaG9+9Pl7Q0vtbpKJKDNpKA4V5e3K5cmfkrVlCvXj1bD9Nhbty4QVjbthRN\nTORXjUZOc5wTEvAn8JZSSff+/flswgQqVarksD+Mn33+Gd+t+A5ND439pp9jodrxahyPO26zNxAZ\nGRnExMRkujtOTk7O9roKFSrIgbhFixb4+/vj5mZpbsz8ISYmhl9nzmTvjh2cunCBWmo1pRUKlIAW\nSNDrSQMa+voS1rs3AwcPFiUen1Mi+OZTkiQxeeJEfpoyhd81Gtrltj3gV4WC8SoV8//8k9DQUFsM\n0+4kSeLKlSvExsYSGRnJ3OnT6ZeWxv+R82RRjzsHtFerGfLRR3z02Wc2ajV7er2elu1aEpcRh66j\nzvYBOAFYDSvXreTVtq/auPGHJEni7Nmz7N27Vw7I8fHxZPenR61W06RJk0x7jvNrIPr777+Z8umn\nXEpK4g2djhCjkQY8vXjVVeAAsFStZoPJxKvdu/PZ119TpUoVxw5asCsRfPOpif/7H8v+7//YotFg\ny2VTUUAXlYp5K1Y4XQDW6/WcOHHiidXGN27cAMwZFYcD39mh78tAK7WaT6ZPZ8jrr9uhh6dLSUmh\n1YutOGo8iqGTwXZpcY4BEUAvKFWnFDsH7cS3lK+NGs/e3bt3iYqKkoPx/v37SU1NzfY6X1/fTAu5\natSo4dRTtNeuXWPk4MEc2bWLb9LSCMO6f8KrwCxXV+Z4evLVtGm8MWKEU3+9guVE8M2HFs6fz8SR\nI9mt0eQoE2F2ooDOajVb9+3Dzy+nVd1z586dO8TFxWUKtEeOHCEj4+mJ/92A1sBmbHfH+7jjmAPw\nf/HxVK9e3U69PCkqMYrgsGCkW5K5Vm+5XDSWDh7bPfA864kh3EBayTQAyniVYdegXdQuaU1KLNsx\nGAwcOXIk01T1uXPnsr2uVKlST+w59vTMSTFk29u1axc9u3RhYHo6X2Rk5KhE8wNHgUFeXpRs2JA/\n168Xi9WeAyL45jMXL14ksE4dtqal4W/HfuYpFMysUYOoo0ft+tztwZTk45mgzp49a3EbarUat/R0\nTphMdnkz8qhprq5saNiQbfv3Z7tlyBa0ei1Nfm3CkatH4DC4bHHBNdAVfSM9Vj3g1wNHQb1HTfew\n7sycPpNj947RYVEHUjPMd5zlC5Vn16Bd1Chewy5fi7UuXbokB+LIyEhiYmKy3XPs7u7+xJ7jMmXK\nOGjED23atIl+3bqxTKvlRRu1aQBGenoSU706WyIjKVIkJys8BGchgm8+IkkSoW3a0DQyks+z+SOU\n676AULWaZu+/z/8mTrRJm+np6Rw9ejTTvtm4uDju3btncRuVK1fOtG/W39+fQa++yutxcQywySif\nzQg08/Zm3O+/89prr9m9v3f+eYcf//sRAJVSxT9d/mHJnCUsWrwIRRUFabXToDxQjCdv+bXAFXBL\ncsP1sCtBDYP48tMvadfu4QqBPef3ELIoBI3evKa7UuFK7Bq0i2rFqtn9a7OWRqPhwIEDmfYc3759\nO9vrfHx8Mi3k8vX1tesbp/3799P5xRdZo9HQ3MZtS8AoDw+O1K/PlshI3N1FIYz8SgTffGTXrl28\nERrKkbQ0i+uj58YFoIGnJ0mXL1u90OXatWtPJKg4ceIERqPRouvd3NyoV69epm09fn5+TyT5j4uL\nI6x5c5I0GodVCfkTmBMUxI6DB+3az4bTGwhd8vC5+5zQOYxoNAKA1NRUFi9ezLLVy4iLiUOj0eBZ\n2tP8QNEIxlQj+nt6atWrRYe2HRjxxghq1Hj6He3OszvptLgTWoMWgKpFq7Jr0C4qF6ls168vt0wm\nEydPnsw0VX3q1KlsrytSpMgTe469vb1tMqa0tDT8atTg/5KTecUmLT7JhPmxUKN33+WLr7+2Uy+C\nvYngm4/0DAuj5YYNvO3Af7I+ajVNJk5k9PtPz/RvNBo5ffr0E9PGV65csbiPEiVKZNo3GxAQQJ06\ndSx6Vz9i4EAqLF7MZxYGdVvIAKqoVGw7eBBfX/ssUrqaehW/n/y4lnYNgK61u7K65+osF9tcvXqV\npKQkdDodbm5uFC9enJo1a1qcVWpr4lbCloShM+oA8Cnmw65Bu6hQuIJtviAHuX79+hN7jnU63TOv\ncXV1zbTnuEWLFlSqVClH/b8zfDh3/viDhVptjq631GUgQKVi0969BAYG2rUvwT5E8M0nkpOTqVu1\nKmdzuJc3p/YCg8uX5+TFi6SmphIfH58p0MbHx6O18A+NQqGgRo0aT0wbV6hQIUcrOCVJomShQsSm\npfGsP5UzgfnAEaA38Pv91/X3j6MxbyfagXnRliXGKJUU+eQT/jdhgtXjzo4kSYQuCeWfhH8AKOdd\njsNvHqakOucZsyyxMWEjXZd1JcNoXtRWq0Qtdg7cSblCuVnhlbd0Ot0Te44tqSxVsWLFJ/YcZ5eA\nJjY2lk4tWnBEo8ERRRjnAz/Xr8+++HgH9CbYmgi++cQff/zB2rfeYoUF2zEedRwYCRwCSgHTwKrp\nMAko4+qKqkIFzp8/b/F1KpUKPz+/THezDRo0sNn0HkBSUhIt69fnkkbzzPNWY94iuwnzY9BHg+8c\nIAjoASwDXrCw7xXAojZtWLNjRw5G/mw/RP3AuxvflY8399tMe5/2Nu/nadadXEf3P7tjMJnXFNQt\nWZedg3ZS2qu0Q/q3N0mSSEpKyhSMjxw5YtGe46ZNm8rBuFmzZk88inm9Xz+qLlvGJw6ahTECPmo1\nK3bupHHjxg7pU7AdEXzzidFvvUW5OXMYZ8U1BsAXeAt4F9gJdAZigJpWtPMi5lSUWSlfvvwT08Y1\natSweyL9lStXsnDIENampFh0/mfARR4G30dVAhZjefBNBFoVLcolCxb8WCP+ajyNf2ksT/+OCR7D\ntx2+tWkf2Vl1fBXhK8IxSuYg0qB0A7YP3G73O++8cvfuXfbv3y8H4/3795OWlpbtdfXq1ZPvjhs0\naMCLLVpwIj0dR66tnuLiwsnwcOYtXerAXgVbEME3n2jl58eE+Hirti0cAYKBR0NTCNAU+NKKdibe\nP9/k4kLt2rWpX78+9evXx9fXlzp16lCsWDGMRmOWHyaT6Zmft+TjaW1s2rSJBps2MdXCH+FPgUvY\nJvhKgFqp5Prt2za7m9fqtTT+pTFHrx8FIKBsAPuH7sdDadu80Zb48+if9P6rNybJJI9l24BtFFc5\nYkI1bxkMBuLj4zPdHVsy6xMCbMzmnKwegQBswzxLdQHz7+h8ILslb9eB6h4e3E5NfS7yshck4l8r\nnzh36RI+NmjHhPkX3xq1ABWQYjJx/Phxjh8/zooVK2wwmtyzZiuHLZNvKAAvpRKtVmuz4Pvhlg/l\nwKtSqljSfUmeBF6A8Hrh6I16+q/uj4REbHIsHf7owNYBWynqWTRPxuQoSqWSwMBAAgMDGTVqFGDe\nX/9ge9PevXuJiYnJtHLfA+hoQdsVMM/APHgE8sAN4FXgN8yzU58CPYF92bRXCqjo7s6xY8fyLCGO\nkDMOqhYq5FZ6RgYqK6+pDZTG/JxXjzn7079k/qW3hCf2yxqVW9ZM29h6isckSTabWt9wegMzD8yU\nj78L+Y66perapO2c6uvXl3ld56G4/68ffSWajos6ck9n+b7s50XFihUJDw9n+vTpHDhwgLt377Jj\nxw6++uorOnXqhNrFhSAL2ukGdAVKPPb6KqA+5gDsDkwA4oDsN05BkMlEdHS05V+M4BTEnW8+4aZU\norf2GuBvzKXxpgCNgXCensz9WfSYg6+Hhweurq5Wfbi4uFh9jaVtxMTEcH3vXjCZLPo6bPkGQg9o\nDAbUanWu27qaepXBawbLx11rd2V40PBct2sLgwIGoTfqeSPiDQCiLkXRaXEnNvbbiLe77RbP5Tde\nXl60adOGNm3aAFDI05MG2WxpetTjbwSPQqaMdWqgBuZZqmdXWAa/tDSOxMTA4MHZnCk4ExF884kS\nRYqQfOeO1SXyGmBeaPVAc8DaX9GrQHi/fsz94w8rr7SvTZs2MblnT7h795nnGTEHS8P9/9dh/sF3\nvf//D/4Q6oB0LHtzcgyoVrZsrvMIS5LE4DWD5f285bzL8WuXX50qef7rQa+jN+kZuWEkAHsv7CVs\nSRgb+m5A7Zb7Nx/5nSRJpGVkWFV2+fF/3TTMU8iPKgxYsrehMJCYze+A4HzEtHM+EdioEYdycF08\n5oCiAb7FHEgHWdlGtEpFwxYtctC7fQUFBXFIqyW7+96JmO8kpgCLMD+/nnT/c7Xvf+4y5gUzXoAl\nG6qigaBGjXIy7Ex+/O9HeT8vwIJXFjjlquK3Gr/F9JDp8vGuc7vosrQLWr19k0nkG1auW338bG/g\n8cn8u4Cl5RMkC2d/BOchgm8+0ah1a6JzcJf1B+bUv2UwJ5HYAlanpox2cyMoyJInWo5VsmRJShUr\nRkw2503AvNDs0Y//3f/c2fvHxkf+a0lSxZ0qFU1fzF3K/Pir8Xy45UP5eEzwGIft582Jd5u9y7T2\n0+TjbUnb6La8G+mG9DwcVd5TKBSo3d2xbMPb/WseO66H+RnvA2nAmfuvZycF8BJFFvIdEXzziZYt\nW7LZ1RVrt+9PBW5h/gVdD1hbCO8icMFgoEGDBlZe6RiDRoxgroNLyN0C1ppM9OrVK8dtaPVaev/V\nW97PG1A2gEntJmVzVd4b23xspnFuOrOJHit6yFmxCirfqlWxJM+UEfNM1KOPQIyYF2IdwbzwKh34\nAggg++e9AIe9vKgnUkzmOyL45hOBgYGUqFCBTQ7ud65SSd++fZ2mRurjho0YwQrMU3SOMt/Fhc6h\noZQq9fhTOss9vq1o6atL82xbkbXGtxrP560/l48jTkXQa2Uv9EZrlwQ+Pxq1aIEl642zegRSEvgL\n+AQoDhzEnHHNEtEuLjSywSMQwbFE8M1H3ho3jlk2TM+YnQzgFzc33hw92mF9Wqts2bKEhYbyjYNK\nq90G/s/Tk3c++ijHbaw/tT7TtqLvQ76nTsk6Nhid43ze+nPGtxwvH68+sZq+q/rKaSkLmsatWrHX\nyyvb8yaQ9SOQFzGng9VgzihnyeOPm8AFnc5uBT4E+xHBNx/p1asXR1Uqh939fqNU0jg42Ol/sb+d\nPZv5np7854C+Rrq50b1v3xzn0k1OTX5iW9EbQW/YangOo1Ao+KrdV4wNHiu/tuLYCgb+PRCjyXEV\nppzFK6+8whajkWsO7neeiwuvdu2Km5sjiowKtiSCbz6iVqv5ZfFiXler7T7NGgfM8vRkzsKFdu4p\n90qXLs2MuXMZqFZbtejFWn8Ba/R6CpUsmW0i/qcxSSYGrxnMdc11wDm3FVlDoVAwtf1U3m36sAjE\nkvglDF07VE5LWVAUK1aM7t26Mc/FcX9STcAcT0/eGjs223MF5yOCbz7Tvn17Xn7tNYZ7ema7xSan\n7gL9vbyYOmMGFSrkj3qu4eHhtAkPp4tazbNrHOXMDqA/5inBb775hj59+pCebt0q3x+jfmRjwsPs\nvwu7LXTKbUXWUCgUfB/yPW82elN+bUHcAoavG56jAPwgj3d+NHLsWH709OSOg/pbApSsUkVUNMqn\nRPDNh76fM4dLdesyysPD5gE4BeisVvNC794MzEcZcxQKBTN//ZXKoaGEqNXctGHba4CeajW+j2y3\nWrZsGW3btrWoNizA4auH+XBr5m1FL1V/yYajzDsKhYKZnWYyLHCY/NqvMb8yasOoZ84QJCcnM2fO\nHHoP6E31utVRuitRuilxVbrirnKnTkAdhrwxhPnz53M3HySRaNiwIV179uR9ByxOTAbGqFTMXrgw\n386cFHiSkC/duXNHahkYKPXx9JTumbf45/rjLEiNvbyk4QMHSkajMa+/xBwxGo3SuNGjpXIqlbQq\nl9+POyAN8/SUKpcsKe3fv1/S6/XSm2++KWHOkSABUpUqVaT4+PhnjkmToZHqzaonMQGJCUgBPwVI\n6fp0B31HHMdoMkoDVw+Uv04mIL2z4R3JZDJlOm/37t1SWLcwycPbQ1IHqSVCkRiGxHgkPr//8RES\ng5EIQfL285Y8vT2lgUMHZvu9zmspKSlS1dKlpXU2+p182ocRpC5qtTR+7Ni8/nKFXBDBNx9LS0uT\nhvTuLVVRq6WtufhlNoH0k0IhlVSppKlff/3EH8v8aPfu3VLN8uWlV1Uqad/9r9HS70cKSD+DVFmt\nlt7o31+6e/eu3K7JZJJmzJghubi4yAG4UKFC0oYNG7Icy6j1o+RgpPpKJR2/ftwR34I8YTAapD5/\n9ckUgMdsGiOZTCbpxo0bUrce3SSv0l6S4mWFxDgynffMjzFIru1cJVVRlfT2e29LGo0mr7/ULO3e\nvVsqqVJJUXYIvCaQRnt4SMF+flJ6+vP3Bq4gEfV8nwP//PMPb/TrR0BKCqP1etphWREBHeZFRD94\ne2OqXJn5K1Y4/cpma2g0GubMmsWc776jcGoq/VNTaYI5ecGjm0IkzDVUo4Ft7u4sUSho3aoV7332\nGS+88PQKv+vXr6dXr16kppqz77q4uDB9+nTefvvtzOedWk/Y0jD5+KfQnxjeyDmKJtiLwWSgz199\nWHHsYdnJcPdwNn+3GU1tDRmtM8yle3IiDVRbVJS4V4K1K9cS6KTJJSIiIhgSHs4KrZbWNmrTCIz2\n8CCyalW27ttHsWLFbNSykBdE8H1O3Lt3jxo+Pmhv3KAI8JqrK42NRoIwp5d0w5w5JwnzBv5oT0/W\nKBTUb9CAt8aNo0uXLs9tMW6TycTmzZtZvWQJ0fv3c+zsWcq4u6N2dcUgSdzU61G6uxPUoAHB7dsz\ncMgQKlWqlG278fHxhIWFZSq0PnLkSKZPn45SqSQ5NRm/OX7y6uautbuyuufqAvGMTm/U03NlT1af\nWA2HMRew7QFUtVEH8eC1zYsNazZk+QYpL0mSROvWrTm4ezejMCfXyE0KlZPAYC8v1A0a8NfGjRQR\n6STzPRF8nxN79uyhVatWgHlL0rgPPyR+3z4OxcRw/e5dMoxGPJVKKpUuTVCTJgS98AIdOnSgdu3a\neTxyx8vIyODChQtotVqUSiVFixalTJkyOQqKycnJvPLKK0RFRcmvdejQgWXLl9FnfR95dXM573Ic\nfvNwvl/dbI0MYwbBY4I59NshGIC5uLQtJYLXWi+2b9pOkyZNbNx47sydO5fhw80zHGqgiocH03Q6\nOmKupmWpm8AcV1eme3gw4euveevtt3Fx4HYmwX5E8H1ODB06lHnz5gHwxhtv8PPPP+fxiAoOrVbL\n4MGDWb58ufxa2WplSe6SDPdnBrf03/LcrG62VEJCAn5Bfmh7a6GcnTo5ASV2luDMiTNOczd49OhR\nGjVqJG9FGzFiBG3btmXqZ59x69Ilhmu1hJhM1OPpRU5uYZ6dWqJSsUaS6BwayudTpuDj4+PAr0Kw\nNxF8nwOpqamULVuWtLQ0APbt20ezZs3yeFQFi8lk4osvvuDLL798+KIa6AVje45lWodpWV77PDKZ\nTDRu0ZjYIrGYgu27b9fjHw+61+7OkgVL7NqPJbRaLY0bN+boUXPe7gYNGhAVFYVKpQLgwIEDzJ0x\ng727dnHu6lV8VSpKYw7CWoWC0wYDNwwGAmrXJqx3b4YMG0bJkgVntqQgeT4f8hUwK1eulANv3bp1\nadq0aR6PqOBxcXHhiy++oGr1qgwdNhTJIIEGFAsV1G9TP6+H53A//fQTJ6+fxNTB/gkzdO10rPl1\nDdu2bePFXJZ5zK0xY8bIgVelUrFs2TI58AI0btyYxosWAeY3zYcPH+bWrVvo9XpUKhVVq1alVq1a\nYmq5ABDB9znw+++/y/8/ePDgArGgx1lFl4pGGiCZS9JoQDJIDBowiDOnzzBhwoQC8UfVZDIxcfJE\n0jqkOSaNjwdoWmj4fNLneRp8V61axZw5c+Tj6dOnP3P3gLe3N82bN3fE0AQnJKad87mEhARq1qwJ\ngKurKxcvXqRs2bJ5PKqCKeJUBJ2XdjYf3IZy68pxJfGK/Pnw8HDmz5+f6U7oebRx40Z6jOhB6qBU\ny/a82YIePH/05MihI3nybPT8+fP4+/tz5445uWSPHj1Yvny5eCMsZOn5fxv+nJs/f778/y+//LII\nvHkkOTWZIWuGyMfdgrtxLPoYISEh8mt//vknbdu2JTk5OS+G6DDTZ08ntYGVgTcK+Bnznpy/c9Cp\nGxj9jfy0ZMhmAAAgAElEQVQ096ccXJw7BoOBPn36yIG3SpUqzJ07VwRe4ZlE8M3HjEYjCxYskI+H\nDBnyjLMFe3m8WlH5QuX5pfMvFC1alIiICEaOHCmfGxUVRdOmTTl8+HBeDdfu9kfuB2tvPgsDrYFc\n5MzQV9WzZeeWnDeQQxMnTmTv3r2AefZp6dKlFC1a1OHjEPIXEXzzsW3btnHx4kUASpYsSWhoaB6P\nqGB6vFrRglcWUEJdAgClUsnMmTP54Ycf5Oe958+fp0WLFqxfvz5PxmtPly9fRpehA2tjT12gDuYV\n4jlVDk4cOeHQqki7du3iq6++ko+//PJLgoODHda/kH+J4JuPPdjXC9CvXz/c3XOas0/IqcerFY0N\nHvvU/bxvv/02ERERFCpUCDCvdO3SpQszZszIUW1gZxUTE4N7JfecP+vNzbdCDUovJWfOnMlFI5a7\nefMmffv2lYN927ZtGTdunEP6FvI/EXzzqdu3b/P33w8fjokpZ8fT6rX0/qs3GcYMAALLBjLpxUlZ\nnv/yyy8TGRlJlSpVAPOq4NGjRzNy5Ej0er1Dxmxvt2/fxqTKxZ1nLh+TKr2V3L59O3eNWECSJAYP\nHsylS5cA88zTokWLcHW1Jn+VUJCJ4JtPLV26FJ1OB0BQUBANGjTI4xEVPB9s+YBj148BoFKqWPLq\nEtxdnz37UL9+faKiojIlQZkzZw6hoaHygp38zGAwILnk4vY1t5MArjjkjczMmTNZt26dfDx//nzK\nly9v936F54cIvvnUo1POg/NR0fvnRcSpCGYdmCUfT+84nTol61h0bZkyZdi+fTu9evWSX9uyZQvN\nmzcnMTHR5mN1JA8PD1wMufizkss7X0kv4WnnYvZxcXGMHTtWPh49erRYbyFYTQTffCg+Pp7o6GgA\n3N3d6d27dx6PqGBJTk1m8JqHb3i61enG6w1ft6oNlUrFkiVLmDBhgvza8ePHadq0KXv27LHVUB2u\nWrVqKG7lIIKaAP39/5oAw/3/WtlG+vV0qlWrZn3/FkpLS6Nnz55kZNx/1BAYyOTJk+3Wn/D8EsE3\nH3o0o1W3bt0oXrx4Ho6mYDFJJgb9PYgbmhvAw21FOdnTqVAo+Pzzz1myZAkeHuaCczdu3ODFF1/k\njz/+sOm4HcXf3x9NssYcSK2xC5gE7MFcgvAr4F8r27gJRYoVsevvwzvvvMPJkycB8PLyYtmyZfK/\nnSBYQ6SXzGcyMjJYdD83LIgpZ0f7IeoHNp3ZBIACBQtfWShvK8qp3r17U7VqVbp27cr169fJyMhg\nwIABnDx5ki+//DJfpaRUqVRUrFqRs1fPQkUrLmx7/yM3LkPDhg1z2UjWli1blulxz6xZs6hVq5bd\n+hOeb/nnt1oAYP369Vy/bk7mULFiRV56qWCVqctLcclxjNv6cCvJ2OZjebG6bXIJBwcH899//1Gv\nXj35tUmTJtGrVy+0Wq1N+nCU8G7huB9z/LY375Pe9Hmtj13aTkxMlOvzAvTt25cBAwbYpS+hYBDB\nN595dMp54MCBYmuDg2j1Wvqs6iNvK2pYriFftfsqm6usU7VqVSIjI+nYsaP82ooVK2jTpk2+Skk5\n8s2RuMS7QIYDO70FXDbnz7Y1vV5Pnz59uHfvHgA+Pj7Mnj1bpI8UckUE33wkOTmZDRs2yMeDBg3K\nu8EUMI9uK1K7qVnSPfttRTlRuHBh1q1bx6hRo+TX/vvvP5o0aUJcXJzN+7OHypUr06JlCxQxjgtO\n7gfcGTpkqF1WOn/22WdERUUB5oxlS5cupXDhwjbvRyhYRPDNR/744w+MRiMArVq1okaNGnk8ooLh\niW1FIdOpXbK23fpTKpX8+OOP/Pjjj/Lz3gsXLtCyZUsiIiLs1q8tTZ86Hc9IT3DE1uULoDql4pOP\nPrF501u2bGHKlCny8TfffEPjxo1t3o9Q8Ijgm09IkvRE3V7B/p62rWhYw2EO6XvUqFGsX79evst6\nkJLy+++/d/qUlPXr1+ejsR+h3qjOfeKMZ9GD1wYvfvv5N0qVKmXTpq9evUr//v3l45CQEN5//32b\n9iEUXKKebz7xaFYkLy8vkpOT8fb2zuNRPd9MkolOizvJq5vLFyrP4RGHc7262VpHjx4lLCyMs2fP\nyq8NHz6cH3/8ETc3N4eOxRoGg4GGzRpy0vskGW3t8ADYBKo1KkJqhbD6z9W2bdpkIjQ0lI0bzQUz\nypQpQ1xcHGXKlLFpP0LBJe5884lH73rDw8NF4HUAe2wryol69eoRFRWVqVrOzz//TKdOnZw6JaVS\nqWT7xu2Uu1wOl20utr0DNoLnOk8CigawdOFSGzZs9v3338uBF2DhwoUi8Ao2JYJvPqDRaFi69OEf\nGDHlbH/23FaUE6VLl2b79u306fNwK83WrVsJDg52WBWfnChZsiTffv0tpv0mWAKk2aDRW+C11Ivm\npZuz7Z9tNl9kdfDgQT7++GP5+MMPP6RDhw427UMQxLRzPrB48WL69esHQI0aNTh16pTY5mChK1eu\ncPDgQQ5GH+RS8iV0GTrUnmp8qvrQqFEjGjZs+EThc61eS6NfGsmrmxuWa8i+ofvssrrZWpIkMXHi\nRD7//HP5tRIlSrB69WpatWqVhyN7usuXLxMQEGDem+4KLh4umDqZwBfr3/obwSXaBc+9nnz+6eeM\neW+Mzbfa3bt3j4YNG8pvaJo0acKePXucenpfyJ9Ehqt84PGFViLwPtvNmzf5bd5vTJ81ndu3b+Ne\n0Z20kmkYvYzmP/hGcI9zR/WbCs0FDTVr12Tce+MIDw/H09OTsZvHOmRbUU4oFAr+97//UatWLQYN\nGoROp+PmzZu8+OKL/Prrr06V+MFgMNCrVy85KUyZkmX45ZdfGPPxGC7vuYzGX4PkL4E6m4bugjJW\niVusG/4N/JkfNZ/ate2z2nzkyJFy4C1UqBBLly4VgVewC3Hn6+TOnj0rJ4p3cXHh3LlzVKxoTd6+\ngiMtLY0x48awYMECFHUUaP215hSHz3qvYgQSwDvOGy5DjxE9+N39d/mubG7YXF4Psq5ogqPs37+f\nrl27cu3aNfm18ePHM3HiRKdISTlu3DimTp0KmH92t23bRps2bZAkiX379vHtjG+JWBuBZ3FPTOVM\npBVNAw9AAoVOgfdtb6RLEkaNkT59+/De2+9lygBmawsXLmTgwIHy8ZIlS0TREsFuRPB1cl988YVc\n+SYkJCTTIhDhoV27dtGrfy/ulr6Ltp0WvHLQyHXgQYnWrtCtRTf+Cv/LqWcazp07R1hYGEeOHJFf\ne+2111iwYAFqdXa3lPazdu1aunbtKh9PmjSJ8ePHP3GeXq/n2LFjREdHc/joYe7eu4uLqwvFChcj\n0D+QoKAgatWqZfc3E6dOnaJhw4akpZkfSg8ePDhTHmdBsDURfJ2YyWTCx8dH3mKyfPlyu6TPy++m\nz5jO+C/Go+2ohdzORpqA/0CxW8HKZSvpHtbdFkO0q3v37tGrVy/++ecf+bVGjRqxdu1aypUr5/Dx\nnD17lsDAQHkldqdOnVi3bp1T3I0/jU6nIzg4mJiYGABq165NdHQ0Xl45eQcnCJZxzt8GATDfzT0I\nvMWKFaNLly55OyAnNHXaVD75+hO0A2wQeMH8G9EMpB4S/fv3Z8uWLTZo1L4KFy7M2rVreeedd+TX\nDh48SJMmTYiNjXXoWHQ6HT169JADb6VKlVi4cKHTBl6Ajz/+WA687u7uLFu2TARewe6c9zdCyDTt\n1adPH7vkrc3PVq5cyRdTv0DTRwPFbNx4VdB009AtvBtHjx61ceO2p1QqmTFjBrNmzZJXAF+8eJGW\nLVuydu1ah41jzJgxHDx4EAA3Nzf+/PNPSpRw/N5oS23YsIHvv/9ePp42bRoBAQF5OCKhoBDTzk7q\n7t27lCtXTi4nFx0dbddapfnN1atXqelbk5TuKdbVjbWS4qCCOufrcDj6MEpl/tgcsGnTJsLDw+Uq\nPAqFgmnTpvH+++/b9fn18uXL6dWrl3w8ffp03n33Xbv1l1uXL1/G39+fGzduANC5c2fWrFnj1M/4\nheeHuPN1Un/++acceP38/AgMDMzjETkPSZIY9PogdA10dg28AFKQxHndeb6Z8o19O7KhkJAQ9u3b\nJ6+SlySJsWPHMmLECPR6vV36PHnyJMOGPcx5/eqrr2aaBnc2RqOR/v37y4G3fPnyzJs3TwRewWFE\n8HVSj045i729mUVFRbE7ajcZLR1QMFYBaR3T+Hry19y9e9f+/dmIr68vUVFRNG/eXH5t7ty5dOzY\nkdu3b9u0L41Gw2uvvUZqaipgTgTz22+/OfXP7JQpU9i+fTtgnhlYvHgxJUuWzONRCQWJCL5O6Pjx\n4+zfvx8wP8vr27dvHo/IuXw741u0gVpwVO6DYuBS04UFCxY4qEPbKFWqFNu2bZOzowFs376dZs2a\nkZCQYLN+Ro4cKW918vDwYOXKlRQpUsRm7dvavn37+N///icff/LJJ7Rp0ybvBiQUSCL4OqH58+fL\n/9+lSxebl0rLz27cuMH6iPWY/E0O7Vfjr2HajGlOX8rvcZ6enixcuJCJEyfKr506dYqmTZvy77//\n5rr9efPmZfp5nTlzJv7+/rlu117u3LlD79695brYLVq0yJSqUxAcRQRfJ2MwGFi4cKF8LIooZLZ1\n61bcfNyyT0n4OA2wDJgEfA/EW3l9Fbh195ZTFzHIikKh4NNPP2X58uXyivlbt27x0ksvZQqc1oqL\ni2PkyJHy8YABAxg6dGhuh2s3kiTxxhtvcO7cOQCKFi3K4sWL881COuH5IoKvk9m4cSPJyckAlC1b\nlo4dO+bxiJzLvqh9pJZMtf7CDZgzmX8AvApEANeeeUVmCnCt6Ep0dLT1fTuJ8PBwdu7cKZfG0+v1\nDB48mI8//hiTybqZhHv37tGjRw/S09MBc9nD2bNnO/Vz3l9//ZUVK1ZkOq5SpUoejkgoyETwdTKP\nFlEYMGCAeFf+mN37dyOVs3LqNwM4DrQF3IHKQB3gsHXNpJZIZf9/+627yMk0bdqUqKgoGjRoIL82\nefJkevToIadWzI4kSQwbNozTp08D4OXlxcqVK506McWxY8cybXsaPnw4r776ah6OSCjoRPB1Itev\nX2fdunXysZhyftKFcxeguJUX3cT8k/5orocyWHfnC0jFJY6dPmZl586nSpUq7N27l9DQUPm1VatW\n0bp1ay5fvpzt9TNnzsx0B/nLL79Qp04du4zVFrRaLb169ZK37tWrVy9TYg1ByAsi+DpAeno6f/31\nFx+MHk27oCBKenvj5uqKi4sLXu7uBPr4MKxvX9566y15H2azZs2c+g9aXsnQZVhfCDMDc7WcR3nc\nf90abuZtNc+DQoUKsWbNGkaPHi2/Fh0dTZMmTeRUi08TFRXFmDFj5OM333zT6Sv/jB07lvh480N+\nT09Pli9fjkqlyuNRCQWdmNO0o3PnzjFnxgzm/forfkDb1FQ+lCQCMN+8uQAavZ7jiYlEJyayQ6FA\nhbkCXvPmzZEkyamfoTmawWAwf3OsXXDsDugeey39/uvWMPJc1XZ1dXXl+++/p3bt2owaNQqj0cil\nS5do2bIlS5YsyVSVCMx1ksPDw+U3iEFBQU5/B7l69Wpmz54tH0+fPt2uZQkFwVIivaQdGI1Gvps6\nlSkTJzLAaOTNjAxqWnjtPWAB8INajd8LLzB7/nx5gUxBYTAYOHPmDEePHs30cfLkSfQKPQwCylvR\nYAYwBXiLh1PPq4DCwEtWtHMQehbtybI/lllxUf6wZcsWevToIScSUSgUTJ06lTFjxqBQKDCZTHTu\n3JkNGzYA5pXChw4dkrNoOaPz588TEBAgJxV59dVXWbFihXhDKzgFcedrY4mJifTp2hVVYiIHtFqs\n/dNUGHgbeF2jYcK2bfjVrMmc33+n+3O4OMRoNGYZZDMyspgTdgOuYF3wdQfqAjuALvevPwkMe9ZF\nT3JNdsWtvhvJqcmU9S5r3cVOrn379uzbt4/Q0FCSkpKQJIkPPviAkydPMmvWLL777js58AIsWLDA\nqQOvwWCgX79+cuCtXLkyv/zyiwi8gtMQd742dOTIETq+8AJj7t7lXZPJJg/Uo4BXVSo+mTqVN0eN\nskGLjmc0GklMTMwUYI8dO8aJEyfQ6R6fD362IkWKkFI9BVNXK5NsaIE1wBnMe4RfAho884on/Qx0\nAipBQNkAOvp0JKRGCM0rNcfd1do5bOd0/fp1unfvzp49e+TXAgMDiY2NlROMjB07lmnTpuXVEC0y\nYcIEvvjiC8A8vb5r1y5atGiRx6MShIdE8LWR06dP07pJE/7vzh1svfwkEWirVvP5jBkMGWbl7ZoD\nGY1GkpKSnhpkH+wHtVT58uWpV69epo+6deuSmJjIC51eIG14mmOXC6YAM4ExPPGs2Nvdm3bV2hHi\nE0KITwg+xX0cODDb0+l0vP766/zxxx9PfK5ly5Zs377dqZ9979q1i3bt2sl7lydOnMinn36ax6MS\nhMxE8LWBjIwMGvv6MiIpiTetTFZgqVNAS5WKzZGReV5v1GQyZQqyx44d4+jRoxw/ftzqIFuuXLlM\nAdbX1xdfX1+KFXt6gV5JkqjVoBYJgQlQwxZfjWVc/nXBT+VH4dcKE3khEoPJkOW5NYrXkANx22pt\n8Xb3dtxAbUSSJCZNmsRnn30mv6ZQKFi+fDk9evTIw5E9282bN/H39+fSpUsAtGnThq1bt8o1jgXB\nWYhnvjbw1eefU+XKFUbYKfAC1AKmpaczqEcP/jt6FHd3+09zmkwmzp49mynAPgiyD/ZMWqps2bJP\nBNl69eplGWSzolAoGDd6HO/NeI/UGjnIdJUTRvCM8+T3rb8TEBDAPd09diTtYGPCRjad2UTSnaRM\npyfcSiDhVgKzDszCzcWNlpVbEuITQscaHfEr45cvnjsqFIonHglIkkTfvn1JTU11yj3okiQxdOhQ\nOfCWKFGCRYsWicArOCVx55tL8fHxvNi0KXFaLeXs3JcEdFarCf7gAz6ZMMFm7ZpMJs6dO/fUIGvt\nvtYyZco8EWDr1atH8eLWZsbIWlpaGpV9KnMr5BZUt1mzWXKNdKWJrgmROyOf+JwkSSTcSpAD8Y6z\nO9Dos/6elfUuSwefDnT06Uh7n/aUVDtnGbuNGzfy8ssvy8deXl6ZMmB9+OGHfPPNN7i4OE+qgFmz\nZjHqkXURa9eupXPnznk4IkHImgi+uTSkVy9qrVjBR3a8633UKaBVoUKcv34dD4/HM0c8m8lk4vz5\n85kC7IMga2lqwQdKly791CBbokSJ7C+2gX/++YfXBr6GZpjmyQQatnQd1IvUHIk5YtHqXp1Bx57z\ne9h0ZhObzmzi8NWsc1gqUBBUPkheuNWsYjOULnk/GXXhwgUCAwO5efMmAC+99BJz587llVde4fDh\nh1/PK6+8wqJFi5wirWRcXBxNmzaV79bfeecdZsyYkcejEoSsieCbC7du3cKnQgVOpafjyKJ/Hby9\nGfjTT1nW+ZUk6alB9tixY1YH2VKlSj0RYOvVq+cUhcd79+/N6uOr0YXpzMk3bC0DvBZ7MfmDyYwa\nmbOV5pdTLrP5zGY2ndnE5jObuaW9leW5hT0K81L1l+TnxVWKOj7pf0ZGBq1bt5brSZcvX56YmBhK\nly5NSkoKffr0ISIiQj6/YcOGrF27lgoVKjh8rA+kpaXRqFEjTpw4AUBAQAD79++3+s2pIDiSCL65\n8OMPPxD18ccssnJqth+wDXOVu7LAh4A1hdhWAzMCA9kRHc3Fixef2Cd77NgxUlOtex5aokSJJ1YX\n16tXz6lrCaekpBDcOpjT6tNkvJRh2wCcAepVajoHdWbJwiU2mV41moxEX4lmU8ImNp7ZyP6L+zFJ\nWc+Y1ClZR35W/EKVF1C7WVtH0Xrvv/++nLXK1dWVnTt30rJly4dfg9HIBx98kCmzVfny5Vm3bh0N\nGza0+/ieZtiwYfz2228AqNVqDh06RO3atfNkLIJgKRF8c6Fnp06E/fMP/a287ijgA3hizvXQBlgP\nWPqnKxUooVDg7uVldZAtXrz4U4Ns6dKlrWrHWdy6dYtWL7bijPIMug4661NGPk0KKJYp6BrclRVL\nV9itstSd9DtsS9wmPy++cO9Clud6uHrwQpUX6FijIyE+IfiW8rX5wq1Vq1ZlqvQzbdo0xo4d+9Rz\nf/75Z0aOHCkXpVer1SxevJhXXnnFpmPKzvLly+nVq5d8PG/ePKdcDCYIjxPBNxdqlC3L2qtX8c1F\nGycxV7r7AXjNiusqApee8flixYplGWTzw2pba6SkpNBvcD+27t2KppPGXDIwJyTMZQbXAwYY/c5o\nh+UuliSJ4zeOsynB/Kx417ldpBuy3rZVsXBFeXr6peovUUxl3arxxyUkJBAUFMS9e/cA6NKlC3//\n/fczf1a2bt3Ka6+9likl5eTJk/nggw9y9DN27do1kpKS0Ol0KJVKihUrRq1atbJcrZyUlGRefX5/\nzL1792bx4sXP3c+38HwSwTeH7t27R/mSJbmr15OTjQxvYc7hrMV8x/sv5sRLluoKrMWcY/dpQbZM\nmTIF7o/QqlWrGDJ8CBmVM9AGas3vUCz5FpiAU+AV44XHXQ9uJT98Lrt+/Xo6depkryFnSavX8u+5\nf9l0ZhMbEzZy/MbxLM91UbjQtEJTeYq6UflGuLpY/lOp1Wpp3rw5sbGxAFStWpVDhw5ZtA3sxIkT\nhIaGkpiYKL82ZMgQ5syZk+12OI1Gw9KlS1ny1xJiY2JJTUnFs7QnCjcFGMGYaiTjXgY1fWvSvk17\nRrw+Qp5O1uv1tGrViqioKACqVatGbGwshQsXtvjrFoS8JIJvDp09e5bW9etzzsoFTI+SgEhgJzAO\n6zZdj1YqKTJ+PBMmTChwQfZZbt++za+//cp3P3xHmksaaVXTMJU1mXNBe2POimUE7gCXwe2qG24n\n3ahWqRrj3htHjx496NGjh7yoqFSpUsTFxVGunL03kj3b+bvn2XxmMxsTNrI1cSt3dXezPLe4qnim\nhVsVCj97MdTw4cOZO3cuAO7u7kRGRhIUFGTx2G7cuEH37t3ZvXu3/FqbNm3466+/nrrF7OrVq3zx\n1RcsWLgARWUFabXTzP8+xXgya5kWuAJuZ91Qxinx8/Pjy0+/ZMeOHUyePBkApVLJ3r17adKkicVj\nFoS8JoJvDiUkJBASGMgZK5+5Ps2bgC/mggqWGufqSrGvvuKjjz7Kdf/PI5PJxPbt29mxcwe79u8i\nPjaelNspSJKEi4sLJcqUoGFQQ1oHtyYkJCTTYqEbN27g5+fHlStXAPNWm02bNjnNnlaDycB/l/6T\nnxUfuHQA6Rl1FuuXri9vZ2pZuSWeSk/5c4sWLaJ//4erFmbPns2bb75p9Zh0Oh3Dhw9nwYIF8ms1\na9YkIiKCWrVqAeap9aVLlzLi7RGk101H30hvDriWMgDHwGOXB7q7OvMxMGXKFD788EOrxywIeUkE\n3xy6ePEiTWvX5pINiqsPAwoB1jxdfMfDA58pU3j33Xdz3X9BIUkSJpPJooxH27dv56WXXpKLCUye\nPJlx48bZe4g5ckNzg62JW817ixM2cSX1SpbnqpQq2lZrS4hPCNX11ekZ0lNOpNKrVy+WLFmS45kU\nSZKYPHky48ePl18rVqwYf/31F82aNSO8bzg7onaQFpoGudmZpAM2AvHQpGET9u3b5zRvjATBUiL4\n5pBer6eolxfJej2FrLjuOuZtRmGACtgKvAosu/+apV4uXJgRCxc+UfBcsJ1PPvmEr7/+GjBPbe7Z\ns4emTZvm8aieTZIk4q/Fy9uZ9pzfQ4bxKeUZdcAvwA3zYYVqFYj6L4oKJXO/X3flypUMGDBATkHq\n6upKJZ9KXFVfRRuqNZeFtIWToN6gZv3f62nTpo2NGhUExxDBNxea1qnDtydP0sqKa25gXtUch3md\nT1XgHazb5ysBxVxc+GjSJPr160fFihWtuFqwlF6v54UXXpATTlSrVo2YmBiKFCmSxyOzXFpGGjvP\n7pSnqE/fOm3+AVoFxN8/SQm8DspySoIrBssLtwLLBeKiyNkd5YEDB+jSpQvJycnmYFsT8w++rW9Q\nk8BrjRe7tu6y6jm1IOQ1EXxzYeTQofjMm8f7Du73PFAH81oUMGf0CQsLIywsjMaNG4spOBt63raz\nJN5O5NOpn7J08tKHL74CPKVQVil1Kdr7tKejT0c6+HSgjHcZq/q6cOECTZo1IVmRDEMgR9sCLHEE\nKkRX4PTR06hUKjt1Igi2JYJvLmzYsIHPe/XiQEqKQ/udBHwFPG0XaOnSpenUqRNhYWG0b99ebL2w\ngccTOcyfP5+BAwfm4Yhy7tChQwQHB5ORYZ6KDu0Zit/rfmw6s4lDVw4989qAsgHywq3mlZrj7vrs\nrUTHjx8nqFkQ2sFa6xZW5YDqbxVD2wzlx+9/tG9HgmAjIvjmgtFopGb58iy/do3GjuoTqK5SET5y\nJHFxcezcuRO9Xv/Uc93c3GjdurV8V+zjk7+LvOelR1MYenl5cejQIXkVb35x584dGjZsSFKSuQSi\nv78/+/btk+8Wr6ZeZUviFjYmbGTzmc1c11zPsi1vd2/aVWsnb2fyKf7kz1bjFo2JLhaN1NgBf2LS\nQPWLiqh/o2jQoIH9+xOEXBLBN5emfvMNMRMnstTK+rY59RcwpU4d/jtuTrqQkpLCli1biIiIYP36\n9Vy7di3La+vUqSMH4ubNm+PmZquVL8+/tLQ0goKCOHnyJACBgYHs27cv3yTvlySJ7t278/fffwNQ\nqFAhoqOjqVmz5lPPN0kmYpNj5WfFkRciMZgMWbZfo3gN+Vlxm6ptSDyRSHDbYDQjNfabbn6M67+u\n9KvWj/m/zndMh4KQCyL45lJKSgp+NWow+9o1Xs7+9Fy5DTRQqfhj/Xratm37xOdNJhMHDx4kIiKC\niIgIYmJismyraNGidOzYkbCwMDp27OiwUoD5WWxsLE2bNpWnbN977z2+++67PB6VZb777jvGjBkj\nH6nJbBIAACAASURBVK9cuTJTHufs3NPdY3vSdjn9ZdKdpCzPdXNxo8T2ElxTXMPU2jGlNgFIAc+f\nPUm+mJyvFsUJBZMIvjawbds2BnXuTLxWS1E79jPI0xOvPn2YdX/6MzsXL15kw4YNREREsHXrVnnr\nx+NcXFxo3ry5fFfs62v7pP3Pix9++CHT3uq8Sj9pjcjISFq3bo3BYL5zfffdd5k+fXqO25MkiYRb\nCfJd8Y6zO9DoH9nvbgKmACOBnC45uAnMBuoB3S2/zHuVNzPfn5lvn8kLBYcIvjby9uuvc3rJEtZq\nNDYprPO4WS4uzChXjkMnTuDt7W319Vqtlh07dsh3xRcuZF1Bp2rVqnIgbt26NZ6enlmeW9BIkkTn\nzp1Zv3494DzpJ7Ny/fp1AgMDuXTJXIajadOm/Pvvv9nmXbaGzqBjz/k9ch7q+CPxsBTITf6XhZgz\nWBXFquDLPhhSZQi//WzZG1RByCsi+NqIwWAgPCwMw+7d/KnRYMtwNcfFha+LFePfAweoVq1artuT\nJIn4+Hg5EO/fv5+sfgy8vLxo3749YWFhdOrUyWmDjCNdv34df39/p00/+YDRaKRTp05s3rwZMJeT\njImJoXLlnJZ9sswPc39g3OxxpHfLuirTM8UDJ4BSwC2sC75noU5sHY7HZF2IQhCcgXP9tcjHlEol\ny9auxat9e1p7eXHCBm2mAqM8PJhWqhQ7o6JsEnjBXPrNz8+P8ePHExkZydWrV1mwYAE9evR4YmtS\nWloaf//9N8OGDaN8+fI0btyYL774gujoaEwmBz7PcyKlSpVi0aJF8tT81q1b+fbbb/N4VE+aNGmS\nHHjBnMfZ3oEX4Nzpc6SXyGHgTcdcaSQEnpGuOmtlIfFEYvbnCUIeE3e+NmYymfhp9mz+N24cH+p0\njDYarZ6GloDtwBtqNS1DQ5n+888WlXezhYyMDPbs2UNERATr1q0jISEhy3PLlStHaGgoYWFhvPTS\nS3h5eTlkjM7i8fSTzlRZZ9u2bbRv316e0Rg/fjyTJk1ySN+DXx/M/MvzISffin8wPydugTkIW3vn\nKwFfgtFgdLqZCEF4lAi+dpKUlMTIgQM5dPAgw/R63jAYsq3xrsGc43l2oULcUquZ8csvdO7c2QGj\nzdqpU6fk6endu3fLi3Ye5+HhQdu2beVnxVWqVHHwSB3v8fST1atXJyYmJs8Tm1y+fJnAwEB521mb\nNm3YsmULSqU1RStzbtCwQSy4ssD64HsFc9rLEZi3J+3AvMQ/B8HXoDdYVEBDEPKKCL52dvz4cX6a\nMYM//viD4i4uBAGBqaly6VINcNzTk2h3d45ptbRr0YK3PvyQkJAQp3vnfufOHTZv3kxERAQbNmzg\n5s2bWZ5bv359ORA3a9bsuf1D+Hj6yT59+mSaknY0g8FAu3bt5Nq6ZcqUISYmxqHP6t99/11+iP8B\nWlp54X7MVUcebJ3OwLxyuhQw3MI2MkD5rRK97umJZwTBWYjg6yBGo5FTp05x8OBB4g4e5N7NmxgN\nBlTe3tT29ycoKAh/f/98M3VrNBqJioqS74rj4+OzPLdEiRK8/PLLhIWFERISQtGi9tyQ5XjOlH5y\n3LhxTJ06FTBvIdu2bZvDK/789ttvvDvnXdI6p1l3oR5ztaUHIoE7mMt9qS1s4yL4RPqQcDTrxyWC\n4AxE8BVs4ty5c6xfv56IiAi2b9+OTqd76nmurq60atVKviuuXbu2g0dqH0OHDmXevHlA3qWf/P/2\n7jw8xqt94Ph3sk82W4k1KFVrJCL2XexRXm1RSkNJq7RaVfXri+7VWstb1UarqdiVUiohtoqdkMRO\niX1fElkmM1me3x9TUyEhk8yWuD/XlauezjPnnIwx95ztPmvXruWFF14wXH/55Zc5zta1lNjYWNoE\ntSF5eCFznm/D+DnffTCg7AAWhS0qXN1CmJkEX2FyqampbN682dArvr8lJzc1a9Y0BOLWrVubdP+p\nJVk7/eS5c+do1KgRd+/eBaBbt26sW7fOKlMXJ0+epF6DemS9l5X/HquprISWrVry9fivaVmlpSSL\nETZLgq8wq+zsbGJjYw2BeP/+/Xne6+HhQZcuXQgKCqJbt26UK1fOgi0tvEOHDtGsWTND+skxY8Yw\nffp0s9er1Wpp1aoVBw4cAKBKlSocOnTIoilDdTodq1evZt68eWzatEl/hm879KuWLUUDzAJGAe76\nfNPBDYMZ1HAQ3iXMv8VKCGNI8BUWdfXqVSIiIli3bh0bN24kNTX3eUGVSkXTpk0NvWIfH58i0YuZ\nNWsW7777ruF6/fr1dOtm3qzfo0aNYs6cOYD+JKvt27fTrFkzs9Z536lTp/jpp58ICwvj5s2HTkFy\nB8ZguWwCu4ErwEMpq1Wo6PhsR4b4DqF37d64Olq6Oy7EoyT4CqvRarX89ddfhj3F586dy/PeKlWq\nGAJx+/btbfbQ9NzST8bHx1O+fHmz1PfwYq9vv/02R+5pc0hPT2fVqlXMmzePbdu2PfK4nZ0dXbt2\nJfZYLFcaX4H6Zm2OnhZcf3JlZuhMYuxjWHp0Kfe09x65zdPZk371+hHsG0zzys2LxBc6UTxJ8BU2\nQVEUjh8/bhie3rlzZ54ZtNRqNYGBgQQFBdGjRw8qVapk4dY+nqXST548eZLGjRuTkpICwIsvvsiK\nFSvMFlCOHTvGvHnzWLBgAXfu3Hnk8cqVKzNs2DCGDh1KlSpV2LNnDx26d0AzTANmXsTvvMGZXtV7\nsWzRMgA0GRpWn1hNWFwYUWeiUHJJl1WrTC3DsHRlz8rmbaAQD5HgK2zS7du32bBhA+vWrSMiIoLE\nxMQ87/Xz8zME4oCAAJvYH/1whqlvvvmGcePG5XrvnTt3OHjwIFeuXEGr1eLk5ET58uVp1KgRZcuW\nzfU5aWlpNG3alCNHjgD6hWsHDhww+VF6Go2GFStWEBoays6dOx953N7enqCgIIYPH07Xrl0f2c89\n+v3RzNs8D01vDZirk3kWSkWW4syJM7lmgruYdJHw+HDCYsM4fef0I4+rUNGpRieCGwbTu3Zv1I62\nOaoiihcJvsLmZWZmsmvXLtauXcu6des4cSLvzNnlypWje/fu9OzZk06dOuHh4WHBlub00UcfMXny\nZODR9JOxsbHMnTGDqMhIbiYm4qdWUzUrC2dFQWdnxyV7ew5qNHi6u9OhY0feHDOGpk2bGnq1Q4YM\nISwsDNBnF9uzZw++vr4ma/vhw4cJDQ1l4cKFuX7xqVq1KsOHD2fIkCFUrFgxz3I0Gg2NmjXiTKkz\nZLTLMH0Avg7qJWrWLF9Dp06dHnuroijsvrSbsNgwlh5ZSrLu0a1QJZxL0L9+f4J9g2laqakMSwuz\nkeAripwzZ84Y9hRv27aNjIzcsxk5OjrSrl07Q6+4Ro0aFm1nRkYGrVu3Zu/evYA+/eS0adOYOmkS\nl86e5Q2tlj5ZWdRCn03xYdnAWWCNnR1z1Wo8K1Rg4pQp3L17l9dff91w37x58xg2bFih25uamsqy\nZcsIDQ01tPlBDg4O9OrVi5CQEAIDA/M9wnDr1i2atGrCpXKXyGifYboFWJdBvULN/Lnzc8x750da\nRhq/H/+dsLgwNp/dnOuw9PNlnifYN5hBPoOo5GlbUxui6JPgK4q05ORkoqKiWLduHX/++achn3Fu\n6tSpY1i01aJFC4vkOn4w/aQLUNLenu+ysugFGFN7NrABeMfFhWs6HSn/zIcPHjyYsLCwQvXQDh48\nyLx581i0aBHJyY/2BmvUqMHw4cMJDg7Gy8urQHXcvn2bwG6BnEo6RVq3NCjMOSFZwE5wPeDK4gWL\n6dWrVyEKgwtJF1gQt4Cw2DDO3D3zyON2Kjs61+hMcMNgetXuhYuDnG8tCk+Cryg2srOzOXDggGH1\ndGxsbJ73lixZ0pDysmvXrpQuXdps7Zo2bRqTPviAl4Dv0B/aU1AaYBzwM1C+enUOHz5coJSkycnJ\nLFmyhNDQUGJiYh553NHRkT59+hASEkK7du1MMo+emZnJlGlT+OLrL0hvlo7SSPk3j3N+KMAFYB2Q\nCG++/iZz584tdLsMxSsKOy/uJCw2jGVHl5GiS3nknpIuJelfrz9D/IYQUDFAhqVFgUnwFcXWpUuX\nDMPTmzZtIj099zNm7ezsaNmypaFXXKdOHZN9qMbHx9O5dWum3LvHYJOUqLcOCFarWRMVRcuW+ctk\noSgKBw4cIDQ0lCVLluS6x7pWrVqEhIQwePDgPBd7Fdbx48cZ/cFoojZG6bch+QHlIdezNxX0KSbP\ngHu8O44Zjty9rs/i5eDgQHx8PHXq1DF5G1N1qaw6voqwuDC2JGzJ9Z46z9Qh2DeYV31epaJH3vPe\n5qbT6Thw4AAxMTFs372dk3+fRJuuxd7BntKlS9MyoCVNA5rSrFmzx87PC8uS4CueCmlpaWzdutWw\nlenSpUt53lu9enVDIG7btm2BU0ReuHCB5r6+zLh7l34FbfhjbAQGubuzde9e6tatm+d9SUlJLFq0\niNDQUOLi4h553NnZmZdeeomQkBBat25tkd7chg0b6Nq1K6jAXm2PKkuFupwayoBir6DKVmGnsSP9\nUjpubm60aNmC90a+R7t27Wjbti07duwAoGPHjkRFRZm1zecSzxmGpRMSEx553E5lR9eaXQluGEzP\n53tabFj60qVLzJk7h7mhc1HcFXReOtLLpkMZ9BnGsoFUsLtuh/std7TntDRv0Zxx79rmqWlPGwm+\n4qmjKArx8fGGQLx3717y+mfg5uZG586dCQoKonv37vlOlqEoCl1ataLdvn18lMcZyKbwo0rFT7Vr\nszs+PscctqIo7N69m3nz5rFs2TI0Gs0jz61bty4hISEMGjTIrMPuuQkODubXX38F9Gk4v/rqK44c\nOcLZs2dJT0/H0dGRUqVK4efn90ia0fj4eBo1akRWVhYAy5cv5+WXXzZ7m7OVbHZc2EFYbBjLjy4n\nNePRkYNSLqV4pf4rDPEbgn8Ff7N8KdBoNIz7aBw//fQTSgMFrZ8W8pOJVQccAfc4d8q6lGX5wuU0\nbtzY5O0T+SPBVzz1bty4YUh5uWHDhlwXHd0XEBBg6BX7+fnl+eEa+sMP/DR2LLtSU41aWGUsBeji\n6kr78eP5v4kTuXPnDuHh4cybN4+jR48+cr9araZv376EhITQvLl1MjxpNBq8vLwMr/P+/fuNDgLv\nvvsus2bNAqBSpUqcOHECd3d3k7c1Lym6FFYeW0lYXBjbzm3L9Z56ZesZhqXLu5smw9mePXt4eeDL\n3Pa8jaZTAZOXKMBhUG9RM/KNkXz52ZdF9kCTokyCrxAP0Ol0REdHGxZtnTnz6OrX+ypWrEiPHj0I\nCgqiY8eOhoVPycnJVK9Qgb9SU6lngTZfAHycnAjs2ZN169blepyjj48PISEhDBw40OrnKa9cuZKX\nXnoJ0CcHOXXqlNFfApKSknj++ee5fv06AOPGjeObb74xeVvzI+Fugn5YOi6Mc4nnHnncXmVP15pd\nGeI7hKBaQTg7FGwaY+XKlQx6fRCazhpM8sZKBvV6NQEVA4j4IwJXV8l5bUkSfIXIg6IonDp1yjA8\nHR0dbRjqfJizszMdOnQgKCiIu3fvcnDyZFbmcWiEOQwCFqOf5rvPzc2N/v37ExISQkCA7azMffHF\nF1m1ahUAkyZN4tNPPy1QOeHh4QwerF/GZs7FV/mVrWSz/fx2wmLDWHFsBWkZaY/cU1pdmgH1BxDs\nG0yjCo3y/XeyevVqBgwZgKavBky5ZioLXP50oZFnI7ZEbrHYEZhCgq8Q+ZaYmGhIebl+/fpc8xuD\n/jCf1UBHC7YtFv3pfWmAv78/ISEh9O/fH0/PwmxsMr2kpCS8vLwMvfPjx49Tu3btApWlKApt2rQx\nLL7q0KEDmzZtsokvGcnaZH479hthcWFsP78913salGtAsG8wAxsMxMs97/3TR44coWmrpqT1SzNt\n4L0vC9Sr1bzU+CUWzF9ghgpEbiT4ClEAWVlZ7Nmzx9Arvp9jGfSLTW9iXCZFHTAC2Ix+Z00NYDLQ\n1Ygy6jo68v7cuTmyX9masLAwhgwZAuhzch88eLBQ5T28+GrZsmX07du30O00pTN3zrAgbgG/xv3K\n+aTzjzxur7Kn+3PdGeI7hB61euBk/+/8a2ZmJj7+PpyoegLF34wf1emgnqfmj6V/EBgYaL56hIGs\nNReiAOzt7WnZsiWTJ0/m8OHDJCQk8N1339GgQQOaYnwK40zAG9gO3AO+APoCj35U5629nR337j16\njJ4tWbJkieHPr7zySqHL8/Hx4e233zZcv/fee49dMGcNNUrX4NP2n3J29Fm2DN7CIJ9BqB3+Pbwh\nS8li7am19Fneh4rTKzI6YjSHrh5CURS+nvI1F3QX9AlJzMkFNN00DHhtgM29fsWV9HyFMKHRI0ZQ\n6YcfyP38IuM0BD4B/pPP++cDW3r1YuHq1Sao3fSuX79OxYoVDUdFXrhwgSpVqhS63IcXX33wwQdM\nmTKl0OWa0z3tPf2wdGwY0Reic72nfqn6nJpwCt0QHVhoJ5jr765MHjqZd955xzIVPsWk5yuECZ2M\njTXJ2fHXgVMYt6i1PnAkLo579+6h0+ny3LtsLStWrDAE3tatW5sk8AKUKFGCadOmGa5nzpzJsWPH\nTFK2uXg6ezLUbyjbh2zn9NunmdB6AlU8c74eRzYfQVfBcoEXIM0vjamzptrce6c4kp6vECbUukED\nvjhyhLaFKCMD6AY8BxiTufgY0Ay4P2ioUqlwcXHJ149arc73vfkt4+GDK1q0aMHu3bsBmDt3Lm++\n+WYhXqWcFEWhbdu2REfre5Ht27dn8+bNNrH4Kr+ylWy2Jmzll9hfWHV8FZrvNdAe/RshL3vRr7a7\nATQAev/z/y8CW4Gr6OdAqqF/Uz3phE0F3H92Z234Wtq1a1fwX0Y8kQRfIUyojY8Pnx8+XODgmw0M\nAFKANeR+1GBejgAt+Df4Wpu9vX2OQHx/WBigSZMmeHh4mPRLQEJCAl27djUsvlq6dCn9+pkjsaf5\nXbh+gWerPkvWuKzHvwmOow+uf6NfOHA/+J5G/y2uBvrxzfXo3xivPrluu612jG81ni+/+LLgv4B4\nIvOfqSbEU8SzRAkePXo+fxTgdfQrpddjXOAFSAQc7e3xcHVFo9GQaca0lvmRlZVFampqrgc47Nu3\nz+z19+/fn2HDhhU4oBfmi4Czs3OhciefOXYG9yruJNknPf7G+9uar6BfqXffw73lACAsf3Vnl89m\n2+5t+btZFJgEXyFMqH7TpsTt2kWv7Own3/yQEcAJYBPGnbR3XxzQp18/5i1aBOi3qWi1WtLT0wv9\no9FojL4/uwCvgamlpKSQkvLo0YCW4OTkVOAAfvDgQVJKG9HuJ41fnid/+Z8BKsLhqMP5r1sUiARf\nIUyocbNmhLu7g5Fbfs4DoYAL+tP17gsF8rshJ0atpknr1oZrBwcHHBwcCnTerylkZmaSnp7OoUOH\naNOmDaDPBBYZGYm9vb1JvhTk9sUgJSWFjIwMq/zOD9LpdOh0OpKSntB7zY0dxmVpedzU9jX0e9jy\n+0byhOS7yWRlZWFvb+z4i8gvCb5CmFCTJk14S6cjA/2pbvlVlZypIY2lANH29oxq0qQQpZiWg4MD\n7u7uREZGGv5fr169zL6QR1EU2rVrx/bt+sxSLVq0YPHixfkaBTC2h/+4n0JRYdync14939vAIvSL\nrbzzX7e9gz06nQ61Wv3k+0WBSPAVwoS8vb2pW7cuqw8exPyH3P1rK+BSpgx+fn4WrPXJFEUxeWKN\nJ1GpVMyZMwdfX1+ysrLYtWsXu3fvpn///mav+z5FUdDpdAUO5r+v+Z19WUbMi+fW800EwoG2gI8x\njYeszCzJ82xmEnyFMLG3PvyQ74cN42ULZgr63s2Nt8aNs7mtNXv37iUhQX8AfYkSJejWrZtF6q1f\nvz7vvPMOM2fOBPRnBvfo0QMPjyfttTENlUqFs7NzgQOYnZ0dsWti0aF7/I3ZQNY//81Gv+LZDv1y\n+V+BJoCxR/Ymg0dJj0ItGBNPJq+uECbWu3dvzjo7s9lC9cUA21UqXh00yEI15t+Dvd4XX3zRor2p\nTz75hPLl9TPoV69eLfDpSdbQuHFjXG66PPnGv4AvgR1APPq8pNuBg8BdYBvw1QM/+XEF6vuaIlWM\neBzZ5yuEGURERPDWSy8Rn5b2xLwGhaEFGru58eHcuTYXfDMzM6lcubJhf++mTZvo2NGSZz3B4sWL\nGThwIKDfdxwbG0v9+rYfWBITEylXsRwZH2RYvItkt9WOD1p8wNdffW3Zip8y0vMVwgy6detG+xde\n4D1n5yfuAimMjx0debZ5cwa+mo/sCRa2bds2Q+AtX768VTImvfLKK7Rtq095kpWVxahRo4pE6sSS\nJUtS7dlqcNbCFSvgetaVzoGdLVzx00eCrxBmMvOHH9hfuTKfOZhnacUcOzt+e+YZQhcutLm5XtD3\nOu/r16+fVbat3F98db/uv/76i6VLl1q8HQUx9p2xuMe5W7bSC+Bp7ympJS1Agq8QZlKiRAk27NjB\nskqVGGtvT5aJylWAb+ztmfbMM0Tt3ImXV94HsVuLVqtl1apVhmtLrHLOS7169Rg9erTh+v3337f5\noxcBBg4cSPb5bP3crYWoD6l5/533ZbGVBcgrLIQZlS9fnmVr1zIP8Ed/UlFhXAQCHR1ZXrMm0TEx\nVK9evfCNNIOIiAhDcolnn32WJlbef/zxxx9ToUIFoOgsvnJzc2PsmLG4Rrk+OYOVKZwF9VU1w14f\nZoHKhARfIcwoOztb39PKyiIe8FOp+NjenmtGlnMbmIw+le8elYq1W7ZQuXJlk7fXVB4ccn7llVes\nPizu6enJ9OnTDdezZs3iyJEjVmxR/kz4aAKVVJVQxZn59dOCa4QrC39ZiKenp3nrEoAEXyHMas6c\nOURFRekvVCp+XryYawMGUMfFhX6uriwHzvBox0ZBn3JyFRCsVlPD2Zlv3d1JBdJ0Oj7//HML/hbG\nSU5OZu3atYZraw45P6h///6GucyisvjK0dGRFYtW4LLVBaO/seVXNrisd+GFLi9YbB+2kK1GQpjN\n8ePHadSokSHV4IcffsjXX+u3byQlJRG+YAGbfv+dmNhYUtLS8HZ2xlmlQqcoXNbpcHB2xr9BA9q/\n8AKvDRnC3r17CQoKAv5JwhAbS4MGDaz2++UlPDycwYMHA+Dj40NcXJyVW/Svo0eP4uvrazjxadGi\nRQwYMMDKrXqy5cuXE/xmMJr+GjDlFH82OEc44+Pow/bN23FxycfeYmESEnyFMAOdTkfz5s05ePAg\nAA0bNmTv3r15Jpm4fv06V69eRavV4uTkRLly5ahYsWKO4VpFUejatSsbN24EoGPHjkRFRVl9SPdh\n3bt3JyIiAoDJkyczfvx4K7cop7FjxxqGoMuXL8/JkyeLxFDrkiVLeP2t19F01UBtExSYCuoINQ1L\nNyTqzyjc3S28svopJ8FXCDOYOHEiX3zxBaA/Wi4mJsYkyR2OHj2Kj4+P4bi+NWvW8MILLxS6XFO5\nefMmFSpUMBxon5CQQLVq1azbqIckJydTu3Ztrly5AsB7773HjBkzrNyq/ImOjqbvwL4klU1CE6gB\n1wIWdBTUUWqGDRnGlK+mSI/XCmTOVwgT2717N1999W8uv8mTJ5ssq1K9evV48803Ddfvv/8+Ot0T\n8v9a0G+//WYIvC1atLC5wAvg4eGRY/HV7NmzOXy4aJxf27p1a/4+/jeDmg7C5QcXnDY56Vfj5UcG\nEAce4R5UjqnM5vWbmT1jtgReK5GerxAmlJKSgq+vL2fOnAGgffv2bNq0yaT7Jm/dukXNmjUNW3mm\nT5/OmDFjTFZ+YbRu3ZodO3YA8N133zFy5Egrtyh3iqLQsWNHtm7dCkCbNm3Ytm2bzQ3hP05CQgKz\n58zm5/k/oyqtIr1cOrpyOiiD/jzLbCANVFdVuN92JyMhA79Gfnz47of06NEDBzMlfxH5I8FXCBN6\n4403CA0NBfTbWw4fPoy3d34PUs2/mTNnGgJuiRIlOH36NGXLljV5Pca4cOECVatWBfR5lK9cuUK5\ncuWs2qbHOXbsGA0bNjQsvlq4cKEhD3RRkp6ezp49ezhw4ADb92zn1OlTaLVaHBwcKFWqFC2atKBZ\nQDOaN29u+PsRNkARQpjE2rVrFfS7hBRACQ8PN1tdWq1WqVWrlqGuESNGmK2u/JoyZYqhPV26dLF2\nc/Jl7NixhjaXL19eSUxMtHaTxFNC5nyFMIGbN2/y+uuvG65ffvlls/ainJyccsxb/vjjj1ZPGvFw\nYo2iYNKkSVSsWBGAa9eu8cknn1i3QeKpIcPOQhSSoij06dOH1atXA1ChQgUOHz5MmTJlzF5vly5d\nDEk8AgMD2bhxo1XmLY8fP07dunUBcHZ25saNG0Vi+w7AsmXL6N+/P6AfLj906JBN7p8WxYv0fIUo\npLCwMEPgBZg/f77ZAy/oT+yZMWOGYTHXpk2b+PPPP81eb26WLFli+HNQUFCRCbwAffv2pUOHDoA+\n89XIkSNtPvOVKPok+ApRCAkJCbzzzjuG67feeouuXbtarP769evzxhtvGK6tsfVIUZQcwbeoDDnf\np1Kp+O677wyrf6Ojo1m0aJGVWyWKOxl2FqKAsrKyaNeunWFrTa1atTh48CBubm4WbcfNmzd57rnn\nDFuPZs6cybvvvmux+vfv3284tcjT05Nr166hVqstVr+pjBs3jqlTpwLg5eXFyZMnKVGihJVbJYor\n6fkKUUDTp083BF57e3vCw8MtHngBypYty6RJkwzXn376Kbdu3bJY/Q/2ev/zn/8UycAL+qxklSpV\nAvTpPj/++GMrt0gUZxJ8hSiAuLg4JkyYYLieOHGiVc+sHTVqFDVr1gQgMTHRYoEjKyuLpUuXGq6L\nwiEFefHw8MiRZvJ///sf8fHxVmyRKM5k2FkII6WnpxMQEGDY2tOkSRN27NiBo6OjVdv1xx9/kjqC\npQAAFfNJREFU0KtXL0B/6lFcXJzJ0lrmZevWrYbFSuXKlePy5ctFOnOSoigEBgayZcsWAFq1asX2\n7duLVOYrUTRIz1cII02YMMEQeNVqNeHh4VYPvAA9e/akY8eOAGRnZzNmzBizr9p9cG9v3759i3Tg\nhUcXX+3YsYOFCxdauVWiOJLgK4QRtm7dmmNocvr06dSqVcuKLfrXw1uPoqKiWL9+vdnq0+l0rFy5\n0nBd1FY556VOnTo5cmWPHTuWxMREK7ZIFEcSfIXIp6SkJF577TVDb7Jr1645ThiyBT4+PgwfPtxw\nPWbMGDIyMsxS14YNG7h79y4AVatWpXnz5mapxxoeXHx148YNWXwlTE6CrxD59Pbbb3Px4kUASpcu\nzfz5821yLvCzzz4zJLk4deoU33//vVnqeTidpC2+FgXl7u7OzJkzDdffffcdcXFxVmyRKG5kwZUQ\n+bBixQr69u1ruP7tt9948cUXrdiix5s+fTpjx44FoGTJkvz9998mzbqVkpKCl5cXaWlpgH71t4+P\nj8nKtwWKotCpUyc2b94MQMuWLYmOji5WXzKE9UjPV4gnuHLlSo7h5cGDB9t04AV9L/3BrUemPjDg\njz/+MATeevXqFctcyPcXX91fTLdz507Cw8Ot3CpRXEjwFeIxFEVh6NCh3LlzBwBvb29mz55t5VY9\nmZOTE9OmTTNcz507l2PHjpms/IfTSRbX3mDt2rVzLL764IMPZPGVMAkJvkI8xty5c9mwYQOg7wkt\nWLCgyKQcfOGFF3IcGPD++++bpNzbt28TGRlpuC4uq5zzMmHCBCpXrgzoF189mE1MiIKS4CtEHk6e\nPGmYNwX9oQVt27a1YouMo1KpmDlzpmHrUWRkJBEREYUud+XKlWRmZgLQtGlTnn322UKXacvc3d1z\nbC+bM2eOLL4ShSbBV4hcZGRkMGjQIDQaDQANGjTgiy++sHKrjOfj48OwYcMM16bYevTgKueinE7S\nGC+99BKBgYGAPoHJyJEjyc7OtnKrRFEmq52FyMUnn3zCp59+CujnT/fv319kV/PeuHGDmjVrkpyc\nDMCsWbNyHINojMuXL1OlShUURcHOzo7Lly9Tvnx5UzbXZp04cQIfHx/Dl5ewsDBee+01w+MajYa4\nuDgOHjzIjRs3yNBqcVarqVy5Mo0bN6Zu3bpFPgOYMCFFCJHDnj17FHt7ewVQAGXKlCnWblKhTZky\nxfD7lCpVSrl161aBypk+fbqhnMDAQBO30vaNHz/e8PuXLVtWuXLlihIWFqY0r1dPUTs4KI08PZVh\narUyCZTPQZkAykA3N6W2h4fi6uio9GjbVlm3bp2SmZlp7V9FWJn0fIV4QGpqKn5+fpw+fRqANm3a\nsGXLFuzt7a3cssLRarXUrVuXs2fPAvqtSAVZtd24cWNiYmIA+Pnnnxk6dKhJ22nrUlNTqVOnDhcv\nXsQBUDs60srZmREpKXQGnB/z3GRgJfC9hwc3XVz4bNo0Xh00qNiuFBePJ8FXiAe89dZbzJ07F9Af\nMRcfH0+1atWs2ygT+f333+nTpw+gP3/48OHD1KlTJ9/PP3XqFM8//zygH4q/fv06JUuWNEtbbdn0\n6dP5eOxYGgHzgZoFKGM38IabG1WbNOHHhQupWLGiaRspbJ5MQAjxj4iICEPgBf15rsUl8AL07t2b\ndu3asW3bNsPWo4cPXrh+/TqHDh3i5s2bZGRk4OLigre3N76+vjn29nbv3v2pDLxLFi/m64kTmQUM\nBQraZ20OHEhN5YvoaBrVqcOajRtp2rSp6RoqbJ70fIVAv3e1fv36XLt2DYA+ffrw22+/Fbshwbi4\nOPz8/AyHQ/z555+4uroSOnMm26OjSU1Lo5GzMxWys3FQFLR2dpxRqTiSloYLkJKZSQawbNmyHOk2\nnwa//vIL/x05kkiNBlOekvwnMMTNjTVRUcXqcArxeBJ8xVNPURRefvllw/F4Xl5eHDlyhGeeecbK\nLTOPkJAQ5s2bB0ApBwcquLgwIjWV7opCdXLvzemAI0A48BPQrFkzvpo9m4CAAIu125o2btzIa717\ns1WjobYZyo8Agj082HXoEDVq1DBDDcLWSPAVT73w8HAGDx5suF63bh09evSwYovM69ChQ7QLCMAr\nK4tQoC3GDZ+mAwuB/6rVDB0xgk+++gpn58ctNSraEhMTaVCjBmF37tDRjPXMsLNjjZ8fW/ftMyRG\nEcWX/A2Lp9r58+cZNWqU4fqNN94o1oF348aNdGnThvcUhaNAO4yft3QBhgHxGg0n584loG5dLl++\nbOqm2owxI0YQlJpq1sALMDo7m8wTJ5hTBHKHi8KTnq94amVnZ9OhQwf++usvAGrWrMmhQ4dwd3e3\ncsvMY926dQzt25dVGg2tTFSmAky1t+eHZ55h2759eHt7m6hk2xAfH0+35s05kZaGhwXqOwk0d3Xl\nwvXrxfZ9KPSk5yueWjNnzjQEXjs7O8LDw4vtB96uXbsY2q8f60wYeEHfax6XlcWoW7fo1LJlsTvx\n5/sZM3hTq7VI4AV4HminUrFo4UIL1SisRXq+4ql0+PBhGjdujE6nA2DixIl89tlnVm6VeaSmptKw\nZk2mX7tGLzPW86azM7r//If5D2xJKsru3btHVS8vjqWnU8GC9W4CxlSvTtyZM8Vutb34l/R8xVNH\nq9Xy6quvGgKvv78/EydOtHKrzOf/xoyhRVKSWQMvwFStlq1//PHI3uGiatOmTTR3cjI68J4DugOl\ngQrA20CWEc/vANy6do2EhAQjaxZFiQRf8dSZNGkS8fHxALi4uLBw4UIcHR2t3CrzOHr0KMvDw/n2\nn9OZzMkD+CktjVFDh5KVZUy4sU0H9uyhSUqK0c97C/ACrgGxwF/A90Y83w4IcHAwpPEUxZMEX/FU\n2b59O1OnTjVcT506ldq1zbFz0zZ8P2MGb+p0lLZQfR2BsmlpJjk32Npitm/HvwDHBp4D+gFO6INw\nV+CokWU0TkkhZu9eo+sWRYfM+Yoi6dq1axw4cICY/fs5f+IE6WlpODg68kzFivg1bYq/vz/PP/98\njgMR7t27h4+PD+fPnwegc+fOREREFNs9lcnJyVT18uKwRkMlC9YbBixv3Zr127dbsFbTq+HlReSN\nGzxn5PNCgV3AXOAO+uD7BRg17L8CWBoYyMqoKCNrF0WF5HYWRUZqaipLlizh+2++4fzFi/g7O+Of\nmkrLrCyc0c+rXQf+/PVXPgXuqVQMHT6cN0aNonr16owePdoQeEuVKsX8+fOLbeAFWL9+PS0cHAoU\neNsBe/n3A6IycDyfz+0HvL13L4mJiVbL/5yRkUFycjL37t0jOTnZ8GPM9fWbN3EtQN2t0QdgT/Tv\nyWCMC7wAroAmLa0AtYuiQoKvsHlZWVnMnjmTLz7+mFZ2dkxOSaETYKfV5v6Ef+bpTgM/fPcdAd9/\nT/0GDfhr/37DLT/88AOVKlmyP2h5B3bvpnkB5ixBv4VoDvrDA4ylBnxcXDh48CAdOnTI13MURUGj\n0RgVKB93jzav94YRXDFuoRRANvqe7pvoTy5KRv8afgh8Y0Q5mYCDg3w8F2fytyts2qlTpxjarx92\np0+zOy2NWkY89zlguk7H58B/9+9nH6ABBg4c+FQcChATHc24QswqFWY+yjctjf/Nns2+ffvyHUxt\nbZGWA3ALMCZtyB3gIjAKcES/4jkYmIhxwfc2ULJMGSOeIYoaCb7CZm3bto2+PXsyIS2NUdnZBV4d\n6ArMBPoDL6lUlHZ3R1GUYr+H8vjffxfq9J3/A8ajT/zwJfoc0PnVMDOTsDVrWL1mTSFaUHB2dnZ4\nenri4eFh+DH2euKYMRyKjKSREfU+A1RHP9/7Pvqe769AQyPbf9DZGd9WpkyHImyNBF9hk7Zt20bf\nHj1YnpZGOxOV2RSIVRS6hYczxs6OGXPmFOsAnKbTUdB8Xd8A9dCv2F0C9ES/bebZfD7fA7B/4l05\nOTs75xkIjQ2earW60H+3rbp0IWbrVl43cgh7FfAu8DX616Aj+i9/xohxduZlf38jnyWKEgm+wuac\nPn2avj17mjTw3lcG2JiWRrsFC5hdsyajx4wxcQ3WoSgKd+7c4dy5cyQkJHDu3DkyMzIKPHTc5IE/\nD0YfgNejH07Nj2ygqrc33fr1y1fg9PDwwMnJqYCtNY8WLVrwg6MjilZr1OETDYGthaj3DnBMq8XP\nz68QpQhbJ8FX2JTs7GyG9uvHf80QeO8rCaxMTaXphAl0CwqiVi1jZpKtJykpyRBYH/7vuXPnSE5O\nznG/K5AIlLJGW4HmrVszZcoUK9RuGgEBATiUKcO2lBTaW7DeMJWKF3r0wNPT04K1CkuT4CtsyuyZ\nM+HUKd4uQHIDY9QAJmm1DOnbl+0xMTn2A1tLSkpKnoE1ISHB6EMLHIB49HOQxkgC9qCf43UAlgHR\nwP+MKCPOxYUGTZsaWbNtUalUvPXBB3z/4Ye0T021SJ3ZwFxXVxaMHWuR+oT1SJINYTPS0tLwLleO\nnampPG+B+rKBJu7uTAgPp3fv3mavT6PR5AimD//51q1bhSrfzc2N6tWrU61aNapVq8bJY8cI2LqV\nL438J34LfW7iE+jnLOsAn4NR59n6e3ryv4gIWrRoYVTdtubevXs87+3NqqQkmlugvlCVil/q1WNX\nfHyxXo8gpOcrbMjSpUtpplJZJPCCPrfq6JQU5k6ZYpLgq9VquXDhQp491+vXrxeqfBcXF6pVq5Yj\nwN7/c/Xq1SlTpkyOD+y1a9cybf9+eGg4+kmeAfYVop2JwKn0dBo2NHaNr+3x9PTkfz/9xJDgYA6l\npqI2Y13ngf+6uLBt6VIJvE8B6fkKmxFQuzafnTxJNwvWmQ54u7iw6/Bhatas+dh7MzIyuHjxYp49\n1ytXrlCYf05OTk5UrVo118BarVo1vLy8jPpQ1mq1VC1Xjm337mHJ7NWzVCr29uzJYittMzKHvkFB\neEVFMVunM2rxVX7pgC6urnQeP57/K8YnbIl/SfAVNuHmzZvUqlKF21qtUft53SHHh6EG/akys40o\nI8TFBZ+pUxkxYgSXL1/Os+d66dIlsgsxF21vb4+3t3eugbV69epUqFDB5Oku/ztuHKmzZvHtP8cn\nmpsC1HZz4+fISFoVo32qd+7coU3jxvS/eJEJmZkmLTsDGKRWo2nZkpUREZLZ6ikhwVfYhMjISKb2\n78/mpKQCl5EKlAciAGM+9kOBCW5u3NVqySzEB6udnR2VK1fOs+daqVIli3+wXrhwgUa1axOj0VDV\nAvUtAqY/9xwxJ08Wu6HTq1evEti8Od2vXGFyRoZJ5uySgMFqNbqAAH7fsAEXFxcTlCqKAvmKJWzC\ngX378C/kitLf0B/hZmx/yx9IT00lP2G3YsWKefZcK1eubHN7Vb29vRn70UcM+/prNqammmXI9L6r\nwHtqNesXLy52gRegQoUK/HXgAAN796ZZbCxhqamFyiC2ARju6kr3l19mdmiozb13hHlJz1fYhOED\nB9J48WLeKEQZHdCfxjPJyOclAeXQz7t5eXnl2XP19vYukj2TzMxMWjRsyGvHjzPSTP/cs4FeajU+\nI0fy5QPnJRdHiqLw87x5/N+YMQzIyGCkTpfvnOMK+m1cs9Rqdru58dPixXTq1MmMrRW2SoKvsAmD\n+/Qh8PffGVzA559Hv3f3DBg9vKoFPOzsSExOxtW1IIfI2b5Tp07RtkkT5iQl0cfEZSvASGdnjtav\nz8adO3F2djZxDbbp8uXLzPn2W37+8Ud8gKDkZPwBX8iR1vM2EAPEqFQsd3MjxcODEWPGMCwkRBJp\nPMUk+Aqb8Hr//rRYtozXC/j8L4DNFCytXwpQ3smJFBMcQ2fLYmJi6NGhA1OTkxlkon/2OuAtFxeO\n1KzJxp07n8pgotVqWb16NX9t2EDMrl0cOXsWR5UKJzs7tNnZYGdHozp18G/Vis5BQQQGBhbrc6RF\n/sicr7AJZSpW5JpKBQUMCguAjwpY93WgjIdHAZ9ddPj7+7Np5056d+7MxsREZmk0lC5EebFAsJsb\n3k2bsmnNGtzdC3qMQ9Hm7OxMv3796NevH6Af5k9OTkan0+Hi4oKHh4cEW/EIeUcIm9CoSRMOFvDD\nexdwBXi5gHXHAI2KQUKI/Khfvz7xf/9Nmddeo4FazY/oe/7GuACMc3Sks7s7786ezZpNm57awJsb\nBwcHSpUqhZeXFyVKlJDAK3Il7wphE/z9/Ykp4B7aBcCLgFsB645xcMC/rTGn1RZtrq6ufDt3Lis2\nbSKiY0equrjwjpMTEcCNXO5XgL/Rn2zU280NP1dXtEOHcujECYKHDi2WK5uFMDeZ8xU2ITs7m0ql\nS7M5KYm6FqxXARq6uzN77VratWtnwZptx4ULF/hl3jyiIyOJOXoUd5WK8o6OOABaReFsejolPDzw\n9/WlW9++DBg4EDe3gn7VEUKABF9hQyaOH0/St98y24ILn3YCQytW5PjFizI8iH4bTUJCArdv3zbM\nWXp7e1O2bFlrN02IYkWCr7AZFy9epOFzz3Feq8VSy58GuLrS5PPPeXfMGAvVKIQQMucrbEiVKlXo\n2bMnkyy0T3QnsNXRkeChQy1SnxBC3CfBV9iUGT/8wDK1mh1mrkcDDHF1Zc78+ZQsWdLMtQkhRE4S\nfIVNKVOmDN//8guvubpy00x1KMC7zs74BwbSp4+p8z0JIcSTSfAVNqd3794MGDWKLm5u3DZx2Qow\n3tGRmOrV+TE83MSlCyFE/kjwFTbps6+/pnNICG1cXTlhojLTgBBnZzbXqEFkdPRTmQpRCGEbJPgK\nm6RSqfh6xgzenjKFVq6uTLO3J6sQ5e0AGrq6ktq1K1v27uWZZ54xVVOFEMJostVI2LyzZ88ytF8/\nEk+c4J2UFPoD+Tl7SAGigTmurkQ7OfH9L7/Qu3dv8zZWCCHyQYKvKBKys7OJjIxk7tSp7N6zh552\ndjROS8MfeA5wATLQH5JwEDjg4MAGFxeySpbkrQ8+YPBrr1GiRAlr/gpCCGEgwVcUOefOnSMyMpKY\n6Ghi9u4l4coVtJmZONrbU8bDAz9fX/zbtqV1mza0atVKcg8LIWyOBF8hhBDCwmTBlRBCCGFhEnyF\nEEIIC5PgK4QQQliYBF8hhBDCwiT4CiGEEBYmwVcIIYSwMAm+QgghhIVJ8BVCCCEsTIKvEEIIYWES\nfIUQQggLk+ArhBBCWJgEXyGEEMLCJPgKIYQQFibBVwghhLAwCb5CCCGEhUnwFUIIISxMgq8QQghh\nYRJ8hRBCCAuT4CuEEEJYmARfIYQQwsIk+AohhBAWJsFXCCGEsDAJvkIIIYSFSfAVQgghLEyCrxBC\nCGFhEnyFEEIIC5PgK4QQQliYBF8hhBDCwiT4CiGEEBYmwVcIIYSwMAm+QgghhIVJ8BVCCCEsTIKv\nEEIIYWESfIUQQggLk+ArhBBCWJgEXyGEEMLCJPgKIYQQFibBVwghhLAwCb5CCCGEhUnwFUIIISxM\ngq8QQghhYRJ8hRBCCAuT4CuEEEJYmARfIYQQwsIk+AohhBAW9v+m+T2J9/4gWwAAAABJRU5ErkJg\ngg==\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"# find a trail with distinct nodes for visibility reasons\n",
"i = 0\n",
"for trail in trails:\n",
" if len(trail) == len(set(trail)):\n",
" break\n",
" i += 1\n",
"\n",
"node_colors=[]\n",
"for n in g.nodes():\n",
" if n in trails[i]:\n",
" node_colors.append('g')\n",
" else:\n",
" node_colors.append('r')\n",
" \n",
"edge_colors=[]\n",
"for e in g.edges():\n",
" try:\n",
" idx1 = trails[i].index(e[0])\n",
" idx2 = trails[i].index(e[1])\n",
" if idx1 + 1 == idx2:\n",
" edge_colors.append('g')\n",
" elif idx2 + 1 == idx1:\n",
" edge_colors.append('g')\n",
" else:\n",
" edge_colors.append('black')\n",
" except:\n",
" edge_colors.append('black')\n",
" continue\n",
" \n",
"nx.draw(g, with_labels=True, node_size=1000, node_color = node_colors, edge_color = edge_colors, width=3)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"###Hypotheses\n",
"\n",
"Now, having the data to study, we want to compare some exemplary hypotheses with each other. Each hypothesis should express a certain belief about the mechanisms producing the trails at hand. Remember that each hypothesis can be expressed via belief in parameters of a Markov chain model. We define some hypotheses next."
]
},
{
"cell_type": "code",
"execution_count": 45,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
"import matplotlib.pyplot as plt\n",
"from scipy.sparse import csr_matrix, lil_matrix"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Structural hypothesis\n",
"\n",
"With this hypothesis we want to express our belief that the trails at interest have been generated by humans (or in this case a walker) that randomly chooses hyperlinks to go to the next node---this means that we do not believe in teleportation here."
]
},
{
"cell_type": "code",
"execution_count": 46,
"metadata": {
"collapsed": false
},
"outputs": [],
"source": [
"from sklearn.preprocessing import normalize\n",
"def struc_prior(paths, vocab, g, ax):\n",
"\n",
" # We start by creating the hypothesis matrix G\n",
" i_indices = list()\n",
" j_indices = list()\n",
" values = list()\n",
" # Let us iterate through all nodes\n",
" for k,v in vocab.iteritems():\n",
" # Get the neighbors of each node (i.e., those nodes the current node links to)\n",
" # and set the corresponding value of the hypothesis matrix G to 1\n",
" for w in g.neighbors(k):\n",
" i_indices.append(v)\n",
" j_indices.append(vocab[w])\n",
" values.append(1)\n",
"\n",
" shape_matrix = (max(vocab.itervalues()) + 1, max(vocab.itervalues()) + 1)\n",
" \n",
" # Next we iterate through some values of k (hypothesis weighting factor)\n",
" evidences = {}\n",
" shape = len(vocab)\n",
" for i in xrange(5):\n",
" # If k = 0 then we can simply use an empty matrix\n",
" if i == 0:\n",
" prior = csr_matrix((shape,shape), dtype=np.float64)\n",
" # Otherwise, we need to build the hypothesis matrix and elicit the prior\n",
" else:\n",
" # Creating the matrix with above defined values\n",
" matrix_struc = csr_matrix((values, (i_indices, j_indices)),\n",
" shape=shape_matrix, dtype=np.float64)\n",
"\n",
" # Here we elicit the Dirichlet prior from expressed hypothesis matrix\n",
" # We use the row-wise (trial) roulette chip distribution (i.e., same amount of chips for each row)\n",
" # chips = number of chips to distribute PER ROW\n",
" # The HypTrails paper suggests to distribute |S|*k chips per row.\n",
" # As we ignore self-loops, we distribute (|S|-1)*k chips per row.\n",
" chips = i*(matrix_struc.shape[0]-1.)\n",
" prior = distr_chips_row(matrix_struc, chips, n_jobs=1)\n",
"\n",
" # Now, we can pass everything to the Markov chain framework and calculate corresponding evidences\n",
" # k=1 corresponds to the order of the MC (first-order)\n",
" # reset=False can be set to true if we want to work with a reset state (start end end state for each trail)\n",
" # prior=1. corresponds to the initial uniform prior that is necessary for ensuring proper priors\n",
" # specific_prior is our elicited prior\n",
" # specific_prior_vocab is the vocabulary mapping the indices of the prior to the states\n",
" # state_count is the number of states; this ensures the correct number of states (suggested to always set)\n",
" markov = MarkovChain(k=1, use_prior=True, reset = False, prior=1., specific_prior=prior,\n",
" specific_prior_vocab = vocab, state_count=len(vocab), modus=\"bayes\")\n",
" markov.prepare_data(paths)\n",
" markov.fit(paths)\n",
"\n",
" evidence = markov.bayesian_evidence()\n",
" evidences[i] = evidence\n",
" \n",
" ax.plot(evidences.keys(), evidences.values(), marker='o', clip_on = False, label=\"structural\", linestyle='--')\n",
" return evidences"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Self-loop hypothesis\n",
"\n",
"With this hypothesis, we express the belief that all consecutive steps of a trail consist of the same state. This would simply mean that a walker prefers to consecutively \"refresh\" the same node over and over. "
]
},
{
"cell_type": "code",
"execution_count": 47,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
"def selfloop_prior(paths, vocab, ax):\n",
" \n",
" #The steps are similar to the structural hypothesis described above\n",
" shape = len(vocab)\n",
" evidences = {}\n",
" for i in xrange(5):\n",
" if i == 0:\n",
" prior = csr_matrix((shape,shape), dtype=np.float64)\n",
"\n",
" else:\n",
" matrix_selfloop = lil_matrix((shape,shape), dtype=np.float64)\n",
" # As we only believe in self-loops we only believe in transitions from the diagonal of Q\n",
" matrix_selfloop.setdiag(1)\n",
" matrix_selfloop = matrix_selfloop.tocsr()\n",
"\n",
" chips = i*(matrix_selfloop.shape[0]-1.)\n",
" prior = distr_chips_row(matrix_selfloop, chips, n_jobs=1)\n",
"\n",
" markov = MarkovChain(k=1, use_prior=True, reset = False, prior=1., specific_prior=prior,\n",
" specific_prior_vocab = vocab, state_count=len(vocab), modus=\"bayes\")\n",
" markov.prepare_data(paths)\n",
" markov.fit(paths)\n",
"\n",
" evidence = markov.bayesian_evidence()\n",
" evidences[i] = evidence\n",
"\n",
" ax.plot(evidences.keys(), evidences.values(), marker='o', clip_on = False, label=\"self-loop\", linestyle='-.')\n",
" return evidences"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Uniform hypothesis\n",
"\n",
"We also introduce a uniform hypothesis which should serve as a baseline hypothesis. With this hypothesis, we believe that all transitions are equally likely and thus, we believe that the walker walked randomly through the network. If another hypothesis is not more plausible compared to this uniform one, we might not expect it to explain the underlying mechanisms well. Note though, that a uniform hypothesis might also be a legit mechanism to be interested in itself; for instance in case of teleportation through the network."
]
},
{
"cell_type": "code",
"execution_count": 48,
"metadata": {
"collapsed": false
},
"outputs": [],
"source": [
"def uniform_prior(paths, vocab, ax):\n",
"\n",
" # In this case we set each element of the hypothesis matrix to the same value\n",
" # We only set the diagonal to zero as we do not consider self-loops\n",
" shape = len(vocab)\n",
" evidences = {}\n",
" for i in xrange(5):\n",
" if i == 0:\n",
" prior = csr_matrix((shape,shape), dtype=np.float64)\n",
" else:\n",
" matrix_uniform = lil_matrix((shape,shape), dtype=np.float64)\n",
" matrix_uniform[:] = 1.\n",
" matrix_uniform.setdiag(0.)\n",
" matrix_uniform = matrix_uniform.tocsr()\n",
"\n",
" chips = i*(matrix_uniform.shape[0]-1.)\n",
" prior = distr_chips_row(matrix_uniform, chips, n_jobs=1)\n",
"\n",
" markov = MarkovChain(k=1, use_prior=True, reset = False, prior=1., specific_prior=prior,\n",
" specific_prior_vocab = vocab, state_count=len(vocab), modus=\"bayes\")\n",
" \n",
" # If we consider self-loops, the whole process can be done more elegantly. In that case, all elicited\n",
" # Dirichlet pseudo counts receive the same value. Thus, we can directly incorporate this into inference\n",
" # via the prior parameter of the MarkovChain class as this is the pseudo count that each\n",
" # single transition receives.\n",
" # markov = pt.MarkovChain(k=1, use_prior=True, reset = False, prior=1.+i, specific_prior=prior,\n",
" # specific_prior_vocab = vocab, modus=\"bayes\")\n",
" \n",
" markov.prepare_data(paths)\n",
" markov.fit(paths)\n",
" evidence = markov.bayesian_evidence()\n",
" evidences[i] = evidence\n",
"\n",
" ax.plot(evidences.keys(), evidences.values(), marker='o', clip_on = False, label=\"uniform\", linestyle='-')\n",
" return evidences\n",
"\n",
" "
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Data hypothesis\n",
"\n",
"Finally, we express a data hypothesis, which is basically a hypothesis that exactly expresses the data. Thus, this can be seen as an upper limit. We can determine the data hypothesis by taking the MLE of the MC of the data. Note that extracting information from the data and use it as a hypothesis is no valid approach and this example should only provide a better understanding of the relative behavior of various hypotheses."
]
},
{
"cell_type": "code",
"execution_count": 49,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
"def data_prior(paths, vocab, ax):\n",
" \n",
" # Again we start by generating the hypothesis matrix G\n",
" shape_matrix = (max(vocab.itervalues()) + 1, max(vocab.itervalues()) + 1)\n",
" evidences = {}\n",
" shape = len(vocab)\n",
" for i in xrange(5):\n",
" if i == 0:\n",
" prior = csr_matrix((shape,shape), dtype=np.float64)\n",
" else:\n",
" # We first calculate the MLE for the data\n",
" markov = MarkovChain(k=1, use_prior=False, reset = False, modus=\"mle\")\n",
" markov.prepare_data(paths)\n",
" markov.fit(paths)\n",
" mle = markov.transition_dict_norm_\n",
" \n",
" # Now we use the parameter configuration from the MLE as a hypothesis\n",
" i_indices = list()\n",
" j_indices = list()\n",
" values = list()\n",
" for s,targets in mle.iteritems():\n",
" for t, v in targets.iteritems():\n",
" i_indices.append(vocab[s[0]])\n",
" j_indices.append(vocab[t])\n",
" values.append(v)\n",
"\n",
" matrix_data = csr_matrix((values, (i_indices, j_indices)),\n",
" shape=shape_matrix, dtype=np.float64)\n",
" \n",
" # Typical chip distribution\n",
" chips = i*(matrix_data.shape[0]-1.)\n",
" prior = distr_chips_row(matrix_data, chips, n_jobs=1)\n",
"\n",
" markov = MarkovChain(k=1, use_prior=True, reset = False, prior=1., specific_prior=prior,\n",
" specific_prior_vocab = vocab, state_count=len(vocab), modus=\"bayes\")\n",
" markov.prepare_data(paths)\n",
" markov.fit(paths)\n",
"\n",
" evidence = markov.bayesian_evidence()\n",
" evidences[i] = evidence\n",
"\n",
" ax.plot(evidences.keys(), evidences.values(), marker='o', clip_on = False, label=\"data\", linestyle='--')\n",
" return evidences"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"###Comparison\n",
"\n",
"Next, we calculate the evidence for each hypothesis and each hypothesis weighting factor k. We plot the final results."
]
},
{
"cell_type": "code",
"execution_count": 50,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": [
"# This is a simple pipeline for the calculation\n",
"def calc(paths, g):\n",
"\n",
" # First, we need to define the different states that we are interested in and\n",
" # over which we build our hypotheses. In this case, these are simply all nodes\n",
" # of the network. Note that this might also include states that cannot be observed\n",
" # in the data.\n",
" states = set()\n",
" for n in g.nodes():\n",
" states.add(n)\n",
" \n",
" # In this step we build a vocabulary which is important for the HypTrails framework\n",
" # Concretely, we assign an index to each state. So for example, \"Node 1\": \"0\"\n",
" # This should match the indices of the matrices that we work with to their corresponding states\n",
" # Thus, this matching has to be kept in mind throughout all steps that follow\n",
" vocab = dict(((t, i) for i, t in enumerate(states)))\n",
" \n",
" # Figure for plotting\n",
" fig = plt.figure()\n",
" ax = fig.add_subplot(111)\n",
"\n",
" # Now, let us calculate the evidences\n",
" print \"UNIFORM\"\n",
" print \"-------\"\n",
" ret = uniform_prior(paths, vocab, ax)\n",
" \n",
" print \"DATA\"\n",
" print \"-------\"\n",
" ret = data_prior(paths, vocab, ax)\n",
"\n",
" print \"STRUCTURAL\"\n",
" print \"-------\"\n",
" ret = struc_prior(paths, vocab, g, ax)\n",
" \n",
" print \"SELF-LOOP\"\n",
" print \"-------\"\n",
" ret = selfloop_prior(paths, vocab, ax)\n",
"\n",
" # Further plotting\n",
" ax.set_xlabel(\"hypothesis weighting factor k\")\n",
" ax.set_ylabel(\"marginal likelihood / evidence\")\n",
"\n",
" plt.legend(loc=7, handlelength = 3)\n",
" plt.grid(False)\n",
" ax.xaxis.grid(True)\n",
" plt.tight_layout(pad=0.2)\n",
" plt.show()"
]
},
{
"cell_type": "code",
"execution_count": 51,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"UNIFORM\n",
"-------\n",
"DATA\n",
"-------\n",
"STRUCTURAL\n",
"-------\n",
"SELF-LOOP\n",
"-------\n"
]
},
{
"data": {
"image/png": "iVBORw0KGgoAAAANSUhEUgAAAbsAAAEsCAYAAABaCh3lAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAIABJREFUeJzsnXd4VVX2v98dElJIIJQQQkgIBqSKIIIdA45GwAL6VUBE\nsMyoCMEZxkFBJM6gY50R+KEyI7YRsYxiC1IUAo4NRRAEpIRepZNC+vr9cW7CTe4N3ITccsJ6n2c/\nOWeffc7+3EO4K3uvtdc2IoKiKIqi1GWC/C1AURRFUbyNGjtFURSlzqPGTlEURanzqLFTFEVR6jxq\n7BRFUZQ6jxo7RVEUpc4TcMbOGJNujNlljFnpKP2crj1ijNlkjPnVGHONU30PY8wax7Wp/lGuKIqi\nBCoBZ+wAAf4hIt0d5XMAY0wnYDDQCbgWeNEYYxz3vATcLSLtgHbGmGv9IVxRFEUJTALR2AEYN3U3\nAnNEpEhEtgGbgYuMMXFAlIgsd7R7ExjoG5mKoiiKHQhUYzfGGPOzMWaWMSbaUdcS2OXUZhcQ76Z+\nt6NeURRFUQAI9kenxphFQAs3lyZiTUn+1XH+N+B54O5a6FPzoimKotgcEXE383da/DKyE5GrReQ8\nN+UTEflNHACvAL0ct+0GEpwe0wprRLfbcexcv7uKfm1XRowY4XcNZ5t21a3aVXdgljMh4KYxHT64\nMgYBaxzHnwBDjDH1jTFtgHbAchHZBxw3xlzkCFgZDnzkU9FeJCkpyd8Saoxdtatu32NX7arbPvhl\nGvM0PG2M6YYVlbkVuBdARNYZY94D1gHFwCg5aepHAa8D4cA8EZnvc9WKoihKwBJwxk5E7jjFtSeB\nJ93UrwDO86YufxEdHX36RgGKXbWrbt9jV+2q2z4E3DSmUpFu3br5W0KNsat21e177KpdddsHc6ZO\nP7tgjJGz5bMqiqLURYwxiJ2iMRVFURTFl6ixC3AyMzP9LaHG2FW76vY9dtWuuu2DGjtFURSlzqM+\nO0VRFMUWqM9OURRFUU6BGrsAx85z63bVrrp9j121q277oMZOURRFqfOoz05RFEWxBeqzUxRFUZRT\noMYuwLHz3Lpdtatu32NX7arbPqixUxRFUeo86rNTFEVRbIH67BRFURTlFKixC3DsPLduV+2q2/fY\nVbvqtg9q7BRFUZQ6j/rsFEVRFFugPjtFURRFOQVq7AIcO8+t21W76vY9dtWuun1DxqIMUu9MBcC0\nM/NNrOlf3WcE17oqRVEURaklMhZlMHbGWLK6Z1kVt5PKJySbWIPsl3mePkd9doqiKIpXKCkt4Wj+\nUXIKc8guzLZ+FmQTUi+ElKQUl/Zbj2zl4S8fJrsgu/yeDe9toF6LE3T4Hn7MgguT4deLIGc582WT\n9PNUi47sFEVRFESEvKI8cgpzKCotolXDVi5tDuQeYOaKmeVGq8yANW/QnJeve9ml/boD6+j9em+i\n6kcRWT+SqNAooupH0Tmms1tj1yisETd1uKm8bWT9SO6ZM4R2n2/i3SNggB+yYPBhWBBOfHU+nxq7\nACczM5OUlBR/y6gRdtWuun2P3bRnLMpg2tvT2L93P7FxsaTdlsaAqwf4WxY5hTl8ueXLCqOonMIc\nIkIiGH/5+PJ2Ze8763AWvV/vTXZBNrlFuYTWCyUqNIqusV1ZNHyRy/MF4UTRCaLDomnVsFW5EYuN\njHWr57zY8zgy/giIwIkTkJtrlZwcOHYMGjWq0L5JeBMG/yLw8//K2178/XZezK/43HePwCV5xFXn\n3aixUxRFqQYVfEgCJEHWDMufdDqDV1xazI5jOyoYouzCbAyGmzvd7NJ+X84+Rn400mUaMKZBDGtH\nrXVpn12QzayVs6yRkdNoqnF4Y7d6Ehsl8v0935e3rVdSahmiMqPUoEGF9s0bNOeJgstgxS+Q8xvk\nbj1pvMaEwEUXuXYydCi89x7Ur289r0EDiIyE6dOhb1/X9iUl1vUWLaBBA8IXLYSdu1yaxRSyt4rX\n7Bb12SmKopwCEeFE8QkiQiIASL0zlW8KF9Lhe2hQDLnBlg8p6mgcvYb3Irswm4iQCD4d+qnLs/Zm\n7+XSVy91MUatoloxtd9Ul/Ynik6QuS2zwhRgZHAEUSX1iIhoBKGhroKXLYP1608aoTLDNWIE9Ozp\n2v6+++Ddd602IicN0syZcN11ru1nzYJff7UMkrPxuvJKSEx0bZ+fDyEhUK/ead+1Ox5NTWXKwoWA\nNY1Z9i3eH+bPE/XZKYqiuCAi5BblcjT/qFufVHZBNvd8eg8H8w6Wl0N5h4hpEMPOP+4E4PiO3fRf\naU2llTH4MKzuGMSI80dYI6nQaCgthaCKq7viouLYesUHsGmTZVyOOhmk5iugR48K7cNDwun3SqY1\nMiozXvn5EB4Or70Gt97q+iHXroWVK08aocaNoVUriI52/1KefNIqDRpYoy9zmjXbd9996uuVCQur\nXvtKXJOWxsSsLJ7IyiqvuweydsD06jwnIEd2xpgxwCigBMgQkfGO+keAuxz1aSKy0FHfA3gdCAPm\nichYN8+05cjObr4MZ+yqXXX7nppoLwuoOJh3kMMnDtM9rrtLm4LiAvq/3Z9DeYfKjVe9oHrER8Wz\nccxGl/bFpcV8sO4DmoY1JrYolJj8IKJzSwk7lgMdO8I553BtfDPm7zlk6QbKVD9UL4hnm8eeNF7/\n/jfcdZer8KlT4euvK46MGjSAG2+Erl1d2+/eDQUFJ41XeLiLEa0udvtdWZaRwaLp05myYAH9YP4O\nmP6LeL7sAAJwZGeM6QPcAHQVkSJjTIyjvhMwGOgExANfGGPaOSzYS8DdIrLcGDPPGHOtiMz312dQ\nFKV6iAi5hbnWSOqEZZiuPudqTKVRRqmU0uNfPTiQe4CDeQcJMkE0i2hGTIMYfvj9DwSZikagfr36\nTOj1Z2ILgmmWZ4jOKyHsWC4cPAirVkG3bhXaBwcFM/j1H+CFFyzD0rTpyfLgg3DOObRrGgcOY+dM\nUXIyLF5y0ogFV/H1OnasVTwlvlpBh3WS3gMG0HvAAKYYQ3WmLp0JuJGdMeY94GURWVyp/hGgVESe\ndpzPB9KB7cBiEenoqB8CpIjIfZXut+XITlHsSNmIy3kq8JbOtxAc5GoA2k1vx67jVgBCTEQMTSOa\n0iyiGZ8N/YzQYFef1C9rM2l2IIfoXIfhOnTIKikpVqnMI4/Aq69WNFxNm8Ltt0OfPm7E51nTeVUY\nK2cfkjOTUlP523z9G9ubnEluzIAb2QHtgN7GmCeBfODPIvIj0BL4zqndLqwRXpHjuIzdjnpFOSso\nC4MvkAJCTWith8GXGS7nqcCDeQe5+4K7y4M2nGn1j1YcOnGIZhHNykvT8KZc3/56IutHurT/6so3\nabx5F6HHciyjtfWg9TPiM7jZNUKxy8KV8J//nDRazZpZP90FawD8/e9W8ZQI18/kjDsf0oTkZK4d\nM8bzPhSf4xdjZ4xZBLRwc2kilqbGInKxMaYn8B5wTm30m56eXn6ckpJiizlru82tO2NX7XbSXSEM\nfisehcHvPr6b33J/qzBleDDvIA9e/CDRYa5BDN1e7saJ4hPlRqvMgBWWFLo1dllXfULoN99bBmuH\nY9R18CAcfMuK/KtEizVbyPx//4+U9u1PGrA2baBtW/cf+o9/tIqf6D3Aeq+Tpk9n5759JLRowbVj\nxpTX2wG7/I5nZmbWWh5Pvxg7Ebm6qmvGmPuBDx3tfjDGlBpjmmGN2BKcmrbCGtHtdhw71+9292xn\nY6codYFpb09jf4MsLvwPFOVASCT8elEWo6aN4ruLvyMuynXd7bAPh3E0/2iFUVeziGaUSqnbPjZe\nOgc++gg2OYzWoQNw6Fe4aRo89phL+9A9+y1/WNOmVhRgt27WcceO7j/EsGGWX8oGX75llPmQ7GI0\n7ErlQcnjjz9e42cFos/uXqCliEw2xpwLfCEiiY4AlbeBXjgCVIC2IiLGmO+BNGA5kAFMqxygoj47\nxc4czT9KWHAYYcEVw7gvuaoLiSvXVgyDbwyrz43lf598T9PmrV0f9s038MorDsN16GS55RZ48UXX\n9t99BwsXuk4btmoFMTG1/EkVpWrOxGcXiMYuBHgV6AYUAuNEJNNxbQLW0oNiYKyILHDUly09CMda\nepDm5rlq7BRb8OWWL/l217dsOryJTYc2senwJvKL85l32zyuaH1FhbbOYfDOTASeuO8+eOkl1w7W\nr7dC38uMVllp0sRa/KsoAUqd2rxVRIpEZLiInCciPcoMnePakyLSVkQ6lBk6R/0KR/u27gydnbHb\nvlPO2FW7N3XnFOawat8q3l/7PhsPua7zAlh/cD35uce5nvbMrDeQzYzl+L67uGL2Vy5t2zU9OU2Z\n6VR//Lwu7g0dWNOJ99wDAwfCFVdAp04QG+tXQ6e/K77FrrrPhECMxlSUOsUbq97g1VWvsunQJo7m\nHyW5STLtmrSjRf0mnNv0XJf2o6UnDBxnTRMmJ1uBGsnJcMEFLm0bxbWENb+41Ee31IBkRXEm4KYx\nvYVOYyq1yYmiE2QdyWLToU1sPryZTYc30SepD0PPG+rSdnXWN9T7NINWBwpouPsAZnMWZGVB8+bw\n88+uDy8utnIUejDSWpaRwYKxY13D4KdOtVV0oKJ4Qp3y2XkLNXZKdRERlwweAC//+DIPzn+QpOgk\n2kUn04OWnJ8bSQ8TT+If/uz6oMOHrZD7shFa27ZWiYs747RPcDKVUr38fErCwrjaZmHwiuIpauw8\nwK7Gzs6hzXbRfijvEN/t+q48IOT7r7/nUOwhUpJSeO3G11zanziRTejgYQRt2QJbtkDDhpYRa9/e\nygh/ukS6XsIu79sddtWuun1LXcugoii1SnFpMduObiOnMIduLbq5XF97YC0z//cCFxXEcG1OA3pt\ni+XG/R1oOG8PXJ3nklEjPDzKyvyelATnnANRUT76JIqi1BQd2Sl1jl3Hd/Hs189aI7XDm9h5bCdx\nUXH8X9zvePaml9znPGzXztpvyzkgpG1buOqqqtNQKYriU3Qa0wPU2NmfktISdh7fWb72LLsgm/GX\nj3dpdyD3AN9M/wsddubRYl8uUTt/s6Yc8/Phhx/cZ/IQ8dv0o6IonlGn1tkpFbHzepja0n40/yid\nX+xM5N8j6f3KZcz66DHyF2RwYcZK2LbNpX1MgxhupD3tm3Wg0Y23EvTPf1obWmZnV52yysnQ2fWd\n21U32Fe76rYP6rNTap2yLPz79+4n9o1Ylyz8IsKe7D1sOuwI23eM1LYd3cby3y932QamUWgjvtx2\nJc0/LiJo+w5oZqBtKCS3sDbJdMfDD3vzIyqKYjN0GlOpVTIWZfDHSffQ6OA+GhRDbjAca9aCf/7t\nlXKDJyJ0/8e5dMuJ5MK8aDodDyXpYDEx+7JpkDaOoFtudX3wL79YYfpt2lg7NSuKctahPjsPUGPn\nGy7tex4Jq35xSUy8r0d3li766WTlY4/B3LlWIIhzUEj37ppcWFEUt6jPrg5jl7n1n/f9zIiPRhD0\n00lDl+m49u4RCFu3reINf/0rrFljbR3z/PNw//1wzTUBYejs8s4rY1fdYF/tqts+nNbYGWMaGGMm\nGWP+7ThvZ4y5zvvSFDuRtWYpD/+/n0k55v56gxLf6lEURXHmtNOYxpj3gBXAHSLS2RjTAPhGRM73\nhcDaQqcxvczx4/D669z36ixe/nm1y+V7L7yAmT+s8IMwRVHqCt6exkwWkaex9pZDRKoIf1PqOt/v\n+p5RGaMoKilyvdiwIaSlcdsTT/JgXIsKl8bGtWBY+l99pFJRFMUVT4xdgTGmPPzNGJMMFHhPkuKM\nv+fWC4oL+M/P/+GSly7kjcduYPzkRZR+8N8q2/ceMICb/v0Kk1JTGXn++UxKTeXmf79iq8TE/n7n\nNcWuusG+2lW3ffBknV06MB9oZYx5G7gMGOlFTUqA8Pqq1/nHhw8xbm1DFn99jLB2HTB/Hg0Dbzrl\nfb0HDKD3gAG2TTarKErdw6OlB8aYZsDFjtPvROSgV1V5AfXZVZ/1H8/i3BF/ot7Q26xoya5d/S1J\nUZSzGK+uszPG3AQsFpGjjvNoIEVEPqpJh/5CjV3VlEopQcbNjHZREeTlQaNGvhelKIpSCW8HqEwu\nM3QAjuP0mnSmVB9vzq3vPLaTCV9O4LoJSZw4/Jtrg5CQMzJ0dvULqG7fY1ftqts+eOKzc2dF69W2\nEMU3iAj/2/E/ZnzzAhGfLWDC6kYkHSgieNA26NXc3/IURVG8gifTmK8BR4AZWIbvAaCxiIz0urpa\nRKcxLdLn3EfMm/9l5I9FhHbsSvCYNBg40BrFKYqiBDDe9tlFApOAqxxVi4Apdltvp8bOIvuLeUTO\nzcCMGgWdO/tbjqIoisd41WcnIjkiMl5ELnSUR+xm6OxMTebWRYR1B9a5vRb1u/6YGTN8Yujs6hdQ\n3b7HrtpVt304rc/OGNMe+DOQ5NReRKSvF3UpNSC3MJfZa2Yzf+6zDFl2hHazVxCS0NrfshRFUfyO\nJ9OYq4GXgJ+AsnS+IiK2SnRYl6cxtx7ZysvfTOPw7Fd4cGUoyUcNofeNxowZA02a+FueoihKreBt\nn90KEelRI2UBRF02dm9MuYVB//yckC5dCU8bBzfcoAEniqLUOby9zu5TY8wDxpg4Y0yTslKTzjzB\nGPOOMWalo2w1xqx0uvaIMWaTMeZXY8w1TvU9jDFrHNemekubP/Bkbn3E8Odo+L8fCF/6Ddx8c8AY\nOrv6BVS377GrdtVtHzxZZzcSECy/nTNtal0NICJDyo6NMc8BZZlbOgGDgU5APPCFMaadY7j2EnC3\niCw3xswzxlwrIvO9oc9fbD68mS9Xf8y9KeNcL7ZWv5yiKMqp8Cg3pj8wxhhgO9BHRLKMMY8ApY7t\nhjDGzMfK5LIdK51ZR0f9EKx0ZvdVep7tpjFLpZRFWYv47L0p9Pr4B/5vHdRfv4l6rRL8LU1RFMXn\neHUa0487lV8B7BeRLMd5S2CX0/VdWCO8yvW7HfW25q0fZvGXkfG0SL2Jv09by5D+4wnftE0NnaIo\nSg3wZBrzNaydyi91nO8B/gt8VtNOjTGLgBZuLk0QkU8dx0OBt2vahzvS09PLj1NSUgJ6+5lus79k\nwJZWrBpxPedPmADBnvxTBRZ23eJHdfseu2pX3d4lMzOz1vyLnnyDJovIrY7pQUQk15phrDkicvWp\nrhtjgoFBwAVO1bsB52FNK6wR3W7HsXP9bnfPdTZ2gU6Xf7wFQUGYzExbGjpFUZQzpfKg5PHHH6/x\nszxZevANVqqwb0Sku2On8jki0qvGvZ5OlDHXAuNFpI9TXSeskV4vHAEqQFsREWPM90AasBzIAKZV\nDlAJNJ/dsfxjvL1sBiX/fY8HXv4JE+RJYKyiKMrZy5n47AJ1p/LBwBznChFZZ4x5D1gHFAOjnKzX\nKOB1IByYF8iRmOsPrOfjtycT/9bHDF8vnLimD+TkQMOG/pamKIpSZ/EkN+ZC4GbgTqyRVQ8RWeJN\nUSJyp4j8y039kyLSVkQ6iMgCp/oVInKe41qaN7WdCTMm9yf3wvO578mF3DjgT0Ru2UXMhwswpzB0\ndl4PY1ftqtv32FW76rYPVY7sjDE9sNbXlbEHa4ufRGNMooj85G1xdY2B595A8xfuJuSGgVBPtwRU\nFEXxFVX67IwxmVjGLhzoAax2XOoK/Cgil/hCYG3hS5/dkRNHaBze2Cd9KYqinC14ZZ2diKQ4AkT2\nABeISA9HjszujjrFieLSYjK+fZOXh7RlW9dEpLDQ35IURVEUB56EAHYQkTVlJyLyC9DRe5LsxaG8\nQ7zx79F8eEk0V/zuLlJz4+jyxueYWspPaee5dbtqV92+x67aVbd98CQac7Ux5hXgLSyf3W3Az15V\nZSO+v6EH/dccouCeO2n42WM0jInxtyRFURSlEp6sswsH7sdK3wWwDHhJRPK9rK1W8ZbPrnTvHoKa\nx2rAiaIoipfx6n52dYUzMXYHju9jw9cfc3m/e2tZlaIoiuIpXglQMca87/j5i2OvOOeyuqr76hKr\nfvmS9+7oQV5SS5o/MgX88IeBnefW7apddfseu2pX3fbhVD67sY6fA7B8dWcNX77zdwqn/5NLVx4k\nKOUCGn28gOgrTpnOU1EURQlgPPHZjQPeERG3yZXtQnWmMb+79VIiWrel01+eJTgm1svKFEVRFE/w\nqs/OGJMO3AIcAd4B3heR/TXpzJ8EWiJoRVG8y5nuzqL4F3ff117dvFVE0kWkM/AAEAcsM8Z8WZPO\n/EFk4yaLG3XqWAIQ3bkT1w64nsLCEyydNo4v/vA7f8s7LXaeW7erdtXte7ylXUS02LB4g+rsK/Mb\nsA84BNhiMVlk4yaL6X5+n+MvvhQEcGzGi3x7IofJMU2JmfYKTc7t5m+JiqIoig/wZBpzFHAr0Bx4\nH3hXRNb5QNsZ06hTx5IyQ0efPrDE2qyh6aj7ObhuvT+lKYriZRxTXv6WodSAqv7tvL2fXSLwoIis\nqkkH/sSEhbkduRaHhXPTTdC9O3TrZpVWrUCn+BVFUeomnvjsHgaijDF3AhhjYowxbbyurBaQ/PxS\ntxcK8hk8GHJzYcYMuPBCiImB3/0OHnoIZs+GtWuhuNjHgt2gfhjfo7p9j521BzL3338/U6ZMKT9/\n6aWXiI2NpWHDhhw5csSPynzPaUd2jmjMHkB74DWgPlaezMu8qqwWKNm7f2mDvz7eJ/exyeV1DR5/\nnIuTkhk8GAYPtupEYN8+WLUKVq6Ejz+G9HTYswc6d644AuzaFRo08M/nURRFqQ4vvfRS+XFRURHj\nxo1j+fLldOnSxY+q/IMnPrufsbb1WSEi3R11q0Wkqw/0nTGRjZssrhcXe+Xx9b8GNerUkYuTkpmf\n8WmFNj/n5NC1QQOXUOXsbFi92jKAZYZw/XpITDxpAMt+Nm/uy0+lKMrpqMrvk5GxjGnTFlJQEExo\naDFpadcwYEBvr2rxR5+V2blzJ61bt6aoqIh61czlW/YefbWcwxs+O09CQJc7fq50/GwArPZ3aGoN\nQlnFHUUlJfK7VavkYGGh2+uVKSwUWb1a5I03RP74R5GUFJHoaJG4OJH+/UUmTBB5/32RTZtESko8\neqSiKF7A3f/5zz5bKsnJE8Saz7FKcvIE+eyzpV7TcaZ9GmMkKyur/HzEiBHy6KOPiojIkiVLJD4+\nXp5//nlp3ry5xMXFyWuvvebSduPGjRIRESHGGImMjJSrrrpKRES+/vprufDCC6VRo0bSs2dP+eab\nb8rvvfLKK2XixIly6aWXSkREhGzevFmMMfLiiy9Ku3btJCoqSiZNmiSbN2+WSy65RBo2bCi33nqr\nFHr4XXoqqvq+dtTXzAactgE8BMwEtgJ/AL4D0mraob9KVS+vNigtFdm2TWTuXJHJk0VuuEEkMVEk\nKkrk8stFRo8WmTVLZMUKkfz86j17yZIl3pDsE+yqXXX7Hm9od/d//pprJlYwOmUlNfXRWu+/tvqs\nbOxGjhwpkyZNEhHrvQUHB8vkyZOluLhY5s2bJxEREXL06FGXttu2bRNjjJQ4/go/dOiQREdHy1tv\nvSUlJSUyZ84cady4sRw+fFhELGPXunVrWbdunZSUlEhhYaEYY2TgwIGSnZ0ta9eulfr168tVV10l\nW7dulWPHjkmnTp3kjTfeOON35g1jd1qfnYg8a4y5BsgGzgUmiciiGg0jbcT63FzahocTEnT6pYjG\nQOvWVhk48GT94cPW9OeqVdaqh3/+EzZvhnPPrTgF2q0bREd78cMoigJAQYH7r7wFC+p5MRrbfZ/5\n+TXfFsz63rcICQnhscceIygoiH79+hEZGcmGDRvo1atXhbbO9wBkZGTQvn17hg0bBsCQIUOYNm0a\nn3zyCSNGjMAYw8iRI+nY0dqrO8jxXfiXv/yFyMhIOnXqxHnnnUdqaipJSUkA9OvXj5UrV3LHHXfU\n+LN5C0+WHiAiC4GFXtYSUDyzcyffHT/OP5OTubZp0xo9o0kT6NvXKmXk58Mvv5z0Ab7/vuUXbNas\nogHs3t1aDpGSklI7H8gP2FW76vY9vtIeGuo+xDo1tYT5873TZ2pqMQvdfHuGhZXUyvObNm1abogA\nIiIiyMnJOe19e/bsITExsUJd69at2bNnT/l5QkKCy32xsSfzBYeHh7uc79u3r1r6fUV1MqicVbza\nvj3PJSfz9x07yCupnV9KgLAwa6nDPfdYyx6+/hqOHYMFC2DoUDhxAl56CXr2tAzgVVfBn/8Mb70V\nOMshFMWupKVdQ3LyxAp1yckTGDPGe7uanGmfERER5OXllZ/v3bu3VgJF4uPj2b59e4W67du3Ex8f\nX35el/KLejSyOxsxxjCgaVMG1HBUVx2CgqypzXPPhVtvPVm/bx+8+WYmJSUpfPop/PWvsGtXxeUQ\n3bvDeedBZKTXZVabzMxMW442VLfv8ZX2sgjI6dMnkZ9fj7CwEsaMudarkZFn2me3bt2YPXs2U6ZM\nYdGiRSxbtqx8ivJ0VJ66dKZ///6MGTOGOXPmcMstt/DBBx/w66+/ct1113l0v7s2nrT3F1UaO2PM\nv4DPgS9EJNt3kgKfdbm5dIiIIMjLf/W0aAG9eoHzd0B2NqxZY02BrlwJr74K69ZBQoLrcohY3Z1I\nUVwYMKC3z8P+z6TPqVOnMmLECGbMmMHAgQMZNGhQheunGn0ZYypcdz5u0qQJn332GWPHjuX++++n\nXbt2fPbZZzRp0qTKZ7vrq/LzA3U0WOU6O2PMxUA/oC9QBCwA5ovIz76TV3vU5hY/A9es4ZnkZM6N\niKiV550pRUWwYUPF9YCrVkFoqKsBTE62RpKKUtfR3Jj2xRvr7E67qNzRQTPgGuBaoCuwEvhcRN6r\nSaf+4Gzbz04Eduw4GQ1aZgAPH7aywDgbwC5dLMOoKHUJNXb2xRvGzqO/8UXkoIi8LSJ3YGVTmQG0\nq0mHp8MY080Y850xZqUx5gdjTE+na48YYzYZY351LIcoq+9hjFnjuDbVG7pOx9YTJzhRi4EsZdQ0\nZ2DZcogbb4TJk+Gjj2DbNqv87W/WCG/pUrjzTmvZQ9eucMcd1vKIJUugNtLm2TXfoer2PXbWrtiD\nageoOIaZxBxuAAAgAElEQVRHPzqKN3gGmCwiC4wx/RznfYwxnYDBQCcgHvjCGNPOoecl4G4RWW6M\nmWeMuVZEvBRI7J5X9u5l9v79PJuczP/FxATsvHWTJtZuR336nKzLz7ciPctGgB98AD//DE2bui6H\nSEjQ3SEURbEfHk1j+hJjzHzgVRF5zxgzFBggIrcbYx4BSkXkaad26cB2YLGIdHTUDwFSROS+Ss/1\n+jTmkiNHmLB1Kx927kyczecFS0shK6viFOjKlVBQ4GoAO3SAYKc/mwIhD6Ci6DSmffHXfna+5kFg\ngTHmOaxp1ksc9S2xUpWVsQtrhFfkOC5jt6Pe5/Rp3JhvGzf2R9e1TlAQtGtnlVtuOVm/b5816lu5\nEjIyYMoUazlEp06W8QsOXsanny5g9+4nyu/JyrLWGKnBUxTFX5xq6cHNgADG8bMCIvJhTTs1xiwC\nWri5NBH4HdZmsXONMbcArwLeW/HpA7JOnCAxNNSj1GOVCbS1Uy1aWCU19WRdTs7J5RBPPrnQydBl\nAilkZT3BmDGT2Lmzd3latdatA3erpEB7555iV91gb+2KPTjVyO56LCPXHLgUWOyo7wN8A9TY2IlI\nlcbLGPOmiKQ5Tv8LvOI43g04565phTWi2+04dq7f7e7Z6enp5ccpKSk++8/19I4d3Na8OSl1ZNRX\nmchIuOQSq7z3XjC73bx9kXr89BPMnWsFyezYYRm71q0hKYkKRrCsNG6s/kFFOZvJzMysteAlT/az\nWwTcISJ7HedxwBsics0pb6ypIGPWAfeLyFJjzFXAUyLS0xGg8jbQC0eACtBWRMQY8z2QBiwHMoBp\nlQNU/Ln0QEQCNmCltklNfZSFC6e4qZ/E/Pl/Kz8Xgd9+g+3bK5Zt204el5ZWbQhbt7YWzeuaQaUq\n1GdnX/zls0sAnDN77gcSq2hbG/wemGqMCQZOYG0rhIisM8a8B6wDioFRTtZrFPA6EA7M83Uk5ulw\nZ+j2FhTQoF49GgYHotu05qSlXUNW1kSysk767Kw8gNdWaGeMZaxiY60sMe44etTVEC5ffvI8O9uK\nDq1sBMsMZHx8xcAZRakrjBw5koSEBP72t7+dvrECeGbsvsAKGHkby383GPDaFj8i8jVwYRXXngSe\ndFO/AjjPW5q8wYcHD/LE9u082aYNd7RoUWXqMbv5MpzzAO7bt5MWLRJqnHswOtoq55/v/npenjUd\n6mwMFyw4ef7bb5Z/sSpjmJhoJeaujN3eeRl21Q321u4PPE3LlZKSwvDhw7n77rt9oCqw8cTYjQEG\nAVc4zmeKyFzvSTo7eCA+nl5RUTy4eTMXREXRNRAzOdeQsjyA3v4Ci4iwlj106OD+elGRFSnqPDX6\n7bfwzjvW8a5dljGtbAiPH7fWGLZuDQ0bek2+4icyFmUw7e1pFEgBoSaUtNvSGHD1ANv16WH2qzPq\noy7habqwFkBZJpPvReQ3r6ryAoGaLuxs8ucFGqWl1lIKZ2NYuYSEuI4InUuzZhpEE6i48/tkLMpg\n7IyxZHXPKq9LXpnM1Aemes3g1UafK1eu5O6772bz5s30798fYwxt27Zl3Lhx3H777Sxfvpzi4mIu\nu+wyXn75ZeLj45k4cSJPP/00ISEhBAcHc+eddzJt2jTGjh3L3LlzOXbsGO3ateOFF17g8ssv98pn\nryl+yY1pjLkVeBZY6qjqDTwkIu/XpEN/EajGzh278vNpGhJCeL2a72SsnDkicOhQ1YZw+3Yr+0xi\nYtWBNHFxoP+M/sHdF2bqnaksTHLdSTV1eyrzX/WOq/9M+ywsLKRdu3b86U9/YvTo0Xz00UcMHTqU\nhx9+mAcffJClS5fSr18/iouLueuuuygqKmLuXGvyrU+fPgwfPpy77rqr/HmzZ8+mf//+NGrUiBde\neIFnn32W7du3U79+/dr70GeIvwJUHgV6lo3mjDExwJeArYydnZi1bx9twsK4o0ULW/sy7Kq9TLcx\n1sitWTPo0cN92+xsVwP4888nfYiHD1s7zlcVUZqQALX1HWPX9w2+014gBW7rF2xZgHnc+g6dfOVk\n0lPSXdqkZ6bz+NLHXepP234rkOTaZ35pvkeav/vuO4qLixk7diwAN998Mz17WhNtTZo0qbDlz4QJ\nE+jbt2+F+ysbjWHDhpUf/+lPf2LKlCls2LCB886zVdhDtfHE2BnggNP5IUed4iUmJyVpyLRNiIqy\ndo3o0sX99fx82LmzojHMzDw5dbp3L8TEuDeESUnWqPF0i+/L0rPt37+L2NgvND3bKQg17tP4pZ6T\nyvzJpx5lpaekuzVqp2ufui2VhbiO7MKC3ERHuWHPnj0Vdg8HaN26NQAnTpzgwQcfZMGCBRxxZG/P\nycmp4B6p7CZ57rnnePXVV9mzZw/GGI4fP87Bgwc9/lx2xRNjNx/XaMzPvapKKf8FLftr92hREcUi\nNAugqYbTYddRRm3qDgs7mXbNHcXFsGdPRWO4YgV8+KF1vGOHtWi/qojSDRuWMXHiggpLPeyYns1X\nvytpt6WRNSOrov/sp2TGjB4TsH3GxcWxu1Kmhu3bt5OcnMxzzz3Hxo0bWb58Oc2bN2fVqlVccMEF\n5causqH76quvePbZZ1m8eDGdO3cGrNHh2fDHtSfG7i/ATcBljnONxvQDXx49yn0bNzKpdWvub9my\nRqnHlMAjONgavSUmwhVXuF53t/h+0yb44gvreN26hZSUPFHhnqysJxg3bhJHjvSmeXPKS7NmtTdl\nalfKAkKmz5lOfmk+YUFhjBk9xqvRmGfa56WXXkpwcDDTpk3j/vvv59NPP+WHH36gb9++5OTkEB4e\nTqNGjTh8+DCPP15xmjU2NpasrJNGNjs7m+DgYJo1a0ZhYSFPPfUUx48fr70PG8iIyGkLVh7L6x2l\nuSf3BFqxPqr9WLJkSfnxmuxsuWrlSvns4EH/CaoGztrthJ10X3nlZLFMoggsKT+Oj58sw4aJXH21\nyPnni8TFiYSEiDRuLNK+vcgVV4jcfLPI/feLTJ4sMmOGyPvviyxdKrJ+vcihQyIlJb77HN5453b9\nP++OH3/8Ubp37y5RUVEyePBgGTJkiEyaNEn27NkjKSkpEhkZKe3bt5eZM2dKUFCQlDj+8b799ls5\n99xzpXHjxjJ27FgpKSmRu+66Sxo2bChxcXHyzDPPSJs2beTLL7/08yesSFX/do76GtmA047s3ERj\nTjfG2C4asy7QJTKSRVWtsFbOSkJDi93Wd+lSwltvVawrLbWy0vz2m2v55RfXupwcazQYE0OFEWJV\nJVATe9cFevTowU8//eT22pIlSyqc/+EPfyg/vvjii9mwYUOF67NmzWLWrFnl5w899FAtKg1cPFl6\nsBr4nVSKxhSRrj7QV2vYaelBdTlYWEhoUBBRmhvrrCMjYxljxy5wSc82dWrNstY4U1gIBw+6N46V\ny/79Vp5ST4xi2ZRqSMiZfvpTo7kx7Yu/1tmtAbqWWQpjTBDws4jYKk61Lhu7f+3Zw4GiIiY6IrSU\ns4uMjGVMn76I/Px6hIWVMGbM1T4PThGB3FzPDONvv1nrFxs29Nw4RkdXf/G+Gjv74i9j9yxwPtaO\nA2XRmKtF5C816dBf2NXYebr+SAIwE4td132pbu9TWmqtQSwzfkuWZBITk1KlcczL83w6tXlzCA9X\nY2dn/LWovCwa83Ks/e00GjMAqWzoCktLOVhURMtQ9+uKFMWfBAWdXLDfqZNVdyo7XVAABw64N4Tr\n17vWeXuKVLEfHuXGrAvYdWRXU/539CgDf/mFcQkJ/LFVK8I0Z5VyliBiZbZp1EhHdnbFGyO70y7W\nMsbcbIzZZIw5bozJdpSzZGGGfbk8Oprve/RgeXY2r+3bd/obFKWOYIzuVqG44snK5GeAG0SkoYhE\nOYr+KvmIM9mSPjk8nLldunBfy5a1J6ganIl2f6K6fY+dtSv2wBNjt09E1ntdieI1KvvzcktKOFxU\n5Cc1iqIovqdKn50x5mbHYW+sDCofAYWOOhGRD70vr/Y423x2p+LTgweZd/gwL517rr+lKIrX0GjM\nwKeqndR97bO7HrgOaAicAK5xnF/nuKbYlOubNePFqjITK4piC9LT0xk+fLjXnj9y5EgmTZrktecD\nbpNVuyMjYxmpqY867uk335gu/avbV5XGTkRGisidjuJ8fKeI3FndjpSa4S1fRuVfMBFhd4H7vb5q\nil39MKrb9/hS+7KMDB5NTSU9JYVHU1NZlpFRJ/ssywnpL4qL3aey85StW+HIEfj0UytL0MKFUxxX\nPk+FS6ZW2+BVlTQTGO/4Od1NmVbTZJz+Ktg0KayvkhJvzM2Vpl99JROysiS7qKhWnmmnhMrOqG7f\n46tE0Es/+0wmJCeXZc4WAZmQnCxLP/us1vuvzT6feuopiY+Pl6ioKGnfvr1kZGRI/fr1JSQkRCIj\nI6Vbt24iInLllVfKxIkT5dJLL5WIiAjZvHmztG7dWr744ovyZ02ePFluv/328vOvvvpKLrnkEomO\njpaEhAR5/fXX5V//+peEhIRI/fr1JTIyUm644QYRETHGSFZWVvm9I0aMkEcffVRErH/D+Ph4efrp\np6VFixZyxx13yJEjR2TAgAESExMjjRs3luuuu0527dpVfn9KSorMmjXL5fMCkpQk0qiRCEx0enU4\nHff7XKphA041jbnO8XNFFUXxAb7KiNEuIoKfe/ZkZ0EBT+7YUSvPtEs2j8qobt/jK+0Lp03jCact\nbwCeyMpi0fTpAdvnhg0bmDFjBj/++CPHjx9n4cKFdOjQgQkTJjBkyBCys7NZuXJlefu33nqLV155\nhezsbBITE12mCp2Pt2/fTv/+/Rk7diwHDx5k1apVdOvWjd///vcMGzaM8ePHk52dzccff+xWW+Vn\n79+/nyNHjrBjxw5mzpxJaWkpd999Nzt27GDHjh2Eh4czevRojz731q1W4vLevavKfRIZ7tGDHFSZ\nQUVEPnX8fL06D1TsS3xoKG927EipOvWVOkpwFVP19RYsOJl8c/JkSE93bZSeDpX2i/OkfVVfsvXy\n808vGKhXrx4FBQWsXbuWpk2bkpiYCLifpjTGMHLkSDp27AhAkJt9L53vefvtt7n66qsZPHgwYG3k\n2qRJE7dtq8K5TVBQEI8//jghISGEhIQQFhbGoEGDyq9PmDCBvn37evKxywkLq2o6NOdEdZ5T5cjO\nGPPpKcon1VKr1Bh/+GGCKvnzSkTYVwN/nl19SKrb9/hKe3EV6fNKUlNPzo65M1xg1VeYjPSsffE1\n17jvMyzMI81t27blhRdeID09ndjYWIYOHcrevXurbJ+QkODRcwF27tzJOeec43H70xETE0N9px2C\n8/LyuPfee0lKSqJRo0ZceeWVHDt2rFq+xLS0a0hOnlip9p4s2FGt4fippjGfP0X5R3U6UezNT9nZ\n3Ltxo79lKMoZc01aGhOTkyvUTUhO5uoxYwK6z6FDh/LVV1+xfft2jDGMHz/e7agNXIPPGjRoQG5u\nbvn5vn37ytskJiZW2Mn8VM8BiIiIIC8vr/x87969VU6RAjz//PNs3LiR5cuXc+zYMZYuXVrtwJkB\nA3ozdWoqqallkaH958N3aSK/zPP4IZx6GjPT6QNEAAkisqGq9op3CAQ/TM+GDZnbpUu17wsE7TVB\ndfseX2nvPWAAAJOmT6defj4lYWFcO2ZMeX0g9rlx40Z27drFZZddRmhoKGFhYYgIsbGxLFq0yGXH\nk8qGpFu3brzzzjv069ePVatW8cEHH9CvXz8AbrvtNp588knef/99Bg0axLFjx9i1axfnn38+sbGx\nbNmyxeVZs2fPZsqUKSxatIhly5bRq1evKrXn5OQQHh5Oo0aNOHz4MI+7mQb2xPANGNCbAQN6Y8wU\nROb1O+0N7jhdBAtwA7AB2OY47w58Up0omEAo2DQaM5DZm5/vbwmKUiV15f/86tWrpVevXhIVFSVN\nmjSR66+/Xvbu3SuHDh2Syy+/XBo3biw9evQQEffRjVu2bJGLLrpIIiMjZcCAATJ27FgZPnx4+fWv\nvvpKLrroImnYsKEkJCTIm2++KSIimzZtkm7dukl0dLQMGjRIRER+/PFH6dy5s0RFRcnw4cPltttu\nk0mTJomIFY2ZkJBQoe89e/ZISkqKREZGSvv27WXmzJkSFBQkJSUlVeoVqfrfzlFfIxvgyX52PwF9\ngSUi0t1R94uIVP9PfQ8wxpwPvAw0ALYBw0Qk23HtEeAuoARIE5GFjvoewOtAGDBPRMa6ea6c7rMG\nIoG6R9mRoiI6LF/O4ObNSU9KoombPVUCVfvpUN2+xxvaNYOKffHLrgdAkYgcrVRXWpPOPOQV4C8i\n0hWYCzwEYIzphLVxbCfgWuBFc3Ls/hJwt4i0A9oZY671oj4FaBwSwtqePSkW4Y+bN/tbjqIoyinx\nZGT3KvAl8DDWJq5pQIiI3OcVQcYcFZFox3ECMF9EOjtGdaUi8rTj2nwgHdgOLBaRjo76IUBKZX12\nHdnZgRIR6jn5DDIWL2baRx9RYAyhIqQNHMiAaoYbK8qZoiM7++KvncpHA48CBcAcYAHwt5p05iFr\njTE3isjHwC1AWRxtS+A7p3a7gHigyHFcxm5HveIjKhu6sXPmkDVsWHld1uzZAGrwFEXxG55MYw4V\nkQkicqGjTMQaUdUYY8wiY8waN+V6LJ/cKGPMj0AkJ3daOCux29qpaR99dNLQrVoFQNawYUyvIgND\nIGK3d16GXXWDvbUr9sCTkd3/GWMKROQtAGPMDKBaaVoqIyJXn6ZJqqOvc4Gy+NzdnBzlAbTCGtHt\ndhw71+9299B0p8WfKSkptnXmBzIFVWQw9yxXhKIoykkyMzNr7Q8hT3x24cAnwKtAP+CIu2jH2sIY\nEyMiB4wxQVgRlotF5HVHgMrbQC+sacovgLYiIsaY77F8icuBDKxE1fMrPVd9dj4gNS2NhTfd5Fo/\ndy6X/fGPHCsu5t6WLWkXEeEHdcrZhPrs7ItPozGNMU2MMU2wRnH3AOOB48DjjnpvMdQYswFYD+wS\nR25OEVkHvIeVoPpzYJST9RqFFcW5Cdhc2dApviNt4ECSHT66MpLfeosxN97IsNhY6hnDZStX8v3x\n435SqCjK2cipdirfBjhfNM7nItLGq8pqGbuO7Oy4dipj8WKmf/wx+3btokWrVoy58cYKwSkFpaWE\nGOOSgzNQsOM7B/vqBl1np1TEpyM7EUkSkTZOpcJ5TTpTzg4G9O3L/KlTeWHMGOZPneoShRkaFORi\n6Dbn5XHvBs1Gpyi1wbZt2wgKCqK01FoSvX//fnr37k3Dhg156KGHXNqnpKQwa9YsX8v0KVUGqBhj\n+orIYmPMzVQc4QEgIh96VZkCnD35DlvUr8+dLVp4T0w1sOs7t6tusLd2O/Cvf/2L5s2bc7wK90Hl\nfenqIqeKxrwSWAxcjxtjB6ixU2qNyOBgLm7UyKU+49AhmoWE0Csqqs7/Z1R8gz+SHvg70cL27dvL\n97g7WznVNOZkx8+RInJn5eI7iWc3dl5/VBva9xcWMnTdOnqsWMFmp61FvIld37lddYPvtJclPVh4\n000sHTSIhTfdxNg5c8hYvDig+3z66adp1aoVDRs2pEOHDixevBgR4amnnqJt27Y0a9aMwYMHc+TI\nkQr3iQgjR47kzTff5JlnniEqKorFp+lXRJgyZQpJSUnExsYyYsSICiPCTz75hM6dO9O4cWP69OnD\nr7/+Wn4tKSmJp556is6dO9OkSRPuuusuCmqwF6Y3OFU05jg35U9lP30pUjl7uSsujs0XXcSTbdrQ\nqoqNNxXFUyokPXDg7aQHZ9rnhg0bmDFjBj/++CPHjx9n4cKFJCUlMW3aND755BOWLVvG3r17ady4\nMQ888ECFe40xvP766wwbNozx48eTnZ192p3CX3vtNd544w0yMzPZsmULOTk5jB49GrC2G7rtttuY\nNm0aBw8epH///lx//fUUF5/cTfztt99m4cKFZGVlsXHjRqZMmeLR5/Q2p8qgEoWVwcS5RDn9VHyA\nnX0ZtaU9yBiubdqUsHr1KtQfKCzkwwMHaqUPZ+z6zu2qG3ynvaqkB7/mu6Y9SN+6lfStW93Wm8xM\nTGZmlded68800UK9evUoKChg7dq1FBUVkZiYyDnnnMPMmTOZMmUKLVu2JCQkhMmTJ/Pf//63PCil\nMp5Gps6ePZtx48aRlJREgwYN+Pvf/84777xDSUkJ7777Ltdddx1XXXUV9erV489//jMnTpzgm2++\nASzjOnr0aOLj42ncuDETJ05kzpw5Hn5S73KqzVvTfahDUarNwaIitrr5klKUqgit4gu/Q1iYS116\nG/dB5+lt2lR5zd19VfXp2qN72rZtywsvvEB6ejpr164lNTWV559/nm3btjFo0KAKO5YHBwezf/9+\nt88p83nfd999zHashZ04cSIPP/xwhXZ79+6ldevW5eeJiYkUFxezf/9+9u7dS2JiYoVnJiQksHv3\nyaRVCQkJFe7ds2ePh5/Uu3iSG1PxI+qHqZqODRowLiHBpX53QQElZ7C+yq7v3K66wXfaT5X0IJD7\nHDp0KF999RXbt2/HGMP48eNJTExk/vz5HDlypLzk5eURFxfn9hllI7uXX36Z7OxssrOzXQwdQMuW\nLdm2bVv5+Y4dOwgODqZFixa0bNmS7du3V3jmzp07iY+Pr9De+bhly5Yef05v4kluTEWxFRO3bGHp\nsWP8IS6OUfHxNArWX3PFoiwCcvrcueRjja7G3HabVyMjz7TPjRs3smvXLi677DJCQ0MJCwtDRLjv\nvvuYMGECb7zxBomJiRw4cIBvv/2WG264weUZ1VlcP3ToUJ5++mn69etHs2bNmDBhAkOGDCEoKIhb\nbrmFp556isWLF3PFFVcwdepUwsLCuPTSS8v7efHFF7nuuusIDw/niSeeYMiQIR737VVqusW53QpV\nbPOu1E1+OHZM7vn1VzlUWOhvKYqfqCv/51evXi29evWSqKgoadKkiVx//fWyd+9eKS0tlX/84x/S\nvn17iYqKkuTkZJk4caKIiGzdulWCgoKkpKRERERGjhwpkyZNqrKPlJQUmTVrloiIlJaWyl//+ldJ\nSEiQmJgYGT58uBw9erS87dy5c6VTp07SqFEjSUlJkXXr1pVfS0pKkqeeeko6deok0dHRMnLkSDlx\n4kS1P3NV/3aO+hrZgFOlCxt3ahsp/6h1y+tF7JouTKld8ktKKBShoY726jyaLsz3tGnThlmzZp02\n4vN0+DRdGO6jMcsiMTUa00eoH6Z2+fr4ce7duPGUbQJRtyfYVTfYW7tiDzQaUzmruKpxY/pER/tb\nhqIoPsbT/ezuBjphbfdT5gC7y+vqahGdxlROxe3r1tGifn3ua9mStrrXXp1ApzHti6+nMcv4DxAL\nXAtkYu0WnlOTzhQlUHm8TRuCjOHylSvZX1jobzmKotQynhi7tiIyCcgRkTeA/sBF3pWllGFnX4ad\ntCeHh/NMcjK7LrmE9Y5sEHbDTu+7MnbWrtgDT4xd2Z+5x4wx5wHRQIz3JCmK/wgOcv0vMe/QIR5z\nkxZKURT74InP7vfAB8B5wOtYEZmTRORlr6urRdRnp9SU48XF7C0spL368myFbgllb2rbZ3daY1dX\nUGOn1Db/3rOH8yMj6al77SmKT/BqgIoxJswYM8wYM9EY85gxZrIx5rGadKZUHzv7Muyq3VPduSUl\nDFm3jgtXrOCY0xYn/sKu7xvsq1112wdP0kh8DBwFVmDtSmFwv3O5opxVPJiQQFqrVnx97Jjm31SU\nAMcTn90vItLFR3q8hk5jKr5kdU4OuwsK6Ne0qb+lKEqdwdvr7L4xxnStycMV5WzlRGkpuSUl/pah\nKIoDT4zdFcAKY8xGY8waR1ntbWGKhZ3n1u2qvTZ0X9SwIf/XvLlL/a+5uWe0196psOv7BvtqV932\nwRNHQz+vq1CUs4S0zZvZdOIE98bF8ceEBELdrOtTFKX2OdUWPw1F5Lgxpom76yJy2KvKahn12SmB\nwg/Hj/Pub7/xTHIyQbpkQVE8xivr7IwxGSIywBizDdfoSxGRc2rSob9QY6cEOgcLC6kfFKR77SlK\nFXglQEVEBjh+JolIm0rFVobOzth5bt2u2v2l+7NDh3h+584a32/X9w321a667YMni8ovcFOSjTE1\n/vPTGHOLMWatMabEGHNBpWuPGGM2GWN+NcZc41TfwxEcs8kYM9WpPtQY866j/jtjTOua6lIUfzIy\nLo70pCSXep2RUJQzx5N1dt8BPYCyCMzzgLVAI+B+EVlQ7U6N6QCUAjOBcSLyk6O+E/A20BOIB74A\n2omIGGOWA6NFZLkxZh4wTUTmG2NGAV1EZJQxZjAwSESGuOlTpzEV2yEi9PrpJ1Kio7k3Lk732lPO\nary9zm4P0E1EeohID6AbsAW4GnimJp2KyK8istHNpRuBOSJSJCLbgM3ARcaYOCBKRJY72r0JDHQc\n3wC84Tj+ALiqJpoUJRAxxjCnY0cMcMMvv1BUWupvSYpiSzwxdu1FZG3ZiYisAzqISBa1nzasJbDL\n6XwX1givcv1uRz2Onzsd2oqxtiJyG0FqR+w8t25X7YGmu21EBM8kJ7O2Z09C3CxVyFi8mNS0NLrd\nfDOpaWlkLF7sB5VnRqC9c09R3fbBE7/bWmPMS8A7WHkxbwXWGWNCgaKqbjLGLAJauLk0QUQ+rYnY\nMyU9Pb38OCUlhZSUFH/IUJQa4W5nhXvefZeP58/n4IgRsGoVdOtG1uzZAAzo29fXEhWlVsnMzKw1\nw+yJzy4ceAC4zFH1NfAiVlLoBiKSXePOjVlCRZ/dwwAi8pTjfD4wGdgOLBGRjo76oUBvEbnf0SZd\nRL5zBM3sFRGXzWXVZ6fURa4aM4bFN9/sUp86dy7zp051c4ei2Bev+ewcxmOeiDwnIoMc5TkRyROR\n0jMxdM7dOB1/AgwxxtQ3xrQB2gHLRWQfcNwYc5Gx/rwdjrUbQ9k9IxzH/wd8WQuaFMUWlFSRgWV5\nbjJXFhUAABY8SURBVC5jN21i6dGjXktPpih24pTGzuEDKzXGRNdmp8aYQcaYncDFQIYx5nNHf+uA\n94B1wOfAKKfh2CjgFWATsFlE5jvqZwFNjTGbgAeBh2tTq7+x89y6XbXbSXeosyFbtar8sFNYGDEh\nIYzPyiLPBgmp7fTOnVHd9sETn10usMbhg8t11ImIpNW0UxGZC8yt4tqTwJNu6ldgLXuoXF+A5UdU\nlLOOtIEDyZo9m6xhw8rrkt96i0duu40BSUk86mbd3uGiIr45dozrmjXzoVJF8S+e+OxGuqkWEXnD\nTX3Aoj47pa6SsXgx0z/+mHwgDBhz442nDE75NTeX9w8cYJIbQ6gogYxXcmPWNdTYKcqpmX/oEDsL\nCrixWTOa16/vbzmK4oJXF5UbY841xvzXGLPOGLPVUbbUpDOl+th5bt2u2s9W3RH16vHlkSOc+/33\nvPvbb7UjykPO1nfuL+yq+0zwxGf3Glb4/z+AFOBOoJ4XNSmK4gd6R0fTOzqa/JIS3IW0/FZYqCM+\nxbZ44rP7SUQuMMasEZHznOt8orCW0GlMRak5IkLXH3/ki/PPJ1YNnuInzmQa05ORXb4xph6w2Rgz\nGitXZoOadKYoij0xxrD6wgtdsrjkl5SwIieHSxo21I1olYDGk9yYDwIRQBpwIXA7JxdxK17GznPr\ndtWuut3jLl3ZzoIC7tu4kfhvv+WJ7dtr/Gx9577FrrrPhNOO7Jx2GsgGRnpVjaIotqJdRARrevZk\nU14eewoL/S1HUarEE59dT2ACkMRJ4ygi0tW70moX9dkpiu95fNs22oeHMyQ21t9SlDqAV9fZGWM2\nAn8GfsHacBUAx35ztkGNnaL4ngOFhQi4RHEWlJYSWkVeT0WpCm9v3vqbiHwiIltEZFtZqUlnSvWx\n89y6XbWr7tojpn59t8sVeq1YwVWrVjFj925OlJQEpHZPUN32wZNozHRjzCtYuwmUTcqLiHzoPVmK\notRlvr3gAhYePkzG4cMEaxSn4gM8mcZ8C+gArKXiNOad3pVWu+g0pqLYgx35+cw9eJCxrVr5W4oS\nYHh7nV1PoINaCkVRfIEBYkNC/C1DqWN44rP7BujkbSGKe+w8t25X7arb9zhrTwgLcxu9+cqePaRt\n2kTmkSMUl5a6XPcHdn3ndtV9Jnhi7C4BVhljNhpj1jjKam8LUxRFcSYlOprY+vUZl5XFHB8nqlbs\njyc+uyR39XaLyFSfnaLUHUTEJaPL/44e5cKoKMLqaZ76uoruZ+cBauwUpe4iIty0di2vd+hAo2BP\nQhEUO+LtdXaKH7Hz3Lpdtatu33Om2o0xzO3SxcXQHS0qYuaePewrKDij51eFXd+5XXWfCWrsFEWp\nsxwrKWHp0aN0/OEH7tuwwd9yFD+i05iKotR5CkpL2V1QwDnh4S71mrbMPug0pqIoyikIDQpyMXQA\nE7Zs4V979vhBkeJr1NgFOHaeW7erdtXte/yl/dnkZEa0aOFSvzkvjxIPZoLs+s7tqvtM0LAlRVHO\nWoKMIdRNbs7fb9zI+txcBjZrxnPJyURWCnzJWLyYaR99xP7du4n98EPSBg5kQN++vpKt1AD12SmK\norhhc14e8w4fZnR8PEFOBjFj8WLGzplD1rBh5XXJs2czdehQNXheRtfZeYAaO0VRaoPLHniAb265\nxaU+de5c5k+d6gdFZw8aoFKHsfPcul21q27fYyftxjlDy6pV5Yc5IuSXlPhBUfWx0/uuLfxi7Iwx\ntxhj1hpjSowxFzjVNzHGLDHGZBtjple6p4cjL+cmY8xUp/pQY8y7jvrvjDGtfflZFEU5u2hQRf3h\nwkKaff01v1u1igWHD/tUk3J6/DKNaYzpgLU33kxgnIj85KiPALoDXYAuIjLG6Z7lwGgRWW6MmQdM\nE5H5xphRjrajjDGDgUEiMsRNnzqNqSjKGePWZ/fWW0y97Tau6N2bpUeP0io0lO5RURXuO1pURKPg\nYJecnorneHs/u1pHRH4FXP7RRSQP+NoY08653hgTB0SJyHJH1ZvAQGA+cAMw2VH/AfD/vKdcUZSz\nnbIglOlz55LP/2/v3IOkqu48/vnKcwDRQXwCBkRWXVbF6AqLmowTXRUwgonvoKKbZI0KxjKFumal\nal0TimRdwGxqfUXjAy1cQFgVIYClWy4QwYExCIvWIPhkjIBIjAH57R/3NFx6umd6YLr73ub3qbrV\n555z7jnf+5uu/s15Q2fg5iuv3BV/Yc+eOZ8bs2YNY3v14uzq6hIpdeIkdcwuuwnWC3gvdv9+iMuk\nbQAwsx3AFkk9iq6wRKS5bz2t2l136Umb9uG1tcydPJkJo0Yxd/LkgmZhzhg4kG8efHCT+H99911m\nf/IJW3bsKIbUnKTN3m1B0Vp2kuYDTVdrwp1mNqdY9TbHhAkTdoVramqoqakphwzHcfZDJJHd/2Zm\ntAOmvPceY1av5oOhQ337shgvv/xymznmsi49kLSI2JhdLP4a4LTMmF3oxlxoZieE+yuAb5jZDZLm\nAhPMbLGk9sCHZnZojrp8zM5xnMSyfedOOmQ5usa//IVnGxu5oVevPE/tX6R96UEu4XvEmdmHwGeS\nBisa6BsNPBeSZwPXhPB3gQXFEuo4jlMssh0dRBtV5/qBLGQrM2dPyrX0YJSkDcAQ4HlJL8bS1gG/\nBK6VtCHM3AT4EfAQsBZ428zmhviHgUMkrQVuAW4v0WuUhDT3radVu+suPWnVXmzdvTt35h9ztOoe\n/egj+i1ezPfXrOGVzZtbXW5a7b0vlGs25kxgZp60vnnilwEn5oj/Eri0LfU5juMkmeuOOIIh3buz\nYNOmnBNbzMyXOGTh24U5juNUGNe89RaXHHooI/Isg0grvjdmAbizcxxnf2HbV18hoEt8azNgRmMj\nA6qq+JuuXVPZ8kv7BBWnGdLct55W7a679KRVe1J1d23XromjA3h1yxZGvvkmh9x/P59u314GZeXD\nnZ3jOM5+wn3HHss7Q4bwH8cdR48OHfZI275zJ7MaG8ukrPh4N6bjOI7Dh19+yb3r1zN1wICWM5cJ\nH7MrAHd2juM4rWfep5/y8/XrOae6mhGHHMJJ3bqVTYuP2VUwSR0TKIS0anfdpSet2vcH3UO7d+fW\n3r1p3L6dBZs2FU9UkSnLOjvHcRwnHXRr354RPXvmXcYwcf16ju/ShYsSvszBuzEdx3Gcvabhiy/o\ndMABHNWp0x7xKz7/nL6dO3NQ+7ZrU/mYXQG4s3Mcxykd161ezfTGRgZ26cL0gQPp07nzPpfpY3YV\nTFrHBCC92l136Umrdtedn0eOP57GoUO595hjOLxjxybpKz//nFI2QNzZOY7jOEWhc7t21FZX0zHr\nRIctO3Zw49q1JdXi3ZiO4zhOIli1bRu/3LCBc6qrqa2u3tUifH7hQqbMmsW8qVPh9NNfYuPGKdbQ\n8EJryvaWneM4jpMIenbowKBu3Xh640buamgAIkc3bto05l18cZRp4sTzGDhwsvr1G9aast3ZJZy0\njglAerW77tKTVu2uu205rGNHbu7dm+dOPJEHjzsOgCmzZvHOVVftmfG2247lsMNubk3Z7uwcx3Gc\nxPJlvtMZqqqqWlOOj9k5juM4ieW8sWN3d2GefTYsWhSFx4+fa0uWXFBoOd6ycxzHcRLL2JEj6f/k\nk3tGTpr0Dhs3Tm1NOe7sEk5S+9YLIa3aXXfpSat21118htfWMvmKKzhv5swoYvz4uaxaNba1szF9\nb0zHcRwn0QyvrWV4bS2aMoXWdF3G8TE7x3EcJxX4dmGO4ziO0wzu7BJOmvrWs0mrdtddetKq3XWn\nB3d2juM4TsXjY3aO4zhOKvAxO8dxHMdpBnd2CSfNfetp1e66S09atbvu9FAWZyfpEkl/kPSVpFNj\n8edKel3SyvB5diztVEn1ktZKmhyL7yTpmRC/WNLXSv0+xaSurq7cEvaatGp33aUnrdpdd3ooV8uu\nHhgFvALEB9IagRFmdhJwDfB4LO3XwPVmNgAYIOn8EH898McQfx8wsdjiS8nmzZvLLWGvSat21116\n0qrddaeHsjg7M1ttZv+XI77OzD4Kt6uAKkkdJB0JHGhmS0Pab4GRIfxt4LEQ/i/gW0WU7jiO46SQ\nJI/ZfQdYZmbbgV7Ae7G090Mc4XMDgJntALZI6lFKocVk3bp15Zaw16RVu+suPWnV7rpThJkV5QLm\nE3VXZl8XxvIsAr6e49mBwNtAv3B/GjA/ln4WMCeE64GjYmlvAz1ylGl++eWXX36l+9pbn1S0jaDN\n7Ny9eU5Sb2AGMNrMGkL0+0DvWLbe7G7pvQ8cDXwgqT1wkJl9mkPPXq3NcBzHcdJPEroxdzkhSQcD\nzwPjzex/M/Fm9iHwmaTBkgSMBp4LybOJJrMAfBdYUBLVjuM4Tmooyw4qkkYBU4CewBbgDTO7QNJd\nwO3A2lj2c83sk7BE4VGgCnjBzMaGsjoRzdo8BfgjcLmZrSvVuziO4zjJZ7/ZLsxxHMfZf0lCN2ab\nIul8SavDIvPxefJMCekrJJ1Sao25aEm3pBpJWyS9Ea67yqEzG0mPSPpYUn0zeZJo72Z1J9jefSQt\nCpsyvClpbJ58ibJ5IboTbPPOkpZIqgvaJ+TJlzSbt6g7qTYHkNQuaJqTJ7119i7WbMxyXEA7otmY\nfYEOQB1wQlaeYUTdoACDgcUp0V0DzC631hzazyLqQq7Pk544exeoO6n2PgIYFMLdgDUp+Y4XojuR\nNg/auoTP9sBiYHDSbV6g7iTb/FbgyVz69sbeldayOx1428zWWbQ+72ngoqw8uxahm9kS4GBJh5dW\nZhMK0Q2xyTxJwcxeBTY1kyWJ9i5ENyTT3h+ZWV0Ifw68BRyVlS1xNi9QNyTQ5gBm9qcQ7Ej0D+nO\nrCyJs3nQ0pJuSKDNw6z8YcBD5NbXantXmrPbtcA88B67F583l6c35aUQ3QYMDU32FyT9dcnU7RtJ\ntHchJN7ekvoStU6XZCUl2ubN6E6szSUdIKkO+BiYZ2a/z8qSSJsXoDupNr8P+Am5nTPshb0rzdkV\nOtsm+z+Fcs/SKaT+5UAfMzsZmArMKq6kNiVp9i6ERNtbUjfgWWBcaCk1yZJ1nwibt6A7sTY3s51m\nNojoB3WwpIE5siXO5gXoTpzNJY0ANprZGzTf6myVvSvN2b0P9Ind92HPbcZy5ekd4spJi7rNbGum\nS8LMXgQ6pGRbtCTau0WSbG9JHYj2gX3CzHL9OCXS5i3pTrLNM5jZFqKdn87PSkqkzTPk051Qmw8F\nvi2pAZgG1Er6bVaeVtu70pzd60QnIvSV1BG4jGjReZzZwNUAkoYAm83s49LKbEKLuiUdHhbUI+l0\nomUjTXaKSSBJtHeLJNXeQdPDwCoz+/c82RJn80J0J9jmPRVteIGkKuBcojHHOEm0eYu6k2hzM7vT\nzPqYWT/gcmChmV2dla3V9i7admHlwMx2SLoJeIlohuPDZvaWpB+G9P80sxckDZP0NrANGFNGyQRd\nLeom2h3mBkk7gD8RfQnKjqRpwDeBnpI2AHcTDYQn1t7Qsm4Sam/gDOB7wEpJb4S4O4m2zEuyzVvU\nTXJtfiTwmKR2RA2EZ4KNE/27QgG6Sa7N4xjAvtrbF5U7juM4FU+ldWM6juM4ThPc2TmO4zgVjzs7\nx3Ecp+JxZ+c4juNUPO7sHMdxnIrHnZ3jOI5T8bizcxJPWGyf9wihNqrjIkknxO5fVnRg8L6W+7yk\n7vtaTgt1XKg8x1nF8tQ0c1TKLWHRcea+zTRLmqToeJmJe/HsnW1Q/7oE7AjiJAB3do4TMQqIb4Lb\nJgtQzWy4mX3WFmU1U8ccM2u1M4kxDugSK68tNX8fONHMmnXGebijNZkVyIr2hcQO4M7OSQ/tJD0Q\nWgkvKTqYsr+kZZkMkgZk7sN/9BMlrVR0gGX/EN9X0sKwy/vvFB0qOhS4EJgkabmkY0KRl4Rn10g6\nMzzfLrRWloYyfhDij5T0iqLDJuslnRHT0UNS19Biqgvpl8ZfTtJhkl4P4ZMl7VR0zAmS3gnve6ik\nZ0PdS4NuJF0raWoI95e0OLz3PZK2xqrpJmm6pLckPRHyjyU6ameRpAVZmvuGvHvYPeT521DHG8Ee\nTVrekmYTnV23XNKlkkYEbcslzZd0WMjXTdJvQnkrJF0s6WdAVSj/8ZDv1mC7eknjYn/PNZIeA+rJ\ns/O9pCpJL0q6vtlvmVO5FPsAPr/82teL6FDb7cBJ4f4Z4KoQXgicHML3AjeGcANwRwiPBuaE8Bxg\ndAiPAWaG8G+Ai2N1LgImhfAFwPwQ/gHwTyHcCfh90HcrcGeIPwDoFtPRA/gO8ECs/O453vNN4EDg\nJqLjb64Evga8FtKfAs4I4aOJ9pkEuBaYGsL/DVwWwj8EtoZwDbCZyLEJeA0YGtcY05HR3Jzd3yQc\nBAr8DFiZ52+3NRY+OBb+B+AXITwR+LfsfFnPngqsBKqArqH+QUHjV8DpeepvCDacD3yv3N9lv8p3\necvOSQsNZrYyhJcR/chBdLjjGEkHAJcSOYQM08Ln08DfhfCQWJ4ngDNj+bO7wGaEz+Wx+v4euFrR\n/o6LiZzCsUROb4yku4m67bKPr1kJnCvp55LOtNzdhK8R7SF5FpED+UbQ90pIPwe4P9T9HHCgpK5Z\nZQwBpme9f4alZvaBmRlQF3un5mhid0kHETnzzHl0T1HYAaB9JM2TtBK4jd3dxt8CfpXJZGabczx7\nJjDDzL4ws21Ef5uziLop3zWzpXnqFJGtHjGzJwrQ6FQo7uyctPBlLPwVuzcxn0HU8hoBLDOzfKeP\nx8du8v0wZ4/vZOqM1wdwk5mdEq7+ZvY7i04+P4vomJFHJY3eo2CztUQHltYD90j6aY76XyFycEcT\n/UAPIvqRfzWme3Cs7j7hh7/Qcal8NtzXZwo96XoqMMXMTiJqdVbF0loqw7LyiN3vva2F5/6H6Dvi\n7Me4s3NSjZn9mei0iF8Dj2QlXxb7fC2EX2P3zu5XsbvVtBUoZAbiS8CPJLUHkPRXkrpIOhpoNLOH\niI6yOSX+kKQjgT+b2ZPAL4Cv5yj7VaKTAdaG1tenwDCiH2uAecDYWJmDMsFYGYuJdrKHwnewL/Td\ngV1no21VdCRMa+rpDnwQwtfG4ucDN2ZuFI6lAbZn7Exkm5Fh7K0rMDLEFeJo/xnYJOlXLeZ0KhZ3\ndk5ayG69xO+fAnYSOYM41ZJWADcDPw5xNxN1N64gcnbjQvzTwE8kLYtNUMlV30PAKqJJF/VETrY9\n0ZhYnaTlwCXA5KznTgSWhC7InwL/0qQCs3dDMOOAXwU2BecCkaM7LUzi+APR+GGmjkw9twC3SqoD\n+gOZZ+NasnkAmJuZoJLnvbPvrwceDO/TJauefM9PAKaHiTiNsbR7iP5W9UF3TUzXSkmPW3Rq9aPA\nUiKH/qCZrWjhvXalmdk4ogkv+zJr1UkxfsSPk3ok3QYcaGZ3x+IagFMtAYd/lhJJVWb2RQhfTjRZ\nZVQR6ukaulCRdDtwuJn9uIXHHKdsVNThrc7+h6SZQD+gNitpf/0v7lRJ9xN1720CritSPcMl3UH0\nG7KOPbslHSdxeMvOcRzHqXh8zM5xHMepeNzZOY7jOBWPOzvHcRyn4nFn5ziO41Q87uwcx3Gciuf/\nAXRf25Jvcq1uAAAAAElFTkSuQmCC\n",
"text/plain": [
""
]
},
"metadata": {},
"output_type": "display_data"
}
],
"source": [
"calc(trails, g)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"###Results\n",
"\n",
"In above figure, we can see the results for comparing four hypotheses about the production of our synthetic trails at interest; each hypothesis is depicted in a distinct color. The x-axis reports the hypothesis weighting factor $k$ that corresponds to the level of belief in a given hypothesis---the higher the fewer parameter configurations receive corresponding belief in the Dirichlet prior. The y-axis reports the evidence. Note that for simplcity, we now state that higher evidence (for the same values of $k$) mean higher plausibility. For completeness, Bayes factors should be computed to judge the strength of the differences. For details, please resort to the elaboration [earlier in this tutorial](#marginal_likelihood).\n",
"\n",
"Overall, the results accurately represent what we expected as we know the underlying mechanisms producing the synthetic trails at interest.\n",
"We can see, as expected, that the self-loop hypothesis for all values of $k>=0$ is the least plausible. The reason for that is that our random walker operated on a synthetic network that did not include any self-links and thus, no self-loops are possible to occur in the produced trails. Next, we can see that the data hypothesis is the most plausible one which also was to be expected as it is built by taking the MLE of the data. The structural hypothesis represents a good explanation of the synthetically-produced trails as it encodes the strategy of the walker---i.e., choosing any out-link at random at each step. We can conclude that because the evidence values for the structural hypothesis are higher compared to the uniform (baseline) hypothesis for all values of $k>0$."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
""
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Weighting factor k\n",
"\n",
"We can also interpret the progression of the evidence values for single hypothesis with rising $k$. \n",
"The evidences for larger values of $k$ of the self-loop hypothesis are falling. This can be explained by the fact that the self-loop hypothesis believes in transitions that never occur in the data (self-loops). Thus, the more we believe in this hypothesis, the less tolerance we give the prior to believe in other parameter configurations and thus, the lower the evidence gets.\n",
"We can observe similar behavior for the uniform hypothesis, but not that drastically.\n",
"Contrary, the evidences are rising for the structural hypothesis with larger values of $k$. This can be explained by the fact that in this structural hypothesis, we closely capture the mechanisms producing the synthetic trails with our hypothesis matrix $Q$. Thus, the more we believe in this hypothesis, the stronger we believe in this single configuration, and thus, the higher the evidence gets. This is also the case for the data hypothesis.\n",
"\n",
"Actually, with larger values of $k$, the evidence converges to the simple categorical likelihood that we would receive by just taking the single parameter configuration expressed in the hypothesis matrix $Q$. This is the case, as with higher values of $k$, we limit our belief to this single configuration by increasing the concentration of the Dirichlet prior (see earlier [Beta](#Beta) and [Dirichlet](*Dirichlet) distribution examples).\n",
"\n",
"Let us demonstrate this behavior, by taking the MLE of the data as a hypothesis matrix $Q$ (data hypothesis). First, we calculate the log-likelihood of the simple categorical Markov chain model based on the MLE parameters. Remember that the likelihood is determined via:\n",
"\n",
"$$\n",
"P(D | \\theta) = \\prod_i \\prod_j p_{i,j}^{n_{i,j}}\n",
"$$"
]
},
{
"cell_type": "code",
"execution_count": 52,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"-513.972740311\n"
]
}
],
"source": [
"markov = MarkovChain(k=1, use_prior=False, reset = False, modus=\"mle\")\n",
"markov.prepare_data(trails)\n",
"markov.fit(trails)\n",
"print markov.loglikelihood()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Next, let us determine the evidence for some rising values of $k$."
]
},
{
"cell_type": "code",
"execution_count": 53,
"metadata": {
"collapsed": false
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"k: 0 evidence: -751.508184863\n",
"k: 1 evidence: -641.989270384\n",
"k: 10 evidence: -542.844680489\n",
"k: 100 evidence: -517.367587418\n",
"k: 1000 evidence: -514.318670921\n"
]
}
],
"source": [
"states = set()\n",
"for n in g.nodes():\n",
" states.add(n)\n",
" \n",
"vocab = dict(((t, i) for i, t in enumerate(states)))\n",
"\n",
"mle = markov.transition_dict_norm_\n",
" \n",
"shape_matrix = (max(vocab.itervalues()) + 1, max(vocab.itervalues()) + 1)\n",
"i_indices = list()\n",
"j_indices = list()\n",
"values = list()\n",
"for s,targets in mle.iteritems():\n",
" for t, v in targets.iteritems():\n",
" i_indices.append(vocab[s[0]])\n",
" j_indices.append(vocab[t])\n",
" values.append(v)\n",
"\n",
"prior_data = csr_matrix((values, (i_indices, j_indices)),\n",
" shape=shape_matrix, dtype=np.float64)\n",
"\n",
"for k in [0,1,10,100,1000]:\n",
" chips = k*(prior_data.shape[0]-1)\n",
" prior = distr_chips_row(prior_data, chips, n_jobs=1)\n",
"\n",
" markov = MarkovChain(k=1, use_prior=True, reset = False, prior=1., specific_prior=prior,\n",
" specific_prior_vocab = vocab, modus=\"bayes\")\n",
" markov.prepare_data(trails)\n",
" markov.fit(trails)\n",
"\n",
" evidence = markov.bayesian_evidence()\n",
" print \"k:\", k, \"evidence:\", evidence"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"As expected, the evidence converges to that of the simple log-likelihood calculated for the categorical Markov chain model."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"As already mentioned in the [first part of this tutorial](#rising_k), in reality it is much more difficult to see rising evidences with higher values of $k$. In this example, this is possible as we synthetically set the hypothesis based on the real mechanisms producing the trails at interest. For a discussion, please resort to the first part of this tutorial and also to Section 5 of our HypTrails paper. "
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"##Definitions"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Markov chain model\n",
"\n",
"The underlying model of HypTrails is a first-order Markov chain model which models transition probabilitites between states. A first-order Markov chain model is memoryless meaning that the next state in a sequence only depends on the current one."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####State\n",
"\n",
"A state in a Markov chain model refers to the individual events in a given human trail dataset at interest. For example, if we study human navigational trails on Wikipedia, then the states refer to the individual pages of Wikipedia that one can navigate over. Or in the small football example of this tutorial, the states refer to our three players that can receive and give passes."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Hypothesis $H$\n",
"A hypothesis is a generic belief about the production of human trails at interest. For example, one hypothesis could express our belief that humans navigate over Wikipedia by preferring to choose hyperlinks. Another hypothesis could believe that humans navigate randomly."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"#### Hypothesis matrix $Q$\n",
"Researchers express a hypothesis $H$ by Markov chain parameters (transition probabilities between states) and the belief in them. This is accomplished by expressing a hypothesis matrix Q. This matrix contains all possible transitions of the Markov chain model and corresponding belief in them; higher values refer to a higher belief. For example, if a hypothesis H believes that humans navigate over the link structure, then this hypothesis could increase the elements $q_{i,j}$ of $Q$ that correspond to existing hyperlinks and keep other elements at zero. E.g., if page $1$ has a link to page $2$ but not to page $3$ we could set $q_{1,2}=1$ while keeping $q_{1,3}=0$.\n",
"\n",
"By and large, researchers can express a hypothesis $H$ by a hypothesis matrix $Q$ capturing the belief in transitions based on the given hypothesis. Higher values in $Q$ correspond to a higher belief in them."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Prior\n",
"\n",
"In the Bayesian framework, a prior corresponds to the belief in parameters before seeing the data. For HypTrails, we utilize the prior for encoding hypotheses. In detail, for a given hypothesis $H$, HypTrails elicits a Dirichlet prior, having the hyperparameters $\\alpha$, based on the hypothesis matrix $Q$. "
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"#### (Trial) roulette method\n",
"\n",
"For eliciting priors, HypTrails utilized an adapted version of the so-called (trial) roulette method. The core idea is to distribute a set of chips (pseudo counts) to the hyperparameters of the Dirichlet priors based on the specification of the hypothesis matrix $Q$. Simply put, higher values for $q_{i,j}$ receive more chips than lower values."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Hypothesis weighting factor $k$\n",
"\n",
"With the hypothesis weighting factor $k$ we can steer the number of chips distributed to the pseudo counts of the Dirichlet priors. The higher we set $k$, the more concentrated the Dirichlet distributions get. This means that with higher $k$, we have more belief in a given hypothesis as the prior assigns less probability to parameter configurations deviating from the specification in a hypothesis matrix $Q$."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Marginal likelihood (evidence)\n",
"\n",
"The marginal likelihood is the weighted average of the likelihood where the weights come from the prior. HypTrails utilizes the marginal likelihood for judging the relative plausibility of hypotheses. Simply put, the higher the marginal likelihood, the better a prior (and thus, a hypothesis) captures the underlying mechanisms producing the human trails at interest."
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"####Bayes factors\n",
"\n",
"For judging the strength of differences between individual marginal likelihoods, Bayes factors can be calculated which simply are ratios of evidences."
]
}
],
"metadata": {
"celltoolbar": "Raw Cell Format",
"css": [
""
],
"kernelspec": {
"display_name": "Python 2",
"language": "python",
"name": "python2"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 2
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython2",
"version": "2.7.10"
}
},
"nbformat": 4,
"nbformat_minor": 0
}
![](\"http://i.imgur.com/0K2oEh3.png\"/)
"
],
"text/plain": [
"![](\"http://i.imgur.com/FR4fqqQ.png\"/)
"
],
"text/plain": [
"![](\"http://i.imgur.com/EZTKWcc.png\"/)
"
],
"text/plain": [
"