{ "cells": [ { "cell_type": "code", "execution_count": 27, "metadata": { "collapsed": true }, "outputs": [], "source": [ "%matplotlib inline\n", "\n", "# RESEARCH IN PYTHON: Regression Discontinuity Analysis\n", "# by J. NATHAN MATIAS March 23, 2015\n", "\n", "# THE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR\n", "# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,\n", "# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE\n", "# AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER\n", "# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,\n", "# OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN\n", "# THE SOFTWARE." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Regression Discontinuity Analysis" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "This section is taken from [Chapter 9](http://www.ats.ucla.edu/stat/stata/examples/methods_matter/chapter9/default.htm) of [Methods Matter](http://www.ats.ucla.edu/stat/examples/methods_matter/) by Richard Murnane and John Willett. \n", "\n", "In chapter 9, Murnane and Willett introduce the practice of Regression Discontinuity Analysis, an method for estimating a causal effect in cases where a randomized trial is not possible. \n", "\n", "Regression Discontinuity analysis is possible in cases where some kind of cutoff determines who goes into one group versus another. Instead of looking at the effect of the predictor on the outcome for the entire population, we compare predicted outcomes on both sides of the cutoff.\n", "\n", "In *Methods Matter*, the authors use a paper by Joshua Angrist and Victor Lavy: \"[Using Maimonides Rule' to Estimate the Effect of Class Size on Scholastic Achievement](http://qje.oxfordjournals.org/content/114/2/533.short).\" In this paper, the authors were not able to randomize class size assigment, but they *were* able to take advantage of a rule in Israeli schools that split classes into smaller sizes if the enrollment cohort was 41 or higher. This offered Angrist and Lavy a natural experiment for their research question, since we might expect cohorts on both sides of the cutoff to be very similar, except for the cutoff (the equality of expectation assymption). \n", "\n", "**Regression Discontinuity** analysis uses observations further from the cutoff together with nearer ones \"to *project* the estimated treatment effect at the *cut-off*.\" Practically, this technique regresses the outcome on two predictors:\n", "* a continuous predictor (the **forcing variable**) \"that arrays observations (here, classrooms) along a continuum [here, class size] that includes an exogenously defined cut-point. The forcing predictor is usually recentered so it has a value of zero at, or just beyond the cut-point\" (180)\n", "* \"a dichotomous predictor that specifies on **which side of the exogenously defined cut-off a particular observation lies**, and consequently to which experimental conditions it has been assigned implicitly\" (180) (in this example, we construct the variable *small* from class sizes above and below the cut-point)\n", "\n", "The assumptions of this approach (beyond the assumptions of regression modeling) are:\n", "* assumption: the cutoff is \"as good as random.\" To test this assumption, we can:\n", " * verify that there is no selection bias in the application of the cutoff, perhaps with the [McCrary Density test (2008)](http://eml.berkeley.edu/~jmccrary/mccrary2006_DCdensity.pdf) on both sides of the cutoff. See also Urquiola and Verhoogen (2009) \"[Class-Size Caps, Sorting, and the Regression-Discontinuity Design](http://www.columbia.edu/~ev2124/research/Urquiola%26VerhoogenAER2009.pdf),\" for an in-depth exploration of how to observe these biases. \n", " * confirm that there is no unobserved influence (in the case of Angrist & Lavy, the authors consider a possible relationship between the socio-economic status of a region and cohort size)\n", "* assumption: the relationship between the outcome and forcing variable is well modeled, something that is sometimes addressed (like below) by limiting the \"bandwidth\" observations on both sides of the cutoff. These can be tested with:\n", " * sensitivity analyses at different bandwidths\n", " * sensitivity models that adopt a variety of possible functional forms\n", "\n", "## About The Angrist & Lavy Dataset\n", "In this analysis, we examine a dataset that includes school level data for:\n", "* *size*: fifth-grade cohort size\n", "* *intended_classsize*: average intended class size for each school\n", "* *observed_classize*: observed average class size for each school\n", "* *read*: average reading achievement in cohort\n" ] }, { "cell_type": "code", "execution_count": 28, "metadata": { "collapsed": true }, "outputs": [], "source": [ "# THINGS TO IMPORT\n", "# This is a baseline set of libraries I import by default if I'm rushed for time.\n", "\n", "import codecs # load UTF-8 Content\n", "import json # load JSON files\n", "import pandas as pd # Pandas handles dataframes\n", "import numpy as np # Numpy handles lots of basic maths operations\n", "import matplotlib.pyplot as plt # Matplotlib for plotting\n", "import seaborn as sns # Seaborn for beautiful plots\n", "from dateutil import * # I prefer dateutil for parsing dates\n", "import math # transformations\n", "import statsmodels.formula.api as smf # for doing statistical regression\n", "import statsmodels.api as sm # access to the wider statsmodels library, including R datasets\n", "from collections import Counter # Counter is useful for grouping and counting\n", "import scipy" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Acquire Dataset from Methods Matter" ] }, { "cell_type": "code", "execution_count": 29, "metadata": { "collapsed": false }, "outputs": [], "source": [ "import urllib2\n", "import os.path\n", "if(os.path.isfile(\"class_size.dta\")!=True):\n", " response = urllib2.urlopen(\"http://www.ats.ucla.edu/stat/stata/examples/methods_matter/chapter9/angrist.dta\")\n", " if(response.getcode()==200):\n", " f = open(\"class_size.dta\",\"w\")\n", " f.write(response.read())\n", " f.close()\n", "class_df = pd.read_stata(\"class_size.dta\")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Summary Statistics " ] }, { "cell_type": "code", "execution_count": 30, "metadata": { "collapsed": false }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ "==============================================================================\n", " OVERALL SUMMARY\n", "==============================================================================\n", " read size intended_classize observed_classize\n", "count 2019.000000 2019.000000 2019.000000 2019.000000\n", "mean 74.379171 77.741951 30.955935 29.935116\n", "std 7.678460 38.810731 6.107924 6.545885\n", "min 34.799999 8.000000 8.000000 8.000000\n", "25% 69.855000 50.000000 27.000000 26.000000\n", "50% 75.379997 72.000000 31.666666 31.000000\n", "75% 79.839996 100.000000 35.666668 35.000000\n", "max 93.860001 226.000000 40.000000 44.000000\n" ] } ], "source": [ "print \"==============================================================================\"\n", "print \" OVERALL SUMMARY\"\n", "print \"==============================================================================\"\n", "print class_df.describe()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Set up Forcing Variable and Cutoff Predictor" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "The Forcing Variable (*csize*) is centered around the cutoff, and the cutoff predictor (*small*) is a dichotomous variable that indicates which side of the cutoff an observation lands." ] }, { "cell_type": "code", "execution_count": 34, "metadata": { "collapsed": false }, "outputs": [ { "data": { "image/png": [ "iVBORw0KGgoAAAANSUhEUgAAAX4AAAEcCAYAAADA5t+tAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\n", "AAALEgAACxIB0t1+/AAAHwlJREFUeJzt3XuYXFWZ7/FvJSEkYIgZSBSMp9sZ5FUJIIgiyOSCEEWN\n", "wUucGefxCCIXiQ4PE4IYAzoHFGea8AjqIIZA8MioE4Yhw3DVkEkgc8AHBpQQffHWfcyoJOEkYAIR\n", "SNf5Y61Oik5fq/elqtbv8zz9pGvvqv2uvVP97rXXXmvtSrVaRURE0jGq7AKIiEixlPhFRBKjxC8i\n", "khglfhGRxCjxi4gkRolfRCQxY8ougLQGM5sJ/DPwBFAB9gU+5e6PZbDt5cB33f2eftZPAya5+/0j\n", "jZUHM7sQ2OzuN9Us+yLwuLv/Sw7xXgVc6u7zs962tAYlfslKFfihu38UwMxOAS4D5mS07YEGnHwY\n", "+B3QkImfvsue2wAad38KUNKXfinxS1Yq8afHnwBPAZjZ0cA1wC5gJ3AWcBDwv4G3AX8BvBu4CLgJ\n", "2AEcDPy7u1/as0EzGwMsB14HjAauAh4ATgd2mtkj7v5wzfsvAU4DNgP7AZcAs4ATgP2BM4H3xvgv\n", "AWvd/eJYG/+du19nZm8ArnX3WWb2n4ADr4/b/Gj83DeBQwlNp4vdfY2ZnRbjPU1I8v/UxzE73cw+\n", "BYwDLgBeCZzl7h+J5V8HfMjdfx9fV4CvAW8FxgJfAP4P8P147McB5wLPAN+N+3p3jL8PcFwsextw\n", "efz/+CVwjru/1Ef5pEWpjV+ydJKZrY4J8gbge3H5UmC+u88E/hG4yt0fBa4Hvg2cB3yCkLzagHmE\n", "5HZKPGkQ150LPOXu7wBOJiSvPwI3xm3WJv2jCCeTYwnJ/+C4qgo8EbexT4x1vLufALzezN5L/7Xx\n", "V8U4JxIS5rnAJwnNODNinG+YWc9J6WR3nw1s6Wd7P3H3k4GzgW+6+w+AI8zslWZ2eNzu72vefxpw\n", "oLsfR0jqx8bjtAU4lVDL37+n/O6+091nuvss4NfAue7eGf8/PhD/P/6bcOKUhCjxS5buc/dZMYke\n", "DXzfzMYBB7v7T+J77gcOj79fB5wE3OzuO+KyB939OXffBTwEHFaz/TfEz+Pu24ENwJ/FdbVXGz3v\n", "/ZG7V919J/Bwzbona97zYIzVu2w9are7yd0fj78/EMs2DXiPma0GbiFciRwCPOPuW+N719K3NXFf\n", "NgCvjsu+A/wVIRlf3+v9hxFq+Lj7tng1dBewDlgJ/C+gu1eZMbOvAz9z92VmNiXGWhHLPBv4H/2U\n", "T1qUEr/kZRN7as6/NbMj4u8zCM0lAB3x5wwze11cdpSZ7RNrzW8D1tds86fAnwOY2QTgCEJNtpu9\n", "v8tPAG81s4qZ7Us4EfXortnecWY2OjajTI9l28meK4Rjaj53kJm1x9/fATwO/Ixw43kWMJdwg/v3\n", "wMSYZAHe3vchCsvN7M1AZ1x2I/CRuJ939nr/Twk1fMxsopndCcwkNEu9C/gS8GVqrljM7DIAd/9S\n", "XLQF2Ai8P5b5K8AP+ymftCglfslKlT1NPT8E7gH+Nta2zwK+bmZrgc8AF5jZXOBQd78COB+4mXDP\n", "qQrcDjwI3OLuT9Rs/1vAgWZ2P7Aa+KK7bwYeAT5tZjN6CuPu6wmJ80HgVuDF+NOzrZ73/DOhxvwQ\n", "8Gt3X0loM++pxR/NnkT6EnCFmT1AaPb5FuGq5Q1m9h/AfwD/191fBD4F3BmPxST6bj6aZmargKsJ\n", "zT24+2+BZ4FV7t5d+2Z3/zdga9z/u+Pnfgx8Mpb1HwiJH6BqZscCFwOHxf+X1YQT7/mxbOti3A19\n", "lE1aWEWzc0qjiLXpr7n7iHsCmdlk4MPufm2s8a8HZrn7xhFs83F3P2Lwd46Mma0ELnD3X+UdS9Kk\n", "Xj3SSAbrtjkcWwhNPWfEbS4dSdKPcq0lmdl4wn2GVUr6kifV+EVEEqM2fpEMmdl2M1MvGWloSvwi\n", "2dIltDQ8tfFLsuL8QlcD2wkDny4FFhFGxT4HXOjuD8a5b64DevrAdwEfcffNZvbnhNG03YSxAqpM\n", "ScPTl1RSdzjwl4T5fi4HTnX3Y4BzgFvNbD/ClA7r3P0Ed/9TwknhY2Y2FlhB6IFzDHAvML6MnRAZ\n", "DiV+Sd1v3P03hBGsBwP3mdmjhBG0u4A/c/drgAfN7G/N7FrCaN39CQPIXnD31QDufguwta8gIo1E\n", "TT2Suu3x31GEbpR/2bMi3qTdaGZ/Txgxuwy4j/B3U6GP6REIg7xEGppq/CLBamC2mRmAmb0beIww\n", "4+Vs4KvufjNhVs5TCHPyPA5UzOzU+Jn3AJNLKLvIsCjxS+p6pm94gjB9wffM7DHiswTc/TnC5GdX\n", "mtmDwLWEydgOjVMZnwZcFpuHPkycilqkkWkAl4hIYgZt4zez44CvxAdRHEp4EEY3Ye6T+e5eNbOz\n", "CLWll4DL3f2OHMssIiIjMGBTj5ldRHhow75x0VXAInefTripNdfMXk2YcfEE4F2E2QvH5ldkEREZ\n", "icHa+H8BfJA9PReOcfeeh0rcRXgK0lsJfZxfdPdn42eOzKOwIiIycgMmfne/lZd3T6vtuvYHYCJw\n", "AOEZn72Xi4hIAxpuP/7aB0McAGwjPDRiQs3yCQw+iGU9ez/iTkREstN7jMluw038j5rZDHdfQ3i4\n", "8yrgR8CX4sMuxgFv5OWPy+vLtGHG7a3KADuVszJjlx1f+16eVPddxz0HQ038PX0+FwBL483bDYRH\n", "41XN7BrCAyRGEW7+vpB9UUVEJAvN2o+/Jc/CTRBf+16eVPddxz0HGrkrIpIYJX4RkcQo8YuIJEaJ\n", "X0QkMUr8IiKJUeIXEUmMEr+ISGKU+EVEEqPELyKSGCV+EZHEKPGLiCRGiV9EJDFK/CIiiVHiFxFJ\n", "jBK/iEhilPhFRBKjxC8ikhglfhGRxCjxi4gkRolfRCQxSvwiIolR4hcRSYwSv4hIYsYM9wNmNha4\n", "HjgUeBH4G2AHsBzoBtYD8929ml0xRUQkK/XU+M8CnnP3E+LvNwJLgEXuPh2oAHOzK6KISP4qlUpH\n", "pVLprP1pb2+n17KOssuZhXoS/5uAuwHc/UngNcBJ7r42rr8LODmb4omISNaG3dQDPAa8D7jNzN4O\n", "TAZqm3W2AxMzKJuISGGq1epCYGHvxUB78aXJVz2J/wbgjWZ2P7AOcOCgmvUTgG2DbGM9cHgdsWuV\n", "eQ+h7PsX2vf0YhcSf+HChaxYsWLA2PPmzaOjo9AWj5Y/7jnFrvS7olod3nbN7HjgQHf/dzM7FugA\n", "ngWucvc1ZvZNYJW79/ntyUiVAXYqZ2XGLjt+Evse23Hn1S5ra2tr6+rq6qpZtCLWEItSyr6Pe8WB\n", "U8eMGTN6+7anytr3JL5zRceup8bvwPfNbBGwE/gk4V7B0tjjZwNwS3ZFFCnXuFccOPXpZ3aWXYxC\n", "9G7umLNgZeeUSePbli2e3V5eqSRrw0787v7/gFP6WDVzxKURaQBKftLq6qnxi0gibl8yt53y29hL\n", "EU/4LFs8u+yiZE4jd0VEEqMav8ggUq71SmtSjV9EJDFK/CIiiVHiFxFJzLAHcDWIlhxU0QTxte/l\n", "KSV+TVdWHfcWiq0av4hIYpT4RQYxZ8HKzjMvv7fsYohkRolfRCQxDZ/4U3o4gohIERo+8YuISLYa\n", "fuRuSg9HEGk0KY9aLnKunn6mAqerq6uzZlFm02Grxi8i0mDyngq84Wv8KSu6FiB9S7nWW6SUv+9F\n", "TwWuGn8TSemBICKSn6ar8bfyHNm96YEgkhLdzytO0yV+EZEszFmwcq+mpV6mbnlmJ3MWrOwc4D0r\n", "bl8yN/Omp7ybF5X4m4jamqVoLX6FPQ+YCmzsZ/3GgyaOa9u09fn+Pj81bqPp7jko8Ys0mJRvcpZg\n", "Y6xQ9affpqZBrgQamm7uigyi7Ll6dFNfsqYav0iD0U39oMWbmUo17MRvZqOA64HDgG7gLGAXsDy+\n", "Xg/Md/dc2qLVzi0iMjL11PhnA/u7+4lmdjLw5bidRe6+1syuBeYCt2VYThHJQSP3bElZ3lc79ST+\n", "54GJZlYBJgIvAMe5+9q4/i7CyUGJP2O69E1Tzle5yfZsOWXzQ5Nev+M3+6+b++3O/t6z75TJ/HHT\n", "5j7Xnzdmv6k/3/+1O0I9t7nUk/jXAeOAnwEHAnOA6TXrtxNOCCJNQbXeNHu2pKyexH8RsM7dP29m\n", "U4HVwD416ycA27IonEhBkq31puwHk4/b+oPJx20d6UnvbzIvWf7qSfz7A8/G37fGbTxqZjPcfQ1w\n", "KrBqkG2sBw6vI3atMm/wlhJ7yqTxhcVfuHAhK1as6GvV7tjz5s2jo6PwZ+Bkvu89x3XZ4tltg7y1\n", "z/Wxq2cb+f+/5LbvQ9h2n+vz/E7evmR3E0oux7WR9z2jbff7oPZ6En8HcKOZ3U+o6X8OeARYamZj\n", "gQ3ALYNsY1odcYGXdW3L5enzQ1BlgAOap01bn++cMml8WxHxr7zyyr4GEbV1dXV11bxnRUdHR5G1\n", "3FyO/aatz3fGX9vriT3Ez49Uqvue299bmfs+lObFUaMqo+csWNk1wHvqbl4cduJ3923AB/pYNbOe\n", "Akhj0oRZIrkqtXlRA7gG0Xv4fJlD5zWGIU3qzdWySruprsQvkrCUuzSmTIl/EH00eai5Q0SaWsMl\n", "fvWpFilOI3dpVBNXfhpxds6emx792XjQxHEDfb7npkfmyp6lsUxF73ulUumoVCqdtT/t7e30WlZ4\n", "X1KRVtBwNf5IIwnlZTQ1sUh2GjXxSx9SuvRVd9I91JtLstaITT0iIpIj1fhFpDSDdOZQR46cKPH3\n", "kuoXUb2ppCQDjWDV5Hg5UeLfW6pfRM1QKWUZqDOHOnLkQIm/b6V8ERug1q3eVCIJ0M3dxtKwYxjK\n", "pjEUae675EM1/sajWreI5Eo1fhGRxCjxi4gkRk09AqQ9PW/K+y5pUuKXhtAAPZpKk8G+N+V+S3mU\n", "+AVoiOl5SxtH0OT7rvETMmxK/NJIUu7RVNe+N/t+D9bMpia2fCjxi6StDQY+gUyZNJ5NW5/vb/1A\n", "VyrSoJT4e1ENRORlpm4Z+DkIG4EV9W58CM1spTz9q9Up8Ysk7PYlcysDrZ+zYGXnQRPHtS1bPLu9\n", "oCJJAYad+M3s48Dp8eV44CjgROBqoBtYD8x396Z8cIRqICKSt7K7EA97AJe73+Tus9x9FvAw8Bng\n", "UmCRu08HKqitQ0SkYdXd1GNmxwJvcvdPm9kX3X1tXHUXMBu4LYsCpqTsWoCIFKPsLsQjaeNfBPxd\n", "/L22nXA7MHEE2xURKUKyPZrqSvxm9krgMHdfExd116yeAGwbZBPrgcP7WjFl0vieXwe7R9Dn+mF8\n", "vk9D/HwusX982Ex+DCxbPLttkLf2uT5O3XtAPfGb5LjnEr+Z932ksQdz+5LdV4+5bL/Mv7ea7fT5\n", "97TlmZ1seWZnv+sB3nHUa9rqiV/Qd67fG/f11vinA6tqXj9qZjPiieDUXuv6Mq2/FTVn1/YBPl+l\n", "n50a4uf7NYTPlxk7t/hNcNxzi9/M+z7S2EPU776P1Katz1cB5ixY2dXX+imTxrdt2vp8n+vYU+Nu\n", "ryd2zUmtT3MWrOycMml827LFszPf97K/c/Um/sOAX9a8XgAsNbOxwAbgljq3K+VJ9rKXkvd9JPd2\n", "Wvy+Tq5jCFJWV+J39yt7vf45MDOLAkljWH/ftyb9/hcP7d/zujJq1GioUO3etfsJYa8+9Lgd0046\n", "e2t82cp/hEpAORloHIHGEORHA7gE2PsPsFI5ba8ZI9va2tq6urp212w7H7tzxa8fvaPpJwcrexDT\n", "SHp4aOyI1EOJX/pUrVYXsveMj/12LxOR5qHELw1BYxgaU7zBybLFs8suSuHiFVhTzkAwGD16UUQk\n", "MarxS0MoeySjNJ5WrnGXTYlfZBBKQNJq1NQjIpIYJX4RkcSoqUdE+pVyM1cr92hSjV9EJDGq8TeW\n", "lOfLEXmZVq5xl02Jv7m08pwxDXvSUwKSVtNwiT/lEZxlzxnT4HTS6/ukp6s8GbaGS/ySJp30BjTQ\n", "Sa+ZT3hSkoZL/BrBKalp5JNeys1crdyjqeESfwMY8LJbN1dFpNkp8Q9PK7czizSUVq5xl02Jv5dG\n", "fiKQ/hDKoeMurUaJX5qCkq9IdpT4RRqcTnqSNSV+EelXyiednHs0lTpgUXP1iMhulUqlo1KpdNb+\n", "tLe302tZR9nlTECuHUlU4x+GlGs/IkUregxBPKHN63k97hUHTh0zZgw3XPJUZ83bVlSr1YUjjVX2\n", "2I26Er+ZfQ6YA+wDfB1YBywHuoH1wHx3V4LMWMqDacqU0nGPSa13Yut3wGSWiky8Q7Fz+9Mb29ra\n", "2rZvKyJasYbd1GNmM4Hj3f0EYCbwp8ASYJG7TwcqNONEOdLQ5ixY2Xnm5feWXQwp0M7tT288cOK4\n", "wuJVq9WF1Wq1vfans7OTXssKOenkrZ4a/2zgcTO7DTiAUDs4093XxvV3xffclk0RRdKWyhVHmVcb\n", "qakn8U8GXgu8j1Dbv51Qy++xHZg48qJJyhrtsl+KV6lQ6e6GyoCt4VKPehL/FuCn7v4S8KSZ7QRe\n", "U7N+AjBYq9h64PC+VkyZNL7n18HuEfS5fhifH4lS7l8UtG+DKST2hRdeyIoVe3daOHBiW1vP7/Pm\n", "zbsQuDDvspR93MuOX1bs7u7yYvdSePzbl+xuLR9J7H5PmfUk/geA84GrzOwQYD9glZnNcPc1wKnA\n", "qkG2Ma2/FTX9VtsH+HyVfnZqiJ+vS7zkblu2eHYpdZBNW5/vnDJpfBsD/IfmrN/jnrWOjg46Ovbq\n", "NVhY/FplH/ey41Pwca9UdseqvPQSu8aM2XMvslotPAmX8p3LO/awE7+732Fm083sR4Sbw+cBncBS\n", "MxsLbABuybSUAqg7aVl03KXV1NWd090/28fimSMrioiIFEEDuEQanK44JGuNmPgb9qHbIpK/nnb8\n", "SiX8lNCu3/Kaca4ePQxFJBGpduXMe8Biw9X4y57DYiC65BaRVtCMNf5kadqCcui4l6NapZpqjT9v\n", "SvwiIolpuKYe2UPTFgikM1ePFEc1/iZS9GyFItKamq7Gn9INVs1WKJKmvPOcavzDoJt8ItIKmq7G\n", "L5K33vdWANra2qhc0tVZs0j3VqRpqcYvIpKYSrXalM3lhU2VWlv7i71qRm/f9lRXzVuKrvm15DSx\n", "TRBf+55e7LLj5xZbNf5hUK8aEWkFTVfjL/thKKgGon1PL36qsUuLn3eeU41fRCQx6tUjTUEP3pZW\n", "VvQofdX4RUQaTN73E1Xjl4ZW++DtahVGjdrT3tqqD+jor/a3fZvmaGpVRY/SV41fpMGpN5lkrel6\n", "9UTqZZBY7NjG311zBVA0/b+nF7vs+OrHLyIi2VDiFxFJTF03d83sv4Bn4stfAVcAy4FuYD0w390z\n", "aUPqb8Ksri5NmJWSVr2RK1KGYSd+MxsH4O6zapb9G7DI3dea2bXAXOC2zEopIiKZqafGfxSwn5nd\n", "Ez//eeAYd18b198FzCajxK+HkYiIZKueNv4dQIe7vws4F7i51/rtwMSRFkxERPJRT43/SeAXAO7+\n", "czN7Gji6Zv0EYNsg21gPHF5H7FpltvmW3d6sfU8vdtnxU41ddvyRxO63K2g9if8M4EhgvpkdQkj0\n", "95rZDHdfA5wKrBpkG9PqiFurJfvWNkF87Xt5Ut13HfccDHsAl5mNAW4E2uKii4CngaXAWGADcFZW\n", "vXr60ZL/GU0QX/tenlT3Xcc9Bxq521yxy46vfS9Pqvuu454DDeASEUmMEr+ISGKU+GVIKpUwLbKI\n", "ND8lfhkyJX6R1qAHsciAej8IpXZaZM2fI9KcVOOXoVJTT0nUzCZZU+KXoarqQecirUFNPTKgnuac\n", "SiX8qHmnOCk+b1iKoRq/iEhiVOOXIVNTT7F0tSV5UY1fhqRaVRt/mXRzV7KkxC8ikhg19Yg0qNqb\n", "u71eq9lHRkQ1fhGRxKjGL9KgdHNX8qIav4hIYpT4RUQSo6YekQanJh7Jmmr8IiKJUeIXEUmMEr+I\n", "SGKU+EVEEqPELyKSmLp79ZjZFOAR4J1AN7A8/rsemO/u6okgItKA6qrxm9k+wHXADsI8IlcBi9x9\n", "enw9N7MSiohIpupt6ukArgV+F18f4+5r4+93ASePtGAiIpKPYSd+Mzsd2Ozu98ZFlfjTYzswceRF\n", "ExGRPNTTxn8GUDWzk4E3AzcBk2vWTwC2DbKN9cDhdcSuVeY9hLLvX2jf04tddvxUY5cdfySx+310\n", "0rATv7vP6PndzFYD5wIdZjbD3dcApwKrBtnMtOHG7aXKADuVszJjlx1f+16eVPddxz0HWczVUwUW\n", "AEvNbCywAbglg+2KiEgOKtXmfJhnS56FmyC+9r08qe67jnsONIBLRCQxSvwiIolR4hcRSYwSv4hI\n", "YpT4RUQSo8QvIpIYJX4RkcQo8YuIJEaJX0QkMUr8TaRSodKcA61FpJEo8YuIJCaLSdokZ5XK7vk6\n", "KtUqjBq1Z/6OarX0KWtFpMmoxi8ikhjV+JtAT62+Ugk/quWLyEioxi8ikhglfhGRxKipp4moiUdE\n", "sqAav4hIYpT4RUQSo8QvIpIYJX4RkcQo8YuIJEaJX0QkMcPuzmlmo4GlwGFAFTgX+COwHOgG1gPz\n", "3V1dD0VEGlA9Nf73Ad3ufiKwGPgysARY5O7TgQowN7siiohIload+N19JXBOfNkObAXe4u5r47K7\n", "gJMzKZ2IiGSurjZ+d99lZsuBq4GbYc80wcB2YOLIiyYiInmo++auu58OGHA9MK5m1QRg28iKNajK\n", "4G9pydhlx9e+pxk/1dhlx88t9rATv5l9zMw+F18+D+wCHjazGXHZqcDaPj8sIiKlq1SH+RBXMxtP\n", "6MHzamAf4ArgZ4SePmOBDcBZ6tUjItKYhp34RUSkuWkAl4hIYpT4RUQSo8QvIpKYpnsCl5ldAJwJ\n", "bI6LznH3Jwsuw7eAp939c4O+Odu4HwI+S5gq42Z3v6bA2H8FnA+8BDwOnFf0DXwz2w/4AfAJd/eC\n", "Yo4C/hE4kjA1ySfd/ZdFxK4pw3HAV9x9VsFx9wFuANqAfYHL3f32gmLvNTWMuz9RROyaMkwBHgHe\n", "WUKO+S/gmfjyV+5+Zpbbb8Ya/zHAx9x9Vvwp+j/kHGAaFPsYxPiHcAXwTuB44Dwz+5OCYo8HLgNm\n", "xqk6JhKm7iiMmR1L6Cb8Ooo99qcBY939BOBiwvQkhTGziwgJcN8i40Z/DWyOU7G8G/h6gbF7Tw3z\n", "pQJj95z0rgN2FBk3xh4HUJPjMk360JyJ/y3AIjO738wuLjKwmZ0AvI3whSh0YIe77wLe4O5/ACYD\n", "o4EXCgq/Ezje3XfG12MIYziKNJaQhAup6dd4B3A3gLs/BBxbcPxfAB+knIFEK4BL4++jCFd7hehn\n", "apgidQDXAr8rOC7AUcB+ZnaPma2KV3yZasbE/13CF+Ik4EQze28RQc3sYMIfwacpaTSfu3eb2QeB\n", "R4HVwHMFxa26+2YAM/sMsL+7/7CI2DVl+E9331hkzOgA4Nma17ti808h3P1WCky4vWLvcPftZjaB\n", "cBL4fMHxe6aGuQb4p6LimtnphCude+Oiov/edwAd7v4uwuzHN2f9nWuKNn4zuww4kfAf8H53fzYu\n", "vwM4GrijgNhHAp3AnYTBa/uZ2U/d/dt5xe4VH0Jb461m9q+EQXT/M/6bd+wqYeK9fwAOBT6UV8wB\n", "4r+zpEGBzxKmIekxyt27SyhHKczstcCtwDfc/XtFx3f3083ss8BDZvZGdy/iSvMMoGpmJwNvBm4y\n", "s7nu/lQBsQGeJFzp4e4/N7OngYOB/84qQFMkfne/BMDMDgAeN7M3EWq7JwHLiohdy8w+Tmh2yTXp\n", "18aPta7VZnaKu79gZjsI02XkHjvGX0po8vlAUQm4r2NfgnXAHGCFmb0d+EnJ5SmMmb0KuJdwI391\n", "wbE/Bkx19ysIzYrd8Sd37t4z/QxmtprQgaSopA/hxHMkMN/MDiFcdWba5NRUTT2xpn8xoZljLbDe\n", "3e8uqTiF1j5j2/53gLVmdj/hj+A7RcQ2s2OATxBuat9nZqvN7LQiYjeAfwV2mtk6wo3dC0oqRxlX\n", "O4sIN/Ivjf/nq3tuPBbgFuDNZraGcI/lfHf/Y0Gxy7YMOMDM1gLfA87I+ipTUzaIiCSmqWr8IiIy\n", "ckr8IiKJUeIXEUmMEr+ISGKU+EVEEqPELyKSGCV+kQGY2Rwz+7uyyyGSJfXjFxFJTFNM2SCSBzP7\n", "e8KMny8RZlwdQ5j/qBv4kbufGyfsmgF8Ebit9uOE6YK/ClwZ3zMaWO7uXy1oF0TqosQvSTKzecAJ\n", "hGkoxgIPEpL5eELi/0acJ6UK4O5dhAkBiTOkfpYwP/3ZQNXd32Jm+wL3mNnD7v5AwbskMmRq45dU\n", "TQe+7+4vxumHjyDMvPow8AXCbJS/pdeUvGZ2JGGu9g+5+wuEWUvfb2aPEk4ehxBOJiINSzV+SdWL\n", "1CR1M2sHPgocAbwHuNvM/pqaydHM7CDC5GFn1DwbYBSw0N1vi++ZDPyhiB0QqZdq/JKqtcAHzWxM\n", "fJbvKmALYcbXLxCmIz6y581mNoaQ9K9297U127kPODtu5xXA/YSntIk0LPXqkWSZ2eXA+wkVoK8R\n", "2vfPJjzroQv4OOGhMzMID3lfDjwG7EO4WriX8FSqJYRnQ4wBbnD3jiL3Q2S4lPhFRBKjph4RkcQo\n", "8YuIJEaJX0QkMUr8IiKJUeIXEUmMEr+ISGKU+EVEEqPELyKSmP8P1qMJ5OvF6GYAAAAASUVORK5C\n", "YII=\n" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "def small(size):\n", " if(size>=41):\n", " return 1\n", " return 0\n", " \n", "# \"first\" distinguishes the groups that participate in the first diff.\n", "def first(group):\n", " groups = {1: 0, 2:0,\n", " 3: 1, 4:1}\n", " return groups[group]\n", "\n", "# SET UP Forcing Variable and Cutoff Predictor\n", "class_df['small'] = class_df['size'].map(small)\n", "class_df['csize'] = class_df['size'].map(lambda x: x-41)\n", "\n", "# summarize the read variable by each class size group\n", "class_df[(class_df['size']>=36) & (class_df['size']<=46)].boxplot(\"read\", \"csize\")\n", "plt.show()" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "# Regression Discontinuity" ] }, { "cell_type": "code", "execution_count": 36, "metadata": { "collapsed": false }, "outputs": [ { "name": "stdout", "output_type": "stream", "text": [ " OLS Regression Results \n", "==============================================================================\n", "Dep. Variable: read R-squared: 0.015\n", "Model: OLS Adj. R-squared: 0.010\n", "Method: Least Squares F-statistic: 3.103\n", "Date: Mon, 23 Mar 2015 Prob (F-statistic): 0.0459\n", "Time: 23:57:58 Log-Likelihood: -1536.6\n", "No. Observations: 423 AIC: 3079.\n", "Df Residuals: 420 BIC: 3091.\n", "Df Model: 2 \n", "Covariance Type: nonrobust \n", "==============================================================================\n", " coef std err t P>|t| [95.0% Conf. Int.]\n", "------------------------------------------------------------------------------\n", "Intercept 70.1188 1.151 60.908 0.000 67.856 72.382\n", "csize -0.1392 0.119 -1.168 0.243 -0.373 0.095\n", "small 3.9531 1.800 2.197 0.029 0.416 7.491\n", "==============================================================================\n", "Omnibus: 34.356 Durbin-Watson: 1.967\n", "Prob(Omnibus): 0.000 Jarque-Bera (JB): 40.549\n", "Skew: -0.711 Prob(JB): 1.57e-09\n", "Kurtosis: 3.529 Cond. No. 34.2\n", "==============================================================================\n", "\n", "Warnings:\n", "[1] Standard Errors assume that the covariance matrix of the errors is correctly specified.\n" ] }, { "data": { "text/plain": [ "" ] }, "execution_count": 36, "metadata": {}, "output_type": "execute_result" }, { "data": { "image/png": [ "iVBORw0KGgoAAAANSUhEUgAAAsYAAAGACAYAAACugaRZAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\n", "AAALEgAACxIB0t1+/AAAIABJREFUeJzs3XlYE8cbB/AviBwegHe1VkO1BhQUkcOjCoI/ihVbqReI\n", "Ih6tB2rV1kqt1LNqva8WlXoiaEVRqYpVPLBKPVqt961YtNYbBSGc+/sjzcKSBBKSMVl4P8+TR7NJ\n", "NsNmdnZ25p0ZE47jOBBCCCGEEFLJmRo6AYQQQgghhBgDqhgTQgghhBACqhgTQgghhBACgCrGhBBC\n", "CCGEAKCKMSGEEEIIIQCoYkwIIYQQQggAA1aMw8PDYW9vr/Ro3bo1vL298c033+DZs2eGSt4btWLF\n", "Ctjb2+Off/55Y9956tQppWPfqlUreHh4YODAgUhISFD6THx8POzt7XHmzJk3lk5dpKWlCZ7b29vj\n", "66+/ZvZ93t7eGDRokGDbs2fPkJ2dzeT7FPmm5MPR0RGdO3fG+PHj8ffffzP57rKUPBaDBg2Ct7e3\n", "QdKyb98+DBo0CO7u7mjTpg0++OADzJ49G0+fPjVIelh6k+fo2bNnMXHiRHh7e8PJyQldunRBeHg4\n", "7t27Z7A0aevx48eYOXMmfHx80Lp1a3h4eGDIkCFITExUeq+q85slVddIJycneHt7Y/bs2Xj16lW5\n", "971hwwa8//77aNOmDRYtWqTHVBsvbcqgtLQ0viwtrZxQdRwzMzPx/PlzvaS5NLm5uXj06BH//E3X\n", "I5KTkzFy5Eh4enrCyckJPj4+mDVrlk7lamFhIR48eFCuz169ehWffPIJX4cEyp/PzcqVAj2aMmUK\n", "atWqxT/PzMxESkoKduzYgUuXLmH79u2oWrWqAVPInq+vLyQSieA4vMnv/t///gcAyM/Px9OnT5GU\n", "lISvvvoKZ8+exfTp0/n3urm5YcGCBXj33XffeDq19e233yI1NRWbNm3ity1YsABNmjRh9p1TpkxB\n", "9erV+efJycmYNGkSdu3aBSsrK2bfO3LkSDRr1ox/LpPJcPbsWezatQtnz57FL7/8AhsbG2bfr46J\n", "iQn//1GjRjG7QSjNkiVLsHr1anh5eSEsLAxWVla4ceMGduzYgcTERGzduhXvvPPOG0+X2C1btgyr\n", "Vq1C8+bN0adPH9SrVw+3b99GXFwcDh48iE2bNqFVq1aGTmapHj58iL59+wIAevfujXfeeQfp6ek4\n", "cOAAJkyYgAsXLmDy5Mn8+0ue329K8WukTCbDrVu38PPPP+PixYvYsmULTE21a9+6fv065s2bB2dn\n", "Z/Tp0wcODg4skm2UipdJpfnll19gZWWF7OxsJCQkYOjQoUrvUXUcL126hFGjRmHx4sWoXbu2vpPP\n", "e/DgAYYOHYqRI0ciICCA2feokpeXh+nTp2PHjh1wdnZGcHAwbG1tcfnyZWzbtg0HDx7Eli1b8Pbb\n", "b2u138zMTISGhsLLywtjxozROl3ffPMN7t69i4kTJ6JevXq65XPOQCZPnsxJpVLuwYMHKl+fPn06\n", "J5VKuX379r3hlFUOJ0+e5KRSKbdixQql1woLC7lJkyaJ+vh37dqVGzRokEHTsHz58lLzuL72f/r0\n", "aZWvR0VFcVKplIuKimLy/aUxhuP/zz//cA4ODtzs2bOVXjt37hzXsmVLbvz48QZIGTs7duwoNU/o\n", "w/bt2zmpVMpNmzZN6bU7d+5w7u7u3Pvvv8/l5OS8sTSVx9SpU7m2bdty//77r9JrI0aM4Ozt7blb\n", "t24ZIGVypV0jY2NjOalUyh05ckTr/SYkJJT7s2I2cOBAztvbW6P3du/enRsxYgTn7+/P+fv7q3yP\n", "quP4pvK64vq9c+dOfhvr643CsmXLOKlUyq1atUrptTNnznCOjo5cQECA1vtNS0tTWyfRRKtWrbix\n", "Y8fyz3XJ50YbY6y4C7pw4YKBU1L5mJiYYNq0abCxsUFUVJShk1NunJEs6miodFT2c+j8+fMoLCzE\n", "+++/r/Sas7MzWrdujfPnzxsgZeKVl5eH+fPno2nTppg2bZrS63Z2dhg2bBiePn2KQ4cOGSCFmjt3\n", "7hzeffddNGjQQOm1kJAQAMBff/31ppOlEXd3dwDArVu3tP5sXl4eAKBatWp6TVNFceXKFdy5cwfu\n", "7u7w9PTEzZs3cenSJaX3lXYc31SZ/6avLU+fPsWaNWvQvn17jBgxQul1V1dXfPLJJ7h27dobv+7k\n", "5+cLenR0yedGWzG2tLQEoPzDHzlyBIGBgXB2doa7uzvGjRuH1NRUpc/v3r0bPXv2RJs2bdCjRw8k\n", "JiYiNDRUECPm7e2NiIgITJkyBa1bt4anpyfS09MByAvNIUOGwMXFBS4uLhg2bJjSD/3y5UuEh4fD\n", "y8sLTk5O+N///ofFixcjNzeXf09ubi6+++47+Pj4wMnJCV5eXpg5c6YgPkxVbNCLFy8wffp0dO7c\n", "GU5OTvDz88OaNWtQWFgo+Fzr1q1x7949jBgxAi4uLnB3d0d4eDj/d5RX9erV0bVrV1y5coWPl1IV\n", "K/jrr7+id+/ecHFxgaurK4YOHYqzZ88K9sVxHDZt2gR/f3+0adMGPj4+WLRoEWQyGf+egoIC/PTT\n", "T/jggw/g5OSEzp07Y/r06Xjx4gX/HkVcdEpKCmbMmIEOHTrA2dkZoaGhuHbtGv8+xbE8c+YM7O3t\n", "sWvXLn578Rhje3t7rFmzBuvXr0e3bt3g5OSEnj17Yv/+/YL0q4tNLrm9eAxieHg4fvjhBwCAj48P\n", "Bg0ahJ9//hn29vZITk5W2le/fv3Qp08fwd+5cuVKlb+NptSdQ5rkbQDYsmUL+vTpAxcXF7Ru3Rrd\n", "u3dXeaO0b98+fPzxx2jTpg169uyJ06dPK72nZHzfoEGDMHz4cBw7doyPC/Py8sLKlSuV0nv+/HmE\n", "hITAxcUFXbp0wcqVK7Fy5UrY29uX+vfXqFEDALBjxw6+kCxu06ZNOHz4sGBbZmYm5syZAy8vLzg7\n", "O6Nnz56Ii4sTvEebc/PgwYPo1KkTXFxcsH37dgDycmPWrFn85z/88ENByI/Cli1b0LNnTzg7O8PD\n", "wwNjxozRuCL06NEjhIWFoW3btujUqRNmz56NzMxMAEBGRgZat26N8ePHq/xOe3t73L59W+V+U1JS\n", "8PLlS/Tp00dtt3RwcDCOHj2K7t27q03fvXv3MHnyZHTp0gWOjo7w8PDAyJEjlf4+TcqX06dPIzg4\n", "GG5ubmjbti2CgoJw5MiRUo8PIM8f169fx7lz55Re69ChAy5fvozevXvz24qf36rGaBR/KMocQPPz\n", "TRv//vsvACiFht26dQthYWFwc3ODs7MzgoKCcPz4cf71QYMGYcqUKQDklf/i59D169cxevRouLm5\n", "oU2bNujfvz+SkpIE+1ect0uWLEHbtm3RsWNH3Lx5U6PvLk1iYiIGDhwIV1dXODo6wsfHBwsWLBBc\n", "S7UpM1JSUhAYGIi2bdvC19dXZcy4Or/88gsA+c2HIswwPj5e6TiUPI4rV64UbCte3v3777/46quv\n", "0L59e7Ru3RoBAQH89yiEh4eje/fuiImJgZubG9zd3VUev/j4eAwePBgA8PXXXyuVg/fu3cPIkSPR\n", "tm1beHh44Ouvv8bLly8F79G0DCrp119/RX5+Pvr166f2PZ9//jmOHz+O1q1bA1Af+1x8+6lTp9Ct\n", "WzcA4Mt2xfuzs7OxaNEieHt7w9HREd7e3oL6g6JeAgA7d+6Evb09vL291eZzTRg8xlid3377DQAE\n", "cSHx8fH45ptv0LFjR0yaNAkvX77Eli1b0K9fP2zbtg0SiQQAEBMTg1mzZsHd3R2BgYG4efMmvvzy\n", "S9SoUQNSqVTwPXv27EHz5s0xdepUPHnyBLa2tjhx4gRGjBiBli1bYvz48cjJyUF8fDwGDhyIdevW\n", "wdXVFQAwfvx4XL16FYMHD0a9evVw7tw5rFmzBunp6Zg5cyYAYObMmdi7dy9CQkLQpEkT3LhxAzEx\n", "Mbh37x7Wrl2r8m9/+fIlAgMD8c8//yAoKAh2dnY4fvw4Fi9ejKtXr2LJkiX8ewsLCxESEgJXV1eE\n", "h4fjwoUL2L59O2QyGZYuXarTb9C8eXMA8gKzQ4cOSq+fPn0aEyZMgJeXF/r374+srCxs3rwZQ4YM\n", "wZ49e/jYzRkzZmDr1q3o2rUrgoODcefOHaxbtw6pqalYsWIFAGDChAk4cOAAfH19ERoaitu3b2Pr\n", "1q04efIk4uLiULNmTf57p06divr162PMmDF48eIF1q5di88++wxHjhxBlSpVMH/+fMydOxe1a9fm\n", "Cwh1tm7dCo7jMGDAAFhaWmLjxo2YMGECmjVrhvfee0/rY6aoLAQGBuL169c4ePAgpkyZgvfeew8t\n", "W7bErFmzsH//fnh6evKfSUtLw4ULF/hKdvPmzbFgwQKlvKotVeeQpnlbEZsbEBCA/v374/Xr19i1\n", "axcWLVqE6tWrY8CAAQDk5+SUKVPQtm1bfPXVV7h79y5GjBiBwsJCNG7cWOWxUbhx4wYmTJiA/v37\n", "IygoCAkJCVi5ciVq167N7//SpUsICQnhf++srCxs2rQJJiYmZcYLenh4oHHjxjhw4AC6du0KX19f\n", "dOzYEe7u7rC2tlYau5Cbm4vg4GDcunUL/fv3h729PY4ePYqIiAjIZDIMGjRIq3MzPz8f06ZNw9Ch\n", "Q5GTkwNXV1dkZWVh4MCBePToEYKCgtCwYUP8/vvvmDNnDlJTU/Htt98CABISEjBjxgwEBAQgJCQE\n", "z58/x8aNGzFo0CAcPHiQr/SrExERgVatWuHLL7/E9evXERMTg5s3b2Ljxo2oWbMmvLy8kJycDJlM\n", "xt9AAcDevXthb28viFkvTtFy5uzsrPa7q1evXmos7tOnT9GvXz9YW1sjJCQEtra2uHr1KrZt24Yr\n", "V67g8OHDMDMz06h8uXPnDkaMGIFWrVph4sSJKCwsRFxcHEaPHo3NmzejXbt2atPRu3dv/PXXXxgw\n", "YAA8PDzg5eWF9u3bw97eXm3+UmxTnKPF5eXl4fvvvwfHcfz3anq+lebly5f8b5SXl4fbt29j9uzZ\n", "aNWqlaDydf36dQwYMAD169fHyJEjUaVKFezduxefffYZFi5ciA8//BCjRo2CnZ0dtm3bJhibcOHC\n", "BYSEhKBmzZoYOnQoqlWrht27d2PMmDGIiIhAcHAw/z1//vkn0tLSMHnyZNy/fx/NmzfX6LvViYuL\n", "Q0REBHx8fDBp0iTk5eXh119/5a+PkyZN4t+rSZmRkpKCTz/9FO+++y7Gjx+P58+fY8qUKTA1NYWt\n", "rW2px7qwsBB79+5Fw4YN4ejoCI7jUK9ePezduxfh4eEwNzcHAJXHsUWLFnj8+DG/zcnJCYD8JrVv\n", "374wMTHB4MGDYW1tjUOHDmHSpEl4/Pgxhg0bxn//w4cPsWrVKowbNw6PHz9WeZ65ublhxIgRWL16\n", "Nfr376+Uh0aPHg0fHx9MmTIFf/75J3bu3IlXr17xDTWalkGqXL58GUDp5395YqubN2+Or7/+GnPn\n", "zuXHPdWqVQu5ubkYMmQIzp8/j969e8PR0RHnz59HVFQU/vzzT2zatAlubm6YP38+vvrqK7i5uaFf\n", "v37Izs7GpUuXlPK5xsoVzKEHivipK1eucM+ePeMf9+7d4zZv3sw5OztzPXr04PLz8zmO47iMjAzO\n", "xcWFmzhxomA/T5484dzd3bmwsDCO4zguMzOTa9euHTdw4ECusLCQf9/GjRs5qVQqiHvs2rUr17Jl\n", "S+7x48f8toKCAs7Hx4cbMGCA4PNZWVmcr68v16tXL47jOO7p06ecVCrl1q1bJ0jP119/zQ0ZMoR/\n", "3rp1a27WrFmC9yxdupTr06cPl5WVxXGccmzQggULOKlUyiUlJQk+N2PGDE4qlXJHjx4VfG7evHmC\n", "9w0fPpxr1aoVJ5PJVB98rvQYY4Vt27ZxUqmU27t3L8dxyvFT06ZN49q1ayf4zPXr1zk/Pz/u119/\n", "5TiO427evMlJpVIuIiJC8L4lS5bwMXzJycmcVCrl5syZI3hPYmIiJ5VKufnz5wvS3LdvX8Fvs2bN\n", "Gk4qlXInTpzgt6mKcZVKpVx4eLjgedu2bbmnT5/y286fP89JpVJu8eLFaj+nbnvJ71QV8zVy5EjO\n", "zc2Ny83N5betWrWKc3BwEORDTSj2n5SUJDiH0tLSuF27dnHt27fnOnbsyL18+ZLjOM3zdm5uLteu\n", "XTulcy0jI4NzcnLiRo0axXEcx+Xn53MdOnTg+vbty5+nHMdx8fHxSudayfi+gQMHKsV/5eTkcO7u\n", "7lxgYCC/LSQkhHN3d+eeP3/Ob7ty5Qrn4ODA2dvbl3mM7t69ywUEBHBSqZR/ODg4cCEhIdzx48cF\n", "742JieGkUim3Z88ewfbg4GDu/fff5woLC7U+N0vGdy9fvpxzdHTkbty4Idi+ePFiTiqVcteuXeM4\n", "Tn4Ol4xtPHr0KOfv78+dPXtW7d+rOEeDgoK4goICfvuKFSs4qVTKHT58mOM4jjtw4IDSGIJ///2X\n", "c3BwKDUmXTH24+7du2rfoy5NinJj9erVnIODA3fnzh3B+xYtWsRfEzhOs/JFce6/ePGCf8+LFy+4\n", "Dz74gNu8eXOZaYuMjOQcHR0F+aNTp07c/PnzuYyMDMF7y4qbnz59Omdvb8/naU3PN3UU10hVjzZt\n", "2nDnz58XvH/gwIGcr68vl52dzW/Lz8/ngoODuU6dOvFljqo42L59+3IuLi6CeOucnBwuICCAa9Om\n", "DX98Fedteb9ble7duwvOecVnPT09uY8++kjwHZqUGQEBAVzXrl25zMxMfpvi2lFWjPHvv//OSaVS\n", "wTV75syZnFQq5RITEwXvVXUcVW2bPHky5+HhwT158kTw+YkTJ3JOTk7cs2fP+PdpOq6ntBjj7777\n", "TvDekJAQrlWrVvxvUFYZdPXqVbXf++mnn3L29val/p4lqYt9LrldVYyxIpZ+48aNgs/+9NNPnFQq\n", "5WJiYvhtJa/HusR7GzyUIiAgAB07duQfvr6+WLhwIXx8fBATE4MqVaoAkN95v379Gj4+Pnj+/Dn/\n", "MDU1hYeHB44fP46CggKcPHkSmZmZGDx4sOCOPygoSGUrS5MmTVCvXj3++ZUrV3D//n34+PjgxYsX\n", "/PdkZ2fDy8sLV69exePHj1GzZk1Uq1YNMTExOHDgALKysgAAc+bMwbp16/j9vfXWW9i7dy9/1wbI\n", "uxri4uLUzlRw+PBhNG/eHD4+PoLto0eP5l8vrmSXpb29PfLz83UOp1B0P6trmWvYsCEyMzMxe/Zs\n", "vuu1RYsWSExMhK+vLwDg6NGjAIpi9hSGDRuGhIQENGnShP97SsYs+fn5wc7OTilW0dfXV5AmRTdJ\n", "eaaJcXV1RZ06dZT2xWqqwJ49e+LVq1c4ceIEv23v3r1wd3cX5ENthIWFCc6hbt264ZtvvkGbNm0Q\n", "FxcHa2trAJrn7apVqyIlJYXv9VB48eIFqlevzuf1y5cv4/nz5/jkk0/48xQAPv74Y41mwbCysoKX\n", "lxf/3NzcHBKJhD/2L1++xJkzZ/DRRx8JZmxxcHBAx44dNTo2EokE8fHx2LRpE0JCQtCsWTNwHIdT\n", "p05h2LBhgtCQo0ePok6dOujRo4dgH/Pnz0dsbCxMTEy0Pjfd3NwEzw8cOIAWLVqgbt26gnJMsT/F\n", "+dKwYUPcuXMHK1eu5Kcv8vT0xC+//FJqD4hCaGioYLYCxfmn2L+npydq1qwp6GJOTEwEx3FKf39x\n", "it+5oKCgzDSo89lnn+H48eOws7Pjt8lkMv6cfv36NQDNypeGDRsCkPfMKVqzbG1tsX//fkErpzoj\n", "R45EcnIyvv32W3h5eaF69ep4+vQp1q5di169emlcpsTFxWHLli0YPXo0n6c1Pd/KsnDhQqxfvx7r\n", "16/HmjVrMG3aNDRu3BjBwcH4/fffAcjPzTNnzqBLly7Iysriv+vly5fo1q0bnj59iosXL6rc/9On\n", "T3HhwgV8/PHHgnhrc3NzDB8+HDKZDCkpKfx2Kysrvptc1+8G5KELa9asUUpTzZo1+bKm+HeXVmY8\n", "e/YMV65cQY8ePQS9Fh4eHhr1wO3ZswcA+PwFQG04hSYKCwuRlJQENzc3VKlSRXDO+/r6Ijc3V3Bs\n", "AeUyQ1v+/v6C546OjoL6gKZlkCqKMqV42BhLhw8fRs2aNZXO5ZCQENSoUYPZOAaDh1IsXLgQderU\n", "QX5+PpKTkxEbG4vu3btj+vTpfLcFAH4+1okTJ6rcj4mJCZ4/f87Podm0aVPB61WrVlU5LVPxSlHx\n", "75k/fz7mz5+v8nsePnyI+vXrY+bMmYiIiMC4ceNgbm4ONzc3fPDBB+jVqxef9unTp2P8+PH4+uuv\n", "YWZmBmdnZ3Tr1g19+vRR2x16//59QVe7Qt26dVGzZk2lWJ2SXReK79bl4gWAP5HUdY0EBwfj+PHj\n", "2Lx5MzZv3ozGjRvDy8sLffr04SuYiot6yd+jZs2afHjE/fv3YWNjo/J73n33XaU4K3V/b3lOVlbH\n", "Th1vb29Uq1YN+/fvh5eXF27fvo0bN25g9uzZ5d5neHg4pFIpCgsL8eeff2Lt2rVo3749vv/+e0EF\n", "VZu8bWZmhiNHjuDQoUO4e/cu/v77bz5OTXGcFb9tyThHU1NTpd9bFVXTE5qbm/PHPi0tDYWFhXyI\n", "VHGq8kVp3N3d+QFLDx8+xI4dO7Bq1SosW7YMH3/8MerXr48HDx6oLCMaNWrE/1/Xc/Pvv/9GTk6O\n", "ytAkExMT/vNhYWE4d+4cH0/dvHlzeHt7o2/fvhpNL1dySkVra2tYW1vz+zc3N4evry/27t3Lh1Ps\n", "3bsXLi4ufGVTlbp16wIAnj9/rn33ZDG5ublYsmQJLl++jLS0NNy/f5//3bn/4kU1KV/8/Pxw8OBB\n", "7Nu3D/v27UO9evXg6emJXr16aRSmAIDvhh8wYADy8/Px+++/Y/ny5bh48SJWrlwpmLJSlbNnz2LG\n", "jBno0qULxo4dy2/X5nwrjYuLiyAPAvLGEF9fX8yaNQv79u3j52yPjo5GdHS0yu9SxCWXpDiPi9+o\n", "KCjyUfG5ZUuGI+jy3YD8ZuvixYvYs2cP7ty5g7S0NL6iW3LKr7LKDHVlkuLvK62Cnpubi19//RU1\n", "atRAw4YNcf/+fQDy879atWpISUnBkydPtGrAePHiBTIzM3Hw4EEcPHhQ6fXi57xCyTqJtkqWOcXD\n", "cICyy6CHDx+q3Xe9evXAcRyePXumlCdZuH//Pt555x1Bwwsgr881bty41LTqwuAV4+InfefOnSGR\n", "SDB79mykp6fjxx9/5N+nuBjPmjVLKXZRwcbGBvn5+QAgqFQrqNpWcg5IxfeMHz8ebdq0Ufk9igLE\n", "398fnTt3RlJSEpKTk5GSkoITJ04gNjYW27Ztg7m5OTp06ICjR4/iyJEjOHLkCE6cOIF58+Zh48aN\n", "2LFjh9bxOIWFhUqxkdrOY6mpq1evwtTUVO2ddo0aNRAdHY3z588jKSkJx44dw+bNmxEbG4v58+fD\n", "39+fL7BKiwflShlZy/rv1XRey5LKW3G2tLREt27dcOjQIeTl5WHfvn0wNzfHBx98UK79AUCrVq34\n", "VoZOnTrB0dERYWFhGD58OGJiYpRuHMrK2xzHYfTo0Th69ChcXV3Rrl07BAUFwdXVlR/0ARQdu+KD\n", "KBU0OT5lHfvSzmULC4sy9x8dHY3c3FxBDB8gb2UcM2YMLCwssGjRIpw/fx7/+9//UFBQUO78AKjO\n", "qyUL9MLCQri6uiIsLEzlPhSVpAYNGiAhIQEnT57EoUOH8Ntvv/EDRdetW1dmq5Kqv4PjOEF6/P39\n", "sWPHDhw+fBhOTk64ePFiqfGFgLy8BuQDytSl4cmTJwgLCxMMKC3ujz/+wLBhw1CjRg0+5rtVq1a4\n", "d++eoJdCk/LFzMwMy5Ytw40bN3DgwAH89ttviI+Px/bt2zFx4kR89tlnKtN469Yt7NixAwEBAWjR\n", "ogW/3czMDJ07d4arqyu8vb2VBvqV9OjRI4wbNw5vvfUWFi5cKHhNm2uJtmxtbeHu7o6kpCRkZGTw\n", "59vAgQOVejMUFGNGSiqr/AUgyNcly19dvhuQX9NjYmLQsmVLtG3bFgEBAWjbti1mzpypVPEp6/ws\n", "rUwqq+EkOTkZGRkZAIpaiUvavXs3hg8fXup+ilMcGz8/P/Tv31/le0re6OpSBgFlXx8LCgo0KoNU\n", "cXFxQVxcHP766y+1FeOLFy9i/vz5CA0NVZsfFOkoi7Z1A30xeMW4pIEDB+L333/HoUOHsGHDBoSG\n", "hgIAXxmuVauW0p3OH3/8gYKCApibm/Pvu3v3rqDViuM4/P3332UOqFLcoVpZWSl9z6VLl/Dq1StY\n", "WlpCJpPh8uXLeO+999C7d2/07t0beXl5WLBgATZt2oQTJ07g/fffx9WrV9GgQQN8+OGH+PDDD8Fx\n", "HNavX4/58+cjMTFRZXff22+/jTt37ihtf/LkCV6/fl1qi46+ZGZm4vjx42jbtq3aAQtpaWlIT09H\n", "mzZt0KZNG3zxxRe4ffs2goODsW7dOvj7+/Mnz7179wQtTI8ePcLcuXMxaNAgNG7cGCdOnMCzZ8+U\n", "7pbv3r37Rv7e0piamgpGRwPlC9tQ8Pf3R0JCAs6cOYNDhw6hc+fOgsGFulKMnt+0aRMWLFiAb775\n", "BoDmefuPP/7A0aNHERYWJmgBy8/Px4sXL/iCXPFvyVlhOI7DgwcPBBWO8lDsX9W5cO/evTIvIElJ\n", "Sbh48SIGDBigMmxJURYoWlQaNWqEGzduKL0vOTkZiYmJmDRpks7n5ttvv43MzEyl45+RkYGTJ0/y\n", "Zdbt27dRWFiIDh068O89e/YsQkJCEB0dXWbF+P79+4Lz7fnz58jIyBBchNu3b4969erh8OHDePLk\n", "CczMzEqdSQKQXxjr1KmDnTt3Yvjw4Sovwnv27MGFCxfUhmQsX74cVlZW2LNnj6AFsGRrnibly6NH\n", "j3D//n20a9cOLVq0wJgxY/Do0SOEhITwg3JVSU9Px/r161G9enWV+dTKygqNGjWCmZn6S2ROTg5G\n", "jx6NzMxM/PTTT3zIkoKm51t5FRYW8oMEFd9lamqq9F23b9/G/fv31YbuKT6raiaSu3fvAkCp+VqX\n", "737w4AHm0K4DAAAgAElEQVRiYmLQq1cvzJs3T/DakydP1H5naWkxMTFROVOVogVYHcUsEeHh4UqV\n", "1cePH2PGjBl8vtdU7dq1YWVlhby8PKVj8+jRI1y+fJnp4k+qNG7cWKMySBVPT0+Ym5sjLi5O7YDK\n", "3bt348yZM3wjiqKMKM819O2338b58+eRn58vOBdzc3Nx//59vhdQ3wweY6zKzJkzYWNjg2XLlvGZ\n", "uWPHjrCwsMDatWv5liRAnmFHjhzJ36137twZVlZW/GwDComJiYKpv9RxcnJCvXr1EB0dLYhvev36\n", "NSZMmIDw8HCYmZnh5s2bCA4O5qdgAuR31YoZAKpUqYKXL1+if//+gvgpExMTODo6AlB/Z9e1a1fc\n", "vn1baaocxX6Kx1ixwHEc5syZg+zs7FILgdmzZ2PUqFGC42RnZ4eaNWvymVjR7bx161bBZ+Pj47F/\n", "/37UqFGDH1m9evVqwXuSkpKQmpparr/X1NRUb3M81q1bVzAdHCCfokyTNADKd8YdO3ZE7dq1ERcX\n", "h2vXrpUa01leX3zxBd555x3ExMTwc/VqmrcVITQlu8q3bdsGmUzG/z0tW7bE22+/jS1btghaaPbu\n", "3atzfDsg71Js27Yt9u7dK5jeMC0tDceOHSvz8x999BGysrIwb948pbygmL3AxsaGr2R6enryKz8W\n", "t3HjRiQnJ6NWrVo6n5ve3t64du2a0pR9q1atwtixY/mprz7//HNMmjRJ0Mrl4OCAqlWrKrVCq7Jt\n", "2zbBc8UIf8WUSIC8LOrRoweOHz+O5ORkdOjQoczVN83MzDB27FjcvXsXc+bMUXr92rVrWL58OerX\n", "r8+vKldSeno66tSpI/iujIwM7Ny5E0BRT4Em5cvq1asRGhoqWBq3QYMGfDiQOi4uLnj77bcRHR3N\n", "H/PiLly4gGvXrpXa4hUREYHLly9jxowZKqeD0vR8K4+nT5/i5MmTcHBwQI0aNVC/fn04Ojpi586d\n", "grjl/Px8fPPNNxg3bpzaFrp69erB0dERCQkJguOYm5uL9evXw8LCAp06dVKbFl2+WxGeVTL0Jzk5\n", "Gffu3dO6Z6527dpwdXVFQkKCYJzIuXPncOXKFbWfy8zMxNGjR9GkSRO+pbP4IygoCC1btsTt27dL\n", "nWqvZJlvZmaGLl26IDk5WekaMnfuXIwePVpQVmraWqwoA8oTPqhpGaRK7dq1MXjwYPz++++CsVQK\n", "x48fR2xsLOzt7fmyRtECXfz4Z2ZmIjk5WfD3Kv6m4mW1t7c3MjMzERMTI/ie2NhYZGVlMasLGV2L\n", "MSC/IH755ZeIiIjAtGnTsHbtWtSqVQsTJkzAvHnz0L9/f/Ts2RMFBQWIjY1Fbm4uv3RnzZo1MW7c\n", "OHz//fcIDQ2Fr68vUlNT8fPPP6Nq1aplZjwzMzNMnToVEyZMQEBAAPr06QNLS0ts374dDx48wMKF\n", "C2FqagonJyd4eHhgyZIl+OeffyCVSvHw4UNs3rwZzZo1Q8eOHWFmZoZevXrxP2Lbtm2Rnp6OzZs3\n", "o27dumpbZ0aMGMEvSxoUFISmTZvi5MmTOHjwIHx9fdG5c2e9Hevr169j9+7dAOQns6JicOHCBQwe\n", "PBhdu3ZV+9khQ4Zg6NChCA4O5uOqk5KSkJaWxrc0Ojg4oG/fvoiOjsbjx4/Rvn17fknTgIAASKVS\n", "SKVS+Pj4YNOmTfj333/h4eGB1NRUbNmyBU2aNFE5kXhZ6tSpg6tXr2LLli1wd3fXKR6yR48eWL9+\n", "PcaMGQNPT09cvnwZ+/fvLzMMRtH6vXbtWnTp0oW/AVC0zMXExKBatWpKF99nz57h+PHjsLe3L/eU\n", "bRYWFpg+fTqGDRuGqVOnYufOnRrnbRcXF9SoUQNz5szBgwcPYG1tjVOnTuHo0aNo1KgRPx+uiYkJ\n", "IiIiEBYWhv79++OTTz7Bo0ePEBsbCxsbG6XKaFnPVW2fPHkyBg0ahD59+iAwMBA5OTmIjo7W6Kbn\n", "k08+wW+//Yaff/4Z586dQ/fu3VG/fn08e/YMiYmJuHnzJhYtWsS32gUGBmLHjh2YMGECgoODIZFI\n", "cPToUaSkpGDu3LkwNTXV+dxUfH7MmDEIDAxE8+bN8ddff2Hnzp3w9PTkbySHDx+O8PBwDB48GH5+\n", "fuA4Drt370ZeXh4/LVVp/vzzT4wePRqenp44e/Ysdu/ejQ8//BAeHh6C9/n7+2PDhg1ISUnB999/\n", "X+Z+AaB///64cuUKNm/ejNOnT8Pf3x81a9bE1atXER8fD0tLSyxbtkztxPqenp6IiorC+PHj0alT\n", "Jzx58gTbt2/nB0spBt9pUr4EBwdj586dGDhwIPr37w9ra2ucPHkSZ86cweeff672bzA1NcWiRYsw\n", "dOhQ9O7dGz169ICTkxPMzMxw6dIl7N69G05OTnyPZUkxMTFISEiAm5sbrKyskJCQIMiTTZs2hbOz\n", "s0bnW1kOHjzI99pxHId///0X27ZtQ05ODiZMmMC/b+rUqRg8eDA++eQTBAUFoVatWti3bx/++usv\n", "fPHFF6UOiFV8tnfv3hgwYACqVauGhIQEXL16FVOnThWMh1F17pX3u5s3b45GjRph9erVyM3NRYMG\n", "DXDhwgX88ssvsLOzU2o11qTMCA8PR3BwMPr164fg4GBkZWVh48aNqFWrltrPHzhwALm5uYJ5q0sK\n", "CgpCREQE4uPjBYMPi1OU+Vu2bMHTp0/h7++PL7/8EidPnkRwcDCCg4PRqFEjHDt2DIcPH0ZgYKDg\n", "2qRpY47ipnL37t0oLCzUalloTcsgdRSV5/nz5yMpKQndunWDhYUFzp07h3379qFu3bqCqWJ9fHww\n", "e/ZszJo1C//88w+qVq2Kbdu2oXr16oLf19bWFqampkhKSsJbb72FDz74AH379sWuXbswb9483Lhx\n", "A61atcKlS5ewc+dOODs7q7351pXBKsZlzUOqOCApKSnYvXs3Pv74Y4SGhuKtt97C+vXrsXTpUlhY\n", "WMDR0RELFy4UjNQeMmQILCwssHHjRsybNw8SiQRLly7FzJkzVcYrlvTBBx9g7dq1WLVqFSIjI2Fq\n", "aooWLVogMjJSkGlWrFiBlStX4vDhw9i2bRtsbGzg5+eHzz//nG8JmDFjBho1aoS9e/di3759sLKy\n", "QseOHTFhwgS+sCt5LGxsbPDzzz9j6dKl2LdvH169eoUmTZpg8uTJgoK6tLk2NY3FSkpK4gcFmJqa\n", "wtraGq1atcLSpUvh5+en9nOAvCs2MjISa9aswY8//oicnBy0aNECixcvFnSzzJw5ExKJBNu2bcPh\n", "w4fRqFEjjBkzRtAavWzZMkRFRWHXrl04cuQI6tati8DAQIwbN05QKKv7u0puHzt2LL799lvMnTsX\n", "YWFhOlWMx48fj4KCAuzduxfHjx+Hs7MzNm7ciC+//LLUz/Xo0QMHDhxAfHw8zpw5I5hztGfPnoiJ\n", "iYGPj49SvOytW7cwefJkjBkzptSKcVm/c6dOndCzZ0/s2bMHa9aswejRozXK23Xq1MHq1auxcOFC\n", "REZGomrVqujYsSPi4+MRHx+PdevW4fnz56hduza8vLywevVqrFixAkuWLEGDBg0wZ84cbNy4USlt\n", "ZT1Xtd3Z2Rk//fQTlixZgqVLl6JWrVoYPHgwbt26hV9//VXt367Yz9KlS7Fr1y4kJCQgOjoar169\n", "gq2tLdq1a4dZs2bxvTeA/GYiOjoaS5cuxZ49e5CZmYlmzZph2bJlfAy4ruem4vPLli3D/v378fLl\n", "SzRq1AhhYWGCbv9evXrBxMQEmzZtwpIlS1BQUAAnJydERUVpFF+8ZMkS/PTTT5gzZw5sbW0xatQo\n", "jBkzRum9jo6OaNq0KR49eqQ2rlLV/mfOnIkuXbpgy5Yt2Lx5M54/f466desiICAAI0eOVBo0VfxY\n", "jB07Fvn5+UhMTMShQ4cgkUgwbNgw9OrVC+7u7jh58iS6deumUfnSrFkzrF+/HitXrsS6deuQmZkJ\n", "Ozs7pbl3VXF2dsaePXuwdu1anDhxgl/Yp2nTpggLC8OQIUPUxjBeunQJJiYm+OOPPwQLHikEBATA\n", "2dlZ42uJuuMMyFsWFapUqQIbGxu0bt0ac+fOFdzoODs7Y8uWLVi+fDk2bNiA/Px82NnZYd68eejV\n", "q5fKfav67Lp161BQUICWLVvihx9+EJRbqj6r7XcXZ25ujjVr1mDu3LnYuHEjCgsL0a5dO0RHR+PK\n", "lSuYPn06rly5gpYtW6r97pLbW7VqhejoaCxatAgrVqyAra0txo0bh3Pnzqld6XLPnj2oUqVKqWn1\n", "9/fH999/j8TERH7xiJLp6dChA7p3744jR47g5MmT8PX1xTvvvIO4uDgsW7YMcXFxyMrKQpMmTfD1\n", "118LZmvS5Lqt0KxZMwwcOBA7d+7EpUuX4OHhoXF9QNMySB1zc3P88MMPSEhIwI4dO7Bu3Tqkp6ej\n", "YcOGCAkJwYgRIwS9QbVr10ZUVBQWLVqE5cuXo3bt2ujXrx8kEgm++OIL/n1WVlYYP3481q5dizlz\n", "5kAikcDNzQ0bNmzAypUrsX//fiQkJKBhw4YYOXIkRo0aVWbvWXnjtU04ffU3G4nc3FzIZDKleC9A\n", "3n3m6+urFMtEyJv2119/ITAwEFFRUXrtAahonj59ys+EUNzIkSNx48YNpenRiPb8/PzQsmVLLF68\n", "2NBJIYQQgyuzH+f8+fP8Mpj37t1DUFAQgoODMX36dL7Zf9u2bejduzf69+9f6hx4b8Ljx4/h7u6u\n", "NC/i0aNHkZWVxa9GQ4ghbd26FQ0aNMD7779v6KQYtX79+inFuT99+hSnTp2ic1kPTp06hdTUVHzy\n", "ySeGTgohhBiFUkMpoqKikJCQwMd+zZ07FxMnToSbmxumTZuGQ4cOoU2bNoiOjkZ8fDxycnIQFBSE\n", "jh07ahSywELjxo3h5uaGH3/8Eenp6bCzs0NaWhpiY2NhZ2encvogQt6UqVOnIi0tDadOnUJ4eLjO\n", "U/NUdAEBAfjhhx/wxRdfwMPDA69eveIHlqkKDSCaUYQsnThxAg4ODnSDRggh/ym1Yty0aVOsXLkS\n", "X331FQD5qEJFfFuXLl1w4sQJfrBO1apVUbVqVTRt2hTXr183aGvOjz/+iMjISBw8eBCPHj1CnTp1\n", "0LNnT4wfP16j+U8JYeX58+e4ePEiAgMDBXMCE9XGjBmDOnXq4Oeff8bhw4dhYWGBdu3aYcWKFWVO\n", "vUjUMzMzw2+//QY7OzssWrTI0MkhhBCjUWrF2NfXVzD3X/Fw5OrVqyMjIwOZmZmCOVirV6/Oj1o3\n", "lJo1a+Krr77iK/SEGIvii9aQspmYmPCrkhH98ff3V1o6lhBCiJbzGBefWiYzMxPW1taoUaMGP70O\n", "IJ9qR9XAN0IIIYQQQoyZVhVjBwcHnD59GgBw7NgxuLq6onXr1vjjjz+Qm5uLjIwM3L59m7o4CSGE\n", "EEKI6Gg0j7FigFB4eDgiIiKQl5eHZs2awc/PDyYmJggJCcGAAQNQWFiIiRMnGmzgHSGEEEIIIeVV\n", "4eYxJoQQQgghpDy0CqUghBBCCCGkoqKKMSGEGIhEIoFEIjF0MgghhPyHKsaEEEIIIYSAKsaEEEII\n", "IYQAoIoxIYQQQgghAKhiTAghhBBCCACqGBNCCCGEEAKA5jEmhBBCCCEEALUYE0IIIYQQAoAqxoQQ\n", "QgghhACgijEhhBBCCCEAqGJMCCGEEEIIAKoYE0IIIYQQAoAqxoQQYjASiQQSicTQySCEEPIfqhgT\n", "QgghhBACqhgTQgghhBACgCrGhBBCCCGEAKCKMSGEEEIIIQCoYkwIIYQQQggAwITjOM7QiSCEEEII\n", "IcTQqMWYEEIIIYQQUMWYEEIIIYQQAFQxJoQQQgghBABVjAkhhBBCCAFAFWNCCCGEEEIAUMWYEEIM\n", "RiKRQCKRGDoZhBBC/kMVY0IIIYQQQkAVY0IIIYQQQgBQxZgQQgghhBAAVDEmhBBCCCEEAFWMCSGE\n", "EEIIAQCYcBzHGToRhBBCCCGEGBq1GBNCCCGEEAKqGBNCCCGEEAKAKsaEEEIIIYQAoIoxIYQQQggh\n", "AKhiTAghhBBCCACqGBNCiMFIJBJIJBJDJ4MQQsh/qGJMCCGEEEIIADNDJ4AQQggxNJkM2LBB/v/Q\n", "UMDS0pCpIYQYitYV49zcXEydOhV///03zMzMMHXqVFhZWSE8PBympqZ47733MG3aNJiYmLBILzEg\n", "unAQQioimQzw8wOSk+XPt24F9u+nMo6IE12rdaN1xTguLg6WlpbYunUr7t69i4kTJ+Ktt97CxIkT\n", "4ebmhmnTpuHQoUPo1q0bi/QSA6ELByGkotqwoahsA+T/37ABGDnSUCkipHzoWq07rWOMb926hS5d\n", "ugAA7Ozs8OjRI5w8eRJubm4AgC5duiAlJUW/qSQGp+7CQQghhBDjQNdq3WldMXZwcMCRI0cAAH/9\n", "9ReeP38OmUzGv16tWjVkZGToL4WEEFJBpaamIjU11dDJYEImA1atkj+KXSKMUmgo4OlZ9NzTU76N\n", "EFL5aF0x7t27N2rUqIEBAwYgKSkJdnZ2sLGx4V9//fo1rK2t9ZpIYnh04SDEcMRUyQSKunNHjZI/\n", "/PyMO92WlvLu5shI+YO6nolY0bVadyYcx3HafODcuXNIT09H165dcfHiRcyfPx81atTAkCFD4O7u\n", "jm+//RYdOnRA9+7dWaWZGAgF9BPy5pWMGfT0NP6K26pV8gpxcZGRFLNLyJtA12rdaD34zs7ODhMm\n", "TMDq1athbm6O7777DoWFhYiIiEBeXh6aNWsGPz8/FmklBmZpSRc2Qt40GhhGiOGIsZJJ12rdaN1i\n", "TAgh5M0RY+urGFu5CSmJ8nHlRBVjQggxYmK9OIuxpY2Q4sR4U0p0RyvfEUKIgUgkEgAodWYKxcAw\n", "qmQSQgh71GJMCCEGoknFWIzE2spNSHGUjysnajE2EOpmJIRUVDRgkKgjpmsf9dZUTlQxNgBaspEQ\n", "QkhlI8ZrH83wUPlovcAH0R0t2UgIqchokQGiCl37iBhQizEhhBC9oi5oQohY0eA7A6CAfkIIIZUN\n", "XfuIGFDF2EDENACBEEII0Qe69hFjRxVjQgghhJAKgm4+dEMVY1KhUQFBCCHaoXJTvChcRXdUMSYV\n", "FhUQhBgOVa7EicpNcaNlrHVH07WRCoumBiLEMBSVq1Gj5A8/P/k2Yvyo3CSVHVWMCSHEQCQSCb8s\n", "dEVClStCDIPmENcdVYxJhUUFBCGGkZen2TZjIpPJu6FXrarcrdtUboqbYg7xyEj5g8JgtEcLfBgI\n", "xd+xR4sMEEI0IcalilmxtAR27SqKU42MrJzHQcxoGWvdUMXYAKgQFmJ5k0AFBCFvXtWqmm0zFupC\n", "Pypj2SGTAb16FR2Phw/FcX2ixiaiLxRKYQAUf1eEBum8OdRVLF5i++3E1h0vxtAPVsR4faLrCNEn\n", "qhgTgxJjISxGdOEQLzH+dhTnSN4kuo4QfaKKsQGIrTWFiB9dOIxTamoqUlNTS30P/XbsiS30Q4FF\n", "T0JgIGBjU/Tcxka+jZDKgirGBiDW1hQWhTDdJBBSOjF284utlZt1OcSi7GR1jLduBV6+LHr+8qV8\n", "mzGj64iQ2EKvjA0NvjMQloPCWAxCYDVgkGaOeDNCQ+W/WfHVrCrzhYOwJbbBbCzLIVZlp9iOMUuW\n", "lvLj6u8vf751q/5+v/R04Qwdtrb62S8rMhng6wv89pv8eWwscOAAXVe1QRXjCkaMhbDYbhJYYpVe\n", "ugERL7F284sNq3JIbBVYMd5Ep6cD9vZFLd329kBqqu6V2PR0oGlT4NUr+fN9+4B794y7chwVVVQp\n", "BuT/j4oCxo41XJrEhkIpKhiKRywitu5c1ulVXPhHjhRHpZi6A+VCQ4HOnYued+5s/BUVll3brPKF\n", "2PJbYCBgbV303NpaP7HAYgz1GzVKOfxD0cqrixEjiirFgPz/I0bovl+WUlI020bUo4ox0YgYL3Ri\n", "u0kQW3pZEttNDRFiVblilS9Y5jdWZWd0tHKlLTpa9/0C4ruJZuX2bc22GZOOHTXbRtSjinEFw6oQ\n", "FtuFjigTU4tYZblJkEgkkEgkpb5nwwblrlExHAsWlStW+YJlfmNVdrJsGWRZVrDYd2Sk8kwakZG6\n", "77dvX822GZNPP1XuYfr0U8OlR4woxriCYbmcJ4sYPJbxd2KLlWOZXlptkRDDYVF2duyoPFuEPloG\n", "WZYVrPZtayuPKdb3IDkxxvdbWsoH29F4Eh1wpELJzuY4T0+OA+QPT0/5NmMVGVmUVsUjMlJ/+8/O\n", "lu8vMtK4j4MCq/SyPs76JrZ8XF5NmzblmjZtWup7srM5rnPnomPRuXPFPBaaYJUvXrzgOBubov3a\n", "2Mi36QuL8zo7m+M6dSpKc6dO+tk3y7JCbOVQYKByegMDDZ0qwhq1GFcwYhwBHRtb1FWs74FFrEaa\n", "s5w9wlh/qzeJZtEgqrDKF+rm7tXHuciyBdbUVPX/iX6wapUnxo1OJUK0JMa4aDFOgE8DgOTEGmPM\n", "itjyBcu4aBb5gmVZIbZyiHW8rpjGfVQm1GJcwYgtrlZd4W7MraZia5UHqAWWkNIEBgKTJxfN8qCv\n", "qc/EiGVZIbZyiGW8Lo37MF5UMa5gxFbwkDeHwjSMT2pqapnvYRluJLYFcFhRN/WZPhZFYNVYwbIR\n", "hGVZQeFtcmJsYKksqGJcAYmpAiS2Fm5AnGkmpCSxtlixqACpm/pMHxVjVjMFUSNIEbHmZWKcKMaY\n", "GJQYV1kSY5rFiOLv5FjFkopxrmhW8f0sF0WQyYBeveSVta1b5f+vzPmZBTHmZTEumlVZUIsxMTgx\n", "tXAriDHNYkItQOLHomWXVffzoEHA1KnCGONBg3TbpwKrNNM58mawDNFg0eJP+UJ31GJMCDE6YmwB\n", "YoVVyxLrFisxzdyydatyjHHJabqMDctzRGwtjqzyskwGdOtWlI+7ddPv8RDT6pCVCVWMCSHEiLEK\n", "3WEZEsTq4iy26b4A8aVZJgN8fYsqg76+xl85ZpWXf/wROHGi6PmJE/JtxiwvT7NtRD2qGBNCjI7Y\n", "KhPlJZFIIJFIynwfq7l7xTYnMKsKEMv8JrY0R0Upx7RHRem+XzGKjdVsG6lYKMaYEGJ0aMS9kNim\n", "VQsMBMLDi1aTs7Ex7nmBWc0cUXz/+h6TwCrNLGfoYIVVXO277wJ//qm8zZhVrarZNqKe1hXjwsJC\n", "fPPNN0hNTYWpqSlmzZqFKlWqIDw8HKampnjvvfcwbdo0mJiYsEgvIaSSoAGOcmIcTMNqiWVFN7+i\n", "RTM2Vr4Ag67HQiYDPvqoaL8PHuhnvywpZrtQ5IuHD/WTL8S4DDKrAY5r1siPaUaG/HnNmvJt+sLi\n", "hpemE9Wd1qEUx48fR3Z2NrZs2YKwsDAsWbIE8+bNw8SJExETEwOO43Do0CEWaSWEkEpHjINpWMU5\n", "surmF2P4AKt8wXoZZDGxtARaty563rq1/le+0/cAVUVPQmCg/LFrl3Hf4BkjrSvGlpaWyMjIAMdx\n", "yMjIQNWqVXH58mW4ubkBALp06YIUVX0xRCA9HQgKkj/S0w2dGqItsY3aJqQiUNfNb6z7ZSkrS7Nt\n", "2lIsg6yIiTb2lnOAXbz1hg3Kg+/0dVPK6sZG0fuhmDf7o4/oGqUtrSvGLi4uyM3NhZ+fH7799lsM\n", "GjQIHMfxr1erVg0Zin4HolJ6OiCRFGVciYQqx2IixlHbREhMNzaBgfIYXQVjj9cF2LUYs1qIg+UC\n", "HwCb/MayMi/GQZliayUVW69KZaJ1xfinn36Ci4sLfv31V+zevRuTJ09Gfn4+//rr169hbW2t10RW\n", "NKNGKcffKQZQEONHBY+4GdMcu6mpqUhNTS31PeridY3ZyZOabdMWq25+luEDrPKbqmxTRlYyCixu\n", "Eli1kgYGyhd7UbC2Nv6bUjH2fhgbrSvG2dnZqF69OgDA2toa+fn5aNmyJU6fPg0AOHbsGFxdXfWb\n", "SkLKSWwtNYQ9scXsinFe0ipVNNumLVbd/CzDB1jlt759NdtmTFj1trFqrIiOVl74JTpa9/0C7GaP\n", "YN37URloXTEeNmwYzp8/jwEDBiA0NBRffPEFIiIisGLFCgQGBqKgoAB+fn4s0lphREYqd41GRhou\n", "PRUVq5YaKnjETYwVTVZYhZQsWSKsCFepIt+mD2Kb05lVLHC1apptKw9WY2BYVWDFGHvOKkSKBk/q\n", "Tuvp2qytrfHDDz8obY/W121UJWBrK+/yKj7/pK2tQZNUIbGawufTT4G4uKICngoeIkYsp4HbtQso\n", "KCh6XlAg31YZp987dUqzbdpi1eKoGAOjCN9JTJRfr/RxjWI1RzKrKeZYTl3HakpDRe+HmOY9Nza0\n", "8p2B2NoCW7bIH1QpFhcxjtpmSUwD2QCaAF9BbCElYmWq4iqrapu2WM3EwHIMzH+TV5W5TVtijD1n\n", "SWyDJ40NVYxJhcV6mVcqeMQ5Q0dlWW7akMQ4kwYrrELnWM3EUFio2bbyYHVTKsbYc5bniNgaK4wN\n", "LQldAYlt+VhWxLissNh+O3Uxg8a8fKwx5QuJRAIAZc5MwUJoqHzluOIhQfq6QWDVTcwSq3OPVegc\n", "q5XvPDyAbduUt+kDy94aVitlstovy9UhxbZSprGhirGBpKeziTFmtWSqWIlpWWEx/nasYgZZE1O+\n", "oNAP9lhXJhShc/rEagwFy0F9LJcrZnVNFRtW+aIyoVAKA2C5wAfNsSteYvztaIYO9kJDleMc9bWq\n", "V8n8pq8YY7GFUogx3prV7CqsQ9D27y8KTdDXzYcYF81idV4T3VHF2ABYDm6gOXbFi/VvxyLuTKyD\n", "UwhbYluUhKbwK8J6FTkW4zNYXlNZxusWj93WVxw3jaHQHVWMKxhWo34JeyxbX1nN6UwzdLDHqmWX\n", "LqDixirERhG7rGh97dWr8g7gYjm4OCoKOHGi6PmJE/rpIWTVKl+ZUMXYAFgu8EHxiOLFsvWVZVcx\n", "zdBRREyjwVleQMUWSiHGcpNliA3LsBIWi4ewuqayDG9j2UNIZbJuqGJsAIpRyoquKn1Nng6Is4AX\n", "U2KOzI0AACAASURBVGWCJWp9FbfytMqnpqaWOSOFGKcdFFsoBbWevxmsYoFtbYFr14B27eSPa9fY\n", "LkiiDzQ+w4hxpELJzuY4T0+OA+QPT0/5NmMltvSKFR1n9iIji46v4hEZqZ99Z2fL9xUZqd/fjdV+\n", "ly9XPhbLl+tv/yywOhas9s0qv2Vnc1znzkX77NxZf2kODFROc2Cg7vtlVb6xzMfZ2RzXqVPRfjt1\n", "ojLZWNB0bRWMMc3RqgmaWubNEFu+IEIsppej+U7fDDEeZxaDwlhidR359FMgLk4417c+BxcXXwFR\n", "H6shKohtPnxjQ6EUFRDFFxVhFaYhxvAPyhdsia07XoxTlLHCanAqwO44s8pvrAaFAcCSJUCVKkXP\n", "q1SRbzNWLMPbWA2qFeNqpMaGKsbEoFhWJlgVECwvouTNYHFjQ6PBxUuMNwms8hvLuNpdu4CCgqLn\n", "BQXybboS22BPlsQ4H76xoYoxMSiWlQlWBYQYL6KkCMsbGzG1yrO8KWU5CFhsvTUsF3Jgkd9YDgrL\n", "ytJsm7ZYDfZkWVYEBgLW1kXPra31U5mntQx0RxXjCkhsFw5WqIAgqhjTjY1EIoFEIjHId7NcyIFV\n", "pZtVL5DYwmBYYjlt5KlTmm0zFizLiuho4NWrouevXsm36Ypmu9AdVYwNhGXsq5i6+VnGQ7EqIOgi\n", "KkQ3YuLEciEHVj1BrHqBWPZcsVx6mwWWcbWqBpjpY9AZqzKZ5YqIrBpuBg1SbokeNEj3/VYqhp4W\n", "ozJiOXUWyymjWGA9HQ6raYdYTu0kJizzMsspyoxl6rqmTZtyTZs2LfN9YpruiyVW032xJMbjzMqL\n", "FxxnY1N0HGxs5Nv0te/AQPlDX/tkeX1itW8xTpVobKjF2ACMqSvX0Fiv/sOq5UNMsaQsscrLrOOA\n", "WbUOsmg9F1svEEtiXPKe9QBjMfXWsFrcilXvB8tYeVYhKxRCqDuqGFcwYuvmZx0PRRVYcWJ988gi\n", "X7CqwIptui8ixCqWm+UNE8sKt6WlPK95euo3XEVs5wirhhuKMdYDQzdZV0asu3LF1M3PMtxBjMT0\n", "23Ecu7wsxu7n8qRZk1AKMa6ox4oYQynEdo6wDo8S07HgOPGdI3RN1R21GBsAzXdahGW4g9iIscuc\n", "VV6uLK2ZqampSE1NLfU9leVYaEKMrWFiC51jmV6WLbtimhKPJbqm6o6WhDYQFku8AuJcfpTVsRAb\n", "sS6PzeL3E+MS1qGh8vNN8RvqqwLL6liIsaxgvUSvmLDKb4RUdiYcx3GGTgTRn1Wr5K2NxUVGGnfl\n", "iuW67mJaM37FCmDcOOG25cuBsWMNk56KjFW+EFN+Y11W0DGWK3kD4umpvxsQFseCZXrT0wGJpGgx\n", "Dhsb/QzAE+N1jxWWv19lQS3GxKBYtlqJsUWMFGFZsWKVL6j3Q46OcRGWvR9i661Rt0Kdrn8Dy/mG\n", "WWJRxom159GYUMW4ghFb9xrLk1hsBQTLqYHEhmXFSmz5grdqFbBkiTxTWFrKHxYWwn/L2lbs/0Mb\n", "WOBGa0ucumCJHFjAydUSQzpbAmklPl+1KmBiolVSRXuMCQDx3XyIETXcGC+qGFcwYozNJHJiu6lh\n", "iWXFSqytSygoADIz5VdUxaOwsNy7MwewuPiGPwA4qnijiYnGlW3Fv553LbECFpDBEjLIK95tDlgC\n", "uWV8vrT9VqlS7r/VkFj3iomprA8NBWJjhTHi+ijjxNiowKqMo+uI7qhiXAGJ6W6f5UkstgJCrDc1\n", "Yrs4s5SeXhTrGBlZduykRCIBgDJnppDJgA1VwoCIMOExzs+Xv5iTI/xX3f/VbcvOlv+r6WfS04Xb\n", "SnD47yGw879HeZmZaVeR1rIFXaOKuhG1nrOscGubjw2NZVnPqnxjdYMu1uuIMaGKMTEo1vF3VECw\n", "xerizPJCx6p1qeTAosRE/QwskskAX9+iVrbY2GJTMJmZATVqyB/l3LfO5wfHAbm5SpXpnJcy7Nku\n", "Q5X8HHzoLYN5oQYVd20q99nZwgp6QUG5joHWtGzx9rxrieX/tZoLWs/zdKi0V6nCrMLNKh8D8vQp\n", "8jEg/78+0kwztxB9olkpCDESYhxNzHI0OKuWGlYj44OC5BfO4gIDgS1b1H9GkxZjVrOViDG/lSo/\n", "X7nyrGkLeFnv1aYl/k0wM0NuFUu8yimqbMtgifrvWKJeYx1ayC0sMH+5JQ78VrRPGSzR7UMLLIks\n", "8V5zc61bz8U2ewTL9LLad4U7rw2AWowJMRI0YEmIVUgQq5HxrKSkqN6ma8W4wuU3MzP5o3p1w6WB\n", "4+T94SUqyzmvcrAnLlveeu6TI289L2/oy3//N8uWIeO6DAVZObBCNuqavYT1ixzgoUx+k1BOX/33\n", "ENgHoKmKN2sZJz68qiUaNLLEnX/kle63JJYIeWYBLC9nKIyFhfw3h/hCugIDgfBw4Q16YKDu+61w\n", "57UBUMWYEFJuYovjZikyUt7tXPxCFxmp+347dlRuiTb21d4A8VVU9MLERN6Sam4u2GwBoHc7/X6V\n", "KYCGJY6xieIYFxSUO+48+4UMi+bkADny9mJr8xwMDpTBQpNQmJcvgceP1baemwEIKL4hFcBUHQ9E\n", "lSrgLC2Rk2OBnvnyFu5/v7BAkxaWMLXSPORF1f+H1rfAzWIztzi2s8SQThbA37q3novtBr0yoVAK\n", "QoxEyVjSzp3FsZyn2CpArBcw0PfgO5kM6NYNOHFC/rxTJyApSff0sl54QkyLWogVy3AjnQffFW89\n", "L1mRVjwv72DREtuepMnwKC3nv8APGSyQAxsLGcwLc97clDNatnZfvWuJwynCUJgPAyzR3lOHUBgz\n", "Mwql0AOqGFdAdOEQJ7FWjMVITOcIy3zB6jhQ/CR7Yj0WLPJcqflN0XquS9x5WTO3aPL/N1HVMjUF\n", "LC3BWVoiq8ACN92CYf/LAqPPE8aGQikqGBpF+2awKNxZjdhmTUyVTAVW8csssMwXYjoOAMVPFifG\n", "Y1HqDCs6KDWkq0oVoFo1+cNQFK3nJSrMrx7L8P0MGcwKcjBprAw1qpaz0l5im4lMhuoyGZxdTAER\n", "lMfGhirGFYwYC0uxYVW4ixHdiLHHckESVjc1rGLPs7I020aMU1SU8k1eVJTuA0mNfmrO4rHnNWsC\n", "kJ97Hw0vOkeS86nsNBZUMTak7dvl/T8mJprFD2nw/2ZnLNGrxIpTdf+2BK6o2bcZZQFtsSrcxTiQ\n", "jW7ExIvlTQ2risqpU5ptqwxYzWrAEqsZVgDq/SD6Q7UiQ6pbVz6hqmKZ18xM4OnTonimcsQk/e+/\n", "h8Dc/x6q/BeTpPOqUNou71p8m4WFPB0iwapwN/pWD2IQrBYkEeOFWVUxIaKiQ6/EOKuBm5vyDCtu\n", "boZJi6bEGComtpULjQ1VjA3Jyws4c0b1axynesJ6DeKM8jJz8OcJ+YpTbR1kMMvXcpBAZmbR/3Nz\n", "38yxMDfXTyVblwq7mZlGU+6wnD5LbK0eYlyKVWzE2JPAqjWa1ZR4AOW3N4HVTR4rLHtVWJ3XLFcu\n", "rCxoVgpSusLCouVeyzmVjkbvVbW9+OuFhez/VlNTjSrSBVUtkHzSEmlP5aEqtRtZolc/C5jV0LKC\n", "rm6byJrAWFQoxDriXluaTNcGsGkBYrUCIMB2xTAWx0KM+U2Ms9jQyndCLPJyeVbgJELUYkxKpwi1\n", "MHRpm59f7hG65a64y2TA8+dF//+v9bwKAO/iafsHwFI9/q1Vq7IPXynr9apVNZ6wnkUrtxi7+VmR\n", "yYBevYqOx8OH+qm0seyKZzlg0NZW/xd5sea34u0Fb6LtQFdijItmhdV5TXSndcV4586diI+PBwDk\n", "5OTg2rVriI2NxXfffQdTU1O89957mDZtGky0XAWGkFKZmQE1asgfhlK89byseS31WYHPyhJW0N/E\n", "FdDERL8Vcy0r52a5FjCBJTiIq/WcBVaVNpaVV8JeVFTRoi+A/P/6GATMEsubMRY9V6Gh8lmHirfK\n", "6yuMidV5zTLcqLLQumIcEBCAgAD5oo4zZ85E37598cMPP2DixIlwc3PDtGnTcOjQIXTr1k3viSXE\n", "oIy19by8E85ru+3FC+E2hob/98hFVeTAAgVmlrCZbQks1CFMpbyVei1az4mc2GJJxRjHzXKGB7HF\n", "W7OMBRZbq7ytrTwkigbflV+5Y4wvXryIBQsWYNOmTejSpQuOHTsGADh06BBOnDiBb7/9Vq8JJYQY\n", "EY7TvPW8HP8vyM7B+VMy5LyUTzxYyyoHTd7KgWmOTPidxtJ6Xvz/VlbA8OHy5qUyaBJjzCoWmGX8\n", "pFhjdsVUGVyxAhg3Trht+XLdK8YsfztW+2aVl1kdY4BtjD/RTbljjFevXo0xY8YAAIrXratVq4aM\n", "jAzdU0aIERPbRVTvFJVFCwsmu49aBYw6UGxDNhD5lYoLXVkzt6jYlpchQ+TSHNy/LYMFctCiiQxB\n", "veSrT2nc0p6eLtxWkq2tRhVjTbDqfmbZTWxpyW7qQVbnnthmhPn0UyAuTvj7ffqp7vtlGW/NMl+w\n", "wLJVXozT7VUW5aoYv3r1CqmpqXB3dwcAmBYbRf/69WtYW1vrJ3WEGCGW3XZES2Zm8kf16hp/ZO0q\n", "4PPbxTb8Dbx20OGCpGg9Lz7F4dtva/TRsmajEDMWFc2SMzHoc9VJsd3sWlrK/3YxpRlgky9YhcKw\n", "nJqTJbHlZWNTrpEtZ86cQfv27fnnDg4OOH36NADg2LFjcHV11U/qCDFC6lpUiP6EhsovbgpGHfOp\n", "aD23tgbq1wcaN9ZrTHJgoLybVUFfI/k3bFBewdHY87G6VSd1pbjZHTVK/vDzU90RUBmI6tz7j6Il\n", "OjJS/tBXQ8Wnnwo7fvTVKg+wO86Ul3VXrhbj1NRUNGnShH8eHh6OiIgI5OXloVmzZvDz89NbAgkh\n", "lQ/LLlexDbRi1eUqxlkpWHVti3G6NlY9V2ILd1Bg0RLNslXe0hLYtUs4SE4f+xZjXjY25aoYDxs2\n", "TPBcIpEgOjpaLwkixNiJrWIlVqxiPlldkFhhVYEVY8VYrF3bLLCOBaaKFFs0j7HxoklCCdESq247\n", "8mYoLkhbt8ofvXoZd1cjqwrsyZOabTMmrLq2WYcPyGTymRNWrTLuvEaEFDHtirAEX1/9/X6sQvLE\n", "GApjbGjlO0LKgVpUxEtsXY1nzmi2TVuqwqCNfbpmVl3brGfRYBHywHJWESKnLqbdmBdREWsojDGh\n", "FmNCCDEQiUTCz2WsjqpQAX2ED7z/vmbbjI3ipnTkSP1e8Fntlwbripe6mHZ9YNmyyyovVxZUMSak\n", "HFh1jf6/vfuPreqs4zj+aQvu0mGpJlOjI73akGVzcQujRoG2Rgs2JkYX19mGVbswWDGZCUVip5bS\n", "haV1yfiDoRfCPyjONVEJ8Q83p82kS2vWZSpmZfy3uzFFcEpNadqtwPGPw+3tL+Dc3vvcc773vl9J\n", "k9vDev16fjz3e5/n+zwPQ67uufxAcnH9XJUPbNsmbdiQ/n3DhtzNuId7LlcVoR3y1dQEO7YUlORF\n", "F6UUCIy1EX2uhkZdr4/M9fO5Gmp0uUqAq5nxs5agn/O6GLl6Ppqbpc7OuTuc5WK5PVdYpz3N9dbm\n", "lORFlAcEMDnpefX1nufvZuC/npwMO6pwJBLp85D6SSSi+76ex/XLh6Vcv6qqKq+qqiov8c3n8n7z\n", "PP/+SiT8n6jfay6fD1fneXLS82pr0+9ZW5ubmF3fF664uN8OHFh4Lg4cyM17I7qKvI8AQVEnZxvX\n", "D/lkbZMBq8/H1auLvy421u43RBuJMZAhVzWqLLNjm7Xr5zJeq4mmC67O85Ej0tBQ+vehodzsAtjc\n", "7G/imFJRkdvSDxf1y67uN9elFNRyR1TYXdawgaH4uVwNE7t8X66fexbvCxfva2043vXz4eI8Nzcv\n", "PMfNzdm/r8vyAVfn2WW5iqv7gjY5uko8z/PCTs5hA5O3bLN2/azF68r8yVD19bmbDOXqHLuM2RVr\n", "99v+/dKuXXOPPf201NGR3fu2tCzcXbC5WXruuezeV/J7RlM7TqYkEtlPQLP4jLg6F8geq1IgMGbQ\n", "2mbp+lmdGe/iQ9TVhiQuz7HFTQYsPR+Su2H+e+9dmBjfe2/27+uSy/vN2n0h2fuSFzXUGCMw6qGQ\n", "LxZrVK1NALJ4jpHmaqvw114Ldmwp2NQizdW5sNYORRGJMQLhYQNuzFWiaW1Sn0R7kQ+udmUrKwt2\n", "bCnY1CLN1bngC2/2SIxDYq331eXDZu1cwD2LyaArrj5A29oW7qjHqhR2JJPBjmUqkfA3IUlZtco/\n", "livWenZd4lxEEzXGIbBaP+kCu71hMRZrVNva/Pt39gSgmyWa8XhckpS8SUZjsc4RaS7aoaamhSUO\n", "TU3Zv29lpZ9gpyaGJRL+MdiwlHYIc9FjHAKLvSmuevBc90QznGuXtd4Ua8PER49KL7+c/v3ll3P3\n", "7NHjn+aqHSovD3ZsKWIx/5rV10f7HsZCsZh04oS/kkhzs/+aa5gZeowRiMUePFez+SV6orE4Sz27\n", "riZvSTbbC1dctUOuVqVgRNO2qSnp619PX79z57h+maLHOARWe1Nc9OBZPBdTU9LmzekeoM2bc9cT\n", "Tb21bVy/NGs9/tZYHMWDe1y/7NFjHILUUMfsGq5i/eBw2bPkqtbqyJGFQ9BHjkiPPZbd+9JTM5e1\n", "Xnlr18/1drfwuWqH6JXPD2vtELLHznchsLgrlFUuGjVXO0O53gnJUgNv8RlZyvULOvnOhdTIR+pL\n", "Xm2t9OKL0T7HVll69v71L+n226UrV/zfy8qkd96RPvax3Ly/y90Wc/2+rtuhsbHcT3K02HZGDT3G\n", "IXBZ+wr31q9fmBivXx9OLEFZ680slmckjIQY+Wep9nznznRSLPmvd+7MzZbQrtohV+/rsh0aG5Pi\n", "cel///N/f/55fzWQbJNjRhKyR40xCpar2eDbti1c/3Xbtuzf12W9NXVn7lmrl3e5KoXkrt6aOm67\n", "XLVDFtu3HTvSSbHkv54/4rRU1Pdnh8Q4BNY+QFOsfSC5aixjMX/IObUsV66Gn60t95Xi4r6w+IxY\n", "u34uV6Vw9aXU6hKMltpO1xt8WGKxHUIOeAjFxYue19zs/1y8GHY0Nzc56Xn19Z4n+T/19f6xKDtw\n", "IB1v6ufAgbCjCsfFi563alX6PKxalZv7zuV9MTnpeYmE/xP1e80il89HIrHwvROJ6L6vSxbbTlef\n", "T67OhcV26Nw5zysrS8dcVuYfywXazuxQYxwCi+sMFkvNZ6Hq7184bNffn/31c3lfWKrLBK7HYttZ\n", "WZmbmuL5XNW/uqyrddUOnTixsJb7xIns/7fmT6r95S+ZVJspSilCYLEeyiKWo3LP5XA87HI1BM3Q\n", "tn2u6l+pq/VdbzlRBEdijEAsfiBZjNkVzkU0xePxmSXb8s3lF0dX9dbW6rglnj0sztV9MTwc7Biu\n", "j3WMQ2B1nUFLa3GmWIzZFRfnwvXay4Uu7HWMLbZDFtEOYTEu7ov9+6Vdu+Yee/ppqaMj+/cuFiTG\n", "IaGhRCEgucpO0MTY0qYIAMLzzDPSd78799iBA9nvzFpMmHwXEiYWoRCwmLx7LjdnoR0CCgtza7JH\n", "jzFCR68VilWQHmPKVfKDdig/OM9uMYqXPXqMESprWxUDKDy0Q/nBeZ7LxZcERvGyx6oUCBVL16GY\n", "JZPJm9YXNzcv3ImsudltXMXGdTtkaec7lyy292NjUkuL/zM2lrv3tbqLYzGgxxgAIszV5iyuMWTu\n", "Y8MFu8bGpHg8/fw9/7yUTPoboGTL1cYv9Mpnjx5jhIo1PoHCY603zGWvPBsupFlr73fsWPildH69\n", "f9RY7JWPGhLjAmRp2M7igv1APllLJiR7H87X65XPBTZcSKO9T7P4XBcLSikKjMVhFJaMAq6PyTTu\n", "udzafP36hUn2+vW5eW+LLLX3iYRfPpH60rRqlX8sF1w9121t/v02e1UKEu7MsFxbgWFpJwBhc7lk\n", "lIvaZZebIsyvMa6tpcbYkrGx9GdqIpGb+mLXqO/PDj3GALJCI7x0Ye9854qr3jBXI2IuN0WIxfxE\n", "2NL1Q1osli55sHLdLPXKRxE9xgWGxb1ts5YAcb9lJ0hizDlOczUixjnGYrgvitOSeowPHz6sl156\n", "SdPT03rooYe0du1adXZ2qrS0VGvWrFF3d7dKSkpyHSsCoB7RLov14a6WHLLKxRcbzrF7tJtYDM9e\n", "ccp4VYpXXnlFf/3rX9Xf369jx47p7Nmz6uvrU0dHh5599ll5nqeBgQEXsSKg1DBKezuNuyXWZvJj\n", "LmtLlFnkciY/7SYAaQmJ8dDQkO644w595zvfUXt7u774xS9qdHRUNTU1kqS6ujoNF+taNECRYcmh\n", "NFdfbDjHaVaX+7K0hCbSePaKU8alFP/973917tw5HT58WGfPnlV7e7tmlymXl5drfHw8p0ECxcDi\n", "MjsMQbvHOZ7L2sQidr6zi2evOGWcGH/oQx9SdXW1li1bpk9+8pO65ZZbdOHChZl/n5iYUEVFRU6D\n", "BIqB1UbYWqLiylK+2NxsNYoUzrFd19v5LhdLwcE9nr3ik3EpxX333aeXrz3l58+f19TUlD73uc9p\n", "ZGREkjQ4OKh169blNkqgSFDnaJfVYX5rrJUlsPMd8s3aMxI1GfcYf+ELX9Crr76qBx54QFevXlV3\n", "d7c+8YlPqKurS9PT06qurlZjY6OLWAEg0uhdcsviyi3sfId8sviMRA3rGANLYG29YaAQWNzZ0+LO\n", "d7Rvdll8RqKGne+ADPGNHAjH9HSwY1Fibec72jcUu4xrjIFix3rDADJhae4A7ZttLDGXPXqMASAk\n", "QbaERtry5cGOAcUqFpNOnEiXUyQS0f8yFjXUGCMw6s5884ca6+ttDDVy/aInaGLs6tpZuyesPnuW\n", "cI5t4/plj8QYgfCwzUVCgVwIkhi7unZW7wlrz55FnGO7mHyXPWqMEQh1Z3NZqhmUuH6Wubp2Vu8J\n", "a8+eRZzjNNYELj4kxgAAAPOkRlV27PB/Ghujnxwz+S57lFIgEKvDrvBx/aKJUgpEEaUUPqtlCVy/\n", "7JAYI7CxsbkzXSsrw40HmaGxtIvJd8gXvjClWU2MkR0SYwRCYwkAhY9kMI3PveLEOsYI5HoTdYqx\n", "sUR+0JsJIEyxmJ8Iu2qHaOOiicQYQOSwLS0QjrY2/3mb3UtazJO3Uit05BptXHSxKgUCYaYr8snq\n", "UmKAdale0kTC/yFZc4M2LrroMUYgroeUAADR4KqXFLCAyXcAIqdYJr0E3RIaQGEpljbOIhJjAJFU\n", "DBNTSIyB4lUMbZxFJMYAEJKgiTEfoACQH9QYA0CEMXsdAPKHVSkAIMKYvQ4A+UOPMYCsMMwP3BjP\n", "CGAHNcYFiEYY+cLMavc4x7Zx/QBbSIwLDI0w8unQIWnHjrnHEgnWQM01vuzaxTMC2EIpRYG5Xj0i\n", "jXBuWUxULMYMHxsuYDE800DukRgDGbK4SoCrmNva/PeaPULBVuFAmqtnxGI7BFhAKUWBoZTCPYtD\n", "oy5jptcKuDEXz4jFdgiwgB7jAhOL+YkwiQryhWF+4MZ4RgA76DEGMmSxV95izMWALaGLg4seY55p\n", "wA0SY2AJLJYPWIy50JEYFz6XCSzPNJB7JMYAkCOZJiphJ8YkVu5RCwzYQo0xAOSAtVUCrMULAPlQ\n", "GnYAAFAIrreGeFRZi9eqtja/fCKFJQ2BaKPHGAAAR1gpCLCFGmMgQqj5tMvaKgHW4gWAfCAxBiKC\n", "RMU+a19srMULAK6RGAMRwex1AADCxeQ7AAAAQPQYA5HhupSCYXMAAG6MxBiIEFfJK/XLAADcHIkx\n", "UASoX46msHe+AwDMRY0xAAAAoCX2GN9///1auXKlJGn16tV69NFH1dnZqdLSUq1Zs0bd3d0qKSnJ\n", "ebAAloZSimiixxgAoiXjne/ee+89SdKxY8dmjrW3t6ujo0M1NTXq7u7WwMCAGhoachclgKyw+xYA\n", "ADeXcWJ85swZTU5OauvWrbp8+bJ27typ06dPq6amRpJUV1enoaEhEmMgYmIxaooBALiRjBPjFStW\n", "aOvWrWpqalIymdQjjzwy59/Ly8s1Pj6eswABAACAfMg4MY7H46qqqpp5XVlZqTfeeGPm3ycmJlRR\n", "UZG7CAGgQFFbDADRkvGqFMePH1dfX58k6fz585qYmNCGDRs0MjIiSRocHNS6detyGyUAAADgWMar\n", "Uly+fFmPP/64/vnPf0qSdu/ercrKSnV1dWl6elrV1dXat28fq1IAAADAFDb4AAAAAMQGHwAAAIAk\n", "EmMAAABAEokxAIQmHo/P7H4HAAgfiTEAAACgJaxjDAAAUAympqSjR/3XbW3+DqIobCTGAAAA80xN\n", "SY2N0smT/u/9/dILL5AcFzpKKQAAAOY5ejSdFEv+61TvMQoXPcYAig7DowCAxbDBB4CiMn94tL6e\n", "4VEAC1ltK/jinx0SYwBF5dAhaceOuccSCam9PZx4gKUiAXLP2jm2msxHCaUUAIrK9HSwY0CUMTEs\n", "P2IxW1+ar1cXben/Q9iYfAcARWpqyu9BP3TIfw07mBgGuEFiDKCoLF8e7FihS/U47tjh/zQ2khwD\n", "1rW1+eUTKfX1/jEER40xgKJCDZ6PWmvbuI9xPdbqoqOGGmMARSUW8xOIKHxwxONxSVIymQwnAJgV\n", "pfsY0WKtLjpq6DEGgJCEmRjT4wgAC9FjDABFiB5HAFiIHmMACAmlFAAQLaxKAQAAAIjEGAAAAJBE\n", "KQUAFC2WdQKAuUiMAaAIsSoFACxEKQUAFCG2FAaAhUiMAQAAAFFKAQBFiVIKAFiIxBgAihST7wBg\n", "LhJjAAgJG3wAQLRQYwwAAACIxBgAAACQRGIMAAAASCIxBgAAACSRGAMAAACSWJUCAAAAkESPMQAA\n", "ACCJxBgAAACQRGIMAAAASJKWhR0AAAAAcoOt3rPD5DsAAIACMDUlNTZKJ0/6v9fXSy+8QHKcCUop\n", "ACAk8Xhc8Xg87DAAFIijR9NJseS/TvUeIxgSYwAAAEBZJMb/+c9/VF9frzfffFNvvfWWWlpaY7O7\n", "aQAACMFJREFUtGXLFu3du1dUZwAAAORXW5tfPpFSX+8fQ3BLSoynp6e1Z88erVixQp7nqbe3Vx0d\n", "HXr22WfleZ4GBgZyHScAAABuIBbza4oTCf+H+uLMLSkxfuqpp9TS0qLbbrtNknT69GnV1NRIkurq\n", "6jQ8PJy7CAEAABBILCa1t/s/JMWZyzgxPn78uD784Q9r48aNkiTP8+aUTpSXl2t8fDx3EQIAAAB5\n", "kPE6xsePH1dJSYmGh4d15swZdXZ26uLFizP/PjExoYqKipwGCQCFKJlMhh0CAGCWjBPjX/ziFzOv\n", "W1tb1dPTo6eeekojIyP67Gc/q8HBQX3+85/PaZAAAACAa1nvfFdSUqLOzk51dXVpenpa1dXVamxs\n", "zEVsAAAAQN6w8x0AAAAgNvgAAAAAJJEYAwAAAJJIjAEgNPF4XPF4POwwAADXkBgDAAAAIjEGAAAA\n", "JJEYAwAAAJJIjAEAAABJJMYAAACAJDb4AAAAACTRYwwAAABIIjEGAAAAJJEYAwAAAJJIjAEAAABJ\n", "JMYAAACAJBJjAAhNPB5XPB4POwwAwDUkxgAAAIBIjAEAAABJJMYAAACAJGlZ2AEAwGKmpqSjR/3X\n", "bW1SLBZmNACAYkBiDCBypqakxkbp5En/9/5+6YUXSI4BAG5RSgEgco4eTSfFkv861XtcSJLJpJLJ\n", "ZNhhAACuITEGAAAAJJV4nueFHQQAzDa/lKK+nlIKAIB7JMYAIonJdwCAfCMxBgAAAESNMQAAACCJ\n", "xBgAQhOPxxWPx8MOAwBwDYkxAAAAIBJjAAAAQBKJMQAAACCJxBgAAACQRGIMAAAASGIdYwAAAEAS\n", "PcYAAACAJBJjAAAAQBKJMQAAACCJxBgAAACQRGIMAAAASCIxBoDQxONxxePxsMMAAFyzLNM/uHLl\n", "in70ox8pmUyqpKREPT09+sAHPqDOzk6VlpZqzZo16u7uVklJiYt4AQAAACcyToxfeukllZaW6rnn\n", "ntPIyIj2798vSero6FBNTY26u7s1MDCghoaGnAcLAAAAuJJxKUVDQ4OeeOIJSdI//vEPrVq1SqOj\n", "o6qpqZEk1dXVaXh4OLdRAgAAAI4tqca4rKxMnZ2devLJJ/XVr35VszfPKy8v1/j4eM4CBAAAAPIh\n", "41KKlL6+Pr377rtqamrS+++/P3N8YmJCFRUVOQkOAAAAyJeMe4xPnDihw4cPS5JisZhKS0t19913\n", "a2RkRJI0ODiodevW5TZKAChAyWRSyWQy7DAAANeUeLPrIAKYmppSZ2en3n33XV2+fFnbt2/Xpz71\n", "KXV1dWl6elrV1dXat28fq1IAAADAlIwTYwAAAKAQscEHAAAAIBJjAAAAQBKJMQAAACCJxBgAAACQ\n", "FEJi/Ic//EG7du2a8/umTZvU2tqq1tZWvfrqq/kOCRmYf/3+9re/6cEHH1RLS4sOHjwYYmQIwvM8\n", "1dbWzjxvqS3dEW1Xr17Vnj171NzcrNbWVr399tthh4QM3H///TPP3A9+8IOww0FAp06dUmtrqyTp\n", "rbfeUktLi7Zs2aK9e/eKdQuibfa1O336tOrq6maewd/97nc3/Nslb/CxFPv27dPQ0JDuuuuumWOj\n", "o6PavXu3Nm/enM9QsASLXb+9e/fqmWee0erVq7V9+3a98cYbuvPOO0OMEjfy9ttv69Of/rQOHToU\n", "dijIwB//+EdNT0+rv79fp06dUl9fn37605+GHRYCeO+99yRJx44dCzkSZOLIkSP67W9/q1tvvVWS\n", "1Nvbq46ODtXU1Ki7u1sDAwNqaGgIOUosZv61Gx0d1cMPP6yHH3440N/ntcd47dq1C75pjY6O6je/\n", "+Y22bNmiH//4x7py5Uo+Q0IG5l+/S5cu6f3339fq1aslSRs3btTw8HCYIeImRkdHdeHCBX3rW9/S\n", "9u3b9eabb4YdEgL4y1/+otraWknSPffco9dffz3kiBDUmTNnNDk5qa1bt+rb3/62Tp06FXZICKCq\n", "qkoHDx6c+bw7ffq0ampqJEl1dXV81kXY/Gv3+uuv609/+pMeeugh/fCHP9TExMQN/95Jj/GvfvUr\n", "/fznP59zrLe3V1/5ylf0yiuvzDm+YcMGNTQ06Pbbb9eePXvU39+vLVu2uAgLAQW9fpcuXdLKlStn\n", "fr/11lt19uzZvMWJG1vsOnZ3d+vRRx/Vl7/8Zb322mvavXu3fv3rX4cUIYKa/6yVlZXp6tWrKi1l\n", "mkjUrVixQlu3blVTU5OSyaS2bdum3//+91y7iNu8ebPeeeedmd9nd+iVl5drfHw8jLAQwPxrd889\n", "9+ib3/ym7rrrLh06dEgHDx7U97///ev+vZPEuKmpSU1NTYH+22984xv64Ac/KEn60pe+pBdffNFF\n", "SMhA0Ou3cuXKOd+8Ll26pIqKCpehIQOLXcepqSmVlZVJku677z5duHAhjNCQofnPGkmxHfF4XFVV\n", "VTOvKysr9e9//1sf/ehHQ44MmZj9vE1MTPBZZ8imTZtm8syGhgbt27fvhv99qC2r53n62te+pvPn\n", "z0uS/vznP+vuu+8OMyRkYOXKlVq+fLnOnj0rz/M0NDSkdevWhR0WbuAnP/mJfvazn0nyh3g//vGP\n", "hxwRgli7dq0GBwcl+RNe77jjjpAjQlDHjx9XX1+fJOn8+fO6dOmSbrvttpCjQqbuvPNOjYyMSJIG\n", "Bwf5rDPkkUce0d///ndJwfLMvE6+k6SSkhKVlJTMvH7yySf12GOP6ZZbbtGaNWv04IMP5jskZGD2\n", "9ZOknp4efe9739OVK1e0ceNGfeYznwkxOtzM9u3btXv3bp08eVLLli1Tb29v2CEhgE2bNmloaEjN\n", "zc2SxHUz5IEHHtDjjz8+UyLY29tLb78hqc+7zs5OdXV1aXp6WtXV1WpsbAw5MtxM6tr19PSop6dH\n", "y5Yt00c+8hE98cQTN/47jzVHAAAAADb4AAAAACQSYwAAAEASiTEAAAAgicQYAAAAkERiDAAAAEgi\n", "MQYAAAAkkRgDAAAAkkiMAQAAAEnS/wHvZVE3+a+WiQAAAABJRU5ErkJggg==\n" ], "text/plain": [ "" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "window = class_df[(class_df['size']>=29) & (class_df['size']<=53)]\n", "\n", "result = smf.ols(formula = \"read ~ csize + small\", \n", " data = window).fit()\n", "print result.summary()\n", "\n", "plt.figure(num=None, figsize=(12, 6), dpi=80, facecolor='w', edgecolor='k')\n", "plt.scatter(window.csize,window.read, color=\"blue\")\n", "l=window[window.csize<0].csize.count()\n", "plt.plot(window.csize[0:l], result.predict()[0:l], '-', color=\"r\")\n", "plt.plot(window.csize[l:], result.predict()[l:], '-', color=\"r\")\n", "plt.axvline(x=-0.5,color=\"black\", linestyle=\"--\")\n", "plt.title(\"Regression Discontinuity: Reading Scores by Class Size Before and After the Cutoff\", fontsize=\"18\")" ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "^^ In this model, we see a statistically significant effect of class size on reading scores (p<0.05), as expressed in the coefficient *small* and illustrated by plotting the predicted value from the model on the forcing variable." ] }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Generalizing the Relationship Between the Outcome and the Forcing Variable\n", "\n", "Murnane and Willett explore a more complex example in Ludwig and Miller (2009) \"[Does Head Start Improve Children's Life Chances? Evidence from a Regression Discontinuity Design](http://qje.oxfordjournals.org/content/122/1/159.short).\" In this paper, the authors identify a possible exogenous cutoff in the deployment of Head Start when the US Office of Economic Opportunity (OEO) offered Head Start grant-writing support to communities with county-level povery rates below 59.2%. The authors fit two regression discontinuity models:\n", "\n", "**Model 1** \"examines differences in counties' funding for and participation in, the Head Start program as a consequence of receipt of grant-writing assistance or the lack of it. The results of these analyses showed that grant-writing assistance did indeed lead to differences in Head Start funding and participation immediately following receipt of the assistance.\" (187)\n", "**Model 2** focused on \"longer-term child health and schooling outcomes.\" In this model, \"poverty-rate was again the forcing variable and exogenous assignment to grant-writing assistance again defined the experimental conditions. However, now, the impact of *participating* in Head Start on future child outcomes is the substantive focus, and so grant-writing assistance--which remains the principal question predictor--has become an exogenously assigned expression of *intent to treat* by Head Start\" (187). This opens up two causal questions:\n", "* \"Did receipt of grant-writing assistance lead to increases in a county's participation in, and funding for, Head Start?\" (187) \n", "* \"Did grant-writing assistance (which constitutes an intent to treat with Head Start) lead to improvement in future child outcomes?\" (187) (particularly recuding child mortality)\n", "\n", "Murnane and Willett walk readers through the various models taken in this paper, as well as the sensitivity analyses conducted on the second set of models:\n", "* demonstrating that their approach \"*revealed no effects for outcomes that they hypothesized should not have been influenced by the OEO grant-writing assistance program*\" (193)\n", " * testing unlinked outcomes, like per-capita spending on non-Head-Start programs\n", " * testing outcomes from a period before the intervention\n", " \n", "## Planning Regression Discontinuity Designs Up Front\n", "Murnane and Willet note that Regression Discontinuity can be convenient as an initial study design in politically complicated situations: \"providing assistance to the 300 poorest counties, with the slightly less needy serving as controls, would be easier to defend ethically to members of Congress who were concerned about equity than would the assignment of poor counties randomly to treatment and control groups\" (195). When doing this, there are several costs:\n", "* Results apply only to observations near the cut-point (197)\n", "* Statistical power is also a problem: \"the sample size required in an impact evaluation with an RD design typically must be almost three times the size of the sample that would be required in an equivalent random-assignment experiment of the same statistical power\" (they cite Bloom, forthcoming, which I couldn't find) (197)\n", "\n", "## Further Reading\n", "Murnane and Willett conclude by suggesting that readers further interested in this technique read Thomas Cook's 2008 paper, \"[Waiting for Life to Arrive: A History of the Regression-Discontinuity Design in Psychology, Statistics, and Economics](http://www.sciencedirect.com/science/article/pii/S0304407607001108)\" in the journal of Econometrics.\n" ] } ], "metadata": { "kernelspec": { "display_name": "Python 2", "language": "python", "name": "python2" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 2 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython2", "version": "2.7.6" } }, "nbformat": 4, "nbformat_minor": 0 }