{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Agent, RL and MultiEnvironment"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "It is recommended to have a look at the [0_basic_functionalities](0_basic_functionalities.ipynb), [1_Observation_Agents](1_Observation_Agents.ipynb) and [2_Action_GridManipulation](2_Action_GridManipulation.ipynb) and especially [3_TrainingAnAgent](3_TrainingAnAgent.ipynb) notebooks before getting into this one."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "**Objectives**\n",
    "\n",
    "In this notebook we will expose :\n",
    "* what is a \"MultiEnv\"\n",
    "* how can it be used with an agent\n",
    "* how can it be used to train a agent that uses different environments"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div id=\"my_id_menu_nb\">run previous cell, wait for 2 seconds</div>\n",
       "<script>\n",
       "function repeat_indent_string(n){\n",
       "    var a = \"\" ;\n",
       "    for ( ; n > 0 ; --n)\n",
       "        a += \"    \";\n",
       "    return a;\n",
       "}\n",
       "// look up into all sections and builds an automated menu //\n",
       "var update_menu_string = function(begin, lfirst, llast, sformat, send, keep_item, begin_format, end_format) {\n",
       "    var anchors = document.getElementsByClassName(\"section\");\n",
       "    if (anchors.length == 0) {\n",
       "        anchors = document.getElementsByClassName(\"text_cell_render rendered_html\");\n",
       "    }\n",
       "    var i,t;\n",
       "    var text_menu = begin;\n",
       "    var text_memo = \"<pre>\\nlength:\" + anchors.length + \"\\n\";\n",
       "    var ind = \"\";\n",
       "    var memo_level = 1;\n",
       "    var href;\n",
       "    var tags = [];\n",
       "    var main_item = 0;\n",
       "    var format_open = 0;\n",
       "    for (i = 0; i <= llast; i++)\n",
       "        tags.push(\"h\" + i);\n",
       "\n",
       "    for (i = 0; i < anchors.length; i++) {\n",
       "        text_memo += \"**\" + anchors[i].id + \"--\\n\";\n",
       "\n",
       "        var child = null;\n",
       "        for(t = 0; t < tags.length; t++) {\n",
       "            var r = anchors[i].getElementsByTagName(tags[t]);\n",
       "            if (r.length > 0) {\n",
       "child = r[0];\n",
       "break;\n",
       "            }\n",
       "        }\n",
       "        if (child == null) {\n",
       "            text_memo += \"null\\n\";\n",
       "            continue;\n",
       "        }\n",
       "        if (anchors[i].hasAttribute(\"id\")) {\n",
       "            // when converted in RST\n",
       "            href = anchors[i].id;\n",
       "            text_memo += \"#1-\" + href;\n",
       "            // passer à child suivant (le chercher)\n",
       "        }\n",
       "        else if (child.hasAttribute(\"id\")) {\n",
       "            // in a notebook\n",
       "            href = child.id;\n",
       "            text_memo += \"#2-\" + href;\n",
       "        }\n",
       "        else {\n",
       "            text_memo += \"#3-\" + \"*\" + \"\\n\";\n",
       "            continue;\n",
       "        }\n",
       "        var title = child.textContent;\n",
       "        var level = parseInt(child.tagName.substring(1,2));\n",
       "\n",
       "        text_memo += \"--\" + level + \"?\" + lfirst + \"--\" + title + \"\\n\";\n",
       "\n",
       "        if ((level < lfirst) || (level > llast)) {\n",
       "            continue ;\n",
       "        }\n",
       "        if (title.endsWith('¶')) {\n",
       "            title = title.substring(0,title.length-1).replace(\"<\", \"&lt;\")\n",
       "         .replace(\">\", \"&gt;\").replace(\"&\", \"&amp;\");\n",
       "        }\n",
       "        if (title.length == 0) {\n",
       "            continue;\n",
       "        }\n",
       "\n",
       "        while (level < memo_level) {\n",
       "            text_menu += end_format + \"</ul>\\n\";\n",
       "            format_open -= 1;\n",
       "            memo_level -= 1;\n",
       "        }\n",
       "        if (level == lfirst) {\n",
       "            main_item += 1;\n",
       "        }\n",
       "        if (keep_item != -1 && main_item != keep_item + 1) {\n",
       "            // alert(main_item + \" - \" + level + \" - \" + keep_item);\n",
       "            continue;\n",
       "        }\n",
       "        while (level > memo_level) {\n",
       "            text_menu += \"<ul>\\n\";\n",
       "            memo_level += 1;\n",
       "        }\n",
       "        text_menu += repeat_indent_string(level-2);\n",
       "        text_menu += begin_format + sformat.replace(\"__HREF__\", href).replace(\"__TITLE__\", title);\n",
       "        format_open += 1;\n",
       "    }\n",
       "    while (1 < memo_level) {\n",
       "        text_menu += end_format + \"</ul>\\n\";\n",
       "        memo_level -= 1;\n",
       "        format_open -= 1;\n",
       "    }\n",
       "    text_menu += send;\n",
       "    //text_menu += \"\\n\" + text_memo;\n",
       "\n",
       "    while (format_open > 0) {\n",
       "        text_menu += end_format;\n",
       "        format_open -= 1;\n",
       "    }\n",
       "    return text_menu;\n",
       "};\n",
       "var update_menu = function() {\n",
       "    var sbegin = \"\";\n",
       "    var sformat = '<a href=\"#__HREF__\">__TITLE__</a>';\n",
       "    var send = \"\";\n",
       "    var begin_format = '<li>';\n",
       "    var end_format = '</li>';\n",
       "    var keep_item = -1;\n",
       "    var text_menu = update_menu_string(sbegin, 2, 4, sformat, send, keep_item,\n",
       "       begin_format, end_format);\n",
       "    var menu = document.getElementById(\"my_id_menu_nb\");\n",
       "    menu.innerHTML=text_menu;\n",
       "};\n",
       "window.setTimeout(update_menu,2000);\n",
       "            </script>"
      ],
      "text/plain": [
       "<IPython.core.display.HTML object>"
      ]
     },
     "execution_count": 1,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "res = None\n",
    "try:\n",
    "    from jyquickhelper import add_notebook_menu\n",
    "    res = add_notebook_menu()\n",
    "except ModuleNotFoundError:\n",
    "    print(\"Impossible to automatically add a menu / table of content to this notebook.\\nYou can download \\\"jyquickhelper\\\" package with: \\n\\\"pip install jyquickhelper\\\"\")\n",
    "res"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "import grid2op\n",
    "from grid2op.Reward import ConstantReward, FlatReward\n",
    "from tqdm.notebook import tqdm\n",
    "from grid2op.Runner import Runner\n",
    "import sys\n",
    "import os\n",
    "import numpy as np\n",
    "TRAINING_STEP = 100"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## I) Download more data for the default environment.\n",
    "\n",
    "A lot of data have been made available for the default \"case14_redisp\" environment. Including this data in the package is not convenient. We chose instead to release them and make them easily available with a utility. To download them in the default directory (\"~/data_grid2op/case14_redisp\") on linux based system you can do the following (uncomment the following command)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [],
   "source": [
    "# !$sys.executable -m grid2op.download --name \"case14_realistic\""
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## I) Make a regular environment and agent"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Now that we downloaded the dataset, it is time to make an environment that will use all the data avaiable. You can execute the following command line. If you see any error or warning consider re downloading the data, or adapting the key-word argument \"chronics_path\" to match the path where the data have been downloaded."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "/home/donnotben/Documents/Grid2Op_dev/getting_started/grid2op/MakeEnv/MakeNew.py:139: UserWarning:\n",
      "\n",
      "You are using a development environment. This is really not recommended for training agents.\n",
      "\n"
     ]
    }
   ],
   "source": [
    "env = grid2op.make_new(\"rte_case14_realistic\", test=True)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A lot of data have been made available for the default \"rte_case14_realistic\" environment. Including this data in the package is not convenient. \n",
    "\n",
    "We chose instead to release them and make them easily available with a utility. To download them in the default directory (\"~/data_grid2op/case14_redisp\")  just pass the argument \"test=False\" (or don't pass anything else) as local=False is the default value. It will download approximately 300Mo of data."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## II) Train a standard RL Agent"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Make sure you are using a computer with at least 4 cores if you want to notice some speed-ups."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [],
   "source": [
    "from grid2op.Environment import MultiEnvironment\n",
    "from grid2op.Agent import DoNothingAgent\n",
    "NUM_CORE = 8"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### IIIa) Using the standard open AI gym loop\n",
    "\n",
    "Here we demonstrate how to use the multi environment class. First let's create a multi environment."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [],
   "source": [
    "# create a simple agent\n",
    "agent = DoNothingAgent(env.action_space)\n",
    "\n",
    "# create the multi environment class\n",
    "multi_envs = MultiEnvironment(env=env, nb_env=NUM_CORE)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A multienvironment is just like a regular environment but instead of dealing with one action, and one observation, is requires to be sent multiple actions, and returns a list of observations as well. \n",
    "\n",
    "It requires a grid2op environment to be initialized and creates some specific \"workers\", each a replication of the initial environment. None of the \"worker\" can be accessed directly. Supported methods are:\n",
    "- multi_env.reset\n",
    "- multi_env.step\n",
    "- multi_env.close\n",
    "\n",
    "That have similar behaviour to \"env.step\", \"env.close\" or \"env.reset\".\n",
    "\n",
    "\n",
    "It can be used the following manner."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([<grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f733c7b1550>,\n",
       "       <grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f733c7ce828>,\n",
       "       <grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f733c7b1710>,\n",
       "       <grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f733c7b14e0>,\n",
       "       <grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f733c7b17b8>,\n",
       "       <grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f737a22ff60>,\n",
       "       <grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f733c7b1d68>,\n",
       "       <grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f737a22ff98>],\n",
       "      dtype=object)"
      ]
     },
     "execution_count": 7,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# initiliaze some variable with the proper dimension\n",
    "obss = multi_envs.reset()\n",
    "rews = [env.reward_range[0] for i in range(NUM_CORE)]\n",
    "dones = [False for i in range(NUM_CORE)]\n",
    "obss"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 8,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[False, False, False, False, False, False, False, False]"
      ]
     },
     "execution_count": 8,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "dones"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "As you can see, obs is not a single obervation, but a list (numpy nd array to be precise) of 4 observations, each one being an observation of a given \"worker\" environment.\n",
    "\n",
    "Worker environments are always called in the same order. It means the first observation of this vector will always correspond to the first worker environment. \n",
    "\n",
    "\n",
    "Similarly to Observation, the \"step\" function of a multi_environment takes as input a list of multiple actions, each action will be implemented in its own environment. It returns a list of observations, a list of rewards, and boolean list of whether or not the worker environment suffer from a game over (in that case this worker environment is automatically restarted using the \"reset\" method.)\n",
    "\n",
    "Because orker environments are always called in the same order, the first action sent to the \"multi_env.step\" function will also be applied on this first environment.\n",
    "\n",
    "It is possible to use it as follow:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "array([<grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f737a238f98>,\n",
       "       <grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f737a238f60>,\n",
       "       <grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f737a238ef0>,\n",
       "       <grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f737a246630>,\n",
       "       <grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f737a238f28>,\n",
       "       <grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f737a246048>,\n",
       "       <grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f737a24dc18>,\n",
       "       <grid2op.Observation.CompleteObservation.CompleteObservation object at 0x7f737a24de48>],\n",
       "      dtype=object)"
      ]
     },
     "execution_count": 9,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# initialize the vector of actions that will be processed by each worker environment.\n",
    "acts = [None for _ in range(NUM_CORE)]\n",
    "for env_act_id in range(NUM_CORE):\n",
    "    acts[env_act_id] = agent.act(obss[env_act_id], rews[env_act_id], dones[env_act_id])\n",
    "    \n",
    "# feed them to the multi_env\n",
    "obss, rews, dones, infos = multi_envs.step(acts)\n",
    "\n",
    "# as explained, this is a vector of Observation (as many as NUM_CORE in this example)\n",
    "obss"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "The multi environment loop is really close to the \"gym\" loop:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "# performs the appropriated steps\n",
    "for i in range(10):\n",
    "    acts = [None for _ in range(NUM_CORE)]\n",
    "    for env_act_id in range(NUM_CORE):\n",
    "        acts[env_act_id] = agent.act(obss[env_act_id], rews[env_act_id], dones[env_act_id])\n",
    "    obss, rews, dones, infos = multi_envs.step(acts)\n",
    "\n",
    "    # DO SOMETHING WITH THE AGENT IF YOU WANT\n",
    "    ## agent.train(obss, rews, dones)\n",
    "    \n",
    "\n",
    "# close the environments created by the multi_env\n",
    "multi_envs.close()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "On the above example, `TRAINING_STEP` steps are performed on `NUM_CORE` environments in parrallel. The agent has then acted `TRAINING_STEP * NUM_CORE` (=`10 * 4 = 40` by default) times on `NUM_CORE` different environments."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### III.b) Practical example"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We reuse the code of the Notebook [3_TrainingAnAgent](3_TrainingAnAgent.ipynb) to train a new agent, but this time using more than one process of the machine. To further emphasize the working of multi environments, we put on a different module ([ml_agent](ml_agent.py)) the code of some agents and focus here on the training part. \n",
    "\n",
    "Note that compare to the previous notebook, the code have been adapted to used \"batch\" of data when predicting movments. The input data is also restricted to:\n",
    "- the relative flow value\n",
    "- the powerline status\n",
    "- the topology vector\n",
    "\n",
    "All the other component of the observations are not used."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 11,
   "metadata": {},
   "outputs": [],
   "source": [
    "from ml_agent import TrainingParam, ReplayBuffer, DeepQAgent\n",
    "from grid2op.Agent import AgentWithConverter\n",
    "from grid2op.Reward import RedispReward\n",
    "from grid2op.Converter import IdToAct\n",
    "import numpy as np\n",
    "import random\n",
    "import warnings\n",
    "import pdb\n",
    "with warnings.catch_warnings():\n",
    "    warnings.filterwarnings(\"ignore\", category=FutureWarning)\n",
    "    import tensorflow.keras\n",
    "    import tensorflow.keras.backend as K\n",
    "    from tensorflow.keras.models import load_model, Sequential, Model\n",
    "    from tensorflow.keras.optimizers import Adam\n",
    "    from tensorflow.keras.layers import Activation, Dropout, Flatten, Dense, subtract, add\n",
    "    from tensorflow.keras.layers import Input, Lambda, Concatenate"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 12,
   "metadata": {},
   "outputs": [],
   "source": [
    "class TrainAgentMultiEnv(object):\n",
    "    def __init__(self, agent, nb_process, reward_fun=RedispReward, env=None, name=None):\n",
    "        # compare to the version showed in the notebook 3, the process buffer has been moved in this class\n",
    "        # and we add a multi_envs argument.\n",
    "        self.nb_process = nb_process\n",
    "        self.multi_envs = None\n",
    "        self.process_buffer = [[] for _ in range(self.nb_process)]\n",
    "        self.name = name\n",
    "        self.agent = agent\n",
    "        self.env = env\n",
    "        self.training_param = None\n",
    "    \n",
    "    def close(self):\n",
    "        self.multi_envs.close()\n",
    "        \n",
    "    def convert_process_buffer(self):\n",
    "        \"\"\"Converts the list of NUM_FRAMES images in the process buffer\n",
    "        into one training sample\"\"\"\n",
    "        # here i simply concatenate the action in case of multiple action in the \"buffer\"\n",
    "        if self.training_param.NUM_FRAMES != 1:\n",
    "            raise RuntimeError(\"This has not been tested with self.training_param.NUM_FRAMES != 1 for now\")\n",
    "        return np.array([np.concatenate(el) for el in self.process_buffer])\n",
    "        \n",
    "    def _build_valid_env(self, training_param):\n",
    "        # this function has also be adapted\n",
    "        create_new = False\n",
    "        if self.multi_envs is None:\n",
    "            create_new = True\n",
    "            # first we need to initialize the multi environment\n",
    "            self.multi_envs = MultiEnvironment(env=env, nb_env=self.nb_process)\n",
    "            \n",
    "            # then, as before, we reset it\n",
    "            obss = self.multi_envs.reset()\n",
    "            for worker_id in range(self.nb_process):\n",
    "                self.process_buffer[worker_id].append(self.agent.convert_obs(obss[worker_id]))\n",
    "                \n",
    "            # used in case of \"num frames\" != 1 (so not tested)\n",
    "            do_nothing = [self.env.action_space() for _ in range(self.nb_process)]\n",
    "            for _ in range(training_param.NUM_FRAMES-1):\n",
    "                # Initialize buffer with the first frames\n",
    "                s1, r1, _, _ = self.multi_envs.step(do_nothing)\n",
    "                for worker_id in range(self.nb_process):\n",
    "                    # difference compared to previous implementation: we loop through all the observations\n",
    "                    # and save them all\n",
    "                    self.process_buffer[worker_id].append(self.agent.convert_obs(s1[worker_id])) \n",
    "                    \n",
    "        return create_new\n",
    "    \n",
    "    def train(self, num_frames, training_param=TrainingParam()):\n",
    "        self.training_param = training_param\n",
    "        \n",
    "        # first we create an environment or make sure the given environment is valid\n",
    "        close_env = self._build_valid_env(training_param)\n",
    "        \n",
    "        # same as in the original implemenation, except the process buffer is now in this class\n",
    "        observation_num = 0\n",
    "        curr_state = self.convert_process_buffer()\n",
    "        \n",
    "        # we initialize the NN exactly as before\n",
    "        self.agent.init_deep_q(curr_state)\n",
    "            \n",
    "        # some parameters have been move to a class named \"training_param\" for convenience\n",
    "        epsilon = training_param.INITIAL_EPSILON\n",
    "        # now the number of alive frames and total reward depends on the \"underlying environment\". It is vector instead\n",
    "        # of scalar\n",
    "        alive_frame = np.zeros(self.nb_process, dtype=np.int)\n",
    "        total_reward = np.zeros(self.nb_process, dtype=np.float)\n",
    "\n",
    "        with tqdm(total=num_frames) as pbar:\n",
    "            while observation_num < num_frames:\n",
    "                if observation_num % 1000 == 999:\n",
    "                    print((\"Executing loop %d\" %observation_num))\n",
    "                    # for efficient reading of data: at early stage of training, it is advised to load\n",
    "                    # data by chunk: the model will do game over pretty easily (no need to load all the dataset)\n",
    "                    tmp = min(10000 * (num_frames // observation_num), 10000)\n",
    "                    self.multi_envs.set_chunk_size(int(max(100, tmp)))\n",
    "\n",
    "                # Slowly decay the learning rate\n",
    "                if epsilon > training_param.FINAL_EPSILON:\n",
    "                    epsilon -= (training_param.INITIAL_EPSILON-training_param.FINAL_EPSILON)/training_param.EPSILON_DECAY\n",
    "\n",
    "                initial_state = self.convert_process_buffer()\n",
    "                self.process_buffer = [[] for _ in range(self.nb_process)]\n",
    "\n",
    "                # TODO vectorize that in the Agent directly\n",
    "                # then we need to predict the next moves. Agents have been adapted to predict a batch of data\n",
    "                pm_i, pq_v = self.agent.deep_q.predict_movement(curr_state, epsilon)\n",
    "                # and build the convenient vectors (it was scalars before)\n",
    "                predict_movement_int = []\n",
    "                predict_q_value = []\n",
    "                acts = []\n",
    "                for p_id in range(self.nb_process):\n",
    "                    predict_movement_int.append(pm_i[p_id])\n",
    "                    predict_q_value.append(pq_v[p_id])\n",
    "                    # and then we convert it to a valid action\n",
    "                    acts.append(self.agent.convert_act(pm_i[p_id]))\n",
    "\n",
    "                # same loop as in notebook 3\n",
    "                reward, done = np.zeros(self.nb_process), np.full(self.nb_process, fill_value=False, dtype=np.bool)\n",
    "                for i in range(training_param.NUM_FRAMES):\n",
    "                    temp_observation_obj, temp_reward, temp_done, _ = self.multi_envs.step(acts)\n",
    "\n",
    "                    # we need to handle vectors for \"done\"\n",
    "                    reward[~temp_done] += temp_reward[~temp_done]\n",
    "                    # and then \"de stack\" the observations coming from different environments\n",
    "                    for worker_id, obs in enumerate(temp_observation_obj):\n",
    "                        self.process_buffer[worker_id].append(self.agent.convert_obs(temp_observation_obj[worker_id])) \n",
    "                    done = done | temp_done\n",
    "\n",
    "                    # increase of 1 the number of frame alive for relevant \"underlying environments\"\n",
    "                    alive_frame[~temp_done] += 1\n",
    "                    # loop through the environment where a game over was done, and print the results\n",
    "                    for env_done_idx in np.where(temp_done)[0]:\n",
    "                        print(\"For env with id {}\".format(env_done_idx))\n",
    "                        print(\"\\tLived with maximum time \", alive_frame[env_done_idx])\n",
    "                        print(\"\\tEarned a total of reward equal to \", total_reward[env_done_idx])\n",
    "\n",
    "                    reward[temp_done] = 0.\n",
    "                    total_reward[temp_done] = 0.\n",
    "                    total_reward += reward\n",
    "                    alive_frame[temp_done] = 0\n",
    "\n",
    "                # vectorized version of the previous code\n",
    "                new_state = self.convert_process_buffer()\n",
    "                # same as before, but looping through the \"underlying environment\"\n",
    "                for sub_env_id in range(self.nb_process):\n",
    "                    self.agent.replay_buffer.add(initial_state[sub_env_id],\n",
    "                                                 predict_movement_int[sub_env_id],\n",
    "                                                 reward[sub_env_id],\n",
    "                                                 done[sub_env_id],\n",
    "                                                 new_state[sub_env_id])\n",
    "\n",
    "                if self.agent.replay_buffer.size() > training_param.MIN_OBSERVATION:\n",
    "                    s_batch, a_batch, r_batch, d_batch, s2_batch = self.agent.replay_buffer.sample(training_param.MINIBATCH_SIZE)\n",
    "                    isfinite = self.agent.deep_q.train(s_batch, a_batch, r_batch, d_batch, s2_batch, observation_num)\n",
    "                    self.agent.deep_q.target_train()\n",
    "\n",
    "                    if not isfinite:\n",
    "                        # if the loss is not finite i stop the learning\n",
    "                        print(\"ERROR INFINITE LOSS\")\n",
    "                        break\n",
    "\n",
    "\n",
    "                # Save the network every 10000 iterations\n",
    "                if observation_num % 10000 == 9999 or observation_num == num_frames-1:\n",
    "                    print(\"Saving Network\")\n",
    "                    if self.name is None:\n",
    "                        self.agent.deep_q.save_network(\"saved_notebook6.h5\")\n",
    "                    else:\n",
    "                        self.agent.deep_q.save_network(\"saved_notebook6_{}\".format(self.name))\n",
    "\n",
    "                observation_num += 1\n",
    "                pbar.update(1)\n",
    "            \n",
    "        if close_env:\n",
    "            print(\"closing env\")\n",
    "            self.env.close()\n",
    "        "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "We redifine the class used to train the agent."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "WARNING:tensorflow:From /home/donnotben/.local/lib/python3.6/site-packages/tensorflow/python/ops/resource_variable_ops.py:435: colocate_with (from tensorflow.python.framework.ops) is deprecated and will be removed in a future version.\n",
      "Instructions for updating:\n",
      "Colocations handled automatically by placer.\n",
      "WARNING:tensorflow:From /home/donnotben/.local/lib/python3.6/site-packages/tensorflow/python/keras/utils/losses_utils.py:170: to_float (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.\n",
      "Instructions for updating:\n",
      "Use tf.cast instead.\n",
      "Successfully constructed networks.\n"
     ]
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "b1b90e9e683f4182ab6765611941d0e6",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "HBox(children=(FloatProgress(value=0.0), HTML(value='')))"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "For env with id 3\n",
      "\tLived with maximum time  2\n",
      "\tEarned a total of reward equal to  -10.0\n",
      "For env with id 5\n",
      "\tLived with maximum time  4\n",
      "\tEarned a total of reward equal to  1077.0223816944304\n",
      "WARNING:tensorflow:From /home/donnotben/.local/lib/python3.6/site-packages/tensorflow/python/ops/math_ops.py:3066: to_int32 (from tensorflow.python.ops.math_ops) is deprecated and will be removed in a future version.\n",
      "Instructions for updating:\n",
      "Use tf.cast instead.\n",
      "For env with id 3\n",
      "\tLived with maximum time  6\n",
      "\tEarned a total of reward equal to  1075.735591002436\n",
      "For env with id 4\n",
      "\tLived with maximum time  10\n",
      "\tEarned a total of reward equal to  1091.7395887955377\n",
      "For env with id 0\n",
      "\tLived with maximum time  13\n",
      "\tEarned a total of reward equal to  1057.4761663196673\n",
      "For env with id 3\n",
      "\tLived with maximum time  12\n",
      "\tEarned a total of reward equal to  2212.497969527082\n",
      "For env with id 5\n",
      "\tLived with maximum time  17\n",
      "\tEarned a total of reward equal to  3285.7270225485163\n",
      "For env with id 7\n",
      "\tLived with maximum time  28\n",
      "\tEarned a total of reward equal to  1035.7451876395112\n",
      "For env with id 6\n",
      "\tLived with maximum time  29\n",
      "\tEarned a total of reward equal to  1028.188758184281\n",
      "For env with id 5\n",
      "\tLived with maximum time  12\n",
      "\tEarned a total of reward equal to  2237.343192563007\n",
      "For env with id 1\n",
      "\tLived with maximum time  53\n",
      "\tEarned a total of reward equal to  1028.9711122236943\n",
      "For env with id 5\n",
      "\tLived with maximum time  25\n",
      "\tEarned a total of reward equal to  2210.648185863736\n",
      "For env with id 3\n",
      "\tLived with maximum time  40\n",
      "\tEarned a total of reward equal to  4415.636092477037\n",
      "For env with id 0\n",
      "\tLived with maximum time  52\n",
      "\tEarned a total of reward equal to  4545.679913625342\n",
      "For env with id 7\n",
      "\tLived with maximum time  41\n",
      "\tEarned a total of reward equal to  3277.2740693289884\n",
      "For env with id 2\n",
      "\tLived with maximum time  71\n",
      "\tEarned a total of reward equal to  4512.580363829556\n",
      "For env with id 0\n",
      "\tLived with maximum time  7\n",
      "\tEarned a total of reward equal to  1082.5597351265721\n",
      "For env with id 3\n",
      "\tLived with maximum time  24\n",
      "\tEarned a total of reward equal to  3349.3043333236146\n",
      "For env with id 7\n",
      "\tLived with maximum time  17\n",
      "\tEarned a total of reward equal to  1086.1556494129995\n",
      "For env with id 5\n",
      "\tLived with maximum time  32\n",
      "\tEarned a total of reward equal to  2136.6764374229965\n",
      "For env with id 3\n",
      "\tLived with maximum time  9\n",
      "\tEarned a total of reward equal to  2226.9701958954647\n",
      "Saving Network\n",
      "Successfully saved network.\n",
      "\n",
      "closing env\n"
     ]
    }
   ],
   "source": [
    "agent_name = \"sac_1e5\"\n",
    "my_agent = DeepQAgent(env.action_space, mode=\"SAC\", training_param=TrainingParam())\n",
    "trainer = TrainAgentMultiEnv(agent=my_agent, env=env, nb_process=NUM_CORE, name=agent_name)\n",
    "# trainer = TrainAgent(agent=my_agent, env=env)\n",
    "trainer.train(TRAINING_STEP)\n",
    "trainer.close()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 14,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAABr8AAAReCAYAAABuCCtxAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADh0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uMy4yLjAsIGh0dHA6Ly9tYXRwbG90bGliLm9yZy8GearUAAAgAElEQVR4nOzdd3ie530f+u8DgAAHBvcCuERRorhpDdvyiCPLu43tnDix3Z6mGXXdZjjNaZq0ddpz0qQ9Ta7sJidJT5117Dhxln1i1473tiVK3BS1RQLgHngBDhDr6R+kQEKQLEoC+IIvP59/iPf+PffD36vrEv/A9/rdd1GWZQAAAAAAAKAW1FW7AQAAAAAAAJgowi8AAAAAAABqhvALAAAAAACAmiH8AgAAAAAAoGYIvwAAAAAAAKgZwi8AAAAAAABqRkO1G3im+fPnlytXrqx2GwAAAAAAAFxjDzzwwImyLBe8lHdMufBr5cqV2bZtW7XbAAAAAAAA4BoriuLAS32HYw8BAAAAAACoGcIvAAAAAAAAaobwCwAAAAAAgJoh/AIAAAAAAKBmCL8AAAAAAACoGcIvAAAAAAAAaobwCwAAAAAAgJoh/AIAAAAAAKBmCL8AAAAAAACoGcIvAAAAAAAAaobwCwAAAAAAgJoh/AIAAAAAAKBmCL8AAAAAAACoGcIvAAAAAAAAaobwCwAAAAAAgJoh/AIAAAAAAKBmCL8AAAAAAACoGcIvAAAAAAAAaobwCwAAAAAAgJoh/AIAAAAAAKBmCL8AAAAAAACoGcIvAAAAAAAAaobwCwAAAAAAgJoh/AIAAAAAAKBmCL8AAAAAAACoGcIvAAAAAAAAaobwCwAAAAAAgJoh/AIAAAAAAKBmCL8AAAAAAACoGcIvAAAAAAAAaobwCwAAAAAAgJoh/AIAAAAAAKBmCL8AAAAAAACoGcIvAAAAAAAAaobwCwAAAAAAgJoh/AIAAAAAAKBmCL8AAAAAAACoGcIvAAAAAAAAaobwCwAAAAAAgJoh/AIAAAAAAKBmCL8AAAAAAACoGcIvAAAAAAAAaobwCwAAAAAAgJoh/AIAAAAAAKBmCL8AAAAAAACoGcIvAAAAAAAAakZDtRsAAAAAAACg9n1i56H8xf2dSZKNHW352TevnZS/x+QXAAAAAAAAk+4Pv/5k9hyq5KmTZ/P7X3485weGJ+XvEX4BAAAAAAAwqYZHyuw/3Jfv3dqRn/8H6zJSJg8d6Z2Uv0v4BQAAAAAAwKR68sTZnB8czrqlrVm3pDVJsu+Q8AsAAAAAAIDr0N5DlSTJ+qWt6ZgzI63TG7JX+AUAAAAAAMD1aN/h3jTW1+Xmhc0piiLrlrZm32HhFwAAAAAAANehfYd6c8vi5kyrvxhNrV/alv2HezM0PDLhf5fwCwAAAAAAgElTlmX2HurN+iVto2vrl7bmwtBInjhxdsL/PuEXAAAAAAAAk+Zo74WcOjuQdUtbR9ee/nnfJNz7JfwCAAAAAABg0uw9VElycdrraasXNKexoW60NpGEXwAAAAAAAEyafYd6UxTJ2iWXw69p9XW5dVFL9h2e+Mmvhgl/IwAAAAAAADeUkZEy//ETe9N1+ty42v4jfVk5b1aam8bGUuuXtuZvd3Tnh/7wviTJr37/lgnpRfgFAAAAAADAd/TNx0/mp/58e4aGy7TOmJaPvf+Vmd/cNFrvPH0uf/qtA1kxb2baZkwbs3dBS1PesaV93DvfvqU9+4/05eTZgSTJ8Eg5Ib0KvwAAAAAAAPiOPvfQ0Zw+N5g3r1+cT+w8lPufPJW3bFwyWn/ocF+S5LfevTWbl82+qne+cvW8/O2PvWrCe72qO7+KonhzURQPF0XxWFEUP/cs9fcXRbG7KIodRVF8rSiKdZfWVxZFcf7S+o6iKH5vor8AAAAAAAAAk2vvoUrWL23NL3/fptTXFdl7aOxdXfuPXLzX65ZFLVXq8LLnnfwqiqI+ye8keUOSriT3F0XxibIs913x2EfKsvy9S89/T5JfS/LmS7XHy7KcmEMaAQAAAAAAuKZGRsrs7e7N27cuzfRp9VmzsDl7DlXGPLP/cF9WzZuVGY31VerysquZ/LoryWNlWT5RluVAko8mefuVD5RleWW8NyvJxBzKCAAAAAAAQFV1nj6XvgtD2bC0LUmyfmlb9nSPnfx66EhvblvSWo32xrma8Ks9SecVn7surY1RFMWPFUXxeJJfTvKTV5RWFUWxvSiKLxdF8ZqX1C0AAAAAAADX1NNHHK4fDb9ac+LMhRzr7U+SnL0wlAMnz2Xt4uofeZhc5Z1fV6Msy98py3J1kp9N8sFLy4eTLC/LcmuSn07ykaIoxsV+RVG8ryiKbUVRbDt+/PhEtQQAAAAAAMBLtKe7koa6Ircsbk6SbGi/GII9ffThw0f7kiRrr6PJr+4ky6743HFp7bl8NMk7kqQsywtlWZ689PMDSR5PcsszN5Rl+QdlWd5RluUdCxYsuNreAQAAAAAAmGR7D/VmzaKWNDVcvM9r3dKLIdfeS0cf7j98Kfy6jia/7k+ypiiKVUVRNCZ5d5JPXPlAURRrrvj4tiSPXlpfUBRF/aWfb0qyJskTE9E4AAAAAAAAk6ssy+zprmTD0stTXc1NDVk1f9bo5Nf+I71pbmpIx5wZ1WpzjIbne6Asy6GiKH48yWeS1Cf5UFmWe4ui+IUk28qy/ESSHy+K4t4kg0lOJ/nBS9tfm+QXiqIYTDKS5P1lWZ6ajC8CAAAAAADAxDraeyEnzw5k/dKxRxquX9qa7Qd7klyc/Fq7uCVFUVSjxXGeN/xKkrIsP5XkU89Y+w9X/PyB59j3V0n+6qU0CAAAAAAAwIs3ODySX/nMwzl9diAN9UX++WtXZ+X8WWOeGRgaycmzF8bt/cZjJ5NcvufraRva2/J3uw7n0aN9eehIb96xpX3yvsALdFXhFwAAAAAAANenBw+czh985YnMb27MybMDaZvRmJ97y9oxz/zon2zLVx45/qz76+uK3LZk7OTXpkth2Bt+/StJLt8DNhUIvwAAAAAAAGrYnkO9SZJPfeA1+acfuj97L93V9bTB4ZF8+4mT+e5bF+RN6xeP27987szMahobKb3ipnn57fdszdkLQ5lWX5e3blwyeV/gBRJ+AQAAAAAA1LC93ZUsam3Kwpbp2djelr/fdyRlWY7e0fXI0b5cGBrJO7a25+1XeXxhXV2Rf7h56WS2/aLVVbsBAAAAAAAAJs/u7ko2LL14TOGG9tacPjeY7p7zl+tdFyfBNnXMrkp/E034BQAAAAAAUKPODQzl8eNnsqH96fDr4p97untHn9nZVUnr9IasnDezKj1ONOEXAAAAAABAjXrocG9Gysuh121LWlNfV2RP9+V7v3Z19WRTx+zRYxCvd8IvAAAAAACAGvX0hNfGS+HX9Gn1WbOwOXsOXQy/+geH8/CRvmzqaKtajxNN+AUAAAAAAFCj9nRXMr+5MYtam0bXNrS3ZU93JWVZZt/h3gyNlDVz31ci/AIAAAAAAKhZu7srWb+0bcyRhhuWtubEmYEc7b2QXZ09SZLNy0x+AQAAAAAAMIX1Dw7n0WNnRo88fNrGS0cc7umuZFdXJQtamrK4dXo1WpwUDdVuAAAAAAAAgOf2sW2d2dl1cULrzeuX5NVr5o+p//n9B/Nv/3p3Rspn37+hvXXM59uWtKauSH70T7YlSV6/duGYybDrnfALAAAAAABgihoaHsnPf3xPihQZHimzu7t3XPj1hf3HMq+5Ke+5a/m4/TMb6/O6Wxc+Y60hv/HurXns2JkkyVs3Lp68L1AFwi8AAAAAAIAp6rHjZ9I/OJJf/4HN2dvdmz/51oEMDo9kWv3lm632HurNXavm5qffcMtVv/d7Ni+djHanBHd+AQAAAAAATFG7uypJko3tbdnY0ZaBoZE8evTMaL1ybjBdp89n/dLW53rFDcfkFwAAAAAAwBS1p7uSmY31WTW/efRerj3dlay7FHbtPXwxHFu/tK1qPU41Jr8AAAAAAACmqN3dlaxf2pr6uiKr5s1Kc1NDdndXRuv7DvUmicmvKwi/AAAAAAAApqCh4ZHsO9ybDe0Xp7rq6oqsW9o6Jvzae6g3i1qbMr+5qVptTjnCLwAAAAAAgCno8eNn0z84ko3tl4803NjelocO92ZoeCRJsvdQxZGHzyD8AgAAAAAAmIKenvB6Zvh1YWgkjx47k/MDw3ns2JlscOThGA3VbgAAAAAAAIDx9nRXMrOxPjctaB5de/oIxN3dlfQPDmekTNaZ/BpD+AUAAAAAADBJPr6jOx/6+lNJkrWLWvJfv2/TuGf6+gczMDQybn1HZ0/WLWlNfV0xunbT/FmZ1VifBw+cTu/5wSTJepNfYwi/AAAAAAAAJsmHv30wnafOZUFzU/58W2f+9ZtuzYKWptH6nu5Kvue/fS0j5bPv/6FXrRzzua6uyIb2tnz0/s4kyeyZ09IxZ8ZktX9dEn4BAAAAAABMgpGRMnu7K/m+2zvylo1L8u4/+Fb2dFfy3WsXjj7ztcdOZKRMPvi229LYUDdmf1EUefP6xePe+0vv3JBvPH4ySbJ2cWuKohj3zI1M+AUAAAAAADAJnjhxNmcHhrOxY3bWL21NUVy8q+vK8GvHwZ6smDczP/qam676vTcvbMnNC1smo+WaUPf8jwAAAAAAAPBC7e7uSZJsbG9Ly/RpWTV/VnZ1VcY8s73zdLYum12N9mqW8AsAAAAAAGAS7OqqZMa0+qxeMCtJsqm9bTQQS5LDlfM52nshW4RfE0r4BQAAAAAAMAl2d1WyfmlrGuovxjEbO2bnaO+FHOvtT5JsP3gxCNu6fE7VeqxFwi8AAAAAAIAJNjxSZu+h3mzsaBtd23Tp593dF48+3NHZk8aGuty2pLUqPdYq4RcAAAAAAMAEe/z4mZwfHM7G9svh17olrSmKy+HX9oOns2FpaxobxDUTyX9NAAAAAACACbar62LAtemKya9ZTQ25eUFzdndVMjg8kt3dlWxZ5sjDidZQ7QYAAAAAAACmokeO9uWDf7sng8MjaW5qyG++e2vmzmoc88wX9x/LwVPnxu397L6jmdVYn1Xzm8esb+xoyxf3H8tvf/7R9A+OZOvy2ZP6HW5Ewi8AAAAAAIBn8cldh3P/U6dy58q5+eqjJ/LVR4/n7VvaR+uV84P54T++P2X57PvvvW1h6uuKMWuvvnl+/vrB7vzWFx5LU0Nd7lo1dzK/wg1J+AUAAAAAAPAsdnX15OYFzfnwj748G/7jZ7KrqzIm/NrZ2ZOyTH7vH9/+rCFW24xp49a+92Udef3aRRkuy0yfVpeZjaKaiea/KAAAAAAAwDOUZZldXZW87taFmVZfl/VLW7Orq2fMMzs6e1IUyd03z0vr9PFB13Npm3n1z/LC1VW7AQAAAAAAgKmmu+d8Tp4dyOZlbUmSTR2zs6e7N0PDI6PP7OjsyeoFzS8o+GLyCb8AAAAAAACeYVdXJcnF0CtJNi9ry/nB4Tx2/EySi5NhOzp7smXZ7Kr1yLMTfgEAAAAAADzDzq6eTKsvctuSliSXQ7BdnRdDsc5T53Pq7IDwawoSfgEAAAAAADzDrs5K1i5uTVNDfZJk1bxZaWlqyM5L935t7zydJMKvKUj4BQAAAAAAcIWRkTJ7uivZ1NE2ulZXV2RjR9vocYg7OnsyfVpd1i5uqVabPAfhFwAAAAAAwBWeOHE2fReGsrlj7FTXpo7Z2X+kNxeGhrOjsycb29vSUC9qmWoaqt0AAAAAAABANXx8R3f+5+4j49aP9fUnSTYtaxuzvrmjLYPDZX70j7dlT3cl//TuldeiTV4g4RcAAAAAAFBzKucG8/pf+1JOnBlIXZH86vdvzju3dox55jc//2hO9F3IkrYZ4/a/fu3CrFk49kjDV66elztWzMmx3gu5ZVFL3rZp6aR+B14c4RcAAAAAAFBzHjx4OifODOQ9dy3P3+89ks89dGxM+NXXP5gnT5zNv7r3lvzk69dc1Ttnz2zMX/6LuyerZSaI8AsAAAAAAKg52zt7UlckH3zbbek9P5idnT1j6nsP9aYsk43tbc/xBq5XbmEDAAAAAABqzo7OntyyqCWzmhqyZdnsdJ0+nxNnLozW93RXkiQbhF81R/gFAAAAAADUlLIss7OzJ1uWzU6SbL70546Dl6e/dndXsrh1eha0NFWlRyaP8AsAAAAAAKgpT508l8r5wdHwa2N7W+rriuzoHBt+mfqqTcIvAAAAAACgpuzoPJ0k2bL8Yvg1o7E+ty5qyc6ui+FXX/9gnjxxNps6hF+1SPgFAAAAAADUlJ2dlcxsrM+ahS2ja5uXzc6Ozp6MjJTZe6g3ZXlxIozaI/wCAAAAAABqyvbOntGjDp+2ddns9PUP5YkTZ7Onu5Ikjj2sUQ3VbgAAAAAAAOCFGhweycNH+jI8Uo5ZHy7LPHSoNz/06pVj1p8+AvF/7j6c7Z09Wdw6PQtamq5Vu1xDwi8AAAAAAOC686GvPZn/8j/3P2f99uVzxnxevaA5bTOm5Vc/+0iS5C0bFk9qf1SP8AsAAAAAAJhyfugP78uXHjmeJHn3ncvyX75305j6AwdOp2POjPzC29eP2zu9oT6vuGnemLX6uiJ/9S9emYOnziVJNnfMnqTOqTbhFwAAAAAAMKWcuTCULz9yPK9aPT99F4by6T1H8p/fuTFFcfkOr72HenP7ijm5Z+2iq37vzQtbcvPClslomSmkrtoNAAAAAAAAXGlXV09GyuRHXrMq775zWU6fG8xTJ8+N1k+dHUh3z/lsaG+tYpdMVcIvAAAAAABgStl+sCdJ8rJlc/KyS3d3PXjg9Gh976FKkmTD0rZr3xxTnvALAAAAAACYUh48cDqrF8xK28xpuXlhc5qbGrK983L4tbv7Yvi1XvjFsxB+AQAAAAAAU0ZZltne2ZOtlya+6uuKbFk2Ow8e6Bl9Zm93b5bNnZG2mdOq1SZTmPALAAAAAACYMg6cPJdTZwdGjztMkq3LZ2f/kd6cGxhKkuw5VHHkIc9J+AUAAAAAAEwZTx9vuHX57NG1ly2fk5Ey2dlZSeX8YA6cPJcN7cIvnl1DtRsAAAAAAAB42oMHetLc1JBbFrWMrm1ZdjEIu/LeL+EXz0X4BQAAAAAAXFMDQyP5H197MmcvDI2rfWH/sWxe1pb6umJ0bc6sxtw0f1Y+vv1Q7n/yVJJk/dLWa9Yv1xfhFwAAAAAAMKHKskzl/GDKMpnZVJ+mhvox9a8/diL/9dP7U1ckRVGMqRVJ/vl33TTunW/ZuDi/9+Un8tjxM3nZ8tmZ39w0mV+B65jwCwAAAAAAmFC/9tlH8ttfeCxJsqClKV//2XvS2FA3Wt/dXUlRJLv+zzeluenqooqfedPa/Myb1k5Kv9SWuud/BAAAAAAA4Op98eFjuXVRS/7Ry5fneN+F7DvcO6a+u7uSVfNnXXXwBS+E8AsAAAAAAJgwZy8M5aHDfXnj+kX5ydevSZJse+rUmGf2dFeysb2tGu1xAxB+AQAAAAAAE2ZHZ0+GR8rcvmJOFrVOT8ecGXnw4OnR+okzF3K40p8NS4VfTA7hFwAAAAAAMGEeOHA6RZFsXT4nSXL7ijnZ9tTplGWZ5OLUV5JsMPnFJBF+AQAAAAAAE2bbgdO5ZWFL2mZMS5LcsWJOjvVdSNfp80kuh1/r21ur1iO1TfgFAAAAAABMiOGRMtsPnM7tK+eMrt2+Ym6SixNhSbKnuzcr581M6/RpVemR2if8AgAAAAAAJsQjR/vSd2Eod6y4HH7durglzU0N2XbgVJJkd3fFkYdMKuEXAAAAAAAwIZ6e7rrj0rRXktTXFdm6fHYeONCT02cH0t1zPhuFX0yihmo3AAAAAAAAXD/Kssy7fu+b2X+kb1ztwtBw5jc3ZdncGWPWX7Z8Tn7z84/m7v/7C0li8otJJfwCAAAAAABGlWWZx4+fyYWhkcyYVp+bFjSPqR+q9GfbgdN57S0LsmZh87j9L181N0VRjFl778uXp39oOEPDZVqmN+SuVXPH7YOJIvwCAAAAAABGfXbf0bzvTx8Y/fwX//yVY8Kq3V2VJMlP3bsmL1s+Z9z+Z7OodXr+7Vtum9hG4Tm48wsAAAAAABj1tcdOZGZjfX73H70sdUXytUePj6nv6a6kvq7IuiWtVeoQvjPhFwAAAAAAMOq+J0/l9hVz8taNS7J+aVvue+rUmPru7krWLGzO9Gn1VeoQvjPhFwAAAAAAkCSpnBvMw0f7cufKi8cc3rlybrYf7MnA0EiSi/eB7emuZEN7WzXbhO9I+AUAAAAAACRJth04lbLMaPh116o5uTA0kt3dF+/5OtLbn5NnB7JR+MUUJvwCAAAAAACSJPc9dSrT6otsXT47SXLHpRDs/ktHH+7uuhiCmfxiKhN+AQAAAAAASZL7nzyVje1to/d5zW9uyk0LZuX+Jy+GX3u6K6krknVLWqvZJnxHwi8AAAAAACD9g8PZ3V3Jnavmjlm/a+XcbDtwOiMjZXZ3V7JmYUtmNNZXqUt4fg3VbgAAAAAAALh2Hj3al68/dmLc+uFKfwaHy9y1cmz4defKufno/Z35zc8/mh2dPbln7aJr1Sq8KMIvAAAAAAC4gfz8x/fkW0+cetZaS1PD6D1fT3vVzfPT1FCX3/z8o0mSu1fPm/Qe4aUQfgEAAAAAQI0YGSnzy595OEd7+1MUyQ/dvSobO9pG68MjZXZ1VfKeu5bn37zp1nH7ZzTWj9739bTFbdOz4z+8Mf2Dw6mrK9I2Y9qkfw94KYRfAAAAAABQI/Yd7s3vffnxLGxpSs+5wYyMlPmNd28drT9+/EzODQznjhVzMmdW41W/d0ZjvXu+uG7UVbsBAAAAAABgYnzriZNJko//+KvyxvWL8q0nTqUsy9H6zs6eJMnmZW3Puh9qgfALAAAAAABqxLeeOJWV82ZmSduMvOKmeTnS258DJ8+N1nd3V9Lc1JCb5jdXsUuYXMIvAAAAAACoAcMjZe578mRecdO8JBn98+lpsCTZ2VXJhvbW1NUVVekRrgXhFwAAAAAA1ICHDvemt39oNPRavWBW5jc3jYZfA0MjeehQbzZ1zK5mmzDphF8AAAAAAFADng65Xn7T3CRJURR5xU1zR+/9evhIXwaGR7Kpw31f1DbhFwAAAAAA1IAr7/t62pX3fu3q7kmSbDb5RY1rqHYDAAAAAADA1bkwNJxtT53O0Eg5rnbfkyfz1o1Lxqw9fQTin913MI8fP5M5M6elY86McXuhlgi/AAAAAADgOvGn3zyQX/zkQ89Zf82aBWM+r14wK+2zZ+T3v/JEkuQN6xalKIpJ7RGqTfgFAAAAAADXiQcPnk777Bn5rfdsHVdraqjLuiWtY9aKoshf/8u703X6fJJkzaLma9InVJPwCwAAAAAApogPfHR7PrP3SJLkH25aml951+Yx9d3dlWxZPju3r5hz1e9c1Do9i1qnT2ifMJXVVbsBAAAAAAAgOXthKJ/cdTibOmZnw9K2fGLnofQPDo/WT58dSOep89nU3lbFLmHqE34BAAAAAMAUcN9TpzI0UuYn7rk57/+u1bkwNJIHD54ere/uriRJNnYIv+A7EX4BAAAAAMAU8I3HTqSxvi53rJibl980N/V1Rb7x2MnR+tPh1waTX/AdCb8AAAAAAGAK+PpjJ/OyFbMzo7E+LdOnZVNHW77++InR+q6unqyaPyut06dVsUuY+oRfAAAAAABQZafODmTf4d68avX80bVXrZ6fXV2V9PUPJkl2d1Wy0dQXPC/hFwAAAAAAVNk3H794vOHdN18Ov+6+eV6GR8p8+4lTOd53IYcq/dnkvi94Xg3VbgAAAAAAAG50X3/8RJqbGrL5inDrZcvnpKmhLl9//ETq64okMfkFV0H4BQAAAAAA18Cx3v687be/lt7zg+NqA8MjuefWhWmov3xg2/Rp9blz5dz80Teeyp9+80CKIlkv/ILnJfwCAAAAAIBr4JtPnMzxvgt5z13L0zpj7K/nixR5+5al4/b83FvW5v/fdShJsmZhS5qb/Fofno//SwAAAAAAYAIc7e3PZ/cdTZmkffb03LN20Zj6rq5Kmhrq8gtvX59pV0x4fScb2tuywbQXvCDCLwAAAAAAmAC/8pmH85cPdI1+/vrP3ZP22TNGP+/uqmT90tarDr6AF8f/YQAAAAAA8BKVZZmvPHI8b16/OH/5/lcmSb76yPHR+vBImT2HKtnUMbtaLcINQ/gFAAAAAAAv0f4jfTnWdyH33LYwt6+Yk8Wt0/OVRy+HX48dO5NzA8PZvMwRhjDZhF8AAAAAAPASffVS0PWaNfNTFEVes2Z+vvboiQyPlEmSnV09SZKN7Sa/YLIJvwAAAAAA4CX6yiMncsui5ixpu3jH12tvWZDe/qHR0GtXV09amhpy0/xZ1WwTbgjCLwAAAAAAeAnODwznvqdO5TVrFoyuvfrm+SmK5CuX7v3a1VXJhva21NUV1WoTbhjCLwAAAAAAeAm+/eTJDAyN5LW3XA6/5sxqzKb2tnz10RO5MDSchw73ZpP7vuCaaKh2AwAAAAAAcD34mY/tHD3G8Eqnzg6msaEud62cO2b9NWsW5He/9Fje/BtfzeBwmc0d7vuCa0H4BQAAAAAAz6O3fzAfe6Ar65a0ZsW8mWNqqxckd66cmxmN9WPWf+DOZTl46lwGh0fysuVz8po1869ly3DDEn4BAAAAAMDz2NvdmyT5N2++Na+7deFV7Vk2d2Z+6z1bJ7Mt4FkIvwAAAAAAuOENDY/ks/uOpn9oOE0N9XnjukVpqK8bre/priRJNrS7twumOuEXAAAAAAA3vE/uPpwPfHTH6Odf+/7N+d6XdYx+3nOokiVt0zO/uaka7QEvQN3zPwIAAAAAALXt8w8dy/zmxnzxX78uC1qa8vn9x8bUd3dXTH3BdUL4BQAAAADADW1oeCRfevhYXnfrwqyaPyvffeuCfOWR4xkcHkmSnLkwlCdPnM2GpcIvuB4IvwAAAAAAuKE9eLAnvf1Def3ahUmSe9YuSl//ULY9dTpJsu9Qb8oy2djRWs02gask/AIAAAAA4Ib2+f1HM62+yKvXzE+SvHrN/EyrL/LFhy8efbi7u5Ikjj2E64TwCwAAAG7Sob8AACAASURBVACAG9oX9x/LnSvnpmX6tCRJc1NDXr5qXr5w6d6vvd2VLGxpysKW6dVsE7hKDdVuAAAAAAAAJltv/2AeOtQ7br1yfjCPHD2T779j2Zj17167MP/p7/bl03uO5MGDp7PR1BdcN4RfAAAAAADUvA/+zZ58YuehZ60VRfL62xaNWbv3toX5xU/uy/v/vweSJN93e8ek9whMDOEXAAAAAAA1b3vn6bz65vn5l69bPa42e2ZjVs2fNWZtxbxZ+dRPvianzw6krq7IlmWzr1WrwEsk/AIAAAAAoKZVzg2m89T5vPeuFbn75vlXve+2Ja2T2BUwWYRfAAAAAABc906cuZDTZwdSFMnKebPSUF83Wtt7uJIk2dAuzIIbgfALAAAAAIDrWuX8YF77y1/MuYHhJMn7XntT/t1bbxut7+3uTZKsX9pWlf6Aa6vu+R8BAAAAAICp60sPH8u5geH8+7feljtXzskndx1OWZaj9T2HKlnaNj1zZzVWsUvgWrmq8KsoijcXRfFwURSPFUXxc89Sf39RFLuLothRFMXXiqJYd0Xt317a93BRFG+ayOYBAAAAAODv9x7Ngpam/MirV+VddyxLd8/57D3UO1rf013JOlNfcMN43vCrKIr6JL+T5C1J1iV5z5Xh1iUfKctyY1mWW5L8cpJfu7R3XZJ3J1mf5M1JfvfS+wAAAAAA4CXrHxzOlx4+lntvW5S6uiKvX7swdUXy9/uOJknODQzliRNn3fcFN5Crmfy6K8ljZVk+UZblQJKPJnn7lQ+UZdl7xcdZSZ6eJ317ko+WZXmhLMsnkzx26X0AAAAAAPCSffPxkzk7MJw3rl+UJJnX3JQ7Vs7N3+89kiR56HBvyjLZYPILbhhXE361J+m84nPXpbUxiqL4saIoHs/Fya+ffCF7AQAAAADgxfj7fUcyq7E+d6+eN7r2xnWLsv9IXw6ePJc93RdnN9ab/IIbRsNEvagsy99J8jtFUbw3yQeT/ODV7i2K4n1J3pcky5cvn6iWAAAAAACoAZVzg/nYA50ZGinH1T6z92het3Zhmhou37jzxnWL84uffCj/9dP7c6S3P/NmNWZx6/Rr2TJQRVcTfnUnWXbF545La8/lo0n+nxeytyzLP0jyB0lyxx13jP/XCwAAAACAG9afbzuY//yp/c9aK4rknVvGHji2fN7M3LVybj65+3CS5B1blqYoiknvE5garib8uj/JmqIoVuVicPXuJO+98oGiKNaUZfnopY9vS/L0z59I8pGiKH4tydIka5LcNxGNAwAAAABwY9jd3Zv22TPyuZ/+rnG1urqMmfp62kff94pcGBpJkkyfdjU3AAG14nnDr7Ish4qi+PEkn0lSn+RDZVnuLYriF5JsK8vyE0l+vCiKe5MMJjmdS0ceXnruL5LsSzKU5MfKshyepO8CAAAAAEAN2ttdyYb21sxoHB9yPZe6uuIFPQ/Ujqu686ssy08l+dQz1v7DFT9/4Dvs/aUkv/RiGwQAAAAAoLYNj5TpPT+YJGmZ3pCG+suTWn39g3nixNm8c2v7c20HGOOqwi8AAAAAAJgsP/LH9+dLDx9Pkty5ck4+9v67R2v7DvUmSTa0t1WlN+D6I/wCAAAAAKBqjvX258uPHM9bNixOY0NdPr7jUA6cPJsV82YlSfZcCr/Wt7dWs03gOuKWPwAAAAAAqubTe4+kLJOffsMt+Zk33Zok+eTuw6P1vd2VLGxpysKW6dVqEbjOCL8AAAAAAKiaT+46nDULm7NmUUs65szM5mWz86krwq89hyrZ6MhD4AUQfgEAAAAAUBXH+vpz31On8taNS0bX3rZxcfZ09+bgyXM5PzCcx46dyXrhF/ACCL8AAAAAAKiKz+y5eOTh2zZdDr/esuHiz5/cfTgPHenNSJlsWOq+L+DqNVS7AQAAAAAAatf5geH8xJ89mFNnB8bVDpw8l5sXNueWRS2ja8vmzszmjrb8/lcez19s60ySbDD5BbwAwi8AAAAAACbNgwdP53MPHcuWZbPTMn3sr6TXLW3Ne+5aPm7PB+5dkz/8+lNJklffPD9L2qZfi1aBGiH8AgAAAABg0uzqqiRJ/uiH7szsmY1XteeetYtyz9pFk9kWUMPc+QUAAAAAwKTZ013Jsrkzrjr4AnipTH4BAAAAAPCiDQyN5JGjfRkpy8yZ2Zhlc2eOqe/q7smm9tlV6g64EQm/AAAAAAB40X7jc4/kd7/0eJKkoa7Il//Nd6d99owkSc+5gXSeOp/33rWimi0CNxjHHgIAAAAA8KIMj5T56we78/JVc/Ob796SoZEyH9/RPVrf3X3xvq+N7W3VahG4AQm/AAAAAAB4Ub79xMkc6e3P//7KFXn7lvbcsWJO/ubB7pRlmUT4BVSH8AsAAAAAgBflb7Z3p7mpIffetihJ8vat7Xn02JnsO9ybJNndVcnyuTPTNnNaNdsEbjDCLwAAAAAAXrD+weF8es+RvHnD4kyfVp8k+Qcbl6ShrsjHdxxKcnHyy9QXcK01VLsBAAAAAACmrj3dlTx6rG/c+sNHzqTvwlDesaV9dG3OrMa87tYF+dvt3Vm9YFa6Tp/PP37FimvZLoDwCwAAAACAZ1eWZf7pH96fE2cuPGu9Y86MvHL1vDFr77pjWT730LH87F/tTpLctWrupPcJcCXhFwAAAAAAz6rr9PmcOHMhP/OmW/O2jUvG1ec1N6a+rhiz9sZ1i/KNn7snA0MjmdFYn0Wt069VuwBJhF8AAAAAADyHnV09SZLXrlmQlfNnXdWeoiiydPaMyWwL4Duqq3YDAAAAAABMTbu6Kmmsr8uti1uq3QrAVTP5BQAAAABwgzrW25//42M7c35gONPq6/KL79yQ1QuaR+s7O3uybmlrGhvMUQDXD/9iAQAAAADcoD787YP52mMn0thQlwcOns6HvvbkaG14pMye7ko2d7RVsUOAF074BQAAAABwAxoZKfOXD3Tl1TfPz0f+2Svyto1L8omdh9I/OJwkefz4mZwdGM6mjtlV7hTghRF+AQAAAADcgL75xMl095zPu+5YliR51x0d6esfymf2Hkly8cjDJNm8zOQXcH0RfgEAAAAA3ID+YltnWqc35I3rFiVJXrFqXjrmzMhfbOtMkuzqqqS5qSE3zW/+Tq8BmHIaqt0AAAAAAACTo3J+cHSC60pDIyP59J4j+f47lmX6tPokSV1dkXfdviy//rlH8qndh3Pfk6eyob01dXXFtW4b4CURfgEAAAAA1Kj/9Hf78pcPdD1n/QfuXDbm8/92e3t++wuP5l9++MEkyU/cc/Ok9gcwGYRfAAAAAAA16sGDp/PKm+blX7/plnG11unTsmZRy5i1jjkz89mf/q6cOnshRVFk/dLWa9UqwIQRfgEAAAAA1KC+/sE8cfxsvndre25fMfeq962aPyur5s+axM4AJlddtRsAAAAAAGDi7enuTZJsaG+rcicA15bJLwAAAACA69TpswM5fW4gSbJs7sxMq78877C7uydJslH4BdxghF8AAAAAANeh3v7BvPZXvpi+/qEkyXvuWpb/8r2bRuu7uippnz0j85qbqtUiQFU49hAAAAAA4Dr0t9u709c/lA++7bbce9ui/M327lTOD47Wd3dXsqnD1Bdw4xF+AQAAAABcZ8qyzEe+fTDrl7bmR169Kj9175r0D47kbx7sSpJUzg3mwMlz2Sj8Am5Awi8AAAAAgOvMgwd7sv9IX/7Ry1ekKIpsaG/L5o62fOS+gynLMru7K0mSTe2zq9wpwLUn/AIAAAAAuM585NsHM6uxPt+zZeno2ntfvjyPHD2TbQdOj4ZfG9tNfgE3noZqNwAAAAAAwHjbnjqVH/6j+zM4XI6rnR8czntfvjzNTZd/xfsPNy/NL/7dQ3nvf/9WRspk+dyZaZs57Vq2DDAlCL8AAAAAAKagz+8/lnMDw/nhV68aV6uvK/KDr1w5Zm1mY0N+/Qe25L6nTiVJ7l4971q0CTDlCL8AAAAAAKagXV09WbukJf/urbdd9Z571y3KvesWTWJXAFOfO78AAAAAAKaYkZEyu7oq2dQxu9qtAFx3hF8AAAAAAFPMUyfPpq9/KFuEXwAvmGMPAQAAAACq4L994dF8YuehJMmdK+fml965cbS2s6snSbJpWVtVegO4npn8AgAAAAC4xk6dHchvfeGx1BVFZjU15MPfPpj9R3pH6zs7K5kxrT43L2iuYpcA1yfhFwAAAADANfbR+w9mYGgkv/WerfnQD96Zpoa6/PE3DozWd3X1ZEN7axrq/QoX4IXyLycAAAAAwDU0NDySD3/rYO5ePS+3LGrJnFmNeceW9vzt9u5Uzg1mcHgkew/1ZpP7vgBeFOEXAAAAAMA19LmHjqW753z+yStXjq79k7tX5PzgcD72QGceOdqXC0Mj2bxM+AXwYjRUuwEAAAAAgFpzbmAoP/D738rxvgvjar39g2mfPSP33rZwdG390rbcuXJOfvkzD2dmY32SZHNH2zXrF6CWCL8AAAAAACbYjoM92d1dyb23Lcy8WU3j6m/dtGTcfV4//w/W5SPfPpiyTNrnzMjyuTOvVbsANUX4BQAAAAAwwR48eDpJ8qvv2pK2mdOuas+mjtnu+QKYAO78AgAAAACYYNsP9mT1gllXHXwBMHGEXwAAAAAAL8Lg8EgGhkYyPFKOWS/LMts7e/Ky5XOq1BnAjc2xhwAAAAAAL9CHv30g//5v9iRJWqY35DM/9dosnT0jSXLw1LmcOjuQrcIvgKow+QUAAAAA8AIMDY/kd7/4eNYubsm/uveWnBsYzh9/46nR+vaDPUmSrcvd3wVQDcIvAAAAAIAX4NN7j6S753x++g235AP3rsmbNyzOR+47mDMXhpIk2w+ezszG+tyyqKXKnQLcmIRfAAAAAABXqSzL/PevPpmV82bm9bctSpL86KtXpa9/KB/b1pkk2d7Zk80ds1NfV1SzVYAblju/AAAAAACe4bFjZ/Lwkb5x60d6+7Ozsye/8Pb1o+HW1uVzcvuKOfkfX3sy85ubsu9Qb9732puudcsAXCL8AgAAAAB4hh/+o/tz8NS5Z63Nm9WY77u9Y8za+79rdf7Zn2zLT/zZ9iTJK26aN+k9AvDshF8AAAAAAFc43nchB0+dy7943eq8c2v7uPr85qbMbBz7q9U3rFuUL//M63JhaCRNDXVZPnfmtWoXgGcQfgEAAAAAXGFXV0+S5LtvXZhbFrVc9b4V82ZNVksAvAB11W4AAAAAAGAq2dlVSV2RbGhvrXYrALwIwi8AAAAAgCvs7OzJLYtaxh1tCMD1wb/eAAAAAMAN5Vhffz7wZztybmAo9XVF/q/v2ZCNHW1JkrIss6urJ29ct7jKXQLwYpn8AgAAAABuKP/vV5/Mt588mdkzG/PosTP51c8+PFrrPHU+p88NZtOytip2CMBLIfwCAAAAAG4Ylf/F3n2H91ne9+J/P1/Jkjwky3vvgQHbYDPDhizI3ulIe9KEpqVN09O0TXM6knOSczrSlTTt6a9pTzN6epK0JYPsUQiQsAzGDAPGxnvhIcvbsiU9vz+gLkYYBLb01Xi9rssX/t6f5+F6+y9beuu+70PH8s93bcjrz5mcz7/nwvzylXPyo1U7s3Lr3iTJis2tSZJzpjZXMyYAp0D5BQAAAAAMGl+4c30OHu3IDVfNSZK86+IZGVFfm//v1rVJkgc3taa+tpIzJjZWMSUAp8KdXwAAAADAgNJy8GjufGJ3ypQnrJdl8tk71ueaBeOzYGJTkmTk0CH52Yun5+9vW5vL543Nj9fsytmTmzKkxr4BgP5K+QUAAAAADCif+O5j+dKyTSed/+rVc074/N7LZuULd2zIh/7twSQ5visMgP5J+QUAAAAADCgrNrXm4tmj8/E3LuwyG1ZfmynNQ09YG9/YkNs+dHVaDx1NUSQzxwzvragA9ADlFwAAAAAwYBw+2pHHn9yf9189N/MmdP/ernGN9RnXWN+DyQDoLQ6uBQAAAAAGjJVb96azTBZNba52FACqRPkFAAAAAAwYD27emyRZPHVklZMAUC2OPQQAAAAA+pWVW/dmU8vhJMl5M0adcFzhQ1v2ZkJTfSY0NVQrHgBVpvwCAAAAAPqNJ/cdyZv/9x052t6ZJLlg5qj8yy+9LEVRJEke3NyaRVMceQgwmDn2EAAAAADoN/72R0+ks7PM/7v+onzwlfOzbP2e3PnE7iTJ/iPHsnbXQUceAgxyyi8AAAAAoF/Yse9IvnjPxrxl6ZRcMnds3nfF7IxvrM+n/n11kmTl1n0py2SR8gtgUHPsIQAAAADQp+w/cizHOsou6//7R0+kvbPMr149N0nSMKQmv3zlnHzsm4/klsd25KEte5Mki6YovwAGM+UXAAAAANBn3LV2d37qM3eddP7WpVMzY8zw459/5qLp+d8/eiK/8LllSZIpzUMzdkR9j+cEoO9SfgEAAAAAfcZP1uxKTaXIH7z2zBRFccKsUiny2kWTTlhrGFKTz/3CBblvw54kcd8XAMovAAAAAKDvWLGpNfMnNObdl87q9jsLp4zMQkcdAvC0SrUDAAAAAAAkSVmWeXDz3pw7TZEFwEun/AIAAAAA+oQNuw9l7+FjWTy1udpRAOjHHHsIAAAAAPSag23tWbfrYJJk4siGjB1Rf3z2wObWJMk5yi8AToHyCwAAAADoFWVZ5r2fX5a71rYkScaOqM+tv31Vhtc/9W3KBzbtTcOQSuZPGFHNmAD0c449BAAAAAB6xR1P7M5da1vyi5fPyv9688LsOtCWz9+5/vj8gc2tWTh5ZGprfNsSgJfO3yIAAAAAQI8ryzJ//v1VmTSyIb/5qjPysxfNyDULxuczt63N/iPHcqyjMyu37s050xx5CMCpUX4BAAAAAKfNkWMdaTl4tMuv763cnuUbW/P+a+amYUhNkuQ3XjE/rYeO5TO3rc3yDXty5FhnFk8dWeU/AQD9nTu/AAAAAIDT4kBbey75o3/PviPtzzmf0jw0bz9v2vHPi6aOzKvOmpBP37wmn755TZJkybRRvZIVgIFL+QUAAAAAnBYrNrZm35H2vPeyWZk+eliX+UWzR6eu9sTDqP7nmxfm8nlj01km4xvrM31M1/cA4MVQfgEAAAAAp8X9G/ckST7w8nkZOXRIt94Z39iQn3vZzB5MBcBg484vAAAAAOC0WL5xT+aNH9Ht4gsAeoLyCwAAAAA4ZWVZ5v5NrVkyvbnaUQAY5Bx7CAAAAAB0y4G29nzt/i052t6ZCU0NuW7hxFQqRZJk/e5DaT10LEunj6pySgAGO+UXAAAAANAtf/C1h/PV+7cc//wX7zgnb1k6NUmyfMNT930tUX4BUGWOPQQAAAAAXtDDW/bmq/dvyfuumJ0VH3llFk8dmT///uM5cqwjSXL/pj1prK/NvPEjqpwUgMFO+QUAAAAAvKA/+e5jaR42JL969dw0D6vLh69bkC2th/OFO9cnSZZvaM2505uPH4MIANXi2EMAAAAAIEnyrQe35SdP7OqyfqitPbev3pU/eN1ZGTl0SJLkkjljc/UZ4/Lpm9dk3a5DWfXk/vzqmXN6OzIAdKH8AgAAAABSlmU+etPDOdjWkeH1Xb9tePm8sXnXxdNPWPu9156ZG/7v8vzgkSczsakhrzxrYm/FBYCTUn4BAAAAAFm362B2HTiaP3zzovzMRdNf+IUkc8c35gcfvLKHkwHAi+POLwAAAAAgy9a3JEkunDWqykkA4NQovwAAAACA3L2uJaOH12XOuBHVjgIAp8SxhwAAAAAwCHR0lvnq/Vuyc39b6moredt5UzNy6JDj82XrW3LBzFEpiqKKKQHg1Cm/AAAAAGAQ+Oe7N+QjX195/PPyDXvyNz+7NEmybe/hbGo5nHdfMqta8QDgtHHsIQAAAAAMcHsOHs2ff//xvGz2mDz6sWvz6y+fl289tC13PLErSXLPuqfv+5o5upoxAeC0UH4BAAAAwAD3Fz94PAfa2vPRN5yVoXU1ueGqOZnSPDQf+8Yjae/ozLL1LRlRX5szJzVWOyoAnDLHHgIAAADAAPCNB7bmT777WMqy62zr3sP5+YtnZMHEpiRJw5Ca/P5rz8wN/7w8l/zxzWk9fCwXzx6T2ho/Kw9A/6f8AgAAAIAB4MvLNqWtvTNXzBvXZTZq2JB84BXzTli7duHE/O5rFmTV9gNJkndeMK1XcgJAT1N+AQAAAEA/d+RYR5atb8nPXjQjH3n9Wd16pyiKvO+KOT2cDAB6n33MAAAAANDPLd+4J23tnblkzphqRwGAqrPzCwAAAAD6gc17DmX1jqeOKDxvxqg0NQw5Prvzid2pqRS5aPboasUDgD5D+QUAAAAAfdzW1sN59V/eloNHO5IkCyY25pu/dllqa5462Okna3Zl8dSRaXxGIQYAg5VjDwEAAACgj/v4Nx9JR1nmC++5MB9/49l5bPv+fO6O9UmS/UeO5YHNe3PpnLHVDQkAfYSdXwAAAADQh/1o1Y585+Ht+e1Xn5Er5o9LWY7NzY/tyF/+4PG8bvHkrNy6Nx2dpfu+AOBpyi8AAAAAqLINuw/ml/7pvrS1d3aZ7dzfltnjhuf6y2clSYqiyH9/w9l55V/eltf+1e0pk9TXVrJ0xqheTg0AfZPyCwAAAACq7KYVW7Pqyf153eLJKZ41q60U+cUrZqe+tub42owxw/Ppn16Sbz24LUly/sxRaRhSEwBA+QUAAAAAVXfzqh1ZPLU5n/7pJd1+59VnT8yrz57Yg6kAoH+qVDsAAAAAAAxmLQePZsWm1lx9xrhqRwGAAcHOLwAAAADoYZ+57Yl8/o4NSZKzJjflb35maepqn/q59Nse35myTK4+Y3w1IwLAgGHnFwAAAAD0oBWbWvPH33ksE0c25NzpzfnBI0/m72594vj8llU7MmZ4XRZNGVnFlAAwcNj5BQAAAAA95Gh7Zz5844MZ39iQz/7CBWlqGJIiy/Ppm9fkukUTM2vsiNz6+M5cs2B8KpWi2nEBYEBQfgEAAADAKSjLMp++eU02tRzqMtu+70ge274/f//z56epYUiS5KOvPzu3r96VX/qn+zJ/QmNaDx1z5CEAnEbKLwAAAAA4BU/sPJC/+MHjGT28Lg21XW8Zuf6yWXnlWROOfx7XWJ8/eevi/OG3H80Dm1pz9uSmXHnGuN6MDAADmvILAAAAAE7BLY/tTJJ849cuy5Tmod1659qFE3Ptwok9GQsABq2uP4oCAAAAAHTbjx7fkTMmNHa7+AIAepadXwAAAADwPA60tefrK7ak7VhnRg0fktcvnpzamsrx2T3rWvKeS2dVOSUA8B+UXwAAAABwEmVZ5rf+5YF8d+X242ubWw7n114+L0nykzW7cqyjzFVnjK9WRADgWRx7CAAAAAAn8fUVW/PdldvzW6+anwc+8qq8bvGkfOrfV2fl1r1Jkh+t2pER9bU5f+aoKicFAP6DnV8AAAAADGprdx7IA5tbu6y3d5T5+DcfyXkzRuWGq+amplLk429cmLvXteSDX34gv3zV7Nz82I5cNndshtT4GXMA6CuUXwAAAAAMar/yz8vz2Pb9zzlrbKjNn739nNRUiiTJqOF1+cRbF+cXv3BvfuPLDyRJrl04sdeyAgAvTPkFAAAAwKC1tfVwHtu+P792zdy8denULvPRI+rS1DDkhLWrF4zPXb/78hw40p7amiJTmof2VlwAoBu6VX4VRXFtkk8lqUnyD2VZ/vGz5h9Mcn2S9iQ7k7ynLMsNT886kjz09KMby7J8w2nKDgAAAACn5EerdiZJ3nDO5MwcO7zb740dUZ+xI+p7KhYAcApesPwqiqImyd8keWWSzUmWFUVxU1mWjzzjsfuTnF+W5aGiKG5I8okk73x6drgsy3NPc24AAAAAOGW3rNqRKc1DM3f8iGpHAQBOk+7s/LowyZqyLNcmSVEUX0ryxiTHy6+yLG95xvN3JXnX6QwJAAAAAC/Ful0H857PLcuOfUdSW1PJ773mzLzjgmlJkrb2jtyxZlfevHRKiqKoclIA4HSpdOOZKUk2PePz5qfXTua9Sb7zjM8NRVHcWxTFXUVRvOm5XiiK4n1PP3Pvzp07uxEJAAAAAJ7f0fbOfOCL96fl4NH89IXTM2vs8Pz+1x/OI1v3JUnuXb8nB4925Kr546ucFAA4nbp151d3FUXxriTnJ7nyGcszyrLcUhTF7CQ3F0XxUFmWTzzzvbIsP5PkM0ly/vnnl6czEwAAAAADW+uho+l8ju8o/fXNa/LQlr35zM+dl1edPTG7D7Tluk/dnl/74vL88/UX5/srt6euppJL5o7p/dAAQI/pTvm1Jcm0Z3ye+vTaCYqieEWS30tyZVmWbf+xXpbllqf/u7Yoih8lWZLkiWe/DwAAAAAv1md/si7/4xuPnHT+8y+bkVedPTFJMmZEff7ynefmXf/n7lz8R/+eJLl83tgMqzutPx8OAFRZd/5mX5ZkXlEUs/JU6fVTSX7mmQ8URbEkyd8lubYsyx3PWB+V5FBZlm1FUYxNcmmST5yu8AAAAAAMbt95eHtmjhmWX7h0VpfZiPravO6cSSesXTp3bP7f9Rfn8Sf3J0munD+uV3ICAL3nBcuvsizbi6J4f5LvJalJ8o9lWa4siuJjSe4ty/KmJH+aZESSf336ctCNZVm+IcmZSf6uKIrOPHW/2B+XZXnyH8UBAAAAgG462Nae+zfuyXsum5X/csnMbr/3sjlj8rI5jjoEgIGqW3u6y7L8dpJvP2vtI8/4/StO8t4dSRadSkAAAAAAeC53r9udYx1lLp9r9xYA8J8q1Q4AAAAAAC/F7at3pb62kvNnjqp2FACgD3GbJwAAAAB90sG29vzc/7k7929qTZK8ZuGk/NVPL0lNpUiS/Hj1rlw4a3QahtRUMyYA0MfY+QUAAABAn1OWZT5044NZsak11182K+84b1q+9dC2fOqHjydJtu09nNU7DuTyeWOrESSsEgAAIABJREFUnBQA6Gvs/AIAAACgKsqyzK2P78zhox1dZis2teZbD27Lh649I79y1dyUZZnOssxf3bwmTUOH5Ml9R5Ikl7nvCwB4FuUXAAAAAFVx2+pdefdnl510fu3ZE3PDlXOSJEVR5ONvWphVT+7P//zWo0mSySMbsmBiY69kBQD6D+UXAAAAAFVx66qdqaut5Cs3XJLamuKEWaUoMnfciBTFf643DKnJv/3yJVm760CSZEJjQyqVE98DAFB+AQAAAFAVP1mzKxfOHJ2FU0Z2+5262koWTGzqwVQAQH9XqXYAAAAAAAafHfuOZNWT+3PZvLHVjgIADDB2fgEAAADQY451dCZJaorihCMKf/LEriTJZXOVXwDA6aX8AgAAAOC0K8syH77xoXz53k1Jkmmjh+ZL73tZpjQPTZLcvnpXRg+vy1mTHGEIAJxejj0EAAAA4LT765vX5Mv3bspbl07Nb7xifloPHsv1n783B9vaU5Zlfrx6Vy6ZM+aE3WAAAKeDnV8AAAAAvCQ33rc5a3cd6LK+/0h7vnDnhrxlyZT82dsXpyiKnDNtZN7zuWV5z+eW5cxJTdmxvy2Xu+8LAOgByi8AAAAAXrRdB9rym//6QCpFUim67t66cv64/NFbF6V4enbVGePzsTcuzP/61qO5b8OejBlel6vOGN/bsQGAQUD5BQAAAMCLdscTu5MkX/2VS3POtOZuvfOui2fkXRfP6MlYAADu/AIAAADgxfvJ6l1paqjNwikjqx0FAOAEyi8AAAAAXpSyLPPjNbtyyZyxqal0PfIQAKCalF8AAAAAvCjrdx/KltbDuXTe2GpHAQDowp1fAAAAAHTx1fs35w++tjJt7R0ZUV+bT/7Uklw5f1yS5MdrdiVJLpur/AIA+h47vwAAAAA4wS2P7chv/euDmT9hRH7x8tkZ39iQG/7vfXlgU2uSp+77mtI8NDPHDKtyUgCAruz8AgAAABiEvv3Qtnz7oW1d1sskNz+6I2dOaswX3ntRRtTX5t2XzMxb/vaOvPuz9+TSuWNz2+qdef3iySkK930BAH2P8gsAAABgEPqz763KzgNtGddY32W2dEZzPvnOJRlR/9S3jsY3NeQL77kwv/1vD+aRbfsyddTQvPW8qb0dGQCgW5RfAAAAAIPMjn1HsnbXwfzuaxbkfVfM6dY7s8eNyI03XNLDyQAATp07vwAAAAAGmbvWtSRJLpo1pspJAABOP+UXAAAAwCBz99rdGVFfm7MnN1U7CgDAaaf8AgAAABhk7l7XkvNnjkptjW8NAQADjzu/AAAAAAagu9fuzs4Dbakpilw6b2yaGoYkSXbub8uaHQfytvOmVjkhAEDPUH4BAAAADDCf/vfV+fMfPH7884KJjfniL16cUcPrcs/x+75GVyseAECPUn4BAAAA9DPtHZ15dNv+dJRll9mPVu3IJ3+4Om9ZMiU3XDUnq3ccyH/98or87D/cnY+/6ex8b+X2DK+rycIpI6uQHACg5ym/AAAAAPqZz/5kff7Xtx896fyN507On779nNRUisyb0JhhdTV53xfuy1v/9s4kyTULxmeI+74AgAFK+QUAAADQz9y+ZldmjR2ej7zurC6zhiE1uXDW6NRUiuNrV50xPt/7jSuyftfBJMmiqXZ9AQADl/ILAAAAoB9p7+jMfetb8palU3P1gvHdfm/W2OGZNXZ4DyYDAOgb7G8HAAAA6Ece3rovB4925KLZo6sdBQCgT1J+AQAAAPQjd6/dnSS5cJbyCwDguSi/AAAAAPqRu9e1ZPbY4Rnf2FDtKAAAfZI7vwAAAAD6kLIs8093bcgDm/YmSS6ePTpvP39akqSjs8yy9S153eJJ1YwIANCnKb8AAAAA+ojOzjIfvWll/umuDZnQVJ/OMrlx+eZs2H0ov/mq+Xl0277sP9Kei2aNqXZUAIA+S/kFAAAA0IsOtrXnozetzIEj7V1mO/YfyfKNrfmlK2bnw9ctSGeZ/P7XHspf37Imy9a35PCxjiTJRbPd9wUAcDLKLwAAAIBedOvjO/Nv923O7LHDM6TmxOvYiyL5/deemesvn50kqSmSP3zzokxsGppvP7QtSfLmJVMyaeTQXs8NANBfKL8AAAAAetE961oydEhNvvtfr0hdbeUFny+KIr/+inn59VfM64V0AAD93wv/CwsAAACA0+aedS1ZOqO5W8UXAAAvnn9lAQAAAPSSvYeP5dHt+3LhzDHVjgIAMGApvwAAAAB6yX0bWlKWyQWzRlU7CgDAgKX8AgAAAOgld69ryZCaIkumKb8AAHpKbbUDAAAAAAwUZVnmkz9cnRuXb05ZJpObG/Lnbz8308cMS5IsW9eSxVObM7SupspJAQAGLju/AAAAAF6EsizT2dn1V1t7R37zXx7Ip/59dWaNHZ6LZo/O6h0H8pa/vSMPbd6bg23teXDz3lw4a3S1/wgAAAOanV8AAAAA3VSWZV7zVz/Oo9v2nfSZ33zl/Lz/mrkpiiJrduzPf/nHZXn9X//4+PzCmcovAICepPwCAAAA6KZ1uw7m0W378tpFkzJ/QmOX+aKpTblmwYTjn+eOb8xXf+WS/NvyzTnWXmZEQ20unze2NyMDAAw6yi8AAACAblq2viVJ8sFXzc+ccSO69c74pob8ylVzezIWAADP4M4vAAAAgG66e11Lxo6oy+yxw6sdBQCAk1B+AQAAAHTTPetacuGs0SmKotpRAAA4CeUXAAAAQDdsaT2czXsO58KZo6sdBQCA5+HOLwAAAIBnOHS0Pcc6ytTVVDK0rub4+rJ1T933dcEs5RcAQF+m/AIAAABI0tlZ5s9/sCp/+6Mn0lkmlSL5wMvn5QPXzEulUuTudS1pbKjNgolN1Y4KAMDzUH4BAAAAg8aW1sPHd3A92zcf3JofProjbzx3chZPbc7yjXvyyR+uzmPb9ufahRNz++qduWDm6NRU3PcFANCXKb8AAACAQeO/feWh3Pb4zuec1VSK/I83nJ2ff9mMFEWR95Qzs2Rac/7w24/muyu3J0muv2xWb8YFAOAlUH4BAAAAg0J7R2fuXd+Sty6dmvdfM7fLvKmhNmNG1B//XBRFrr98dt60ZEr2H2lPTVFk2uihvRkZAICXQPkFAAAADAort+7LoaMdueqMcZk1dni33xs7oj5jn1GKAQDQt1WqHQAAAACgNyxb/9RdXxfOGl3lJAAA9CTlFwAAADAoLFvfkumjh2VCU0O1owAA0IOUXwAAAMCAV5Zl7l2/JxfMtOsLAGCgc+cXAAAAMGAc6+jMsY7OFCkytK7m+PoTOw9m98GjuXDWqCqmAwCgNyi/AAAAgH6vLMt8ZfmW/PdvrMz+I+1JkqvPGJc/edvijG9sOH7fl51fAAADn/ILAAAA6Be2th7OZ3+yLu2dZZfZ+l0Hc8uqnblw5ui8/MzxaT18LP/443W57pO35/XnTM4961oydkRdZo0dXoXkAAD0JuUXAAAA0C988Z6N+fvb16Wxoeu3M+pqKvntV5+RX75yTmoqRZLkLUum5HdufDA3Lt+cJPnpC6enKIpezQwAQO9TfgEAAAD9wvKNe3L25KZ86wOXd+v5eRMa85VfubSHUwEA0NdUqh0AAAAA4IV0dJZZsbE1S6ePqnYUAAD6OOUXAAAA0Oet2r4/B4925LwZyi8AAJ6f8gsAAADo85Zv3JMkdn4BAPCClF8AAABAn7d8456MHVGXaaOHVjsKAAB9nPILAAAA6PPu39iaJdNHpSiKakcBAKCPq612AAAAAICOzjJfvGdjVm7dlyQ5a3JTfubC6ampFGk5eDTrdh3MO86fVuWUAAD0B8ovAAAAoFds2H0w+4+0d1k/2NaeP/3eqty7YU/GDK9Lknzxno352v1b8qFXn5FVT+5Pkiyd3tyreQEA6J+UXwAAAECPW7vzQF7+F7emLJ973tRQm7985zl507lTkiRfX7E1H71pZd75mbuSJPW1lSyeqvwCAOCFKb8AAACAHnfn2t0py+QTb1ucUcPquszPndaccY31xz+/acmUXDZvbO7f2JokmdI8NEPranotLwAA/ZfyCwAAAOhx967fk3GN9Xn7eVNTFEW33hk7oj6vPGtCDycDAGCgqVQ7AAAAADDwLVvfkgtmjup28QUAAC+V8gsAAADoUdv3HsnmPYdz3ozR1Y4CAMAgoPwCAAAAetS9G1qSJBfMHFXlJAAADAbKLwAAAKBH3bt+T4bV1eSsSU3VjgIAwCBQW+0AAAAAQP9399rd+d7KJ1OmzJjhdfn5S2amqWFIkqfu+1oyvTm1NX4GFwCAnqf8AgAAAF7Qtr2Hs3nP4S7rZZnceN/mfPneTamvraSutpIDbe35p7s25MPXLciExoY8um1f3n/NvCqkBgBgMFJ+AQAAAM+rLMu8+W/uyPZ9R55zXlMpcsNVc/KBa+ZlaF1NHtjUmg9/5aH8xpcfOP7MxbNH91ZcAAAGOeUXAAAA8Lw27D6U7fuO5JeumJ3L543rMp82emhmjBl+/PM505pz0/svzfINe3Kso8zQuposnd7cm5EBABjElF8AAADA81q+cU+S5E1LpuTMSU3demdITSUXzR7Tk7EAAOA5uWkWAAAAeF7LN+7JiPrazJ/QWO0oAADwgpRfAAAAwPNavqE1505rTk2lqHYUAAB4QcovAAAA4KQOtrXnse373NkFAEC/ofwCAAAATuqBza3pLJMlM0ZVOwoAAHRLbbUDAAAAANV3oK09x9o7U1tTpLFhyPH1+ze2JkmWTlN+AQDQPyi/AAAAYBDbdaAtf/Kdx/Kv920+vvbGcyfnv113ZiaObMjyDXsyZ9zwjBw25Hn+LwAA0HcovwAAAGCA+9I9G/N/frzuOWdbWw/naEdn3n3JzMwcMyxbWg/n83duyPdXPpmpo4Zmw+5DeeO5k3s5MQAAvHTKLwAAABjgvrhsU/YdOZbznuPerqXTR+V9V87OnHEjjq/93MUz87e3PpG9h49m/sTG/NzLZvRmXAAAOCXKLwAAABjA2to78ujWffmFy2bmv113ZrfemT5mWP7oLYt6OBkAAPSMSrUDAAAAAD1n5dZ9OdrRmSXTuu76AgCAgUj5BQAAAAPYio2tSZIl05urnAQAAHqH8gsAAAAGsPs3tWbyyIZMaGqodhQAAOgVyi8AAAAYwFZs2pNz7foCAGAQUX4BAADAALXrQFs2tRx23xcAAINKbbUDAAAAAKfmka37svtgW5Jk0ZSRaR5Wl+Q/7/uy8wsAgMFE+QUAAAB9WFmWWbvrYI51dHaZtRw8mv/v1rW57fGdx9dG1Nfm+stn5dVnT8wtq3aktlJk4eSRvRkZAACqSvkFAAAAfdhND2zNr39pxUnno4YNye++ZkGWTh+VI8c683/v2pBP/nB1PvnD1UmSc6Y1Z2hdTW/FBQCAqlN+AQAAQB92z7qWNNbX5hNvW9xlVqkUuWTOmDQ2DDm+dtm8sXl0276s33UwSbJwil1fAAAMLsovAAAA6MMe2rI3i6aOzHWLJnX7nTMnNeXMSU09mAoAAPquSrUDAAAAAM+trb0jj27bl8VTm6sdBQAA+g3lFwAAAPRRj23bn2MdZRZPdXQhAAB0l/ILAAAA+qgHt+xNEuUXAAC8CMovAAAA6KMe3NSa0cPrMqV5aLWjAABAv6H8AgAAgD7qwc17s3jqyBRFUe0oAADQbyi/AAAAoA86dLQ9q3fsz+IpjjwEAIAXo7baAQAAAGAwau/ozLcf3p6/v21tVu/YnySZPnpY3nvZrLxpyZSs3LovnWWyeGpzlZMCAED/ovwCAACAHrL30LG84i9vze4DbV1mZZKyTGaPG56fu3hGiqLIT9bsyu/c+FB+58aHjj+3eKqdXwAA8GIovwAAAKCHLN+0Jzv3t+WnLpiWcY31XeaLpozMK86ckErlqTu9yrLMj9fsyrJ1LSmTTBs1LOObGno5NQAA9G/KLwAAAOghD23em6JIfv91Z2VE/Qt/CV4URS6fNy6XzxvXC+kAAGBgqlQ7AAAAAAxUD27em9ljh3er+AIAAE4P5RcAAAD0kIe2tGbRFHd2AQBAb1J+AQAAQA/Yse9IntzXlkVTm6sdBQAABhXlFwAAAPSAh7bsTZIsnmrnFwAA9CblFwAAAPSABzfvTVEkZ01qqnYUAAAYVJRfAAAA0AMe3rI3c8eNyPD62mpHAQCAQcW/wAEAAOAl6Owsc+vjO/OTNbtSJhlRX5u3nTc100YPS1mWeXDL3lw+d2y1YwIAwKCj/AIAAICT+Jdlm7Jsfctzzu7f1Jo1Ow6krraSuppKDh1tz6dvXp2rzhifkUOHZOf+tixy3xcAAPQ65RcAAAA8h47OMv/jGytTKYo0NnT98nnCyIZ88p3n5jWLJqWutpLte4/kc3esz3ce3pZj7Z2ZPXZ4rpw/rgrJAQBgcFN+AQAAwHN4YueBHDzakb94xzl5y9KpL/j8xJEN+fB1C/Lh6xb0QjoAAOBkKtUOAAAAAH3Rio2tSZJzpjVXOQkAAPBiKL8AAADgOazY3JqmhtrMGjO82lEAAIAXQfkFAAAAz+GBTa05Z1pzKpWi2lEAAIAXQfkFAAAAz3L4aEce274/50x15CEAAPQ3yi8AAAB4lpVb96ajs8y57vsCAIB+R/kFAAAAz7JiU2uSZPG0kVVOAgAAvFi11Q4AAAAAva2zs8yPHt+Rbz64LW3tnamtFLlmwfhct3BS6morWbGpNVOah2Z8Y0O1owIAAC9St8qvoiiuTfKpJDVJ/qEsyz9+1vyDSa5P0p5kZ5L3lGW54enZf0ny+08/+j/Lsvz8acoOAAAAJ/Xdh7flH25f95yzbXuPZEvr4YweXpdRw4Zk/5H2fH3F1nx8xKOZOWZYHtm2L1efMb6XEwMAAKfDC5ZfRVHUJPmbJK9MsjnJsqIobirL8pFnPHZ/kvPLsjxUFMUNST6R5J1FUYxO8tEk5ycpk9z39Lt7TvcfBAAAAJ7pC3duyJqdB3L25KYuszMnNebD1y3ItQsnZkhNJZ2dZW5dvTP/eu+m7D18LEunj8rPXDS9CqkBAIBT1Z2dXxcmWVOW5dokKYriS0nemOR4+VWW5S3PeP6uJO96+vevTvKDsixbnn73B0muTfLFU48OAAAAz62js8wDm1rz1vOm5mNvXPiCz1cqRa4+Y7zdXgAAMABUuvHMlCSbnvF589NrJ/PeJN95Me8WRfG+oijuLYri3p07d3YjEgAAAJzcqu37c/BoR5ZOH1XtKAAAQC/rTvnVbUVRvCtPHXH4py/mvbIsP1OW5fllWZ4/bty40xkJAACAQei+jU+dtn/eDOUXAAAMNt0pv7YkmfaMz1OfXjtBURSvSPJ7Sd5QlmXbi3kXAAAATqf7N+zJ2BH1mTpqaLWjAAAAvaw75deyJPOKophVFEVdkp9KctMzHyiKYkmSv8tTxdeOZ4y+l+RVRVGMKopiVJJXPb0GAAAAPWb5xj1ZOr05RVFUOwoAANDLXrD8KsuyPcn781Rp9WiSfynLcmVRFB8riuINTz/2p0lGJPnXoihWFEVx09PvtiT5eJ4q0JYl+djTawAAANAjdh9oy/rdh7LUkYcAADAo1XbnobIsv53k289a+8gzfv+K53n3H5P840sNCAAAAM9WlmUe274/LQePJknmT2jMuMb6JMnyja1J3PcFAACDVbfKLwAAAOhNR4515OsrtuRoe2eX2aGjHbnpga1ZuXXf8bXaSpFXnz0xF80endse35naSpFFU0b2ZmQAAKCPUH4BAADQ53zt/i358FceOul8wcTGfPxNC3PGhMa0d3bm5kd35N+Wb863HtqWJLl07pg0DKnprbgAAEAfovwCAACgz7l3w56MGV6X7/7XK1IUJ84qRZFRw4akeMbgkjlj86FrF2TfkWNJkuahQ3ozLgAA0IcovwAAAOhzlm/Yk6UzRh2/x6s76morGTui+88DAAADU6XaAQAAAOCZWg4ezdpdB3PejFHVjgIAAPRDyi8AAAD6lOUb9iSJ8gsAAHhJlF8AAAD0Kfdt3JPaSpFFU0ZWOwoAANAPKb8AAADoU+7bsCdnTxmZhiE11Y4CAAD0Q8ovAAAA+oxjHZ15YFNrzpvuyEMAAOClqa12AAAAAAaenfvbsvfw0S7rHZ3J7at35kvLNmXNjgNJkglN9XnH+dPy6rMnZvOeQ2lr73TfFwAA8JIpvwAAADitWg4ezaV/cnOOtnee9Jml05vzgWvmJkWRh7fszV/fsiafvnlNkqQoovwCAABeMuUXAAAAp9U961pytL0zv3PtgkwdNbTLfP6ExpwxsfGEtS2th3P/xj0py2RCU0MmjmzorbgAAMAAo/wCAADgtLp3fUvqait5z2UzU19b0613pjQPzZTmrkUZAADAi1WpdgAAAAAGlmXrW3LutOZuF18AAACnk/ILAACA0+bQ0fY8vHVfLpjpzi4AAKA6lF8AAACcNis2tqajs8z5M0dXOwoAADBIKb8AAAA4be5Z35KiSM6bYecXAABQHbXVDgAAAED/c+hoe8oyqa0pTrjb6971e7JgYlOaGoZUMR0AADCYKb8AAAA4weY9h7Jmx4HnnK3ZcSBfWb4lj2zblySprRS56oxxed3iyRk5bEiWb9yTt503tTfjAgAAnED5BQAAwAne/dllJy2/kmTx1JH54Cvnp2FIJU/ua8s3HtiaHz664/j8kjljeyMmAADAc1J+AQAAcNyO/UeyZseBvPeyWXnt4kld5mOG12XGmOEnrP3ua87Mo9v25WhHZ+prKzlrUlNvxQUAAOhC+QUAAMBx967fkyR57eJJWTp9VLfeqakUWThlZE/GAgAA6LZKtQMAAADQd9yzriUNQypZOFmZBQAA9E/KLwAAAI5btr4lS6aNSl2tLxcBAID+yVczAAAAJEn2HzmWR7ftywWzRlc7CgAAwEum/AIAACBJsnxjazrL5MKZyi8AAKD/qq12AAAAAHrPkWMduXtdS44c60ilKHLBzFFpHlaXJFm2riU1lSJLpjdXOSUAAMBLp/wCAAAYQDbsPphvPrgtZVl2me3c35avP7A1rYeOHV+rq63kNQsnZu74Efn2w9uycHJThtf7UhEAAOi/fEUDAAAwgPzFDx7P11dsfc7ZkJoirzprYt52/tSMb6zPwbaOfPPBrfnq/Vvytaff+dC1Z/RmXAAAgNNO+QUAADBAlGWZu9buzmsXTconf+rcLvNKUaSmUpywduGs0fnvrz87HU/vFBtS42poAACgf1N+AQAADBDrdx/Kk/va8rI5Y15UiVWpFKmkeOEHAQAA+gE/0gcAADBA3L12d5Lk4tljqpwEAACgepRfAAAAA8Rda3dn7Ij6zBk3vNpRAAAAqkb5BQAAMAA8dd9XSy6ePTpF4QhDAABg8FJ+AQAADAAbWw5l+74jjjwEAAAGvdpqBwAAAOA/7TtyLEfbO7ust7V35uZHn8w3HtyW3QfakiRzx4/Im5dMyXkzRufmx3Ykcd8XAACA8gsAAKCPuGddS97xd3c+7zNnTGjMgklN6ewss2z9nnxv5ZPHZ+Ma3fcFAACg/AIAAOgjbn5sR4bUFPmD152VLrd2FUXOnzEqZ05qOr7U3tGZO57YnQ27DyZJzp4y0n1fAADAoKf8AgAA6CPuWrs750xtzs+/bGa3nq+tqeSK+eOSjOvRXAAAAP1JpdoBAAAASA62teehLXtz0ezR1Y4CAADQrym/AAAA+oB7N+xJR2eZi2ePqXYUAACAfk35BQAA0AfcvXZ3aitFzpsxqtpRAAAA+jXlFwAAQB9w19rdWTR1ZIbVuZoZAADgVPiqCgAAoJdsajmUjS2HkiTNw4bkzIlNqVSKHDrangc3780vXjG7ygkBAAD6P+UXAADAaVCWZf7s+6uyZc/hrrMkj27bl8efPHDC+vjG+lwwc3QOHm1Pe2eZi2aN7qW0AAAAA5fyCwAA4DRYs+NA/uaWJzK+sT5D62q6zKc0D807zp+WhVNGplIU2dhyKLc8tiMrt+5NmeS8GaNyofILAADglCm/AAAAToM71+5Oktx4wyWZNnrYCz5/4azRedt5U3s6FgAAwKBTqXYAAACAgeDOJ3ZnSvPQbhVfAAAA9BzlFwAAwCnq7Cxz19rduXj2mGpHAQAAGPSUXwAAAKdo1ZP7s+fQsbxsjvILAACg2pRfAAAAp+jOJ56670v5BQAAUH3KLwAAgFN019rdmT56WKY0D612FAAAgEGvttoBAAAA+oJV2/fngU2tzznbffBoVmzakzU7DqRMUldTyVmTm7J4ysgMq6vNXWt357qFk3o3MAAAAM9J+QUAAJDkV//f8qzZceCk85ljhmXBxKbU1hQ5dLQjtz2+M19ZvuX4/OoF43sjJgAAAC9A+QUAAAx6T+47kjU7DuQDL5+Xd14wrct8eF1NmofVnbBWlmV2HmjLsY4yQ2qKjG9s6K24AAAAPA/lFwAAMOjd+cTuJMmrzprQ7Xu7ikLhBQAA0BdVqh0AAACg2u58YneaGmpz5qSmakcBAADgFCm/AACAQe/Otbtz8ewxqakU1Y4CAADAKVJ+AQAAg9rmPYeyseVQXjZnTLWjAAAAcBoovwAAgEHtP+77umTO2ConAQAA4HSorXYAAACAU3W0vTOrtu9PZ1l2nXV0ZsPup3Z3tXd0piiSiU0NmT1uREbU1+b7jzyZMcPrMn/CiCokBwAA4HRTfgEAAP3ep29enU/fvOZ5nymKpLZSpLNMOjpPLMnecM7kFIX7vgAAAAYC5RcAANDv3b56V86a1JTfevX8LrOaSiXTRg3NtNHDMqSmkrIs8+S+tqzddSBHjnUkSZZOH9XbkQEAAOghyi8AAKBfO9jWnoe27M0vXzk71yyY8ILPF0WRiSMbMnFkQy+kAwAAoLdVqh0AAADgVNy3YU86Ostc9P+zd6dxet13efCvc8+qfaSRZGvfZVu25X2R5DVkcRITk4RHEzcAAAAgAElEQVRQk/hJKZSQ0LRAPyElFEhJ+kB4KAUClJJQaFMKAUxCQpp9ty3JthyvcmxLGtnal5mRRuus93le2Ch2RrYlezT3zOj7fWPf53fO+PILy6O5dP6/Ra21jgIAAMAIoPwCAABGtfu2dqauUuTyBY4uBAAAQPkFAACMcvdu7chFc6ZkYpNT3QEAAFB+AQAAo1h330Ae3t6VaxdNq3UUAAAARgjlFwAAMGp9b9uB9A5Uc81i5RcAAADPci4IAABQUweO9uY//dPGHO8dGDQrkxzp7s/B433pG6gmSZobKmkZ15hxjXXZ3nksRZFcsUD5BQAAwLOUXwAAQE198bHd+dxDu3LeOZNSFIPnE5vqM6elOU31dSlT5njvQA4e70v7kZ4kyR3XLMiUcQ3DnBoAAICRSvkFAADU1NrNHZk1pTlf/sXrU5ys/QIAAIDTYOcXAABQM9VqmbVb2rNm6XTFFwAAAENC+QUAANTM47sP5cCxvqxZ2lrrKAAAAIwRyi8AAKBm7tncniRZs2R6jZMAAAAwVii/AACAmrlnS0eWzZyYmZObax0FAACAMUL5BQAA1ERP/0Du39qZNUu99QUAAMDQqa91AAAAYPQqyzK/+tnH8kzH0dN+9njfQI73DSi/AAAAGFLKLwAA4BV7cu/h/M1927Js5sS0jG84rWfrK0Vet+KcrFnaeobSAQAAcDZSfgEAAK/Yt5/cnyT51M9cnVlTxtU4DQAAANj5BQAAvArffnJfzj93kuILAACAEUP5BQAAvCKHu/uy4ekDufG8GbWOAgAAACcovwAAgFfkns0d6a+Wufm8mbWOAgAAACcovwAAgFfkO0/ty6Sm+lyxYGqtowAAAMAJ9bUOAAAA1M4Tew7lvq2dr+jZb3x/X9YsnZ6GOn+mDgAAgJFD+QUAAGexX/z0Q3liz+FX/PybVs4awjQAAADw6im/AADgLLXr4PE8sedw/v3rludd18w/7efrK5VMGd9wBpIBAADAK6f8AgCAs9R3ntqfJLnlonPTOrGpxmkAAABgaDicHwAAzlLffnJfZk9pzrKZE2sdBQAAAIaM8gsAAM5Cvf3V3L2pPTedPzNFUdQ6DgAAAAwZ5RcAAJyFNjzTmaO9A7lp+YxaRwEAAIAhZecXAACMUmVZZt/hnlTLctCsSJFJzfUZ31h34s2uvoFqDh7rS3+1mq88ticNdUVWL50+3LEBAADgjFJ+AQDAKPWX9zydj3zh8Ze8p6GuSH2lkjJluvuqL5itWdqaiU1+SwAAAMDY4ne6AAAwSn3psd1ZPH1C3nPD4kGzapkc6u7LwWN9J94Mm9hUn5bxDWmse/b089VLvPUFAADA2KP8AgCAUajrWF8eeOZA/s3NS3P71fNrHQcAAABGjEqtAwAAAKfvu5v2p1omN503s9ZRAAAAYERRfgEAwCj0rSf3pWV8Qy6d11LrKAAAADCiKL8AAGCUqVbLfPep/blx+YzUVYpaxwEAAIARRfkFAACjzGO7utJ+pDc3O/IQAAAABqmvdQAAADgb7enqzk/95X051jtw0vnUCY2ZN3VcJo9rSFkmXcd7s63zWA4d78/Rnv4URXLD8hnDnBoAAABGPuUXAADUwFcf35Mn9hzOm1fOSmPdCw9kKMsy+4/05JEdXSfKscnN9Zk7bXyWzpiYoihy4ezJmTahsRbRAQAAYERTfgEAQA3ctak9c6eOyx//5GUpCnu7AAAAYKjY+QUAAMOsb6CadVs6cv2yGYovAAAAGGLKLwAAGGYPbz+YIz39uX7Z9FpHAQAAgDFH+QUAAMPsrk3tKYpk9ZLWWkcBAACAMUf5BQAAw+yuTfuzcm5LWsY31joKAAAAjDn1tQ4AAACjUdfxvhw42nvSWcv4hkHFVm9/NXu6unOsrz8P7+jK+25cMhwxAQAA4Kyj/AIAgNPUP1DNj/zet9N+5OTlV5LMntKcedPGp1IU6Trel837jqR3oHpifsPyGcMRFQAAAM46yi8AADhND+/oSvuR3vzs9YuyYvbkQfP9h3uycdeh7D7YnYGyzIxJTblh+YwsnjEhDXVFJjU15KqFU2uQHAAAAMY+5RcAAJymtZvbkyTvvXFJWic21TgNAAAA8HyVWgcAAIDRZu2Wjlwwa7LiCwAAAEYg5RcAAJyG7r6BPLDtQNYsaa11FAAAAOAklF8AAHAaNjx9IL391axZOr3WUQAAAICTUH4BAMBpuGdLe+orRa5eNK3WUQAAAICTqK91AAAAGG59A9XsPdR90tm4hrqT7vLaf7gnPf0DuWvT/lw6ryUTmnwrDQAAACOR37EDAHDW+aW/fShfeGT3i87nTxufS+a1pKm+kuO9A3lw24Hs6vpBWfYLP7JsOGICAAAAr4DyCwCAs0pvfzXfemJfblw+I29eOWvQvOtYXzY805mHth9ItZrU1xW5bP7U/MyCqZnUXJ/6SpHXrjinBskBAACAU6H8AgDgrPK9bQdytHcg77xmft5w4bknvedns3iYUwEAAABDpVLrAAAAMJy++9T+1FeKrF7SWusoAAAAwBmg/AIA4Kzy3U37c/n8qZnU3FDrKAAAAMAZoPwCAOCs0X6kJ4/tPJQblk+vdRQAAADgDFF+AQBw1rhnc3uS5IblM2qcBAAAADhT6msdAAAATseug8fzqXXPZKBaHTSrVIqsnNOSNUtb0zK+MQPVMo/t7Mrdm9tz8Fhv1rd1Zur4hlw4e0oNkgMAAADDQfkFAMCo8pf3bM0n79qa8Y11g2Z9A9X0DZRJkvpKkWpZpvrsxxP333HtgtRVimHLCwAAAAwv5RcAAKPK2i0duXbxtHz6PasGzfoHqnl4x8Gsb+vMsd7+JMnycyZlzdLpmT6xabijAgAAADWg/AIAYNQ4cLQ3j+8+lF967fKTzuvrKrliwbRcsWDaMCcDAAAARopKrQMAAMCpundrR8oyWb2ktdZRAAAAgBFK+QUAwKixdktHxjfWZeXcllpHAQAAAEYo5RcAAKPG2i0duWrhtDTW+zYWAAAAODk/NQAAYFTYd6g7m/cdceQhAAAA8JLqT+WmoihuSfKHSeqS/HlZlh/7ofkNSf4gycokt5dleefzZgNJHn3u47ayLN8yFMEBABh9qtUydz6wI4e6+046XzJzYlYvaU1TfV2SpLtvIGu3tKdt/9Fs2nskSbJ6yfRhywsAAACMPi9bfhVFUZfkT5K8LsmOJPcXRfH5siwff95t25L8VJIPnORLHC/L8tIhyAoAwCi3rq0jH/yHR17yngmNdVk4fUKSZGv70RzrHTgxmzt1XFbMnnxGMwIAAACj26m8+XV1ks1lWbYlSVEUn05yW5IT5VdZlk8/N6uegYwAAIwRd29uT32lyNoPvSbjGupeMKtWk+9tO5CvfX9v9nZ1J0kum9+S115wTi6bNzWVStLcUJe6SlGL6AAAAMAocSrl15wk25/3eUeSa07jn9FcFMWGJP1JPlaW5T/+8A1FUbwnyXuSZP78+afxpQEAGE3u3tSey+dPzcxJzSed33z+zNx8/sxhTgUAAACMJZVh+GcsKMvyyiTvTPIHRVEs+eEbyrL8RFmWV5ZleeWMGTOGIRIAAMPtwNHePLarK2uW2tkFAAAAnDmnUn7tTDLveZ/nPnftlJRlufO5v7Yl+XaSy04jHwAAY8S6to6UZXLdMuUXAAAAcOacSvl1f5JlRVEsKoqiMcntST5/Kl+8KIqpRVE0Pff305OsyfN2hQEAcPa4e3N7JjbV55K5U2odBQAAABjDXrb8KsuyP8n7k3wlyfeT/F1ZlhuLovhIURRvSZKiKK4qimJHknck+bOiKDY+9/gFSTYURfFwkm/l2Z1fyi8AgLPQ3Zvac+3i1tTXDcfJ2wAAAMDZqv5UbirL8otJvvhD137jeX9/f549DvGHn1ub5OJXmREAgBHif697Oht3HTrpbOakptxy0axcMGtSiqLI4e6+fOP7+3Lf053p6atmW+ex/PSahcOaFwAAADj7nFL5BQAAh7r78uHPb8yEpvqMb6x7wawsk/YjPfn4NzdnyriGNNQVOXS8P70D1Uxurs+4xrosnj4hr7/w3BqlBwAAAM4Wyi8AAE7JvW2dqZbJJ999Za5d3Dpo3nGkJ1/ZuDcbd3UlSSY1N+R1K2bmsnlTU6kUwx0XAAAAOEspvwAAOCX3bG7PuIa6XDa/5aTz1olNeec184c5FQAAAMAL2TYOAMApuXtze65eNC1N9XUvfzMAAABAjSi/AAB4WXu6urN535Fct3R6raMAAAAAvCTlFwAAL2vtlvYkyeqlg3d9AQAAAIwkyi8AAF7W3ZvbM21CYy44d3KtowAAAAC8pPpaBwAAYHh8+bE9ufOB7SedjWusz2vOn5HXXnBOJjU35HB3X77x/X355hP7cqy3P/e2debG82akUimGOTUAAADA6VF+AQCcJf7g609ld1d35k4dN2i2/3BP/unhXYOuz5zUlBmTmrJoxoT85NXzhyMmAAAAwKui/AIAOAvs6erOE3sO50NvPD8/d+OSQfNqtcyD2w9m7eb29FXLNFSKrF7amsvmTfW2FwAAADCqKL8AAM4C331qf5LkxvNmnHReqRS5YsHUXLFg6nDGAgAAABhylVoHAADgzPv2U/ty7uTmnHfOpFpHAQAAADijlF8AAGNc/0A1d21qz43LZ6QoHGEIAAAAjG3KLwCAMe7B7QdzuLv/RY88BAAAABhL7PwCABgFevoHsr6tM/0D1UGzSqXIZfNa0jK+8cS1siyzcdeh7D3Unf/7yO7UVYqsWTp9OCMDAAAA1ITyCwBgFPg/67flI194/EXn9ZUiq5dOz5yWcekfqGZdW0d2HDh+Yr56SWumjGsYjqgAAAAANaX8AgAYBb75xL4snj4hf3D7pYNmx3oH8q0n9+Xrj+/N93cfSpKsmDU5/+5HluW8cyalKJKF0ycMd2QAAACAmlB+AQCMcMd6+3Pf1s68e9WCrJzbctJ7rl3cmg+98YJhTgYAAAAw8lRqHQAAgJe2bktHegequem8mbWOAgAAADDiKb8AAEa47zy1P+Ma6nLVoqm1jgIAAAAw4im/AABGsLIs8+0n92f1ktY01dfVOg4AAADAiKf8AgAYwba2H822zmO56bwZtY4CAAAAMCrU1zoAAMBYd/BYb972p2tz8FjfSefLZk7MbZfOyaXzWpIkj+3qyucf2pXHdx9Kb381SXLjcvu+AAAAAE6F8gsA4Az7zlP707b/aN562ZxMbHrht18DZZn1bR351c8++oLrC1rH5w0Xnpv6SpEFreMzv3X8cEYGAAAAGLWUXwAAZ9h3ntqfqeMb8l/ecUnqKsWgeVmW2bjrUHYcOJYkmTVlXFbOnZKiGHwvAAAAAC9N+QUAcAaVZZm7NrVnzdLpJy2+kqQoilw0Z0oumjNlmNMBAAAAjD2VWgcAABjLntx7OPsP9+SGZTNqHQUAAADgrKD8AgA4g+56qj1Jcv3y6TVOAgAAAHB2UH4BAJxB3920P8tmTsysKeNqHQUAAADgrGDnFwDAy3im42ja2o+edDZzUlNWzJqcovjBPq9jvf154JkD6Ruo5r6tnXnXNQuGKyoAAADAWU/5BQDwEsqyzE/82brsPdTzovecf+6kvH7FOWlqqMv2zmP5wiO7c6Sn/8T8NefPHI6oAAAAAET5BQDwkp7aeyR7D/Xkl167PDecZG/Xxl2H8ncbtufj39ycJBnXUJc3XTwrb7l0diY312dcY13OO2fScMcGAAAAOGspvwAAXsK6Le1JkrddPifzpo0fNL9s/tTcce2C9A1UU5ZJXaVIXaUYdB8AAAAAw0P5BQDwEta1dWTetHEnLb6er6GuMkyJAAAAAHgpfkoDAPAiqtUy69s6s2pxa62jAAAAAHCKlF8AAC/i8d2H0nW8L6uWKL8AAAAARgvlFwDAi1i3pSNJsmrx9BonAQAAAOBU2fkFAIxpZVmm/UjvSWdNDZVMbm4YdP1IT3+O9w7krs3tWTx9Qs6d0nymYwIAAAAwRJRfAMCY9tEvfD9/cc/Wk86KInnNeTNz+9XzM2NSUw4e683fP7AjX3lsT/qrZZLkXdfMH864AAAAALxKyi8AYEz7+vf35pJ5LfnxK+YOmu06eDx/v2F7vvHEvhPXJjfX592rFmbRjAmpFMnrV5w7nHEBAAAAeJWUXwDAmLXjwLFs6zyWn1q9MP/PtQtOes8vvnZZNjx9IL391dRVily1cFrGNdYNc1IAAAAAhoryCwAYs9Zt6UiSrFrS+qL3NNXXZc3S6cMVCQAAAIAzrFLrAAAAZ8q6to5Mm9CY886ZVOsoAAAAAAwT5RcAMCaVZZn1Wzpy7eJpqVSKWscBAAAAYJgovwCAMemZjmPZ1dWdVYtf/MhDAAAAAMYe5RcAMCata3v5fV8AAAAAjD31tQ4AAPBiHtp+MP/2b76Xvv5y0KxSJNcvm5E7rl2Q5edOTP9Ama8+vid/c+/2bOs8lsPdfZkxqSlLZkysQXIAAAAAakX5BQCMWJ9/aFf2HurJWy+dM2h2pLc/n394V/52w/YXXF88fUJuWD49RYpcv3x6isK+LwAAAICzifILABix7tncnqsXTsvv/PjKk84Pdffli4/sTsfR3iTJpfNasnpJq8ILAAAA4Cym/AIARqR9h7vz5N7Due2y2S96z+Tmhtx+9fxhTAUAAADASFepdQAAgJNZt6UjSXLd0uk1TgIAAADAaKL8AgBGpLs3tWfKuIZcOHtKraMAAAAAMIoovwCAEacsy9yzuT2rl7SmrmJ/FwAAAACnTvkFAIw4T3ccy66u7qx25CEAAAAAp6m+1gEAgLGp63hfbvmD72b/4Z6TzpedMynvuGJurlk8LUWKPLazK3+3YXse2n4w1bJMkqxZ0jqckQEAAAAYA5RfAMAZsb6tI7u7unP7VfPSOrHxBbOBarJ2S3s+8oXHX3B98YwJ+enrFqWhrsjslnFZPGPicEYGAAAAYAxQfgEAZ8S6LR1pbqjkN2+7ME31dSe958k9h7O1/UiS5Nwp43LJ3CkpCju+AAAAAHjllF8AwBmxbktHrlww7UWLryQ579xJOe/cScOYCgAAAICxrlLrAADA2NNxpCdP7j2cVXZ2AQAAADDMlF8AwJBb39aZJLl2sfILAAAAgOGl/AIAhty6tvaMb6zLyrlTah0FAAAAgLOM8gsAGHLrtnTkqoXT0lDnWw0AAAAAhld9rQMAACPTH31jU+7e3H7SWcv4hly/bEauXDg1DXWVHDjam+8+tT/f23YwvQPVbNl/NO+4ct4wJwYAAAAA5RcAcBLdfQP5o29tzjmTmzJ7yrhB8427DuUrG/e+4FqlSC6cPSXjG+tyw/IZuXXlrOGKCwAAAAAnKL8AgEEe3HYwvf3VfPjWC/PaFecMmpdlmS37j+bx3YdSlmXGNdTl6kXT0jK+sQZpAQAAAOAHlF8AwCDrtrSnUiRXL5520nlRFFk6c2KWzpw4zMkAAAAA4KXZQg8ADLKurSMXz5mSyc0NtY4CAAAAAKdF+QUAvMCx3v48tP1gVi2ZXusoAAAAAHDalF8AwAtsePpA+gbKrFrSWusoAAAAAHDalF8AwAus3dKR+kqRqxZOrXUUAAAAADht9bUOAAAMvcd2duXOB3acdFZXKTKnZVzmTRufxvpKBqrV7DrYne2dx9LTX83XHt+bS+e1ZHyjbxMAAAAAGH38VAsAxqA//MamfPOJfZnYNPh/9b391RzvGxh0vbG+knENdSmK5G2Xzx2OmAAAAAAw5JRfADDGDFTLrG/ryE9cOTe//baVg+ZlWabzaG92HDie/mqZokhmTxmXmZOaUqkUNUgMAAAAAENH+QUAY8zGXV053N2fVUumn3ReFEVaJzaldWLTMCcDAAAAgDOvUusAAMDQWrulI0ly7eJpNU4CAAAAAMNP+QUAY8y6LR1ZNnNiZk5qrnUUAAAAABh2yi8AGEN6+6u5/+nOrF7SWusoAAAAAFATyi8AGEMe2XEwx3oHskr5BQAAAMBZqr7WAQCAF+ruG8hnvrczPf0Dp/3s+raOFEVyzSLlFwAAAABnJ+UXAIwwn3toZ371s4++4uevWTQtUyc0DmEiAAAAABg9lF8AMMKsb+vM9IlN+dov3ZCiOP3nJzb53zsAAAAAZy8/HQOAEaQsy6xv68g1i729BQAAAACvRKXWAQCAH9jWeSy7u7pz7WI7uwAAAADglVB+AcAIsr6tI0myavG0GicBAAAAgNFJ+QUAI8iz+74as2TGxFpHAQAAAIBRSfkFACNEWZa5t60j1yxqTVEUtY4DAAAAAKNSfa0DAMBYM1AtM1AtB10vU2bXwe5s3NWV/Yd7kiSTmhuyYtbkLJ4xITsPHs+uru68z5GHAAAAAPCKKb8AYAgd7enPTf/l2yfKrVfimsWtQ5gIAAAAAM4uyi8AGEL3P92Z/Yd7cse18zNryrhB89YJjblozpTMaRmXokg6jvZm465D2d55LEkyY1JTls207wsAAAAAXinlFwAMoXVtHWmoK/If37Qi4xrrXvb+lvGNWTJD2QUAAAAAQ6VS6wAAMJasb+vMpfNaTqn4AgAAAACGnvILAIbI4e6+PLazK9fa2QUAAAAANaP8AoAhsuHpAxmolsovAAAAAKgh5RcADJH1bR1prKvk8vlTax0FAAAAAM5a9bUOAACjRf9ANV/euCfffWp/qmUyvrEuP3bZnBNl17q2Dvu+AAAAAKDGlF8A8Dz/a+3T+daT+046e3LP4ezu6s7U8Q0Z31ifA8d686l1z2TFrMmZObkpj+3syvtfs2yYEwMAAAAAz6f8AoDnVKtl/uvXnkpTfSWzpjQPml8wa3I+ettFufn8mamrFDna059/+N6OfOHh3TlwtDdXLJiat1wyqwbJAQAAAIB/pvwCgOc8te9wuo735ffecUnefsXcl71/QlN93r1qYd69auGZDwcAAAAAnJJKrQMAwEhx39bOJMnVi6bVOAkAAAAA8EopvwDgOfdt7czsKc2ZO3VcraMAAAAAAK+Q8gsAkpRlmfu2duaqRdNSFEWt4wAAAAAAr5DyCwCSPNNxLPsO9zjyEAAAAABGufpaBwCA4dI3UM1XN+7NkZ6+1FUqec35MzNtQmOSH+z7ukb5BQAAAACjmvILgDGlp38gZTn4+hN7DudX/uGRPLHn8Ilr0yY05sM/uiJvuPDcrG/ryLQJjVkyY+IwpgUAAAAAhpryC4Ax43/cvTUf/cLjLzo/Z3JT/vsdl2fl3JbsPdSd//RPj+cXPv3QifkbLjzHvi8AAAAAGOWUXwCMGV96dHcWto7PT1w1b9BsXENd3nb53EwZ15Akmd0yLp953+p8/uGd2d3VnSS55cJzhzUvAAAAADD0lF8AjAnHevvz8I6D+ZnrFufnb1p6Ss/UVYq89bK5ZzgZAAAAADCcKrUOAABDYcPTB9I3UGbVktZaRwEAAAAAakj5BcCYsK6tI/WVIlcumFrrKAAAAABADSm/ABgT1m3pyCXzWjKhyYm+AAAAAHA28xNCAEaFsizz1cf3pm3/0STJ6iWtuWReS5LkSE9/Ht3ZlffduKSWEQEAAACAEUD5BcCI19M/kN/4x4352w3bT1yrrxT59VtX5N2rFuT+rZ0ZqNr3BQAAAAAovwAYIXYePJ5f+tuH0tM3MGjWcbQ3Ow4cz/tvXpqfv3lJjvcO5IN3PpIPf35j/vrebTnc3ZfGukqusO8LAAAAAM56yi8ARoQvPrI7923tzA3LZ6RSvHDWOrEpv37rirzhwnOTJOMb6/PJd1+ZT9zVlvVtHZmV5rxr4bQ0N9TVIDkAAAAAMJIovwAYEe7Z0p4lMybkUz999SndX6kUee+NS/Jee74AAAAAgOep1DoAAPT2V3NvW2euWzq91lEAAAAAgFFO+QVAzT20/WCO9w1ktfILAAAAAHiVlF8A1Nzdm9tTKZJrF7fWOgoAAAAAMMrZ+QXAsPi7+7fnq4/vSZIsbJ2QD7zhvDQ31CVJ1m5uz8VzWzJlXEMtIwIAAAAAY4DyC4Azqlot8ztffiJ/9t22LGgdnwmN9fn69/fl4R0H88l3X5n6ukoe2n4wP3fj4lpHBQAAAADGAOUXAK/aQLXMv/qf92dH57FBs57+anYePJ47rp2f33zLRamrFPnCI7vy7//24dz8X76d8Y316a+WWbPEvi8AAAAA4NVTfgHwqj26syvffWp/Vi1uzfRJTYPm77tpSd51zfwURZEkuXXl7Jw7uTl/tf6ZDJTJay+YmasWTRvu2AAAAADAGKT8AuBVu+up/SmK5E/edXmmTWg8pWeuXDgtVy5UeAEAAAAAQ6tS6wAAjH53bWrPxXOmnHLxBQAAAABwpii/AHhVDnf35XvbDuT6ZXZ2AQAAAAC159hDAF7WQLXMQ9sPpm+gmknN9Vkxa/KJ/V3r2zrTXy1z/bIZNU4JAAAAAKD8AuBl9PQP5P1//WC+9vjeE9f+zc1L8oHXn5eiKHLXpv0Z31iXy+dPrWFKAAAAAIBnKb8AyKHuvmzrODboelkmv//1p/LNJ/bll99wXi6b35LPPbgrf/KtLenpq+bHLpuT7zy1P6sWt6ax3km6AAAAAEDtKb8AyHs+tSHr2zpfdP5bb70477xmfpLk2kXPFl1/fvfW/PndW5MkP3PdomHJCQAAAADwck6p/CqK4pYkf5ikLsmfl2X5sR+a35DkD5KsTHJ7WZZ3Pm/2L5P82nMf/3NZlv9rKIIDMDQOd/fl/qcP5K2XzcmbLp41aD5rSnMumjPlxOdKpchHbrswb145K4e7+1NfV2TNkunDGRkAAAAA4EW9bPlVFEVdkj9J8rokO5LcXxTF58uyfPx5t21L8lNJPvBDz05L8uEkVyYpkzzw3LMHhiY+AK/WvW2dGaiW+Ykr52XVktZTeqYoily7+NTuBQAAAAAYTqeyoOXqJJvLst8xFwUAACAASURBVGwry7I3yaeT3Pb8G8qyfLosy0eSVH/o2Tck+VpZlp3PFV5fS3LLEOQGYIjcs6U9zQ2VXL6gpdZRAAAAAABetVMpv+Yk2f68zzueu3YqXs2zAAyDtZs7ctXCaWmqr6t1FAAAAACAV+2Udn6daUVRvCfJe5Jk/vz5NU4DMLb0DVTzV+ufSefR3tRVivz4FXMzd+r4JMm+w915cu/h/Nhl/lwCAAAAADA2nEr5tTPJvOd9nvvctVOxM8lNP/Tst3/4prIsP5HkE0ly5ZVXlqf4tQF4GdVqmV/++4fzjw/tSqVIqmVy5wM78g/vW51zJjdn3ZaOJMl1S6fXOCkAAAAAwNA4lfLr/iTLiqJYlGfLrNuTvPMUv/5XkvxWURRTn/v8+iQfOu2UALyonv6BPLazK9WT/NGBzz+0K//40K788hvOy7+5eWke2XEwP/mJ9Xn3/7gvv3nbhfnio7szZVxDVsyePPzBAQAAAADOgJctv8qy7C+K4v15tsiqS/IXZVluLIriI0k2lGX5+aIorkry2SRTk/xoURS/WZblhWVZdhZF8dE8W6AlyUfKsuw8Q/8uAGelP/nWlnz8G5tedP7Taxbl529akiRZObcln3z3lfmpv7w/t39ifZLkzStnpa5SDEtWAAAAAIAzrSjLkXXK4JVXXllu2LCh1jEARo3b/uSe9A9U86E3XjBoNr6pLpfNa0lRvLDc2tZxLNs6jyVJLp4zJVPGNwxLVgAAAACAl1IUxQNlWV75ar7GqRx7CMAIdai7L4/uOJj337w01y079b1d81vHZ37r+DOYDAAAAACgNiq1DgDAK3dvW2eqZbJ66akXXwAAAAAAY5nyC2AUW7ulPc0NlVw2v6XWUQAAAAAARgTHHgKMYNVqmd/96pN5aNvBJMktF52bf7l64Yn52s0duWrhtDTV19UoIQAAAADAyOLNL4AR7I++uTl/+u0tOdrbn46jPfnw5zfmcw/tTJLsP9yTJ/cezqolrTVOCQAAAAAwcnjzC6DGnuk4mmO9A4OuP7qzK7//9afytsvn5PfecUn6Bsrc8ef35oN3PpLJzQ3Zsv9IkmTNEvu+AAAAAAD+mfILoIYeeOZA3v6na190fum8lvzWWy9OURRprC/y3+64PLf98T35V//z/iRJy/iGXDh78nDFBQAAAAAY8ZRfADX0rSf2pa5S5A9vvzT1leIFs6Iosmbp9DQ3/GCf1/SJTfnc+9dkw9OdSZJF0yemvs4JtgAAAAAA/0z5BVBDd29uz6XzWnLrytmn/Mz0iU255aJZZzAVAAAAAMDo5XUBgBrpOt6XR3YczJqldnYBAAAAAAwVb34BnEHVaplnOo+lLMtMn9SUyc0NJ2br2zpSLZPrlF8AAAAAAENG+QVwhlSrZf71pzbkm0/sS5JMbq7P595/XRZNn5AkuWdze8Y31uXSeS21jAkAAAAAMKY49hDgDPnkXW355hP78nM3Ls7vveOSVCpF/u3ffC89/QNJnt33dc2iaWms90sxAAAAAMBQ8eYXwKuwcVdXdh44Puj6gWO9+d2vPJk3XnRufuWW81MURSaPa8jPfmpD/uNnH8uapa1p238077x6fg1SAwAAAACMXcovgFfoSE9/3vrf1qa3v3rS+bxp4/Kxt61MURRJktetOCc/vWZR/uKerbnzgR0piuSm82YMZ2QAAAAAgDFP+QXwCt3b1pHe/mr+v7evzIrZkwfNF02fkAlNL/xl9tdvvSC3Xz0vvf3VTG5uyPzW8cMVFwAAAADgrKD8AniF7trUnuaGSm67bHaa6utO6ZmiKLL8nElnOBkAAAAAwNmrUusAAKPVdzftz7WLW0+5+AIAAAAA4Mzz5hfAi/j+7kP5f//v93O8byBTxjXkI7ddmLlTnz2mcMeBY2nbfzTvumZBjVMCAAAAAPB83vwCOIme/oH8wqcfzMZdXRnXUJf1bR354J2PpFotkyR3b2pPktywbHotYwIAAAAA8EOUXwAn8Ydf35Sn9h7Jf/0Xl+av/vU1+fVbV2Ttlo78n3ufSfLsvq9zJzdn6cyJNU4KAAAAAMDzOfYQOGt96dHd+dJjewZdr5Zlvvjo7vzElXNz83kzkyS3XzUvX3x0d377S0/k/qcP5NtP7subLp6VoiiGOzYAAAAAAC9B+QWctT725SfSeaQ30yc1DZqtWTo9v3brihOfi6LI77x9ZX7h0w/m0Z1dmdUyLj9+xdzhjAsAAAAAwClQfgFnpe2dx/JMx7F8+EdX5F+tWXRKz8xuGZe/f+/qM5wMAAAAAIBXw84v4Kx016b2JMn1y6bXOAkAAAAAAEPJm1/AmPXIjoPZdfB46iqVXL9sepob6k7M7tq0P7OmNGfJjIk1TAgAAAAAwFBTfgFj0t2b2nPH/7j3xOc3XnRu/vSOK5IkA9Uya7d05PUrzklRFLWKCAAAAADAGeDYQ2DM6e4byK9/7rEsbB2f//vvrsvP37QkX3psT771xL4kyaM7u9J1vC/XOfIQAAAAAGDMUX4BY86ffactW9uP5qM/dlEunD0lv/ja5Vk6c2J+4/OP5XjvQO7etD9Jct1S5RcAAAAAwFjj2ENgVPrG9/fmVz/7aAaqg2cHjvXm1pWzcv2yGUmSxvpKPnrbRfnJT67Ptb/9jXT3DeTC2ZPTOrFpmFMDAAAAAHCmKb+AUenvN+xIb381b7x41qDZxKb6vPfGJS+4tmpJa373x1fmwe0HkyRvumjwcwAAAAAAjH7KL2DU6Ruo5p7N7bn1kln5rbdefMrPvePKeXnHlfPOYDIAAAAAAGpN+QWMSL391ew91J0kmTWlOfV1P1hR+OC2gznc058bnjvWEAAAAAAA/pnyCxhxevurecsf350n9hxOkly1cGr+9j2rUqkUSZLvPrU/dZUiq5dOr2VMAAAAAABGoMrL3wIwvD617uk8sedw/v3rlue9Ny7J/U8fyGce3Hli/p2n9ufy+S2ZMq6hdiEBAAAAABiRvPkFjCidR3vz8W9syo3LZ+Tf/ciyVKtl1rV15He/8kTeeNG5Od43kEd3duUDr19e66gAAAAAAIxAyi9g2FWrZe58YEcO9/QPmq3b0pGjvQP5tTdfkCSpVIr8xq0r8vY/XZv/8A+PZGLTs79s3bh85rBmBgAAAABgdFB+AcPurs3t+eA/PPKi8/fdtCTLzpl04vMVC6bmndfMz1/fuy1JsqB1fC6cPfmM5wQAAAAAYPRRfgHD7p7N7Wmsq+TuX7k5TfV1L5gVRTK5efAur99668X5D7ecnyQZ31iXSqUYlqwAAAAAAIwuyi9g2N29qT2XL2jJzEnNp/XclHGDSzEAAAAAAHg+5Rcw5O5t68jf3LctZZLZLePywTecl6J49k2tjiM9eXz3oXzg9ctrGxIAAAAAgDFJ+QUMqf6Ban7lM49m/+GeTBnXkJ0Hd+WSuS255aJzkyRrt3QkSdYsnV7LmAAAAAAAjFGVWgcAxpbPPLgzW9uP5vd+4pJ855dvyuLpE/L7X3sq1WqZ5Nl9X5Oa63PxnCk1TgoAAAAAwFik/AKGTN9ANR//xqZcPGdKXr/inNTXVfILr12WJ/cezhcf252yLHPXpvasWtya+jq//AAAAAAAMPQcewictjsf2JEn9xwadH3Xwe7sOHA8H73tohM7vm5dOTt//M3N+diXnsh9Wzuz8+Dx/NyNi4c7MgAAAAAAZwnlF3BaDnX35YN3Ppz6SiX1dcWg+Y+cPzM3nTfjxOe6SpEPven8/MKnH8qdD+zIjElNec35M4czMgAAAAAAZxHlF3BaNjzdmWqZ/M+fviqrl0w/pWdec/45efQ/veEMJwMAAAAAADu/gNO0vq0zjXWVXD5/aq2jAAAAAADAIN78Al7g6faj+Y//+Gh6+6tpqq/Lx95+ceZOHX9ivm5LRy6d35LmhroapgQAAAAAgJPz5hfwAn/0zc3Z8PSBNNRVct/Wzvy3b285Mes63peNu7qyanFrDRMCAAAAAMCLU34BJ+zuOp7PPbQzP3n1/Pz1z16bt18xJ3c+sCP7D/ck+cG+r2uVXwAAAAAAjFDKL+CEv7h7a8ok//r6RUmSn71+cfoGqvlfa59O8uyRh431lVw2v6V2IQEAAAAA4CXY+QVnmUPdfdm09/Cg630DZf763m350ZWzTuz4WjxjYt6w4tx8at3TuX7Z9Ny1qT2X2/cFAAAAAMAIpvyCs8wH//6RfHnjnpPOiiJ5zw1LXnDtvTctyZc37sm/+MT6JMkHXr/8jGcEAAAAAIBXSvkFZ5GBapl7Nrfn9SvOyR3XLhg0nzahMStmT37BtUvnteSf3n9dDhzrTV2lyBULpg5XXAAAAAAAOG3KLziLbNzVlcM9/Xnzylm5YfmMU37u4rlTzmAqAAAAAAAYOsovGEOO9PTnzR+/K7u7ulMk+dU3XZB/uXrhifn6to4kyarFrbUJCAAAAAAAZ1il1gGAofPZB3fmmY5j+RdXzsui6RPy37+zJf0D1RPz9W2dWTxjQmZObq5hSgAAAAAAOHOUXzBGlGWZ/7P+mVw0Z3I+ctuF+aXXLc/uru5884l9SZL+gWru29qZa731BQAAAADAGKb8gjFiwzMH8sSew7njmgUpiiI/cv7MzJrSnP+9/pkkycZdh3Kkp9+RhwAAAAAAjGnKLxgj/mr9M5nUXJ+3XDo7SVJfV8lPXj0/d21qz9PtR0/s+7pm8bRaxgQAAAAAgDOqvtYBgFO3dnN7fvnORzJQLQfN9h3uzrtXLcz4xh/8Z337VfPy8W9sylv++O70DZRZOnNiZk6y7wsAAAAAgLFL+QWjyOce2pWDx3pz68rZg2YN9UXee+OSF1ybObk5//nHLsqD2w4mSV5/4TnDkhMAAAAAAGpF+QUjyDMdR/P93YeTJBfMmpQFrRNeMF/X1pHVS6fnd3585Sl/zduvnp/br54/pDkBAAAAAGCkUn7BCFGWZd79F/flmY5jSZJ508blOx+4OZVKkSTZefB4tnUey0+tXljDlAAAAAAAMLJVah0AeNaGZw7kmY5j+dAbz8+vvfmCbO88nvue7jwxX7elI0myaklrrSICAAAAAMCIp/yCEeIz39uR8Y11uePaBXnnNfMzobEun/nejhPzdVs6MnV8Q847Z1INUwIAAAAAwMim/IIRoLtvIF94eHduuejcTGiqz/jG+rzp4ln54qN7crx3IGVZZn1bR65Z1HriGEQAAAAAAGAw5ReMAF97fG8O9/Tn7ZfPPXHtbZfPzZGe/nz18T3Z3nk8Ow8ed+QhAAAAAAC8jPpaB4CzRU//QH77i0+k63jfoNlD2w9m9pTmrFr8g3LrmkXTMqdlXH7/a0/lnMnNSez7AgAAAACAl6P8gmGydktH/v/27jzIruq+E/j3dLf2fZcsdgkkhLExKBjwwiIg2HGFmYyT4ExmPIkzjif2JM44i5NUPBOnUjWZyiQznjhJUbETx0ns2CS2iR3HC8LGBgwIYxZJLJIAobXRDhLaus/80U+NFkCv3UItXX0+VV1699x7j37voR/9Xn/7nvvXdz2VWRNGZljnkRdd/per5x6ypGFHR8n7r56bv/j2yqzfvjtXzZuWc6ePPZ4lAwAAAADASUf4BcfIvU9uyc13rEpSM2P8yHz0xtem86Aw63srN2d4Z0cWf+iqjBre2dacP/PGM/IzbzzjVaoYAAAAAACaxz2/4Bj5f4ufyN0rN2XVpp35u3tW594ntxyy/+5Vm3PRGRPbDr4AAAAAAICBE37BMbB1597ctXJz/sPlZ+XL//XNGTmsI//y8Pr+/dtf2JdH1m4/5J5eAAAAAADAsSf8gmPga0s3pKe35h2vm5XRw7uyaP6MfPWRvrGkb0nE3ppcPkf4BQAAAAAArybhFxwDX3l4fc6YPDoXvGZ8kuTtF87Kpuf39C99ePfKzRnR1ZE3nDFxKMsEAAAAAIDGE37BIB1Y8vDtF85KKSVJcvX8aYcsfXj3qs255MxJGdHlfl8AAAAAAPBq6hrqAuBkcc+qzXl843NHjC9bv6N/ycMDDix9+C8Pr88508Zk+fod+bXrzzue5QIAAAAAwClJ+AVt2NfTm/d8akme37P/JffPmzGuf8nDA37i4tn5ysPr83v/vCwdJbl6/vTjUSoAAAAAAJzShF+QZOm67fl3f35Xdu/rzfCujvz9L7wxC8+a3L//oTXb8vye/fmjn3x9rpo37Yjzx48c1r/k4QGLzp+RBz9yffb19mZEV0fGjRz2qj8PAAAAAAA41bnnFyS59Qfr0tNb88vXzE1XR8kXHlh7yP67VmxOKcmi+dMzdeyII76Gd710K00YPSxTx44QfAEAAAAAwHEi/OKUV2vN15ZuyOVzpua/XT8vV543Ld9YtjG9vbX/mLtWbs6CWeMzaczwIawUAAAAAAA4GuEXp7wV3c/nqc27cv2CGUmS6y+Yke7n9uTBNduSJLv39eT+1VtzxZwpQ1kmAAAAAADQBuEXp7yvL9uYJLmuFX5dM29GujpK//j3n96avft7c8WcqUNWIwAAAAAA0B7hF6e8ry3dkDecMTEzxo9M0nefrsvOmZKvL92QpG/Jw86Okh85e/JQlgkAAAAAALSha6gLgONh8/N78sDqbUeM79y7Pw+t2Z7fvGH+IePXXzAjH/nS0nx+yTP55vKNef1pEzJ2hHYBAAAAAIATnZ/m0wi79u7Pc7v3pySZNm5ESimH7P/dLz2Sf3l4w0ue21GSH71gxiFj1y2Ykd//8rL8+i0PJUl+9drzXpW6AQAAAACAY0v4xUnvhb09edP/XJytu/YlSX7xynPyW287v39/T2/Nd5/YlLe9dmZ+6aq5R5w/flRXzpwy5pCxWRNGZfGHrsq2XftSSjJv5rhX90kAAAAAAADHhPCLk953nng2W3fty/uvnpM7V2zOlx9cnw/fML//6q+l67Znx+79ueG1M3PhaRPanvf0yaNzutt8AQAAAADASaVjqAuAwfrm8o0ZN7IrH7z2vLzr0tOzdtsLWb7+uf79d67YnCS5fM6UoSoRAAAAAAA4ToRfnNR6emtuW96dq+dNz7DOjlwzf0ZKSb6xbGP/MXet3JTzZozN9HEjh7BSAAAAAADgeBB+cVL7wTNbs3nn3ly3YEaSZNq4EXnD6RPzzeV94dee/T2576ktuWLO1KEsEwAAAAAAOE6EX5zUvrGsO10dJVfOm9Y/du2CGXl47fas3/5CHli9Lbv39eYKSx4CAAAAAMApoWuoC4Cj2dfTm/ue2pL9PfWIfV9buiGXnTMl40cO6x+7fsGM/K9/fSx/dedT2bpzbzpK8sZzhF8AAAAAAHAqEH4x5J7atDMPrtmWJJk/c3zmzRx3yP7PL1mT3/7Cwy97/nvefPYh23Omjc3c6WNz8x2rkiQLz5yUCaOGvdSpAAAAAABAwwi/GHK/9Hffz7L1O5IkM8aPyN0fXpSOjtK//9uPd2f2xFH52LsuOuLcro6OvHb2hEPGSin5zH++LKu37EySnDN17KtYPQAAAAAAcCIRfjGk1mzdlWXrd+QDV8/NpDHD8/tfXpaH127P60+fmCTp6a25a+Xm/NiFs3LJmZPbnnfauBGZNm7Eq1U2AAAAAABwguoY6gI4tS1+tDtJ8m8vnp2feMPsdJTktuUb+/c/vHZ7ntu9P1fMnTpUJQIAAAAAACcR4RdD6pvLu3P21DGZM21sJo0ZnkvOnJRvLu/u33/nik1JkivmTBmqEgEAAAAAgJOI8Ishs3PP/nxv5eYsmj+9f+ya+TOybP2OrN/+QpLku09syvmzxmfqWEsYAgAAAAAARyf8Ysh854lN2dvTm0Xnz+gfu/b8viDstuXdeWFvT+5/emvePNdVXwAAAAAAQHu6hroAmu+byzZmy869R4z/80PrMn5kVxaeNal/bO70sTlj8uh8/v41Wb/9hezt6c2b3O8LAAAAAABo00kXft3+aHce3/hckuTq+dNz3oxxAzq/p7fms/etzvO796ersyPvvPi0TBg9bEBzbHp+T774wNr09NZMGj08P7nwtJRSBjTHI2u399/PasFrxuct504b0PlJ8vWlG/Lkpp1JkmsXzMicaWMHdP6+nt589r5nsmvP/gzr7MhPLjwt40YO7LXo3rE7X/rBuvTWmqljR+QnLp59yGvx6IYd+YW/WfKy5//UwtMyrPPFCxBLKXnH62blz761Mg8+sy3jRnbl0rMnD6gmAAAAAADg1HVShV/P79mf9356Sfb11CR9S+N97n2XD2iOO554Nr/zhUf6t5/bvS8fvPa8Ac1x8x2rcvMdq/q3z5o6ZsABzW/+40NZum5HkmTM8M58/yPXZURXZ9vnb9m5N+/72/vT2/dS5K6Vm/Opn790QDV8c9nG/O4XX3wt9vX05hevnDOgOT62+In87fdW92/Pmzkur509oX/7u0/0BXy3fuBNmfIS9+2aOX7kEWO/dv28/OxlZ6YmGT+yK6OHn1T/TAEAAAAAgCF0Ut3z67tPPJt9PTWffs+led+Vc3L/6q3ZtuvI5fReyeLl3Rk1rDM/+Mh1ecMZE3P7o90DruO25Rvz5rlTc+/vLEpXR8niAc6xYfvuLF23Ix+67rz8xc9enJ17e3Lvk1sGNMe3H+9Ob00+/77L85+uOCt3r9qcXXv3D2iO2x7tzviRXXn4f1yf+TPHDfh51FqzeHl3rj1/eu788DUpJUfMceeKTTln6pi87rSJmT1x1BFfnR1HXjHX0VHymtb+gV6JBgAAAAAAnNpOqvDrtuV9Yc3l50zJdQtmpKe35tuPP9v2+bXWLH60O2+aOzUTRw/PovnT8+Ca7el+bnfbczy9eWdWPrszi86fnunjRuZHzpqcxY9uHNDzOBAQXX/BzFx53vSM6OrIbcsHFjzdtrw7U8eOyCVnTMp1C2Zk7/7e3Llic9vn9/bWfOux7lw5b3rGjRyWa+ZPz5Knt2b7rn1tz/HohueybvvuXHv+jMyeOCqvP21ibjso/NrX05t7n9ySK+ZOGdBzAwAAAAAA+GGdNOFXb2/N7Y89myvnTU9XZ0cuOn1iJo8ZPqArtx7f+HzWbnshi86fniS5Zv6MJMm3Hms/QDsQXF0zv2+ORedPz+Mbn88zW3YNaI7ZE0flvBljM2p4Z66YMyWLH+1OrbWt8/f19OaOx5/NNfOnpaOj5EfOmpyxI7oGFMI9tHZ7Nj2/N4sOeh49vTV3PDHw1+LqA3PMn56H1mzLs8/tSZI8+My27NzbkzfNmdr2nAAAAAAAAINx0oRfD6/dnk3P7+kPazo7Sq6aNy3fevzZ7O/pbWuO21rh0NXz+uY4f9a4zJowMosHcNXV4ke7M3f62Jw5ZUySF0Ow2x9rb47d+3py54pNWXT+9JTSt+TfNefPyOotu7Ly2Z1tzXH/01uzY/f+/vBueFdH3nre1AEFaIuXb0xHSa48b1qS5KLTJ2XS6GEDWvpw8aPduXD2hMxo3bfrmvOnp9bkW63X4s4Vm1NKcvkcV34BAAAAAADHx0kTft32aPchYU3SFzxt27UvDzyzra05Fi/vzgWvGZ+ZE/rCmlJKrp4/Pd954tns2d9z1POf37M/31u1uT/wSpJzpo3NWVNGt71s4d2rNueFfT39V0sdeB5J2r5ya/Gj3RnWWfLmc1+8ourqedOzcceeLF23o605bnu0OxefMSmTxgxPciBMnJ5vPdadnt6jB2hbdu7N91dvPeR5LJg1PjPHj+wP0O5cuSkXvGZ8Jo4e3lZNAAAAAAAAg9U11AUcbuuuvfn8kmeOGP/KQ+sOCWuS5C3nTktXR8knv/tkntr0yldN9fTWfH/11nzg6rmHjC+aPz1/f8/qfHzxipw+efQrzrGi+/ns66mHhF9J3/KJf3vP0/nckmdSjvL8vvrIhowa1pnLz3nxaqjZE0dl/sxx+eID6zKpjaDoXx/ZkMvOmZKxI178z3fVvOkpJbn5jlV5y7mvvMzgnv29WbpuR37jhnmHPY/p+cIDa/Nnt6/oDwhfztJ1O1Jr+q/ES14ME//5wXX53JJn8sDqrfn5N5191OcDAAAAAABwrJxw4dearS/k12956CX3/e47zjxke8KoYXnzuVPz1Uc25KuPbGhr/h997cxDtq+YMzUTRg3LxxavaOv8aeNG5JIzJx0y9vYLZ+aTdz6Z33iZug/3Y6+blZHDOg+bY1b++BuPv+xzP9z7rpxzRF2XnjU5tz64Lrc+uO6o53eU5PoFh74Wbz1vWsYM78z//sbjbdUwe+KoXDh7wiFjb79wZj5z7+r+1+LwoBAAAAAAAODVVNq9R9Tx8rqLLq5fWfzdI8Y7O0pmTRjZf5+sA/bu783GHbvbmnv08M5MGTviiPEdu/dl+659bc0xaczwQ664OuDZ5/Zk976jL52YJDMnjMywzkNXnKy1Zt323eltY8nBrs6SmeOPfC127+vJs8/taauGMSO6MnnMkVeZbX9hX3a80N5rMXnM8Ix5idei+7nd2bOvNyOGdWT6uFe+ggwAAAAAAOCAUsr9tdaFg5rjRAu/Fi5cWJcsWTLUZQAAAAAAAHCcHYvwq+PohwAAAAAAAMDJQfgFAAAAAABAYwi/AAAAAAAAaAzhFwAAAAAAAI0h/AIAAAAAAKAxhF8AAAAAAAA0hvALAAAAAACAxhB+AQAAAAAA0BjCLwAAAAAAABpD+AUAAAAAAEBjCL8AAAAAAABoDOEXAAAAAAAAjSH8AgAAAAAAoDGEXwAAAAAAADSG8AsAAAAAAIDGEH4BAAAAAADQGMIvAAAAAAAAGqOt8KuUckMp5bFSyopSyodfYv+IUso/tPbfU0o5qzV+VinlhVLKD1pff3FsywcAAAAAAIAXdR3tgFJKZ5KPJ7kuyZok95VSbq21LjvosPck2VprnVtKuSnJHyb56da+lbXWi45x3QAAAAAAAHCEdq78ujTJilrrqlrr3iSfTXLj/trBmQAAEFVJREFUYcfcmORTrce3JFlUSinHrkwAAAAAAAA4unbCr9lJnjloe01r7CWPqbXuT7I9yZTWvrNLKQ+UUr5dSnnLIOsFAAAAAACAl3XUZQ8HaX2SM2qtm0splyT5YinlglrrjoMPKqW8N8l7k+SMM854lUsCAAAAAACgqdq58mttktMP2j6tNfaSx5RSupJMSLK51rqn1ro5SWqt9ydZmeS8w/+CWuvNtdaFtdaF06ZNG/izAAAAAAAAgLQXft2X5NxSytmllOFJbkpy62HH3Jrk3a3H70yyuNZaSynTSimdSVJKOSfJuUlWHZvSAQAAAAAA4FBHXfaw1rq/lPKBJF9L0pnkk7XWpaWUjyZZUmu9Ncknkny6lLIiyZb0BWRJ8tYkHy2l7EvSm+R9tdYtr8YTAQAAAAAAgFJrHeoaDrFw4cK6ZMmSoS4DAAAAAACA46yUcn+tdeFg5mhn2UMAAAAAAAA4KQi/AAAAAAAAaAzhFwAAAAAAAI0h/AIAAAAAAKAxhF8AAAAAAAA0hvALAAAAAACAxhB+AQAAAAAA0BjCLwAAAAAAABpD+AUAAAAAAEBjCL8AAAAAAABoDOEXAAAAAAAAjSH8AgAAAAAAoDGEXwAAAAAAADSG8AsAAAAAAIDGEH4BAAAAAADQGMIvAAAAAAAAGkP4BQAAAAAAQGMIvwAAAAAAAGgM4RcAAAAAAACNIfwCAAAAAACgMYRfAAAAAAAANIbwCwAAAAAAgMYQfgEAAAAAANAYwi8AAAAAAAAaQ/gFAAAAAABAYwi/AAAAAAAAaAzhFwAAAAAAAI0h/AIAAAAAAKAxhF8AAAAAAAA0hvALAAAAAACAxhB+AQAAAAAA0BjCLwAAAAAAABpD+AUAAAAAAEBjCL8AAAAAAABoDOEXAAAAAAAAjSH8AgAAAAAAoDGEXwAAAAAAADSG8AsAAAAAAIDGEH4BAAAAAADQGMIvAAAAAAAAGkP4BQAAAAAAQGMIvwAAAAAAAGgM4RcAAAAAAACNIfwCAAAAAACgMYRfAAAAAAAANIbwCwAAAAAAgMYQfgEAAAAAANAYwi8AAAAAAAAaQ/gFAAAAAABAYwi/AAAAAAAAaAzhFwAAAAAAAI0h/AIAAAAAAKAxhF8AAAAAAAA0hvALAAAAAACAxhB+AQAAAAAA0BjCLwAAAAAAABpD+AUAAAAAAEBjCL8AAAAAAABoDOEXAAAAAAAAjSH8AgAAAAAAoDGEXwAAAAAAADSG8AsAAAAAAIDGEH4BAAAAAADQGMIvAAAAAAAAGkP4BQAAAAAAQGMIvwAAAAAAAGgM4RcAAAAAAACNIfwCAAAAAACgMYRfAAAAAAAANIbwCwAAAAAAgMYQfgEAAAAAANAYwi8AAAAAAAAaQ/gFAAAAAABAYwi/AAAAAAAAaAzhFwAAAAAAAI0h/AIAAAAAAKAxhF8AAAAAAAA0hvALAAAAAACAxhB+AQAAAAAA0BjCLwAAAAAAABpD+AUAAAAAAEBjCL8AAAAAAABoDOEXAAAAAAAAjSH8AgAAAAAAoDGEXwAAAAAAADSG8AsAAAAAAIDGEH4BAAAAAADQGMIvAAAAAAAAGkP4BQAAAAAAQGMIvwAAAAAAAGgM4RcAAAAAAACNIfwCAAAAAACgMYRfAAAAAAAANIbwCwAAAAAAgMYQfgEAAAAAANAYwi8AAAAAAAAaQ/gFAAAAAABAYwi/AAAAAAAAaAzhFwAAAAAAAI0h/AIAAAAAAKAxhF8AAAAAAAA0hvALAAAAAACAxhB+AQAAAAAA0BjCLwAAAAAAABpD+AUAAAAAAEBjCL8AAAAAAABoDOEXAAAAAAAAjSH8AgAAAAAAoDGEXwAAAAAAADSG8AsAAAAAAIDGEH4BAAAAAADQGMIvAAAAAAAAGkP4BQAAAAAAQGMIvwAAAAAAAGgM4RcAAAAAAACNIfwCAAAAAACgMYRfAAAAAAAANIbwCwAAAAAAgMYQfgEAAAAAANAYwi8AAAAAAAAaQ/gFAAAAAABAYwi/AAAAAAAAaAzhFwAAAAAAAI0h/AIAAAAAAKAxhF8AAAAAAAA0hvALAAAAAACAxhB+AQAAAAAA0BjCLwAAAAAAABpD+AUAAAAAAEBjCL8AAAAAAABojLbCr1LKDaWUx0opK0opH36J/SNKKf/Q2n9PKeWsg/b9Vmv8sVLKjx670gEAAAAAAOBQRw2/SimdST6e5G1JFiR5VyllwWGHvSfJ1lrr3CR/kuQPW+cuSHJTkguS3JDkz1rzAQAAAAAAwDHX1cYxlyZZUWtdlSSllM8muTHJsoOOuTHJ/2g9viXJn5ZSSmv8s7XWPUmeLKWsaM1398v+bfffn5QywKcBAAAAAAAA7S17ODvJMwdtr2mNveQxtdb9SbYnmdLmuSmlvLeUsqSUsqT90gEAAAAAAOBQbd3z69VWa7251rqw1rpwqGsBAAAAAADg5NXOsodrk5x+0PZprbGXOmZNKaUryYQkm9s891CXXJIscQEYAAAAAADAKecY3BqrnSu/7ktybinl7FLK8CQ3Jbn1sGNuTfLu1uN3Jllca62t8ZtKKSNKKWcnOTfJvYOuGgAAAAAAAF7CUa/8qrXuL6V8IMnXknQm+WStdWkp5aNJltRab03yiSSfLqWsSLIlfQFZWsd9LsmyJPuTvL/W2vMqPRcAAAAAAABOcaXvAq0Tx8KFC+sSyx4CAAAAAACcckop99daFw5mjnaWPQQAAAAAAICTgvALAAAAAACAxhB+AQAAAAAA0BjCLwAAAAAAABpD+AUAAAAAAEBjCL8AAAAAAABoDOEXAAAAAAAAjSH8AgAAAAAAoDGEXwAAAAAAADSG8AsAAAAAAIDGEH4BAAAAAADQGMIvAAAAAAAAGkP4BQAAAAAAQGMIvwAAAAAAAGgM4RcAAAAAAACNIfwCAAAAAACgMYRfAAAAAAAANIbwCwAAAAAAgMYQfgEAAAAAANAYwi8AAAAAAAAaQ/gFAAAAAABAYwi/AAAAAAAAaAzhFwAAAAAAAI0h/AIAAAAAAKAxhF8AAAAAAAA0hvALAAAAAACAxhB+AQAAAAAA0BjCLwAAAAAAABpD+AUAAAAAAEBjCL8AAAAAAABoDOEXAAAAAAAAjSH8AgAAAAAAoDGEXwAAAAAAADSG8AsAAAAAAIDGEH4BAAAAAADQGMIvAAAAAAAAGkP4BQAAAAAAQGMIvwAAAAAAAGgM4RcAAAAAAACNIfwCAAAAAACgMYRfAAAAAAAANIbwCwAAAAAAgMYQfgEAAAAAANAYwi8AAAAAAAAao9Rah7qGQ5RSnkvy2FDXASe5qUk2DXURcBLTQzA4eggGRw/B4OkjGBw9BIOjh2Bw5tVaxw1mgq5jVckx9FitdeFQFwEns1LKEn0EPzw9BIOjh2Bw9BAMnj6CwdFDMDh6CAanlLJksHNY9hAAAAAAAIDGEH4BAAAAAADQGCdi+HXzUBcADaCPYHD0EAyOHoLB0UMwePoIBkcPweDoIRicQfdQqbUei0IAAAAAAABgyJ2IV34BAAAAAADAD+WECr9KKTeUUh4rpawopXx4qOuBE1Ep5ZOllO5SyiMHjU0upXyjlPJE689JrfFSSvlYq6ceKqVcPHSVw4mhlHJ6KeX2UsqyUsrSUsqvtMb1EbSplDKylHJvKeXBVh/9Xmv87FLKPa1++YdSyvDW+IjW9orW/rOGsn44UZRSOkspD5RSvtza1kPQplLKU6WUh0spPyilLGmNeT8HbSqlTCyl3FJKebSUsryUcrkegvaVUua1vgcd+NpRSvmgPoL2lVJ+tfUzhUdKKZ9p/azhmH0mOmHCr1JKZ5KPJ3lbkgVJ3lVKWTC0VcEJ6a+T3HDY2IeT3FZrPTfJba3tpK+fzm19vTfJnx+nGuFEtj/Jh2qtC5JcluT9re83+gjatyfJNbXW1ye5KMkNpZTLkvxhkj+ptc5NsjXJe1rHvyfJ1tb4n7SOA5JfSbL8oG09BANzda31olrrwta293PQvv+b5F9rrfOTvD5934/0ELSp1vpY63vQRUkuSbIryReij6AtpZTZSX45ycJa62uTdCa5KcfwM9EJE34luTTJilrrqlrr3iSfTXLjENcEJ5xa6x1Jthw2fGOST7UefyrJvzlo/G9qn+8lmVhKmXV8KoUTU611fa31+63Hz6XvQ97s6CNoW6sfnm9tDmt91STXJLmlNX54Hx3or1uSLCqllONULpyQSimnJfmxJH/Z2i7RQzBY3s9BG0opE5K8NcknkqTWurfWui16CH5Yi5KsrLU+HX0EA9GVZFQppSvJ6CTrcww/E51I4dfsJM8ctL2mNQYc3Yxa6/rW4w1JZrQe6yt4Ba1LpN+Q5J7oIxiQ1nJtP0jSneQbSVYm2VZr3d865OBe6e+j1v7tSaYc34rhhPN/kvxGkt7W9pToIRiImuTrpZT7SynvbY15PwftOTvJs0n+qrX87l+WUsZED8EP66Ykn2k91kfQhlrr2iR/lGR1+kKv7UnuzzH8THQihV/AMVBrren7IAi8glLK2CT/mOSDtdYdB+/TR3B0tdae1hIfp6XvCv75Q1wSnDRKKe9I0l1rvX+oa4GT2JtrrRenbxmp95dS3nrwTu/n4BV1Jbk4yZ/XWt+QZGdeXJotiR6CdrXuR/TjST5/+D59BC+vdT+8G9P3CxmvSTImR97qZ1BOpPBrbZLTD9o+rTUGHN3GA5dKt/7sbo3rK3gJpZRh6Qu+/q7W+k+tYX0EP4TWEjm3J7k8fUt3dLV2Hdwr/X3U2j8hyebjXCqcSN6U5MdLKU+lb7n3a9J37xU9BG1q/bZwaq3d6bvHyqXxfg7atSbJmlrrPa3tW9IXhukhGLi3Jfl+rXVja1sfQXuuTfJkrfXZWuu+JP+Uvs9Jx+wz0YkUft2X5NxSytmtxPymJLcOcU1wsrg1ybtbj9+d5EsHjf/H0ueyJNsPuvQaTkmt9YA/kWR5rfWPD9qlj6BNpZRppZSJrcejklyXvvvn3Z7kna3DDu+jA/31ziSLW78FCaekWutv1VpPq7Welb7PPYtrrf8+egjaUkoZU0oZd+BxkuuTPBLv56AttdYNSZ4ppcxrDS1Ksix6CH4Y78qLSx4m+gjatTrJZaWU0a2f1R34XnTMPhOVE+kzUynl7elb+74zySdrrX8wxCXBCaeU8pkkVyWZmmRjkv+e5ItJPpfkjCRPJ/mpWuuW1v84/jR9l4zuSvJztdYlQ1E3nChKKW9O8p0kD+fF+6z8dvru+6WPoA2llNel70aznen7ZarP1Vo/Wko5J31XsUxO8kCSn6217imljEzy6fTdY29LkptqrauGpno4sZRSrkrya7XWd+ghaE+rV77Q2uxK8ve11j8opUyJ93PQllLKRUn+MsnwJKuS/Fxa7+uih6AtrV/AWJ3knFrr9taY70XQplLK7yX56ST70/f55xfSd2+vY/KZ6IQKvwAAAAAAAGAwTqRlDwEAAAAAAGBQhF8AAAAAAAA0hvALAAAAAACAxhB+AQAAAAAA0BjCLwAAAAAAABpD+AUAAAAAAEBjCL8AAAAAAABoDOEXAAAAAAAAjfH/AX7b7e0OU2TZAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<Figure size 2160x1440 with 1 Axes>"
      ]
     },
     "metadata": {
      "needs_background": "light"
     },
     "output_type": "display_data"
    }
   ],
   "source": [
    "import matplotlib.pyplot as plt\n",
    "%matplotlib inline\n",
    "\n",
    "plt.figure(figsize=(30,20))\n",
    "plt.plot(my_agent.deep_q.qvalue_evolution)\n",
    "plt.axhline(y=0, linewidth=3, color='red')\n",
    "_ = plt.xlim(0, len(my_agent.deep_q.qvalue_evolution))"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A loss trained for 100000 iterations on 8 cores, for a ddqn agent and default parameters can look like:\n",
    "![](img/qvalue.png)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### II c) Assess the performance of the trained agent"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "First we evaluate the performance of a baseline, in this case the \"do nothing\" agent.\n",
    "\n",
    "**NB** The use of a Runner (see the first notebook) is particurlaly suited for that purpose. We are showing here how to quickly assess the performances."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 15,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "48c8d6fdf4e74a1fbdd7374b0b86c536",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "HBox(children=(FloatProgress(value=0.0, description='episode', max=2.0, style=ProgressStyle(description_width=…"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "9d58a792ca0a4477ac141fda3a23eff2",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "HBox(children=(FloatProgress(value=1.0, bar_style='info', description='episode', max=1.0, style=ProgressStyle(…"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n"
     ]
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "446289d49f954f3a997384890cb3c901",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "HBox(children=(FloatProgress(value=1.0, bar_style='info', description='episode', max=1.0, style=ProgressStyle(…"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "\n",
      "The results for the DoNothing agent are:\n",
      "\tFor chronics with id 000\n",
      "\t\t - cumulative reward: 122885.137597\n",
      "\t\t - number of time steps completed: 100 / 100\n",
      "\tFor chronics with id 001\n",
      "\t\t - cumulative reward: 122958.161930\n",
      "\t\t - number of time steps completed: 100 / 100\n"
     ]
    }
   ],
   "source": [
    "NB_EPISODE = 2\n",
    "max_iter = 100\n",
    "# tun the do nothing for the whole episode\n",
    "dn_agent = grid2op.Agent.DoNothingAgent(env.action_space)\n",
    "runner = Runner(**env.get_params_for_runner(), agentInstance=dn_agent, agentClass=None)\n",
    "res = runner.run(nb_episode=NB_EPISODE, max_iter=max_iter, pbar=tqdm)\n",
    "print(\"The results for the DoNothing agent are:\")\n",
    "for _, chron_id, cum_reward, nb_time_step, max_ts in res:\n",
    "    msg_tmp = \"\\tFor chronics with id {}\\n\".format(chron_id)\n",
    "    msg_tmp += \"\\t\\t - cumulative reward: {:.6f}\\n\".format(cum_reward)\n",
    "    msg_tmp += \"\\t\\t - number of time steps completed: {:.0f} / {:.0f}\".format(nb_time_step, max_ts)\n",
    "    print(msg_tmp)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "Then we load the saved neural network, and we can now evaluate the fixed policy:"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 16,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Successfully constructed networks.\n",
      "Succesfully loaded network.\n"
     ]
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "3763ebf61b5c4ba78a6e2333a8d30438",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "HBox(children=(FloatProgress(value=0.0, description='episode', max=2.0, style=ProgressStyle(description_width=…"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "c5377dd831ed4a8984517b7ab7698601",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "HBox(children=(FloatProgress(value=1.0, bar_style='info', description='episode', max=1.0, style=ProgressStyle(…"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n"
     ]
    },
    {
     "data": {
      "application/vnd.jupyter.widget-view+json": {
       "model_id": "43ce14aca8e14da9b03b75cb71b13f44",
       "version_major": 2,
       "version_minor": 0
      },
      "text/plain": [
       "HBox(children=(FloatProgress(value=1.0, bar_style='info', description='episode', max=1.0, style=ProgressStyle(…"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\n",
      "\n",
      "The results for the DoNothing agent are:\n",
      "\tFor chronics with id 000\n",
      "\t\t - cumulative reward: 122885.137597\n",
      "\t\t - number of time steps completed: 100 / 100\n",
      "\tFor chronics with id 001\n",
      "\t\t - cumulative reward: 122958.161930\n",
      "\t\t - number of time steps completed: 100 / 100\n"
     ]
    }
   ],
   "source": [
    "obs = env.reset()\n",
    "trained_agent = DeepQAgent(env.action_space, mode=\"DDQN\", training_param=TrainingParam())\n",
    "trained_agent.init_deep_q(trained_agent.convert_obs(obs))\n",
    "trained_agent.load_network(\"saved_notebook6_{}\".format(agent_name))\n",
    "runner = Runner(**env.get_params_for_runner(), agentInstance=trained_agent, agentClass=None)\n",
    "res = runner.run(nb_episode=NB_EPISODE, max_iter=max_iter, pbar=tqdm)\n",
    "print(\"The results for the DoNothing agent are:\")\n",
    "for _, chron_id, cum_reward, nb_time_step, max_ts in res:\n",
    "    msg_tmp = \"\\tFor chronics with id {}\\n\".format(chron_id)\n",
    "    msg_tmp += \"\\t\\t - cumulative reward: {:.6f}\\n\".format(cum_reward)\n",
    "    msg_tmp += \"\\t\\t - number of time steps completed: {:.0f} / {:.0f}\".format(nb_time_step, max_ts)\n",
    "    print(msg_tmp)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "A default DDQN agent trained on 8 cores on 1000000 steps (so 8e6 steps in total), 24h of training on a laptop achieved to perform 5637 steps, largely outperforming the \"do nothing\" agent (which did only 2180 steps on the same 2 environment)."
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.6"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}