{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 一.损失函数\n",
    "\n",
    "这一节对xgboost回归做介绍，xgboost共实现了5种类型的回归，分别是squarederror、logistic、poisson、gamma、tweedie回归，下面主要对前两种进行推导实现，剩余三种放到下一节  \n",
    "\n",
    "#### squarederror\n",
    "即损失函数为平方误差的回归模型：  \n",
    "\n",
    "$$\n",
    "L(y,\\hat{y})=\\frac{1}{2}(y-\\hat{y})^2\n",
    "$$  \n",
    "\n",
    "所以一阶导和二阶导分别为：   \n",
    "\n",
    "$$\n",
    "\\frac{\\partial L(y,\\hat{y})}{\\partial \\hat{y}}=\\hat{y}-y\\\\\n",
    "\\frac{\\partial^2 L(y,\\hat{y})}{{\\partial \\hat{y}}^2}=1.0\\\\\n",
    "$$  "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "#### logistic\n",
    "\n",
    "由于是回归任务，所以y也要套上`sigmoid`函数（用$\\sigma(\\cdot)$表示），损失函数：   \n",
    "\n",
    "$$\n",
    "L(y,\\hat{y})=(1-\\sigma(y))log(1-\\sigma(\\hat{y}))+\\sigma(y)log(\\sigma(\\hat{y}))\n",
    "$$\n",
    "\n",
    "一阶导和二阶导分别为：   \n",
    "\n",
    "$$\n",
    "\\frac{\\partial L(y,\\hat{y})}{\\partial \\hat{y}}=\\sigma(\\hat{y})-\\sigma(y)\\\\\n",
    "\\frac{\\partial^2 L(y,\\hat{y})}{{\\partial \\hat{y}}^2}=\\sigma(\\hat{y})(1-\\sigma(\\hat{y}))\\\\\n",
    "$$   \n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### 二.代码实现\n",
    "具体流程与gbdt的回归类似，只是每次要计算一阶、二阶导数信息，同时基学习器要替换为上一节的xgboost回归树"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 1,
   "metadata": {},
   "outputs": [],
   "source": [
    "import os\n",
    "os.chdir('../')\n",
    "import matplotlib.pyplot as plt\n",
    "%matplotlib inline\n",
    "from ml_models.ensemble import XGBoostBaseTree\n",
    "from ml_models import utils\n",
    "import copy\n",
    "import numpy as np\n",
    "\n",
    "\"\"\"\n",
    "xgboost回归树的实现，封装到ml_models.ensemble\n",
    "\"\"\"\n",
    "\n",
    "class XGBoostRegressor(object):\n",
    "    def __init__(self, base_estimator=None, n_estimators=10, learning_rate=1.0, loss='squarederror'):\n",
    "        \"\"\"\n",
    "        :param base_estimator: 基学习器\n",
    "        :param n_estimators: 基学习器迭代数量\n",
    "        :param learning_rate: 学习率，降低后续基学习器的权重，避免过拟合\n",
    "        :param loss:损失函数，支持squarederror、logistic\n",
    "        \"\"\"\n",
    "        self.base_estimator = base_estimator\n",
    "        self.n_estimators = n_estimators\n",
    "        self.learning_rate = learning_rate\n",
    "        if self.base_estimator is None:\n",
    "            # 默认使用决策树桩\n",
    "            self.base_estimator = XGBoostBaseTree()\n",
    "        # 同质分类器\n",
    "        if type(base_estimator) != list:\n",
    "            estimator = self.base_estimator\n",
    "            self.base_estimator = [copy.deepcopy(estimator) for _ in range(0, self.n_estimators)]\n",
    "        # 异质分类器\n",
    "        else:\n",
    "            self.n_estimators = len(self.base_estimator)\n",
    "        self.loss = loss\n",
    "\n",
    "    def _get_gradient_hess(self, y, y_pred):\n",
    "        \"\"\"\n",
    "        获取一阶、二阶导数信息\n",
    "        :param y:真实值\n",
    "        :param y_pred:预测值\n",
    "        :return:\n",
    "        \"\"\"\n",
    "        if self.loss == 'squarederror':\n",
    "            return y_pred - y, np.ones_like(y)\n",
    "        elif self.loss == 'logistic':\n",
    "            return utils.sigmoid(y_pred) - utils.sigmoid(y), utils.sigmoid(y_pred) * (1 - utils.sigmoid(y_pred))\n",
    "\n",
    "    def fit(self, x, y):\n",
    "        y_pred = np.zeros_like(y)\n",
    "        g, h = self._get_gradient_hess(y, y_pred)\n",
    "        for index in range(0, self.n_estimators):\n",
    "            self.base_estimator[index].fit(x, g, h)\n",
    "            y_pred += self.base_estimator[index].predict(x) * self.learning_rate\n",
    "            g, h = self._get_gradient_hess(y, y_pred)\n",
    "\n",
    "    def predict(self, x):\n",
    "        rst_np = np.sum(\n",
    "            [self.base_estimator[0].predict(x)] +\n",
    "            [self.learning_rate * self.base_estimator[i].predict(x) for i in\n",
    "             range(1, self.n_estimators - 1)] +\n",
    "            [self.base_estimator[self.n_estimators - 1].predict(x)]\n",
    "            , axis=0)\n",
    "        return rst_np"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "#测试\n",
    "data = np.linspace(1, 10, num=100)\n",
    "target = np.sin(data) + np.random.random(size=100)  # 添加噪声\n",
    "data = data.reshape((-1, 1))"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX8AAAD8CAYAAACfF6SlAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3XuQXHWd9/H3dy7JTK6dhADJhJCoERS5BEchCYgVYWWVByKugj7rorUWVU/pLuLlMezqQllbRba0vOwuK8sqCisPIoqQ54EVkahguMiQxI2AXBVmOoGEwCSTZJLM5ff80d1JT8853af7nO7Tfc7nVTXVM90nfQ7N6e/5nu/vZs45REQkXdriPgAREWk8BX8RkRRS8BcRSSEFfxGRFFLwFxFJIQV/EZEUUvAXEUkhBX8RkRRS8BcRSaGOuA/Az1FHHeWWLFkS92GIiLSUxx9//FXn3PxK2zVt8F+yZAl9fX1xH4aISEsxsxeDbKeyj4hICin4i4ikUOjgb2bHmdkvzewpM3vCzK7w2MbM7J/N7Dkz+28zOz3sfkVEpHZR1PxHgc855zaZ2UzgcTO7zzn3ZNE2fw4sy/+cAXw7/ygiIjEInfk757Y75zblfx8CngJ6Sja7CLjZ5TwCZMxsQdh9i4hIbSKt+ZvZEmA58GjJSz1Af9HfA0y+QIiISINE1tXTzGYAPwE+45zbU/qyxz+ZtISYmV0OXA6wePHiqA5tkjs3Z/nqvU+zbXCYhZluvvDeE1izXNciEUmPSDJ/M+skF/hvcc7d4bHJAHBc0d+LgG2lGznnbnDO9TrneufPrzhGoSZ3bs5y1R1byQ4O44Ds4DBX3bGVOzdn67I/EZFmFEVvHwO+CzzlnPu6z2brgb/K9/o5E9jtnNsedt+1+Oq9TzM8MjbhueGRMb5679NxHI6ISCyiKPusAj4GbDWzLfnn/g5YDOCcux64B3gf8BywH/hEBPutybbB4aqeFxFJotDB3zn3G7xr+sXbOOBTYfcVhYWZbrIegX5hpjuGoxERiUfqRvh+4b0n0N3ZPuG57s52vvDeE2I6IhGRxmvaid3qpdCrR719RCTNUhf8IXcBULAXkTRLXdlHREQU/EVEUimVZZ+wNEJY0kLnenIp+FepMEK4MFCsMEIY0JdCEkXnerKp7FMljRCWtAh7rt+5OcuqdRtYuvZuVq3boClUmowy/ypphLCkRZhzXXcNzU+Zf5X8RgJrhLAkTZhzXXfIzU/Bv0oaISxpEeZc1x1y81PZp0oaISxpEfRc9+oRpDm0mp/l5lxrPr29va6vry/uwxBJhVq7dJbW9iF3d/DBt/fwk8ezk56/9uKTlSjVmZk97pzrrbSdMn+RlAvTOOtX2//BIy+R6e6kq7ONwf0jukNuQgr+IilXrnG2UrAuV8MfHB6hu7Odb1xymoJ+E1KDr0jKhWmcrVTDVw+f5qXgL5JyYbp0evUIKqUePs1JwV8k5cJ06VyzvIdrLz6ZnjIXCvXwaU4K/iIpVxzADejJdFfVK2fN8h42rl3NNy85TWNgWogafEUkkgWONAamtSj4i0hktEpe61DZR0QkhRT8RURSSMFfRCSFIqn5m9mNwAXADufc2zxefzdwF/DH/FN3OOe+EsW+RSS9tMxk7aJq8P0+8K/AzWW2edA5d0FE+6s7nVQi0fH7PoX5nmnBmHAiCf7OuQfMbEkU7xWlqGYqjPOk0kVIGi3qc87v+9T34msTZv6s9nsWZk4iaWzNf4WZ/c7M/svMTqr3zgonXHZwGMeREyvIOqJRrEIUxfqlYf4bRGpRj3PO7/t066P9ob5nWjAmnEYF/03A8c65U4F/Ae702sjMLjezPjPr27lzZ6gdhgngYU+qqL5AWgpPGq0e55zf92bMZy2RoN8zLakaTkOCv3Nuj3Nub/73e4BOMzvKY7sbnHO9zrne+fPnh9pnPWYqrHRSFbL9z9y2JZIvkDIbabR6nHN+35t2s6q2L6UlVcNpSPA3s2PNcv+nzeyd+f3uquc+o56psNJJVZzt+6n2C6TMRhqtHuec3/fpI2ccFyp4h52TKO2i6up5K/Bu4CgzGwCuBjoBnHPXA38B/C8zGwWGgUtdndeP/MJ7T/BcXi7oTIVQ3RwlXrfLpar9AoX5bxCpRT3OuXLfp97j51bduKxOENFI9Bq+xSfJ7O5OzJi0pFxUJ9LStXdT7pOsdf3SIP8NIlFq5uDqt2awMv4jgq7hm+jgX9CIRaZXrdvgW/LpqUN3uTDHKhKnMBcXv+9ZT6abjWtXR32oLUkLuBcp19WstMdBrf2E/W6XowrO6tMssXMOzjkHnq6958+B0XHOOjjKqqKvnf0jHJjaQVdH24Tt9h8aZUfXbP7m0//Kpy5czprlPXXrBNHMdzv1korgX6+uZsXqPZe5ev5I7F59FR58EN71LnjrW2t6i//anGXfwdFJz0+f2sEH8t+VP766j0df2MXMfbt5/9MbWfDEJq4azYWqhZluz8y/lgbpQsDPDg5jcLhsm5aRwqkI/n4nTLuZ5wWg1p4N9ZzLPMqTXqQm/f25xyuugIsvruktPuvTNmbAB9a9H4C/XLeB7BuHmXZomPOfeZi3Z//AA294O1+99+nIGqRLy6ilx5SGu+pkBv/LLoOtWw//effwCNsGhxkv+j/cZpCZ1sng/pFJzy/MdMOPOoPvb+pU+N734MQTPV+O4pZSPX8kdoXgf9xxNb9FkCSmcDe7f0o3Tx29lNOzTx1+Pqo77CC985J+V53M4D9/PixadPjPDDC8+wDP79zLgZExujrbeeP8GSyY3YV5PJ+Z3RV8X87B3XfD7bfDl7886eWo5gnSEnkSuwiCf5AkpvgCsWnhiVz8xAbaxsdYMHcGEM0ddpjBnkmRzOD/ta9NempB/ifo81U55ZRcLdRDlA21WiJPYjUwAJ2dcPTRNb9FkCSm+ALxeM+J/NXmuzllcICPf+Si0P8JBX53IAVpuKtOZvBvtLPPhptvhtFR6Jj4kaqhVhKjvx96eqAt3MQAlZKY4gvEpp63AHDN/D2cFmHi43UHUmj0jaJrditQ8I/C2WfDv/0bbNkCvRO716qhVhKjvz9Uyacahy8QzsFdX+K0/ier+veV2tlURlXwj8bZZ+ceH3xwUvBXQ60kRn8/rFzZ2H2awYoV8NBDgf9J0Ha2tJdRtYZvFHp6YOlSz7q/Jp+SRBgfh2y2YZn/BCtXwvPPwyuvBNq8XDtbFOtsJIUy/6icdRb87Ge529SSqWrTnmFIAuzYASMj8QV/gIcfhjVrKm7u156WHRzmytu2pG4wlx9l/lE5+2zYuROeeSbuIxGJXqGbZ1EX6oY5/XSYMiUX/AMo157mN5grjRT8i4S6JSyu+4skTQR9/GvW1ZW7AASs+3utH1BOWnveqeyTF3ow1gkn5AaXPfggfPKT9TxUkcYbGMg9xhH8IVf6ue46uOOOSWXVUmuABZld3LllG6/tO1jxredOnwo/PTT5hdNOy7XlJZSCf17owVhmubq/Mn9Jov7+XAZ+1KTVVxtj9Wr4+tfhgx8MtPkZ+Z/AfuDx3IoV3Hnd7YntDqrgnxfJYKyzz4af/jTXK6InGSeICJAL/osWVcy66+HOzVm++t9ddH3yehZNa+OylUtYfWKwUcYb/rCDf77/WQ6OTh7MdfTMLv/3+tKX2LdlayRTszQrBf+8SAZjFer+J5+ca6BqhGXL4Ne/Dj3qUqSsQvCvI6+BWcCRADxvEc8Dv/39GNe++ahAAXj1qbDnzW+tPntfsoSx+3+d6DU0FPzzIhmMdfrpcPXV8PLLdThCD1u3wm9+A0NDMHt2Y/Yp6TQwkFvIpU782ty6OttCB+CaulpnMkw/sA9z4zibmFglpYFYwT8vkuHebW1wzTX1OUAvN96Y6wHx+usK/lI/Y2N1H+Dl1+bmN+1y3QNwJkO7G2f6oQPsnTptwktJmZpFwb9Iyw3GmjMn9zg4GO9xSLK9/DKMjbGFmXxq3YaGrlTnp+4BOJMB4OixYfZyJPgnaWoWFYpbWf4E5fXX4z0OSbZ8H//rnz9EdnAYx5GyTFTTI/gF80x356Q++w0JwPnv1pdWLUjs1CzK/BusuFFrdncnZjC4f6S2TEqZvzRCvo//i9PmTHg6ysZPvza3ay48CYhh9s188F+9YCqrL3lXffcVEwX/Bipt1BocHjn8Wk3dyJT5SyPkM/9tM+dPeimq2nulNreGZ9uF71aCEysF/5CqWZ+30rqhVWdSyvylEfr7Ge7sYnfXjEkvRVl7b6o2NwX/YMzsRuACYIdz7m0erxvwLeB9wH7g4865TVHsuxH8Any1U0IEyZKqyqRmzswNulHmL/XU389oTw/dUzrSsy5FCoJ/VA2+3wfOL/P6nwPL8j+XA9+OaL91VwjwXg1d5aaE8BIkS6oqk2pry3XxTPAJKk2gv5+Zb1qarnUpCl2nfRKrJKwLEEnm75x7wMyWlNnkIuBm55wDHjGzjJktcM5tj2L/9VQuwFc7JYRXo1axmjKpOXOU+Ut9DQzAeec1V1mm3jo6cnfWHolV6Ekgm0Sjav49QH/R3wP55yYEfzO7nNydAYsXL27QoZVXLsBXOyVEaaNW6N4+kLs9VeafLvffD7feGuot/rRrH1sHdrP/0BjTprRz8qLZLJk33Xvj7dvjm80zTj7frdCTQDaJRgV/r9mgStdVwDl3A3ADQG9v76TX41AuwNcyJUTk2ZMy//T5xjfg5z+Ho4NNblZqeGSMruERir9h9jQMe/SpB2Dx4tysmkWq6ejQsnyCfySTQDaBRgX/AaA4dVgEbGvQvkMpF+AjmRIirEwG/vCHxu1P4jc0lJvf/le/qumfn7tug2dC05PpZuPa1R7/YqKklD0q8gn+kUwC2QQaFfzXA582sx+Sm2Z7dyvU+yFY/+NYT3hl/ukzNAQLF1b9zwrZulfgguCZa1LKHhVlMkdWMCsSySSQTSCqrp63Au8GjjKzAeBqoBPAOXc9cA+5bp7Pkevq+Yko9tsosQf4clTzT5+9e3ONkVUozda9BM1ck1L2qCiTyc2cW6Ip7vgjEFVvn49UeN0Bn4piX1JizhwYHoaDB2Hq1LiPRhphaKjq4F9pgGE1mWtSyh4VlUmsmjohDChxE7slof9tVVIwGEVK7N0LMyaPti2nXFZebZ99rwXSW7HsUVEmA7t3w/h43EdSF4ma3iE1DVHFiqd4OOaYeI9F6m98vKayj1+2HrSRt1hSyh4VZTLgXGIXS0pU8G/lhqiau85pcrd02b8/91hl5h91I2USyh4VFRKrhC6WlKjg36oNUaHuWPIn6Gf//Vf89M5dk+YeSnx2liCB/n8NDeUeq8z8U5OtRynhJdVEBf9WbYgKc8fyi20HORcY3fUa7pgjF46+F1/jJ49n01UCa2GBE4BC8K8y8y+8j/7fVyHhwT9RDb6t2hDld2eSHRz2bbQuNGxf9cvcQhuzDu47/NrwyBi3Ptpf1aRzEq/AkwTu3Zt7DJj5p64DRJQSHvwTlfm36q2t3x0LeGeAxVni1K7cfCyzDuyd8O/GnPfsGM1eAkurwCXLKjL/tHWAiLzMqeDfWlrx1rbSbJ+lJaDiLPFgxxQOdEyZFPzbzTwvAM1eAkurwCXLKjL/Vu4AUa26XOgSHvwTVfZpVWuW9xyeK91PcQZYmg3umTqd2UXBv7uznY+ccVxLlsDSKnDJsorMv1U7QNSi2rU1Apk1K/eo4C/1tGZ5DxvXrva9ABRngKXZ4O6uGYdr/oUBO/+45uR0Lb7R4ooTgLL/v6rI/P3u8pJ491eXC117e+4CkNDgn7iyT6sL0h+7dJs9U6cz9+A+vnnJaUAuC7ryti0t0+YhOYFKllV09UzKBGRBRNnTr7jt4OG2Lg69sI3mWF0kWsr8m0yQDLB0m0MzZnFid24Iut+Sk5IQhcw/QNkn8N1EAkTV06902dbXO6fxzNMDifwOKfNvQkEywAnb9P8feOSRVDXwpdbQEHR15ZYZDKAVO0DUIqqefqXfod1dM5g5PMTVNXyHmn2QpYJ/EuRnH0xTA19q1TCpW1pEcaGb1JmiawbHDb5c9XeoFbrZquyTBHPmwOAgPbO8p3ROYgNfatUwnbMEV/pd2TN1OjMP7qv6O1SX3kcRU/BPgkwGxsdZe/Yide9MOmX+dVXadrBn6nRmH9xX9XeoFe7CFfyTID+52wXHT0tNA19qKfOvq9JGcpfJMPPgftaccmxV79MK3WxV80+Commd1yw/VcE+yfbu9ZxeuNkbF1vJhLaDbz4L998Me/YcmeI5gFboZqvMPwmKF3SRZPPI/Eu7J2YHh7nyti0s0WRu4dU4xUMrdLNV5p8EARd0UXaYAB7B36txsTCrUzP2MmkpIeb3afZutgr+SRAg82+FrmcSgEeDb6VGRI31CCHCyd2aLflS2ScJAmT+rdD1TCoorCebz/wLc/V7T949UTP1MmkpEQV/r9Jc3KPvFfyTYPZsMCt7grZC1zOp4NAhGB2FGTMmBJMgmqmXSUspXsc3hGZMvlT2SYK2ttzsg2VO0FZd4lKKFE3q5hVMCgwm3A00Wy+TlhIg8w9SzmnG5CuSzN/Mzjezp83sOTNb6/H6x81sp5ltyf98Mor9SpH8KF8/rbrEpRQpmtTNL2gY8I1LTmvqXiYtZebMsnfVQcs5zdjvP3Tmb2btwHXAecAA8JiZrXfOPVmy6W3OuU+H3Z/4yGTKZv6tusSlFCnK/MvdyTV7L5OW0taWK6v6BP+gkyk2Y7//KMo+7wSec869AGBmPwQuAkqDv9RThcwfmr/rmVSQz/w/e/dzZI85WeWdRslPnOglaDmnGZOvKIJ/D9Bf9PcAcIbHdh80s3cBzwBXOuf6PbaRWmUy8MwzcR+F1NHGzX9kFfDiSK585zhS3+9pgmCSWGWCfzVtac2WfEVR8zeP50p7n/1fYIlz7hTgF8BNnm9kdrmZ9ZlZ386dOyM4tBQpc4JGodCtcKlGjTZc4bO/+b4nANg/pevwa4XAv3Ht6qYKLIlS5rvVym1pUWT+A8BxRX8vArYVb+Cc21X0538A/+T1Rs65G4AbAHp7e4N0X5aCOXNCd0fzowFi8Sn+7M88lMsw906ZNmEbddets0wGNm6Ez39+0ktrgJN27OWxP73GvgOjTO/q4B1L5rLsll/ALSH2ef75cO65Id6gsiiC/2PAMjNbCmSBS4GPFm9gZgucc9vzf14IPBXBfqVYJgP79+dO0oCrPAV19019nLD34KTnr1s/quBfZ8UNitNGckF+35SJJQV1162zVavgvvvg+us9X16W/zlsUwT7PPro5g/+zrlRM/s0cC/QDtzonHvCzL4C9Dnn1gN/a2YXAqPAa8DHw+5XSixcmHs866zI3/o/fJ5f/5Z3wdUXRL4/OaI4q5+Rz/z3dR4p+7RKiaGlff7znll/q4skRXTO3QPcU/LcPxT9fhVwVRT7Eh8f+xgcfzyMjET+1p/70RZ27T008bkH/5Ol+16NfF8yUXGD4rRDBxi1Ng52TAHUyCvhaIRvUkyZUrfbxLOPPWVSH+VLntzAWfsG6rI/OaK4f/iMQ/vZP6Wb7ikdGrgloSn4S0VefZRPOGkJMzc8EfORJV/xZz/90DDDXdMU+CUSCv4ygd88JZP6KH/5l/CT12F8PDcKUurm8Ge/6XoYmafAL5HQt1YOq2ra2XnzcoFfq4c1jtbvlQgp+MthVU07O29e7nHXrsmvSX14LOQiUisFfzmsqmlnFfwbT5m/REjBXw6ratpZBf/G27tXwV8io+Avh1U1T4mCf+MNDans0+RaaQ4s9fZJqXKrDwWadlbBv/GU+Te1VpsDS8E/hSqdpIFO1Nmzc108FfwbY2wsN3eTMv+mFXRhl2ahsk8K+Z2kn7ltS/Bb1bY2mDvXN/i30u1vS9i3L/eozL9pNeM6veUo80+hcidjVbeq8+Z5Bv9Wu/0NI8ji3ZEoLOGozL9pVbOwSzNQ5p9ClU5G3779pXyCf1XjBVpYVYPiwios3q7Mv2m12sIuCv4p5HWSlgp0q+oT/Fvt9rdWDb3IKfOPXaVS5prlPVx78cn0ZLoxcrOuBpmHKa4Sqco+KVTcq8frNhUC3qrOmwebN3v+21a6/a1VQy9yyvxjFbSUWe06vXGWSJX5p9Sa5T1sXLuab15ymu+tasWMxCfzL3f7m6SG4KoGxfkI/Hko849Vve7y4iyRKvinnN+tKlC5nj1vHgwP536ies8WErbGW1WbQSH4K/OPRdR3eYWLvt+ddyNKpCr7iOet6qp1Gyr3WS4e6LVoUTTv2UKqGhTnoap+4Sr7xCrKUmZpqcdvf/Wm4C+eAmU6ZYJ/ze/ZYqqt8Rar6vNQ2SdWxSuqFdTak8frol+sUT2EFPzFU6BMp8opHtLQEFxNv/+qPo9C5j99epSHKwGFvcsrVi7ZaeS6zAr+4ilQplNl8I8ye2pG1fbcqOrzGBqCadOgvXwXXamfMHd5xfwu+j2ZbjauXR36/YNSg694CtRnee7c3GPA4F/uPZPQC6janhtV9QvXpG6J0SyDwZT5i6+KmU4NM3t6vWdSpoOopU3D7zMuLR/98KVXOE71/kSIsoQUhoK/1K6rK1eKCDmzZ6vNhugnqjYNr4vhM8+/zMyOLjKRHKnELaoSUhgK/hKOz0CvarRkL6AHH4Tzz4eDB488BYyPu0mbtrUZfCn4W1/gHBeUvE2HG2fz0lNYXuPhipSKJPib2fnAt4B24DvOuXUlr08FbgbeDuwCLnHO/SmKfUvjFZck7h2dyqwXshwb4v1ashfQo4/m5tf/4hehI/c1agOefXmIh1/Yxd4Do8zo6mDFG+ZxwrHV1eqv3/Acky8h8MAbTuf28EcuAkQQ/M2sHbgOOA8YAB4zs/XOuSeLNvtr4HXn3JvM7FLgn4BLwu5bGq+0JLFjynT2/zHLI5uzNd/GtmQvoGw21+3y2mvB7PDTJ+R/wrjVZ+RnTzNfDKXlRNHb553Ac865F5xzh4AfAheVbHMRcFP+9x8D7zEr+sZIyyitzw92z2LW/j2h5iKpdTbEegjc62hgAHp6JgT+qDRLbxBJtijKPj1Af9HfA8AZfts450bNbDcwD3i1eCMzuxy4HGDx4sURHJpErbQO/3r3TOYMD4WuzzdDA1hVvY6y2UCjmmvRLL1BJNmiCP5eqU9pyTLINjjnbgBuAOjt7fUqe0rMSuvzr3fNZPaBvfTMmhrjUUWjql5H2Sycc07djqUZLoaSbFEE/wHguKK/FwHbfLYZMLMOYDbwWgT7lgYrrc8Pds+iDcdVK8M0+Tae1zQMgXsdjY/Dtm25so9IhBq2LCjRBP/HgGVmthTIApcCHy3ZZj1wGfAw8BfABuecMvsWVFqSKAz0en9P9Zl/I0/00v16lXcy0zp5ff/IpO0n9TrasQNGR+tW9pF0avRgx9DBP1/D/zRwL7munjc6554ws68Afc659cB3gf80s+fIZfyXht2vxGdCSeIeg9vX5fr6L1vmub1XkAdiG9XrV96Z2tFGd2d75V5H2XwjsDJ/iVCjBztG0s/fOXcPcE/Jc/9Q9PsB4ENR7EuaTIUpHvyyma7OtsAnetR3CH7lnd3DI3zjktMq70vBX+qg0YMdNcJXwikK/l5B2i+b8ZvPvPREr8etcLlBZYEaWgcGco8K/hKhRg921KyeEk4++G/93QueSxL6LVPnp/REr8cap6H70WezuamVjzmm5mMQKdXo8R3K/CWc2bOhrY3HNz/H8DvfMeGl4ZEx2s0Y82jbz3R3cnB0vGJ9vZZb4UplotD96LNZWLBAc+tLpBo9vkPBX8Jpa4O5c+l43bvn7phzno2o11x4ElD5RK/2VjhomShUP/rC6F6RiDVyfIeCv4Q3bx4LxvZ7vtRTVPv3CvKVTvRq5/1pSI+JbBZOOima9xKJiYK/hDdvHudsfoz7bvwU40UlnjYzjpnVxawfdLCmePsfBH/rNcDqA6O8uvcgI2PjdLa3MTczncwHbiY3a8hEfuWg7OAwq9ZtiOY2OpuFP/uzcO8hEjMFfwnviivo+NGPmDY4zDOvDHHg0BhdU9p58zEzmRVBT4VZ+Z/D7roLbr8dTj990rZ+ZSII11Oo0I6w55VdbB0a4vfM4G1VvYNIc1Hwl/A+/GH48IfpwSsXr4Mzz4SHHvJ8yatMVKyWElBxO8Ibh3LjGb7/0ihnhZjGWiRu6uoprWflSvjtb2Fk8lQMxdND+6l20ExxO8Kxe3PBv797Ts3dTZOwWL20PgV/CSWWQLZiBRw4AFu2eL68ZnkPG9eu9r0AVDtopvhicWw+83955ryaRl4W7iJKx0PoAiCNpuAvNYstkK1YkXt8+OGym0U1aKb4YnHsUG4JipdnzKtp5GU9Bq2J1ELBX2oWWyBbtAgWL/at+xdEtUJY8UXk2L27eL1rJm3TplW8iHjdFbXkYvWSSGrwlZrFGshWrJgQ/P1G9UYxaKZ45OWxQ7vYlTmq4kXEa7DZlbdt8VyYHZp8sXpJJAV/qVmjJ6KaYOVKuO02GBjgzp1W9+mhD19Ebh+BN53Amyq8r9ddkV/g1/q8EgeVfaRmsS40vnJl7vHhhxtbfgq4dm/Qu584F6uXdFPmLzWLdaHxU0+F7m546CG2TT3Xc5PIy0+HDuVW8Qowr0+5wWYFBmxcuzqigxOpjoK/hBLbQuOdnfCOd8BDD7HwA/+jMeWn7dvBuUDBv9JgM1CdX+Klso+0rpUrYdMmvnjO4saUnworeAUo+5QONrOS11Xnl7gp85fWtWIFjI5y4ZO/Zvab5nPLoy+xc+gg82dO5X+esZhzDvbDI/3R7e+BB3KPAadzLr4rimuxehE/5jwW2mgGvb29rq+vL+7DkGa2cycsXAijo43bZ3s7vPoqZDKN26dIFczscedcb6XtlPlL65o/H/r6crX4RlmwQIFfEkHBX1rbqafmfkSkKgr+IlVS/V6SQMFfpApB1wgWaXahunqa2Vwzu8/Mns0/zvHZbszMtuR/1ofZp0icNCunJEXYfv5rgfudc8uA+/N/exl2zp2W/7kw5D5FYqNZOSUpwpZ9LgLenf/9JuBXwBdDvqdIXURRq491MjuRCIXN/I9xzm3r/EJNAAAGl0lEQVQHyD8e7bNdl5n1mdkjZrbG783M7PL8dn07d+4MeWgiR0S18Eysk9mJRKhi5m9mvwCO9Xjp76vYz2Ln3DYzewOwwcy2OueeL93IOXcDcAPkBnlV8f4iZZWr1VeT/cc6mZ1IhCoGf+ec95SJgJm9YmYLnHPbzWwBsMPnPbblH18ws18By4FJwV+kXqKs1cc2mZ1IhMKWfdYDl+V/vwy4q3QDM5tjZlPzvx8FrAKeDLlfkar41eRVq5e0Chv81wHnmdmzwHn5vzGzXjP7Tn6btwB9ZvY74JfAOuecgr80lGr1IhOF6u3jnNsFvMfj+T7gk/nfHwJODrMfkbBUqxeZSCN8JTVUqxc5Qou5iIikkIK/iEgKqewjLUUzaopEQ8FfWka9ZtTUBUXSSMFfWkZUo3SLlbugFPapi4IkkYK/tIx6zKjpd0G5Zv0THBwd17z9klhq8JWWUY9Run4XjsHhEc3bL4mm4C8tox6jdKu9cGjefkkKBX9pGWuW93DtxSfTk+nGgJ5MN9defHKoMozfBWXOtE7P7TUXkCSFav7SUqIepes37QMwoSEYNBeQJIuCv6ReuQuKevtIUin4i/jQXECSZKr5i4ikkIK/iEgKKfiLiKSQgr+ISAop+IuIpJB6+0jT0SybIvWn4C9NpV7TNovIRCr7SFMpN22ziERHwV+aSj2mbRaRyRT8panUY9pmEZlMwV+aSj2mbRaRyUIFfzP7kJk9YWbjZtZbZrvzzexpM3vOzNaG2ackWzXTNt+5OcuqdRtYuvZuVq3bwJ2bs40/YJEWFba3z++Bi4F/99vAzNqB64DzgAHgMTNb75x7MuS+JaGCTKimXkEi4YTK/J1zTznnKnXDeCfwnHPuBefcIeCHwEVh9iuiXkEi4TSi5t8D9Bf9PZB/TqRm6hUkEk7Fso+Z/QI41uOlv3fO3RVgH+bxnPPZ1+XA5QCLFy8O8NaSVgsz3WQ9Ar16BYkEUzHzd86d65x7m8dPkMAPuUz/uKK/FwHbfPZ1g3Ou1znXO3/+/IBvL2mkXkEi4TRieofHgGVmthTIApcCH23AfiXB/NbeVWOvSDChgr+ZfQD4F2A+cLeZbXHOvdfMFgLfcc69zzk3amafBu4F2oEbnXNPhD5yST0tsyhSu1DB3zn3U+CnHs9vA95X9Pc9wD1h9iUiItHRCF8RkRRS8BcRSSEFfxGRFFLwFxFJIQV/EZEUMuc8B9vGzsx2Ai/GfRwROAp4Ne6DaBL6LCbS53GEPouJwnwexzvnKo6SbdrgnxRm1uec853uOk30WUykz+MIfRYTNeLzUNlHRCSFFPxFRFJIwb/+boj7AJqIPouJ9Hkcoc9iorp/Hqr5i4ikkDJ/EZEUUvCvAzM7zsx+aWZP5Re4vyLuY2oGZtZuZpvN7P/FfSxxMrOMmf3YzP6QP0dWxH1McTKzK/Pfk9+b2a1m1hX3MTWSmd1oZjvM7PdFz801s/vM7Nn845yo96vgXx+jwOecc28BzgQ+ZWZvjfmYmsEVwFNxH0QT+BbwM+fcicCppPgzMbMe4G+BXufc28hN+35pvEfVcN8Hzi95bi1wv3NuGXB//u9IKfjXgXNuu3NuU/73IXJf7lRPPG9mi4D3A9+J+1jiZGazgHcB3wVwzh1yzg3Ge1Sx6wC6zawDmIbPSn9J5Zx7AHit5OmLgJvyv98ErIl6vwr+dWZmS4DlwKPxHknsvgn8b2A87gOJ2RuAncD38iWw75jZ9LgPKi7OuSzwNeAlYDuw2zn383iPqikc45zbDrlkEjg66h0o+NeRmc0AfgJ8xjm3J+7jiYuZXQDscM49HvexNIEO4HTg28655cA+6nBL3yryteyLgKXAQmC6mf1lvEeVDgr+dWJmneQC/y3OuTviPp6YrQIuNLM/AT8EVpvZD+I9pNgMAAPOucKd4I/JXQzS6lzgj865nc65EeAOYGXMx9QMXjGzBQD5xx1R70DBvw7MzMjVdJ9yzn097uOJm3PuKufcIufcEnKNeRucc6nM7pxzLwP9ZnZC/qn3AE/GeEhxewk408ym5b837yHFDeBF1gOX5X+/DLgr6h2EWsNXfK0CPgZsNbMt+ef+Lr+WscjfALeY2RTgBeATMR9PbJxzj5rZj4FN5HrJbSZlo33N7Fbg3cBRZjYAXA2sA35kZn9N7gL5ocj3qxG+IiLpo7KPiEgKKfiLiKSQgr+ISAop+IuIpJCCv4hICin4i4ikkIK/iEgKKfiLiKTQ/wcQG9mvHLGnVgAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x20350e52cc0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "model = XGBoostRegressor(loss='squarederror')\n",
    "model.fit(data, target)\n",
    "plt.scatter(data, target)\n",
    "plt.plot(data, model.predict(data), color='r')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAX8AAAD8CAYAAACfF6SlAAAABHNCSVQICAgIfAhkiAAAAAlwSFlzAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4yLCBodHRwOi8vbWF0cGxvdGxpYi5vcmcvNQv5yAAAIABJREFUeJzt3X+UXGWd5/H3N92dpBOSdDrdQNJJCGBgVILE9ACSATHAouCBLOgBXR30zGzcPbIK4+oGnR3dOZ4lc9hRnJEDRkRhREAFIUp2WSV6wLggnR8CIZKEAOnuBAj5/aNJJ51n/6iqpLr63qq6dW/Vrbr38zonp7qrbte9FLe+97nf5/s8jznnEBGRdBkV9wGIiEjtKfiLiKSQgr+ISAop+IuIpJCCv4hICin4i4ikkIK/iEgKKfiLiKSQgr+ISAo1x30Afjo6OtysWbPiPgwRkYayatWqt51znaW2q9vgP2vWLHp6euI+DBGRhmJmr5ezndI+IiIppOAvIpJCoYO/mc0ws9+a2XozW2dmX/TYxszsX8xsk5k9b2bvD7tfERGpXBQ5/yPAl5xzq81sArDKzH7tnHspb5uPALOz/84D7sw+iohIDEK3/J1z25xzq7M/7wPWA10Fm10N3OcyngHazGxq2H2LiEhlIs35m9ksYC7wbMFLXUBv3u99jLxAiIhIjURW6mlmJwAPAzc55/YWvuzxJyOWEDOzRcAigJkzZ0Z1aCM8uqaf2554ma27B5jW1sqXLz+ThXN1LRKR9Iik5W9mLWQC//3OuUc8NukDZuT9Ph3YWriRc26pc67bOdfd2VlyjEJFHl3Tzy2PvED/7gEc0L97gFseeYFH1/RXZX8iIvUoimofA34ArHfOfctns2XAX2erfs4H9jjntoXddyVue+JlBg4PDXtu4PAQtz3xchyHIyISiyjSPvOBTwMvmNna7HNfBWYCOOfuApYDVwCbgIPAZyPYb0W27h4I9LyISBKFDv7Oud/jndPP38YBnw+7ryhMa2ul3yPQT2trjeFoRETikboRvl++/ExaW5qGPdfa0sSXLz8zpiMSEam9up3YrVpyVT2q9hGRNEtd8IfMBUDBXkTSLHVpHxERUfAXEUmlVKZ9wtIIYUkLnevJpeAfUG6EcG6gWG6EMKAvhSSKzvVkU9onII0QlrQIe64/uqaf+UtWcOrix5m/ZIWmUKkzavkHpBHCkhZhznXdNdQ/tfwD8hsJrBHCkjRhznXdIdc/Bf+ANEJY0iLMua475PqntE9AGiEsaVHuue5VEaQ5tOqfZeZcqz/d3d2up6cn7sMQSYVKSzoLc/uQuTu4dl4XD6/qH/H8rdfMUUOpysxslXOuu9R2avmLpFyYzlm/3P6Pn9lCW2sLY1tGsfvgYd0h1yEFf5GUK9Y5WypYF8vh7x44TGtLE9++7hwF/TqkDl+RlAvTOVsqh68Kn/ql4C+ScmFKOr0qggqpwqc+KfiLpFyYks6Fc7u49Zo5dBW5UKjCpz4p+IukXH4AN6CrrTVQVc7CuV2sXLyA2687R2NgGog6fEUkkgWONAamsSj4i0hktEpe41DaR0QkhRT8RURSSMFfRCSFIsn5m9k9wEeBt5xzZ3m8fjHwGPBq9qlHnHP/GMW+RSS9tMxk5aLq8P0R8F3gviLbPO2c+2hE+6s6nVQi0fH7PoX5nmnBmHAiCf7OuafMbFYU7xWlqGYqjPOk0kVIai3qc87v+9Tz+s5hM38G/Z6FmZNIapvz/4CZ/cnM/reZvbfaO8udcP27B3AcP7HKWUc0ilWIoli/NMx/g0glqnHO+X2fHni2N9T3TAvGhFOr4L8aOMU59z7gX4FHvTYys0Vm1mNmPdu3bw+1wzABPOxJFdUXSEvhSa1V45zz+94M+awlUu73TEuqhlOT4O+c2+uc25/9eTnQYmYdHtstdc51O+e6Ozs7Q+2zGjMVljqpcq39mx5aG8kXSC0bqbVqnHN+35sms0DbF9KSquHUJPib2clmmf/TZnZudr87qrnPqGcqLHVS5bf2/QT9AqllI7VWjXPO7/v0ifNmhAreYeckSruoSj0fAC4GOsysD/g60ALgnLsL+Bjwn83sCDAAXO+qvH7kly8/03N5uXJnKoRgc5R43S4XCvoFCvPfIFKJapxzxb5P3ae0B+5cVhFENBK9hm/+STKptQUzRiwpF9WJdOrixyn2SVa6fmk5/w0iUarn4Oq3ZrBa/MeVu4ZvooN/Ti0WmZ6/ZIVvyqerCuVyYY5VJE5hLi5+37OutlZWLl4Q9aE2JC3gnqdYqVlhxUGldcJ+t8tRBWfVNEsSlDuGxu8CUa0iiHq+26mWVAT/apWa5av2XOaq/JEkKKcRU+wCMa2t1bPlX0mHdC7g9+8ewOBY2jYtI4VTEfz9TpgmM88LQKWVDdWcyzzKk14kLuU0YopdIKLqkC68wBRGgTTcVaci+PudMH45/6iraaK4pVTlj9SFP/4RXn+94j//D70vsvPA4Ijn28ePhp8dBOCcZ1bzvuzzO8dN5JmZZwOZC0RUd9jlVOcl/a46FcE/6lKzIKKaJ0hL5EnsBgbgwgthcGTwLtc3i734k8zDHQVPX/i5u+ltO/nYXW4Ud9hhBnsmRSqCP/ifMNVedi7KjlotkSexeuWVTOD/53+Gyy+v+G2eXP8mP1z5Gm/tfYcTJ47ls/Nnccm7Txr2+u2/2cjJ2/v4/iPf5JytL/N2Z1ekd7l+adScNNxVJzP4f/7zsH597fY3ZgzccQecdtqIl9RRK4mxYUPm8eKL4b2Vz814yXvfyyUfK/76vtPP5FvL13HosRY+sPs1Lom4pNkrjZrr9I2iNLsRJDP4Dw3BkSO12Zdz8Nvfwi9+AV/60oiX1VEriZEL/rNnV31Xx+5yl83lk03bIcTgSK8UqdKoSQ3+d91V2/2dcgqsWuX5kjpqJTE2bICpU2HChNrtc948uP9+OHoURpU3FVm5/WxpT6MmM/jX2rx54DMaWS0MSYwNG+CMM2q7z+5uuPNO2LSp7H2XmpZa38UMBf8odHdn0j579sCkSSNeTnsLQxJiwwZYuLC2+5w3L/O4alXZwd+vP61/9wA3P7Q2dYO5/NRyJa/k6s5Oo7F6dbzHIVItu3bB9u21b/m/5z0wdqzvnbWXYv1pfoO50kjBP0/FSy/mWicRTUQnUnc2bsw81jr4t7TA+97n26fmxWv9gGLSWnmn4J8VaunFKVNg1iwFf0muXKVPrYM/ZBpXq1dnOn3LkL/ISznSWnmn4J8Veu3SefMCtU5EGsqGDZlqG4+xLFXX3Q379h2/+yjDwrldrFy8oOQFoJwV+irKBjQABf+s0IOxurszIyB37YrwqETqxIYNcOqpMHp0zXe9Ytx0AG76r98PHIC9UkC5lYNLLfsYKhvQAFTtkxV6MFau03fVKrj00giPTKQO1KDM02tgFsDfPz9IT/NoznpjE48GrNAJU2qd9DU0FPyzQg/Gev/7M48K/pI0zmWC/0UXVW0XfgOzxraMYv8QvHTiqcx5YxMQPABXWmqd9KlZFPyzQg/Gam/P5EPV6StJs20bHDhQ1Za/Xys799wLJ7+La19cwcR39uPM2Pfmgcy4mirqmjiGvr2HRjyflA5iBf88oQdjdXfDc89Fd0Ai9SBb6bNyVDtfWbKipivV5Tx/8hncsPpxnv/O9cefvD2SXfv66Ycu55L5NyV2ahYF/yjNmwc//Sns2JEp/xRJgmzw/+8vDdI/LhOkox4d69fn1tbawqEjR/nVX/wVrUcOMebIIC1No7hyzlTmTB85mj4yP/kJ03pf4dZr5iR2OggF/yjlOn2/+EWYNs1zk41v7uOPr+1k/ztHGNPcBAaHDg9xwthmzp3VzuyTAk6a9a53waJFIQ9cpIgNGzjUPJpXWycPezrKzk+/PrdvXJWZOvq2J17m/rlXHAvAc6odgDdvhh//ONFTsyj4R+kv/zJTDvfII54vH3GO6Ucc0/3+/g9wpNloNvPbYrjDhzNTV3/qUzBuXEWHLFLShg28OnkazkZWhkfV+Vmqz63mAbijA3bvzny/mpMZJpP5X1VDI8rTHn7a90T94JIVRVcPgkzt8crFC8rb+dKl8LnPZcYWKPhLtWzYwLaTZni+FGXnZ121snNp2127oLMz3mOpkkiCv5ndA3wUeMs5d5bH6wZ8B7gCOAh8xjnXMLOg+S0MEXR93nJaSYFaUu3tmcedO6GrTr40Un3LlsG999Zuf5s2Me2vL6O1pSmxnZ8j5IL/228r+JfwI+C7wH0+r38EmJ39dx5wZ/ax7hUL8EEHgZRaNzS3TdkmZ3OwO3eW/zfS+L73vczqcaefXpv9zZnDmf/xk9w6dmZiOz9HyAX/HTs8Xy61UlgjiCT4O+eeMrNZRTa5GrjPOeeAZ8yszcymOue2RbH/aioW4IMOAvHq1MoXuCWVa/lrSol02b8fzj0Xfve7mu52ISma976jI/PoEfyD3vHXq1rN7dMF9Ob93pd9bhgzW2RmPWbWs3379hodWnHFArxfK93v+fzZBo1MGdvkcS0YpecZ8ZSf9pH02L8fTjgh1FskecKySBRp+YeeBLJO1KrD16t8pXBdBZxzS4GlAN3d3SNej0OxOX8qmRIi0k4tpX3SKWTwj6LlmoS0R1H5Of8CSZn2oVYt/z4gv1xgOrC1RvsOxWtWwFyAL2zJV9R6D2PCBGhqUtonbQ4cCBX8w7Zckz7bJQDjx2dmMPVo+Qe9469XtWr5LwNuNLMHyXT07mmEfD+UV38cW4vHLJP6Ucs/XSps+eda635FB+W2XJM+2yWQ+W51dHgG/9CTQNaJqEo9HwAuBjrMrA/4OtAC4Jy7C1hOpsxzE5lSz89Gsd9aqav640KTJyv4p4lzFQX/wlSPl3JbrklJe5Q0ZYpn8A89CWSdiKra5xMlXnfA56PYlxRQyz9dDh2CoaHAwd+rtZ4vSMs19NoXjWLKFM+cP9R5g7BMiVvJK3VVDO3tyvmnyf79mcfx4wP9WbFWedC+qmL9YIni0/JPikRN75CU+ttAJk+G9evjPgqplVzwD9jy92utB5pOJCspaY+SFPwbRyN3RFVcOqe0T7pUGPyj7qRMQtqjpFyHr3OZDuCESVTwb9SOqFB3LO3tsGcPF/7PX9O3d3DE3EOJb50lSFn/vw4cyDwGDP6paa1HacqUTP/Knj3Q1hb30UQuUcG/UTuiwtyxPH/AOBvY9+bbuNaJxy4cPa/v5OFV/elKgTWwshsAFbb8c++j//cB5I/yTWDwT1SHb6N2RPndmfTvHvDttM51bP9w/V4A2gb2HXtt4PAQDzzbm4gh6GlR9sCrgME/dQUQUSoxuVujS1TLv1FvbYvN9unVAsxvJe5uzaz8Nemd/cP+bsh5z45R7ymwtCo7ZRmg2idtBRCRpzmLTO6WBIkK/tCYt7alZvssTAHltxL3jM20ANsKgn+TmecFoN5TYGlVdsoyQMu/kQsggqrKha7I/D5JkKi0T6PKnyPIT34LMP/nXPCf9M7xtE9rSxOfOG9GQ6bA0qrslGWA4N+oBRCVqMpMmwlP+yj414mFc7tYuXiB7wUgvwWY//PuscPTPrkBO99cOCfeSeckkLInCcxV+5SR9knKBGTlqMqFrq0NRo1KbPBPXNqn0ZVTj52/Ta7l3zl4gNuvOwfItIJufmhtw/R5SEZZKcv9+6G1NTObawlJmYCsHFFW+uX3HawZewI7X97CaVEcZJ1Ry7/OlNMCzN9mqKmZg6NbuaJrDEDyp9pNuwCTusU+5XgNRVXpVzhd9Y6xE3n5xVcT+R1Sy78OldMCHLbNA528q+UwN6Sogy+1As7o2YgFEJWIqtKvsO9gV+sEJh7cw1cq+A7V+yBLBf8kyE7xkKYOvtTavz/wpG5pEcWFrvC7sqt1Al17twf+DjVCma3SPkmQndM/TR18qRXB+r3ir/C7snvsRNoG9gX+DjXCOr8K/kmQbfk36ghnCUDBv6oKv0M7x02kfWBv4O9QI9yFK/gnQXZO/zR18KVWyPV7pbjC79DRye2MPTLIwjMnB3qfRrgLV84/CXJLOTqXmg6+1PJp+dd752IjGfYd+v5WeOLuTK3/uHFlv0cjlNmq5Z8E7e0wOAgHD8Z9JFJtHsG/sDyxf/cANz+0llmazC28Ckf5NsJduFr+SdDennnctatoJYhahwngUe3j1bmYm9WpHqtMGkqI+X3q/S5cLf8kmJzNRxZZ0curdagBYA1maChzd1fQ8i/ViVhvVSYNJcKZPettem0F/yTItfyLBP9GKD2TEnJpvWzwzwUT78m7h6unKpOGEtHkbvXY+FLwT4L8tI+PRig9kxLylnDMDyblqKcqk4aS+26FDP712PhSzj8Jymj5N+oSl5Inbzpnr2CSYzDsbqDeqkwayujRMGFC0Zx/OX1p9dj4iqTlb2YfNrOXzWyTmS32eP0zZrbdzNZm//1tFPuVrDJy/hoAlgB5wd8vaBjw7evOqesqk4bT0eHb8i83nVOPdf+hW/5m1gTcAVwG9AHPmdky59xLBZs+5Jy7Mez+xMMJJ0Bzc9G0T6MucSl58oL/tLZRvndy9V5l0nCmTPEN/uWullaPdf9RpH3OBTY55zYDmNmDwNVAYfCXajE7NsVDMQoKDS4b/Bc9vJ7+SacpvVMrU6bAli3w7LMjXjrxpbV0evyJbQWePV6SuxCYPPswP35mC2/vP0THCWP41Pkz+eBgHzzbN/INpk+Hrup+V6MI/l1Ab97vfcB5Httda2YXARuAm51zvR7bSKVyo3wlsf74wuucC7w+mMnWOo7n97t0J1c906fDE0/A+eePeOkXxf7u34b/+sHsv2PuLPK33/wmfO1rZR9iJaII/ubxXGH12S+BB5xzh8zsPwH3AgtGvJHZImARwMyZMyM4tBTJzu9TLRogFp/cZ/+Bp//MucCBlrHHXssF/pWLR3ydJCq33QbXXuv50h9eeZsfrXyNwSNHjz03unkUn5k/iwtO76h8n7NnV/63ZYoi+PcBM/J+nw5szd/AOZefMPs+8E9eb+ScWwosBeju7i6nfFly2tth27aqvHUjzE2eVPmffevhdwA4OHp4J6HKdats8mT4yEc8X7oAeGv+yIbRBQ3wvYgi+D8HzDazU4F+4Hrgk/kbmNlU51wuMl0FrI9gv5Jv8mRYt64qb11up5ZEL/+zHz+YCf75LX9QuW7cGrUvLXTwd84dMbMbgSeAJuAe59w6M/tHoMc5twz4gpldBRwBdgKfCbtfKVDFtE891iinRf5nPG5wgCEbxaHm0ceeUyevVCqSQV7OueXA8oLn/iHv51uAW6LYl/hob4c9e2DjRmhqKr19AN1Hd/HG3kMjnrcZMzy2lijlD84bf/gdDraMyVR3oU5eCUcjfJPipJMyj2ecEflb/8zn+S0f/Rjw7yLfnxyXXx8+bnCAg6NbaW1p0sAtCU3BPyk+/WmYNAkOH67K2696fRfLX9jG7oODtI0bzRfWPMrMHZoRtNryB+eNP/wOh8ZoxK5Ew5yrz6Ka7u5u19PTE/dhpE7ZJZ3XXw+rV8OGDbU/yLS66iro68t87iI+zGyVc6671HZq+csxgUo6OzsrWuBCQtDi7RIhTeksxwSadrajI1NdVKU0k3hQ8JcIKfjLMYFKOnMrHGlKidpR8JcIKfjLMYGmnc0Ff6V+asdj/V6RSin4yzGB5vzvzM5lqOBfO2r51716W6e3GHX4plSxqp6yqn1yLf/t22t41Cmn4F/XGm0OLAX/FCp1kpZ1oirtU1uDg5nOdQX/utVoc2Ap7ZNCfifpTQ+tLf9WtUTwb6Tb34aQt3i71KdGmwNLLf8UKnYyln2rOno0TJzomfZptNvfMGq2zkHeEo5Sn/LnYSp8vh6p5Z9CpU5G39r+Qh0dni3/QOMFGli5i3dHIhf8Ve1TtwIVTNQBBf8U8jpJC5V1q+oT/Bvt9rdSNb3IqeUfu1KpzIVzu7j1mjl0tbViZGZdLWceprhSpEr7pFB+VY/XbSqUeava2em5elij3f5WqqYXOQX/WJWbygy6sEucKVK1/FNq4dwuVi5ewO3XneN7q1qyRdLR4ZnzL3b7m6SO4ECD4nyU/XmowzdW1brLizNFquCfcn63qkDpfLZP2ifUezaQsDneQH0GavnHKuq7vNxF3+/OuxYpUqV9xPNWdf6SFaVrljs7YWAADh6EceOiec8GEmhQnIdAdeEK/rGKMpVZmOrx21+1KfiLp7JaOvmjfE85JZr3bDBhFu8O9Hko+Mcqf0W1nEorebwu+vlqVSGk4C+eymrp5A/0KiP4p6EjOEjdf6DPQ6WesQp7l5evWGOnlusyK/iLp7JaOgGneIiy9VSPglZuBPo89u/PDKxraanOwUtJYe7y8vld9LvaWlm5eEHo9y+XOnzFU1k1ywFn9iz2nkmoAgpauRGoLlyTuiVGvQwGU8tffJVs6VQws6fXeyZlOohK+jT8PuPC9NFPtmznFAX/RIgyhRSGgr9Urq0NmppCz+zZaLMh+omqT8PrYrh+01YmN49lYiRHKnGLKoUUhoK/VG7UKJgyJXTwb8gqoIEBeOwxOHTo2FP/MriLn73Uy+Ehd+y5libj490z4N7est/6xV+9xBUHh6+NfMrbffSOGct7wx+5CBBR8DezDwPfAZqAu51zSwpeHwPcB8wDdgDXOedei2LfUnv5KYkVtDJm4xamhXi/hqwC+tnP4IYbhj01L/tvhF8Ge+u/93l++ZnzFfwlMqGDv5k1AXcAlwF9wHNmtsw591LeZn8D7HLOvcvMrgf+Cbgu7L6l9gpTEm+NmcCoTb38cU1/xbexDVkFtHkzmMHLL0NztDfQH7vzD7yx950RzzdNn84Vke5J0iyKs/ZcYJNzbjOAmT0IXA3kB/+rgW9kf/458F0zM+ecQxpKYX5+Z+tETt/Rx00h8vP10gEGAer0t2yBk0+G2bMjP4ZPfWK058Xw1ivPinxfkl5RBP8uID+h2Qec57eNc+6Ime0BpgDDksVmtghYBDBz5swIDk2iVpiH3zluIt19e0Pn5+uhAyxQ1VFvL1TpHK2ni6EkVxTB3zyeK2zRl7MNzrmlwFKA7u5u3RXUocL8/M7WSUwe2EvXxDExHlU0AlUd9fbCnDlVO5Z6uBhKskUR/PuAGXm/Twe2+mzTZ2bNwCRgZwT7lhorzM/vap1IszvKLRecHPORBeOV3im76si5TNrnCmXgJVo1WxaUaIL/c8BsMzsV6AeuBz5ZsM0y4Abg/wEfA1Yo39+YClMSrmMKAFdOGx34vWp5ohfu1yu90zauhV0FJZbgUXW0c2em1FOpSYlQrQc7hg7+2Rz+jcATZEo973HOrTOzfwR6nHPLgB8A/2Zmm8i0+K8Pu1+Jz7CUxBPN8NMlmVr/M87w3N4ryAOxjer1S++MaR5Fa0tT6aqj3mwX14wZiESl1oMdI6lRc84tB5YXPPcPeT+/A3w8in1JnSkxxYNfa2Zsy6iyT/So7xD80jt7Bg7z7evOKb2vLVsyjwr+EqFaD3bUCF8JJ29mT68g7dea8ZvPvPBEr8atcLFBZWV1tOZa/kr7SIRqPdhRs3pKONmZPdc9/4rnkoR+y9T5KTzRq7HGaehZFXt7M1Mrn3hixccgUqjWs32q5S/hjBsHra38ac0mBi6YP+ylgcNDNJkx5NG339bawqEjR0vm1yu5FS6VJgpdR79lC0yfnpnbSCQitR7foeAv4XV0MHqXd+XukHOenajfuCozS02pEz3orXC5aaJQdfRVHOAl6VbL8R0K/hJeRwdzt27mhlUjZzBra23hknefyJPr32LPwGEmZX8/+/cbAVg4HsitTPj7dfD74X9/567dLPvT1mEzZVpLC91fvdHzUGpSMdHbCxdeGM17icREwV/CmzOH09fcx/9483ver/8Szi74vVxnU/C3OZeeCn81Mhfqlw7q3z3A/CUrwt9GDw1BX59a/tLwFPwlvB/+EL71LR5/fhvfXbGRN/a+w8kTx3LjgtlcefbU6Pd33nnw1FPwd3834iW/NBGEqxTK9SMM9fbyzNAQa5nAOcGPXKRuKPhLeNlFXa780BSu/FANZp688EL45S/h6NERna5e00PnqyQFlN+PMHdvZi7Cu14Z5MMhprEWiZvKFaTxXHQR7NgBf/7ziJfyF0X3E3TQTH4/wrS9mcFsr46fUnG5aRIWq5fGp+AvocQSyHKdrU8/7fnywrldrFy8wPcCEHTQTP7FYuq+TPDfNqGjopGXubuIwvEQugBIrSn4S8ViC2Snn55ZSOWpp4puFtWgmfyLxbS9b7N/dCt7x4yvaORlNQatiVRCwV8qFlsgM8u0/n1a/jn5KSADutpaufWaOYHz9PkXkWn7trN1Qieto5tLXkS87ooacrF6SSR1+ErFYg1kF12UWUT99dfhlFN8R/VGMWgmf+Tl1L1vs7P9pJIXEa/BZjc/tHbkCkZZdb1YvSSSgr9UrNYTUQ2Tl/d/dGdz1aeHPnYRuX0vfPCDUOJ9ve6K/AJ/3S9WL4mktI9UrNYTUQ1z1lkwaRI8/XTt0k+HDsGbb5Y1wKvcu59KU1EiYanlLxWLdaHxpiaYPx+eeoqtk6/y3CTy9FNfX+axjHn8iw02yzFg5eIFERyYSHAK/hJKrAuNX3ghLF/Oe649xLojIxeQjzz9FGAFr1KDzUB5fomXgr80rosuAuAHT93JU/ubOXL0eFa9eZRx7qx2WPRgdPvbvDnzWEbaJ/+uqH/3AMbwnL/y/BI3q9d11Lu7u11PT0/chyH1bHAwcwHYsoWBw0c5cOgIQ87RZMb4Mc20tlShS2vGjEyJ6ehgC9bHtVi9pI+ZrXLOdZfcTsFfRCQ5yg3+qvYREUkhBX8RkRRSh69IQMrfSxIo+IsEUO4awSL1LlTax8zazezXZrYx+zjZZ7shM1ub/bcszD5F4qRZOSUpwub8FwNPOudmA09mf/cy4Jw7J/vPezimSAPQrJySFGHTPlcDF2d/vhf4HfDfQr6nSFVEkauPdTI7kQiFbfmf5JzbBpB9PNFnu7Fm1mNmz5jZQr83M7NF2e16tm/fHvLQRI6LauGZWCezE4lQyZa/mf0GONnjpa8F2M/OwIcnAAAGW0lEQVRM59xWMzsNWGFmLzjnXincyDm3FFgKmUFeAd5fpKhiufogrf9YJ7MTiVDJ4O+cu9TvNTN708ymOue2mdlU4C2f99iafdxsZr8D5gIjgr9ItUSZq491MjuRiIRN+ywDbsj+fAPwWOEGZjbZzMZkf+4A5gMvhdyvSCB+OXnl6iWtwgb/JcBlZrYRuCz7O2bWbWZ3Z7d5N9BjZn8Cfgsscc4p+EtNKVcvMlyoah/n3A7gEo/ne4C/zf78B2BOmP2IhKVcvchwGuErqaFcvchxmthNRCSFFPxFRFJIaR9pKJpRUyQaCv7SMKo1o6YuKJJGCv7SMKIapZuv2AUlt09dFCSJFPylYVRjRk2/C8o3lq3j0JGjmrdfEksdvtIwqjFK1+/CsXvgsObtl0RT8JeGUY1RukEvHJq3X5JCwV8axsK5Xdx6zRy62loxoKutlVuvmRMqDeN3QZk8rsVze80FJEmhnL80lKhH6fpN+wAM6wgGzQUkyaLgL6lX7IKiah9JKgV/ER+aC0iSTDl/EZEUUvAXEUkhBX8RkRRS8BcRSSEFfxGRFFK1j9QdzbIpUn0K/lJXqjVts4gMp7SP1JVi0zaLSHQU/KWuVGPaZhEZScFf6ko1pm0WkZEU/KWuVGPaZhEZKVTwN7OPm9k6MztqZt1Ftvuwmb1sZpvMbHGYfUqyBZm2+dE1/cxfsoJTFz/O/CUreHRNf+0PWKRBha32eRG4Bvie3wZm1gTcAVwG9AHPmdky59xLIfctCVXOhGqqChIJJ1TL3zm33jlXqgzjXGCTc26zc24QeBC4Osx+RVQVJBJOLXL+XUBv3u992edEKqaqIJFwSqZ9zOw3wMkeL33NOfdYGfswj+ecz74WAYsAZs6cWcZbS1pNa2ul3yPQqypIpDwlW/7OuUudc2d5/Csn8EOmpT8j7/fpwFaffS11znU757o7OzvLfHtJI1UFiYRTi+kdngNmm9mpQD9wPfDJGuxXEsxv7V119oqUJ1TwN7N/D/wr0Ak8bmZrnXOXm9k04G7n3BXOuSNmdiPwBNAE3OOcWxf6yCX1tMyiSOVCBX/n3C+AX3g8vxW4Iu/35cDyMPsSEZHoaISviEgKKfiLiKSQgr+ISAop+IuIpJCCv4hICplznoNtY2dm24HX4z6OCHQAb8d9EHVCn8Vw+jyO02cxXJjP4xTnXMlRsnUb/JPCzHqcc77TXaeJPovh9Hkcp89iuFp8Hkr7iIikkIK/iEgKKfhX39K4D6CO6LMYTp/Hcfoshqv656Gcv4hICqnlLyKSQgr+VWBmM8zst2a2PrvA/RfjPqZ6YGZNZrbGzH4V97HEyczazOznZvbn7DnygbiPKU5mdnP2e/KimT1gZmPjPqZaMrN7zOwtM3sx77l2M/u1mW3MPk6Oer8K/tVxBPiSc+7dwPnA583sPTEfUz34IrA+7oOoA98B/o9z7i+A95Hiz8TMuoAvAN3OubPITPt+fbxHVXM/Aj5c8Nxi4Enn3GzgyezvkVLwrwLn3Dbn3Orsz/vIfLlTPfG8mU0HrgTujvtY4mRmE4GLgB8AOOcGnXO74z2q2DUDrWbWDIzDZ6W/pHLOPQXsLHj6auDe7M/3Aguj3q+Cf5WZ2SxgLvBsvEcSu9uBrwBH4z6QmJ0GbAd+mE2B3W1m4+M+qLg45/qB/wVsAbYBe5xz/zfeo6oLJznntkGmMQmcGPUOFPyryMxOAB4GbnLO7Y37eOJiZh8F3nLOrYr7WOpAM/B+4E7n3FzgAFW4pW8U2Vz21cCpwDRgvJl9Kt6jSgcF/yoxsxYygf9+59wjcR9PzOYDV5nZa8CDwAIz+3G8hxSbPqDPOZe7E/w5mYtBWl0KvOqc2+6cOww8AlwQ8zHVgzfNbCpA9vGtqHeg4F8FZmZkcrrrnXPfivt44uacu8U5N905N4tMZ94K51wqW3fOuTeAXjM7M/vUJcBLMR5S3LYA55vZuOz35hJS3AGeZxlwQ/bnG4DHot5BqDV8xdd84NPAC2a2NvvcV7NrGYv8F+B+MxsNbAY+G/PxxMY596yZ/RxYTaZKbg0pG+1rZg8AFwMdZtYHfB1YAvzUzP6GzAXy45HvVyN8RUTSR2kfEZEUUvAXEUkhBX8RkRRS8BcRSSEFfxGRFFLwFxFJIQV/EZEUUvAXEUmh/w9S3+vzkmk54gAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x20350e52da0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "model = XGBoostRegressor(loss='logistic')\n",
    "model.fit(data, target)\n",
    "plt.scatter(data, target)\n",
    "plt.plot(data, model.predict(data), color='r')\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {},
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.4"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}