{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# 在Keras中使用圖像增強來進行深度學習\n",
    "\n",
    "使用神經網絡和深度學習模型時需要準備數據。對於複雜的圖像對象物件識別的任務，也需要越來越多的數據增強功能。\n",
    "\n",
    "在這篇文章中，您將了解使用Keras開發深度學習模型時，如何使用數據準備和數據增強來讓您的模型的效能更好。"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Keras圖像增強API\n",
    "\n",
    "\n",
    "Keras的圖像增強(image augmentation) API簡單而強大。\n",
    "\n",
    "\n",
    "Keras提供ImageDataGenerator類別，用於定義圖像數據準備和增強的配置。這包括以下功能：\n",
    "\n",
    "* 圖像隨機旋轉(rotate)\n",
    "* 圖像隨機偏移(shift)\n",
    "* 圖像隨機推移錯切(shear)\n",
    "* 圖像隨機翻轉(flip)\n",
    "* Sample-wise 圖像像素標準化\n",
    "* Feature-wise 圖像像素標準化\n",
    "* ZCA 白化轉換\n",
    "* 圖像張量維度的重排序\n",
    "* 儲存增強圖像數據\n",
    "\n",
    "增強圖像生成器可以透過以下的方法創建：\n",
    "\n",
    "    datagen = ImageDataGenerator()\n",
    "    \n",
    "Keras並不是在記憶體中對整個圖像數據集執行圖像轉換操作，而是設計為通過深度學習模型訓練過程進行迭代，從而為您動態地創建增強的圖像數據。這會減少您的記憶體開銷，但在模型訓練期間會增加一些額外的時間成本。\n",
    "\n",
    "創建並配置好**ImageDataGenerator**之後，您必須用您的數據來訓練它。這個步驟將計算實際執行轉換到您的圖像數據所需的任何統計參數。您可以通過調用數據生成器上的**fit( )**函數並將傳遞您的訓練數據集來完成這個前置動作。\n",
    "\n",
    "    datagen.fit(train)\n",
    "    \n",
    "數據生成器本身實際上是一個迭代器，當被呼叫時返回一個批量的圖像資料。我們可以通過調用**flow( )**函數來配置批量大小並並獲取批量的圖像資料。\n",
    "    \n",
    "    X_batch, y_batch = datagen.flow(train, train, batch_size=32)\n",
    "\n",
    "最後我們就可以使用數據生成器。我們不必調用我們模型的**fit( )**函數，而是調用**fit_generator( )**函數，並傳遞數據生成器的實例(instance)和每個循環的步數(steps_per_epoch)以及要訓練的循環總數(epochs)。\n",
    "\n",
    "    model.fit_generator(datagen.flow(X_train, Y_train, batch_size=batch_size),\n",
    "                        steps_per_epoch=len(X_train)/batch_size,\n",
    "                        epochs=nb_epoch)\n",
    "                        \n",
    "您可以在Keras文檔中了解關於Keras[圖像數據生成器API](http://keras.io/preprocessing/image/)或是[圖像數據生成器API中文](http://eighty20.cc/keras-docs-tw/preprocessing/image/)更多信息。"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 圖像增強(Image Augmentation)相關參數的比較\n",
    "\n",
    "現在您已經知道Keras中的圖像增強API是如何工作的，我們來看一些例子。\n",
    "\n",
    "這些例子中我們將使用MNIST手寫數字識別的圖像集。首先，讓我們看看訓練數據集中的前6個圖像。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 40,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAeAAAAFICAYAAACImy0WAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4wLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvpW3flQAAGy1JREFUeJzt3XmQFfW1wPHzgwFkEQgJQaLFJosL\nwggiQlFAIqAiUcCIIjKBRLEkqLGEwpjRDCoguLxCBOOTsFNBKiiokRIjCJFlCqKYUjIKGNkFVAZm\nWIYH9PsDXtX79Wlzh8u999zl+6miKufUud1H0jOHnv7Nr10QBAIAAFKrinUDAADkIgYwAAAGGMAA\nABhgAAMAYIABDACAAQYwAAAGGMAAABhgAKeAc+4D59xx51z52T+fW/eE7Oaca+Cce8M5d8Q5t905\nd5d1T8gdzrlWZ7/nzbfuJZ0xgFNnVBAEdc7+aWPdDLLeNBE5ISKNRGSIiLzsnLvStiXkkGkissG6\niXTHAAayjHOutojcJiKPB0FQHgTBhyLypogMte0MucA5d6eIlIrI+9a9pDsGcOpMdM5945xb45zr\nad0MslprETkVBMEX/y/3iYhwB4ykcs7VFZEnReQR614yAQM4NcaKSAsRuVhE/ltE3nLOXWrbErJY\nHRE5FModEpELDXpBbnlKRP4UBMFO60YyAQM4BYIgKA6CoCwIgoogCOaIyBoR6WvdF7JWuYjUDeXq\nikiZQS/IEc65fBHpJSL/Zd1LpsizbiBHBSLirJtA1vpCRPKcc62CINhyNtdeRD4z7AnZr6eINBOR\nHc45kTM/ianqnLsiCIIOhn2lLcfrCJPLOVdfRDqLyCoROSkid8iZH0N3CIKAX0dCUjjnFsqZf+jd\nIyL5IvKOiHQNgoAhjKRwztUS/ycvo+XMQL4/CIIDJk2lOe6Ak6+aiDwtIpeJyCkRKRGR/gxfJNlI\nEZkpIvtF5Fs5802Q4YukCYLgqIgc/b/YOVcuIscZvt+PO2AAAAywCAsAAAMMYAAADDCAAQAwwAAG\nAMBASldBO+dY8ZXDgiAw+d1nrrvcZnHdcc3ltspec9wBAwBggAEMAIABBjAAAAYYwAAAGGAAAwBg\ngAEMAIABBjAAAAYYwAAAGGAAAwBggAEMAIABBjAAAAYYwAAAGGAAAwBggAEMAIABBjAAAAYYwAAA\nGGAAAwBgIM+6AQCp17FjRy8eNWqUqikoKPDiuXPnqpqpU6d68UcffZSA7oDcwB0wAAAGGMAAABhg\nAAMAYIABDACAARcEQepO5lzqTpZiVatW9eJ69erFdZyoxTC1atXy4jZt2qia3/zmN1783HPPqZrB\ngwer3PHjx734mWeeUTXjxo2LbvYcBUHgEnKgc5TN111l5Ofnq9yKFSu8uG7dunEd+9ChQ178wx/+\nMK7jJJPFdZfr11wqXX/99Sq3YMEClevRo4cXf/7550nrqbLXHHfAAAAYYAADAGCAAQwAgIGc34ij\nSZMmXly9enVV07VrVy/u1q2bqqlfv74X33bbbQnoLtquXbtU7sUXX/TiAQMGqJqysjKV++STT7x4\n1apV59kdLF177bUqt3jxYpULr1GIWgsSvl5OnDihasLPfK+77jpVE7U5R9SxoHXv3l3lwn/nb7zx\nRqraSUudOnVSuQ0bNhh0cu64AwYAwAADGAAAAwxgAAAMMIABADCQU4uwKrMhQbwbaCTT6dOnvbiw\nsFDVlJeXe3HUL6Lv3btX5Q4ePOjFyfzldJyf8IYsIiIdOnTw4vnz56uaxo0bx3W+LVu2ePHkyZNV\nzcKFC714zZo1qibqep04cWJcPeWanj17qlyrVq28ONcWYVWp4t83Nm/eXNU0bdpU5Zwz2QfoP+IO\nGAAAAwxgAAAMMIABADDAAAYAwEBOLcLasWOHyn377bdenMxFWMXFxSpXWlrqxT/96U9VTXjXoHnz\n5iW2MWSEV155ReWi3nCVKOEFXnXq1FE14Z3TohYNtWvXLqF95ZKCggKVW7dunUEn6SO8qPDee+9V\nNVGLEUtKSpLWU7y4AwYAwAADGAAAAwxgAAAM5NQz4O+++07lxowZ48X9+vVTNR9//LEXh988FGXT\npk0q17t3b5U7cuSIF1955ZWq5qGHHop5PmSfjh07evHNN9+saiqzuUDUG67eeustL37uuedUzZ49\ne7w4/HUgojdy+dnPfhZXj4gW3nQCIjNmzIhZE95EJl3x/y4AAAYYwAAAGGAAAwBggAEMAICBnFqE\nFWXJkiVeHH47kohIWVmZF7dv317V/PrXv/biqEUt4QVXUT777DOVGzFiRMzPIbNFvanrvffe8+K6\ndeuqmiAIvHjZsmWqJmqzjh49enhx1BuLwotdDhw4oGo++eQTLw6/uUskevFYeJOPjz76SNXkovCm\nJY0aNTLqJH1VZrOk8NdOuuIOGAAAAwxgAAAMMIABADCQ88+Aww4fPhyz5tChQzFrojYIf+2111Qu\n6pkZsl/r1q29OLwhjIh+1vXNN9+omr1793rxnDlzVE15ebnK/fWvf/2PcSLVrFlT5R555BEvHjJk\nSNLOn0n69u3rxVF/d7kk6hl48+bNY35u9+7dyWgn4bgDBgDAAAMYAAADDGAAAAwwgAEAMMAirDgU\nFRWpXPjNNeGNDkREevXqpXLLly9PWF9ITzVq1FC58EYt4cU3InoDmIKCAlWzceNGL86URTtNmjSx\nbiEttWnTJmZN1GY92SpqQ6PwwqwvvvhC1YS/dtIVd8AAABhgAAMAYIABDACAAZ4BxyHqpQrhjTei\nNpd/9dVXVW7lypVeHH6mJyIybdo0Lw5vwI/0dvXVV6tc1DPfsFtvvdWLV61albCekLk2bNhg3UJc\nwi8TufHGG1XN3Xff7cV9+vSJedynnnpK5UpLS8+xOxvcAQMAYIABDACAAQYwAAAGGMAAABhgEVaC\nbNu2zYuHDRumambNmqVyQ4cO/Y+xiEjt2rW9eO7cuaom/FYcpI8XXnhB5ZxzXhy1wCoTF11VqaL/\nTc8bvxKrQYMGCTlO+/btVS58XUZtHnTJJZd4cfXq1VVN1NutwtfGsWPHVE1xcbEXV1RUqJq8PH9s\n/eMf/1A1mYI7YAAADDCAAQAwwAAGAMAAAxgAAAMswkqSN954Q+W2bNmicuEFOtdff72qmTBhghc3\nbdpU1YwfP96Ld+/eXak+kVj9+vVTufz8fJUL72b25ptvJq2nVIpacBW1c9umTZtS0U7GCS9Mivq7\n++Mf/+jFjz32WFznateuncqFF2GdPHlS1Rw9etSLN2/erGpmzpypcuFd/qIWGe7bt8+Ld+3apWrC\nb/wqKSlRNZmCO2AAAAwwgAEAMMAABgDAAM+AU+jTTz9VuUGDBnnxz3/+c1UT3sDjvvvuUzWtWrXy\n4t69e8fTIs5T+PmUSPRGBfv37/fi1157LWk9JUqNGjVUrqioKObnVqxYoXK/+93vEtFS1hk5cqQX\nb9++XdV07do1IefasWOHyi1ZssSL//Wvf6ma9evXJ+T8UUaMGOHFDRs2VDVffvll0s6fatwBAwBg\ngAEMAIABBjAAAAYYwAAAGGARlrHS0lIvnjdvnqqZMWOGF4ffBiIi0r17dy/u2bOnqvnggw/OvUEk\nRfgtL+n4NqvwoqvCwkJVM2bMGC+O2jjh+eefV7ny8vLz7C43TJo0ybqFlIraiChs8eLFKegkNbgD\nBgDAAAMYAAADDGAAAAzwDDiFojY//8UvfuHFnTp1UjVRz3zDwhuir169+hy7Qyql28sXol4YEX6+\ne8cdd6iapUuXevFtt92W2MaAkKgX3WQq7oABADDAAAYAwAADGAAAAwxgAAAMsAgrQdq0aePFo0aN\nUjUDBw5UuYsuuuicz3Xq1CmVC2/kcPr06XM+Ls6fc65Suf79+3vxQw89lLSeojz88MNe/Pjjj6ua\nevXqefGCBQtUTUFBQWIbA3IId8AAABhgAAMAYIABDACAAZ4BV0L4Oe3gwYNVTfiZb7NmzRJ2/o0b\nN3rx+PHjVU26beyQq4IgqFQufE29+OKLqmbmzJle/O2336qa6667zouHDh2qatq3b69yl1xyiRfv\n2LFD1bz77rtePH36dFUDJFPU+onWrVt78fr161PVTsJxBwwAgAEGMAAABhjAAAAYYAADAGAg5xdh\nNWrUyIuvuOIKVfPSSy958WWXXZaw8xcXF3vxs88+q2rCb5xhk43MV7VqVS8eOXKkqgm/Wejw4cOq\nplWrVnGdf+3atV68cuVKVfPEE0/EdWwgUaIWMFapkj33jdnzXwIAQAZhAAMAYIABDACAAQYwAAAG\nsnYRVoMGDVTulVdeUbn8/HwvbtGiRULOH17kIiLy/PPPq1x4t6Fjx44l5PywsW7dOpXbsGGDynXq\n1CnmscK7ZYUXDEaJ2i1r4cKFKpfqty8BidKlSxcvnj17tk0jCcAdMAAABhjAAAAYYAADAGAgI58B\nd+7cWeXGjBnjxddee62qufjiixNy/qNHj6pc+G02EyZMUDVHjhxJyPmRvnbt2qVyAwcOVLn77rvP\niwsLC+M635QpU7z45ZdfVjVbt26N69iAtai3IWUT7oABADDAAAYAwAADGAAAAwxgAAAMZOQirAED\nBlQqVxmbN2/24rffflvVnDx50oujNtQoLS2N6/zIfnv37lW5oqKi/xgDuWjZsmVefPvttxt1khrc\nAQMAYIABDACAAQYwAAAGXBAEqTuZc6k7GdJOEAQmv1XPdZfbLK47rrncVtlrjjtgAAAMMIABADDA\nAAYAwAADGAAAAwxgAAAMMIABADDAAAYAwAADGAAAAwxgAAAMMIABADDAAAYAwAADGAAAAwxgAAAM\npPRtSAAA4AzugAEAMMAABgDAAAMYAAADDGAAAAwwgAEAMMAABgDAAAMYAAADDGAAAAwwgAEAMMAA\nBgDAAAMYAAADDOAkc86Ncs5tdM5VOOdmW/eD3OCcu9w5t8I5d8g5t9U5N8C6J2Q351wN59yfnHPb\nnXNlzrmPnXM3WfeVzhjAybdHRJ4WkZnWjSA3OOfyRGSpiLwtIg1EZISIzHfOtTZtDNkuT0R2ikgP\nEaknIo+LyCLnXDPDntIab0NKEefc0yJySRAEw6x7QXZzzrUVkfUicmFw9gvcObdcRIqDIHjctDnk\nFOfcP0VkXBAEi617SUfcAQPZx31Prm2qG0Hucs41EpHWIvKZdS/pigEMZJ8SEdkvImOcc9Wcc33k\nzI8Fa9m2hVzhnKsmIgtEZE4QBCXW/aQrBjCQZYIg+B8R6S8iN4vI1yLyiIgsEpFdln0hNzjnqojI\nPBE5ISKjjNtJa3nWDQBIvCAI/iln7npFRMQ5t1ZE5th1hFzgnHMi8icRaSQifc/+YxDfgwGcZGdX\npOaJSFURqeqcu0BETgZBcNK2M2Qz51w7EflCzvyUa6SINBaR2ZY9ISe8LCKXi0ivIAiOWTeT7vgR\ndPIVisgxEXlURO4++78LTTtCLhgqInvlzLPg60WkdxAEFbYtIZs555qKyH0iki8iXzvnys/+GWLc\nWtri15AAADDAHTAAAAYYwAAAGGAAAwBggAEMAICBlP4aknOOFV85LAiCqC0Sk47rLrdZXHdcc7mt\nstccd8AAABhgAAMAYIABDACAAQYwAAAGGMAAABhgAAMAYIABDACAAQYwAAAGGMAAABhgAAMAYIAB\nDACAAQYwAAAGGMAAABhgAAMAYIABDACAAQYwAAAGGMAAABhgAAMAYIABDACAAQYwAAAGGMAAABhg\nAAMAYCDPugGcu8LCQpUbN26cF1epov9t1bNnT5VbtWpVwvoCgO9z4YUXenGdOnVUzc033+zFDRs2\nVDUvvPCCF1dUVCSgOxvcAQMAYIABDACAAQYwAAAGeAacAYYNG+bFY8eOVTWnT5+OeZwgCBLVEgCI\niEizZs1ULup7VJcuXby4bdu2cZ2vcePGXvzggw/GdZx0wB0wAAAGGMAAABhgAAMAYIABDACAARZh\nZYCmTZt68QUXXGDUCdJN586dvfjuu+9WNT169FC5K6+8MuaxR48e7cV79uxRNd26dfPi+fPnq5ri\n4uKY50J6uuyyy1Tut7/9rRcPGTJE1dSsWVPlnHNevHPnTlVTVlbmxZdffrmqGTRokBdPnz5d1ZSU\nlKhcOuIOGAAAAwxgAAAMMIABADDAAAYAwACLsNJMr169VO6BBx6I+bnwooN+/fqpmn379sXfGMzd\ncccdKjdlyhQv/tGPfqRqwotfREQ++OADL45668yzzz4bs6fwsaOOc+edd8Y8DlKvXr16Kjdp0iQv\njrrmwm81qqwtW7Z48Q033KBqqlWr5sVRi6nC13jUNZ8puAMGAMAAAxgAAAMMYAAADPAM2Fh4I4NZ\ns2apmqhnNWHh53Xbt28/v8aQUnl5+kvxmmuu8eJXX31V1dSqVcuLV69erWqeeuoplfvwww+9uEaN\nGqpm0aJFXtynTx9VE7Zx48aYNUgPAwYMULl77rknIcfetm2byvXu3duLozbiaNmyZULOnym4AwYA\nwAADGAAAAwxgAAAMMIABADDAIixjv/zlL734Jz/5SczPhDdREBGZO3duolqCgai3GM2YMSPm5957\n7z0vjto44fDhwzGPE/W5yiy62rVrlxfPmTMn5meQHm6//fa4PvfVV1958YYNG1TN2LFjVS5q0VVY\n1NuPshl3wAAAGGAAAwBggAEMAIABngGnUNSm4b/61a+8+PTp06qmtLTUi59++unENoaUC2+O8dhj\nj6maIAi8ePr06aqmsLDQiyvzvDfK73//+7g+9+CDD3rxgQMH4joOUu/ee+9VuREjRnjx8uXLVc3W\nrVu9eP/+/QnrqVGjRgk7VibgDhgAAAMMYAAADDCAAQAwwAAGAMAAi7CSpFmzZiq3ePHiuI41depU\nL165cmVcx4GNJ554QuXCi65OnDihat59910vjtrc4NixYzHPf8EFF6hceJONJk2aqBrnnBdHLf5b\nunRpzPMjPe3Zs0flioqKUt/I/9OlSxfT86cad8AAABhgAAMAYIABDACAAZ4BJ8mNN96ocu3atYv5\nuffff1/lpkyZkpCekHz169dXuZEjR6pceJON8PNeEZH+/fuf8/lbtmypcgsWLFC5jh07xjzWX/7y\nFy+ePHnyOfeD7BfejEVEpHbt2nEd66qrropZs3btWi9et25dXOdKB9wBAwBggAEMAIABBjAAAAYY\nwAAAGHDhxSBJPZlzqTtZioUXzMyePVvVRC1MCC8oGDRokKrZt2/f+TWXJoIgcLGrEi+V192Pf/xj\nlYva8CCsRYsWKnf8+HEvHj58uKq55ZZbvLht27aqpk6dOioX/rqP+j4wcOBAL37rrbdUTSawuO4y\n9XtdrVq1vPiKK65QNX/4wx+8uG/fvpU6dpUq/v1e1JvfwqK+dnr27OnF27Ztq9T5U6my1xx3wAAA\nGGAAAwBggAEMAIABBjAAAAbYCSsOiXzT0ZdffunF2bLgKldFvdXowIEDKtewYUMv/ve//61q4lkg\nGbVo5fDhwyrXuHFjL/7mm29UTaYuukK0atWqefHVV1+tasLfx8LXiYh+A1fUNRe1O1V4d8Dwgq8o\neXl6RIUXB0btFBj1dZiOuAMGAMAAAxgAAAMMYAAADPAMOA5jx45Vucr8UnmUZ5555nzbQRopLS1V\nuai3Gr399tte3KBBA1UT3mBg6dKlqia84ct3332nahYuXKhy4Wd7UTXIXNWrV1e58DPY119/PeZx\nxo0bp3IrVqzw4jVr1qiaqOs5/LmoTWPCwmslREQmTpzoxTt27FA1S5YsUbmKioqY50s17oABADDA\nAAYAwAADGAAAAwxgAAAMsAirEvLz8724T58+cR0nahHN559/HtexkDmKi4tVLmpxSSJ0795d5Xr0\n6KFy4UWD4Q1hkDnCG2yIRC+eGjNmTMxjLVu2zIunTp2qasILDaOu5XfeeUflrrrqKi+O2ixj8uTJ\nXhy1UOvWW2/14gULFqiav/3tbyo3adIkLz548KCqCdu0aVPMmvPBHTAAAAYYwAAAGGAAAwBgwMWz\n4XvcJ3MudSdLoP3793vxD37wg5ifWb9+vcrddNNNKldeXh5/YxkmCAJncd5Mve7iccMNN6hc1PO4\n8Nd91Kb7US+RyEQW110yr7mqVat68fjx41XN6NGjVe7IkSNe/Oijj6qa8IYsUc9Jr7nmGi9+6aWX\nYtaIiGzdutWL77//flWzcuVKL65bt66q6dq1qxcPGTJE1dxyyy0qV7t2bZUL27lzpxc3b9485mei\nVPaa4w4YAAADDGAAAAwwgAEAMMAABgDAAIuwKuHUqVNeXJk3HxUUFKjcn//854T1lIlYhGUjfP2K\nsAgr2ZJ5zYUXL0VtlnH06FGVGzFihBcvX75c1XTu3NmLhw8frmrCi0lr1qypap588kmVmzVrlheH\nFzwl0uDBg1Xurrvuivm5hx9+2IvDC8cqi0VYAACkMQYwAAAGGMAAABjgGXBI+DmFiMiwYcO8uDLP\ngFu0aKFy27dvj7uvbMAz4ORjIw4t254B792714ujXoZQUVGhciUlJV4ctTFFy5Ytz7mfoqIilZs4\ncaLKRa1FyFY8AwYAII0xgAEAMMAABgDAAAMYAAADedYNWMvPz/fiXr16qZrwoqsTJ06ommnTpnnx\nvn37EtAdcG6iFv8hu3z99ddeHLUIq0aNGirXvn37mMcOL9hbvXq1qlmyZIkXf/XVV6omlxZcnQ/u\ngAEAMMAABgDAAAMYAAADDGAAAAzk/CKs+vXre/FFF10U8zO7d+9WudGjRyesJyBef//731WuShX9\n7+zK7OaG9NS9e3cv7t+/v6rp0KGDyu3fv9+LZ86cqWoOHjzoxVELTpE43AEDAGCAAQwAgAEGMAAA\nBnL+GTCQTT799FOV27Jli8qFN+y49NJLVU22vA0p25SVlXnxvHnzVE1UDumHO2AAAAwwgAEAMMAA\nBgDAAAMYAAADOb8Iq6SkxIvXrl2rarp165aqdoCEmzBhgsrNmDHDi8ePH69qHnjgAS/evHlzYhsD\nchx3wAAAGGAAAwBggAEMAIABFwRB6k7mXOpOhrQTBIGzOG+uX3d169ZVuUWLFnlxr169VM3rr7/u\nxcOHD1c1R44cOc/uks/iusv1ay7XVfaa4w4YAAADDGAAAAwwgAEAMMAABgDAAIuwkDIswkof4YVZ\nURtx3H///V7crl07VZMJm3OwCAupxiIsAADSGAMYAAADDGAAAAzwDBgpwzNgWOAZMFKNZ8AAAKQx\nBjAAAAYYwAAAGGAAAwBgIKWLsAAAwBncAQMAYIABDACAAQYwAAAGGMAAABhgAAMAYIABDACAAQYw\nAAAGGMAAABhgAAMAYIABDACAAQYwAAAGGMAAABhgAAMAYIABDACAAQYwAAAGGMAAABhgAAMAYIAB\nDACAAQYwAAAGGMAAABhgAAMAYIABDACAAQYwAAAG/hfHno9VjYUCHwAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1765c7fe0f0>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "import keras\n",
    "# Plot images\n",
    "from keras.datasets import mnist\n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "# load data\n",
    "(X_train, y_train), (X_test, y_test) = mnist.load_data()\n",
    "\n",
    "plt.figure(figsize=(8,8)) # 設定每個圖像顯示的大小\n",
    "\n",
    "# 產生一個3x2網格的組合圖像\n",
    "for i in range(0, 6):\n",
    "    plt.subplot(330+1+i) # (331) -> 第一個子圖像, (332) -> 第二個子圖像\n",
    "    plt.title(y_train[i])\n",
    "    plt.axis('off')     #不顯示坐標\n",
    "    plt.imshow(X_train[i], cmap=plt.get_cmap('gray')) # 以灰階的圖像顯示\n",
    "    \n",
    "# 展現出圖像\n",
    "plt.show()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "運行這個例子會提供了以上的圖片，我們可以用它來比較下面例子中的圖片準備(image preparation)和增強(augmentation)對圖像轉換效果的理解。"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 隨機旋轉 (Random Rotations)\n",
    "\n",
    "有時您的樣本數據中的圖像可能在場景中會有不同的旋轉的角度。\n",
    "\n",
    "在訓練您的模型時，妳可以透過隨機旋轉訓練數據集裡的圖像來產生一些新的訓練圖像來幫助您的模型可以更好地處理圖像的旋轉問題。\n",
    "\n",
    "下面的範例通過設置rotation_range參數來創建更多的MNIST數字圖像(隨機旋轉最多可達90度)。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 41,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAeAAAAFICAYAAACImy0WAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4wLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvpW3flQAAHDlJREFUeJzt3XtwVdX1wPG1CSAvA0FARUHkKdAK\ng9haAaVaQER/kGJH5SUqozwc5TeiQgFFFMGCOFp+PGYc0eIUpZUig0V5VBEUFGSQCiYZigVSIwTK\nSxCU5Pz+iB3dZx96Tq733nVy7/cz05muNeues4WbrFz2yj7G8zwBAADpVU17AQAAZCMaMAAACmjA\nAAAooAEDAKCABgwAgAIaMAAACmjAAAAooAGnmDHmPmPMFmPMaWPMS9rrQXYwxjQ0xvzFGHPCGLPH\nGDNIe03IfMaYV4wxJcaYY8aYImPMCO01xZnhII7UMsb8WkTKRaSPiNT2PG+47oqQDYwxi6XiB+y7\nRaSziLwpIld7nrdDdWHIaMaYjiKyy/O808aYy0TkXRHp53nex7oriyc+AaeY53lLPc9bJiKHtNeC\n7GCMqSsiA0Vksud5X3met0FElovIUN2VIdN5nrfD87zT/wm/+18rxSXFGg0YyDxtRaTM87yiH+Q+\nEZGOSutBFjHGzDXGnBSRAhEpEZG/Ki8ptmjAQOapJyJHfbmjInKuwlqQZTzPGy0V77UeIrJURE7/\n91dkLxowkHm+EpFcXy5XRI4rrAVZyPO8su+2Pi4WkVHa64krGjCQeYpEpLoxps0Pcp1EhAEspFt1\nYQ/4rGjAKWaMqW6MqSUiOSKSY4ypZYyprr0uZC7P805IxT/9TTXG1DXGdBOR/iKySHdlyGTGmCbG\nmNuMMfWMMTnGmD4icruI/E17bXFFA069SSLytYiMF5Eh3/3/SaorQjYYLSK1ReSAiCwWkVH8ChJS\nzJOKf24uFpHDIjJLRMZ6nveG6qpijN8DBgBAAZ+AAQBQQAMGAEABDRgAAAU0YAAAFKT112GMMUx8\nZTHP84zGfXnfZTeN9x3vuewW9T3HJ2AAABTQgAEAUEADBgBAAQ0YAAAFNGAAABTQgAEAUEADBgBA\nAQ0YAAAFPJcWABBoyJAhTm7jxo1WfP755zs1H3zwQcrWlEn4BAwAgAIaMAAACmjAAAAooAEDAKCA\nISwAgIiInDx50oo///zz0Nd06NDByc2fPz/0daNGjYq+sAzFJ2AAABTQgAEAUEADBgBAgfE8L303\nMyZ9N0PseJ5nNO7L+y67abzvqsJ7rl27dk7u73//uxXXqFEjZfc/evRoaE2DBg1Sdv9Uivqe4xMw\nAAAKaMAAACigAQMAoIAGDACAAoawkDYMYUEDQ1jBpk+fHlozfvx4J7dz504rDjqIo7y83Mnt3r3b\nilu3bh16/8LCQie3dOlSK16wYIFTs2fPntBrpxJDWAAAxBgNGAAABTRgAAAUsAeMtGEPGBrYA05c\nnTp1nJz/gQ3XXnutU7Nu3brQaz/xxBNO7siRI1Y8a9as0Ou0aNHCybEHDAAAzooGDACAAhowAAAK\naMAAAChgCAtpwxDWj5Ofn+/k+vTpY8Xr16+PdK0TJ05Y8bJly0Jfc8kllzg57WGXKBjCqrr8Q1lB\nzpw54+TmzZvn5CZPnpyUNUXBEBYAADFGAwYAQAENGAAABTRgAAAUMISFtGEI6+zmz5/v5KJ8bd59\n991WXK2a+zN1aWmpk2vcuHHotYuKiqy4b9++Tk3t2rWtuKCgIPS66cYQVnLl5uZa8bFjx1J2r169\nejm5VatWWXHQ18ltt93m5JYsWZK8hYVgCAsAgBijAQMAoIAGDACAguraCwAy3ZAhQ5xct27drHjE\niBFOTXl5eaXvlZOT4+Si7PcG3att27ZWvHDhwkqvR0Rk+PDhTm7v3r0JXQupdc4551jxlClTnJob\nb7zRiqMecLF8+XIr9n8NiIi8//77VnzRRReFXtcYd7t18ODBTi6de8BR8QkYAAAFNGAAABTQgAEA\nUEADBgBAAUNYQIoFDZv4D9AIcuutt1rxhAkTnJr27dtbcdBBHEGiDHj5a6655pqErtOwYUMnxxCW\nvqDhvAMHDoS+bvv27Vb8xhtvRLqf/wCNnj17OjXFxcVW3LJlS6fm1KlTVjxt2jSn5sknn4y0Jm18\nAgYAQAENGAAABTRgAAAU8DCGDNWsWbNIdRdeeKEVX3HFFU7NihUrrHjfvn0JrSlbH8YwceLE0Jr+\n/fs7uZ/97GdJuX/QIR/du3e34jp16jg1AwYMsOKo+8t+Xbt2dXLbtm1L6FqJ4GEM0R05csSK69ev\nr7SSs/PvAffo0cOp2bJlS7qWE4iHMQAAEGM0YAAAFNCAAQBQQAMGAEABQ1gpEnUIKorjx49b8bnn\nnhv6mj179ji5RP+u/cM3QU8fiSJbh7DiqFGjRlZ88OBBp2bRokVWHDSg17p166Ssp2bNmkm5ThCG\nsKLz/30GDWG9++67VlxQUODUBA3eJeKll15ycnfeeWdSrp1KDGEBABBjNGAAABTQgAEAUMAecASv\nvfZaaI1/X3TgwIEJ3Stof7WoqMiK27Rpk9B1Tpw44eTefPNNK77uuuucmrlz51rxlClTQu8fhD3g\nzOPfF964cWOk1w0bNsyKX3311aStyS/T9oD9h+fs37/fqYnykIxU+t3vfufkCgsLrTgvL8+pmTlz\nZui1zzvvPCv+97//XcnVpR57wAAAxBgNGAAABTRgAAAU0IABAFBQXXsBqdK2bVsn17Bhw9DX9ezZ\n08ndcsstoa/zDz0lc7gtytCVX/PmzZ1cWVmZkyspKbHiJk2aODVxHHIAMlGnTp2seMmSJU7N9u3b\nrXj06NFOTWlpaXIXVkkPP/xwaM3mzZudXND3KD//k7Tuuusup2bNmjWh14kDPgEDAKCABgwAgAIa\nMAAACmjAAAAoyJiTsO6//34rnjx5slMTNIQVZXjq2WefDb1/okNY/hOAvvzyy0ivC1NcXJyU6yQT\nJ2FlHv9JWB9++GFC17n00kud3L59+xK6ll9VOgmrQYMGVnz48OHQ1wQNTmoPYSWqc+fOVty/f3+n\nZvz48Vacn5/v1Lz11lvJXVglcRIWAAAxRgMGAEABDRgAAAUZcxCHf3/35ZdfjvS6KHu348aNS3xh\nyBj+p0KJBB+CkE0+/vjj0JqgJ/OsX7/eipO131vVHTlyxIqjPNWooKDAyQXNrfz+97+34qNHj1Zy\ndannP2QjaA/Y/z066LCS3Nzc5C4sRfgEDACAAhowAAAKaMAAACigAQMAoCBjDuJA/FW1gzj8AzDz\n5893ap5//nkrDhqIyWT+QxD+9Kc/OTXr1q1zcmPGjLHiVP65VaWDOPy6dOni5AYNGmTFDz74oFOz\nf/9+J3fBBRckY0lpFfR+8j+dbuzYsZGu9dxzzyVlTVFwEAcAADFGAwYAQAENGAAABewBI22q2h6w\n35kzZ5ycf5846GCOF154IRm3T7t58+aF1gwYMMCKDx486NTceOONoddJ5UEcVXkPOIr33nvPyV19\n9dVObsqUKVa8adMmp2bjxo1WfOLEiR+3uB+pXbt2Tm7NmjVWHPSQnbp166ZsTVGwBwwAQIzRgAEA\nUEADBgBAAQ0YAAAFDGEhbbJhCCtomKhfv36h147jAR47duyw4jZt2oS+pmbNmqlaTsIyfQhr+PDh\nTu7xxx93cs2bNw+9Vr169axYewirb9++oTUrVqxwcg888ICTmzNnTlLWFAVDWAAAxBgNGAAABTRg\nAAAUsAeMtMnEPeCtW7dacdA+W6NGjZzc3r17rXjYsGGh99+wYYOTmzhxohVPmzbNqfnoo4+c3FNP\nPWXFy5Ytc2p27txpxW3btnVqRo4cacVxPHQk0/eAgzRp0sTJBT2gwc//91dYWBj6mlmzZkVfWCUF\nfe1s377dioN6WNeuXZ1cSUlJ8hYWgj1gAABijAYMAIACGjAAAApowAAAKGAIC2lT1YewEhX0VKG7\n777biqtVc38WXrBggRVfeeWVTo3/aTFFRUVOTdDXeJcuXYIX+1+u9c477zg1ixcvtuKgQTFt2TiE\nFeSGG26w4vz8fKfmnnvuCb3OQw89lND9/cNaLVu2dGp2794dep1du3ZZcatWrZyaTp06OTn/8FYq\nMYQFAECM0YABAFBAAwYAQAENGAAABQxhIW0YwvqefwjrjjvucGpmz55txUFPWvKfVDRgwACnprS0\n1MmtXLkyeLH/xZgxYyr9mjhgCCu6VPYD/9OIBg0a5NSMGzfOip9//nmnxv/EJu2BqyAMYQEAEGM0\nYAAAFNCAAQBQwB4w0iZb94CDnpDUsGFDK962bVvK7j9hwgQnN3369JTdL27YA06udPaMKNgDBgAA\nlUIDBgBAAQ0YAAAFNGAAABQwhIW0ydYhLOhiCCv9ovSV4uJiJ9e0aVMrXr58uVPz2GOPhV6bISwA\nAHBWNGAAABTQgAEAUMAeMNKGPWBoYA84noIeLvL6669b8dixY52avLw8Kz58+HByF5YE7AEDABBj\nNGAAABTQgAEAUEADBgBAAUNYSBuGsKCBISykG0NYAADEGA0YAAAFNGAAABTQgAEAUEADBgBAAQ0Y\nAAAFNGAAABTQgAEAUJDWgzgAAEAFPgEDAKCABgwAgAIaMAAACmjAAAAooAEDAKCABgwAgAIaMAAA\nCmjAAAAooAEDAKCABgwAgAIaMAAACmjAaWCMecUYU2KMOWaMKTLGjNBeEzKbMaaFMeavxpjDxpgv\njTFzjDHVtdeFzGaMaWiM+Ysx5oQxZo8xZpD2muKMBpwe00Wkhed5uSLyPyLypDHmCuU1IbPNFZED\nInKhiHQWkWtFZLTqipAN/k9EvhGR80VksIjMM8Z01F1SfNGA08DzvB2e553+T/jd/1opLgmZ71IR\nWeJ53inP874UkbdEhG+ESBljTF0RGSgikz3P+8rzvA0islxEhuquLL5owGlijJlrjDkpIgUiUiIi\nf1VeEjLbcyJymzGmjjHmIhHpKxVNGEiVtiJS5nle0Q9ynwg/+J0VDThNPM8bLSLnikgPEVkqIqf/\n+yuAH2WdVHzjOyYixSKyRUSWqa4Ima6eiBz15Y5Kxfc9BKABp5HneWXf/bPMxSIySns9yEzGmGoi\n8rZU/KBXV0QaiUieiDytuS5kvK9EJNeXyxWR4wprqRJowDqqC3vASJ2GItJMROZ4nnfa87xDIrJQ\nRG7UXRYyXJGIVDfGtPlBrpOI7FBaT+zRgFPMGNPEGHObMaaeMSbHGNNHRG4Xkb9prw2ZyfO8gyLy\nuYiMMsZUN8Y0EJE7pGI/DkgJz/NOSMW/ukw1xtQ1xnQTkf4iskh3ZfFFA049Tyr+ublYRA6LyCwR\nGet53huqq0Km+7WI3CAipSKyS0TOiMj/qq4I2WC0iNSWil+BWywiozzP4xPwWRjP87TXAABA1uET\nMAAACmjAAAAooAEDAKCABgwAgIK0Ph3FGMPEVxbzPM9o3Jf3XXbTeN/xnstuUd9zfAIGAEABDRgA\nAAU0YAAAFNCAAQBQQAMGAEABDRgAAAU0YAAAFNCAAQBQQAMGAEABDRgAAAU0YAAAFNCAAQBQQAMG\nAEBBWp+GlMmaNm1qxW+//bZT06FDByeXk5OTsjUBAOKLT8AAACigAQMAoIAGDACAAvaAE9CsWTMn\nd99991lx+/btnRrP85xcWVlZ6P0mTZpkxdOnTw99DQAg3vgEDACAAhowAAAKaMAAACigAQMAoMAE\nDQal7GbGpO9mKXT99dc7uaCDN5LFGGPFtWvXdmq++eablN0/WTzPM+FVyVcV3nerVq0KrQka7Asa\nCIRN431XFd5zSJ2o7zk+AQMAoIAGDACAAhowAAAKOIgjAb/97W9V73/gwAEnt3XrViueOXOmU7Ny\n5cqUrQmVM3bsWCs+ffq0U9OvX7/Q65SXl1vxNddc49Rs2LChkqsDkA58AgYAQAENGAAABTRgAAAU\n0IABAFDAQRwJqFevnpN74IEHrHjTpk1OTZTDOvyHbogEP0XJ7+uvv7biLVu2ODW//OUvQ6+TShzE\n8T3/8FSQOnXqWPHs2bOdmpEjR1px0BBWkGwazOIgjgpHjx614qDvR926dbPiF1980akZPXq0Fd9y\nyy1OTbVq7me7tWvXRlpnJuAgDgAAYowGDACAAhowAAAKaMAAAChgCCuN7rvvPidXv359K7722mud\nGn8uJycnofsHPTmnpKQkoWslgiGs7z366KNWHPSko9tvvz30Og8//LAVz5gxw6nJ9tOxMm0Iy/80\ntqDhJv/AlUjw8KjfsmXLrDg/P9+p8feMQ4cOOTVRhgz/8Y9/OLnevXuHXsc/cBpHDGEBABBjNGAA\nABTQgAEAUMAecBXg3wNO9BfaN27c6ORuvfVWK/7iiy8SunYU2boH3KlTp9CaP/7xj07u8ssvt+Ky\nsjKnxr8HHCTo6V0dO3a04n/961+h16mqqtIecLt27ax4zZo1Tk3Tpk2t+OTJk06N/xCXIP793iAD\nBw50ci1atLDit956y6lp06ZN6LWDLFy40IrvvPPO0DVF+e9IN/aAAQCIMRowAAAKaMAAACigAQMA\noIAhrAScd955Tq5WrVqhr0t00OWpp56y4iiDN1E98sgjVvzMM88k7dp+2TqEFWTBggVW3Lp169DX\n+A9gCLJ161YnF3TYSr9+/UKvlSmq0hCW39NPP+3kxo0bF/q6Dh06hNYUFhYmtCb/ENZNN90U6XUt\nW7a04jFjxjg1/qfBBR065B/C2rVrV6T7f/rpp5HqkoEhLAAAYowGDACAAhowAAAK2AOOwL8PsXTp\nUqcmyp7aJZdcktD98/LyrHj16tVOTePGjUOv89lnnzm5n/70pwmtKRHsAX8vNzfXioP+bubPn2/F\nTzzxROh1u3bt6uQ++ugjJ+d/0MNrr70Weu2qqirvAf/mN79xcq+88ooVV69e3anxf88QETl27Fgy\nlhTJZZdd5uQKCgqsePPmzU7NlVdeacUffvhhaE1paalT8+c//9nJBe05pwp7wAAAxBgNGAAABTRg\nAAAU0IABAFDg7t5nGf8vlQcNOA0ePNiKEz3EYM+ePU7O/4vnQUNxK1eutOIoA1fffPONkzt48GDo\n65Aebdu2teL+/fs7Ne+8844VL1myxKnxH6Ywc+ZMp+bbb791cu3bt4+0Tui64oornJx/6CpomGnV\nqlVO7qqrrkrewkL4B66C+Iepgqxbt87JXXDBBaGvGzlypJO7+eabrbh58+ah10k1PgEDAKCABgwA\ngAIaMAAACrL+II527dpZ8dtvv+3UNGvWrNLXDfpz9e/3nq0uGYL2gPPz851c0H9vqnAQx9lNnTrV\nyd17771W/JOf/MSp8R9wf+jQIadmx44dTu6cc86p7BKrrKp8EEeQffv2WXHTpk2dmrVr1zq53r17\np2pJqoLmdq677jonF+VhOMnaF+YgDgAAYowGDACAAhowAAAKaMAAACjI+oM4/AcZDBgwwKnZsmVL\npa8bNHBVrZr78055eXnotaIMaj355JNWPGXKlNDXID4effRRJ1erVi0r3r9/v1OzfPlyKw5639Wo\nUcPJLVq0yIqHDh0aaZ2oGq6//non5z+cI1OGsnr16uXkXnrpJSfnf49HGcpKNT4BAwCggAYMAIAC\nGjAAAApowAAAKMj6ISy/bdu2Obk//OEPlb7OsGHDnFzQwFWUASv/YE3QwM60adMqsTpURUGDNUEn\nHvkdP37cyfmHt06dOuXUjBgxwoqDToSbPn166P2RXP6/B//JWCLBp2P5+U8BDHqd/4lcmeSiiy5y\ncuPHj7fiGTNmpHQNfAIGAEABDRgAAAU0YAAAFGTV05C6du3q5ObMmWPFpaWlTs3NN99c6Xu9+OKL\nTu7yyy93cp07d670ta+66ionl8hhIenG05B+nKA9qw8++MCKt2/f7tT069fPyfmfmhT0FKUWLVpY\ncdBBIP7DZfr27evUfPrpp04unTLtaUh+QXvAQaLsC//qV7+y4qq6B9ylSxcnt3nzZisOemJc7dq1\nk3J/noYEAECM0YABAFBAAwYAQAENGAAABRl7EEdeXp6TmzRpkpPzD2atXLnSqenevbsVb9iwIfT+\nDz30kJNbsWJF6OuCLFu2zIqrwsAVki/o6S3+wxROnjzp1Ozdu9fJ+d/TPXr0cGpWr15txXfddZdT\nM3XqVCtu0KBB6L1Eon0NIZqgA1KiDGYFPTnLf7BL0OEvcRvMatWqlZML+v7rV7NmTSfXsmVLK969\ne3fiC4uAT8AAACigAQMAoIAGDACAgow9iGPu3LlO7p577knoWqdPn7bi999/36nx75fNnDnTqTn/\n/POd3CeffGLFjRo1cmr8+3q9e/d2ajZt2uTk4oaDOFLv3nvvdXLDhw93cr/4xS+Scr9u3bpZ8fr1\n652aoD1g/wEiqZTpB3FEdccdd1jx7NmznRr/Hv4jjzzi1MyaNcuKgw74+OKLLxJZYtIcPnzYyeXm\n5lrxs88+69SMGzcuKffnIA4AAGKMBgwAgAIaMAAACmjAAAAoyNghrI8//tjJderUKV23l6uvvjpS\n3ZgxY6x48ODBoa/p1auXk4vbL8cHYQgr+YYMGWLFL7zwglPz2WefOTn/ENapU6cSuv+rr74aWhP0\nFKeggz9ShSGsCj//+c9DaxYuXGjF/oNeRER27dplxf/85z+dmj59+lRucd+57LLLrLigoMCpefnl\nl0Ov4/+6CHLxxRc7uZKSktDXRcEQFgAAMUYDBgBAAQ0YAAAFGbsH3LNnTye3dOnS0Nf5f1k7Kv/B\n5qn8c128eLGTGzp0aMrulyzsASef/xCEnTt3OjWPPfaYk3vuuecqfa9q1dyf18vKyqw46H0f9Lp0\nYg84Ov9hRfPmzUvoOkEPBbn//vutOOhAoccff9yKJ0yY4NQMGzbMisvLyyOtyX/wRrIO3QjCHjAA\nADFGAwYAQAENGAAABTRgAAAUZOwQVqK+/vprJ1ejRo3Q16VyCOvNN9+04v79+yft2unEEFby+Yew\niouLI72udevWVrxv3z6n5ttvv7XitWvXhl73888/d3IjRoyItKZUYQgrcfn5+U6uVatWVvz000+n\nazki4g71BR0iU7NmTSeXk5OTsjX5MYQFAECM0YABAFBAAwYAQAENGAAABQxh+dx0001OrmPHjlYc\ndIKL/+StZP65+p9+VBWefBSEIazU6969u5N77733nJx/sC+If9jG/6QaEZHjx49bcf369UOvm24M\nYSWucePGTq60tDS0pnPnzk5u/PjxVhw0FOV/StbEiRND1zhjxozQmnRjCAsAgBijAQMAoIAGDACA\nAvaAk+TMmTNJuU5hYaGT69OnjxVHPWwhbtgD1tGtWzcn16RJEyt+/fXXnZpVq1aFXvuGG25IfGFp\nwh5w+vnnVkREVq9ebcV5eXlOjf/7qH/GoKpgDxgAgBijAQMAoIAGDACAAhowAAAKGMJS9uCDD1rx\nM888o7SS1GMICxoYwkK6MYQFAECM0YABAFBAAwYAQAF7wEgb9oChgT1gpBt7wAAAxBgNGAAABTRg\nAAAU0IABAFBAAwYAQAENGAAABTRgAAAU0IABAFBAAwYAQAENGAAABTRgAAAU0IABAFBAAwYAQEFa\nn4YEAAAq8AkYAAAFNGAAABTQgAEAUEADBgBAAQ0YAAAFNGAAABTQgAEAUEADBgBAAQ0YAAAFNGAA\nABTQgAEAUEADBgBAAQ0YAAAFNGAAABTQgAEAUEADBgBAAQ0YAAAFNGAAABTQgAEAUEADBgBAAQ0Y\nAAAFNGAAABTQgAEAUPD/yjA2nuaVEgoAAAAASUVORK5CYII=\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1765c7fe6d8>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# 隨機旋轉 (Random Rotations)\n",
    "from keras.datasets import mnist\n",
    "from keras.preprocessing.image import ImageDataGenerator\n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "# 載入數據\n",
    "(X_train, y_train), (X_test, y_test) = mnist.load_data()\n",
    "\n",
    "# 將圖像數據集的維度進行改變 \n",
    "# 改變前: [樣本數, 圖像寬, 圖像高] -> 改變後: [樣本數, 圖像寬, 圖像高, 圖像頻道數]\n",
    "X_train = X_train.reshape(X_train.shape[0], 28, 28, 1)\n",
    "X_test  = X_test.reshape(X_test.shape[0], 28, 28, 1)\n",
    "\n",
    "# 將像素值由\"整數(0~255)\"換成\"浮點數(0.0~255.0)\"\n",
    "X_train = X_train.astype('float32')\n",
    "X_test = X_test.astype('float32')\n",
    "\n",
    "# 定義\"圖像數據增強產生器(ImageDataGenerator)\"的參數\n",
    "datagen = ImageDataGenerator(rotation_range=90)\n",
    "\n",
    "# 透過訓練數據集來訓練(fit)圖像數據增強產生器(ImageDataGenerator)的實例\n",
    "datagen.fit(X_train)\n",
    "\n",
    "# 設定要\"圖像數據增強產生器(ImageDataGenerator)\"產生的圖像批次值(batch size)\n",
    "# \"圖像數據增強產生器(ImageDataGenerator)\"會根據設定回傳指定批次量的新生成圖像數據\n",
    "for X_batch, y_batch in datagen.flow(X_train, y_train, batch_size=9):\n",
    "    plt.figure(figsize=(8,8)) # 設定每個圖像顯示的大小\n",
    "    # 產生一個3x3網格的組合圖像\n",
    "    for i in range(0, 6):\n",
    "        plt.subplot(331+i)\n",
    "        plt.title(y_batch[i]) # 秀出圖像的真實值\n",
    "        plt.axis('off')     #不顯示坐標\n",
    "        plt.imshow(X_batch[i].reshape(28,28), cmap=plt.get_cmap('gray'))\n",
    "        \n",
    "    plt.show()\n",
    "    break # 跳出迴圈"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "運行以上範例，您可以看到圖像已左右旋轉至90度的極限。這個\"隨機旋轉\"的功能對解決MNIST數字辨識這個問題沒有什麼幫助，因為MNIST數字有一個標準化的方向，但是當您要辨識的對象或物件需要不同方向的照片來進行訓練學習時，這種轉換可能有相當的幫助。"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 隨機偏移 (Random Shifts)\n",
    "\n",
    "圖像中的對象或物件在圖框中的位置可能在最中間。他們可能以各種不同的方式偏離圖框的中心點。\n",
    "\n",
    "您可以訓練您的深度學習網絡，通過人工創建您的訓練數據的偏移圖像來讓您的模型能夠辨識和處理偏離中心的對象或物件。 Keras的\"圖像數據增強產生器(ImageDataGenerator)\"支持通過width_shift_range和height_shift_range兩個參數設定來對訓練數據進行水平和垂直隨機轉換來產生新圖像數據。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 42,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAeAAAAFICAYAAACImy0WAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4wLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvpW3flQAAHYtJREFUeJzt3Xu0zXX6wPHnQwflSDFRIZfk10Wj\nCLN0XGahyxGGmqnpoqIxIxNjMRkNFiY1p3LNL5XIZUiYRiEUI1NNpikjI3QjRuSSphh3vr8/9FvT\n5/t8tbdt7++zzz7v11qtWc8zz/5+n6bdeXzn8zmfrwuCQAAAQLxKWTcAAEBJxAAGAMAAAxgAAAMM\nYAAADDCAAQAwwAAGAMAAAxgAAAMM4Bg4515zzh1wzu395q8PrHtCbnPOlXXOTXTObXLO7XHO/cM5\nd711X8h9zrlbnHPrnHP/cc594pxrbt1TtmIAx+eXQRDkf/PX/1g3g5x3moj8S0RaikhFERkkIrOc\nc7UMe0KOc861FZEiEblbRCqISAsR2WDaVBY7zboBAOkXBMF/RGTIt1LznXMbRaSRiHxq0RNKhKEi\nMiwIghXfxJ9ZNpPteAKOz8POuV3OuTedc62sm0HJ4pyrKiL1ROR9616Qm5xzpUXkKhE5xzn3sXNu\ni3NunHPudOveshUDOB79RaSOiFQTkadFZJ5z7kLbllBSOOfyRGS6iEwJgmC9dT/IWVVFJE9EbhKR\n5iJyhYhcKSIDLZvKZgzgGARB8LcgCPYEQXAwCIIpIvKmiBRa94Xc55wrJSLTROSQiPzSuB3ktv3f\n/OfjQRBsC4Jgl4iMFH7WnRBrwDYCEXHWTSC3OeeciEyU408mhUEQHDZuCTksCIIvnXNb5PjPNySB\nJ+AMc86d5Zy71jlXzjl3mnPuNjm+M3CxdW/IeeNF5BIRaR8Ewf5ExUAaPCsi9znnqjjnzhaRX4nI\nfOOespbjfcCZ5Zw7R0ReFpGLReSoiKwXkUFBELxq2hhymnOuphzf7XxQRI5867/6eRAE002aQs77\nZr/BGBG5VUQOiMgsEbk/CIIDpo1lKQYwAAAG+L+gAQAwwAAGAMAAAxgAAAMMYAAADMT6e8DOOXZ8\nlWBBEJj87jPfu5LN4nvHd65kS/Y7xxMwAAAGGMAAABhgAAMAYIABDACAAQYwAAAGGMAAABhgAAMA\nYIABDACAAQYwAAAGGMAAABhgAAMAYIABDACAAQYwAAAGYn0bEgAA6dSjRw+VGz16tMrddtttXjxn\nzpyM9ZQsnoABADDAAAYAwAADGAAAA6wBAwCKrfbt26tcXl6eytWoUSOOdk4KT8AAABhgAAMAYIAB\nDACAAQYwAAAG2ISVIzp16uTFnTt3VjXhX0SPUlBQoHJ//etfU28MsapatarK3XnnnSoX3rhy9dVX\nJ7y2c07lgiDw4scee0zV3H///QmvDSRr8ODBXnzttdcm9bldu3Zlop1TwhMwAAAGGMAAABhgAAMA\nYMCF13AyejPn4rtZMVW/fn2VKyws/M5YRKRFixZefPToUVWzatUqlXvhhRe8OOoQ8/3790c3e5KC\nINCLiDHI5e9dx44dvfiBBx5QNVdddVVc7UR+77p06aJyM2fOjKMdEbH53uXydy6T6tat68U1a9ZU\nNfPmzfPicuXKJXXt6tWre/HWrVtPsrvkJfud4wkYAAADDGAAAAwwgAEAMMAABgDAAJuwYnTFFVeo\nXJ8+fby4TZs2qubcc89NeO0JEyZ48dy5c1XNokWLEl4nk9iElX4rV6704gYNGqTt2r169fLiI0eO\nqJrwhsAmTZqomqgDEC6//PJT7C55bMIqPoqKirz43nvvVTXly5dPeJ2oDactW7b04j179pxkd8lj\nExYAAFmMAQwAgAEGMAAABhjAAAAY4G1IMYp6q1DZsmW9+P3331c1Q4cO9eI//vGPquaLL744xe6Q\nqw4dOqRyw4cP9+Lw91BE5Mknn/TiqFOunnrqKS8On1IkItK4ceOk+gRq1arlxclsuHruuedUrm/f\nviqXyU1XqeIJGAAAAwxgAAAMMIABADDAGnCMlixZonLt2rXz4o8//ljVPP300xnrCbll48aNKnff\nffep3MKFC+NoBzihqLdkXXPNNQk/F/55uGLFClWze/fu1BuLEU/AAAAYYAADAGCAAQwAgAEGMAAA\nBtiEFaMOHTqo3Lp167x4x44dcbWDHPDQQw95cdTbzdhwhWwQfhvRmDFjVE3FihW9OOpgokGDBiW8\nV9ThM9mIJ2AAAAwwgAEAMMAABgDAAGvAMWrWrJnKhQ8f79+/f0zdIBfMmTPHugVAKVVKP9uNGDHC\ni8PrvSIiR44c8eI77rhD1ezcufMUu8sePAEDAGCAAQwAgAEGMAAABhjAAAAYYBNWjIYMGaJyZcqU\nib8RIE0KCgq8+Prrr1c1u3btiqsdZInwoRsiIg0bNkz4ucmTJ3vxqlWrVE3NmjW9eNOmTSfXXBbh\nCRgAAAMMYAAADDCAAQAwwBpwjNq0aaNy4fWxRYsWxdUOcMpKly7txc45VRN+YQRyy5lnnqlyQ4cO\nTela4YNlmjZtqmpmzZrlxdu2bVM1lSpVUrm6det68fTp01XN8OHDvXj9+vUnbjYNeAIGAMAAAxgA\nAAMMYAAADDCAAQAw4IIgiO9mzsV3syx07NgxlQv/4nnXrl1j6iZ+QRDoHToxKK7fuwsuuMCLd+zY\noWquuOIKL65QoUJS1/7ggw+8ePPmzQk/U7VqVZWbMWOGF4d7FoneSLN79+6E90sXi+9dcf3OpSLq\njUVTpkxJ+LmFCxeqXOXKlb24UaNGqia88S+d3nvvPS/u1KmTqvn0008TXifZ7xxPwAAAGGAAAwBg\ngAEMAIABBjAAAAY4CStDunXrpnJRpwQVFRVl5P55eXkqF7VBJ87NMPivOnXqeHGzZs1UTf/+/b04\n6p9VeBNWfn5+Uvdfu3atF0dtpPnnP//pxeE3H4mItGrVyouXLl2qaviO5bbBgwen9LmoN2dZa9Cg\ngRd3795d1TzwwANpux9PwAAAGGAAAwBggAEMAIAB1oAz5LLLLlO5VA89KV++vBf/5je/UTUtWrTw\n4i1btqia5s2bq9xjjz3mxePHj1c1hw8fTqpPiJQpU0bl+vbtq3K33367Fx89elTVXHrppQnvFz6c\nI2rtv2zZsgmv/e6776qa8JtpzjvvPFUTflvMXXfddcJekRvC+w7Ch2fEbePGjSoXfsuciEjjxo0T\nXuvAgQNeHP53IN14AgYAwAADGAAAAwxgAAAMMIABADDAJqwMSWbBP0rUm2MmTJjgxVEbvMKHHXz9\n9deqplq1aio3atQoL7788stVzc9+9rPoZqFE/XN/8MEHE34uahNW+FCLefPmqZqZM2d68fDhw1VN\n+EANEZHOnTt7cXgTn4jITTfdFN3st4Q3BG7dujXhZ1C8hTcQnnXWWRm71+uvv65yI0eO9OJ+/fqp\nmvr166d0v0ceecSLV65cmdJ1ksUTMAAABhjAAAAYYAADAGCANWBjHTp08OJ77rlH1dStW9eLn3ji\nCVUzcOBAL96zZ4+q+f73v69y4XXFrl27qprXXnvNi6dPn65qSqp69ep58bRp05L63MGDB7046mD6\n5cuXn3Q/UYfHR7nwwgu9OGoNOBmFhYVe/Oijj6Z0HRQfe/fuje1emzdvVrmxY8d6cY0aNZK6VviQ\njZ49e6qa55577iS6O3U8AQMAYIABDACAAQYwAAAGGMAAABhwqb6hJ6WbORffzYxNnDhR5e6++26V\nS+Z//z59+njx5MmTVU3UwRvJCG++WbZsmaoJ/3L6gAEDUrpXEAQupQ+eokx+78K/qN+gQQNV88or\nr6jciBEjvHjJkiXpbexb8vPzVe7FF1/04latWqV07fABIu3bt1c1ixcvTuna6WLxvcvln3VXXXWV\nF7/99ttGnZxYeJOjiN5gmskNV8l+53gCBgDAAAMYAAADDGAAAAywBpwh4QMaRET+8pe/qFyVKlW8\nOOrw8TZt2njx4cOHT7G7E4u6f1jz5s1TunZxXwMeMmSIyoVfRhB1AMoNN9ygcn/729/S0ZISdTD+\nT37yE5UbP358wmuF14nD30MRkfLly3vxm2++qWpSPeQjXVgDTq+GDRt6cdR3uXTp0hm7v3P+P85J\nkyapmjFjxqjc6tWrM9ZTGGvAAABkMQYwAAAGGMAAABhgAAMAYIBNWDE699xzVa5t27ZeHHXIRuvW\nrb04/HaiU1GnTh0vjjoQ4pNPPvHicM/JKu6bsHbs2BF1bS+OOmxl/vz56bh9Up555hmVi+opLOqt\nM5dddpkXd+7cWdWMGzfOi6M239xyyy0qt2DBgoQ9pQubsNKrcuXKXrxmzRpVU7Vq1bTc69ChQyo3\nc+ZML+7WrZuqCR8QEzc2YQEAkMUYwAAAGGAAAwBggAEMAIABNmEZK1OmjBcvX75c1YTfZtOvXz9V\n884773hxjRo1VE3NmjVVbsqUKV5coUIFVXPttdd6capv7snFTVjhDShRp17t27cvpftdfPHFXtyo\nUSNVE97g1KRJE1UTdTrWunXrvPjmm29WNR988EHCHsOnZUX9/UdtkonabJgpbMLKrPDb2kREBg8e\nrHIVK1ZMeK2lS5d6cZcuXVTNtm3bTqI7G2zCAgAgizGAAQAwwAAGAMAAa8BZpnfv3io3cOBALz7j\njDNUTfgX1sNryyIi5cqVS/i5Xr16qZoJEyZEN3uScnENOHwowaJFi1TN9u3bU7rfHXfc4cWlSiX+\n8/LatWtVbtiwYSo3e/bslHoKCx8uM2/ePFUTdcjHjTfemJb7J4M1YMSNNWAAALIYAxgAAAMMYAAA\nDDCAAQAwwCasYqBBgwZePHbsWFVTr149L456A8+//vUvlXvppZe8eNWqVam0mJTivgmrZ8+eKnf6\n6aendK3whrihQ4emdJ3Ro0d7cdR3Y9OmTSldOxUtW7ZUucLCQpXr379/HO2ICJuwED82YQEAkMUY\nwAAAGGAAAwBggDVgxKa4rwGjeGINGHFjDRgAgCzGAAYAwAADGAAAAwxgAAAMMIABADDAAAYAwAAD\nGAAAAwxgAAAMMIABADDAAAYAwAADGAAAAwxgAAAMMIABADAQ69uQAADAcTwBAwBggAEMAIABBjAA\nAAYYwAAAGGAAAwBggAEMAIABBjAAAAYYwAAAGGAAAwBggAEMAIABBjAAAAYYwDFwzlVyzv3JOfcf\n59wm59yt1j0htznnajnnXnbOfemc+9w5N845d5p1X8hdzrm9ob+OOucet+4rmzGA4/G/InJIRKqK\nyG0iMt45d5ltS8hxT4jIDhE5T0SuEJGWInKvaUfIaUEQ5P//X3L8Z91+EZlt3FZWYwBnmHOuvIjc\nKCKDgiDYGwTBGyLykojcYdsZclxtEZkVBMGBIAg+F5FFIsIf+hCXm+T4HwBft24kmzGAM6+eiBwN\nguDDb+XeE34YIrPGiMgtzrkznHPVROR6OT6EgTjcKSJTA953+50YwJmXLyJfhXJfiUgFg15QciyX\n43/I+1pEtojIOyIy17QjlAjOuQvk+JLHFOtesh0DOPP2isiZodyZIrLHoBeUAM65UiKyWEReEJHy\nIvI9ETlbRIos+0KJ0UVE3giCYKN1I9mOAZx5H4rIac65i76VayAi7xv1g9xXSURqiMi4IAgOBkHw\nhYg8KyKFtm2hhOgiPP0mhQGcYUEQ/EeOP4kMc86Vd85dLSIdRWSabWfIVUEQ7BKRjSLSwzl3mnPu\nLDm+JveebWfIdc65ZiJSTdj9nBQGcDzuFZHT5fiuwOdEpEcQBDwBI5M6i8h1IrJTRD4WkSMi0se0\nI5QEd4rIC0EQsMSWBMcmNQAA4scTMAAABhjAAAAYYAADAGCAAQwAgIFY347inMv6HV81a9ZUuQ0b\nNhh0cmJHjx5Vudtuu82LZ8/Ovt8CCILAWdy3OHzvkDkW3zu+cyVbst85noABADDAAAYAwAADGAAA\nAwxgAAAMxHoSVnHYmLBgwQKVu+666ww6OTnhjVkNGzZUNWvWrImrnUhswoIFNmEhbmzCAgAgizGA\nAQAwwAAGAMBArAdxZKO6det68ZlnnpnSdY4cOeLFn3zyiaoZMGCAyu3fv9+Lp06dqmrOOeechPcv\nXbq0Fw8ePFjVdO/eXeX+/e9/J7w2Mq9WrVoqF957ED5sRUTkyy+/9OLWrVurmjlz5qiccy5hzVdf\nfeXFy5cvVzUAUscTMAAABhjAAAAYYAADAGCAAQwAgIESdRBH+/btVW7WrFleXKZMmZSuvX37di8+\n//zzU7pOv379VK6oqCila4VFbcKaOHFiWq6dDA7i+K9evXp58e9+9ztVk5+f78WrV69WNcn8+3v2\n2WerXPitX1HXOXbsmBfPnDlT1YT/PsKbwrIBB3EgbhzEAQBAFmMAAwBggAEMAICBnD2Io0KFCip3\nzz33qFyqa75hvXv3Tst1Hn/8cZULv1jh5ptvTunajRo1Urk414BLqqjv3aOPPurF4UMvRET69+/v\nxU8++WRK949aA65Ro4YX33jjjarm5z//uRffeuutqiYvL8+Lb7nlllRaBEoknoABADDAAAYAwAAD\nGAAAAwxgAAAM5MxBHOFDC6I2M3Xp0iUt91qwYIHKdevWzYt37tyZlnuJiLRo0cKLly1blrZrh9+i\nlEkl9SCO119/XeWaNWvmxYWFhapm8eLFGespLGqj1j/+8Q8vDm/cEhF5+umnvbhHjx7pbSwNOIgD\nceMgDgAAshgDGAAAAwxgAAAM5MxBHJMnT/biTp06ZexeUQcrpHPNF7mloKBA5RYuXOjFca73Rrng\nggsS5mbPnq1qwgeKAEgeT8AAABhgAAMAYIABDACAAQYwAAAGiuUmrPr166tc+/bt03Ltffv2qVyv\nXr28eNeuXWm5V7I++ugjL16xYoWq+cEPfhBXO/iW8NuARo4cqWqiDrspV66cF999992qZs6cOV68\nZ8+eVFqMPGTjrrvu8uJ69eqpmvDhMtOnT1c1hw4dSqknADwBAwBgggEMAIABBjAAAAYYwAAAGCgW\nm7Bq1arlxS+++KKqOe209PytDBkyROWeffbZtFw7VRdddJEXs+Eqe4Q3U0W91ShKy5YtvzMWEalS\npYoXFxUVJbxu+fLlVe7ll19WuaZNm3rxpk2bVM2wYcO8mA1XQHrxBAwAgAEGMAAABhjAAAAYKBZr\nwBUrVvTi8JrwqVi7dq0Xz507N23XTpd27dql5ToLFixIy3XwX+HDMZ566ilV0717d5WrXbt2wms/\n9NBDXnzJJZeomgkTJnhx1FvAmjRponKfffaZF19//fWqZtu2bQl7BJA6noABADDAAAYAwAADGAAA\nAwxgAAAMuKg3tWTsZs4lvFn16tVV7vnnn/fiVA+i+PDDD1Wubdu2Xrxly5aUrp2M733veyp39dVX\ne/GYMWNUzXnnnefFyRw6MmPGDJXr0aOHyu3duzfhtdIlCAIX282+JZnvXdwaNWrkxb/+9a9VTevW\nrb24cuXKabt/qVIl58/eFt+7bPzOZZv8/HyV69ixoxdPnTpV1bzwwgteHPXvzqeffnpqzZ2iZL9z\nJeffQgAAsggDGAAAAwxgAAAMZN0a8DvvvKNyV155ZVruf//996vciBEj0nLt8CH4eXl5qmbSpEkq\nF17zSMa+fftUbvHixV7crVs3VfPVV1+d9L3SiTXgk9OwYUMvjjrkI1wTZcOGDSoXfsFHLivOa8D1\n69dXuQcffNCLH3/8cVWzdOnSdNw+Za1atVK50qVLe/GvfvUrVRN1IEwiUWvAo0aNOunrpBNrwAAA\nZDEGMAAABhjAAAAYYAADAGAg696GFLWpJM6NYlEKCgq8OOogkDvvvNOLL7300oz1E3Wgxh/+8IeM\n3Q82Dh486MV16tRRNYcPH/biAwcOqJqozw0aNMiLw29eEhE5evRoUn0ifQYPHuzF9957r6oJH+jT\nvHlzVXPTTTep3IUXXpjw/uGfY+E30Ykk9/M46uefc+nZC7dw4UIvnjZtWlqua4EnYAAADDCAAQAw\nwAAGAMBA1h3EcezYMZVLV4+7du1SuS+//DLh58KH4FeqVCkt/STr73//uxeH1+9ERF599dW42kkZ\nB3Gc2Omnn65yf/rTn7z4mmuuUTU9e/b04rfeekvVvPvuuyoXXo9r1qyZqlmxYkV0s8VMth7EMWDA\nAJUbNmxY+Dop3f/IkSMql8xLXMKi7p/JmRG+9rhx41RNv379vDgb9ypwEAcAAFmMAQwAgAEGMAAA\nBhjAAAAYyLqDODK56B/+BfYT5TIlaoNZ+A1FUW8Ieemll7z466+/Tm9jMBfeTCWiN11NnTpV1Ywf\nP96LozZzLVmyROXatm3rxVEHN+TKJqxs1bRpU5VL12EVqWy4EhFZtWqVF0dtON22bZsXV6lSRdXU\nrl07pfuH3/TWp0+flK5TXPAEDACAAQYwAAAGGMAAABhgAAMAYCDrNmH9+c9/VrlWrVrF38gpCp9e\nJSIyZcoUlQtvokHJEN4sFXUS1e7du734kUceSXjd/fv3q1zURpY1a9Z48X333adqJk2a5MVr165N\neH+cWH5+vhdXq1YtY/eKOglr9uzZXjx37lxVM3/+fC8+++yzVc3nn3/uxUVFRaqmb9++CXvctGmT\nyo0ZMybh53IJT8AAABhgAAMAYIABDACAgaxbA/7xj3+scs8++6wX33DDDXG1E2nlypUqF16v69Kl\ni6rZvn17xnpC8fKjH/3Iizt27Khqpk2b5sWprsFGfS68Hhh1EEeqhzkg2saNG704an01LHxQj4jI\nE0884cXPP/+8qon6WbNz586E9wsLr/eKiPzwhz/04qjDg6KEDyKKWu8dO3bsSXRX/PEEDACAAQYw\nAAAGGMAAABhgAAMAYCDrdlmENzOJiHTt2tWLwxtYRPTGhFQ3kIwaNUrl1q1b58UzZsxQNVEHIAAn\ncuWVV5ref+LEiV4ctQkL6RV+s1DUW97eeOMNL+7du7eqee+999Lb2He4+OKLVS58QEvp0qVVTdRB\nIL/97W+9uKRtuIrCEzAAAAYYwAAAGGAAAwBgIOvWgKN88cUXXhxevzpRDshWb731lhc751RNQUGB\nF59//vmqZuvWrWnpJ+r+SK82bdokrNm2bZsXr1+/PlPtRKpTp44XL168WNUk8xKJgQMHqtyIESNS\nbyxH8QQMAIABBjAAAAYYwAAAGGAAAwBgwEX9MnjGbuZcfDdD1gmCwGSnTzZ+7/Ly8rz4mWeeUTW3\n3367F7/22muq5rrrrvPiw4cPq5qot+58/PHHXnzWWWepmvBhIatXr1Y1xYHF9y4bv3Nh4Q1XIiKv\nvPKKF9euXVvVhGfG+++/r2oaN26scocOHTrZFoutZL9zPAEDAGCAAQwAgAEGMAAABorFQRxArgmv\n1Q4aNEjVhA/vb9eunapZuXKlF0cdgh+1BhzOrVq1StV89NFHKofiK3yQy7Jly1RN9erVvbhUKf2M\n9vbbb3txYWGhqilJ672ngidgAAAMMIABADDAAAYAwAADGAAAA2zCArLA5s2bVe73v/+9F5ctW1bV\ntG7dOqX7ffbZZ1586623qpr9+/endG3Yq1Wrlsr17dvXi6PeahQ+ZCO84UpEpEOHDl4cflsdkscT\nMAAABhjAAAAYYAADAGCAAQwAgAHehoTY8DYkWCiJb0OaNm2ayv30pz9N+Lnwm43CG7dERJYsWZJ6\nYyUEb0MCACCLMYABADDAAAYAwABrwIgNa8CwkGtrwHl5eV48cuRIVfOLX/wiqicvjnpjUf369b14\nw4YNqbRY4rEGDABAFmMAAwBggAEMAIABBjAAAAZ4GxIAFCPt2rXz4h49eiT1ufDbrbp3765q2HQV\nL56AAQAwwAAGAMAAAxgAAAMcxIHYcBAHLBTngzgqVaqkcuvXr09YE2XQoEFe/PDDD6feGL4TB3EA\nAJDFGMAAABhgAAMAYIABDACAAQ7iAIAs1aJFC5VLZtPV8uXLVW706NFp6QnpwxMwAAAGGMAAABhg\nAAMAYIA1YADIEgUFBV48c+bMlK4zf/58lQu/jAH2eAIGAMAAAxgAAAMMYAAADDCAAQAwEOvbkAAA\nwHE8AQMAYIABDACAAQYwAAAGGMAAABhgAAMAYIABDACAAQYwAAAGGMAAABhgAAMAYIABDACAAQYw\nAAAGGMAAABhgAAMAYIABDACAAQYwAAAGGMAAABhgAAMAYIABDACAAQYwAAAGGMAAABhgAAMAYIAB\nDACAAQYwAAAG/g+VW4WxX8adpwAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1765e0da160>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# 隨機偏移 (Random Shifts)\n",
    "from keras.datasets import mnist\n",
    "from keras.preprocessing.image import ImageDataGenerator\n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "# 載入數據\n",
    "(X_train, y_train), (X_test, y_test) = mnist.load_data()\n",
    "\n",
    "# 將圖像數據集的維度進行改變 \n",
    "# 改變前: [樣本數, 圖像寬, 圖像高] -> 改變後: [樣本數, 圖像寬, 圖像高, 圖像頻道數]\n",
    "X_train = X_train.reshape(X_train.shape[0], 28, 28, 1)\n",
    "X_test  = X_test.reshape(X_test.shape[0], 28, 28, 1)\n",
    "\n",
    "# 將像素值由\"整數(0~255)\"換成\"浮點數(0.0~255.0)\"\n",
    "X_train = X_train.astype('float32')\n",
    "X_test = X_test.astype('float32')\n",
    "\n",
    "# 定義\"圖像數據增強產生器(ImageDataGenerator)\"的參數\n",
    "shift = 0.2\n",
    "datagen = ImageDataGenerator(width_shift_range=shift, height_shift_range=shift)\n",
    "\n",
    "# 透過訓練數據集來訓練(fit)圖像數據增強產生器(ImageDataGenerator)的實例\n",
    "datagen.fit(X_train)\n",
    "\n",
    "# 設定要\"圖像數據增強產生器(ImageDataGenerator)\"產生的圖像批次值(batch size)\n",
    "# \"圖像數據增強產生器(ImageDataGenerator)\"會根據設定回傳指定批次量的新生成圖像數據\n",
    "for X_batch, y_batch in datagen.flow(X_train, y_train, batch_size=9):\n",
    "    plt.figure(figsize=(8,8)) # 設定每個圖像顯示的大小\n",
    "    # 產生一個3x3網格的組合圖像\n",
    "    for i in range(0, 6):\n",
    "        plt.subplot(331+i)\n",
    "        plt.title(y_batch[i]) # 秀出圖像的真實值\n",
    "        plt.axis('off')     #不顯示坐標\n",
    "        plt.imshow(X_batch[i].reshape(28,28), cmap=plt.get_cmap('gray'))\n",
    "        \n",
    "    plt.show()\n",
    "    break # 跳出迴圈"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "運行此範例將創建新的MNIST數字圖像的位移版本。同樣的，這對於MNIST來說不是必須的，因為手寫數字已經居中，但是你可以看到這對於更複雜的圖像問題來說可能是有用的。"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 隨機推移錯切 (Random Shear)\n",
    "\n",
    "透過一個圖像的錯切變換，圖像以它的中心垂直軸不變動的方式變形。可以用這樣的技術來產生新的經過錯切變換的圖像數據。\n",
    "\n",
    "詳細說明見:[Wikiepedia-圖像錯切](https://zh.wikipedia.org/wiki/%E9%94%99%E5%88%87)\n",
    "\n",
    "![Wikipedia-圖像錯切](https://upload.wikimedia.org/wikipedia/commons/thumb/0/08/Eigen.jpg/330px-Eigen.jpg)\n",
    "\n",
    "\n",
    "Keras的\"圖像數據增強產生器(ImageDataGenerator)\"支持使用shear_range參數設定來對訓練數據進行圖像錯切變換來產生新圖像數據。\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 43,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAeAAAAFICAYAAACImy0WAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4wLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvpW3flQAAHqRJREFUeJzt3XmQVdX16PG1GSTI+MCIzRSCpGWK\nIWiUEJBJgkKEpxEElZ8gJgIByQuopWEGsTTIT/iBQ5S8AEYtIUQi4KOIzCRkEOEVRCDoDwk0IGDE\n8ASR5rw/OqlkD3oOl9t3nb73+6myrLVr3XO2cPouD3uxt4miSAAAQG5V0p4AAACFiAIMAIACCjAA\nAAoowAAAKKAAAwCggAIMAIACCjAAAAoowDlkjPmKMea0MeYF7bkgvxljWhlj1hhjThhj9hpjbtae\nEwqDMWagMeZtY8z/M8a8Y4zprD2ntKIA59Y8Efmj9iSQ34wxVURkmYgsF5F6IvJ9EXnBGFOsOjHk\nPWNMTxF5TESGikgtEblORN5VnVSKUYBzxBgzUEQ+FJE3tOeCvNdSRBqKyH9GUVQaRdEaEdksIoN1\np4UCMEVEpkZRtCWKonNRFB2Mouig9qTSigKcA8aY2iIyVUTGas8FBcF8xljbXE8EhcMYU1lErhaR\nL/5j2eOAMWauMaa69tzSigKcG9NEZH4URX/VnggKwi4ReV9E7jfGVDXGfFtEuojIxbrTQp5rICJV\nReRWEeksIu1E5OsiMl5zUmlGAS5nxph2InK9iPyn9lxQGKIo+lRE/qeI9BGRw1L2Jy+viMgBzXkh\n7536x7//K4qiQ1EUHRORWSLSW3FOqVZFewIFoKuINBOR/cYYEZGaIlLZGNM6iqL2ivNCHoui6P9K\n2VuviIgYY34rIgv0ZoR8F0XR34wxB0SEI/YSMhxHWL6MMReLSO1/GxonZQV5RBRFR1UmhbxnjLlS\nRPZI2Z9yjRSRH4hIyyiKPlGdGPKaMWaqiNwoZX/68qmI/FpE1kVRNEF1YinFG3A5i6LoYxH5+J+x\nMeakiJym+KKcDRaRe6RsTW6jiPSk+CIHponIJVL2P3+npWzp4xHVGaUYb8AAACigCQsAAAUUYAAA\nFFCAAQBQQAEGAEBBTrugb7vtNq/jq1u3blY8YsQI73Nt29o76O3YsSPLM0MuRFEU2iKx3Blj6DQs\nYBrPHc9cYUv6zPEGDACAAgowAAAKKMAAACigAAMAoCCnTVgDBgzwxm6++ebYz/Xt29eKe/Xq5eVc\nddVVVrxggb/vfHFxsTe2Z8+e2PsDAJBtvAEDAKCAAgwAgAIKMAAACnJ6GlJpaWnszf5xaP3nOnz4\nsDd29uxZK544caKXM2PGDG/M3QiENeHyw0Yc0MBGHMg1NuIAACDFKMAAACigAAMAoIACDACAgtQ1\nYYVUrlzZis+dO+fluP8dBw8e9HIaNWrkjR05csSKb7/9di9n/fr1ieaJz0cTFjTQhJVOtWrV8sbe\nfPNNK161apWXM3r06HKbU7bQhAUAQIpRgAEAUEABBgBAQU4PYwhtspFkDdpd861Uyf//htLSUisO\nrfeGNGjQwIrXrFnj5XTv3t2KWRMGgPNz9dVXW/GkSZO8nObNm+dqOqnAGzAAAAoowAAAKKAAAwCg\ngAIMAICCnDZhhRqu3MasTJqykl5nxYoV3lifPn1iP+c2ZrkbgwAA/qVJkybe2PLly6344osvjr3O\nqVOnsjanNOINGAAABRRgAAAUUIABAFCQ0zXgTp06eWOLFy+24oYNG2Z0bXftNrTpR2jMXRf+6KOP\nvJxBgwZZ8aJFi7ycwYMHJ5onCk/oubv00kut2D0URMRfI2vatKmX4/5MPf/885lMEcjYdddd541d\nf/313tgll1wSe63Vq1db8fTp0zOfWAXAGzAAAAoowAAAKKAAAwCggAIMAICCnDZhbdmyxRtzm0g2\nbdrk5TRu3NiKQxtxuEIbavTu3dsbW7lypRWPGjUq9trTpk3zxtzGLJqyCtPll1/ujY0fP94bu+uu\nu6z4pz/9qZfTt29fK77sssti7x9qiGndurU31r59+9hrhU4dA9wGwscee8zLufbaa70x9zs59B09\nf/58Kw41xeYTfsIAAFBAAQYAQAEFGAAABRRgAAAUmCSnD2XtZsbE3uxLX/qSN3bvvfda8UMPPeTl\nlJaWXsDM/uXLX/6yN+Y2Apw4ccLLKS4utuI9e/ZkZT75JIoif0uoHEjy3CURarCqX7++Fb/66qte\nTqh5avv27Vb8ta99zcs5dOiQFa9atcrL2bhxoxU/88wzXs7hw4e9sa1bt1px6OfnlltuseLQjl7u\n98cbb7zh5fTs2dMbyyWN5y5bz5y2UCPeL37xCyvu37+/lxN6VtatW2fFBw4c8HKmTp1qxe+8806S\naaZO0meON2AAABRQgAEAUEABBgBAQerWgJOYMWOGN3bPPfdYcb169bJxKxHx14X/+te/Zu3ahaSi\nrwGH1rrGjRtnxaFNLyZMmOCNuRsOfPe73/VylixZYsUnT56MnaO7Ji0icvz48djPhQwfPtyKW7Zs\n6eXs2rXLikM9FKF5u//9JSUlmUwxEdaAyxQVFVmx22MgItKiRQsrDj2XjzzySOy9Qpsl9erVy4pD\nmy59+umnsdeuCFgDBgAgxSjAAAAooAADAKCAAgwAgIIK2YQV4p6Y5G40ICLy8MMPe2OhjQvitG3b\n1htzm1Hgq+hNWO7JXSIiGzZssOJZs2Z5OW6jVqE5c+aMN7Z7924rDm3WEdpAJBM0YZVxT9f64x//\n6OX84Q9/sOLatWt7OTVq1LDiHTt2eDm/+c1vvLFC+jmgCQsAgBSjAAMAoIACDACAgiraE8gWd2Pv\n9u3bx+aEJFkT3rlzpzfWpk0bK2ZNOP+4ByiENGjQwBu76KKLvLHQumg+CG3e37FjR2/sd7/7nRV3\n6NDBywkdbIFkrrnmGm/spZdesuJBgwZ5Oe5mHaFDFT7++GMrnjRpkpfjHhKCMN6AAQBQQAEGAEAB\nBRgAAAUUYAAAFOTNRhzl6ezZs1YcakxwPfnkk97Y2LFjszaniqiib8QR4jbbFRcXeznvvvuuN7Z+\n/XorHjZsWOy9qlev7o1VrlzZipOcmJRNtWrVsuKHHnrIywk15Dz//PNWPGbMGC/HPQ0qU/m+EUfd\nunW9sVdeecUb69GjhxWfPn3ay6lWrVrs/X70ox9Z8Zw5c2I/U2jYiAMAgBSjAAMAoIACDACAAtaA\nM1BaWhqbE/p1nT17tjf2la98xYrdDdNF/HXFPXv2xN4/jfJxDdjdrP7RRx/1ckK/p40aNbLie++9\nN/Ze7dq188Zat25txRMmTPByqlat6o11797dir/61a96OdOmTbPigQMHejkDBgyw4iZNmng5IR9+\n+KEVhzaO2Lt3b6Jrxcn3NeBRo0Z5Y6EelCS9K+731q9+9Ssv584777Ti0OYroc1nRo4cacVLly71\ncnr37m3F/fr183K6du3qjaUNa8AAAKQYBRgAAAUUYAAAFFCAAQBQUCGasNy/7P/3v//dy+nSpYsV\nuxsdiISbWLZt22bFoRNC3FNEhg8f7uXMmzfPijP9dV25cqU3duLECSt2m2NERI4fP/65cRrkYxNW\nEqEmFbf57u23387o2m5DXmgjkFDToHuize7du72cli1bWnHNmjVj5xPadMS9l4jfkLNp06bYa2cq\n35qw3I03nn32WS/n1ltv9cb+/Oc/W7HbwCciMnPmzM+NRUSOHj1qxaHvo86dO3tjnTp1suJPP/3U\nywk1DLrczWfOnTsXm5NrNGEBAJBiFGAAABRQgAEAUEABBgBAQRXtCSThNl25TVkiIs2aNYu9zujR\no72x6dOnW/H48eNjr+M2XImI/OAHP7DiuXPnxl4nxN0JRiTZDjatWrWy4l69enk5RUVF3tiOHTus\nOEkTGs5PqEnEbXq66aabYq+zevVqb8w9qeuRRx7xctzmm9C1PvjgAy/HbYy6+uqrvRx3R6tx48Z5\nOfv37/fGtm7d6o0hmTp16lix24AqEm4CdXdtCz0XDz74oBVXqeKXiKFDh1px6JS30KlK7pySNFyF\nuD9Pof/WUOOhu2vbL3/5y4zun028AQMAoIACDACAAgowAAAKKsQasCu0EceYMWOsOHTyUGgNy13z\nbdy4cWxOSGhd2JXp5hzu526//fbYz6xatcob++IXv+iN9enTx4pDf/He5W4iISIydepUKw6dboPP\ntmLFiqxc56GHHsrocwsXLvTGTp8+Hfu5OXPmWPFrr73m5SQ5PQzJDRkyxIovueSSRJ9zv9sOHDjg\n5fTv39+KFy9e7OXccMMNVhxa79UW+q5t06aNFbMGDABAgaIAAwCggAIMAIACCjAAAAoqxGlImQj9\nRX/35BgRkQ4dOljx9u3bvZyuXbvGXqd9+/ZWHPp1DW2o4Z4UU716dS8nCffEndD9Q2MHDx604kaN\nGnk5R44cseIvfOELXo7b9DZp0qTQHAvyNKQ06tixoxWvW7fOy3E3YQg1av3whz+0YndjjjTIt9OQ\nmjZtasWhE6hCkmzo435H3H333V7O448/bsWhJrDQaUR/+ctfrLh58+ax8wlx/zuS1jC3UdSNs4nT\nkAAASDEKMAAACijAAAAoyNs14KRefvllK542bZqXM2PGDCueNWuWl+NuYOGu04iI1K9f3xtbsmSJ\nFbsbY4gkWxd210VC6z2hQwFcob+c7/4F/tC13bW/unXrejmsAetw+wNERJYtW2bFoefuxIkTVty6\ndWsv59ChQxc4u/KXb2vALvdgDxGRyy+/3BvLZA04U6F7udf+5JNPvJxQf0mc0OZBoQMiOnXqZMVb\ntmw573slxRowAAApRgEGAEABBRgAAAUUYAAAFFTI05CyaeDAgbE5Dz/8sBXv3LnTyxk3bpwV33LL\nLYnu9dRTT8Xef9GiRVbsNtCEhJopQg0zRUVFVhxqTEiyWcl3vvMdKw6d7nPTTTeFJ4tydd9993lj\nbtNV6Pdr06ZNVlwRGq4K0RVXXJHR57RPqQqdouR+bz3xxBNezpkzZ6x4woQJie73pz/96Txmlxu8\nAQMAoIACDACAAgowAAAKCn4NOInQmq9r/fr1Vpx0vWzDhg3nndOvXz8vx934IrRxvrveK+LP88EH\nH/RyHnvsMSsObVbiKikpic1B9oXW2UObEhw9etSKQ+tob7/9dvYmhtQJHZjgOnv2bGxO6NmZPn26\nN+b2jrgb/IiIzJ8/34onTpyY0ZxC32NpxBswAAAKKMAAACigAAMAoIACDACAgoI/DSmXiouLvbE9\ne/aUy73uuOMOb2zBggWxn1u7dq03ds8991jxe++95+W0adPGikONaxqn0ojk93M3ZswYK77xxhu9\nnB49enhj7kYxr732WnYnliL5fhpSGoVOznK/N6pWrerluKeqVVSchgQAQIpRgAEAUEABBgBAAQUY\nAAAFNGEVkEGDBnlj7klLIW5jVs+ePTO6P01YFyZ06s2qVausuEmTJl7Oz3/+c29s2LBhWZtX2tGE\nhVyjCQsAgBSjAAMAoIACDACAAk5DKiAvvfRSbE7t2rW9sXnz5llxaA149erVmU8MibgbooiING3a\n1IrfffddLyd0Wg0AfbwBAwCggAIMAIACCjAAAAoowAAAKKAJq8Alacxyvf76696YewoPTVkX7sor\nr7Ti2267zcvZvHmzFS9cuNDLKSkpye7EAGQFb8AAACigAAMAoIACDACAAtaAEevZZ5+14hUrVng5\n+/bts+IRI0aU55QKQocOHay4cePGXs748eOt+MUXXyzXOQHIHt6AAQBQQAEGAEABBRgAAAUUYAAA\nFJgoinJ3M2NydzPklNsg5G4QISLStGlTk6v5/Dueu8IWRVHOnzueucKW9JnjDRgAAAUUYAAAFFCA\nAQBQwBowykVRUZE3VlJSwhowco41YOQaa8AAAKQYBRgAAAUUYAAAFFCAAQBQkNMmLAAAUIY3YAAA\nFFCAAQBQQAEGAEABBRgAAAUUYAAAFFCAAQBQQAEGAEABBRgAAAUUYAAAFFCAAQBQQAEGAEABBTgH\njDEvGGMOGWM+MsbsMcbcoz0n5DdjzEnnn1JjzH9pzwv5zRjTzBiz0hjzN2PMYWPMXGNMFe15pRUF\nODceFZFmURTVFpG+IjLdGHOV8pyQx6IoqvnPf0SkgYicEpHFytNC/ntKRN4XkSIRaSciXURkpOqM\nUowCnANRFO2MouiTf4b/+OdyxSmhsNwqZV+KG7Ungrz3ZRF5JYqi01EUHRaR/yMibZTnlFoU4Bwx\nxjxljPlYRHaJyCERWak8JRSOu0RkYcTZoyh/s0VkoDHmYmNMIxG5UcqKMAIowDkSRdFIEaklIp1F\nZKmIfPL5nwAunDGmqZT9MeAC7bmgIKyXsjfej0TkgIj8SUReVZ1RilGAcyiKotIoijaJSGMRGaE9\nHxSE/xCRTVEU/bf2RJDfjDGVRGSVlL1g1BCRS0Tkf4jIY5rzSjMKsI4qwhowcuM/hLdf5EY9EWki\nInOjKPokiqLjIvK/RaS37rTSiwJczowxlxpjBhpjahpjKhtjeonIIBFZoz035DdjTEcRaSR0PyMH\noig6JiL/LSIjjDFVjDF1paz/YLvuzNKLAlz+Iin74+YDIvI3EZkpIj+MomiZ6qxQCO4SkaVRFP1d\neyIoGLeIyA0iclRE9orIWRH5X6ozSjFDYyQAALnHGzAAAAoowAAAKKAAAwCggAIMAICCnJ5SYYyh\n46uARVFkNO7Lc1fYNJ47nrnClvSZ4w0YAAAFFGAAABRQgAEAUEABBgBAAQUYAAAFFGAAABRQgAEA\nUEABBgBAAQUYAAAFFGAAABRQgAEAUEABBgBAAQUYAAAFOT0NCcg3DRo0sOKioiIvZ9u2bbmaDoAK\nhDdgAAAUUIABAFBAAQYAQAFrwEBC1apV88ZGjRplxUOGDPFybrrpJm9s7NixVjx48OALmxyAz1W9\nenUrPnXqlNJM/oU3YAAAFFCAAQBQQAEGAEABBRgAAAUmiqLc3cyY3N0siyZPnmzFXbp08XK6du1a\nbvfv1q2bFa9bt67c7lWeoigyGvfN1nP36KOPemP3339/7OcOHTrkjTVs2NCKBw4cGHudxYsXx+bA\np/HcVdTvOm0bN248788cPnzYG9u8ebM31qdPHyteunSpl/P000+f9/1Dkj5zvAEDAKCAAgwAgAIK\nMAAAClgDTiCXv0ZJTJkyxRtz16nTqKKvAf/2t7/1xq699lorTvqsGGP/UiT53MqVK72xvn37WnGo\nP2H9+vWJ5pSvWANOh+bNm1vxNddc4+W8+OKLVpzpd6/78xW61tmzZ72c2bNnW/EDDzyQ0f1ZAwYA\nIMUowAAAKKAAAwCggAIMAIACmrCyxN2II+lmGe7n1q5dm9H9Q00HaVPRm7Ceeuopb+z73/++ey8v\nJ/QzlkkTVojbmHXdddd5OaGmvQkTJlhxvXr1Mrp/RUATVvlq2bKlN+ae9iUicuedd1rxRRdd5OW4\nPxehjTkuu+wyK27RokXsdZLav3+/FTdr1iyj69CEBQBAilGAAQBQQAEGAEABBRgAAAU0YaVMaEer\nSZMmxX6OJqzPlq3nrlatWt5Y69atrTh0Ckvo96ZSJfv/fUtLS72cffv2WXGTJk28nMqVKwfnGnd/\n9+c+yfOT5F5pRBNW+Tp9+rQ3VrVq1Yyu5T5jVapU8XLmzp1rxUOGDPFyqlWr5o0dO3bMiidOnOjl\nuE2wu3bt+sy5fh6asAAASDEKMAAACijAAAAoYA04ZbJ5+kfaVPQ14CTc05FEwuvCo0ePtuL77rvP\ny7nhhhus+Prrr/dy3M1BSkpKvJymTZt6Y+56WP369b0cV+gZqwjrwqwBZ65NmzbeWKdOnaz4mWee\n8XJCJw298847Vjxv3jwvZ8WKFbHX7tGjR3iy/yb0rE6dOtWKy/MEOdaAAQBIMQowAAAKKMAAACig\nAAMAoIAmrBxyTz4S8TfZCOW4unXr5o0lPX1JUyE0YYWEGrN+//vfW3HoNKIPPvgg9trDhg2z4vnz\n53s5Cxcu9Mbc5q2f/OQnsff65je/6Y0lOb0myTNdnmjCSs492ejXv/61l+OePrR8+XIvJ7TJxbZt\n22Lv/9FHH1lxjRo1Yj8TEmoCKyoqsuIkP1+ZogkLAIAUowADAKCAAgwAgALWgDOQ5C9wJzlAIakp\nU6ac9/3TqFDXgPNFaH3XXRcObYBQp04db+zkyZPZm1gM1oDDGjdu7I3t2LHDikMHkLi/d6Hf35Da\ntWtbcc+ePb2cxYsXW3GoPq1Zs8aK3Y1BRESWLVvmjQ0cODDRPLOBNWAAAFKMAgwAgAIKMAAACijA\nAAAoqKI9gYogl41qIV26dFG9PyAi0rlzZ2/Mbczq2LGjlzNz5kxvbPjw4dmbGDIS2iDFbbpyN8YQ\nSfZ7527WISIybdo0Kx4wYICX4zbxvfzyy16Ou8lHzZo1vZwkm36kAW/AAAAooAADAKCAAgwAgAI2\n4kjA3fgiySYb7uYZn8Vd302ycX3o4IXQAQ1pw0Yc+a+0tNQbO3bsmDfWvXt3K965c2e5zYmNOMK2\nbNnijX3jG9+w4iNHjng5xcXFVty2bVsvZ/r06d6Y+3se0r9/fytevXq1lxNal04bNuIAACDFKMAA\nACigAAMAoIACDACAApqwUmbt2rXeWJLGLLcJK9SopY0mrIqlYcOGVlxSUhL7mVATVug75lvf+pYV\nh05HylZjFk1YYXPmzPHGRo0aFfu5t956y4q//vWvezlJ6kpos4yrrroq9nMVAU1YAACkGAUYAAAF\nFGAAABRQgAEAUMBpSCkT2tEqSUOD26iVxiYsVCyVK1e2YrcpS0Rk7NixVlypkv//9KHGLFfoRBuU\nr71793pjSb5r2rVrl9H9tm7dasW9e/fO6Dr5hDdgAAAUUIABAFBAAQYAQAFrwBWAe7JSktOYgAtV\np04dKz5x4oSXM2zYMCs+d+6cl2OMvyeBO5bLDYFQ5rnnnvPGevbsacWZrtMuXrzYGxs6dKgVnzp1\nKqNr5xPegAEAUEABBgBAAQUYAAAFFGAAABTQhFUB0HSF8tasWTNvzG2k6d+/v5eTZAONUIOVOxZq\n1EL5Cp08dOWVV573dUK/d0VFRd7YmTNnzvva+Y43YAAAFFCAAQBQQAEGAEABa8Ap4x6qkNTkyZOz\nOg/ktx//+MdW3KdPHy+nuLjYikObKyRx/Phxb+zkyZNWzGEM5e/xxx+34vvvv9/LyWRDlNBn6tWr\nFzt29OjR875XvuENGAAABRRgAAAUUIABAFBAAQYAQAFNWCmzdu3a2Jx169aV/0SQNwYNGuSNuU1Y\nIW5zjduUFcpZv369l7N7925vbOfOnVbcpk2b2PngwowZM8aKk2yQ8uabb3o5rVq1suIaNWp4OaEG\nK5qufLwBAwCggAIMAIACCjAAAApYA86h0CYbSQ5acNd8u3XrlqUZIc1effVVK16yZImX88ILL1hx\nv379vJwrrrjCG7voooti7//+++9b8aWXXurluBvxz54928t54403Yu/lrgnjwjzxxBPeWJUq8V/3\n7mYdy5Yt83I2bNhgxaFDFmbNmhV7L/AGDACACgowAAAKKMAAACigAAMAoIAmrAyEmqmSnGKUpOEq\nZMqUKRl9DhXH0KFDvTH3merRo0fsdRYsWJDofklOvXnuuees+Hvf+56XU1JSYsWhph2Ur1DD1ciR\nI2M/t3HjRm9s165dVhw6Aaty5cpWvHTpUi9n+fLlsfcHb8AAAKigAAMAoIACDACAAgowAAAKTJJm\njKzdzJjc3SxDoWaqJCcUZaqQdrmKosjEZ2VfRXju3nvvPW+sUaNGsZ87deqUFVevXt3LcZtmRETO\nnTtnxU8++aSX8/TTT1vx4MGDvZxnnnnGig8dOvTZk1Wi8dyV5zN3xx13WPHPfvYzLye065W7a5kb\niyRrznNVqsR7nCvpM8evHAAACijAAAAooAADAKCAjTgc2VrvDW2e4a73ftYYCk9oA4skmymE1nxd\n7nqviMj06dOt+PXXX/dy9u7da8WLFi3yctK45pvvRo8ebcVVq1ZN9Lkk67tuzsGDB72cBx54INH9\nEI83YAAAFFCAAQBQQAEGAEABBRgAAAV5uxHH5MmTvbFsnUZEM1Vm2Ijjwhw7dswbq1u3rhV/+OGH\nXs6qVau8sdDpS64zZ86cx+zSK9824ti3b58VN2nSJNHnNm/ebMWhjTjeeustK545c6aXs3///kT3\nK2RsxAEAQIpRgAEAUEABBgBAQd6uAYckWRcOrYsgO1gDzj53Xfjb3/62l1NaWuqNbd++vdzmlDb5\ntgZ88803W3GLFi28nFatWnljd999d3lNCQ7WgAEASDEKMAAACijAAAAooAADAKCgoJqwoIsmLGjI\ntyYspB9NWAAApBgFGAAABRRgAAAUUIABAFBAAQYAQAEFGAAABRRgAAAUUIABAFCQ0404AABAGd6A\nAQBQQAEGAEABBRgAAAUUYAAAFFCAAQBQQAEGAEABBRgAAAUUYAAAFFCAAQBQQAEGAEABBRgAAAUU\nYAAAFFCAAQBQQAEGAEABBRgAAAUUYAAAFFCAAQBQQAEGAEABBRgAAAUUYAAAFFCAAQBQQAEGAEAB\nBRgAAAX/HzBl0gawT9bXAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1765c2baf98>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# 隨機推移錯切 (Random Shear)\n",
    "from keras.datasets import mnist\n",
    "from keras.preprocessing.image import ImageDataGenerator\n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "# 載入數據\n",
    "(X_train, y_train), (X_test, y_test) = mnist.load_data()\n",
    "\n",
    "# 將圖像數據集的維度進行改變 \n",
    "# 改變前: [樣本數, 圖像寬, 圖像高] -> 改變後: [樣本數, 圖像寬, 圖像高, 圖像頻道數]\n",
    "X_train = X_train.reshape(X_train.shape[0], 28, 28, 1)\n",
    "X_test  = X_test.reshape(X_test.shape[0], 28, 28, 1)\n",
    "\n",
    "# 將像素值由\"整數(0~255)\"換成\"浮點數(0.0~255.0)\"\n",
    "X_train = X_train.astype('float32')\n",
    "X_test = X_test.astype('float32')\n",
    "\n",
    "# 定義\"圖像數據增強產生器(ImageDataGenerator)\"的參數\n",
    "shear_range=1.25 # 推移錯切的強度\n",
    "datagen = ImageDataGenerator(shear_range=shear_range)\n",
    "\n",
    "# 透過訓練數據集來訓練(fit)圖像數據增強產生器(ImageDataGenerator)的實例\n",
    "datagen.fit(X_train)\n",
    "\n",
    "# 設定要\"圖像數據增強產生器(ImageDataGenerator)\"產生的圖像批次值(batch size)\n",
    "# \"圖像數據增強產生器(ImageDataGenerator)\"會根據設定回傳指定批次量的新生成圖像數據\n",
    "for X_batch, y_batch in datagen.flow(X_train, y_train, batch_size=9):\n",
    "    plt.figure(figsize=(8,8)) # 設定每個圖像顯示的大小\n",
    "    # 產生一個3x3網格的組合圖像\n",
    "    for i in range(0, 6):\n",
    "        plt.subplot(331+i)\n",
    "        plt.title(y_batch[i]) # 秀出圖像的真實值\n",
    "        plt.axis('off')     #不顯示坐標\n",
    "        plt.imshow(X_batch[i].reshape(28,28), cmap=plt.get_cmap('gray'))\n",
    "        \n",
    "    plt.show()\n",
    "    break # 跳出迴圈"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 隨機鏡像翻轉 (Random Flips)\n",
    "\n",
    "另一個可以提高大型複雜圖像問題辨識性能的圖像增強法，是在您的圖像訓練數據中利用圖像隨機翻轉來產生新的圖像數據。\n",
    "\n",
    "Keras的\"圖像數據增強產生器(ImageDataGenerator)\"支持使用vertical_flip和horizontal_flip兩個參數設定來對訓練數據進行垂直和水平軸隨機翻轉來產生新圖像數據。\n",
    "\n"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 44,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAeAAAAFICAYAAACImy0WAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4wLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvpW3flQAAHIJJREFUeJzt3XmQVcX1wPHTMKLsqIABVAg/JAqi\nExQFLSEpkGVAUNDITxMI0SJICe4WBJIQ16BSvyA6aFREHJCwqcgmIdGoaAoIKkTQkQgqy7AvgrJO\n//4YU2V3X32P53v3vHnv+6nyj3PqvHs7k8s7XLqn21hrBQAAxKuK9gAAAMhHNGAAABTQgAEAUEAD\nBgBAAQ0YAAAFNGAAABTQgAEAUEADjoExppkxZoExZrcxpswY85gxpkB7XMhdxphzjDF/N8bsNcas\nM8ZcpT0m5D5jTIkxZosxZp8xptQYc6P2mLIZDTgexSKyTUQaiUihiHQSkaGqI0LO+vovdy+LyDwR\nOUVEBotIiTGmperAkA8eFJFm1to6ItJbRO4zxlygPKasRQOOxw9FZIa19qC1tkxEFolIa+UxIXed\nLSKNReT/rLXHrLV/F5GlIvIL3WEh11lrP7DWHvpv+PV//6M4pKxGA47HeBHpb4ypYYxpIiI9pKIJ\nA5lgviV3btwDQf4xxhQbY74UkQ9FZIuILFAeUtaiAcfjH1LxxrtPRDaKyAoReUl1RMhlH0rFlMdd\nxpgTjDFdpWLao4busJAPrLVDRaS2iFwmInNE5NB3fyJ/0YAzzBhTRURelYoHsaaI1BeRk0VkrOa4\nkLustUdE5EoR6SkiZSJyh4jMkIq//AEZ9/XUx1sicrqI3KQ9nmxFA868U0TkDBF5zFp7yFq7U0Se\nFZEi3WEhl1lrV1lrO1lrT7XWdhOR5iKyTHtcyDsFwhzwt6IBZ5i1doeIrBeRm4wxBcaYeiIyUETe\n1x0Zcpkx5jxjzElfrzu4UypW4E9WHhZymDGmoTGmvzGmljGmqjGmm4j8r4j8XXts2YoGHI++ItJd\nRLaLyDoROSoit6mOCLnuF1KxAGabiHQWkcu/sToVyAQrFf/cvFFEdovIIyJyq7X2ZdVRZTFjrdUe\nAwAAeYc3YAAAFNCAAQBQQAMGAEABDRgAAAWxnshjjGHFVx6z1kZtkZhxPHf5TeO545nLb8k+c7wB\nAwCggAYMAIACGjAAAApowAAAKKABAwCggAYMAIACGjAAAApowAAAKIh1Iw4AyRs8eLATd+nSJagp\nLi524tdffz2TQwKQRrwBAwCggAYMAIACGjAAAApowAAAKDDWxndoByeE5DdOQzo+1atXd2J/wZWI\nSL9+/Zx46NChQU1JSUl6B1bJcBoS4sZpSAAAZDEaMAAACmjAAAAoYA7YU7t27SD3ox/9yIlHjRoV\n1PTu3Tul+y1dutSJV69eHdQ8+OCDTrxx48aU7qWNOeDv56677gpyY8eOdeK1a9cGNa1bt87YmCoD\n5oARN+aAAQDIYjRgAAAU0IABAFBAAwYAQEHen4ZUWFjoxPfee29QU1RUlLH7X3rppd8ZR91/zJgx\nQc1zzz2X1nGhcjp8+LD2EJBGTZs2DXLNmjVLy7W3bt0a5MrKypz4/PPPT3idTZs2Bbl169alPrA8\nwhswAAAKaMAAACigAQMAoCDv54AfeughJ+7cuXNK1/n888+dONm5uGrVqjnxGWecEdSceeaZTvzU\nU08FNfv373fi2bNnJ3V/5Ja5c+dqDwHfw4YNG5y4bt26QU29evXSci//O0NEZM+ePcd9nfLy8iC3\nZMmSIHfPPfc48aeffnrc98o1vAEDAKCABgwAgAIaMAAACmjAAAAoyKtFWE2aNAly7dq1S/i5o0eP\nOvEtt9wS1JSUlDhx1AKHKDVr1nTiDh06BDVz5sz5zs+IhCc0sQgr9zRv3jxhzcGDB2MYCTLlhhtu\nUL3/kSNHnPiNN95I+Bl/kahI9IZG8+bNc+I2bdoc5+hyD2/AAAAooAEDAKCABgwAgAIaMAAACoy1\nNr6bGRPfzSKcffbZQW758uVOXKNGjaBmwIABTjx16tT0DiwB//STRYsWBTUtWrRw4quuuiqoeeWV\nV9I6ruNlrTUa99V+7tLlnXfeCXIXXHCBE5933nlBzYcffpixMVUGGs9drjxzqapSJXy3e/311524\nY8eOMY0mfsk+c7wBAwCggAYMAIACGjAAAAryaiOOqLkwP9e2bdugZunSpRkbUzL8E1L+85//BDVn\nnXWWE/fu3Tuo0Z4DxvEpKHD/eJ544olBzfr165043+d7Eb+o+d677747yPknv4E3YAAAVNCAAQBQ\nQAMGAEABDRgAAAV5tQgryoIFC5w4ahHWww8/7MTXXHNNRsfk809xSuZUnMaNG2dqOIhJo0aNnLiw\nsDCoee2115z43HPPDWouu+yyIPeXv/zFiXft2pXKEAHp169fkBs2bFiQ69y5cxzDqVR4AwYAQAEN\nGAAABTRgAAAU5NVhDFH8DcH9OTURkSNHjjjx9ddfH9TMnj07LeOJmk/xD3844YQTgpqjR486cbdu\n3YIafzP0uHEYw/Hp2rWrE0cdwnHo0CEnLi8vD2qqV68e5MrKypx4ypQpQc2IESOSGme24zCG9Boy\nZIgT/+lPfwpqbrvttiA3ceLEjI0p23AYAwAAWYwGDACAAhowAAAKaMAAACjI+0VY/oKm+fPnBzX+\nL5B/+eWXQc2Pf/xjJ163bl1QE3VqyMiRI504auFLjRo1gpzPXzzWpUuXhJ+JG4uwjo+/kGXcuHEJ\nPxP13A0YMCDIVa1a1Yl///vfBzUrV6504sq6KItFWOn12WefOfGECROCGn/zonzDIiwAALIYDRgA\nAAU0YAAAFOT9YQz+JhtjxowJavzN7KPmZOfMmePEgwYNCmqi5tD69u2bcIyHDx924rFjxwY1+T7n\nkq/ee+89J/Y37xAR2bFjR8LrRG1AM3r0aCeeNGlSUFNaWprw2sgte/fudWKegdTxBgwAgAIaMAAA\nCmjAAAAooAEDAKAg7xdh+d5+++0gN2zYMCd+8skng5rWrVs78bJly9I2puHDhzvxU089lbZrIztU\nq1YtyCWzQG/hwoVOnMyCqyjbtm0Lcv4pSlEnbLEAJ/88//zzThx1kpYx4T4U06ZNc+KoDY38a33w\nwQdBjb9wtjLjDRgAAAU0YAAAFNCAAQBQQAMGAEABi7CSMHPmTCeOWoSVqo8++siJ77jjjqBm0aJF\nabsfstOpp54a5C699NKEn9u1a1da7t+yZcu0XAe576GHHnLil19+OagpKioKck2bNnVif+GqiMjS\npUud+JNPPglq5s6d68T+97OIyKpVq4JceXl5kNPGGzAAAApowAAAKKABAwCggDngJHTv3j1j1/Y3\n+fjb3/6WsXshe0XNAfsOHjwY5F555ZW03L9+/fppuQ7yj7+O5dtyyfjBD37gxB06dAhqevXq5cRR\nfwb8zUJERMaNG+fEO3fuTGWIacUbMAAACmjAAAAooAEDAKCABgwAgAJjrY3vZsbEd7MUXXnllUFu\n1qxZThx10keq1qxZ48Tt2rULaqIW31RG1tr0/eCOQ2V47m6++eYg9+ijjzrxnDlzgpqrr746pfud\neeaZThy1cUGdOnWcuHnz5kHNhg0bUrp/nDSeu8rwzOWKWrVqBbmSkpIgV1ZW5sRDhgzJ2JiSfeZ4\nAwYAQAENGAAABTRgAAAU5P1GHG3btnXiiRMnBjX+nG/UBvjDhw934gEDBgQ1Xbt2DXKtWrVy4tde\ney2oufHGG534gw8+CGpQuW3dujVhjb8W4fvwn0V/vlck3ODgs88+S9v9gXTZv39/kHvggQeC3IIF\nC5w4k3PAyeINGAAABTRgAAAU0IABAFBAAwYAQEHeL8Lq06ePEzds2DCoOXTokBNfccUVQc0///lP\nJ164cGFQ88gjjwS5QYMGOfFFF10U1CxdutSJf/nLXwY1/oKZY8eOBTXIXvPnzw9yb775phO3adMm\nqJk+fXrCa0ctsBo1alTCz/nXLi8vT/gZIBtEnWC3evVqhZF8N96AAQBQQAMGAEABDRgAAAV5Pwe8\nadOmhDX+fGoyG9Dv2bMnyPlzuSLhHHCU2rVrO/Hs2bODmg4dOjjxsmXLEl4X2ePLL78McsXFxU48\nevTooObjjz924qi5/6i1Bw0aNHDiuXPnBjXJzC8DcWvatKkTR32H3nTTTUFuxIgRGRtTqngDBgBA\nAQ0YAAAFNGAAABTQgAEAUGCstfHdzJj4bpakRo0aOXHUiS9Vqrh/T4k6uebpp5924t27dwc1UZts\n/OxnP3PiqEU0VatWDXK+1q1bO/GHH36Y8DNxs9aaxFXpl43PXTL8U7j8k7NEwtO7LrvssqBm7969\nQW7mzJlOfPvttwc1X3zxRVLjzHYaz532M+c/OyIiRUVFTrx+/fqgZu3atU4c9d1z9OhRJ/a/H0Wi\nN23xx1RQEK4BbtKkiROPHDkyqLnuuuucOGrBa9QirHnz5gW5TEn2meMNGAAABTRgAAAU0IABAFBA\nAwYAQEHeL8LyDRw4MMg98cQTTlytWrWM3X/IkCFBzl8ME3X/WbNmOXHUzkraWIQFDfm4CMtfXCoi\nsnnzZidevnx5UOMvQo1aOOqf0tW8efOg5pNPPgly/qlcvXr1CmoS3UtE5MUXX/zOWCS53QoziUVY\nAABkMRowAAAKaMAAAChgDjgJhYWFTjxjxoygpkWLFk4c9YvwUT9r/5fI27dvH9SUlpYmNc5sxxww\nNOTjHHDUBhr+iWnXXHNNUHP55Zc78QsvvJDegX2Dv6GHiEhJSYkT+/PWItGbFWUb5oABAMhiNGAA\nABTQgAEAUEADBgBAAYuwEBsWYUFDPi7Cgi4WYQEAkMVowAAAKKABAwCggAYMAIACGjAAAApowAAA\nKKABAwCggAYMAIACGjAAAApowAAAKKABAwCggAYMAIACGjAAAApowAAAKKABAwCggAYMAIACGjAA\nAAqMtVZ7DAAA5B3egAEAUEADBgBAAQ0YAAAFNGAAABTQgAEAUEADBgBAAQ0YAAAFNGAAABTQgAEA\nUEADBgBAAQ0YAAAFNOAYGGOaGWMWGGN2G2PKjDGPGWMKtMeF3GWM2e/9d8wYM0F7XMhtxphTjDEv\nGmMOGGM+NcZcpz2mbEYDjkexiGwTkUYiUiginURkqOqIkNOstbX++5+InCYiX4nITOVhIfc9LiKH\npeKZu15EJhpjWusOKXvRgOPxQxGZYa09aK0tE5FFIsJDibhcLRV/AXxTeyDIXcaYmiLST0R+a63d\nb619S0TmisgvdEeWvWjA8RgvIv2NMTWMMU1EpIdUNGEgDgNFZIrl7FFkVksROWatLf1G7n3hZeNb\n0YDj8Q+peAj3ichGEVkhIi+pjgh5wRhzplRMeTynPRbkvFoistfL7RWR2gpjqRRowBlmjKkiIq+K\nyBwRqSki9UXkZBEZqzku5I0BIvKWtXa99kCQ8/aLSB0vV0dEvlAYS6VAA868U0TkDBF5zFp7yFq7\nU0SeFZEi3WEhTwwQ3n4Rj1IRKTDGnPWN3Pki8oHSeLIeDTjDrLU7RGS9iNxkjCkwxtSTijm593VH\nhlxnjLlERJoIq58RA2vtAan4l757jDE1jTGXikgfEXled2TZiwYcj74i0l1EtovIOhE5KiK3qY4I\n+WCgiMyx1vJPgIjLUBGpLhWr7l8QkZustbwBfwvDwkgAAOLHGzAAAApowAAAKKABAwCggAYMAICC\nWE/kMcaw4iuPWWuNxn157vKbxnPHM5ffkn3meAMGAEABDRgAAAU0YAAAFNCAAQBQEOsiLADxKyws\nDHKLFrnHUdevXz+oqVu3rhMfOHAgvQMD8hxvwAAAKKABAwCggAYMAICCWE9D4pfT8xsbcejw53tF\nRLp06ZLwc++++64Tl5SUBDXjx49PfWAxYSMOxI2NOAAAyGI0YAAAFNCAAQBQQAMGAEABG3EAiLRy\n5UonnjFjhtJIgNzEGzAAAApowAAAKKABAwCggDlgIMetWbMmyCWzEUf79u2deMuWLWkbEwDegAEA\nUEEDBgBAAQ0YAAAFNGAAABRwGhJiw2lIOrp27RrkFi5cmPBz27Ztc+JGjRqlbUxx4jQkxI3TkAAA\nyGI0YAAAFNCAAQBQwEYcMSosLAxyY8eOdeLLL788qDEm8XSCP5e/adOmoOa+++4Lcv4G+7t37054\nL1QupaWlQW7z5s1OHDW/W6tWLSdu27ZtUOMf2ID41atXL8h16NAhyLVr1y7htfzvmnXr1gU1ixcv\nduIjR44ENXv27El4L/AGDACAChowAAAKaMAAACigAQMAoIBFWEnwF0YdOnQoqHnjjTec+K677gpq\nevToEeQ6derkxFEbo6SyWUrjxo2DXHFxcZC78MILnXj06NFBzdatW4/7/sgeGzZsCHI7duxw4qhF\nWDVq1HDiVq1aBTUsworfxRdf7MQvvfRSUNOgQYOUru0vwkrmu2f79u1B7vHHHw9yixYtcuIVK1Yc\n5+hyD2/AAAAooAEDAKCABgwAgAIaMAAACjgNydOiRYsgt3z5cic+6aSTgppXX33ViXv27BnUVKmS\n+O87b731VpBbtmyZE/fv3z+oadiwoRMXFKS2vm7WrFlB7tprr03pWj5OQ8oe7777rhO3adMmqPEX\n5AwcODCoKSkpSe/AMiDXTkPauXOnE0fthJWM6dOnB7nTTz/diVetWhXUXHTRRU7sL+T8NocPH3Zi\n/ztTJNytr7Iu1OI0JAAAshgNGAAABTRgAAAUsBGHp1mzZkHuq6++cuI6deoENVdccYUTb9y4Mai5\n//77E97/ueeeC3L+xh9Rm3z4czeffvppwntFifrfhtwzZcoUJ3744YcTfuaCCy4IcpVhDjjX+HO+\nUet4brvttiA3YcKEjIynSZMmQa53795B7vbbb3fiXr16BTV+7tlnnw1qfvvb3zpxWVlZUuPMRrwB\nAwCggAYMAIACGjAAAApowAAAKGARlmfJkiVB7pZbbnHiqF9g902ePDnI/fnPf055XN8UtVDMX+AA\nfBf/NCR/0w2RcOOYqBpkJ3/haCZt2rQpyE2cODHI+Qv/ojYUuvXWW5140KBBQU23bt2c+MYbbwxq\nFi9eHD3YLMMbMAAACmjAAAAooAEDAKCAOeAkRM1xxMk//GHq1KlBTfv27VO6tj8XOHr06JSug8ot\najOH8vJyJ7755puDmn379jnx7373u/QODClp3Lix9hACBw4ccOJnnnkmqPHX10RtKDJmzBgnnjdv\nXlAzadKkIDdq1Cgn9g+10MAbMAAACmjAAAAooAEDAKCABgwAgAIWYSXh/fffj+1eUYup/EVXURtx\nJCNq0UHnzp2d+N///ndK10Z+ateunfYQEKFp06ZBrkGDBk68ffv2uIaTNH+hVtTmRQUFbtvyT0cS\nid6c44QTTnDiESNGBDVx/0x4AwYAQAENGAAABTRgAAAUmKhfwM/YzYyJ72ZpVLNmTSf2Nx+IsmbN\nmiD3k5/8JMg9+eSTTty7d++gpmrVqgnv51u6dGmQizqwYcWKFcd97VRZa1V286+sz10m+Rs1rFq1\nKqg5+eSTnTjqu+Kvf/2rE/fo0SMNo0svjecuk8+cv6HEPffck9Tn7r33Xif2N7SorKZNmxbkrr32\n2oSfe/HFF4Pc1VdfnZYxJfvM8QYMAIACGjAAAApowAAAKKABAwCggEVYSTDGnU8vKSkJavr37+/E\nUT/XN998M8h17NjxuMczefLkIOf/UnnUQrFDhw4d973SiUVY2WvChAlBbujQoU7MIqzkxfnMzZ49\nO8j16dMnyG3evNmJu3fvHtRELR6tjO68884gd//99zvx1q1bE35uxowZKd2fRVgAAGQxGjAAAApo\nwAAAKKABAwCggEVYSfB3opozZ05Q06tXr7Tca9OmTUFu0qRJTvzoo48GNbt27UrL/TOJRViVi//d\nUF5eHtT4i7CiFvZoy/VFWA0bNgxy8+bNC3Jt27Z14sWLFwc1RUVF6RtYlvF3HbzhhhuCmokTJzrx\nsGHDUroXi7AAAMhiNGAAABTQgAEAUMAccBJSOQ0pVeecc06QKy0tzdj94lTZ54BPPPHEIFe3bt1k\n7h/k/A0rov5/v/DCC534iSeeCGr89QhR40l1fcCxY8ecmI04kqf9XVe/fv0gt2DBAif254RFwufJ\n37xCRGT16tVOHLU2IBv17NnTiV9++eWg5quvvnLi2rVrp3Qv5oABAMhiNGAAABTQgAEAUEADBgBA\nQYH2ALJNq1atgtyrr76almtHbbJxxx13OPHHH3+clnvh+/v1r3/txH379g1qOnfunPA6UYuwUln8\n2KlTpyA3cuRIJ7777ruDmvnz5x/3vZJVq1YtJ65evXpQ4y9sQebt2LEjyA0ePNiJp0+fHtT069fP\niaOe+YEDBzrx1KlTUxli2viLZEXCBYwiIsuWLXPiqJ9R1OK1TOINGAAABTRgAAAU0IABAFCQ93PA\n/vxBnz59gprGjRun5V5Rc8AzZ85My7WRfk2aNHHiZOZ74/bHP/7RiaPmln/+859n7P5lZWVOXFCQ\n918pWeu9995z4ksuuSSo2blzpxNHbbIxbtw4J476c/GrX/0qlSGmJOognGnTpgW5jz76yImjNtaJ\nWq+RSbwBAwCggAYMAIACGjAAAApowAAAKMj7FRMjRoxw4t/85jcZu9eaNWsydm2k34MPPujEK1as\nCGomTZrkxPXq1cvomLLNypUrnfiLL75QGgmOV9QpWVdddZUTT5kyJajxN6sYMGBAUBN10tIDDzzg\nxFEbxBw4cMCJTz/99KBm+/btTrxly5agxt90Q0SkXbt2Qc6X6slhqeINGAAABTRgAAAU0IABAFBg\nUtkUPuWbGRPfzSL4G9eLiIwZM8aJozYS+Pzzz534D3/4Q1Dz9NNPJ7y/v4m5iEhJSUnCz+UKa228\nv+X+tUw+d6eeeqoTd+jQIaXr+PNaIuHG+FH8jQPS+efZv3bUBvf+gRWlpaVpu3+6aDx32t916VJY\nWBjkhg8f7sRRc8BR/OfJ3xhERGTPnj1O3KBBg6CmqKjIiTdu3BjUNGzYMMj537+NGjUKaoqLi514\n3bp1QU0ykn3meAMGAEABDRgAAAU0YAAAFNCAAQBQkDOLsGrUqOHEF198cVAzderUIHfaaac58ezZ\ns4Maf/K+S5cuQc1LL73kxEePHg1qevbsGeSWLFkS5HJVLi7CQvZjEVZ6+SfInXXWWUHNqFGjglzH\njh2dOJne8/bbbwe5vn37JvycNhZhAQCQxWjAAAAooAEDAKCABgwAgIKcWYTVsmVLJ167dm1Sn/N3\nOok6xcP/Gfk7Y4mEp+D4O7qIhLsm5RsWYUEDi7AQNxZhAQCQxWjAAAAooAEDAKAgPPqnkvJPk1mx\nYkVQE3Way/PPP+/EUafZjB492on9+d4o+/btS1gDAMhfvAEDAKCABgwAgAIaMAAACmjAAAAoyJmN\nOHxRpyFNnjw5yPkbeKTL4MGDg9wzzzyTkXtVFmzEAQ1sxIG4sREHAABZjAYMAIACGjAAAApydg44\nyk9/+tMgN378eCdu3bp1UPOvf/3Lid95552gxj/Uobi4OKg5duxYUuPMVcwBQwNzwIgbc8AAAGQx\nGjAAAApowAAAKKABAwCgIK8WYUEXi7CggUVYiBuLsAAAyGI0YAAAFNCAAQBQQAMGAEABDRgAAAU0\nYAAAFNCAAQBQQAMGAEBBrBtxAACACrwBAwCggAYMAIACGjAAAApowAAAKKABAwCggAYMAIACGjAA\nAApowAAAKKABAwCggAYMAIACGjAAAApowAAAKKABAwCggAYMAIACGjAAAApowAAAKKABAwCggAYM\nAIACGjAAAApowAAAKKABAwCggAYMAIACGjAAAAr+HyR3rPwvqlh7AAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1765c01e588>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# 隨機鏡像翻轉 (Random Flips)\n",
    "from keras.datasets import mnist\n",
    "from keras.preprocessing.image import ImageDataGenerator\n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "# 載入數據\n",
    "(X_train, y_train), (X_test, y_test) = mnist.load_data()\n",
    "\n",
    "# 將圖像數據集的維度進行改變 \n",
    "# 改變前: [樣本數, 圖像寬, 圖像高] -> 改變後: [樣本數, 圖像寬, 圖像高, 圖像頻道數]\n",
    "X_train = X_train.reshape(X_train.shape[0], 28, 28, 1)\n",
    "X_test  = X_test.reshape(X_test.shape[0], 28, 28, 1)\n",
    "\n",
    "# 將像素值由\"整數(0~255)\"換成\"浮點數(0.0~255.0)\"\n",
    "X_train = X_train.astype('float32')\n",
    "X_test = X_test.astype('float32')\n",
    "\n",
    "# 定義\"圖像數據增強產生器(ImageDataGenerator)\"的參數\n",
    "datagen = ImageDataGenerator(horizontal_flip=True, vertical_flip=True)\n",
    "\n",
    "# 透過訓練數據集來訓練(fit)圖像數據增強產生器(ImageDataGenerator)的實例\n",
    "datagen.fit(X_train)\n",
    "\n",
    "# 設定要\"圖像數據增強產生器(ImageDataGenerator)\"產生的圖像批次值(batch size)\n",
    "# \"圖像數據增強產生器(ImageDataGenerator)\"會根據設定回傳指定批次量的新生成圖像數據\n",
    "for X_batch, y_batch in datagen.flow(X_train, y_train, batch_size=9):\n",
    "    plt.figure(figsize=(8,8)) # 設定每個圖像顯示的大小\n",
    "    # 產生一個3x3網格的組合圖像\n",
    "    for i in range(0, 6):\n",
    "        plt.subplot(331+i)\n",
    "        plt.title(y_batch[i]) # 秀出圖像的真實值\n",
    "        plt.axis('off')     #不顯示坐標\n",
    "        plt.imshow(X_batch[i].reshape(28,28), cmap=plt.get_cmap('gray'))\n",
    "        \n",
    "    plt.show()\n",
    "    break # 跳出迴圈"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "運行這個範例，您可以看到翻轉的數字。翻轉數字對於MNIST來說是沒有用的，因為它們總是具有正確的左右方向，但是這對於可能具有不同方向的場景中的對象的照片的問題可能是有用的。"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 影像特徵標準化 (Feature Standardization)\n",
    "\n",
    "我們可以把整個數據集中的每個像素值來進行標準化(standardize pixel)。這被稱為特徵標準化，你可以想像影像特徵標準化的程序如同我們對一般表格數據集中每個列會進次的資料標準化。\n",
    "\n",
    "您可以通過在ImageDataGenerator類別上設置featurewise_center和featurewise_std_normalization的參數來執行影像特徵標準化。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 45,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAeAAAAFICAYAAACImy0WAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4wLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvpW3flQAAGaxJREFUeJzt3XuQ1cWVwPHTwgBO8LWWmFAMjBKS\nQIyCPAahjGt0tVBYUGACWIlUYS3BXcJQQJ6aslwSnxRiWEhCDKFkZcAZAikjUkKMFV6GRBNSiCHI\n8iaBJMDyBuG3f5DUpvu0ub+53vs7d+58P1X+cU7O3F8b2zn87L7dLkkSAQAA2brIegAAALRENGAA\nAAzQgAEAMEADBgDAAA0YAAADNGAAAAzQgAEAMEADzoBzrrtz7qfOuSPOuW3OuXusx4TyxpyDJedc\nN+fcKefcQuuxlDIacJE551qLyHIReUlE/klE/k1EFjrnPmY6MJQt5hxKwH+JyEbrQZQ6GnDxfUJE\nOorIzCRJziVJ8lMRWSsin7MdFsoYcw5mnHOjROSwiKy2HkupowEXn3uf3HVZDwQtBnMOJpxzl4rI\noyIyxXoszQENuPjeEZEDIjLNOVfhnLtDRG4RkUrbYaGMMedg5T9F5LkkSXZbD6Q5oAEXWZIkZ0Vk\nmIjcLSJ/kAt/MlwiInssx4XyxZyDBedcTxG5XURmWo+luWhtPYCWIEmSTXLhDURERJxz60Rkgd2I\nUO6YczDwzyJSLSK7nHMiIu1FpJVzrkeSJDcajqtkOa4jLD7n3PUislUu/BeHB0Xk30XkE0mSnDYd\nGMoWcw5Zc85Visilf5eaKhca8oQkSQ6aDKrE8Z+gs/E5EdkvF9blbhORf+EXIYqMOYdMJUlyIkmS\nP/ztLxE5JiKnaL7vjzdgAAAM8AYMAIABGjAAAAZowAAAGKABAwBgINPvATvn2PHVgiVJEjsiseiY\ndy2bxbxjzrVsaeccb8AAABigAQMAYIAGDACAARowAAAGaMAAABigAQMAYIAGDACAARowAAAGaMAA\nABigAQMAYIAGDACAARowAAAGaMAAABigAQMAYIAGDACAARowAAAGaMAAABigAQMAYIAGDACAARow\nAAAGaMAAABigAQMAYKC19QAAAIVVVVWlcvX19V7snFM1tbW1Xrxnz57CDiyHGTNmeHFdXZ2qCccd\njllEpKGhobADKxLegAEAMEADBgDAAA0YAAADrAEXyIc+9CEvrq6uVjXhGoyIXqvZvXu3qpk6daoX\nr1y5Mo8RorkJ58akSZNUzciRI724c+fOqub06dMq98QTT3jx9OnTVc3Zs2dTjROlJ/a7pl+/fl58\n0UX6/aumpsaLs14DDtd8z58/r2rCcSdJUtQxFRNvwAAAGKABAwBggAYMAIABGjAAAAbYhFUgo0eP\n9uLvfve7qib2xff77rvPixctWlTYgaEktW7t/6s3fvx4VfPUU095cdu2bVXN4cOHvfj73/++qhk4\ncKDKPfTQQ158xx13qJrPfOYzXnzy5ElVA3v9+/dXuQEDBqhcuKEptgkr9jsqS+Hz04wx9vff2NhY\n2IEVCW/AAAAYoAEDAGCABgwAgAEaMAAABtiElYdBgwap3Le//W0vPnXqlKoZPHiwyq1Zs8aLb731\nVlXTpUsXL/7hD3+YZpgoYU8//bQXT5w4UdVs27YtZ82qVau8OHZyUEVFhcpNmDDBi2fOnKlqvvrV\nr3rxN77xDVUDe7Ebg2LzIJYLZXmq1OTJk3M+P81JWLG//2nTpn3A0WWDN2AAAAzQgAEAMEADBgDA\nAGvAKXTo0MGLH330UVVz4sQJL66trVU1r732Ws5nffOb31S5a6+91ovDdT+R7G8tQXrDhg1TuXHj\nxnlxbM/A0KFDvfidd97J6/mxW41efPFFL46tAYdzGqUhvCUrjEXiB1ikqcnyII7YARr5HMSxYcOG\nwg4sQ7wBAwBggAYMAIABGjAAAAZowAAAGGATVgpz58714htvvFHVzJ4924tXr16d17O6du2qcmfO\nnPHic+fO5fXZsBHePCQiUllZ6cWzZs1SNfluukrj2LFjXjx//nxV8/Of/9yLw82AIiLbt28v7MCQ\nU7h5qV+/fqqmORzEEXtWPgdxPPPMM4UdWIZ4AwYAwAANGAAAAzRgAAAMsAYcaNeuncqFX3Q/fvy4\nqgkvY0j72VOmTPHiSy65RNWEXzTfv39/zmfBRtu2bVUuXO8V0YdchJczFNvRo0e9+JFHHlE1v/vd\n77x4y5YtqqZPnz4FHRdyW7JkiRenWSeN2bt3b6pcscQO/cjnII4sDw8pNN6AAQAwQAMGAMAADRgA\nAAM0YAAADLAJKxA7CKN3795ePG/ePFWzbdu2nJ89Z84clbv//vubMDqUuiuvvFLlOnXqpHLhQRix\n25CyNGTIEJWLbRpEtiZPnqxy4aarNAdsxOrSHLqxePFilQt/LrYJKna7VriZtFAHcWR5eEih8QYM\nAIABGjAAAAZowAAAGGANOHDw4EGV27lzpxcfOXJE1fTs2dOLv/71r6ua4cOHq1ya9YuTJ0/mrEFp\n2Ldvn8pt3bpV5Xr16uXFsbkR22tQKJdddpkXT5s2rWjPQv7CixdE8jusIlYXHjAkIrJ27dqcn5Nm\nDXjEiBE5xxT73cdBHAAAoOhowAAAGKABAwBggAYMAIABNmEFDhw4oHLhJqypU6eqmlgu9MYbb6hc\n+/btvbhHjx6qZv78+Tk/G6Vr1qxZKjd79ux/GIuIfPrTn/biuXPnqpp169blfH5FRYXKhRu8unTp\nkvNzkL1CHVYRq8uyJlZXqBoO4gAAAE1CAwYAwAANGAAAAzRgAAAMsAkrhenTp3vxt771LVXTp08f\nL66vr1c1EydOVLnGxsYPODqUuueff17lwo0jDz30kKoZM2aMF48aNUrV7Nixw4vDG2dERAYOHKhy\n4aarjRs3qpq+ffuqHLIV27jZuXNnL66pqVE1aU7CyrImVleoGk7CAgAATUIDBgDAAA0YAAADrAGn\nsHr1ai+OreV27NjRi5ctW5bqs8P1i9gXz48ePZrqs9B8LFy40ItXrFihasKDOIYMGaJqRo4c6cWx\nW5XOnDmjcuGa86JFi1TN9u3bVQ7Zmjlzpsq9+OKLXpx2DXjSpElePGDAAFXDQRzZ4g0YAAADNGAA\nAAzQgAEAMEADBgDAgMtyAds513xXy4vktdde8+I2bdqomthBCs1RkiQm35hn3uVWXV2tcu+++64X\nv/XWW6omPICmFFnMO+acFm4YjB1WFG4ei/WnsKa2tlbVNDQ05DPEgkk753gDBgDAAA0YAAADNGAA\nAAxwEEeGOnTooHLhofibN2/OajgAYIaDOHgDBgDABA0YAAADNGAAAAzQgAEAMMAmrAz17NlT5cJN\nWJWVlVkNBwAyE97iNGLECFUTHtYRu2kpPIgjdvNTc8EbMAAABmjAAAAYoAEDAGCANeAMDRkyxHoI\nQN4+/vGPq1zHjh29eN++fVkNB81c7ACNMMdBHAAAoOBowAAAGKABAwBggAYMAIABNmFlKM2Xyg8d\nOpTVcIAmiR0S06ZNG4ORoBzEDtAIc2l+Z/bv31/VNDY2fsDRZYM3YAAADNCAAQAwQAMGAMAADRgA\nAANswspQ165dVS48xaW+vj6r4QCAmUKdhFVXV6dqpk2b9gFHlw3egAEAMEADBgDAAA0YAAADrAFn\n6M4771S5cI3jF7/4RVbDAQAzhTqIY8OGDYUdWIZ4AwYAwAANGAAAAzRgAAAM0IABADDAJqwMxb54\nfvDgQS9ev359VsMBmmTTpk0qt2vXLoORoBwU6iCOZ555prADyxBvwAAAGKABAwBggAYMAIAB1oAz\nFLtoYcuWLV58+PDhrIYDNMm5c+dULrZGB6QxatSoVLlyxhswAAAGaMAAABigAQMAYIAGDACAARf7\nMnTRHuZcdg9DyUmSRF9/kgHmXctmMe+Ycy1b2jnHGzAAAAZowAAAGKABAwBggAYMAIABGjAAAAZo\nwAAAGKABAwBggAYMAICBTA/iAAAAF/AGDACAARowAAAGaMAAABigAQMAYIAGDACAARowAAAGaMAA\nABigAQMAYIAGDACAARowAAAGaMAAABigAWfAObfQObffOfe/zrmtzrkHrMeE8uaca+uce845t9M5\nd9Q595ZzbpD1uFC+mHNNRwPOxmMiUp0kyaUi8q8iMt0519t4TChvrUVkt4jcIiKXicjDIrLEOVdt\nOCaUN+ZcE9GAM5AkyeYkSU7/LfzrX10Nh4QylyTJ8SRJHkmSZEeSJOeTJHlJRP5HRPiDH4qCOdd0\nNOCMOOfmOOdOiMg7IrJfRF42HhJaEOfc1SLyMRHZbD0WtAzMudy4DzhDzrlWInKTiPyziDyRJMlZ\n2xGhJXDOVYjIChF5N0mS8dbjQfljzqXDG3CGkiQ5lyTJGhHpJCITrMeD8uecu0hEnheRMyLyH8bD\nQQvAnEuvtfUAWqjWwhowisw550TkORG5WkTu4r+4oNiYc03DG3CROec6OOdGOefaO+daOefuFJHR\nIvJT67Gh7M0Vke4iMiRJkpPWg0GLwJxrAtaAi8w5d5WINIjIDXLhDzw7ReTZJEnmmQ4MZc0510VE\ndojIaRF57+/+p/FJkvy3yaBQ1phzTUcDBgDAAP8JGgAAAzRgAAAM0IABADBAAwYAwECm3wN2zrHj\nqwVLksRZPJd517JZzDvmXMuWds7xBgwAgAEaMAAABmjAAAAYoAEDAGCABgwAgAEaMAAABmjAAAAY\noAEDAGCABgwAgAEaMAAABmjAAAAYoAEDAGCABgwAgIFMb0MCUFhVVVVe3L9/f1WzZMkSlTt//rwX\njx49WtWsW7fOi/fs2ZPPEAG8D96AAQAwQAMGAMAADRgAAAMuSZLsHuZcdg9DyUmSxFk8t5zn3dq1\na724X79+quaii/Sfs8M14FhNuAZ888035zNEcxbzrpznXBqtWrVSuc9//vNe3L17d1UT5u666y5V\n88orr3jxiBEjVM3JkydTjbNY0s453oABADBAAwYAwAANGAAAAzRgAAAMsAkLmWET1gezePFilaut\nrfXicHOViMjevXtVLvz3PjzQI1bT0NCgaj772c/GB1tC2ISVvdjhL/fee29BPts5/x/nsmXLVM3Y\nsWNV7ujRowV5fhpswgIAoITRgAEAMEADBgDAQIu/jKGysvIfxiIi9913nxe3bdu2qGMK/eAHP/Di\n2JfMjx8/ntVwkJHwYoWamhpVE675xtaAw3XimPBAj9hnZblfBKWrY8eOXjx79mxVM3ToUJUL12AX\nLVqkapYuXerFffr0UTXTp0/P+azYpSSvvvqqylnjDRgAAAM0YAAADNCAAQAwQAMGAMBAi9qE9eST\nT6rcoEGDvLhHjx55fXb45fBCblh5/PHHvfhXv/qVqunbt2/BnofSsH79ei9Oc8hGbMPVhg0bcj4r\nnL8i+oakWA3KW7jhSkRk+fLlXtyrVy9V8+abb6pcuHkq/JyY2MapMWPGeHHsVqXmgjdgAAAM0IAB\nADBAAwYAwAANGAAAA2W7CWvmzJkqN2nSJJXbvHmzF3/lK1/J63nhaVX56tatm8rNmjXLi2Mbxe6/\n/34vXrBgQUHGAztpTrlat26dF6fZcBUzY8YMlaurq/Pi2OlCYS7f56M0XXfddSoX23QVmjp1qsq9\n/vrrBRlTdXV1QT6nFPAGDACAARowAAAGaMAAABgo2zXgP/7xjyr32GOPqVz45fDYTUNZ+vOf/6xy\nv/3tb704dkPI008/7cXLli1TNUeOHPmAo0OxTJ48WeXCgzBi0hyOUVVVpXLh2u2UKVNUTXiYDAdx\ntDxnzpxRufBWo0svvVTV/PKXvyzamNq3b+/Fsb0RzQVvwAAAGKABAwBggAYMAIABGjAAAAbKdhNW\neINQczF8+HCVGzdunBfHblpqbGz0YjZcNS+xg2PCjXWxzSZpbt2qr69XuX79+uX8nPB54aEfIhy8\nUe5+9rOfqVzv3r29OLbhasKECSoXzuc0wtvqRPS8LOTNc1njDRgAAAM0YAAADNCAAQAwULZrwKUo\n9oX12bNne/E999yjasI1jr1796qa2OHnaN7eeOMNL66pqVE1tbW1Xjxy5EhVEztAI80hG+FBIBzE\nARGR7du3e3Hsd9bOnTsL8qxPfvKTTR6PiMibb75ZkOcXG2/AAAAYoAEDAGCABgwAgAEaMAAABtiE\nVSA9e/b04sGDB6ua2JfTP/zhD+f87C1btnhxbKPNsWPHcn4OmpfwcI4XXnhB1YQbpWKHdcRuVQrr\n0tQ05wMPUDyvv/666fNjv/tit8qVIt6AAQAwQAMGAMAADRgAAAOsAacwevRoL/7a176marp27erF\nbdu2LdjzP/rRj3rxK6+8omrC9cFnn31W1ezbt69gY0L2Yuu04eEYaWpidRzE0XxVV1er3MMPP6xy\n4cUGsX+eL7/8shevWLFC1TQ0NDRxhPn7whe+kLNm48aNGYykOHgDBgDAAA0YAAADNGAAAAzQgAEA\nMMAmrECXLl1U7jvf+Y4Xt2/fXtWEGxpihxasWrVK5Xbt2tXUIUY3eE2bNs2Lr7jiClUzfvz4Jj8L\ndurq6rw4zSEbHMRRXlq1aqVy3bt39+If//jHqubqq69WuSNHjuR83qhRo7x47NixOX9mzpw5Krdy\n5UqVW79+vRfHDsvo3bu3F8f+Po4fP+7Fs2bNyjnGUsUbMAAABmjAAAAYoAEDAGCABgwAgAE2YQV2\n7typcrfddpsXf+pTn1I18+fPL9qYQu3atVO5Q4cOefHEiRNVTewErR/96EeFGxhSq6qq8uL6+npV\nc9NNN3lxbBPU3r17vXjdunWqpnPnzipXU1PjxZyEVZrCDVciIr/+9a+9OHYb0JgxY1Ru+fLlOZ83\ncOBAL546daqquf322704dsvbgw8+qHLh76if/OQnquaaa67x4osvvljV/OUvf/HiiooKVXPDDTeo\nXOjtt99WubNnz+b8uULiDRgAAAM0YAAADNCAAQAw4LL8cr1zjm/yF8nQoUO9eOnSpapmzZo1KnfL\nLbcUbUyhJElMFhFLcd6NHDnSi8PbrETSHbLR2NjoxeFBCrFnxZ6X5iCO8Fnv97xSYzHvCjXnlixZ\nonL33nuvF8+bN0/VxNZlC6V///5eHB4CJCIybNgwlStUr0lz6FEaM2bMULkvf/nLeX1WKO2c4w0Y\nAAADNGAAAAzQgAEAMEADBgDAAAdxNEOx25D69OmT8+e2bt1ajOEgD4sXL/bifA/ZSLMJKnxW7Hlp\nDuKora1VNbt37/bi2IYc5G/48OEqF/6zi224LKYNGzZ4cWyM119/vcp169bNi2PzMo2Ghoacz9+/\nf7/KrV692ovDuWuBN2AAAAzQgAEAMEADBgDAAGvAzcBHPvIRL545c6aqCQ9bOHPmjKp57rnnCjsw\n5C1cx4sdshGu+cbWe8NDEerq6nI+K/a8NAdxxGrC5+3bt0/VxOYrytumTZtUrm/fvk3+nHHjxqnc\nwoULvfjKK69UNbHff4cPH27y84uNN2AAAAzQgAEAMEADBgDAAA0YAAADJbcJa/DgwSr30ksvGYwk\nG5dffrkXx27jGDt2rBd36NAh5+cOGjRI5cIv0MNOePBFbINT586dvTh2q1GaAz3SHLIRHvoR+6yq\nqqqcnxO7YaZjx44qF96sxNyMO3HihMpVVlZ68RVXXKFqKioqVO7s2bOFG9jfif0+uvvuu1Xue9/7\nXs7PeuCBB7x4wYIFOX/mwIEDOWtKFW/AAAAYoAEDAGCABgwAgAEXWzMq2sOcy+5hKXXq1MmLY2su\np06d8uJevXrl/Nx27dqp3OjRo1VuzJgxOX8uXMPbtm2bqpkwYYIXr1q1KucYs5YkiV6MzEApzrtz\n5855cewgjnB9tVA1sbqbb775/Qf7V2vXrs35OWmeJaLXgNNcKpEvi3lXqDl36623qtyrr76a8+ee\neuoplauvr/fi9957T9UcPXrUi2Pryz169PDi2NpuuE4ton+3Pv7446pmzpw5Xnzo0CFV0xyknXO8\nAQMAYIAGDACAARowAAAGaMAAABhoUZuwwgMtRPRGgNgtGmHummuuUTXhRqm0/78eP37ci3/zm9+o\nmqVLl3pxeBuIiMjBgwdTPc8Sm7D+X3jTUU1NjapJM6fS1DQ0NKhceENRmoMwYgeBhBt7Yod+xMYU\nHvxRW1uragp1OEdz3oQV2wQV3jQU3paWVuxgjj/96U8F+ezf//73Kvfkk0968fz58/P67OaATVgA\nAJQwGjAAAAZowAAAGKABAwBgoORuQyqmSy65ROUuvvhiL77qqqtyfs7OnTtVLtw8Fdt4snr1apVb\nuXKlF8dOuUL5CTdBvfDCC6omn1OuYrcRfelLX8pniMr69etVLtw8tWTJElUTG3e4CY3bkOJiJ0EN\nHTrUi7/4xS+qmmuvvVblBgwY4MVt2rRRNflsuopt8ps4caLKNYeNolnjDRgAAAM0YAAADNCAAQAw\n0KIO4oi5/PLLvbhVq1Y5f+b06dMqd+zYsYKNqVxxEAcsNOeDOPIV7m0R0XtgYoemDBo0yIvffvtt\nVbNjxw4vDg/vEImv+7ckHMQBAEAJowEDAGCABgwAgAEaMAAABlr8Jixkh01YsNASN2HBFpuwAAAo\nYTRgAAAM0IABADBAAwYAwAANGAAAAzRgAAAM0IABADBAAwYAwAANGAAAAzRgAAAM0IABADBAAwYA\nwAANGAAAAzRgAAAM0IABADBAAwYAwAANGAAAAy5JEusxAADQ4vAGDACAARowAAAGaMAAABigAQMA\nYIAGDACAARowAAAGaMAAABigAQMAYIAGDACAARowAAAGaMAAABigAQMAYIAGDACAARowAAAGaMAA\nABigAQMAYIAGDACAARowAAAGaMAAABigAQMAYIAGDACAARowAAAGaMAAABj4P53EXscWQsQ4AAAA\nAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1765e2d5748>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# 對整個資料集進行\"影像特徵標準化\" , mean=0, stdev=1\n",
    "from keras.datasets import mnist\n",
    "from keras.preprocessing.image import ImageDataGenerator\n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "# 在keras的backend預設使用tensorflow\n",
    "# 而tensorflow在處理圖像是的資料結構是3維的張量 (圖像寬:width, 圖像高:height, 圖像頻道:channel)\n",
    "\n",
    "# 載入數據\n",
    "(X_train, y_train), (X_test, y_test) = mnist.load_data()\n",
    "\n",
    "# 將圖像數據集的維度進行改變 \n",
    "# 改變前: [樣本數, 圖像寬, 圖像高] -> 改變後: [樣本數, 圖像寬, 圖像高, 圖像頻道數]\n",
    "X_train = X_train.reshape(X_train.shape[0], 28, 28, 1)\n",
    "X_test  = X_test.reshape(X_test.shape[0], 28, 28, 1)\n",
    "\n",
    "# 將像素值由\"整數(0~255)\"換成\"浮點數(0.0~255.0)\"\n",
    "X_train = X_train.astype('float32')\n",
    "X_test = X_test.astype('float32')\n",
    "\n",
    "# 定義\"圖像數據增強產生器(ImageDataGenerator)\"的參數\n",
    "datagen = ImageDataGenerator(featurewise_center=True, \n",
    "                             featurewise_std_normalization=True)\n",
    "\n",
    "# 透過訓練數據集來訓練(fit)圖像數據增強產生器(ImageDataGenerator)的實例\n",
    "datagen.fit(X_train)\n",
    "\n",
    "# 設定要\"圖像數據增強產生器(ImageDataGenerator)\"產生的圖像批次值(batch size)\n",
    "# \"圖像數據增強產生器(ImageDataGenerator)\"會根據設定回傳指定批次量的新生成圖像數據\n",
    "for X_batch, y_batch in datagen.flow(X_train, y_train, batch_size=9):\n",
    "    plt.figure(figsize=(8,8)) # 設定每個圖像顯示的大小\n",
    "    # 產生一個3x3網格的組合圖像\n",
    "    for i in range(0, 6):\n",
    "        plt.subplot(331+i)\n",
    "        plt.title(y_batch[i]) # 秀出圖像的真實值\n",
    "        plt.axis('off')     #不顯示坐標\n",
    "        plt.imshow(X_batch[i].reshape(28,28), cmap=plt.get_cmap('gray'))\n",
    "        \n",
    "    plt.show()\n",
    "    break # 跳出迴圈"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## ZCA 白化轉換 (ZCA Whitening)\n",
    "\n",
    "圖像的白化變換是為了減少圖像像素矩陣中的冗餘/去除相關性(共線性)的線性特徵所進行的代數運算轉換。\n",
    "\n",
    "進行圖像中像素矩陣去除相關性的轉換是為了更好地突顯圖像中的結構和特徵到學習演算法。\n",
    "\n",
    "這個轉換的概念在以前大多是使用主成分分析（PCA）技術來執行圖像白化。最近，ZCA的技術顯示了更好的結果，對圖像進行ZCA轉換後的圖像可以保留原始尺寸的大小，從而使轉換後的圖像仍然看起來像原始圖像(這一點與PCA是不同的)。\n",
    "\n",
    "您可以通過將zca_whitening參數設置為True來執行ZCA白化轉換。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 46,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAeAAAAFICAYAAACImy0WAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4wLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvpW3flQAAIABJREFUeJztnXvQXlV59u8tSCBHAiEhQDgGwiEQ\njoKAE1soRhGYftYRsfSz4NQho1I7tNqptjPMN/PVqa0jKGKHwRk5DhZQGdGvKoNAoQJykkMgQDiF\nhBxIQk6A4vP9gZ1xXeuK7+2T5F3P++b3m8kf95p777322muvlee9r33fXa/XCwAAABhe3tG6AwAA\nANsibMAAAAANYAMGAABoABswAABAA9iAAQAAGsAGDAAA0AA2YAAAgAawAQ8DXdft0nXdzV3Xre+6\n7vmu685p3ScY3TDnoAVd113ddd2Srute67ruqa7rPtG6T4PM9q07sI3w9Yh4MyKmRcSREfGDruse\n7vV6j7XtFoximHPQgv8bEef3er03uq47OCJu77ruwV6v94vWHRtEOjJhbV26rhsXEasiYnav13vq\nt21XRcTiXq/3+aadg1EJcw4Gga7rZkXE7RFxYa/Xu6FxdwYS/gS99TkoIt76n4XwtzwcEYc16g+M\nfphz0Iyu6y7rum5DRCyIiCURcWvjLg0sbMBbn/ERsUba1kTEhAZ9gW0D5hw0o9frzY+359p7IuKm\niHijbY8GFzbgrc+6iJgobRMjYm2DvsC2AXMOmtLr9d7q9Xp3RcReEXFB6/4MKmzAW5+nImL7rusO\n/J22ORGBGAa2Fsw5GBS2j4gDWndiUGED3sr0er318fafYS7uum5c13UnRcRZEXFV257BaIU5By3o\num5q13Vnd103vuu67bque19EfDQibmvdt0GFDXh4mB8RO0XEsoi4LiIu4HMQ2Mow52C46cXbf25+\nKd5W4X85Iv661+t9r2mvBhg+QwIAAGgAv4ABAAAawAYMAADQADZgAACABrABAwAANGBYizFccskl\no1bxNWbMmMLesGFD5fPWW28NeVxGFJfx6bpuSJ/h5jOf+UyTTv3lX/7lqJ13mef8m9/8pmp7xzv+\n8P97b0nBpvZ7a4pBv/Wtbw37vDvjjDNG7ZzTZ+Xmkmv79a9/XdiZudvvOubmU6bf6uOun5mrt9xy\nS6rj/AIGAABoABswAABAA9iAAQAAGsAGDAAA0IBhFWFtTTKiDhdQ32677QrbCaVUxKLHRES88UZZ\ncctda8cdd6zalO23rx+J3ovrox7n7l/7GBHxzne+s7BVKBHRn2BnkOhXSNHPubPzLtMfPc6JqTJs\nKUGemxv6LmSvRQa+HFtSZKfPT999h3tObv1T+l2j9F76FVM5Mmv9cIoDI/gFDAAA0AQ2YAAAgAaw\nAQMAADRg4GLALuaRicHq3/Mzf9/PXj8T89D4RjYu8+abb/5eOyLiV7/61ZDn7qePEbmP4zMfpw8y\nWzOOo+fuNwacmfeZeJg7j3sXMj79xP6z74/2OxPfdj4jbS7+Lv1qE3Q9cLgxz8Rgt1Syisy9Ze7V\nzcvM3HH9zoybktHkbA78AgYAAGgAGzAAAEAD2IABAAAawAYMAADQgBEhwlJcMF1FB06E4IL1mcC8\n9sklJNCP2jOVj1zbxo0bK5+MiMaJtxTXbxUZ9PtxvooeRlryjowgJSN06/fc2Yoy/eCEJJmEAxlh\nVEZ8mBGGubm5ww47DHl9HaPMuzIoZARrr7/+euWjCX3cGuba9Nlk5lxGzJod836Ed25euvncDxlx\n4NZmZK2SAAAAowQ2YAAAgAawAQMAADSgeQw483G2tmViANnYgcae3HEa43CxE/Vx13Kxkmeffbaw\nd95558pn6tSphe2KKmg8w8XU+k0IoW2ZpBEjLQbs7knvIfPBf1Z70E9ieIde3x3j5uL69esLe926\ndUOe28Vk9Tg379z9T5kypbDHjx9f+aiuwc0pfRf6jdMPB/qM3bPS+3G6Eb1HN3ZOy6HX7ycxhaPf\nBCmZtd69F5k12/VJx7JfvYDOw80Zx5G1SgIAAIwS2IABAAAawAYMAADQADZgAACABjQXYWWSXGQ+\njs6ILzLJKlzwXttc0F0FKipyiYhYuHBh1XbVVVcV9kUXXVT5LFq0qLBnzJhR+SxfvrywDznkkMrH\nfdSvuLHWe8uIkdxzHGS2VBUoNzYZYV+/VX30OPcePPnkk1XbkUceWdgHHHBA5aPnuu222yqfD37w\ng4W9YsWKymfOnDlV23e/+93Cfvjhhyufww8/vLAzCXAyyR1akRFK6ru2YcOGymfZsmWF7cZu7Nix\nVduuu+76e/sTUQv2nM9OO+1UtSlOsKdzVROKRERMmjSpsN27o8e5cXSCPb2Xft95fXc3R/jHL2AA\nAIAGsAEDAAA0gA0YAACgAc1jwBn07/mZhBouFpQ5zsUONObrPnLXj+EfeOCByucjH/lI1XbJJZcU\n9sEHHzzkuffee+/K56GHHirs++67r/I55phjqjb98D8Tw3RjpGM76DHgfpOSDIUbm8yYulhX5vr6\n/DQ+GBHxJ3/yJ1XbM888U9gvv/xy5aNJYY4//vjK56WXXipsF7O88cYbq7ZTTz21sN378uqrrxb2\n5MmTKx/VdfQbSx8UXnvttcJ2iXn222+/wr7lllsqHzfma9asKezVq1dXPhm9i77b2WIQ48aNK2yX\nCEPXsZkzZ1Y+Dz74YGG7NdOdW+8tEwPOJAvZnAIO/AIGAABoABswAABAA9iAAQAAGsAGDAAA0IDm\nIiwN6GeqCLlqQP1U7InICbz0+k68oMyaNatqc+ItxYmXNLmBE8zstddehX322WdXPjfffHPVduih\nhxZ2RnSREboMuggrU41IcT6Z82SqIWXEHu48moBFE2xE+EQc+gwPPPDAymfx4sWF7YRSioqyIiJO\nPvnkqm3BggWFPWHChMpHBWWZClsjSYSlSSciIpYsWVLYTnD5zW9+s7D/6q/+qvJRwVNELcJyyTKe\ne+65wp42bVrl88orrxT2PvvsU/k4Md7atWsL2621Krpy8+Loo48u7BdffLHy0aQjEfX75BIzaZKP\nTOU5EnEAAACMMNiAAQAAGsAGDAAA0AA2YAAAgAYMqwjLCSQyGZQ2J8j9uzgRy5gxYwp748aNlY9W\nFnHChI9//OOF7SofXX/99VXb7rvv/gf30aHCrN12263ycfemoiHnozjxhvY70+fhwo1pRiSm89WJ\ngPoVBmWqIalob+XKlZXPUUcdVdgq4tlUH1W054RaKsjbY489Kh+tjOPEP67qjQpiXKUufe+diFHn\n66CIsDL9cMK76dOnF/b9999f+ajQzo1vZs10AicV9bn3RH3cvToxp76HToSl81JFYRERxx13XGGr\nKGxT6PXdfNJ+u7FVn82pwMUvYAAAgAawAQMAADSADRgAAKABwxoDziQbcPEq9ckm2ejn+vqxeEQd\nB9AYRETE9773vcK+9tprKx+Nl0XU8WTns2jRosJ2YzRlypTCdpWPXFzmv/7rvwrbxY4zMQ+N57gP\n2FvhxmtLxQr7nXcao3Mxc01qccABB1Q+L7zwQmG7yjB33HFH1aaVhlzVHY0Runigxm5dLDcz1pkE\nMO76+mw3pzLNliSzRrmxmjhxYmHvv//+lY++Wy75i9Np6BhnYtDuPjQ5iEto4a6vuNitrocuoYZe\nLxuD1ZhvRm+UqWRGIg4AAIARBhswAABAA9iAAQAAGsAGDAAA0IBhFWG5gLYKCNzH0eqTqWrkfDIB\ndVfF47DDDitsFVxF1EIt95H7vHnzqravfOUrhX3sscdWPvpxuhNGfOxjHyvs++67r/JRgUdELd5y\nY6TPxPlon9xH9iMNnVOZakhO2JFJQLN+/frKR5NaONHOvvvuW9iuYtGee+5ZtekzdUKaTIUoxT13\nN19UpOOO03HLrB+DkojDCZy0r85HBVZO4KNrTSbRS5ZM5TMVimZFsTrHp06dWvlov52A8rrrrivs\n448/fsjzuDY3tnq9jFBrc+Ycv4ABAAAawAYMAADQADZgAACABgxcoM4lcNB4USbmkPn7fkQdq336\n6acrnxdffLGwx48fX/loXGTSpEmVz6WXXlq1aRxEEytE1MnX16xZU/mcf/75ha0FJCJ8DNjFFRU9\nVyYG72L5rXDzJZPcJXOeTMzMxTc14Ysm3YiIOPnkkwvbxbXuvffewtbiHpsik1wlk2Agk7ggGxdW\ndGwzMfhBRsfBrUf9JPp3seTMXM0UF3EJYhYvXlzYLomL+kREnHnmmYXt1jpdD5944onKR5MMuXnh\nErsomQQ92bHtF34BAwAANIANGAAAoAFswAAAAA1gAwYAAGhAcxGWChMyAqtMsggXPHeB+ZUrVxb2\nJz/5ycrntddeK2xXMUnP7ZJu3HPPPVWbJsK4//77K5+lS5cWthOq6fWuueaaymfOnDlVmwoR3LlV\nvJERWLnEDq3IiMYyx2UEGe68q1atqtpU2Pb+97+/8tHnvmLFispHq8U4wVMmKYPrd+b+9Tgn6tP3\nJyJi5syZhe2EjS+//HJhu/vQPmUr42xtMsK/TBWhfhNKuONULOXWQ51zWjUrIuI973lPYbsKbq6K\n04IFC4a8vlZn22+//SofnStuzcqIcDMJTDLrRMZnk8f2fSQAAAD0DRswAABAA9iAAQAAGjCsMeDM\nB8yZOJuLQWqc0p3HfVSuMY9f/OIXlY/GaV1849Of/nRhH3TQQZWPS86h7LLLLlXbY489VthanMHh\nrpUZfxdDzBRW6Cd2MlxsqUQcGVwM0sW6tECCSzigz9DFUjXxhovBZuLCmRiw89E+uQQwbr5q4pGb\nbrqp8jnrrLMK28X6MkUlWuDWH23rtxhA5t1ya6RqUNxcOf300wt748aNlY+Osa6hET4Gre+Y6hci\n6uQzLjHSo48+WthakCSijqVncc9N0ftwzyjL4KySAAAA2xBswAAAAA1gAwYAAGgAGzAAAEADhlWE\nlRF6ZMQwmaooTgzjPhh/9tlnC1vFVBERd955Z2E7odQpp5xS2C7pxrhx46q2jNBl8uTJhe3EKCqW\ncD4OHW8nXsiIRzL30YqMCCsj/nM+OqcWLVpU+Zx44olVm/odddRRlc/3v//9wj744IMrnw0bNhS2\nE1y5fuszzNy/G0c9z7ve9a7KR9+xiFo85o7TOZxJKLIlK9VsDm790b659yhTXUtxz9xV1/r7v//7\nIX1cm7J69erCnj59euWTSQ7inqcKvLTyUUT9zun6vKk+6Vg6caSOpevjllzrBmeVBAAA2IZgAwYA\nAGgAGzAAAEAD2IABAAAaMKwirIzQw2UV0cC4C3pnhELr1q2r2rRCiMs2tNtuuxX2Qw89VPloVhcn\n+HL3tuOOOxa2imoiamFCJvNKJhNNRC26cmOk9+IEJpkMMoNEP2IdN++0mpYTdrhnqvNOBVcREQce\neGBhZ7JcZYRKjsy76cQ+zz//fGHruxIRccghh1RtP/7xjwvbZcvKvNPa1u/9b2nc/NpSc05xWa8y\nValclil9t11mMx1zJ4Jy80D75OaTCg2XL19e+ago1Y2rE6HqWtsvW+qdi+AXMAAAQBPYgAEAABrA\nBgwAANCA5jFgjXG4OE8mIYKex1U+WrhwYdV2/vnnF/a9995b+Wh86sUXX6x8NL7gqoi4mIfGd12c\n4vjjjy/s2267rfLRJB+a6CDCx4415uMScWRiV+rj4sSt6KfCicPNzTVr1hT2OeecU/m4GJnGsTQm\nHFHPFxdf1meaTcShbS7WqHNhyZIllc+cOXMK28Ue77vvvqpNdQVu3mVihoMS81UyyV/cmOt64Hw0\n5uvea5eIQtc2t47pc3Dvsc7dww8/vPJxVal0/rp+33333YV96KGHVj4ayz7hhBMqH/fOadUk94x0\nPmV8Ngd+AQMAADSADRgAAKABbMAAAAANYAMGAABowLCKsDLCBCd0UZwYJSPmWr9+fdWmIhrHQQcd\nVNhXXHFF5XPmmWcWtiZoiPDCsFdeeaWwnXjiiSeeKGwnWJkyZUphu4Qie+yxR9WmH6xnqphkEqEM\nemKOfqrMOGGd3ucjjzxS+RxxxBFVmyaicKI5fTaZpAzZJCl6Lif+W7x4cWFPmzat8tG5sf/++1c+\nOscj6opiLnFC5hnpfQyKKMuNufatX3Fg5n10CTR0/ZsxY0blo+dyYipdI9y66tB12/UxI5TS6y9d\nurTyyYytE4Hpuft957LwCxgAAKABbMAAAAANYAMGAABoQPMYsJKJYbnk45kPqN3f/PU4LaoQUcfr\njjrqqCH7OHHixMrnmWeeqdqUk046qWp78MEHC9vF4r7xjW8UtkuAn4mdu/HPJNlQn0zsZLjIxLVd\nzEhj7ffcc0/lc+655xb2q6++Wvn8/Oc/r9o05urmtIu/KZkkNe7+1W/RokWVj2oG3LuhhSbcvbp7\n0zY3N/tZLwZZe5DRqej9uJi2ahPc++jeP01+4sZcr+f6mNEmuH5n4quZxEBuPinu3cnEanX+ZJIX\nZXRLm2JwVkkAAIBtCDZgAACABrABAwAANIANGAAAoAHNqyGpoMB9kO8SWCgqKMhUgImoK6444cee\ne+5Z2O7DcxWouIpFRx99dNWm1T7uuuuuykf7feqpp1Y+KhQbP3585eP6nanQkhEmDGpChAgvvsiI\nPdauXVvYJ554YuWjYg93HjfumojCiUYylY5UAOLu1SVl0XPNnj278skI9DThjHt/Jk2aVLX1k7wg\nM6cGRfyXEZBlBGOZ6nAO944qGaFU5jg3L93zzQgPX3rppd97jDu3Ju+IqJMXRXjR2VC4+aRjtDlr\n3WDMVgAAgG0MNmAAAIAGsAEDAAA0YFhjwI5MMQCNZ2Q+xHbxFRdf1uu547Rgw8KFCyufn/3sZ4V9\n0UUXVT4aU4yIuOOOOwrbxW41afrf/u3fVj6nnHJKYbu4nyMT51MycSIXF2pFJjmF89HY7X777Vf5\nrFu3rrAnT55c+bi2TPxP57mLR2niD9U0RPgCCZooxsWxlixZUtirV6+ufDS+O27cuMonk2QjE9fM\nJFQZFNzzzSS0ycSw+43BKpnxdM9OdQ7OxyUi0uIeTi/xvve9r7BdIQ99n1T/EhExderUqq2fgjGZ\n57E5ugN+AQMAADSADRgAAKABbMAAAAANYAMGAABoQHOlTEYMo+IFF/TPJCTQaiARtVhgxYoVlY+K\nwFxCDRVd/eQnP6l8XL+1T5r0I6IWbzkx0MaNGwt7SyYkUDGQSxqh49/PR+/DifbPJYtQH638E1GL\njpxQ6fHHH6/a9Bk6MVFmDDMVi9ycVrHWiy++WPlon6ZPnz6kj7uPjAguIxoaVMGVI1ONzYmndKz6\nrYbkBFaZClTalhFTunX12Wefrdre/e53F7Z7L5YtW1bYq1atqnwOPPDAws7ca5ZMNah+kshsCn4B\nAwAANIANGAAAoAFswAAAAA1gAwYAAGhAcxFWJgOOkqm04YRCWnkoIuKb3/xmYV9wwQWVz2OPPVbY\nO++8c+Vz6623FrYTQbl+H3vssYXtxFua7eiII46ofDQjkyOT+caJF1Tg5YQZGTHOIKH34Pr7wgsv\nFLYbdxVhafaoTZ1bxTZuTmk2H5flSs89YcKEyufOO++s2lR0tvvuu1c+OoedaEfvw73P7l1QQVKm\nCldm3g0yGeFZRuCj4+LeWVeBa+nSpYXtKg1p5Tm3jur1NcNVhJ+Hem8uQ5z26YQTTqh8vvSlLxX2\nGWecUfm49VD7nRFYZebl5oiy+AUMAADQADZgAACABrABAwAANKB5DLifihQuzqSxChevcskWFi1a\nVNiHH3545XP//fcXtos7aRxm5syZlY9LsvGv//qvhT1nzpzKZ9q0aYXtqiplYpoad4uo4yAuzqjn\nduOv13OVTgYZNzYaR/rEJz5R+TzzzDOF/cADD1Q+73//+6s2jRu5cdfruzixJv746U9/WvnMnj27\nalPc+6JjkkmSk61YlEkUo+d259Fx7EdTsjXIrGvZePlQ53bXuuuuu6q2yy+/vLAvu+yyIa/l5qXG\nid/73vdWPqqfiKi1LG4+//KXvyzsJ598svLRikku+Y2Lb2fmSiZOn9E9ZOEXMAAAQAPYgAEAABrA\nBgwAANAANmAAAIAGNBdhKU4M009lC/fRvhM4aGWj6667rvI577zzCvvee++tfLQqzcUXX1z57Lvv\nvlXbSSedVNju/t94442qTVERmhPDZHBjlBGGbMnqSy1wY6wf+Lvn97nPfa6wr7322srnkksuqdpe\ne+21wt57770rn//+7/8u7DVr1lQ+mnBBK8VEeCFJP9WqMokL+k2M4eaPnsuJjfS4jPhpUMiMp1sP\nVODoKlmdeeaZVZvOHycU1TGfMmVK5aN9cok4XMW473//+4Xt7n+33XYrbJcIRN/VbMWijGBQyQgP\nN2fOjexVEwAAYITCBgwAANAANmAAAIAGDFwM2MVu9W/uLn6lcWIXN3bxhIMOOqiwNbFCRMTf/M3f\nFPZOO+1U+WhS/rlz51Y+WtQgoo7h9ZvsIBOXcPG5TBykn4QMg5IQIYsbh+XLlxf2P/zDP1Q+zz77\nbGEfd9xxlc/06dOrtrFjxw7ZJ01U4OKku+66a2G7WLZ7Fu49G+o4F1fTPjkfN7Y6pzIxu9FGP4UX\nIuq5o0U7IiLuvvvuqk0TcTh0/s6fP7/y+eAHP1jYDz74YOXz/PPPV20a383E/TPaEpf0x631Op8y\n53bn6UeTtCn4BQwAANAANmAAAIAGsAEDAAA0gA0YAACgAQMnwnJoYD4jIHGCIxdQVzGIVh6KiNh9\n990LO1MhQ8VVzsedywlPMgKrTBUP15ZJ4JGpvjIaBTM6z1Rw5XyOPPLIyseNjUuwoOgcdsfo88vM\nTdenLZVwIJuUoJ/ru3EcSYk3FNd3bXOCT33mThR02GGHVW2zZs0qbCcOvOaaawpbRaoRdcUil9Cj\n33VE529mPmeFf4oTYamI0Qm8MuK5LPwCBgAAaAAbMAAAQAPYgAEAABowImLAmViQxsdcDNjFjrXN\nxQU08Yc7TyYpfSaRgbu3THxXz+PihdkCFYrGXEZjvDfDmDFjhvRx495vwgU9VyautjWfTSYG6+ZT\nJtY52uK7/ZKJjWfi/u45aJINN5/1XC6xi85LVyQkUzgjQ2YOZApWuHNlCodsyXivg1/AAAAADWAD\nBgAAaAAbMAAAQAPYgAEAABrQbYtCBwAAgNbwCxgAAKABbMAAAAANYAMGAABoABswAABAA9iAAQAA\nGsAGDAAA0AA2YAAAgAawAQMAADSADRgAAKABbMAAAAANYAMGAABoABvwMNB13dVd1y3puu61ruue\n6rruE637BKObrut26bru5q7r1ndd93zXdee07hOMfrqu27frulu7rlvVdd3Sruu+1nXd9q37Naiw\nAQ8P/zci9u31ehMj4syI+D9d1x3TuE8wuvl6RLwZEdMi4mMR8Y2u6w5r2yXYBrgsIpZFxPSIODIi\n5kbE/KY9GmDYgIeBXq/3WK/Xe+N/zN/+O6Bhl2AU03XduIj4UER8sdfrrev1endFxPcj4ty2PYNt\ngP0i4oZer/d6r9dbGhE/igj+47cJ2ICHia7rLuu6bkNELIiIJRFxa+MuwejloIh4q9frPfU7bQ8H\nCyFsfb4aEWd3XTe267o9I+L98fYmDAY24GGi1+vNj4gJEfGeiLgpIt74/UcA9M34iFgjbWvi7fkH\nsDX5Wbz9H73XIuKliLg/Ir7btEcDDBvwMNLr9d767Z8D94qIC1r3B0Yt6yJiorRNjIi1DfoC2whd\n170jIv5fvP0DY1xETImIyRHxpZb9GmTYgNuwfRADhq3HUxGxfdd1B/5O25yIeKxRf2DbYJeImBER\nX+v1em/0er2VEfGtiPhA224NLmzAW5mu66Z2XXd213Xju67bruu690XERyPittZ9g9FJr9dbH2//\nCrm467pxXdedFBFnRcRVbXsGo5ler7ciIhZFxAVd123fdd3OEfG/4239ARjYgLc+vXj7z80vRcSq\niPhyRPx1r9f7XtNewWhnfkTsFG9/EnJdRFzQ6/X4BQxbm/8VEfMiYnlEPB0Rv46Izzbt0QDT9Xq9\n1n0AAADY5uAXMAAAQAPYgAEAABrABgwAANAANmAAAIAGDGuVinPOOQfF1xbACee6rvuDfYaba6+9\ntkkHzjvvvFE77956663Cfuc731n5bLfddlXbm2++Wdit58bW5Morrxz2m5s/f/6onXNKVsg7mueY\nctlll6Vull/AAAAADWADBgAAaAAbMAAAQAPYgAEAABowrCKsLYUL+mub83nHO+r/b6gwQEUtWfoV\nGGg/nWAmI3JQn9/85jeVjzu38utf/7pq2377ETlNmuDG+Fe/+tWQx7n5456FsuOOOxa2iqs2dZ6M\neEuPc++Pzjt3r9pHdy43X6F/dthhh6pN54abq5n1T5/n66+/nuqTPvN+r69k545ez62rwz0P+QUM\nAADQADZgAACABrABAwAANGBEBvcy8VYXr8rg4hLaljm3iy+4+JjGHFy8rp/YhRsjF9/QcxHv3TQu\nPqVzwT3jzHxxz0afhXum2id3LfdMNebr+q3zLqMPcNd3MUK9fmaMtqVEDv+DGxd95m5c3Jjrudw6\nos/FzUudK+69yGhw3njjjcpH7yWzHmUSzWyqT4re27hx44b02Rz4BQwAANAANmAAAIAGsAEDAAA0\ngA0YAACgASNSceOC6RnBihM0aNvq1asrn+XLlxe2C8yPGTOmsLNVaSZOnFjYGdFDRkzghBHu+nq9\nfqso6XGjQTCTEbuoMMk9dyeI0fniRCP6bNy5MzixSyYRRj9CKXcelxRCccKWTLIQ7VO/4ssWuHct\nkywns9Zlkrhk1oPMeE6dOrVqc3Ne21yCFn3mbq3VdyWTmMmRmav9JmbKMnJmKwAAwCiCDRgAAKAB\nbMAAAAANGBExYI1nuI+z9W/+LgaxdOnSqm3JkiWFfeGFF1Y+Gqt49tlnKx+NVbjrjx07tmq7+eab\nC3vmzJmVTz+xv8wYOfqN3Y70mG9GH5BJspGJpUbUc9rF4/QZunP3O+6ZpPOZGKz6uDmW0SNk7j+j\n/RhJRR0yiVUyx7l4b0YDs3YdCtqKAAAVwUlEQVTt2iF9HKpbefLJJysfd+5JkyYVdiaxizv3qlWr\nCtvFkg899NCqTd/fTDEINx4Z3UwWfgEDAAA0gA0YAACgAWzAAAAADWADBgAAaMDAibBcQFuD7C54\nr4Hx++67r/L51Kc+VbVpQoRFixZVPioeWLx4ceXzyiuvFPZJJ51U+SxYsKBqO+usswr7tttuq3z0\nQ/eMYMiREahkRAejESew0rmoc2VTxymZ5ApujHWeu2ejfXTnyYigMtW7dI5H1GKfvffeu/Jx4i1N\nDuLuLZNMQtkcQcwgkBFc6ti5RCeZakBuXuqYjx8/vvL54Q9/WNjf+c53Kp8f/OAHVdvDDz9c2LNn\nz6587r777sL+sz/7s8pHxazHH3985fOBD3ygajv22GMLe/LkyZWPjn8mMdHmJOvgFzAAAEAD2IAB\nAAAawAYMAADQgOYxYP0beyaZ/U477VT5fPvb3/69542I+MpXvlK13XLLLYW9cOHCymefffYpbBcL\nVDTBRkTE6aefXrW9+uqrhe1iYZkYg8Zzsh/nKy6GmEk2MRqLMWQSceh9Z4tg6HGZJBP9xEQj/HzV\ne9uwYUPlo0VIdt1118pn3rx5hX3ppZdWPnvuuWfVNmXKlMJ277TGNl1yGx3bkaRXcMlytP/uPdJ7\ndvFeN+f0XJm4u7u+ztU777yz8nFJj3bbbbfCXrNmTeWjcdpnnnmm8tH38I477qh83Pr7+c9/vrDd\nnNNxc/evbRmNx6bgFzAAAEAD2IABAAAawAYMAADQADZgAACABgyrCCvzUbMTFGQ+fD7mmGMK+4IL\nLqh8Hn300apNhSVz586tfLRPLuiu4jHn8/jjj1dtRx11VGGvX7++8lHBihNvZKrrODKiFfXJfMA/\n6Ogccvekbf0m3cgI69wzzYjv+qkYFBHx8ssvF/aKFSsqn49//OND+jz00EOFPWvWrMrn4IMPrtqu\nvfbawj7iiCMqH60w5gSaujaMJBGWJtSIqO/RzQGdT25+9SuC1DHXeRIR8dRTTxW2q3zknpWuo26u\nvvbaa4U9YcKEykcTM7n7v/XWW6u2Qw45pLBdpSXdD9y6polASMQBAAAwwmADBgAAaAAbMAAAQAPY\ngAEAABowcCIsRybbjQo9XIB9xowZQ15r48aNVVtGBJYRPWnwPiJi2bJlhe0qezz99NOF7YQJSr9i\nlExVpZFecSYi97z6EZZlq0ll5pSKpzLPxgmuXHY3FRu666to0L0bKrZx1ZBcv6+88srC1go7ERH/\n/M//XNgqCouohT2ZakKtyGSL0+fgfFQM6OZy5v13c+Wxxx4r7C984QuVzx577FHYKsqKiNh5552H\nvJ7r41577VXYq1evrnxUqOrWo7PPPrtqu+666wrb7RE6f5zwUufz5mT94xcwAABAA9iAAQAAGsAG\nDAAA0IBhjQFn/lbufDIVQtRn9913r3xcrCBT/SPTRz23i3u5GPS6desK+5FHHql8pk6d+gf3MRMv\ndPQbOx7JCREi/NzIVJ3JkKmokokHOrTfGsOLiDj66KOrNk0C4ZIp6PVd9RiN+e6yyy6Vj0su88Uv\nfrGwP/e5z1U+Oofcu6Exw0FOCJN55hpzdO+xximz81JjsC4x0Gc/+9nC/o//+I/KRzUomXcnon6e\nTsty++23F7bTxOh6qAk2IuoKdhERf/qnf1rYrkqXPhOtyOUgEQcAAMAIgw0YAACgAWzAAAAADWAD\nBgAAaMDAibD6TdahAX4nxnCChsxH1ZlKR6+++urv7U9ExNKlS6s2FQu4D9j7ISuCyiSk0DFy5874\nDBI6z9w4ZAQZOs+ySUoy1ZDGjBlT2Bs2bKh8VEhz2mmnVT6u6o6K/9y7oaIrTcAQEXH33XcPea0H\nHnigavvkJz9Z2IsXL658nnnmmd/bn4h6HAclSUxGBOmSPGQSiajoKivg0/nkxHEPP/xwYWfWB/dc\nXJ80kYsTB+r6d8ABB1Q+119/fWE7cZ6rhqdjq5WXIup3XCsvRdRjuzlrHb+AAQAAGsAGDAAA0AA2\nYAAAgAYMXDGGfhNIKC5el4lduo/aNfa2atWqymfmzJmFPWXKlMrHxWVuueWWwj7mmGMqH+3T66+/\nXvnofWSLAmRiZoMez90SOM2AziFXjEBjZC5m5uaUxqPc8/r5z39e2PPmzat8Dj300MJ+7rnnKh+N\n/UXUc3H69OmVz7Rp0wr7mmuuqXxUw+CKMbgxWblyZWG7+9ckEC4eeOqppxa2i0G3wMV3dRwy76jz\nyRSncbHkV155pbBPOeWUyke1LO48Tq+guLVu1113LeyvfvWrlY+uR66AjZ7H4Y7TuZHRfTgoxgAA\nADDCYQMGAABoABswAABAA9iAAQAAGtBchKVkKg31mwjCnVsTEmSqqcyaNatqU2HCCy+8UPm4RAb6\nMfhLL71U+ejH4E5Uo/efrdCREX1kRFiZilWDRKZ6lfo4QYr6OPGNQ8dnzZo1lc/8+fML+6GHHqp8\nVDTj5phLuKCCJq1CExGxbNmywj788MMrH8UlC3FiF61WpiLGiIgHH3ywsF01MRW4bSkR59ZA1xbX\nV50Xbj3KCP9cAomFCxcW9gc+8IHK52c/+1lhjxs3bsjrO1GoE2qpMNW9TyoqdO+Trn9ufXLjllnb\nM8l3VIyZSVayKQZ3tgIAAIxi2IABAAAawAYMAADQgObFGLTNxYkzf7vXeIo7TybOd95551U+v/zl\nLwt77dq1lY/GKlxRBReX/ehHP1rYLnasceLVq1dXPno9F7tx8blMzExjHO4+BiUJfr9kdAXuvjMJ\nUDIsWLCgatM4rZt3c+bMKWxNph/h3zv1c4k4pk6dWtguoUgm5v38889XbSeeeGJhuyQnmqz/s5/9\nbOWjGg61W+Himxldhr5HLgbZbzEA1QI4LYm2ZdZMd1/ueV5xxRWF7Yox6Bx3fdSEGq6PLgatbe69\nUB+X2GVzYr4Kv4ABAAAawAYMAADQADZgAACABrABAwAANKC5CCuTwEED407wo239Bsq/9rWvVW3a\nJycM0D464ZirkLTLLrsU9m677TbkcU50cc8991Rtikt2kBFPqY87Ru8/m5BiUMgkIHHPXQVybt45\nIY0mXJk7d27lo6KZ2bNnVz4qcHLVkC688MKqTQUxDhXSuHdzwoQJhf3II49UPh/60IeqNhUNLl++\nvPLRMXHCHp1nLgFFC7KJgBSdP24dySTPcWjyk5tuuqnyOeKIIwrbPZfMe+HWiPHjxxd2Zjzc/eta\n40Rg7j3sR+CW2bM2J/kLv4ABAAAawAYMAADQADZgAACABrABAwAANGBYRViOfgLYmeC9EwFkRCRq\nb+pcima+cRVCtHJNRMRPf/rTwnYZiVS8MG3atMrntNNOK2yXweXee++t2vbcc8+qTVEhhBvHjHhh\nkFAhRyabkBOWqdjDZeB58sknq7ZDDjmksN1z0Os98cQTlY9WMbrxxhsrnzPOOKNqmzdvXmFnxC7u\nPXjggQcKW+dqRH2vEXWmtr/7u7+rfM4999zCdlWddJ5ls0K1IFNdKyNezAi1XJuOubu+rn9uzdKM\naPvss0/lc8kll1RtmrXNkRE4ZarjZdb/zFxxYi49Llt5zsEvYAAAgAawAQMAADSADRgAAKABzWPA\n+rd6FzvUuIiLXSjZD+Ez19dzubiAxlxcLNBVSNLEGy4GpMkVFi9eXPlofMVVrtl1112rtlWrVhW2\nfqwfUcc4XHwlE5caJLR/br7oM3RJHjTWvmbNmspnv/32q9q0GtAvfvGLykfnhvP5x3/8x8K+/vrr\nK5/jjjuualNc7FYrc61cubLyUe3BySefXPncfPPNVdt3vvOdwj7nnHOG7GMmrrc5SRG2JJnqWo5M\nfLPfe1Y/t9bp2ppZj928+Iu/+Iuq7fLLLy/s008/vfKZOHFiYTstjb67bj9wa3QmBqznyuh/Nqc6\n0mDMVgAAgG0MNmAAAIAGsAEDAAA0gA0YAACgAc1FWBoYd0FvFQ+4D5/VJ/MBdfb6GfQ410d3bhUU\nOKHP/vvvX9hOhKWCGVdVSYU/ERE33HBDYU+dOnXIPmYqBw06+tzdfBk7dmxhO0GICrU0MUVExBe+\n8IWq7Y477ihsFTNF1KKVU089tfLR56fVtSJ8chet4nT33XdXPprAQxM5RNTCviuvvLLycQlE/vzP\n/7ywXZINHW8n7NNKPJuTFGFLkhFGZZKfODFl5h7d9XU8nVBURZmu0pH2e926dZWPS2j04Q9/uLBv\nueWWymePPfYobF37ImrB4IYNGyqfzHrUr5g3s9dk4RcwAABAA9iAAQAAGsAGDAAA0IBhjQFn4qv9\nfmyvf6vPxnIzH75n/uafics4n0wRB/3w3SXUWLRoUWHPmDGj8lm2bFnVlokLaZu7D/VxxSAGiUzM\nXsfdxbV+9KMfFfY//dM/VT733Xdf1Xb00UcXtkugccQRRxS2xuci6rm5evXqysfF6LT4w6c+9anK\nZ/ny5YU9adKkykcLfLg59t73vrdq0xh0Jum+m5u6NgxKEZDMGuXWkcz7qDHYbOGZF198sbAvvvji\nykeTprjkQapTyRbg0Pnk9Ar6zl199dWVzx/90R8NeX2X0EjHMlNcxcXp1SdTQGNT8AsYAACgAWzA\nAAAADWADBgAAaAAbMAAAQAOaJ+LICHy0LSOUcsHzfiulZComZYL3TlChx2USeLhkHXpvTpix9957\nD3mc63fm/vW4zfk4fThQ8Zu7b/VxAqd3v/vdha0JUSK8SERFc060tmLFiqpN0epDGzdurHyceEyv\n/9RTT1U+er8LFy6sfDTJx2GHHVb5uCQbGfGj4sQuO+yww5A+LchU13J9zYjIMlWN3PW17dVXX618\ndDzdszv++OML+4ILLqh85s+fX7UdeuihQ55bfT796U9XPldddVVhO5GfQ99xvVdHZq/ZnApc/AIG\nAABoABswAABAA9iAAQAAGjCsMWAXq8gksNDj+k387+Kiev3M3/Nd7EbjKS6JuiuQoPFcl4hDfVwx\nBu23iynec889Vdu0adMKOxOXyox/v0UtWuHmoT6LJUuWVD6aHOPwww+vfFwM+LrrrivsWbNmVT6a\ncMXF8LXQgSuY4GJtmijh0UcfrXw0qcaxxx5b+WhczV3LkYl1qo9Lnq/zdXPicVsbXRMySTYyiSDc\nWuPWEX3XL7vsssrn9NNPL2ynDZg4cWJha8KYiIhvf/vbVdtnPvOZwnZrhCatmTdvXuVz4IEHFvZP\nfvKTymfu3LlVW2bO6drm9DbumfTL4M5WAACAUQwbMAAAQAPYgAEAABrABgwAANCA5ok4lIzAxwXT\nM1VR+q3GpMkNnOhBP053Iqgf/vCHVds+++xT2Bs2bKh8Vq5cWdhaScdxzDHHVG3/8i//UrWpsMaJ\nN1T0MWbMmMpHhQmDUpVmU2QSh6hIxgmMbrjhhsL+0pe+VPlo5Z+IiHPPPbew3Xjp9VwiDBVTOZ/n\nn3++atMqRjNnzqx8VOzi5nRmHDPvqxP/Zd7XTAKcQUEFYhnBoxOVqWAwI06LqOezE0/peLr16PHH\nHy/sE088sfJxYkRN7OKe70477VTYt99+e+Xz9a9/vbBd0g9XlWvq1KmF7eazE8YpW1Loxy9gAACA\nBrABAwAANIANGAAAoAFswAAAAA0YOBFWJsDtgvcq3sqIELLXX7p0aWGff/75lc+Pf/zjwp40aVLl\n4yrFqKBLRTURtQjMVTHRKiKXX3555aOimoh6nDLVmNz4D7roSlGxibsnfTZOWHLccccV9qWXXlr5\nuMxlKgBxc1Mzl82ePbvy+dGPflTYmu0oImKPPfao2vbdd9/CzmRTcs84Uxkmk+0ukxXKCTT13CMt\nA5uSqTymbZkKZhERM2bMKOyrr7668rniiisK+5FHHql8FixYUNguQ5uryvXKK68UtpuXmUxg+o45\nAaFeK6Kem05MqoI2J9TakvALGAAAoAFswAAAAA1gAwYAAGjAwMWA3d/8tW2HHXaofDKVU1ySAD23\nfggeUX/A/Z//+Z+VzwEHHFDYLqHF5MmTqzaNYbnYicZYxo4dW/noR+7OZ+edd67atJ+ZOPlIi/c6\nNJ6Y0R64pASayESrE0XUiVQiIu64447CdhWTtHrWc889V/m4KkqKe6f0ubv71ziie3/Ux2kv3HE6\n7zMJeDJzcyThKu3oc8kkFnFrnYu7a0KYM844o/K56KKLCvvLX/5y5aMxYNdH96w0sYzr95w5cwr7\nwx/+cOWjSYY0CVKE10LoGunmpZu/Sj9rx6bgFzAAAEAD2IABAAAawAYMAADQADZgAACABgycqsEF\n7/WD6cyH/Q73cbpez51bxUtOMPL0008XtgvMZwRmzuexxx4r7AkTJlQ+eh+aaCHCi4hU0ObuTdtG\nQyIOpV8hhY7zU089Vfm4MX3Xu95V2E78p8kx3LjrfHXzJ/Ns3LzX41yyDiU7juqXqV6WmZtbslLN\n1saNpwqTnJhT39nsM9excs987ty5hf3v//7vlY+udSpEjIg47bTTqrYLL7ywsE8//fTKRxNf/Nu/\n/Vvl88d//MeF7d4Ll0BD9xE3nzKJXPQZ9bsfRfALGAAAoAlswAAAAA1gAwYAAGjAwMWA3d/gMx9H\na8wjk8Tc4eIyGitw59HEF+4j737jU5nYjcaBXLzXXb+fsXX3lkmkMMi4/muszcWV1q5dW9guuYLT\nNeizcAlY+oktuWu5+Zo5d2a+Zp57pnhK5jh3b5sTf2uNey76PrqEOuqTKSoQUY+VS2ikc1wTY0RE\nnHDCCYXtEs1897vfrdpuvPHGwv7IRz5S+ei80EI4ERHr1q0rbPfOOTLFPXRtc3NuSxb84BcwAABA\nA9iAAQAAGsAGDAAA0AA2YAAAgAYMnAhrSyV0cIHybFs/fcoE+B16/UxCgkwiDHd9J6rR45woSwUd\nI11wlSWTeEJFGlmhm457Zh5mhH3Z5ALa78z1neApk1DDJYrQe8nMe3d9NyYjGb0fN3Y6Ls7HzTmd\nG06oqdd3iUB07rg556oRab9feOGFymeoYyLq9ciJIzO4d1Xn2NZOOsQvYAAAgAawAQMAADSADRgA\nAKABAxcDdvQTL3O4v/lnYrBDHeOOy8YOtlQMWs+TTfqh8aPRFlPbkrjnoOPl4lGZpDDug/8MLv6n\nuLmgcbuMZiBzHkemMADkycRgM4ll3NzJrBsaJ3XXyiaEUTIFOPT6rs8uEYlqOjJzfmsXmeEXMAAA\nQAPYgAEAABrABgwAANAANmAAAIAGdFuysgMAAADk4BcwAABAA9iAAQAAGsAGDAAA0AA2YAAAgAaw\nAQMAADSADRgAAKABbMAAAAANYAMGAABoABswAABAA9iAAQAAGsAGDAAA0AA2YAAAgAawAQMAADSA\nDRgAAKABbMAAAAANYAMGAABoABswAABAA9iAAQAAGsAGDAAA0AA2YAAAgAawAQMAADSADRgAAKAB\nbMAAAAAN+P87JsgRcvP0fQAAAABJRU5ErkJggg==\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1765c068860>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# ZCA 白化轉換 (ZCA Whitening)\n",
    "from keras.datasets import mnist\n",
    "from keras.preprocessing.image import ImageDataGenerator\n",
    "import matplotlib.pyplot as plt\n",
    "\n",
    "# 載入數據\n",
    "(X_train, y_train), (X_test, y_test) = mnist.load_data()\n",
    "\n",
    "# 將圖像數據集的維度進行改變 \n",
    "# 改變前: [樣本數, 圖像寬, 圖像高] -> 改變後: [樣本數, 圖像寬, 圖像高, 圖像頻道數]\n",
    "X_train = X_train.reshape(X_train.shape[0], 28, 28, 1)\n",
    "X_test  = X_test.reshape(X_test.shape[0], 28, 28, 1)\n",
    "\n",
    "# 將像素值由\"整數(0~255)\"換成\"浮點數(0.0~255.0)\"\n",
    "X_train = X_train.astype('float32')\n",
    "X_test = X_test.astype('float32')\n",
    "\n",
    "# 定義\"圖像數據增強產生器(ImageDataGenerator)\"的參數\n",
    "datagen = ImageDataGenerator(zca_whitening=True)\n",
    "\n",
    "# 透過訓練數據集來訓練(fit)圖像數據增強產生器(ImageDataGenerator)的實例\n",
    "datagen.fit(X_train)\n",
    "\n",
    "# 設定要\"圖像數據增強產生器(ImageDataGenerator)\"產生的圖像批次值(batch size)\n",
    "# \"圖像數據增強產生器(ImageDataGenerator)\"會根據設定回傳指定批次量的新生成圖像數據\n",
    "for X_batch, y_batch in datagen.flow(X_train, y_train, batch_size=9):\n",
    "    plt.figure(figsize=(8,8)) # 設定每個圖像顯示的大小\n",
    "    # 產生一個3x3網格的組合圖像\n",
    "    for i in range(0, 6):\n",
    "        plt.subplot(331+i)\n",
    "        plt.title(y_batch[i]) # 秀出圖像的真實值\n",
    "        plt.axis('off')     #不顯示坐標\n",
    "        plt.imshow(X_batch[i].reshape(28,28), cmap=plt.get_cmap('gray'))\n",
    "        \n",
    "    plt.show()\n",
    "    break # 跳出迴圈"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "運行以上範例，您可以在圖像中看到相同的一般數字結構以及每個數字的輪廓如何被突顯。"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 儲存增強的圖像數據　(Saving Augmented Images to File)\n",
    "\n",
    "數據準備和增強由Keras在模型訓練的運行中進行。\n",
    "\n",
    "這對記憶體的使用效率很高，但是您有可能需要在訓練期間使用在檔案系統中圖像檔。例如，也許您希望稍後使用不同的套件　進行分析，或者只生成一次新增強的圖像數據，然後在多種不同的深度學習模型或配置中使用它們。\n",
    "\n",
    "Keras允許您保存訓練期間動態生成的圖像。您可以在訓練前指定給flow（）函數有關於您想保存的目錄、文件名前綴和圖像文件類型。然後在訓練過程中，動態生成的圖像將被寫入到檔案系統中。\n",
    "\n",
    "下面的範例演示了這一點，並將6個圖像寫入“images”子目錄，前綴為“aug”，文件類型為PNG。"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 47,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "image/png": "iVBORw0KGgoAAAANSUhEUgAAAeAAAAFICAYAAACImy0WAAAABHNCSVQICAgIfAhkiAAAAAlwSFlz\nAAALEgAACxIB0t1+/AAAADl0RVh0U29mdHdhcmUAbWF0cGxvdGxpYiB2ZXJzaW9uIDIuMS4wLCBo\ndHRwOi8vbWF0cGxvdGxpYi5vcmcvpW3flQAAG/JJREFUeJzt3XmQVdXxwPE+wJAwjAMSICwKJPkp\nKgGBYIgrUOwgCrJKZCuBkpCIpShRAQNoUKmAJMEoCorBlKIIJVtEMJQLEEAigSihABEQkX3fZuD+\n/iBWcm5fnDeP916/ee/7qfpVft3Vc2+XXqe93sM5LggCAQAAqVXKugEAALIRAxgAAAMMYAAADDCA\nAQAwwAAGAMAAAxgAAAMMYAAADDCAU8g5d4Vz7pRzbqZ1L8gOzrlezrnPnHPHnXNbnHM3W/eEzMfv\nutiUsW4gy0wRkdXWTSA7OOdai8hTItJTRFaJSHXbjpBF+F0XA96AU8Q510tEDonIUutekDXGiMjY\nIAhWBkFwLgiCL4Mg+NK6KWQ2ftfFjgGcAs65fBEZKyIPWPeC7OCcKy0iTUSkinNus3Nup3Puj865\ncta9IXPxu654GMCpMU5EpgVBsMO6EWSN74tIjoh0E5GbRaShiDQSkZGWTSHj8buuGBjASeacaygi\nrURkknUvyCon//O/fwiC4KsgCPaJyEQR6WDYEzIYv+uKj0VYyddcROqIyHbnnIhInoiUds5dEwRB\nY8O+kMGCIDjonNspIhx3hlRpLvyuKxbHcYTJ5ZzLFZH8/0kNl/MP6ZAgCPaaNIWs4JwbKyLtRaSj\niBSIyNsisiwIglGmjSEj8buu+HgDTrIgCE6IyIlvYufcMRE5xQOJFBgnIpVFZJOInBKRWSLyhGlH\nyFj8ris+3oABADDAIiwAAAwwgAEAMMAABgDAAAMYAAADKV0F7ZxjxVcWC4LAWdyX5y67WTx3PHPZ\nLdZnjjdgAAAMMIABADDAAAYAwAADGAAAAwxgAAAMMIABADDAAAYAwAADGAAAAwxgAAAMMIABADDA\nAAYAwAADGAAAAwxgAAAMpPQ0JACxq1y5shcPGzZM1TRt2tSLq1WrpmoGDhyocqtWrbrI7gBcLN6A\nAQAwwAAGAMAAAxgAAAMuCILU3cy51N0MaScIAmdx35Lw3PXv31/lRowY4cVVq1ZVNR988IEXV6hQ\nQdXUqVNH5a699lovPnLkSAxdlkwWz11JeOaQPLE+c7wBAwBggAEMAIABBjAAAAYYwAAAGGARFlKG\nRVj/1adPHy+eMWOGqjl48KAXt23bVtWsWbPGiytVqqRqNmzYoHLPP/+8F48ZM+bCzZZwLMKKXdeu\nXb34yiuvVDWLFy/24o8//jiue/Xt21flXnrppSJ/LryJzPXXXx/X/ZOJRVgAAKQxBjAAAAYYwAAA\nGOAwhpA5c+ao3IoVK7z46aefTlU7MevWrZsX33///apm1KhRKrd06dKk9YTzGjRooHLhb7Dh770i\n+ptv+HtvlAMHDqhc1N/jUqX4d29ovXv39uLbb79d1Tz44INe3Lp1a1UT73fhWNYkhTek+eEPf6hq\ntm7dGtf9U41/CgEAMMAABgDAAAMYAAADDGAAAAxk/SKs8EkxzZo1UzX//Oc/U9RNtEsvvdSLn332\nWVXTvXt3Lw7/gXoRFlylQuXKlVXulVdeUbnvfve7XvzYY4+pmlgWXcXi888/T8h1kFkGDBigcm3a\ntCny5/Lz8724VatWqibeRVixqF27thfXr19f1bAICwAAXBADGAAAAwxgAAAMMIABADCQ9Yuwwoth\ncnJyVM3OnTtT1U6k/v37e3GPHj1Uzfvvv+/F8+fPT2ZLuIConYOidsJ68803vfh3v/td0np67rnn\nVO7yyy9P2v2QnsI7SN17772qply5ckVep7Cw0Is3bdoUVz/33XdfXD+XSXgDBgDAAAMYAAADDGAA\nAAxk/Tfgnj17enHZsmVVTSq/l9WtW1flRo4c6cU7duxQNeFTTM6ePZvYxhDpe9/7nhc/8MADqubQ\noUMqN2TIEC8+d+5cYhv7H7t27Yoph8zWpUsXL47awCIW69ev9+KoE+RiEbVpTSyOHDnixXv37o3r\nOumAN2AAAAwwgAEAMMAABgDAAAMYAAADWb8I65JLLvHiMmVs/5J06tRJ5SpWrOjFUafkfPXVV0nr\nCRfWvHlzL77qqqtUzaJFi1Ru//79yWopYb7zne94cSyLdlq0aKFyx44dU7m//OUvXnz48OFidodv\nc9NNN6nc+PHji32dM2fOqNxTTz0VV0+dO3f24vACxlht3LjRi5cvXx7XddIBb8AAABhgAAMAYIAB\nDACAgaz/BhyLevXqJe3a4Y03HnroIVVz4sQJL54wYULS+kHxhL/PR1m4cGEKOrk4ffr0UbnHH3/c\ni2PZkCZqA5iTJ0+q3COPPOLFgwcPVjVR384Rm2HDhqlcfn5+sa8zadIklQsfJBKrhg0benF4jUE2\n4g0YAAADDGAAAAwwgAEAMMAABgDAQNYvwtqwYYMXFxYWqprwH2qvU6eOqtm2bVtc94/lD6e/8847\nXrxkyZK47oXEa9OmTZE1s2bNSkEnxRNeEDN16lRV8/XXX3vxiBEjVM3bb7/txVGLsE6dOqVy4Q1n\n5s2bp2rC/9ytXLlS1UAkNzdX5Ro0aBDXtT777DMvnjZtWlzXiXLfffcl5DqLFy9OyHXSAW/AAAAY\nYAADAGCAAQwAgAEXBEHqbuZc6m4Wp6hNE9q2bevF8+fPVzXdunXz4oKCAlUT9QfPt2/f7sUVKlRQ\nNR07dvTipUuXqpqSIAgCZ3HfZD534UMEwod7iER/o4v6LposUc/da6+95sWNGjVSNe3atfPi8Cb4\nF6NUKf/f/SdPnqxqwpuDxLLpSRSL5y6Zz1zZsmW9OHywhYheWxKru+66y4tj2UQmah1Es2bNVG7g\nwIFenJOTU8zuztuzZ48XR20MErXu4sMPP4zrfvGI9ZnjDRgAAAMMYAAADDCAAQAwwAAGAMAAi7BC\nmjRponILFizw4sqVK6uaGTNmePHQoUNVzR133KFyf/7zn704vOmGiEj79u2jmy1hMnER1tGjR724\nfPnyquaWW25RuVQuCOnevbvKzZw504ujTkNK5QYiUYuG3nrrLS8OL9yKVaYtwgr/bolawGbNOf2X\nPJWzJvzPpYj+PZrMjV1YhAUAQBpjAAMAYIABDACAAQYwAAAGsv40pLA1a9ao3PDhw7345ZdfVjX9\n+vXz4vCOMiIie/fuvbjmkHbCOwVFLXjq0qWLyqVyEVZ4lzYRka1bt3qx9YlNf/vb30zvX5KEFzhF\nLXiyFrVg7ty5cym7fzr+NYnCGzAAAAYYwAAAGGAAAwBggG/AMQhvlrF69WpVM2LECC8OfxMWEale\nvbrKhb9VhE9eEhHZvXu3F3/yySeqpkaNGl7coEEDVYPEC59MFfUNuEqVKqlqR6688kqV69Spk8p9\n8cUXqWgnZlF/3VJ5YlRJMnXqVC+OOnkoat1BKkV9741nI47x48er3NNPPx3X/Y8fP17s+ycbb8AA\nABhgAAMAYIABDACAAQYwAAAGOA0pQcKLqQYNGqRq/vSnP6lceHOOf/zjH6pmzpw5XvzGG2+omhMn\nTnjx6dOnL9yskUw8DSl8MtYHH3ygaqpWrapyjz/+uBdPmjQpIf00bNhQ5dauXaty//73v7346quv\nTsj9Y1WmjL/+M6rHcK5///5x3SvTTkMKy83NVbkbbrhB5X72s5958fTp04u8dtTiuO3bt3tx8+bN\nVc0vf/lLlYtn1oR7FoneLCndcBoSAABpjAEMAIABBjAAAAbYiCNBwt83CgoKYvq5FStWeLH1H6BH\n8ezbt8+L7733XlUzd+5clRs5cqQX5+TkqJrf//73XhzLxhRbtmxRufDBC6mWl5encqNHj/biH/3o\nR6qmZcuWSespk4TXf4iILFmyJKZcUSZPnqxy4We1d+/exb7uhYR73LBhQ8KunY54AwYAwAADGAAA\nAwxgAAAMMIABADDAIqwkqVSpUkx1UScboeR69913Va5z584qN3HiRC9+8sknVc2tt97qxVGbdYRP\nYzp79qyqeeKJJ1QuvMCrbt26qia8WUeUsmXLenGjRo1UzYsvvqhyl112mRffcccdqia8SQ3SQ716\n9bw4kQtHw78PM/1ELN6AAQAwwAAGAMAAAxgAAAN8A06S1q1bx1S3atWqJHcCa1HfhVu0aOHF4Y0p\nREQGDhzoxbNnz1Y14UNAjhw5omrWrVuncuXLl/fiBQsWqJpNmzapXFjt2rW9+PLLL1c148ePjymH\n9BP+xi8i8vDDDyftfi+99FLSrp2OeAMGAMAAAxgAAAMMYAAADDCAAQAw4MKn+CT1Zs6l7mbG/vrX\nv6pc1MKsihUrevHRo0eT1pO1IAhc0VWJlynPXZs2bVSuevXqXtyqVauYrpWfn+/FHTp0UDWlS5f2\n4oMHD6qau+++24s//PBDVRM+MSrVLJ67THnmatasqXJffPFFkT8XXhwook+MW7ZsmaoJb+pRUn8f\nxvrM8QYMAIABBjAAAAYYwAAAGGAAAwBggJ2wjHXs2NGLX3vtNaNOkO4WL15cZM2MGTPiunZeXp7K\nhU9xCp/OJCJy3XXXefHy5cvjuj+yz/bt21WupC66ihdvwAAAGGAAAwBggAEMAIABvgEnyXvvvady\nURtxXHHFFaloB/hWx44dU7mZM2d+a4zMF7VRU/g77SWXXBLXtU+fPh3Xz2US3oABADDAAAYAwAAD\nGAAAAwxgAAAMsAgrSXbv3q1yZ8+eVbnwZgc7d+5UNatWrfLif/3rXxfZHQAUbdeuXSpXrVo1L164\ncKGqad68ucqNHTvWiydOnHhxzWUA3oABADDAAAYAwAADGAAAAy7qD1on7WbOpe5maah79+4q9/rr\nr3tx1N+Pe+65x4tfeOGFxDaWIkEQOIv7Zvtzl+0snjueuewW6zPHGzAAAAYYwAAAGGAAAwBggAEM\nAIABFmEhZViEBQsswkKqsQgLAIA0xgAGAMAAAxgAAAMMYAAADDCAAQAwwAAGAMAAAxgAAAMMYAAA\nDKR0Iw4AAHAeb8AAABhgAAMAYIABDACAAQYwAAAGGMAAABhgAAMAYIABDACAAQYwAAAGGMAAABhg\nAAMAYIABDACAAQZwijjnejnnPnPOHXfObXHO3WzdEzKfc+4K59wp59xM616Q2Zxzx0L/d9Y59wfr\nvtJZGesGsoFzrrWIPCUiPUVklYhUt+0IWWSKiKy2bgKZLwiCvG/+f+dceRH5WkTesOso/TGAU2OM\niIwNgmDlf+IvLZtBdnDO9RKRQyKyXET+z7gdZJduIrJHRD6wbiSd8Z+gk8w5V1pEmohIFefcZufc\nTufcH51z5ax7Q+ZyzuWLyFgRecC6F2SlfiLySsB5t9+KAZx83xeRHDn/b4Q3i0hDEWkkIiMtm0LG\nGyci04Ig2GHdCLKLc66WiDQTkRnWvaQ7BnDynfzP//4hCIKvgiDYJyITRaSDYU/IYM65hiLSSkQm\nWfeCrNRXRD4MguBz60bSHd+AkywIgoPOuZ0iwn+KQao0F5E6IrLdOScikicipZ1z1wRB0NiwL2SH\nviLypHUTJYHjP9Enn3NurIi0F5GOIlIgIm+LyLIgCEaZNoaM5JzLFZH8/0kNl/MDeUgQBHtNmkJW\ncM7dICLviki1IAiOWveT7ngDTo1xIlJZRDaJyCkRmSUiT5h2hIwVBMEJETnxTeycOyYipxi+SIF+\nIvIWwzc2vAEDAGCARVgAABhgAAMAYIABDACAAQYwAAAGUroK2jnHiq8sFgSBs7gvz112s3jueOay\nW6zPHG/AAAAYYAADAGCAAQwAgAEGMAAABhjAAAAYYAADAGCAAQwAgAEGMAAABhjAAAAYYAADAGCA\nAQwAgAEGMAAABhjAAAAYYAADAGCAAQwAgAEGMAAABhjAAAAYKGPdABKjcePGXnz33XermiFDhhR5\nndtuu03l5s+fH39jAIBIvAEDAGCAAQwAgAEGMAAABhjAAAAYcEEQpO5mzqXuZhmkQoUKXly/fn1V\n8/Of/9yLBw8eHNe9Dh8+rHLha7355ptxXTsIAhfXD16kkvDc3XnnnSrXt29fL77rrrtUzf79+5PW\nU6aweO5KwjOH5In1meMNGAAAAwxgAAAMMIABADDARhxppmLFiir3zDPPeHGfPn2Sdv/c3FyVq1at\nWtLuh/OuvvpqlWvbtq0XR/19Dz8bAEoO3oABADDAAAYAwAADGAAAAwxgAAAMsAjLWLt27bx44cKF\nqiaZm6UsW7bMi6dOnapqXn/99aTdH7GbN2+edQtF6t69u8pddtllKjdlyhQvPnPmTNJ6QnKVKqXf\n46IWk4ZFbSxTo0YNLx46dKiqKV++vBc7p/e8WL9+vcr95Cc/8eKCgoIie0w23oABADDAAAYAwAAD\nGAAAAwxgAAAMsAgrhWbPnq1yrVq1Ssq99uzZo3IDBgxQueXLl3vxkSNHktIPvt2nn35aZE1hYWEK\nOime8KKZ559/XtVELcgJLyjbvHlzYhtDQoRPYhMR+e1vf+vF+fn5qqZ3795J6ym8KDVqkWq9evVU\nrkWLFl68ePHixDYWB96AAQAwwAAGAMAAAxgAAAN8A06Q8HeuF198UdU0a9ZM5fLy8op9r3379qnc\nnDlzirz/mjVrin0vpMY111xj3UJcrrvuOi+O+t67aNEilfv888+T1hPi16NHDy/+9a9/rWquvfba\nVLUTtxMnTqhcOq5v4Q0YAAADDGAAAAwwgAEAMMAABgDAAIuw4tC/f3+VGzx4sBc3bdo0Yfd75pln\nvHjatGmqJpaNHJC+atWqpXJRp7ykm6i+w6ZPn65yZ8+eTUY7KIaePXuq3AsvvODF4ZOHLsahQ4e8\n+O9//7uquemmm4p9/1OnTqlc1ClKK1euLPJaqcYbMAAABhjAAAAYYAADAGCAb8AxGDVqlBePHDlS\n1ZQpk5i/lFHf/TZs2ODFfO8t+a666iov7tq1q6p55513vPjLL79Mak/xaN++vRcfOHBA1URtxAF7\n4XUrIvF98127dq3KhdetiOhvvlHfblesWFFkPx9//LEX9+3bV9Vs3Lgxutk0wxswAAAGGMAAABhg\nAAMAYIABDACAgaxfhBU+jWjhwoWqpkmTJl6cqAVXUYIgULmJEyd68Z133qlqwgsRdu/endjGkFBt\n2rTx4pycHFUzbtw4Ly4sLExqT0WpUqWKyjVs2NCLz507p2qiTqaBvUceeUTl5s2b58W7du1SNcuW\nLfPi8CJVEZGjR4+qXPXq1b149OjRqqZGjRpevG7dOlXTtm1bLz548KCqKSl4AwYAwAADGAAAAwxg\nAAAMZP034NKlS3vxjTfeaNTJheXn53txy5YtVc2vfvUrL3700UeT2hNiF7W5yu233+7Fe/fuVTUf\nffSRF0d9J47lwIaogw/iOQzh8OHDKrd582YvLigoKPZ1YSPqMITatWt7cdQ3/dOnT8d1vz59+nhx\n1EYgYUuWLFG5kvzNN4w3YAAADDCAAQAwwAAGAMAAAxgAAANZvwjr2Wef9eJYFrXEIuo6UZtshD33\n3HMq16NHDy+uVKmSqnn44YeLvM6OHTuKvD8S7/rrr1e5Fi1aePG+fftUTXijggcffFDVxHJ6zZw5\nc1QuvHHL8ePHi7xOeDGgiMgPfvADL54+fXqR10H6OnnyZEKuE7VZUCyLrsKbfPzmN79JSD/pijdg\nAAAMMIABADDAAAYAwAADGAAAA1m1CKtx48Yq1759ey+OZaFUlG3btnnxzp07VU34VCMRkS1btnjx\n/v37VU345JxLL71U1YTvF+9uNUi8rl27FllTuXJllUvUApQuXbqo3OrVq704vNBPRGTDhg1e3K9f\nP1VTs2bNi+wOJV3U6XBRz1N4wd6xY8dUzaBBg7w400/S4g0YAAADDGAAAAwwgAEAMJBV34CHDh2q\nchUqVCj2daK+73bq1MmLP/3002JfV0Rk1apVKhf+dhL1nXratGlevGfPnrjuDxuFhYUqt3TpUi+e\nO3euqglvfFGqlP536ldffVXlOnTo4MWffPKJqpkwYYIXR32nDgv3jMwTfsYee+wxVXPbbbcVeZ2Z\nM2eq3NatW+NvrATiDRgAAAMMYAAADDCAAQAwwAAGAMCAi3fjibhu5lzqbhZh3bp1KvfjH/+42Ne5\n9dZbVW7RokVx9dSuXTsvXrhwoaoJ/z06fPiwqok6ISndBEGQmKOmisn6uYvaAGb48OFe/NFHH6ma\nKVOmpKynMWPGqJqOHTsW+7pRpzpVrVq12NdJJIvnzvqZS6ayZct6cawnKK1fv96Lb7nlFlVz5MiR\n+BtLI7E+c7wBAwBggAEMAIABBjAAAAYydiOOvn37qlzdunXjutbkyZO9eNmyZXFdZ/bs2SrXqlWr\nYl8nvEk+0tvatWtVrnfv3gad/Fe4p86dO6ua8HN+4403qprwxjFR10FmqV+/flw/F/6+mynfey8G\nb8AAABhgAAMAYIABDACAAQYwAAAGMnYRVvny5VUuJycnrmtNmjTJiwsKClRNrVq1vPinP/2pqmnW\nrJnK5eXlebFz+s9vhxdd9erV68LNAnHIzc1VuYoVK3px1IYLv/jFL7x49+7diW0MaWf06NFF1hw4\ncEDl7r///mS0U6LxBgwAgAEGMAAABhjAAAAYyNhvwIn00EMPeXGpUvrfW+65556E3CvqcIyDBw96\n8a5duxJyL+Abb731lsrVq1fPix999FFVE7XJCDLHsGHDVC7qMJqwHTt2qNyaNWsS0lMm4Q0YAAAD\nDGAAAAwwgAEAMMAABgDAgIta9JO0mzmXsptFnTI0a9YslatQoUIq2onZ5s2bVa5jx45F1pQEQRDo\nXUZSIJXPXUlRs2ZNL962bZuqWbFihRe3bNlS1URtSpNuLJ67kvrMhTcw2rhxo6qpUaNGkdcZMGCA\nyr3yyivxN1bCxPrM8QYMAIABBjAAAAYYwAAAGGAAAwBgIGN3wlqyZInKvffeeyrXokULLw6fAJNI\np06dUrlx48Z58RtvvKFqtmzZkrSekJ06derkxaVLl1Y1EyZM8OKSsOAKF2fQoEFeHMuCq8OHD6vc\n+++/n7CeMhlvwAAAGGAAAwBggAEMAICBjP0GHKVbt24q9+qrr3pxr1694rr23Llzvfjdd99VNQcO\nHFC5qM1BgETKy8tTufApNydPnlQ1USfaILP169ev2D8TtcFG1MYu0HgDBgDAAAMYAAADDGAAAAww\ngAEAMJCxpyEh/XAako3c3FyVe/nll704agOYqFxJxGlI0apVq6Zyy5cv9+LatWurmsLCQi+uVauW\nqvn6668vsruSjdOQAABIYwxgAAAMMIABADDAN2CkDN+AYYFvwNHatWuncgsWLCjy586cOePF5cqV\nS1hPmYJvwAAApDEGMAAABhjAAAAYYAADAGAgq05DAgCc17Rp07h+rnfv3gnuJHvxBgwAgAEGMAAA\nBhjAAAAYYCMOpAwbccACG3Eg1diIAwCANMYABgDAAAMYAAADDGAAAAykdBEWAAA4jzdgAAAMMIAB\nADDAAAYAwAADGAAAAwxgAAAMMIABADDAAAYAwAADGAAAAwxgAAAMMIABADDAAAYAwAADGAAAAwxg\nAAAMMIABADDAAAYAwAADGAAAAwxgAAAMMIABADDAAAYAwAADGAAAAwxgAAAMMIABADDAAAYAwMD/\nA57vAEYKKvWAAAAAAElFTkSuQmCC\n",
      "text/plain": [
       "<matplotlib.figure.Figure at 0x1765e2f0c18>"
      ]
     },
     "metadata": {},
     "output_type": "display_data"
    }
   ],
   "source": [
    "# 儲存增強的圖像數據　(Saving Augmented Images to File)\n",
    "from keras.datasets import mnist\n",
    "from keras.preprocessing.image import ImageDataGenerator\n",
    "import matplotlib.pyplot as plt\n",
    "import os\n",
    "\n",
    "# 載入數據\n",
    "(X_train, y_train), (X_test, y_test) = mnist.load_data()\n",
    "\n",
    "# 將圖像數據集的維度進行改變 \n",
    "# 改變前: [樣本數, 圖像寬, 圖像高] -> 改變後: [樣本數, 圖像寬, 圖像高, 圖像頻道數]\n",
    "X_train = X_train.reshape(X_train.shape[0], 28, 28, 1)\n",
    "X_test  = X_test.reshape(X_test.shape[0], 28, 28, 1)\n",
    "\n",
    "# 將像素值由\"整數(0~255)\"換成\"浮點數(0.0~255.0)\"\n",
    "X_train = X_train.astype('float32')\n",
    "X_test = X_test.astype('float32')\n",
    "\n",
    "# 定義\"圖像數據增強產生器(ImageDataGenerator)\"的參數\n",
    "datagen = ImageDataGenerator()\n",
    "\n",
    "# 透過訓練數據集來訓練(fit)圖像數據增強產生器(ImageDataGenerator)的實例\n",
    "datagen.fit(X_train)\n",
    "\n",
    "# 產生要保存圖像檔案的目錄\n",
    "if not os.path.exists('images'):\n",
    "    os.makedirs('images')\n",
    "    \n",
    "# 設定要\"圖像數據增強產生器(ImageDataGenerator)\"產生的圖像批次值(batch size)\n",
    "# \"圖像數據增強產生器(ImageDataGenerator)\"會根據設定回傳指定批次量的新生成圖像數據\n",
    "for X_batch, y_batch in datagen.flow(X_train, y_train, batch_size=9, save_to_dir='images', save_prefix='aug', save_format='png'):\n",
    "    plt.figure(figsize=(8,8)) # 設定每個圖像顯示的大小\n",
    "    # 產生一個3x3網格的組合圖像\n",
    "    for i in range(0, 6):\n",
    "        plt.subplot(331+i)\n",
    "        plt.title(y_batch[i]) # 秀出圖像的真實值\n",
    "        plt.axis('off')     #不顯示坐標\n",
    "        plt.imshow(X_batch[i].reshape(28,28), cmap=plt.get_cmap('gray'))\n",
    "        \n",
    "    plt.show()\n",
    "    break # 跳出迴圈"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "運行範例，您可以看到只有在圖像生成時才會也把寫入圖像寫到檔案系統中。"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 用Keras增強圖像數據的技巧"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "圖像數據很獨特，因為您可以查看數據和數據的轉換副本，並快速了解模型如何通過您的圖像感知到某種影像特徵。\n",
    "\n",
    "\n",
    "以下是從圖像數據準備和增強深度學習中獲得最多的一些時間。\n",
    "\n",
    "* **查看圖像數據集** 花一些時間仔細檢查你的數據集。看圖像。注意可能有利於模型訓練過程的圖像準備和增強，例如需要處理場景中不同的輪班，旋轉或翻轉對象。\n",
    "* **查看增強過的圖像** 增強操作完成後，查看一些範例圖像。理智地知道你正在使用什麼樣的圖像變換是一回事，真正看到範例圖像是非常不同的事情。查看您正在使用的單個增強圖像以及您計劃使用的全套增強圖像。您可能會看到簡化或進一步增強您的模型訓練的方法。\n",
    "* **評估一整套變換** 嘗試多個圖像數據準備和增強方案。通常情況下，您認為這樣做不會有好處的轉換, 最後您可能會對數據增強後對模型的結果感到驚訝。"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## 總結\n",
    "在這篇文章中，您瞭解了圖像數據準備和增強的一些面向。\n",
    "\n",
    "您發現了一系列可以輕鬆使用Keras來使用圖像數據增強(data augmentation)應用在深度學習模型的技術。您了解到：\n",
    "* Keras中的ImageDataGenerator API可以用來動態產生新的轉換後的圖像來用於訓練。\n",
    "* 圖像像素的標準化手法。\n",
    "* ZCA白化轉換。\n",
    "* 對圖像進行隨機旋轉，移動和翻轉。\n",
    "* 如何將轉換後的圖像保存到檔案系統中以備後用。"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {
    "collapsed": true
   },
   "source": [
    "參考:\n",
    "* [Keras官網](http://keras.io/)\n",
    "* [Image Augmentation for Deep Learning With Keras](https://machinelearningmastery.com/image-augmentation-deep-learning-keras/)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": null,
   "metadata": {
    "collapsed": true
   },
   "outputs": [],
   "source": []
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "Python 3",
   "language": "python",
   "name": "python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.5.4"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 2
}