{ "cells": [ { "cell_type": "markdown", "metadata": { "id": "Td_EDk49y8wt" }, "source": [ "# 머신 러닝 교과서 3판" ] }, { "cell_type": "markdown", "metadata": { "id": "8vj8Oyxiy8w0" }, "source": [ "# 14장 - 텐서플로의 구조 자세히 알아보기 (2/3)" ] }, { "cell_type": "markdown", "metadata": { "id": "9SUdqsLFy8w0" }, "source": [ "**아래 링크를 통해 이 노트북을 주피터 노트북 뷰어(nbviewer.jupyter.org)로 보거나 구글 코랩(colab.research.google.com)에서 실행할 수 있습니다.**\n", "\n", "\n", " \n", " \n", "
\n", " 주피터 노트북 뷰어로 보기\n", " \n", " 구글 코랩(Colab)에서 실행하기\n", "
" ] }, { "cell_type": "markdown", "metadata": { "id": "sZOZo9xwy8w0" }, "source": [ "### 목차" ] }, { "cell_type": "markdown", "metadata": { "id": "I76d0TZxy8w1" }, "source": [ "- 텐서플로 추정기\n", " - 특성 열 사용하기\n", " - 사전에 준비된 추정기로 머신 러닝 수행하기" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "id": "CsQvsr58y8w1" }, "outputs": [], "source": [ "import numpy as np\n", "import tensorflow as tf\n", "import pandas as pd\n", "\n", "from IPython.display import Image" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 36 }, "id": "jCgZBvoRzZsB", "outputId": "73ff7323-aa03-4d8d-c886-60e4e1525fbf" }, "outputs": [ { "output_type": "execute_result", "data": { "text/plain": [ "'2.8.2'" ], "application/vnd.google.colaboratory.intrinsic+json": { "type": "string" } }, "metadata": {}, "execution_count": 2 } ], "source": [ "tf.__version__" ] }, { "cell_type": "markdown", "metadata": { "id": "kZAANkUJy8w1" }, "source": [ "## 텐서플로 추정기\n", "\n", "##### 사전에 준비된 추정기 사용하는 단계\n", "\n", " * **단계 1:** 데이터 로딩을 위해 입력 함수 정의하기\n", " * **단계 2:** 추정기와 데이터 사이를 연결하기 위해 특성 열 정의하기\n", " * **단계 3:** 추정기 객체를 만들거나 케라스 모델을 추정기로 바꾸기\n", " * **단계 4:** 추정기 사용하기: train() evaluate() predict()" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "id": "csAr00GCy8w2" }, "outputs": [], "source": [ "tf.random.set_seed(1)\n", "np.random.seed(1)" ] }, { "cell_type": "markdown", "metadata": { "id": "nOFiP8O9y8w2" }, "source": [ "### 특성 열 사용하기\n", "\n", "\n", " * 정의: https://developers.google.com/machine-learning/glossary/#feature_columns\n", " * 문서: https://www.tensorflow.org/api_docs/python/tf/feature_column" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 398 }, "id": "bJbH-xauy8w2", "outputId": "e51530f6-03eb-4667-c2e0-20dac7166902" }, "outputs": [ { "output_type": "execute_result", "data": { "text/plain": [ "" ], "text/html": [ "" ] }, "metadata": {}, "execution_count": 4 } ], "source": [ "Image(url='https://git.io/JL56E', width=700)" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 260 }, "id": "YRGME3Lqy8w3", "outputId": "ea23ad95-7478-4e89-8e54-e0ed316c6bb8" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "Downloading data from http://archive.ics.uci.edu/ml/machine-learning-databases/auto-mpg/auto-mpg.data\n", "32768/30286 [================================] - 0s 5us/step\n", "40960/30286 [========================================] - 0s 4us/step\n" ] }, { "output_type": "execute_result", "data": { "text/plain": [ " MPG Cylinders Displacement Horsepower Weight Acceleration \\\n", "393 27.0 4 140.0 86.0 2790.0 15.6 \n", "394 44.0 4 97.0 52.0 2130.0 24.6 \n", "395 32.0 4 135.0 84.0 2295.0 11.6 \n", "396 28.0 4 120.0 79.0 2625.0 18.6 \n", "397 31.0 4 119.0 82.0 2720.0 19.4 \n", "\n", " ModelYear Origin \n", "393 82 1 \n", "394 82 2 \n", "395 82 1 \n", "396 82 1 \n", "397 82 1 " ], "text/html": [ "\n", "
\n", "
\n", "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
MPGCylindersDisplacementHorsepowerWeightAccelerationModelYearOrigin
39327.04140.086.02790.015.6821
39444.0497.052.02130.024.6822
39532.04135.084.02295.011.6821
39628.04120.079.02625.018.6821
39731.04119.082.02720.019.4821
\n", "
\n", " \n", " \n", " \n", "\n", " \n", "
\n", "
\n", " " ] }, "metadata": {}, "execution_count": 5 } ], "source": [ "dataset_path = tf.keras.utils.get_file(\n", " origin=\"https://archive.ics.uci.edu/static/public/9/auto+mpg.zip\",\n", " extract=True)\n", "dataset_path = dataset_path.replace('auto+mpg.zip', 'auto-mpg.data')\n", "\n", "column_names = ['MPG', 'Cylinders', 'Displacement', 'Horsepower',\n", " 'Weight', 'Acceleration', 'ModelYear', 'Origin']\n", "\n", "df = pd.read_csv(dataset_path, names=column_names,\n", " na_values = \"?\", comment='\\t',\n", " sep=\" \", skipinitialspace=True)\n", "\n", "df.tail()" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 366 }, "id": "lRR0q4Eky8w3", "outputId": "bf33598e-84dc-4805-8c01-427a5cdc34fd" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "MPG 0\n", "Cylinders 0\n", "Displacement 0\n", "Horsepower 6\n", "Weight 0\n", "Acceleration 0\n", "ModelYear 0\n", "Origin 0\n", "dtype: int64\n" ] }, { "output_type": "execute_result", "data": { "text/plain": [ " MPG Cylinders Displacement Horsepower Weight Acceleration \\\n", "387 27.0 4 140.0 86.0 2790.0 15.6 \n", "388 44.0 4 97.0 52.0 2130.0 24.6 \n", "389 32.0 4 135.0 84.0 2295.0 11.6 \n", "390 28.0 4 120.0 79.0 2625.0 18.6 \n", "391 31.0 4 119.0 82.0 2720.0 19.4 \n", "\n", " ModelYear Origin \n", "387 82 1 \n", "388 82 2 \n", "389 82 1 \n", "390 82 1 \n", "391 82 1 " ], "text/html": [ "\n", "
\n", "
\n", "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
MPGCylindersDisplacementHorsepowerWeightAccelerationModelYearOrigin
38727.04140.086.02790.015.6821
38844.0497.052.02130.024.6822
38932.04135.084.02295.011.6821
39028.04120.079.02625.018.6821
39131.04119.082.02720.019.4821
\n", "
\n", " \n", " \n", " \n", "\n", " \n", "
\n", "
\n", " " ] }, "metadata": {}, "execution_count": 6 } ], "source": [ "print(df.isna().sum())\n", "\n", "df = df.dropna()\n", "df = df.reset_index(drop=True)\n", "df.tail()" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 300 }, "id": "VBr_cK0dy8w4", "outputId": "ac21c79d-fb88-45e7-c9d7-ed2a8cd4cd9d" }, "outputs": [ { "output_type": "execute_result", "data": { "text/plain": [ " count mean std min 25% 50% 75% \\\n", "MPG 313.0 23.404153 7.666909 9.0 17.5 23.0 29.0 \n", "Cylinders 313.0 5.402556 1.701506 3.0 4.0 4.0 8.0 \n", "Displacement 313.0 189.512780 102.675646 68.0 104.0 140.0 260.0 \n", "Horsepower 313.0 102.929712 37.919046 46.0 75.0 92.0 120.0 \n", "Weight 313.0 2961.198083 848.602146 1613.0 2219.0 2755.0 3574.0 \n", "Acceleration 313.0 15.704473 2.725399 8.5 14.0 15.5 17.3 \n", "ModelYear 313.0 75.929712 3.675305 70.0 73.0 76.0 79.0 \n", "Origin 313.0 1.591054 0.807923 1.0 1.0 1.0 2.0 \n", "\n", " max \n", "MPG 46.6 \n", "Cylinders 8.0 \n", "Displacement 455.0 \n", "Horsepower 230.0 \n", "Weight 5140.0 \n", "Acceleration 24.8 \n", "ModelYear 82.0 \n", "Origin 3.0 " ], "text/html": [ "\n", "
\n", "
\n", "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
countmeanstdmin25%50%75%max
MPG313.023.4041537.6669099.017.523.029.046.6
Cylinders313.05.4025561.7015063.04.04.08.08.0
Displacement313.0189.512780102.67564668.0104.0140.0260.0455.0
Horsepower313.0102.92971237.91904646.075.092.0120.0230.0
Weight313.02961.198083848.6021461613.02219.02755.03574.05140.0
Acceleration313.015.7044732.7253998.514.015.517.324.8
ModelYear313.075.9297123.67530570.073.076.079.082.0
Origin313.01.5910540.8079231.01.01.02.03.0
\n", "
\n", " \n", " \n", " \n", "\n", " \n", "
\n", "
\n", " " ] }, "metadata": {}, "execution_count": 7 } ], "source": [ "import sklearn\n", "import sklearn.model_selection\n", "\n", "\n", "df_train, df_test = sklearn.model_selection.train_test_split(df, train_size=0.8)\n", "train_stats = df_train.describe().transpose()\n", "train_stats" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/", "height": 206 }, "id": "0Xit7Hj4y8w4", "outputId": "df1f3926-5ea6-445c-c8ef-b943c5a771c4" }, "outputs": [ { "output_type": "execute_result", "data": { "text/plain": [ " MPG Cylinders Displacement Horsepower Weight Acceleration \\\n", "203 28.0 -0.824303 -0.901020 -0.736562 -0.950031 0.255202 \n", "255 19.4 0.351127 0.413800 -0.340982 0.293190 0.548737 \n", "72 13.0 1.526556 1.144256 0.713897 1.339617 -0.625403 \n", "235 30.5 -0.824303 -0.891280 -1.053025 -1.072585 0.475353 \n", "37 14.0 1.526556 1.563051 1.636916 1.470420 -1.359240 \n", "\n", " ModelYear Origin \n", "203 76 3 \n", "255 78 1 \n", "72 72 1 \n", "235 77 1 \n", "37 71 1 " ], "text/html": [ "\n", "
\n", "
\n", "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
MPGCylindersDisplacementHorsepowerWeightAccelerationModelYearOrigin
20328.0-0.824303-0.901020-0.736562-0.9500310.255202763
25519.40.3511270.413800-0.3409820.2931900.548737781
7213.01.5265561.1442560.7138971.339617-0.625403721
23530.5-0.824303-0.891280-1.053025-1.0725850.475353771
3714.01.5265561.5630511.6369161.470420-1.359240711
\n", "
\n", " \n", " \n", " \n", "\n", " \n", "
\n", "
\n", " " ] }, "metadata": {}, "execution_count": 8 } ], "source": [ "numeric_column_names = ['Cylinders', 'Displacement', 'Horsepower', 'Weight', 'Acceleration']\n", "\n", "df_train_norm, df_test_norm = df_train.copy(), df_test.copy()\n", "\n", "for col_name in numeric_column_names:\n", " mean = train_stats.loc[col_name, 'mean']\n", " std = train_stats.loc[col_name, 'std']\n", " df_train_norm.loc[:, col_name] = (df_train_norm.loc[:, col_name] - mean)/std\n", " df_test_norm.loc[:, col_name] = (df_test_norm.loc[:, col_name] - mean)/std\n", "\n", "df_train_norm.tail()" ] }, { "cell_type": "markdown", "metadata": { "id": "gsn1sbM5y8w4" }, "source": [ "#### 수치형 열" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "jyFdfmKFy8w5", "outputId": "bfdd5dbf-ebaf-46b4-c713-a92dd3381cc9" }, "outputs": [ { "output_type": "execute_result", "data": { "text/plain": [ "[NumericColumn(key='Cylinders', shape=(1,), default_value=None, dtype=tf.float32, normalizer_fn=None),\n", " NumericColumn(key='Displacement', shape=(1,), default_value=None, dtype=tf.float32, normalizer_fn=None),\n", " NumericColumn(key='Horsepower', shape=(1,), default_value=None, dtype=tf.float32, normalizer_fn=None),\n", " NumericColumn(key='Weight', shape=(1,), default_value=None, dtype=tf.float32, normalizer_fn=None),\n", " NumericColumn(key='Acceleration', shape=(1,), default_value=None, dtype=tf.float32, normalizer_fn=None)]" ] }, "metadata": {}, "execution_count": 9 } ], "source": [ "numeric_features = []\n", "\n", "for col_name in numeric_column_names:\n", " numeric_features.append(tf.feature_column.numeric_column(key=col_name))\n", "\n", "numeric_features" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "OtZQ-fNHy8w5", "outputId": "d11c58b8-c7bc-4bb0-dd1e-3b268a9261cb" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "[BucketizedColumn(source_column=NumericColumn(key='ModelYear', shape=(1,), default_value=None, dtype=tf.float32, normalizer_fn=None), boundaries=(73, 76, 79))]\n" ] } ], "source": [ "feature_year = tf.feature_column.numeric_column(key=\"ModelYear\")\n", "\n", "bucketized_features = []\n", "\n", "bucketized_features.append(tf.feature_column.bucketized_column(\n", " source_column=feature_year,\n", " boundaries=[73, 76, 79]))\n", "\n", "print(bucketized_features)" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "V1OIxbvmy8w6", "outputId": "2aa99c0d-5c23-44c6-b244-eb2ee31905c9" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "[IndicatorColumn(categorical_column=VocabularyListCategoricalColumn(key='Origin', vocabulary_list=(1, 2, 3), dtype=tf.int64, default_value=-1, num_oov_buckets=0))]\n" ] } ], "source": [ "feature_origin = tf.feature_column.categorical_column_with_vocabulary_list(\n", " key='Origin',\n", " vocabulary_list=[1, 2, 3])\n", "\n", "categorical_indicator_features = []\n", "categorical_indicator_features.append(tf.feature_column.indicator_column(feature_origin))\n", "\n", "print(categorical_indicator_features)" ] }, { "cell_type": "markdown", "metadata": { "id": "LM8nvPgJy8w6" }, "source": [ "### 사전에 준비된 추정기로 머신러닝 수행하기" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "e5TtiGv6y8w7", "outputId": "b1b3fa2f-31a2-4ff1-d872-13b66e8ef8e5" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "키: dict_keys(['Cylinders', 'Displacement', 'Horsepower', 'Weight', 'Acceleration', 'ModelYear', 'Origin'])\n", "ModelYear: tf.Tensor([82 78 76 72 78 73 70 78], shape=(8,), dtype=int64)\n" ] } ], "source": [ "def train_input_fn(df_train, batch_size=8):\n", " df = df_train.copy()\n", " train_x, train_y = df, df.pop('MPG')\n", " dataset = tf.data.Dataset.from_tensor_slices((dict(train_x), train_y))\n", "\n", " # 셔플, 반복, 배치\n", " return dataset.shuffle(1000).repeat().batch(batch_size)\n", "\n", "## 조사\n", "ds = train_input_fn(df_train_norm)\n", "batch = next(iter(ds))\n", "print('키:', batch[0].keys())\n", "print('ModelYear:', batch[0]['ModelYear'])" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "E0EbaOx2y8w7", "outputId": "5b7a2762-9903-48b3-d88b-b90a72a6220a" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "[NumericColumn(key='Cylinders', shape=(1,), default_value=None, dtype=tf.float32, normalizer_fn=None), NumericColumn(key='Displacement', shape=(1,), default_value=None, dtype=tf.float32, normalizer_fn=None), NumericColumn(key='Horsepower', shape=(1,), default_value=None, dtype=tf.float32, normalizer_fn=None), NumericColumn(key='Weight', shape=(1,), default_value=None, dtype=tf.float32, normalizer_fn=None), NumericColumn(key='Acceleration', shape=(1,), default_value=None, dtype=tf.float32, normalizer_fn=None), BucketizedColumn(source_column=NumericColumn(key='ModelYear', shape=(1,), default_value=None, dtype=tf.float32, normalizer_fn=None), boundaries=(73, 76, 79)), IndicatorColumn(categorical_column=VocabularyListCategoricalColumn(key='Origin', vocabulary_list=(1, 2, 3), dtype=tf.int64, default_value=-1, num_oov_buckets=0))]\n" ] } ], "source": [ "all_feature_columns = (numeric_features +\n", " bucketized_features +\n", " categorical_indicator_features)\n", "\n", "print(all_feature_columns)" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "2tSgfsKHy8w7", "outputId": "985307d9-5d7b-4329-cad6-6a8fbfee607a" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "INFO:tensorflow:Using default config.\n", "INFO:tensorflow:Using config: {'_model_dir': 'models/autompg-dnnregressor/', '_tf_random_seed': None, '_save_summary_steps': 100, '_save_checkpoints_steps': None, '_save_checkpoints_secs': 600, '_session_config': allow_soft_placement: true\n", "graph_options {\n", " rewrite_options {\n", " meta_optimizer_iterations: ONE\n", " }\n", "}\n", ", '_keep_checkpoint_max': 5, '_keep_checkpoint_every_n_hours': 10000, '_log_step_count_steps': 100, '_train_distribute': None, '_device_fn': None, '_protocol': None, '_eval_distribute': None, '_experimental_distribute': None, '_experimental_max_worker_delay_secs': None, '_session_creation_timeout_secs': 7200, '_checkpoint_save_graph_def': True, '_service': None, '_cluster_spec': ClusterSpec({}), '_task_type': 'worker', '_task_id': 0, '_global_id_in_cluster': 0, '_master': '', '_evaluation_master': '', '_is_chief': True, '_num_ps_replicas': 0, '_num_worker_replicas': 1}\n" ] } ], "source": [ "regressor = tf.estimator.DNNRegressor(\n", " feature_columns=all_feature_columns,\n", " hidden_units=[32, 10],\n", " model_dir='models/autompg-dnnregressor/')" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "sESlS5e5y8w7", "outputId": "b5a82c09-14ee-4186-9dc8-be736ef8181a", "scrolled": false }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "훈련 스텝: 40000\n", "WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/tensorflow/python/training/training_util.py:397: Variable.initialized_value (from tensorflow.python.ops.variables) is deprecated and will be removed in a future version.\n", "Instructions for updating:\n", "Use Variable.read_value. Variables in 2.X are initialized automatically both in eager and graph (inside tf.defun) contexts.\n", "INFO:tensorflow:Calling model_fn.\n", "WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/keras/optimizer_v2/adagrad.py:84: calling Constant.__init__ (from tensorflow.python.ops.init_ops) with dtype is deprecated and will be removed in a future version.\n", "Instructions for updating:\n", "Call initializer instance with the dtype argument instead of passing it to the constructor\n", "INFO:tensorflow:Done calling model_fn.\n", "INFO:tensorflow:Create CheckpointSaverHook.\n", "INFO:tensorflow:Graph was finalized.\n", "INFO:tensorflow:Running local_init_op.\n", "INFO:tensorflow:Done running local_init_op.\n", "INFO:tensorflow:Calling checkpoint listeners before saving checkpoint 0...\n", "INFO:tensorflow:Saving checkpoints for 0 into models/autompg-dnnregressor/model.ckpt.\n", "INFO:tensorflow:Calling checkpoint listeners after saving checkpoint 0...\n", "INFO:tensorflow:loss = 616.7173, step = 0\n", "WARNING:tensorflow:It seems that global step (tf.train.get_global_step) has not been increased. Current value (could be stable): 53 vs previous value: 53. You could increase the global step by passing tf.train.get_global_step() to Optimizer.apply_gradients or Optimizer.minimize.\n", "WARNING:tensorflow:It seems that global step (tf.train.get_global_step) has not been increased. Current value (could be stable): 75 vs previous value: 75. You could increase the global step by passing tf.train.get_global_step() to Optimizer.apply_gradients or Optimizer.minimize.\n", "INFO:tensorflow:global_step/sec: 239.979\n", "INFO:tensorflow:loss = 445.9389, step = 100 (0.424 sec)\n", "INFO:tensorflow:global_step/sec: 287.157\n", "INFO:tensorflow:loss = 590.6575, step = 200 (0.347 sec)\n", "WARNING:tensorflow:It seems that global step (tf.train.get_global_step) has not been increased. Current value (could be stable): 210 vs previous value: 210. You could increase the global step by passing tf.train.get_global_step() to Optimizer.apply_gradients or Optimizer.minimize.\n", "INFO:tensorflow:global_step/sec: 238.528\n", "INFO:tensorflow:loss = 655.11475, step = 300 (0.418 sec)\n", "INFO:tensorflow:global_step/sec: 287.884\n", "INFO:tensorflow:loss = 586.1028, step = 400 (0.349 sec)\n", "INFO:tensorflow:global_step/sec: 247.252\n", "INFO:tensorflow:loss = 501.3753, step = 500 (0.406 sec)\n", "INFO:tensorflow:global_step/sec: 271.98\n", "INFO:tensorflow:loss = 669.2413, step = 600 (0.364 sec)\n", "INFO:tensorflow:global_step/sec: 230.799\n", "INFO:tensorflow:loss = 831.84, step = 700 (0.431 sec)\n", "INFO:tensorflow:global_step/sec: 270.836\n", "INFO:tensorflow:loss = 441.08755, step = 800 (0.370 sec)\n", "INFO:tensorflow:global_step/sec: 235.588\n", "INFO:tensorflow:loss = 390.67947, step = 900 (0.425 sec)\n", "INFO:tensorflow:global_step/sec: 274.14\n", "INFO:tensorflow:loss = 558.16125, step = 1000 (0.367 sec)\n", "INFO:tensorflow:global_step/sec: 215.508\n", "INFO:tensorflow:loss = 300.93704, step = 1100 (0.465 sec)\n", "INFO:tensorflow:global_step/sec: 275.015\n", "INFO:tensorflow:loss = 532.7837, step = 1200 (0.363 sec)\n", "INFO:tensorflow:global_step/sec: 271.048\n", "INFO:tensorflow:loss = 599.0055, step = 1300 (0.370 sec)\n", "WARNING:tensorflow:It seems that global step (tf.train.get_global_step) has not been increased. Current value (could be stable): 1320 vs previous value: 1320. You could increase the global step by passing tf.train.get_global_step() to Optimizer.apply_gradients or Optimizer.minimize.\n", "INFO:tensorflow:global_step/sec: 275.457\n", "INFO:tensorflow:loss = 377.85394, step = 1400 (0.364 sec)\n", "INFO:tensorflow:global_step/sec: 237.143\n", "INFO:tensorflow:loss = 368.85147, step = 1500 (0.417 sec)\n", "INFO:tensorflow:global_step/sec: 221.685\n", "INFO:tensorflow:loss = 502.51175, step = 1600 (0.453 sec)\n", "INFO:tensorflow:global_step/sec: 269.232\n", "INFO:tensorflow:loss = 580.99756, step = 1700 (0.368 sec)\n", "WARNING:tensorflow:It seems that global step (tf.train.get_global_step) has not been increased. Current value (could be stable): 1740 vs previous value: 1740. You could increase the global step by passing tf.train.get_global_step() to Optimizer.apply_gradients or Optimizer.minimize.\n", "INFO:tensorflow:global_step/sec: 252.123\n", "INFO:tensorflow:loss = 578.44696, step = 1800 (0.401 sec)\n", "INFO:tensorflow:global_step/sec: 242.827\n", "INFO:tensorflow:loss = 541.79407, step = 1900 (0.413 sec)\n", "INFO:tensorflow:global_step/sec: 310.088\n", "INFO:tensorflow:loss = 261.43768, step = 2000 (0.322 sec)\n", "INFO:tensorflow:global_step/sec: 279.543\n", "INFO:tensorflow:loss = 597.9768, step = 2100 (0.357 sec)\n", "INFO:tensorflow:global_step/sec: 303.641\n", "INFO:tensorflow:loss = 513.1537, step = 2200 (0.329 sec)\n", "INFO:tensorflow:global_step/sec: 231.546\n", "INFO:tensorflow:loss = 428.7917, step = 2300 (0.430 sec)\n", "INFO:tensorflow:global_step/sec: 216.908\n", "INFO:tensorflow:loss = 338.6472, step = 2400 (0.461 sec)\n", "INFO:tensorflow:global_step/sec: 250.638\n", "INFO:tensorflow:loss = 610.71643, step = 2500 (0.402 sec)\n", "INFO:tensorflow:global_step/sec: 244.38\n", "INFO:tensorflow:loss = 367.79074, step = 2600 (0.410 sec)\n", "INFO:tensorflow:global_step/sec: 275.359\n", "INFO:tensorflow:loss = 651.73303, step = 2700 (0.358 sec)\n", "INFO:tensorflow:global_step/sec: 302.533\n", "INFO:tensorflow:loss = 610.9225, step = 2800 (0.335 sec)\n", "INFO:tensorflow:global_step/sec: 291.434\n", "INFO:tensorflow:loss = 476.7032, step = 2900 (0.343 sec)\n", "INFO:tensorflow:global_step/sec: 266.644\n", "INFO:tensorflow:loss = 490.3686, step = 3000 (0.372 sec)\n", "INFO:tensorflow:global_step/sec: 278.97\n", "INFO:tensorflow:loss = 228.54947, step = 3100 (0.359 sec)\n", "INFO:tensorflow:global_step/sec: 260.075\n", "INFO:tensorflow:loss = 587.274, step = 3200 (0.387 sec)\n", "INFO:tensorflow:global_step/sec: 275.909\n", "INFO:tensorflow:loss = 322.59427, step = 3300 (0.359 sec)\n", "INFO:tensorflow:global_step/sec: 302.973\n", "INFO:tensorflow:loss = 158.60677, step = 3400 (0.336 sec)\n", "INFO:tensorflow:global_step/sec: 282.204\n", "INFO:tensorflow:loss = 309.1047, step = 3500 (0.354 sec)\n", "INFO:tensorflow:global_step/sec: 226.166\n", "INFO:tensorflow:loss = 324.4612, step = 3600 (0.443 sec)\n", "INFO:tensorflow:global_step/sec: 256.246\n", "INFO:tensorflow:loss = 368.90317, step = 3700 (0.394 sec)\n", "INFO:tensorflow:global_step/sec: 257.339\n", "INFO:tensorflow:loss = 352.03497, step = 3800 (0.385 sec)\n", "INFO:tensorflow:global_step/sec: 325.025\n", "INFO:tensorflow:loss = 464.93195, step = 3900 (0.302 sec)\n", "INFO:tensorflow:global_step/sec: 261.861\n", "INFO:tensorflow:loss = 465.94193, step = 4000 (0.387 sec)\n", "INFO:tensorflow:global_step/sec: 314.667\n", "INFO:tensorflow:loss = 237.93906, step = 4100 (0.317 sec)\n", "INFO:tensorflow:global_step/sec: 283.091\n", "INFO:tensorflow:loss = 280.3776, step = 4200 (0.359 sec)\n", "INFO:tensorflow:global_step/sec: 299.19\n", "INFO:tensorflow:loss = 408.34882, step = 4300 (0.328 sec)\n", "INFO:tensorflow:global_step/sec: 321.824\n", "INFO:tensorflow:loss = 247.83783, step = 4400 (0.311 sec)\n", "INFO:tensorflow:global_step/sec: 243.781\n", "INFO:tensorflow:loss = 338.04776, step = 4500 (0.410 sec)\n", "INFO:tensorflow:global_step/sec: 213.464\n", "INFO:tensorflow:loss = 224.32138, step = 4600 (0.469 sec)\n", "INFO:tensorflow:global_step/sec: 270.093\n", "INFO:tensorflow:loss = 329.30554, step = 4700 (0.372 sec)\n", "INFO:tensorflow:global_step/sec: 238.596\n", "INFO:tensorflow:loss = 486.72992, step = 4800 (0.414 sec)\n", "INFO:tensorflow:global_step/sec: 251.309\n", "INFO:tensorflow:loss = 398.2456, step = 4900 (0.403 sec)\n", "INFO:tensorflow:global_step/sec: 320.758\n", "INFO:tensorflow:loss = 231.17645, step = 5000 (0.308 sec)\n", "INFO:tensorflow:global_step/sec: 245.441\n", "INFO:tensorflow:loss = 454.76862, step = 5100 (0.410 sec)\n", "INFO:tensorflow:global_step/sec: 305.296\n", "INFO:tensorflow:loss = 269.61566, step = 5200 (0.328 sec)\n", "INFO:tensorflow:global_step/sec: 261.997\n", "INFO:tensorflow:loss = 276.39362, step = 5300 (0.381 sec)\n", "INFO:tensorflow:global_step/sec: 279.34\n", "INFO:tensorflow:loss = 310.61893, step = 5400 (0.360 sec)\n", "INFO:tensorflow:global_step/sec: 308.287\n", "INFO:tensorflow:loss = 157.07571, step = 5500 (0.322 sec)\n", "INFO:tensorflow:global_step/sec: 400.773\n", "INFO:tensorflow:loss = 50.250412, step = 5600 (0.246 sec)\n", "INFO:tensorflow:global_step/sec: 491.215\n", "INFO:tensorflow:loss = 167.94759, step = 5700 (0.204 sec)\n", "INFO:tensorflow:global_step/sec: 473.332\n", "INFO:tensorflow:loss = 273.76794, step = 5800 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 456.587\n", "INFO:tensorflow:loss = 216.6827, step = 5900 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 478.711\n", "INFO:tensorflow:loss = 243.11047, step = 6000 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 458.816\n", "INFO:tensorflow:loss = 337.50702, step = 6100 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 458.736\n", "INFO:tensorflow:loss = 241.6358, step = 6200 (0.218 sec)\n", "INFO:tensorflow:global_step/sec: 457.438\n", "INFO:tensorflow:loss = 462.48386, step = 6300 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 457.115\n", "INFO:tensorflow:loss = 259.4772, step = 6400 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 480.606\n", "INFO:tensorflow:loss = 310.74615, step = 6500 (0.205 sec)\n", "INFO:tensorflow:global_step/sec: 475.025\n", "INFO:tensorflow:loss = 182.19812, step = 6600 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 466.203\n", "INFO:tensorflow:loss = 215.94955, step = 6700 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 484.725\n", "INFO:tensorflow:loss = 103.2921, step = 6800 (0.204 sec)\n", "INFO:tensorflow:global_step/sec: 457.966\n", "INFO:tensorflow:loss = 157.93628, step = 6900 (0.218 sec)\n", "INFO:tensorflow:global_step/sec: 460.233\n", "INFO:tensorflow:loss = 296.50635, step = 7000 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 472.647\n", "INFO:tensorflow:loss = 109.56937, step = 7100 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 473.088\n", "INFO:tensorflow:loss = 162.96582, step = 7200 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 461.912\n", "INFO:tensorflow:loss = 109.78856, step = 7300 (0.218 sec)\n", "INFO:tensorflow:global_step/sec: 473.752\n", "INFO:tensorflow:loss = 297.7414, step = 7400 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 459.506\n", "INFO:tensorflow:loss = 142.23315, step = 7500 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 452.364\n", "INFO:tensorflow:loss = 154.41182, step = 7600 (0.224 sec)\n", "INFO:tensorflow:global_step/sec: 479.094\n", "INFO:tensorflow:loss = 126.05536, step = 7700 (0.209 sec)\n", "INFO:tensorflow:global_step/sec: 460.452\n", "INFO:tensorflow:loss = 121.47843, step = 7800 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 486.604\n", "INFO:tensorflow:loss = 196.01422, step = 7900 (0.208 sec)\n", "INFO:tensorflow:global_step/sec: 474.264\n", "INFO:tensorflow:loss = 192.39813, step = 8000 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 473.236\n", "INFO:tensorflow:loss = 120.865036, step = 8100 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 483.667\n", "INFO:tensorflow:loss = 129.37616, step = 8200 (0.209 sec)\n", "INFO:tensorflow:global_step/sec: 463.002\n", "INFO:tensorflow:loss = 204.65428, step = 8300 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 479.147\n", "INFO:tensorflow:loss = 143.12766, step = 8400 (0.208 sec)\n", "INFO:tensorflow:global_step/sec: 450.193\n", "INFO:tensorflow:loss = 157.94269, step = 8500 (0.221 sec)\n", "INFO:tensorflow:global_step/sec: 467.641\n", "INFO:tensorflow:loss = 147.16454, step = 8600 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 472.179\n", "INFO:tensorflow:loss = 179.69406, step = 8700 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 469.688\n", "INFO:tensorflow:loss = 181.20328, step = 8800 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 472.9\n", "INFO:tensorflow:loss = 100.69723, step = 8900 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 437.949\n", "INFO:tensorflow:loss = 99.33911, step = 9000 (0.226 sec)\n", "INFO:tensorflow:global_step/sec: 471.858\n", "INFO:tensorflow:loss = 129.4132, step = 9100 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 463.064\n", "INFO:tensorflow:loss = 196.74867, step = 9200 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 474.96\n", "INFO:tensorflow:loss = 143.00618, step = 9300 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 460.847\n", "INFO:tensorflow:loss = 217.89899, step = 9400 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 458.204\n", "INFO:tensorflow:loss = 75.210785, step = 9500 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 459.944\n", "INFO:tensorflow:loss = 71.03182, step = 9600 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 447.66\n", "INFO:tensorflow:loss = 198.12076, step = 9700 (0.226 sec)\n", "INFO:tensorflow:global_step/sec: 471.83\n", "INFO:tensorflow:loss = 61.32717, step = 9800 (0.209 sec)\n", "INFO:tensorflow:global_step/sec: 471.512\n", "INFO:tensorflow:loss = 122.47622, step = 9900 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 445.794\n", "INFO:tensorflow:loss = 89.25596, step = 10000 (0.221 sec)\n", "INFO:tensorflow:global_step/sec: 483.014\n", "INFO:tensorflow:loss = 53.980305, step = 10100 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 468.713\n", "INFO:tensorflow:loss = 62.33815, step = 10200 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 456.286\n", "INFO:tensorflow:loss = 76.11931, step = 10300 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 464.98\n", "INFO:tensorflow:loss = 101.62215, step = 10400 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 471.122\n", "INFO:tensorflow:loss = 138.17145, step = 10500 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 310.527\n", "INFO:tensorflow:loss = 202.67238, step = 10600 (0.325 sec)\n", "INFO:tensorflow:global_step/sec: 444.894\n", "INFO:tensorflow:loss = 98.9326, step = 10700 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 472.181\n", "INFO:tensorflow:loss = 75.616554, step = 10800 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 452.255\n", "INFO:tensorflow:loss = 53.432484, step = 10900 (0.223 sec)\n", "INFO:tensorflow:global_step/sec: 476.317\n", "INFO:tensorflow:loss = 39.189026, step = 11000 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 449.326\n", "INFO:tensorflow:loss = 103.55175, step = 11100 (0.222 sec)\n", "INFO:tensorflow:global_step/sec: 472.953\n", "INFO:tensorflow:loss = 54.73918, step = 11200 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 462.041\n", "INFO:tensorflow:loss = 24.177704, step = 11300 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 473.709\n", "INFO:tensorflow:loss = 26.009624, step = 11400 (0.208 sec)\n", "INFO:tensorflow:global_step/sec: 489.936\n", "INFO:tensorflow:loss = 13.340521, step = 11500 (0.207 sec)\n", "INFO:tensorflow:global_step/sec: 441.245\n", "INFO:tensorflow:loss = 76.38739, step = 11600 (0.224 sec)\n", "INFO:tensorflow:global_step/sec: 477.249\n", "INFO:tensorflow:loss = 97.01935, step = 11700 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 460.851\n", "INFO:tensorflow:loss = 129.2532, step = 11800 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 466.12\n", "INFO:tensorflow:loss = 43.8845, step = 11900 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 451.149\n", "INFO:tensorflow:loss = 42.973675, step = 12000 (0.225 sec)\n", "INFO:tensorflow:global_step/sec: 470.576\n", "INFO:tensorflow:loss = 128.45581, step = 12100 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 456.689\n", "INFO:tensorflow:loss = 40.81806, step = 12200 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 469.484\n", "INFO:tensorflow:loss = 56.980927, step = 12300 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 480.076\n", "INFO:tensorflow:loss = 35.11835, step = 12400 (0.209 sec)\n", "INFO:tensorflow:global_step/sec: 452.828\n", "INFO:tensorflow:loss = 99.98085, step = 12500 (0.223 sec)\n", "INFO:tensorflow:global_step/sec: 467.145\n", "INFO:tensorflow:loss = 26.250843, step = 12600 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 475.926\n", "INFO:tensorflow:loss = 58.336693, step = 12700 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 463.829\n", "INFO:tensorflow:loss = 13.668128, step = 12800 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 469.438\n", "INFO:tensorflow:loss = 53.502953, step = 12900 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 441.251\n", "INFO:tensorflow:loss = 19.391193, step = 13000 (0.229 sec)\n", "INFO:tensorflow:global_step/sec: 443.783\n", "INFO:tensorflow:loss = 60.34593, step = 13100 (0.223 sec)\n", "INFO:tensorflow:global_step/sec: 464.832\n", "INFO:tensorflow:loss = 49.55037, step = 13200 (0.218 sec)\n", "INFO:tensorflow:global_step/sec: 448.801\n", "INFO:tensorflow:loss = 38.969215, step = 13300 (0.228 sec)\n", "INFO:tensorflow:global_step/sec: 440.045\n", "INFO:tensorflow:loss = 73.344986, step = 13400 (0.223 sec)\n", "INFO:tensorflow:global_step/sec: 466.255\n", "INFO:tensorflow:loss = 29.41666, step = 13500 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 469.549\n", "INFO:tensorflow:loss = 43.13427, step = 13600 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 476.562\n", "INFO:tensorflow:loss = 32.427773, step = 13700 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 480.92\n", "INFO:tensorflow:loss = 14.445665, step = 13800 (0.205 sec)\n", "INFO:tensorflow:global_step/sec: 467.759\n", "INFO:tensorflow:loss = 47.02291, step = 13900 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 466.964\n", "INFO:tensorflow:loss = 61.91919, step = 14000 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 457.6\n", "INFO:tensorflow:loss = 36.706825, step = 14100 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 477.617\n", "INFO:tensorflow:loss = 39.316154, step = 14200 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 460.289\n", "INFO:tensorflow:loss = 43.922913, step = 14300 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 456.558\n", "INFO:tensorflow:loss = 16.188198, step = 14400 (0.223 sec)\n", "INFO:tensorflow:global_step/sec: 473.07\n", "INFO:tensorflow:loss = 34.92536, step = 14500 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 473.806\n", "INFO:tensorflow:loss = 67.7717, step = 14600 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 481.888\n", "INFO:tensorflow:loss = 14.307301, step = 14700 (0.208 sec)\n", "INFO:tensorflow:global_step/sec: 466.342\n", "INFO:tensorflow:loss = 33.21187, step = 14800 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 456.13\n", "INFO:tensorflow:loss = 22.559818, step = 14900 (0.221 sec)\n", "INFO:tensorflow:global_step/sec: 436.739\n", "INFO:tensorflow:loss = 18.019247, step = 15000 (0.227 sec)\n", "INFO:tensorflow:global_step/sec: 473.826\n", "INFO:tensorflow:loss = 13.325601, step = 15100 (0.208 sec)\n", "INFO:tensorflow:global_step/sec: 476.078\n", "INFO:tensorflow:loss = 20.606499, step = 15200 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 440.463\n", "INFO:tensorflow:loss = 57.983643, step = 15300 (0.224 sec)\n", "INFO:tensorflow:global_step/sec: 460.183\n", "INFO:tensorflow:loss = 28.97099, step = 15400 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 461.717\n", "INFO:tensorflow:loss = 23.70376, step = 15500 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 474.225\n", "INFO:tensorflow:loss = 13.260283, step = 15600 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 485.3\n", "INFO:tensorflow:loss = 36.07292, step = 15700 (0.206 sec)\n", "INFO:tensorflow:global_step/sec: 455.746\n", "INFO:tensorflow:loss = 20.232124, step = 15800 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 476.52\n", "INFO:tensorflow:loss = 72.29108, step = 15900 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 452.366\n", "INFO:tensorflow:loss = 27.944174, step = 16000 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 453.855\n", "INFO:tensorflow:loss = 16.33589, step = 16100 (0.224 sec)\n", "INFO:tensorflow:global_step/sec: 448.532\n", "INFO:tensorflow:loss = 74.485794, step = 16200 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 439.036\n", "INFO:tensorflow:loss = 8.916859, step = 16300 (0.230 sec)\n", "INFO:tensorflow:global_step/sec: 463.155\n", "INFO:tensorflow:loss = 26.993343, step = 16400 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 474.553\n", "INFO:tensorflow:loss = 26.719025, step = 16500 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 473.727\n", "INFO:tensorflow:loss = 30.090384, step = 16600 (0.208 sec)\n", "INFO:tensorflow:global_step/sec: 454.033\n", "INFO:tensorflow:loss = 10.998323, step = 16700 (0.223 sec)\n", "INFO:tensorflow:global_step/sec: 454.503\n", "INFO:tensorflow:loss = 21.39538, step = 16800 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 474.16\n", "INFO:tensorflow:loss = 9.325804, step = 16900 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 466.641\n", "INFO:tensorflow:loss = 29.7347, step = 17000 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 470.283\n", "INFO:tensorflow:loss = 18.520401, step = 17100 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 452.92\n", "INFO:tensorflow:loss = 43.501236, step = 17200 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 443.307\n", "INFO:tensorflow:loss = 43.30314, step = 17300 (0.222 sec)\n", "INFO:tensorflow:global_step/sec: 458.305\n", "INFO:tensorflow:loss = 29.388601, step = 17400 (0.222 sec)\n", "INFO:tensorflow:global_step/sec: 465.87\n", "INFO:tensorflow:loss = 4.1588697, step = 17500 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 460.889\n", "INFO:tensorflow:loss = 3.8622057, step = 17600 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 446.844\n", "INFO:tensorflow:loss = 9.607635, step = 17700 (0.224 sec)\n", "INFO:tensorflow:global_step/sec: 471.284\n", "INFO:tensorflow:loss = 19.083681, step = 17800 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 466.828\n", "INFO:tensorflow:loss = 47.726936, step = 17900 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 464.448\n", "INFO:tensorflow:loss = 26.39741, step = 18000 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 448.745\n", "INFO:tensorflow:loss = 17.166637, step = 18100 (0.224 sec)\n", "INFO:tensorflow:global_step/sec: 460.978\n", "INFO:tensorflow:loss = 12.519736, step = 18200 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 477.563\n", "INFO:tensorflow:loss = 34.65383, step = 18300 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 481.051\n", "INFO:tensorflow:loss = 32.24772, step = 18400 (0.208 sec)\n", "INFO:tensorflow:global_step/sec: 481.594\n", "INFO:tensorflow:loss = 32.058594, step = 18500 (0.207 sec)\n", "INFO:tensorflow:global_step/sec: 413.648\n", "INFO:tensorflow:loss = 25.9293, step = 18600 (0.240 sec)\n", "INFO:tensorflow:global_step/sec: 466.486\n", "INFO:tensorflow:loss = 17.837841, step = 18700 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 462.915\n", "INFO:tensorflow:loss = 44.107323, step = 18800 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 474.517\n", "INFO:tensorflow:loss = 47.98845, step = 18900 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 469.356\n", "INFO:tensorflow:loss = 20.956676, step = 19000 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 444.954\n", "INFO:tensorflow:loss = 8.814898, step = 19100 (0.222 sec)\n", "INFO:tensorflow:global_step/sec: 469.781\n", "INFO:tensorflow:loss = 18.143345, step = 19200 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 465.75\n", "INFO:tensorflow:loss = 13.712688, step = 19300 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 482.631\n", "INFO:tensorflow:loss = 18.664692, step = 19400 (0.207 sec)\n", "INFO:tensorflow:global_step/sec: 460.289\n", "INFO:tensorflow:loss = 12.757539, step = 19500 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 453.621\n", "INFO:tensorflow:loss = 18.01501, step = 19600 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 459.872\n", "INFO:tensorflow:loss = 8.343716, step = 19700 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 464.436\n", "INFO:tensorflow:loss = 16.812944, step = 19800 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 480.616\n", "INFO:tensorflow:loss = 23.273952, step = 19900 (0.208 sec)\n", "INFO:tensorflow:global_step/sec: 440.479\n", "INFO:tensorflow:loss = 55.286587, step = 20000 (0.230 sec)\n", "INFO:tensorflow:global_step/sec: 470.585\n", "INFO:tensorflow:loss = 16.271858, step = 20100 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 456.832\n", "INFO:tensorflow:loss = 6.6021547, step = 20200 (0.221 sec)\n", "INFO:tensorflow:global_step/sec: 468.986\n", "INFO:tensorflow:loss = 9.953886, step = 20300 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 453.459\n", "INFO:tensorflow:loss = 16.890442, step = 20400 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 450.679\n", "INFO:tensorflow:loss = 3.1709657, step = 20500 (0.222 sec)\n", "INFO:tensorflow:global_step/sec: 454.055\n", "INFO:tensorflow:loss = 17.51634, step = 20600 (0.222 sec)\n", "INFO:tensorflow:global_step/sec: 469.638\n", "INFO:tensorflow:loss = 15.479401, step = 20700 (0.208 sec)\n", "INFO:tensorflow:global_step/sec: 470.97\n", "INFO:tensorflow:loss = 16.141584, step = 20800 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 447.937\n", "INFO:tensorflow:loss = 8.279337, step = 20900 (0.225 sec)\n", "INFO:tensorflow:global_step/sec: 453.383\n", "INFO:tensorflow:loss = 33.03417, step = 21000 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 451.702\n", "INFO:tensorflow:loss = 19.716728, step = 21100 (0.222 sec)\n", "INFO:tensorflow:global_step/sec: 472.646\n", "INFO:tensorflow:loss = 2.8707504, step = 21200 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 463.117\n", "INFO:tensorflow:loss = 23.583725, step = 21300 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 444.134\n", "INFO:tensorflow:loss = 5.145803, step = 21400 (0.229 sec)\n", "INFO:tensorflow:global_step/sec: 452.416\n", "INFO:tensorflow:loss = 18.48024, step = 21500 (0.221 sec)\n", "INFO:tensorflow:global_step/sec: 465.49\n", "INFO:tensorflow:loss = 12.605504, step = 21600 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 467.255\n", "INFO:tensorflow:loss = 8.921439, step = 21700 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 465.699\n", "INFO:tensorflow:loss = 44.824104, step = 21800 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 454.476\n", "INFO:tensorflow:loss = 6.5051913, step = 21900 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 467.578\n", "INFO:tensorflow:loss = 16.271145, step = 22000 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 477.527\n", "INFO:tensorflow:loss = 26.531158, step = 22100 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 455.81\n", "INFO:tensorflow:loss = 33.894367, step = 22200 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 459.111\n", "INFO:tensorflow:loss = 3.9773245, step = 22300 (0.218 sec)\n", "INFO:tensorflow:global_step/sec: 448.581\n", "INFO:tensorflow:loss = 21.257072, step = 22400 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 469.874\n", "INFO:tensorflow:loss = 13.6777115, step = 22500 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 474.807\n", "INFO:tensorflow:loss = 14.181101, step = 22600 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 465.159\n", "INFO:tensorflow:loss = 5.17632, step = 22700 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 440.54\n", "INFO:tensorflow:loss = 9.119291, step = 22800 (0.226 sec)\n", "INFO:tensorflow:global_step/sec: 441.369\n", "INFO:tensorflow:loss = 28.966875, step = 22900 (0.225 sec)\n", "INFO:tensorflow:global_step/sec: 461.328\n", "INFO:tensorflow:loss = 5.2642474, step = 23000 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 465.182\n", "INFO:tensorflow:loss = 12.722582, step = 23100 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 469.452\n", "INFO:tensorflow:loss = 6.682399, step = 23200 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 449.68\n", "INFO:tensorflow:loss = 9.597814, step = 23300 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 441.182\n", "INFO:tensorflow:loss = 6.9218144, step = 23400 (0.229 sec)\n", "INFO:tensorflow:global_step/sec: 461.551\n", "INFO:tensorflow:loss = 33.87813, step = 23500 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 438.438\n", "INFO:tensorflow:loss = 5.7835894, step = 23600 (0.228 sec)\n", "INFO:tensorflow:global_step/sec: 443.455\n", "INFO:tensorflow:loss = 11.15064, step = 23700 (0.229 sec)\n", "INFO:tensorflow:global_step/sec: 444.459\n", "INFO:tensorflow:loss = 5.578021, step = 23800 (0.222 sec)\n", "INFO:tensorflow:global_step/sec: 468.991\n", "INFO:tensorflow:loss = 8.360031, step = 23900 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 458.342\n", "INFO:tensorflow:loss = 23.440624, step = 24000 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 440.85\n", "INFO:tensorflow:loss = 7.31043, step = 24100 (0.231 sec)\n", "INFO:tensorflow:global_step/sec: 440.841\n", "INFO:tensorflow:loss = 13.232655, step = 24200 (0.226 sec)\n", "INFO:tensorflow:global_step/sec: 463.076\n", "INFO:tensorflow:loss = 7.4960694, step = 24300 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 469.469\n", "INFO:tensorflow:loss = 12.834114, step = 24400 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 459.901\n", "INFO:tensorflow:loss = 9.471176, step = 24500 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 467.742\n", "INFO:tensorflow:loss = 9.423434, step = 24600 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 450.401\n", "INFO:tensorflow:loss = 3.934022, step = 24700 (0.221 sec)\n", "INFO:tensorflow:global_step/sec: 470.179\n", "INFO:tensorflow:loss = 9.6249485, step = 24800 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 473.906\n", "INFO:tensorflow:loss = 9.880373, step = 24900 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 467.597\n", "INFO:tensorflow:loss = 18.794914, step = 25000 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 453.052\n", "INFO:tensorflow:loss = 23.607628, step = 25100 (0.218 sec)\n", "INFO:tensorflow:global_step/sec: 457.723\n", "INFO:tensorflow:loss = 7.165414, step = 25200 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 482.928\n", "INFO:tensorflow:loss = 12.007322, step = 25300 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 448.515\n", "INFO:tensorflow:loss = 16.284008, step = 25400 (0.223 sec)\n", "INFO:tensorflow:global_step/sec: 462.051\n", "INFO:tensorflow:loss = 23.348679, step = 25500 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 451.135\n", "INFO:tensorflow:loss = 6.118327, step = 25600 (0.225 sec)\n", "INFO:tensorflow:global_step/sec: 478.901\n", "INFO:tensorflow:loss = 9.5843525, step = 25700 (0.209 sec)\n", "INFO:tensorflow:global_step/sec: 468.234\n", "INFO:tensorflow:loss = 10.749292, step = 25800 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 459.926\n", "INFO:tensorflow:loss = 15.877416, step = 25900 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 471.497\n", "INFO:tensorflow:loss = 25.10238, step = 26000 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 443.666\n", "INFO:tensorflow:loss = 10.9091625, step = 26100 (0.223 sec)\n", "INFO:tensorflow:global_step/sec: 474.59\n", "INFO:tensorflow:loss = 22.00437, step = 26200 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 475.208\n", "INFO:tensorflow:loss = 13.540822, step = 26300 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 459.255\n", "INFO:tensorflow:loss = 6.440311, step = 26400 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 461.274\n", "INFO:tensorflow:loss = 17.447918, step = 26500 (0.218 sec)\n", "INFO:tensorflow:global_step/sec: 436.347\n", "INFO:tensorflow:loss = 14.226518, step = 26600 (0.228 sec)\n", "INFO:tensorflow:global_step/sec: 438.625\n", "INFO:tensorflow:loss = 29.519482, step = 26700 (0.228 sec)\n", "INFO:tensorflow:global_step/sec: 478.846\n", "INFO:tensorflow:loss = 4.557602, step = 26800 (0.209 sec)\n", "INFO:tensorflow:global_step/sec: 460.26\n", "INFO:tensorflow:loss = 13.926151, step = 26900 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 444.311\n", "INFO:tensorflow:loss = 5.715318, step = 27000 (0.225 sec)\n", "INFO:tensorflow:global_step/sec: 474.011\n", "INFO:tensorflow:loss = 2.780272, step = 27100 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 481.027\n", "INFO:tensorflow:loss = 15.597063, step = 27200 (0.209 sec)\n", "INFO:tensorflow:global_step/sec: 454.408\n", "INFO:tensorflow:loss = 15.180899, step = 27300 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 474.236\n", "INFO:tensorflow:loss = 10.018114, step = 27400 (0.208 sec)\n", "INFO:tensorflow:global_step/sec: 439.045\n", "INFO:tensorflow:loss = 20.028845, step = 27500 (0.231 sec)\n", "INFO:tensorflow:global_step/sec: 469.782\n", "INFO:tensorflow:loss = 8.941496, step = 27600 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 461.694\n", "INFO:tensorflow:loss = 12.881708, step = 27700 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 465.997\n", "INFO:tensorflow:loss = 10.7458105, step = 27800 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 466.855\n", "INFO:tensorflow:loss = 8.405386, step = 27900 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 435.177\n", "INFO:tensorflow:loss = 13.277586, step = 28000 (0.232 sec)\n", "INFO:tensorflow:global_step/sec: 457.682\n", "INFO:tensorflow:loss = 34.092384, step = 28100 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 451.626\n", "INFO:tensorflow:loss = 4.71091, step = 28200 (0.221 sec)\n", "INFO:tensorflow:global_step/sec: 458.545\n", "INFO:tensorflow:loss = 3.8344078, step = 28300 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 454.727\n", "INFO:tensorflow:loss = 12.47625, step = 28400 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 473.192\n", "INFO:tensorflow:loss = 1.6983385, step = 28500 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 470.913\n", "INFO:tensorflow:loss = 3.4077313, step = 28600 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 460.002\n", "INFO:tensorflow:loss = 39.38697, step = 28700 (0.218 sec)\n", "INFO:tensorflow:global_step/sec: 434.845\n", "INFO:tensorflow:loss = 40.823807, step = 28800 (0.230 sec)\n", "INFO:tensorflow:global_step/sec: 455.605\n", "INFO:tensorflow:loss = 14.85188, step = 28900 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 469.604\n", "INFO:tensorflow:loss = 27.656487, step = 29000 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 480.033\n", "INFO:tensorflow:loss = 24.06651, step = 29100 (0.206 sec)\n", "INFO:tensorflow:global_step/sec: 470.368\n", "INFO:tensorflow:loss = 21.786335, step = 29200 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 461.82\n", "INFO:tensorflow:loss = 6.270864, step = 29300 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 455.427\n", "INFO:tensorflow:loss = 5.9982657, step = 29400 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 472.545\n", "INFO:tensorflow:loss = 7.9089584, step = 29500 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 471.411\n", "INFO:tensorflow:loss = 20.56556, step = 29600 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 465.662\n", "INFO:tensorflow:loss = 36.922127, step = 29700 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 458.602\n", "INFO:tensorflow:loss = 10.915519, step = 29800 (0.218 sec)\n", "INFO:tensorflow:global_step/sec: 467.454\n", "INFO:tensorflow:loss = 3.909404, step = 29900 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 480.714\n", "INFO:tensorflow:loss = 16.469095, step = 30000 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 469.228\n", "INFO:tensorflow:loss = 10.660473, step = 30100 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 466.93\n", "INFO:tensorflow:loss = 18.283772, step = 30200 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 453.674\n", "INFO:tensorflow:loss = 12.865719, step = 30300 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 464.226\n", "INFO:tensorflow:loss = 6.936103, step = 30400 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 482.107\n", "INFO:tensorflow:loss = 24.065418, step = 30500 (0.207 sec)\n", "INFO:tensorflow:global_step/sec: 459.599\n", "INFO:tensorflow:loss = 28.989565, step = 30600 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 460.976\n", "INFO:tensorflow:loss = 6.0468793, step = 30700 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 456.974\n", "INFO:tensorflow:loss = 9.861507, step = 30800 (0.222 sec)\n", "INFO:tensorflow:global_step/sec: 460.263\n", "INFO:tensorflow:loss = 10.347976, step = 30900 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 472.069\n", "INFO:tensorflow:loss = 7.492622, step = 31000 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 469.214\n", "INFO:tensorflow:loss = 12.511204, step = 31100 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 467.532\n", "INFO:tensorflow:loss = 21.11621, step = 31200 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 467.402\n", "INFO:tensorflow:loss = 3.2566044, step = 31300 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 487.908\n", "INFO:tensorflow:loss = 7.370183, step = 31400 (0.207 sec)\n", "INFO:tensorflow:global_step/sec: 464.845\n", "INFO:tensorflow:loss = 18.520819, step = 31500 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 445.347\n", "INFO:tensorflow:loss = 15.041449, step = 31600 (0.224 sec)\n", "INFO:tensorflow:global_step/sec: 458.907\n", "INFO:tensorflow:loss = 4.696784, step = 31700 (0.218 sec)\n", "INFO:tensorflow:global_step/sec: 479.361\n", "INFO:tensorflow:loss = 24.94238, step = 31800 (0.209 sec)\n", "INFO:tensorflow:global_step/sec: 470.566\n", "INFO:tensorflow:loss = 8.263337, step = 31900 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 454.012\n", "INFO:tensorflow:loss = 6.4451227, step = 32000 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 469.471\n", "INFO:tensorflow:loss = 7.2219687, step = 32100 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 451.178\n", "INFO:tensorflow:loss = 5.234274, step = 32200 (0.222 sec)\n", "INFO:tensorflow:global_step/sec: 455.645\n", "INFO:tensorflow:loss = 30.90236, step = 32300 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 463.736\n", "INFO:tensorflow:loss = 12.145181, step = 32400 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 481.978\n", "INFO:tensorflow:loss = 17.400644, step = 32500 (0.207 sec)\n", "INFO:tensorflow:global_step/sec: 472.125\n", "INFO:tensorflow:loss = 25.729801, step = 32600 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 460.768\n", "INFO:tensorflow:loss = 6.4954996, step = 32700 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 477.309\n", "INFO:tensorflow:loss = 6.7181587, step = 32800 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 466.02\n", "INFO:tensorflow:loss = 17.731228, step = 32900 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 470.911\n", "INFO:tensorflow:loss = 15.974545, step = 33000 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 484.23\n", "INFO:tensorflow:loss = 4.188789, step = 33100 (0.207 sec)\n", "INFO:tensorflow:global_step/sec: 458.766\n", "INFO:tensorflow:loss = 14.308117, step = 33200 (0.218 sec)\n", "INFO:tensorflow:global_step/sec: 470.042\n", "INFO:tensorflow:loss = 4.7078323, step = 33300 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 453.42\n", "INFO:tensorflow:loss = 2.065091, step = 33400 (0.221 sec)\n", "INFO:tensorflow:global_step/sec: 462.635\n", "INFO:tensorflow:loss = 5.4696803, step = 33500 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 445.076\n", "INFO:tensorflow:loss = 26.21112, step = 33600 (0.221 sec)\n", "INFO:tensorflow:global_step/sec: 483.111\n", "INFO:tensorflow:loss = 8.482587, step = 33700 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 459.552\n", "INFO:tensorflow:loss = 8.954087, step = 33800 (0.218 sec)\n", "INFO:tensorflow:global_step/sec: 437.551\n", "INFO:tensorflow:loss = 4.605938, step = 33900 (0.229 sec)\n", "INFO:tensorflow:global_step/sec: 459.778\n", "INFO:tensorflow:loss = 14.68046, step = 34000 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 445.581\n", "INFO:tensorflow:loss = 18.09366, step = 34100 (0.225 sec)\n", "INFO:tensorflow:global_step/sec: 461.591\n", "INFO:tensorflow:loss = 26.085516, step = 34200 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 465.451\n", "INFO:tensorflow:loss = 13.96898, step = 34300 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 468.233\n", "INFO:tensorflow:loss = 15.795761, step = 34400 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 469.435\n", "INFO:tensorflow:loss = 13.562956, step = 34500 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 452.9\n", "INFO:tensorflow:loss = 7.520429, step = 34600 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 457.36\n", "INFO:tensorflow:loss = 4.281724, step = 34700 (0.222 sec)\n", "INFO:tensorflow:global_step/sec: 456.41\n", "INFO:tensorflow:loss = 12.018632, step = 34800 (0.223 sec)\n", "INFO:tensorflow:global_step/sec: 440.183\n", "INFO:tensorflow:loss = 34.710686, step = 34900 (0.222 sec)\n", "INFO:tensorflow:global_step/sec: 457.204\n", "INFO:tensorflow:loss = 11.351408, step = 35000 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 466.593\n", "INFO:tensorflow:loss = 6.822466, step = 35100 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 465.678\n", "INFO:tensorflow:loss = 53.842426, step = 35200 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 461.194\n", "INFO:tensorflow:loss = 7.0689335, step = 35300 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 480.137\n", "INFO:tensorflow:loss = 24.502487, step = 35400 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 450.862\n", "INFO:tensorflow:loss = 23.246147, step = 35500 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 474.968\n", "INFO:tensorflow:loss = 15.832615, step = 35600 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 471.287\n", "INFO:tensorflow:loss = 16.968363, step = 35700 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 464.683\n", "INFO:tensorflow:loss = 8.062547, step = 35800 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 479.919\n", "INFO:tensorflow:loss = 13.422481, step = 35900 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 446.873\n", "INFO:tensorflow:loss = 4.183349, step = 36000 (0.221 sec)\n", "INFO:tensorflow:global_step/sec: 464.703\n", "INFO:tensorflow:loss = 13.323553, step = 36100 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 449.781\n", "INFO:tensorflow:loss = 11.525163, step = 36200 (0.224 sec)\n", "INFO:tensorflow:global_step/sec: 470.867\n", "INFO:tensorflow:loss = 6.468131, step = 36300 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 459.96\n", "INFO:tensorflow:loss = 8.521664, step = 36400 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 476.539\n", "INFO:tensorflow:loss = 21.422922, step = 36500 (0.209 sec)\n", "INFO:tensorflow:global_step/sec: 475.297\n", "INFO:tensorflow:loss = 5.8486495, step = 36600 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 474.113\n", "INFO:tensorflow:loss = 33.237568, step = 36700 (0.213 sec)\n", "INFO:tensorflow:global_step/sec: 477.332\n", "INFO:tensorflow:loss = 23.698952, step = 36800 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 434.396\n", "INFO:tensorflow:loss = 6.335133, step = 36900 (0.229 sec)\n", "INFO:tensorflow:global_step/sec: 475.548\n", "INFO:tensorflow:loss = 1.508002, step = 37000 (0.208 sec)\n", "INFO:tensorflow:global_step/sec: 463.831\n", "INFO:tensorflow:loss = 3.6374853, step = 37100 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 470.243\n", "INFO:tensorflow:loss = 7.301122, step = 37200 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 480.68\n", "INFO:tensorflow:loss = 14.201712, step = 37300 (0.208 sec)\n", "INFO:tensorflow:global_step/sec: 422.365\n", "INFO:tensorflow:loss = 7.8651886, step = 37400 (0.237 sec)\n", "INFO:tensorflow:global_step/sec: 477.547\n", "INFO:tensorflow:loss = 8.820171, step = 37500 (0.206 sec)\n", "INFO:tensorflow:global_step/sec: 470.12\n", "INFO:tensorflow:loss = 31.641243, step = 37600 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 444.869\n", "INFO:tensorflow:loss = 4.884571, step = 37700 (0.225 sec)\n", "INFO:tensorflow:global_step/sec: 467.069\n", "INFO:tensorflow:loss = 17.525532, step = 37800 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 463.052\n", "INFO:tensorflow:loss = 8.624132, step = 37900 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 457.805\n", "INFO:tensorflow:loss = 3.5297353, step = 38000 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 475.627\n", "INFO:tensorflow:loss = 9.144406, step = 38100 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 480.755\n", "INFO:tensorflow:loss = 1.1243948, step = 38200 (0.207 sec)\n", "INFO:tensorflow:global_step/sec: 464.274\n", "INFO:tensorflow:loss = 7.0743666, step = 38300 (0.218 sec)\n", "INFO:tensorflow:global_step/sec: 465.574\n", "INFO:tensorflow:loss = 5.084804, step = 38400 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 459.023\n", "INFO:tensorflow:loss = 22.566488, step = 38500 (0.218 sec)\n", "INFO:tensorflow:global_step/sec: 460.382\n", "INFO:tensorflow:loss = 2.4603887, step = 38600 (0.217 sec)\n", "INFO:tensorflow:global_step/sec: 453.11\n", "INFO:tensorflow:loss = 5.7750998, step = 38700 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 445.667\n", "INFO:tensorflow:loss = 3.2315903, step = 38800 (0.225 sec)\n", "INFO:tensorflow:global_step/sec: 473.062\n", "INFO:tensorflow:loss = 7.439247, step = 38900 (0.211 sec)\n", "INFO:tensorflow:global_step/sec: 476.458\n", "INFO:tensorflow:loss = 13.182194, step = 39000 (0.212 sec)\n", "INFO:tensorflow:global_step/sec: 420.876\n", "INFO:tensorflow:loss = 37.41014, step = 39100 (0.236 sec)\n", "INFO:tensorflow:global_step/sec: 465.337\n", "INFO:tensorflow:loss = 38.065186, step = 39200 (0.215 sec)\n", "INFO:tensorflow:global_step/sec: 447.64\n", "INFO:tensorflow:loss = 4.3470774, step = 39300 (0.220 sec)\n", "INFO:tensorflow:global_step/sec: 465.402\n", "INFO:tensorflow:loss = 8.519768, step = 39400 (0.223 sec)\n", "INFO:tensorflow:global_step/sec: 457.541\n", "INFO:tensorflow:loss = 17.297688, step = 39500 (0.214 sec)\n", "INFO:tensorflow:global_step/sec: 469.163\n", "INFO:tensorflow:loss = 5.993822, step = 39600 (0.210 sec)\n", "INFO:tensorflow:global_step/sec: 464.924\n", "INFO:tensorflow:loss = 3.27424, step = 39700 (0.219 sec)\n", "INFO:tensorflow:global_step/sec: 455.594\n", "INFO:tensorflow:loss = 12.356253, step = 39800 (0.216 sec)\n", "INFO:tensorflow:global_step/sec: 471.027\n", "INFO:tensorflow:loss = 9.971731, step = 39900 (0.212 sec)\n", "INFO:tensorflow:Calling checkpoint listeners before saving checkpoint 40000...\n", "INFO:tensorflow:Saving checkpoints for 40000 into models/autompg-dnnregressor/model.ckpt.\n", "INFO:tensorflow:Calling checkpoint listeners after saving checkpoint 40000...\n", "INFO:tensorflow:Loss for final step: 3.7350163.\n" ] }, { "output_type": "execute_result", "data": { "text/plain": [ "" ] }, "metadata": {}, "execution_count": 15 } ], "source": [ "EPOCHS = 1000\n", "BATCH_SIZE = 8\n", "total_steps = EPOCHS * int(np.ceil(len(df_train) / BATCH_SIZE))\n", "print('훈련 스텝:', total_steps)\n", "\n", "regressor.train(\n", " input_fn=lambda:train_input_fn(df_train_norm, batch_size=BATCH_SIZE),\n", " steps=total_steps)" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "k7-xm6ggy8w8", "outputId": "dfcf810d-4a48-48d7-e5ba-c7c9ddec2af3" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "INFO:tensorflow:Using default config.\n", "INFO:tensorflow:Using config: {'_model_dir': 'models/autompg-dnnregressor/', '_tf_random_seed': None, '_save_summary_steps': 100, '_save_checkpoints_steps': None, '_save_checkpoints_secs': 600, '_session_config': allow_soft_placement: true\n", "graph_options {\n", " rewrite_options {\n", " meta_optimizer_iterations: ONE\n", " }\n", "}\n", ", '_keep_checkpoint_max': 5, '_keep_checkpoint_every_n_hours': 10000, '_log_step_count_steps': 100, '_train_distribute': None, '_device_fn': None, '_protocol': None, '_eval_distribute': None, '_experimental_distribute': None, '_experimental_max_worker_delay_secs': None, '_session_creation_timeout_secs': 7200, '_checkpoint_save_graph_def': True, '_service': None, '_cluster_spec': ClusterSpec({}), '_task_type': 'worker', '_task_id': 0, '_global_id_in_cluster': 0, '_master': '', '_evaluation_master': '', '_is_chief': True, '_num_ps_replicas': 0, '_num_worker_replicas': 1}\n" ] } ], "source": [ "reloaded_regressor = tf.estimator.DNNRegressor(\n", " feature_columns=all_feature_columns,\n", " hidden_units=[32, 10],\n", " warm_start_from='models/autompg-dnnregressor/',\n", " model_dir='models/autompg-dnnregressor/')" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "BcSjYtdQy8w8", "outputId": "ffbdf82e-dfe6-4613-c1b2-7e67681b2e49" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "INFO:tensorflow:Calling model_fn.\n", "INFO:tensorflow:Done calling model_fn.\n", "INFO:tensorflow:Starting evaluation at 2022-07-29T03:39:05\n", "INFO:tensorflow:Graph was finalized.\n", "INFO:tensorflow:Restoring parameters from models/autompg-dnnregressor/model.ckpt-40000\n", "INFO:tensorflow:Running local_init_op.\n", "INFO:tensorflow:Done running local_init_op.\n", "INFO:tensorflow:Inference Time : 0.56955s\n", "INFO:tensorflow:Finished evaluation at 2022-07-29-03:39:06\n", "INFO:tensorflow:Saving dict for global step 40000: average_loss = 15.3082905, global_step = 40000, label/mean = 23.611391, loss = 15.220606, prediction/mean = 22.022804\n", "INFO:tensorflow:Saving 'checkpoint_path' summary for global step 40000: models/autompg-dnnregressor/model.ckpt-40000\n", "average_loss 15.308290481567383\n", "label/mean 23.611391067504883\n", "loss 15.220605850219727\n", "prediction/mean 22.022804260253906\n", "global_step 40000\n", "평균 손실 15.3083\n" ] } ], "source": [ "def eval_input_fn(df_test, batch_size=8):\n", " df = df_test.copy()\n", " test_x, test_y = df, df.pop('MPG')\n", " dataset = tf.data.Dataset.from_tensor_slices((dict(test_x), test_y))\n", "\n", " return dataset.batch(batch_size)\n", "\n", "eval_results = reloaded_regressor.evaluate(\n", " input_fn=lambda:eval_input_fn(df_test_norm, batch_size=8))\n", "\n", "for key in eval_results:\n", " print('{:15s} {}'.format(key, eval_results[key]))\n", "\n", "print('평균 손실 {:.4f}'.format(eval_results['average_loss']))" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "B8u7CKJ_y8w8", "outputId": "39769ce6-ea83-467e-81a9-6673cc4e804c" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "INFO:tensorflow:Calling model_fn.\n", "INFO:tensorflow:Done calling model_fn.\n", "INFO:tensorflow:Graph was finalized.\n", "INFO:tensorflow:Restoring parameters from models/autompg-dnnregressor/model.ckpt-40000\n", "INFO:tensorflow:Running local_init_op.\n", "INFO:tensorflow:Done running local_init_op.\n", "{'predictions': array([24.396297], dtype=float32)}\n" ] } ], "source": [ "pred_res = regressor.predict(input_fn=lambda: eval_input_fn(df_test_norm, batch_size=8))\n", "\n", "print(next(iter(pred_res)))" ] }, { "cell_type": "markdown", "metadata": { "id": "1WMTIRkXy8w9" }, "source": [ "#### Boosted Tree Regressor" ] }, { "cell_type": "code", "execution_count": null, "metadata": { "colab": { "base_uri": "https://localhost:8080/" }, "id": "zcrXe74iy8w9", "outputId": "81c74b9b-ddd3-40a0-f2f2-e34a70325fed" }, "outputs": [ { "output_type": "stream", "name": "stdout", "text": [ "WARNING:tensorflow:From :4: BoostedTreesRegressor.__init__ (from tensorflow_estimator.python.estimator.canned.boosted_trees) is deprecated and will be removed in a future version.\n", "Instructions for updating:\n", "Boosted Trees kernels in TF are deprecated. Please use TensorFlow Decision Forests instead (https://github.com/tensorflow/decision-forests)\n", "INFO:tensorflow:Using default config.\n", "WARNING:tensorflow:Using temporary folder as model directory: /tmp/tmpkt_mgjm2\n", "INFO:tensorflow:Using config: {'_model_dir': '/tmp/tmpkt_mgjm2', '_tf_random_seed': None, '_save_summary_steps': 100, '_save_checkpoints_steps': None, '_save_checkpoints_secs': 600, '_session_config': allow_soft_placement: true\n", "graph_options {\n", " rewrite_options {\n", " meta_optimizer_iterations: ONE\n", " }\n", "}\n", ", '_keep_checkpoint_max': 5, '_keep_checkpoint_every_n_hours': 10000, '_log_step_count_steps': 100, '_train_distribute': None, '_device_fn': None, '_protocol': None, '_eval_distribute': None, '_experimental_distribute': None, '_experimental_max_worker_delay_secs': None, '_session_creation_timeout_secs': 7200, '_checkpoint_save_graph_def': True, '_service': None, '_cluster_spec': ClusterSpec({}), '_task_type': 'worker', '_task_id': 0, '_global_id_in_cluster': 0, '_master': '', '_evaluation_master': '', '_is_chief': True, '_num_ps_replicas': 0, '_num_worker_replicas': 1}\n", "WARNING:tensorflow:From /usr/local/lib/python3.7/dist-packages/tensorflow_estimator/python/estimator/canned/boosted_trees.py:398: VocabularyListCategoricalColumn._num_buckets (from tensorflow.python.feature_column.feature_column_v2) is deprecated and will be removed in a future version.\n", "Instructions for updating:\n", "The old _FeatureColumn APIs are being deprecated. Please use the new FeatureColumn APIs instead.\n", "INFO:tensorflow:Calling model_fn.\n", "INFO:tensorflow:Done calling model_fn.\n", "INFO:tensorflow:Create CheckpointSaverHook.\n", "WARNING:tensorflow:Issue encountered when serializing resources.\n", "Type is unsupported, or the types of the items don't match field type in CollectionDef. Note this is a warning and probably safe to ignore.\n", "'_Resource' object has no attribute 'name'\n", "INFO:tensorflow:Graph was finalized.\n", "INFO:tensorflow:Running local_init_op.\n", "INFO:tensorflow:Done running local_init_op.\n", "WARNING:tensorflow:Issue encountered when serializing resources.\n", "Type is unsupported, or the types of the items don't match field type in CollectionDef. Note this is a warning and probably safe to ignore.\n", "'_Resource' object has no attribute 'name'\n", "INFO:tensorflow:Calling checkpoint listeners before saving checkpoint 0...\n", "INFO:tensorflow:Saving checkpoints for 0 into /tmp/tmpkt_mgjm2/model.ckpt.\n", "WARNING:tensorflow:Issue encountered when serializing resources.\n", "Type is unsupported, or the types of the items don't match field type in CollectionDef. Note this is a warning and probably safe to ignore.\n", "'_Resource' object has no attribute 'name'\n", "INFO:tensorflow:Calling checkpoint listeners after saving checkpoint 0...\n", "INFO:tensorflow:loss = 389.33374, step = 0\n", "INFO:tensorflow:loss = 271.24652, step = 80 (0.682 sec)\n", "INFO:tensorflow:global_step/sec: 115.54\n", "INFO:tensorflow:loss = 76.2742, step = 180 (0.545 sec)\n", "INFO:tensorflow:global_step/sec: 224.642\n", "INFO:tensorflow:loss = 25.58537, step = 280 (0.440 sec)\n", "INFO:tensorflow:global_step/sec: 223.416\n", "INFO:tensorflow:loss = 17.621681, step = 380 (0.455 sec)\n", "INFO:tensorflow:global_step/sec: 223.605\n", "INFO:tensorflow:loss = 8.099854, step = 480 (0.445 sec)\n", "INFO:tensorflow:global_step/sec: 223.335\n", "INFO:tensorflow:loss = 9.212008, step = 580 (0.435 sec)\n", "INFO:tensorflow:global_step/sec: 224.263\n", "INFO:tensorflow:loss = 2.8024404, step = 680 (0.449 sec)\n", "INFO:tensorflow:global_step/sec: 225.999\n", "INFO:tensorflow:loss = 1.6661799, step = 780 (0.440 sec)\n", "INFO:tensorflow:global_step/sec: 229.712\n", "INFO:tensorflow:loss = 1.7573171, step = 880 (0.455 sec)\n", "INFO:tensorflow:global_step/sec: 218.358\n", "INFO:tensorflow:loss = 2.5733104, step = 980 (0.442 sec)\n", "INFO:tensorflow:global_step/sec: 222.466\n", "INFO:tensorflow:loss = 3.0270538, step = 1080 (0.460 sec)\n", "INFO:tensorflow:global_step/sec: 220.721\n", "INFO:tensorflow:loss = 3.8566308, step = 1180 (0.443 sec)\n", "INFO:tensorflow:global_step/sec: 223.165\n", "INFO:tensorflow:loss = 2.4193988, step = 1280 (0.454 sec)\n", "INFO:tensorflow:global_step/sec: 218.743\n", "INFO:tensorflow:loss = 3.5105104, step = 1380 (0.455 sec)\n", "INFO:tensorflow:global_step/sec: 224.117\n", "INFO:tensorflow:loss = 3.8904362, step = 1480 (0.458 sec)\n", "INFO:tensorflow:global_step/sec: 214.13\n", "INFO:tensorflow:loss = 0.4817164, step = 1580 (0.466 sec)\n", "INFO:tensorflow:global_step/sec: 218.956\n", "INFO:tensorflow:loss = 0.51105994, step = 1680 (0.445 sec)\n", "INFO:tensorflow:global_step/sec: 226.138\n", "INFO:tensorflow:loss = 1.5812495, step = 1780 (0.465 sec)\n", "INFO:tensorflow:global_step/sec: 210.592\n", "INFO:tensorflow:loss = 4.4917717, step = 1880 (0.452 sec)\n", "INFO:tensorflow:global_step/sec: 223.784\n", "INFO:tensorflow:loss = 2.2426171, step = 1980 (0.460 sec)\n", "INFO:tensorflow:global_step/sec: 219.568\n", "INFO:tensorflow:loss = 1.8837336, step = 2080 (0.443 sec)\n", "INFO:tensorflow:global_step/sec: 225.059\n", "INFO:tensorflow:loss = 1.601377, step = 2180 (0.464 sec)\n", "INFO:tensorflow:global_step/sec: 216.343\n", "INFO:tensorflow:loss = 1.1178868, step = 2280 (0.446 sec)\n", "INFO:tensorflow:global_step/sec: 224.158\n", "INFO:tensorflow:loss = 0.9965202, step = 2380 (0.442 sec)\n", "INFO:tensorflow:global_step/sec: 216.427\n", "INFO:tensorflow:loss = 1.9913646, step = 2480 (0.474 sec)\n", "INFO:tensorflow:global_step/sec: 218.691\n", "INFO:tensorflow:loss = 0.7251757, step = 2580 (0.443 sec)\n", "INFO:tensorflow:global_step/sec: 225.747\n", "INFO:tensorflow:loss = 0.3651243, step = 2680 (0.851 sec)\n", "INFO:tensorflow:global_step/sec: 105.26\n", "INFO:tensorflow:loss = 0.6829959, step = 2780 (0.668 sec)\n", "INFO:tensorflow:global_step/sec: 176.28\n", "INFO:tensorflow:loss = 1.2585962, step = 2880 (0.959 sec)\n", "INFO:tensorflow:global_step/sec: 92.7365\n", "INFO:tensorflow:loss = 0.713354, step = 2980 (0.614 sec)\n", "INFO:tensorflow:global_step/sec: 193.932\n", "INFO:tensorflow:loss = 0.73630756, step = 3080 (0.966 sec)\n", "INFO:tensorflow:global_step/sec: 98.8495\n", "INFO:tensorflow:loss = 0.43729934, step = 3180 (0.545 sec)\n", "INFO:tensorflow:global_step/sec: 205.66\n", "INFO:tensorflow:loss = 0.780161, step = 3280 (0.458 sec)\n", "INFO:tensorflow:global_step/sec: 220.968\n", "INFO:tensorflow:loss = 0.9817555, step = 3380 (0.474 sec)\n", "INFO:tensorflow:global_step/sec: 210.652\n", "INFO:tensorflow:loss = 0.4174361, step = 3480 (0.450 sec)\n", "INFO:tensorflow:global_step/sec: 223.471\n", "INFO:tensorflow:loss = 0.34950867, step = 3580 (0.459 sec)\n", "INFO:tensorflow:global_step/sec: 216.451\n", "INFO:tensorflow:loss = 0.2061396, step = 3680 (0.447 sec)\n", "INFO:tensorflow:global_step/sec: 224.604\n", "INFO:tensorflow:loss = 0.4162572, step = 3780 (0.462 sec)\n", "INFO:tensorflow:global_step/sec: 215.669\n", "INFO:tensorflow:loss = 0.7756387, step = 3880 (0.453 sec)\n", "INFO:tensorflow:global_step/sec: 221.95\n", "INFO:tensorflow:loss = 0.5983211, step = 3980 (0.450 sec)\n", "INFO:tensorflow:global_step/sec: 217.645\n", "INFO:tensorflow:loss = 0.67728513, step = 4080 (0.464 sec)\n", "INFO:tensorflow:global_step/sec: 219.419\n", "INFO:tensorflow:loss = 0.27105936, step = 4180 (0.447 sec)\n", "INFO:tensorflow:global_step/sec: 222.248\n", "INFO:tensorflow:loss = 0.8645248, step = 4280 (0.453 sec)\n", "INFO:tensorflow:global_step/sec: 221.139\n", "INFO:tensorflow:loss = 0.3688935, step = 4380 (0.447 sec)\n", "INFO:tensorflow:global_step/sec: 222.69\n", "INFO:tensorflow:loss = 0.1230904, step = 4480 (0.480 sec)\n", "INFO:tensorflow:global_step/sec: 210.111\n", "INFO:tensorflow:loss = 0.4384833, step = 4580 (0.459 sec)\n", "INFO:tensorflow:global_step/sec: 218.984\n", "INFO:tensorflow:loss = 0.2775449, step = 4680 (0.465 sec)\n", "INFO:tensorflow:global_step/sec: 214.691\n", "INFO:tensorflow:loss = 0.51141137, step = 4780 (0.459 sec)\n", "INFO:tensorflow:global_step/sec: 215.917\n", "INFO:tensorflow:loss = 0.14138478, step = 4880 (0.467 sec)\n", "INFO:tensorflow:global_step/sec: 216.003\n", "INFO:tensorflow:loss = 0.38507292, step = 4980 (0.448 sec)\n", "INFO:tensorflow:global_step/sec: 217.863\n", "INFO:tensorflow:loss = 0.69141936, step = 5080 (0.471 sec)\n", "INFO:tensorflow:global_step/sec: 212.865\n", "INFO:tensorflow:loss = 0.3014815, step = 5180 (0.465 sec)\n", "INFO:tensorflow:global_step/sec: 219.085\n", "INFO:tensorflow:loss = 0.73166424, step = 5280 (0.458 sec)\n", "INFO:tensorflow:global_step/sec: 219.263\n", "INFO:tensorflow:loss = 0.3473918, step = 5380 (0.464 sec)\n", "INFO:tensorflow:global_step/sec: 212.22\n", "INFO:tensorflow:loss = 0.16817072, step = 5480 (0.458 sec)\n", "INFO:tensorflow:global_step/sec: 218.715\n", "INFO:tensorflow:loss = 0.21869558, step = 5580 (0.472 sec)\n", "INFO:tensorflow:global_step/sec: 213.859\n", "INFO:tensorflow:loss = 0.18171437, step = 5680 (0.480 sec)\n", "INFO:tensorflow:global_step/sec: 207.612\n", "INFO:tensorflow:loss = 0.2261396, step = 5780 (0.480 sec)\n", "INFO:tensorflow:global_step/sec: 208.395\n", "INFO:tensorflow:loss = 0.20207018, step = 5880 (0.458 sec)\n", "INFO:tensorflow:global_step/sec: 218.058\n", "INFO:tensorflow:loss = 0.1673903, step = 5980 (0.470 sec)\n", "INFO:tensorflow:global_step/sec: 213.074\n", "INFO:tensorflow:loss = 0.19930236, step = 6080 (0.453 sec)\n", "INFO:tensorflow:global_step/sec: 222.172\n", "INFO:tensorflow:loss = 0.22259659, step = 6180 (0.464 sec)\n", "INFO:tensorflow:global_step/sec: 211.186\n", "INFO:tensorflow:loss = 0.111403264, step = 6280 (0.475 sec)\n", "INFO:tensorflow:global_step/sec: 215.759\n", "INFO:tensorflow:loss = 0.45827308, step = 6380 (0.460 sec)\n", "INFO:tensorflow:global_step/sec: 215.111\n", "INFO:tensorflow:loss = 0.11738847, step = 6480 (0.484 sec)\n", "INFO:tensorflow:global_step/sec: 202.115\n", "INFO:tensorflow:loss = 0.30969933, step = 6580 (0.472 sec)\n", "INFO:tensorflow:global_step/sec: 215.245\n", "INFO:tensorflow:loss = 0.16219021, step = 6680 (0.470 sec)\n", "INFO:tensorflow:global_step/sec: 214.311\n", "INFO:tensorflow:loss = 0.057941448, step = 6780 (0.471 sec)\n", "INFO:tensorflow:global_step/sec: 213.322\n", "INFO:tensorflow:loss = 0.050147314, step = 6880 (0.481 sec)\n", "INFO:tensorflow:global_step/sec: 207.137\n", "INFO:tensorflow:loss = 0.122599855, step = 6980 (0.472 sec)\n", "INFO:tensorflow:global_step/sec: 212.018\n", "INFO:tensorflow:loss = 0.16145848, step = 7080 (0.479 sec)\n", "INFO:tensorflow:global_step/sec: 209.911\n", "INFO:tensorflow:loss = 0.093206406, step = 7180 (0.464 sec)\n", "INFO:tensorflow:global_step/sec: 212.862\n", "INFO:tensorflow:loss = 0.16239843, step = 7280 (0.475 sec)\n", "INFO:tensorflow:global_step/sec: 211.546\n", "INFO:tensorflow:loss = 0.10595548, step = 7380 (0.459 sec)\n", "INFO:tensorflow:global_step/sec: 217.566\n", "INFO:tensorflow:loss = 0.072357595, step = 7480 (0.477 sec)\n", "INFO:tensorflow:global_step/sec: 210.507\n", "INFO:tensorflow:loss = 0.06852858, step = 7580 (0.477 sec)\n", "INFO:tensorflow:global_step/sec: 207.224\n", "INFO:tensorflow:loss = 0.2187958, step = 7680 (0.486 sec)\n", "INFO:tensorflow:global_step/sec: 203.425\n", "INFO:tensorflow:loss = 0.12078498, step = 7780 (0.472 sec)\n", "INFO:tensorflow:global_step/sec: 214.418\n", "INFO:tensorflow:loss = 0.08954671, step = 7880 (0.499 sec)\n", "INFO:tensorflow:global_step/sec: 196.937\n", "INFO:tensorflow:loss = 0.059539113, step = 7980 (0.479 sec)\n", "INFO:tensorflow:global_step/sec: 214.331\n", "INFO:tensorflow:loss = 0.064551175, step = 8080 (0.471 sec)\n", "INFO:tensorflow:global_step/sec: 212.534\n", "INFO:tensorflow:loss = 0.09451306, step = 8180 (0.476 sec)\n", "INFO:tensorflow:global_step/sec: 210.178\n", "INFO:tensorflow:loss = 0.05338911, step = 8280 (0.479 sec)\n", "INFO:tensorflow:global_step/sec: 208.605\n", "INFO:tensorflow:loss = 0.054043185, step = 8380 (0.474 sec)\n", "INFO:tensorflow:global_step/sec: 208.507\n", "INFO:tensorflow:loss = 0.08476552, step = 8480 (0.466 sec)\n", "INFO:tensorflow:global_step/sec: 216.703\n", "INFO:tensorflow:loss = 0.067879364, step = 8580 (0.485 sec)\n", "INFO:tensorflow:global_step/sec: 206.386\n", "INFO:tensorflow:loss = 0.06005768, step = 8680 (0.472 sec)\n", "INFO:tensorflow:global_step/sec: 211.513\n", "INFO:tensorflow:loss = 0.033881374, step = 8780 (0.474 sec)\n", "INFO:tensorflow:global_step/sec: 211.947\n", "INFO:tensorflow:loss = 0.05941634, step = 8880 (0.467 sec)\n", "INFO:tensorflow:global_step/sec: 213.876\n", "INFO:tensorflow:loss = 0.057237647, step = 8980 (0.475 sec)\n", "INFO:tensorflow:global_step/sec: 207.603\n", "INFO:tensorflow:loss = 0.02990023, step = 9080 (0.482 sec)\n", "INFO:tensorflow:global_step/sec: 202.708\n", "INFO:tensorflow:loss = 0.13230202, step = 9180 (0.496 sec)\n", "INFO:tensorflow:global_step/sec: 208.125\n", "INFO:tensorflow:loss = 0.026092524, step = 9280 (0.461 sec)\n", "INFO:tensorflow:global_step/sec: 215.078\n", "INFO:tensorflow:loss = 0.060495723, step = 9380 (0.473 sec)\n", "INFO:tensorflow:global_step/sec: 210.1\n", "INFO:tensorflow:loss = 0.06297326, step = 9480 (0.483 sec)\n", "INFO:tensorflow:global_step/sec: 210.147\n", "INFO:tensorflow:loss = 0.072230384, step = 9580 (0.467 sec)\n", "INFO:tensorflow:global_step/sec: 213.141\n", "INFO:tensorflow:loss = 0.059191234, step = 9680 (0.482 sec)\n", "INFO:tensorflow:global_step/sec: 207.748\n", "INFO:tensorflow:loss = 0.036093883, step = 9780 (0.477 sec)\n", "INFO:tensorflow:global_step/sec: 211.288\n", "INFO:tensorflow:loss = 0.010315346, step = 9880 (0.479 sec)\n", "INFO:tensorflow:global_step/sec: 208.976\n", "INFO:tensorflow:loss = 0.038313873, step = 9980 (0.470 sec)\n", "INFO:tensorflow:global_step/sec: 211.987\n", "INFO:tensorflow:loss = 0.07553963, step = 10080 (0.493 sec)\n", "INFO:tensorflow:global_step/sec: 203.866\n", "INFO:tensorflow:loss = 0.06943573, step = 10180 (0.478 sec)\n", "INFO:tensorflow:global_step/sec: 207.251\n", "INFO:tensorflow:loss = 0.03832016, step = 10280 (0.492 sec)\n", "INFO:tensorflow:global_step/sec: 201.966\n", "INFO:tensorflow:loss = 0.073557906, step = 10380 (0.482 sec)\n", "INFO:tensorflow:global_step/sec: 206.79\n", "INFO:tensorflow:loss = 0.033035275, step = 10480 (0.485 sec)\n", "INFO:tensorflow:global_step/sec: 208.894\n", "INFO:tensorflow:loss = 0.016407736, step = 10580 (0.470 sec)\n", "INFO:tensorflow:global_step/sec: 210.236\n", "INFO:tensorflow:loss = 0.020986933, step = 10680 (0.481 sec)\n", "INFO:tensorflow:global_step/sec: 211.355\n", "INFO:tensorflow:loss = 0.03199364, step = 10780 (0.469 sec)\n", "INFO:tensorflow:global_step/sec: 207.11\n", "INFO:tensorflow:loss = 0.024187505, step = 10880 (0.492 sec)\n", "INFO:tensorflow:global_step/sec: 207.031\n", "INFO:tensorflow:loss = 0.039492976, step = 10980 (0.489 sec)\n", "INFO:tensorflow:global_step/sec: 205.05\n", "INFO:tensorflow:loss = 0.009173639, step = 11080 (0.474 sec)\n", "INFO:tensorflow:global_step/sec: 205.622\n", "INFO:tensorflow:loss = 0.016640125, step = 11180 (0.482 sec)\n", "INFO:tensorflow:global_step/sec: 213.733\n", "INFO:tensorflow:loss = 0.026708333, step = 11280 (0.472 sec)\n", "INFO:tensorflow:global_step/sec: 208.608\n", "INFO:tensorflow:loss = 0.020799056, step = 11380 (0.480 sec)\n", "INFO:tensorflow:global_step/sec: 209.042\n", "INFO:tensorflow:loss = 0.009672264, step = 11480 (0.471 sec)\n", "INFO:tensorflow:global_step/sec: 213.388\n", "INFO:tensorflow:loss = 0.037598006, step = 11580 (0.484 sec)\n", "INFO:tensorflow:global_step/sec: 206.809\n", "INFO:tensorflow:loss = 0.011837823, step = 11680 (0.484 sec)\n", "INFO:tensorflow:global_step/sec: 207.419\n", "INFO:tensorflow:loss = 0.01758483, step = 11780 (0.479 sec)\n", "INFO:tensorflow:global_step/sec: 207.973\n", "INFO:tensorflow:loss = 0.010002964, step = 11880 (0.469 sec)\n", "INFO:tensorflow:global_step/sec: 213.517\n", "INFO:tensorflow:loss = 0.026136518, step = 11980 (0.487 sec)\n", "INFO:tensorflow:global_step/sec: 201.526\n", "INFO:tensorflow:loss = 0.014055295, step = 12080 (0.498 sec)\n", "INFO:tensorflow:global_step/sec: 204.829\n", "INFO:tensorflow:loss = 0.019798817, step = 12180 (0.480 sec)\n", "INFO:tensorflow:global_step/sec: 204.865\n", "INFO:tensorflow:loss = 0.02431019, step = 12280 (0.525 sec)\n", "INFO:tensorflow:global_step/sec: 193.696\n", "INFO:tensorflow:loss = 0.044845037, step = 12380 (0.486 sec)\n", "INFO:tensorflow:global_step/sec: 202.731\n", "INFO:tensorflow:loss = 0.016120337, step = 12480 (0.483 sec)\n", "INFO:tensorflow:global_step/sec: 208.863\n", "INFO:tensorflow:loss = 0.01512509, step = 12580 (0.483 sec)\n", "INFO:tensorflow:global_step/sec: 205.633\n", "INFO:tensorflow:loss = 0.010137366, step = 12680 (0.479 sec)\n", "INFO:tensorflow:global_step/sec: 208.972\n", "INFO:tensorflow:loss = 0.011791935, step = 12780 (0.493 sec)\n", "INFO:tensorflow:global_step/sec: 204.99\n", "INFO:tensorflow:loss = 0.019709203, step = 12880 (0.477 sec)\n", "INFO:tensorflow:global_step/sec: 209.61\n", "INFO:tensorflow:loss = 0.015359176, step = 12980 (0.489 sec)\n", "INFO:tensorflow:global_step/sec: 205.272\n", "INFO:tensorflow:loss = 0.0067172586, step = 13080 (0.491 sec)\n", "INFO:tensorflow:global_step/sec: 203.89\n", "INFO:tensorflow:loss = 0.016199274, step = 13180 (0.465 sec)\n", "INFO:tensorflow:global_step/sec: 210.507\n", "INFO:tensorflow:loss = 0.009473262, step = 13280 (0.485 sec)\n", "INFO:tensorflow:global_step/sec: 209.404\n", "INFO:tensorflow:loss = 0.009215506, step = 13380 (0.471 sec)\n", "INFO:tensorflow:global_step/sec: 207.142\n", "INFO:tensorflow:loss = 0.024180822, step = 13480 (0.499 sec)\n", "INFO:tensorflow:global_step/sec: 206.038\n", "INFO:tensorflow:loss = 0.0057633584, step = 13580 (0.473 sec)\n", "INFO:tensorflow:global_step/sec: 208.685\n", "INFO:tensorflow:loss = 0.016087279, step = 13680 (0.500 sec)\n", "INFO:tensorflow:global_step/sec: 201.122\n", "INFO:tensorflow:loss = 0.011232584, step = 13780 (0.477 sec)\n", "INFO:tensorflow:global_step/sec: 208.529\n", "INFO:tensorflow:loss = 0.0051534306, step = 13880 (0.501 sec)\n", "INFO:tensorflow:global_step/sec: 201.129\n", "INFO:tensorflow:loss = 0.001830505, step = 13980 (0.485 sec)\n", "INFO:tensorflow:global_step/sec: 206.924\n", "INFO:tensorflow:loss = 0.0053134295, step = 14080 (0.488 sec)\n", "INFO:tensorflow:global_step/sec: 204.325\n", "INFO:tensorflow:loss = 0.008606601, step = 14180 (0.473 sec)\n", "INFO:tensorflow:global_step/sec: 212.197\n", "INFO:tensorflow:loss = 0.0043740296, step = 14280 (0.485 sec)\n", "INFO:tensorflow:global_step/sec: 203.688\n", "INFO:tensorflow:loss = 0.015767906, step = 14380 (0.475 sec)\n", "INFO:tensorflow:global_step/sec: 212.424\n", "INFO:tensorflow:loss = 0.013907417, step = 14480 (0.505 sec)\n", "INFO:tensorflow:global_step/sec: 197.675\n", "INFO:tensorflow:loss = 0.01125269, step = 14580 (0.479 sec)\n", "INFO:tensorflow:global_step/sec: 210.755\n", "INFO:tensorflow:loss = 0.0032652824, step = 14680 (0.489 sec)\n", "INFO:tensorflow:global_step/sec: 204.071\n", "INFO:tensorflow:loss = 0.0069463598, step = 14780 (0.493 sec)\n", "INFO:tensorflow:global_step/sec: 204.282\n", "INFO:tensorflow:loss = 0.012265051, step = 14880 (0.484 sec)\n", "INFO:tensorflow:global_step/sec: 205.165\n", "INFO:tensorflow:loss = 0.0027184403, step = 14980 (0.476 sec)\n", "INFO:tensorflow:global_step/sec: 209.002\n", "INFO:tensorflow:loss = 0.004181682, step = 15080 (0.483 sec)\n", "INFO:tensorflow:global_step/sec: 203.594\n", "INFO:tensorflow:loss = 0.0046712644, step = 15180 (0.492 sec)\n", "INFO:tensorflow:global_step/sec: 207.242\n", "INFO:tensorflow:loss = 0.003824675, step = 15280 (0.480 sec)\n", "INFO:tensorflow:global_step/sec: 199.311\n", "INFO:tensorflow:loss = 0.0025618752, step = 15380 (0.517 sec)\n", "INFO:tensorflow:global_step/sec: 201.66\n", "INFO:tensorflow:loss = 0.009708263, step = 15480 (0.486 sec)\n", "INFO:tensorflow:global_step/sec: 200.707\n", "INFO:tensorflow:loss = 0.010694781, step = 15580 (0.497 sec)\n", "INFO:tensorflow:global_step/sec: 205.922\n", "INFO:tensorflow:loss = 0.00828812, step = 15680 (0.481 sec)\n", "INFO:tensorflow:global_step/sec: 202.158\n", "INFO:tensorflow:loss = 0.0045329295, step = 15780 (0.495 sec)\n", "INFO:tensorflow:global_step/sec: 208.623\n", "INFO:tensorflow:loss = 0.009527046, step = 15880 (0.479 sec)\n", "INFO:tensorflow:global_step/sec: 208.905\n", "INFO:tensorflow:loss = 0.00497582, step = 15980 (0.495 sec)\n", "INFO:tensorflow:global_step/sec: 200.514\n", "INFO:tensorflow:loss = 0.004362338, step = 16080 (0.481 sec)\n", "INFO:tensorflow:global_step/sec: 211.32\n", "INFO:tensorflow:loss = 0.0031403105, step = 16180 (0.498 sec)\n", "INFO:tensorflow:global_step/sec: 198.002\n", "INFO:tensorflow:loss = 0.0072610653, step = 16280 (0.475 sec)\n", "INFO:tensorflow:global_step/sec: 211.231\n", "INFO:tensorflow:loss = 0.003275363, step = 16380 (0.496 sec)\n", "INFO:tensorflow:global_step/sec: 202.565\n", "INFO:tensorflow:loss = 0.004974664, step = 16480 (0.475 sec)\n", "INFO:tensorflow:global_step/sec: 209.879\n", "INFO:tensorflow:loss = 0.002192147, step = 16580 (0.502 sec)\n", "INFO:tensorflow:global_step/sec: 200.361\n", "INFO:tensorflow:loss = 0.0030089444, step = 16680 (0.487 sec)\n", "INFO:tensorflow:global_step/sec: 205.124\n", "INFO:tensorflow:loss = 0.0029668491, step = 16780 (0.501 sec)\n", "INFO:tensorflow:global_step/sec: 195.989\n", "INFO:tensorflow:loss = 0.00064637186, step = 16880 (0.482 sec)\n", "INFO:tensorflow:global_step/sec: 208.723\n", "INFO:tensorflow:loss = 0.010118947, step = 16980 (0.502 sec)\n", "INFO:tensorflow:global_step/sec: 199.716\n", "INFO:tensorflow:loss = 0.0029406087, step = 17080 (0.481 sec)\n", "INFO:tensorflow:global_step/sec: 207.768\n", "INFO:tensorflow:loss = 0.0026923874, step = 17180 (0.511 sec)\n", "INFO:tensorflow:global_step/sec: 197.44\n", "INFO:tensorflow:loss = 0.0010737382, step = 17280 (0.491 sec)\n", "INFO:tensorflow:global_step/sec: 204.367\n", "INFO:tensorflow:loss = 0.002681211, step = 17380 (0.497 sec)\n", "INFO:tensorflow:global_step/sec: 199.592\n", "INFO:tensorflow:loss = 0.00994407, step = 17480 (0.484 sec)\n", "INFO:tensorflow:global_step/sec: 205.791\n", "INFO:tensorflow:loss = 0.002264757, step = 17580 (0.500 sec)\n", "INFO:tensorflow:global_step/sec: 201.546\n", "INFO:tensorflow:loss = 0.0043665757, step = 17680 (0.485 sec)\n", "INFO:tensorflow:global_step/sec: 206.712\n", "INFO:tensorflow:loss = 0.0034828947, step = 17780 (0.501 sec)\n", "INFO:tensorflow:global_step/sec: 195.254\n", "INFO:tensorflow:loss = 0.0030491385, step = 17880 (0.497 sec)\n", "INFO:tensorflow:global_step/sec: 201.04\n", "INFO:tensorflow:loss = 0.001812386, step = 17980 (0.509 sec)\n", "INFO:tensorflow:global_step/sec: 199.707\n", "INFO:tensorflow:loss = 0.0014632049, step = 18080 (0.481 sec)\n", "INFO:tensorflow:global_step/sec: 207.792\n", "INFO:tensorflow:loss = 0.002133291, step = 18180 (0.509 sec)\n", "INFO:tensorflow:global_step/sec: 195.638\n", "INFO:tensorflow:loss = 0.00054716505, step = 18280 (0.488 sec)\n", "INFO:tensorflow:global_step/sec: 207.308\n", "INFO:tensorflow:loss = 0.0010584778, step = 18380 (0.498 sec)\n", "INFO:tensorflow:global_step/sec: 200.173\n", "INFO:tensorflow:loss = 0.00017813517, step = 18480 (0.491 sec)\n", "INFO:tensorflow:global_step/sec: 201.472\n", "INFO:tensorflow:loss = 0.0025510017, step = 18580 (0.491 sec)\n", "INFO:tensorflow:global_step/sec: 199.899\n", "INFO:tensorflow:loss = 0.0027081082, step = 18680 (0.495 sec)\n", "INFO:tensorflow:global_step/sec: 207.121\n", "INFO:tensorflow:loss = 0.001387673, step = 18780 (0.496 sec)\n", "INFO:tensorflow:global_step/sec: 194.955\n", "INFO:tensorflow:loss = 0.0013421192, step = 18880 (0.507 sec)\n", "INFO:tensorflow:global_step/sec: 204.933\n", "INFO:tensorflow:loss = 0.0007783506, step = 18980 (0.495 sec)\n", "INFO:tensorflow:global_step/sec: 197.781\n", "INFO:tensorflow:loss = 0.00052562193, step = 19080 (0.500 sec)\n", "INFO:tensorflow:global_step/sec: 202.163\n", "INFO:tensorflow:loss = 0.0017197155, step = 19180 (0.493 sec)\n", "INFO:tensorflow:global_step/sec: 198.069\n", "INFO:tensorflow:loss = 0.002417413, step = 19280 (0.501 sec)\n", "INFO:tensorflow:global_step/sec: 206.875\n", "INFO:tensorflow:loss = 0.001412559, step = 19380 (0.499 sec)\n", "INFO:tensorflow:global_step/sec: 200.044\n", "INFO:tensorflow:loss = 0.0014356391, step = 19480 (0.496 sec)\n", "INFO:tensorflow:global_step/sec: 199.529\n", "INFO:tensorflow:loss = 0.0023009388, step = 19580 (0.497 sec)\n", "INFO:tensorflow:global_step/sec: 203.195\n", "INFO:tensorflow:loss = 0.00047729828, step = 19680 (0.502 sec)\n", "INFO:tensorflow:global_step/sec: 198.22\n", "INFO:tensorflow:loss = 0.0017033746, step = 19780 (0.496 sec)\n", "INFO:tensorflow:global_step/sec: 201.129\n", "INFO:tensorflow:loss = 0.00093277363, step = 19880 (0.499 sec)\n", "INFO:tensorflow:global_step/sec: 200.672\n", "INFO:tensorflow:loss = 0.0011551518, step = 19980 (0.498 sec)\n", "INFO:tensorflow:global_step/sec: 201.603\n", "INFO:tensorflow:loss = 0.0008106844, step = 20080 (0.508 sec)\n", "INFO:tensorflow:global_step/sec: 197.273\n", "INFO:tensorflow:loss = 0.00078337395, step = 20180 (0.501 sec)\n", "INFO:tensorflow:global_step/sec: 198.999\n", "INFO:tensorflow:loss = 0.0006026571, step = 20280 (0.501 sec)\n", "INFO:tensorflow:global_step/sec: 198.584\n", "INFO:tensorflow:loss = 0.001087544, step = 20380 (0.494 sec)\n", "INFO:tensorflow:global_step/sec: 202.666\n", "INFO:tensorflow:loss = 0.0013143616, step = 20480 (0.503 sec)\n", "INFO:tensorflow:global_step/sec: 198.363\n", "INFO:tensorflow:loss = 0.0013403151, step = 20580 (0.515 sec)\n", "INFO:tensorflow:global_step/sec: 194.668\n", "INFO:tensorflow:loss = 0.00033145832, step = 20680 (0.497 sec)\n", "INFO:tensorflow:global_step/sec: 202.926\n", "INFO:tensorflow:loss = 0.0006547819, step = 20780 (0.502 sec)\n", "INFO:tensorflow:global_step/sec: 198.73\n", "INFO:tensorflow:loss = 0.0015867853, step = 20880 (0.497 sec)\n", "INFO:tensorflow:global_step/sec: 200.677\n", "INFO:tensorflow:loss = 0.0002727672, step = 20980 (0.493 sec)\n", "INFO:tensorflow:global_step/sec: 201.697\n", "INFO:tensorflow:loss = 0.0005815914, step = 21080 (0.496 sec)\n", "INFO:tensorflow:global_step/sec: 199.282\n", "INFO:tensorflow:loss = 0.0008792831, step = 21180 (0.513 sec)\n", "INFO:tensorflow:global_step/sec: 197.025\n", "INFO:tensorflow:loss = 0.0005078574, step = 21280 (0.507 sec)\n", "INFO:tensorflow:global_step/sec: 199.3\n", "INFO:tensorflow:loss = 0.0014644307, step = 21380 (0.502 sec)\n", "INFO:tensorflow:global_step/sec: 194.585\n", "INFO:tensorflow:loss = 0.00096290756, step = 21480 (0.515 sec)\n", "INFO:tensorflow:global_step/sec: 196.076\n", "INFO:tensorflow:loss = 0.0006970129, step = 21580 (0.520 sec)\n", "INFO:tensorflow:global_step/sec: 192.024\n", "INFO:tensorflow:loss = 0.0009132192, step = 21680 (0.513 sec)\n", "INFO:tensorflow:global_step/sec: 194.249\n", "INFO:tensorflow:loss = 0.0007954323, step = 21780 (0.504 sec)\n", "INFO:tensorflow:global_step/sec: 200.84\n", "INFO:tensorflow:loss = 0.00041834678, step = 21880 (0.505 sec)\n", "INFO:tensorflow:global_step/sec: 197.18\n", "INFO:tensorflow:loss = 0.0003101712, step = 21980 (0.514 sec)\n", "INFO:tensorflow:global_step/sec: 195.604\n", "INFO:tensorflow:loss = 0.0005693605, step = 22080 (0.501 sec)\n", "INFO:tensorflow:global_step/sec: 197.445\n", "INFO:tensorflow:loss = 0.0016302168, step = 22180 (0.502 sec)\n", "INFO:tensorflow:global_step/sec: 199.322\n", "INFO:tensorflow:loss = 0.0005263687, step = 22280 (0.515 sec)\n", "INFO:tensorflow:global_step/sec: 194.494\n", "INFO:tensorflow:loss = 0.0003867588, step = 22380 (0.516 sec)\n", "INFO:tensorflow:global_step/sec: 193.965\n", "INFO:tensorflow:loss = 0.00023681414, step = 22480 (0.505 sec)\n", "INFO:tensorflow:global_step/sec: 197.778\n", "INFO:tensorflow:loss = 0.0002933269, step = 22580 (0.515 sec)\n", "INFO:tensorflow:global_step/sec: 194.329\n", "INFO:tensorflow:loss = 0.00044774357, step = 22680 (0.508 sec)\n", "INFO:tensorflow:global_step/sec: 197.493\n", "INFO:tensorflow:loss = 0.0005453555, step = 22780 (0.498 sec)\n", "INFO:tensorflow:global_step/sec: 199.828\n", "INFO:tensorflow:loss = 0.0004744119, step = 22880 (0.511 sec)\n", "INFO:tensorflow:global_step/sec: 195.887\n", "INFO:tensorflow:loss = 0.0004988988, step = 22980 (0.511 sec)\n", "INFO:tensorflow:global_step/sec: 195.688\n", "INFO:tensorflow:loss = 0.00028212756, step = 23080 (0.512 sec)\n", "INFO:tensorflow:global_step/sec: 195.408\n", "INFO:tensorflow:loss = 0.00031696315, step = 23180 (0.521 sec)\n", "INFO:tensorflow:global_step/sec: 184.674\n", "INFO:tensorflow:loss = 0.00015678698, step = 23280 (0.536 sec)\n", "INFO:tensorflow:global_step/sec: 194.371\n", "INFO:tensorflow:loss = 0.000784349, step = 23380 (0.505 sec)\n", "INFO:tensorflow:global_step/sec: 197.18\n", "INFO:tensorflow:loss = 0.00054657116, step = 23480 (0.519 sec)\n", "INFO:tensorflow:global_step/sec: 192.129\n", "INFO:tensorflow:loss = 0.00018126283, step = 23580 (0.512 sec)\n", "INFO:tensorflow:global_step/sec: 196.904\n", "INFO:tensorflow:loss = 0.0002742348, step = 23680 (0.528 sec)\n", "INFO:tensorflow:global_step/sec: 187.025\n", "INFO:tensorflow:loss = 0.00019303239, step = 23780 (0.517 sec)\n", "INFO:tensorflow:global_step/sec: 195.965\n", "INFO:tensorflow:loss = 0.00022270979, step = 23880 (0.525 sec)\n", "INFO:tensorflow:global_step/sec: 184.162\n", "INFO:tensorflow:loss = 0.00015774262, step = 23980 (0.552 sec)\n", "INFO:tensorflow:global_step/sec: 179.965\n", "INFO:tensorflow:Calling checkpoint listeners before saving checkpoint 24000...\n", "INFO:tensorflow:Saving checkpoints for 24000 into /tmp/tmpkt_mgjm2/model.ckpt.\n", "WARNING:tensorflow:Issue encountered when serializing resources.\n", "Type is unsupported, or the types of the items don't match field type in CollectionDef. Note this is a warning and probably safe to ignore.\n", "'_Resource' object has no attribute 'name'\n", "INFO:tensorflow:Calling checkpoint listeners after saving checkpoint 24000...\n", "INFO:tensorflow:Loss for final step: 0.00042771612.\n", "INFO:tensorflow:Calling model_fn.\n", "INFO:tensorflow:Done calling model_fn.\n", "INFO:tensorflow:Starting evaluation at 2022-07-29T03:41:05\n", "INFO:tensorflow:Graph was finalized.\n", "INFO:tensorflow:Restoring parameters from /tmp/tmpkt_mgjm2/model.ckpt-24000\n", "INFO:tensorflow:Running local_init_op.\n", "INFO:tensorflow:Done running local_init_op.\n", "INFO:tensorflow:Inference Time : 0.27246s\n", "INFO:tensorflow:Finished evaluation at 2022-07-29-03:41:05\n", "INFO:tensorflow:Saving dict for global step 24000: average_loss = 13.208195, global_step = 24000, label/mean = 23.611391, loss = 13.109375, prediction/mean = 22.630728\n", "WARNING:tensorflow:Issue encountered when serializing resources.\n", "Type is unsupported, or the types of the items don't match field type in CollectionDef. Note this is a warning and probably safe to ignore.\n", "'_Resource' object has no attribute 'name'\n", "INFO:tensorflow:Saving 'checkpoint_path' summary for global step 24000: /tmp/tmpkt_mgjm2/model.ckpt-24000\n", "{'average_loss': 13.208195, 'label/mean': 23.611391, 'loss': 13.109375, 'prediction/mean': 22.630728, 'global_step': 24000}\n", "평균 손실 13.2082\n" ] } ], "source": [ "boosted_tree = tf.estimator.BoostedTreesRegressor(\n", " feature_columns=all_feature_columns,\n", " n_batches_per_layer=20,\n", " n_trees=200)\n", "\n", "boosted_tree.train(\n", " input_fn=lambda:train_input_fn(df_train_norm, batch_size=BATCH_SIZE))\n", "\n", "eval_results = boosted_tree.evaluate(\n", " input_fn=lambda:eval_input_fn(df_test_norm, batch_size=8))\n", "\n", "print(eval_results)\n", "\n", "print('평균 손실 {:.4f}'.format(eval_results['average_loss']))" ] } ], "metadata": { "accelerator": "GPU", "colab": { "name": "ch14_part2.ipynb", "provenance": [] }, "kernelspec": { "display_name": "Python 3", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.7.3" } }, "nbformat": 4, "nbformat_minor": 0 }