{ "metadata": { "name": "", "signature": "sha256:0f0d3b8e79cd355377c21e020a568bb6fb8c42170405b4e1f23b951823796be0" }, "nbformat": 3, "nbformat_minor": 0, "worksheets": [ { "cells": [ { "cell_type": "markdown", "metadata": {}, "source": [ "# Data Wrangling\n", "\n", "For some large scale buildings in Harvard, there are three types energy consumption, electricity, chilled water and steam. Chilled water is for cooling and steam is for heating. The following figure shows the buildings with chilled water and steam supply from Harvard plants.\n", "\n", "\n", "
Fig. Harvard chilled water and steam supply. (Left: chilled water, highlighted in blue. Right: Steam, highlighted in yellow.)
\n", "Image source: Harvard University Campus Service\n", "\n", "We picked one building and got energy consumption data from 2011/07/01 to 2014/10/31. There are several months data missing due to meter malfunction. The data resolution is hourly. In original data, the hourly data is meter readings. So in order to get hourly consumption, we need to offset the data and do the minus. We have hourly data from January 2012 to October 2014 for both weather and energy (2.75 years). The weather data is from weather stations in Cambridge. \n", "\n", "---\n", "In this section, we are going to finish the following tasks.\n", "\n", "1. Get hourly electricity, chilled water and steam from the original data downloaded from Harvard Energy Witness website manually.\n", "\n", "2. Clean weather data, add more features including cooling degrees, heating degress and humidity ratio.\n", "\n", "3. Estimate daily occupancy based on holidays, school year and weekends.\n", "\n", "4. Create features reletate to hour, which is cos(hourOfDay * 2 * pi / 24).\n", "\n", "5. Merge electricity, chilled water and steam dataframe with weather and time and occupancy features." ] }, { "cell_type": "code", "collapsed": false, "input": [ "%matplotlib inline \n", "\n", "import requests \n", "from StringIO import StringIO\n", "import numpy as np\n", "import pandas as pd # pandas\n", "import matplotlib.pyplot as plt # module for plotting \n", "import datetime as dt # module for manipulating dates and times\n", "import numpy.linalg as lin # module for performing linear algebra operations\n", "from __future__ import division\n", "from math import log10,exp\n", "\n", "pd.options.display.mpl_style = 'default'" ], "language": "python", "metadata": {}, "outputs": [], "prompt_number": 1 }, { "cell_type": "markdown", "metadata": {}, "source": [ "## Original Energy Consumption Data\n", "\n", "Original data are downloaded from Harvard Energy Witness Website\n", "\n", "\n", "\n", "Then we use Pandas to put them together into one dataframe.\n" ] }, { "cell_type": "code", "collapsed": false, "input": [ "file = 'Data/Org/0701-0930-2011.xls' \n", "df = pd.read_excel(file, header = 0, skiprows = np.arange(0,6))\n", "\n", "files = ['Data/Org/1101-1130-2011.xls', 'Data/Org/1201-2011-0131-2012.xls',\n", " 'Data/Org/0201-0331-2012.xls','Data/Org/0401-0531-2012.xls','Data/Org/0601-0630-2012.xls',\n", " 'Data/Org/0701-0831-2012.xls','Data/Org/0901-1031-2012.xls','Data/Org/1101-1231-2012.xls',\n", " 'Data/Org/0101-0228-2013.xls',\n", " 'Data/Org/0301-0430-2013.xls','Data/Org/0501-0630-2013.xls','Data/Org/0701-0831-2013.xls',\n", " 'Data/Org/0901-1031-2013.xls','Data/Org/1101-1231-2013.xls','Data/Org/0101-0228-2014.xls',\n", " 'Data/Org/0301-0430-2014.xls', 'Data/Org/0501-0630-2014.xls', 'Data/Org/0701-0831-2014.xls',\n", " 'Data/Org/0901-1031-2014.xls']\n", "\n", "for file in files:\n", " data = pd.read_excel(file, header = 0, skiprows = np.arange(0,6))\n", " df = df.append(data)\n", "\n", "df.head()" ], "language": "python", "metadata": {}, "outputs": [ { "output_type": "stream", "stream": "stdout", "text": [ "WARNING *** file size (2481102) not 512 + multiple of sector size (512)\n", "WARNING *** file size (848833) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1694257) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1640459) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1667907) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (847258) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1691449) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1666647) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1665736) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1614814) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1665980) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1667276) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1691736) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1666704) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1665920) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1614900) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1666228) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1666191) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1691845) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n", "WARNING *** file size (1663846) not 512 + multiple of sector size (512)" ] }, { "output_type": "stream", "stream": "stdout", "text": [ "\n" ] }, { "html": [ "\n", " | Unnamed: 0 | \n", "Unnamed: 1 | \n", "Gund Bus-A 15 Min Block Demand - kW | \n", "Gund Bus-A CurrentA - Amps | \n", "Unnamed: 4 | \n", "Unnamed: 5 | \n", "Gund Bus-A CurrentB - Amps | \n", "Unnamed: 7 | \n", "Gund Bus-A CurrentC - Amps | \n", "Unnamed: 9 | \n", "... | \n", "Gund Main Demand - Tons | \n", "Gund Main Energy - Ton-Days | \n", "Gund Main FlowRate - gpm | \n", "Gund Main FlowTotal - kgal(1000) | \n", "Gund Main SignalAeration - Count | \n", "Gund Main SignalStrength - Count | \n", "Gund Main SonicVelocity - Ft/Sec | \n", "Gund Main TempDelta - Deg F | \n", "Gund Main TempReturn - Deg F | \n", "Gund Main TempSupply - Deg F | \n", "
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | \n", "2011-07-01 01:00:00 | \n", "White | \n", "48.458733 | \n", "65.977882 | \n", "NaN | \n", "NaN | \n", "52.631417 | \n", "NaN | \n", "55.603840 | \n", "NaN | \n", "... | \n", "4.677294 | \n", "17912.537804 | \n", "6.916454 | \n", "48168.083414 | \n", "0.693405 | \n", "57.208127 | \n", "1437.640543 | \n", "16.238684 | \n", "59.757447 | \n", "43.516103 | \n", "
1 | \n", "2011-07-01 02:00:00 | \n", "White | \n", "40.472697 | \n", "57.230223 | \n", "NaN | \n", "NaN | \n", "42.483092 | \n", "NaN | \n", "50.243230 | \n", "NaN | \n", "... | \n", "4.586403 | \n", "17912.853518 | \n", "6.739337 | \n", "48168.645429 | \n", "0.567355 | \n", "57.082909 | \n", "1438.030719 | \n", "16.263573 | \n", "59.710199 | \n", "43.495128 | \n", "
2 | \n", "2011-07-01 03:00:00 | \n", "#d2e4b0 | \n", "39.472809 | \n", "55.487443 | \n", "NaN | \n", "NaN | \n", "41.911784 | \n", "NaN | \n", "48.482163 | \n", "NaN | \n", "... | \n", "4.462877 | \n", "17913.169232 | \n", "6.725142 | \n", "48169.207444 | \n", "0.441304 | \n", "57.001646 | \n", "1439.111130 | \n", "15.797043 | \n", "59.248158 | \n", "43.457344 | \n", "
3 | \n", "2011-07-01 04:00:00 | \n", "White | \n", "39.198879 | \n", "55.849806 | \n", "NaN | \n", "NaN | \n", "41.525529 | \n", "NaN | \n", "48.987457 | \n", "NaN | \n", "... | \n", "4.696993 | \n", "17913.484946 | \n", "7.041330 | \n", "48169.769458 | \n", "0.315254 | \n", "57.000000 | \n", "1440.768604 | \n", "15.947392 | \n", "59.207097 | \n", "43.267682 | \n", "
4 | \n", "2011-07-01 05:00:00 | \n", "White | \n", "39.297522 | \n", "55.736219 | \n", "NaN | \n", "NaN | \n", "41.299381 | \n", "NaN | \n", "48.710408 | \n", "NaN | \n", "... | \n", "4.550372 | \n", "17913.800660 | \n", "6.863004 | \n", "48170.331473 | \n", "0.189204 | \n", "57.000000 | \n", "1442.426077 | \n", "15.903679 | \n", "59.282707 | \n", "43.372615 | \n", "
5 rows \u00d7 55 columns
\n", "\n", " | Gund Bus-A 15 Min Block Demand - kW | \n", "Gund Bus-A CurrentA - Amps | \n", "Gund Bus-A CurrentB - Amps | \n", "Gund Bus-A CurrentC - Amps | \n", "Gund Bus-A CurrentN - Amps | \n", "Gund Bus-A EnergyReal - kWhr | \n", "Gund Bus-A Freq - Hertz | \n", "Gund Bus-A Max Monthly Demand - kW | \n", "Gund Bus-A PowerApp - kVA | \n", "Gund Bus-A PowerReac - kVAR | \n", "... | \n", "Gund Main Demand - Tons | \n", "Gund Main Energy - Ton-Days | \n", "Gund Main FlowRate - gpm | \n", "Gund Main FlowTotal - kgal(1000) | \n", "Gund Main SignalAeration - Count | \n", "Gund Main SignalStrength - Count | \n", "Gund Main SonicVelocity - Ft/Sec | \n", "Gund Main TempDelta - Deg F | \n", "Gund Main TempReturn - Deg F | \n", "Gund Main TempSupply - Deg F | \n", "
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2011-07-01 01:00:00 | \n", "48.458733 | \n", "65.977882 | \n", "52.631417 | \n", "55.603840 | \n", "15.982278 | \n", "1796757.502803 | \n", "59.837524 | \n", "96.117915 | \n", "48.757073 | \n", "12.344712 | \n", "... | \n", "4.677294 | \n", "17912.537804 | \n", "6.916454 | \n", "48168.083414 | \n", "0.693405 | \n", "57.208127 | \n", "1437.640543 | \n", "16.238684 | \n", "59.757447 | \n", "43.516103 | \n", "
2011-07-01 02:00:00 | \n", "40.472697 | \n", "57.230223 | \n", "42.483092 | \n", "50.243230 | \n", "13.423762 | \n", "1796800.145991 | \n", "60.005569 | \n", "96.117915 | \n", "42.238685 | \n", "12.967984 | \n", "... | \n", "4.586403 | \n", "17912.853518 | \n", "6.739337 | \n", "48168.645429 | \n", "0.567355 | \n", "57.082909 | \n", "1438.030719 | \n", "16.263573 | \n", "59.710199 | \n", "43.495128 | \n", "
2011-07-01 03:00:00 | \n", "39.472809 | \n", "55.487443 | \n", "41.911784 | \n", "48.482163 | \n", "13.478933 | \n", "1796840.146023 | \n", "59.833880 | \n", "96.117915 | \n", "41.278573 | \n", "12.732046 | \n", "... | \n", "4.462877 | \n", "17913.169232 | \n", "6.725142 | \n", "48169.207444 | \n", "0.441304 | \n", "57.001646 | \n", "1439.111130 | \n", "15.797043 | \n", "59.248158 | \n", "43.457344 | \n", "
2011-07-01 04:00:00 | \n", "39.198879 | \n", "55.849806 | \n", "41.525529 | \n", "48.987457 | \n", "13.603309 | \n", "1796879.023607 | \n", "59.673044 | \n", "96.117915 | \n", "41.345776 | \n", "12.687845 | \n", "... | \n", "4.696993 | \n", "17913.484946 | \n", "7.041330 | \n", "48169.769458 | \n", "0.315254 | \n", "57.000000 | \n", "1440.768604 | \n", "15.947392 | \n", "59.207097 | \n", "43.267682 | \n", "
2011-07-01 05:00:00 | \n", "39.297522 | \n", "55.736219 | \n", "41.299381 | \n", "48.710408 | \n", "13.797331 | \n", "1796918.273558 | \n", "59.986672 | \n", "96.117915 | \n", "41.166736 | \n", "12.437842 | \n", "... | \n", "4.550372 | \n", "17913.800660 | \n", "6.863004 | \n", "48170.331473 | \n", "0.189204 | \n", "57.000000 | \n", "1442.426077 | \n", "15.903679 | \n", "59.282707 | \n", "43.372615 | \n", "
5 rows \u00d7 48 columns
\n", "\n", " | Gund Bus-A EnergyReal - kWhr | \n", "Gund Bus-B EnergyReal - kWhr | \n", "Gund Bus-A PowerReal - kW | \n", "Gund Bus-B PowerReal - kW | \n", "
---|---|---|---|---|
2011-07-01 01:00:00 | \n", "1796757.502803 | \n", "3657811.582122 | \n", "47.184015 | \n", "63.486186 | \n", "
2011-07-01 02:00:00 | \n", "1796800.145991 | \n", "3657873.464938 | \n", "40.208796 | \n", "61.270542 | \n", "
2011-07-01 03:00:00 | \n", "1796840.146023 | \n", "3657934.837505 | \n", "39.209866 | \n", "61.464394 | \n", "
2011-07-01 04:00:00 | \n", "1796879.023607 | \n", "3657995.470348 | \n", "39.378507 | \n", "59.396581 | \n", "
2011-07-01 05:00:00 | \n", "1796918.273558 | \n", "3658054.470285 | \n", "39.240837 | \n", "58.911729 | \n", "
\n", " | startDate | \n", "endDate | \n", "CE603B kWh | \n", "CE604B kWh | \n", "
---|---|---|---|---|
month | \n", "\n", " | \n", " | \n", " | \n", " |
Jul 11 | \n", "6/16/11 | \n", "7/18/11 | \n", "43968.1 | \n", "106307.1 | \n", "
Aug 11 | \n", "7/18/11 | \n", "8/17/11 | \n", "41270.1 | \n", "83121.1 | \n", "
Sep 11 | \n", "8/17/11 | \n", "9/16/11 | \n", "51514.1 | \n", "107083.1 | \n", "
Oct 11 | \n", "9/16/11 | \n", "10/18/11 | \n", "65338.1 | \n", "114350.1 | \n", "
Nov 11 | \n", "10/18/11 | \n", "11/17/11 | \n", "65453.1 | \n", "115318.1 | \n", "
\n", " | Gund Bus-A EnergyReal - kWhr | \n", "Gund Bus-B EnergyReal - kWhr | \n", "Gund Bus-A PowerReal - kW | \n", "Gund Bus-B PowerReal - kW | \n", "energy | \n", "power | \n", "startTime | \n", "endTime | \n", "
---|---|---|---|---|---|---|---|---|
2011-07-01 00:00:00 | \n", "NaN | \n", "NaN | \n", "NaN | \n", "NaN | \n", "NaN | \n", "NaN | \n", "2011-07-01 00:00:00 | \n", "2011-07-01 01:00:00 | \n", "
2011-07-01 01:00:00 | \n", "1796757.502803 | \n", "3657811.582122 | \n", "47.184015 | \n", "63.486186 | \n", "5454569.084925 | \n", "110.670201 | \n", "2011-07-01 01:00:00 | \n", "2011-07-01 02:00:00 | \n", "
2011-07-01 02:00:00 | \n", "1796800.145991 | \n", "3657873.464938 | \n", "40.208796 | \n", "61.270542 | \n", "5454673.610929 | \n", "101.479338 | \n", "2011-07-01 02:00:00 | \n", "2011-07-01 03:00:00 | \n", "
2011-07-01 03:00:00 | \n", "1796840.146023 | \n", "3657934.837505 | \n", "39.209866 | \n", "61.464394 | \n", "5454774.983528 | \n", "100.674260 | \n", "2011-07-01 03:00:00 | \n", "2011-07-01 04:00:00 | \n", "
2011-07-01 04:00:00 | \n", "1796879.023607 | \n", "3657995.470348 | \n", "39.378507 | \n", "59.396581 | \n", "5454874.493955 | \n", "98.775088 | \n", "2011-07-01 04:00:00 | \n", "2011-07-01 05:00:00 | \n", "
\n", " | electricity-kWh | \n", "startTime | \n", "endTime | \n", "
---|---|---|---|
2011-07-01 00:00:00 | \n", "NaN | \n", "2011-07-01 00:00:00 | \n", "2011-07-01 01:00:00 | \n", "
2011-07-01 01:00:00 | \n", "NaN | \n", "2011-07-01 01:00:00 | \n", "2011-07-01 02:00:00 | \n", "
2011-07-01 02:00:00 | \n", "104.526004 | \n", "2011-07-01 02:00:00 | \n", "2011-07-01 03:00:00 | \n", "
2011-07-01 03:00:00 | \n", "101.372599 | \n", "2011-07-01 03:00:00 | \n", "2011-07-01 04:00:00 | \n", "
2011-07-01 04:00:00 | \n", "99.510428 | \n", "2011-07-01 04:00:00 | \n", "2011-07-01 05:00:00 | \n", "
\n", " | electricity-kWh | \n", "startDay | \n", "endDay | \n", "
---|---|---|---|
2011-06-30 | \n", "NaN | \n", "2011-06-30 | \n", "2011-07-01 | \n", "
2011-07-01 | \n", "NaN | \n", "2011-07-01 | \n", "2011-07-02 | \n", "
2011-07-02 | \n", "3630.398480 | \n", "2011-07-02 | \n", "2011-07-03 | \n", "
2011-07-03 | \n", "3750.648885 | \n", "2011-07-03 | \n", "2011-07-04 | \n", "
2011-07-04 | \n", "4568.724044 | \n", "2011-07-04 | \n", "2011-07-05 | \n", "
\n", " | Gund Main Energy - Ton-Days | \n", "
---|---|
2011-07-01 01:00:00 | \n", "17912.537804 | \n", "
2011-07-01 02:00:00 | \n", "17912.853518 | \n", "
2011-07-01 03:00:00 | \n", "17913.169232 | \n", "
2011-07-01 04:00:00 | \n", "17913.484946 | \n", "
2011-07-01 05:00:00 | \n", "17913.800660 | \n", "
\n", " | startDate | \n", "endDate | \n", "chilledWater | \n", "
---|---|---|---|
month | \n", "\n", " | \n", " | \n", " |
11-Jul | \n", "6/12/11 | \n", "7/12/11 | \n", "2258 | \n", "
11-Aug | \n", "7/12/11 | \n", "8/12/11 | \n", "2095 | \n", "
11-Sep | \n", "8/12/11 | \n", "9/12/11 | \n", "2200 | \n", "
11-Oct | \n", "9/12/11 | \n", "10/12/11 | \n", "1664 | \n", "
11-Nov | \n", "10/12/11 | \n", "11/12/11 | \n", "447 | \n", "
\n", " | chilledWater-TonDays | \n", "startTime | \n", "endTime | \n", "
---|---|---|---|
2011-07-01 01:00:00 | \n", "NaN | \n", "2011-07-01 01:00:00 | \n", "2011-07-01 02:00:00 | \n", "
2011-07-01 02:00:00 | \n", "0.315714 | \n", "2011-07-01 02:00:00 | \n", "2011-07-01 03:00:00 | \n", "
2011-07-01 03:00:00 | \n", "0.315714 | \n", "2011-07-01 03:00:00 | \n", "2011-07-01 04:00:00 | \n", "
2011-07-01 04:00:00 | \n", "0.315714 | \n", "2011-07-01 04:00:00 | \n", "2011-07-01 05:00:00 | \n", "
2011-07-01 05:00:00 | \n", "0.315714 | \n", "2011-07-01 05:00:00 | \n", "2011-07-01 06:00:00 | \n", "
\n", " | chilledWater-TonDays | \n", "startDay | \n", "endDay | \n", "
---|---|---|---|
2011-06-30 | \n", "NaN | \n", "2011-06-30 | \n", "2011-07-01 | \n", "
2011-07-01 | \n", "NaN | \n", "2011-07-01 | \n", "2011-07-02 | \n", "
2011-07-02 | \n", "54.741028 | \n", "2011-07-02 | \n", "2011-07-03 | \n", "
2011-07-03 | \n", "55.649728 | \n", "2011-07-03 | \n", "2011-07-04 | \n", "
2011-07-04 | \n", "109.049077 | \n", "2011-07-04 | \n", "2011-07-05 | \n", "
\n", " | Gund Condensate FlowTotal - LBS | \n", "
---|---|
2011-07-01 01:00:00 | \n", "15443350.388455 | \n", "
2011-07-01 02:00:00 | \n", "15443459.322917 | \n", "
2011-07-01 03:00:00 | \n", "15443574.687500 | \n", "
2011-07-01 04:00:00 | \n", "15443701.953125 | \n", "
2011-07-01 05:00:00 | \n", "15443818.359375 | \n", "
\n", " | startDate | \n", "endDate | \n", "steam | \n", "
---|---|---|---|
month | \n", "\n", " | \n", " | \n", " |
Jul 11 | \n", "6/17/2011 | \n", "7/21/2011 | \n", "0.0 | \n", "
Aug 11 | \n", "7/21/2011 | \n", "8/20/2011 | \n", "0.0 | \n", "
Sep 11 | \n", "8/20/2011 | \n", "9/17/2011 | \n", "0.0 | \n", "
Oct 11 | \n", "9/17/2011 | \n", "10/20/2011 | \n", "246.5 | \n", "
Nov 11 | \n", "10/20/2011 | \n", "11/20/2011 | \n", "786.1 | \n", "
\n", " | steam-LBS | \n", "startTime | \n", "endTime | \n", "
---|---|---|---|
2011-07-01 01:00:00 | \n", "NaN | \n", "2011-07-01 01:00:00 | \n", "2011-07-01 02:00:00 | \n", "
2011-07-01 02:00:00 | \n", "108.934462 | \n", "2011-07-01 02:00:00 | \n", "2011-07-01 03:00:00 | \n", "
2011-07-01 03:00:00 | \n", "115.364583 | \n", "2011-07-01 03:00:00 | \n", "2011-07-01 04:00:00 | \n", "
2011-07-01 04:00:00 | \n", "127.265625 | \n", "2011-07-01 04:00:00 | \n", "2011-07-01 05:00:00 | \n", "
2011-07-01 05:00:00 | \n", "116.406250 | \n", "2011-07-01 05:00:00 | \n", "2011-07-01 06:00:00 | \n", "
\n", " | steam-LBS | \n", "startDay | \n", "endDay | \n", "
---|---|---|---|
2011-06-30 | \n", "NaN | \n", "2011-06-30 | \n", "2011-07-01 | \n", "
2011-07-01 | \n", "NaN | \n", "2011-07-01 | \n", "2011-07-02 | \n", "
2011-07-02 | \n", "3250.651042 | \n", "2011-07-02 | \n", "2011-07-03 | \n", "
2011-07-03 | \n", "3271.276042 | \n", "2011-07-03 | \n", "2011-07-04 | \n", "
2011-07-04 | \n", "3236.718750 | \n", "2011-07-04 | \n", "2011-07-05 | \n", "
\n", " | Datetime | \n", "T-C | \n", "RH-% | \n", "Tdew-C | \n", "windDirection | \n", "windSpeed-m/s | \n", "pressure-mbar | \n", "solarRadiation-W/m2 | \n", "
---|---|---|---|---|---|---|---|---|
0 | \n", "2014-01-01 00:00:00 | \n", "-5.02 | \n", "53.2 | \n", "-13.07 | \n", "256 | \n", "4.5 | \n", "1020.8 | \n", "1 | \n", "
1 | \n", "2014-01-01 00:05:00 | \n", "-5.14 | \n", "54.3 | \n", "-12.93 | \n", "257 | \n", "4.0 | \n", "1020.7 | \n", "1 | \n", "
2 | \n", "2014-01-01 00:10:00 | \n", "-5.08 | \n", "53.4 | \n", "-13.08 | \n", "258 | \n", "3.5 | \n", "1021.1 | \n", "1 | \n", "
3 | \n", "2014-01-01 00:15:00 | \n", "-5.17 | \n", "52.6 | \n", "-13.35 | \n", "257 | \n", "2.8 | \n", "1021.0 | \n", "1 | \n", "
4 | \n", "2014-01-01 00:20:00 | \n", "-5.23 | \n", "52.9 | \n", "-13.33 | \n", "248 | \n", "2.5 | \n", "1021.2 | \n", "1 | \n", "
\n", " | T-C | \n", "RH-% | \n", "Tdew-C | \n", "windDirection | \n", "windSpeed-m/s | \n", "pressure-mbar | \n", "solarRadiation-W/m2 | \n", "
---|---|---|---|---|---|---|---|
Datetime | \n", "\n", " | \n", " | \n", " | \n", " | \n", " | \n", " | \n", " |
2014-01-01 00:00:00 | \n", "-5.281667 | \n", "52.858333 | \n", "-13.393333 | \n", "253.500000 | \n", "2.775000 | \n", "1021.158333 | \n", "1 | \n", "
2014-01-01 01:00:00 | \n", "-5.725000 | \n", "51.650000 | \n", "-14.090833 | \n", "253.000000 | \n", "2.350000 | \n", "1021.700000 | \n", "1 | \n", "
2014-01-01 02:00:00 | \n", "-6.002500 | \n", "50.766667 | \n", "-14.555833 | \n", "239.250000 | \n", "1.133333 | \n", "1022.708333 | \n", "1 | \n", "
2014-01-01 03:00:00 | \n", "-6.320833 | \n", "49.675000 | \n", "-15.114167 | \n", "234.333333 | \n", "1.191667 | \n", "1023.233333 | \n", "1 | \n", "
2014-01-01 04:00:00 | \n", "-6.535833 | \n", "49.708333 | \n", "-15.305833 | \n", "227.333333 | \n", "1.633333 | \n", "1023.925000 | \n", "1 | \n", "
\n", " | Datetime | \n", "RH-% | \n", "windDirection | \n", "solarRadiation-W/m2 | \n", "T-C | \n", "Tdew-C | \n", "pressure-mbar | \n", "windSpeed-m/s | \n", "
---|---|---|---|---|---|---|---|---|
0 | \n", "2012-01-01-01 | \n", "87 | \n", "310 | \n", "0 | \n", "4 | \n", "1.9 | \n", "1004 | \n", "4.166670 | \n", "
1 | \n", "2012-01-01-02 | \n", "87 | \n", "280 | \n", "0 | \n", "4 | \n", "1.9 | \n", "1005 | \n", "4.166670 | \n", "
2 | \n", "2012-01-01-03 | \n", "81 | \n", "270 | \n", "0 | \n", "5 | \n", "1.9 | \n", "1006 | \n", "4.166670 | \n", "
3 | \n", "2012-01-01-04 | \n", "76 | \n", "290 | \n", "0 | \n", "6 | \n", "1.9 | \n", "1007 | \n", "4.722226 | \n", "
4 | \n", "2012-01-01-05 | \n", "87 | \n", "280 | \n", "0 | \n", "4 | \n", "1.9 | \n", "1007 | \n", "3.055558 | \n", "
\n", " | RH-% | \n", "windDirection | \n", "solarRadiation-W/m2 | \n", "T-C | \n", "Tdew-C | \n", "pressure-mbar | \n", "windSpeed-m/s | \n", "
---|---|---|---|---|---|---|---|
Datetime | \n", "\n", " | \n", " | \n", " | \n", " | \n", " | \n", " | \n", " |
2012-01-01 01:00:00 | \n", "87 | \n", "310 | \n", "0 | \n", "4 | \n", "1.9 | \n", "1004 | \n", "4.166670 | \n", "
2012-01-01 02:00:00 | \n", "87 | \n", "280 | \n", "0 | \n", "4 | \n", "1.9 | \n", "1005 | \n", "4.166670 | \n", "
2012-01-01 03:00:00 | \n", "81 | \n", "270 | \n", "0 | \n", "5 | \n", "1.9 | \n", "1006 | \n", "4.166670 | \n", "
2012-01-01 04:00:00 | \n", "76 | \n", "290 | \n", "0 | \n", "6 | \n", "1.9 | \n", "1007 | \n", "4.722226 | \n", "
2012-01-01 05:00:00 | \n", "87 | \n", "280 | \n", "0 | \n", "4 | \n", "1.9 | \n", "1007 | \n", "3.055558 | \n", "
\n", " | RH-% | \n", "T-C | \n", "Tdew-C | \n", "pressure-mbar | \n", "solarRadiation-W/m2 | \n", "windDirection | \n", "windSpeed-m/s | \n", "humidityRatio-kg/kg | \n", "coolingDegrees | \n", "heatingDegrees | \n", "dehumidification | \n", "
---|---|---|---|---|---|---|---|---|---|---|---|
2012-01-01 01:00:00 | \n", "87 | \n", "4 | \n", "1.9 | \n", "1004 | \n", "0 | \n", "310 | \n", "4.166670 | \n", "0.004396 | \n", "0 | \n", "11 | \n", "0 | \n", "
2012-01-01 02:00:00 | \n", "87 | \n", "4 | \n", "1.9 | \n", "1005 | \n", "0 | \n", "280 | \n", "4.166670 | \n", "0.004391 | \n", "0 | \n", "11 | \n", "0 | \n", "
2012-01-01 03:00:00 | \n", "81 | \n", "5 | \n", "1.9 | \n", "1006 | \n", "0 | \n", "270 | \n", "4.166670 | \n", "0.004380 | \n", "0 | \n", "10 | \n", "0 | \n", "
2012-01-01 04:00:00 | \n", "76 | \n", "6 | \n", "1.9 | \n", "1007 | \n", "0 | \n", "290 | \n", "4.722226 | \n", "0.004401 | \n", "0 | \n", "9 | \n", "0 | \n", "
2012-01-01 05:00:00 | \n", "87 | \n", "4 | \n", "1.9 | \n", "1007 | \n", "0 | \n", "280 | \n", "3.055558 | \n", "0.004382 | \n", "0 | \n", "11 | \n", "0 | \n", "
\n", " | RH-% | \n", "T-C | \n", "Tdew-C | \n", "pressure-mbar | \n", "solarRadiation-W/m2 | \n", "windDirection | \n", "windSpeed-m/s | \n", "humidityRatio-kg/kg | \n", "coolingDegrees | \n", "heatingDegrees | \n", "dehumidification | \n", "
---|---|---|---|---|---|---|---|---|---|---|---|
2012-01-01 | \n", "76.652174 | \n", "7.173913 | \n", "3.073913 | \n", "1004.956522 | \n", "95.260870 | \n", "236.086957 | \n", "4.118361 | \n", "0.004796 | \n", "0 | \n", "7.826087 | \n", "0 | \n", "
2012-01-02 | \n", "55.958333 | \n", "5.833333 | \n", "-2.937500 | \n", "994.625000 | \n", "87.333333 | \n", "253.750000 | \n", "5.914357 | \n", "0.003415 | \n", "0 | \n", "9.166667 | \n", "0 | \n", "
2012-01-03 | \n", "42.500000 | \n", "-3.208333 | \n", "-12.975000 | \n", "1002.125000 | \n", "95.708333 | \n", "302.916667 | \n", "6.250005 | \n", "0.001327 | \n", "0 | \n", "18.208333 | \n", "0 | \n", "
2012-01-04 | \n", "41.541667 | \n", "-7.083333 | \n", "-16.958333 | \n", "1008.250000 | \n", "98.750000 | \n", "286.666667 | \n", "5.127319 | \n", "0.000890 | \n", "0 | \n", "22.083333 | \n", "0 | \n", "
2012-01-05 | \n", "46.916667 | \n", "-0.583333 | \n", "-9.866667 | \n", "1002.041667 | \n", "90.750000 | \n", "258.333333 | \n", "5.162041 | \n", "0.001746 | \n", "0 | \n", "15.583333 | \n", "0 | \n", "
\n", " | startDate | \n", "endDate | \n", "value | \n", "
---|---|---|---|
0 | \n", "2011-07-01 | \n", "2011-09-06 | \n", "0.5 | \n", "
1 | \n", "2011-10-10 | \n", "2011-10-11 | \n", "0.6 | \n", "
2 | \n", "2011-11-24 | \n", "2011-11-28 | \n", "0.2 | \n", "
3 | \n", "2011-12-22 | \n", "2011-12-24 | \n", "0.1 | \n", "
4 | \n", "2011-12-24 | \n", "2012-01-02 | \n", "0.0 | \n", "
\n", " | electricity-kWh | \n", "startTime | \n", "endTime | \n", "RH-% | \n", "T-C | \n", "Tdew-C | \n", "pressure-mbar | \n", "solarRadiation-W/m2 | \n", "windDirection | \n", "windSpeed-m/s | \n", "humidityRatio-kg/kg | \n", "coolingDegrees | \n", "heatingDegrees | \n", "dehumidification | \n", "occupancy | \n", "cosHour | \n", "
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2012-01-01 01:00:00 | \n", "111.479277 | \n", "2012-01-01 01:00:00 | \n", "2012-01-01 02:00:00 | \n", "87 | \n", "4 | \n", "1.9 | \n", "1004 | \n", "0 | \n", "310 | \n", "4.166670 | \n", "0.004396 | \n", "0 | \n", "11 | \n", "0 | \n", "0 | \n", "0.866025 | \n", "
2012-01-01 02:00:00 | \n", "117.989395 | \n", "2012-01-01 02:00:00 | \n", "2012-01-01 03:00:00 | \n", "87 | \n", "4 | \n", "1.9 | \n", "1005 | \n", "0 | \n", "280 | \n", "4.166670 | \n", "0.004391 | \n", "0 | \n", "11 | \n", "0 | \n", "0 | \n", "0.965926 | \n", "
2012-01-01 03:00:00 | \n", "119.010131 | \n", "2012-01-01 03:00:00 | \n", "2012-01-01 04:00:00 | \n", "81 | \n", "5 | \n", "1.9 | \n", "1006 | \n", "0 | \n", "270 | \n", "4.166670 | \n", "0.004380 | \n", "0 | \n", "10 | \n", "0 | \n", "0 | \n", "1.000000 | \n", "
2012-01-01 04:00:00 | \n", "116.005587 | \n", "2012-01-01 04:00:00 | \n", "2012-01-01 05:00:00 | \n", "76 | \n", "6 | \n", "1.9 | \n", "1007 | \n", "0 | \n", "290 | \n", "4.722226 | \n", "0.004401 | \n", "0 | \n", "9 | \n", "0 | \n", "0 | \n", "0.965926 | \n", "
2012-01-01 05:00:00 | \n", "111.132977 | \n", "2012-01-01 05:00:00 | \n", "2012-01-01 06:00:00 | \n", "87 | \n", "4 | \n", "1.9 | \n", "1007 | \n", "0 | \n", "280 | \n", "3.055558 | \n", "0.004382 | \n", "0 | \n", "11 | \n", "0 | \n", "0 | \n", "0.866025 | \n", "
coolingDegrees: if T-C - 12 > 0, then = T-C - 12, else = 0. Assume that when outdoor temperature is below 12C, no cooling is needed, which is true for many buildings. This will be useful for daily prediction, because the average of hourly cooling degrees is better than average of hourly temperature.
\n", "cosHour: $\\text{cos}(\\text{hourOfDay} \\cdot \\frac{2\\pi}{24})$
\n", "dehumidification: if humidityRatio - 0.00886 > 0, then = humidityRatio - 0.00886, else = 0. This will be useful for chilled water prediction, especially daily chilled water prediction.
\n", "heatingDegrees: if 15 - T-C > 0, then = 15 - T-C, else = 0. Assume that when outdoor temperature is above 15C, no heating is needed. This will be useful for daily prediction, because the average of hourly heating degrees is better than average of hourly temperature.
\n", "occupancy: A number between 0 and 1. 0 indicated no occupants, 1 indicates normal occupancy. This is an estimate based on holidays, weekends and school academic calendar.
\n", "pressure-mbar: atmospheric pressure
\n", "RH-% : Relative humidity
\n", "T-C : Dry-bulb temperature
\n", "Tdew-C : Dew-point temperature
\n", "\n", "### Humidity\n", "Humidity ratio is important for chilled water prediction as chilled water is also used to dry the air discharged to rooms. Using humidity ratio will be more efficient and effective than using RH and dew point temperature.\n" ] } ], "metadata": {} } ] }