{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# National generation and fuel consumption\n",
"The data in this notebook is generation and consumption by fuel type for the entire US. These values are larger than what would be calculated by summing facility-level data. Note that the fuel types are somewhat aggregated (coal rather than BIT, SUB, LIG, etc). So when we multiply the fuel consumption by an emissions factor there will be some level of error.\n",
"\n",
"The code assumes that you have already downloaded an `ELEC.txt` file from [EIA's bulk download website](https://www.eia.gov/opendata/bulkfiles.php)."
]
},
{
"cell_type": "code",
"execution_count": 1,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:49:04.181106Z",
"start_time": "2017-10-31T17:49:03.361179Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"import json\n",
"import pandas as pd\n",
"import os\n",
"from os.path import join\n",
"import numpy as np\n",
"import sys\n",
"\n",
"cwd = os.getcwd()\n",
"data_path = join(cwd, '..', 'Data storage')\n",
"idx = pd.IndexSlice"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Date string for filenames\n",
"This will be inserted into all filenames (reading and writing)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
"file_date = '2018-03-06'"
]
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:49:04.207213Z",
"start_time": "2017-10-31T17:49:04.183134Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"%load_ext watermark"
]
},
{
"cell_type": "code",
"execution_count": 3,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:49:04.224531Z",
"start_time": "2017-10-31T17:49:04.209308Z"
}
},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"json 2.0.9\n",
"pandas 0.21.1\n",
"numpy 1.13.3\n",
"CPython 3.6.3\n",
"IPython 6.2.1\n"
]
}
],
"source": [
"%watermark -iv -v"
]
},
{
"cell_type": "code",
"execution_count": 4,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:49:04.262482Z",
"start_time": "2017-10-31T17:49:04.227049Z"
}
},
"outputs": [],
"source": [
"# Load the \"autoreload\" extension\n",
"%load_ext autoreload\n",
"\n",
"# always reload modules marked with \"%aimport\"\n",
"%autoreload 1\n",
"\n",
"# add the 'src' directory as one where we can import modules\n",
"src_dir = join(os.getcwd(), os.pardir, 'src')\n",
"sys.path.append(src_dir)"
]
},
{
"cell_type": "code",
"execution_count": 5,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:49:04.273333Z",
"start_time": "2017-10-31T17:49:04.264609Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"%aimport Analysis.index\n",
"from Analysis.index import add_datetime, add_quarter"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Read ELECT.txt file"
]
},
{
"cell_type": "code",
"execution_count": 55,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:49:06.979494Z",
"start_time": "2017-10-31T17:49:04.300072Z"
}
},
"outputs": [],
"source": [
"cwd = os.getcwd()\n",
"path = join(data_path, 'Raw EIA bulk', '{} ELEC.txt'.format(file_date))\n",
"with open(path, 'r') as f:\n",
" raw_txt = f.readlines()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Filter lines to only include total generation and fuel use\n",
"Only want monthly US data for all sectors\n",
"- US-99.M\n",
"- ELEC.GEN, ELEC.CONS_TOT_BTU, ELEC.CONS_EG_BTU\n",
"- not ALL"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Fuel codes:\n",
"- WWW, wood and wood derived fuels\n",
"- WND, wind\n",
"- STH, solar thermal\n",
"- WAS, other biomass\n",
"- TSN, all solar\n",
"- SUN, utility-scale solar\n",
"- NUC, nuclear\n",
"- NG, natural gas\n",
"- PEL, petroleum liquids\n",
"- SPV, utility-scale solar photovoltaic\n",
"- PC, petroluem coke\n",
"- OTH, other\n",
"- COW, coal,\n",
"- DPV, distributed photovoltaic\n",
"- OOG, other gases\n",
"- HPS, hydro pumped storage\n",
"- HYC, conventional hydroelectric\n",
"- GEO, geothermal\n",
"- AOR, other renewables (total)"
]
},
{
"cell_type": "code",
"execution_count": 56,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:49:08.570386Z",
"start_time": "2017-10-31T17:49:06.992870Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"def line_to_df(line):\n",
" \"\"\"\n",
" Takes in a line (dictionary), returns a dataframe\n",
" \"\"\"\n",
" for key in ['latlon', 'source', 'copyright', 'description', \n",
" 'geoset_id', 'iso3166', 'name', 'state']:\n",
" line.pop(key, None)\n",
"\n",
" # Split the series_id up to extract information\n",
" # Example: ELEC.PLANT.GEN.388-WAT-ALL.M\n",
" series_id = line['series_id']\n",
" series_id_list = series_id.split('.')\n",
" # Use the second to last item in list rather than third\n",
" plant_fuel_mover = series_id_list[-2].split('-')\n",
" line['type'] = plant_fuel_mover[0]\n",
"# line['state'] = plant_fuel_mover[1]\n",
" line['sector'] = plant_fuel_mover[2]\n",
" temp_df = pd.DataFrame(line)\n",
"\n",
" try:\n",
" temp_df['year'] = temp_df.apply(lambda x: x['data'][0][:4], axis=1).astype(int)\n",
" temp_df['month'] = temp_df.apply(lambda x: x['data'][0][-2:], axis=1).astype(int)\n",
" temp_df['value'] = temp_df.apply(lambda x: x['data'][1], axis=1)\n",
" temp_df.drop('data', axis=1, inplace=True)\n",
" return temp_df\n",
" except:\n",
" exception_list.append(line)\n",
" pass"
]
},
{
"cell_type": "code",
"execution_count": 57,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:49:08.585889Z",
"start_time": "2017-10-31T17:49:08.573127Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"states = [\"AL\", \"AK\", \"AZ\", \"AR\", \"CA\", \"CO\", \"CT\", \"DE\",\n",
" \"FL\", \"GA\", \"HI\", \"ID\", \"IL\", \"IN\", \"IA\", \"KS\",\n",
" \"KY\", \"LA\", \"ME\", \"MD\", \"MA\", \"MI\", \"MN\", \"MS\",\n",
" \"MO\", \"MT\", \"NE\", \"NV\", \"NH\", \"NJ\", \"NM\", \"NY\",\n",
" \"NC\", \"ND\", \"OH\", \"OK\", \"OR\", \"PA\", \"RI\", \"SC\",\n",
" \"SD\", \"TN\", \"TX\", \"UT\", \"VT\", \"VA\", \"WA\", \"WV\", \"WI\", \"WY\"]"
]
},
{
"cell_type": "code",
"execution_count": 58,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:49:08.592972Z",
"start_time": "2017-10-31T17:49:08.588321Z"
},
"collapsed": true,
"scrolled": true
},
"outputs": [],
"source": [
"state_geos = ['USA-{}'.format(state) for state in states]"
]
},
{
"cell_type": "code",
"execution_count": 59,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:49:08.637908Z",
"start_time": "2017-10-31T17:49:08.596564Z"
}
},
"outputs": [
{
"data": {
"text/plain": [
"dict"
]
},
"execution_count": 59,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"type(json.loads(raw_txt[0]))"
]
},
{
"cell_type": "code",
"execution_count": 60,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:49:08.655737Z",
"start_time": "2017-10-31T17:49:08.646593Z"
}
},
"outputs": [
{
"data": {
"text/plain": [
"'USA-CA'"
]
},
"execution_count": 60,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"json.loads(raw_txt[0])['geography']"
]
},
{
"cell_type": "code",
"execution_count": 61,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:49:10.033511Z",
"start_time": "2017-10-31T17:49:08.659056Z"
}
},
"outputs": [],
"source": [
"gen_rows = [row for row in raw_txt if 'ELEC.GEN' in row \n",
" and 'series_id' in row \n",
" and '-99.M' in row \n",
" and 'ALL' not in row]\n",
"\n",
"total_fuel_rows = [row for row in raw_txt if 'ELEC.CONS_TOT_BTU' in row \n",
" and 'series_id' in row \n",
" and '-99.M' in row \n",
" and 'ALL' not in row\n",
" and 'US-99.m' not in row]\n",
"\n",
"eg_fuel_rows = [row for row in raw_txt if 'ELEC.CONS_EG_BTU' in row \n",
" and 'series_id' in row \n",
" and '-99.M' in row \n",
" and 'ALL' not in row\n",
" and 'US-99.m' not in row]"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## All generation by fuel"
]
},
{
"cell_type": "code",
"execution_count": 62,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:51:28.104940Z",
"start_time": "2017-10-31T17:51:27.723553Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"gen_dicts = [json.loads(row) for row in gen_rows]"
]
},
{
"cell_type": "code",
"execution_count": 63,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:51:51.811851Z",
"start_time": "2017-10-31T17:51:41.595556Z"
}
},
"outputs": [],
"source": [
"gen_df = pd.concat([line_to_df(x) for x in gen_dicts\n",
" if x['geography'] in state_geos])"
]
},
{
"cell_type": "code",
"execution_count": 64,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:52:03.655509Z",
"start_time": "2017-10-31T17:52:03.630690Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"
\n",
"\n",
"
\n",
" \n",
" \n",
" | \n",
" end | \n",
" f | \n",
" geography | \n",
" last_updated | \n",
" sector | \n",
" series_id | \n",
" start | \n",
" type | \n",
" units | \n",
" year | \n",
" month | \n",
" value | \n",
"
\n",
" \n",
" \n",
" \n",
" 0 | \n",
" 201712 | \n",
" M | \n",
" USA-AK | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.AOR-AK-99.M | \n",
" 200101 | \n",
" AOR | \n",
" thousand megawatthours | \n",
" 2017 | \n",
" 12 | \n",
" 19.39150 | \n",
"
\n",
" \n",
" 1 | \n",
" 201712 | \n",
" M | \n",
" USA-AK | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.AOR-AK-99.M | \n",
" 200101 | \n",
" AOR | \n",
" thousand megawatthours | \n",
" 2017 | \n",
" 11 | \n",
" 19.76574 | \n",
"
\n",
" \n",
" 2 | \n",
" 201712 | \n",
" M | \n",
" USA-AK | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.AOR-AK-99.M | \n",
" 200101 | \n",
" AOR | \n",
" thousand megawatthours | \n",
" 2017 | \n",
" 10 | \n",
" 20.52333 | \n",
"
\n",
" \n",
" 3 | \n",
" 201712 | \n",
" M | \n",
" USA-AK | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.AOR-AK-99.M | \n",
" 200101 | \n",
" AOR | \n",
" thousand megawatthours | \n",
" 2017 | \n",
" 9 | \n",
" 13.56737 | \n",
"
\n",
" \n",
" 4 | \n",
" 201712 | \n",
" M | \n",
" USA-AK | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.AOR-AK-99.M | \n",
" 200101 | \n",
" AOR | \n",
" thousand megawatthours | \n",
" 2017 | \n",
" 8 | \n",
" 11.61728 | \n",
"
\n",
" \n",
"
\n",
"
"
],
"text/plain": [
" end f geography last_updated sector \\\n",
"0 201712 M USA-AK 2018-02-28T02:03:13-05:00 99 \n",
"1 201712 M USA-AK 2018-02-28T02:03:13-05:00 99 \n",
"2 201712 M USA-AK 2018-02-28T02:03:13-05:00 99 \n",
"3 201712 M USA-AK 2018-02-28T02:03:13-05:00 99 \n",
"4 201712 M USA-AK 2018-02-28T02:03:13-05:00 99 \n",
"\n",
" series_id start type units year month \\\n",
"0 ELEC.GEN.AOR-AK-99.M 200101 AOR thousand megawatthours 2017 12 \n",
"1 ELEC.GEN.AOR-AK-99.M 200101 AOR thousand megawatthours 2017 11 \n",
"2 ELEC.GEN.AOR-AK-99.M 200101 AOR thousand megawatthours 2017 10 \n",
"3 ELEC.GEN.AOR-AK-99.M 200101 AOR thousand megawatthours 2017 9 \n",
"4 ELEC.GEN.AOR-AK-99.M 200101 AOR thousand megawatthours 2017 8 \n",
"\n",
" value \n",
"0 19.39150 \n",
"1 19.76574 \n",
"2 20.52333 \n",
"3 13.56737 \n",
"4 11.61728 "
]
},
"execution_count": 64,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"#drop\n",
"gen_df.head()"
]
},
{
"cell_type": "code",
"execution_count": 65,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:52:12.850899Z",
"start_time": "2017-10-31T17:52:12.839775Z"
}
},
"outputs": [
{
"data": {
"text/plain": [
"array(['USA-AK', 'USA-AZ', 'USA-CO', 'USA-MI', 'USA-DE', 'USA-MO',\n",
" 'USA-WA', 'USA-NY', 'USA-CA', 'USA-PA', 'USA-MN', 'USA-MS',\n",
" 'USA-MT', 'USA-WI', 'USA-MD', 'USA-OH', 'USA-ME', 'USA-KS',\n",
" 'USA-WY', 'USA-RI', 'USA-NV', 'USA-OK', 'USA-OR', 'USA-NC',\n",
" 'USA-AR', 'USA-WV', 'USA-SD', 'USA-HI', 'USA-GA', 'USA-ND',\n",
" 'USA-TN', 'USA-CT', 'USA-NE', 'USA-SC', 'USA-LA', 'USA-VA',\n",
" 'USA-IL', 'USA-AL', 'USA-IN', 'USA-MA', 'USA-IA', 'USA-KY',\n",
" 'USA-FL', 'USA-ID', 'USA-NM', 'USA-NJ', 'USA-UT', 'USA-TX',\n",
" 'USA-VT', 'USA-NH'], dtype=object)"
]
},
"execution_count": 65,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"gen_df['geography'].unique()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Multiply generation values by 1000 and change the units to MWh"
]
},
{
"cell_type": "code",
"execution_count": 66,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:52:22.002882Z",
"start_time": "2017-10-31T17:52:21.970781Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"gen_df.loc[:,'value'] *= 1000\n",
"gen_df.loc[:,'units'] = 'megawatthours'"
]
},
{
"cell_type": "code",
"execution_count": 67,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:52:32.017315Z",
"start_time": "2017-10-31T17:52:31.992727Z"
},
"collapsed": true
},
"outputs": [
{
"name": "stderr",
"output_type": "stream",
"text": [
"C:\\Users\\gschivley\\Anaconda2\\envs\\psci\\lib\\site-packages\\ipykernel_launcher.py:1: FutureWarning: Using 'rename_axis' to alter labels is deprecated. Use '.rename' instead\n",
" \"\"\"Entry point for launching an IPython kernel.\n"
]
}
],
"source": [
"gen_df.rename_axis({'value':'generation (MWh)'}, axis=1, inplace=True)"
]
},
{
"cell_type": "code",
"execution_count": 68,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:52:32.171144Z",
"start_time": "2017-10-31T17:52:32.020555Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"
\n",
" \n",
" \n",
" | \n",
" end | \n",
" f | \n",
" geography | \n",
" last_updated | \n",
" sector | \n",
" series_id | \n",
" start | \n",
" type | \n",
" units | \n",
" year | \n",
" month | \n",
" generation (MWh) | \n",
"
\n",
" \n",
" \n",
" \n",
" 5 | \n",
" 201712 | \n",
" M | \n",
" USA-AK | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.AOR-AK-99.M | \n",
" 200101 | \n",
" AOR | \n",
" megawatthours | \n",
" 2017 | \n",
" 7 | \n",
" NaN | \n",
"
\n",
" \n",
" 10 | \n",
" 201712 | \n",
" M | \n",
" USA-AK | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.AOR-AK-99.M | \n",
" 200101 | \n",
" AOR | \n",
" megawatthours | \n",
" 2017 | \n",
" 2 | \n",
" NaN | \n",
"
\n",
" \n",
" 11 | \n",
" 201712 | \n",
" M | \n",
" USA-AK | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.AOR-AK-99.M | \n",
" 200101 | \n",
" AOR | \n",
" megawatthours | \n",
" 2017 | \n",
" 1 | \n",
" NaN | \n",
"
\n",
" \n",
" 61 | \n",
" 201712 | \n",
" M | \n",
" USA-AK | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.AOR-AK-99.M | \n",
" 200101 | \n",
" AOR | \n",
" megawatthours | \n",
" 2012 | \n",
" 11 | \n",
" NaN | \n",
"
\n",
" \n",
" 71 | \n",
" 201712 | \n",
" M | \n",
" USA-AK | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.AOR-AK-99.M | \n",
" 200101 | \n",
" AOR | \n",
" megawatthours | \n",
" 2012 | \n",
" 1 | \n",
" NaN | \n",
"
\n",
" \n",
" 12 | \n",
" 201712 | \n",
" M | \n",
" USA-MI | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-MI-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2016 | \n",
" 12 | \n",
" NaN | \n",
"
\n",
" \n",
" 24 | \n",
" 201712 | \n",
" M | \n",
" USA-WY | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-WY-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2015 | \n",
" 12 | \n",
" NaN | \n",
"
\n",
" \n",
" 25 | \n",
" 201712 | \n",
" M | \n",
" USA-WY | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-WY-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2015 | \n",
" 11 | \n",
" NaN | \n",
"
\n",
" \n",
" 4 | \n",
" 201712 | \n",
" M | \n",
" USA-HI | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.HYC-HI-99.M | \n",
" 200101 | \n",
" HYC | \n",
" megawatthours | \n",
" 2017 | \n",
" 8 | \n",
" NaN | \n",
"
\n",
" \n",
" 5 | \n",
" 201712 | \n",
" M | \n",
" USA-HI | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.HYC-HI-99.M | \n",
" 200101 | \n",
" HYC | \n",
" megawatthours | \n",
" 2017 | \n",
" 7 | \n",
" NaN | \n",
"
\n",
" \n",
" 6 | \n",
" 201712 | \n",
" M | \n",
" USA-HI | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.HYC-HI-99.M | \n",
" 200101 | \n",
" HYC | \n",
" megawatthours | \n",
" 2017 | \n",
" 6 | \n",
" NaN | \n",
"
\n",
" \n",
" 7 | \n",
" 201712 | \n",
" M | \n",
" USA-HI | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.HYC-HI-99.M | \n",
" 200101 | \n",
" HYC | \n",
" megawatthours | \n",
" 2017 | \n",
" 5 | \n",
" NaN | \n",
"
\n",
" \n",
" 8 | \n",
" 201712 | \n",
" M | \n",
" USA-HI | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.HYC-HI-99.M | \n",
" 200101 | \n",
" HYC | \n",
" megawatthours | \n",
" 2017 | \n",
" 4 | \n",
" NaN | \n",
"
\n",
" \n",
" 9 | \n",
" 201712 | \n",
" M | \n",
" USA-HI | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.HYC-HI-99.M | \n",
" 200101 | \n",
" HYC | \n",
" megawatthours | \n",
" 2017 | \n",
" 3 | \n",
" NaN | \n",
"
\n",
" \n",
" 10 | \n",
" 201712 | \n",
" M | \n",
" USA-HI | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.HYC-HI-99.M | \n",
" 200101 | \n",
" HYC | \n",
" megawatthours | \n",
" 2017 | \n",
" 2 | \n",
" NaN | \n",
"
\n",
" \n",
" 61 | \n",
" 201712 | \n",
" M | \n",
" USA-OR | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.GEO-OR-99.M | \n",
" 201211 | \n",
" GEO | \n",
" megawatthours | \n",
" 2012 | \n",
" 11 | \n",
" NaN | \n",
"
\n",
" \n",
" 0 | \n",
" 201712 | \n",
" M | \n",
" USA-GA | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-GA-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2017 | \n",
" 12 | \n",
" NaN | \n",
"
\n",
" \n",
" 1 | \n",
" 201712 | \n",
" M | \n",
" USA-GA | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-GA-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2017 | \n",
" 11 | \n",
" NaN | \n",
"
\n",
" \n",
" 2 | \n",
" 201712 | \n",
" M | \n",
" USA-GA | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-GA-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2017 | \n",
" 10 | \n",
" NaN | \n",
"
\n",
" \n",
" 3 | \n",
" 201712 | \n",
" M | \n",
" USA-GA | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-GA-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2017 | \n",
" 9 | \n",
" NaN | \n",
"
\n",
" \n",
" 4 | \n",
" 201712 | \n",
" M | \n",
" USA-GA | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-GA-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2017 | \n",
" 8 | \n",
" NaN | \n",
"
\n",
" \n",
" 12 | \n",
" 201712 | \n",
" M | \n",
" USA-GA | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-GA-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2016 | \n",
" 12 | \n",
" NaN | \n",
"
\n",
" \n",
" 13 | \n",
" 201712 | \n",
" M | \n",
" USA-GA | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-GA-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2016 | \n",
" 11 | \n",
" NaN | \n",
"
\n",
" \n",
" 14 | \n",
" 201712 | \n",
" M | \n",
" USA-GA | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-GA-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2016 | \n",
" 10 | \n",
" NaN | \n",
"
\n",
" \n",
" 15 | \n",
" 201712 | \n",
" M | \n",
" USA-GA | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-GA-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2016 | \n",
" 9 | \n",
" NaN | \n",
"
\n",
" \n",
" 16 | \n",
" 201712 | \n",
" M | \n",
" USA-GA | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-GA-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2016 | \n",
" 8 | \n",
" NaN | \n",
"
\n",
" \n",
" 17 | \n",
" 201712 | \n",
" M | \n",
" USA-GA | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-GA-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2016 | \n",
" 7 | \n",
" NaN | \n",
"
\n",
" \n",
" 18 | \n",
" 201712 | \n",
" M | \n",
" USA-GA | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-GA-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2016 | \n",
" 6 | \n",
" NaN | \n",
"
\n",
" \n",
" 19 | \n",
" 201712 | \n",
" M | \n",
" USA-GA | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-GA-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2016 | \n",
" 5 | \n",
" NaN | \n",
"
\n",
" \n",
" 20 | \n",
" 201712 | \n",
" M | \n",
" USA-GA | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.DPV-GA-99.M | \n",
" 201401 | \n",
" DPV | \n",
" megawatthours | \n",
" 2016 | \n",
" 4 | \n",
" NaN | \n",
"
\n",
" \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
"
\n",
" \n",
" 30 | \n",
" 201702 | \n",
" M | \n",
" USA-WV | \n",
" 2017-05-24T14:26:30-04:00 | \n",
" 99 | \n",
" ELEC.GEN.WAS-WV-99.M | \n",
" 200101 | \n",
" WAS | \n",
" megawatthours | \n",
" 2014 | \n",
" 8 | \n",
" NaN | \n",
"
\n",
" \n",
" 31 | \n",
" 201702 | \n",
" M | \n",
" USA-WV | \n",
" 2017-05-24T14:26:30-04:00 | \n",
" 99 | \n",
" ELEC.GEN.WAS-WV-99.M | \n",
" 200101 | \n",
" WAS | \n",
" megawatthours | \n",
" 2014 | \n",
" 7 | \n",
" NaN | \n",
"
\n",
" \n",
" 32 | \n",
" 201702 | \n",
" M | \n",
" USA-WV | \n",
" 2017-05-24T14:26:30-04:00 | \n",
" 99 | \n",
" ELEC.GEN.WAS-WV-99.M | \n",
" 200101 | \n",
" WAS | \n",
" megawatthours | \n",
" 2014 | \n",
" 6 | \n",
" NaN | \n",
"
\n",
" \n",
" 33 | \n",
" 201702 | \n",
" M | \n",
" USA-WV | \n",
" 2017-05-24T14:26:30-04:00 | \n",
" 99 | \n",
" ELEC.GEN.WAS-WV-99.M | \n",
" 200101 | \n",
" WAS | \n",
" megawatthours | \n",
" 2014 | \n",
" 5 | \n",
" NaN | \n",
"
\n",
" \n",
" 34 | \n",
" 201702 | \n",
" M | \n",
" USA-WV | \n",
" 2017-05-24T14:26:30-04:00 | \n",
" 99 | \n",
" ELEC.GEN.WAS-WV-99.M | \n",
" 200101 | \n",
" WAS | \n",
" megawatthours | \n",
" 2014 | \n",
" 4 | \n",
" NaN | \n",
"
\n",
" \n",
" 35 | \n",
" 201702 | \n",
" M | \n",
" USA-WV | \n",
" 2017-05-24T14:26:30-04:00 | \n",
" 99 | \n",
" ELEC.GEN.WAS-WV-99.M | \n",
" 200101 | \n",
" WAS | \n",
" megawatthours | \n",
" 2014 | \n",
" 3 | \n",
" NaN | \n",
"
\n",
" \n",
" 36 | \n",
" 201702 | \n",
" M | \n",
" USA-WV | \n",
" 2017-05-24T14:26:30-04:00 | \n",
" 99 | \n",
" ELEC.GEN.WAS-WV-99.M | \n",
" 200101 | \n",
" WAS | \n",
" megawatthours | \n",
" 2014 | \n",
" 2 | \n",
" NaN | \n",
"
\n",
" \n",
" 37 | \n",
" 201702 | \n",
" M | \n",
" USA-WV | \n",
" 2017-05-24T14:26:30-04:00 | \n",
" 99 | \n",
" ELEC.GEN.WAS-WV-99.M | \n",
" 200101 | \n",
" WAS | \n",
" megawatthours | \n",
" 2014 | \n",
" 1 | \n",
" NaN | \n",
"
\n",
" \n",
" 0 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2014 | \n",
" 10 | \n",
" NaN | \n",
"
\n",
" \n",
" 1 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2014 | \n",
" 9 | \n",
" NaN | \n",
"
\n",
" \n",
" 2 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2014 | \n",
" 8 | \n",
" NaN | \n",
"
\n",
" \n",
" 3 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2014 | \n",
" 7 | \n",
" NaN | \n",
"
\n",
" \n",
" 4 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2014 | \n",
" 6 | \n",
" NaN | \n",
"
\n",
" \n",
" 5 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2014 | \n",
" 5 | \n",
" NaN | \n",
"
\n",
" \n",
" 6 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2014 | \n",
" 4 | \n",
" NaN | \n",
"
\n",
" \n",
" 7 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2014 | \n",
" 3 | \n",
" NaN | \n",
"
\n",
" \n",
" 8 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2014 | \n",
" 2 | \n",
" NaN | \n",
"
\n",
" \n",
" 9 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2014 | \n",
" 1 | \n",
" NaN | \n",
"
\n",
" \n",
" 10 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2013 | \n",
" 12 | \n",
" NaN | \n",
"
\n",
" \n",
" 11 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2013 | \n",
" 11 | \n",
" NaN | \n",
"
\n",
" \n",
" 12 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2013 | \n",
" 10 | \n",
" NaN | \n",
"
\n",
" \n",
" 13 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2013 | \n",
" 9 | \n",
" NaN | \n",
"
\n",
" \n",
" 14 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2013 | \n",
" 8 | \n",
" NaN | \n",
"
\n",
" \n",
" 15 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2013 | \n",
" 7 | \n",
" NaN | \n",
"
\n",
" \n",
" 16 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2013 | \n",
" 6 | \n",
" NaN | \n",
"
\n",
" \n",
" 17 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2013 | \n",
" 5 | \n",
" NaN | \n",
"
\n",
" \n",
" 18 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2013 | \n",
" 4 | \n",
" NaN | \n",
"
\n",
" \n",
" 19 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2013 | \n",
" 3 | \n",
" NaN | \n",
"
\n",
" \n",
" 20 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2013 | \n",
" 2 | \n",
" NaN | \n",
"
\n",
" \n",
" 21 | \n",
" 201410 | \n",
" M | \n",
" USA-AK | \n",
" 2016-12-19T17:19:30-05:00 | \n",
" 99 | \n",
" ELEC.GEN.OOG-AK-99.M | \n",
" 201101 | \n",
" OOG | \n",
" megawatthours | \n",
" 2013 | \n",
" 1 | \n",
" NaN | \n",
"
\n",
" \n",
"
\n",
"
900 rows × 12 columns
\n",
"
"
],
"text/plain": [
" end f geography last_updated sector \\\n",
"5 201712 M USA-AK 2018-02-28T02:03:13-05:00 99 \n",
"10 201712 M USA-AK 2018-02-28T02:03:13-05:00 99 \n",
"11 201712 M USA-AK 2018-02-28T02:03:13-05:00 99 \n",
"61 201712 M USA-AK 2018-02-28T02:03:13-05:00 99 \n",
"71 201712 M USA-AK 2018-02-28T02:03:13-05:00 99 \n",
"12 201712 M USA-MI 2018-02-28T02:03:13-05:00 99 \n",
"24 201712 M USA-WY 2018-02-28T02:03:13-05:00 99 \n",
"25 201712 M USA-WY 2018-02-28T02:03:13-05:00 99 \n",
"4 201712 M USA-HI 2018-02-28T02:03:13-05:00 99 \n",
"5 201712 M USA-HI 2018-02-28T02:03:13-05:00 99 \n",
"6 201712 M USA-HI 2018-02-28T02:03:13-05:00 99 \n",
"7 201712 M USA-HI 2018-02-28T02:03:13-05:00 99 \n",
"8 201712 M USA-HI 2018-02-28T02:03:13-05:00 99 \n",
"9 201712 M USA-HI 2018-02-28T02:03:13-05:00 99 \n",
"10 201712 M USA-HI 2018-02-28T02:03:13-05:00 99 \n",
"61 201712 M USA-OR 2018-02-28T02:03:13-05:00 99 \n",
"0 201712 M USA-GA 2018-02-28T02:03:13-05:00 99 \n",
"1 201712 M USA-GA 2018-02-28T02:03:13-05:00 99 \n",
"2 201712 M USA-GA 2018-02-28T02:03:13-05:00 99 \n",
"3 201712 M USA-GA 2018-02-28T02:03:13-05:00 99 \n",
"4 201712 M USA-GA 2018-02-28T02:03:13-05:00 99 \n",
"12 201712 M USA-GA 2018-02-28T02:03:13-05:00 99 \n",
"13 201712 M USA-GA 2018-02-28T02:03:13-05:00 99 \n",
"14 201712 M USA-GA 2018-02-28T02:03:13-05:00 99 \n",
"15 201712 M USA-GA 2018-02-28T02:03:13-05:00 99 \n",
"16 201712 M USA-GA 2018-02-28T02:03:13-05:00 99 \n",
"17 201712 M USA-GA 2018-02-28T02:03:13-05:00 99 \n",
"18 201712 M USA-GA 2018-02-28T02:03:13-05:00 99 \n",
"19 201712 M USA-GA 2018-02-28T02:03:13-05:00 99 \n",
"20 201712 M USA-GA 2018-02-28T02:03:13-05:00 99 \n",
".. ... .. ... ... ... \n",
"30 201702 M USA-WV 2017-05-24T14:26:30-04:00 99 \n",
"31 201702 M USA-WV 2017-05-24T14:26:30-04:00 99 \n",
"32 201702 M USA-WV 2017-05-24T14:26:30-04:00 99 \n",
"33 201702 M USA-WV 2017-05-24T14:26:30-04:00 99 \n",
"34 201702 M USA-WV 2017-05-24T14:26:30-04:00 99 \n",
"35 201702 M USA-WV 2017-05-24T14:26:30-04:00 99 \n",
"36 201702 M USA-WV 2017-05-24T14:26:30-04:00 99 \n",
"37 201702 M USA-WV 2017-05-24T14:26:30-04:00 99 \n",
"0 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"1 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"2 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"3 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"4 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"5 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"6 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"7 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"8 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"9 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"10 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"11 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"12 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"13 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"14 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"15 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"16 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"17 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"18 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"19 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"20 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"21 201410 M USA-AK 2016-12-19T17:19:30-05:00 99 \n",
"\n",
" series_id start type units year month \\\n",
"5 ELEC.GEN.AOR-AK-99.M 200101 AOR megawatthours 2017 7 \n",
"10 ELEC.GEN.AOR-AK-99.M 200101 AOR megawatthours 2017 2 \n",
"11 ELEC.GEN.AOR-AK-99.M 200101 AOR megawatthours 2017 1 \n",
"61 ELEC.GEN.AOR-AK-99.M 200101 AOR megawatthours 2012 11 \n",
"71 ELEC.GEN.AOR-AK-99.M 200101 AOR megawatthours 2012 1 \n",
"12 ELEC.GEN.DPV-MI-99.M 201401 DPV megawatthours 2016 12 \n",
"24 ELEC.GEN.DPV-WY-99.M 201401 DPV megawatthours 2015 12 \n",
"25 ELEC.GEN.DPV-WY-99.M 201401 DPV megawatthours 2015 11 \n",
"4 ELEC.GEN.HYC-HI-99.M 200101 HYC megawatthours 2017 8 \n",
"5 ELEC.GEN.HYC-HI-99.M 200101 HYC megawatthours 2017 7 \n",
"6 ELEC.GEN.HYC-HI-99.M 200101 HYC megawatthours 2017 6 \n",
"7 ELEC.GEN.HYC-HI-99.M 200101 HYC megawatthours 2017 5 \n",
"8 ELEC.GEN.HYC-HI-99.M 200101 HYC megawatthours 2017 4 \n",
"9 ELEC.GEN.HYC-HI-99.M 200101 HYC megawatthours 2017 3 \n",
"10 ELEC.GEN.HYC-HI-99.M 200101 HYC megawatthours 2017 2 \n",
"61 ELEC.GEN.GEO-OR-99.M 201211 GEO megawatthours 2012 11 \n",
"0 ELEC.GEN.DPV-GA-99.M 201401 DPV megawatthours 2017 12 \n",
"1 ELEC.GEN.DPV-GA-99.M 201401 DPV megawatthours 2017 11 \n",
"2 ELEC.GEN.DPV-GA-99.M 201401 DPV megawatthours 2017 10 \n",
"3 ELEC.GEN.DPV-GA-99.M 201401 DPV megawatthours 2017 9 \n",
"4 ELEC.GEN.DPV-GA-99.M 201401 DPV megawatthours 2017 8 \n",
"12 ELEC.GEN.DPV-GA-99.M 201401 DPV megawatthours 2016 12 \n",
"13 ELEC.GEN.DPV-GA-99.M 201401 DPV megawatthours 2016 11 \n",
"14 ELEC.GEN.DPV-GA-99.M 201401 DPV megawatthours 2016 10 \n",
"15 ELEC.GEN.DPV-GA-99.M 201401 DPV megawatthours 2016 9 \n",
"16 ELEC.GEN.DPV-GA-99.M 201401 DPV megawatthours 2016 8 \n",
"17 ELEC.GEN.DPV-GA-99.M 201401 DPV megawatthours 2016 7 \n",
"18 ELEC.GEN.DPV-GA-99.M 201401 DPV megawatthours 2016 6 \n",
"19 ELEC.GEN.DPV-GA-99.M 201401 DPV megawatthours 2016 5 \n",
"20 ELEC.GEN.DPV-GA-99.M 201401 DPV megawatthours 2016 4 \n",
".. ... ... ... ... ... ... \n",
"30 ELEC.GEN.WAS-WV-99.M 200101 WAS megawatthours 2014 8 \n",
"31 ELEC.GEN.WAS-WV-99.M 200101 WAS megawatthours 2014 7 \n",
"32 ELEC.GEN.WAS-WV-99.M 200101 WAS megawatthours 2014 6 \n",
"33 ELEC.GEN.WAS-WV-99.M 200101 WAS megawatthours 2014 5 \n",
"34 ELEC.GEN.WAS-WV-99.M 200101 WAS megawatthours 2014 4 \n",
"35 ELEC.GEN.WAS-WV-99.M 200101 WAS megawatthours 2014 3 \n",
"36 ELEC.GEN.WAS-WV-99.M 200101 WAS megawatthours 2014 2 \n",
"37 ELEC.GEN.WAS-WV-99.M 200101 WAS megawatthours 2014 1 \n",
"0 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2014 10 \n",
"1 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2014 9 \n",
"2 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2014 8 \n",
"3 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2014 7 \n",
"4 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2014 6 \n",
"5 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2014 5 \n",
"6 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2014 4 \n",
"7 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2014 3 \n",
"8 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2014 2 \n",
"9 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2014 1 \n",
"10 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2013 12 \n",
"11 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2013 11 \n",
"12 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2013 10 \n",
"13 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2013 9 \n",
"14 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2013 8 \n",
"15 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2013 7 \n",
"16 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2013 6 \n",
"17 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2013 5 \n",
"18 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2013 4 \n",
"19 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2013 3 \n",
"20 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2013 2 \n",
"21 ELEC.GEN.OOG-AK-99.M 201101 OOG megawatthours 2013 1 \n",
"\n",
" generation (MWh) \n",
"5 NaN \n",
"10 NaN \n",
"11 NaN \n",
"61 NaN \n",
"71 NaN \n",
"12 NaN \n",
"24 NaN \n",
"25 NaN \n",
"4 NaN \n",
"5 NaN \n",
"6 NaN \n",
"7 NaN \n",
"8 NaN \n",
"9 NaN \n",
"10 NaN \n",
"61 NaN \n",
"0 NaN \n",
"1 NaN \n",
"2 NaN \n",
"3 NaN \n",
"4 NaN \n",
"12 NaN \n",
"13 NaN \n",
"14 NaN \n",
"15 NaN \n",
"16 NaN \n",
"17 NaN \n",
"18 NaN \n",
"19 NaN \n",
"20 NaN \n",
".. ... \n",
"30 NaN \n",
"31 NaN \n",
"32 NaN \n",
"33 NaN \n",
"34 NaN \n",
"35 NaN \n",
"36 NaN \n",
"37 NaN \n",
"0 NaN \n",
"1 NaN \n",
"2 NaN \n",
"3 NaN \n",
"4 NaN \n",
"5 NaN \n",
"6 NaN \n",
"7 NaN \n",
"8 NaN \n",
"9 NaN \n",
"10 NaN \n",
"11 NaN \n",
"12 NaN \n",
"13 NaN \n",
"14 NaN \n",
"15 NaN \n",
"16 NaN \n",
"17 NaN \n",
"18 NaN \n",
"19 NaN \n",
"20 NaN \n",
"21 NaN \n",
"\n",
"[900 rows x 12 columns]"
]
},
"execution_count": 68,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"gen_df.loc[gen_df.isnull().any(axis=1)]"
]
},
{
"cell_type": "code",
"execution_count": 69,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:52:32.337577Z",
"start_time": "2017-10-31T17:52:32.173250Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"gen_df.dropna(inplace=True)"
]
},
{
"cell_type": "code",
"execution_count": 70,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:52:32.432083Z",
"start_time": "2017-10-31T17:52:32.344291Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"gen_df.set_index(['type', 'year', 'month', 'geography'], inplace=True)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Total fuel consumption"
]
},
{
"cell_type": "code",
"execution_count": 71,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:52:56.725934Z",
"start_time": "2017-10-31T17:52:56.689529Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"total_fuel_dict = [json.loads(row) for row in total_fuel_rows]"
]
},
{
"cell_type": "code",
"execution_count": 72,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:52:59.336234Z",
"start_time": "2017-10-31T17:52:56.727860Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"total_fuel_df = pd.concat([line_to_df(x) for x in total_fuel_dict\n",
" if x['geography'] in state_geos])"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Multiply generation values by 1,000,000 and change the units to MMBtu"
]
},
{
"cell_type": "code",
"execution_count": 73,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:53:08.715443Z",
"start_time": "2017-10-31T17:53:08.704070Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"total_fuel_df.loc[:,'value'] *= 1E6\n",
"total_fuel_df.loc[:,'units'] = 'mmbtu'"
]
},
{
"cell_type": "code",
"execution_count": 74,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:53:26.292463Z",
"start_time": "2017-10-31T17:53:26.282484Z"
},
"collapsed": true
},
"outputs": [
{
"name": "stderr",
"output_type": "stream",
"text": [
"C:\\Users\\gschivley\\Anaconda2\\envs\\psci\\lib\\site-packages\\ipykernel_launcher.py:1: FutureWarning: Using 'rename_axis' to alter labels is deprecated. Use '.rename' instead\n",
" \"\"\"Entry point for launching an IPython kernel.\n"
]
}
],
"source": [
"total_fuel_df.rename_axis({'value':'total fuel (mmbtu)'}, axis=1, inplace=True)"
]
},
{
"cell_type": "code",
"execution_count": 75,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:53:36.092110Z",
"start_time": "2017-10-31T17:53:36.074386Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"total_fuel_df.set_index(['type', 'year', 'month', 'geography'], inplace=True)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Drop nans"
]
},
{
"cell_type": "code",
"execution_count": 76,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:53:43.878486Z",
"start_time": "2017-10-31T17:53:43.802556Z"
},
"scrolled": true
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"
\n",
" \n",
" \n",
" | \n",
" | \n",
" | \n",
" | \n",
" end | \n",
" f | \n",
" last_updated | \n",
" sector | \n",
" series_id | \n",
" start | \n",
" units | \n",
" total fuel (mmbtu) | \n",
"
\n",
" \n",
" type | \n",
" year | \n",
" month | \n",
" geography | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
"
\n",
" \n",
" \n",
" \n",
" COW | \n",
" 2017 | \n",
" 6 | \n",
" USA-ME | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-ME-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 12 | \n",
" USA-AK | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-AK-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 7 | \n",
" USA-AK | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-AK-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 6 | \n",
" USA-AK | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-AK-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 3 | \n",
" USA-AK | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-AK-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 12 | \n",
" USA-ID | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-ID-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 11 | \n",
" USA-ID | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-ID-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 10 | \n",
" USA-ID | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-ID-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 9 | \n",
" USA-ID | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-ID-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 8 | \n",
" USA-ID | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-ID-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 7 | \n",
" USA-ID | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-ID-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 6 | \n",
" USA-ID | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-ID-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 5 | \n",
" USA-ID | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-ID-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 4 | \n",
" USA-ID | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-ID-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 3 | \n",
" USA-ID | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-ID-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 2 | \n",
" USA-ID | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-ID-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 1 | \n",
" USA-ID | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-ID-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 2015 | \n",
" 1 | \n",
" USA-HI | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-HI-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" PEL | \n",
" 2017 | \n",
" 12 | \n",
" USA-MT | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-MT-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 11 | \n",
" USA-MT | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-MT-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 8 | \n",
" USA-MT | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-MT-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 2015 | \n",
" 2 | \n",
" USA-KY | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-KY-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 2017 | \n",
" 8 | \n",
" USA-KS | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-KS-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 12 | \n",
" USA-LA | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-LA-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 11 | \n",
" USA-LA | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-LA-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 10 | \n",
" USA-LA | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-LA-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 9 | \n",
" USA-LA | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-LA-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 8 | \n",
" USA-LA | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-LA-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 7 | \n",
" USA-LA | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-LA-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 6 | \n",
" USA-LA | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-LA-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
" ... | \n",
"
\n",
" \n",
" 9 | \n",
" USA-NE | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-NE-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 8 | \n",
" USA-NE | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-NE-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 7 | \n",
" USA-NE | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-NE-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 6 | \n",
" USA-NE | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-NE-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 5 | \n",
" USA-NE | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-NE-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 4 | \n",
" USA-NE | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-NE-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 3 | \n",
" USA-NE | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-NE-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 2 | \n",
" USA-NE | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-NE-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 1 | \n",
" USA-NE | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-NE-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 6 | \n",
" USA-NM | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-NM-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 11 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-NJ-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 5 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-NJ-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 3 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-NJ-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 2 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-NJ-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 2015 | \n",
" 2 | \n",
" USA-NV | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-NV-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 2013 | \n",
" 12 | \n",
" USA-PA | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-PA-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 2 | \n",
" USA-PA | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-PA-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" PC | \n",
" 2014 | \n",
" 12 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PC-NJ-99.M | \n",
" 201101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 6 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PC-NJ-99.M | \n",
" 201101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 5 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PC-NJ-99.M | \n",
" 201101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 4 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PC-NJ-99.M | \n",
" 201101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 3 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PC-NJ-99.M | \n",
" 201101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 2 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PC-NJ-99.M | \n",
" 201101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 1 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PC-NJ-99.M | \n",
" 201101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" PEL | \n",
" 2017 | \n",
" 6 | \n",
" USA-CO | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-CO-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 4 | \n",
" USA-CO | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-CO-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 1 | \n",
" USA-CO | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-CO-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 12 | \n",
" USA-IL | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-IL-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" 4 | \n",
" USA-CT | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-CT-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
" NG | \n",
" 2017 | \n",
" 10 | \n",
" USA-MO | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.NG-MO-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" NaN | \n",
"
\n",
" \n",
"
\n",
"
197 rows × 8 columns
\n",
"
"
],
"text/plain": [
" end f last_updated sector \\\n",
"type year month geography \n",
"COW 2017 6 USA-ME 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 12 USA-AK 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 7 USA-AK 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 6 USA-AK 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 3 USA-AK 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 12 USA-ID 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 11 USA-ID 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 10 USA-ID 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 9 USA-ID 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 8 USA-ID 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 7 USA-ID 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 6 USA-ID 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 5 USA-ID 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 4 USA-ID 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 3 USA-ID 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 2 USA-ID 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 1 USA-ID 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 2015 1 USA-HI 201712 M 2018-02-28T02:03:13-05:00 99 \n",
"PEL 2017 12 USA-MT 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 11 USA-MT 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 8 USA-MT 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 2015 2 USA-KY 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 2017 8 USA-KS 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 12 USA-LA 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 11 USA-LA 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 10 USA-LA 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 9 USA-LA 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 8 USA-LA 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 7 USA-LA 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 6 USA-LA 201712 M 2018-02-28T02:03:13-05:00 99 \n",
"... ... .. ... ... \n",
" 9 USA-NE 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 8 USA-NE 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 7 USA-NE 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 6 USA-NE 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 5 USA-NE 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 4 USA-NE 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 3 USA-NE 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 2 USA-NE 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 1 USA-NE 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 6 USA-NM 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 11 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 5 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 3 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 2 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 2015 2 USA-NV 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 2013 12 USA-PA 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 2 USA-PA 201712 M 2018-02-28T02:03:13-05:00 99 \n",
"PC 2014 12 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 6 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 5 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 4 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 3 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 2 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 1 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
"PEL 2017 6 USA-CO 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 4 USA-CO 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 1 USA-CO 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 12 USA-IL 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 4 USA-CT 201712 M 2018-02-28T02:03:13-05:00 99 \n",
"NG 2017 10 USA-MO 201712 M 2018-02-28T02:03:13-05:00 99 \n",
"\n",
" series_id start units \\\n",
"type year month geography \n",
"COW 2017 6 USA-ME ELEC.CONS_TOT_BTU.COW-ME-99.M 200101 mmbtu \n",
" 12 USA-AK ELEC.CONS_TOT_BTU.COW-AK-99.M 200101 mmbtu \n",
" 7 USA-AK ELEC.CONS_TOT_BTU.COW-AK-99.M 200101 mmbtu \n",
" 6 USA-AK ELEC.CONS_TOT_BTU.COW-AK-99.M 200101 mmbtu \n",
" 3 USA-AK ELEC.CONS_TOT_BTU.COW-AK-99.M 200101 mmbtu \n",
" 12 USA-ID ELEC.CONS_TOT_BTU.COW-ID-99.M 200101 mmbtu \n",
" 11 USA-ID ELEC.CONS_TOT_BTU.COW-ID-99.M 200101 mmbtu \n",
" 10 USA-ID ELEC.CONS_TOT_BTU.COW-ID-99.M 200101 mmbtu \n",
" 9 USA-ID ELEC.CONS_TOT_BTU.COW-ID-99.M 200101 mmbtu \n",
" 8 USA-ID ELEC.CONS_TOT_BTU.COW-ID-99.M 200101 mmbtu \n",
" 7 USA-ID ELEC.CONS_TOT_BTU.COW-ID-99.M 200101 mmbtu \n",
" 6 USA-ID ELEC.CONS_TOT_BTU.COW-ID-99.M 200101 mmbtu \n",
" 5 USA-ID ELEC.CONS_TOT_BTU.COW-ID-99.M 200101 mmbtu \n",
" 4 USA-ID ELEC.CONS_TOT_BTU.COW-ID-99.M 200101 mmbtu \n",
" 3 USA-ID ELEC.CONS_TOT_BTU.COW-ID-99.M 200101 mmbtu \n",
" 2 USA-ID ELEC.CONS_TOT_BTU.COW-ID-99.M 200101 mmbtu \n",
" 1 USA-ID ELEC.CONS_TOT_BTU.COW-ID-99.M 200101 mmbtu \n",
" 2015 1 USA-HI ELEC.CONS_TOT_BTU.COW-HI-99.M 200101 mmbtu \n",
"PEL 2017 12 USA-MT ELEC.CONS_TOT_BTU.PEL-MT-99.M 200101 mmbtu \n",
" 11 USA-MT ELEC.CONS_TOT_BTU.PEL-MT-99.M 200101 mmbtu \n",
" 8 USA-MT ELEC.CONS_TOT_BTU.PEL-MT-99.M 200101 mmbtu \n",
" 2015 2 USA-KY ELEC.CONS_TOT_BTU.PEL-KY-99.M 200101 mmbtu \n",
" 2017 8 USA-KS ELEC.CONS_TOT_BTU.PEL-KS-99.M 200101 mmbtu \n",
" 12 USA-LA ELEC.CONS_TOT_BTU.PEL-LA-99.M 200101 mmbtu \n",
" 11 USA-LA ELEC.CONS_TOT_BTU.PEL-LA-99.M 200101 mmbtu \n",
" 10 USA-LA ELEC.CONS_TOT_BTU.PEL-LA-99.M 200101 mmbtu \n",
" 9 USA-LA ELEC.CONS_TOT_BTU.PEL-LA-99.M 200101 mmbtu \n",
" 8 USA-LA ELEC.CONS_TOT_BTU.PEL-LA-99.M 200101 mmbtu \n",
" 7 USA-LA ELEC.CONS_TOT_BTU.PEL-LA-99.M 200101 mmbtu \n",
" 6 USA-LA ELEC.CONS_TOT_BTU.PEL-LA-99.M 200101 mmbtu \n",
"... ... ... ... \n",
" 9 USA-NE ELEC.CONS_TOT_BTU.PEL-NE-99.M 200101 mmbtu \n",
" 8 USA-NE ELEC.CONS_TOT_BTU.PEL-NE-99.M 200101 mmbtu \n",
" 7 USA-NE ELEC.CONS_TOT_BTU.PEL-NE-99.M 200101 mmbtu \n",
" 6 USA-NE ELEC.CONS_TOT_BTU.PEL-NE-99.M 200101 mmbtu \n",
" 5 USA-NE ELEC.CONS_TOT_BTU.PEL-NE-99.M 200101 mmbtu \n",
" 4 USA-NE ELEC.CONS_TOT_BTU.PEL-NE-99.M 200101 mmbtu \n",
" 3 USA-NE ELEC.CONS_TOT_BTU.PEL-NE-99.M 200101 mmbtu \n",
" 2 USA-NE ELEC.CONS_TOT_BTU.PEL-NE-99.M 200101 mmbtu \n",
" 1 USA-NE ELEC.CONS_TOT_BTU.PEL-NE-99.M 200101 mmbtu \n",
" 6 USA-NM ELEC.CONS_TOT_BTU.PEL-NM-99.M 200101 mmbtu \n",
" 11 USA-NJ ELEC.CONS_TOT_BTU.PEL-NJ-99.M 200101 mmbtu \n",
" 5 USA-NJ ELEC.CONS_TOT_BTU.PEL-NJ-99.M 200101 mmbtu \n",
" 3 USA-NJ ELEC.CONS_TOT_BTU.PEL-NJ-99.M 200101 mmbtu \n",
" 2 USA-NJ ELEC.CONS_TOT_BTU.PEL-NJ-99.M 200101 mmbtu \n",
" 2015 2 USA-NV ELEC.CONS_TOT_BTU.PEL-NV-99.M 200101 mmbtu \n",
" 2013 12 USA-PA ELEC.CONS_TOT_BTU.PEL-PA-99.M 200101 mmbtu \n",
" 2 USA-PA ELEC.CONS_TOT_BTU.PEL-PA-99.M 200101 mmbtu \n",
"PC 2014 12 USA-NJ ELEC.CONS_TOT_BTU.PC-NJ-99.M 201101 mmbtu \n",
" 6 USA-NJ ELEC.CONS_TOT_BTU.PC-NJ-99.M 201101 mmbtu \n",
" 5 USA-NJ ELEC.CONS_TOT_BTU.PC-NJ-99.M 201101 mmbtu \n",
" 4 USA-NJ ELEC.CONS_TOT_BTU.PC-NJ-99.M 201101 mmbtu \n",
" 3 USA-NJ ELEC.CONS_TOT_BTU.PC-NJ-99.M 201101 mmbtu \n",
" 2 USA-NJ ELEC.CONS_TOT_BTU.PC-NJ-99.M 201101 mmbtu \n",
" 1 USA-NJ ELEC.CONS_TOT_BTU.PC-NJ-99.M 201101 mmbtu \n",
"PEL 2017 6 USA-CO ELEC.CONS_TOT_BTU.PEL-CO-99.M 200101 mmbtu \n",
" 4 USA-CO ELEC.CONS_TOT_BTU.PEL-CO-99.M 200101 mmbtu \n",
" 1 USA-CO ELEC.CONS_TOT_BTU.PEL-CO-99.M 200101 mmbtu \n",
" 12 USA-IL ELEC.CONS_TOT_BTU.PEL-IL-99.M 200101 mmbtu \n",
" 4 USA-CT ELEC.CONS_TOT_BTU.PEL-CT-99.M 200101 mmbtu \n",
"NG 2017 10 USA-MO ELEC.CONS_TOT_BTU.NG-MO-99.M 200101 mmbtu \n",
"\n",
" total fuel (mmbtu) \n",
"type year month geography \n",
"COW 2017 6 USA-ME NaN \n",
" 12 USA-AK NaN \n",
" 7 USA-AK NaN \n",
" 6 USA-AK NaN \n",
" 3 USA-AK NaN \n",
" 12 USA-ID NaN \n",
" 11 USA-ID NaN \n",
" 10 USA-ID NaN \n",
" 9 USA-ID NaN \n",
" 8 USA-ID NaN \n",
" 7 USA-ID NaN \n",
" 6 USA-ID NaN \n",
" 5 USA-ID NaN \n",
" 4 USA-ID NaN \n",
" 3 USA-ID NaN \n",
" 2 USA-ID NaN \n",
" 1 USA-ID NaN \n",
" 2015 1 USA-HI NaN \n",
"PEL 2017 12 USA-MT NaN \n",
" 11 USA-MT NaN \n",
" 8 USA-MT NaN \n",
" 2015 2 USA-KY NaN \n",
" 2017 8 USA-KS NaN \n",
" 12 USA-LA NaN \n",
" 11 USA-LA NaN \n",
" 10 USA-LA NaN \n",
" 9 USA-LA NaN \n",
" 8 USA-LA NaN \n",
" 7 USA-LA NaN \n",
" 6 USA-LA NaN \n",
"... ... \n",
" 9 USA-NE NaN \n",
" 8 USA-NE NaN \n",
" 7 USA-NE NaN \n",
" 6 USA-NE NaN \n",
" 5 USA-NE NaN \n",
" 4 USA-NE NaN \n",
" 3 USA-NE NaN \n",
" 2 USA-NE NaN \n",
" 1 USA-NE NaN \n",
" 6 USA-NM NaN \n",
" 11 USA-NJ NaN \n",
" 5 USA-NJ NaN \n",
" 3 USA-NJ NaN \n",
" 2 USA-NJ NaN \n",
" 2015 2 USA-NV NaN \n",
" 2013 12 USA-PA NaN \n",
" 2 USA-PA NaN \n",
"PC 2014 12 USA-NJ NaN \n",
" 6 USA-NJ NaN \n",
" 5 USA-NJ NaN \n",
" 4 USA-NJ NaN \n",
" 3 USA-NJ NaN \n",
" 2 USA-NJ NaN \n",
" 1 USA-NJ NaN \n",
"PEL 2017 6 USA-CO NaN \n",
" 4 USA-CO NaN \n",
" 1 USA-CO NaN \n",
" 12 USA-IL NaN \n",
" 4 USA-CT NaN \n",
"NG 2017 10 USA-MO NaN \n",
"\n",
"[197 rows x 8 columns]"
]
},
"execution_count": 76,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"total_fuel_df.loc[total_fuel_df.isnull().any(axis=1)]"
]
},
{
"cell_type": "code",
"execution_count": 77,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:53:53.313268Z",
"start_time": "2017-10-31T17:53:53.288287Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"total_fuel_df = total_fuel_df.dropna()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Electric generation fuel consumption"
]
},
{
"cell_type": "code",
"execution_count": 78,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:54:01.866857Z",
"start_time": "2017-10-31T17:54:01.739518Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"eg_fuel_dict = [json.loads(row) for row in eg_fuel_rows]"
]
},
{
"cell_type": "code",
"execution_count": 79,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:54:12.574727Z",
"start_time": "2017-10-31T17:54:09.940318Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"eg_fuel_df = pd.concat([line_to_df(x) for x in eg_fuel_dict\n",
" if x['geography'] in state_geos])"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Multiply generation values by 1,000,000 and change the units to MMBtu"
]
},
{
"cell_type": "code",
"execution_count": 80,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:54:25.125560Z",
"start_time": "2017-10-31T17:54:25.114673Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"eg_fuel_df.loc[:,'value'] *= 1E6\n",
"eg_fuel_df.loc[:,'units'] = 'mmbtu'"
]
},
{
"cell_type": "code",
"execution_count": 81,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:54:32.925591Z",
"start_time": "2017-10-31T17:54:32.917528Z"
},
"collapsed": true
},
"outputs": [
{
"name": "stderr",
"output_type": "stream",
"text": [
"C:\\Users\\gschivley\\Anaconda2\\envs\\psci\\lib\\site-packages\\ipykernel_launcher.py:1: FutureWarning: Using 'rename_axis' to alter labels is deprecated. Use '.rename' instead\n",
" \"\"\"Entry point for launching an IPython kernel.\n"
]
}
],
"source": [
"eg_fuel_df.rename_axis({'value':'elec fuel (mmbtu)'}, axis=1, inplace=True)"
]
},
{
"cell_type": "code",
"execution_count": 82,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:54:41.279174Z",
"start_time": "2017-10-31T17:54:41.259131Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"eg_fuel_df.set_index(['type', 'year', 'month', 'geography'], inplace=True)"
]
},
{
"cell_type": "code",
"execution_count": 83,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:54:50.073626Z",
"start_time": "2017-10-31T17:54:50.054411Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"
\n",
" \n",
" \n",
" | \n",
" | \n",
" | \n",
" | \n",
" end | \n",
" f | \n",
" last_updated | \n",
" sector | \n",
" series_id | \n",
" start | \n",
" units | \n",
" elec fuel (mmbtu) | \n",
"
\n",
" \n",
" type | \n",
" year | \n",
" month | \n",
" geography | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
"
\n",
" \n",
" \n",
" \n",
" PC | \n",
" 2017 | \n",
" 12 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_EG_BTU.PC-NJ-99.M | \n",
" 201101 | \n",
" mmbtu | \n",
" 22330.0 | \n",
"
\n",
" \n",
" 11 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_EG_BTU.PC-NJ-99.M | \n",
" 201101 | \n",
" mmbtu | \n",
" 21780.0 | \n",
"
\n",
" \n",
" 10 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_EG_BTU.PC-NJ-99.M | \n",
" 201101 | \n",
" mmbtu | \n",
" 18450.0 | \n",
"
\n",
" \n",
" 9 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_EG_BTU.PC-NJ-99.M | \n",
" 201101 | \n",
" mmbtu | \n",
" 22760.0 | \n",
"
\n",
" \n",
" 8 | \n",
" USA-NJ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_EG_BTU.PC-NJ-99.M | \n",
" 201101 | \n",
" mmbtu | \n",
" 20030.0 | \n",
"
\n",
" \n",
"
\n",
"
"
],
"text/plain": [
" end f last_updated sector \\\n",
"type year month geography \n",
"PC 2017 12 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 11 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 10 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 9 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 8 USA-NJ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
"\n",
" series_id start units \\\n",
"type year month geography \n",
"PC 2017 12 USA-NJ ELEC.CONS_EG_BTU.PC-NJ-99.M 201101 mmbtu \n",
" 11 USA-NJ ELEC.CONS_EG_BTU.PC-NJ-99.M 201101 mmbtu \n",
" 10 USA-NJ ELEC.CONS_EG_BTU.PC-NJ-99.M 201101 mmbtu \n",
" 9 USA-NJ ELEC.CONS_EG_BTU.PC-NJ-99.M 201101 mmbtu \n",
" 8 USA-NJ ELEC.CONS_EG_BTU.PC-NJ-99.M 201101 mmbtu \n",
"\n",
" elec fuel (mmbtu) \n",
"type year month geography \n",
"PC 2017 12 USA-NJ 22330.0 \n",
" 11 USA-NJ 21780.0 \n",
" 10 USA-NJ 18450.0 \n",
" 9 USA-NJ 22760.0 \n",
" 8 USA-NJ 20030.0 "
]
},
"execution_count": 83,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"#drop\n",
"eg_fuel_df.head()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"I verified on [EIA's website](https://www.eia.gov/opendata/qb.php?category=400&sdid=ELEC.CONS_EG_BTU.PEL-MN-99.M) that the values below are correct."
]
},
{
"cell_type": "code",
"execution_count": 84,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:54:58.387406Z",
"start_time": "2017-10-31T17:54:58.356615Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"
\n",
" \n",
" \n",
" | \n",
" | \n",
" | \n",
" | \n",
" end | \n",
" f | \n",
" last_updated | \n",
" sector | \n",
" series_id | \n",
" start | \n",
" units | \n",
" elec fuel (mmbtu) | \n",
"
\n",
" \n",
" type | \n",
" year | \n",
" month | \n",
" geography | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
"
\n",
" \n",
" \n",
" \n",
" PEL | \n",
" 2002 | \n",
" 12 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_EG_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" -43000.0 | \n",
"
\n",
" \n",
" 11 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_EG_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" -32000.0 | \n",
"
\n",
" \n",
" 10 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_EG_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" -15000.0 | \n",
"
\n",
" \n",
" 8 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_EG_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" -16000.0 | \n",
"
\n",
" \n",
" 7 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_EG_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" -1000.0 | \n",
"
\n",
" \n",
" 4 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_EG_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" -6000.0 | \n",
"
\n",
" \n",
" 3 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_EG_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" -10000.0 | \n",
"
\n",
" \n",
" 2 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_EG_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" -30000.0 | \n",
"
\n",
" \n",
" 1 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_EG_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" -34000.0 | \n",
"
\n",
" \n",
"
\n",
"
"
],
"text/plain": [
" end f last_updated sector \\\n",
"type year month geography \n",
"PEL 2002 12 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 11 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 10 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 8 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 7 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 4 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 3 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 2 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 1 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
"\n",
" series_id start units \\\n",
"type year month geography \n",
"PEL 2002 12 USA-MN ELEC.CONS_EG_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 11 USA-MN ELEC.CONS_EG_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 10 USA-MN ELEC.CONS_EG_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 8 USA-MN ELEC.CONS_EG_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 7 USA-MN ELEC.CONS_EG_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 4 USA-MN ELEC.CONS_EG_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 3 USA-MN ELEC.CONS_EG_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 2 USA-MN ELEC.CONS_EG_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 1 USA-MN ELEC.CONS_EG_BTU.PEL-MN-99.M 200101 mmbtu \n",
"\n",
" elec fuel (mmbtu) \n",
"type year month geography \n",
"PEL 2002 12 USA-MN -43000.0 \n",
" 11 USA-MN -32000.0 \n",
" 10 USA-MN -15000.0 \n",
" 8 USA-MN -16000.0 \n",
" 7 USA-MN -1000.0 \n",
" 4 USA-MN -6000.0 \n",
" 3 USA-MN -10000.0 \n",
" 2 USA-MN -30000.0 \n",
" 1 USA-MN -34000.0 "
]
},
"execution_count": 84,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"#drop\n",
"eg_fuel_df.loc[~(eg_fuel_df['elec fuel (mmbtu)'] >= 0) &\n",
" ~(eg_fuel_df['elec fuel (mmbtu)'].isnull())]"
]
},
{
"cell_type": "code",
"execution_count": 85,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:55:07.070435Z",
"start_time": "2017-10-31T17:55:07.045574Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"eg_fuel_df.dropna(inplace=True)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Combine three datasets\n",
"Need to estimate fuel use for OOG, because EIA doesn't include any (this is only ~2% of OOG fuel for electricity in 2015)."
]
},
{
"cell_type": "code",
"execution_count": 86,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:55:15.779136Z",
"start_time": "2017-10-31T17:55:15.473615Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"fuel_df = pd.concat([total_fuel_df, eg_fuel_df['elec fuel (mmbtu)']], axis=1)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Not sure how this happens in EIA's data, but we do see the negative fuel consumption for electricity generation."
]
},
{
"cell_type": "code",
"execution_count": 87,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:55:25.638114Z",
"start_time": "2017-10-31T17:55:25.612533Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"
\n",
" \n",
" \n",
" | \n",
" | \n",
" | \n",
" | \n",
" end | \n",
" f | \n",
" last_updated | \n",
" sector | \n",
" series_id | \n",
" start | \n",
" units | \n",
" total fuel (mmbtu) | \n",
" elec fuel (mmbtu) | \n",
"
\n",
" \n",
" type | \n",
" year | \n",
" month | \n",
" geography | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
"
\n",
" \n",
" \n",
" \n",
" PEL | \n",
" 2002 | \n",
" 1 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" 51000.0 | \n",
" -34000.0 | \n",
"
\n",
" \n",
" 2 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" 62000.0 | \n",
" -30000.0 | \n",
"
\n",
" \n",
" 3 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" 99000.0 | \n",
" -10000.0 | \n",
"
\n",
" \n",
" 4 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" 84000.0 | \n",
" -6000.0 | \n",
"
\n",
" \n",
" 7 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" 93000.0 | \n",
" -1000.0 | \n",
"
\n",
" \n",
" 8 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" 66000.0 | \n",
" -16000.0 | \n",
"
\n",
" \n",
" 10 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" 64000.0 | \n",
" -15000.0 | \n",
"
\n",
" \n",
" 11 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" 49000.0 | \n",
" -32000.0 | \n",
"
\n",
" \n",
" 12 | \n",
" USA-MN | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.PEL-MN-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" 50000.0 | \n",
" -43000.0 | \n",
"
\n",
" \n",
"
\n",
"
"
],
"text/plain": [
" end f last_updated sector \\\n",
"type year month geography \n",
"PEL 2002 1 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 2 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 3 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 4 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 7 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 8 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 10 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 11 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" 12 USA-MN 201712 M 2018-02-28T02:03:13-05:00 99 \n",
"\n",
" series_id start units \\\n",
"type year month geography \n",
"PEL 2002 1 USA-MN ELEC.CONS_TOT_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 2 USA-MN ELEC.CONS_TOT_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 3 USA-MN ELEC.CONS_TOT_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 4 USA-MN ELEC.CONS_TOT_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 7 USA-MN ELEC.CONS_TOT_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 8 USA-MN ELEC.CONS_TOT_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 10 USA-MN ELEC.CONS_TOT_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 11 USA-MN ELEC.CONS_TOT_BTU.PEL-MN-99.M 200101 mmbtu \n",
" 12 USA-MN ELEC.CONS_TOT_BTU.PEL-MN-99.M 200101 mmbtu \n",
"\n",
" total fuel (mmbtu) elec fuel (mmbtu) \n",
"type year month geography \n",
"PEL 2002 1 USA-MN 51000.0 -34000.0 \n",
" 2 USA-MN 62000.0 -30000.0 \n",
" 3 USA-MN 99000.0 -10000.0 \n",
" 4 USA-MN 84000.0 -6000.0 \n",
" 7 USA-MN 93000.0 -1000.0 \n",
" 8 USA-MN 66000.0 -16000.0 \n",
" 10 USA-MN 64000.0 -15000.0 \n",
" 11 USA-MN 49000.0 -32000.0 \n",
" 12 USA-MN 50000.0 -43000.0 "
]
},
"execution_count": 87,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"#drop\n",
"fuel_df.loc[~(fuel_df['elec fuel (mmbtu)']>=0)]"
]
},
{
"cell_type": "code",
"execution_count": 88,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:55:34.219142Z",
"start_time": "2017-10-31T17:55:34.206392Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"
\n",
" \n",
" \n",
" | \n",
" | \n",
" | \n",
" | \n",
" end | \n",
" f | \n",
" last_updated | \n",
" sector | \n",
" series_id | \n",
" start | \n",
" units | \n",
" total fuel (mmbtu) | \n",
" elec fuel (mmbtu) | \n",
"
\n",
" \n",
" type | \n",
" year | \n",
" month | \n",
" geography | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
"
\n",
" \n",
" \n",
" \n",
"
\n",
"
"
],
"text/plain": [
"Empty DataFrame\n",
"Columns: [end, f, last_updated, sector, series_id, start, units, total fuel (mmbtu), elec fuel (mmbtu)]\n",
"Index: []"
]
},
"execution_count": 88,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"#drop\n",
"fuel_df.loc[~(fuel_df['total fuel (mmbtu)']>=0)]"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Add CO2 emissions\n",
"\n",
"The difficulty here is that EIA combines all types of coal fuel consumption together in the bulk download and API. Fortunately the emission factors for different coal types aren't too far off on an energy basis (BIT is 93.3 kg/mmbtu, SUB is 97.2 kg/mmbtu). I'm going to average the BIT and SUB factors rather than trying to do something more complicated. In 2015 BIT represented 45% of coal energy for electricity and SUB represented 48%.\n",
"\n",
"Same issue with petroleum liquids. Using the average of DFO and RFO, which were the two largest share of petroleum liquids."
]
},
{
"cell_type": "code",
"execution_count": 89,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:55:42.569867Z",
"start_time": "2017-10-31T17:55:42.560218Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"path = join(data_path, 'Final emission factors.csv')\n",
"ef = pd.read_csv(path, index_col=0)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Match general types with specific fuel codes"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Fuel codes:\n",
"- WWW, wood and wood derived fuels\n",
"- WND, wind\n",
"- STH, solar thermal\n",
"- WAS, other biomass\n",
"- TSN, all solar\n",
"- SUN, utility-scale solar\n",
"- NUC, nuclear\n",
"- NG, natural gas\n",
"- PEL, petroleum liquids\n",
"- SPV, utility-scale solar photovoltaic\n",
"- PC, petroluem coke\n",
"- OTH, other\n",
"- COW, coal,\n",
"- DPV, distributed photovoltaic\n",
"- OOG, other gases\n",
"- HPS, hydro pumped storage\n",
"- HYC, conventional hydroelectric\n",
"- GEO, geothermal\n",
"- AOR, other renewables (total)"
]
},
{
"cell_type": "code",
"execution_count": 90,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:56:04.263644Z",
"start_time": "2017-10-31T17:56:04.253963Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"fuel_factors = pd.Series({'NG' : ef.loc['NG', 'Fossil Factor'],\n",
" 'PEL': ef.loc[['DFO', 'RFO'], 'Fossil Factor'].mean(),\n",
" 'PC' : ef.loc['PC', 'Fossil Factor'], \n",
" 'COW' : ef.loc[['BIT', 'SUB'], 'Fossil Factor'].mean(),\n",
" 'OOG' : ef.loc['OG', 'Fossil Factor']}, name='type')"
]
},
{
"cell_type": "code",
"execution_count": 91,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:56:12.342458Z",
"start_time": "2017-10-31T17:56:12.335537Z"
}
},
"outputs": [
{
"data": {
"text/plain": [
"COW 95.250\n",
"NG 53.070\n",
"OOG 59.000\n",
"PC 102.100\n",
"PEL 75.975\n",
"Name: type, dtype: float64"
]
},
"execution_count": 91,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"#drop\n",
"fuel_factors"
]
},
{
"cell_type": "code",
"execution_count": 92,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:56:21.450888Z",
"start_time": "2017-10-31T17:56:21.424111Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"fuel_df['all fuel CO2 (kg)'] = (fuel_df['total fuel (mmbtu)']\n",
" .multiply(fuel_factors, level='type',\n",
" fill_value=0))\n",
"fuel_df['elec fuel CO2 (kg)'] = (fuel_df['elec fuel (mmbtu)']\n",
" .multiply(fuel_factors, level='type',\n",
" fill_value=0))"
]
},
{
"cell_type": "code",
"execution_count": 93,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:56:29.803955Z",
"start_time": "2017-10-31T17:56:29.774735Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"
\n",
" \n",
" \n",
" | \n",
" | \n",
" | \n",
" | \n",
" end | \n",
" f | \n",
" last_updated | \n",
" sector | \n",
" series_id | \n",
" start | \n",
" units | \n",
" total fuel (mmbtu) | \n",
" elec fuel (mmbtu) | \n",
" all fuel CO2 (kg) | \n",
" elec fuel CO2 (kg) | \n",
"
\n",
" \n",
" type | \n",
" year | \n",
" month | \n",
" geography | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
"
\n",
" \n",
" \n",
" \n",
" COW | \n",
" 2001 | \n",
" 1 | \n",
" USA-AK | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-AK-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" 1120000.0 | \n",
" 872000.0 | \n",
" 1.066800e+08 | \n",
" 8.305800e+07 | \n",
"
\n",
" \n",
" USA-AL | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-AL-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" 67999000.0 | \n",
" 66582000.0 | \n",
" 6.476905e+09 | \n",
" 6.341935e+09 | \n",
"
\n",
" \n",
" USA-AR | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-AR-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" 23099000.0 | \n",
" 22700000.0 | \n",
" 2.200180e+09 | \n",
" 2.162175e+09 | \n",
"
\n",
" \n",
" USA-AZ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-AZ-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" 35873000.0 | \n",
" 35483000.0 | \n",
" 3.416903e+09 | \n",
" 3.379756e+09 | \n",
"
\n",
" \n",
" USA-CA | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.CONS_TOT_BTU.COW-CA-99.M | \n",
" 200101 | \n",
" mmbtu | \n",
" 3652000.0 | \n",
" 2008000.0 | \n",
" 3.478530e+08 | \n",
" 1.912620e+08 | \n",
"
\n",
" \n",
"
\n",
"
"
],
"text/plain": [
" end f last_updated sector \\\n",
"type year month geography \n",
"COW 2001 1 USA-AK 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" USA-AL 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" USA-AR 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" USA-AZ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" USA-CA 201712 M 2018-02-28T02:03:13-05:00 99 \n",
"\n",
" series_id start units \\\n",
"type year month geography \n",
"COW 2001 1 USA-AK ELEC.CONS_TOT_BTU.COW-AK-99.M 200101 mmbtu \n",
" USA-AL ELEC.CONS_TOT_BTU.COW-AL-99.M 200101 mmbtu \n",
" USA-AR ELEC.CONS_TOT_BTU.COW-AR-99.M 200101 mmbtu \n",
" USA-AZ ELEC.CONS_TOT_BTU.COW-AZ-99.M 200101 mmbtu \n",
" USA-CA ELEC.CONS_TOT_BTU.COW-CA-99.M 200101 mmbtu \n",
"\n",
" total fuel (mmbtu) elec fuel (mmbtu) \\\n",
"type year month geography \n",
"COW 2001 1 USA-AK 1120000.0 872000.0 \n",
" USA-AL 67999000.0 66582000.0 \n",
" USA-AR 23099000.0 22700000.0 \n",
" USA-AZ 35873000.0 35483000.0 \n",
" USA-CA 3652000.0 2008000.0 \n",
"\n",
" all fuel CO2 (kg) elec fuel CO2 (kg) \n",
"type year month geography \n",
"COW 2001 1 USA-AK 1.066800e+08 8.305800e+07 \n",
" USA-AL 6.476905e+09 6.341935e+09 \n",
" USA-AR 2.200180e+09 2.162175e+09 \n",
" USA-AZ 3.416903e+09 3.379756e+09 \n",
" USA-CA 3.478530e+08 1.912620e+08 "
]
},
"execution_count": 93,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"fuel_df.head()"
]
},
{
"cell_type": "code",
"execution_count": 94,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:56:39.238148Z",
"start_time": "2017-10-31T17:56:38.505831Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"fuel_cols = ['total fuel (mmbtu)', 'elec fuel (mmbtu)',\n",
" 'all fuel CO2 (kg)', 'elec fuel CO2 (kg)']\n",
"gen_fuel_df = pd.concat([gen_df, fuel_df[fuel_cols]], axis=1)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Add datetime and quarter columns"
]
},
{
"cell_type": "code",
"execution_count": 95,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:56:59.385347Z",
"start_time": "2017-10-31T17:56:59.219142Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"add_quarter(gen_fuel_df)"
]
},
{
"cell_type": "code",
"execution_count": 96,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:57:07.206454Z",
"start_time": "2017-10-31T17:57:07.135063Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"
\n",
" \n",
" \n",
" | \n",
" | \n",
" | \n",
" | \n",
" end | \n",
" f | \n",
" last_updated | \n",
" sector | \n",
" series_id | \n",
" start | \n",
" units | \n",
" generation (MWh) | \n",
" total fuel (mmbtu) | \n",
" elec fuel (mmbtu) | \n",
" all fuel CO2 (kg) | \n",
" elec fuel CO2 (kg) | \n",
" datetime | \n",
" quarter | \n",
"
\n",
" \n",
" type | \n",
" year | \n",
" month | \n",
" geography | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
"
\n",
" \n",
" \n",
" \n",
" AOR | \n",
" 2001 | \n",
" 1 | \n",
" USA-AK | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.AOR-AK-99.M | \n",
" 200101 | \n",
" megawatthours | \n",
" 87.00 | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" 2001-01-01 | \n",
" 1 | \n",
"
\n",
" \n",
" USA-AL | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.AOR-AL-99.M | \n",
" 200101 | \n",
" megawatthours | \n",
" 401167.59 | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" 2001-01-01 | \n",
" 1 | \n",
"
\n",
" \n",
" USA-AR | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.AOR-AR-99.M | \n",
" 200101 | \n",
" megawatthours | \n",
" 136530.37 | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" 2001-01-01 | \n",
" 1 | \n",
"
\n",
" \n",
" USA-AZ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.AOR-AZ-99.M | \n",
" 200101 | \n",
" megawatthours | \n",
" 453.00 | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" 2001-01-01 | \n",
" 1 | \n",
"
\n",
" \n",
" USA-CA | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.AOR-CA-99.M | \n",
" 200101 | \n",
" megawatthours | \n",
" 1717398.41 | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" 2001-01-01 | \n",
" 1 | \n",
"
\n",
" \n",
"
\n",
"
"
],
"text/plain": [
" end f last_updated sector \\\n",
"type year month geography \n",
"AOR 2001 1 USA-AK 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" USA-AL 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" USA-AR 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" USA-AZ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" USA-CA 201712 M 2018-02-28T02:03:13-05:00 99 \n",
"\n",
" series_id start units \\\n",
"type year month geography \n",
"AOR 2001 1 USA-AK ELEC.GEN.AOR-AK-99.M 200101 megawatthours \n",
" USA-AL ELEC.GEN.AOR-AL-99.M 200101 megawatthours \n",
" USA-AR ELEC.GEN.AOR-AR-99.M 200101 megawatthours \n",
" USA-AZ ELEC.GEN.AOR-AZ-99.M 200101 megawatthours \n",
" USA-CA ELEC.GEN.AOR-CA-99.M 200101 megawatthours \n",
"\n",
" generation (MWh) total fuel (mmbtu) \\\n",
"type year month geography \n",
"AOR 2001 1 USA-AK 87.00 NaN \n",
" USA-AL 401167.59 NaN \n",
" USA-AR 136530.37 NaN \n",
" USA-AZ 453.00 NaN \n",
" USA-CA 1717398.41 NaN \n",
"\n",
" elec fuel (mmbtu) all fuel CO2 (kg) \\\n",
"type year month geography \n",
"AOR 2001 1 USA-AK NaN NaN \n",
" USA-AL NaN NaN \n",
" USA-AR NaN NaN \n",
" USA-AZ NaN NaN \n",
" USA-CA NaN NaN \n",
"\n",
" elec fuel CO2 (kg) datetime quarter \n",
"type year month geography \n",
"AOR 2001 1 USA-AK NaN 2001-01-01 1 \n",
" USA-AL NaN 2001-01-01 1 \n",
" USA-AR NaN 2001-01-01 1 \n",
" USA-AZ NaN 2001-01-01 1 \n",
" USA-CA NaN 2001-01-01 1 "
]
},
"execution_count": 96,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"gen_fuel_df.head()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"No records with positive fuel use but no generation"
]
},
{
"cell_type": "code",
"execution_count": 97,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:57:35.851758Z",
"start_time": "2017-10-31T17:57:35.843395Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"gen_fuel_df['generation (MWh)'].fillna(value=0, inplace=True)"
]
},
{
"cell_type": "code",
"execution_count": 98,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T17:57:46.347755Z",
"start_time": "2017-10-31T17:57:46.304898Z"
},
"scrolled": true
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"
\n",
" \n",
" \n",
" | \n",
" | \n",
" | \n",
" end | \n",
" f | \n",
" last_updated | \n",
" sector | \n",
" series_id | \n",
" start | \n",
" units | \n",
" generation (MWh) | \n",
" total fuel (mmbtu) | \n",
" elec fuel (mmbtu) | \n",
" all fuel CO2 (kg) | \n",
" elec fuel CO2 (kg) | \n",
" datetime | \n",
" quarter | \n",
"
\n",
" \n",
" year | \n",
" month | \n",
" geography | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
"
\n",
" \n",
" \n",
" \n",
" 2001 | \n",
" 1 | \n",
" USA-AK | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.COW-AK-99.M | \n",
" 200101 | \n",
" megawatthours | \n",
" 46903.0 | \n",
" 1120000.0 | \n",
" 872000.0 | \n",
" 1.066800e+08 | \n",
" 8.305800e+07 | \n",
" 2001-01-01 | \n",
" 1 | \n",
"
\n",
" \n",
" USA-AL | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.COW-AL-99.M | \n",
" 200101 | \n",
" megawatthours | \n",
" 6557913.0 | \n",
" 67999000.0 | \n",
" 66582000.0 | \n",
" 6.476905e+09 | \n",
" 6.341935e+09 | \n",
" 2001-01-01 | \n",
" 1 | \n",
"
\n",
" \n",
" USA-AR | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.COW-AR-99.M | \n",
" 200101 | \n",
" megawatthours | \n",
" 2149808.0 | \n",
" 23099000.0 | \n",
" 22700000.0 | \n",
" 2.200180e+09 | \n",
" 2.162175e+09 | \n",
" 2001-01-01 | \n",
" 1 | \n",
"
\n",
" \n",
" USA-AZ | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.COW-AZ-99.M | \n",
" 200101 | \n",
" megawatthours | \n",
" 3418454.0 | \n",
" 35873000.0 | \n",
" 35483000.0 | \n",
" 3.416903e+09 | \n",
" 3.379756e+09 | \n",
" 2001-01-01 | \n",
" 1 | \n",
"
\n",
" \n",
" USA-CA | \n",
" 201712 | \n",
" M | \n",
" 2018-02-28T02:03:13-05:00 | \n",
" 99 | \n",
" ELEC.GEN.COW-CA-99.M | \n",
" 200101 | \n",
" megawatthours | \n",
" 199857.0 | \n",
" 3652000.0 | \n",
" 2008000.0 | \n",
" 3.478530e+08 | \n",
" 1.912620e+08 | \n",
" 2001-01-01 | \n",
" 1 | \n",
"
\n",
" \n",
"
\n",
"
"
],
"text/plain": [
" end f last_updated sector \\\n",
"year month geography \n",
"2001 1 USA-AK 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" USA-AL 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" USA-AR 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" USA-AZ 201712 M 2018-02-28T02:03:13-05:00 99 \n",
" USA-CA 201712 M 2018-02-28T02:03:13-05:00 99 \n",
"\n",
" series_id start units \\\n",
"year month geography \n",
"2001 1 USA-AK ELEC.GEN.COW-AK-99.M 200101 megawatthours \n",
" USA-AL ELEC.GEN.COW-AL-99.M 200101 megawatthours \n",
" USA-AR ELEC.GEN.COW-AR-99.M 200101 megawatthours \n",
" USA-AZ ELEC.GEN.COW-AZ-99.M 200101 megawatthours \n",
" USA-CA ELEC.GEN.COW-CA-99.M 200101 megawatthours \n",
"\n",
" generation (MWh) total fuel (mmbtu) elec fuel (mmbtu) \\\n",
"year month geography \n",
"2001 1 USA-AK 46903.0 1120000.0 872000.0 \n",
" USA-AL 6557913.0 67999000.0 66582000.0 \n",
" USA-AR 2149808.0 23099000.0 22700000.0 \n",
" USA-AZ 3418454.0 35873000.0 35483000.0 \n",
" USA-CA 199857.0 3652000.0 2008000.0 \n",
"\n",
" all fuel CO2 (kg) elec fuel CO2 (kg) datetime \\\n",
"year month geography \n",
"2001 1 USA-AK 1.066800e+08 8.305800e+07 2001-01-01 \n",
" USA-AL 6.476905e+09 6.341935e+09 2001-01-01 \n",
" USA-AR 2.200180e+09 2.162175e+09 2001-01-01 \n",
" USA-AZ 3.416903e+09 3.379756e+09 2001-01-01 \n",
" USA-CA 3.478530e+08 1.912620e+08 2001-01-01 \n",
"\n",
" quarter \n",
"year month geography \n",
"2001 1 USA-AK 1 \n",
" USA-AL 1 \n",
" USA-AR 1 \n",
" USA-AZ 1 \n",
" USA-CA 1 "
]
},
"execution_count": 98,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"gen_fuel_df.loc['COW',:].head()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"### Export data"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"State-level"
]
},
{
"cell_type": "code",
"execution_count": 99,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T18:05:21.536020Z",
"start_time": "2017-10-31T18:05:19.631166Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"path = join(data_path, 'EIA state-level gen fuel CO2 2018-03-06.csv')\n",
"gen_fuel_df.to_csv(path)"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"National totals"
]
},
{
"cell_type": "code",
"execution_count": 100,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T18:03:49.791963Z",
"start_time": "2017-10-31T18:03:49.736372Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"nat_gen_fuel = gen_fuel_df.groupby(['type', 'year', 'month']).sum()\n",
"add_quarter(nat_gen_fuel)"
]
},
{
"cell_type": "code",
"execution_count": 101,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T18:04:09.296377Z",
"start_time": "2017-10-31T18:04:09.280132Z"
}
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"
\n",
" \n",
" \n",
" | \n",
" | \n",
" | \n",
" generation (MWh) | \n",
" total fuel (mmbtu) | \n",
" elec fuel (mmbtu) | \n",
" all fuel CO2 (kg) | \n",
" elec fuel CO2 (kg) | \n",
" quarter | \n",
" datetime | \n",
"
\n",
" \n",
" type | \n",
" year | \n",
" month | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
" | \n",
"
\n",
" \n",
" \n",
" \n",
" WWW | \n",
" 2017 | \n",
" 8 | \n",
" 3879727.60 | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" 3 | \n",
" 2017-08-01 | \n",
"
\n",
" \n",
" 9 | \n",
" 3357157.33 | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" 3 | \n",
" 2017-09-01 | \n",
"
\n",
" \n",
" 10 | \n",
" 3558432.79 | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" 4 | \n",
" 2017-10-01 | \n",
"
\n",
" \n",
" 11 | \n",
" 3512302.55 | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" 4 | \n",
" 2017-11-01 | \n",
"
\n",
" \n",
" 12 | \n",
" 3831624.38 | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" NaN | \n",
" 4 | \n",
" 2017-12-01 | \n",
"
\n",
" \n",
"
\n",
"
"
],
"text/plain": [
" generation (MWh) total fuel (mmbtu) elec fuel (mmbtu) \\\n",
"type year month \n",
"WWW 2017 8 3879727.60 NaN NaN \n",
" 9 3357157.33 NaN NaN \n",
" 10 3558432.79 NaN NaN \n",
" 11 3512302.55 NaN NaN \n",
" 12 3831624.38 NaN NaN \n",
"\n",
" all fuel CO2 (kg) elec fuel CO2 (kg) quarter datetime \n",
"type year month \n",
"WWW 2017 8 NaN NaN 3 2017-08-01 \n",
" 9 NaN NaN 3 2017-09-01 \n",
" 10 NaN NaN 4 2017-10-01 \n",
" 11 NaN NaN 4 2017-11-01 \n",
" 12 NaN NaN 4 2017-12-01 "
]
},
"execution_count": 101,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"nat_gen_fuel.tail()"
]
},
{
"cell_type": "code",
"execution_count": 102,
"metadata": {
"ExecuteTime": {
"end_time": "2017-10-31T18:05:35.398602Z",
"start_time": "2017-10-31T18:05:33.172398Z"
},
"collapsed": true
},
"outputs": [],
"source": [
"path = join(data_path, 'Derived data',\n",
" 'EIA country-wide gen fuel CO2 {}.csv'.format(file_date))\n",
"gen_fuel_df.to_csv(path)"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"collapsed": true
},
"outputs": [],
"source": []
}
],
"metadata": {
"kernelspec": {
"display_name": "psci",
"language": "python",
"name": "psci"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.6.4"
},
"varInspector": {
"cols": {
"lenName": 16,
"lenType": 16,
"lenVar": 40
},
"kernels_config": {
"python": {
"delete_cmd_postfix": "",
"delete_cmd_prefix": "del ",
"library": "var_list.py",
"varRefreshCmd": "print(var_dic_list())"
},
"r": {
"delete_cmd_postfix": ") ",
"delete_cmd_prefix": "rm(",
"library": "var_list.r",
"varRefreshCmd": "cat(var_dic_list()) "
}
},
"types_to_exclude": [
"module",
"function",
"builtin_function_or_method",
"instance",
"_Feature"
],
"window_display": false
}
},
"nbformat": 4,
"nbformat_minor": 2
}