{
"cells": [
{
"cell_type": "markdown",
"metadata": {},
"source": [
"# Mauna Loa Time Series Example"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Gaussian processes can be used to model nonlinear time series. We consider the problem of predicting future concentrations of CO2 in the atmosphere. The data are taken from the Mauna Loa observatory in Hawaii which records the monthly average atmospheric concentration of CO2 (in parts per million) between 1958 to 2015. The purposes of testing the predictive accuracy of the Gaussian process model, we fit the GP to the historical data from 1958 to 2004 and optimise the parameters using maximum likelihood estimation. \n",
"\n",
"We employ a seemingly complex kernel function to model these data which follows the kernel structure given in Rasmussen and Williams (2006). The kernel comprises of simpler kernels with each kernel term accounting for a different aspect in the variation of the data. For example, the `Periodic` kernel captures the seasonal effect of CO2 absorption from plants. A detailed description of each kernel contribution is given in Chapter 5 of Rasmussen and Williams (2006).\n"
]
},
{
"cell_type": "code",
"execution_count": 1,
"metadata": {
"collapsed": false
},
"outputs": [],
"source": [
"using GaussianProcesses\n",
"using DelimitedFiles\n",
"\n",
"data = readdlm(\"data/CO2_data.csv\",',')\n",
"\n",
"year = data[:,1]; co2 = data[:,2];\n",
"#Split the data into training and testing data\n",
"xtrain = year[year.<2004]; ytrain = co2[year.<2004];\n",
"xtest = year[year.>=2004]; ytest = co2[year.>=2004];\n",
"\n",
"#Kernel is represented as a sum of kernels\n",
"kernel = SE(4.0,4.0) + Periodic(0.0,1.0,0.0)*SE(4.0,0.0) + RQ(0.0,0.0,-1.0) + SE(-2.0,-2.0);\n",
"\n",
"gp = GP(xtrain,ytrain,MeanZero(),kernel,-2.0) #Fit the GP\n",
"\n",
"optimize!(gp) #Estimate the parameters through maximum likelihood estimation\n",
"\n",
"μ, Σ = predict_y(gp,xtest);"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Over the ten year predidction horizon the GP is able to accurately capture both the trend and seasonal variations of the CO2 concentrations. Arguably, the GP prediction gradually begins to underestimate the CO2 concentration. The accuracy of the fit could be further improved by extending the kernel function to include additionally terms. Recent work on automatic structure discovery (Duvenaud et al., 2013) could be used to optimise the modelling process."
]
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {
"collapsed": false
},
"outputs": [
{
"data": {
"text/html": [
"