{"cells":[{"cell_type":"markdown","metadata":{"id":"YqZeQnKeVnbs"},"source":["**Name:** \\_\\_\\_\\_\\_\n","\n","**EID:** \\_\\_\\_\\_\\_"]},{"cell_type":"markdown","metadata":{"id":"KnbADvwBVnbu"},"source":["# Tutorial 4: Predicting Popularity of Online News\n","\n","In this tutorial you will train regression models to predict the number of \"shares\" of a news article on Mashable.\n","\n","First we need to initialize Python. Run the below cell."]},{"cell_type":"code","execution_count":null,"metadata":{"id":"ZEABdiRIVnbu"},"outputs":[],"source":["%matplotlib inline\n","import IPython.core.display\n","# setup output image format (Chrome works best)\n","IPython.core.display.set_matplotlib_formats(\"svg\")\n","import matplotlib.pyplot as plt\n","import matplotlib\n","from numpy import *\n","from sklearn import *\n","import glob\n","import os\n","import csv\n","import string\n","random.seed(100)"]},{"cell_type":"markdown","metadata":{"id":"c_QYHQaDVnbv"},"source":["## 1. Loading Data and Pre-processing\n","Next we need to load the data. Download `OnlineNewsPopularity.zip`, and **unzip** it in the same directory as this ipynb file. Then run the following cell to load the data."]},{"cell_type":"code","execution_count":null,"metadata":{"id":"cQqdLy5uVnbw","outputId":"0eed4f8d-33f9-4a10-9b91-97d382fe6c9b"},"outputs":[{"name":"stdout","output_type":"stream","text":["(6608, 58)\n","(6608,)\n"]}],"source":["filename = 'OnlineNewsPopularity/OnlineNewsPopularity.csv'\n","\n","# read the data\n","allfeatnames = []\n","textdata = []\n","with open(filename, 'r') as f:\n"," reader = csv.reader(f)\n"," for row in reader:\n"," if len(allfeatnames)==0:\n"," allfeatnames = row\n"," else:\n"," textdata.append(row)\n","\n","# put the data into a np array\n","dataX = empty((len(textdata), len(allfeatnames)-3))\n","dataY = empty(len(textdata))\n","for i,row in enumerate(textdata):\n"," # extract features (remove the first 2 features and the last feature)\n"," dataX[i,:] = array([float(x) for x in row[2:-1]])\n"," # extract target (last entry)\n"," dataY[i] = float(row[-1])\n","\n","# extract feature names\n","featnames = [x.strip() for x in allfeatnames[2:-1]]\n","\n","# extract a subset of data\n","dataX = dataX[::6]\n","dataY = dataY[::6]\n","\n","print(dataX.shape)\n","print(dataY.shape)"]},{"cell_type":"markdown","metadata":{"id":"fmA57ITCVnbx"},"source":["There are 58 features for each article. Here are the feature names, and an example entry. The actual description of the features can be found in the `OnlineNewsPopularity-features.txt` file."]},{"cell_type":"code","execution_count":null,"metadata":{"id":"KdbtDd3nVnbx","outputId":"dd3fdc40-37c6-4bec-8fb7-5a92a27f8853"},"outputs":[{"name":"stdout","output_type":"stream","text":["['n_tokens_title', 'n_tokens_content', 'n_unique_tokens', 'n_non_stop_words', 'n_non_stop_unique_tokens', 'num_hrefs', 'num_self_hrefs', 'num_imgs', 'num_videos', 'average_token_length', 'num_keywords', 'data_channel_is_lifestyle', 'data_channel_is_entertainment', 'data_channel_is_bus', 'data_channel_is_socmed', 'data_channel_is_tech', 'data_channel_is_world', 'kw_min_min', 'kw_max_min', 'kw_avg_min', 'kw_min_max', 'kw_max_max', 'kw_avg_max', 'kw_min_avg', 'kw_max_avg', 'kw_avg_avg', 'self_reference_min_shares', 'self_reference_max_shares', 'self_reference_avg_sharess', 'weekday_is_monday', 'weekday_is_tuesday', 'weekday_is_wednesday', 'weekday_is_thursday', 'weekday_is_friday', 'weekday_is_saturday', 'weekday_is_sunday', 'is_weekend', 'LDA_00', 'LDA_01', 'LDA_02', 'LDA_03', 'LDA_04', 'global_subjectivity', 'global_sentiment_polarity', 'global_rate_positive_words', 'global_rate_negative_words', 'rate_positive_words', 'rate_negative_words', 'avg_positive_polarity', 'min_positive_polarity', 'max_positive_polarity', 'avg_negative_polarity', 'min_negative_polarity', 'max_negative_polarity', 'title_subjectivity', 'title_sentiment_polarity', 'abs_title_subjectivity', 'abs_title_sentiment_polarity']\n","--- example article features---\n","[ 1.20000000e+01 2.19000000e+02 6.63594467e-01 9.99999992e-01\n"," 8.15384609e-01 4.00000000e+00 2.00000000e+00 1.00000000e+00\n"," 0.00000000e+00 4.68036530e+00 5.00000000e+00 0.00000000e+00\n"," 1.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n"," 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n"," 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n"," 0.00000000e+00 0.00000000e+00 4.96000000e+02 4.96000000e+02\n"," 4.96000000e+02 1.00000000e+00 0.00000000e+00 0.00000000e+00\n"," 0.00000000e+00 0.00000000e+00 0.00000000e+00 0.00000000e+00\n"," 0.00000000e+00 5.00331204e-01 3.78278930e-01 4.00046751e-02\n"," 4.12626477e-02 4.01225435e-02 5.21617145e-01 9.25619835e-02\n"," 4.56621005e-02 1.36986301e-02 7.69230769e-01 2.30769231e-01\n"," 3.78636364e-01 1.00000000e-01 7.00000000e-01 -3.50000000e-01\n"," -6.00000000e-01 -2.00000000e-01 5.00000000e-01 -1.87500000e-01\n"," 0.00000000e+00 1.87500000e-01]\n","--- example article target (# of shares)\n","593.0\n"]}],"source":["print(featnames)\n","\n","print(\"--- example article features---\")\n","print(dataX[0])\n","print(\"--- example article target (# of shares)\")\n","print(dataY[0])"]},{"cell_type":"markdown","metadata":{"id":"344B9RM1Vnbx"},"source":["Now separate the data into training and testing sets."]},{"cell_type":"code","execution_count":null,"metadata":{"id":"oLHLZRUgVnbx","outputId":"83ca01c8-1600-420d-9a6a-c6319207d428"},"outputs":[{"name":"stdout","output_type":"stream","text":["(3304, 58)\n","(3304, 58)\n"]}],"source":["# randomly split data into 50% train and 50% test set\n","trainX, testX, trainYo, testYo = \\\n"," model_selection.train_test_split(dataX, dataY,\n"," train_size=0.50, test_size=0.50, random_state=4487)\n","\n","print(trainX.shape)\n","print(testX.shape)"]},{"cell_type":"markdown","metadata":{"id":"THv_LciTVnbx"},"source":["Finally, we normalize the input features."]},{"cell_type":"code","execution_count":null,"metadata":{"id":"GEKMqzM6Vnby"},"outputs":[],"source":["# normalize feature values\n","# this makes comparing weights more meaningful\n","scaler = preprocessing.StandardScaler()\n","trainXn = scaler.fit_transform(trainX)\n","testXn = scaler.transform(testX)"]},{"cell_type":"markdown","metadata":{"id":"QrcevsQwVnby"},"source":["Because the target value (number of shares) has a large dynamic range, we will transform the target values through the log function."]},{"cell_type":"code","execution_count":null,"metadata":{"id":"MxxV4lnuVnby","outputId":"ffefaec1-281e-457e-9169-80c0750ef134"},"outputs":[{"data":{"image/svg+xml":["\n","\n","\n","\n"," \n"," \n"," \n"," \n"," 2023-10-09T11:32:42.384814\n"," image/svg+xml\n"," \n"," \n"," Matplotlib v3.3.3, https://matplotlib.org/\n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n","\n"],"text/plain":["
"]},"metadata":{"needs_background":"light"},"output_type":"display_data"}],"source":["# map targets to log-space\n","trainY = log10(trainYo)\n","testY = log10(testYo)\n","\n","plt.figure(figsize=(10,3))\n","plt.subplot(1,2,1)\n","plt.hist(trainYo, 25);\n","plt.title('histogram of Y values')\n","plt.subplot(1,2,2)\n","plt.hist(trainY, 25);\n","plt.title(\"histogram of log(Y) values\");"]},{"cell_type":"markdown","metadata":{"id":"bJL4wfzMVnby"},"source":["## 2. Prediction with Linear Regression\n","\n","First we will look at predicting the number of shares using simple linear regression models. Use the training data to fit a linear model using Ordinary Least Squares and Ridge Regression. Use cross-validation on the training set to select the optimal $\\alpha$ parameter for ridge regression."]},{"cell_type":"code","execution_count":null,"metadata":{"id":"ukFc4QL5Vnby"},"outputs":[],"source":["### INSERT YOUR CODE HERE\n","## HINT:\n","# 1. Ordinary Least Squares: linear_model.LinearRegression()\n","# 2. Ridge Regression: linear_model.Ridge(alphas= )\n","# 3. Rigge Regression with Cross-validation: linear_model.Ridge(alphas= )"]},{"cell_type":"code","execution_count":null,"metadata":{"id":"u_DBlQUCVnbz","outputId":"76e0a3c7-f394-4735-be38-503893d90854"},"outputs":[{"name":"stdout","output_type":"stream","text":["train error: 0.2868856437837091\n","test error : 187.72428004424154\n"]}],"source":["### INSERT YOUR CODE HERE\n","ols = linear_model.LinearRegression()\n","ols.fit(trainXn, trainY)\n","\n","trainAE = metrics.mean_absolute_error(trainY, ols.predict(trainXn))\n","testAE = metrics.mean_absolute_error(testY, ols.predict(testXn))\n","\n","print(\"train error:\", trainAE)\n","print(\"test error :\", testAE)"]},{"cell_type":"code","execution_count":null,"metadata":{"scrolled":false,"id":"lec7JjQMVnbz","outputId":"f5747287-f3a5-43be-88b9-5d506d9289bd"},"outputs":[{"name":"stdout","output_type":"stream","text":["best alpha: 385.6620421163472\n","train error: 0.28859917591560874\n","test error : 0.2854267347255127\n"]},{"data":{"image/svg+xml":["\n","\n","\n","\n"," \n"," \n"," \n"," \n"," 2023-10-09T11:32:45.473004\n"," image/svg+xml\n"," \n"," \n"," Matplotlib v3.3.3, https://matplotlib.org/\n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n"," \n","\n"],"text/plain":["
"]},"metadata":{"needs_background":"light"},"output_type":"display_data"}],"source":["### INSERT YOUR CODE HERE\n","alphas = logspace(-5,15,30)\n","\n","trainAEs = empty(len(alphas))\n","testAEs = empty(len(alphas))\n","for i,a in enumerate(alphas):\n"," rr = linear_model.Ridge(alpha=a)\n"," rr.fit(trainXn, trainY)\n","\n"," trainAEs[i] = metrics.mean_absolute_error(trainY, rr.predict(trainXn))\n"," testAEs[i] = metrics.mean_absolute_error(testY, rr.predict(testXn))\n","\n","plt.figure(figsize=(10,3))\n","plt.subplot(1,2,1)\n","plt.semilogx(alphas, trainAEs)\n","plt.xlabel('alpha')\n","plt.title('train AE')\n","plt.grid(True)\n","plt.subplot(1,2,2)\n","plt.semilogx(alphas, testAEs)\n","plt.xlabel('alpha')\n","plt.title('test AE')\n","plt.grid(True)\n","\n","rr = linear_model.RidgeCV(alphas=alphas, cv=5)\n","rr.fit(trainXn, trainY)\n","\n","print(\"best alpha: \", rr.alpha_)\n","\n","trainAE = metrics.mean_absolute_error(trainY, rr.predict(trainXn))\n","testAE = metrics.mean_absolute_error(testY, rr.predict(testXn))\n","\n","print(\"train error: \", trainAE)\n","print(\"test error : \", testAE)"]},{"cell_type":"markdown","metadata":{"id":"V4ctUrFxVnbz"},"source":["Compare the two models using the _average absolute error_ (AE) between the predictions and the true values. Below is code that will calculate AE for the training and test sets."]},{"cell_type":"code","execution_count":null,"metadata":{"id":"Oa8mlGNJVnbz","outputId":"4fd1eb49-155f-4a13-da8b-820948f2203a"},"outputs":[{"name":"stdout","output_type":"stream","text":["OLS: train error = 0.2868856437837091\n","OLS: test error = 187.72428004424154\n"]}],"source":["# ols is the linear regression model\n","trainAE = metrics.mean_absolute_error(trainY, ols.predict(trainXn))\n","testAE = metrics.mean_absolute_error(testY, ols.predict(testXn))\n","print(\"OLS: train error =\", trainAE)\n","print(\"OLS: test error =\", testAE)"]},{"cell_type":"code","execution_count":null,"metadata":{"id":"tRQYjFRxVnbz","outputId":"db2d9dcf-9af1-4e6a-b736-1d1965e593f2"},"outputs":[{"name":"stdout","output_type":"stream","text":["RR: train error = 0.28859917591560874\n","RR: test error = 0.2854267347255127\n"]}],"source":["# rr is the ridge regression model\n","trainAE = metrics.mean_absolute_error(trainY, rr.predict(trainXn))\n","testAE = metrics.mean_absolute_error(testY, rr.predict(testXn))\n","print(\"RR: train error =\", trainAE)\n","print(\"RR: test error =\", testAE)"]},{"cell_type":"markdown","metadata":{"id":"eDMEPrfHVnbz"},"source":["Which model has better prediction ability on the test set? Why?\n","- **INSERT YOUR ANSWER HERE**"]},{"cell_type":"markdown","metadata":{"id":"jXxV7fYlVnbz"},"source":["- **INSERT YOUR ANSWER HERE**\n","- RR has better performance. selecting the best alpha prevents overfitting. \n","- OLS has severe overfitting -- very bad performance on test set."]},{"cell_type":"markdown","metadata":{"id":"1exunAp6Vnb0"},"source":["## 3. Which features are important?\n","Next we will investigate which features are the most important for the prediction. Use LASSO with cross-validation to learn the model, and print the training and testing error."]},{"cell_type":"code","execution_count":null,"metadata":{"id":"OodFMGd1Vnb0"},"outputs":[],"source":["### INSERT YOUR CODE HERE\n","## HINT\n","# 1. LASSO with Cross-validation: linear_model.LassoCV()"]},{"cell_type":"code","execution_count":null,"metadata":{"id":"LeEawuv8Vnb0","outputId":"4aff09a6-17a8-4eea-8582-a9f29c00fbac"},"outputs":[{"name":"stdout","output_type":"stream","text":["0.2884555818253427\n","0.2847674710353574\n"]}],"source":["### INSERT YOUR CODE HERE\n","las = linear_model.LassoCV()\n","las.fit(trainXn, trainY)\n","\n","trainAE = metrics.mean_absolute_error(trainY, las.predict(trainXn))\n","testAE = metrics.mean_absolute_error(testY, las.predict(testXn))\n","print(trainAE)\n","print(testAE)"]},{"cell_type":"markdown","metadata":{"id":"WWuU_nb3Vnb0"},"source":["Examine the LASSO coefficients by sorting them in descending order."]},{"cell_type":"code","execution_count":null,"metadata":{"id":"VrCdBQWGVnb0","outputId":"8db0605b-328a-4056-bf92-92115912802e"},"outputs":[{"name":"stdout","output_type":"stream","text":["weight : feature description\n"," 0.098 : kw_avg_avg\n","-0.042 : LDA_02\n","-0.041 : kw_max_avg\n","-0.034 : data_channel_is_entertainment\n","-0.027 : average_token_length\n"," 0.026 : global_subjectivity\n"," 0.025 : num_hrefs\n","-0.023 : data_channel_is_bus\n"," 0.022 : kw_min_min\n"," 0.022 : is_weekend\n"," 0.022 : LDA_00\n"," 0.020 : n_tokens_content\n","-0.018 : kw_avg_min\n"," 0.018 : data_channel_is_socmed\n"," 0.014 : self_reference_avg_sharess\n","-0.013 : max_positive_polarity\n"," 0.013 : title_sentiment_polarity\n","-0.012 : data_channel_is_lifestyle\n"," 0.009 : weekday_is_sunday\n","-0.008 : kw_avg_max\n","-0.008 : LDA_01\n"," 0.007 : self_reference_max_shares\n"," 0.007 : n_tokens_title\n","-0.007 : avg_negative_polarity\n"," 0.007 : num_keywords\n","-0.006 : kw_min_max\n"," 0.006 : weekday_is_monday\n","-0.005 : weekday_is_friday\n"," 0.005 : data_channel_is_tech\n","-0.004 : num_self_hrefs\n","-0.004 : weekday_is_tuesday\n"," 0.003 : LDA_03\n","-0.003 : min_positive_polarity\n","-0.003 : rate_positive_words\n","-0.002 : max_negative_polarity\n"," 0.002 : self_reference_min_shares\n"," 0.002 : num_imgs\n"," 0.001 : weekday_is_thursday\n","-0.000 : n_non_stop_words\n"," 0.000 : num_videos\n","-0.000 : min_negative_polarity\n","-0.000 : n_unique_tokens\n","-0.000 : title_subjectivity\n","-0.000 : n_non_stop_unique_tokens\n"," 0.000 : weekday_is_saturday\n","-0.000 : avg_positive_polarity\n"," 0.000 : rate_negative_words\n","-0.000 : data_channel_is_world\n","-0.000 : kw_max_min\n"," 0.000 : global_rate_negative_words\n","-0.000 : kw_max_max\n","-0.000 : global_rate_positive_words\n"," 0.000 : kw_min_avg\n","-0.000 : global_sentiment_polarity\n","-0.000 : LDA_04\n"," 0.000 : abs_title_subjectivity\n","-0.000 : weekday_is_wednesday\n"," 0.000 : abs_title_sentiment_polarity\n"]}],"source":["# sort coefficients from smallest to largest, then reverse it\n","inds = argsort(abs(las.coef_))[::-1]\n","# print out\n","print(\"weight : feature description\")\n","for i in inds:\n"," print(\"{: .3f} : {}\".format(las.coef_[i], featnames[i]))"]},{"cell_type":"markdown","metadata":{"id":"WcAsUlKuVnb0"},"source":["_Which features are most important for predicting the number of shares? For these features, which feature values (low or high values) will yield a higher number of shares?_\n","- **INSERT YOUR ANSWER HERE**"]},{"cell_type":"markdown","metadata":{"id":"nB3qzFNCVnb0"},"source":["- **INSERT YOUR ANSWER HERE**\n"," - kw_avg_avg -- keywords that have large average number of shares (large)\n"," - LDA02 -- related to LDA topic 2 (low)\n"," - kw_max_avg -- number of keywords with max shares? (low)\n"," - data_channel_is_entertainment -- entertainment channel! (low)\n"," - avg_token_length -- length of words (low)"]},{"cell_type":"markdown","metadata":{"id":"A8X1mGb1Vnb0"},"source":["## 4. Kernel Methods and Supprot Vector Regression\n","Next, let us try some non-linear regression model such as[ kernel ridge regression](https://scikit-learn.org/stable/modules/kernel_ridge.html), [random forest regression](https://scikit-learn.org/stable/modules/generated/sklearn.ensemble.RandomForestRegressor.html)(Optional), [support vector regression](https://scikit-learn.org/stable/modules/generated/sklearn.svm.SVR.html). To improve the prediction accuracy in Tutorial 3, and using cross-validation on the training set to select the parameters."]},{"cell_type":"code","execution_count":null,"metadata":{"id":"rfX5_ruIVnb0"},"outputs":[],"source":["### INSERT YOUR CODE HERE\n","##Hint:\n","## 1. Kernel Ridge Regression: kernel_ridge.KernelRidge(kernel='rbf'/'poly')\n","## 2. Random Forest Regression: ensemble.RandomForestRegressor(random_state= , n_estimators= )\n","## 3. Support Vector Regression: svm.SVR(kernel='poly')\n","## 4. Avoid using large values of $C$ with SVR."]},{"cell_type":"code","execution_count":null,"metadata":{"id":"5FexuhwSVnb0","outputId":"404b8d1f-d847-488e-cdea-6dec82613d23"},"outputs":[{"name":"stdout","output_type":"stream","text":["=== krr-rbf ==================\n","Fitting 5 folds for each of 100 candidates, totalling 500 fits\n","-0.15529889342986547\n","{'alpha': 0.001, 'gamma': 0.0001}\n","train error: 0.27179287281260844\n","test error : 0.2805575276800711\n","=== krr-poly ==================\n","Fitting 5 folds for each of 50 candidates, totalling 250 fits\n","-0.1552552059441652\n","{'alpha': 10.0, 'degree': 2}\n","train error: 0.268831060681726\n","test error : 0.27956156164035045\n","=== rf ==================\n","Fitting 5 folds for each of 7 candidates, totalling 35 fits\n","-0.15598974861954493\n","{'max_depth': 15}\n","train error: 0.1387213103740817\n","test error : 0.2851202564582334\n","=== svr-poly ==================\n","Fitting 5 folds for each of 50 candidates, totalling 250 fits\n","-0.1641195433664376\n","{'C': 0.03162277660168379, 'degree': 1, 'epsilon': 0.1}\n","train error: 0.28124637842194516\n","test error : 0.27492017267526386\n"]}],"source":["allexps = [\n"," {'name': 'krr-rbf',\n"," 'clf': kernel_ridge.KernelRidge(kernel='rbf'),\n"," 'params': {'alpha': logspace(-3,3,10), 'gamma': logspace(-6,3,10)}\n"," },\n"," {'name': 'krr-poly',\n"," 'clf': kernel_ridge.KernelRidge(kernel='poly'),\n"," 'params': {'alpha': logspace(-3,3,10), 'degree': [1,2,3,4,5]}\n"," },\n"," {'name': 'rf',\n"," 'clf': ensemble.RandomForestRegressor(random_state=4487, n_estimators=100),\n"," 'params': {'max_depth': array([1, 2, 3, 4, 5, 10, 15])}\n"," },\n"," {'name': 'svr-poly',\n"," 'clf': svm.SVR(kernel='poly'),\n"," 'params': {'C': logspace(-3,0,5), 'degree': [1,2], 'epsilon': logspace(-2,2,5)}\n"," },\n","]\n","\n","clfs = {}\n","trainAE = {}\n","testAE = {}\n","for i,ex in enumerate(allexps):\n"," myname = ex['name']\n"," print(\"=== \" + myname + \" ==================\")\n"," clfs[myname] = model_selection.GridSearchCV(ex['clf'], ex['params'],\n"," scoring='neg_mean_squared_error', cv=5, verbose=True, n_jobs=-1)\n"," clfs[myname].fit(trainXn, trainY)\n","\n"," print(clfs[myname].best_score_)\n"," print(clfs[myname].best_params_)\n","\n"," trainAE[myname] = metrics.mean_absolute_error(trainY, clfs[myname].predict(trainXn))\n"," testAE[myname] = metrics.mean_absolute_error(testY, clfs[myname].predict(testXn))\n","\n"," print(\"train error:\", trainAE[myname])\n"," print(\"test error :\", testAE[myname])"]},{"cell_type":"code","execution_count":null,"metadata":{"id":"xLJcjEyqVnb1","outputId":"229ac842-2e56-4fcb-8523-6ed552afaeee"},"outputs":[{"name":"stderr","output_type":"stream","text":["/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.05037434915789163, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.07602264048404095, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.059553429418258474, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.5564244213603615, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.992597682617486, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.1237092820256862, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.0956181566671717, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 6.887046355541713, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 4.103656148240475, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.9477132317139194, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.9342910607037993, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.48137387842041335, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.3143333951833256, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.2420582772696207, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.08527877818437446, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.5358823287580776, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 2.077214675728044, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 3.8385602137984733, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 5.438603743793863, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 6.696947974675652, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 8.654975300809724, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 10.695417395713264, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 15.537717650952175, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.9427119108683542, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.4591606666592156, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.5498074082025823, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.5392844517045319, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.138343157080726, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 2.4700845111921126, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 6.588669874770574, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 10.528637925208159, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 14.27505591655472, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n"]},{"name":"stderr","output_type":"stream","text":["/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 28.244740515385445, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 48.74371179436497, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 62.863118875546675, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 71.37033718111238, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 75.61335284718618, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 76.40197703629434, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 78.22520823582471, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 84.55287668008408, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 86.28572569769132, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 83.45691449830181, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 70.61699347982612, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 65.301351629337, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 61.91434025676024, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 70.35888266470924, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 76.60447263549972, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 80.1148229016643, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 85.57305385411885, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 83.07951334883015, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 80.16432612205082, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 78.45948661980295, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 76.97954014451024, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 67.5280037212884, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 78.86735897971333, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 85.49199493394177, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 90.21458598764256, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 95.61844598280106, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 98.84720840105228, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n"]},{"name":"stderr","output_type":"stream","text":["/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 101.40509745946088, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 105.56574230182285, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 107.77543468159263, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 107.03516382432444, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 105.86327777980637, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 105.49399830378992, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 106.43868764176023, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 107.21412179549138, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 107.2057244049874, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 106.36181266171418, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 105.70810501218695, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 105.04021327597388, tolerance: 0.04468952155620218\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.060817300792678, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.21206157310257367, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.2985942503997876, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.3528218689885989, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.4058376097836458, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.48346200323254607, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.47080278957162136, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.4029390565406743, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.8674466996316141, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.2279161317445073, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.1199352219919092, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.09412675321226516, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.1069627428312856, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.08113770147519972, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.6080372524388054, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.6400225845756609, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.08463759454576802, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.065156097094075, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.07429777339814336, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.07601694118477553, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.29175638111394164, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.483129062589228, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.82355746629122, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 19.79463416616329, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 24.813321577318987, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n"]},{"name":"stderr","output_type":"stream","text":["/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 25.439526132065737, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 26.24516391970363, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 35.81818113361396, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 42.95668414186065, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 47.704959255682155, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 51.94234787523675, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 58.32705360772857, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 61.96062258300421, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 59.098884791251464, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 62.53513101413688, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 56.67985160752215, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 61.849381493611574, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 69.9908744289769, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 79.02240556618712, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 86.51356092370926, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 87.0946475011994, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 89.23613582993408, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 98.6151307112803, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 103.95413810299982, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 110.60929984627714, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 117.1194028467982, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 121.04838444340895, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 117.93241534091882, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 117.665306419861, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 115.61245030978296, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 107.81429635401594, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 103.36262426409668, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 100.76518842392895, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n"]},{"name":"stderr","output_type":"stream","text":["/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 103.42806533947447, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 109.47971169020855, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 113.54249466468097, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 117.51956761615654, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 118.78859601503189, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 119.57107391759521, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 120.2231236455182, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 121.11855075063204, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 121.11928335442894, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 120.6552147877712, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 118.78751231816418, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 117.0827381501027, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 115.72290801377456, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 113.98404507945938, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 111.83579434844255, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 108.68143465611504, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 106.25101132471364, tolerance: 0.04651778807722932\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.38756574981727, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 3.6239988596682906, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 5.962605202973577, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 8.244696055339432, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.04872433620045058, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.2407129639090613, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 2.2883481134286967, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 2.7033131766773977, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 3.0961290013231633, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.6590084150117832, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 2.335199730586453, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 3.6375336543105163, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 5.120782846722307, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 6.7584773835694705, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 8.814552870592308, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 8.836356345375236, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 10.654199874639005, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 3.939510703025803, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 6.557089095241452, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 7.7143883413672825, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n"]},{"name":"stderr","output_type":"stream","text":["/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 3.9992818050549204, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 13.340509594920036, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 18.007419003625557, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 20.992864208743498, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 16.166215120209586, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 19.008625925534517, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 16.281448808747314, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 23.389806230898387, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 46.39216058842834, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 72.95205401152049, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 62.57952722382214, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 82.11126461627256, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 93.93450387851702, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 97.74473731682664, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 103.86560029029918, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 109.45279177794188, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 111.94286274519881, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 110.88348584198575, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 107.01490720608828, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 104.73680238975263, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 91.13549073458665, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 96.274667480322, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 94.18479248004422, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 94.14136955129203, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 87.50023317021045, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 95.0722097300044, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 99.01256980910051, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 107.88242169371804, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 109.54190943142218, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 107.8538978887714, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 104.38536337362005, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 87.11630427040694, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n"]},{"name":"stderr","output_type":"stream","text":["/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 97.89553345530099, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 101.74393754761364, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 102.55754271202122, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 101.71028104956713, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 101.39021845484567, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 99.08800387526328, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 102.43705316993041, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 104.4886211114181, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 105.12897214482817, tolerance: 0.045356200509820144\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.082032975211348, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.28992098280906475, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.38775885040860203, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.2931369329740505, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.8412329165033157, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.2350255008395834, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.626893195323703, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.07965405748922194, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.07476506489058465, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.07153648660982981, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.09571979134250341, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.08181999807101192, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.12985722125961274, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.15087246645276764, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.171277238342725, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.13967973083600782, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.6718599356868822, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.9267548010311657, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.19154674804457272, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.45249447941120025, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.4409277946506336, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.7880336750170613, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.5814501119730835, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.8163545309637925, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.5174285327472603, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n"]},{"name":"stderr","output_type":"stream","text":["/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.37840034207602, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.2647226309010193, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.2458540474717665, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 4.339351251567109, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 10.71807206835362, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 18.174810944837702, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 25.27530765238899, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 31.552997817374205, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 37.72377346403874, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 42.153520766220794, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 48.2853182815021, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 51.21322664732948, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 54.31998998053142, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 57.961838805124415, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 58.72971845429623, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 58.31353870680701, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 60.100045059488565, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 64.34189649320132, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 66.43915711749699, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 68.39078104819542, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 68.65752132828555, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 69.65671376812762, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 75.6546330417313, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 80.77449569371677, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 81.91638543703873, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 86.98685336574351, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 89.2538743941308, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 89.14529431125462, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n"]},{"name":"stderr","output_type":"stream","text":["/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 88.0395868184162, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 85.14119117964997, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 83.36424223929046, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 81.35992459723818, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 84.47282080289773, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 88.87207556045044, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 92.97270219821338, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 94.8140063893331, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 92.92111082822177, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 86.78654454480159, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 79.26756065030159, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 76.34452148814078, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 58.99437031374593, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 60.2456943091195, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 64.47215945384706, tolerance: 0.04487751332114914\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.09381749234313475, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.15746125000379152, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.22021000053160833, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.3443654071622291, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.47674641848851707, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.65590314627525, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.8673798525459233, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 3.452433865540854, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.04615036252215532, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.07812043232871702, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.06958840597167182, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.7710274355867455, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.11426217834537056, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.1877530241082468, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.31784308979916887, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 0.09385496235717028, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.0602601885539684, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.4180046447789891, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 8.912046266899438, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n"]},{"name":"stderr","output_type":"stream","text":["/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 20.533028846755144, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 25.04254205027354, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 25.277256323675516, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 39.09062565260527, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 45.167276431903616, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 36.319186918176115, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 38.8471659889276, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 45.224727587314135, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 38.46056019740695, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 40.450194934476485, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 41.462647995980404, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 30.501345920352406, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 33.69305352795243, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 35.51028564109683, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 42.941592065645466, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 47.31240399461953, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 44.08017514616654, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 60.09265437568517, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 70.33908447567052, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 88.7062021040297, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 97.6366522805771, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 105.27628381291012, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 111.12114718184154, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 112.31904877012535, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 111.60242932477362, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 116.59931519292874, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 116.81219601868968, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 117.52947935705821, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n"]},{"name":"stderr","output_type":"stream","text":["/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 117.0387555768265, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 117.0070443986846, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 121.05751836205877, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 122.51200413087008, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 122.50107699086702, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 122.1485867890932, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 121.83470265801945, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 122.28173081018272, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 122.13599960864032, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 121.90671539299352, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 121.46681644835374, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 120.68352917998355, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 119.6709975550144, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 118.75519419531014, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 117.85464125375978, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n","/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:528: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 116.91135912029796, tolerance: 0.045892227505379204\n"," tol, rng, random, positive)\n"]},{"name":"stdout","output_type":"stream","text":["train error: 0.2839947427050651\n","test error : 0.28535385992635737\n"]},{"name":"stderr","output_type":"stream","text":["/Users/zhw/opt/anaconda3/envs/DNN/lib/python3.6/site-packages/sklearn/linear_model/_coordinate_descent.py:532: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Duality gap: 1.662013092100949, tolerance: 0.056840105935647846\n"," positive)\n"]}],"source":["# LASSO - poly features\n","polyfeats = preprocessing.PolynomialFeatures(degree=2)\n","trainXnf = polyfeats.fit_transform(trainXn)\n","testXnf = polyfeats.transform(testXn)\n","\n","myname = 'las-poly'\n","clfs[myname] = linear_model.LassoCV(max_iter=20)\n","clfs[myname].fit(trainXnf, trainY)\n","trainAE[myname] = metrics.mean_absolute_error(trainY, clfs[myname].predict(trainXnf))\n","testAE[myname] = metrics.mean_absolute_error(testY, clfs[myname].predict(testXnf))\n","\n","print(\"train error:\", trainAE[myname])\n","print(\"test error :\", testAE[myname])"]},{"cell_type":"code","execution_count":null,"metadata":{"scrolled":true,"id":"W40zCcTpVnb1","outputId":"a7716e93-be49-4fcb-8d40-2858df98ac2a"},"outputs":[{"name":"stdout","output_type":"stream","text":["1770\n","weight : feature description\n"," 0.089 : kw_avg_avg(1) \n"," 0.020 : kw_min_avg(2) \n","-0.015 : data_channel_is_entertainment(2) \n","-0.011 : LDA_02(2) \n"," 0.009 : kw_min_min(2) \n","-0.009 : data_channel_is_world(1) LDA_02(1) \n"," 0.009 : global_subjectivity(1) \n"," 0.008 : data_channel_is_socmed(1) LDA_00(1) \n"," 0.008 : weekday_is_sunday(2) \n","-0.008 : data_channel_is_world(1) rate_negative_words(1) \n"," 0.007 : n_tokens_content(2) \n","-0.007 : weekday_is_monday(1) title_sentiment_polarity(1) \n"," 0.007 : weekday_is_thursday(1) title_sentiment_polarity(1) \n","-0.007 : data_channel_is_lifestyle(1) max_positive_polarity(1) \n","-0.007 : n_tokens_content(1) num_imgs(1) \n"," 0.007 : num_videos(1) data_channel_is_bus(1) \n"," 0.006 : data_channel_is_tech(2) \n"," 0.006 : kw_avg_avg(1) LDA_00(1) \n"," 0.006 : kw_max_avg(1) LDA_00(1) \n"," 0.006 : num_keywords(1) kw_avg_max(1) \n","-0.006 : n_tokens_title(1) n_tokens_content(1) \n"," 0.006 : n_unique_tokens(1) rate_negative_words(1) \n","-0.005 : kw_max_max(1) title_sentiment_polarity(1) \n"," 0.005 : n_tokens_content(1) num_hrefs(1) \n"," 0.004 : self_reference_avg_sharess(1) \n"," 0.004 : title_sentiment_polarity(1) abs_title_sentiment_polarity(1) \n"," 0.004 : data_channel_is_socmed(2) \n"," 0.004 : num_hrefs(2) \n"," 0.004 : weekday_is_saturday(2) \n","-0.004 : n_tokens_title(1) n_non_stop_words(1) \n"," 0.004 : LDA_00(2) \n","-0.004 : num_imgs(1) data_channel_is_socmed(1) \n","-0.004 : weekday_is_monday(1) global_rate_negative_words(1) \n"," 0.004 : LDA_00(1) global_rate_positive_words(1) \n","-0.003 : kw_max_avg(2) \n"," 0.003 : weekday_is_friday(1) max_positive_polarity(1) \n"," 0.003 : kw_min_avg(1) weekday_is_monday(1) \n","-0.003 : data_channel_is_lifestyle(1) avg_positive_polarity(1) \n","-0.003 : num_keywords(1) data_channel_is_tech(1) \n","-0.003 : num_hrefs(1) data_channel_is_socmed(1) \n","-0.002 : kw_avg_max(1) kw_min_avg(1) \n"," 0.002 : LDA_03(1) rate_negative_words(1) \n","-0.002 : kw_min_avg(1) self_reference_max_shares(1) \n"," 0.002 : n_tokens_title(1) LDA_03(1) \n","-0.002 : kw_min_avg(1) kw_max_avg(1) \n","-0.002 : LDA_03(1) global_rate_positive_words(1) \n"," 0.002 : global_sentiment_polarity(1) min_positive_polarity(1) \n","-0.002 : kw_avg_avg(1) is_weekend(1) \n"," 0.002 : kw_max_avg(1) self_reference_max_shares(1) \n","-0.002 : num_self_hrefs(2) \n"," 0.002 : num_imgs(1) min_positive_polarity(1) \n"," 0.002 : n_non_stop_words(1) weekday_is_wednesday(1) \n","-0.002 : data_channel_is_lifestyle(2) \n"," 0.002 : weekday_is_monday(2) \n","-0.002 : num_keywords(2) \n","-0.001 : data_channel_is_bus(2) \n","-0.001 : min_negative_polarity(2) \n"," 0.001 : num_imgs(2) \n","-0.001 : rate_negative_words(1) abs_title_subjectivity(1) \n"," 0.001 : global_rate_negative_words(1) title_sentiment_polarity(1) \n"," 0.001 : self_reference_min_shares(1) LDA_04(1) \n"]}],"source":["# sort coefficients from smallest to largest, then reverse it\n","inds = argsort(abs(clfs['las-poly'].coef_))[::-1]\n","print(len(polyfeats.powers_))\n","# print out\n","print(\"weight : feature description\")\n","for i in inds:\n"," if abs(clfs['las-poly'].coef_[i])>1e-3:\n"," # get active features and powers\n"," pows = where(polyfeats.powers_[i])[0]\n"," fstr = \"\"\n"," for p in pows:\n"," fstr += featnames[p] + \"(\" + str(polyfeats.powers_[i][p]) + \") \"\n"," print(\"{: .3f} : {}\".format(clfs['las-poly'].coef_[i], fstr))"]},{"cell_type":"markdown","metadata":{"id":"PseHQ25mVnb1"},"source":["_Which regression method performs the best? Why do you think so?_\n","- **INSERT YOUR ANSWER HERE**"]},{"cell_type":"markdown","metadata":{"id":"KfbubVI6Vnb1"},"source":["- **INSERT YOUR ANSWER HERE**\n","- polynomial (krr-poly, las-poly, and svr-poly) does slightly better.\n","- interactions between features is important."]},{"cell_type":"code","execution_count":null,"metadata":{"id":"c1C4KsJoVnb1"},"outputs":[],"source":[]},{"cell_type":"code","execution_count":null,"metadata":{"id":"67bCB1_qVnb1"},"outputs":[],"source":[]},{"cell_type":"code","execution_count":null,"metadata":{"id":"20BtUb_1Vnb1"},"outputs":[],"source":[]},{"cell_type":"code","execution_count":null,"metadata":{"id":"Ie0ktFRiVnb2"},"outputs":[],"source":[]},{"cell_type":"code","execution_count":null,"metadata":{"id":"QlngbkftVnb2"},"outputs":[],"source":[]},{"cell_type":"code","execution_count":null,"metadata":{"id":"mqVRoo9RVnb2"},"outputs":[],"source":[]}],"metadata":{"anaconda-cloud":{},"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.6.12"},"colab":{"provenance":[]}},"nbformat":4,"nbformat_minor":0}