In this project, we assess the following questions:
This notebook is divided into various parts. Part 1 outlines the data used and cleans the data. Part 2 presents an overview of the data. Part 3 shows overall trends in ideology. Part 4 isolates specific effects. Part 5 looks at how judges make decisions.
# All packages used in this notebook are imported here.
import pandas as pd
import numpy as np
import seaborn as sns
import matplotlib.pyplot as plt
%matplotlib inline
from sklearn import (
linear_model, metrics, neural_network, pipeline, preprocessing, model_selection, tree
)
from sklearn.ensemble import RandomForestRegressor
from sklearn.model_selection import cross_val_score, cross_val_predict
import plotly
import chart_studio.plotly as py
import plotly.graph_objs as go
from scipy import stats
import statsmodels as sm
import statsmodels.formula.api as smf
from statsmodels.iolib.summary2 import summary_col
from patsy.builtins import *
from patsy import dmatrices
import statistics as st
#Jellyfish is not included in syzygy. Uncomment if necessary.
#!pip install jellyfish
import jellyfish as jf
The main dataset for this analysis is the Attributes of U.S. Federal Judges Database, from The Judicial Research Initiative (JuRI) at the University of South Carolina. The data was downloaded as a .dta file from the website, but had no data labels or encoding. The labeling file was written only for SAS. Before starting to clean the data in Python, we took the SAS cleaning code and manually changed it into Stata code in order to label the values and clean other portions of the data. After running this through Stata, the data was exported as a .csv file, and we do the final cleaning (everything that could possibly be done in Python) here.
# Load raw data
judge_att_data = pd.read_csv('Judge Attribute Data.csv')
# Here is what it looks like right now
judge_att_data.head()
name_original | name | songer_code | circuit_original | circuit | id | pres | appres | yearl | yearb | ... | pmayor | pccoun | pccom | pada | pda | plother | plotherl | plawprof | pprivate | recdate | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | Abruzzo, Matthew J. | Abruzzo, Matthew J. | 10201.0 | 2 | Second | 2 | F. Roosevelt | Democrat | 1966 | 1889.0 | ... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 1.0 | NaN |
1 | Acheson, Marcus Wilson | Acheson, Marcus Wilson | NaN | 3 | Third | 4 | Hayes | Republican | 1891 | 1828.0 | ... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 1.0 | NaN |
2 | Acker, William Marsh, Jr. | Acker, William Marsh, Jr. | 11101.0 | 11 | Eleventh | 10 | Reagan | Republican | 1996 | 1927.0 | ... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 1.0 | NaN |
3 | Ackerman, Harold Arnold | Ackerman, Harold Arnold | 10301.0 | 3 | Third | 15 | Carter | Democrat | 1994 | 1928.0 | ... | NaN | NaN | NaN | NaN | NaN | NaN | NaN | NaN | 1.0 | NaN |
4 | Ackerman, James Waldo | Ackerman, James Waldo | 10701.0 | 7 | Seventh | 20 | Ford | Republican | 1984 | 1926.0 | ... | NaN | NaN | NaN | NaN | NaN | 1.0 | 3.0 | NaN | 1.0 | NaN |
5 rows × 147 columns
# Drop unnecessary columns, rename necessary columns
judge_att_data = judge_att_data.drop(columns = ['name_original','___l','___j','___char','elevate','dcother',
'liable', 'dummy','religion','circuit',
'songer_code','amon','crossl','pred','appt','temp',
'trans','liable','abamin','dsenate','rsenate','dhouse',
'rhouse','fhouse','fsenate','drhouse','drsenate',
'whouse','wsenate','nrhouse','nrsenate','dsens','rsens',
'yeari','yearc','e1','e2','e3','e4','e5','e6','congresi',
'unity','e7','e8','yearo','congreso','unityo','cityb',
'badeg','bastate','bastatus','jddeg','jdstate','jdstatus',
'grad1','grad2','tperm','fsens','drsens','wsens','nrsens',
'osens','agego','service','csb','ba','bast','bapp','ls',
'lsst','jdpp','graddeg1','graddeg2','statecab','state2',
'recdate','ageon'])
judge_att_data = judge_att_data.rename(columns = {'name':'Name','circuit_original':'Circuit','id':'ID',
'pres':'Appointing President','yearl':'Year of Departure',
'yearb':'Year of Birth','yeard':'Year of Death',
'pleft':'President when Departed','left':'Reason for Departing',
'party':'Judge Party','district':'District','state':'State',
'city':'City','gender':'Gender','race':'Race',
'ayear':'Year of Appointment','crossa':'Cross Appointment',
'recess':'Recess Appointment','aba':'ABA Rating',
'assets':'Assets','congress':'Congress','unityi':'Unity',
'hdem':'House Democrats','hrep':'House Republicans',
'sdem':'Senate Democrats','srep':'Senate Republicans',
'hother':'House Independents','sother':'Senate Independents',
'networth':'Net Worth','appres':'Appointing President Party'})
# Replace zero values with missing for net worth and assets
def replace_zero_with_na(x):
if x == 0:
return np.nan
else:
return x
judge_att_data['Assets'] = judge_att_data['Assets'].apply(replace_zero_with_na)
judge_att_data['Net Worth'] = judge_att_data['Net Worth'].apply(replace_zero_with_na)
# Turn the position indicator columns into dummies and rename (these all start with 'p')
def turn_into_dummy(val):
if np.isnan(val):
return 0
else:
return 1
position_columns = list(filter(lambda col: col[0] == 'p', list(judge_att_data.columns)))
for col in position_columns:
judge_att_data[col] = judge_att_data[col].apply(turn_into_dummy)
judge_att_data = judge_att_data.rename(columns = {col:'Previous Position - ' + col[1:]})
# Creating new variable for whether judge held any of the elected positions
# These are the variables for the judge holding elected office of some kind
political_positions = ['Previous Position - house', 'Previous Position - senate',
'Previous Position - gov','Previous Position - ssenate',
'Previous Position - shouse','Previous Position - mayor','Previous Position - ccoun']
# Creating column of 0's which we will then fill
judge_att_data["Politician"] = 0*judge_att_data['Previous Position - house']
for position in political_positions:
judge_att_data["Politician"] = np.maximum(judge_att_data["Politician"],judge_att_data[position])
# Creating new variable for judge's age at the time of appointment
judge_att_data["Age When Appointed"] = judge_att_data["Year of Appointment"] - judge_att_data["Year of Birth"]
# Here is the data now
judge_att_data.head()
Name | Circuit | ID | Appointing President | Appointing President Party | Year of Departure | Year of Birth | Year of Death | President when Departed | Reason for Departing | ... | Previous Position - ccoun | Previous Position - ccom | Previous Position - ada | Previous Position - da | Previous Position - lother | Previous Position - lotherl | Previous Position - lawprof | Previous Position - private | Politician | Age When Appointed | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | Abruzzo, Matthew J. | 2 | 2 | F. Roosevelt | Democrat | 1966 | 1889.0 | 1971.0 | L.B. Johnson | Retired | ... | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 47.0 |
1 | Acheson, Marcus Wilson | 3 | 4 | Hayes | Republican | 1891 | 1828.0 | 1906.0 | B. Harrison | Elevated | ... | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 52.0 |
2 | Acker, William Marsh, Jr. | 11 | 10 | Reagan | Republican | 1996 | 1927.0 | 9999.0 | Clinton | Retired | ... | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 55.0 |
3 | Ackerman, Harold Arnold | 3 | 15 | Carter | Democrat | 1994 | 1928.0 | 9999.0 | Clinton | Retired | ... | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 51.0 |
4 | Ackerman, James Waldo | 7 | 20 | Ford | Republican | 1984 | 1926.0 | 1984.0 | Reagan | Died | ... | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 1 | 0 | 50.0 |
5 rows × 72 columns
We also have data on individual judge ideology scores, which comes from Christina L Boyd at the University of Georgia. In this dataset, a negative ideology score is more liberal, while a positive ideology score is more conservative. The scores range from -1 to 1.
The judge names in the two datasets do not match perfectly. As a result, we must fuzzy match the names to obtain a high number matches between the two datasets. To do this, we calculate the Jaro-Winkler distance between each string in the Judge Attribute Data and the Ideology Data, and take a match for the highest scoring match for each name in the Attribute Data. The Jaro-Winkler distance assigns stronger weights to characters at the beginning of the string. Since the names are in the Last, First M. format, this makes last names more important than first names for the matching, which gives more accurate results. With some manual inspection, we chose 0.89 as the minimum score for an accurate name match.
# Load ideology data
judge_ideo_score = pd.read_excel('Judge Ideology Scores.xlsx')
judge_ideo_score = judge_ideo_score[['judgename','ideology_score']]
judge_ideo_score = judge_ideo_score.rename(columns = {'judgename':'Name','ideology_score':'Ideology Score'})
# Here is what it looks like
judge_ideo_score.head()
Name | Ideology Score | |
---|---|---|
0 | Abrams, Leslie Joyce | -0.294 |
1 | Abrams, Ronnie | -0.302 |
2 | Acker, William Marsh | 0.407 |
3 | Ackerman, Harold Arnold | -0.306 |
4 | Ackerman, James Waldo | 0.061 |
# Define function for getting the best matching from a given list. We will use this again later on.
def get_best_name_match_from_list(name, data_list):
best_match = ""
highest_jw = 0
for potential_match in data_list:
# This gives the Jaro-Winkler score which we use for matching
current_score = jf.jaro_winkler(potential_match, name)
if ((current_score > highest_jw) and (current_score > 0.89)):
highest_jw = current_score
best_match = potential_match
return best_match
# Create column of closest name
judge_att_data['Closest Name'] = judge_att_data['Name'].apply(lambda x : get_best_name_match_from_list(x,judge_ideo_score['Name']))
# Here is what some results look like. Note that blanks exist where no match was found.
judge_att_data[['Name','Closest Name']].sample(10)
Name | Closest Name | |
---|---|---|
481 | Cote, Denise Louise | Cote, Denise |
1438 | Martin, John S., Jr. | Martin, John S. |
168 | Blackburn, Robert E. | Blackburn, Robert E. |
1763 | Payne, Robert Elkin | Payne, Robert E. |
731 | Foley, James T. | Foley, James Thomas |
1236 | Kinkeade, James E. | Kinkeade, James E. |
2446 | Wilkerson, James Herbert | |
902 | Hall, Sam B., Jr. | |
153 | Bicks, Alexander | Bicks, Alexander |
1424 | Marchant, Henry |
# Merge ideology data into attribute data using the closest match found
judge_att_data = judge_att_data.merge(judge_ideo_score, left_on = 'Closest Name', right_on = 'Name', how = 'left')
judge_att_data = judge_att_data.drop(columns = ['Name_y','Closest Name'])
judge_att_data = judge_att_data.rename(columns = {'Name_x':'Name'})
judge_att_data.info()
<class 'pandas.core.frame.DataFrame'> Int64Index: 2561 entries, 0 to 2560 Data columns (total 73 columns): Name 2561 non-null object Circuit 2561 non-null int64 ID 2561 non-null int64 Appointing President 2561 non-null object Appointing President Party 2561 non-null object Year of Departure 2561 non-null int64 Year of Birth 2489 non-null float64 Year of Death 2494 non-null float64 President when Departed 2559 non-null object Reason for Departing 2561 non-null object Judge Party 2555 non-null object District 2561 non-null object State 2561 non-null object City 2377 non-null object Gender 2561 non-null object Race 2561 non-null object Year of Appointment 2561 non-null int64 Cross Appointment 2561 non-null object Recess Appointment 2561 non-null object Assets 894 non-null float64 ABA Rating 2393 non-null object Congress 1905 non-null object Unity 2561 non-null object House Democrats 2561 non-null int64 House Republicans 2561 non-null int64 Senate Democrats 2561 non-null int64 Senate Republicans 2561 non-null int64 House Independents 2561 non-null int64 Senate Independents 2561 non-null int64 Net Worth 894 non-null float64 Previous Position - ssc 2561 non-null int64 Previous Position - slc 2561 non-null int64 Previous Position - locct 2561 non-null int64 Previous Position - sjdget 2561 non-null int64 Previous Position - ausa 2561 non-null int64 Previous Position - usa 2561 non-null int64 Previous Position - sgo 2561 non-null int64 Previous Position - sg 2561 non-null int64 Previous Position - ago 2561 non-null int64 Previous Position - ag 2561 non-null int64 Previous Position - cc 2561 non-null int64 Previous Position - sp 2561 non-null int64 Previous Position - mag 2561 non-null int64 Previous Position - bank 2561 non-null int64 Previous Position - terr 2561 non-null int64 Previous Position - cab 2561 non-null int64 Previous Position - asatty 2561 non-null int64 Previous Position - satty 2561 non-null int64 Previous Position - cabdept 2561 non-null int64 Previous Position - scab 2561 non-null int64 Previous Position - scabdpt 2561 non-null int64 Previous Position - aag 2561 non-null int64 Previous Position - indreg1 2561 non-null int64 Previous Position - reg1 2561 non-null int64 Previous Position - reg2 2561 non-null int64 Previous Position - reg3 2561 non-null int64 Previous Position - house 2561 non-null int64 Previous Position - senate 2561 non-null int64 Previous Position - gov 2561 non-null int64 Previous Position - ssenate 2561 non-null int64 Previous Position - shouse 2561 non-null int64 Previous Position - mayor 2561 non-null int64 Previous Position - ccoun 2561 non-null int64 Previous Position - ccom 2561 non-null int64 Previous Position - ada 2561 non-null int64 Previous Position - da 2561 non-null int64 Previous Position - lother 2561 non-null int64 Previous Position - lotherl 2561 non-null int64 Previous Position - lawprof 2561 non-null int64 Previous Position - private 2561 non-null int64 Politician 2561 non-null int64 Age When Appointed 2489 non-null float64 Ideology Score 1881 non-null float64 dtypes: float64(6), int64(51), object(16) memory usage: 1.4+ MB
Finally, we have data on decisions made by US Federal District Court judges. This comes from The Carp-Manning U.S. District Court Case Database. For every decision, the dataset assigns a 'liberal' or 'conservative' designation to the decision that was made, and states which judge authored the decision. The dataset also has information on the court that made the decision, when the decision was made, and what legal category the decision falls under. We take this data and merge the Judge Attribute Data into it, again using Jaro-Winkler fuzzy matching. Thus we can also explore what influences specific decisions that judges have made.
# Load data and rename columns
decision_data = pd.read_csv('Carp-Manning.csv')
decision_data = decision_data.rename(columns
= {'judge':'Authoring Judge','crtpoint':'Court Location',
'numjudge':'Number of Judges','circuit':'Circuit',
'state':'State','statdist':'District','month':'Month',
'year':'Year','libcon':'Decision Ideology',
'casetype':'Case Type','category':'Case Category',
'casnum':'Case Number','apyear':'Year of Appointment',
'appres':'Appointing President','party':'Judge Party',
'gender':'Gender','race':'Race'})
# Here is what the data looks like
decision_data.head()
Authoring Judge | Court Location | Number of Judges | Circuit | State | District | Month | Year | Decision Ideology | Case Type | Case Category | Case Number | Year of Appointment | Appointing President | Judge Party | Gender | Race | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | Avis, John Boyd | Camden, NJ | 1 | 3RD CIRCUIT | NEW JERSEY | New Jersey Dist of NJ | July | 1932 | Conservative | alien petitions | Civil Liberties/Rights Cases | 10010028 | 1929 | HOOVER | Republican | male | white/caucasian |
1 | Avis, John Boyd | Camden, NJ | 1 | 3RD CIRCUIT | NEW JERSEY | New Jersey Dist of NJ | July | 1932 | Conservative | alien petitions | Civil Liberties/Rights Cases | 10010029 | 1929 | HOOVER | Republican | male | white/caucasian |
2 | Strum, Louie W. | Jacksonville, FL | 1 | 5TH CIRCUIT | FLORIDA | Florida Southern Dist | September | 1932 | Conservative | (non)conv-criminal case | Criminal Justice Cases | 10010033 | 1931 | HOOVER | Democrat | male | white/caucasian |
3 | Moscowitz, Grover | Brooklyn, NY | 5 | 2ND CIRCUIT | NEW YORK | New York Eastern Dist | July | 1932 | Conservative | criminal court motions | Criminal Justice Cases | 10010104 | 1925 | COOLIDGE | Republican | male | white/caucasian |
4 | Cochran, Andrew | Maysville, KY | 1 | 6TH CIRCUIT | KENTUCKY | Kentucky Eastern Dist | March | 1932 | Liberal | voting rights | Civil Liberties/Rights Cases | 10010142 | 1901 | MCKINLEY | Republican | male | white/caucasian |
# Get best match in Attributes Data
decision_data['Closest Name'] = decision_data['Authoring Judge'].apply(lambda x : get_best_name_match_from_list(x,judge_att_data['Name']))
# Here are some matches
decision_data[['Authoring Judge','Closest Name']].sample(10)
# Now merge based on these matches
decision_data = decision_data.merge(judge_att_data, left_on = 'Closest Name', right_on = 'Name', how = 'left')
# Get rid of duplicate columns
duplicate_cols = list(filter(lambda col: col[-2:] == '_y', list(decision_data.columns)))
decision_data = decision_data.drop(columns = duplicate_cols)
decision_data = decision_data.drop(columns = ['Closest Name','Name'])
duplicate_cols = [col[:-2] for col in duplicate_cols]
for col in duplicate_cols:
decision_data = decision_data.rename(columns = {col + '_x': col})
# Here is what it looks like now
decision_data.head()
decision_data.info()
We now present some graphs, charts and map that highlight key attributes of the Judge Attribute and Ideology Data. Ideology data are not consistent before 1956, so we eliminate years before this.
# Ideology data are not consistent before 1956, so we eliminate years before this.
judges = judge_att_data[judge_att_data["Year of Appointment"] > 1956].copy()
# Rescaling the ideology variable for presentation
judges["Ideology Score"] = judges["Ideology Score"].apply(lambda x: x*100)
# The absolute value of the ideology score measures a judge's distance from the ideological centre
judges["Absolute Ideology"] = judges["Ideology Score"].apply(abs)
# The dataset includes attributes of judges including:
# Gender, race, age, politican party, past experience (including in politics)
judges.head()
To provide motivation for our analysis, we will create a graph showing how the average ideology of judges shifts over time
# Dataframe with mean ideology and absolute ideology by year
year_ideology = judges.groupby("Year of Appointment")[["Absolute Ideology","Ideology Score"]].mean()
year_ideology.reset_index(inplace = True)
plt.style.use("fivethirtyeight")
fig, ax = plt.subplots(2,1,figsize=(11,8.5))
# Hide grid lines, set a white face color, and set yaxis label
for counter, value in enumerate(["Mean Ideology Score","Mean Absolute Ideology Score"]):
ax[counter].set_facecolor('white')
ax[counter].grid(False)
ax[counter].set_ylabel(value)
# Plot mean ideology, absolute ideology over time
for counter, value in enumerate(["Ideology Score","Absolute Ideology"]):
ax[counter].plot(year_ideology["Year of Appointment"],
year_ideology[value],"-o")
ax[0].set_title("Judge Ideology Varies by President...")
ax[1].set_title("...But Absolute Ideology is on the Rise")
ax[1].set_xlabel("Year of Judge Appointment")
fig.tight_layout()
The graph above showed judges have become more ideological. Our next question is whether this trend occurred in Democratic judges, Republican judges, or both? Since ideology varies so much based on the president in power, we'll look at the judge's year of birth, rather than year of appointment to see whether newer judges are more ideoligical than older ones.
age_ideology = judges.groupby(["Year of Birth","Judge Party"])[["Ideology Score","Absolute Ideology"]].mean()
age_ideology.reset_index(inplace = True)
fig, ax = plt.subplots(figsize=(11,8.5))
ax.set_facecolor('white')
ax.grid(False)
# Data is sparse for judges born before 1900
initial_age = 1900
recent = age_ideology["Year of Birth"] >= initial_age
democrats = age_ideology["Judge Party"] == "Democrat"
republicans = age_ideology["Judge Party"] == "Republican"
ax.plot(age_ideology[democrats & recent]["Year of Birth"],
age_ideology[democrats & recent]["Ideology Score"],"-o",label="Democrats",color="#0e44f5")
ax.plot(age_ideology[republicans & recent]["Year of Birth"],
age_ideology[republicans & recent]["Ideology Score"],"-o",label="Republicans",color="#f23417")
ax.legend()
ax.set_title("Divergence of Judge Ideology By Party")
ax.set_xlabel("Year of Birth")
ax.set_ylabel("Mean Ideology Score")
Finally, we explore how ideology, both in real and absolute terms, has varied across states and time. We note that this appears to be very dependent on who is president.
# Load crosswalk between state names and state codes
state_name_to_code = pd.read_csv('State Name to Code.csv')
state_name_to_code.sample(5)
# Clean judge ideology data and take only necessary columns
map_data = judge_att_data[['Name','State','Year of Appointment','Year of Departure','Ideology Score']].copy()
map_data = map_data[map_data['State'] != 'Puerto Rico']
map_data = map_data.merge(state_name_to_code, how = 'left')
map_data = map_data[map_data['Ideology Score'].apply(lambda x : ~np.isnan(x))]
# Create empty dataframe to be filled by each unique judge-year pair
# A judge-year pair exists if the judge was active in the year
judge_ideo_by_year = pd.DataFrame(columns = ['Name','State','StateCode','Year','Ideology Score'])
# Fill dataframe
for index, row in map_data.iterrows():
name = row['Name']
state = row['State']
statecode = row['StateCode']
app_year = int(row['Year of Appointment'])
# If the judge is still active in 2004, the year of departure is '9999'
dep_year = np.min([2004, int(row['Year of Departure'])])
ideo = row['Ideology Score']
for year in range(app_year, dep_year + 1):
judge_ideo_by_year = judge_ideo_by_year.append({'Name':name,'State':state,'StateCode':statecode,
'Year':year,'Ideology Score':ideo},
ignore_index = True)
# Add absolute ideology score
judge_ideo_by_year['Absolute Ideology Score'] = judge_ideo_by_year['Ideology Score'].apply(np.abs)
# Now group by year and state, and take means
state_ideo_by_year = judge_ideo_by_year.groupby(['Year','State','StateCode']).mean().reset_index()
# Scale ideology score for readability
state_ideo_by_year['Ideology Score'] = state_ideo_by_year['Ideology Score'].apply(lambda x: 100*x)
state_ideo_by_year['Absolute Ideology Score'] = state_ideo_by_year['Absolute Ideology Score'].apply(lambda x: 100*x)
# Here is what a random sample of the data looks like
state_ideo_by_year.sample(10)
Now we make interactive map of average state judge ideology by year. For the two maps presented, use the slider to see ideology changing by year.
# Create dict of US presidents by year
president_by_year = dict(
[(n, 'George W. Bush')
for n in range(2001, 2005)] +
[(n, 'Bill Clinton')
for n in range(1993, 2001)] +
[(n, 'George H. W. Bush')
for n in range(1989, 1993)] +
[(n, 'Ronald Reagan')
for n in range(1981, 1989)] +
[(n, 'Jimmy Carter')
for n in range(1977, 1981)] +
[(n, 'Gerald Ford')
for n in range(1975, 1977)] +
[(n, 'Richard Nixon')
for n in range(1969, 1975)] +
[(n, 'Lyndon B. Johnson')
for n in range(1964, 1969)] +
[(n, 'John F. Kennedy')
for n in range(1961, 1964)] +
[(n, 'Dwight D. Eisenhower')
for n in range(1956, 1961)]
)
# Define plotting function.
def plot_ideology_by_year(beginyear = 1956, scl = None, absolute = False):
plotly.offline.init_notebook_mode()
if absolute:
ideo = 'Absolute Ideology Score'
zmin = 0
text = 'Average Absolute Judge Ideology Score by State and Year'
else:
ideo = 'Ideology Score'
zmin = -60
text = 'Average Judge Ideology Score by State and Year'
# Create dict of data to feed into plotly.
data = [dict(type='choropleth',
marker = go.choropleth.Marker(
line = go.choropleth.marker.Line(
color = 'rgb(255,255,255)',
width = 1.5
)),
hoverinfo = 'z+text',
colorbar = go.choropleth.ColorBar(
title = ideo,
thickness = 40
),
colorscale = scl,
zmin = zmin,
zmax = 60,
autocolorscale = False,
locations = state_ideo_by_year[state_ideo_by_year['Year'] == year]['StateCode'],
z = state_ideo_by_year[state_ideo_by_year['Year'] == year][ideo].astype(float),
text = state_ideo_by_year[state_ideo_by_year['Year'] == year]['State'],
locationmode='USA-states')
for year in range(beginyear,2005)]
# Create slider for the map
steps = []
for i in range(len(data)):
step = dict(method='update',
args = [
# Make the ith trace visible
{'visible': [False for t in range(len(data))]},
# Set the title for the ith trace
{'title.text': text + "<br />" + f"President is {president_by_year[i+beginyear]}"}],
label='Year {}'.format(i + beginyear))
step['args'][0]['visible'][i] = True
steps.append(step)
sliders = [dict(active=0,
pad={"t": 1},
steps=steps)]
# Define layout
layout = dict(geo = go.layout.Geo(
scope = 'usa',
projection = go.layout.geo.Projection(type = 'albers usa')),
sliders=sliders,
title = {'text': text + "<br />" + f"President is {president_by_year[i+beginyear]}"}
)
# Create map with plotly
fig = dict(data=data, layout=layout)
return plotly.offline.iplot(fig)
This first map presents judge ideology in absolute terms. Unsurprisingly, as the presidency changes from one party to another, we see judge ideology follow the President's ideology.
# Choose a colour scale from blue (democrat) to red (republican)
demrep_scl = [
[0.0, 'rgb(0,24,229)'],
[0.2, 'rgb(38,19,186)'],
[0.4, 'rgb(76,14,144)'],
[0.6, 'rgb(114,9,102)'],
[0.8, 'rgb(152,4,60)'],
[1.0, 'rgb(191,0,18)']
]
plot_ideology_by_year(scl = demrep_scl, absolute = False)
Next, we show the same map with absolute ideology. We see absolute ideology increasing over time.
# Choose a colour scale from light orange (low) to dark orange (high)
hl_scl = [
[0.0, 'rgb(247,232,206)'],
[0.2, 'rgb(248,219,171)'],
[0.4, 'rgb(249,207,137)'],
[0.6, 'rgb(250,194,102)'],
[0.8, 'rgb(251,182,68)'],
[1.0, 'rgb(252,170,34)']
]
plot_ideology_by_year(scl = hl_scl, absolute = True)
We now move on to an analysis of the judge attribute and ideology data. Specifically, we attempt to determine how ideology is impacted by characteristics of the judges. We begin by preparing the data for prediction.
# Prep data for prediction
def prep_data(df, continuous_variables, categories, y_var, test_size=0.15):
ohe = preprocessing.OneHotEncoder(sparse=False)
y = df[y_var].values
X = np.zeros((y.size, 0))
# Add continuous variables if exist
if len(continuous_variables) > 0:
X = np.hstack([X, df[continuous_variables].values])
if len(categories) > 0:
X = np.hstack([X, ohe.fit_transform(df[categories])])
X_train, X_test, y_train, y_test = model_selection.train_test_split(
X, y, test_size=test_size, random_state=42
)
return X_train, X_test, y_train, y_test
# This function will allow us to compare the MSE's of each model
def fit_and_report_mses(mod, X_train, X_test, y_train, y_test):
mod.fit(X_train, y_train)
return dict(
mse_train=metrics.mean_squared_error(y_train, mod.predict(X_train)),
mse_test=metrics.mean_squared_error(y_test, mod.predict(X_test))
)
# Dropping everything but the regressors and the outcome variable
# Net Worth and Assets have NA/missinng values for 45% of entries so we drop them
judges_ideology = judges.drop([ "Name","ID","Year of Death",
"Net Worth","Assets","Congress"],1)
# Removing rows with NAs
judges_ideology = judges_ideology.dropna()
# Continuous variables or variables that are already indicators
continuous_variables = ['House Democrats', 'House Republicans', 'Senate Democrats', 'Senate Republicans',
'House Independents', 'Senate Independents', 'Previous Position - ssc', 'Previous Position - slc',
'Previous Position - locct', 'Previous Position - sjdget', 'Previous Position - ausa',
'Previous Position - usa', 'Previous Position - sgo', 'Previous Position - sg',
'Previous Position - ago', 'Previous Position - ag', 'Previous Position - cc',
'Previous Position - sp', 'Previous Position - mag', 'Previous Position - bank',
'Previous Position - terr', 'Previous Position - cab', 'Previous Position - asatty',
'Previous Position - satty', 'Previous Position - cabdept', 'Previous Position - scab',
'Previous Position - scabdpt', 'Previous Position - aag', 'Previous Position - indreg1',
'Previous Position - reg1', 'Previous Position - reg2', 'Previous Position - reg3',
'Previous Position - house', 'Previous Position - senate', 'Previous Position - gov',
'Previous Position - ssenate', 'Previous Position - shouse', 'Previous Position - mayor',
'Previous Position - ccoun', 'Previous Position - ccom', 'Previous Position - ada',
'Previous Position - da', 'Previous Position - lother', 'Previous Position - lotherl',
'Previous Position - lawprof', 'Previous Position - private']
# Categorical variables
categories = ['Year of Appointment', 'Year of Birth', 'Year of Departure', 'Cross Appointment', 'Recess Appointment',
'Unity', 'Circuit', 'Appointing President', 'Appointing President Party', 'President when Departed',
'Reason for Departing', 'Judge Party', 'District', 'State', 'City', 'Gender', 'Race', 'ABA Rating']
# Creating test and training data for the two outcomes: ideology and absolute ideology
X_train, X_test, ideo_train, ideo_test = prep_data(
judges_ideology,continuous_variables , categories, "Ideology Score"
)
X_train, X_test, abs_ideo_train, abs_ideo_test = prep_data(
judges_ideology,continuous_variables , categories, "Absolute Ideology"
)
# After some experimentation, we've selected some model parameters for lasso, random forest, and a neural network model
alphas = np.exp(np.linspace(-2., -12., 25))
lr_model = linear_model.LinearRegression()
lasso_model = linear_model.LassoCV(cv=6, alphas = alphas, max_iter=500)
forest_model = RandomForestRegressor(n_estimators = 100)
nn_scaled_model = pipeline.make_pipeline(
preprocessing.StandardScaler(), # this will do the input scaling
neural_network.MLPRegressor((150,),activation = "logistic",
solver="adam",alpha=0.005)) # we tried a few alphas chose this one
# based on minimizing mse_test ... but it was somewhat arbitrary
models = { "OLS": lr_model, "Lasso": lasso_model,
"Random Forest": forest_model, "Neural Network": nn_scaled_model}
# Creating an empty dataframe (with hierarchical columns) for the test and training MSE of each model
MSE_by_model = pd.DataFrame(index = models.keys(),
columns= pd.MultiIndex.from_arrays((["Ideology","Ideology","Absolute Ideology","Absolute Ideology"],
["Train MSE","Test MSE","Train MSE","Test MSE"])))
# This is what that dataframe looks like
MSE_by_model
Ideology | Absolute Ideology | |||
---|---|---|---|---|
Train MSE | Test MSE | Train MSE | Test MSE | |
OLS | NaN | NaN | NaN | NaN |
Lasso | NaN | NaN | NaN | NaN |
Random Forest | NaN | NaN | NaN | NaN |
Neural Network | NaN | NaN | NaN | NaN |
# Takes a few minutes to run
ideo_mse_list = [fit_and_report_mses(model,X_train,X_test, ideo_train,ideo_test) for model in models.values()]
abs_ideo_mse_list = [fit_and_report_mses(model,X_train,X_test, abs_ideo_train,abs_ideo_test) for model in models.values()]
MSE_by_model[("Ideology","Train MSE")] = [result["mse_train"] for result in ideo_mse_list]
MSE_by_model[("Ideology","Test MSE")] = [result["mse_test"] for result in ideo_mse_list]
MSE_by_model[("Absolute Ideology","Train MSE")] = [result["mse_train"] for result in abs_ideo_mse_list]
MSE_by_model[("Absolute Ideology","Test MSE")] = [result["mse_test"] for result in abs_ideo_mse_list]
MSE_by_model
C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\neural_network\multilayer_perceptron.py:562: ConvergenceWarning: Stochastic Optimizer: Maximum iterations (200) reached and the optimization hasn't converged yet. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\neural_network\multilayer_perceptron.py:562: ConvergenceWarning: Stochastic Optimizer: Maximum iterations (200) reached and the optimization hasn't converged yet.
Ideology | Absolute Ideology | |||
---|---|---|---|---|
Train MSE | Test MSE | Train MSE | Test MSE | |
OLS | 93.451018 | 3.731771e+18 | 96.521900 | 1.515461e+19 |
Lasso | 144.451759 | 2.191193e+02 | 158.052784 | 1.803260e+02 |
Random Forest | 17.029786 | 1.309845e+02 | 12.133112 | 8.674473e+01 |
Neural Network | 37.042254 | 2.688825e+02 | 48.897053 | 2.258672e+02 |
With our parameters (and computing time limitations), the Random Forest clearly does the best job predicting ideology and absolute ideology.
We'll now use the Random Forest to see how much of the growth in absolute ideology over time is explained by the judge attributes.
We will generate fitted values and residuals for the absolute ideology using the Random Forest (because it performed the best above) and the entire sample (not just training data). Then we'll plot the average change in residuls and fitted values in a graph similar to one above that we used to motivate analysis.
# Using the fulldataset is equivalent to setting test_size = 0
X_full, X_empty_test, abs_ideo_full, abs_ideo_empty_train = prep_data(
judges_ideology,continuous_variables , categories, "Absolute Ideology",test_size=0
)
# Fitted values
abs_ideo_hat = forest_model.fit(X_full,abs_ideo_full).predict(X_full)
# Residuals
abs_ideo_resid = abs_ideo_full - abs_ideo_hat
# Creating dataframe to ultimately generate mean observed, predicted, and residual values by year
judges_decomposition = judges_ideology[["Year of Appointment","State","Absolute Ideology"]].copy()
judges_decomposition["Residuals"] = abs_ideo_resid
judges_decomposition["Fitted"] = abs_ideo_hat
year_decomposition = judges_decomposition.groupby("Year of Appointment")[["Absolute Ideology","Residuals","Fitted"]].mean()
year_decomposition.reset_index(inplace = True)
plt.style.use("fivethirtyeight")
fig, ax = plt.subplots(1,2,figsize=(22,8.5))
colors = ["#4135ed" ,"#5cb6cf"]
for counter,value in enumerate(["Absolute Ideology","Fitted"]):
ax[0].plot(year_decomposition["Year of Appointment"],
year_decomposition[value],"-o", color = colors[counter],label=value)
ax[1].scatter(year_decomposition["Year of Appointment"],
year_decomposition[value], color = colors[counter],label=value)
slope, intercept, r_value, p_value, std_err = stats.linregress(year_decomposition["Year of Appointment"],year_decomposition[value])
line = slope*year_decomposition["Year of Appointment"]+intercept
ax[1].plot(year_decomposition["Year of Appointment"], line,color=colors[counter],label="_")
ax[0].set_title("Are Judge Attributes Driving Rising Absolute Ideology?")
ax[1].set_title("...They Do Not Appear to Explain Increasing Absolute Ideology")
for n in [0,1]:
ax[n].set_facecolor('white')
ax[n].grid(False)
ax[n].set_ylabel("Yearly Mean")
ax[n].set_xlabel("Year of Judge Appointment")
ax[n].legend()
fig.tight_layout()
The fitted values do not show an increase in predicted absolute ideology over time. But part of the reason is structural: we are controlling for year of appointment and other variables that vary over time such as appointed president. Next, we'll look at whether the judge's static personal attributes (excluding age) predict the rise in absolute over time. We'll use the following variables: race, gender, previous job experience, judge's political party, and American Bar Association Rating (level of qualification).
First, we'll look at how judge personal attributes have changed over time.
# Subset of full dataframe with only key judge personal attributes, as well as year of appointment
judges_personal = judges_ideology[["Age When Appointed","Race","Gender","Judge Party","Politician","ABA Rating","Year of Appointment"]]
# Manual "one-hot encoding" or in other words, creating columns which serve as indicator variables for key attributes
for race_name in ["White","African American"]:
judges_personal[race_name] = [1 if race == race_name else 0 for race in judges_personal["Race"]]
judges_personal["Female"] = [1 if gender == "Female" else 0 for gender in judges_personal["Gender"]]
judges_personal["Republican"] = [1 if party == "Republican" else 0 for party in judges_personal["Judge Party"]]
judges_personal["Well Qualified"] = [1 if rating == "Well-Qual." else 0 for rating in judges_personal["ABA Rating"]]
mean_age = np.mean(judges["Age When Appointed"])
judges_personal["Young"] = [1 if age < mean_age else 0 for age in judges_personal["Age When Appointed"]]
judges_personal.head()
C:\Users\Ian\Anaconda3\lib\site-packages\ipykernel_launcher.py:6: SettingWithCopyWarning: A value is trying to be set on a copy of a slice from a DataFrame. Try using .loc[row_indexer,col_indexer] = value instead See the caveats in the documentation: http://pandas.pydata.org/pandas-docs/stable/indexing.html#indexing-view-versus-copy C:\Users\Ian\Anaconda3\lib\site-packages\ipykernel_launcher.py:8: SettingWithCopyWarning: A value is trying to be set on a copy of a slice from a DataFrame. Try using .loc[row_indexer,col_indexer] = value instead See the caveats in the documentation: http://pandas.pydata.org/pandas-docs/stable/indexing.html#indexing-view-versus-copy C:\Users\Ian\Anaconda3\lib\site-packages\ipykernel_launcher.py:9: SettingWithCopyWarning: A value is trying to be set on a copy of a slice from a DataFrame. Try using .loc[row_indexer,col_indexer] = value instead See the caveats in the documentation: http://pandas.pydata.org/pandas-docs/stable/indexing.html#indexing-view-versus-copy C:\Users\Ian\Anaconda3\lib\site-packages\ipykernel_launcher.py:10: SettingWithCopyWarning: A value is trying to be set on a copy of a slice from a DataFrame. Try using .loc[row_indexer,col_indexer] = value instead See the caveats in the documentation: http://pandas.pydata.org/pandas-docs/stable/indexing.html#indexing-view-versus-copy C:\Users\Ian\Anaconda3\lib\site-packages\ipykernel_launcher.py:13: SettingWithCopyWarning: A value is trying to be set on a copy of a slice from a DataFrame. Try using .loc[row_indexer,col_indexer] = value instead See the caveats in the documentation: http://pandas.pydata.org/pandas-docs/stable/indexing.html#indexing-view-versus-copy
Age When Appointed | Race | Gender | Judge Party | Politician | ABA Rating | Year of Appointment | White | African American | Female | Republican | Well Qualified | Young | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2 | 55.0 | White | Male | Republican | 0 | Qualified | 1982 | 1 | 0 | 0 | 1 | 0 | 0 |
3 | 51.0 | White | Male | Democrat | 1 | Well-Qual. | 1979 | 1 | 0 | 0 | 0 | 1 | 0 |
4 | 50.0 | White | Male | Republican | 0 | Well-Qual. | 1976 | 1 | 0 | 0 | 1 | 1 | 1 |
5 | 57.0 | Hispanic | Male | Republican | 0 | Qualified | 1982 | 0 | 0 | 0 | 1 | 0 | 0 |
10 | 48.0 | African American | Male | Democrat | 0 | Qualified | 1993 | 0 | 1 | 0 | 0 | 0 | 1 |
# Dataframe with the average fraction of judges with each personal attribute by year
year_personal = judges_personal.groupby("Year of Appointment")[["White","African American",
"Female","Republican","Well Qualified","Young"]].mean()
# Multiplying by 100 to provide percentage term interpretation
for name in list(year_personal):
year_personal[name] = 100*year_personal[name]
year_personal.head(n=15)
White | African American | Female | Republican | Well Qualified | Young | |
---|---|---|---|---|---|---|
Year of Appointment | ||||||
1957 | 100.000000 | 0.000000 | 0.000000 | 100.000000 | 46.153846 | 30.769231 |
1958 | 100.000000 | 0.000000 | 0.000000 | 90.909091 | 36.363636 | 27.272727 |
1959 | 100.000000 | 0.000000 | 0.000000 | 83.333333 | 50.000000 | 33.333333 |
1960 | 100.000000 | 0.000000 | 0.000000 | 100.000000 | 45.454545 | 54.545455 |
1961 | 95.081967 | 3.278689 | 0.000000 | 0.000000 | 47.540984 | 47.540984 |
1962 | 100.000000 | 0.000000 | 3.225806 | 29.032258 | 41.935484 | 29.032258 |
1963 | 100.000000 | 0.000000 | 0.000000 | 0.000000 | 66.666667 | 11.111111 |
1964 | 92.857143 | 7.142857 | 0.000000 | 0.000000 | 14.285714 | 64.285714 |
1965 | 94.736842 | 5.263158 | 0.000000 | 5.263158 | 52.631579 | 47.368421 |
1966 | 92.857143 | 4.761905 | 2.380952 | 7.142857 | 45.238095 | 47.619048 |
1967 | 86.666667 | 6.666667 | 0.000000 | 6.666667 | 43.333333 | 46.666667 |
1968 | 100.000000 | 0.000000 | 5.882353 | 5.882353 | 35.294118 | 41.176471 |
1969 | 78.571429 | 21.428571 | 0.000000 | 100.000000 | 28.571429 | 50.000000 |
1970 | 98.039216 | 0.000000 | 1.960784 | 98.039216 | 43.137255 | 60.784314 |
1971 | 96.428571 | 3.571429 | 0.000000 | 85.714286 | 50.000000 | 57.142857 |
This plot shows considerable variation over time in the proportion of judges with each of the personal attributes
fig, ax = plt.subplots(7,1,figsize=(11,8.5*7))
for counter,attribute in enumerate(list(year_personal)):
ax[counter].set_facecolor('white')
ax[counter].grid(False)
ax[counter].set_ylabel("Percentage")
ax[counter].set_xlabel("Year of Appointment")
ax[counter].set_yticks(range(0,100,10))
ax[counter].plot(list(year_personal.index),year_personal[attribute],"-o",label=attribute)
ax[counter].set_title(attribute)
# All the attributes in one plot (a bit overwhelming, but makes for comparison)
for attribute in list(year_personal):
ax[6].set_facecolor('white')
ax[6].grid(False)
ax[6].set_ylabel("Percentage")
ax[6].set_xlabel("Year of Appointment")
ax[6].set_yticks(range(0,100,10))
ax[6].plot(list(year_personal.index),year_personal[attribute],"-o",label=attribute)
ax[6].set_title("All Attributes")
ax[6].legend()
fig.tight_layout()
As the plot above shows, there variation in judge attributes over time. But do the changing attributes predict changing ideology?
Now we'll determine whether static personal attributes help explain rising judge absolute ideology.
# We'll add "P" to the varialbe names to refer to "personal" and distinguish them from the variables above
continuous_variablesP = ['Age When Appointed', 'Previous Position - slc', 'Previous Position - locct',
'Previous Position - sjdget', 'Previous Position - ausa', 'Previous Position - usa',
'Previous Position - sgo', 'Previous Position - sg', 'Previous Position - ago',
'Previous Position - ag', 'Previous Position - cc', 'Previous Position - sp',
'Previous Position - mag', 'Previous Position - bank', 'Previous Position - terr',
'Previous Position - cab', 'Previous Position - asatty', 'Previous Position - satty',
'Previous Position - cabdept', 'Previous Position - scab', 'Previous Position - scabdpt',
'Previous Position - aag', 'Previous Position - indreg1', 'Previous Position - reg1',
'Previous Position - reg2', 'Previous Position - reg3', 'Previous Position - house',
'Previous Position - senate', 'Previous Position - gov', 'Previous Position - ssenate',
'Previous Position - shouse', 'Previous Position - mayor', 'Previous Position - ccoun',
'Previous Position - ccom', 'Previous Position - ada', 'Previous Position - da',
'Previous Position - lother', 'Previous Position - lotherl', 'Previous Position - lawprof',
'Previous Position - private']
# Categorical variables
categoriesP = ['Judge Party','Gender','Race','ABA Rating']
# Using the fulldataset is equivalent to setting test_size = 0
X_fullP, X_empty_test, abs_ideo_fullP, abs_ideo_empty_train = prep_data(
judges_ideology,continuous_variablesP , categoriesP, "Absolute Ideology",test_size=0
)
# Fitted values
abs_ideo_hatP = forest_model.fit(X_fullP,abs_ideo_fullP).predict(X_fullP)
# Residuals
abs_ideo_residP = abs_ideo_fullP - abs_ideo_hatP
# Similar to above, creating dataframe with mean observed, residual and fitted values by year
judges_decompositionP = judges_ideology[["Year of Appointment","State","Absolute Ideology"]].copy()
judges_decompositionP["Residuals"] = abs_ideo_residP
judges_decompositionP["Fitted"] = abs_ideo_hatP
year_decompositionP = judges_decompositionP.groupby("Year of Appointment")[["Absolute Ideology","Residuals","Fitted"]].mean()
year_decompositionP.reset_index(inplace = True)
plt.style.use("fivethirtyeight")
fig, ax = plt.subplots(1,2,figsize=(22,8.5))
colors = ["#4135ed" ,"#5cb6cf"]
# Plotting trends in observed and fitted values
for counter,value in enumerate(["Absolute Ideology","Fitted"]):
ax[0].plot(year_decompositionP["Year of Appointment"],
year_decompositionP[value],"-o", color = colors[counter],label=value)
ax[1].scatter(year_decompositionP["Year of Appointment"],
year_decompositionP[value], color = colors[counter],label=value)
slope, intercept, r_value, p_value, std_err = stats.linregress(year_decompositionP["Year of Appointment"],year_decompositionP[value])
line = slope*year_decompositionP["Year of Appointment"]+intercept
ax[1].plot(year_decompositionP["Year of Appointment"], line,color=colors[counter],label="_")
ax[0].set_title("Are Judge Personal Attributes Driving Rising Absolute Ideology?")
ax[1].set_title("...Personal Attributes Do not Predict Rising Absolute Ideology")
for n in [0,1]:
ax[n].set_facecolor('white')
ax[n].grid(False)
ax[n].set_ylabel("Yearly Mean")
ax[n].set_xlabel("Year of Judge Appointment")
ax[n].legend()
#ax[n].set_yticks(range(0,40,5))
fig.tight_layout()
The meaning behind this chart is that the shifting of judges' static personal attributes over time does not explain the rise in absolute ideology. It is interest how similar this chart is to the the chart above, which included dynamic attributes of judges (including year of appointment, appointing president, etc.). The chart may beg the question: how much does adding dynamic attributes really improve the predictive power of the random forest model? Comparing the the MSE's of the random forest model with and without dynamic attributes (see below), it is clear the dynamic attributes do add predictive power. That said, the charts, taken together, suggest there are unobserved forces behind the rising absolute ideology of US judges
# All judge attributes
full_mse = metrics.mean_squared_error(abs_ideo_full,
forest_model.fit(X_full,abs_ideo_full).predict(X_full))
# Only including static personal attributes
full_mseP = metrics.mean_squared_error(abs_ideo_fullP,
forest_model.fit(X_fullP,abs_ideo_fullP).predict(X_fullP))
print(f"MSE with all Attributes: {full_mse}")
print(f"MSE with only Static Personal Attributes: {full_mseP}")
MSE with all Attributes: 10.762745067579159 MSE with only Static Personal Attributes: 53.242898266036356
We'll estimate the influence of judge political experience on judge ideology
Are judges with past experience as elected officials more ideological?
We'll estimate regressions of the form
$$Y = \beta Politician + f(x) + \epsilon $$where $Y$ is ideology or absolute ideology, $Politician$ is an indicator for past politican experience, and $f(x)$ is the nuisance function for the controls (judge attributes)
# Creating a dataframe which is ready for regressions/partial regressions
# Setting continuous variables for this analysis (the categories are the same as the ones above)
continuous_variables2 = ["Ideology Score","Absolute Ideology","Politician",
'Previous Position - house', 'Previous Position - senate',
'Previous Position - gov','Previous Position - ssenate',
'Previous Position - shouse','Previous Position - mayor',
'Previous Position - ccoun','House Democrats','House Republicans',
'Senate Democrats', 'Senate Republicans','House Independents','Senate Independents']
political_judges = judges_ideology[continuous_variables2]
political_judges.reset_index(inplace = True)
political_judges = political_judges.drop(["index"],axis=1)
political_judges.head()
Ideology Score | Absolute Ideology | Politician | Previous Position - house | Previous Position - senate | Previous Position - gov | Previous Position - ssenate | Previous Position - shouse | Previous Position - mayor | Previous Position - ccoun | House Democrats | House Republicans | Senate Democrats | Senate Republicans | House Independents | Senate Independents | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | 40.700001 | 40.700001 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 243 | 192 | 47 | 53 | 0 | 0 |
1 | -30.599999 | 30.599999 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 277 | 158 | 59 | 41 | 0 | 0 |
2 | 6.100000 | 6.100000 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 291 | 144 | 61 | 38 | 0 | 0 |
3 | 53.799999 | 53.799999 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 243 | 192 | 47 | 53 | 0 | 0 |
4 | -22.600000 | 22.600000 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 258 | 176 | 57 | 43 | 1 | 0 |
#Creating indicator variables for all categorical variables
ohe = preprocessing.OneHotEncoder(sparse=False)
#OneHotEncoder creates a numpy array which we have to convert to a dataframe.
political_judges_dummies = pd.DataFrame.from_records(ohe.fit_transform(judges_ideology[categories]))
#From the array, we have no meaningful variable/column names.
#Nonetheless, we are not particularly interested in which of these indicator variables
#have predictive power, so we'll just name them numerically
dummy_columns = ["dummy" + str(i) for i in range(654)]
political_judges_dummies.columns = dummy_columns
political_judges_dummies.head(n=10)
dummy0 | dummy1 | dummy2 | dummy3 | dummy4 | dummy5 | dummy6 | dummy7 | dummy8 | dummy9 | ... | dummy644 | dummy645 | dummy646 | dummy647 | dummy648 | dummy649 | dummy650 | dummy651 | dummy652 | dummy653 | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | ... | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 |
1 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | ... | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 |
2 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | ... | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 |
3 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | ... | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 |
4 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | ... | 1.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 |
5 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | ... | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 |
6 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | ... | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 |
7 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | ... | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 |
8 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | ... | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 |
9 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | ... | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 |
10 rows × 654 columns
#Combining the dataframes with the continuous and indicator variables
political_judges = pd.concat([political_judges, political_judges_dummies],axis=1)
political_judges.head()
Ideology Score | Absolute Ideology | Politician | Previous Position - house | Previous Position - senate | Previous Position - gov | Previous Position - ssenate | Previous Position - shouse | Previous Position - mayor | Previous Position - ccoun | ... | dummy644 | dummy645 | dummy646 | dummy647 | dummy648 | dummy649 | dummy650 | dummy651 | dummy652 | dummy653 | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | 40.700001 | 40.700001 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | ... | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 |
1 | -30.599999 | 30.599999 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | ... | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 |
2 | 6.100000 | 6.100000 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | ... | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 |
3 | 53.799999 | 53.799999 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | ... | 0.0 | 0.0 | 1.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 |
4 | -22.600000 | 22.600000 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | ... | 1.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 1.0 | 0.0 |
5 rows × 670 columns
First, we'll run the OLS regression. We have hundreds of dummy variables, and including them manually in the regression would be tedious.
def list_to_formula(var_list):
"""
Given a list of variable names: var1, var2, ... varN,
Output single string: + var1 + var2 + ... + varN
"""
output = ""
for var in var_list:
output = output + " + " + var
return output
To include variables with spaces in their name in the regression, we need to rely on patsy and put them in the form Q('variable name')
congress_composition = ['House Democrats','House Republicans','Senate Democrats',
'Senate Republicans','House Independents','Senate Independents',]
congress_composition_Q = ["Q('" + val + "')" for val in congress_composition]
composition_formula = list_to_formula(congress_composition_Q)
# We'll also make a formula for the dummy variables
dummies_formula = list_to_formula(dummy_columns)
# Estimating three variations of the model (adding controls)
lm_ideo = list()
lm_ideo.append(smf.ols(formula="Q('Ideology Score') ~ Politician", data=political_judges,
missing="drop").fit(cov_type='HC0'))
lm_ideo.append(smf.ols(formula="Q('Ideology Score') ~ Politician" + composition_formula
,data=political_judges,
missing="drop").fit(cov_type='HC0'))
lm_ideo.append(smf.ols(formula="Q('Ideology Score') ~ Politician" + composition_formula + dummies_formula
,data=political_judges,
missing="drop").fit(cov_type='HC0'))
# Notably, the inclusion of the dummies (important controls) flipped the sign of the Politician coefficient!
summary_col(lm_ideo, stars=True)
C:\Users\Ian\Anaconda3\lib\site-packages\statsmodels\base\model.py:1100: RuntimeWarning: invalid value encountered in true_divide C:\Users\Ian\Anaconda3\lib\site-packages\scipy\stats\_distn_infrastructure.py:879: RuntimeWarning: invalid value encountered in greater C:\Users\Ian\Anaconda3\lib\site-packages\scipy\stats\_distn_infrastructure.py:879: RuntimeWarning: invalid value encountered in less C:\Users\Ian\Anaconda3\lib\site-packages\scipy\stats\_distn_infrastructure.py:1821: RuntimeWarning: invalid value encountered in less_equal
Q('Ideology Score') I | Q('Ideology Score') II | Q('Ideology Score') III | |
---|---|---|---|
Intercept | -1.5510* | 1104.0585*** | 0.2721 |
(0.9003) | (97.9475) | (0.2390) | |
Politician | -1.7957 | -1.2555 | 1.7023 |
(2.6717) | (2.3194) | (1.3807) | |
Q('House Democrats') | -0.6835*** | 0.1280 | |
(0.0965) | (0.1688) | ||
Q('House Independents') | -19.0197*** | 1.6115 | |
(2.0924) | (1.7263) | ||
Q('House Republicans') | -1.1714*** | 0.0014 | |
(0.1111) | (0.1310) | ||
Q('Senate Democrats') | -8.3880*** | -0.4918 | |
(0.8194) | (0.7375) | ||
Q('Senate Independents') | 0.0000 | -0.0000*** | |
(0.0000) | (0.0000) | ||
Q('Senate Republicans') | -5.6559*** | -0.1453 | |
(0.8063) | (0.6026) | ||
dummy0 | 8.7967** | ||
(3.7420) | |||
dummy1 | -0.0369 | ||
(3.8463) | |||
dummy10 | -1.1470 | ||
(4.2688) | |||
dummy100 | -4.6980* | ||
(2.7500) | |||
dummy101 | -1.9303 | ||
(3.1707) | |||
dummy102 | -5.7876* | ||
(3.0750) | |||
dummy103 | 2.3233 | ||
(3.5053) | |||
dummy104 | -3.3165 | ||
(4.0422) | |||
dummy105 | 17.5145** | ||
(6.8378) | |||
dummy106 | -0.9921 | ||
(9.5944) | |||
dummy107 | 1.9969 | ||
(11.7381) | |||
dummy108 | 10.4009 | ||
(6.3372) | |||
dummy109 | -19.5423*** | ||
(5.5514) | |||
dummy11 | 2.9343 | ||
(4.5257) | |||
dummy110 | 6.0855 | ||
(6.4821) | |||
dummy111 | -9.9288** | ||
(4.4182) | |||
dummy112 | -7.5253 | ||
(4.6335) | |||
dummy113 | 9.7864* | ||
(5.2479) | |||
dummy114 | -13.4855** | ||
(6.1765) | |||
dummy115 | -0.7765 | ||
(4.6326) | |||
dummy116 | -3.0026 | ||
(4.7719) | |||
dummy117 | -7.8867 | ||
(11.9506) | |||
dummy118 | 31.4442*** | ||
(6.1735) | |||
dummy119 | -18.3352* | ||
(10.5789) | |||
dummy12 | -0.8658 | ||
(5.1134) | |||
dummy120 | -5.5570 | ||
(10.2223) | |||
dummy121 | -9.1042 | ||
(9.7097) | |||
dummy122 | -11.5992 | ||
(10.3419) | |||
dummy123 | -6.3014 | ||
(9.8715) | |||
dummy124 | -13.3211 | ||
(8.8126) | |||
dummy125 | -7.1113 | ||
(8.6018) | |||
dummy126 | -5.8065 | ||
(7.4119) | |||
dummy127 | -9.7170 | ||
(7.3515) | |||
dummy128 | -3.8444 | ||
(7.6122) | |||
dummy129 | -5.2870 | ||
(7.3320) | |||
dummy13 | 3.5937 | ||
(2.7451) | |||
dummy130 | -2.6094 | ||
(7.8713) | |||
dummy131 | -4.1731 | ||
(5.4239) | |||
dummy132 | -1.9242 | ||
(5.8575) | |||
dummy133 | 0.2204 | ||
(6.0428) | |||
dummy134 | -0.9136 | ||
(6.0709) | |||
dummy135 | 0.0339 | ||
(5.8066) | |||
dummy136 | -0.5035 | ||
(5.9959) | |||
dummy137 | -7.4833 | ||
(6.3546) | |||
dummy138 | 0.6194 | ||
(5.5878) | |||
dummy139 | 11.4150* | ||
(5.9032) | |||
dummy14 | 3.1949 | ||
(3.7280) | |||
dummy140 | 13.6382** | ||
(6.3596) | |||
dummy141 | 14.2125** | ||
(6.1565) | |||
dummy142 | 10.4685* | ||
(6.2908) | |||
dummy143 | 11.5950 | ||
(8.3517) | |||
dummy144 | 6.4311 | ||
(7.9468) | |||
dummy145 | 3.6622 | ||
(8.1888) | |||
dummy146 | 10.1283 | ||
(7.8284) | |||
dummy147 | 8.0675 | ||
(8.1445) | |||
dummy148 | 3.7101 | ||
(7.6514) | |||
dummy149 | 7.6706 | ||
(8.4660) | |||
dummy15 | -9.4974** | ||
(3.8107) | |||
dummy150 | 10.7789 | ||
(8.4014) | |||
dummy151 | 6.4112* | ||
(3.4001) | |||
dummy152 | 3.4347 | ||
(2.4889) | |||
dummy153 | -4.3919* | ||
(2.5531) | |||
dummy154 | -4.3234 | ||
(2.7687) | |||
dummy155 | 1.4563 | ||
(3.4563) | |||
dummy156 | -0.5372 | ||
(1.0422) | |||
dummy157 | 1.8496 | ||
(1.1327) | |||
dummy158 | -1.0404 | ||
(0.9824) | |||
dummy159 | -3.7862** | ||
(1.5446) | |||
dummy16 | -5.6631 | ||
(4.0456) | |||
dummy160 | 4.0583** | ||
(1.5922) | |||
dummy161 | 3.4690 | ||
(2.1754) | |||
dummy162 | 0.7287 | ||
(1.3608) | |||
dummy163 | -3.9257 | ||
(2.6656) | |||
dummy164 | -0.5233 | ||
(1.6872) | |||
dummy165 | -4.1429*** | ||
(0.8433) | |||
dummy166 | -4.5336*** | ||
(0.9652) | |||
dummy167 | 4.7151*** | ||
(0.8738) | |||
dummy168 | 12.3001*** | ||
(4.7047) | |||
dummy169 | 7.2354 | ||
(8.6868) | |||
dummy17 | 1.2163 | ||
(3.7234) | |||
dummy170 | -4.0123*** | ||
(1.2763) | |||
dummy171 | 4.1244 | ||
(3.5341) | |||
dummy172 | -0.0715 | ||
(3.8402) | |||
dummy173 | -10.2511** | ||
(4.5434) | |||
dummy174 | -0.8886 | ||
(4.9509) | |||
dummy175 | -3.6797 | ||
(2.2932) | |||
dummy176 | 10.9769*** | ||
(1.4227) | |||
dummy177 | -7.4852*** | ||
(1.3076) | |||
dummy178 | -7.6521*** | ||
(2.5755) | |||
dummy179 | -4.0551 | ||
(4.2138) | |||
dummy18 | 4.3238 | ||
(4.3833) | |||
dummy180 | -4.7883 | ||
(3.7952) | |||
dummy181 | -3.4087 | ||
(4.1263) | |||
dummy182 | 1.7371 | ||
(4.9830) | |||
dummy183 | 3.2066 | ||
(3.1929) | |||
dummy184 | 11.7408*** | ||
(1.3654) | |||
dummy185 | -16.8089*** | ||
(2.3415) | |||
dummy186 | 17.0810*** | ||
(2.1398) | |||
dummy187 | -5.2663 | ||
(7.3216) | |||
dummy188 | -9.1071 | ||
(5.8309) | |||
dummy189 | 1.1305 | ||
(2.4878) | |||
dummy19 | 2.1161 | ||
(3.9920) | |||
dummy190 | 7.9892 | ||
(6.8100) | |||
dummy191 | -7.4433 | ||
(8.2294) | |||
dummy192 | -9.9288** | ||
(4.4182) | |||
dummy193 | 3.0463 | ||
(7.1166) | |||
dummy194 | 2.2611 | ||
(3.3827) | |||
dummy195 | 6.2929* | ||
(3.2970) | |||
dummy196 | 9.8684 | ||
(8.8895) | |||
dummy197 | 1.4292 | ||
(5.6290) | |||
dummy198 | 1.4563 | ||
(3.4563) | |||
dummy199 | -1.9885 | ||
(2.0741) | |||
dummy2 | -3.0521 | ||
(4.1707) | |||
dummy20 | 1.0100 | ||
(2.5092) | |||
dummy200 | -0.9180 | ||
(2.0581) | |||
dummy201 | 6.8607 | ||
(6.1660) | |||
dummy202 | -3.1516 | ||
(2.4769) | |||
dummy203 | -1.9868 | ||
(1.9241) | |||
dummy204 | -0.7108 | ||
(0.9801) | |||
dummy205 | -4.6094** | ||
(2.3196) | |||
dummy206 | 6.4591** | ||
(2.9783) | |||
dummy207 | -0.8668 | ||
(0.9982) | |||
dummy208 | 7.1559 | ||
(5.0434) | |||
dummy209 | -4.4056 | ||
(4.4356) | |||
dummy21 | -1.9124 | ||
(1.9682) | |||
dummy210 | -5.6649* | ||
(3.2355) | |||
dummy211 | -4.6817** | ||
(2.2299) | |||
dummy212 | -0.2894 | ||
(4.0560) | |||
dummy213 | -2.4509 | ||
(7.8373) | |||
dummy214 | 0.6741 | ||
(3.8056) | |||
dummy215 | 17.9901*** | ||
(5.9006) | |||
dummy216 | 0.2086 | ||
(2.7786) | |||
dummy217 | 1.0876 | ||
(3.0303) | |||
dummy218 | -9.3517*** | ||
(3.3120) | |||
dummy219 | 3.2460 | ||
(4.2555) | |||
dummy22 | -1.3361 | ||
(1.1534) | |||
dummy220 | -6.6719 | ||
(4.8207) | |||
dummy221 | 4.6131 | ||
(2.9681) | |||
dummy222 | 12.4860*** | ||
(4.1160) | |||
dummy223 | -6.6960 | ||
(4.9586) | |||
dummy224 | 12.2189*** | ||
(3.2413) | |||
dummy225 | 6.8951*** | ||
(1.5693) | |||
dummy226 | -3.6797 | ||
(2.2932) | |||
dummy227 | 0.6102 | ||
(1.4839) | |||
dummy228 | 0.0140 | ||
(5.0147) | |||
dummy229 | 6.2532 | ||
(4.4699) | |||
dummy23 | -5.2467*** | ||
(1.4200) | |||
dummy230 | 3.5739 | ||
(2.5900) | |||
dummy231 | 3.5312 | ||
(2.9900) | |||
dummy232 | -0.1648 | ||
(1.9048) | |||
dummy233 | -2.1517 | ||
(2.5109) | |||
dummy234 | -10.8289*** | ||
(4.1857) | |||
dummy235 | 0.0078 | ||
(3.6668) | |||
dummy236 | 0.6876 | ||
(7.4878) | |||
dummy237 | 9.2045* | ||
(4.7573) | |||
dummy238 | -17.1121*** | ||
(1.7407) | |||
dummy239 | -26.5891*** | ||
(3.0268) | |||
dummy24 | 0.2346 | ||
(2.1488) | |||
dummy240 | 10.6258*** | ||
(2.8647) | |||
dummy241 | -4.4839 | ||
(7.7310) | |||
dummy242 | -17.3136*** | ||
(3.3071) | |||
dummy243 | -10.0575** | ||
(4.9978) | |||
dummy244 | -5.7316 | ||
(3.9979) | |||
dummy245 | 4.3360 | ||
(3.1388) | |||
dummy246 | 7.3671** | ||
(2.9559) | |||
dummy247 | 6.9638*** | ||
(2.6359) | |||
dummy248 | 3.5736** | ||
(1.4697) | |||
dummy249 | 5.4026*** | ||
(1.6004) | |||
dummy25 | 0.9002 | ||
(2.6636) | |||
dummy250 | 5.0520 | ||
(3.2367) | |||
dummy251 | -4.1985** | ||
(1.6942) | |||
dummy252 | 14.1206*** | ||
(1.9928) | |||
dummy253 | -9.8526*** | ||
(3.1759) | |||
dummy254 | -3.2511 | ||
(8.0455) | |||
dummy255 | 15.9338*** | ||
(5.1602) | |||
dummy256 | -7.2678** | ||
(3.6472) | |||
dummy257 | -10.5464*** | ||
(1.9751) | |||
dummy258 | 5.7447** | ||
(2.3233) | |||
dummy259 | -3.3553 | ||
(2.3751) | |||
dummy26 | -3.6120 | ||
(2.3442) | |||
dummy260 | 9.6232*** | ||
(2.0675) | |||
dummy261 | -7.5953** | ||
(3.5110) | |||
dummy262 | -2.8688 | ||
(7.8672) | |||
dummy263 | -3.4058 | ||
(4.4332) | |||
dummy264 | 3.4029 | ||
(3.0722) | |||
dummy265 | -6.8395*** | ||
(1.7804) | |||
dummy266 | 5.7056** | ||
(2.2922) | |||
dummy267 | 1.5285 | ||
(4.2729) | |||
dummy268 | 1.8549 | ||
(2.3850) | |||
dummy269 | -1.6958 | ||
(2.5497) | |||
dummy27 | -3.3694 | ||
(2.1373) | |||
dummy270 | 8.0533** | ||
(4.0703) | |||
dummy271 | 7.5014 | ||
(6.7868) | |||
dummy272 | 19.4654*** | ||
(5.1904) | |||
dummy273 | 21.6003*** | ||
(4.4351) | |||
dummy274 | -4.4661 | ||
(3.2156) | |||
dummy275 | 4.9154 | ||
(3.3706) | |||
dummy276 | -18.9998*** | ||
(3.5037) | |||
dummy277 | -2.7152 | ||
(5.8503) | |||
dummy278 | 15.2088*** | ||
(3.4991) | |||
dummy279 | -3.9430 | ||
(3.4265) | |||
dummy28 | 4.7642** | ||
(2.0936) | |||
dummy280 | -5.6398 | ||
(6.1219) | |||
dummy281 | 15.1035*** | ||
(4.2584) | |||
dummy282 | 18.3772*** | ||
(4.1669) | |||
dummy283 | 6.7625** | ||
(3.1524) | |||
dummy284 | 4.5147 | ||
(4.9661) | |||
dummy285 | 9.5966 | ||
(6.4257) | |||
dummy286 | -17.3908*** | ||
(3.5005) | |||
dummy287 | -1.5385 | ||
(7.5209) | |||
dummy288 | -7.1155 | ||
(4.7038) | |||
dummy289 | -5.7997 | ||
(5.3299) | |||
dummy29 | 1.8111 | ||
(2.3425) | |||
dummy290 | 7.1701 | ||
(8.9730) | |||
dummy291 | 6.5339 | ||
(3.9824) | |||
dummy292 | 6.2221 | ||
(6.9625) | |||
dummy293 | 11.7746*** | ||
(4.0391) | |||
dummy294 | -14.3543*** | ||
(4.2420) | |||
dummy295 | 14.1530*** | ||
(5.2299) | |||
dummy296 | 3.2124 | ||
(3.6172) | |||
dummy297 | 3.1154 | ||
(4.1786) | |||
dummy298 | -11.9731** | ||
(5.6521) | |||
dummy299 | -4.7150 | ||
(3.5081) | |||
dummy3 | -3.7640 | ||
(3.6813) | |||
dummy30 | 5.0257** | ||
(2.1880) | |||
dummy300 | 13.7939*** | ||
(4.3690) | |||
dummy301 | -15.9828*** | ||
(5.6963) | |||
dummy302 | -7.3127 | ||
(4.8460) | |||
dummy303 | -13.0963 | ||
(9.2860) | |||
dummy304 | 13.5245*** | ||
(4.7082) | |||
dummy305 | 3.8920 | ||
(2.8787) | |||
dummy306 | -6.1462 | ||
(5.7970) | |||
dummy307 | 1.5683 | ||
(8.1445) | |||
dummy308 | 6.8236 | ||
(4.7797) | |||
dummy309 | 15.3185*** | ||
(4.9946) | |||
dummy31 | 5.9864*** | ||
(2.1395) | |||
dummy310 | 3.5549 | ||
(3.4142) | |||
dummy311 | -1.1376 | ||
(4.1012) | |||
dummy312 | 10.7592*** | ||
(4.1563) | |||
dummy313 | 9.4957* | ||
(5.1559) | |||
dummy314 | 3.3027 | ||
(5.2967) | |||
dummy315 | 7.0640 | ||
(7.4118) | |||
dummy316 | -3.6254 | ||
(5.1766) | |||
dummy317 | -2.0559 | ||
(5.9199) | |||
dummy318 | -5.4699 | ||
(3.7069) | |||
dummy319 | 21.4562*** | ||
(5.4698) | |||
dummy32 | 5.7526 | ||
(3.6297) | |||
dummy320 | -0.5898 | ||
(4.1564) | |||
dummy321 | -0.8469 | ||
(11.5136) | |||
dummy322 | -14.5756** | ||
(5.8370) | |||
dummy323 | 6.7810** | ||
(3.1449) | |||
dummy324 | -23.9845*** | ||
(3.8421) | |||
dummy325 | 5.5875 | ||
(4.4789) | |||
dummy326 | 3.6916 | ||
(3.7018) | |||
dummy327 | -3.7694 | ||
(5.4603) | |||
dummy328 | -8.2148** | ||
(3.3367) | |||
dummy329 | 9.7746** | ||
(4.2309) | |||
dummy33 | 0.9318 | ||
(2.0736) | |||
dummy330 | -12.6646*** | ||
(3.0446) | |||
dummy331 | -4.6089 | ||
(3.4829) | |||
dummy332 | -10.9900 | ||
(7.0238) | |||
dummy333 | 0.0816 | ||
(3.9883) | |||
dummy334 | 9.1920* | ||
(4.7895) | |||
dummy335 | -17.6920*** | ||
(4.4690) | |||
dummy336 | -5.9318* | ||
(3.3641) | |||
dummy337 | 9.2032** | ||
(4.6882) | |||
dummy338 | -5.3373 | ||
(4.3071) | |||
dummy339 | -4.8045 | ||
(4.9293) | |||
dummy34 | 2.1250 | ||
(1.9225) | |||
dummy340 | -3.0268 | ||
(7.3783) | |||
dummy341 | -15.0397*** | ||
(4.3582) | |||
dummy342 | -16.1006* | ||
(8.6063) | |||
dummy343 | -0.3655 | ||
(4.1502) | |||
dummy344 | -7.1911* | ||
(4.0435) | |||
dummy345 | 9.7733 | ||
(7.0624) | |||
dummy346 | -10.8935** | ||
(4.4765) | |||
dummy347 | -11.1486*** | ||
(4.1854) | |||
dummy348 | -0.8986 | ||
(4.3756) | |||
dummy349 | 6.1382** | ||
(2.9461) | |||
dummy35 | 2.1675 | ||
(1.9108) | |||
dummy350 | 12.5192** | ||
(5.7356) | |||
dummy351 | 7.1765 | ||
(15.1418) | |||
dummy352 | -2.3682 | ||
(5.6244) | |||
dummy353 | 6.6519 | ||
(8.0737) | |||
dummy354 | -0.0322 | ||
(5.4897) | |||
dummy355 | 14.5359*** | ||
(4.7493) | |||
dummy356 | 15.2444** | ||
(6.3504) | |||
dummy357 | -4.1917 | ||
(3.5369) | |||
dummy358 | 4.4844 | ||
(3.5971) | |||
dummy359 | 7.6692* | ||
(3.9898) | |||
dummy36 | 8.6596** | ||
(3.7123) | |||
dummy360 | 7.6590** | ||
(3.7645) | |||
dummy361 | -14.4226*** | ||
(3.8188) | |||
dummy362 | -10.8634* | ||
(6.0335) | |||
dummy363 | 3.9631 | ||
(3.5788) | |||
dummy364 | -17.7174*** | ||
(6.2666) | |||
dummy365 | 12.7404*** | ||
(4.5300) | |||
dummy366 | -6.3428 | ||
(5.4220) | |||
dummy367 | -1.6282 | ||
(4.3374) | |||
dummy368 | 7.8399 | ||
(6.4957) | |||
dummy369 | 2.4152 | ||
(3.7364) | |||
dummy37 | 2.5703 | ||
(3.6142) | |||
dummy370 | 3.5736** | ||
(1.4697) | |||
dummy371 | 3.7924 | ||
(3.6840) | |||
dummy372 | -12.4783** | ||
(5.5103) | |||
dummy373 | -5.3802 | ||
(5.1384) | |||
dummy374 | -9.8013 | ||
(6.0573) | |||
dummy375 | -5.2865 | ||
(4.9785) | |||
dummy376 | -2.1143 | ||
(3.6503) | |||
dummy377 | -16.7350* | ||
(9.5173) | |||
dummy378 | -11.3366** | ||
(4.9506) | |||
dummy379 | 14.0267*** | ||
(4.8719) | |||
dummy38 | -1.4043 | ||
(2.4957) | |||
dummy380 | 0.4852 | ||
(6.2261) | |||
dummy381 | 0.7330 | ||
(5.9158) | |||
dummy382 | 3.8603 | ||
(3.0713) | |||
dummy383 | 1.9860 | ||
(4.2464) | |||
dummy384 | 7.2767** | ||
(2.9963) | |||
dummy385 | 7.8048** | ||
(3.5513) | |||
dummy386 | 0.4082 | ||
(3.4683) | |||
dummy387 | 11.3003*** | ||
(3.5856) | |||
dummy388 | -1.5601 | ||
(4.2745) | |||
dummy389 | -23.1150*** | ||
(5.4526) | |||
dummy39 | -1.5420 | ||
(3.7713) | |||
dummy390 | -2.2470 | ||
(3.6606) | |||
dummy391 | 8.2434** | ||
(3.4417) | |||
dummy392 | -3.0284 | ||
(5.3246) | |||
dummy393 | -2.6062 | ||
(5.2902) | |||
dummy394 | 15.2713*** | ||
(5.9067) | |||
dummy395 | -10.8257 | ||
(6.9036) | |||
dummy396 | 1.3474 | ||
(4.9475) | |||
dummy397 | -2.9621 | ||
(6.1987) | |||
dummy398 | -2.3480 | ||
(11.1037) | |||
dummy399 | -6.2589 | ||
(5.6353) | |||
dummy4 | -1.1739 | ||
(4.1572) | |||
dummy40 | -4.1140* | ||
(2.4417) | |||
dummy400 | -3.3352 | ||
(4.3513) | |||
dummy401 | -4.6124 | ||
(4.3483) | |||
dummy402 | 1.8204 | ||
(7.9635) | |||
dummy403 | 14.2683*** | ||
(4.5575) | |||
dummy404 | -0.2359 | ||
(4.5309) | |||
dummy405 | 6.7223 | ||
(4.1368) | |||
dummy406 | 0.5605 | ||
(5.8882) | |||
dummy407 | -9.3385** | ||
(4.4611) | |||
dummy408 | 7.8569 | ||
(5.7116) | |||
dummy409 | -16.3954* | ||
(9.7592) | |||
dummy41 | -6.7474*** | ||
(2.5459) | |||
dummy410 | 7.0406 | ||
(7.7717) | |||
dummy411 | -15.9480* | ||
(8.3399) | |||
dummy412 | -24.3049*** | ||
(5.7855) | |||
dummy413 | 0.6980 | ||
(5.9017) | |||
dummy414 | 5.7837 | ||
(5.4810) | |||
dummy415 | 7.8803 | ||
(6.4238) | |||
dummy416 | 6.0823 | ||
(4.1530) | |||
dummy417 | 11.8385*** | ||
(4.5281) | |||
dummy418 | 5.1123 | ||
(4.6065) | |||
dummy419 | 1.4515 | ||
(5.6966) | |||
dummy42 | -3.1082 | ||
(4.5038) | |||
dummy420 | 1.4760 | ||
(3.3227) | |||
dummy421 | 8.3586** | ||
(4.0839) | |||
dummy422 | -4.9963 | ||
(7.1252) | |||
dummy423 | 12.0555** | ||
(4.9572) | |||
dummy424 | 1.8917 | ||
(4.9172) | |||
dummy425 | -1.9453 | ||
(3.8372) | |||
dummy426 | -0.3802 | ||
(6.0758) | |||
dummy427 | -9.4888** | ||
(3.9174) | |||
dummy428 | 19.9580*** | ||
(4.5775) | |||
dummy429 | 5.7913* | ||
(3.2975) | |||
dummy43 | -1.9662 | ||
(3.5086) | |||
dummy430 | 0.6930 | ||
(10.2301) | |||
dummy431 | -9.5484* | ||
(5.6990) | |||
dummy432 | -10.3726 | ||
(6.7353) | |||
dummy433 | 12.1183** | ||
(5.7003) | |||
dummy434 | 16.7427*** | ||
(3.6884) | |||
dummy435 | -1.0455 | ||
(3.5571) | |||
dummy436 | -5.2088 | ||
(4.6798) | |||
dummy437 | 6.5098* | ||
(3.3509) | |||
dummy438 | 3.5739 | ||
(2.5900) | |||
dummy439 | 0.2014 | ||
(4.3209) | |||
dummy44 | 34.2379*** | ||
(7.5193) | |||
dummy440 | -2.1684 | ||
(3.9514) | |||
dummy441 | -4.7824 | ||
(2.9452) | |||
dummy442 | 1.9981 | ||
(5.1465) | |||
dummy443 | -1.7089 | ||
(4.3213) | |||
dummy444 | 3.0757 | ||
(5.6434) | |||
dummy445 | -1.7701 | ||
(6.8206) | |||
dummy446 | 18.2421*** | ||
(4.9978) | |||
dummy447 | -2.0103 | ||
(3.9112) | |||
dummy448 | 12.9791** | ||
(6.1422) | |||
dummy449 | -4.0911 | ||
(5.1245) | |||
dummy45 | 14.0267*** | ||
(4.8719) | |||
dummy450 | 0.6408 | ||
(8.5719) | |||
dummy451 | 3.4153 | ||
(4.7031) | |||
dummy452 | 1.9866 | ||
(9.1235) | |||
dummy453 | -2.4247 | ||
(3.0632) | |||
dummy454 | 2.1433 | ||
(4.6806) | |||
dummy455 | -5.1416 | ||
(9.3754) | |||
dummy456 | -0.0678 | ||
(7.9316) | |||
dummy457 | 0.9670 | ||
(5.7113) | |||
dummy458 | 5.1056 | ||
(3.4627) | |||
dummy459 | -3.0527 | ||
(4.3563) | |||
dummy46 | 10.9358 | ||
(10.7678) | |||
dummy460 | -3.8676 | ||
(3.9662) | |||
dummy461 | 15.6608*** | ||
(5.2432) | |||
dummy462 | 23.0434*** | ||
(5.3387) | |||
dummy463 | 1.5220 | ||
(4.6595) | |||
dummy464 | 8.7034** | ||
(4.2479) | |||
dummy465 | 3.8625 | ||
(2.9343) | |||
dummy466 | -1.1554 | ||
(3.4492) | |||
dummy467 | -0.1210 | ||
(3.7358) | |||
dummy468 | -0.0180 | ||
(2.8485) | |||
dummy469 | -2.3650 | ||
(4.6080) | |||
dummy47 | -0.1514 | ||
(5.3139) | |||
dummy470 | -20.1997*** | ||
(6.1371) | |||
dummy471 | 7.0438 | ||
(5.9070) | |||
dummy472 | -1.6665 | ||
(2.8369) | |||
dummy473 | -1.8597 | ||
(5.0367) | |||
dummy474 | 14.1180** | ||
(5.5139) | |||
dummy475 | -9.1918 | ||
(7.1790) | |||
dummy476 | 2.1449 | ||
(6.3920) | |||
dummy477 | 5.6092 | ||
(4.7690) | |||
dummy478 | -0.6252 | ||
(7.6922) | |||
dummy479 | -2.8064 | ||
(5.3254) | |||
dummy48 | 4.1099 | ||
(5.8874) | |||
dummy480 | -1.9041 | ||
(4.8482) | |||
dummy481 | 3.9452 | ||
(4.4426) | |||
dummy482 | 2.3164 | ||
(3.2896) | |||
dummy483 | -1.5810 | ||
(3.3990) | |||
dummy484 | 6.5058 | ||
(5.0240) | |||
dummy485 | 3.7401 | ||
(4.1279) | |||
dummy486 | 5.7524 | ||
(5.2189) | |||
dummy487 | 6.5459 | ||
(5.6107) | |||
dummy488 | -0.9054 | ||
(4.3458) | |||
dummy489 | 6.9959 | ||
(5.4722) | |||
dummy49 | -17.4737*** | ||
(5.9811) | |||
dummy490 | 6.9003 | ||
(4.7611) | |||
dummy491 | -5.2678 | ||
(4.2163) | |||
dummy492 | -1.0742 | ||
(4.3120) | |||
dummy493 | 4.8106 | ||
(3.4031) | |||
dummy494 | 17.1415*** | ||
(4.4331) | |||
dummy495 | -21.7882*** | ||
(4.3814) | |||
dummy496 | -1.4431 | ||
(3.4466) | |||
dummy497 | -1.9043 | ||
(3.1232) | |||
dummy498 | -0.1364 | ||
(3.6322) | |||
dummy499 | -13.2930** | ||
(5.3178) | |||
dummy5 | 1.8951 | ||
(5.3856) | |||
dummy50 | -4.9570 | ||
(5.4230) | |||
dummy500 | 1.0058 | ||
(5.1767) | |||
dummy501 | 5.2136 | ||
(5.5283) | |||
dummy502 | -2.5258 | ||
(4.2479) | |||
dummy503 | 3.3815 | ||
(4.7629) | |||
dummy504 | 0.6834 | ||
(5.8196) | |||
dummy505 | -21.2526*** | ||
(6.5488) | |||
dummy506 | -6.5589 | ||
(5.8819) | |||
dummy507 | -1.7164 | ||
(4.9732) | |||
dummy508 | -17.6426*** | ||
(4.6486) | |||
dummy509 | -2.7452 | ||
(4.3164) | |||
dummy51 | 9.5014 | ||
(9.8113) | |||
dummy510 | 2.7627 | ||
(3.3056) | |||
dummy511 | 1.1501 | ||
(3.4367) | |||
dummy512 | -10.0008*** | ||
(3.3426) | |||
dummy513 | -1.8485 | ||
(4.3811) | |||
dummy514 | 8.5596 | ||
(5.6541) | |||
dummy515 | -32.7660*** | ||
(7.2327) | |||
dummy516 | 4.1046 | ||
(5.8954) | |||
dummy517 | 1.6097 | ||
(6.8631) | |||
dummy518 | -11.1715*** | ||
(4.0178) | |||
dummy519 | -3.7312 | ||
(4.5200) | |||
dummy52 | -1.8077 | ||
(4.3528) | |||
dummy520 | 0.3894 | ||
(4.5977) | |||
dummy521 | 11.5116*** | ||
(4.3059) | |||
dummy522 | 7.3850** | ||
(3.4208) | |||
dummy523 | 3.3529 | ||
(3.0474) | |||
dummy524 | -8.9788 | ||
(6.4629) | |||
dummy525 | 2.1356 | ||
(5.0696) | |||
dummy526 | -2.6942 | ||
(5.0913) | |||
dummy527 | 3.2525 | ||
(5.2582) | |||
dummy528 | -5.1356 | ||
(5.5209) | |||
dummy529 | 0.8745 | ||
(4.3381) | |||
dummy53 | -2.0293 | ||
(5.4399) | |||
dummy530 | -10.4534** | ||
(4.0700) | |||
dummy531 | -5.1593 | ||
(4.6936) | |||
dummy532 | 6.8702* | ||
(3.5121) | |||
dummy533 | 1.7930 | ||
(5.9962) | |||
dummy534 | 0.1267 | ||
(8.1602) | |||
dummy535 | -8.2493 | ||
(10.1029) | |||
dummy536 | -3.0074 | ||
(2.9436) | |||
dummy537 | 8.8096*** | ||
(3.1049) | |||
dummy538 | -9.8694** | ||
(3.8568) | |||
dummy539 | 0.0011 | ||
(4.3666) | |||
dummy54 | 3.2915 | ||
(5.4945) | |||
dummy540 | 2.4259 | ||
(4.7219) | |||
dummy541 | 0.2201 | ||
(4.9285) | |||
dummy542 | 6.9568 | ||
(4.7941) | |||
dummy543 | -4.4428 | ||
(5.5113) | |||
dummy544 | -6.2434** | ||
(3.1208) | |||
dummy545 | -7.7058 | ||
(5.0813) | |||
dummy546 | 11.2713*** | ||
(4.2463) | |||
dummy547 | -1.6671 | ||
(3.2180) | |||
dummy548 | -3.8332 | ||
(4.3907) | |||
dummy549 | 2.3440 | ||
(4.3776) | |||
dummy55 | 9.5819* | ||
(5.1711) | |||
dummy550 | -11.5987** | ||
(4.7862) | |||
dummy551 | 5.7447** | ||
(2.3233) | |||
dummy552 | -9.4743** | ||
(4.0263) | |||
dummy553 | -0.6352 | ||
(4.8909) | |||
dummy554 | 3.1880 | ||
(4.2429) | |||
dummy555 | 2.7068 | ||
(4.8604) | |||
dummy556 | 4.1468 | ||
(3.2226) | |||
dummy557 | 5.8523 | ||
(8.5836) | |||
dummy558 | -1.6287 | ||
(5.9804) | |||
dummy559 | -4.7852 | ||
(3.5944) | |||
dummy56 | 0.9731 | ||
(3.2535) | |||
dummy560 | -8.8258 | ||
(10.8741) | |||
dummy561 | 5.2989 | ||
(10.2630) | |||
dummy562 | -2.6583 | ||
(5.0062) | |||
dummy563 | -17.3975*** | ||
(4.7777) | |||
dummy564 | -4.2821 | ||
(3.5861) | |||
dummy565 | 1.4113 | ||
(4.8082) | |||
dummy566 | 3.4732 | ||
(5.9326) | |||
dummy567 | 0.8402 | ||
(3.5577) | |||
dummy568 | -15.3147*** | ||
(4.0275) | |||
dummy569 | 5.5361 | ||
(3.9485) | |||
dummy57 | -9.8434** | ||
(3.8494) | |||
dummy570 | 6.7618 | ||
(4.4871) | |||
dummy571 | -18.7454*** | ||
(4.7311) | |||
dummy572 | 3.2306 | ||
(3.2542) | |||
dummy573 | 5.3450 | ||
(6.1003) | |||
dummy574 | 4.6945 | ||
(3.5797) | |||
dummy575 | 4.3042 | ||
(4.2680) | |||
dummy576 | 5.6040 | ||
(5.7755) | |||
dummy577 | -8.5313 | ||
(6.0578) | |||
dummy578 | 1.8396 | ||
(3.5038) | |||
dummy579 | 6.7067 | ||
(4.6110) | |||
dummy58 | -1.0421 | ||
(5.2775) | |||
dummy580 | -13.6529*** | ||
(5.0952) | |||
dummy581 | 6.1554 | ||
(5.1098) | |||
dummy582 | 0.8816 | ||
(3.5957) | |||
dummy583 | 14.7077*** | ||
(5.2202) | |||
dummy584 | 3.3134 | ||
(5.6816) | |||
dummy585 | 4.6202 | ||
(5.5409) | |||
dummy586 | 2.7583 | ||
(6.0835) | |||
dummy587 | -3.6245 | ||
(4.6650) | |||
dummy588 | 11.0166 | ||
(7.5482) | |||
dummy589 | -2.1589 | ||
(5.0231) | |||
dummy59 | 1.4143 | ||
(4.5321) | |||
dummy590 | 13.5349*** | ||
(4.5759) | |||
dummy591 | -0.2648 | ||
(5.2970) | |||
dummy592 | 1.5601 | ||
(5.3742) | |||
dummy593 | 3.4497 | ||
(4.8534) | |||
dummy594 | 12.0738*** | ||
(3.7058) | |||
dummy595 | 5.5114 | ||
(5.6700) | |||
dummy596 | -9.6128* | ||
(5.2058) | |||
dummy597 | 3.4734 | ||
(5.1049) | |||
dummy598 | 0.5349 | ||
(3.5548) | |||
dummy599 | 4.2422 | ||
(5.0113) | |||
dummy6 | 1.2027 | ||
(5.0278) | |||
dummy60 | -2.4541 | ||
(3.4610) | |||
dummy600 | -3.8795 | ||
(6.1843) | |||
dummy601 | -12.1054*** | ||
(3.8969) | |||
dummy602 | -0.7531 | ||
(4.0827) | |||
dummy603 | -6.1493 | ||
(8.1295) | |||
dummy604 | -0.6310 | ||
(5.8568) | |||
dummy605 | 2.1764 | ||
(3.9461) | |||
dummy606 | 3.0961 | ||
(3.9557) | |||
dummy607 | 6.9611 | ||
(4.9993) | |||
dummy608 | -17.7831*** | ||
(4.5315) | |||
dummy609 | 0.0630 | ||
(6.0804) | |||
dummy61 | -0.2580 | ||
(3.6621) | |||
dummy610 | -1.5003 | ||
(5.7399) | |||
dummy611 | 3.4733 | ||
(5.0911) | |||
dummy612 | -5.9997 | ||
(4.2167) | |||
dummy613 | 6.2568 | ||
(4.1170) | |||
dummy614 | 8.0658** | ||
(3.8730) | |||
dummy615 | -10.9266*** | ||
(3.6884) | |||
dummy616 | -6.3649 | ||
(5.2386) | |||
dummy617 | -7.3913 | ||
(4.6511) | |||
dummy618 | -2.4139 | ||
(3.7550) | |||
dummy619 | -3.1033 | ||
(3.6070) | |||
dummy62 | -2.2850 | ||
(3.3003) | |||
dummy620 | 11.0382** | ||
(4.3842) | |||
dummy621 | -3.6944 | ||
(4.8216) | |||
dummy622 | -2.5585 | ||
(3.9426) | |||
dummy623 | -21.0371*** | ||
(4.4701) | |||
dummy624 | 12.9034*** | ||
(4.8743) | |||
dummy625 | -13.7536*** | ||
(4.6844) | |||
dummy626 | -10.0747*** | ||
(3.5685) | |||
dummy627 | 3.8972 | ||
(4.1234) | |||
dummy628 | 0.9682 | ||
(4.2964) | |||
dummy629 | -4.1516 | ||
(11.5443) | |||
dummy63 | 6.9548** | ||
(3.0566) | |||
dummy630 | 0.0473 | ||
(5.8141) | |||
dummy631 | -12.6676** | ||
(6.2217) | |||
dummy632 | 5.4827 | ||
(5.4211) | |||
dummy633 | 0.6102 | ||
(1.4839) | |||
dummy634 | -17.4744*** | ||
(4.9484) | |||
dummy635 | 6.5961 | ||
(4.3882) | |||
dummy636 | 1.1271 | ||
(3.4144) | |||
dummy637 | -7.3962 | ||
(8.6965) | |||
dummy638 | 1.4030 | ||
(3.3476) | |||
dummy639 | 6.7896 | ||
(4.7436) | |||
dummy64 | 0.4731 | ||
(3.2476) | |||
dummy640 | 13.4591*** | ||
(4.4259) | |||
dummy641 | -9.5152 | ||
(11.5879) | |||
dummy642 | -0.4694 | ||
(0.6553) | |||
dummy643 | 0.7415 | ||
(0.6595) | |||
dummy644 | -5.4637** | ||
(2.2849) | |||
dummy645 | 0.0617 | ||
(4.0300) | |||
dummy646 | -5.4255** | ||
(2.5935) | |||
dummy647 | 13.8081** | ||
(6.5902) | |||
dummy648 | -2.7085 | ||
(1.9050) | |||
dummy649 | 4.6602 | ||
(3.6623) | |||
dummy65 | -4.5726 | ||
(5.9071) | |||
dummy650 | 1.8370 | ||
(4.5434) | |||
dummy651 | -12.1206 | ||
(12.4086) | |||
dummy652 | 2.9765 | ||
(3.2429) | |||
dummy653 | 2.9191 | ||
(3.2250) | |||
dummy66 | -0.4434 | ||
(3.0394) | |||
dummy67 | 1.5055 | ||
(3.7338) | |||
dummy68 | -4.4962 | ||
(3.1669) | |||
dummy69 | -0.8677 | ||
(3.5165) | |||
dummy7 | 3.7684 | ||
(3.3640) | |||
dummy70 | -5.4844** | ||
(2.1660) | |||
dummy71 | -4.3484 | ||
(2.8575) | |||
dummy72 | -0.1907 | ||
(2.3153) | |||
dummy73 | -1.9982 | ||
(2.5011) | |||
dummy74 | -2.5523 | ||
(2.4558) | |||
dummy75 | 2.7364 | ||
(2.4950) | |||
dummy76 | -5.8831** | ||
(2.9148) | |||
dummy77 | -3.5706 | ||
(3.1871) | |||
dummy78 | -3.4602 | ||
(2.4375) | |||
dummy79 | -3.4021 | ||
(2.0751) | |||
dummy8 | -7.0252 | ||
(4.8915) | |||
dummy80 | -1.4898 | ||
(3.0600) | |||
dummy81 | -4.3049* | ||
(2.3258) | |||
dummy82 | -2.7352 | ||
(3.3310) | |||
dummy83 | 4.9438* | ||
(2.5395) | |||
dummy84 | -2.3419 | ||
(2.8217) | |||
dummy85 | -2.7045 | ||
(3.1301) | |||
dummy86 | -0.9674 | ||
(2.9558) | |||
dummy87 | -0.8916 | ||
(3.7544) | |||
dummy88 | 1.0795 | ||
(3.4910) | |||
dummy89 | 5.4826 | ||
(3.8765) | |||
dummy9 | -8.1249* | ||
(4.3812) | |||
dummy90 | -1.6933 | ||
(2.7859) | |||
dummy91 | -5.2465 | ||
(3.4553) | |||
dummy92 | -5.0755* | ||
(2.7653) | |||
dummy93 | 3.3689 | ||
(2.7793) | |||
dummy94 | -0.8988 | ||
(3.1840) | |||
dummy95 | 0.0582 | ||
(2.8463) | |||
dummy96 | 0.3937 | ||
(3.1168) | |||
dummy97 | 1.3006 | ||
(3.4192) | |||
dummy98 | -2.2401 | ||
(2.8306) | |||
dummy99 | -3.9907 | ||
(4.5044) |
Repeating with absolute ideology as the outcome
lm_asb_ideo = list()
lm_asb_ideo.append(smf.ols(formula="Q('Absolute Ideology') ~ Politician", data=political_judges,
missing="drop").fit(cov_type='HC0'))
lm_asb_ideo.append(smf.ols(formula="Q('Absolute Ideology') ~ Politician" + composition_formula
,data=political_judges,
missing="drop").fit(cov_type='HC0'))
lm_asb_ideo.append(smf.ols(formula="Q('Absolute Ideology') ~ Politician" + composition_formula + dummies_formula
,data=political_judges,
missing="drop").fit(cov_type='HC0'))
# Inclusion of the full set of dummies flipped the sign of the Politician coefficient, again
summary_col(lm_asb_ideo, stars=True)
Q('Absolute Ideology') I | Q('Absolute Ideology') II | Q('Absolute Ideology') III | |
---|---|---|---|
Intercept | 28.5407*** | -272.0906*** | -0.3419* |
(0.4117) | (64.0601) | (0.1971) | |
Politician | -1.8292 | -0.6761 | 0.3298 |
(1.3808) | (1.4009) | (1.5538) | |
Q('House Democrats') | 0.1698*** | -0.0750 | |
(0.0627) | (0.1381) | ||
Q('House Independents') | 1.8830* | 1.4025 | |
(0.9781) | (1.7199) | ||
Q('House Republicans') | 0.1181* | -0.0537 | |
(0.0674) | (0.1129) | ||
Q('Senate Democrats') | 2.2413*** | 0.6618 | |
(0.5456) | (0.6099) | ||
Q('Senate Independents') | 0.0000 | -0.0000*** | |
(0.0000) | (0.0000) | ||
Q('Senate Republicans') | 2.5066*** | 0.5657 | |
(0.5423) | (0.5132) | ||
dummy0 | -6.4309* | ||
(3.5146) | |||
dummy1 | 2.2893 | ||
(3.9393) | |||
dummy10 | 4.7159 | ||
(4.5786) | |||
dummy100 | 0.9001 | ||
(3.0147) | |||
dummy101 | 1.7881 | ||
(3.1954) | |||
dummy102 | 4.2295 | ||
(3.1828) | |||
dummy103 | 1.3625 | ||
(3.2565) | |||
dummy104 | -6.1599 | ||
(4.9198) | |||
dummy105 | 1.3123 | ||
(7.3208) | |||
dummy106 | -0.1749 | ||
(3.2590) | |||
dummy107 | -4.0457 | ||
(7.4427) | |||
dummy108 | 6.2139 | ||
(5.4967) | |||
dummy109 | -2.4741 | ||
(5.4794) | |||
dummy11 | 1.3659 | ||
(4.4303) | |||
dummy110 | 2.7499 | ||
(4.4753) | |||
dummy111 | -9.2837** | ||
(4.5645) | |||
dummy112 | 7.9795 | ||
(7.2590) | |||
dummy113 | -17.7430** | ||
(8.2769) | |||
dummy114 | 20.9180*** | ||
(5.3288) | |||
dummy115 | -16.6493** | ||
(6.4994) | |||
dummy116 | -18.2578*** | ||
(5.0047) | |||
dummy117 | -5.1702 | ||
(6.0488) | |||
dummy118 | 26.6610*** | ||
(6.3042) | |||
dummy119 | -13.1899 | ||
(10.2683) | |||
dummy12 | -1.6138 | ||
(3.0894) | |||
dummy120 | 7.7802 | ||
(11.2818) | |||
dummy121 | -10.0057 | ||
(10.7919) | |||
dummy122 | -0.7009 | ||
(11.0531) | |||
dummy123 | -11.1824 | ||
(11.2610) | |||
dummy124 | -2.7772 | ||
(8.6630) | |||
dummy125 | -6.8469 | ||
(9.2009) | |||
dummy126 | 2.1988 | ||
(7.3213) | |||
dummy127 | -12.1955* | ||
(6.3116) | |||
dummy128 | -6.3001 | ||
(6.8371) | |||
dummy129 | -15.6439** | ||
(6.1391) | |||
dummy13 | -0.9798 | ||
(2.2688) | |||
dummy130 | -6.3439 | ||
(6.8992) | |||
dummy131 | -6.8783 | ||
(4.9044) | |||
dummy132 | -0.3355 | ||
(5.6813) | |||
dummy133 | 5.1227 | ||
(6.0893) | |||
dummy134 | 3.3945 | ||
(5.4786) | |||
dummy135 | -1.1765 | ||
(5.3409) | |||
dummy136 | -1.1167 | ||
(5.7784) | |||
dummy137 | -0.2566 | ||
(5.7028) | |||
dummy138 | 4.1485 | ||
(5.5261) | |||
dummy139 | 1.7723 | ||
(5.4360) | |||
dummy14 | -5.5584* | ||
(3.0491) | |||
dummy140 | 9.9512* | ||
(5.9718) | |||
dummy141 | 10.4308* | ||
(5.7667) | |||
dummy142 | 11.4175* | ||
(5.8612) | |||
dummy143 | 4.6266 | ||
(8.1817) | |||
dummy144 | 0.2022 | ||
(8.0071) | |||
dummy145 | 8.2815 | ||
(8.1693) | |||
dummy146 | 3.9845 | ||
(7.6751) | |||
dummy147 | 4.7226 | ||
(8.2136) | |||
dummy148 | 3.5291 | ||
(7.7163) | |||
dummy149 | 5.4259 | ||
(8.3921) | |||
dummy15 | -5.0534 | ||
(3.3120) | |||
dummy150 | 7.8709 | ||
(8.3643) | |||
dummy151 | 6.3054*** | ||
(2.2529) | |||
dummy152 | 1.5843 | ||
(2.8530) | |||
dummy153 | -3.6007 | ||
(2.6232) | |||
dummy154 | 0.7060 | ||
(2.5579) | |||
dummy155 | 6.2986** | ||
(3.1695) | |||
dummy156 | 1.7909* | ||
(0.9801) | |||
dummy157 | -0.6899 | ||
(0.9653) | |||
dummy158 | -1.4428* | ||
(0.8148) | |||
dummy159 | 2.4251 | ||
(2.1435) | |||
dummy16 | -7.5755** | ||
(3.1570) | |||
dummy160 | -2.7670 | ||
(2.2129) | |||
dummy161 | -5.0665*** | ||
(1.6925) | |||
dummy162 | -2.1936* | ||
(1.1707) | |||
dummy163 | 6.9181*** | ||
(1.9943) | |||
dummy164 | 1.1206 | ||
(1.7573) | |||
dummy165 | -5.0841*** | ||
(0.8563) | |||
dummy166 | -3.2254*** | ||
(0.8784) | |||
dummy167 | -2.0822** | ||
(0.9048) | |||
dummy168 | 2.2279 | ||
(5.4987) | |||
dummy169 | -12.5235 | ||
(9.8339) | |||
dummy17 | 1.3868 | ||
(2.4283) | |||
dummy170 | 3.6676*** | ||
(1.2831) | |||
dummy171 | -0.6913 | ||
(3.8703) | |||
dummy172 | 3.4555 | ||
(4.8676) | |||
dummy173 | 1.9254 | ||
(5.1874) | |||
dummy174 | 1.7427 | ||
(5.8317) | |||
dummy175 | 9.1248*** | ||
(2.2871) | |||
dummy176 | 2.0119* | ||
(1.2097) | |||
dummy177 | -2.0320 | ||
(1.3195) | |||
dummy178 | 1.8847 | ||
(2.2152) | |||
dummy179 | 1.9527 | ||
(3.2775) | |||
dummy18 | 7.5805* | ||
(4.3318) | |||
dummy180 | -5.7556** | ||
(2.9041) | |||
dummy181 | 3.5328 | ||
(4.6111) | |||
dummy182 | -4.9510 | ||
(4.9878) | |||
dummy183 | 2.6346 | ||
(2.3750) | |||
dummy184 | 0.3800 | ||
(1.2556) | |||
dummy185 | -1.5654 | ||
(1.7595) | |||
dummy186 | 1.2235 | ||
(1.5989) | |||
dummy187 | -8.1692 | ||
(6.8178) | |||
dummy188 | -2.7224 | ||
(5.3408) | |||
dummy189 | 4.9950** | ||
(2.2580) | |||
dummy19 | 8.6925** | ||
(3.4495) | |||
dummy190 | 7.7876 | ||
(5.7720) | |||
dummy191 | -1.8013 | ||
(8.1833) | |||
dummy192 | -9.2837** | ||
(4.5645) | |||
dummy193 | 3.4694 | ||
(7.2536) | |||
dummy194 | -9.7636** | ||
(4.8285) | |||
dummy195 | 7.5017*** | ||
(2.7829) | |||
dummy196 | 8.1985 | ||
(9.7524) | |||
dummy197 | -0.5540 | ||
(5.2032) | |||
dummy198 | 6.2986** | ||
(3.1695) | |||
dummy199 | 0.3129 | ||
(1.9424) | |||
dummy2 | -14.3015*** | ||
(3.3564) | |||
dummy20 | -0.4232 | ||
(1.9767) | |||
dummy200 | -0.3933 | ||
(1.6593) | |||
dummy201 | -5.2616 | ||
(4.4953) | |||
dummy202 | -1.5222 | ||
(2.2133) | |||
dummy203 | 0.2237 | ||
(1.5888) | |||
dummy204 | -1.7078** | ||
(0.8614) | |||
dummy205 | -0.2086 | ||
(2.2567) | |||
dummy206 | -0.4813 | ||
(2.7052) | |||
dummy207 | 2.0558** | ||
(0.9400) | |||
dummy208 | 5.5476 | ||
(5.6064) | |||
dummy209 | 1.6771 | ||
(4.9549) | |||
dummy21 | 5.3447** | ||
(2.3241) | |||
dummy210 | 0.3335 | ||
(2.9174) | |||
dummy211 | -1.4333 | ||
(2.5495) | |||
dummy212 | 5.9345 | ||
(3.9243) | |||
dummy213 | 2.7149 | ||
(8.4546) | |||
dummy214 | -3.3527 | ||
(8.0507) | |||
dummy215 | -2.6480 | ||
(7.0283) | |||
dummy216 | -8.8482*** | ||
(3.2859) | |||
dummy217 | -0.9151 | ||
(3.0009) | |||
dummy218 | 0.6478 | ||
(4.1618) | |||
dummy219 | 5.1525 | ||
(5.0209) | |||
dummy22 | -4.2910*** | ||
(1.3991) | |||
dummy220 | -2.7944 | ||
(5.5997) | |||
dummy221 | 0.0686 | ||
(3.6394) | |||
dummy222 | -2.3966 | ||
(4.6292) | |||
dummy223 | -2.8402 | ||
(5.6586) | |||
dummy224 | -5.0861 | ||
(3.3451) | |||
dummy225 | -0.3973 | ||
(1.5609) | |||
dummy226 | 9.1248*** | ||
(2.2871) | |||
dummy227 | -1.7426 | ||
(1.3371) | |||
dummy228 | -16.3685*** | ||
(5.5315) | |||
dummy229 | -19.0923*** | ||
(5.1878) | |||
dummy23 | -2.6624 | ||
(1.7481) | |||
dummy230 | 0.3163 | ||
(2.7842) | |||
dummy231 | 4.5397 | ||
(2.9590) | |||
dummy232 | 0.7298 | ||
(1.6862) | |||
dummy233 | 4.4911** | ||
(1.7554) | |||
dummy234 | 9.0118** | ||
(4.4559) | |||
dummy235 | -2.0121 | ||
(3.7527) | |||
dummy236 | 6.2105 | ||
(8.2776) | |||
dummy237 | -10.2301* | ||
(5.7148) | |||
dummy238 | -12.8890*** | ||
(2.1415) | |||
dummy239 | -9.8415*** | ||
(2.7251) | |||
dummy24 | -1.7464 | ||
(2.2813) | |||
dummy240 | 15.1577*** | ||
(2.4765) | |||
dummy241 | 17.1364** | ||
(8.6068) | |||
dummy242 | 12.3464*** | ||
(3.7217) | |||
dummy243 | -8.4462 | ||
(5.2271) | |||
dummy244 | 1.5120 | ||
(4.2501) | |||
dummy245 | 3.3618 | ||
(3.8183) | |||
dummy246 | 3.3111 | ||
(4.2077) | |||
dummy247 | -3.3272 | ||
(3.7261) | |||
dummy248 | 1.7003 | ||
(1.9350) | |||
dummy249 | 5.3408*** | ||
(1.6026) | |||
dummy25 | -0.2042 | ||
(2.5123) | |||
dummy250 | -2.1116 | ||
(3.9445) | |||
dummy251 | -2.2180 | ||
(1.8518) | |||
dummy252 | 6.3154*** | ||
(2.3621) | |||
dummy253 | -6.3612* | ||
(3.7848) | |||
dummy254 | 17.7606* | ||
(9.0956) | |||
dummy255 | -8.9501 | ||
(5.7684) | |||
dummy256 | -9.2858** | ||
(3.8984) | |||
dummy257 | -6.8236*** | ||
(2.1048) | |||
dummy258 | 5.2554*** | ||
(1.8795) | |||
dummy259 | -8.1037*** | ||
(2.1429) | |||
dummy26 | -1.2456 | ||
(2.4899) | |||
dummy260 | -2.1888 | ||
(2.3522) | |||
dummy261 | 0.5079 | ||
(3.6233) | |||
dummy262 | 14.3196* | ||
(8.6476) | |||
dummy263 | 1.0903 | ||
(5.1594) | |||
dummy264 | 2.6979 | ||
(3.3301) | |||
dummy265 | -2.4687 | ||
(1.7920) | |||
dummy266 | -5.4195** | ||
(2.1231) | |||
dummy267 | -7.3525 | ||
(5.0359) | |||
dummy268 | 9.0522*** | ||
(2.3450) | |||
dummy269 | -1.5533 | ||
(2.2132) | |||
dummy27 | -2.3791 | ||
(2.6842) | |||
dummy270 | 3.4481 | ||
(3.6499) | |||
dummy271 | -12.3682* | ||
(6.5148) | |||
dummy272 | 10.3758** | ||
(4.8572) | |||
dummy273 | 19.8849*** | ||
(4.3252) | |||
dummy274 | -16.2254*** | ||
(3.5822) | |||
dummy275 | 18.1501*** | ||
(3.6996) | |||
dummy276 | -20.7256*** | ||
(4.0196) | |||
dummy277 | -11.2533** | ||
(5.0149) | |||
dummy278 | 7.9876** | ||
(3.3015) | |||
dummy279 | -3.6106 | ||
(2.9285) | |||
dummy28 | 2.8588 | ||
(1.8406) | |||
dummy280 | 5.3624 | ||
(5.9007) | |||
dummy281 | 10.4135*** | ||
(3.8767) | |||
dummy282 | 23.6415*** | ||
(4.8510) | |||
dummy283 | 16.6989*** | ||
(3.7895) | |||
dummy284 | 11.1391** | ||
(5.5614) | |||
dummy285 | 15.4924*** | ||
(5.5513) | |||
dummy286 | -18.3814*** | ||
(3.8898) | |||
dummy287 | 0.5279 | ||
(8.5931) | |||
dummy288 | -10.9779** | ||
(4.6594) | |||
dummy289 | -6.2350 | ||
(3.8911) | |||
dummy29 | 0.5230 | ||
(2.1143) | |||
dummy290 | -2.8687 | ||
(4.4273) | |||
dummy291 | 2.7482 | ||
(3.5836) | |||
dummy292 | 2.8346 | ||
(5.9442) | |||
dummy293 | 28.0003*** | ||
(4.9497) | |||
dummy294 | -3.0127 | ||
(4.3099) | |||
dummy295 | -3.3468 | ||
(5.2038) | |||
dummy296 | -2.2829 | ||
(4.7856) | |||
dummy297 | 23.4443*** | ||
(3.7719) | |||
dummy298 | 6.5112 | ||
(6.2379) | |||
dummy299 | -4.8954 | ||
(3.9857) | |||
dummy3 | -3.2597 | ||
(3.0944) | |||
dummy30 | -1.0997 | ||
(2.1733) | |||
dummy300 | -6.9779 | ||
(4.7382) | |||
dummy301 | -15.8351*** | ||
(4.7273) | |||
dummy302 | -3.5524 | ||
(6.1876) | |||
dummy303 | 1.3418 | ||
(10.4881) | |||
dummy304 | 18.0516*** | ||
(4.4776) | |||
dummy305 | 13.2018*** | ||
(3.5518) | |||
dummy306 | 12.5207* | ||
(7.5921) | |||
dummy307 | 6.7210 | ||
(5.2863) | |||
dummy308 | 8.6857** | ||
(4.2559) | |||
dummy309 | 14.5672*** | ||
(4.2172) | |||
dummy31 | 3.6733* | ||
(2.0754) | |||
dummy310 | 11.1807** | ||
(4.9629) | |||
dummy311 | -13.3107*** | ||
(4.8798) | |||
dummy312 | 0.3784 | ||
(4.1626) | |||
dummy313 | -0.4901 | ||
(4.4129) | |||
dummy314 | 1.8481 | ||
(3.8710) | |||
dummy315 | 8.5064 | ||
(7.7252) | |||
dummy316 | -28.9888*** | ||
(5.1461) | |||
dummy317 | 4.8137 | ||
(5.4281) | |||
dummy318 | -7.6041* | ||
(3.9664) | |||
dummy319 | 33.2120*** | ||
(5.7002) | |||
dummy32 | 1.7620 | ||
(2.1921) | |||
dummy320 | -14.1018*** | ||
(3.9754) | |||
dummy321 | -9.9800** | ||
(4.0971) | |||
dummy322 | -3.5383 | ||
(5.5431) | |||
dummy323 | 5.3866 | ||
(4.6265) | |||
dummy324 | -27.9864*** | ||
(4.1146) | |||
dummy325 | -9.0111** | ||
(4.2657) | |||
dummy326 | -3.4623 | ||
(3.5374) | |||
dummy327 | 0.0591 | ||
(6.2318) | |||
dummy328 | -1.1453 | ||
(3.5715) | |||
dummy329 | 4.4469* | ||
(2.6564) | |||
dummy33 | -1.0865 | ||
(1.9051) | |||
dummy330 | -11.7028*** | ||
(2.7726) | |||
dummy331 | -10.8886*** | ||
(3.2780) | |||
dummy332 | -4.3313 | ||
(4.9413) | |||
dummy333 | 6.5357* | ||
(3.7362) | |||
dummy334 | 0.6541 | ||
(4.3302) | |||
dummy335 | -14.5043*** | ||
(3.7639) | |||
dummy336 | -2.6585 | ||
(2.8429) | |||
dummy337 | -25.3323*** | ||
(4.2024) | |||
dummy338 | 21.2207*** | ||
(4.5842) | |||
dummy339 | -2.8347 | ||
(6.5850) | |||
dummy34 | 2.1197 | ||
(2.1176) | |||
dummy340 | -6.5009 | ||
(6.1680) | |||
dummy341 | -7.5048* | ||
(3.8961) | |||
dummy342 | -12.3302** | ||
(5.8737) | |||
dummy343 | 5.7414 | ||
(5.0272) | |||
dummy344 | -0.1781 | ||
(3.0194) | |||
dummy345 | 17.2257* | ||
(8.9793) | |||
dummy346 | -2.8360 | ||
(6.0831) | |||
dummy347 | 7.7606* | ||
(4.6484) | |||
dummy348 | 0.9429 | ||
(3.2288) | |||
dummy349 | 5.5783 | ||
(3.4360) | |||
dummy35 | -0.7833 | ||
(2.0421) | |||
dummy350 | 4.0828 | ||
(16.0480) | |||
dummy351 | 4.3482 | ||
(14.3958) | |||
dummy352 | 13.5756*** | ||
(3.8146) | |||
dummy353 | 4.0107 | ||
(7.0826) | |||
dummy354 | 12.3652*** | ||
(4.6441) | |||
dummy355 | 14.5277*** | ||
(3.9691) | |||
dummy356 | 3.6262 | ||
(4.3341) | |||
dummy357 | 5.6330 | ||
(3.7104) | |||
dummy358 | -1.9432 | ||
(5.9050) | |||
dummy359 | 0.6152 | ||
(3.8856) | |||
dummy36 | -6.0044** | ||
(2.9497) | |||
dummy360 | 18.9701*** | ||
(4.1669) | |||
dummy361 | 2.7844 | ||
(3.3990) | |||
dummy362 | 18.7821*** | ||
(3.7077) | |||
dummy363 | 2.3705 | ||
(4.4013) | |||
dummy364 | 12.7828* | ||
(6.5798) | |||
dummy365 | 15.0767*** | ||
(3.8015) | |||
dummy366 | 3.7812 | ||
(4.5993) | |||
dummy367 | -2.1663 | ||
(3.5745) | |||
dummy368 | -21.8867*** | ||
(6.5191) | |||
dummy369 | -1.6544 | ||
(5.5129) | |||
dummy37 | -7.2829*** | ||
(2.6732) | |||
dummy370 | 1.7003 | ||
(1.9350) | |||
dummy371 | 4.5755 | ||
(4.6275) | |||
dummy372 | 8.3170 | ||
(5.7108) | |||
dummy373 | -11.5293** | ||
(4.5085) | |||
dummy374 | 7.3146 | ||
(4.8150) | |||
dummy375 | -16.4238*** | ||
(5.0684) | |||
dummy376 | 9.9316** | ||
(4.3353) | |||
dummy377 | 9.6355 | ||
(11.6203) | |||
dummy378 | -0.5004 | ||
(4.9700) | |||
dummy379 | 18.6113*** | ||
(5.4076) | |||
dummy38 | -0.3235 | ||
(2.1033) | |||
dummy380 | -5.7479 | ||
(7.1423) | |||
dummy381 | 4.4948 | ||
(4.5553) | |||
dummy382 | 9.7261*** | ||
(2.5932) | |||
dummy383 | -4.1845 | ||
(4.5427) | |||
dummy384 | 4.6301* | ||
(2.6595) | |||
dummy385 | -7.3013* | ||
(3.7837) | |||
dummy386 | 2.6148 | ||
(3.4449) | |||
dummy387 | 12.9071*** | ||
(3.1873) | |||
dummy388 | -6.1856 | ||
(13.1877) | |||
dummy389 | 0.9683 | ||
(5.9608) | |||
dummy39 | 0.2674 | ||
(2.5413) | |||
dummy390 | -4.0081 | ||
(3.5909) | |||
dummy391 | 3.3142 | ||
(3.2567) | |||
dummy392 | 24.5780*** | ||
(4.9945) | |||
dummy393 | 4.5787 | ||
(4.4511) | |||
dummy394 | -22.9404*** | ||
(7.0348) | |||
dummy395 | -0.5064 | ||
(5.8784) | |||
dummy396 | -12.6885** | ||
(5.6406) | |||
dummy397 | 2.7288 | ||
(8.9827) | |||
dummy398 | -11.5720 | ||
(8.8876) | |||
dummy399 | 4.9890 | ||
(3.6634) | |||
dummy4 | 6.2695 | ||
(4.6696) | |||
dummy40 | 2.3635 | ||
(2.4583) | |||
dummy400 | 1.7418 | ||
(3.4008) | |||
dummy401 | -3.2540 | ||
(3.6570) | |||
dummy402 | 1.5687 | ||
(3.1320) | |||
dummy403 | 14.9887** | ||
(6.9931) | |||
dummy404 | -6.3587** | ||
(3.2389) | |||
dummy405 | 1.9929 | ||
(10.6706) | |||
dummy406 | 13.4934 | ||
(9.0755) | |||
dummy407 | 0.5634 | ||
(5.3246) | |||
dummy408 | 5.7830 | ||
(6.0929) | |||
dummy409 | 1.2793 | ||
(4.6524) | |||
dummy41 | 1.5477 | ||
(1.8264) | |||
dummy410 | 1.6954 | ||
(7.4008) | |||
dummy411 | -2.5789 | ||
(8.9691) | |||
dummy412 | -6.3260 | ||
(5.0615) | |||
dummy413 | -3.8835 | ||
(5.9152) | |||
dummy414 | 9.2376 | ||
(9.5113) | |||
dummy415 | 9.2086 | ||
(6.4482) | |||
dummy416 | -3.6325 | ||
(6.8987) | |||
dummy417 | -2.2234 | ||
(4.2802) | |||
dummy418 | -0.4450 | ||
(3.6622) | |||
dummy419 | 4.6224 | ||
(5.0834) | |||
dummy42 | 4.0398* | ||
(2.1013) | |||
dummy420 | -10.0606*** | ||
(3.7457) | |||
dummy421 | -14.8121*** | ||
(3.0781) | |||
dummy422 | -6.5164 | ||
(8.3152) | |||
dummy423 | 0.4135 | ||
(5.1554) | |||
dummy424 | 15.7257*** | ||
(4.5376) | |||
dummy425 | 3.5551 | ||
(3.6017) | |||
dummy426 | 0.9346 | ||
(7.3258) | |||
dummy427 | -2.2814 | ||
(2.7305) | |||
dummy428 | -13.7545*** | ||
(4.7657) | |||
dummy429 | 2.3201 | ||
(3.0891) | |||
dummy43 | 7.2770** | ||
(2.8568) | |||
dummy430 | 0.3978 | ||
(4.2269) | |||
dummy431 | -5.0071 | ||
(8.8229) | |||
dummy432 | -9.7750 | ||
(6.7055) | |||
dummy433 | -4.1146 | ||
(4.9392) | |||
dummy434 | 14.8206*** | ||
(3.8103) | |||
dummy435 | -5.4903 | ||
(3.7285) | |||
dummy436 | 7.2244* | ||
(3.9154) | |||
dummy437 | 4.6425 | ||
(3.2938) | |||
dummy438 | 0.3163 | ||
(2.7842) | |||
dummy439 | -8.0993** | ||
(3.9729) | |||
dummy44 | 28.9139*** | ||
(8.6780) | |||
dummy440 | 2.5663 | ||
(3.5413) | |||
dummy441 | -11.3083*** | ||
(4.0795) | |||
dummy442 | 16.7436*** | ||
(3.1474) | |||
dummy443 | -7.4770** | ||
(3.6876) | |||
dummy444 | 7.8375** | ||
(3.3903) | |||
dummy445 | -8.9970* | ||
(5.3640) | |||
dummy446 | 13.0108*** | ||
(5.0191) | |||
dummy447 | -5.6624 | ||
(4.6869) | |||
dummy448 | -9.6362* | ||
(5.4271) | |||
dummy449 | -17.3593*** | ||
(5.0751) | |||
dummy45 | 18.6113*** | ||
(5.4076) | |||
dummy450 | 0.7580 | ||
(9.5858) | |||
dummy451 | 5.9649 | ||
(4.8859) | |||
dummy452 | 9.5968 | ||
(6.1413) | |||
dummy453 | -11.2110*** | ||
(3.2105) | |||
dummy454 | 10.0353** | ||
(4.6887) | |||
dummy455 | 4.1981 | ||
(4.8943) | |||
dummy456 | -1.8473 | ||
(6.2741) | |||
dummy457 | 1.6807 | ||
(4.2144) | |||
dummy458 | 3.1409 | ||
(7.8690) | |||
dummy459 | -2.7191 | ||
(3.7975) | |||
dummy46 | 4.9328 | ||
(11.5553) | |||
dummy460 | -0.0708 | ||
(9.4653) | |||
dummy461 | -1.9001 | ||
(3.2964) | |||
dummy462 | 11.5389** | ||
(5.2625) | |||
dummy463 | 8.5502*** | ||
(3.3166) | |||
dummy464 | -7.3711 | ||
(9.5587) | |||
dummy465 | 2.7036 | ||
(4.4156) | |||
dummy466 | -12.7836*** | ||
(3.4594) | |||
dummy467 | -1.3704 | ||
(3.8313) | |||
dummy468 | -7.4759 | ||
(6.2391) | |||
dummy469 | 5.5667 | ||
(4.8387) | |||
dummy47 | 7.8417 | ||
(6.6201) | |||
dummy470 | 0.2866 | ||
(4.0690) | |||
dummy471 | 8.8790 | ||
(5.5246) | |||
dummy472 | -4.7896 | ||
(3.0547) | |||
dummy473 | 0.8728 | ||
(4.1125) | |||
dummy474 | 6.8231 | ||
(5.4939) | |||
dummy475 | 14.9549** | ||
(6.6600) | |||
dummy476 | -9.5651** | ||
(4.7000) | |||
dummy477 | -5.1414 | ||
(4.6127) | |||
dummy478 | -1.3128 | ||
(6.5245) | |||
dummy479 | 4.1580 | ||
(6.4458) | |||
dummy48 | 19.2053*** | ||
(7.4187) | |||
dummy480 | -4.2690 | ||
(3.3531) | |||
dummy481 | -0.4861 | ||
(3.9787) | |||
dummy482 | -3.7467 | ||
(3.1364) | |||
dummy483 | -15.6329*** | ||
(3.1566) | |||
dummy484 | 3.2846 | ||
(5.2208) | |||
dummy485 | 10.0254*** | ||
(3.4018) | |||
dummy486 | 8.2728* | ||
(4.6223) | |||
dummy487 | 9.5565* | ||
(5.2054) | |||
dummy488 | 14.5483*** | ||
(4.1136) | |||
dummy489 | 3.1209 | ||
(5.6863) | |||
dummy49 | -13.7229** | ||
(6.6540) | |||
dummy490 | 15.5143*** | ||
(4.1572) | |||
dummy491 | -15.3186*** | ||
(3.8143) | |||
dummy492 | 1.5193 | ||
(3.8916) | |||
dummy493 | 12.0203*** | ||
(2.8536) | |||
dummy494 | -23.2397*** | ||
(4.9471) | |||
dummy495 | -10.4033*** | ||
(3.5345) | |||
dummy496 | -0.2594 | ||
(4.2220) | |||
dummy497 | -7.8292 | ||
(6.4760) | |||
dummy498 | 6.6365* | ||
(3.6409) | |||
dummy499 | 12.7037** | ||
(6.3904) | |||
dummy5 | 4.2487 | ||
(5.9189) | |||
dummy50 | 4.7128 | ||
(6.8776) | |||
dummy500 | 6.5028 | ||
(4.6470) | |||
dummy501 | 1.0713 | ||
(5.0674) | |||
dummy502 | 13.9389*** | ||
(4.3386) | |||
dummy503 | -21.2777*** | ||
(6.9007) | |||
dummy504 | 6.6588 | ||
(5.6750) | |||
dummy505 | -0.4971 | ||
(5.3124) | |||
dummy506 | -7.1543 | ||
(5.1915) | |||
dummy507 | -9.0825* | ||
(5.3577) | |||
dummy508 | -5.7210 | ||
(4.0228) | |||
dummy509 | 4.9653 | ||
(3.9906) | |||
dummy51 | 0.3730 | ||
(6.6197) | |||
dummy510 | 1.4929 | ||
(4.2590) | |||
dummy511 | -0.6424 | ||
(4.3139) | |||
dummy512 | 1.6863 | ||
(2.7278) | |||
dummy513 | -2.1121 | ||
(3.5808) | |||
dummy514 | -35.4652*** | ||
(5.1691) | |||
dummy515 | -34.6396*** | ||
(8.0714) | |||
dummy516 | 11.8936** | ||
(5.1547) | |||
dummy517 | -7.5583 | ||
(4.6907) | |||
dummy518 | -19.6883*** | ||
(4.5994) | |||
dummy519 | -9.5906*** | ||
(3.6352) | |||
dummy52 | -6.6939 | ||
(6.4470) | |||
dummy520 | 3.0323 | ||
(5.8774) | |||
dummy521 | 3.9844 | ||
(5.6472) | |||
dummy522 | 10.7870** | ||
(4.7396) | |||
dummy523 | -3.2482 | ||
(3.6035) | |||
dummy524 | -12.4289** | ||
(5.4071) | |||
dummy525 | -7.3202 | ||
(4.6813) | |||
dummy526 | 1.8862 | ||
(4.2805) | |||
dummy527 | -7.7584* | ||
(4.4863) | |||
dummy528 | -5.0377 | ||
(4.3909) | |||
dummy529 | -1.0718 | ||
(4.2786) | |||
dummy53 | -8.7154 | ||
(6.0232) | |||
dummy530 | -1.9531 | ||
(3.9947) | |||
dummy531 | 4.3449 | ||
(4.2082) | |||
dummy532 | 8.6184*** | ||
(3.1979) | |||
dummy533 | 5.5129 | ||
(6.4692) | |||
dummy534 | 11.3670 | ||
(8.2000) | |||
dummy535 | -14.3321 | ||
(11.1637) | |||
dummy536 | -5.0200 | ||
(3.6885) | |||
dummy537 | 1.6131 | ||
(3.7000) | |||
dummy538 | 11.1125*** | ||
(4.0335) | |||
dummy539 | 5.0918 | ||
(4.3769) | |||
dummy54 | -1.2614 | ||
(4.8228) | |||
dummy540 | -1.8351 | ||
(5.6162) | |||
dummy541 | -6.8171* | ||
(4.0900) | |||
dummy542 | -1.0078 | ||
(4.4702) | |||
dummy543 | 12.1178*** | ||
(4.4132) | |||
dummy544 | 0.0929 | ||
(2.7581) | |||
dummy545 | -17.5358*** | ||
(5.0210) | |||
dummy546 | 1.7085 | ||
(3.5961) | |||
dummy547 | -3.3441 | ||
(4.4806) | |||
dummy548 | 6.1786 | ||
(4.9880) | |||
dummy549 | -0.6166 | ||
(4.1792) | |||
dummy55 | -11.1469* | ||
(6.5377) | |||
dummy550 | -11.4179*** | ||
(4.2072) | |||
dummy551 | 5.2554*** | ||
(1.8795) | |||
dummy552 | 10.2814** | ||
(4.5879) | |||
dummy553 | -9.4912*** | ||
(3.5053) | |||
dummy554 | -21.4795*** | ||
(4.9566) | |||
dummy555 | 12.5022** | ||
(4.9050) | |||
dummy556 | -0.5404 | ||
(5.9370) | |||
dummy557 | -9.4227* | ||
(5.1329) | |||
dummy558 | 2.5389 | ||
(4.5250) | |||
dummy559 | -1.4025 | ||
(3.4429) | |||
dummy56 | -1.6826 | ||
(4.1620) | |||
dummy560 | -0.6521 | ||
(7.8426) | |||
dummy561 | 9.7020 | ||
(6.9437) | |||
dummy562 | -10.8534* | ||
(5.5996) | |||
dummy563 | -7.0638 | ||
(4.8451) | |||
dummy564 | 0.8817 | ||
(3.2575) | |||
dummy565 | 1.1843 | ||
(4.9720) | |||
dummy566 | 18.1758*** | ||
(4.3522) | |||
dummy567 | -10.6100*** | ||
(3.1823) | |||
dummy568 | -10.0067** | ||
(4.3398) | |||
dummy569 | 3.4831 | ||
(2.7062) | |||
dummy57 | 1.0384 | ||
(4.7881) | |||
dummy570 | -3.1982 | ||
(4.6244) | |||
dummy571 | -18.7359*** | ||
(4.8989) | |||
dummy572 | 6.4418** | ||
(2.7572) | |||
dummy573 | -7.9669 | ||
(5.4388) | |||
dummy574 | 0.1489 | ||
(3.7010) | |||
dummy575 | 9.8837** | ||
(4.4565) | |||
dummy576 | 6.0386 | ||
(4.8074) | |||
dummy577 | -4.0027 | ||
(5.9356) | |||
dummy578 | 0.1713 | ||
(4.9636) | |||
dummy579 | -3.1614 | ||
(4.5802) | |||
dummy58 | -1.9767 | ||
(6.7113) | |||
dummy580 | 3.6000 | ||
(9.5436) | |||
dummy581 | 0.1209 | ||
(4.9348) | |||
dummy582 | -1.3909 | ||
(3.6218) | |||
dummy583 | -33.9655*** | ||
(5.3633) | |||
dummy584 | 3.9480 | ||
(4.7039) | |||
dummy585 | -2.6671 | ||
(2.7734) | |||
dummy586 | 7.5937 | ||
(5.0094) | |||
dummy587 | -3.8617 | ||
(4.3385) | |||
dummy588 | -5.2865 | ||
(4.0413) | |||
dummy589 | 3.5634 | ||
(4.2581) | |||
dummy59 | -4.1096 | ||
(3.8414) | |||
dummy590 | -18.0139*** | ||
(4.8757) | |||
dummy591 | 2.2018 | ||
(5.2584) | |||
dummy592 | -8.2304* | ||
(4.4318) | |||
dummy593 | -7.6912 | ||
(7.0392) | |||
dummy594 | -6.2650* | ||
(3.6527) | |||
dummy595 | -5.4569 | ||
(4.6982) | |||
dummy596 | -8.3210 | ||
(5.1241) | |||
dummy597 | -6.0179 | ||
(5.0051) | |||
dummy598 | -3.4606 | ||
(3.2524) | |||
dummy599 | -13.1169*** | ||
(4.6369) | |||
dummy6 | -5.3228 | ||
(5.8692) | |||
dummy60 | -7.8973** | ||
(3.2807) | |||
dummy600 | 12.5817** | ||
(6.0551) | |||
dummy601 | 13.7000*** | ||
(3.6552) | |||
dummy602 | -4.0788 | ||
(4.0037) | |||
dummy603 | 8.0983 | ||
(6.1401) | |||
dummy604 | -8.3026 | ||
(6.2218) | |||
dummy605 | 16.8651*** | ||
(4.3627) | |||
dummy606 | -0.5679 | ||
(4.9428) | |||
dummy607 | -13.8937*** | ||
(4.3822) | |||
dummy608 | 3.0824 | ||
(3.7667) | |||
dummy609 | 10.0633 | ||
(6.4071) | |||
dummy61 | -1.2081 | ||
(3.5445) | |||
dummy610 | -3.7768 | ||
(6.4736) | |||
dummy611 | 4.4328 | ||
(4.3269) | |||
dummy612 | -6.8928* | ||
(4.0123) | |||
dummy613 | 0.4085 | ||
(4.9526) | |||
dummy614 | 6.7444* | ||
(4.0750) | |||
dummy615 | 10.1270*** | ||
(3.8173) | |||
dummy616 | -4.0641 | ||
(4.7713) | |||
dummy617 | -10.5499*** | ||
(4.0338) | |||
dummy618 | -5.1023 | ||
(3.8277) | |||
dummy619 | 7.4747** | ||
(3.5625) | |||
dummy62 | 0.5198 | ||
(4.1824) | |||
dummy620 | 6.3634 | ||
(5.1833) | |||
dummy621 | -8.1600 | ||
(5.1821) | |||
dummy622 | -5.0069 | ||
(3.6497) | |||
dummy623 | 9.2479* | ||
(4.8110) | |||
dummy624 | 2.4744 | ||
(5.0784) | |||
dummy625 | -6.7328* | ||
(3.4873) | |||
dummy626 | -21.6778*** | ||
(3.7603) | |||
dummy627 | 6.7658 | ||
(4.6162) | |||
dummy628 | 3.0710 | ||
(4.4314) | |||
dummy629 | 8.4173 | ||
(7.2168) | |||
dummy63 | -9.5287** | ||
(4.4297) | |||
dummy630 | 9.8439* | ||
(5.7664) | |||
dummy631 | -22.5254*** | ||
(4.8053) | |||
dummy632 | 11.8836** | ||
(5.5717) | |||
dummy633 | -1.7426 | ||
(1.3371) | |||
dummy634 | -10.6109*** | ||
(3.9282) | |||
dummy635 | 2.1512 | ||
(3.7734) | |||
dummy636 | -1.5743 | ||
(3.2224) | |||
dummy637 | -7.3584 | ||
(6.5403) | |||
dummy638 | 11.1515** | ||
(5.5070) | |||
dummy639 | 8.3905* | ||
(4.5375) | |||
dummy64 | -2.8361 | ||
(3.1963) | |||
dummy640 | -24.4600*** | ||
(5.2040) | |||
dummy641 | 18.9985** | ||
(8.4051) | |||
dummy642 | -0.3890 | ||
(0.6080) | |||
dummy643 | 0.0471 | ||
(0.6053) | |||
dummy644 | 1.8572 | ||
(2.1264) | |||
dummy645 | 4.1029 | ||
(3.6064) | |||
dummy646 | 4.0156 | ||
(2.6657) | |||
dummy647 | -13.4345** | ||
(6.3276) | |||
dummy648 | 3.1169* | ||
(1.8136) | |||
dummy649 | -6.3358*** | ||
(2.3068) | |||
dummy65 | -3.2532 | ||
(3.1551) | |||
dummy650 | -20.4280*** | ||
(4.3601) | |||
dummy651 | 33.1622*** | ||
(6.3120) | |||
dummy652 | -2.3455 | ||
(1.8722) | |||
dummy653 | -4.3948** | ||
(1.8608) | |||
dummy66 | -10.2019*** | ||
(3.1868) | |||
dummy67 | -5.8392* | ||
(3.0175) | |||
dummy68 | 0.3705 | ||
(3.0876) | |||
dummy69 | 3.7853 | ||
(3.7941) | |||
dummy7 | 3.5042 | ||
(3.8723) | |||
dummy70 | -0.4388 | ||
(2.4990) | |||
dummy71 | 3.3393 | ||
(3.1608) | |||
dummy72 | -3.8643 | ||
(2.7953) | |||
dummy73 | -3.3661 | ||
(2.4850) | |||
dummy74 | -2.3614 | ||
(2.3506) | |||
dummy75 | -1.0220 | ||
(2.9960) | |||
dummy76 | -6.2496** | ||
(3.0759) | |||
dummy77 | -2.4332 | ||
(3.6609) | |||
dummy78 | 0.6241 | ||
(2.7071) | |||
dummy79 | -3.5744 | ||
(2.3544) | |||
dummy8 | 4.5546 | ||
(4.8323) | |||
dummy80 | 0.8569 | ||
(2.9020) | |||
dummy81 | -5.0199* | ||
(2.7231) | |||
dummy82 | 5.5795* | ||
(2.9225) | |||
dummy83 | 0.6180 | ||
(2.5043) | |||
dummy84 | 2.8232 | ||
(2.8276) | |||
dummy85 | -3.1661 | ||
(3.5645) | |||
dummy86 | 2.7656 | ||
(3.0703) | |||
dummy87 | -3.0965 | ||
(3.3622) | |||
dummy88 | 0.6002 | ||
(3.0024) | |||
dummy89 | 3.3502 | ||
(2.9704) | |||
dummy9 | 2.9014 | ||
(4.4109) | |||
dummy90 | 0.3399 | ||
(2.9783) | |||
dummy91 | 1.2140 | ||
(2.9840) | |||
dummy92 | -4.8182* | ||
(2.6277) | |||
dummy93 | 3.0407 | ||
(3.0534) | |||
dummy94 | -2.0571 | ||
(2.6061) | |||
dummy95 | -0.4011 | ||
(2.9925) | |||
dummy96 | 2.4012 | ||
(2.8159) | |||
dummy97 | 4.1502 | ||
(2.8870) | |||
dummy98 | 1.1011 | ||
(2.6796) | |||
dummy99 | 2.7900 | ||
(3.8928) |
def partial_linear(y, d, X, yestimator, destimator, folds=3):
"""Estimate the partially linear model y = d*C + f(x) + e
Parameters
----------
y : array_like
vector of outcomes
d : array_like
vector or matrix of regressors of interest
X : array_like
matrix of controls
mlestimate : Estimator object for partialling out X. Must have ‘fit’
and ‘predict’ methods.
folds : int
Number of folds for cross-fitting
Returns
-------
ols : statsmodels regression results containing estimate of coefficient on d.
yhat : cross-fitted predictions of y
dhat : cross-fitted predictions of d
"""
# we want predicted probabilities if y or d is discrete
ymethod = "predict" if False==getattr(yestimator, "predict_proba",False) else "predict_proba"
dmethod = "predict" if False==getattr(destimator, "predict_proba",False) else "predict_proba"
# get the predictions
yhat = cross_val_predict(yestimator,X,y,cv=folds,method=ymethod)
dhat = cross_val_predict(destimator,X,d,cv=folds,method=dmethod)
ey = np.array(y - yhat)
ed = np.array(d - dhat)
ols = sm.regression.linear_model.OLS(ey,ed).fit(cov_type='HC0')
return(ols, yhat, dhat)
# Prepare data
formula="Q('Ideology Score') + Q('Absolute Ideology') + Politician ~ " + composition_formula + dummies_formula
yd, X = dmatrices(formula,political_judges)
ideo = yd[:,0]
abs_ideo = yd[:,1]
politician = yd[:,2]
# We use another list of alphas compared to the above, so this is number 2
alphas2 = np.exp(np.linspace(1.5, -10., 25))
lasso_ideo = linear_model.LassoCV(cv=6, alphas=alphas2, max_iter=500).fit(X,ideo)
lasso_abs_ideo = linear_model.LassoCV(cv=6, alphas=alphas2, max_iter=500).fit(X,abs_ideo)
lasso_politician = linear_model.LassoCV(cv=6, alphas=alphas2, max_iter=500).fit(X,politician)
fig, ax = plt.subplots(1,3, figsize=(15,5))
# Plotting the MSE for the two outcomes and the explanatory variable, "Politician"
def plotlassocv(l, ax) :
alphas = l.alphas_
mse = l.mse_path_.mean(axis=1)
std_error = l.mse_path_.std(axis=1)
ax.plot(alphas,mse)
ax.fill_between(alphas, mse + std_error, mse - std_error, alpha=0.2)
ax.set_ylabel('MSE +/- std error')
ax.set_xlabel('alpha')
ax.set_xlim([alphas[0], alphas[-1]])
ax.set_xscale("log")
return(ax)
ax[0] = plotlassocv(lasso_ideo,ax[0])
ax[0].set_title("MSE for Ideology Score")
ax[1] = plotlassocv(lasso_abs_ideo,ax[1])
ax[1].set_title("MSE for Absolute Ideology")
ax[2] = plotlassocv(lasso_politician,ax[2])
ax[2].set_title("MSE for Politician")
fig.tight_layout()
C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems.
# Summarizing the lasso model partial regression
pl_lasso_ideo = partial_linear(ideo, politician, X,
linear_model.Lasso(alpha=lasso_ideo.alpha_),
linear_model.Lasso(alpha=lasso_politician.alpha_))
pl_lasso_ideo[0].summary()
C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems.
Dep. Variable: | y | R-squared: | 0.000 |
---|---|---|---|
Model: | OLS | Adj. R-squared: | -0.001 |
Method: | Least Squares | F-statistic: | 0.02221 |
Date: | Sun, 21 Apr 2019 | Prob (F-statistic): | 0.882 |
Time: | 18:35:11 | Log-Likelihood: | -5708.4 |
No. Observations: | 1420 | AIC: | 1.142e+04 |
Df Residuals: | 1419 | BIC: | 1.142e+04 |
Df Model: | 1 | ||
Covariance Type: | HC0 |
coef | std err | z | P>|z| | [0.025 | 0.975] | |
---|---|---|---|---|---|---|
x1 | 0.1924 | 1.291 | 0.149 | 0.882 | -2.338 | 2.723 |
Omnibus: | 45.691 | Durbin-Watson: | 2.000 |
---|---|---|---|
Prob(Omnibus): | 0.000 | Jarque-Bera (JB): | 115.136 |
Skew: | 0.056 | Prob(JB): | 9.97e-26 |
Kurtosis: | 4.390 | Cond. No. | 1.00 |
# Now for absolute ideology
pl_lasso_abs_ideo = partial_linear(abs_ideo, politician, X,
linear_model.Lasso(alpha=lasso_abs_ideo.alpha_),
linear_model.Lasso(alpha=lasso_politician.alpha_))
pl_lasso_abs_ideo[0].summary()
Dep. Variable: | y | R-squared: | 0.001 |
---|---|---|---|
Model: | OLS | Adj. R-squared: | -0.000 |
Method: | Least Squares | F-statistic: | 0.5756 |
Date: | Sun, 21 Apr 2019 | Prob (F-statistic): | 0.448 |
Time: | 18:35:13 | Log-Likelihood: | -5762.4 |
No. Observations: | 1420 | AIC: | 1.153e+04 |
Df Residuals: | 1419 | BIC: | 1.153e+04 |
Df Model: | 1 | ||
Covariance Type: | HC0 |
coef | std err | z | P>|z| | [0.025 | 0.975] | |
---|---|---|---|---|---|---|
x1 | -1.0393 | 1.370 | -0.759 | 0.448 | -3.724 | 1.646 |
Omnibus: | 31.882 | Durbin-Watson: | 1.942 |
---|---|---|---|
Prob(Omnibus): | 0.000 | Jarque-Bera (JB): | 18.034 |
Skew: | 0.085 | Prob(JB): | 0.000121 |
Kurtosis: | 2.475 | Cond. No. | 1.00 |
# Fitting the forest model
forest_ideo = RandomForestRegressor(n_estimators = 100).fit(X,ideo)
forest_abs_ideo = RandomForestRegressor(n_estimators = 100).fit(X,abs_ideo)
fores_politician = RandomForestRegressor(n_estimators = 100).fit(X,politician)
# Summarizing the partial linear regression with Random Forests
pl_forest_ideo = partial_linear(ideo, politician, X,
RandomForestRegressor(n_estimators = 100),
RandomForestRegressor(n_estimators = 100))
pl_lasso_ideo[0].summary()
Dep. Variable: | y | R-squared: | 0.000 |
---|---|---|---|
Model: | OLS | Adj. R-squared: | -0.001 |
Method: | Least Squares | F-statistic: | 0.02221 |
Date: | Sun, 21 Apr 2019 | Prob (F-statistic): | 0.882 |
Time: | 18:35:57 | Log-Likelihood: | -5708.4 |
No. Observations: | 1420 | AIC: | 1.142e+04 |
Df Residuals: | 1419 | BIC: | 1.142e+04 |
Df Model: | 1 | ||
Covariance Type: | HC0 |
coef | std err | z | P>|z| | [0.025 | 0.975] | |
---|---|---|---|---|---|---|
x1 | 0.1924 | 1.291 | 0.149 | 0.882 | -2.338 | 2.723 |
Omnibus: | 45.691 | Durbin-Watson: | 2.000 |
---|---|---|---|
Prob(Omnibus): | 0.000 | Jarque-Bera (JB): | 115.136 |
Skew: | 0.056 | Prob(JB): | 9.97e-26 |
Kurtosis: | 4.390 | Cond. No. | 1.00 |
# Absolute ideology
pl_forest_abs_ideo = partial_linear(abs_ideo, politician, X,
RandomForestRegressor(n_estimators = 100),
RandomForestRegressor(n_estimators = 100))
pl_forest_abs_ideo[0].summary()
Dep. Variable: | y | R-squared: | 0.000 |
---|---|---|---|
Model: | OLS | Adj. R-squared: | -0.001 |
Method: | Least Squares | F-statistic: | 0.06898 |
Date: | Sun, 21 Apr 2019 | Prob (F-statistic): | 0.793 |
Time: | 18:36:22 | Log-Likelihood: | -5252.3 |
No. Observations: | 1420 | AIC: | 1.051e+04 |
Df Residuals: | 1419 | BIC: | 1.051e+04 |
Df Model: | 1 | ||
Covariance Type: | HC0 |
coef | std err | z | P>|z| | [0.025 | 0.975] | |
---|---|---|---|---|---|---|
x1 | -0.2503 | 0.953 | -0.263 | 0.793 | -2.118 | 1.618 |
Omnibus: | 52.141 | Durbin-Watson: | 1.961 |
---|---|---|---|
Prob(Omnibus): | 0.000 | Jarque-Bera (JB): | 135.897 |
Skew: | -0.108 | Prob(JB): | 3.09e-30 |
Kurtosis: | 4.500 | Cond. No. | 1.00 |
#Summarizing the neural network model's partial linear regression
pl_nn_ideo = partial_linear(ideo, politician, X,
nn_scaled_model, #from above
nn_scaled_model)
pl_nn_ideo[0].summary()
C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\neural_network\multilayer_perceptron.py:562: ConvergenceWarning: Stochastic Optimizer: Maximum iterations (200) reached and the optimization hasn't converged yet. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\neural_network\multilayer_perceptron.py:562: ConvergenceWarning: Stochastic Optimizer: Maximum iterations (200) reached and the optimization hasn't converged yet. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\neural_network\multilayer_perceptron.py:562: ConvergenceWarning: Stochastic Optimizer: Maximum iterations (200) reached and the optimization hasn't converged yet.
Dep. Variable: | y | R-squared: | 0.000 |
---|---|---|---|
Model: | OLS | Adj. R-squared: | -0.001 |
Method: | Least Squares | F-statistic: | 0.009375 |
Date: | Sun, 21 Apr 2019 | Prob (F-statistic): | 0.923 |
Time: | 18:37:15 | Log-Likelihood: | -5852.5 |
No. Observations: | 1420 | AIC: | 1.171e+04 |
Df Residuals: | 1419 | BIC: | 1.171e+04 |
Df Model: | 1 | ||
Covariance Type: | HC0 |
coef | std err | z | P>|z| | [0.025 | 0.975] | |
---|---|---|---|---|---|---|
x1 | -0.1078 | 1.113 | -0.097 | 0.923 | -2.290 | 2.074 |
Omnibus: | 108.136 | Durbin-Watson: | 2.001 |
---|---|---|---|
Prob(Omnibus): | 0.000 | Jarque-Bera (JB): | 422.939 |
Skew: | -0.263 | Prob(JB): | 1.45e-92 |
Kurtosis: | 5.621 | Cond. No. | 1.00 |
pl_nn_abs_ideo = partial_linear(abs_ideo, politician, X,
nn_scaled_model,
nn_scaled_model)
pl_nn_abs_ideo[0].summary()
C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\neural_network\multilayer_perceptron.py:562: ConvergenceWarning: Stochastic Optimizer: Maximum iterations (200) reached and the optimization hasn't converged yet. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\neural_network\multilayer_perceptron.py:562: ConvergenceWarning: Stochastic Optimizer: Maximum iterations (200) reached and the optimization hasn't converged yet. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\neural_network\multilayer_perceptron.py:562: ConvergenceWarning: Stochastic Optimizer: Maximum iterations (200) reached and the optimization hasn't converged yet.
Dep. Variable: | y | R-squared: | 0.001 |
---|---|---|---|
Model: | OLS | Adj. R-squared: | 0.000 |
Method: | Least Squares | F-statistic: | 1.219 |
Date: | Sun, 21 Apr 2019 | Prob (F-statistic): | 0.270 |
Time: | 18:38:10 | Log-Likelihood: | -5843.2 |
No. Observations: | 1420 | AIC: | 1.169e+04 |
Df Residuals: | 1419 | BIC: | 1.169e+04 |
Df Model: | 1 | ||
Covariance Type: | HC0 |
coef | std err | z | P>|z| | [0.025 | 0.975] | |
---|---|---|---|---|---|---|
x1 | -1.1489 | 1.041 | -1.104 | 0.270 | -3.189 | 0.891 |
Omnibus: | 12.113 | Durbin-Watson: | 1.942 |
---|---|---|---|
Prob(Omnibus): | 0.002 | Jarque-Bera (JB): | 13.104 |
Skew: | 0.175 | Prob(JB): | 0.00143 |
Kurtosis: | 3.315 | Cond. No. | 1.00 |
print("Outcome: Ideology (positive = conservative)")
summary_col([pl_lasso_ideo[0], pl_forest_ideo[0],pl_nn_ideo[0]],
model_names=["Lasso", "Random Forest","Neural Network"] ,stars=False)
Outcome: Ideology (positive = conservative)
Lasso | Random Forest | Neural Network | |
---|---|---|---|
x1 | 0.1924 | -0.6276 | -0.1078 |
(1.2910) | (0.9753) | (1.1133) |
print("Outcome: Absolute Ideology")
summary_col([pl_lasso_abs_ideo[0], pl_forest_abs_ideo[0], pl_nn_abs_ideo[0]],
model_names=["Lasso", "Random Forest","Neural Network"],stars=False)
Outcome: Absolute Ideology
Lasso | Random Forest | Neural Network | |
---|---|---|---|
x1 | -1.0393 | -0.2503 | -1.1489 |
(1.3698) | (0.9531) | (1.0408) |
Overall, due to the imprecise (and somewhat noisy estimates across methods), we don't have evidence that past political experience is highly correlated with either ideology or absolute ideology. For absolute ideology, there is suggestive evidence that past political experience is correlated with more ideologically centrist judges (lower absolute ideology). The story for raw ideology as the outcome is less clear, as the coefficients have different signs across methods.
We now turn to our final dataset, which contains every decision made by US Federal District Courts that can be categorized as political - over 100000 in total. We begin by showing key characteristics of the data.
# We only need some of this data
judge_decisions = decision_data[['Authoring Judge','Court Location','Number of Judges','Circuit','Year','Decision Ideology',
'Case Type','Case Category','Year of Appointment','Appointing President','Judge Party',
'Gender','Race','Year of Birth','ABA Rating','Congress','Unity']].copy()
# We begin by converting the decision ideology, which is either liberal or conservative, into a dummy.
def libcon_dummy(ideology):
if ideology == 'Conservative':
return 100
if ideology == 'Liberal':
return -100
else:
return np.nan
judge_decisions['Decision Ideology'] = judge_decisions['Decision Ideology'].apply(libcon_dummy)
# Here is what the data looks like
judge_decisions.head()
Authoring Judge | Court Location | Number of Judges | Circuit | Year | Decision Ideology | Case Type | Case Category | Year of Appointment | Appointing President | Judge Party | Gender | Race | Year of Birth | ABA Rating | Congress | Unity | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | Avis, John Boyd | Camden, NJ | 1 | 3RD CIRCUIT | 1932 | 100 | alien petitions | Civil Liberties/Rights Cases | 1929 | HOOVER | Republican | male | white/caucasian | 1875.0 | Not Rated | 78TH | Unified |
1 | Avis, John Boyd | Camden, NJ | 1 | 3RD CIRCUIT | 1932 | 100 | alien petitions | Civil Liberties/Rights Cases | 1929 | HOOVER | Republican | male | white/caucasian | 1875.0 | Not Rated | 78TH | Unified |
2 | Strum, Louie W. | Jacksonville, FL | 1 | 5TH CIRCUIT | 1932 | 100 | (non)conv-criminal case | Criminal Justice Cases | 1931 | HOOVER | Democrat | male | white/caucasian | 1890.0 | Not Rated | 81ST | Divided, House |
3 | Moscowitz, Grover | Brooklyn, NY | 5 | 2ND CIRCUIT | 1932 | 100 | criminal court motions | Criminal Justice Cases | 1925 | COOLIDGE | Republican | male | white/caucasian | 1886.0 | Not Rated | 80TH | Unified |
4 | Cochran, Andrew | Maysville, KY | 1 | 6TH CIRCUIT | 1932 | -100 | voting rights | Civil Liberties/Rights Cases | 1901 | MCKINLEY | Republican | male | white/caucasian | 1854.0 | Not Rated | 73RD | Unified |
First, we plot the average decision ideology by case type.
# Get the list of case types with more than 1000 cases
high_vol_types = judge_decisions[['Case Type','Authoring Judge']].groupby('Case Type').count().reset_index()
high_vol_types['High Vol'] = [1 if count >= 1000 else 0 for count in high_vol_types['Authoring Judge']]
high_vol_types = high_vol_types[high_vol_types['High Vol'] == 1]
high_vol_types = high_vol_types.drop(columns = ['Authoring Judge','High Vol'])
ideology_by_type = (judge_decisions[['Case Type','Decision Ideology']].groupby('Case Type')
.mean().sort_values('Decision Ideology').reset_index())
ideology_by_type = ideology_by_type.merge(high_vol_types, on = 'Case Type', how = 'right')
plt.style.use("fivethirtyeight")
fig, ax = plt.subplots(figsize=(11,8.5))
ax.set_facecolor('white')
ax.grid(False)
ax.set_title("Average Ideological Result by Case Type")
ax.set_xlabel("Average Ideological Score")
colors = ["b" if x < 0 else "r" for x in ideology_by_type['Decision Ideology'].values]
ideology_by_type.plot(kind = 'barh', x = 'Case Type', y = 'Decision Ideology', ax = ax, color = colors, legend = False)
<matplotlib.axes._subplots.AxesSubplot at 0x3826fe0f60>
Nothing too crazy is happening here - certain types seem to be prone to a certain ideological result, but everything seems balanced overall. Next, we explore how the results have changed over time, and how they depend on judge ideology.
ideology_by_party_year = (judge_decisions[['Year','Judge Party','Decision Ideology']].groupby(['Year','Judge Party',])
.mean().reset_index())
ideology_by_party_year = ideology_by_party_year[(ideology_by_party_year['Judge Party'] == 'Democrat') |
(ideology_by_party_year['Judge Party'] == 'Republican')]
# 1933 is first year where both parties are present
ideology_by_party_year = ideology_by_party_year[ideology_by_party_year['Year'] >= 1933]
democrats = ideology_by_party_year["Judge Party"] == "Democrat"
republicans = ideology_by_party_year["Judge Party"] == "Republican"
fig, ax = plt.subplots(figsize=(11,8.5))
ax.set_facecolor('white')
ax.grid(False)
ax.plot(ideology_by_party_year[republicans]["Year"],
ideology_by_party_year[republicans]["Decision Ideology"],"-o",label="Republicans",color='r')
ax.plot(ideology_by_party_year[democrats]["Year"],
ideology_by_party_year[democrats]["Decision Ideology"],"-o",label="Democrats",color='b')
ax.legend()
ax.set_title("Decision Ideology By Judge Party and Time")
ax.set_xlabel("Year")
ax.set_ylabel("Mean Decision Ideology Score")
Text(0, 0.5, 'Mean Decision Ideology Score')
Between 1930 and 1970, Democratic and Republican judges were practically indistinguishable! But since 1970, there has been a sharp divide, with judges sticking to their ideology more consistently. However, a similar trend appears for both parties. Overall, results seem to generally be more conservative. Since presidents appoint these judges, it is interesting to ask how results vary by appointing president. Could this be why things have changed since 1970?
ideology_by_app_pres = (judge_decisions[judge_decisions['Year of Appointment']>=1933]
[['Appointing President','Decision Ideology']]
.groupby(['Appointing President'])
.mean().reset_index().reindex([9,12,2,0,10,1,5,8,6,7,3,11,4]))
fig, ax = plt.subplots(figsize=(11,8.5))
ax.set_facecolor('white')
ax.grid(False)
ax.set_title("Average Ideological Result by Appointing President")
ax.set_xlabel("Average Ideological Score")
colors = ["b" if x in ['F. ROOSEVELT','TRUMAN','KENNEDY','JOHNSON','CARTER','CLINTON','OBAMA']
else "r" for x in ideology_by_app_pres['Appointing President'].values]
ideology_by_app_pres.plot(kind = 'barh', x = 'Appointing President', y = 'Decision Ideology',
ax = ax, color = colors, legend = False)
<matplotlib.axes._subplots.AxesSubplot at 0x3812a4fc18>
This seems to explain some of the results! Roosevelt, Truman and Kennedy's Judges voted more conservative despite being appointed by a Democrat! Judges have generally stuck to their appointing president's ideology since then. What if, however, party and president have nothing to do with these decisions? Could personal attributes of judges drive their decision-making?
ideology_by_gen_race = (judge_decisions[judge_decisions['Race'].isin(
['African-American/black','Asian-American','Latino/Hispanic','white/caucasian'])]
.pivot_table(index='Race', columns='Gender', values='Decision Ideology', margins=True))
ideology_by_gen_race
Gender | female | male | All |
---|---|---|---|
Race | |||
African-American/black | 1.870748 | 5.016212 | 4.439944 |
Asian-American | -14.754098 | 5.413105 | 0.211416 |
Latino/Hispanic | 5.091650 | 26.355388 | 24.271457 |
white/caucasian | 12.628256 | 15.822735 | 15.497959 |
All | 10.976939 | 15.695166 | 15.190996 |
This seems to be the case! Overall, male judges vote more conservatively than female judges. Meanwhile, Afrian-American and Asian-American judges are more liberal than the rest. However, when comparing the overall mean to the mean for white male judges, we realize that these are practically the same. The majority of judges are indeed white men - so while this might explain some individual nuances, it can't be driving the large divergence. Finally, we ask: could this be due to differences in the quality of judges?
ideology_by_rating = (judge_decisions[judge_decisions['ABA Rating'].isin(
['Not Rated','Well-Qual.','Qualified','Not Qualified','Excep. Well-Qual.']) &
judge_decisions['Judge Party'].isin(['Democrat','Republican'])]
.groupby(['ABA Rating','Judge Party'])[['Decision Ideology']].mean()
.unstack().reset_index().reindex([2,1,3,4,0]))
ideology_by_rating.columns = ['ABA Rating','Democrat','Republican']
# Add counts of each rating-party pair
count_by_rating = (judge_decisions[judge_decisions['ABA Rating'].isin(
['Not Rated','Well-Qual.','Qualified','Not Qualified','Excep. Well-Qual.']) &
judge_decisions['Judge Party'].isin(['Democrat','Republican'])]
.groupby(['ABA Rating','Judge Party'])[['Decision Ideology']].count().unstack().reset_index())
count_by_rating.columns = ['ABA Rating','Democrat Count','Republican Count']
ideology_by_rating = ideology_by_rating.merge(count_by_rating, on = 'ABA Rating')
fig, ax = plt.subplots(figsize=(11,8.5))
ax.set_facecolor('white')
ax.grid(False)
ideology_by_rating.plot(kind = 'bar', x = 'ABA Rating', y = ['Democrat','Republican'], ax = ax, color =['b','r'])
ax.set_title("Average Ideological Result by ABA Rating and Party")
ax.set_ylabel("Average Ideological Result")
for i, v in enumerate(ideology_by_rating['Democrat'].values):
text = ideology_by_rating[ideology_by_rating['Democrat'] == v]['Democrat Count'].iloc[0]
if v > 0:
ax.text(i - 0.25 , v + 1, text, color='b', fontdict = {'size': 10})
else:
ax.text(i - 0.25 , v - 1, text, color='b', fontdict = {'size': 10})
for i, v in enumerate(ideology_by_rating['Republican'].values):
text = ideology_by_rating[ideology_by_rating['Republican'] == v]['Republican Count'].iloc[0]
if v > 0:
ax.text(i + 0.05, v + 1, text, color='r', fontdict = {'size': 10})
else:
ax.text(i + 0.05, v - 1, text, color='r', fontdict = {'size': 10})
There is practically no difference in decision-making between judges that are not rated or not qualified, according to the ABA. However, we see that qualified, well-qualified, and exceptionally well-qualified judges are much more likely to default to their own ideology! Exceptionally well-qualified democratic judges hold this bias so hard that their mean decision is liberal, despite mean decisions generally being conservative. It seems that more qualified judges are also more ideological.
Visually, it seems that a combination of factors, including case type, year, judge party, appointing president, ABA rating, gender and ethnicity, are determining factors in how judges make decisions. We ask one final question: is this complete? That is to say, do these factors combined account for everything? We run some statistical models to find out.
# We clean the data some more and take a new subset with more factors
decisions = decision_data[list(judge_decisions) + ['House Democrats','House Republicans','Senate Democrats',
'Senate Republicans','House Independents','Senate Independents',
'Recess Appointment']]
decisions = decisions.drop(columns = ['Authoring Judge'])
decisions = decisions.dropna()
# We again convert the decision ideology, which is either liberal or conservative, into a dummy.
def libcon_dummy(ideology):
if ideology == 'Conservative':
return 1
if ideology == 'Liberal':
return 0
else:
return np.nan
decisions['Decision Ideology'] = decisions['Decision Ideology'].apply(libcon_dummy)
# Categorical variables
categories_dec = ['Court Location', 'Circuit', 'Case Type', 'Case Category', 'Appointing President', 'Judge Party', 'Gender',
'Race', 'ABA Rating', 'Congress', 'Unity', 'Recess Appointment']
# Continuous variables
continuous_variables_dec = list(filter(lambda col: col not in categories_dec + ['Decision Ideology'], list(decisions)))
# Split into test and train
X_dec_train, X_dec_test, y_dec_train, y_dec_test = prep_data(
decisions, continuous_variables_dec, categories_dec, 'Decision Ideology'
)
# A bunch of different models
alphas = np.exp(np.linspace(-2., -12., 25))
lr_model = linear_model.LinearRegression(n_jobs = 100)
logistic_model = linear_model.LogisticRegression(solver="liblinear", max_iter = 1000, n_jobs = 100)
lasso_model = linear_model.LassoCV(cv=6, alphas = alphas, max_iter=500, n_jobs = 100)
forest_model = RandomForestRegressor(n_estimators = 100, n_jobs = 100)
nn_scaled_model = pipeline.make_pipeline(
preprocessing.StandardScaler(), # this will do the input scaling
neural_network.MLPRegressor((150,),activation = "logistic",
solver="adam",alpha=0.005))
models = { "OLS": lr_model, "Logistic": logistic_model, "Lasso": lasso_model,
"Random Forest": forest_model, "Neural Network":nn_scaled_model}
MSE_by_model = pd.DataFrame(index = models.keys(),
columns= ["Train MSE","Test MSE"])
mse_list = [fit_and_report_mses(model,X_dec_train, X_dec_test, y_dec_train, y_dec_test) for model in models.values()]
MSE_by_model['Train MSE'] = ['%f' % result["mse_train"] for result in mse_list]
MSE_by_model['Test MSE'] = ['%f' % result["mse_test"] for result in mse_list]
MSE_by_model
C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\logistic.py:1297: UserWarning: 'n_jobs' > 1 does not have any effect when 'solver' is set to 'liblinear'. Got 'n_jobs' = 100. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems. C:\Users\Ian\Anaconda3\lib\site-packages\sklearn\linear_model\coordinate_descent.py:492: ConvergenceWarning: Objective did not converge. You might want to increase the number of iterations. Fitting data with very small alpha may cause precision problems.
Train MSE | Test MSE | |
---|---|---|
OLS | 0.216954 | 3045509606943.511719 |
Logistic | 0.348573 | 0.351613 |
Lasso | 0.217721 | 0.219440 |
Random Forest | 0.063066 | 0.240465 |
Neural Network | 0.176032 | 0.226521 |
dev = st.stdev(decisions['Decision Ideology'])
print(f'The standard deviation for decision ideology is {dev}.')
The standard deviation for decision ideology is 0.4953091925451147.
OLS does a terrible job of predicting the data! Clearly the relationship between these factors and judge decision making is not linear. However, when fed into logistic regression, lasso, random forests, and neural networks, the predictive capacity becomes extremely strong! All MSEs are much lower than the standard deviation. Clearly there is strong predictive power from these attributes.
We unfortunately do not estimate nuisance function due to the complications induced by the fact that our regressors of interest are categorical as opposed to dummy variables.