# Attention Report¶

### 31st July 2014 Neil D. Lawrence¶

This notebook contains scripts for emailing area chairs notifying them of potential problems with the papers allocated to them. The script goes through the calibrated reviews (as generated by this notebook) and seeks papers which seem problematic in terms of either the span of the review scores, the confidence of the reviewers, the length of the reviews or those that are in the 'grey area' for publication. For each paper it creates a set of comments, which is then emailed out to area chairs.

In [ ]:
import cmtutils
import pandas as pd
import os


Firstly we read in the processed reviews. The processing includes the calibrated review scores and the probability of accept.

In [ ]:
revs = pd.io.parsers.read_csv(os.path.join(cmtutils.cmt_data_directory,
'2014-08-02_processed_reviews.csv'),
dtype={'PaperID':object})
revs.set_index(keys='PaperID', inplace=True)
revs.fillna('', inplace=True)


We also load in the area chair assignments.

In [ ]:
report = cmtutils.review_report(calibrated_reviews=revs)


Now that the reports have been generated, load the area chair assignments so we know who to notify about problems.

In [ ]:
a = cmtutils.assignment()


Now we can email out the report. We use software written for using gmail for this purpose. The gmail user name that is used is set inside .ods_user.cfg in the users home directory or in defaults.cfg in the directory where pods is installed.

In [ ]:
from pods import email
mailer = email.gmail()


You'll need to check the console where you launched the notebook from to input your gmail password. Now we can construct the reports for the individual area chairs from the overall attention report. Since for NIPS this command sends 92 emails to the area chairs, it is currently 'switched off' in this notebook with an if False: statement. Simply set False to True to send mails.

In [ ]:
if False:
for reviewer in a.assignment_reviewer['metareviewer']:
recipient=reviewer