Assignment Differences

8th July 2014 Neil D. Lawrence

During the review process there are problems with some reviewers not managing to complete their allocation. Or there may be more expertise required on an individual paper. Unfortunately, when a reviewer's allocation changes, they are not necessariliy informed. We developed scripts to check what the difference between two allocations was.

Here we load in two assignment files and compute the differences so that those who have gained assignments can be emailed to let them know. The first thing to do is load in the two assignment files. First we load in an assignment from the 1st July.

In [ ]:
import cmtutils
a1 = cmtutils.assignment()
a1.load_assignment('2014-07-01_reviewer_assignments.txt')

Now we load in an assignment from the 8th July.

In [ ]:
a2 = cmtutils.assignment()
a2.load_assignment('2014-07-08_reviewer_assignments.txt')

Now the difference can be computed.

In [ ]:
d = a1.diff(a2)

And those reviewers who have gained a review can be shown by joining them with a list.

In [ ]:
';'.join(d.gain_reviewer['reviewer'])

Similarly those who've lost a review can also be seen.

In [ ]:
';'.join(a1.diff(a2).loss_reviewer['reviewer'])