Bulk assignments
The bulk assignments page offers fine-grained control over review assignments, tags, leads, shepherds, and many other aspects of site operation. Users upload a CSV (comma-separated value file) to prepare an assignment. HotCRP will display the consequences of the requested assignment for confirmation and approval.
Assignment CSVs contain paper
and action
columns,
where paper
determines which submissions are affected and
action
determines what kind of assignment is performed. The
paper
column can be a simple submission number, like “10”, or a
search string, like “#manny OR #ramirez”. Other parameter columns depend
on action. For instance, the tag
action uses the tag
column to determine what tag to add. Actions requiring a user locate that user
via the email
, name
, first name
,
last name
, and/or user
columns.
This example file clears existing R1 review assignments for papers tagged #redo, then assigns two primary reviews for submission #1 and one secondary review for submission #2:
paper,action,email,round #redo,clearreview,all,R1 1,primary,man@alice.org 2,secondary,slugger@manny.com 1,primary,slugger@manny.com
Errors will be reported if man@alice.org
or
slugger@manny.com
aren’t PC members, or if they have conflicts
with their assigned papers.
Assignment files are parsed from top to bottom, but applied as a unit. For example, if a file clears and then recreates a existing review assignment, HotCRP will leave the existing assignment alone.
Action overview
Action name | Parameter columns | Description |
---|---|---|
review | paper , user , review type , [review round ] | Assign review |
clearreview | paper , user , [review type ], [review round ] | Remove review assignment |
externalreview | paper , user , [review round ] | Assign external review |
metareview | paper , user , [review round ] | Assign metareview |
pcreview | paper , user , [review round ] | Assign optional PC review |
primaryreview | paper , user , [review round ] | Assign primary review |
secondaryreview | paper , user , [review round ] | Assign secondary review |
administrator | paper , user | Set submission administrator |
conflict | paper , user , [conflict type ] | Set PC conflict status |
contact | paper , user | Add contact author relationship |
clearcontact | paper , user | Clear contact author relationship |
decision | paper , decision | Set decision |
follow | paper , user , following | Follow or block review and comment notifications |
lead | paper , user | Set discussion lead |
pref | paper , user , preference , [expertise ] | Set reviewer preference |
shepherd | paper , user | Set shepherd |
submit | paper | Mark submission as ready for review |
revive | paper | Revive (unwithdraw) submission |
unsubmit | paper | Mark submission as not ready for review |
withdraw | paper | Withdraw submission |
tag | paper , tag , [tag value ] | Modify tag |
cleartag | paper , tag | Remove tag |
nexttag | paper , tag | Add to tag order |
seqnexttag | paper , tag | Add to gapless tag order |
unsubmitreview | paper , user , [review type ], [review round ] | Unsubmit review |
Notes: The paper
parameter
can be a paper number, like “1”, or a search, like
“re:jhala #good”. Instead of a user
parameter, you can
supply email
, name
,
first name
, and/or last name
. tag
columns can contain a tag value, using “tag#value” syntax, or the value
can be supplied separately.
review
action
The review
action assigns reviews. The
review type
column sets the review type; it can be
primary
, secondary
, pcreview
(optional
PC review), meta
, or external
, or clear
to unassign the review. The optional round
or review
round
column sets the review round.
Only PC members can be assigned primary, secondary, meta-, and optional PC
reviews. Accounts will be created for new external reviewers as necessary. The
clear
action doesn’t delete reviews that have already been
entered.
The following file will create a primary review for
drew@harvard.edu
in review round R2, or, if Drew already has a
review assignment for submission #1, modify that review’s type and round:
paper,action,email,reviewtype,round 1,review,drew@harvard.edu,primary,R2
To avoid modifying an existing review, use this syntax, which means “ignore this assignment unless the current review type is ‘none’”:
paper,action,email,reviewtype,round 1,review,drew@harvard.edu,none:primary,R2
To modify an existing review (the “any
” review type only
matches existing reviews):
paper,action,email,reviewtype,round 1,review,drew@harvard.edu,any,R2
To change an existing review from round R1 to round R2:
paper,action,email,reviewtype,round 1,review,drew@harvard.edu,any,R1:R2
To change all round-R1 primary reviews to round R2:
paper,action,email,reviewtype,round all,review,all,primary,R1:R2
The primary
, secondary
, pcreview
,
metareview
, and external
actions are shorthand for
the corresponding review types.
conflict
action
The conflict type
column can be “yes”, “no”, or
a conflict type, such as “advisor” or “institutional”.
follow
action
The following
column can be “yes” (to receive
email notifications on updates to reviews and comments), “no” (to block
notifications), or “default” (to revert to the default, which is based
on the user’s site preferences).
tag
action
The tag
action controls tags. The tag
column names the tag to add; it can contain a tag value, using “tag#value”
syntax, or the value can be specified using the optional tag
value
column.
To clear a tag, use action cleartag
or tag value
clear
. For example, this file clears all #p tags with value
less than 10:
paper,action,tag p#<10,cleartag,p
To add to a tag order, use action nexttag
; to add to a gapless
tag order, use seqnexttag
. For example, this file creates a
tag order in tag #p containing submissions 4, 3, 2, 9, 10, and 6:
paper,action,tag all,cleartag,p 4,nexttag,p 3,nexttag,p 2,nexttag,p 9,nexttag,p 10,nexttag,p 6,nexttag,p