Go to Peer review > Form to access the reviewing form.
Note: Peer review is available from the Advanced plan. If your plan doesn't include it, Peer review shows in the menu with a diamond icon. Click it to see how to upgrade.
Edit the reviewing form
Add a form section
Click Add section to create a form section that will contain your form fields. You need at least one section. Enter a title for this section and a description (optional).
Configure form fields
You can add any field you like to the reviewing form to collect feedback from reviewers. See the form management section for more information.
Reviewing forms have a specific field type: Score. A score field type allows the reviewer to choose a score between 1 and X. The value of X can be from 1 to 25.
This is what a score field from 1 to 5 looks like for the reviewer:
Tip: We recommend adding at least 2 or 3 fields of type Score. These fields are used to calculate a numerical score for each submission.
Edit the reviewing period
Under Settings, you can change the reviewing period, that is, the period within which reviewers can complete their assigned reviews. Outside those dates, only the organizers can modify the form.
In the example below, the reviewing period is set to February 1st 2024 19:00 to February 29th 2024 at noon.
Set the reviewer assignment rules
Under Settings, the Reviewer assignment section holds the rules used when you assign submissions to reviewers. The Assign reviewers window shows them as read-only, with an Edit link that brings you back to this page.
Target reviews per submission: the number of reviews each submission should receive (at least 1). The automated method uses it to distribute submissions, and the Confirmation step of the Assign reviewers window warns you when some submissions will not reach this target.
Limit reviewer workload: turn it on to cap the number of reviews a reviewer can be assigned, then enter the Max reviewer workload (at least 1). The limit applies to the whole event, to both assignment methods and across all assignment rounds.
Tracks matching mode: how the automated method pairs reviewers and submissions based on their tracks.
Force track match: reviewers are only assigned submissions in their assigned tracks.
Try to match: reviewers are assigned submissions in their own tracks as much as possible, but cross-track assignments are allowed if necessary.
Ignore track matching: reviewers may be assigned to any submission, regardless of the track.
In the example below, each submission should receive 2 reviews, a reviewer can be assigned at most 6 reviews, and Try to match is selected.
Note: the Tracks matching mode requires tracks management, which is available with the Pro plan. Without it, the options are locked.
See Assign submissions to reviewers to learn how these settings are used.
Select the fields visible to reviewers
The Fields visible to reviewers list holds the fields of your submission form. You don't need to add them to the review form. New submission fields are visible to reviewers by default.
You can select which fields are visible to reviewers. This is useful to hide data like authors, or submitter information that is not relevant for the review and that could bias the reviews.
For example, you can make only the title, topic and abstract visible to reviewers. Here's how to select which fields are visible to reviewers:
Go to your review form and click Settings.
Under Fields visible to reviewers, select the fields you want visible. You can select multiple fields from the dropdown menu.
In the example below only the title, abstract and topic were selected.
Note 1: the title and abstract are always visible to reviewers. They can't be hidden from reviewers.
Note 2: when organizers are looking at the reviews from the event dashboard, they see all fields, even those not selected in this dropdown menu. Reviewers, from their review panel only see the selected fields.
Questions
Why can't reviewers see a submission field?
Check that the field is selected under Fields visible to reviewers, in the Settings of the review form. Reviewers never see fields that are for organizers only.
Can I create a second reviewing form or a separate group of reviewers?
No. Each event has one reviewing form, and all reviewers use it. Reviewers are not split into groups.
To collect different feedback for different submissions, add a Dropdown or Single select field to the form, for example "Review type". Then open another field, go to its Conditions tab, and select Conditional. Choose Visible only when a given option is selected. The reviewer sees that field only after they choose the option.