Examiner history report

The examiner history report is a longitudinal report that takes the information shown in the examiner performance report and displays this over time. This can enable you to gain insight into change over time as well as whether the examiner's marking profile is consistently hawkish or doveish. You can also distribute copies of the reports directly from the system to provide feedback to individual examiners.

Running the examiner history report

To run the examiner history report:

• Step 1 of 3

  Navigate to Reports then select Examiner History report

  

• Step 2 of 3

  Select the examiner from the dropdown list. Any examiner present in the examiner index will be available in this list.

  

  A warning will be displayed when the system detects that any exams do not have up-to-date results. The report can still be run, but those exams should be updated to ensure you are working with all the available data.

  Click Show.

Report output

This report uses the z-score metric which is a measure of how far away the examiner’s mean score lies from the cohort mean score and is expressed in standard deviations. It is calculated as the difference between the examiner’s mean score and the item's mean score divided by the item’s standard deviation.

The first part of the output shows a plotted set of z-scores for the examiner's marking profile in all the exams they have contributed to. 

It uses the z-score index on the x-axis and dates on the y-axis to present the information longitudinally. In the image above you can see each exam represented a yellow dot.

These points are also presented in table format underneath, so you can see the actual values being plotted as well as the dates of each exam and the total number of contributions the examiner has made.

Distributing to examiners

Once generated, reports can be downloaded to PDF or printed and can also be distributed to examiners both individually and in bulk.

The download and print options are shown just above the report output

To email the report(s) out to examiners choose the Email... option instead. This opens up the Global Report email interface.

1. You can use the search bar to find a specific exam (or set of exams that share a common attribute) for which you would like to distribute feedback. This can be omitted if you would like to include all exams.
2. The date filters enable you to include only exams that took place between two specific dates.
3. You can compose your email message to be delivered to examiners using the email fields.

Use the Apply Filters button to generate the list of examiners who have taken part in the set of filtered examination events. 

Only examiners whose email addresses are present in the examiner index will be shown in the list.

Use the checkboxes to select the examiners you want to include in the mail-out and ensure the Send emails option is selected. Click Send to all selected users to complete the action.

Each examiner in the list will receive a branded email from the system with a PDF copy of their report attached.