Cumulative cut score report

The cumulative cut score report is a longitudinal report which can be used to provide insight into the item's performance over time, producing an aggregate cut score for all of the candidate cohorts for which it has been used. A practical example might be where the item is used in a resit for a small cohort but you want to see its performance amongst a larger cohort to determine an appropriate passing standard. This can be achieved using the cumulative cut score report.

Running the cumulative cut score report

To run the cumulative cut score report:

• Step 1 of 3

  Navigate to Reports then select Cumulative cut score report

  

• Step 2 of 3

  Select the item for which you want to run the report.

  

• Step 3 of 3

  The next screen displays all the exams in which the item has been used. Select the ones you wish to include in the aggregation. Click Show.

  

  Where borderline methods are used for standard setting the intercept must be the same for each time the item has been used. An error will be shown if it is not and you will not be able to run the report. 

Report output

The output shows the cumulative statistics for each deployment of the item in an exam. In the below example, we also have an aggregate regression plot.

Metric	Description
Mean score	The combined simple average score achieved by candidates on the item.
Cut score	The cut score is generated by the standard setting method once all data is combined.
Max score	The maximum possible score for the item.
Standard deviation	A representation of the dispersion of given scores relative to the cohort mean score (calculated as the square root of the variance). Larger values mean the scores are more spread out whereas smaller values mean the scores are more concentrated.
R2	Indicates the goodness of fit of the observed values to the regression line. The closer the value is to 1, the more variance can be explained by the regression model and the closer the observations are to the line of best fit.
Cohort size	The combined cohort size for all deployments of the item.
Passes	The combined total number of passes for all deployments of the item.