Station cut scores

The station cut scores report is available for both OSCE and written exams, although the former contains the most information. For OSCEs, this report will show item-level performance data, including regression plots where regression methods are used for standard setting. In the written exam context (or for OSCEs standard set using alternative methods) a more limited set of metrics will be shown and without the regression information.

Running the station cut scores report

To run the station cut scores report:

• Step 1 of 4

  Navigate to your exam then Set standard and View reports.

  

• Step 2 of 4

  Click Create new report and Station cut scores report.

  

• Step 3 of 4

  Select the date for which you wish to run the report and you can also optionally give the report a name. Select which items you want to include in the report (SHIFT+click or CMD/CTRL+click to select multiple). Alternatively do not select any items to include everything. You also have the option to display percentages in the report rather than absolute values should that be desired.

  

  Click Save to commit.

• Step 4 of 4

  Click Preview to view the output.

  

  You can also export a copy of this report to PDF.

Report output

The report output is shown below, with the metrics displayed for each item in the exam:

Metric	Description
Mean score	The simple average of the candidate scores on the station
Cut score	The station passing score as determined by the standard-setting methodology
Max score	The maximum possible score attainable on the station
Standard deviation	A representation of the dispersion of given scores relative to the cohort mean score (calculated as the square root of the variance). Larger values mean the scores are more spread out whereas smaller values mean the scores are more concentrated.
Alpha (if station deleted)	Gives the revised internal consistency estimate (Cronbach’s alpha) score if the station were to be removed from the exam. A common analytical method would be to compare this value against the alpha score for the exam. You might consider removing the item if the alpha value increases.
Passes	The number of candidates who have achieved higher than the cut score.
Fails	The number of candidates who have not reached the required standard on the item.
R2	Indicates the goodness of fit of the observed values to the regression line. The closer the value is to 1, the more variance can be explained by the regression model and the closer the observations are to the line of best fit.
Equation of the regression line	The mathematical formula for the regression line, is calculated as Y=mX+b, where Y is the dependent variable, X is the predictor variable, m is the slope and b is the intercept.
Inter-grade discrimination	The average increase in station score for each category on the global rating scale (i.e. slope).
Regression plot	A visual representation of the regression information used to establish the cut score.

Where the report is used for written exams or for OSCE's which use alternative standard setting methods, the regression information is omitted.