Building OSCE mark sheets

The mark sheet in the OSCE item type is where you will design and add the scoring instruments you would like to present to examiners for recording candidate performance. Mark sheet elements can be built individually per item or, for efficiency, can be created at the global site level and applied accordingly to individual item mark sheets.

If you wish to set up a borderline judgement criterion for use in regression-based standard-setting methods, this must be set up as a global criterion. It cannot be created individually per mark sheet.

Building an OSCE mark sheet

To build an OSCE mark sheet:

• Step 1 of 10

  Navigate to Items from the top menu bar.

  

• Step 2 of 10

  Access the item mark sheet by clicking View.

  

• Step 3 of 10

  Click Marksheet.

  Any global criteria (with appropriate ApplyIf conditions) will already be automatically populated here. Please refer to this article for further information.

  If global criteria are not being used (most commonly for checklist-style mark sheet elements) or you wish to append any global criteria on the mark sheet with local ones, you can do so by clicking + Add new criteria.

  

• Step 4 of 10

  A popup will appear for you to customise the mark sheet. Using the dropdown menu for Section, select the mark sheet section you want the criterion to appear in.

  

• Step 5 of 10

  Using the free text field for Text, enter the label to appear against the criterion.

  

  HTML is supported during mark sheet creation and can be used to tell the browser how to display content within the mark sheet.

• Step 6 of 10

  From the dropdown menu, select the Sheet type. This is the type of response field you wish to present to the examiner.

  

  • Discrete: A set of selectable responses (i.e. dropdown). Used where examiners are required to select the most appropriate value.
  • Boolean: A binary response field (i.e. checkmark or cross). Used for checklist-style responses. This Sheet type also provides the option to mark the criteria as a critical stop point. If the boolean Sheet type is selected, it will not be possible to mark the criteria as mandatory. 
  • Free text: An open-ended text response. For example, enabling examiners to provide free text feedback.
  • Audio: Creates an audio recording response field. Examiners can record verbal feedback for the candidate.
  • Label: No response field is created. This acts as a text placeholder on the mark sheet and can be used for headings or explanatory text.

• Step 7 of 10

  Select the scoring schema to be used in the criterion

  

  The values available in the list are those set up under the mark sheet schema. If Custom is selected, a new schema will need to be built specifically for this criterion.

• Step 8 of 10

  Give the criterion a weighting.

  

  The weighting acts as a multiplier for the response provided by the examiner. So if, for example, the weighting was 2.0, the final value recorded would be the examiner's response (let's say 3.0) multiplied by 2.0 = 6.0.

  Common weightings that might be used here could be 1.0 if all mark sheet items are to be weighted equally, or 0.0 if the criterion is not intended to count towards the calculated total station score (e.g. where a global mark is being requested).

• Step 9 of 10

  Use the checkboxes to specify the behaviour of the criterion on the mark sheet.

  

  1. Mandatory: Controls whether a response from the marker is required. If checked, the criterion is mandatory and the examiner cannot submit their mark sheet without completing the field (they will be prompted to complete the missing field). This is generally desirable as it helps ensure data integrity and completeness in the exam.   
  2. Feedback visible to candidate: Controls whether the examiner's response to this criterion is visible to candidates in the Candidate Feedback Report.

  Please note that the behaviour checkboxes are dynamic and will appear and disappear based on the value selected in the Sheet type field. For example, if Boolean is selected, instead of seeing the Mandatory option, you will see another option to make the criterion a critical stop point. If the Label option is selected, then all the behaviour checkboxes disappear.

• Step 10 of 10

  Click Save.

  

Updating OSCE mark sheet

The process for making updates to mark sheet criteria depend on whether local or global are used and the review state of the item. This is to prevent changes at the global level from cascading into active exams without a conscious decision being made to do so. Please refer to our article on updating mark sheet criteria for more detialed information.

The mark sheet view

The finished mark sheet view with embedded scoring criteria can be seen in the images below. Toggle for the final rendered views in both assess for iPad and assess for browser applications.

• 

•