Dimension-based passing criteria

risr/ assess offers the possibility to set exam passing criteria based on any blueprint dimensions you have set up in the site. Where items in the exam are tagged using blueprint categories it is possible to leverage that information to create additional measurement criteria for use during the standard setting process. 

For example, candidates might need to reach an overall passing score but also not fail any of a subset of stations. Alternatively, they might need to reach an overall passing score but must also reach a specific standard across all stations tagged to "Communication" or some other value. You might even disregard the overall exam score (by setting it to zero) and rely solely on dimensional criteria as your passing standard.

One or several categories/dimensions can be used together to create sophisticated passing rules for the exam, and categories/dimensions can be evaluated either discretely or in aggregate (or both).

Adding a dimension(s) and categories

• Step 1 of 3

  To get started navigate to the Set standard page for your exam and go to Dimension pass mark.

  

• Step 2 of 3

  In the prompt, select the dimension you would like to add into the calculation and number of categories from within that dimension for which the minimum requirement will need to be achieved. 

  

  For example, in the Competency example shown above we might add passing requirements for Communication skills, Diagnosis and Investigation categories into the equation but, having set a value of 2, only two of the three sets of requirements need to be met in order satisfy this dimensional passing criterion overall.

  Click Add to commit.

• Step 3 of 3

  The dimension has now been added and you can proceed to setting the passing requirements within it.

  

Setting the passing requirements

Once the dimension has been added, there are several options for configuring the requirements that needs to met in order for it to be satisfied. 

• Step 1 of 3

  To set the criteria click Edit against the dimension.

  

• Step 2 of 3

  Select a category from the list and add the values in the appropriate fields.

  

  • To set a criterion whereby the candidate must pass individual items/stations tagged to that category use a combination of the Min. count and Station pass mark [%] fields. The Min. count field represents the number of stations that must be passed at the value in Station pass mark [%]. So 2 in Min. count and 50 in Station pass mark [%] would mean that the candidate needs to achieve 50% in at least 2 stations tagged to the category (in this case Communication skills).
  • To set a criterion whereby the candidate must meet an aggregate minimum across all stations tagged to the category, use the Overall pass mark [%] field. The Overall pass mark [%] represents the minimum score that must be achieved across all items/stations tagged to the category when they are combined. So 50 in Overall pass mark [%] means the candidate must achieve at least 50, on aggregate, across all stations tagged to Communication skills.

• Step 3 of 3

  Once the criteria for all categories have been set, click Save and close to commit the changes.

  

  In the example shown we have set up a set of passing criteria according to the following rules.

  In order to pass the Competency dimension, the candidate must:

  • Achieve at least two of the following:
    • A minimum aggregate score of 50% across all items/stations tagged to Communication skills
    • Pass at least two items/stations tagged to Diagnosis and synthesis of data at a pass mark of 60% or greater
    • Pass at least one item/station tagged to Investigation plan at a pass mark of 70% or greater.

  This process can be repeated to add several dimensions should that be required.

Grading dimension-based criteria

It is also possible to set grades per dimensional criteria category which can be later displayed on the Candidate feedback report.

From the set standard screen, click Grades against the category for which you would like to set them.

For further information on setting up grading bands, please see the dedicated article here.