Making post-hoc item adjustments

Once an examination has concluded, it's possible to change an item's scoring information and have those changes retroactively affect previous exams. Items can also be excluded from marking altogether. This can be useful if you notice an error post-exam and need to make some retroactive adjustments to rectify it.

Adjusting written item marks

To adjust marks for a written item, find the item in your bank and navigate to the 'item information' tab. Scroll down, and you'll find the 'available answers' section and an 'admin' button:

Clicking the 'admin' button will take you to the following page:

From here, you can adjust the answer option text and the value of the marks awarded for each option. If, for example, you need to change the correct answer to another option, you can change the value of the 'incorrect' correct answer to 0 and then amend the value of the actual correct answer to 1. The option text can also be changed, which may be useful if you intend to include this information in your candidate feedback reports.

Below the answer table, you will find a list of exams that this item has been used in. These entries will all be checked by default, which means that any changes you make here will retroactively adjust all of those exams accordingly. If you want the changes to affect a narrower selection of exams, then you can uncheck those exams which you don't want to push the changes to.

Once you're satisfied with the changes, click 'continue' to go to the summary page:

This page lists the changes that are about to be made. If you're satisfied that this is correct, click on 'make changes', and the platform will implement them.

This section used the single best answer (SBA) item type to illustrate how this functionality works. However, the same method can be applied to any other automatically-marked item type on risr/assess

Adjusting OSCE marksheet

The process for making post-hoc changes to OSCE items is similar to that of written items but with a few key differences. Rather than making amendments at the item level, changes to OSCE items are made to their marksheet criteria. To make a change, open up the OSCE item in your bank, navigate to the 'marksheet' tab and select 'options' then 'admin' for the criteria you wish to change:

This will take you here:

The parameters you can change here are the same as for written items but with a couple of additions:

• Weight - allows you to adjust the weighted for scores awarded against this criteria
• Criteria feedback visibility - determines whether this criteria will appear on any candidate feedback reports that you generate that include the item breakdown.

Once you've made your changes, you can follow the same process for implementing them as written items: select the exam you want to retroactively amend, confirm the changes, and save.

Excluding entire items

On some occasions, there may be a need to exclude an entire item from the scoring calculations in an exam, such as if it was added accidentally or if it performed so poorly that it significantly affects the exam's overall performance metrics.

By excluding an item on risr/assess, you are removing it from the results calculations. The item's response data will no longer be considered in the overall exam performance calculations or the candidates' results.

• Step 1 of 5

  
  Click on 'options' next to the exam you want to remove an item from and then 'view standard'

• Step 2 of 5

  
  Click on 'items'

• Step 3 of 5

  
  Press the 'exclude' button next to the item you wish to remove from the exam.

• Step 4 of 5

  
  You will need to enter a value into the 'reason for marking change' box before you can exclude the item. This change will be logged in the session history section of the exam.

• Step 5 of 5

  
  You'll be taken back to the 'items' view, and you'll see a banner prompting you to update the results. You'll need to press this button to prompt the platform to recalculate the exam results based on the exclusion(s) you have just made. If you forget to do this here, there will also be a prompt on the 'set standard' page.

If you need to re-enable an item you've excluded, you can follow the same process from step 3 onwards. The 'exclude' button will be replaced with an 'enable' button.