Live exam dashboard

This feature was released in risr/ assess v.8.11. If your site is currently on a version lower than v8.11 please talk to us about an upgrade so you can benefit from the new functionality.

The live exam dashboard enables system users to monitor the progress of the OSCE exam in real time. Unlike the standard dashboard view, this version presents the information in a matrix style format, aligning more closely with a cyclical OSCE setup, with rooms across one axis and candidates across the other. This can help users quickly identify from where in the cycle the information is originating.

The live exam dashboard can be set up to surface either live scoring data (discrete or aggregated) or, as in the example above, simply an indication of whether a mark sheet has been received. Both options are described in the setup section of this article.

The dashboard will also act as mechanism to display examiner help requests in a central location as well as on the marshal iPads.

Setting up the live exam dashboard

Before it can be accessed within an exam, the dashboard must first be configured at the site level. The design of the dashboard will therefore be applied site-wide and cannot be configured differently for different exams. The dashboard can also only be built using the site's global criteria, so you will need some to exist before it can be set up. 

To set up the dashboard:

• Step 1 of 4

  Navigate to Settings > Manage live dashboard.

  

• Step 2 of 4

  You will then be presented with options to add either a summary or a discrete score to the dashboard.

  

  • Summary score: An aggregation of the values selected by examiners in two or more scoring criteria (e.g. a station total score). You must have at least two mandatory global criteria present in the site to be able to use this option.
  • Discrete score: A single value selected by an examiner in a scoring criterion and can be either numerical or descriptive (e.g. global judgement value). You must have at least one mandatory global criterion present in the site to use this option. Where a descriptive value is selected the system requires an abbreviation to be added to each row in the schema.

  If you plan to use the live exam dashboard to present submission rather than scoring data you should use a global criterion common to all mark sheets and use a consistent value in the schema abbreviation (e.g. Y or X for all values).

• Step 3 of 4

  Depending on whether you select a summary or discrete measure for the dashboard you will then see all of the available global criteria on the next screen.

  

  Select the measures you would like to apply to the dashboard (up to a maximum of 3).

  For summary measures you will see the option to either sum or average the values. For discrete measures you will see the option to either present the actual value supplied or use the schema abbreviation.

  Click Save.

• Step 4 of 4

  Once you have selected the measures you wish to include in the dashboard these are displayed on the Manage live dashboard landing page.

  

  The dashboard is now ready to be used in exams but if you need to edit or remove any of the measures you can use the Edit and Delete buttons shown above.

Once a global criterion is used in a live exam dashboard it is locked for editing. This is denoted by the padlock on the Manage global criteria page.



If you need to edit the criterion it must first be removed from the live dashboard.

Using the live exam dashboard

It is possible to edit the live exam dashboard up until the point it an exam is published. At this point the dashboard is localised and any changes will not be reflected in that exam. To make changes you would need to reset the exam, make your changes to the dashboard and then republish the exam.

To access the live dashboard for an exam navigate to the main dashboard screen and then View > View live exam dashboard.

Depending on the configuration established during the setup phase, the dashboard will either show live scoring or live submission information as the exam progresses. This will update in real time and there is no need to refresh the browser.

The Summary score key accessed in the top right of the screen will give an explanation of the measures used in the dashboard.

Examiner help requests 

A further benefit of the live exam dashboard is that it can display any help requests sent from examiner iPads.

When a help request is received the room column header will turn orange with a warning icon and a notification will appear in the top right. You can optionally play a sound when a help request is received by checking the box shown (please ensure any speakers or audio devices are turned up if this option is selected).

Clicking on the help request button shows the detail of the request.

Help requests can only be cleared via the marshal iPad, but they will also disappear from the dashboard once the marshal has cleared them. They will also disappear if the examiner cancels the help request.

For any exams in which candidates have been provided with iPads, candidate help requests are currently unsupported on the live exam dashboard.