Interpreting the view logins screen

The View Logins screen in risr/assess is a powerful tool used to monitor live exam activity. It gives administrators real-time visibility into the status of all users in a session, including candidates, examiners, observers, and role players. This view also offers detailed insights into downloads, responses, timing, and device information.

You can access this screen by navigating to an exam session via View > View Logins either from the dashboard or from the exam’s view sessions page.

Overview of exam details

At the top of the View Logins page, you’ll find high-level details about the session and exam settings.

1. Exam name: Displays the name of the exam along with the selected session and date.
2. Exam ID: A unique internal identifier used to track the exam in the system.
3. Require exam PIN?: Indicates whether candidates need to enter a PIN to access the exam content. This depends on how the exam was configured. If set to “Yes”, candidates must input a PIN after login. If set to “No”, candidates will start the exam automatically once the session begins.
4. Exam start mode: Explains how timing is initiated for different exam types:
   1. Written exams: Can either start timing when the session begins or when the user enters the exam.
   2. OSCEs: Can start automatically with the session or via an admin command using the waiting room feature.
5. Exam duration: If exam timing is enabled, this shows the total allotted time for the exam. If disabled, candidates are not limited by time.
6. Round timing (OSCE only): Shows the breakdown of reading, assessment, and marking time for each station as defined in the exam timing setting.
7. Automatic rotation (OSCE only): Indicates whether candidates move between stations automatically.
8. Time counter: Specifies how the round remaining timer is displayed, either counting down to 0:00 or counting up from 0:00.
9. Current round (OSCE only): Updates during the exam to show the active round.
10. Elapsed exam time: Indicates how long it has been since the exam ended, if timing was enabled.
11. Time to next change (OSCE only): When exam timing is enabled and the exam timing has started, this field displays the remaining time before the next station rotation.
12. Not downloaded yet: Shows how many users have not yet downloaded the exam content.

Exam controls

Below the high-level exam details, you will see a selection of exam control buttons and a list of all users scheduled within that session with valuable details for each. To use the exam controls, you can select individual, multiple or all users by using the checkbox next to the user's ID/Pass. 

• Here are the exam controls for a written exam:

  

  1. Reset: Clicking 'Reset' will logout the selected user(s), and you'll have the optional to delete all responses submitted by these users. Note: Once the responses are deleted, they cannot be recovered. 
  2. Start: Clicking 'Start' will change the selected user(s)' status to 'In progress'. For written exams, you can start individual, multiple, or all candidates within a session.
  3. Pause: Clicking 'Pause' will change the selected user(s)' status to 'Paused'. This will stop their exam timer and prevent them from proceeding with the exam. For written exams, you can pause individual, multiple, or all candidates within a session.
  4. Stop: Clicking 'Stop' will change the selected user(s)' status to 'Complete'. If you select all of the users, the current session will be stopped, and all devices will be logged out.
  5. Change Time (Written only): Add/Subtract reading or exam time for the selected user(s).
  6. Set Downloads: This allows you to set the number of allowed exam downloads for the selected users. 

• Here are the exam controls for an OSCE exam:

  

  1. Reset: Clicking 'Reset' will logout the selected user(s), and you'll have the optional to delete all responses submitted by these users. Note: Once the responses are deleted, they cannot be recovered. 
  2. Start: Clicking 'Start' will change the selected user(s)' status to 'In progress'. Note: If exam timing is enabled, the selected user(s)' status will change from 'Pending' to 'Can Start', the user may also see the yellow timing bar start prematurely if the session was already started. To fix this, the user(s) should refresh their browser. 
  3. Pause: For OSCEs, you can only pause the exam for everyone. Clicking 'Pause' will change the status of all user(s) to 'Paused'. All of the users will receive a popup notification indicating that the exam is paused, and they won't be able to interact with the exam. 
  4. Stop: Clicking 'Stop' will change the selected user(s)' status to 'Complete'. If you select all of the users, the current session will be stopped, and all devices will be logged out.
  5. Set Downloads: This allows you to set the number of allowed exam downloads for the selected user(s). By default, examiners, observers, and role players has an infinite number of downloads. 
  6. Start Timer (OSCE only): If exam timing is enabled, and once the exam session is started all users will be in a 'Can Start' status. Clicking Start Timer will start the exam and the exam timer will begin to count up/down based on what was configured in the exam settings. 

User table

The view logins screen lists all users scheduled for that session along with detailed data for each. This includes:

• ID/Pass: This is the Username and Password that the user will use to login to the exam.
• Name: This is the user's full name. Clicking the name is a hyperlink to viewing all received responses from that user during the entire duration of the exam.
• After the exam is started, tracking of the user's exam time will be displayed under their name. It provides "time remaining in exam (total duration of exam)".
• Status: This controls the user's access to the exam content. The are statuses for 'Can Start', Pending', 'In Progress', 'Paused', and 'Complete'. See more details below.
• Down - Del: This displays details related to the user's downloading of the exam content. It indicates (number of times user has downloaded exam) / (number of available permitted downloads) - (number of times data has been deleted from user's device)
• Questions: This displays how many questions the user has answered on the exam out of how many total questions exist on the exam. During the exam, underneath this will display a live indication of what question number the user is actively viewing in the format "Q#".
• Responses: This displays information related to the responses received by the user.
  • The top row provides the total number of data points received for that user (which can be seen in full detail through their Name hyperlink) The system tracks all selections that a user makes. The system can receive multiple data points for each question if they change their answer. For text answer type questions, P4B autosaves and submits responses every 20seconds, so these answers will progressively build.
  • The bottom row provides the total number of marks that have been satisfied (based on a response being received) out of how many marks are expected (in brackets).
  • The top row typically never aligns with the bottom row since users typically change their answers. Therefore, the bottom row is helpful for tracking the user's progress during the exam.
• Devices: This displays details related to the device that the user accessed the exam on. It only displays after the user has been launched into the exam and gained access to the exam content. It provides whether they are on a PC vs Mac as well as what Browser type and version.
• Start [idle for]: This displays what time the user started the exam. In brackets, it displays a count up of the duration of time that the user has been inactive, meaning we have not received any responses. The user toggling between questions (as seen within Questions) does not impact idle time.
• Logged out: This displays what time the user submitted the exam. It will reflect the Start Time + [total duration of exam - time remaining in exam].

Searching

There is a search bar in the top right corner of the candidate list that can be used to search within the scheduled candidates appearing in the list. You can search for any of the details provided in the table (example: ID, Name, Device, etc)

View logins legend

From the view logins page, there are a few different colours that you may notice for users:

• White: The candidate is not actively participating in the exam and viewing content. This occurs prior to exam starting, them logging in, them launching into the exam, and after submission of the exam.
• Yellow (OSCE only): The candidate has launched into the exam and hasn't been validated. 
• Green: The candidates has launched into the exam and is viewing exam content. With this, the candidate's Device and time will be available.
• Red: When a candidate is marked as Did not attend, the row will appear red indicating that their responses won't impact the scoring process. For more information on this feature, please refer to the support article titled Did not attend.

User status

• Pending: Before the session is started, the screen will show the ‘Status’ of all users as ‘Pending’. Even if a user logged into the P4B interface, they would not be able to access the exam. The exam will download to the user's device. The user will be held at a screen that informs them the exam has not been started yet, and they should wait.
• Can start: Once the session is started for a user, the screen will show the ‘Status’ of the user as ‘Can start’. Under the status ‘Can start’ the PIN number for the exam is displayed. If a user is connected to the internet, they will not need a PIN to start the exam. If a user has downloaded the exam, but is offline when the exam is started, they should get in touch with the exam support team, who can provide them with the PIN to access the exam.
• In progress: Once a user logs in to start the exam, the screen will show the ‘Status’ of the user as ‘In progress’, and the row with the user information will change to green. (it may not if they lose connection when logging in)
• Paused: As an administrator, you can pause the exam for selected user(s) by selecting them and then selecting the ‘Pause’ action at the top of the page. This will pause the user, locking the exam and showing a warning to them that the exam has been paused by an administrator. The exam timer will pause for the user in P4B, and on the view logins screen. The user must have an active internet connection for this control to work. To start the user(s) again, select them and then select the ‘Start’ function at the top of the page, this will allow the user to access the exam again, and restart the exam timer.
• Complete: Either the user has finished the exam and logged out, or an administrator has used the ‘Stop’ action to end the exam for a user. The user log back into the exam unless reset using the ‘Reset’ action.