Creating an item set

In risr/ assess, item sets are referred to as a group of related items to be used in an exam. An item set can incorporate a range of item types. However, it is not possible to combine OSCE and written item types into one item set. 

There is no limit on the number of items in an item set but the exam blueprint would indicate the maximum number of items for the specific item set using that exam blueprint. Therefore, it is important to ensure that an exam blueprint has been created before creating the item set. The exam blueprint would also act as the constraint for the item set. 

Creating a new item set

To create a new item set:

• Step 1 of 3

  Navigate to Item Sets from the top menu bar.

  

• Step 2 of 3

  Click + Create new item set.

  

• Step 3 of 3

  Complete the fields on the new item set screen.

  

  1. Number: By default, the system automatically generates a unique number to identify the item set with an ID which can be changed later. This number can be changed at the time of creation or later. 
  2. Title: Give the item set a name. This is entirely free text and at your discretion, but it is required. 
  3. Exam blueprint: Using the dropdown menu, select the exam blueprint previously created that applies to your item set.
  4. Item status: Using the checkboxes next to the item status to determine what items will be available for selection based on the item status. By default, only items in the state of Approved will be available for selection when creating the item set. Although it is possible to include items in every state, an exam can only be published when all items are approved. Depending on how your instance was configured, you may see more than the default three item status, Draft, Pending, and Approved.
  5. Include items in existing item sets: Identify whether or not you want to include items used in existing item sets. By default, the system will include items in existing item sets. To exclude items used in other item sets, click No. 
  6. Add items automatically: By default, the system can automatically add items to the item set based on the constraints of the exam blueprint selected. If you want to manually add items to the item set, click No and items can be added manually later. 
  7. [Optional] Primary language: The language only applies to multi-lingual instances. The primary language field is only used to determine the language of the items automatically added to the item set. Only the selected value of the primary language will be picked for the item set. If an item has more than one variant, setting the primary variant would only pick the item with the selected value. If the incorrect item is added to the item set, you can replace the item manually later. 
  8. [Optional] Variants: The variant only applies to multi-lingual instances. By default, all variants will be selected. All items assigned to the item set must exist in the selected variant(s). Otherwise, it would not be possible to use the item set for an exam. Only variants in this list can be added to the item set. Clicking on the checkboxes next to each variant would unselect the variant. To request additional variants for your instance, read more about the site configuration options.

  Click Create item set.

The item set interface

The image below shows a high-level overview of the item set authoring interface, details can be found in separate articles (the image is of an OSCE item set with only one main difference for 13). Add station group, for written, item sets, you'll see Add item set section). Any warnings and system notes will appear at the top of the item set page. 

1. Submit for review: If the item set is in the DRAFT state, you can submit the item for review. Read the item set version control article for more information on the workflow state for item sets and how it impacts what you see here.
2. Delete/retire: Only item sets in the DRAFT state can be deleted. Once the item set has been approved, you can only retire the item set or start a new version.
3. Clone: Clones the item set to create a duplicate copy (only available from risr/ assess v8.17). 
4. Preview: The option to preview the item set will appear where you can download the item set as an HTML, PDF or MS Word file. 
5. Ebel scoring: Invite judges to provide the Ebel scoring judgement to the standard set for the item set. 
6. Normalize: Enter a score for all items within the item set to be normalized or use the default scores of the items.
7. Edit details: While an item is in the DRAFT state, clicking the edit details will allow you to update the item title, and depending on how the instance was configured, you can also update the primary variant and variant selection for regenerating the item set. 
8. Task details: When items are automatically assigned to an item set, the operation is performed as a background task. The details and status of these tasks can be seen using the task details button. 
9. Report: Review the blueprint satisfaction report for the selected item set.
10. Define: Specify and exclude item sets from the selected item set. 
11. Add an item: Items can be manually added to the item set.
12. Regenerate item set: Automatically remove all items in the item set and regenerate a new set of items from the item bank based on the item status and variant, if applicable. 
13. Add station group/Add item set section: For OSCE item sets, you can add station groups to organize and structure the item set. For written item sets, you can add item set sections to organize items and control how the items are shuffled.
14. Download item set: Download an Excel file (.xlsx) of the item set history or the details of each item within the item set.
15. Details: Quickly see the master blueprint tagged to the item, the performance of the item and the resources attached by hovering over the letters (B, P, R). If the item does not have a blueprint, performance or resource attached, the icon will have a white background. A blue background would indicate that the item has it. 
16. Options: From the options dropdown menu, you can view the item information page for the selected item, replace the selected item with another item, and remove the selected item from the item set. 
17. Version history and activity log: The item set's version history and an activity log of changes that occurred within each of the versions are maintained here.