Multipart written question (MWQ)

The Multipart written question is a compound item type that combines the functionality of two of our most commonly used item types; the single-best answer (SBA) and the short answer question (SAQ) which uses a free text box to collect the test-taker's response. By default only the SAQ and SBA item types are available. The MAA and VSAQ item types can also be made available upon request. However, VSAQ and SAQ are incompatible within a single MWQ due to differences in how the 2 question types are marked.

With MWQs you can start to create richer, more in-depth and multi-part items that challenge test-takers beyond the simple respond and move on approach.

Building an MWQ item

To build an MWQ item:

• Step 1 of 3

  Navigate to Items and Create new item.

  

• Step 2 of 3

  Complete the fields on the new item screen.

  

  1. Item type: Select Multipart written question from the dropdown menu
  2. Item title: Give the item a name. This is entirely free-text and at your discretion, but it is required. This is not visible to candidates during the exam, but it can optionally be used later in the candidate feedback report.
  3. Item number: The item number auto populates but can be overwritten. Each item type maintains its own sequential index from 1-n (e.g. ARQ1, ARQ2 / SBA1, SBA2 etc.). By default this field will receive the next available sequential number for that item type.

• Step 3 of 3

  The basic form fields for the item type are now made available.

  

  1. Item number: This is the item number established in the previous step. It can no longer be changed. 
  2. Question author(s): Unless specified, the question author will default to the current user. Alternatively you can select another author if you are inputting the material on someone else's behalf. Start typing a name in the field and the system will suggest names based on the list of users present in the system.
  3. Item title: The item title entered in the previous step. This can be changed here.
  4. Summary: This is the item lead in. You can use the WYSIWYG editor to write a general question prompt.
  5. Comments: The comments field is used for notes against the item. These do not appear to candidates and are for administrative use only.
  6. Item notes: The item notes field can be made available to candidates in the candidate feedback report and is designed to be used for any predetermined answer justification.
  7. Questions: Below the page divider is where we start to add the individual question stems that make up the multipart question. By default, risr/ assess adds one blank sub-part. We will cover adding questions and answers in the next section.

Adding the question stems and answer options

The next step is to add the individual question stems and answers. One is placed in the item at creation, but you can add more using the Add new question button. 

You can add as many sub-parts as are needed, but there are 5 possible options to choose from:

• Short answer question (SAQ): Provides the candidate with an open-ended text box to respond into. SAQ and VSAQ item types cannot be used together in a single MWQ.
• Label: The label option inserts a placeholder text and does not require a response from the candidate. It can be used to add headings or split up sections of the question with text.
• Single-best answer (SBA): Provides the candidate with a set of answer options from which to choose.
• Multiple acceptable answer (MAA): Provides the candidate with a set of multiple correct answer options to choose from. This item type can be enabled for MWQ upon request. 
• Very short answer question (VSAQ): Provides the candidate with a text box to respond with a single line of text. This item type can be enabled for MWQ upon request. VSAQ and SAQ item types cannot be used together.

SAQ and VSAQ item types are incompatible and should not be used together within the same MWQ item. Doing so may result in issues with marking the item.

• 

  1. Use the arrows to indent the question parts. Upon indent a new labelling scheme will be started and will last until the next indentation change. The number of possible indents for MWQ items can be changed as a site configuration.
  2. The WYSIWYG editor is used to add the question stem.
  3. This WYSIWYG editor is used to add a model answer for markers to evaluate against. This is visible to markers during the marking process. 
  4. If printing the exam paper, the lines field controls how many lines are printed for the candidate to provide their response.
  5. The number of marks available for the sub-part. This controls the maximum number of marks it is possible to assign during the marking process. 
  6. The visible by marker only checkbox makes the sub-part invisible to candidates and only visible to the marker. This can be useful if you would like to bypass scoring per part and provide a marker with an option to grade the item holistically. 
  7. Provides an option to bank an Angoff score per item sub-part.
  8. Provides the option to bank Ebel difficulty and relevance scores per item sub-part.
  9. A comments field for administrative use only.
  10. It is possible to add resources per item sub-part in the same way as you can per item.

  Adding items per sub-part achieves the same rendering in the browser application as adding them per item.

• 

  1. Use the arrows to indent the question parts. Upon indent a new labelling scheme will be started and will last until the next indentation change. The number of possible indents for MWQ items can be changed as a site configuration.
  2. The WYSIWYG editor is used to add the placeholder text.
  3. The visible by marker only checkbox makes the sub-part invisible to candidates and only visible to the marker. This can be useful if you would like to bypass scoring per part and provide a marker with an option to grade the item holistically.
  4. It is possible to add resources per item sub-part in the same way as you can per item.

  Adding items per sub-part achieves the same rendering in the browser application as adding them per item.

• 

  1. Use the arrows to indent the question parts. Upon indent a new labelling scheme will be started and will last until the next indentation change. The number of possible indents for MWQ items can be changed as a site configuration.
  2. The WYSIWYG editor is used to add the question stem.
  3. This controls the order in which response options are presented to test-takers (if answer order randomisation is not used). The options are:
     • Default: Answers are presented in alphanumeric order
     • Custom: Answers are presented in the same order as they appear in the authoring interface
  4. Add further answer options fields to the list
  5. The list of answer options. These fields have some limited rich text options available through clicking in the field.
  6. Select the correct answer option. You can achieve a de facto multiple acceptable answer (MAA) question by selecting more than one correct answer (although you do not have the same options to limit the number of options that can be selected). Use the arrow symbol to toggle between the correct answer checkboxes and the value per response option. 
  7. The visible by marker only checkbox makes the sub-part invisible to candidates and only visible to the marker. This can be useful if you would like to bypass scoring per part and provide a marker with an option to grade the item holistically. 
  8. Provides an option to bank an Angoff score per item sub-part.
  9. Provides the option to bank Ebel difficulty and relevance scores per item sub-part.
  10. A comments field for administrative use only.
  11. It is possible to add resources per item sub-part in the same way as you can per item.

  Adding items per sub-part achieves the same rendering in the browser application as adding them per item.

If you need to delete any of the sub-parts click the Delete checkbox and save the item.

Adding marking criteria and changing the order of the sub-parts

Once the item sub parts are added, there are some further actions that can be carried out from the item page. 

If you would like to add a marking rubric to any SAQ parts you can do so under Marking criteria.

If you need to rearrange the order you can do so using the Change order button.

From the next screen, drag and drop the sub-parts into the required order.

Item preview

In the browser application, the MWQ item presents the question lead in on the left and the individual stems and answer options on the right hand side.