Assertion-reasoning question (ARQ)

The assertion-reasoning question requires test-takers to evaluate both the validity of an assertion statement as well as its justification.

Building an ARQ item

To build an ARQ item:

• Step 1 of 3

  Navigate to Items and Create new item.

  

• Step 2 of 3

  Complete the fields on the new item screen.

  

  1. Item type: Select Assertion-reasoning question from the dropdown menu
  2. Item title: Give the item a name. This is entirely free-text and at your discretion, but it is required. This is not visible to candidates during the exam, but it can optionally be used later in the candidate feedback report.
  3. Item number: The item number auto populates but can be overwritten. Each item type maintains its own sequential index from 1-n (e.g. ARQ1, ARQ2 / SBA1, SBA2 etc.). By default this field will receive the next available sequential number for that item type.

• Step 3 of 3

  The basic form fields for the item type are now made available.

  

  1. Item number: This is the item number established in the previous step. It can no longer be changed. 
  2. Question author(s): Unless specified, the question author will default to the current user. Alternatively you can select another author if you are inputting the material on someone else's behalf. Start typing a name in the field and the system will suggest names based on the list of users present in the system.
  3. Item title: The item title entered int he previous step. This can be changed here.
  4. Summary: This is the item stem. You can use the WYSIWYG editor to write your question prompts. For the ARQ item Assertion and Reason placeholders are already present by default.
  5. Correct answer: The ARQ item uses predetermined answer options. Select the appropriate one:
     • a. Both assertion and reason are true, and reason is a correct explanation for assertion
     • b. Both assertion and reason are true, but reason is not a correct explanation for assertion
     • c. Assertion is true but reason is false
     • d. Assertion is false but reason is true
     • e. Both assertion and reason are false
  6. Comments: The comments field is used for notes against the item. These do not appear to candidates and are for administrative use only.
  7. Item notes: The item notes field can be made available to candidates in the candidate feedback report and is designed to be used for any predetermined answer justification.
  8. Angoff: An Angoff rating for later standard setting can be banked against the item. If a value is given, this will be used if Angoff is selected as the standard-setting method.
  9. Difficulty and relevance: If Ebel standard setting is used, you can bank the difficulty and relevance values agains the item.

  Click Save item to commit the changes.

Item preview

In the browser application, the ARQ item appears as a simple single-best answer question. Test-takers are required to select one option from the list available.