This article describes the Job Settings for your Test Questions.
To access Test Question Settings, select "Settings", then select "Test Questions" from the "Quality Control" drop-down tab.
Fig. 1: Test Question Settings page
Minimum Accuracy
This percentage is the minimum accuracy a contributor must maintain during the job to continue working. If the contributor falls below this accuracy at any time, they will be removed from the job and all of their answers will be disregarded, or untrusted. If Quiz Mode is enabled, this is the minimum accuracy percentage (Trust Score) a contributor must achieve to pass Quiz Mode and enter the job.
Configurable Test Questions
This section enables configuring the number of test questions that appear in Quiz Mode as well as how frequently they appear in Work Mode.
By default, Quiz Mode is the same length as the number of Rows Per Page (or assignment length); however, when this setting is enabled, the length can be shorter or longer than an assignment.
In terms of Work Mode, the default test question frequency is 1 per page. You can configure the frequency to be X test questions per X pages. Remember, however, that a contributor will not be able to continue working once they have exhausted the available test questions.
Note: these settings cannot be changed once the job has been launched.