Guide To: Test Question Settings (Quality Control)

This article describes the Settings for your Test Questions. Test Questions (aka Test Question Data) are a powerful method for measuring the quality of the contributors in your job. By providing the answers to a small percentage of units, you can tell how accurate someone is and automatically remove anyone who doesn't meet your requirements.

To access Test Question Settings, select "Settings", then select "Test Questions" from the "Quality Control" drop-down tab.


Fig. 1: Test Question Settings page

Minimum Accuracy

This percentage is the minimum accuracy a contributor must maintain during the job to continue working. If the contributor falls below this accuracy at any time, he or she will be removed from the job and all of his or her answers will be disregarded, or untrusted. If Quiz Mode is enabled, this is the minimum accuracy percentage (Trust Score) a contributor must achieve to pass Quiz Mode and enter the job.


Configurable Test Questions

This section enables configuring the number of test questions that appear in Quiz Mode. By default, Quiz Mode is the same length as the number of Rows Per Page (or assignment length); however, when this setting is enabled, the length can be shorter or longer than an assignment. This will impact the number of Test Questions required to enable them in the job altogether. When disabled, the formula is Rows per Page + 3 to enable Test Questions in the job; when using this feature, that formula changes to Quiz Mode Length + 3. If this value is not met, no test questions will appear in the job at all.

Note: these settings cannot be changed once the job has been launched.


Was this article helpful?
8 out of 17 found this helpful

Have more questions? Submit a request
Powered by Zendesk