| evalResults {validateIt} | R Documentation |
Evaluate results
Description
Evaluate results
Usage
evalResults(results, key, type = NULL)
Arguments
results |
results of human choice; outputs from getResults() |
key |
the local task record; outputs form recordTasks() |
type |
Task structures to be specified. Must be one of "WI" (word intrusion), "T8WSI" (top 8 word set intrusion), "R4WSI" (random 4 word set intrusion), "LI" (Label Intrusion), and "OL" (Optimal Label) |
Details
Evaluate worker performance by gold-standard HITs; Return the accuracy rate (proportion correct) for a specified batch
Value
A list containing the gold-standard HIT correct rate, gold-standard HIT correct rate by workers, and non-gold-standard HIT correct rate
[Package validateIt version 1.2.1 Index]