nosof94oat {catlearn}

Ordinal adequacy test for simulations of nosof94 CIRP

Description

Tests whether a model output passes the ordinal adequacy criteria for the nosof94 CIRP.

Usage

  nosof94oat(dta, xtdo=FALSE)

Arguments

dta

Matrix containing model output. The matrix must have the same format, row order, and column names, as data(nosof94); with that proviso, the output of any simulation implementation can be handled by this function.

xtdo

eXTenDed Output: Either TRUE or FALSE

Details

This function implements a standard ordinal adequacy test for the nosof94 CIRP. Specifically, a model passes this test if the mean errors (averaged across blocks), obey the following:

I < II < [III, IV, V] < VI

Note that '[III, IV, V]' indicates that the these three problems can be in any order of difficulty (or all be of equal difficulty), as long as all three are harder than Problem 2 and all three are easier than Problem 6.

Alternatively, by setting xtdo to TRUE, this function returns the mean classification error by Problem type.

Value

Where xtdo=FALSE, this function returns TRUE if the ordinal adequacy tests are passed, and FALSE otherwise.

Where xtdo=TRUE, this function returns a summary matrix, containing mean errors (across blocks) for each of the six problem types.

Author(s)

Andy Wills

See Also

nosof94