SRCScomparison {SRCS}

Compares the performance of two algorithms for a single problem configuration specified by the user.

Description

Compares the performance of two algorithms for a single problem configuration specified by the user.

Usage

SRCScomparison(rankdata, target, alpha = 0.05, pvalues = FALSE, ...)

Arguments

rankdata

The ranks data frame obtained by a previous call to SRCSranks.

target

Name of the target column in rframe that separates the levels to be compared, probably "Algorithm" or similar.

alpha

Significance threshold to consider two set of measurements coming from two algorithms as statistically significant

pvalues

Boolean. TRUE indicates that the pairwise comparison table should contain p-values. FALSE means only ">","<" or "=" (the latter for non-significant difference) will be displayed in the table. Defaults to FALSE.

...

The rest of the columns in rframe and the values to fully specify a single problem configuration for which algorithms will be compared. Must be indicated as named arguments, like in "severity" = 4.

Value

A square matrix of the same dimension as algorithms found in the data. An entry i,j contains either the p-value of the Wilcoxon test between algorithms i and j (if pvalues was set to TRUE), or the qualitative result (">", "<" or "=") of the statistical comparison (if pvalues was set to FALSE).

See Also

SRCSranks, plot.SRCS for a full working example of SRCScomparison.