Metrics for Continuous Efficiency


[Up] [Top]

Documentation for package ‘dief’ version 1.2

Help Pages

dief Tools for Computing Diefficiency Metrics
diefk Compute metric dief@k
diefk2 Compute dief@k at a portion of the answer
dieft Compute metric dief@t
experiment1 Compares dief@t with other benchmark metrics as in <doi:10.1007/978-3-319-68204-4_1>
experiment2 Compares dief@k at different answer portions as in <doi:10.1007/978-3-319-68204-4_1>
metrics Example of benchmarking performance with other metrics
plotAnswerTrace Plot the answer trace of approaches
plotExperiment1 Generate radar plots that compare dief@t with other benchmark metrics in all tests as in <doi:10.1007/978-3-319-68204-4_1>
plotExperiment1Test Generate radar plots that compare dief@t with other benchmark metrics in a specific test as in <doi:10.1007/978-3-319-68204-4_1>
plotExperiment2 Generate radar plots that compare dief@k at different answer completeness in all tests as in <doi:10.1007/978-3-319-68204-4_1>
plotExperiment2Test Generate radar plots that compare dief@k at different answer completeness in a specific test as in <doi:10.1007/978-3-319-68204-4_1>
traces Example of answer traces