KitchenhamEtAl.CorrelationsAmongParticipants.Scanniello17TOSEM {reproducer}

KitchenhamEtAl.CorrelationsAmongParticipants.Scanniello17TOSEM data

Description

Data illustrate correlations between results from individual participants in a family of four cross-over experiments conducted by Scanniello et al.: [1] G. Scanniello, M. Risi, P. Tramontana, and S. Romano, 'Fixing faults in C and Java source code: Abbreviated vs. full-word identifier names', ACM Transactions on Software Engineering Methodology, vol. 26, no. 2, 2017. The experiments assess whether whether the use of abbreviated identifier names (ABBR), impacts the effectiveness of fault fixing in C and Java source code in comparison with full-word identifier names (FULL). If you use this data set please cite: [1] G. Scanniello, M. Risi, P. Tramontana, and S. Romano, “Fixing faults in C and Java source code: Abbreviated vs. full-word identifier names', ACM Transactions on Software Engineering Methodology, vol. 26, no. 2, 2017. [2] Barbara Kitchenham, Lech Madeyski, Giuseppe Scanniello and Carmine Gravino, 'On the Importance of the Correlation between Results from Individual Participants in Crossover Experiments' (to be submitted as of 2020).

Usage

KitchenhamEtAl.CorrelationsAmongParticipants.Scanniello17TOSEM

Format

A data frame with 200 rows and 17 variables:

ExperimentID

<fct>|ExperimentID: A unique identifier for each of the experiments in the data set.

ParticipantID

<fct>|Participant ID: An identifier for each participant, unique for a specific experiment.

SequenceGroup

<fct>|Experimental Sequence Group: A , B , C, D

System

<fct>|Software systems used in the experiments: The Unibas experiment used Agenda (a system for tracking personal contacts) and Gas-Station (a system for managing a petrol station). The UniNa experiment used Financial (a system which is a command line option price calculator) and Hotel-Reservation. The POLINA and PROF experiments used AveCalc (a system that manages as electronic register and LaTazza (a system for a drinks vending machine).

Period

<fct>|Time period of the cross-over experiment: 1 or 2

Treatment

<fct>|Experimental Treatment:ABBR, abbreviated names. FULL, full names

Time

<dbl>|Dependent variable: The time each participant spent performing the SE task.

FMeasure

<dbl>|Dependent variable: The effectiveness of the participants taking into account correctness and completeness of the fault fixing tasks

Efficiency

<dbl>|Dependent variable: The ratio of effectiveness to time.

CrossOverID

<fct>|CrossOver category: For 4 group crossover designs, the crossover category specifies the matching pairs of sequence groups, CO1 and CO2. For 2 group crossover, the category is set to CO1 only.

Language

<fct>|Java or C. The language was the same for all participants in a specific experiment. POLINA and PROF used Java, UNIBAS and UNINA used C.

Ident

<dbl>|Dependent variable: The number of faults identified.

Fixed

<dbl>|Dependent variable: The number of faults identified.

WrongIdent

<dbl>|Dependent variable: The number of faults incorrectly identified

WronglyFixed

<dbl>|Dependent variable: The number of faults incorrectly fixed.

precision

<dbl>|Dependent variable: The ratio of number of faults correctly fixed to the number of faults correctly identified.

recall

<dbl>|Dependent variable: The ratio of number of faults correctly fixed to the total number of fault.

Examples

KitchenhamEtAl.CorrelationsAmongParticipants.Scanniello17TOSEM