rater_agreement {ura}R Documentation

rater_agreement

Description

rater_agreement calculates the percent agreement between each rater and the other raters who coded the same subjects.

Usage

rater_agreement(object_name, rater_column, subject_column, coding_column)

Arguments

object_name

A dataframe or tibble containing raters' codings. Each row should contain the assigned coding from a given rater-subject.

rater_column

The name of the column containing the raters' names as a string.

subject_column

The name of the column containing the names of the subjects being coded as a string.

coding_column

The name of the column containing the codings assigned by the raters as a string.

Value

A tibble where each row notes the percent agreement between rater i and all other raters who coded the same subjects (percent_agree). The n_multi_coded column notes how many subjects have been coded by rater i that have also been coded by other raters (i.e., the denominator for the percent_agree value).

Author(s)

Benjamin Goehring <bengoehr@umich.edu>

Examples

# Example data: 3 raters assigning binary values to 10 subjects
example_data <- tibble::tribble(
  ~rater,	~subject,	~coding,
  1,	1,	1,
  1,	2,	0,
  1,	3,	1,
  1,	4,	0,
  2,	3,	1,
  2,	9,	0,
  2,	10,	1,
  2,	4,	1,
  2,	5,	1,
  2,	6,	1,
  3,	5,	1,
  3,	6,	1,
  3,	7,	1,
  3,	8,	1,
)

# Find percent agreement by rater
rater_agreement(example_data,
                rater_column = 'rater',
                subject_column = 'subject',
                coding_column = 'coding')



[Package ura version 1.0.1 Index]