Skip to content
Jeffrey M Girard edited this page Feb 18, 2016 · 43 revisions

Welcome to the mReliability wiki! Below you will find information about the indices of inter-observer reliability that are included in mReliability. They are organized by type and ordered alphabetically.

Indexes for Categorical Measurements

Bennett et al.'s S index

The S index is a chance-adjusted index that adopts a category-based approach to estimating chance agreement. It can be calculated using the FAST_S and FULL_S functions.

Cohen's Kappa coefficient

The Kappa coefficient is a chance-adjusted index that adopts an individual distribution-based approach to estimating chance agreement. It can be calculated using the FAST_KAPPA and FULL_KAPPA functions.

Gwet's AC coefficient

The AC coefficient is a chance-adjusted index that adopts an average distribution-based approach to estimating chance agreement with dichotomous data and a hybrid category/distribution-based approach to estimating chance agreement with polychotomous data. It can be calculated using the FAST_AC and FULL_AC functions.

Krippendorff's Alpha coefficient

The Alpha coefficient is a chance-adjusted index that adopts an average distribution-based approach to estimating chance agreement and adjusts for sample size. It can be calculated using the FAST_ALPHAK and FULL_ALPHAK functions.

Scott's Pi coefficient

The Pi coefficient is a chance-adjusted index that adopts an average distribution-based approach to estimating chance agreement. It can be calculated using the FAST_PI and FULL_PI functions.

Indexes for Dimensional Measurements

McGraw & Wong's Intraclass Correlation Coefficient

The Intraclass correlation coefficient (ICC) is a measure of... Its various formulations can be calculated using the ICC_A_1, ICC_A_k, ICC_C_1, and ICC_C_k functions.