Home

Welcome to the mReliability wiki! Below you will find information about the indices of inter-observer reliability that are included in mReliability. They are organized by type.

Indexes of Reliability for Categorical Measurements

Bennett et al.'s (1954) S index

The S index is a chance-adjusted index that adopts a category-based approach to estimating chance agreement. It can be calculated using the FAST_S and FULL_S functions.

Scott's (1955) Pi coefficient

The Pi coefficient is a chance-adjusted index that adopts a distribution-based approach to estimating chance agreement. It can be calculated using the FAST_PI and FULL_PI functions.

Cohen's (1960) Kappa coefficient

This index can be calculated using the FAST_KAPPA and FULL_KAPPA functions. More information about its assumptions, usage, and equivalent forms can be found at the Kappa coefficient page.

Krippendorff's Alpha

This index can be calculated using FAST_ALPHAK or FULL_ALPHAK.