Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for Krippendorff's alpha reliability coefficient #13

Open
ludwigschubert opened this issue Mar 16, 2013 · 2 comments
Open

Comments

@ludwigschubert
Copy link

(First of all, thanks so much for this package!
While it took me some time to get used to it, it's super handy even for simple statistics in business applications.)

I might lack the knowledge to combine the pieces of this framework, but I'm missing explicit support for measuring reliability between raters, e.g. Krippendorff's alpha.

R provides a nice interface for this here.

Thanks again for your efforts and time in supporting this project!

@clbustos
Copy link
Owner

Can you provide me a reference? A journal or book reference will be cool :)

@ludwigschubert
Copy link
Author

Yes.

The Original paper by Prof. Krippendorf is available here.
Together with a colleague he also provided a (to me unreadable) implementation in SAS here.

Instead, I'd recommend working of Matlab code and the wikipedia article on the subject.
I'm currently using R's package "irr"'s implementation, which can be found here - I extracted the specific file for you in this GIST.

Let me know if there's anything else I can help with - unfortunately I had about one introductory class in statistics, so the finer points of Krippendorf's alpha are entirely lost on me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants