Percent agreement among multiple raters (2, 3, +) when the input data represent the raw ratings reported for each subject and each rater.
Useful links