What is Inter-rater Reliability?

Inter-rater reliability is a measure of dependability that assesses how well various judges or raters agree on assessment choices. Inter-rater reliability is important because human observers do not always perceive responses in the same way; raters may differ on how effectively specific replies or material exhibit knowledge of the construct or skill being assessed.