Since the early days of performance assessment, human ratings have been subject to various forms of error and bias. Expert raters often come up with different ratings for the very same performance and it seems that assessment outcomes largely depend upon which raters happen to assign the rating. This book provides an introduction to many-facet Rasch measurement (MFRM), a psychometric approach that establishes a coherent framework for drawing reliable, valid, and fair inferences from rater-mediated assessments, thus answering the problem of fallible human ratings. Revised and updated throughout, the Second Edition includes a stronger focus on the Facets computer program, emphasizing the pivotal role that MFRM plays for validating the interpretations and uses of assessment outcomes.
Contents: Conceptual-psychometric framework for rater-mediated assessments - Principles of many-facet Rasch measurement - Measurement of rater severity/leniency - Correcting examinee proficiency measures for rater severity differences - Examining rater consistency and rating scale effectiveness - Increasing validity and fairness of performance assessments.