ENS 305 Lecture Notes - Lecture 7: Inter-Rater Reliability, Repeated Measures Design, Standard Deviation
14 May 2020
School
Department
Course
Professor
Document Summary
Discuss the concepts of inter-rater and inter-rater reliability. Understand the relationship between reliability and validity. Evaluate typical evidence of reliability in human performance. Reliability relates to the consistency or repeatability of an observation. The degree to which repeated measures of the same trait are reproduced under the same conditions. Also described as consistency, dependability, stability, and precision. Validity is the degree of truthfulness of a test score. Dependent on two characteristics: reliability and relevance. Relevance is the degree to which a test pertains to its objectives. Objectivity is a special kind of reliability also known as interrater reliability. Objective tests (multiple-choice) differ from subjective tests (essay) in that they are less biased or not as easily influenced regardless of the rater. Pearson product-moment (ppm) correlation coefficient (chapter 4) is used to provide evidence of a test"s reliability. Observed, error, and true scores are theoretical concepts that will help you understand the concept of reliability.
