Mediaspace scheduled maintenance: Aug 25, 2026 07:00 - 12:00 AM. During this time, videos will be temporarily unavailable. Check status updates.

Lecture

Assessment of Learning: Validity and Reliability

Description

This lecture covers the foundations of assessment in higher education, focusing on validity and reliability. It explains the concepts of validity and reliability in assessment, using examples from physics education and student evaluation standards. The importance of contextualizing theoretical models in everyday life for validity and ensuring consistency in scores for reliability is discussed. Strategies for improving test reliability are presented, emphasizing the need for clear questions, consistent grading, and similar test conditions. The lecture concludes by highlighting the significance of testing what students are expected to learn, communicating key concepts, and ensuring clarity and consistency in assessments.

In MOOC

Teaching Science and Engineering

Official source

Quiz

Ontological neighbourhood

Psychology

Basic psychology: Psychometrics

Related concepts (24)

Validity (statistics)

Validity is the main extent to which a concept, conclusion or measurement is well-founded and likely corresponds accurately to the real world. The word "valid" is derived from the Latin validus, meaning strong. The validity of a measurement tool (for example, a test in education) is the degree to which the tool measures what it claims to measure. Validity is based on the strength of a collection of different types of evidence (e.g. face validity, construct validity, etc.) described in greater detail below.

Criterion validity

In psychometrics, criterion validity, or criterion-related validity, is the extent to which an operationalization of a construct, such as a test, relates to, or predicts, a theoretical representation of the construct—the criterion. Criterion validity is often divided into concurrent and predictive validity based on the timing of measurement for the "predictor" and outcome. Concurrent validity refers to a comparison between the measure in question and an outcome assessed at the same time.

External validity

External validity is the validity of applying the conclusions of a scientific study outside the context of that study. In other words, it is the extent to which the results of a study can be generalized to and across other situations, people, stimuli, and times. In contrast, internal validity is the validity of conclusions drawn within the context of a particular study. Because general conclusions are almost always a goal in research, external validity is an important property of any study.

Educational assessment

Educational assessment or educational evaluation is the systematic process of documenting and using empirical data on the knowledge, skill, attitudes, aptitude and beliefs to refine programs and improve student learning. Assessment data can be obtained from directly examining student work to assess the achievement of learning outcomes or can be based on data from which one can make inferences about learning. Assessment is often used interchangeably with test, but not limited to tests.

Formative assessment

Formative assessment, formative evaluation, formative feedback, or assessment for learning, including diagnostic testing, is a range of formal and informal assessment procedures conducted by teachers during the learning process in order to modify teaching and learning activities to improve student attainment. The goal of a formative assessment is to monitor student learning to provide ongoing feedback that can help students identify their strengths and weaknesses and target areas that need work.

Related lectures (28)

Student Evaluation of Teaching: Effective Strategies

Discusses the importance of student evaluations in improving teaching effectiveness and understanding student perspectives.

Designing Experiments and Measuring Learning

Explores experimental design challenges in social sciences, emphasizing hypothesis formulation, variable control, and bias mitigation.

Evaluation in NLP

Delves into NLP evaluation, covering gold standards, precision, recall, and statistical significance.

Effective Teaching Evaluations: Dimensions and Formulation Tips

Discusses the multidimensional nature of teaching evaluations and offers tips for formulating effective questions.

Assessment Process Design